-- Logs begin at Sat 2022-08-06 20:01:12 UTC, end at Sat 2022-08-06 22:19:46 UTC. -- Aug 06 20:37:10.406289 ncdv-master-1 systemd[1]: Starting Devstack devstack@keystone.service... Aug 06 20:37:10.413999 ncdv-master-1 devstack@keystone.service[102746]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 06 20:37:10.422587 ncdv-master-1 devstack@keystone.service[102746]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Aug 6 20:37:10 2022] *** Aug 06 20:37:10.422587 ncdv-master-1 devstack@keystone.service[102746]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 06 20:37:10.422587 ncdv-master-1 devstack@keystone.service[102746]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 06 20:37:10.422587 ncdv-master-1 devstack@keystone.service[102746]: nodename: ncdv-master-1 Aug 06 20:37:10.422587 ncdv-master-1 devstack@keystone.service[102746]: machine: x86_64 Aug 06 20:37:10.422587 ncdv-master-1 devstack@keystone.service[102746]: clock source: unix Aug 06 20:37:10.422587 ncdv-master-1 devstack@keystone.service[102746]: pcre jit disabled Aug 06 20:37:10.422587 ncdv-master-1 devstack@keystone.service[102746]: detected number of CPU cores: 4 Aug 06 20:37:10.422587 ncdv-master-1 devstack@keystone.service[102746]: current working directory: / Aug 06 20:37:10.422587 ncdv-master-1 devstack@keystone.service[102746]: detected binary path: /usr/bin/uwsgi-core Aug 06 20:37:10.422587 ncdv-master-1 devstack@keystone.service[102746]: your processes number limit is 47680 Aug 06 20:37:10.422587 ncdv-master-1 devstack@keystone.service[102746]: your memory page size is 4096 bytes Aug 06 20:37:10.422587 ncdv-master-1 devstack@keystone.service[102746]: detected max file descriptor number: 2048 Aug 06 20:37:10.422587 ncdv-master-1 devstack@keystone.service[102746]: lock engine: pthread robust mutexes Aug 06 20:37:10.422587 ncdv-master-1 devstack@keystone.service[102746]: thunder lock: enabled Aug 06 20:37:10.422587 ncdv-master-1 devstack@keystone.service[102746]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 06 20:37:10.422587 ncdv-master-1 devstack@keystone.service[102746]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 06 20:37:10.462760 ncdv-master-1 devstack@keystone.service[102746]: Python main interpreter initialized at 0x55646dad59c0 Aug 06 20:37:10.462760 ncdv-master-1 devstack@keystone.service[102746]: python threads support enabled Aug 06 20:37:10.462760 ncdv-master-1 devstack@keystone.service[102746]: your server socket listen backlog is limited to 100 connections Aug 06 20:37:10.462760 ncdv-master-1 devstack@keystone.service[102746]: your mercy for graceful operations on workers is 90 seconds Aug 06 20:37:10.463115 ncdv-master-1 devstack@keystone.service[102746]: mapped 403077 bytes (393 KB) for 2 cores Aug 06 20:37:10.463183 ncdv-master-1 devstack@keystone.service[102746]: *** Operational MODE: preforking *** Aug 06 20:37:10.463436 ncdv-master-1 devstack@keystone.service[102746]: *** uWSGI is running in multiple interpreter mode *** Aug 06 20:37:10.463436 ncdv-master-1 devstack@keystone.service[102746]: spawned uWSGI master process (pid: 102746) Aug 06 20:37:10.463643 ncdv-master-1 systemd[1]: Started Devstack devstack@keystone.service. Aug 06 20:37:10.464204 ncdv-master-1 devstack@keystone.service[102746]: spawned uWSGI worker 1 (pid: 102758, cores: 1) Aug 06 20:37:10.464559 ncdv-master-1 devstack@keystone.service[102746]: spawned uWSGI worker 2 (pid: 102759, cores: 1) Aug 06 20:37:10.465654 ncdv-master-1 devstack@keystone.service[102746]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 06 20:37:16.207207 ncdv-master-1 devstack@keystone.service[102758]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 20:37:16.207207 ncdv-master-1 devstack@keystone.service[102758]: from cryptography.utils import int_from_bytes Aug 06 20:37:16.208006 ncdv-master-1 devstack@keystone.service[102758]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 20:37:16.208006 ncdv-master-1 devstack@keystone.service[102758]: from cryptography.utils import int_from_bytes Aug 06 20:37:16.208117 ncdv-master-1 devstack@keystone.service[102759]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 20:37:16.208117 ncdv-master-1 devstack@keystone.service[102759]: from cryptography.utils import int_from_bytes Aug 06 20:37:16.208117 ncdv-master-1 devstack@keystone.service[102759]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 20:37:16.208117 ncdv-master-1 devstack@keystone.service[102759]: from cryptography.utils import int_from_bytes Aug 06 20:37:16.257464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 06 20:37:16.257634 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 06 20:37:16.257722 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 06 20:37:16.257808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 06 20:37:16.257886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] command line args: [] {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 06 20:37:16.257989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] command line args: [] {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 06 20:37:16.258077 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 06 20:37:16.258259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ================================================================================ {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 06 20:37:16.258343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 06 20:37:16.258444 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ================================================================================ {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 06 20:37:16.258521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] admin_token = **** {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.258734 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] admin_token = **** {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.258820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] config_dir = [] {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.258961 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.259043 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] config_dir = [] {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.259145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] config_source = [] {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.259228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.259326 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] debug = True {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.259415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] config_source = [] {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.259506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] debug = True {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.259586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.260750 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.260852 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.260916 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.260977 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] insecure_debug = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.261038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] insecure_debug = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.261098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.261164 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.261226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.261287 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.261342 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] list_limit = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.261397 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] list_limit = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.261452 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] log_config_append = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.261513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] log_config_append = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.261575 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.261636 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.261696 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] log_dir = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.261753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] log_dir = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.261812 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] log_file = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.261876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] log_file = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.261933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.261993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.262048 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.262103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.262157 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.262217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.262515 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.262664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.262772 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.262879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.262982 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.263082 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.263188 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.263282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.263372 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.263469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.263615 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.263728 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.263821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.263917 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.264021 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.264131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.264261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.264336 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.264449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.264533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.264604 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] notification_format = cadf {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.264716 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] notification_format = cadf {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.264820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.264905 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.265308 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.265375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.265492 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] publish_errors = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.265564 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] publish_errors = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.265725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.265790 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.266585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.266707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.266808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.266951 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.267055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.267236 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.267395 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.267554 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] standard_threads = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.267711 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.267841 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] strict_password_check = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.268092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] standard_threads = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.268206 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.268316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] strict_password_check = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.268426 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] use_eventlog = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.268539 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.268649 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] use_journal = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.268767 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] use_eventlog = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.268886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] use_json = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.269003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] use_journal = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.269114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] use_stderr = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.269208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] use_json = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.269306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] use_syslog = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.269410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] use_stderr = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.269504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] watch_log_file = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.269595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] use_syslog = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.269691 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.269784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] watch_log_file = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:37:16.269887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.269992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.270086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.270205 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.270317 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.270411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.270509 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.270652 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.270756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.270850 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.270940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.271037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.271130 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.271229 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.271329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.271433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.271542 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.271658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.271770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.271888 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.272006 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.272117 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.272226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.272345 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.272456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.272575 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.272696 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.272814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.272926 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.273035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.273145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.273326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.273441 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.273558 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.273702 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.273822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.273940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.274060 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.274172 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.274282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.274392 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.274503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.274503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.274851 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.274851 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.275067 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.275177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.275271 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.275370 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.275464 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.275556 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.275646 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.275736 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.275832 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.275933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.276026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.276117 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.276214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.276326 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.276436 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.276554 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.276666 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.276775 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.276884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.276989 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.277099 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.277216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.277319 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.277427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.277542 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.277679 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.277795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.277913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.278026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.278136 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.278252 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.278363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.278473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.278693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.278811 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.278922 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.279022 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.279131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.279241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.279360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.279472 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.279472 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.279690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.279807 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.279919 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.280038 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.280150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.280150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.280364 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.280555 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.280671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.280792 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.280904 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.281015 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.281132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.281243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.281353 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.281471 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.281588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.281700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.281811 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.281946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.282093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.282223 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.282427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.282694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.282934 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.283061 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.283186 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.283298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.283409 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.283526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.283639 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.283787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.283913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.284033 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.284154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.284275 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.284400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.284514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.284625 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.284737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.284856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.284978 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.285098 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.285217 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.285330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.285441 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.285560 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.285673 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.285785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.285896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.286008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.286119 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.286242 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.286356 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.286468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.286606 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.286720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.286831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.286954 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.287069 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.287180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] cache.enabled = True {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.287297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.287410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.287521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.287643 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.287756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] cache.enabled = True {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.287867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.287978 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.288091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.288208 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.288331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.288444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.288555 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.288667 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.288789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.288909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.289033 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.289153 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.289266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.289377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.289511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.289628 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.289793 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.289914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.290028 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.290139 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.290273 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.290389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.290621 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.290737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.290850 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.290962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.291074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.291185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.291301 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.291422 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.291544 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.291658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.291770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.291887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.292001 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.292120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.292234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.292347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.292465 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.292578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.292690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.292809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.292929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.293042 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.293160 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.293273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.293385 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.293505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.293619 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.293732 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.293874 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.293989 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.294100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] auth.external = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.294223 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.294337 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] auth.mapped = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.294449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.294603 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.294721 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] auth.external = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.294834 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.294975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] auth.mapped = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.295098 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] auth.password = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.295220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.295336 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] auth.token = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.295449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.295562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.295674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] auth.password = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.295786 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] catalog.caching = True {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.295906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] auth.token = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.296021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.296133 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.296246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.296358 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] catalog.caching = True {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.296472 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.296593 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.296715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.296829 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.296941 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.297053 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.297165 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] credential.caching = True {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.297285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.297399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] credential.driver = sql {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.297513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.297626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.297739 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.297850 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] credential.caching = True {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.297974 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.298089 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] credential.driver = sql {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.298201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.298313 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.298425 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.298537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.298704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.298823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.298936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.299047 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.299167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.299282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.299402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.299515 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.299666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.299782 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.299894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.300006 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.300150 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.300273 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.300387 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.300498 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.300617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.300731 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.300854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] federation.caching = True {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.300968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.301081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.301193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.301304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] federation.driver = sql {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.301416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.301536 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.301650 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] federation.caching = True {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.301764 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.301876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.301988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.302108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] federation.driver = sql {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.302222 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.302349 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.302463 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.302609 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.302724 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.302849 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.302964 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.303077 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.303189 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.303300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.303412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.303531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.303651 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] identity.caching = True {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.303772 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.303925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.304041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.304153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.304338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.304456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.304567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] identity.caching = True {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.304687 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.304807 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.304922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] identity.driver = sql {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.305045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.305159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.305270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.305383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.305494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.305606 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.305725 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] identity.driver = sql {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.305887 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.306004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.306117 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.306229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.306340 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.306461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.306617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.306732 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.306845 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.306958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.307069 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.307192 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.307307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.307419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.307531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.307643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.307755 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.307875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.307990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.308102 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.308213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.308325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.308437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.308556 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.308676 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.308788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.308973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.309088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.309209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.309323 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.309435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.309547 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.309658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.309770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.309896 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.310010 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.310124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.310236 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.310348 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.310460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.310609 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.310726 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.310839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.310952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.311064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.311206 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.311332 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.311447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.311559 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.311671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.311783 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.312145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.312267 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.312381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.312494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.password = **** {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.312606 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.312719 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.313372 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.313506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.313652 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.313768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.314076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.password = **** {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.314195 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.314309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.314432 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.314588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.314705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.314818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.314930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.315042 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.315167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.315282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.315396 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.315508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.315620 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.315733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.315853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.315974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.316088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.316200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.316312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.316426 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.316546 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.316660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.316772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.user = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.316884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.316995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.317107 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.317227 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.317341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.317455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.317567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.user = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.317679 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.317791 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.317912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.318026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.318138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.318250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.318363 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.318476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.318622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.318738 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.318851 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.318966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.319079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.319192 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.319312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.319427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.319541 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.319653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.319766 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.319877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.319997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.320111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.320224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.320336 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.320447 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.320560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.320680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.320795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.320907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.321020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.321132 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.321252 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.321366 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.321479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.321591 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.321704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.321816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.321935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.322049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.322161 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.322310 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.322431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.322573 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.322701 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.322817 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.322930 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.323042 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] policy.driver = sql {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.323154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.323266 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.323387 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.323501 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.323613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.323727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.323839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] policy.driver = sql {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.323951 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] receipt.caching = True {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.324113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.324231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.324344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.324457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.324570 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.324682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.324803 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] receipt.caching = True {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.324917 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.325029 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.325141 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.325252 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.325364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] resource.caching = True {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.325484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.325598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.325709 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.325823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] resource.driver = sql {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.325934 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.326046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.326165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] resource.caching = True {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.326279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.326391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.326503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.326639 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] resource.driver = sql {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.326753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] revoke.caching = True {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.326877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.326992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.327105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.327216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.327328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.327440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] role.cache_time = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.327621 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] revoke.caching = True {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.327738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] role.caching = True {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.327851 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.327963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] role.driver = sql {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.328074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.328186 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] role.list_limit = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.328306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] role.cache_time = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.329026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.329330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] role.caching = True {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.329449 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.329562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] role.driver = sql {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.329674 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.329796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] role.list_limit = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.329911 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.330025 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.330143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.330143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.330356 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.330485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.330650 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.330764 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.330876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.330988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.331111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.331235 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.331363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.331458 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.331569 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.331665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.331774 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.331870 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.331963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.331963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.332138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.332231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.332353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.332451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.332562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.332673 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.332785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.332785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.333067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.333177 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.333320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.333414 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.333526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.333623 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.333724 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.333820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.333914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.334026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.334191 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.334301 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.334422 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.334538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.334663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.334775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.334889 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.334984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.335092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.335205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.335302 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.335413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.335511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.335723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.335860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.335974 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] token.cache_time = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.336085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.336197 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] token.caching = True {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.336365 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.336507 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.336783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.336909 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] token.provider = fernet {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.336909 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.337087 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.337188 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.337320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.337445 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.337559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.337673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.337776 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] token.cache_time = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.337893 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.338046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.338255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] token.caching = True {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.338366 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] trust.driver = sql {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.338462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.338594 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.338710 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] token.provider = fernet {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.338837 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.338978 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.339091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.339186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.339280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.339440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.339560 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.339684 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.339787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.339931 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.340048 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.340255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.340379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.340541 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] database.connection = **** {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.340656 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] trust.driver = sql {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.340781 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.340901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.341070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.341199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.341303 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.341424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.341561 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.341662 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.341774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.341893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.341996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.342116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.342232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.342421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.342588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.342691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.342803 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.342913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.343011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] database.connection = **** {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.343154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.343317 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.343442 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.343639 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.343757 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.344151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.344319 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.344319 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.344550 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.344646 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.344742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.344847 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.345057 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.345185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.345299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=102758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 06 20:37:16.345413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.345599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.345859 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.346175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.346603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.346774 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.347024 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.347390 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.347581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.347841 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.348088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.348515 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:37:16.348721 ncdv-master-1 devstack@keystone.service[102759]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=102759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 06 20:37:16.378346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=102758) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.378651 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=102758) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.378787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=102758) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.384418 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=102759) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.384655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=102759) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.384944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=102759) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.387498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=102758) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.393859 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=102759) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.415992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=102758) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.416222 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=102758) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.420301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=102759) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.420538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=102759) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.469914 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=102758) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.470061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=102759) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.521147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=102758) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.521382 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=102758) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.522076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=102759) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.522317 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=102759) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.587647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=102759) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.587876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=102759) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.588106 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=102759) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.588333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=102759) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.588438 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=102758) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.588556 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=102759) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.588638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=102758) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.588777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=102759) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.588868 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=102758) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.589015 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=102758) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.589241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=102758) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.589460 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=102758) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.612780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=102758) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.613010 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=102759) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.613117 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=102758) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.613292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=102759) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.613376 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=102758) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.613521 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=102758) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.613602 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=102759) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.613745 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=102758) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.613868 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=102759) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.613948 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=102758) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.614020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=102759) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.614172 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=102759) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.614253 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=102758) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.614386 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=102759) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.625234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=102758) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.625860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=102759) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.638258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=102758) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.638493 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=102758) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.638753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=102759) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.638840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=102758) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.638990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=102758) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.639070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=102759) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.639214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=102758) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.639304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=102759) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.639434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=102758) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.639516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=102759) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.639653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=102759) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.639732 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=102758) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.639873 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=102759) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.640091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=102759) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:37:16.660150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.660362 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 06 20:37:16.660451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.660608 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 06 20:37:16.660709 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.660896 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 06 20:37:16.660976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.661144 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 06 20:37:16.661223 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.661425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.661514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.661685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.661764 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.661943 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.662020 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.662199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.671722 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.672009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.672114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.672321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.672421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.672599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.672733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.672890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.679703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=102758) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:37:16.679994 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=102759) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:37:16.682686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=102758) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:37:16.682978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.683058 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=102759) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:37:16.683266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.683357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.683552 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.683631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.683834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.683913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.684100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.684187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.684376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.684453 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.684651 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.684729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.684924 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.685004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.685198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.685275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.685468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.685554 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.685746 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.709680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.709786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.711212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=102758) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:37:16.711312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=102759) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:37:16.711507 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.711588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.716168 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=102758) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:37:16.716257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=102759) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:37:16.716456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.716548 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.716742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.716821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.723737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=102758) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:37:16.723939 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=102759) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:37:16.724036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.724311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.728079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=102758) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:37:16.728373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.728539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=102759) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:37:16.728662 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.728836 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.728951 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.729132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.729352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.729431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.729646 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.729809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.729932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.730094 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.730207 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.730372 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.730671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.746807 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.747090 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.747173 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.747450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.751232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=102758) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:37:16.751462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=102759) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:37:16.754406 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.754666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.754750 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.754968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.759145 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=102758) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:37:16.759376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=102759) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:37:16.762585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=102758) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:37:16.762670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=102759) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:37:16.765744 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.766344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.766580 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.766719 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.766852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.767013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.767261 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.767410 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.767552 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.767704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.767843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.768000 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.784066 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=102759) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:37:16.784191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=102758) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:37:16.784358 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.784464 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.784630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.784713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.784900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.784983 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.791831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.791926 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.793534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.793656 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.793822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.793902 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.796550 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=102759) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:37:16.796634 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=102758) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:37:16.796839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.796962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.797659 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.797907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.798009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.798264 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.798345 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.798419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.810890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=102759) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:37:16.810998 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=102758) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:37:16.811180 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.811271 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.811462 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.811550 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.811741 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.812109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.812276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.812358 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.812560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.812643 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.812914 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.813075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.929523 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=102759) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:37:16.929760 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=102758) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:37:16.932533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=102759) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:37:16.932630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=102758) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:37:16.935632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.935720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.937360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.937464 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.939540 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=102758) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:37:16.939670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=102759) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:37:16.939829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.939961 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.940128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.940259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.946722 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.946885 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.948229 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=102758) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:37:16.948396 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=102759) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:37:16.951191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.951370 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.951487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.951666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.951786 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.951966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.952071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.952251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.960346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=102758) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:37:16.960538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=102759) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:37:16.960637 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.960838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.960921 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.961164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.967844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=102758) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:37:16.968099 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=102759) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:37:16.968245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.968497 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.968579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.968786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.968868 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.969590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.969676 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.969963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.970076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.970248 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.970344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.970529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.970642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.970830 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.970923 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.971103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.971186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.971375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.971455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.971649 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.971730 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.971920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.972000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.972190 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=102758) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.972268 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:16.972466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=102759) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:37:17.006273 ncdv-master-1 devstack@keystone.service[102758]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55646dad59c0 pid: 102758 (default app) Aug 06 20:37:17.006570 ncdv-master-1 devstack@keystone.service[102759]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55646dad59c0 pid: 102759 (default app) Aug 06 20:37:17.009678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0903499-5265-421e-99c5-08c7e388aa76 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:17.009969 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0903499-5265-421e-99c5-08c7e388aa76 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:17.010245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0903499-5265-421e-99c5-08c7e388aa76 None None] PATH_INFO: `/v3` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:17.014391 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 791 bytes} [Sat Aug 6 20:37:17 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:25.147947 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2ab27-cee2-4221-a790-e161d4614f55 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:25.148503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2ab27-cee2-4221-a790-e161d4614f55 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:25.148503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2ab27-cee2-4221-a790-e161d4614f55 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:25.152734 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1/2] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:37:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:37:25.157930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c22d36-2a5a-458c-897b-96b7d919dab3 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:25.158353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c22d36-2a5a-458c-897b-96b7d919dab3 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:25.158475 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c22d36-2a5a-458c-897b-96b7d919dab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:25.236873 ncdv-master-1 devstack@keystone.service[102758]: INFO dbcounter [None req-04c22d36-2a5a-458c-897b-96b7d919dab3 None None] Registered counter for database keystone Aug 06 20:37:25.256206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG oslo_db.sqlalchemy.engines [None req-04c22d36-2a5a-458c-897b-96b7d919dab3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102758) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 20:37:25.262278 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writer thread running {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 20:37:25.438609 ncdv-master-1 devstack@keystone.service[102758]: DEBUG passlib.handlers.bcrypt [None req-04c22d36-2a5a-458c-897b-96b7d919dab3 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=102758) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 06 20:37:25.438960 ncdv-master-1 devstack@keystone.service[102758]: DEBUG passlib.handlers.bcrypt [None req-04c22d36-2a5a-458c-897b-96b7d919dab3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=102758) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 06 20:37:25.493454 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-04c22d36-2a5a-458c-897b-96b7d919dab3 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:25.495374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-04c22d36-2a5a-458c-897b-96b7d919dab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:25.624899 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2/3] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 06 20:37:25.773391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2ab27-cee2-4221-a790-e161d4614f55 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:25.851822 ncdv-master-1 devstack@keystone.service[102759]: INFO dbcounter [None req-70d2ab27-cee2-4221-a790-e161d4614f55 None None] Registered counter for database keystone Aug 06 20:37:25.872961 ncdv-master-1 devstack@keystone.service[102759]: DEBUG oslo_db.sqlalchemy.engines [None req-70d2ab27-cee2-4221-a790-e161d4614f55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102759) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 20:37:25.879949 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writer thread running {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 20:37:25.999342 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2ab27-cee2-4221-a790-e161d4614f55 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:26.004589 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccb95e-51f7-44eb-8ea5-2d03e4e5256c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:26.005264 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccb95e-51f7-44eb-8ea5-2d03e4e5256c admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:26.005551 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccb95e-51f7-44eb-8ea5-2d03e4e5256c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:26.005825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccb95e-51f7-44eb-8ea5-2d03e4e5256c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:26.016305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ccb95e-51f7-44eb-8ea5-2d03e4e5256c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:26.066689 ncdv-master-1 devstack@keystone.service[102759]: WARNING keystone.common.rbac_enforcer.enforcer [None req-18ccb95e-51f7-44eb-8ea5-2d03e4e5256c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 06 20:37:26.066973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ccb95e-51f7-44eb-8ea5-2d03e4e5256c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:26.076356 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2/4] 10.222.0.33 () {58 vars in 1324 bytes} [Sat Aug 6 20:37:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 06 20:37:26.083153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c22d36-2a5a-458c-897b-96b7d919dab3 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:26.098487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c22d36-2a5a-458c-897b-96b7d919dab3 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:26.103047 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb4ed2-d143-40e6-8f98-040e42cb0398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:26.104134 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb4ed2-d143-40e6-8f98-040e42cb0398 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:26.104418 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb4ed2-d143-40e6-8f98-040e42cb0398 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:26.104687 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb4ed2-d143-40e6-8f98-040e42cb0398 admin admin] PATH_INFO: `/v3/projects/39f3affb323c4555adb3a84fee8265cf` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:26.106131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb4ed2-d143-40e6-8f98-040e42cb0398 admin admin] RBAC: Authorizing `identity:get_project(project_id=39f3affb323c4555adb3a84fee8265cf)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:26.159622 ncdv-master-1 devstack@keystone.service[102758]: WARNING keystone.common.rbac_enforcer.enforcer [None req-72fb4ed2-d143-40e6-8f98-040e42cb0398 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 06 20:37:26.160156 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb4ed2-d143-40e6-8f98-040e42cb0398 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:26.164776 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3/5] 10.222.0.33 () {56 vars in 1207 bytes} [Sat Aug 6 20:37:26 2022] GET /identity/v3/projects/39f3affb323c4555adb3a84fee8265cf => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:28.395216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40287de-2a22-4698-8311-b4b5e5968f97 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:28.395761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40287de-2a22-4698-8311-b4b5e5968f97 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:28.395761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40287de-2a22-4698-8311-b4b5e5968f97 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:28.399897 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3/6] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:37:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:28.405349 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a81704-5b0d-4c4e-9e2c-432f829eb1aa None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:28.406345 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a81704-5b0d-4c4e-9e2c-432f829eb1aa None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:28.406851 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a81704-5b0d-4c4e-9e2c-432f829eb1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:28.427003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-c8a81704-5b0d-4c4e-9e2c-432f829eb1aa None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:28.428534 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c8a81704-5b0d-4c4e-9e2c-432f829eb1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:28.437067 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4/7] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 06 20:37:28.460702 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40287de-2a22-4698-8311-b4b5e5968f97 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:28.473448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40287de-2a22-4698-8311-b4b5e5968f97 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:28.477682 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c8c5a-2b42-4a97-a122-7f48c064ac41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:28.478271 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c8c5a-2b42-4a97-a122-7f48c064ac41 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:28.478575 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c8c5a-2b42-4a97-a122-7f48c064ac41 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:28.478846 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c8c5a-2b42-4a97-a122-7f48c064ac41 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:28.486494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c8c5a-2b42-4a97-a122-7f48c064ac41 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:28.488282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c8c5a-2b42-4a97-a122-7f48c064ac41 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:28.496906 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4/8] 10.222.0.33 () {58 vars in 1324 bytes} [Sat Aug 6 20:37:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 06 20:37:28.502424 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a81704-5b0d-4c4e-9e2c-432f829eb1aa None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:28.511629 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a81704-5b0d-4c4e-9e2c-432f829eb1aa None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:28.516752 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27a58b-9649-411f-9791-af16fc1f1d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:28.517404 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27a58b-9649-411f-9791-af16fc1f1d1e admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:28.517689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27a58b-9649-411f-9791-af16fc1f1d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:28.517968 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27a58b-9649-411f-9791-af16fc1f1d1e admin admin] PATH_INFO: `/v3/users/051007d94d8d4d818b5d4705a31e110b` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:28.519370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27a58b-9649-411f-9791-af16fc1f1d1e admin admin] RBAC: Authorizing `identity:get_user(user_id=051007d94d8d4d818b5d4705a31e110b)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:28.521215 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27a58b-9649-411f-9791-af16fc1f1d1e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:28.522766 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 5/9] 10.222.0.33 () {56 vars in 1198 bytes} [Sat Aug 6 20:37:28 2022] GET /identity/v3/users/051007d94d8d4d818b5d4705a31e110b => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:30.910602 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb831f-7dfc-414c-911f-20e21b868e6d None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:30.911122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb831f-7dfc-414c-911f-20e21b868e6d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:30.911205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb831f-7dfc-414c-911f-20e21b868e6d None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:30.912656 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 5/10] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:37:30.918108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01161c1-03cc-4b8e-8deb-114f9843cf6d None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:30.918573 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01161c1-03cc-4b8e-8deb-114f9843cf6d None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:30.918676 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01161c1-03cc-4b8e-8deb-114f9843cf6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:30.939222 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-e01161c1-03cc-4b8e-8deb-114f9843cf6d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:30.940322 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e01161c1-03cc-4b8e-8deb-114f9843cf6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:30.957685 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12e534-3621-4ae9-8108-6924f1732283 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:30.957966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12e534-3621-4ae9-8108-6924f1732283 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:30.958235 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12e534-3621-4ae9-8108-6924f1732283 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:30.959577 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 6/11] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:37:30.964732 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a535f-2935-42ea-825c-2d562016b703 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:30.965010 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a535f-2935-42ea-825c-2d562016b703 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:30.965282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a535f-2935-42ea-825c-2d562016b703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:31.010713 ncdv-master-1 devstack@keystone.service[102759]: DEBUG passlib.handlers.bcrypt [None req-b47a535f-2935-42ea-825c-2d562016b703 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=102759) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 06 20:37:31.011145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG passlib.handlers.bcrypt [None req-b47a535f-2935-42ea-825c-2d562016b703 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=102759) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 06 20:37:31.022386 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 6/12] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:37:31.047073 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01161c1-03cc-4b8e-8deb-114f9843cf6d None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:31.057356 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b47a535f-2935-42ea-825c-2d562016b703 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:31.059013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b47a535f-2935-42ea-825c-2d562016b703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:31.070602 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:31.151470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01161c1-03cc-4b8e-8deb-114f9843cf6d None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:31.160230 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 7/13] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:37:31.183450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a535f-2935-42ea-825c-2d562016b703 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:31.187511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621ed26-c886-408e-b07b-18b067f4cafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:31.188363 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621ed26-c886-408e-b07b-18b067f4cafe None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:31.188638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621ed26-c886-408e-b07b-18b067f4cafe None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:31.188911 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621ed26-c886-408e-b07b-18b067f4cafe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:31.200261 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621ed26-c886-408e-b07b-18b067f4cafe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:37:31.209372 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-1621ed26-c886-408e-b07b-18b067f4cafe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:37:31.209372 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:31.209372 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:37:31.209372 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:37:31.209372 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:37:31.209372 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:37:31.209372 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:37:31.209372 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:37:31.209372 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:37:31.209372 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:37:31.209372 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:37:31.209372 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:37:31.209372 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:37:31.209372 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:37:31.209372 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:37:31.209372 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:37:31.210329 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:37:31.210329 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:37:31.210329 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:37:31.210329 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:37:31.210329 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:37:31.210329 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:37:31.210329 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:37:31.210329 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:37:31.210329 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:37:31.210329 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:37:31.210329 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:37:31.210329 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:37:31.210329 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:37:31.210329 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:37:31.210329 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:37:31.210329 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:37:31.211193 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:37:31.211193 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:37:31.211193 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:37:31.211193 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:37:31.211193 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:37:31.211193 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:37:31.211193 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:37:31.211193 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:37:31.211193 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:37:31.211193 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:37:31.211193 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:37:31.211193 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:37:31.211193 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 7/14] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Aug 6 20:37:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:37:31.216422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621ed26-c886-408e-b07b-18b067f4cafe None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:31.291440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a535f-2935-42ea-825c-2d562016b703 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:31.293700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:31.299588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:31.320247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621ed26-c886-408e-b07b-18b067f4cafe None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:31.330108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca01b6b-c418-4cd8-8b01-47786fcc42ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:31.330999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca01b6b-c418-4cd8-8b01-47786fcc42ef None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:31.331283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca01b6b-c418-4cd8-8b01-47786fcc42ef None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:31.331557 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca01b6b-c418-4cd8-8b01-47786fcc42ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:31.356658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef41f27-2068-427a-8697-97fa2007f866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:31.357266 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef41f27-2068-427a-8697-97fa2007f866 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:31.357550 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef41f27-2068-427a-8697-97fa2007f866 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:31.357826 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef41f27-2068-427a-8697-97fa2007f866 None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:31.358496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef41f27-2068-427a-8697-97fa2007f866 None admin] RBAC: Adding query filter params (name=admin) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:31.358833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef41f27-2068-427a-8697-97fa2007f866 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:31.360233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef41f27-2068-427a-8697-97fa2007f866 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:31.371364 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 8/15] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:37:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:37:31.377410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef41f27-2068-427a-8697-97fa2007f866 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:31.399928 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca01b6b-c418-4cd8-8b01-47786fcc42ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:31.401489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca01b6b-c418-4cd8-8b01-47786fcc42ef None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:31.475679 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef41f27-2068-427a-8697-97fa2007f866 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:31.502536 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 8/16] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:37:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 06 20:37:31.507891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca01b6b-c418-4cd8-8b01-47786fcc42ef None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:31.509411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d147eb-66a4-4a9d-9fd1-275b5556c2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:31.510047 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d147eb-66a4-4a9d-9fd1-275b5556c2f0 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:31.510328 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d147eb-66a4-4a9d-9fd1-275b5556c2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:31.510635 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d147eb-66a4-4a9d-9fd1-275b5556c2f0 None admin] PATH_INFO: `/v3/users/051007d94d8d4d818b5d4705a31e110b` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:31.510773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:31.511985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d147eb-66a4-4a9d-9fd1-275b5556c2f0 None admin] RBAC: Authorizing `identity:get_user(user_id=051007d94d8d4d818b5d4705a31e110b)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:31.513411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d147eb-66a4-4a9d-9fd1-275b5556c2f0 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:31.515551 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 9/17] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:37:31 2022] GET /identity/v3/users/051007d94d8d4d818b5d4705a31e110b => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:37:31.521358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d147eb-66a4-4a9d-9fd1-275b5556c2f0 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:31.537034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:31.616122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca01b6b-c418-4cd8-8b01-47786fcc42ef None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:31.624241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d147eb-66a4-4a9d-9fd1-275b5556c2f0 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:31.650059 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172c761-96c9-48f6-8466-9f8e91b12bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:31.650949 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172c761-96c9-48f6-8466-9f8e91b12bed None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:31.651230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172c761-96c9-48f6-8466-9f8e91b12bed None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:31.651505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172c761-96c9-48f6-8466-9f8e91b12bed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:31.658852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5dbdf2-511f-4658-affc-71ca0549a1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:31.659477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5dbdf2-511f-4658-affc-71ca0549a1d6 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:31.659756 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5dbdf2-511f-4658-affc-71ca0549a1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:31.660029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5dbdf2-511f-4658-affc-71ca0549a1d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:31.661153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5dbdf2-511f-4658-affc-71ca0549a1d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:31.662641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5dbdf2-511f-4658-affc-71ca0549a1d6 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:31.664393 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 10/18] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:37:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:37:31.670057 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5dbdf2-511f-4658-affc-71ca0549a1d6 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:31.676697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172c761-96c9-48f6-8466-9f8e91b12bed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:31.678192 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172c761-96c9-48f6-8466-9f8e91b12bed None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:31.697443 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-9172c761-96c9-48f6-8466-9f8e91b12bed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:37:31.697443 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:31.697443 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:37:31.697443 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:37:31.697443 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:37:31.697443 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:37:31.697443 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:37:31.697443 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:37:31.697443 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:37:31.697443 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:37:31.697443 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:37:31.697443 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:37:31.697443 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:37:31.697443 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:37:31.697443 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:37:31.697443 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:37:31.698435 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:37:31.698435 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:37:31.698435 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:37:31.698435 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:37:31.698435 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:37:31.698435 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:37:31.698435 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:37:31.698435 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:37:31.698435 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:37:31.698435 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:37:31.698435 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:37:31.698435 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:37:31.698435 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:37:31.698435 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:37:31.698435 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:37:31.698435 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:37:31.698435 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:37:31.699766 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:37:31.699766 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:37:31.699766 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:37:31.699766 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 9/19] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:37:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:37:31.704319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172c761-96c9-48f6-8466-9f8e91b12bed None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:31.752796 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:31.759861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:31.773664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5dbdf2-511f-4658-affc-71ca0549a1d6 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:31.803374 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172c761-96c9-48f6-8466-9f8e91b12bed None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:31.807637 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb7fc4-eab0-40d6-ab26-6157ce2fc4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:31.808260 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb7fc4-eab0-40d6-ab26-6157ce2fc4f3 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:31.808541 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb7fc4-eab0-40d6-ab26-6157ce2fc4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:31.808816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb7fc4-eab0-40d6-ab26-6157ce2fc4f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:31.809537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb7fc4-eab0-40d6-ab26-6157ce2fc4f3 None admin] RBAC: Adding query filter params (role.id=ab245eea8a714462a00c4546309de9c9, scope.domain.id=default, user.id=051007d94d8d4d818b5d4705a31e110b) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:31.809849 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb7fc4-eab0-40d6-ab26-6157ce2fc4f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:31.811641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb7fc4-eab0-40d6-ab26-6157ce2fc4f3 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:31.822892 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 11/20] 10.222.0.33 () {56 vars in 1322 bytes} [Sat Aug 6 20:37:31 2022] GET /identity/v3/role_assignments?user.id=051007d94d8d4d818b5d4705a31e110b&scope.domain.id=default&role.id=ab245eea8a714462a00c4546309de9c9 => generated 233 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:31.838395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7fd7a2-c41f-4030-bb97-ac23652d8a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:31.839055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7fd7a2-c41f-4030-bb97-ac23652d8a70 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:31.839331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7fd7a2-c41f-4030-bb97-ac23652d8a70 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:31.839599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7fd7a2-c41f-4030-bb97-ac23652d8a70 None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:31.840263 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7fd7a2-c41f-4030-bb97-ac23652d8a70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:31.840565 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7fd7a2-c41f-4030-bb97-ac23652d8a70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:31.841987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7fd7a2-c41f-4030-bb97-ac23652d8a70 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:31.862719 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 10/21] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:37:34.252182 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05349df3-5ef1-45ba-b35b-1ca5ea4ca1ed None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:34.253239 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05349df3-5ef1-45ba-b35b-1ca5ea4ca1ed None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:34.253737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05349df3-5ef1-45ba-b35b-1ca5ea4ca1ed None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:34.255314 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 12/22] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:37:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:34.266198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c52138-5eae-450c-8788-7af89cee81a9 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:34.266687 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c52138-5eae-450c-8788-7af89cee81a9 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:34.266773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c52138-5eae-450c-8788-7af89cee81a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:34.296053 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-12c52138-5eae-450c-8788-7af89cee81a9 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:34.297382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-12c52138-5eae-450c-8788-7af89cee81a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:34.390429 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 11/23] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:37:34.426658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05349df3-5ef1-45ba-b35b-1ca5ea4ca1ed None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:34.561582 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05349df3-5ef1-45ba-b35b-1ca5ea4ca1ed None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:34.609423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d7e79-55e5-48fe-9497-7f42957b0034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:34.610516 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d7e79-55e5-48fe-9497-7f42957b0034 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:34.611028 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d7e79-55e5-48fe-9497-7f42957b0034 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:34.611500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d7e79-55e5-48fe-9497-7f42957b0034 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:34.628474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d7e79-55e5-48fe-9497-7f42957b0034 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:37:34.634310 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-287d7e79-55e5-48fe-9497-7f42957b0034 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:37:34.634310 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:34.634310 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:37:34.634310 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:37:34.634310 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:37:34.634310 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:37:34.634310 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:37:34.634310 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:37:34.634310 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:37:34.634310 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:37:34.634310 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:37:34.634310 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:37:34.634310 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:37:34.634310 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:37:34.634310 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:37:34.634310 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:37:34.635283 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:37:34.635283 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:37:34.635283 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:37:34.635283 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:37:34.635283 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:37:34.635283 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:37:34.635283 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:37:34.635283 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:37:34.635283 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:37:34.635283 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:37:34.635283 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:37:34.635283 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:37:34.635283 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:37:34.635283 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:37:34.635283 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:37:34.635283 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:37:34.636045 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:37:34.636045 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:37:34.636045 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:37:34.636045 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:37:34.636045 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:37:34.636045 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:37:34.636045 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:37:34.636045 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:37:34.636045 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:37:34.636045 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:37:34.636045 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:37:34.636045 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:37:34.638398 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 13/24] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Aug 6 20:37:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:37:34.645164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c52138-5eae-450c-8788-7af89cee81a9 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:34.722947 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:34.774697 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450fe75-f193-4f16-a418-ed5151b6bea6 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:34.775320 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450fe75-f193-4f16-a418-ed5151b6bea6 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:34.775814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450fe75-f193-4f16-a418-ed5151b6bea6 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:34.777636 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 14/25] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:37:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:34.785563 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75e959-a97a-4ca6-940c-42878805d03b None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:34.786123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75e959-a97a-4ca6-940c-42878805d03b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:34.786661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75e959-a97a-4ca6-940c-42878805d03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:34.794579 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c52138-5eae-450c-8788-7af89cee81a9 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:34.803633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:34.820170 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-ca75e959-a97a-4ca6-940c-42878805d03b None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:34.821287 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ca75e959-a97a-4ca6-940c-42878805d03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:34.847234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27198c-5074-4b37-8b5c-ee5c4cf3b46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:34.847854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27198c-5074-4b37-8b5c-ee5c4cf3b46c None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:34.848129 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27198c-5074-4b37-8b5c-ee5c4cf3b46c None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:34.848401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27198c-5074-4b37-8b5c-ee5c4cf3b46c None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:34.849077 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e27198c-5074-4b37-8b5c-ee5c4cf3b46c None admin] RBAC: Adding query filter params (name=admin) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:34.849383 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e27198c-5074-4b37-8b5c-ee5c4cf3b46c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:34.850796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e27198c-5074-4b37-8b5c-ee5c4cf3b46c None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:34.885105 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 12/26] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:37:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:37:34.907937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27198c-5074-4b37-8b5c-ee5c4cf3b46c None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:34.994540 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 15/27] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:37:35.047190 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca75e959-a97a-4ca6-940c-42878805d03b None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:35.119672 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27198c-5074-4b37-8b5c-ee5c4cf3b46c None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:35.138925 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:35.222854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca75e959-a97a-4ca6-940c-42878805d03b None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:35.223831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938dfc3-e24f-4f5a-b1b8-f7531b171d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:35.224796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938dfc3-e24f-4f5a-b1b8-f7531b171d0f None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:35.225365 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938dfc3-e24f-4f5a-b1b8-f7531b171d0f None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:35.225860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938dfc3-e24f-4f5a-b1b8-f7531b171d0f None admin] PATH_INFO: `/v3/users/051007d94d8d4d818b5d4705a31e110b` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:35.231138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0938dfc3-e24f-4f5a-b1b8-f7531b171d0f None admin] RBAC: Authorizing `identity:get_user(user_id=051007d94d8d4d818b5d4705a31e110b)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:35.232960 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0938dfc3-e24f-4f5a-b1b8-f7531b171d0f None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:35.235463 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 13/28] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:37:34 2022] GET /identity/v3/users/051007d94d8d4d818b5d4705a31e110b => generated 247 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:35.236981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa40cff-f99d-40e6-9c64-585cc202e4d9 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:35.237582 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa40cff-f99d-40e6-9c64-585cc202e4d9 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:35.238070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa40cff-f99d-40e6-9c64-585cc202e4d9 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:35.245185 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 14/29] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:37:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:35.245185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa40cff-f99d-40e6-9c64-585cc202e4d9 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:35.282767 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e679a6-01bd-4568-8346-6465a60fc336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:35.283418 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e679a6-01bd-4568-8346-6465a60fc336 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:35.283683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e679a6-01bd-4568-8346-6465a60fc336 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:35.283954 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e679a6-01bd-4568-8346-6465a60fc336 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:35.291829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:35.307778 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e679a6-01bd-4568-8346-6465a60fc336 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:35.309282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e679a6-01bd-4568-8346-6465a60fc336 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:35.342416 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-33e679a6-01bd-4568-8346-6465a60fc336 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:37:35.342416 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:35.342416 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:37:35.342416 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:37:35.342416 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:37:35.342416 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:37:35.342416 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:37:35.342416 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:37:35.342416 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:37:35.342416 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:37:35.342416 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:37:35.342416 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:37:35.342416 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:37:35.342416 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:37:35.342416 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:37:35.342416 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:37:35.343931 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:37:35.343931 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:37:35.343931 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:37:35.343931 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:37:35.343931 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:37:35.343931 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:37:35.343931 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:37:35.343931 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:37:35.343931 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:37:35.343931 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:37:35.343931 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:37:35.343931 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:37:35.343931 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:37:35.343931 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:37:35.343931 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:37:35.343931 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:37:35.343931 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:37:35.344826 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:37:35.344826 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:37:35.344826 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:37:35.350978 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 16/30] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:37:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:37:35.352294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da7364-9ae8-4d60-b126-ae73c4efdfa3 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:35.352577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da7364-9ae8-4d60-b126-ae73c4efdfa3 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:35.352853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da7364-9ae8-4d60-b126-ae73c4efdfa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:35.388090 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-67da7364-9ae8-4d60-b126-ae73c4efdfa3 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:35.389204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-67da7364-9ae8-4d60-b126-ae73c4efdfa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:35.412296 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa40cff-f99d-40e6-9c64-585cc202e4d9 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:35.481397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c6606-0afc-4fd6-a0ca-4920c4ebc141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:35.482040 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c6606-0afc-4fd6-a0ca-4920c4ebc141 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:35.482321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c6606-0afc-4fd6-a0ca-4920c4ebc141 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:35.482625 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c6606-0afc-4fd6-a0ca-4920c4ebc141 None admin] PATH_INFO: `/v3/domains/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:35.484276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c6606-0afc-4fd6-a0ca-4920c4ebc141 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:35.485747 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c6606-0afc-4fd6-a0ca-4920c4ebc141 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:35.487358 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 15/31] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:37:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:35.494367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c6606-0afc-4fd6-a0ca-4920c4ebc141 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:35.552654 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 17/32] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:37:35.555003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da7364-9ae8-4d60-b126-ae73c4efdfa3 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:35.594183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:35.672029 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c6606-0afc-4fd6-a0ca-4920c4ebc141 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:35.713259 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da7364-9ae8-4d60-b126-ae73c4efdfa3 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:35.714360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf8cb5-793a-42a0-b7ea-9c958f1e2cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:35.715326 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf8cb5-793a-42a0-b7ea-9c958f1e2cb1 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:35.715870 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf8cb5-793a-42a0-b7ea-9c958f1e2cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:35.716341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf8cb5-793a-42a0-b7ea-9c958f1e2cb1 None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:35.717188 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbf8cb5-793a-42a0-b7ea-9c958f1e2cb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:35.718214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbf8cb5-793a-42a0-b7ea-9c958f1e2cb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:35.719864 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbf8cb5-793a-42a0-b7ea-9c958f1e2cb1 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:35.733204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:35.733819 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 16/33] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:35.735777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea15557-c951-48fc-81ba-52bef2d57c8c None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:35.736295 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea15557-c951-48fc-81ba-52bef2d57c8c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:35.737373 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea15557-c951-48fc-81ba-52bef2d57c8c None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:35.738986 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 17/34] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:37:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:35.740565 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea15557-c951-48fc-81ba-52bef2d57c8c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:35.760754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2c4b4-5394-4889-b3c9-132fa0ab7147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:35.761709 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2c4b4-5394-4889-b3c9-132fa0ab7147 None admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:35.761991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2c4b4-5394-4889-b3c9-132fa0ab7147 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:35.762273 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2c4b4-5394-4889-b3c9-132fa0ab7147 None admin] PATH_INFO: `/v3/domains/default/users/051007d94d8d4d818b5d4705a31e110b/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:35.764816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa2c4b4-5394-4889-b3c9-132fa0ab7147 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=051007d94d8d4d818b5d4705a31e110b, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:35.766291 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa2c4b4-5394-4889-b3c9-132fa0ab7147 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:35.851868 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea15557-c951-48fc-81ba-52bef2d57c8c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:35.854140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:35.886769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb04a1-ac5f-4c89-bcba-82099342d67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:35.887383 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb04a1-ac5f-4c89-bcba-82099342d67a None admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:35.887662 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb04a1-ac5f-4c89-bcba-82099342d67a None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:35.887939 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb04a1-ac5f-4c89-bcba-82099342d67a None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:35.888625 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb04a1-ac5f-4c89-bcba-82099342d67a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:35.890034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb04a1-ac5f-4c89-bcba-82099342d67a None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:35.916541 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 18/35] 10.222.0.33 () {58 vars in 1361 bytes} [Sat Aug 6 20:37:35 2022] PUT /identity/v3/domains/default/users/051007d94d8d4d818b5d4705a31e110b/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:35.918488 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfc366-9296-43dd-bd34-f768bef18622 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:35.918815 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfc366-9296-43dd-bd34-f768bef18622 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:35.919097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfc366-9296-43dd-bd34-f768bef18622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:35.947998 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-1fbfc366-9296-43dd-bd34-f768bef18622 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:35.949566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1fbfc366-9296-43dd-bd34-f768bef18622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:36.033495 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 18/36] 10.222.0.33 () {60 vars in 1131 bytes} [Sat Aug 6 20:37:35 2022] POST /identity/v3/roles => generated 219 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:36.034446 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb04a1-ac5f-4c89-bcba-82099342d67a None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:36.041866 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 19/37] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:37:36.043608 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49350af5-61d8-44f3-94b6-2c55df08128b None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:36.044158 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49350af5-61d8-44f3-94b6-2c55df08128b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:36.044685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49350af5-61d8-44f3-94b6-2c55df08128b None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:36.050318 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 20/38] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:37:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:36.056500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc8427-5827-40f5-9b56-f7acdb46b8b8 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:36.057157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc8427-5827-40f5-9b56-f7acdb46b8b8 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:36.057658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc8427-5827-40f5-9b56-f7acdb46b8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:36.079734 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-adbc8427-5827-40f5-9b56-f7acdb46b8b8 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:36.081473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-adbc8427-5827-40f5-9b56-f7acdb46b8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:36.169094 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 21/39] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:37:36.169874 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc8427-5827-40f5-9b56-f7acdb46b8b8 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:36.212694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:36.238296 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb04a1-ac5f-4c89-bcba-82099342d67a None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:36.278215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c491d10-123e-49ec-889d-46f07f3d21f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:36.278877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c491d10-123e-49ec-889d-46f07f3d21f9 None admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:36.279166 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c491d10-123e-49ec-889d-46f07f3d21f9 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:36.279441 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c491d10-123e-49ec-889d-46f07f3d21f9 None admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:36.280115 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c491d10-123e-49ec-889d-46f07f3d21f9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:36.282206 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c491d10-123e-49ec-889d-46f07f3d21f9 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:36.297210 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc8427-5827-40f5-9b56-f7acdb46b8b8 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:36.319386 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 19/40] 10.222.0.33 () {60 vars in 1141 bytes} [Sat Aug 6 20:37:36 2022] POST /identity/v3/projects => generated 301 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:36.320800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a82a96-361f-43c6-a70a-c8e5cfa92e72 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:36.321146 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a82a96-361f-43c6-a70a-c8e5cfa92e72 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:36.321361 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a82a96-361f-43c6-a70a-c8e5cfa92e72 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:36.322849 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 20/41] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:36.323560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a82a96-361f-43c6-a70a-c8e5cfa92e72 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:36.349062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a56f902-6756-4449-b3ca-d78cb50beadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:36.349925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56f902-6756-4449-b3ca-d78cb50beadc None admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:36.350388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56f902-6756-4449-b3ca-d78cb50beadc None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:36.350917 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56f902-6756-4449-b3ca-d78cb50beadc None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:36.351742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a56f902-6756-4449-b3ca-d78cb50beadc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:36.353517 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a56f902-6756-4449-b3ca-d78cb50beadc None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:36.355137 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:36.378832 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 22/42] 10.222.0.33 () {60 vars in 1131 bytes} [Sat Aug 6 20:37:36 2022] POST /identity/v3/roles => generated 225 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:36.380533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57594e61-7357-4dbd-a112-877c88757697 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:36.381215 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57594e61-7357-4dbd-a112-877c88757697 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:36.381726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57594e61-7357-4dbd-a112-877c88757697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:36.414455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-57594e61-7357-4dbd-a112-877c88757697 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:36.416271 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-57594e61-7357-4dbd-a112-877c88757697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:36.505161 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a82a96-361f-43c6-a70a-c8e5cfa92e72 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:36.571387 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c14a2-f670-4e9b-964d-44b21a7af791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:36.572031 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c14a2-f670-4e9b-964d-44b21a7af791 None admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:36.572315 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c14a2-f670-4e9b-964d-44b21a7af791 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:36.572595 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c14a2-f670-4e9b-964d-44b21a7af791 None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:36.573282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c14a2-f670-4e9b-964d-44b21a7af791 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:36.574769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c14a2-f670-4e9b-964d-44b21a7af791 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:36.589238 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 23/43] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:37:36.593598 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 21/44] 10.222.0.33 () {60 vars in 1131 bytes} [Sat Aug 6 20:37:36 2022] POST /identity/v3/roles => generated 223 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:36.614855 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57594e61-7357-4dbd-a112-877c88757697 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:36.654079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:36.748207 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57594e61-7357-4dbd-a112-877c88757697 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:36.787049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322767a-f467-4730-8701-c0b8f6d3ee33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:36.787623 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322767a-f467-4730-8701-c0b8f6d3ee33 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:36.787906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322767a-f467-4730-8701-c0b8f6d3ee33 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:36.788180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322767a-f467-4730-8701-c0b8f6d3ee33 None admin] PATH_INFO: `/v3/domains/default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:36.789383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0322767a-f467-4730-8701-c0b8f6d3ee33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:36.790892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0322767a-f467-4730-8701-c0b8f6d3ee33 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:36.792692 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 24/45] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:37:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:36.799050 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c14a2-f670-4e9b-964d-44b21a7af791 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:36.886566 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:36.911394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c14a2-f670-4e9b-964d-44b21a7af791 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:36.945093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d5f2c-2a0e-4af4-a520-b340e962d03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:36.945695 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d5f2c-2a0e-4af4-a520-b340e962d03d None admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:36.945981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d5f2c-2a0e-4af4-a520-b340e962d03d None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:36.946258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d5f2c-2a0e-4af4-a520-b340e962d03d None admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:36.946941 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d5f2c-2a0e-4af4-a520-b340e962d03d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:36.948395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d5f2c-2a0e-4af4-a520-b340e962d03d None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:36.975387 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 22/46] 10.222.0.33 () {60 vars in 1141 bytes} [Sat Aug 6 20:37:36 2022] POST /identity/v3/projects => generated 312 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:38.344892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa3194-0aaa-46e1-9228-a1d0ec036b86 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:38.345445 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa3194-0aaa-46e1-9228-a1d0ec036b86 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:38.345445 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa3194-0aaa-46e1-9228-a1d0ec036b86 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:38.346830 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 25/47] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:38.351979 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde9b7e-37e4-4016-8fe4-71afbe177924 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:38.352389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde9b7e-37e4-4016-8fe4-71afbe177924 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:38.352544 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde9b7e-37e4-4016-8fe4-71afbe177924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:38.371163 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-8cde9b7e-37e4-4016-8fe4-71afbe177924 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:38.372698 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8cde9b7e-37e4-4016-8fe4-71afbe177924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:38.441587 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 23/48] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:37:38.466210 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa3194-0aaa-46e1-9228-a1d0ec036b86 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:38.562387 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:38.569960 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa3194-0aaa-46e1-9228-a1d0ec036b86 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:38.605139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bea311-9d62-4067-8288-ab296a6f7552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:38.605695 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bea311-9d62-4067-8288-ab296a6f7552 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:38.605977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bea311-9d62-4067-8288-ab296a6f7552 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:38.606248 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bea311-9d62-4067-8288-ab296a6f7552 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:38.616821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bea311-9d62-4067-8288-ab296a6f7552 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:37:38.621599 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-b0bea311-9d62-4067-8288-ab296a6f7552 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:37:38.621599 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:38.621599 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:37:38.621599 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:37:38.621599 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:37:38.621599 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:37:38.621599 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:37:38.621599 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:37:38.621599 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:37:38.621599 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:37:38.621599 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:37:38.621599 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:37:38.621599 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:37:38.621599 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:37:38.621599 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:37:38.621599 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:37:38.622414 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:37:38.622414 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:37:38.622414 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:37:38.622414 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:37:38.622414 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:37:38.622414 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:37:38.622414 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:37:38.622414 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:37:38.622414 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:37:38.622414 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:37:38.622414 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:37:38.622414 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:37:38.622414 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:37:38.622414 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:37:38.622414 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:37:38.622414 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:37:38.623466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:37:38.623466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:37:38.623466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:37:38.623466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:37:38.623466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:37:38.623466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:37:38.623466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:37:38.623466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:37:38.623466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:37:38.623466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:37:38.623466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:37:38.623466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:37:38.623466 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 26/49] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Aug 6 20:37:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:37:38.629558 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde9b7e-37e4-4016-8fe4-71afbe177924 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:38.692391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:38.734946 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde9b7e-37e4-4016-8fe4-71afbe177924 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:38.768451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544cabe4-998d-4b5e-85cc-42840b8aaecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:38.769071 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cabe4-998d-4b5e-85cc-42840b8aaecb None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:38.769352 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cabe4-998d-4b5e-85cc-42840b8aaecb None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:38.769632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cabe4-998d-4b5e-85cc-42840b8aaecb None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:38.770315 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544cabe4-998d-4b5e-85cc-42840b8aaecb None admin] RBAC: Adding query filter params (name=admin) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:38.770657 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544cabe4-998d-4b5e-85cc-42840b8aaecb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:38.772089 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544cabe4-998d-4b5e-85cc-42840b8aaecb None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:38.780723 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 24/50] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:37:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:38.786323 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bea311-9d62-4067-8288-ab296a6f7552 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:38.886206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bea311-9d62-4067-8288-ab296a6f7552 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:38.920219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b1848-bfb7-46ee-89a2-d66e4dc76092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:38.920967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b1848-bfb7-46ee-89a2-d66e4dc76092 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:38.921250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b1848-bfb7-46ee-89a2-d66e4dc76092 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:38.921531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b1848-bfb7-46ee-89a2-d66e4dc76092 None admin] PATH_INFO: `/v3/users/051007d94d8d4d818b5d4705a31e110b` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:38.922699 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b1848-bfb7-46ee-89a2-d66e4dc76092 None admin] RBAC: Authorizing `identity:get_user(user_id=051007d94d8d4d818b5d4705a31e110b)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:38.924192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b1848-bfb7-46ee-89a2-d66e4dc76092 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:38.925771 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 27/51] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:37:38 2022] GET /identity/v3/users/051007d94d8d4d818b5d4705a31e110b => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:37:38.931228 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544cabe4-998d-4b5e-85cc-42840b8aaecb None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:39.035869 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544cabe4-998d-4b5e-85cc-42840b8aaecb None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:39.057851 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:39.075834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d46f5-da7e-4ae5-994e-aedf3f51b1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:39.076489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d46f5-da7e-4ae5-994e-aedf3f51b1f8 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:39.076800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d46f5-da7e-4ae5-994e-aedf3f51b1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:39.077079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d46f5-da7e-4ae5-994e-aedf3f51b1f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:39.078329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d46f5-da7e-4ae5-994e-aedf3f51b1f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:39.079875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d46f5-da7e-4ae5-994e-aedf3f51b1f8 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:39.081558 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 25/52] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:37:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:39.087633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b1848-bfb7-46ee-89a2-d66e4dc76092 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:39.112603 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:39.188798 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b1848-bfb7-46ee-89a2-d66e4dc76092 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:39.214255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d94b36-92f3-4975-885f-231aff6e42b1 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:39.214567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d94b36-92f3-4975-885f-231aff6e42b1 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:39.214850 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d94b36-92f3-4975-885f-231aff6e42b1 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:39.216197 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 26/53] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:39.221729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8b182-7a01-44af-9341-dfdbd04d805d None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:39.222014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8b182-7a01-44af-9341-dfdbd04d805d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:39.222285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8b182-7a01-44af-9341-dfdbd04d805d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:39.225042 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660e06c-d42e-4134-abb0-a2aaf318c4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:39.225725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660e06c-d42e-4134-abb0-a2aaf318c4e5 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:39.226012 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660e06c-d42e-4134-abb0-a2aaf318c4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:39.226285 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660e06c-d42e-4134-abb0-a2aaf318c4e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:39.227055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660e06c-d42e-4134-abb0-a2aaf318c4e5 None admin] RBAC: Adding query filter params (role.id=ab245eea8a714462a00c4546309de9c9, scope.domain.id=default, user.id=051007d94d8d4d818b5d4705a31e110b) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:39.227370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660e06c-d42e-4134-abb0-a2aaf318c4e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:39.229017 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660e06c-d42e-4134-abb0-a2aaf318c4e5 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:39.236384 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 28/54] 10.222.0.33 () {56 vars in 1322 bytes} [Sat Aug 6 20:37:39 2022] GET /identity/v3/role_assignments?user.id=051007d94d8d4d818b5d4705a31e110b&scope.domain.id=default&role.id=ab245eea8a714462a00c4546309de9c9 => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:39.240021 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d2e8b182-7a01-44af-9341-dfdbd04d805d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:39.241247 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d2e8b182-7a01-44af-9341-dfdbd04d805d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:39.314601 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 27/55] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:37:39.339838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660e06c-d42e-4134-abb0-a2aaf318c4e5 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:39.430133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:39.446861 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660e06c-d42e-4134-abb0-a2aaf318c4e5 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:39.480192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06869f8c-5758-45ef-ac14-9b5a8284b86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:39.480824 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06869f8c-5758-45ef-ac14-9b5a8284b86e None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:39.481103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06869f8c-5758-45ef-ac14-9b5a8284b86e None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:39.481375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06869f8c-5758-45ef-ac14-9b5a8284b86e None admin] PATH_INFO: `/v3/domains/default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:39.482490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06869f8c-5758-45ef-ac14-9b5a8284b86e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:39.484020 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06869f8c-5758-45ef-ac14-9b5a8284b86e None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:39.485578 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 29/56] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:37:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:39.491229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8b182-7a01-44af-9341-dfdbd04d805d None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:39.587097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8b182-7a01-44af-9341-dfdbd04d805d None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:39.603636 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:39.621821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8793073-d60f-4a7c-85e3-c6f88bb68c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:39.622423 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8793073-d60f-4a7c-85e3-c6f88bb68c03 None admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:39.622744 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8793073-d60f-4a7c-85e3-c6f88bb68c03 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:39.623046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8793073-d60f-4a7c-85e3-c6f88bb68c03 None admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:39.624302 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8793073-d60f-4a7c-85e3-c6f88bb68c03 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:39.625735 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8793073-d60f-4a7c-85e3-c6f88bb68c03 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:39.650836 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 28/57] 10.222.0.33 () {60 vars in 1140 bytes} [Sat Aug 6 20:37:39 2022] POST /identity/v3/projects => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:41.870214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436f96b-0181-4132-ace7-d4bb3b4fabb1 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:41.870753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436f96b-0181-4132-ace7-d4bb3b4fabb1 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:41.870835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436f96b-0181-4132-ace7-d4bb3b4fabb1 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:41.872147 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 30/58] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:41.877892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45398e2d-7d71-45ec-83f4-2756bd5be8e8 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:41.878327 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45398e2d-7d71-45ec-83f4-2756bd5be8e8 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:41.878440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45398e2d-7d71-45ec-83f4-2756bd5be8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:41.896816 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-45398e2d-7d71-45ec-83f4-2756bd5be8e8 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:41.897981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-45398e2d-7d71-45ec-83f4-2756bd5be8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:41.963314 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 29/59] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:37:41.989342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436f96b-0181-4132-ace7-d4bb3b4fabb1 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:42.089047 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436f96b-0181-4132-ace7-d4bb3b4fabb1 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:42.127016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdae10b-aa21-43d4-98a2-b1b98244d008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:42.127640 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdae10b-aa21-43d4-98a2-b1b98244d008 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:42.127920 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdae10b-aa21-43d4-98a2-b1b98244d008 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:42.128198 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdae10b-aa21-43d4-98a2-b1b98244d008 None admin] PATH_INFO: `/v3/domains/default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:42.129307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdae10b-aa21-43d4-98a2-b1b98244d008 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:42.130799 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdae10b-aa21-43d4-98a2-b1b98244d008 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:42.132347 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 31/60] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:37:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:42.139520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45398e2d-7d71-45ec-83f4-2756bd5be8e8 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:42.234489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:42.237419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45398e2d-7d71-45ec-83f4-2756bd5be8e8 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:42.270528 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1bb51c-81e1-44d4-8c64-6b2a89bc3ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:42.271154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bb51c-81e1-44d4-8c64-6b2a89bc3ee2 None admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:42.271433 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bb51c-81e1-44d4-8c64-6b2a89bc3ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:42.271731 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bb51c-81e1-44d4-8c64-6b2a89bc3ee2 None admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:42.272370 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1bb51c-81e1-44d4-8c64-6b2a89bc3ee2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:42.273807 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1bb51c-81e1-44d4-8c64-6b2a89bc3ee2 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:42.300883 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 30/61] 10.222.0.33 () {60 vars in 1132 bytes} [Sat Aug 6 20:37:42 2022] POST /identity/v3/users => generated 275 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:45.645400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004283f-89a6-447b-aa61-4c571be10c33 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:45.646251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004283f-89a6-447b-aa61-4c571be10c33 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:45.646701 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004283f-89a6-447b-aa61-4c571be10c33 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:45.648472 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 32/62] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:37:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:45.653414 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c131c2-6f73-40b9-b9f4-a6f6016e67c3 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:45.653842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c131c2-6f73-40b9-b9f4-a6f6016e67c3 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:45.653964 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c131c2-6f73-40b9-b9f4-a6f6016e67c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:45.683795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-c2c131c2-6f73-40b9-b9f4-a6f6016e67c3 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:45.685021 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c2c131c2-6f73-40b9-b9f4-a6f6016e67c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:45.736633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7dc252-9915-4c70-9c98-40ae842e44b4 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:45.736919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7dc252-9915-4c70-9c98-40ae842e44b4 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:45.737361 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7dc252-9915-4c70-9c98-40ae842e44b4 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:45.739292 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 33/63] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:45.746592 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a89ca0-b5ef-43fc-bf39-e32bad667a4b None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:45.746907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a89ca0-b5ef-43fc-bf39-e32bad667a4b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:45.747189 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a89ca0-b5ef-43fc-bf39-e32bad667a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:45.780922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-41a89ca0-b5ef-43fc-bf39-e32bad667a4b None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:45.782137 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-41a89ca0-b5ef-43fc-bf39-e32bad667a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:45.799850 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 31/64] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:37:45.803677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:45.851272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c131c2-6f73-40b9-b9f4-a6f6016e67c3 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:45.856684 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 34/65] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:37:45.882652 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a89ca0-b5ef-43fc-bf39-e32bad667a4b None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:46.038663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:46.053382 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a89ca0-b5ef-43fc-bf39-e32bad667a4b None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:46.070891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c131c2-6f73-40b9-b9f4-a6f6016e67c3 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:46.120324 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f3e57-0006-4557-9b51-ad5203353f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:46.121562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f3e57-0006-4557-9b51-ad5203353f81 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:46.124162 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f3e57-0006-4557-9b51-ad5203353f81 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:46.125380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f3e57-0006-4557-9b51-ad5203353f81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:46.142112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad537bf-573e-4e40-95d4-27105428c70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:46.143995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad537bf-573e-4e40-95d4-27105428c70c None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:46.146539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad537bf-573e-4e40-95d4-27105428c70c None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:46.147239 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad537bf-573e-4e40-95d4-27105428c70c None admin] PATH_INFO: `/v3/roles/member` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:46.147949 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f3e57-0006-4557-9b51-ad5203353f81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:37:46.158009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-9b5f3e57-0006-4557-9b51-ad5203353f81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:37:46.158009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:46.158009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:37:46.158009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:37:46.158009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:37:46.158009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:37:46.158009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:37:46.158009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:37:46.158009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:37:46.158009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:37:46.158009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:37:46.158009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:37:46.158009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:37:46.158009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:37:46.158009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:37:46.158009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:37:46.159187 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:37:46.159187 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:37:46.159187 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:37:46.159187 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:37:46.159187 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:37:46.159187 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:37:46.159187 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:37:46.159187 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:37:46.159187 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:37:46.159187 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:37:46.159187 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:37:46.159187 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:37:46.159187 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:37:46.159187 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:37:46.159187 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:37:46.159187 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:37:46.160130 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:37:46.160130 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:37:46.160130 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:37:46.160130 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:37:46.160130 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:37:46.160130 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:37:46.160130 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:37:46.160130 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:37:46.160130 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:37:46.160130 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:37:46.160130 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:37:46.160130 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:37:46.162031 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 35/66] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Aug 6 20:37:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:37:46.168196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f3e57-0006-4557-9b51-ad5203353f81 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:46.177032 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad537bf-573e-4e40-95d4-27105428c70c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:37:46.190429 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-4ad537bf-573e-4e40-95d4-27105428c70c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:37:46.190429 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:46.190429 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:37:46.190429 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:37:46.190429 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:37:46.190429 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:37:46.190429 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:37:46.190429 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:37:46.190429 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:37:46.190429 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:37:46.190429 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:37:46.190429 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:37:46.190429 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:37:46.190429 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:37:46.190429 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:37:46.190429 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:37:46.191552 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:37:46.191552 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:37:46.191552 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:37:46.191552 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:37:46.191552 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:37:46.191552 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:37:46.191552 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:37:46.191552 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:37:46.191552 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:37:46.191552 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:37:46.191552 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:37:46.191552 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:37:46.191552 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:37:46.191552 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:37:46.191552 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:37:46.191552 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:37:46.192444 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:37:46.192444 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:37:46.192444 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:37:46.192444 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:37:46.192444 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:37:46.192444 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:37:46.192444 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:37:46.192444 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:37:46.192444 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:37:46.192444 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:37:46.192444 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:37:46.192444 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:37:46.193142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:46.194665 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 32/67] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:37:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:37:46.196004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcafa7a-61ac-4595-a1c3-dedd444ce007 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:46.196422 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcafa7a-61ac-4595-a1c3-dedd444ce007 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:46.196828 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcafa7a-61ac-4595-a1c3-dedd444ce007 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:46.198222 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 33/68] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:46.203563 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcafa7a-61ac-4595-a1c3-dedd444ce007 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:46.301190 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f3e57-0006-4557-9b51-ad5203353f81 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:46.322909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcafa7a-61ac-4595-a1c3-dedd444ce007 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:46.351001 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57a7c7-2812-4fb0-9711-4b81dd3c6412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:46.351944 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57a7c7-2812-4fb0-9711-4b81dd3c6412 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:46.352404 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57a7c7-2812-4fb0-9711-4b81dd3c6412 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:46.352856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57a7c7-2812-4fb0-9711-4b81dd3c6412 None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:46.353697 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57a7c7-2812-4fb0-9711-4b81dd3c6412 None admin] RBAC: Adding query filter params (name=admin) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:46.354205 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57a7c7-2812-4fb0-9711-4b81dd3c6412 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:46.355683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57a7c7-2812-4fb0-9711-4b81dd3c6412 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:46.363151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1839aa8-e709-4c88-8fa4-49cae14ab9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:46.363767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1839aa8-e709-4c88-8fa4-49cae14ab9e8 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:46.364051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1839aa8-e709-4c88-8fa4-49cae14ab9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:46.364326 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1839aa8-e709-4c88-8fa4-49cae14ab9e8 None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:46.364985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1839aa8-e709-4c88-8fa4-49cae14ab9e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:46.365291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1839aa8-e709-4c88-8fa4-49cae14ab9e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:46.370884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1839aa8-e709-4c88-8fa4-49cae14ab9e8 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:46.371032 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 36/69] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:37:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:37:46.371871 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3d496-bb61-4d46-b8d2-6dd059748aed None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:46.372205 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3d496-bb61-4d46-b8d2-6dd059748aed None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:46.372492 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3d496-bb61-4d46-b8d2-6dd059748aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:46.383796 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 34/70] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Aug 6 20:37:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:46.383796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a1175-af46-49e8-946b-5de64b51f615 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:46.383796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a1175-af46-49e8-946b-5de64b51f615 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:46.383796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a1175-af46-49e8-946b-5de64b51f615 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:46.384153 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 35/71] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:37:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:46.385134 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a1175-af46-49e8-946b-5de64b51f615 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:46.391127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a1a3d496-bb61-4d46-b8d2-6dd059748aed None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:46.392341 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a1a3d496-bb61-4d46-b8d2-6dd059748aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:46.397738 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:46.459443 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 37/72] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:37:46.460455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3d496-bb61-4d46-b8d2-6dd059748aed None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:46.467893 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:46.499641 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a1175-af46-49e8-946b-5de64b51f615 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:46.533299 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939275eb-2b70-4983-9df5-bd191af821ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:46.533933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939275eb-2b70-4983-9df5-bd191af821ce None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:46.534214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939275eb-2b70-4983-9df5-bd191af821ce None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:46.534492 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939275eb-2b70-4983-9df5-bd191af821ce None admin] PATH_INFO: `/v3/users/051007d94d8d4d818b5d4705a31e110b` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:46.535649 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939275eb-2b70-4983-9df5-bd191af821ce None admin] RBAC: Authorizing `identity:get_user(user_id=051007d94d8d4d818b5d4705a31e110b)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:46.537113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939275eb-2b70-4983-9df5-bd191af821ce None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:46.539087 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 36/73] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:37:46 2022] GET /identity/v3/users/051007d94d8d4d818b5d4705a31e110b => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:46.540342 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5975a-5a9a-4c33-affc-8188d7d078f9 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:46.540632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5975a-5a9a-4c33-affc-8188d7d078f9 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:46.540908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5975a-5a9a-4c33-affc-8188d7d078f9 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:46.542104 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 37/74] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:37:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:46.546663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ddbb4-2a2d-4adb-92ae-e2a552a3fe42 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:46.546663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ddbb4-2a2d-4adb-92ae-e2a552a3fe42 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:46.546663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ddbb4-2a2d-4adb-92ae-e2a552a3fe42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:46.562482 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-073ddbb4-2a2d-4adb-92ae-e2a552a3fe42 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:46.563633 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-073ddbb4-2a2d-4adb-92ae-e2a552a3fe42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:46.577277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3d496-bb61-4d46-b8d2-6dd059748aed None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:46.610075 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b67680-ce6a-4a8e-beba-e03a4eaf12e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:46.610747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b67680-ce6a-4a8e-beba-e03a4eaf12e5 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:46.611029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b67680-ce6a-4a8e-beba-e03a4eaf12e5 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:46.611307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b67680-ce6a-4a8e-beba-e03a4eaf12e5 None admin] PATH_INFO: `/v3/users/7c8e7c536115407885851d0e16fabe30` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:46.625047 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b67680-ce6a-4a8e-beba-e03a4eaf12e5 None admin] RBAC: Authorizing `identity:get_user(user_id=7c8e7c536115407885851d0e16fabe30)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:46.626492 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b67680-ce6a-4a8e-beba-e03a4eaf12e5 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:46.628131 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 38/75] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:37:46 2022] GET /identity/v3/users/7c8e7c536115407885851d0e16fabe30 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:46.628511 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 38/76] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:37:46.629338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ddbb4-2a2d-4adb-92ae-e2a552a3fe42 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:46.631666 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b67680-ce6a-4a8e-beba-e03a4eaf12e5 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:46.655230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:46.697933 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:46.729350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ddbb4-2a2d-4adb-92ae-e2a552a3fe42 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:46.735811 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b67680-ce6a-4a8e-beba-e03a4eaf12e5 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:46.763983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a665f-8985-4af5-b99f-9b82e660d684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:46.764765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a665f-8985-4af5-b99f-9b82e660d684 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:46.765082 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a665f-8985-4af5-b99f-9b82e660d684 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:46.765357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a665f-8985-4af5-b99f-9b82e660d684 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:46.769708 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b51d66-eaf3-4bd3-bd1c-c0651bc756f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:46.770339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b51d66-eaf3-4bd3-bd1c-c0651bc756f3 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:46.770656 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b51d66-eaf3-4bd3-bd1c-c0651bc756f3 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:46.770937 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b51d66-eaf3-4bd3-bd1c-c0651bc756f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:46.780926 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b51d66-eaf3-4bd3-bd1c-c0651bc756f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:37:46.785727 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-54b51d66-eaf3-4bd3-bd1c-c0651bc756f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:37:46.785727 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:46.785727 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:37:46.785727 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:37:46.785727 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:37:46.785727 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:37:46.785727 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:37:46.785727 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:37:46.785727 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:37:46.785727 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:37:46.785727 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:37:46.785727 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:37:46.785727 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:37:46.785727 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:37:46.785727 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:37:46.785727 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:37:46.786586 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:37:46.786586 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:37:46.786586 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:37:46.786586 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:37:46.786586 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:37:46.786586 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:37:46.786586 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:37:46.786586 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:37:46.786586 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:37:46.786586 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:37:46.786586 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:37:46.786586 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:37:46.786586 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:37:46.786586 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:37:46.786586 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:37:46.786586 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:37:46.787358 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:37:46.787358 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:37:46.787358 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:37:46.787358 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:37:46.787358 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:37:46.787358 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:37:46.787358 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:37:46.787358 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:37:46.787358 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:37:46.787358 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:37:46.787358 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:37:46.787358 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:37:46.787358 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 39/77] 10.222.0.33 () {56 vars in 1114 bytes} [Sat Aug 6 20:37:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:37:46.788131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae8781-59e8-425a-a91e-19b4bab2a5a2 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:46.788555 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae8781-59e8-425a-a91e-19b4bab2a5a2 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:46.788717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae8781-59e8-425a-a91e-19b4bab2a5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:46.807095 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-31ae8781-59e8-425a-a91e-19b4bab2a5a2 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:46.808294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-31ae8781-59e8-425a-a91e-19b4bab2a5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:46.834189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a665f-8985-4af5-b99f-9b82e660d684 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:46.835629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a665f-8985-4af5-b99f-9b82e660d684 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:46.843691 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:46.874366 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 40/78] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:37:46.875235 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae8781-59e8-425a-a91e-19b4bab2a5a2 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:46.938379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:46.939418 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 39/79] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:37:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:46.940277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a665f-8985-4af5-b99f-9b82e660d684 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:46.991011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae8781-59e8-425a-a91e-19b4bab2a5a2 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:47.024398 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db4003-ebe0-4924-aa3f-a014a856e2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:47.025004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db4003-ebe0-4924-aa3f-a014a856e2be None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:47.025288 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db4003-ebe0-4924-aa3f-a014a856e2be None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:47.025559 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db4003-ebe0-4924-aa3f-a014a856e2be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:47.037585 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a665f-8985-4af5-b99f-9b82e660d684 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:47.044721 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:47.071623 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369694f-172a-4319-ae3d-62021f116ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:47.072243 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369694f-172a-4319-ae3d-62021f116ed5 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:47.072520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369694f-172a-4319-ae3d-62021f116ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:47.072794 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369694f-172a-4319-ae3d-62021f116ed5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:47.073874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369694f-172a-4319-ae3d-62021f116ed5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:47.075342 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369694f-172a-4319-ae3d-62021f116ed5 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:47.077110 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 40/80] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:37:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:47.078132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369694f-172a-4319-ae3d-62021f116ed5 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:47.097408 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db4003-ebe0-4924-aa3f-a014a856e2be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:47.098852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db4003-ebe0-4924-aa3f-a014a856e2be None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:47.149147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:47.177177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369694f-172a-4319-ae3d-62021f116ed5 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:47.200473 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 41/81] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:37:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:47.202268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db4003-ebe0-4924-aa3f-a014a856e2be None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:47.215478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58d38f-89e7-4799-81ee-3dd760eea743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:47.216087 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58d38f-89e7-4799-81ee-3dd760eea743 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:47.216360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58d38f-89e7-4799-81ee-3dd760eea743 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:47.216633 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58d38f-89e7-4799-81ee-3dd760eea743 None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:47.217849 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58d38f-89e7-4799-81ee-3dd760eea743 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:47.218154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58d38f-89e7-4799-81ee-3dd760eea743 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:47.219560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58d38f-89e7-4799-81ee-3dd760eea743 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:47.227333 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 41/82] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:37:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:47.228109 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58d38f-89e7-4799-81ee-3dd760eea743 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:47.261608 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:47.303730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db4003-ebe0-4924-aa3f-a014a856e2be None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:47.326810 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58d38f-89e7-4799-81ee-3dd760eea743 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:47.336329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be20d53-f3b9-4e82-ae4f-61463e2eb4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:47.336946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be20d53-f3b9-4e82-ae4f-61463e2eb4b4 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:47.337222 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be20d53-f3b9-4e82-ae4f-61463e2eb4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:47.337493 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be20d53-f3b9-4e82-ae4f-61463e2eb4b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:47.348298 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be20d53-f3b9-4e82-ae4f-61463e2eb4b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:37:47.353066 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-9be20d53-f3b9-4e82-ae4f-61463e2eb4b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:37:47.353066 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:47.353066 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:37:47.353066 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:37:47.353066 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:37:47.353066 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:37:47.353066 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:37:47.353066 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:37:47.353066 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:37:47.353066 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:37:47.353066 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:37:47.353066 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:37:47.353066 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:37:47.353066 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:37:47.353066 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:37:47.353066 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:37:47.353992 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:37:47.353992 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:37:47.353992 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:37:47.353992 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:37:47.353992 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:37:47.353992 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:37:47.353992 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:37:47.353992 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:37:47.353992 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:37:47.353992 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:37:47.353992 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:37:47.353992 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:37:47.353992 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:37:47.353992 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:37:47.353992 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:37:47.353992 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:37:47.354829 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:37:47.354829 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:37:47.354829 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:37:47.354829 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:37:47.354829 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:37:47.354829 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:37:47.354829 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:37:47.354829 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:37:47.354829 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:37:47.354829 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:37:47.354829 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:37:47.354829 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:37:47.354829 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 42/83] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:37:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:37:47.355687 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be20d53-f3b9-4e82-ae4f-61463e2eb4b4 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:47.364696 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa79503-1fd8-4df9-b791-bce65a76f31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:47.365342 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa79503-1fd8-4df9-b791-bce65a76f31c None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:47.365629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa79503-1fd8-4df9-b791-bce65a76f31c None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:47.365905 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa79503-1fd8-4df9-b791-bce65a76f31c None admin] PATH_INFO: `/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:47.367068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa79503-1fd8-4df9-b791-bce65a76f31c None admin] RBAC: Authorizing `identity:get_project(project_id=e4eeeb6b2c9345388f01f51f75c671dc)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:47.368520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa79503-1fd8-4df9-b791-bce65a76f31c None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:47.369167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:47.375570 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 42/84] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:37:47 2022] GET /identity/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:47.375570 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa79503-1fd8-4df9-b791-bce65a76f31c None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:47.458037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be20d53-f3b9-4e82-ae4f-61463e2eb4b4 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:47.469770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa79503-1fd8-4df9-b791-bce65a76f31c None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:47.472053 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:47.492090 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b0b3a-0477-46a3-afc2-c75dd9909dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:47.492700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b0b3a-0477-46a3-afc2-c75dd9909dbf None admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:47.492980 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b0b3a-0477-46a3-afc2-c75dd9909dbf None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:47.493257 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b0b3a-0477-46a3-afc2-c75dd9909dbf None admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:47.493900 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b0b3a-0477-46a3-afc2-c75dd9909dbf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:47.495379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b0b3a-0477-46a3-afc2-c75dd9909dbf None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:47.502826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075be64-8269-4a95-964a-d49e2cd39d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:47.503455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075be64-8269-4a95-964a-d49e2cd39d9a None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:47.503771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075be64-8269-4a95-964a-d49e2cd39d9a None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:47.504043 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075be64-8269-4a95-964a-d49e2cd39d9a None admin] PATH_INFO: `/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:47.505142 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b075be64-8269-4a95-964a-d49e2cd39d9a None admin] RBAC: Authorizing `identity:get_project(project_id=e4eeeb6b2c9345388f01f51f75c671dc)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:47.506603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b075be64-8269-4a95-964a-d49e2cd39d9a None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:47.508227 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 43/85] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:37:47 2022] GET /identity/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:47.508991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075be64-8269-4a95-964a-d49e2cd39d9a None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:47.532285 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 43/86] 10.222.0.33 () {60 vars in 1132 bytes} [Sat Aug 6 20:37:47 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:47.532285 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b0b3a-0477-46a3-afc2-c75dd9909dbf None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:47.604492 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:47.639330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075be64-8269-4a95-964a-d49e2cd39d9a None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:47.645765 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b0b3a-0477-46a3-afc2-c75dd9909dbf None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:47.690010 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42ab36-2dbe-4a6e-91fa-087a462aaef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:47.691455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42ab36-2dbe-4a6e-91fa-087a462aaef4 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:47.691563 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9523a6e-c4ae-4980-bb3e-7e30b24c6c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:47.691976 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42ab36-2dbe-4a6e-91fa-087a462aaef4 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:47.691976 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42ab36-2dbe-4a6e-91fa-087a462aaef4 None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:47.692116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9523a6e-c4ae-4980-bb3e-7e30b24c6c6b None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:47.692116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9523a6e-c4ae-4980-bb3e-7e30b24c6c6b None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:47.692237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42ab36-2dbe-4a6e-91fa-087a462aaef4 None admin] RBAC: Adding query filter params (name=member) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:47.692299 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9523a6e-c4ae-4980-bb3e-7e30b24c6c6b None admin] PATH_INFO: `/v3/users/7c8e7c536115407885851d0e16fabe30` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:47.692427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42ab36-2dbe-4a6e-91fa-087a462aaef4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:47.693635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9523a6e-c4ae-4980-bb3e-7e30b24c6c6b None admin] RBAC: Authorizing `identity:get_user(user_id=7c8e7c536115407885851d0e16fabe30)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:47.694016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42ab36-2dbe-4a6e-91fa-087a462aaef4 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:47.695126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9523a6e-c4ae-4980-bb3e-7e30b24c6c6b None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:47.702134 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 44/87] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:37:47 2022] GET /identity/v3/users/7c8e7c536115407885851d0e16fabe30 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:47.702134 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9523a6e-c4ae-4980-bb3e-7e30b24c6c6b None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:47.710110 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 44/88] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Aug 6 20:37:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:47.710983 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42ab36-2dbe-4a6e-91fa-087a462aaef4 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:47.755221 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:47.832261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9523a6e-c4ae-4980-bb3e-7e30b24c6c6b None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:47.847824 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42ab36-2dbe-4a6e-91fa-087a462aaef4 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:47.876099 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549cf4eb-f053-4e0e-989a-7066b7e31bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:47.876628 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cf4eb-f053-4e0e-989a-7066b7e31bce None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:47.876914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cf4eb-f053-4e0e-989a-7066b7e31bce None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:47.877187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cf4eb-f053-4e0e-989a-7066b7e31bce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:47.877916 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549cf4eb-f053-4e0e-989a-7066b7e31bce None admin] RBAC: Adding query filter params (role.id=ab245eea8a714462a00c4546309de9c9, scope.project.id=e4eeeb6b2c9345388f01f51f75c671dc, user.id=051007d94d8d4d818b5d4705a31e110b) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:47.878224 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549cf4eb-f053-4e0e-989a-7066b7e31bce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:47.879730 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549cf4eb-f053-4e0e-989a-7066b7e31bce None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:47.888655 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 45/89] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:37:47 2022] GET /identity/v3/role_assignments?user.id=051007d94d8d4d818b5d4705a31e110b&scope.project.id=e4eeeb6b2c9345388f01f51f75c671dc&role.id=ab245eea8a714462a00c4546309de9c9 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:47.889513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549cf4eb-f053-4e0e-989a-7066b7e31bce None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:47.891059 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad47e50-3dd2-47c4-a149-84931364c8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:47.891686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad47e50-3dd2-47c4-a149-84931364c8f4 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:47.891962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad47e50-3dd2-47c4-a149-84931364c8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:47.892231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad47e50-3dd2-47c4-a149-84931364c8f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:47.892973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad47e50-3dd2-47c4-a149-84931364c8f4 None admin] RBAC: Adding query filter params (role.id=1a212772e06344478184ce7d44a58b40, scope.project.id=e4eeeb6b2c9345388f01f51f75c671dc, user.id=7c8e7c536115407885851d0e16fabe30) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:47.893282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad47e50-3dd2-47c4-a149-84931364c8f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:47.897317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad47e50-3dd2-47c4-a149-84931364c8f4 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:47.899707 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:47.917028 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 45/90] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:37:47 2022] GET /identity/v3/role_assignments?user.id=7c8e7c536115407885851d0e16fabe30&scope.project.id=e4eeeb6b2c9345388f01f51f75c671dc&role.id=1a212772e06344478184ce7d44a58b40 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:47.917733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad47e50-3dd2-47c4-a149-84931364c8f4 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:48.028832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549cf4eb-f053-4e0e-989a-7066b7e31bce None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:48.031687 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:48.072879 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0a570-c7fb-442f-92a4-2ab090b30781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:48.073521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0a570-c7fb-442f-92a4-2ab090b30781 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:48.073806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0a570-c7fb-442f-92a4-2ab090b30781 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:48.074087 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0a570-c7fb-442f-92a4-2ab090b30781 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:48.131314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad47e50-3dd2-47c4-a149-84931364c8f4 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:48.156059 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f0a570-c7fb-442f-92a4-2ab090b30781 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:48.157661 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f0a570-c7fb-442f-92a4-2ab090b30781 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:48.207376 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c6f66-5ecf-43c7-adf5-843589ebb5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:48.208123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c6f66-5ecf-43c7-adf5-843589ebb5d0 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:48.208409 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c6f66-5ecf-43c7-adf5-843589ebb5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:48.208681 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c6f66-5ecf-43c7-adf5-843589ebb5d0 None admin] PATH_INFO: `/v3/users/7c8e7c536115407885851d0e16fabe30` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:48.210084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c6f66-5ecf-43c7-adf5-843589ebb5d0 None admin] RBAC: Authorizing `identity:get_user(user_id=7c8e7c536115407885851d0e16fabe30)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:48.211600 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c6f66-5ecf-43c7-adf5-843589ebb5d0 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:48.213621 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 46/91] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:37:47 2022] GET /identity/v3/users/7c8e7c536115407885851d0e16fabe30 => generated 275 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:48.220343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c6f66-5ecf-43c7-adf5-843589ebb5d0 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:48.312853 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 46/92] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:37:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:48.318759 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0a570-c7fb-442f-92a4-2ab090b30781 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:48.321943 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:48.325291 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:48.409269 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c6f66-5ecf-43c7-adf5-843589ebb5d0 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:48.437273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0a570-c7fb-442f-92a4-2ab090b30781 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:48.476375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6e22d-419f-45ff-9588-349936ed4152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:48.477460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6e22d-419f-45ff-9588-349936ed4152 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:48.477912 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6e22d-419f-45ff-9588-349936ed4152 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:48.478505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6e22d-419f-45ff-9588-349936ed4152 None admin] PATH_INFO: `/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:48.480174 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed6e22d-419f-45ff-9588-349936ed4152 None admin] RBAC: Authorizing `identity:get_project(project_id=e4eeeb6b2c9345388f01f51f75c671dc)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:48.482022 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed6e22d-419f-45ff-9588-349936ed4152 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:48.484366 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 47/93] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:37:48 2022] GET /identity/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:48.489094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf262474-652a-44bb-9655-cedc3d65a427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:48.489925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf262474-652a-44bb-9655-cedc3d65a427 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:48.490391 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf262474-652a-44bb-9655-cedc3d65a427 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:48.491536 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6e22d-419f-45ff-9588-349936ed4152 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:48.492653 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf262474-652a-44bb-9655-cedc3d65a427 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:48.637343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf262474-652a-44bb-9655-cedc3d65a427 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:48.639576 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf262474-652a-44bb-9655-cedc3d65a427 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:48.644227 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:48.689613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6e22d-419f-45ff-9588-349936ed4152 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:48.714851 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:48.728186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3098e72-e72a-4578-a61b-b49e55589e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:48.728795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3098e72-e72a-4578-a61b-b49e55589e02 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:48.729318 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3098e72-e72a-4578-a61b-b49e55589e02 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:48.729738 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3098e72-e72a-4578-a61b-b49e55589e02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:48.730639 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3098e72-e72a-4578-a61b-b49e55589e02 None admin] RBAC: Adding query filter params (role.id=b9254dbd663046739a1ba48d8c0027ad, scope.project.id=e4eeeb6b2c9345388f01f51f75c671dc, user.id=7c8e7c536115407885851d0e16fabe30) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:48.731095 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3098e72-e72a-4578-a61b-b49e55589e02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:48.733412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3098e72-e72a-4578-a61b-b49e55589e02 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:48.740124 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 48/94] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:37:48 2022] GET /identity/v3/role_assignments?user.id=7c8e7c536115407885851d0e16fabe30&scope.project.id=e4eeeb6b2c9345388f01f51f75c671dc&role.id=b9254dbd663046739a1ba48d8c0027ad => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:37:48.760678 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 47/95] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:37:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:48.766824 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3098e72-e72a-4578-a61b-b49e55589e02 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:48.925420 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3098e72-e72a-4578-a61b-b49e55589e02 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:48.983086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66578b7d-055a-41b0-a64d-f79c857447d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:48.983779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66578b7d-055a-41b0-a64d-f79c857447d5 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:48.984062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66578b7d-055a-41b0-a64d-f79c857447d5 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:48.984341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66578b7d-055a-41b0-a64d-f79c857447d5 None admin] PATH_INFO: `/v3/projects/f904bbcd8b2a4d0b890ebe4d29599454` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:48.985482 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66578b7d-055a-41b0-a64d-f79c857447d5 None admin] RBAC: Authorizing `identity:get_project(project_id=f904bbcd8b2a4d0b890ebe4d29599454)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:48.987052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66578b7d-055a-41b0-a64d-f79c857447d5 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:48.993604 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 49/96] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:37:48 2022] GET /identity/v3/projects/f904bbcd8b2a4d0b890ebe4d29599454 => generated 312 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:48.996544 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf262474-652a-44bb-9655-cedc3d65a427 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:49.109850 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf262474-652a-44bb-9655-cedc3d65a427 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:49.146305 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20747ba-c14f-441f-a4b0-b1598bb3b6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:49.147292 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20747ba-c14f-441f-a4b0-b1598bb3b6cb None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:49.147788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20747ba-c14f-441f-a4b0-b1598bb3b6cb None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:49.148250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20747ba-c14f-441f-a4b0-b1598bb3b6cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:49.149178 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20747ba-c14f-441f-a4b0-b1598bb3b6cb None admin] RBAC: Adding query filter params (role.id=1a212772e06344478184ce7d44a58b40, scope.project.id=f904bbcd8b2a4d0b890ebe4d29599454, user.id=7c8e7c536115407885851d0e16fabe30) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:49.149676 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20747ba-c14f-441f-a4b0-b1598bb3b6cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:49.151351 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20747ba-c14f-441f-a4b0-b1598bb3b6cb None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:49.158435 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 48/97] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:37:48 2022] GET /identity/v3/role_assignments?user.id=7c8e7c536115407885851d0e16fabe30&scope.project.id=f904bbcd8b2a4d0b890ebe4d29599454&role.id=1a212772e06344478184ce7d44a58b40 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:50.633786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b55a3-c518-4f41-8489-02d51a377458 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:50.634845 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b55a3-c518-4f41-8489-02d51a377458 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:50.635336 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b55a3-c518-4f41-8489-02d51a377458 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:50.637219 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 50/98] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:37:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:50.643793 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64aec30-6302-425f-b3ee-2df2c3914fe8 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:50.644628 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64aec30-6302-425f-b3ee-2df2c3914fe8 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:50.645123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64aec30-6302-425f-b3ee-2df2c3914fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:50.675981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-e64aec30-6302-425f-b3ee-2df2c3914fe8 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:50.677441 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e64aec30-6302-425f-b3ee-2df2c3914fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:50.699889 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:50.754648 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 49/99] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:37:50.773650 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b55a3-c518-4f41-8489-02d51a377458 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:50.778196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:50.921733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b55a3-c518-4f41-8489-02d51a377458 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:50.969668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ce4e0-1ced-4aa4-b539-a3a79086bee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:50.970339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ce4e0-1ced-4aa4-b539-a3a79086bee7 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:50.970645 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ce4e0-1ced-4aa4-b539-a3a79086bee7 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:50.970920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ce4e0-1ced-4aa4-b539-a3a79086bee7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:50.975258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ce4e0-1ced-4aa4-b539-a3a79086bee7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:50.976716 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ce4e0-1ced-4aa4-b539-a3a79086bee7 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:50.978513 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 51/100] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:37:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:50.984834 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64aec30-6302-425f-b3ee-2df2c3914fe8 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:51.164657 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64aec30-6302-425f-b3ee-2df2c3914fe8 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:51.205091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662f91d-ff7a-472f-ad48-a4d5daa09176 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:51.205387 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662f91d-ff7a-472f-ad48-a4d5daa09176 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:51.205570 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662f91d-ff7a-472f-ad48-a4d5daa09176 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:51.206952 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 52/101] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:37:51.215964 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddd01d-a20a-416e-a4da-71528e864f9a None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:51.216238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddd01d-a20a-416e-a4da-71528e864f9a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:51.216629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddd01d-a20a-416e-a4da-71528e864f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:51.217062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac71a30-b442-4226-b7fb-37b07151e1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:51.217912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac71a30-b442-4226-b7fb-37b07151e1a6 None admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:51.218382 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac71a30-b442-4226-b7fb-37b07151e1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:51.218905 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac71a30-b442-4226-b7fb-37b07151e1a6 None admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:51.219905 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac71a30-b442-4226-b7fb-37b07151e1a6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:51.221613 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac71a30-b442-4226-b7fb-37b07151e1a6 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:51.256694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-58ddd01d-a20a-416e-a4da-71528e864f9a None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:51.257940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-58ddd01d-a20a-416e-a4da-71528e864f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:51.268083 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 50/102] 10.222.0.33 () {60 vars in 1141 bytes} [Sat Aug 6 20:37:50 2022] POST /identity/v3/projects => generated 302 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:51.365569 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 53/103] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:37:51.391319 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac71a30-b442-4226-b7fb-37b07151e1a6 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:51.404181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:51.412861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d35f0-5338-4863-8846-30c8a2383916 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:51.413146 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d35f0-5338-4863-8846-30c8a2383916 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:51.413408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d35f0-5338-4863-8846-30c8a2383916 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:51.414790 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 54/104] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:37:51.421514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653ef7d-c423-4736-93db-bef0aee0548c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:51.421781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653ef7d-c423-4736-93db-bef0aee0548c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:51.422052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653ef7d-c423-4736-93db-bef0aee0548c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:51.429698 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:51.449832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-4653ef7d-c423-4736-93db-bef0aee0548c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:51.451255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4653ef7d-c423-4736-93db-bef0aee0548c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:51.589398 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 55/105] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:37:51.601419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac71a30-b442-4226-b7fb-37b07151e1a6 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:51.615981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1ae68-ebe8-43bb-90fd-b69ebf480f96 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:51.616299 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1ae68-ebe8-43bb-90fd-b69ebf480f96 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:51.616546 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1ae68-ebe8-43bb-90fd-b69ebf480f96 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:51.618027 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 56/106] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:37:51.620992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1ae68-ebe8-43bb-90fd-b69ebf480f96 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:51.651481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0a0ef-0330-4744-a888-e2d6d2a79628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:51.652148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0a0ef-0330-4744-a888-e2d6d2a79628 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:51.652402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0a0ef-0330-4744-a888-e2d6d2a79628 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:51.652677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0a0ef-0330-4744-a888-e2d6d2a79628 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:51.671273 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f0a0ef-0330-4744-a888-e2d6d2a79628 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:37:51.676614 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-79f0a0ef-0330-4744-a888-e2d6d2a79628 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:37:51.676614 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:51.676614 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:37:51.676614 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:37:51.676614 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:37:51.676614 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:37:51.676614 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:37:51.676614 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:37:51.676614 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:37:51.676614 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:37:51.676614 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:37:51.676614 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:37:51.676614 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:37:51.676614 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:37:51.676614 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:37:51.676614 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:37:51.677460 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:37:51.677460 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:37:51.677460 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:37:51.677460 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:37:51.677460 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:37:51.677460 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:37:51.677460 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:37:51.677460 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:37:51.677460 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:37:51.677460 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:37:51.677460 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:37:51.677460 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:37:51.677460 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:37:51.677460 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:37:51.677460 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:37:51.677460 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:37:51.678238 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:37:51.678238 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:37:51.678238 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:37:51.678238 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:37:51.678238 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:37:51.678238 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:37:51.678238 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:37:51.678238 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:37:51.678238 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:37:51.678238 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:37:51.678238 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:37:51.678238 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:37:51.678238 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 51/107] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:37:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:37:51.681169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743104f-cddd-430e-b5eb-94351149a46b None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:51.681281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743104f-cddd-430e-b5eb-94351149a46b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:51.682182 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743104f-cddd-430e-b5eb-94351149a46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:51.714472 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d743104f-cddd-430e-b5eb-94351149a46b None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:51.716160 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d743104f-cddd-430e-b5eb-94351149a46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:51.788072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1ae68-ebe8-43bb-90fd-b69ebf480f96 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:51.795999 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:51.802523 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 52/108] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:37:51.803872 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743104f-cddd-430e-b5eb-94351149a46b None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:51.832139 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:51.840768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72926457-49bc-473a-adea-6f62f494f4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:51.842416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72926457-49bc-473a-adea-6f62f494f4bc None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:51.842875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72926457-49bc-473a-adea-6f62f494f4bc None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:51.843319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72926457-49bc-473a-adea-6f62f494f4bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:51.857010 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72926457-49bc-473a-adea-6f62f494f4bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:37:51.866715 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-72926457-49bc-473a-adea-6f62f494f4bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:37:51.866715 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:51.866715 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:37:51.866715 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:37:51.866715 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:37:51.866715 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:37:51.866715 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:37:51.866715 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:37:51.866715 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:37:51.866715 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:37:51.866715 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:37:51.866715 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:37:51.866715 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:37:51.866715 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:37:51.866715 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:37:51.866715 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:37:51.867833 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:37:51.867833 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:37:51.867833 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:37:51.867833 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:37:51.867833 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:37:51.867833 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:37:51.867833 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:37:51.867833 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:37:51.867833 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:37:51.867833 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:37:51.867833 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:37:51.867833 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:37:51.867833 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:37:51.867833 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:37:51.867833 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:37:51.867833 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:37:51.868757 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:37:51.868757 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:37:51.868757 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:37:51.868757 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:37:51.868757 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:37:51.868757 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:37:51.868757 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:37:51.868757 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:37:51.868757 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:37:51.868757 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:37:51.868757 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:37:51.868757 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:37:51.874199 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 57/109] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Aug 6 20:37:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:37:51.874199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72926457-49bc-473a-adea-6f62f494f4bc None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:51.949725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743104f-cddd-430e-b5eb-94351149a46b None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:52.051281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16bd5a1-e418-4157-9eee-33c82869c56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:52.051911 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bd5a1-e418-4157-9eee-33c82869c56a None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:52.052193 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bd5a1-e418-4157-9eee-33c82869c56a None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:52.052469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bd5a1-e418-4157-9eee-33c82869c56a None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:52.053140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16bd5a1-e418-4157-9eee-33c82869c56a None admin] RBAC: Adding query filter params (name=reader) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:52.053442 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16bd5a1-e418-4157-9eee-33c82869c56a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:52.054871 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16bd5a1-e418-4157-9eee-33c82869c56a None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:52.059264 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72926457-49bc-473a-adea-6f62f494f4bc None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:52.070201 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 53/110] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Aug 6 20:37:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:52.071092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16bd5a1-e418-4157-9eee-33c82869c56a None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:52.097992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5340059-6465-49ee-b8ff-e77b6bb19651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:52.098632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5340059-6465-49ee-b8ff-e77b6bb19651 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:52.098926 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5340059-6465-49ee-b8ff-e77b6bb19651 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:52.099204 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5340059-6465-49ee-b8ff-e77b6bb19651 None admin] PATH_INFO: `/v3/roles/member` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:52.110324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5340059-6465-49ee-b8ff-e77b6bb19651 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:37:52.115276 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-d5340059-6465-49ee-b8ff-e77b6bb19651 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:37:52.115276 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:52.115276 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:37:52.115276 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:37:52.115276 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:37:52.115276 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:37:52.115276 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:37:52.115276 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:37:52.115276 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:37:52.115276 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:37:52.115276 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:37:52.115276 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:37:52.115276 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:37:52.115276 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:37:52.115276 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:37:52.115276 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:37:52.116122 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:37:52.116122 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:37:52.116122 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:37:52.116122 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:37:52.116122 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:37:52.116122 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:37:52.116122 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:37:52.116122 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:37:52.116122 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:37:52.116122 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:37:52.116122 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:37:52.116122 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:37:52.116122 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:37:52.116122 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:37:52.116122 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:37:52.116122 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:37:52.116877 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:37:52.116877 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:37:52.116877 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:37:52.116877 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:37:52.116877 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:37:52.116877 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:37:52.116877 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:37:52.116877 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:37:52.116877 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:37:52.116877 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:37:52.116877 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:37:52.116877 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:37:52.116877 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 58/111] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:37:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:37:52.117518 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5340059-6465-49ee-b8ff-e77b6bb19651 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:52.188171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:52.218757 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16bd5a1-e418-4157-9eee-33c82869c56a None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:52.223004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:52.256742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90593e7-645b-4556-8b6c-93d3218dcfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:52.257361 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90593e7-645b-4556-8b6c-93d3218dcfd5 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:52.257772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90593e7-645b-4556-8b6c-93d3218dcfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:52.258083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90593e7-645b-4556-8b6c-93d3218dcfd5 None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:52.258610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90593e7-645b-4556-8b6c-93d3218dcfd5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:52.258895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90593e7-645b-4556-8b6c-93d3218dcfd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:52.260288 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90593e7-645b-4556-8b6c-93d3218dcfd5 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:52.269420 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 54/112] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:37:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:52.270304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90593e7-645b-4556-8b6c-93d3218dcfd5 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:52.273118 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5340059-6465-49ee-b8ff-e77b6bb19651 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:52.351397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b0de8-0215-4f7c-bd68-423b89c34a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:52.351965 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b0de8-0215-4f7c-bd68-423b89c34a26 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:52.352250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b0de8-0215-4f7c-bd68-423b89c34a26 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:52.352602 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b0de8-0215-4f7c-bd68-423b89c34a26 None admin] PATH_INFO: `/v3/users/da2eb7b6e50c4d688bb8ef505ee26ece` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:52.374168 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90593e7-645b-4556-8b6c-93d3218dcfd5 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:52.379301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b0de8-0215-4f7c-bd68-423b89c34a26 None admin] RBAC: Authorizing `identity:get_user(user_id=da2eb7b6e50c4d688bb8ef505ee26ece)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:52.380774 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b0de8-0215-4f7c-bd68-423b89c34a26 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:52.382453 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 59/113] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:37:52 2022] GET /identity/v3/users/da2eb7b6e50c4d688bb8ef505ee26ece => generated 289 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:52.383465 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b0de8-0215-4f7c-bd68-423b89c34a26 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:52.406520 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:52.432453 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e600709-5726-40e1-905d-46e4840a6b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:52.433096 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e600709-5726-40e1-905d-46e4840a6b06 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:52.433376 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e600709-5726-40e1-905d-46e4840a6b06 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:52.433645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e600709-5726-40e1-905d-46e4840a6b06 None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:52.434339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e600709-5726-40e1-905d-46e4840a6b06 None admin] RBAC: Adding query filter params (name=member) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:52.434672 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e600709-5726-40e1-905d-46e4840a6b06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:52.436910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e600709-5726-40e1-905d-46e4840a6b06 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:52.454205 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 55/114] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Aug 6 20:37:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:52.455130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e600709-5726-40e1-905d-46e4840a6b06 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:52.505360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b0de8-0215-4f7c-bd68-423b89c34a26 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:52.517357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:52.542795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1345ce3-7c7f-4462-ac59-22bab2aaca49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:52.543592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1345ce3-7c7f-4462-ac59-22bab2aaca49 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:52.543873 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1345ce3-7c7f-4462-ac59-22bab2aaca49 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:52.544150 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1345ce3-7c7f-4462-ac59-22bab2aaca49 None admin] PATH_INFO: `/v3/users/051007d94d8d4d818b5d4705a31e110b` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:52.545971 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1345ce3-7c7f-4462-ac59-22bab2aaca49 None admin] RBAC: Authorizing `identity:get_user(user_id=051007d94d8d4d818b5d4705a31e110b)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:52.547574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1345ce3-7c7f-4462-ac59-22bab2aaca49 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:52.549566 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 60/115] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:37:52 2022] GET /identity/v3/users/051007d94d8d4d818b5d4705a31e110b => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:52.550841 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d03b32-12e2-46a1-8b9a-39c7d6e9d3e3 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:52.551122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d03b32-12e2-46a1-8b9a-39c7d6e9d3e3 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:52.551396 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d03b32-12e2-46a1-8b9a-39c7d6e9d3e3 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:52.552825 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 61/116] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:52.553502 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d03b32-12e2-46a1-8b9a-39c7d6e9d3e3 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:52.558906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e600709-5726-40e1-905d-46e4840a6b06 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:52.593342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650256d-4812-4dfb-b7a9-fb9be8f3ae58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:52.593950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650256d-4812-4dfb-b7a9-fb9be8f3ae58 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:52.594229 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650256d-4812-4dfb-b7a9-fb9be8f3ae58 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:52.594498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650256d-4812-4dfb-b7a9-fb9be8f3ae58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:52.650953 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:52.669016 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d03b32-12e2-46a1-8b9a-39c7d6e9d3e3 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:52.670831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650256d-4812-4dfb-b7a9-fb9be8f3ae58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:52.673260 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650256d-4812-4dfb-b7a9-fb9be8f3ae58 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:52.705388 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0697a-e6b0-4f45-a1ca-de14c5ecf7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:52.706010 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0697a-e6b0-4f45-a1ca-de14c5ecf7b7 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:52.706298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0697a-e6b0-4f45-a1ca-de14c5ecf7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:52.706584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0697a-e6b0-4f45-a1ca-de14c5ecf7b7 None admin] PATH_INFO: `/v3/users/7c8e7c536115407885851d0e16fabe30` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:52.707699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0697a-e6b0-4f45-a1ca-de14c5ecf7b7 None admin] RBAC: Authorizing `identity:get_user(user_id=7c8e7c536115407885851d0e16fabe30)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:52.709132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0697a-e6b0-4f45-a1ca-de14c5ecf7b7 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:52.710800 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 62/117] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:37:52 2022] GET /identity/v3/users/7c8e7c536115407885851d0e16fabe30 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:52.716155 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0697a-e6b0-4f45-a1ca-de14c5ecf7b7 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:52.769711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:52.783964 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 56/118] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:37:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:52.785211 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cfd1f-a541-415f-bc21-53508e193355 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:52.785504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cfd1f-a541-415f-bc21-53508e193355 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:52.785784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cfd1f-a541-415f-bc21-53508e193355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:52.804957 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f62cfd1f-a541-415f-bc21-53508e193355 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:52.806135 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f62cfd1f-a541-415f-bc21-53508e193355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:52.832148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0697a-e6b0-4f45-a1ca-de14c5ecf7b7 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:52.868687 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb362e2-579c-422c-a65f-04cad15c257a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:52.869416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb362e2-579c-422c-a65f-04cad15c257a None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:52.869707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb362e2-579c-422c-a65f-04cad15c257a None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:52.870004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb362e2-579c-422c-a65f-04cad15c257a None admin] PATH_INFO: `/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:52.871161 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb362e2-579c-422c-a65f-04cad15c257a None admin] RBAC: Authorizing `identity:get_project(project_id=e4eeeb6b2c9345388f01f51f75c671dc)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:52.872623 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb362e2-579c-422c-a65f-04cad15c257a None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:52.875208 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 63/119] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:37:52 2022] GET /identity/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:52.876364 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbcb2a3-346d-46ee-8bdf-39dbb0ee833a None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:52.876650 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbcb2a3-346d-46ee-8bdf-39dbb0ee833a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:52.876923 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbcb2a3-346d-46ee-8bdf-39dbb0ee833a None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:52.878257 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 64/120] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:37:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:52.882604 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbcb2a3-346d-46ee-8bdf-39dbb0ee833a None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:52.885791 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 57/121] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:37:52.887100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cfd1f-a541-415f-bc21-53508e193355 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:52.909351 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:52.991287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbcb2a3-346d-46ee-8bdf-39dbb0ee833a None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:53.006188 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cfd1f-a541-415f-bc21-53508e193355 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:53.009769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:53.032981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc4261-7176-46fa-a067-5c2a67f698f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:53.033636 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc4261-7176-46fa-a067-5c2a67f698f9 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:53.033897 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc4261-7176-46fa-a067-5c2a67f698f9 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:53.034175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc4261-7176-46fa-a067-5c2a67f698f9 None admin] PATH_INFO: `/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:53.035320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffc4261-7176-46fa-a067-5c2a67f698f9 None admin] RBAC: Authorizing `identity:get_project(project_id=e4eeeb6b2c9345388f01f51f75c671dc)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:53.036751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffc4261-7176-46fa-a067-5c2a67f698f9 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:53.038387 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 65/122] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:37:52 2022] GET /identity/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:53.039165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc4261-7176-46fa-a067-5c2a67f698f9 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:53.049835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4ee19-3e93-4169-9f3f-ba2f3e189f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:53.050471 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4ee19-3e93-4169-9f3f-ba2f3e189f19 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:53.050783 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4ee19-3e93-4169-9f3f-ba2f3e189f19 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:53.051066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4ee19-3e93-4169-9f3f-ba2f3e189f19 None admin] PATH_INFO: `/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:53.052194 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4ee19-3e93-4169-9f3f-ba2f3e189f19 None admin] RBAC: Authorizing `identity:get_project(project_id=e4eeeb6b2c9345388f01f51f75c671dc)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:53.053649 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4ee19-3e93-4169-9f3f-ba2f3e189f19 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:53.055445 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 58/123] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:37:52 2022] GET /identity/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:53.056412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18842c6-8efd-4aca-822f-bd6d0acf376f None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:53.056697 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18842c6-8efd-4aca-822f-bd6d0acf376f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:53.056973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18842c6-8efd-4aca-822f-bd6d0acf376f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:53.078061 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-c18842c6-8efd-4aca-822f-bd6d0acf376f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:53.079288 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c18842c6-8efd-4aca-822f-bd6d0acf376f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:53.150390 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 59/124] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:37:53.151556 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18842c6-8efd-4aca-822f-bd6d0acf376f None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:53.153674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc4261-7176-46fa-a067-5c2a67f698f9 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:53.171337 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:53.200176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab774304-9afc-454d-86a1-76bb497f8670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:53.200952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab774304-9afc-454d-86a1-76bb497f8670 None admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:53.201234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab774304-9afc-454d-86a1-76bb497f8670 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:53.201507 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab774304-9afc-454d-86a1-76bb497f8670 None admin] PATH_INFO: `/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc/users/051007d94d8d4d818b5d4705a31e110b/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:53.203900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab774304-9afc-454d-86a1-76bb497f8670 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4eeeb6b2c9345388f01f51f75c671dc, user_id=051007d94d8d4d818b5d4705a31e110b, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:53.204936 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab774304-9afc-454d-86a1-76bb497f8670 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:53.219901 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 66/125] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Aug 6 20:37:53 2022] PUT /identity/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc/users/051007d94d8d4d818b5d4705a31e110b/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:53.220588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab774304-9afc-454d-86a1-76bb497f8670 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:53.277369 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18842c6-8efd-4aca-822f-bd6d0acf376f None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:53.291857 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:53.323069 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ebd6bd-9989-4158-b628-cf8167fdbe13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:53.324168 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebd6bd-9989-4158-b628-cf8167fdbe13 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:53.324676 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebd6bd-9989-4158-b628-cf8167fdbe13 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:53.325138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebd6bd-9989-4158-b628-cf8167fdbe13 None admin] PATH_INFO: `/v3/roles/member` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:53.340547 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ebd6bd-9989-4158-b628-cf8167fdbe13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:37:53.346697 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-d5ebd6bd-9989-4158-b628-cf8167fdbe13 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:37:53.346697 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:53.346697 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:37:53.346697 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:37:53.346697 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:37:53.346697 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:37:53.346697 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:37:53.346697 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:37:53.346697 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:37:53.346697 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:37:53.346697 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:37:53.346697 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:37:53.346697 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:37:53.346697 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:37:53.346697 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:37:53.346697 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:37:53.347822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:37:53.347822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:37:53.347822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:37:53.347822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:37:53.347822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:37:53.347822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:37:53.347822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:37:53.347822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:37:53.347822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:37:53.347822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:37:53.347822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:37:53.347822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:37:53.347822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:37:53.347822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:37:53.347822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:37:53.347822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:37:53.348678 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:37:53.348678 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:37:53.348678 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:37:53.348678 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:37:53.348678 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:37:53.348678 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:37:53.348678 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:37:53.348678 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:37:53.348678 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:37:53.348678 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:37:53.348678 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:37:53.348678 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:37:53.348678 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 60/126] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:37:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:37:53.348678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ebd6bd-9989-4158-b628-cf8167fdbe13 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:53.380809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab774304-9afc-454d-86a1-76bb497f8670 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:53.429904 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247cf8d0-b4b7-41fb-b7d4-7dc6f1fbeabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:53.430497 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cf8d0-b4b7-41fb-b7d4-7dc6f1fbeabe None admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:53.430801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cf8d0-b4b7-41fb-b7d4-7dc6f1fbeabe None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:53.431082 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cf8d0-b4b7-41fb-b7d4-7dc6f1fbeabe None admin] PATH_INFO: `/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc/users/7c8e7c536115407885851d0e16fabe30/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:53.433035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247cf8d0-b4b7-41fb-b7d4-7dc6f1fbeabe None admin] RBAC: Authorizing `identity:create_grant(project_id=e4eeeb6b2c9345388f01f51f75c671dc, user_id=7c8e7c536115407885851d0e16fabe30, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:53.434492 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247cf8d0-b4b7-41fb-b7d4-7dc6f1fbeabe None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:53.448323 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:53.457392 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 67/127] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Aug 6 20:37:53 2022] PUT /identity/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc/users/7c8e7c536115407885851d0e16fabe30/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:53.458254 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247cf8d0-b4b7-41fb-b7d4-7dc6f1fbeabe None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:53.505709 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ebd6bd-9989-4158-b628-cf8167fdbe13 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:53.579103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47373df-5a6f-43c2-b02f-e28fed37dbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:53.579745 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47373df-5a6f-43c2-b02f-e28fed37dbf7 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:53.580028 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47373df-5a6f-43c2-b02f-e28fed37dbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:53.580304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47373df-5a6f-43c2-b02f-e28fed37dbf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:53.581056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47373df-5a6f-43c2-b02f-e28fed37dbf7 None admin] RBAC: Adding query filter params (role.id=c136f425b8234bfda1c7a8a99fcdc614, scope.project.id=e4eeeb6b2c9345388f01f51f75c671dc, user.id=da2eb7b6e50c4d688bb8ef505ee26ece) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:53.581372 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47373df-5a6f-43c2-b02f-e28fed37dbf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:53.588287 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47373df-5a6f-43c2-b02f-e28fed37dbf7 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:53.611144 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 61/128] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:37:53 2022] GET /identity/v3/role_assignments?user.id=da2eb7b6e50c4d688bb8ef505ee26ece&scope.project.id=e4eeeb6b2c9345388f01f51f75c671dc&role.id=c136f425b8234bfda1c7a8a99fcdc614 => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:53.612258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47373df-5a6f-43c2-b02f-e28fed37dbf7 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:53.682906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247cf8d0-b4b7-41fb-b7d4-7dc6f1fbeabe None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:53.686216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:53.735064 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af5fee-d6e2-4bb1-b933-48c20d466128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:53.735725 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af5fee-d6e2-4bb1-b933-48c20d466128 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:53.736010 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af5fee-d6e2-4bb1-b933-48c20d466128 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:53.736290 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af5fee-d6e2-4bb1-b933-48c20d466128 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:53.758791 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af5fee-d6e2-4bb1-b933-48c20d466128 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:37:53.763868 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-72af5fee-d6e2-4bb1-b933-48c20d466128 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:37:53.763868 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:53.763868 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:37:53.763868 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:37:53.763868 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:37:53.763868 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:37:53.763868 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:37:53.763868 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:37:53.763868 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:37:53.763868 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:37:53.763868 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:37:53.763868 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:37:53.763868 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:37:53.763868 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:37:53.763868 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:37:53.763868 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:37:53.764977 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:37:53.764977 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:37:53.764977 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:37:53.764977 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:37:53.764977 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:37:53.764977 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:37:53.764977 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:37:53.764977 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:37:53.764977 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:37:53.764977 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:37:53.764977 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:37:53.764977 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:37:53.764977 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:37:53.764977 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:37:53.764977 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:37:53.764977 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:37:53.766041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:37:53.766041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:37:53.766041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:37:53.766041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:37:53.766041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:37:53.766041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:37:53.766041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:37:53.766041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:37:53.766041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:37:53.766041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:37:53.766041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:37:53.766041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:37:53.766041 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 68/129] 10.222.0.33 () {56 vars in 1114 bytes} [Sat Aug 6 20:37:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:37:53.780010 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af5fee-d6e2-4bb1-b933-48c20d466128 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:53.838071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47373df-5a6f-43c2-b02f-e28fed37dbf7 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:53.910579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b7585-3ac6-44b8-b608-176c34b844c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:53.911201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b7585-3ac6-44b8-b608-176c34b844c7 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:53.911480 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b7585-3ac6-44b8-b608-176c34b844c7 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:53.911750 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b7585-3ac6-44b8-b608-176c34b844c7 None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:53.912542 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b7585-3ac6-44b8-b608-176c34b844c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:53.912767 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b7585-3ac6-44b8-b608-176c34b844c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:53.914246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b7585-3ac6-44b8-b608-176c34b844c7 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:53.920800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:53.936367 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 62/130] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Aug 6 20:37:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:53.939941 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b7585-3ac6-44b8-b608-176c34b844c7 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:53.986773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af5fee-d6e2-4bb1-b933-48c20d466128 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:54.063045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7801d4-8e53-4e13-a3d6-3886ef7c8614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:54.063926 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7801d4-8e53-4e13-a3d6-3886ef7c8614 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:54.064206 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7801d4-8e53-4e13-a3d6-3886ef7c8614 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:54.064478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7801d4-8e53-4e13-a3d6-3886ef7c8614 None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:54.065155 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7801d4-8e53-4e13-a3d6-3886ef7c8614 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:54.065458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7801d4-8e53-4e13-a3d6-3886ef7c8614 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:54.066866 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7801d4-8e53-4e13-a3d6-3886ef7c8614 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:54.075611 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 69/131] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:37:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:54.081977 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7801d4-8e53-4e13-a3d6-3886ef7c8614 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:54.113004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:54.158698 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b7585-3ac6-44b8-b608-176c34b844c7 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:54.221305 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97a64e-5258-4aaa-a5b0-2d74251515aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:54.222265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97a64e-5258-4aaa-a5b0-2d74251515aa None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:54.223683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97a64e-5258-4aaa-a5b0-2d74251515aa None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:54.224541 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97a64e-5258-4aaa-a5b0-2d74251515aa None admin] PATH_INFO: `/v3/users/7c8e7c536115407885851d0e16fabe30` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:54.228482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97a64e-5258-4aaa-a5b0-2d74251515aa None admin] RBAC: Authorizing `identity:get_user(user_id=7c8e7c536115407885851d0e16fabe30)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:54.230096 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97a64e-5258-4aaa-a5b0-2d74251515aa None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:54.233517 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 63/132] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:37:53 2022] GET /identity/v3/users/7c8e7c536115407885851d0e16fabe30 => generated 275 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:37:54.238598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fd0cc-3fec-4fa5-b6fc-6518b883805b None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:54.239065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fd0cc-3fec-4fa5-b6fc-6518b883805b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:54.239713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fd0cc-3fec-4fa5-b6fc-6518b883805b None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:54.243011 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 64/133] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:37:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:54.243887 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42fd0cc-3fec-4fa5-b6fc-6518b883805b None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:54.254125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7801d4-8e53-4e13-a3d6-3886ef7c8614 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:54.319236 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfdf7c-b590-466a-a8fe-624b56866a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:54.320108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfdf7c-b590-466a-a8fe-624b56866a1c None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:54.320622 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfdf7c-b590-466a-a8fe-624b56866a1c None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:54.321030 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfdf7c-b590-466a-a8fe-624b56866a1c None admin] PATH_INFO: `/v3/users/7c8e7c536115407885851d0e16fabe30` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:54.323078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bfdf7c-b590-466a-a8fe-624b56866a1c None admin] RBAC: Authorizing `identity:get_user(user_id=7c8e7c536115407885851d0e16fabe30)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:54.327242 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bfdf7c-b590-466a-a8fe-624b56866a1c None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:54.329001 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 70/134] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:37:54 2022] GET /identity/v3/users/7c8e7c536115407885851d0e16fabe30 => generated 275 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:37:54.331180 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285cd14a-3a10-4f7a-8f20-6dd678e0bddc None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:54.337439 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285cd14a-3a10-4f7a-8f20-6dd678e0bddc None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:54.337918 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285cd14a-3a10-4f7a-8f20-6dd678e0bddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:54.375424 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:54.376093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-285cd14a-3a10-4f7a-8f20-6dd678e0bddc None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:54.377484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-285cd14a-3a10-4f7a-8f20-6dd678e0bddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:54.455710 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42fd0cc-3fec-4fa5-b6fc-6518b883805b None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:54.507039 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 71/135] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:37:54.508016 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285cd14a-3a10-4f7a-8f20-6dd678e0bddc None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:54.536092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5f13b-f42b-4547-b4fc-433aae6c4d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:54.536745 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5f13b-f42b-4547-b4fc-433aae6c4d9b None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:54.537031 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5f13b-f42b-4547-b4fc-433aae6c4d9b None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:54.537305 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5f13b-f42b-4547-b4fc-433aae6c4d9b None admin] PATH_INFO: `/v3/projects/f904bbcd8b2a4d0b890ebe4d29599454` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:54.541183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5f13b-f42b-4547-b4fc-433aae6c4d9b None admin] RBAC: Authorizing `identity:get_project(project_id=f904bbcd8b2a4d0b890ebe4d29599454)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:54.542676 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5f13b-f42b-4547-b4fc-433aae6c4d9b None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:54.544390 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 65/136] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:37:54 2022] GET /identity/v3/projects/f904bbcd8b2a4d0b890ebe4d29599454 => generated 312 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:54.550775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5f13b-f42b-4547-b4fc-433aae6c4d9b None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:54.556757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:54.705760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285cd14a-3a10-4f7a-8f20-6dd678e0bddc None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:54.742301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e187f6-2c3d-4ccd-a31b-71301872f75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:54.742961 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e187f6-2c3d-4ccd-a31b-71301872f75d None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:54.743305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e187f6-2c3d-4ccd-a31b-71301872f75d None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:54.743581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e187f6-2c3d-4ccd-a31b-71301872f75d None admin] PATH_INFO: `/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:54.744837 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e187f6-2c3d-4ccd-a31b-71301872f75d None admin] RBAC: Authorizing `identity:get_project(project_id=e4eeeb6b2c9345388f01f51f75c671dc)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:54.746383 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e187f6-2c3d-4ccd-a31b-71301872f75d None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:54.748127 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 72/137] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:37:54 2022] GET /identity/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:54.748851 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e187f6-2c3d-4ccd-a31b-71301872f75d None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:54.750906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5f13b-f42b-4547-b4fc-433aae6c4d9b None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:54.832214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7e2d8-e863-44d7-85bc-326bf2ebc298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:54.833230 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7e2d8-e863-44d7-85bc-326bf2ebc298 None admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:54.833715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7e2d8-e863-44d7-85bc-326bf2ebc298 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:54.834187 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7e2d8-e863-44d7-85bc-326bf2ebc298 None admin] PATH_INFO: `/v3/projects/f904bbcd8b2a4d0b890ebe4d29599454/users/7c8e7c536115407885851d0e16fabe30/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:54.836377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7e2d8-e863-44d7-85bc-326bf2ebc298 None admin] RBAC: Authorizing `identity:create_grant(project_id=f904bbcd8b2a4d0b890ebe4d29599454, user_id=7c8e7c536115407885851d0e16fabe30, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:54.838105 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7e2d8-e863-44d7-85bc-326bf2ebc298 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:54.841234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:54.853557 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:54.864502 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 66/138] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Aug 6 20:37:54 2022] PUT /identity/v3/projects/f904bbcd8b2a4d0b890ebe4d29599454/users/7c8e7c536115407885851d0e16fabe30/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:54.865440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e187f6-2c3d-4ccd-a31b-71301872f75d None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:54.865574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7e2d8-e863-44d7-85bc-326bf2ebc298 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:54.905574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f03a47-1c10-4c64-aa12-35c7b37731dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:54.906483 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f03a47-1c10-4c64-aa12-35c7b37731dc None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:54.906983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f03a47-1c10-4c64-aa12-35c7b37731dc None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:54.907412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f03a47-1c10-4c64-aa12-35c7b37731dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:54.908923 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f03a47-1c10-4c64-aa12-35c7b37731dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:54.910716 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f03a47-1c10-4c64-aa12-35c7b37731dc None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:54.912630 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 73/139] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:37:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:54.920659 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f03a47-1c10-4c64-aa12-35c7b37731dc None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:55.078495 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f03a47-1c10-4c64-aa12-35c7b37731dc None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:55.138014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba0dc54-c5d9-4e8e-a70a-f3faf641d770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:55.139170 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0dc54-c5d9-4e8e-a70a-f3faf641d770 None admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:55.139640 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0dc54-c5d9-4e8e-a70a-f3faf641d770 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:55.139640 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0dc54-c5d9-4e8e-a70a-f3faf641d770 None admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:55.140292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba0dc54-c5d9-4e8e-a70a-f3faf641d770 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:55.141739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba0dc54-c5d9-4e8e-a70a-f3faf641d770 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:55.148080 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7e2d8-e863-44d7-85bc-326bf2ebc298 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:55.172548 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 74/140] 10.222.0.33 () {60 vars in 1132 bytes} [Sat Aug 6 20:37:54 2022] POST /identity/v3/users => generated 283 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:55.192500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5278e0-8afa-4e5e-95fa-18e2be788d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:55.193617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5278e0-8afa-4e5e-95fa-18e2be788d6d None admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:55.194177 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5278e0-8afa-4e5e-95fa-18e2be788d6d None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:55.194700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5278e0-8afa-4e5e-95fa-18e2be788d6d None admin] PATH_INFO: `/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc/users/7c8e7c536115407885851d0e16fabe30/roles/b9254dbd663046739a1ba48d8c0027ad` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:55.197459 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5278e0-8afa-4e5e-95fa-18e2be788d6d None admin] RBAC: Authorizing `identity:create_grant(project_id=e4eeeb6b2c9345388f01f51f75c671dc, user_id=7c8e7c536115407885851d0e16fabe30, role_id=b9254dbd663046739a1ba48d8c0027ad)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:55.199327 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5278e0-8afa-4e5e-95fa-18e2be788d6d None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:55.218259 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 67/141] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Aug 6 20:37:54 2022] PUT /identity/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc/users/7c8e7c536115407885851d0e16fabe30/roles/b9254dbd663046739a1ba48d8c0027ad => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:56.074131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2da51-fb15-4f55-b78f-a01cca640bb5 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:56.074498 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2da51-fb15-4f55-b78f-a01cca640bb5 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:56.074715 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2da51-fb15-4f55-b78f-a01cca640bb5 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:56.076642 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 75/142] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:37:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:56.083226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5f9be-744b-4be6-a291-9ddf44654451 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:56.083693 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5f9be-744b-4be6-a291-9ddf44654451 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:56.083773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5f9be-744b-4be6-a291-9ddf44654451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:56.106664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-b7f5f9be-744b-4be6-a291-9ddf44654451 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:56.108788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b7f5f9be-744b-4be6-a291-9ddf44654451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:56.178365 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:56.196947 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 68/143] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:37:56.233173 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2da51-fb15-4f55-b78f-a01cca640bb5 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:56.250335 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:56.362225 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2da51-fb15-4f55-b78f-a01cca640bb5 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:56.410419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af73f86-0559-4ace-adf4-21289f9cd7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:56.411097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af73f86-0559-4ace-adf4-21289f9cd7c8 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:56.411371 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af73f86-0559-4ace-adf4-21289f9cd7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:56.411639 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af73f86-0559-4ace-adf4-21289f9cd7c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:56.428525 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af73f86-0559-4ace-adf4-21289f9cd7c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:37:56.433406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-3af73f86-0559-4ace-adf4-21289f9cd7c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:37:56.433406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:56.433406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:37:56.433406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:37:56.433406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:37:56.433406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:37:56.433406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:37:56.433406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:37:56.433406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:37:56.433406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:37:56.433406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:37:56.433406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:37:56.433406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:37:56.433406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:37:56.433406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:37:56.433406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:37:56.434316 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:37:56.434316 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:37:56.434316 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:37:56.434316 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:37:56.434316 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:37:56.434316 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:37:56.434316 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:37:56.434316 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:37:56.434316 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:37:56.434316 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:37:56.434316 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:37:56.434316 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:37:56.434316 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:37:56.434316 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:37:56.434316 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:37:56.434316 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:37:56.436369 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:37:56.436369 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:37:56.436369 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:37:56.436369 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:37:56.436369 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:37:56.436369 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:37:56.436369 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:37:56.436369 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:37:56.436369 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:37:56.436369 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:37:56.436369 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:37:56.436369 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:37:56.436369 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 76/144] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Aug 6 20:37:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:37:56.441655 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5f9be-744b-4be6-a291-9ddf44654451 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:56.557116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5f9be-744b-4be6-a291-9ddf44654451 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:56.600461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c27c79-94b2-404f-9750-f672151256ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:56.601076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c27c79-94b2-404f-9750-f672151256ae None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:56.601352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c27c79-94b2-404f-9750-f672151256ae None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:56.601624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c27c79-94b2-404f-9750-f672151256ae None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:56.602290 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c27c79-94b2-404f-9750-f672151256ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:56.602628 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c27c79-94b2-404f-9750-f672151256ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:56.604031 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c27c79-94b2-404f-9750-f672151256ae None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:56.617579 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 69/145] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:37:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:56.623506 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af73f86-0559-4ace-adf4-21289f9cd7c8 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:56.718933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:56.732711 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8273f8-64fa-477d-8778-195bba090be4 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:56.733017 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8273f8-64fa-477d-8778-195bba090be4 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:56.733485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8273f8-64fa-477d-8778-195bba090be4 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:56.734920 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 70/146] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:37:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:37:56.746069 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320bb13-064d-41cc-a09b-5f84a790f146 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:56.746493 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320bb13-064d-41cc-a09b-5f84a790f146 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:56.746892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320bb13-064d-41cc-a09b-5f84a790f146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:56.759255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af73f86-0559-4ace-adf4-21289f9cd7c8 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:56.776919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a320bb13-064d-41cc-a09b-5f84a790f146 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:56.778144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a320bb13-064d-41cc-a09b-5f84a790f146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:56.813539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651bae10-e4a6-42bf-be49-0703356d1360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:56.814168 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651bae10-e4a6-42bf-be49-0703356d1360 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:56.814447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651bae10-e4a6-42bf-be49-0703356d1360 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:56.814750 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651bae10-e4a6-42bf-be49-0703356d1360 None admin] PATH_INFO: `/v3/users/051007d94d8d4d818b5d4705a31e110b` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:56.815904 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651bae10-e4a6-42bf-be49-0703356d1360 None admin] RBAC: Authorizing `identity:get_user(user_id=051007d94d8d4d818b5d4705a31e110b)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:56.817344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651bae10-e4a6-42bf-be49-0703356d1360 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:56.818973 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 77/147] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:37:56 2022] GET /identity/v3/users/051007d94d8d4d818b5d4705a31e110b => generated 247 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:56.828977 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651bae10-e4a6-42bf-be49-0703356d1360 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:56.858933 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:56.890683 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 71/148] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:37:56.960331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651bae10-e4a6-42bf-be49-0703356d1360 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:56.966280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320bb13-064d-41cc-a09b-5f84a790f146 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:56.997699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c50384-5781-4481-821c-f763e1479b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:56.997699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c50384-5781-4481-821c-f763e1479b66 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:56.997699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c50384-5781-4481-821c-f763e1479b66 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:56.998036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c50384-5781-4481-821c-f763e1479b66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:57.012490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:57.110715 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c50384-5781-4481-821c-f763e1479b66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:57.112203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c50384-5781-4481-821c-f763e1479b66 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:57.137861 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320bb13-064d-41cc-a09b-5f84a790f146 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:57.180916 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a66cb61-f931-41b2-b477-bcdffc22514d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:57.181488 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66cb61-f931-41b2-b477-bcdffc22514d None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:57.181768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66cb61-f931-41b2-b477-bcdffc22514d None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:57.182040 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66cb61-f931-41b2-b477-bcdffc22514d None admin] PATH_INFO: `/v3/roles/member` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:57.204786 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a66cb61-f931-41b2-b477-bcdffc22514d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:37:57.221435 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-3a66cb61-f931-41b2-b477-bcdffc22514d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:37:57.221435 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:57.221435 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:37:57.221435 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:37:57.221435 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:37:57.221435 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:37:57.221435 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:37:57.221435 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:37:57.221435 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:37:57.221435 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:37:57.221435 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:37:57.221435 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:37:57.221435 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:37:57.221435 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:37:57.221435 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:37:57.221435 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:37:57.222352 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:37:57.222352 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:37:57.222352 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:37:57.222352 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:37:57.222352 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:37:57.222352 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:37:57.222352 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:37:57.222352 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:37:57.222352 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:37:57.222352 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:37:57.222352 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:37:57.222352 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:37:57.222352 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:37:57.222352 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:37:57.222352 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:37:57.222352 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:37:57.223174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:37:57.223174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:37:57.223174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:37:57.223174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:37:57.223174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:37:57.223174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:37:57.223174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:37:57.223174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:37:57.223174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:37:57.223174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:37:57.223174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:37:57.223174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:37:57.223174 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 72/149] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:37:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:37:57.224327 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a7436-5186-4ab1-abf3-39e256f991d8 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:57.224423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a7436-5186-4ab1-abf3-39e256f991d8 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:57.224638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a7436-5186-4ab1-abf3-39e256f991d8 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:57.229629 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 73/150] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:37:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:57.235620 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa43c4-e094-4c7b-9d78-675babe068d0 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:57.235903 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa43c4-e094-4c7b-9d78-675babe068d0 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:57.236173 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa43c4-e094-4c7b-9d78-675babe068d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:57.264297 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-37aa43c4-e094-4c7b-9d78-675babe068d0 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:57.265513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-37aa43c4-e094-4c7b-9d78-675babe068d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:57.323344 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 78/151] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:37:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 06 20:37:57.324866 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c50384-5781-4481-821c-f763e1479b66 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:57.340086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:57.410624 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:57.426571 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 74/152] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:37:57.426571 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa43c4-e094-4c7b-9d78-675babe068d0 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:57.485954 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c50384-5781-4481-821c-f763e1479b66 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:57.525049 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117d3cd-732a-4f49-8574-4e187b997379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:57.526124 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117d3cd-732a-4f49-8574-4e187b997379 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:57.526538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117d3cd-732a-4f49-8574-4e187b997379 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:57.527011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117d3cd-732a-4f49-8574-4e187b997379 None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:57.527825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f117d3cd-732a-4f49-8574-4e187b997379 None admin] RBAC: Adding query filter params (name=member) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:57.528320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f117d3cd-732a-4f49-8574-4e187b997379 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:57.530292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f117d3cd-732a-4f49-8574-4e187b997379 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:57.540181 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 79/153] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Aug 6 20:37:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:57.541288 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117d3cd-732a-4f49-8574-4e187b997379 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:57.709852 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117d3cd-732a-4f49-8574-4e187b997379 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:57.722435 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:57.736673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa43c4-e094-4c7b-9d78-675babe068d0 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:57.773793 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105000ed-92aa-4f80-89d6-b43c406113bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:57.774735 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105000ed-92aa-4f80-89d6-b43c406113bc None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:57.775018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105000ed-92aa-4f80-89d6-b43c406113bc None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:57.775280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105000ed-92aa-4f80-89d6-b43c406113bc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:57.800568 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105000ed-92aa-4f80-89d6-b43c406113bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:37:57.806287 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-105000ed-92aa-4f80-89d6-b43c406113bc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:37:57.806287 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:57.806287 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:37:57.806287 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:37:57.806287 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:37:57.806287 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:37:57.806287 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:37:57.806287 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:37:57.806287 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:37:57.806287 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:37:57.806287 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:37:57.806287 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:37:57.806287 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:37:57.806287 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:37:57.806287 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:37:57.806287 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:37:57.807157 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:37:57.807157 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:37:57.807157 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:37:57.807157 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:37:57.807157 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:37:57.807157 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:37:57.807157 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:37:57.807157 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:37:57.807157 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:37:57.807157 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:37:57.807157 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:37:57.807157 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:37:57.807157 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:37:57.807157 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:37:57.807157 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:37:57.807157 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:37:57.808120 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:37:57.808120 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:37:57.808120 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:37:57.808120 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:37:57.808120 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:37:57.808120 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:37:57.808120 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:37:57.808120 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:37:57.808120 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:37:57.808120 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:37:57.808120 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:37:57.808120 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:37:57.812173 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 80/154] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:37:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:37:57.813058 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105000ed-92aa-4f80-89d6-b43c406113bc None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:57.831304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfe4ca-541a-41aa-85fe-1140d280fe8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:57.831963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfe4ca-541a-41aa-85fe-1140d280fe8f None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:57.832248 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfe4ca-541a-41aa-85fe-1140d280fe8f None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:57.832837 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfe4ca-541a-41aa-85fe-1140d280fe8f None admin] PATH_INFO: `/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:57.833710 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acfe4ca-541a-41aa-85fe-1140d280fe8f None admin] RBAC: Authorizing `identity:get_project(project_id=e4eeeb6b2c9345388f01f51f75c671dc)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:57.835218 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acfe4ca-541a-41aa-85fe-1140d280fe8f None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:57.836853 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 75/155] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:37:57 2022] GET /identity/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc => generated 298 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:57.837614 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfe4ca-541a-41aa-85fe-1140d280fe8f None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:57.893506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:57.998404 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfe4ca-541a-41aa-85fe-1140d280fe8f None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:58.040443 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105000ed-92aa-4f80-89d6-b43c406113bc None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:58.055276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0fa33-f0f8-4c2e-834b-69ac36e95977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:58.056079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0fa33-f0f8-4c2e-834b-69ac36e95977 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:58.056367 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0fa33-f0f8-4c2e-834b-69ac36e95977 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:58.056643 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0fa33-f0f8-4c2e-834b-69ac36e95977 None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:58.057320 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0fa33-f0f8-4c2e-834b-69ac36e95977 None admin] RBAC: Adding query filter params (name=reader) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:58.057623 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0fa33-f0f8-4c2e-834b-69ac36e95977 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:58.059044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0fa33-f0f8-4c2e-834b-69ac36e95977 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:58.069370 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 76/156] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Aug 6 20:37:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:58.070218 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0fa33-f0f8-4c2e-834b-69ac36e95977 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:58.115333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e01a32-cf8c-455d-856e-acdc8ecfea2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:58.115980 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e01a32-cf8c-455d-856e-acdc8ecfea2f None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:58.116259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e01a32-cf8c-455d-856e-acdc8ecfea2f None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:58.116531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e01a32-cf8c-455d-856e-acdc8ecfea2f None admin] PATH_INFO: `/v3/users/7c8e7c536115407885851d0e16fabe30` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:58.119304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e01a32-cf8c-455d-856e-acdc8ecfea2f None admin] RBAC: Authorizing `identity:get_user(user_id=7c8e7c536115407885851d0e16fabe30)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:58.120772 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e01a32-cf8c-455d-856e-acdc8ecfea2f None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:58.122423 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 81/157] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:37:57 2022] GET /identity/v3/users/7c8e7c536115407885851d0e16fabe30 => generated 275 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:58.123219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e01a32-cf8c-455d-856e-acdc8ecfea2f None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:58.172461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:58.221764 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:58.230380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0fa33-f0f8-4c2e-834b-69ac36e95977 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:58.261966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e01a32-cf8c-455d-856e-acdc8ecfea2f None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:58.287270 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50617e2-7a30-4da6-b58b-d8035ce5fe84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:58.287897 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50617e2-7a30-4da6-b58b-d8035ce5fe84 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:58.288185 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50617e2-7a30-4da6-b58b-d8035ce5fe84 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:58.288456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50617e2-7a30-4da6-b58b-d8035ce5fe84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:58.289189 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50617e2-7a30-4da6-b58b-d8035ce5fe84 None admin] RBAC: Adding query filter params (role.id=ab245eea8a714462a00c4546309de9c9, scope.project.id=e4eeeb6b2c9345388f01f51f75c671dc, user.id=051007d94d8d4d818b5d4705a31e110b) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:58.289500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50617e2-7a30-4da6-b58b-d8035ce5fe84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:58.290989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50617e2-7a30-4da6-b58b-d8035ce5fe84 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:58.297244 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 77/158] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:37:58 2022] GET /identity/v3/role_assignments?user.id=051007d94d8d4d818b5d4705a31e110b&scope.project.id=e4eeeb6b2c9345388f01f51f75c671dc&role.id=ab245eea8a714462a00c4546309de9c9 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:58.298069 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50617e2-7a30-4da6-b58b-d8035ce5fe84 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:58.325058 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a4993-5e42-4fa9-891d-770358d2bd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:58.326321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a4993-5e42-4fa9-891d-770358d2bd8f None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:58.326618 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a4993-5e42-4fa9-891d-770358d2bd8f None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:58.326884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a4993-5e42-4fa9-891d-770358d2bd8f None admin] PATH_INFO: `/v3/users/da2eb7b6e50c4d688bb8ef505ee26ece` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:58.331553 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a4993-5e42-4fa9-891d-770358d2bd8f None admin] RBAC: Authorizing `identity:get_user(user_id=da2eb7b6e50c4d688bb8ef505ee26ece)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:58.333045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a4993-5e42-4fa9-891d-770358d2bd8f None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:58.334852 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 82/159] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:37:58 2022] GET /identity/v3/users/da2eb7b6e50c4d688bb8ef505ee26ece => generated 289 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:58.341164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a4993-5e42-4fa9-891d-770358d2bd8f None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:58.455026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50617e2-7a30-4da6-b58b-d8035ce5fe84 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:58.515489 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c15ec-7135-4390-824b-8b85e2ffbbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:58.516042 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c15ec-7135-4390-824b-8b85e2ffbbec None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:58.516323 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c15ec-7135-4390-824b-8b85e2ffbbec None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:58.516593 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c15ec-7135-4390-824b-8b85e2ffbbec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:58.537376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:58.542065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a4993-5e42-4fa9-891d-770358d2bd8f None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:58.563042 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:58.623572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c15ec-7135-4390-824b-8b85e2ffbbec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:58.625061 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c15ec-7135-4390-824b-8b85e2ffbbec None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:58.648286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8354d5-1f70-47ce-9754-495b8eae039f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:58.648936 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8354d5-1f70-47ce-9754-495b8eae039f None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:58.649212 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8354d5-1f70-47ce-9754-495b8eae039f None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:58.649487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8354d5-1f70-47ce-9754-495b8eae039f None admin] PATH_INFO: `/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:58.650760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8354d5-1f70-47ce-9754-495b8eae039f None admin] RBAC: Authorizing `identity:get_project(project_id=e4eeeb6b2c9345388f01f51f75c671dc)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:58.652324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8354d5-1f70-47ce-9754-495b8eae039f None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:58.655323 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 83/160] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:37:58 2022] GET /identity/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc => generated 298 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:58.661304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8354d5-1f70-47ce-9754-495b8eae039f None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:58.822928 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8354d5-1f70-47ce-9754-495b8eae039f None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:58.828824 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 78/161] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:37:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:58.834494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c15ec-7135-4390-824b-8b85e2ffbbec None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:58.874279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdeea7-1d35-4871-badf-b80759250401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:58.875146 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdeea7-1d35-4871-badf-b80759250401 None admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:58.875427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdeea7-1d35-4871-badf-b80759250401 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:58.875704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdeea7-1d35-4871-badf-b80759250401 None admin] PATH_INFO: `/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc/users/da2eb7b6e50c4d688bb8ef505ee26ece/roles/c136f425b8234bfda1c7a8a99fcdc614` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:58.877709 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbdeea7-1d35-4871-badf-b80759250401 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4eeeb6b2c9345388f01f51f75c671dc, user_id=da2eb7b6e50c4d688bb8ef505ee26ece, role_id=c136f425b8234bfda1c7a8a99fcdc614)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:58.879321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbdeea7-1d35-4871-badf-b80759250401 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:58.897469 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 84/162] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Aug 6 20:37:58 2022] PUT /identity/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc/users/da2eb7b6e50c4d688bb8ef505ee26ece/roles/c136f425b8234bfda1c7a8a99fcdc614 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:58.951899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:59.008388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c15ec-7135-4390-824b-8b85e2ffbbec None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:59.059100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e5e5d-4291-43b6-a3b3-f6d836d2fd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:59.059787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e5e5d-4291-43b6-a3b3-f6d836d2fd59 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:59.060068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e5e5d-4291-43b6-a3b3-f6d836d2fd59 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:59.060604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e5e5d-4291-43b6-a3b3-f6d836d2fd59 None admin] PATH_INFO: `/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:59.063678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4e5e5d-4291-43b6-a3b3-f6d836d2fd59 None admin] RBAC: Authorizing `identity:get_project(project_id=e4eeeb6b2c9345388f01f51f75c671dc)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:59.065199 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4e5e5d-4291-43b6-a3b3-f6d836d2fd59 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:59.067420 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 79/163] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:37:58 2022] GET /identity/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:37:59.073136 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdeea7-1d35-4871-badf-b80759250401 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:59.081597 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a2b67-066a-45ba-9c09-84f74bcda077 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:59.081943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a2b67-066a-45ba-9c09-84f74bcda077 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:59.082149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a2b67-066a-45ba-9c09-84f74bcda077 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:59.083959 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 80/164] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:59.094613 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee09d94-135d-4c0c-aee0-2f94130bcde7 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:59.094613 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee09d94-135d-4c0c-aee0-2f94130bcde7 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:59.094613 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee09d94-135d-4c0c-aee0-2f94130bcde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:59.109659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-2ee09d94-135d-4c0c-aee0-2f94130bcde7 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:59.110897 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2ee09d94-135d-4c0c-aee0-2f94130bcde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:59.144740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:59.181883 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 81/165] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:37:59.210574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee09d94-135d-4c0c-aee0-2f94130bcde7 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:59.317095 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdeea7-1d35-4871-badf-b80759250401 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:59.368291 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:59.404757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198dcf33-de16-49ec-b2e6-38d19a5152b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:59.406222 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dcf33-de16-49ec-b2e6-38d19a5152b8 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:59.406746 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dcf33-de16-49ec-b2e6-38d19a5152b8 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:59.407226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dcf33-de16-49ec-b2e6-38d19a5152b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:59.408148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198dcf33-de16-49ec-b2e6-38d19a5152b8 None admin] RBAC: Adding query filter params (role.id=1a212772e06344478184ce7d44a58b40, scope.project.id=e4eeeb6b2c9345388f01f51f75c671dc, user.id=7c8e7c536115407885851d0e16fabe30) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:59.408647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198dcf33-de16-49ec-b2e6-38d19a5152b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:59.410429 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198dcf33-de16-49ec-b2e6-38d19a5152b8 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:59.424515 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 85/166] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:37:59 2022] GET /identity/v3/role_assignments?user.id=7c8e7c536115407885851d0e16fabe30&scope.project.id=e4eeeb6b2c9345388f01f51f75c671dc&role.id=1a212772e06344478184ce7d44a58b40 => generated 608 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:59.455529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee09d94-135d-4c0c-aee0-2f94130bcde7 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:59.504625 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89d25f-599c-48c4-8d16-19670e65f5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:59.505641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89d25f-599c-48c4-8d16-19670e65f5b3 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:59.506136 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89d25f-599c-48c4-8d16-19670e65f5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:59.506618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89d25f-599c-48c4-8d16-19670e65f5b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:59.511499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463dbd2-f958-482d-ad10-94dffc1934c2 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:59.512155 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463dbd2-f958-482d-ad10-94dffc1934c2 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:59.512629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463dbd2-f958-482d-ad10-94dffc1934c2 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:59.514999 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 86/167] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:37:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:37:59.526346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89d25f-599c-48c4-8d16-19670e65f5b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:37:59.531848 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-6c89d25f-599c-48c4-8d16-19670e65f5b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:37:59.531848 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:37:59.531848 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:37:59.531848 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:37:59.531848 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:37:59.531848 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:37:59.531848 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:37:59.531848 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:37:59.531848 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:37:59.531848 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:37:59.531848 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:37:59.531848 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:37:59.531848 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:37:59.531848 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:37:59.531848 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:37:59.531848 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:37:59.532951 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:37:59.532951 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:37:59.532951 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:37:59.532951 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:37:59.532951 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:37:59.532951 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:37:59.532951 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:37:59.532951 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:37:59.532951 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:37:59.532951 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:37:59.532951 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:37:59.532951 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:37:59.532951 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:37:59.532951 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:37:59.532951 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:37:59.532951 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:37:59.533724 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:37:59.533724 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:37:59.533724 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:37:59.533724 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:37:59.533724 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:37:59.533724 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:37:59.533724 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:37:59.533724 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:37:59.533724 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:37:59.533724 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:37:59.533724 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:37:59.533724 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:37:59.534371 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 82/168] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:37:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:37:59.539372 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463dbd2-f958-482d-ad10-94dffc1934c2 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:59.539841 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b8639-e3f9-454a-8153-6b07d7363f05 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:59.540130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b8639-e3f9-454a-8153-6b07d7363f05 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:59.540405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b8639-e3f9-454a-8153-6b07d7363f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:59.580214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-730b8639-e3f9-454a-8153-6b07d7363f05 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:59.583301 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-730b8639-e3f9-454a-8153-6b07d7363f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:59.757842 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 83/169] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:37:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:37:59.767481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:59.787819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463dbd2-f958-482d-ad10-94dffc1934c2 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:59.803453 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b8639-e3f9-454a-8153-6b07d7363f05 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:59.869751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca1dc7-38f8-4925-8629-bd82984ba8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:59.870373 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca1dc7-38f8-4925-8629-bd82984ba8ca None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:59.870671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca1dc7-38f8-4925-8629-bd82984ba8ca None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:59.870939 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca1dc7-38f8-4925-8629-bd82984ba8ca None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:59.871622 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca1dc7-38f8-4925-8629-bd82984ba8ca None admin] RBAC: Adding query filter params (name=member) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:59.871922 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca1dc7-38f8-4925-8629-bd82984ba8ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:59.873599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca1dc7-38f8-4925-8629-bd82984ba8ca None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:59.894998 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 87/170] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Aug 6 20:37:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:59.900481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca1dc7-38f8-4925-8629-bd82984ba8ca None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:59.904412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:59.998118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b8639-e3f9-454a-8153-6b07d7363f05 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:00.035717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a0349f-6ab3-40ab-b622-7929dfdfed63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:00.036365 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0349f-6ab3-40ab-b622-7929dfdfed63 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:00.036648 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0349f-6ab3-40ab-b622-7929dfdfed63 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:00.036924 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0349f-6ab3-40ab-b622-7929dfdfed63 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:00.052453 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a0349f-6ab3-40ab-b622-7929dfdfed63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:00.058923 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-a6a0349f-6ab3-40ab-b622-7929dfdfed63 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:38:00.058923 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:00.058923 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:00.058923 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:00.058923 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:00.058923 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:00.058923 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:00.058923 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:00.058923 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:00.058923 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:00.058923 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:00.058923 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:00.058923 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:00.058923 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:00.058923 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:00.058923 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:00.059906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:00.059906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:00.059906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:00.059906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:00.059906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:00.059906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:00.059906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:00.059906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:00.059906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:00.059906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:00.059906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:00.059906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:00.059906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:00.059906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:00.059906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:00.059906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:00.061586 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:00.061586 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:00.061586 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:00.061586 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:00.061586 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:00.061586 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:00.061586 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:00.061586 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:00.061586 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:00.061586 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:00.061586 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:38:00.061586 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:00.061586 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 84/171] 10.222.0.33 () {56 vars in 1114 bytes} [Sat Aug 6 20:37:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:38:00.073291 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e644f7-867f-417e-bed4-8511672a093e None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:00.073565 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e644f7-867f-417e-bed4-8511672a093e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:00.073831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e644f7-867f-417e-bed4-8511672a093e None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:00.078135 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 85/172] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:00 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:38:00.079067 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e644f7-867f-417e-bed4-8511672a093e None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:00.127813 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca1dc7-38f8-4925-8629-bd82984ba8ca None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:00.188442 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c92ca-8fe6-4b18-953b-4b755123f24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:00.189450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c92ca-8fe6-4b18-953b-4b755123f24c None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:00.190006 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c92ca-8fe6-4b18-953b-4b755123f24c None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:00.190466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c92ca-8fe6-4b18-953b-4b755123f24c None admin] PATH_INFO: `/v3/users/7c8e7c536115407885851d0e16fabe30` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:00.192947 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c92ca-8fe6-4b18-953b-4b755123f24c None admin] RBAC: Authorizing `identity:get_user(user_id=7c8e7c536115407885851d0e16fabe30)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:00.194631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c92ca-8fe6-4b18-953b-4b755123f24c None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:00.196491 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 88/173] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:37:59 2022] GET /identity/v3/users/7c8e7c536115407885851d0e16fabe30 => generated 275 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:00.198048 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c55a4-191b-4bc0-b4b9-6df6a7dadfaa None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:00.198558 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c55a4-191b-4bc0-b4b9-6df6a7dadfaa None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:00.199034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c55a4-191b-4bc0-b4b9-6df6a7dadfaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:00.221248 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-566c55a4-191b-4bc0-b4b9-6df6a7dadfaa None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:00.223094 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-566c55a4-191b-4bc0-b4b9-6df6a7dadfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:00.236631 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e644f7-867f-417e-bed4-8511672a093e None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:00.247069 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:00.261997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:00.318796 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d399f5-14b2-4ff8-a707-c30e52535be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:00.319555 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d399f5-14b2-4ff8-a707-c30e52535be3 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:00.319836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d399f5-14b2-4ff8-a707-c30e52535be3 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:00.320110 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d399f5-14b2-4ff8-a707-c30e52535be3 None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:00.321792 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d399f5-14b2-4ff8-a707-c30e52535be3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:00.322102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d399f5-14b2-4ff8-a707-c30e52535be3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:00.326876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d399f5-14b2-4ff8-a707-c30e52535be3 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:00.347269 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 89/174] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:00.348198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c55a4-191b-4bc0-b4b9-6df6a7dadfaa None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:00.348867 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 86/175] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:38:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:00.357204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d399f5-14b2-4ff8-a707-c30e52535be3 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:00.509192 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c55a4-191b-4bc0-b4b9-6df6a7dadfaa None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:00.553744 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d399f5-14b2-4ff8-a707-c30e52535be3 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:00.581528 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e35c0-6de0-4479-a601-01e383f17522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:00.582138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e35c0-6de0-4479-a601-01e383f17522 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:00.582409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e35c0-6de0-4479-a601-01e383f17522 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:00.582700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e35c0-6de0-4479-a601-01e383f17522 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:00.607798 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:00.628074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2e3f4-a6b3-4379-bdc8-d2ec822d66a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:00.628724 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2e3f4-a6b3-4379-bdc8-d2ec822d66a9 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:00.629056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2e3f4-a6b3-4379-bdc8-d2ec822d66a9 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:00.629482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2e3f4-a6b3-4379-bdc8-d2ec822d66a9 None admin] PATH_INFO: `/v3/users/7c8e7c536115407885851d0e16fabe30` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:00.632495 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b2e3f4-a6b3-4379-bdc8-d2ec822d66a9 None admin] RBAC: Authorizing `identity:get_user(user_id=7c8e7c536115407885851d0e16fabe30)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:00.634084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b2e3f4-a6b3-4379-bdc8-d2ec822d66a9 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:00.635820 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 87/176] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:38:00 2022] GET /identity/v3/users/7c8e7c536115407885851d0e16fabe30 => generated 275 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:00.639503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2e3f4-a6b3-4379-bdc8-d2ec822d66a9 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:00.656351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e35c0-6de0-4479-a601-01e383f17522 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:00.657823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e35c0-6de0-4479-a601-01e383f17522 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:00.725535 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:00.764776 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 90/177] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:38:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:00.765707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e35c0-6de0-4479-a601-01e383f17522 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:00.816211 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2e3f4-a6b3-4379-bdc8-d2ec822d66a9 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:00.824680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:00.854949 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa145db7-c94e-406c-a0e4-5a81b795ad00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:00.855584 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa145db7-c94e-406c-a0e4-5a81b795ad00 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:00.855864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa145db7-c94e-406c-a0e4-5a81b795ad00 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:00.856136 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa145db7-c94e-406c-a0e4-5a81b795ad00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:00.868094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa145db7-c94e-406c-a0e4-5a81b795ad00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:00.873811 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e35c0-6de0-4479-a601-01e383f17522 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:00.874037 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-fa145db7-c94e-406c-a0e4-5a81b795ad00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:38:00.874037 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:00.874037 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:00.874037 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:00.874037 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:00.874037 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:00.874037 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:00.874037 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:00.874037 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:00.874037 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:00.874037 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:00.874037 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:00.874037 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:00.874037 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:00.874037 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:00.874037 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:00.874906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:00.874906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:00.874906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:00.874906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:00.874906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:00.874906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:00.874906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:00.874906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:00.874906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:00.874906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:00.874906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:00.874906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:00.874906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:00.874906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:00.874906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:00.874906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:00.875686 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:00.875686 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:00.875686 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:00.875686 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:00.875686 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:00.875686 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:00.875686 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:00.875686 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:00.875686 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:00.875686 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:00.875686 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:38:00.875686 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:00.875686 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 88/178] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Aug 6 20:38:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:00.876330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa145db7-c94e-406c-a0e4-5a81b795ad00 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:00.910362 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6159557d-13ed-41bd-ace2-7cd0d258eefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:00.911183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159557d-13ed-41bd-ace2-7cd0d258eefd None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:00.911466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159557d-13ed-41bd-ace2-7cd0d258eefd None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:00.911739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159557d-13ed-41bd-ace2-7cd0d258eefd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:00.983839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6159557d-13ed-41bd-ace2-7cd0d258eefd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:00.985591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6159557d-13ed-41bd-ace2-7cd0d258eefd None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:00.985740 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:00.989702 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa145db7-c94e-406c-a0e4-5a81b795ad00 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:01.027816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872663be-c6a1-464e-92c1-7faad91afcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:01.029100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872663be-c6a1-464e-92c1-7faad91afcb1 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:01.029617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872663be-c6a1-464e-92c1-7faad91afcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:01.029791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872663be-c6a1-464e-92c1-7faad91afcb1 None admin] PATH_INFO: `/v3/projects/f904bbcd8b2a4d0b890ebe4d29599454` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:01.030895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872663be-c6a1-464e-92c1-7faad91afcb1 None admin] RBAC: Authorizing `identity:get_project(project_id=f904bbcd8b2a4d0b890ebe4d29599454)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:01.032346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872663be-c6a1-464e-92c1-7faad91afcb1 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:01.034132 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 89/179] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:38:00 2022] GET /identity/v3/projects/f904bbcd8b2a4d0b890ebe4d29599454 => generated 312 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:01.037008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c8762-25da-4ee0-84e9-25939f2c0be8 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:01.037289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c8762-25da-4ee0-84e9-25939f2c0be8 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:01.037560 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c8762-25da-4ee0-84e9-25939f2c0be8 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:01.042618 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 90/180] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:01.042618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c8762-25da-4ee0-84e9-25939f2c0be8 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:01.051853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:01.107137 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 91/181] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:38:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:01.108285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c08287-c46d-4cfe-b2ce-ed730e77fbd7 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:01.108624 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c08287-c46d-4cfe-b2ce-ed730e77fbd7 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:01.108909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c08287-c46d-4cfe-b2ce-ed730e77fbd7 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:01.110300 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 92/182] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:01.114587 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c08287-c46d-4cfe-b2ce-ed730e77fbd7 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:01.163837 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c8762-25da-4ee0-84e9-25939f2c0be8 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:01.200025 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4564c-7c91-47ac-82d9-629816643f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:01.201689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4564c-7c91-47ac-82d9-629816643f88 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:01.202031 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4564c-7c91-47ac-82d9-629816643f88 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:01.202316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4564c-7c91-47ac-82d9-629816643f88 None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:01.202930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4564c-7c91-47ac-82d9-629816643f88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:01.203232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4564c-7c91-47ac-82d9-629816643f88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:01.204771 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4564c-7c91-47ac-82d9-629816643f88 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:01.213601 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 91/183] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:38:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:01.216294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff61ef-e9a0-48c6-8ab2-147de0273078 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:01.216662 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff61ef-e9a0-48c6-8ab2-147de0273078 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:01.217155 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff61ef-e9a0-48c6-8ab2-147de0273078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:01.230303 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c08287-c46d-4cfe-b2ce-ed730e77fbd7 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:01.238033 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-22ff61ef-e9a0-48c6-8ab2-147de0273078 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:01.239413 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-22ff61ef-e9a0-48c6-8ab2-147de0273078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:01.265114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:01.272890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e1415-e103-4a8b-b3b8-b4106de3b239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:01.273795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e1415-e103-4a8b-b3b8-b4106de3b239 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:01.274100 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e1415-e103-4a8b-b3b8-b4106de3b239 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:01.274364 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e1415-e103-4a8b-b3b8-b4106de3b239 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:01.275096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e1415-e103-4a8b-b3b8-b4106de3b239 None admin] RBAC: Adding query filter params (role.id=1a212772e06344478184ce7d44a58b40, scope.project.id=f904bbcd8b2a4d0b890ebe4d29599454, user.id=7c8e7c536115407885851d0e16fabe30) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:01.275452 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e1415-e103-4a8b-b3b8-b4106de3b239 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:01.276833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e1415-e103-4a8b-b3b8-b4106de3b239 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:01.294624 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 93/184] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:38:01 2022] GET /identity/v3/role_assignments?user.id=7c8e7c536115407885851d0e16fabe30&scope.project.id=f904bbcd8b2a4d0b890ebe4d29599454&role.id=1a212772e06344478184ce7d44a58b40 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:01.296281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7989f-b959-4581-93d6-d7ffaa8eccad None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:01.296566 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7989f-b959-4581-93d6-d7ffaa8eccad None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:01.296840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7989f-b959-4581-93d6-d7ffaa8eccad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:01.322147 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 92/185] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:01.323617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff61ef-e9a0-48c6-8ab2-147de0273078 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:01.331469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-2ff7989f-b959-4581-93d6-d7ffaa8eccad None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:01.332764 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2ff7989f-b959-4581-93d6-d7ffaa8eccad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:01.360840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:01.423924 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 94/186] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:01.424858 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7989f-b959-4581-93d6-d7ffaa8eccad None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:01.459894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff61ef-e9a0-48c6-8ab2-147de0273078 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:01.501092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a34987-eb3d-4be0-99ac-5d986db4f85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:01.502098 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a34987-eb3d-4be0-99ac-5d986db4f85c None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:01.502605 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a34987-eb3d-4be0-99ac-5d986db4f85c None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:01.503147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a34987-eb3d-4be0-99ac-5d986db4f85c None admin] PATH_INFO: `/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:01.504485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a34987-eb3d-4be0-99ac-5d986db4f85c None admin] RBAC: Authorizing `identity:get_project(project_id=e4eeeb6b2c9345388f01f51f75c671dc)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:01.506159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a34987-eb3d-4be0-99ac-5d986db4f85c None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:01.508078 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 93/187] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:38:01 2022] GET /identity/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:01.509629 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a34987-eb3d-4be0-99ac-5d986db4f85c None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:01.540095 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:01.558427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7989f-b959-4581-93d6-d7ffaa8eccad None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:01.597442 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421da33-5c13-4821-a356-7448bbcd8444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:01.598078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421da33-5c13-4821-a356-7448bbcd8444 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:01.598360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421da33-5c13-4821-a356-7448bbcd8444 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:01.598668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421da33-5c13-4821-a356-7448bbcd8444 None admin] PATH_INFO: `/v3/users/1c704a5306294252b088871a805ebff6` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:01.615037 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b421da33-5c13-4821-a356-7448bbcd8444 None admin] RBAC: Authorizing `identity:get_user(user_id=1c704a5306294252b088871a805ebff6)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:01.616440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b421da33-5c13-4821-a356-7448bbcd8444 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:01.618399 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 95/188] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:38:01 2022] GET /identity/v3/users/1c704a5306294252b088871a805ebff6 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:01.619161 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421da33-5c13-4821-a356-7448bbcd8444 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:01.623932 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:01.638681 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a34987-eb3d-4be0-99ac-5d986db4f85c None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:01.677727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e8aee-d994-49d2-9510-32056bc367b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:01.678410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e8aee-d994-49d2-9510-32056bc367b4 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:01.678772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e8aee-d994-49d2-9510-32056bc367b4 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:01.679093 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e8aee-d994-49d2-9510-32056bc367b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:01.680206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e8aee-d994-49d2-9510-32056bc367b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:01.681667 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e8aee-d994-49d2-9510-32056bc367b4 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:01.683440 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 94/189] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:01.688821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e8aee-d994-49d2-9510-32056bc367b4 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:01.738702 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421da33-5c13-4821-a356-7448bbcd8444 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:01.780855 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247b1f6-40f0-42c2-9c59-4301526d558b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:01.781489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247b1f6-40f0-42c2-9c59-4301526d558b None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:01.781760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247b1f6-40f0-42c2-9c59-4301526d558b None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:01.782029 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247b1f6-40f0-42c2-9c59-4301526d558b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:01.786955 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:01.794992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247b1f6-40f0-42c2-9c59-4301526d558b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:01.795119 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e8aee-d994-49d2-9510-32056bc367b4 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:01.800212 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-d247b1f6-40f0-42c2-9c59-4301526d558b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:38:01.800212 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:01.800212 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:01.800212 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:01.800212 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:01.800212 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:01.800212 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:01.800212 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:01.800212 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:01.800212 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:01.800212 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:01.800212 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:01.800212 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:01.800212 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:01.800212 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:01.800212 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:01.801096 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:01.801096 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:01.801096 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:01.801096 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:01.801096 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:01.801096 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:01.801096 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:01.801096 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:01.801096 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:01.801096 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:01.801096 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:01.801096 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:01.801096 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:01.801096 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:01.801096 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:01.801096 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:01.801970 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:01.801970 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:01.801970 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:01.801970 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:01.801970 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:01.801970 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:01.801970 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:01.801970 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:01.801970 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:01.801970 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:01.801970 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:38:01.801970 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:01.801970 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 96/190] 10.222.0.33 () {56 vars in 1114 bytes} [Sat Aug 6 20:38:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:01.802655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247b1f6-40f0-42c2-9c59-4301526d558b None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:01.836747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40ef63-2054-4322-b06d-cfaebcbf7349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:01.837450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40ef63-2054-4322-b06d-cfaebcbf7349 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:01.837781 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40ef63-2054-4322-b06d-cfaebcbf7349 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:01.838056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40ef63-2054-4322-b06d-cfaebcbf7349 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:01.838949 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40ef63-2054-4322-b06d-cfaebcbf7349 None admin] RBAC: Adding query filter params (role.id=b9254dbd663046739a1ba48d8c0027ad, scope.project.id=e4eeeb6b2c9345388f01f51f75c671dc, user.id=7c8e7c536115407885851d0e16fabe30) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:01.839261 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40ef63-2054-4322-b06d-cfaebcbf7349 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:01.841249 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40ef63-2054-4322-b06d-cfaebcbf7349 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:01.847442 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 95/191] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:38:01 2022] GET /identity/v3/role_assignments?user.id=7c8e7c536115407885851d0e16fabe30&scope.project.id=e4eeeb6b2c9345388f01f51f75c671dc&role.id=b9254dbd663046739a1ba48d8c0027ad => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:01.848452 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40ef63-2054-4322-b06d-cfaebcbf7349 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:01.878864 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:01.938991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247b1f6-40f0-42c2-9c59-4301526d558b None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:01.982971 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89f24d-18bd-4464-8ecb-5a40226a1472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:01.983350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89f24d-18bd-4464-8ecb-5a40226a1472 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:01.983559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89f24d-18bd-4464-8ecb-5a40226a1472 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:01.983850 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89f24d-18bd-4464-8ecb-5a40226a1472 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:01.990667 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40ef63-2054-4322-b06d-cfaebcbf7349 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:02.030889 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60b2cb-f165-421f-96dc-63a8162f4389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:02.032169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60b2cb-f165-421f-96dc-63a8162f4389 None admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:02.032832 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60b2cb-f165-421f-96dc-63a8162f4389 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:02.033508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60b2cb-f165-421f-96dc-63a8162f4389 None admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:02.034420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60b2cb-f165-421f-96dc-63a8162f4389 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:02.036112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60b2cb-f165-421f-96dc-63a8162f4389 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:02.061369 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 96/192] 10.222.0.33 () {60 vars in 1132 bytes} [Sat Aug 6 20:38:01 2022] POST /identity/v3/users => generated 297 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:38:02.062879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60b2cb-f165-421f-96dc-63a8162f4389 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:02.066715 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc89f24d-18bd-4464-8ecb-5a40226a1472 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:02.069147 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc89f24d-18bd-4464-8ecb-5a40226a1472 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:02.087763 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:02.166159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:02.211317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60b2cb-f165-421f-96dc-63a8162f4389 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:02.218904 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 97/193] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:38:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:02.220419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00bda7-0288-4685-8bd9-6c8b8a78ea06 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:02.220798 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00bda7-0288-4685-8bd9-6c8b8a78ea06 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:02.221148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00bda7-0288-4685-8bd9-6c8b8a78ea06 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:02.227493 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 98/194] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:02.227493 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00bda7-0288-4685-8bd9-6c8b8a78ea06 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:02.254595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93dab8e-c8db-4cab-8b68-375dac721f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:02.254595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93dab8e-c8db-4cab-8b68-375dac721f6c None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:02.254595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93dab8e-c8db-4cab-8b68-375dac721f6c None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:02.254953 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93dab8e-c8db-4cab-8b68-375dac721f6c None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:02.255424 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93dab8e-c8db-4cab-8b68-375dac721f6c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:02.255726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93dab8e-c8db-4cab-8b68-375dac721f6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:02.257116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93dab8e-c8db-4cab-8b68-375dac721f6c None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:02.267102 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 97/195] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:38:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:02.268352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0b6c8-6ea8-46e2-8428-85f88dd4585c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:02.268636 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0b6c8-6ea8-46e2-8428-85f88dd4585c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:02.268906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0b6c8-6ea8-46e2-8428-85f88dd4585c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:02.289292 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-47f0b6c8-6ea8-46e2-8428-85f88dd4585c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:02.290520 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-47f0b6c8-6ea8-46e2-8428-85f88dd4585c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:02.351714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00bda7-0288-4685-8bd9-6c8b8a78ea06 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:02.374128 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 98/196] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:02.374128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0b6c8-6ea8-46e2-8428-85f88dd4585c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:02.384747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:02.416701 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca73e5-45f0-4612-b0a7-ada44fb495a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:02.417275 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca73e5-45f0-4612-b0a7-ada44fb495a4 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:02.417555 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca73e5-45f0-4612-b0a7-ada44fb495a4 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:02.417826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca73e5-45f0-4612-b0a7-ada44fb495a4 None admin] PATH_INFO: `/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:02.419134 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca73e5-45f0-4612-b0a7-ada44fb495a4 None admin] RBAC: Authorizing `identity:get_project(project_id=cfb3fc3dc2a2444e8e451370bc40764d)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:02.420607 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca73e5-45f0-4612-b0a7-ada44fb495a4 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:02.422260 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 99/197] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:38:02 2022] GET /identity/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:02.423380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca73e5-45f0-4612-b0a7-ada44fb495a4 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:02.468152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:02.497242 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0b6c8-6ea8-46e2-8428-85f88dd4585c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:02.536803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988bb40-0d86-4cd8-ba33-7f31bbc4fc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:02.537440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988bb40-0d86-4cd8-ba33-7f31bbc4fc62 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:02.537715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988bb40-0d86-4cd8-ba33-7f31bbc4fc62 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:02.537984 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988bb40-0d86-4cd8-ba33-7f31bbc4fc62 None admin] PATH_INFO: `/v3/users/1c704a5306294252b088871a805ebff6` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:02.539254 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988bb40-0d86-4cd8-ba33-7f31bbc4fc62 None admin] RBAC: Authorizing `identity:get_user(user_id=1c704a5306294252b088871a805ebff6)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:02.540765 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988bb40-0d86-4cd8-ba33-7f31bbc4fc62 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:02.542497 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 99/198] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:38:02 2022] GET /identity/v3/users/1c704a5306294252b088871a805ebff6 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:02.547875 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988bb40-0d86-4cd8-ba33-7f31bbc4fc62 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:02.556185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca73e5-45f0-4612-b0a7-ada44fb495a4 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:02.607329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a0f19e-efd1-4e5e-9506-19113ac46736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:02.608303 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0f19e-efd1-4e5e-9506-19113ac46736 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:02.608643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0f19e-efd1-4e5e-9506-19113ac46736 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:02.608921 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0f19e-efd1-4e5e-9506-19113ac46736 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:02.624646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a0f19e-efd1-4e5e-9506-19113ac46736 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:02.630630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:02.631992 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-56a0f19e-efd1-4e5e-9506-19113ac46736 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:38:02.631992 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:02.631992 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:02.631992 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:02.631992 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:02.631992 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:02.631992 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:02.631992 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:02.631992 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:02.631992 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:02.631992 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:02.631992 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:02.631992 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:02.631992 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:02.631992 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:02.631992 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:02.633113 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:02.633113 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:02.633113 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:02.633113 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:02.633113 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:02.633113 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:02.633113 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:02.633113 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:02.633113 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:02.633113 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:02.633113 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:02.633113 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:02.633113 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:02.633113 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:02.633113 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:02.633113 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:02.634062 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:02.634062 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:02.634062 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:02.634062 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:02.634062 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:02.634062 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:02.634062 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:02.634062 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:02.634062 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:02.634062 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:02.634062 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:38:02.634062 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:02.634062 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 100/199] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:38:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:02.634847 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a0f19e-efd1-4e5e-9506-19113ac46736 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:02.681368 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988bb40-0d86-4cd8-ba33-7f31bbc4fc62 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:02.730214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc47c7-87ba-49e4-8e6d-c774a7c75006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:02.731802 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc47c7-87ba-49e4-8e6d-c774a7c75006 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:02.732415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc47c7-87ba-49e4-8e6d-c774a7c75006 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:02.733027 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc47c7-87ba-49e4-8e6d-c774a7c75006 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:02.734204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc47c7-87ba-49e4-8e6d-c774a7c75006 None admin] RBAC: Adding query filter params (role.id=ab245eea8a714462a00c4546309de9c9, scope.project.id=cfb3fc3dc2a2444e8e451370bc40764d, user.id=1c704a5306294252b088871a805ebff6) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:02.734755 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc47c7-87ba-49e4-8e6d-c774a7c75006 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:02.737148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc47c7-87ba-49e4-8e6d-c774a7c75006 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:02.745075 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 100/200] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:38:02 2022] GET /identity/v3/role_assignments?user.id=1c704a5306294252b088871a805ebff6&scope.project.id=cfb3fc3dc2a2444e8e451370bc40764d&role.id=ab245eea8a714462a00c4546309de9c9 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:02.746522 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:02.747634 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc47c7-87ba-49e4-8e6d-c774a7c75006 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:02.758643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a0f19e-efd1-4e5e-9506-19113ac46736 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:02.808028 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c96766-0b2b-4a4e-8217-363f0e0cfc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:02.809025 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c96766-0b2b-4a4e-8217-363f0e0cfc39 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:02.810392 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c96766-0b2b-4a4e-8217-363f0e0cfc39 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:02.811175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c96766-0b2b-4a4e-8217-363f0e0cfc39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:02.876735 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc47c7-87ba-49e4-8e6d-c774a7c75006 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:02.891693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c96766-0b2b-4a4e-8217-363f0e0cfc39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:02.893610 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c96766-0b2b-4a4e-8217-363f0e0cfc39 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:02.912487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff99a34-7739-4215-ab1c-d92d8360cfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:02.913083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff99a34-7739-4215-ab1c-d92d8360cfdd None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:02.913364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff99a34-7739-4215-ab1c-d92d8360cfdd None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:02.913635 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff99a34-7739-4215-ab1c-d92d8360cfdd None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:02.914314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff99a34-7739-4215-ab1c-d92d8360cfdd None admin] RBAC: Adding query filter params (name=reader) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:02.914672 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff99a34-7739-4215-ab1c-d92d8360cfdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:02.916049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff99a34-7739-4215-ab1c-d92d8360cfdd None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:02.922358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:02.926121 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 101/201] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Aug 6 20:38:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:02.936131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff99a34-7739-4215-ab1c-d92d8360cfdd None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:03.055022 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:03.071944 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff99a34-7739-4215-ab1c-d92d8360cfdd None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:03.089310 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 101/202] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:38:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:03.094923 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c96766-0b2b-4a4e-8217-363f0e0cfc39 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:03.120721 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb335296-aeff-4891-8276-4a41489e1c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:03.121728 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb335296-aeff-4891-8276-4a41489e1c3b None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:03.124364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb335296-aeff-4891-8276-4a41489e1c3b None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:03.126395 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb335296-aeff-4891-8276-4a41489e1c3b None admin] PATH_INFO: `/v3/users/da2eb7b6e50c4d688bb8ef505ee26ece` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:03.127878 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb335296-aeff-4891-8276-4a41489e1c3b None admin] RBAC: Authorizing `identity:get_user(user_id=da2eb7b6e50c4d688bb8ef505ee26ece)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:03.130436 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb335296-aeff-4891-8276-4a41489e1c3b None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:03.141392 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 102/203] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:38:02 2022] GET /identity/v3/users/da2eb7b6e50c4d688bb8ef505ee26ece => generated 289 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:03.142576 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb335296-aeff-4891-8276-4a41489e1c3b None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:03.233274 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:03.251519 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c96766-0b2b-4a4e-8217-363f0e0cfc39 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:03.270764 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb335296-aeff-4891-8276-4a41489e1c3b None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:03.289906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb7b01-1d86-46a7-8921-8290192f9830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:03.290888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb7b01-1d86-46a7-8921-8290192f9830 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:03.291469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb7b01-1d86-46a7-8921-8290192f9830 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:03.292046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb7b01-1d86-46a7-8921-8290192f9830 None admin] PATH_INFO: `/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:03.293368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb7b01-1d86-46a7-8921-8290192f9830 None admin] RBAC: Authorizing `identity:get_project(project_id=cfb3fc3dc2a2444e8e451370bc40764d)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:03.295931 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb7b01-1d86-46a7-8921-8290192f9830 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:03.298226 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 102/204] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:38:03 2022] GET /identity/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:03.303559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb7b01-1d86-46a7-8921-8290192f9830 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:03.306159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2675e09-b32c-4914-95ad-fef973f9f05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:03.306899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2675e09-b32c-4914-95ad-fef973f9f05b None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:03.307314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2675e09-b32c-4914-95ad-fef973f9f05b None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:03.307675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2675e09-b32c-4914-95ad-fef973f9f05b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:03.389762 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2675e09-b32c-4914-95ad-fef973f9f05b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:03.392198 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2675e09-b32c-4914-95ad-fef973f9f05b None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:03.394937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:03.470926 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:03.511152 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 103/205] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:38:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:03.517872 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2675e09-b32c-4914-95ad-fef973f9f05b None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:03.532529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb7b01-1d86-46a7-8921-8290192f9830 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:03.627096 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2675e09-b32c-4914-95ad-fef973f9f05b None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:03.659286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9266058-e2e8-4ec5-859a-2603e29460e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:03.659903 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9266058-e2e8-4ec5-859a-2603e29460e7 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:03.660203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9266058-e2e8-4ec5-859a-2603e29460e7 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:03.660449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9266058-e2e8-4ec5-859a-2603e29460e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:03.661181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9266058-e2e8-4ec5-859a-2603e29460e7 None admin] RBAC: Adding query filter params (role.id=b9254dbd663046739a1ba48d8c0027ad, scope.project.id=cfb3fc3dc2a2444e8e451370bc40764d, user.id=1c704a5306294252b088871a805ebff6) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:03.661487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9266058-e2e8-4ec5-859a-2603e29460e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:03.668070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9266058-e2e8-4ec5-859a-2603e29460e7 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:03.676775 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 103/206] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:38:03 2022] GET /identity/v3/role_assignments?user.id=1c704a5306294252b088871a805ebff6&scope.project.id=cfb3fc3dc2a2444e8e451370bc40764d&role.id=b9254dbd663046739a1ba48d8c0027ad => generated 259 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:03.678876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a1fc6-3930-4b00-9e9d-08ad4e398437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:03.679706 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a1fc6-3930-4b00-9e9d-08ad4e398437 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:03.680194 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a1fc6-3930-4b00-9e9d-08ad4e398437 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:03.680610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a1fc6-3930-4b00-9e9d-08ad4e398437 None admin] PATH_INFO: `/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:03.682020 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a1fc6-3930-4b00-9e9d-08ad4e398437 None admin] RBAC: Authorizing `identity:get_project(project_id=e4eeeb6b2c9345388f01f51f75c671dc)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:03.684162 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a1fc6-3930-4b00-9e9d-08ad4e398437 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:03.687426 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 104/207] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:38:03 2022] GET /identity/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:03.693720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9266058-e2e8-4ec5-859a-2603e29460e7 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:03.811717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9266058-e2e8-4ec5-859a-2603e29460e7 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:03.838494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:03.852741 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447564a-bc30-4482-89cf-5c18b51e4b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:03.853617 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447564a-bc30-4482-89cf-5c18b51e4b92 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:03.854091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447564a-bc30-4482-89cf-5c18b51e4b92 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:03.854507 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447564a-bc30-4482-89cf-5c18b51e4b92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:03.855533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9447564a-bc30-4482-89cf-5c18b51e4b92 None admin] RBAC: Adding query filter params (role.id=c136f425b8234bfda1c7a8a99fcdc614, scope.project.id=e4eeeb6b2c9345388f01f51f75c671dc, user.id=da2eb7b6e50c4d688bb8ef505ee26ece) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:03.856032 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9447564a-bc30-4482-89cf-5c18b51e4b92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:03.857866 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9447564a-bc30-4482-89cf-5c18b51e4b92 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:03.865024 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 104/208] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:38:03 2022] GET /identity/v3/role_assignments?user.id=da2eb7b6e50c4d688bb8ef505ee26ece&scope.project.id=e4eeeb6b2c9345388f01f51f75c671dc&role.id=c136f425b8234bfda1c7a8a99fcdc614 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:04.743137 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61923daa-f220-4f49-aa3f-71898f9cf404 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:04.744106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61923daa-f220-4f49-aa3f-71898f9cf404 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:04.744605 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61923daa-f220-4f49-aa3f-71898f9cf404 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:04.746161 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 105/209] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:04.751846 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608377c-918c-450a-b01c-2c40b3b3ed9b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:04.752676 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608377c-918c-450a-b01c-2c40b3b3ed9b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:04.753154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608377c-918c-450a-b01c-2c40b3b3ed9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:04.772585 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-8608377c-918c-450a-b01c-2c40b3b3ed9b None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:04.774085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8608377c-918c-450a-b01c-2c40b3b3ed9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:04.845138 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 105/210] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:38:04.870844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61923daa-f220-4f49-aa3f-71898f9cf404 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:04.911572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:04.986447 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61923daa-f220-4f49-aa3f-71898f9cf404 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:05.022252 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de8b95-8fef-4a10-9c31-f0bcd9c55586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:05.022928 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de8b95-8fef-4a10-9c31-f0bcd9c55586 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:05.023206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de8b95-8fef-4a10-9c31-f0bcd9c55586 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:05.023610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de8b95-8fef-4a10-9c31-f0bcd9c55586 None admin] PATH_INFO: `/v3/roles/member` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:05.025546 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf7639-a29d-427a-b0a5-7bf90cbcb34b None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:05.025826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf7639-a29d-427a-b0a5-7bf90cbcb34b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:05.026092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf7639-a29d-427a-b0a5-7bf90cbcb34b None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:05.027775 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 106/211] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:38:05.033581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcdaa3-7809-48b1-88ae-da3837567dca None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:05.033853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcdaa3-7809-48b1-88ae-da3837567dca None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:05.034131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcdaa3-7809-48b1-88ae-da3837567dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:05.036624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de8b95-8fef-4a10-9c31-f0bcd9c55586 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:05.042723 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-45de8b95-8fef-4a10-9c31-f0bcd9c55586 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:38:05.042723 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:05.042723 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:05.042723 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:05.042723 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:05.042723 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:05.042723 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:05.042723 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:05.042723 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:05.042723 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:05.042723 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:05.042723 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:05.042723 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:05.042723 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:05.042723 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:05.042723 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:05.043744 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:05.043744 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:05.043744 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:05.043744 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:05.043744 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:05.043744 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:05.043744 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:05.043744 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:05.043744 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:05.043744 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:05.043744 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:05.043744 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:05.043744 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:05.043744 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:05.043744 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:05.043744 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:05.045254 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:05.045254 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:05.045254 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:05.045254 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:05.045254 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:05.045254 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:05.045254 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:05.045254 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:05.045254 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:05.045254 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:05.045254 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:38:05.045254 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:05.045254 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 106/212] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:38:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:05.054073 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de8b95-8fef-4a10-9c31-f0bcd9c55586 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:05.056590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-3afcdaa3-7809-48b1-88ae-da3837567dca None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:05.057865 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3afcdaa3-7809-48b1-88ae-da3837567dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:05.134012 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 107/213] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:05.156586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afcdaa3-7809-48b1-88ae-da3837567dca None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:05.184719 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de8b95-8fef-4a10-9c31-f0bcd9c55586 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:05.202893 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:05.226524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:05.230330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df0c5d-6962-49bd-af06-14ecf8eac7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:05.232106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df0c5d-6962-49bd-af06-14ecf8eac7ff None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:05.232262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df0c5d-6962-49bd-af06-14ecf8eac7ff None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:05.232537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df0c5d-6962-49bd-af06-14ecf8eac7ff None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:05.233308 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df0c5d-6962-49bd-af06-14ecf8eac7ff None admin] RBAC: Adding query filter params (name=member) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:05.233694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df0c5d-6962-49bd-af06-14ecf8eac7ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:05.235189 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df0c5d-6962-49bd-af06-14ecf8eac7ff None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:05.250091 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 107/214] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Aug 6 20:38:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:05.251121 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df0c5d-6962-49bd-af06-14ecf8eac7ff None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:05.298600 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afcdaa3-7809-48b1-88ae-da3837567dca None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:05.348628 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb2431-d8e1-4af5-a4c0-fde154f802c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:05.349327 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb2431-d8e1-4af5-a4c0-fde154f802c0 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:05.349608 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb2431-d8e1-4af5-a4c0-fde154f802c0 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:05.349879 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb2431-d8e1-4af5-a4c0-fde154f802c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:05.351133 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb2431-d8e1-4af5-a4c0-fde154f802c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:05.352619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb2431-d8e1-4af5-a4c0-fde154f802c0 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:05.358831 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 108/215] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:05.361021 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb2431-d8e1-4af5-a4c0-fde154f802c0 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:05.380812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df0c5d-6962-49bd-af06-14ecf8eac7ff None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:05.422536 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a1ef4-e666-4de7-9578-a3f94b3bf1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:05.423551 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a1ef4-e666-4de7-9578-a3f94b3bf1cf None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:05.423755 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a1ef4-e666-4de7-9578-a3f94b3bf1cf None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:05.424026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a1ef4-e666-4de7-9578-a3f94b3bf1cf None admin] PATH_INFO: `/v3/users/d39097035c2246baa8e27ff38a69f4b8` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:05.439725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a1ef4-e666-4de7-9578-a3f94b3bf1cf None admin] RBAC: Authorizing `identity:get_user(user_id=d39097035c2246baa8e27ff38a69f4b8)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:05.441294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a1ef4-e666-4de7-9578-a3f94b3bf1cf None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:05.447655 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 108/216] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:38:05 2022] GET /identity/v3/users/d39097035c2246baa8e27ff38a69f4b8 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:05.448660 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a1ef4-e666-4de7-9578-a3f94b3bf1cf None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:05.469684 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:05.568282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a1ef4-e666-4de7-9578-a3f94b3bf1cf None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:05.605517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb2431-d8e1-4af5-a4c0-fde154f802c0 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:05.607503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19c407-293c-4208-9373-869f0b3a7ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:05.608116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19c407-293c-4208-9373-869f0b3a7ab4 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:05.608390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19c407-293c-4208-9373-869f0b3a7ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:05.608659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19c407-293c-4208-9373-869f0b3a7ab4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:05.624743 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:05.644712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b527632-7066-49a0-9d30-0d26f74600b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:05.645322 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b527632-7066-49a0-9d30-0d26f74600b9 None admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:05.645602 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b527632-7066-49a0-9d30-0d26f74600b9 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:05.645864 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b527632-7066-49a0-9d30-0d26f74600b9 None admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:05.646523 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b527632-7066-49a0-9d30-0d26f74600b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:05.647981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b527632-7066-49a0-9d30-0d26f74600b9 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:05.674961 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 109/217] 10.222.0.33 () {60 vars in 1132 bytes} [Sat Aug 6 20:38:05 2022] POST /identity/v3/users => generated 297 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:38:05.676229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555308b1-79c8-47af-b3b3-8bf5901f3deb None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:05.676516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555308b1-79c8-47af-b3b3-8bf5901f3deb None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:05.676790 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555308b1-79c8-47af-b3b3-8bf5901f3deb None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:05.678019 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 110/218] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:05.687549 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ef146-fcdd-4c2e-a8a5-21c96e8b57a2 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:05.687913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ef146-fcdd-4c2e-a8a5-21c96e8b57a2 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:05.688106 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ef146-fcdd-4c2e-a8a5-21c96e8b57a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:05.703245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19c407-293c-4208-9373-869f0b3a7ab4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:05.705860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19c407-293c-4208-9373-869f0b3a7ab4 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:05.712874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-519ef146-fcdd-4c2e-a8a5-21c96e8b57a2 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:05.716312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-519ef146-fcdd-4c2e-a8a5-21c96e8b57a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:05.730108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:05.795212 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 111/219] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:05.821165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ef146-fcdd-4c2e-a8a5-21c96e8b57a2 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:05.837447 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 109/220] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:38:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:05.843704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19c407-293c-4208-9373-869f0b3a7ab4 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:05.957944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ef146-fcdd-4c2e-a8a5-21c96e8b57a2 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:05.959745 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:05.987966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19c407-293c-4208-9373-869f0b3a7ab4 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:06.009757 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:06.018128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e074e4f-aac1-4d2e-a67a-19714e2faa70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:06.018828 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e074e4f-aac1-4d2e-a67a-19714e2faa70 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:06.019114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e074e4f-aac1-4d2e-a67a-19714e2faa70 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:06.019398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e074e4f-aac1-4d2e-a67a-19714e2faa70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:06.037027 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e074e4f-aac1-4d2e-a67a-19714e2faa70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:06.039357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0eaea6-adf9-424b-9054-b72b93ec5ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:06.040239 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0eaea6-adf9-424b-9054-b72b93ec5ca5 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:06.040696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0eaea6-adf9-424b-9054-b72b93ec5ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:06.041155 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0eaea6-adf9-424b-9054-b72b93ec5ca5 None admin] PATH_INFO: `/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:06.042470 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-0e074e4f-aac1-4d2e-a67a-19714e2faa70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:38:06.042470 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:06.042470 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:06.042470 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:06.042470 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:06.042470 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:06.042470 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:06.042470 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:06.042470 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:06.042470 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:06.042470 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:06.042470 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:06.042470 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:06.042470 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:06.042470 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:06.042470 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:06.044143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:06.044143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:06.044143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:06.044143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:06.044143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:06.044143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:06.044143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:06.044143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:06.044143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:06.044143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:06.044143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:06.044143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:06.044143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:06.044143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:06.044143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:06.044143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:06.045092 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:06.045092 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:06.045092 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:06.045092 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:06.045092 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:06.045092 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:06.045092 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:06.045092 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:06.045092 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:06.045092 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:06.045092 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:38:06.045092 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:06.045092 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 112/221] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Aug 6 20:38:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:38:06.048433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0eaea6-adf9-424b-9054-b72b93ec5ca5 None admin] RBAC: Authorizing `identity:get_project(project_id=cfb3fc3dc2a2444e8e451370bc40764d)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:06.050248 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0eaea6-adf9-424b-9054-b72b93ec5ca5 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:06.050529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6291ba7-1951-4fe2-86da-7a10cb55e852 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:06.050839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6291ba7-1951-4fe2-86da-7a10cb55e852 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:06.051114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6291ba7-1951-4fe2-86da-7a10cb55e852 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:06.054580 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 113/222] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:06.058049 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 110/223] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:38:05 2022] GET /identity/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:06.059180 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6291ba7-1951-4fe2-86da-7a10cb55e852 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:06.061147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f40441-56e0-4f94-9f29-3217b5f8da59 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:06.061772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f40441-56e0-4f94-9f29-3217b5f8da59 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:06.062057 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f40441-56e0-4f94-9f29-3217b5f8da59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:06.092007 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-c9f40441-56e0-4f94-9f29-3217b5f8da59 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:06.093476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c9f40441-56e0-4f94-9f29-3217b5f8da59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:06.178689 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 111/224] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:06.179657 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f40441-56e0-4f94-9f29-3217b5f8da59 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:06.209419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6291ba7-1951-4fe2-86da-7a10cb55e852 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:06.246271 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a85ece-72da-4e7f-91e0-a18d08b51797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:06.247618 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a85ece-72da-4e7f-91e0-a18d08b51797 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:06.247895 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a85ece-72da-4e7f-91e0-a18d08b51797 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:06.248159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a85ece-72da-4e7f-91e0-a18d08b51797 None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:06.248832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a85ece-72da-4e7f-91e0-a18d08b51797 None admin] RBAC: Adding query filter params (name=admin) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:06.249128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a85ece-72da-4e7f-91e0-a18d08b51797 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:06.250502 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a85ece-72da-4e7f-91e0-a18d08b51797 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:06.259071 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 114/225] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:38:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:06.259901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a85ece-72da-4e7f-91e0-a18d08b51797 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:06.285513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:06.306704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f40441-56e0-4f94-9f29-3217b5f8da59 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:06.323009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:06.347711 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe73f4-1416-4e52-b372-bcd898e00121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:06.348613 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe73f4-1416-4e52-b372-bcd898e00121 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:06.349052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe73f4-1416-4e52-b372-bcd898e00121 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:06.349479 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe73f4-1416-4e52-b372-bcd898e00121 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:06.350343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe73f4-1416-4e52-b372-bcd898e00121 None admin] RBAC: Adding query filter params (role.id=1a212772e06344478184ce7d44a58b40, scope.project.id=cfb3fc3dc2a2444e8e451370bc40764d, user.id=d39097035c2246baa8e27ff38a69f4b8) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:06.350966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe73f4-1416-4e52-b372-bcd898e00121 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:06.352604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe73f4-1416-4e52-b372-bcd898e00121 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:06.359743 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 112/226] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:38:06 2022] GET /identity/v3/role_assignments?user.id=d39097035c2246baa8e27ff38a69f4b8&scope.project.id=cfb3fc3dc2a2444e8e451370bc40764d&role.id=1a212772e06344478184ce7d44a58b40 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:06.360823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe73f4-1416-4e52-b372-bcd898e00121 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:06.362874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a85ece-72da-4e7f-91e0-a18d08b51797 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:06.400079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1892c9-213f-48c3-bfd5-f03aba885b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:06.400729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1892c9-213f-48c3-bfd5-f03aba885b8a None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:06.401003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1892c9-213f-48c3-bfd5-f03aba885b8a None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:06.401267 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1892c9-213f-48c3-bfd5-f03aba885b8a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:06.413913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1892c9-213f-48c3-bfd5-f03aba885b8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:06.419579 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-6b1892c9-213f-48c3-bfd5-f03aba885b8a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:38:06.419579 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:06.419579 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:06.419579 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:06.419579 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:06.419579 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:06.419579 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:06.419579 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:06.419579 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:06.419579 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:06.419579 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:06.419579 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:06.419579 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:06.419579 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:06.419579 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:06.419579 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:06.420746 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:06.420746 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:06.420746 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:06.420746 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:06.420746 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:06.420746 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:06.420746 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:06.420746 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:06.420746 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:06.420746 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:06.420746 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:06.420746 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:06.420746 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:06.420746 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:06.420746 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:06.420746 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:06.421721 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:06.421721 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:06.421721 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:06.421721 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:06.421721 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:06.421721 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:06.421721 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:06.421721 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:06.421721 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:06.421721 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:06.421721 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:38:06.421721 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:06.421721 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 115/227] 10.222.0.33 () {56 vars in 1114 bytes} [Sat Aug 6 20:38:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:06.427054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1892c9-213f-48c3-bfd5-f03aba885b8a None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:06.487782 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe73f4-1416-4e52-b372-bcd898e00121 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:06.521066 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:06.529440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a5fac-5914-40fc-bed8-1c99e17bfda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:06.530357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a5fac-5914-40fc-bed8-1c99e17bfda2 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:06.530825 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a5fac-5914-40fc-bed8-1c99e17bfda2 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:06.531343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a5fac-5914-40fc-bed8-1c99e17bfda2 None admin] PATH_INFO: `/v3/users/1c704a5306294252b088871a805ebff6` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:06.532773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5a5fac-5914-40fc-bed8-1c99e17bfda2 None admin] RBAC: Authorizing `identity:get_user(user_id=1c704a5306294252b088871a805ebff6)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:06.534581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5a5fac-5914-40fc-bed8-1c99e17bfda2 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:06.536789 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 113/228] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:38:06 2022] GET /identity/v3/users/1c704a5306294252b088871a805ebff6 => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:06.537860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1892c9-213f-48c3-bfd5-f03aba885b8a None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:06.545539 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a5fac-5914-40fc-bed8-1c99e17bfda2 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:06.575446 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ee00f-0ce6-425d-9999-c5fb39ffd559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:06.576103 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ee00f-0ce6-425d-9999-c5fb39ffd559 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:06.576369 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ee00f-0ce6-425d-9999-c5fb39ffd559 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:06.576635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ee00f-0ce6-425d-9999-c5fb39ffd559 None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:06.577304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ee00f-0ce6-425d-9999-c5fb39ffd559 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:06.577601 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ee00f-0ce6-425d-9999-c5fb39ffd559 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:06.579219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ee00f-0ce6-425d-9999-c5fb39ffd559 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:06.587812 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 116/229] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:38:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:06.593563 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ee00f-0ce6-425d-9999-c5fb39ffd559 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:06.603734 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:06.673483 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a5fac-5914-40fc-bed8-1c99e17bfda2 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:06.719161 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897e02f-d5ac-445a-a028-41e153a4e990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:06.720693 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897e02f-d5ac-445a-a028-41e153a4e990 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:06.721175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897e02f-d5ac-445a-a028-41e153a4e990 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:06.722059 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897e02f-d5ac-445a-a028-41e153a4e990 None admin] PATH_INFO: `/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:06.723762 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897e02f-d5ac-445a-a028-41e153a4e990 None admin] RBAC: Authorizing `identity:get_project(project_id=cfb3fc3dc2a2444e8e451370bc40764d)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:06.726301 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897e02f-d5ac-445a-a028-41e153a4e990 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:06.728732 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 114/230] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:38:06 2022] GET /identity/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:06.738477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897e02f-d5ac-445a-a028-41e153a4e990 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:06.752624 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ee00f-0ce6-425d-9999-c5fb39ffd559 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:06.836068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d34704-2ab0-4a8d-80bd-fa262371225e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:06.836831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d34704-2ab0-4a8d-80bd-fa262371225e None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:06.837040 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d34704-2ab0-4a8d-80bd-fa262371225e None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:06.837325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d34704-2ab0-4a8d-80bd-fa262371225e None admin] PATH_INFO: `/v3/users/1c704a5306294252b088871a805ebff6` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:06.842138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d34704-2ab0-4a8d-80bd-fa262371225e None admin] RBAC: Authorizing `identity:get_user(user_id=1c704a5306294252b088871a805ebff6)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:06.846011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d34704-2ab0-4a8d-80bd-fa262371225e None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:06.848066 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 117/231] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:38:06 2022] GET /identity/v3/users/1c704a5306294252b088871a805ebff6 => generated 283 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:06.853277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d34704-2ab0-4a8d-80bd-fa262371225e None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:06.859500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897e02f-d5ac-445a-a028-41e153a4e990 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:06.876764 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:06.886831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:06.908442 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fc6de-c183-4832-b594-cc9d40741fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:06.910422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fc6de-c183-4832-b594-cc9d40741fce None admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:06.912167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fc6de-c183-4832-b594-cc9d40741fce None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:06.912927 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fc6de-c183-4832-b594-cc9d40741fce None admin] PATH_INFO: `/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d/users/1c704a5306294252b088871a805ebff6/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:06.916899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857fc6de-c183-4832-b594-cc9d40741fce None admin] RBAC: Authorizing `identity:create_grant(project_id=cfb3fc3dc2a2444e8e451370bc40764d, user_id=1c704a5306294252b088871a805ebff6, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:06.922478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857fc6de-c183-4832-b594-cc9d40741fce None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:06.945039 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 115/232] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Aug 6 20:38:06 2022] PUT /identity/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d/users/1c704a5306294252b088871a805ebff6/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:38:07.013100 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d34704-2ab0-4a8d-80bd-fa262371225e None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:07.051918 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dad96d-ac0e-414e-bcf0-5799900278bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:07.052892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dad96d-ac0e-414e-bcf0-5799900278bf None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:07.053417 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dad96d-ac0e-414e-bcf0-5799900278bf None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:07.053910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dad96d-ac0e-414e-bcf0-5799900278bf None admin] PATH_INFO: `/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:07.055342 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dad96d-ac0e-414e-bcf0-5799900278bf None admin] RBAC: Authorizing `identity:get_project(project_id=cfb3fc3dc2a2444e8e451370bc40764d)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:07.057024 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dad96d-ac0e-414e-bcf0-5799900278bf None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:07.059492 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 118/233] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:38:06 2022] GET /identity/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:07.065566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fc6de-c183-4832-b594-cc9d40741fce None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:07.204994 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fc6de-c183-4832-b594-cc9d40741fce None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:07.243687 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3031d0-55c2-4fe3-8c63-d72b7a99bc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:07.244359 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3031d0-55c2-4fe3-8c63-d72b7a99bc20 None admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:07.244633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3031d0-55c2-4fe3-8c63-d72b7a99bc20 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:07.244903 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3031d0-55c2-4fe3-8c63-d72b7a99bc20 None admin] PATH_INFO: `/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d/users/1c704a5306294252b088871a805ebff6/roles/b9254dbd663046739a1ba48d8c0027ad` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:07.247228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3031d0-55c2-4fe3-8c63-d72b7a99bc20 None admin] RBAC: Authorizing `identity:create_grant(project_id=cfb3fc3dc2a2444e8e451370bc40764d, user_id=1c704a5306294252b088871a805ebff6, role_id=b9254dbd663046739a1ba48d8c0027ad)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:07.248744 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3031d0-55c2-4fe3-8c63-d72b7a99bc20 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:07.265664 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 116/234] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Aug 6 20:38:07 2022] PUT /identity/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d/users/1c704a5306294252b088871a805ebff6/roles/b9254dbd663046739a1ba48d8c0027ad => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:08.670377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753ab72-c414-4deb-a20e-3f79d78acc4f None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:08.670956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753ab72-c414-4deb-a20e-3f79d78acc4f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:08.670956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753ab72-c414-4deb-a20e-3f79d78acc4f None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:08.673547 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 119/235] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:08.678125 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28ae33-c018-4753-a842-c3c6690c194b None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:08.678515 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28ae33-c018-4753-a842-c3c6690c194b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:08.678705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28ae33-c018-4753-a842-c3c6690c194b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:08.704835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-0b28ae33-c018-4753-a842-c3c6690c194b None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:08.706025 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0b28ae33-c018-4753-a842-c3c6690c194b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:08.749182 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:08.752974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386ed65-2952-4084-a377-966c032dce4a None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:08.753250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386ed65-2952-4084-a377-966c032dce4a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:08.753519 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386ed65-2952-4084-a377-966c032dce4a None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:08.755135 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 120/236] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:08.764770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc700f86-d6df-4b26-acb1-6727d6b2bb9c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:08.765053 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc700f86-d6df-4b26-acb1-6727d6b2bb9c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:08.765520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc700f86-d6df-4b26-acb1-6727d6b2bb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:08.793039 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-dc700f86-d6df-4b26-acb1-6727d6b2bb9c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:08.794865 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-dc700f86-d6df-4b26-acb1-6727d6b2bb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:08.819890 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 117/237] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:08.848754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28ae33-c018-4753-a842-c3c6690c194b None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:08.951657 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 121/238] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:08.999092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28ae33-c018-4753-a842-c3c6690c194b None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:09.005306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc700f86-d6df-4b26-acb1-6727d6b2bb9c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:09.027065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:09.058246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3b09a-269a-4213-a818-25125c1015a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:09.059329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3b09a-269a-4213-a818-25125c1015a6 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:09.060358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3b09a-269a-4213-a818-25125c1015a6 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:09.060831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3b09a-269a-4213-a818-25125c1015a6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:09.072386 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3b09a-269a-4213-a818-25125c1015a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:09.086878 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-fbd3b09a-269a-4213-a818-25125c1015a6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:38:09.086878 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:09.086878 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:09.086878 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:09.086878 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:09.086878 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:09.086878 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:09.086878 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:09.086878 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:09.086878 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:09.086878 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:09.086878 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:09.086878 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:09.086878 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:09.086878 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:09.086878 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:09.087808 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:09.087808 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:09.087808 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:09.087808 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:09.087808 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:09.087808 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:09.087808 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:09.087808 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:09.087808 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:09.087808 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:09.087808 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:09.087808 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:09.087808 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:09.087808 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:09.087808 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:09.087808 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:09.088626 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:09.088626 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:09.088626 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:09.088626 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:09.088626 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:09.088626 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:09.088626 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:09.088626 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:09.088626 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:09.088626 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:09.088626 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:38:09.088626 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:09.092199 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 118/239] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:38:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:38:09.094084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c1d04-4786-45b9-963a-5c16009601a8 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:09.094625 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c1d04-4786-45b9-963a-5c16009601a8 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:09.095103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c1d04-4786-45b9-963a-5c16009601a8 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:09.097970 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 119/240] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:38:09.099054 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c1d04-4786-45b9-963a-5c16009601a8 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:09.121565 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc700f86-d6df-4b26-acb1-6727d6b2bb9c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:09.129574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:09.159608 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b0e8f-eb0c-45d4-8fa3-c71856f0f504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:09.160475 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b0e8f-eb0c-45d4-8fa3-c71856f0f504 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:09.160920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b0e8f-eb0c-45d4-8fa3-c71856f0f504 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:09.161377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b0e8f-eb0c-45d4-8fa3-c71856f0f504 None admin] PATH_INFO: `/v3/domains/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:09.162682 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b0e8f-eb0c-45d4-8fa3-c71856f0f504 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:09.164306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b0e8f-eb0c-45d4-8fa3-c71856f0f504 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:09.166001 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 122/241] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:09.167382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b8596-29c9-41ea-8993-b4a3bc335e58 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:09.167868 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b8596-29c9-41ea-8993-b4a3bc335e58 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:09.168417 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b8596-29c9-41ea-8993-b4a3bc335e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:09.188133 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-495b8596-29c9-41ea-8993-b4a3bc335e58 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:09.189671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-495b8596-29c9-41ea-8993-b4a3bc335e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:09.226852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c1d04-4786-45b9-963a-5c16009601a8 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:09.263114 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 123/242] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:09.264403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b8596-29c9-41ea-8993-b4a3bc335e58 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:09.267064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480b099-47bb-4a26-a6e5-44b3b51d5a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:09.267723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480b099-47bb-4a26-a6e5-44b3b51d5a99 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:09.268762 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480b099-47bb-4a26-a6e5-44b3b51d5a99 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:09.273835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480b099-47bb-4a26-a6e5-44b3b51d5a99 None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:09.274531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6480b099-47bb-4a26-a6e5-44b3b51d5a99 None admin] RBAC: Adding query filter params (name=reader) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:09.274877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6480b099-47bb-4a26-a6e5-44b3b51d5a99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:09.276505 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6480b099-47bb-4a26-a6e5-44b3b51d5a99 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:09.279025 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:09.296848 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 120/243] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Aug 6 20:38:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:09.302350 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480b099-47bb-4a26-a6e5-44b3b51d5a99 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:09.379934 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b8596-29c9-41ea-8993-b4a3bc335e58 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:09.407175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:09.420327 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815dcf2-20d0-483c-aa2f-a3bba101976d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:09.421859 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815dcf2-20d0-483c-aa2f-a3bba101976d None admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:09.422639 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815dcf2-20d0-483c-aa2f-a3bba101976d None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:09.423111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815dcf2-20d0-483c-aa2f-a3bba101976d None admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:09.423937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6815dcf2-20d0-483c-aa2f-a3bba101976d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:09.424307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480b099-47bb-4a26-a6e5-44b3b51d5a99 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:09.426134 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6815dcf2-20d0-483c-aa2f-a3bba101976d None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:09.455059 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 124/244] 10.222.0.33 () {60 vars in 1132 bytes} [Sat Aug 6 20:38:09 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:38:09.456411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815dcf2-20d0-483c-aa2f-a3bba101976d None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:09.483424 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3ac0a-1bfc-4d62-844c-26fdddb43921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:09.484703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3ac0a-1bfc-4d62-844c-26fdddb43921 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:09.485280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3ac0a-1bfc-4d62-844c-26fdddb43921 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:09.486206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3ac0a-1bfc-4d62-844c-26fdddb43921 None admin] PATH_INFO: `/v3/users/b086f37d4fa9485daf06b0d957badc0e` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:09.518127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3ac0a-1bfc-4d62-844c-26fdddb43921 None admin] RBAC: Authorizing `identity:get_user(user_id=b086f37d4fa9485daf06b0d957badc0e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:09.520957 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3ac0a-1bfc-4d62-844c-26fdddb43921 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:09.526584 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 121/245] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:38:09 2022] GET /identity/v3/users/b086f37d4fa9485daf06b0d957badc0e => generated 297 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:09.530852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3ac0a-1bfc-4d62-844c-26fdddb43921 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:09.638732 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:09.661566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3ac0a-1bfc-4d62-844c-26fdddb43921 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:09.709122 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021aa4d-892c-4691-a402-feb8cf8d712b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:09.710735 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021aa4d-892c-4691-a402-feb8cf8d712b None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:09.711224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021aa4d-892c-4691-a402-feb8cf8d712b None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:09.711684 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021aa4d-892c-4691-a402-feb8cf8d712b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:09.725070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815dcf2-20d0-483c-aa2f-a3bba101976d None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:09.732686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:09.770292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851ddab-88ad-449b-b443-316fed7e585c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:09.770912 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851ddab-88ad-449b-b443-316fed7e585c None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:09.771199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851ddab-88ad-449b-b443-316fed7e585c None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:09.771473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851ddab-88ad-449b-b443-316fed7e585c None admin] PATH_INFO: `/v3/roles/member` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:09.783924 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851ddab-88ad-449b-b443-316fed7e585c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:09.789370 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-d851ddab-88ad-449b-b443-316fed7e585c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:38:09.789370 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:09.789370 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:09.789370 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:09.789370 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:09.789370 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:09.789370 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:09.789370 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:09.789370 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:09.789370 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:09.789370 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:09.789370 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:09.789370 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:09.789370 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:09.789370 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:09.789370 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:09.790266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:09.790266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:09.790266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:09.790266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:09.790266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:09.790266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:09.790266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:09.790266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:09.790266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:09.790266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:09.790266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:09.790266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:09.790266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:09.790266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:09.790266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:09.790266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:09.791103 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:09.791103 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:09.791103 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:09.791103 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:09.791103 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:09.791103 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:09.791103 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:09.791103 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:09.791103 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:09.791103 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:09.791103 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:38:09.791103 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:09.791103 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 125/246] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:38:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:09.798577 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851ddab-88ad-449b-b443-316fed7e585c None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:09.808095 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2021aa4d-892c-4691-a402-feb8cf8d712b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:09.810797 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2021aa4d-892c-4691-a402-feb8cf8d712b None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:09.927760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851ddab-88ad-449b-b443-316fed7e585c None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:09.951641 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 122/247] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:38:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:09.953267 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23128604-4d28-4567-96e7-52e0f78d95c8 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:09.953740 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23128604-4d28-4567-96e7-52e0f78d95c8 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:09.954175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23128604-4d28-4567-96e7-52e0f78d95c8 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:09.955773 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 123/248] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:09.961469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad513367-e05e-422d-8bbc-6e7a1e916c9c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:09.961749 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad513367-e05e-422d-8bbc-6e7a1e916c9c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:09.962017 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad513367-e05e-422d-8bbc-6e7a1e916c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:09.964117 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:09.976877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350d84d-4112-45ec-8f27-c64b9131aacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:09.977495 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350d84d-4112-45ec-8f27-c64b9131aacb None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:09.977777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350d84d-4112-45ec-8f27-c64b9131aacb None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:09.978101 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350d84d-4112-45ec-8f27-c64b9131aacb None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:09.978820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350d84d-4112-45ec-8f27-c64b9131aacb None admin] RBAC: Adding query filter params (name=member) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:09.979121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350d84d-4112-45ec-8f27-c64b9131aacb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:09.980495 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350d84d-4112-45ec-8f27-c64b9131aacb None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:09.984981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-ad513367-e05e-422d-8bbc-6e7a1e916c9c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:09.986167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ad513367-e05e-422d-8bbc-6e7a1e916c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:09.990179 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 126/249] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Aug 6 20:38:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:09.990937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350d84d-4112-45ec-8f27-c64b9131aacb None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:10.038750 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:10.077109 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 124/250] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:38:10.078016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad513367-e05e-422d-8bbc-6e7a1e916c9c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:10.129624 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350d84d-4112-45ec-8f27-c64b9131aacb None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:10.171214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5d47d-32c6-445c-80fb-6a690c6c8516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:10.171926 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5d47d-32c6-445c-80fb-6a690c6c8516 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:10.172207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5d47d-32c6-445c-80fb-6a690c6c8516 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:10.172482 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5d47d-32c6-445c-80fb-6a690c6c8516 None admin] PATH_INFO: `/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:10.173684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5d47d-32c6-445c-80fb-6a690c6c8516 None admin] RBAC: Authorizing `identity:get_project(project_id=cfb3fc3dc2a2444e8e451370bc40764d)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:10.175185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5d47d-32c6-445c-80fb-6a690c6c8516 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:10.176940 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 127/251] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:38:09 2022] GET /identity/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:10.178100 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c9b2c-3ad2-42a0-ac70-424f57fe4282 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:10.178382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c9b2c-3ad2-42a0-ac70-424f57fe4282 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:10.178677 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c9b2c-3ad2-42a0-ac70-424f57fe4282 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:10.180243 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 128/252] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:10.186209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c9b2c-3ad2-42a0-ac70-424f57fe4282 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:10.204770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad513367-e05e-422d-8bbc-6e7a1e916c9c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:10.240176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea8795-23d1-444d-bab6-ee0f1e9c56b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:10.240820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea8795-23d1-444d-bab6-ee0f1e9c56b6 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:10.241097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea8795-23d1-444d-bab6-ee0f1e9c56b6 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:10.241369 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea8795-23d1-444d-bab6-ee0f1e9c56b6 None admin] PATH_INFO: `/v3/users/d39097035c2246baa8e27ff38a69f4b8` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:10.242500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea8795-23d1-444d-bab6-ee0f1e9c56b6 None admin] RBAC: Authorizing `identity:get_user(user_id=d39097035c2246baa8e27ff38a69f4b8)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:10.243984 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea8795-23d1-444d-bab6-ee0f1e9c56b6 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:10.245607 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 125/253] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:38:10 2022] GET /identity/v3/users/d39097035c2246baa8e27ff38a69f4b8 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:10.246923 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea8795-23d1-444d-bab6-ee0f1e9c56b6 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:10.263018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:10.292049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:10.301816 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c9b2c-3ad2-42a0-ac70-424f57fe4282 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:10.338648 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c5c07-8dd2-4037-8173-783a420f9805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:10.339714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c5c07-8dd2-4037-8173-783a420f9805 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:10.340825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c5c07-8dd2-4037-8173-783a420f9805 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:10.341734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c5c07-8dd2-4037-8173-783a420f9805 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:10.353062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea8795-23d1-444d-bab6-ee0f1e9c56b6 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:10.353958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c5c07-8dd2-4037-8173-783a420f9805 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:10.360035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-867c5c07-8dd2-4037-8173-783a420f9805 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:38:10.360035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:10.360035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:10.360035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:10.360035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:10.360035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:10.360035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:10.360035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:10.360035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:10.360035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:10.360035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:10.360035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:10.360035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:10.360035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:10.360035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:10.360035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:10.360952 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:10.360952 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:10.360952 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:10.360952 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:10.360952 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:10.360952 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:10.360952 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:10.360952 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:10.360952 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:10.360952 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:10.360952 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:10.360952 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:10.360952 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:10.360952 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:10.360952 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:10.360952 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:10.361736 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:10.361736 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:10.361736 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:10.361736 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:10.361736 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:10.361736 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:10.361736 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:10.361736 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:10.361736 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:10.361736 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:10.361736 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:38:10.361736 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:10.364266 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 129/254] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Aug 6 20:38:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:10.365614 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828c85f-d8ff-4202-a2ee-74ddc55a795b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:10.366067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828c85f-d8ff-4202-a2ee-74ddc55a795b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:10.366505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828c85f-d8ff-4202-a2ee-74ddc55a795b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:10.384955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-5828c85f-d8ff-4202-a2ee-74ddc55a795b None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:10.386465 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5828c85f-d8ff-4202-a2ee-74ddc55a795b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:10.391111 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbca3c7-31db-4f39-a761-02c9305ecc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:10.391111 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbca3c7-31db-4f39-a761-02c9305ecc27 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:10.391396 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbca3c7-31db-4f39-a761-02c9305ecc27 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:10.391792 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbca3c7-31db-4f39-a761-02c9305ecc27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:10.392592 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbca3c7-31db-4f39-a761-02c9305ecc27 None admin] RBAC: Adding query filter params (role.id=c136f425b8234bfda1c7a8a99fcdc614, scope.project.id=cfb3fc3dc2a2444e8e451370bc40764d, user.id=b086f37d4fa9485daf06b0d957badc0e) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:10.392966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbca3c7-31db-4f39-a761-02c9305ecc27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:10.394499 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbca3c7-31db-4f39-a761-02c9305ecc27 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:10.400838 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 126/255] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:38:10 2022] GET /identity/v3/role_assignments?user.id=b086f37d4fa9485daf06b0d957badc0e&scope.project.id=cfb3fc3dc2a2444e8e451370bc40764d&role.id=c136f425b8234bfda1c7a8a99fcdc614 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:10.401756 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbca3c7-31db-4f39-a761-02c9305ecc27 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:10.497202 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 130/256] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:10.505338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828c85f-d8ff-4202-a2ee-74ddc55a795b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:10.577292 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbca3c7-31db-4f39-a761-02c9305ecc27 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:10.585141 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:10.587348 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:10.645024 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530dcc64-2d50-4e90-8044-2558808e0fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:10.645660 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530dcc64-2d50-4e90-8044-2558808e0fa1 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:10.645937 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530dcc64-2d50-4e90-8044-2558808e0fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:10.646200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530dcc64-2d50-4e90-8044-2558808e0fa1 None admin] PATH_INFO: `/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:10.647446 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530dcc64-2d50-4e90-8044-2558808e0fa1 None admin] RBAC: Authorizing `identity:get_project(project_id=cfb3fc3dc2a2444e8e451370bc40764d)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:10.650276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530dcc64-2d50-4e90-8044-2558808e0fa1 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:10.651945 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 127/257] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:38:10 2022] GET /identity/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:10.653314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530dcc64-2d50-4e90-8044-2558808e0fa1 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:10.680220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828c85f-d8ff-4202-a2ee-74ddc55a795b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:10.745840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23eaef-f55d-4e2d-b5b1-3e87e0191d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:10.748229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23eaef-f55d-4e2d-b5b1-3e87e0191d38 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:10.748513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23eaef-f55d-4e2d-b5b1-3e87e0191d38 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:10.748783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23eaef-f55d-4e2d-b5b1-3e87e0191d38 None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:10.749453 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d23eaef-f55d-4e2d-b5b1-3e87e0191d38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:10.749753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d23eaef-f55d-4e2d-b5b1-3e87e0191d38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:10.751375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d23eaef-f55d-4e2d-b5b1-3e87e0191d38 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:10.768202 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 131/258] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:38:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:10.769051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23eaef-f55d-4e2d-b5b1-3e87e0191d38 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:10.844916 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530dcc64-2d50-4e90-8044-2558808e0fa1 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:10.908626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5be0f-53d7-4b0c-9852-a5c96aceaf86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:10.909252 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5be0f-53d7-4b0c-9852-a5c96aceaf86 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:10.909526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5be0f-53d7-4b0c-9852-a5c96aceaf86 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:10.909796 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5be0f-53d7-4b0c-9852-a5c96aceaf86 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:10.928644 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5be0f-53d7-4b0c-9852-a5c96aceaf86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:10.937244 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-39a5be0f-53d7-4b0c-9852-a5c96aceaf86 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:38:10.937244 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:10.937244 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:10.937244 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:10.937244 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:10.937244 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:10.937244 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:10.937244 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:10.937244 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:10.937244 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:10.937244 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:10.937244 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:10.937244 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:10.937244 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:10.937244 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:10.937244 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:10.938125 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:10.938125 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:10.938125 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:10.938125 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:10.938125 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:10.938125 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:10.938125 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:10.938125 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:10.938125 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:10.938125 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:10.938125 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:10.938125 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:10.938125 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:10.938125 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:10.938125 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:10.938125 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:10.938968 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:10.938968 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:10.938968 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:10.938968 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:10.938968 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:10.938968 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:10.938968 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:10.938968 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:10.938968 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:10.938968 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:10.938968 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:38:10.938968 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:10.940776 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 128/259] 10.222.0.33 () {56 vars in 1114 bytes} [Sat Aug 6 20:38:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:10.941572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5be0f-53d7-4b0c-9852-a5c96aceaf86 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:10.964720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23eaef-f55d-4e2d-b5b1-3e87e0191d38 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:10.983380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:10.983896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:11.014593 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ad28f-d7eb-4a69-b028-9f84360e6c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:11.015454 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ad28f-d7eb-4a69-b028-9f84360e6c0e None admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:11.015727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ad28f-d7eb-4a69-b028-9f84360e6c0e None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:11.015994 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ad28f-d7eb-4a69-b028-9f84360e6c0e None admin] PATH_INFO: `/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d/users/d39097035c2246baa8e27ff38a69f4b8/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:11.019727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ad28f-d7eb-4a69-b028-9f84360e6c0e None admin] RBAC: Authorizing `identity:create_grant(project_id=cfb3fc3dc2a2444e8e451370bc40764d, user_id=d39097035c2246baa8e27ff38a69f4b8, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:11.021168 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ad28f-d7eb-4a69-b028-9f84360e6c0e None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:11.045618 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 132/260] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Aug 6 20:38:10 2022] PUT /identity/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d/users/d39097035c2246baa8e27ff38a69f4b8/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:11.046521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ad28f-d7eb-4a69-b028-9f84360e6c0e None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:11.100921 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5be0f-53d7-4b0c-9852-a5c96aceaf86 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:11.176727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc1072-95dd-4491-a590-09a66f5cbd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:11.177757 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc1072-95dd-4491-a590-09a66f5cbd7b None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:11.178241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc1072-95dd-4491-a590-09a66f5cbd7b None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:11.178996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc1072-95dd-4491-a590-09a66f5cbd7b None admin] PATH_INFO: `/v3/users/1c704a5306294252b088871a805ebff6` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:11.180861 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc1072-95dd-4491-a590-09a66f5cbd7b None admin] RBAC: Authorizing `identity:get_user(user_id=1c704a5306294252b088871a805ebff6)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:11.182666 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc1072-95dd-4491-a590-09a66f5cbd7b None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:11.185555 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 129/261] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:38:10 2022] GET /identity/v3/users/1c704a5306294252b088871a805ebff6 => generated 283 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:11.191489 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc1072-95dd-4491-a590-09a66f5cbd7b None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:11.233161 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ad28f-d7eb-4a69-b028-9f84360e6c0e None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:11.313822 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368f66d-9464-4beb-9d1f-a02a289a1252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:11.314448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368f66d-9464-4beb-9d1f-a02a289a1252 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:11.314752 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368f66d-9464-4beb-9d1f-a02a289a1252 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:11.315028 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368f66d-9464-4beb-9d1f-a02a289a1252 None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:11.315761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368f66d-9464-4beb-9d1f-a02a289a1252 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:11.318633 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368f66d-9464-4beb-9d1f-a02a289a1252 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:11.318633 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368f66d-9464-4beb-9d1f-a02a289a1252 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:11.334052 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 133/262] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:38:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:11.349235 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368f66d-9464-4beb-9d1f-a02a289a1252 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:11.392888 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc1072-95dd-4491-a590-09a66f5cbd7b None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:11.397653 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:11.415695 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:11.470454 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78099ff7-4c84-4534-84dc-5286a10d2dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:11.471091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78099ff7-4c84-4534-84dc-5286a10d2dfb None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:11.471366 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78099ff7-4c84-4534-84dc-5286a10d2dfb None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:11.471636 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78099ff7-4c84-4534-84dc-5286a10d2dfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:11.548495 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368f66d-9464-4beb-9d1f-a02a289a1252 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:11.579378 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78099ff7-4c84-4534-84dc-5286a10d2dfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:11.581276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78099ff7-4c84-4534-84dc-5286a10d2dfb None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:11.635175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1a09b-9a3d-4d4a-a016-5abc4575e7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:11.636163 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1a09b-9a3d-4d4a-a016-5abc4575e7a4 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:11.636650 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1a09b-9a3d-4d4a-a016-5abc4575e7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:11.637822 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1a09b-9a3d-4d4a-a016-5abc4575e7a4 None admin] PATH_INFO: `/v3/users/1c704a5306294252b088871a805ebff6` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:11.643378 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a1a09b-9a3d-4d4a-a016-5abc4575e7a4 None admin] RBAC: Authorizing `identity:get_user(user_id=1c704a5306294252b088871a805ebff6)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:11.644913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a1a09b-9a3d-4d4a-a016-5abc4575e7a4 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:11.647008 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 134/263] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:38:11 2022] GET /identity/v3/users/1c704a5306294252b088871a805ebff6 => generated 283 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:11.652879 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1a09b-9a3d-4d4a-a016-5abc4575e7a4 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:11.747712 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 130/264] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:38:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:11.753365 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78099ff7-4c84-4534-84dc-5286a10d2dfb None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:11.756591 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:11.830098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:11.836832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1a09b-9a3d-4d4a-a016-5abc4575e7a4 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:11.891830 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78099ff7-4c84-4534-84dc-5286a10d2dfb None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:11.912304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4574c86-04a8-4bdf-a60e-eda87f52c0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:11.912843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4574c86-04a8-4bdf-a60e-eda87f52c0e1 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:11.913120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4574c86-04a8-4bdf-a60e-eda87f52c0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:11.913391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4574c86-04a8-4bdf-a60e-eda87f52c0e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:11.952685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c256f6-c2e7-46ea-a01f-81746defcb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:11.953663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c256f6-c2e7-46ea-a01f-81746defcb31 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:11.954377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c256f6-c2e7-46ea-a01f-81746defcb31 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:11.954946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c256f6-c2e7-46ea-a01f-81746defcb31 None admin] PATH_INFO: `/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:11.958224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c256f6-c2e7-46ea-a01f-81746defcb31 None admin] RBAC: Authorizing `identity:get_project(project_id=cfb3fc3dc2a2444e8e451370bc40764d)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:11.959958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c256f6-c2e7-46ea-a01f-81746defcb31 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:11.961821 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 131/265] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:38:11 2022] GET /identity/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:11.967996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c256f6-c2e7-46ea-a01f-81746defcb31 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:11.993331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4574c86-04a8-4bdf-a60e-eda87f52c0e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:11.994935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4574c86-04a8-4bdf-a60e-eda87f52c0e1 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:12.089569 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:12.101491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:12.108434 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 135/266] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:38:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:12.115580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4574c86-04a8-4bdf-a60e-eda87f52c0e1 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:12.150600 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c256f6-c2e7-46ea-a01f-81746defcb31 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:12.252759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e89c2-f199-4669-a57d-538b5fbada5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:12.252759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e89c2-f199-4669-a57d-538b5fbada5b None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:12.252759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e89c2-f199-4669-a57d-538b5fbada5b None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:12.252759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e89c2-f199-4669-a57d-538b5fbada5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:12.253886 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e89c2-f199-4669-a57d-538b5fbada5b None admin] RBAC: Adding query filter params (role.id=ab245eea8a714462a00c4546309de9c9, scope.project.id=cfb3fc3dc2a2444e8e451370bc40764d, user.id=1c704a5306294252b088871a805ebff6) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:12.253886 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e89c2-f199-4669-a57d-538b5fbada5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:12.255490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e89c2-f199-4669-a57d-538b5fbada5b None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:12.271028 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 132/267] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:38:11 2022] GET /identity/v3/role_assignments?user.id=1c704a5306294252b088871a805ebff6&scope.project.id=cfb3fc3dc2a2444e8e451370bc40764d&role.id=ab245eea8a714462a00c4546309de9c9 => generated 608 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:12.271603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4574c86-04a8-4bdf-a60e-eda87f52c0e1 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:12.310022 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b0cad-59f7-4a72-a66f-9b878b70bf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:12.311024 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b0cad-59f7-4a72-a66f-9b878b70bf31 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:12.311479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b0cad-59f7-4a72-a66f-9b878b70bf31 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:12.311920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b0cad-59f7-4a72-a66f-9b878b70bf31 None admin] PATH_INFO: `/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:12.313322 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b0cad-59f7-4a72-a66f-9b878b70bf31 None admin] RBAC: Authorizing `identity:get_project(project_id=cfb3fc3dc2a2444e8e451370bc40764d)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:12.315033 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b0cad-59f7-4a72-a66f-9b878b70bf31 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:12.317473 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 136/268] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:38:12 2022] GET /identity/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:12.324796 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e89c2-f199-4669-a57d-538b5fbada5b None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:12.588105 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e89c2-f199-4669-a57d-538b5fbada5b None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:12.624236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19966b7-b547-46fb-9172-1bed35509252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:12.624844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19966b7-b547-46fb-9172-1bed35509252 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:12.625117 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19966b7-b547-46fb-9172-1bed35509252 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:12.625383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19966b7-b547-46fb-9172-1bed35509252 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:12.626094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19966b7-b547-46fb-9172-1bed35509252 None admin] RBAC: Adding query filter params (role.id=b9254dbd663046739a1ba48d8c0027ad, scope.project.id=cfb3fc3dc2a2444e8e451370bc40764d, user.id=1c704a5306294252b088871a805ebff6) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:12.626397 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19966b7-b547-46fb-9172-1bed35509252 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:12.627917 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19966b7-b547-46fb-9172-1bed35509252 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:12.634326 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 133/269] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:38:12 2022] GET /identity/v3/role_assignments?user.id=1c704a5306294252b088871a805ebff6&scope.project.id=cfb3fc3dc2a2444e8e451370bc40764d&role.id=b9254dbd663046739a1ba48d8c0027ad => generated 608 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:12.634845 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:12.837066 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba933556-0926-492a-be87-606616b9e10a None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:12.837573 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba933556-0926-492a-be87-606616b9e10a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:12.837686 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba933556-0926-492a-be87-606616b9e10a None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:12.839068 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 137/270] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:12.845067 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd685e-26f4-4b2c-82bb-0dd7e8688f5f None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:12.845367 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd685e-26f4-4b2c-82bb-0dd7e8688f5f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:12.845612 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd685e-26f4-4b2c-82bb-0dd7e8688f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:12.872366 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-dbcd685e-26f4-4b2c-82bb-0dd7e8688f5f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:12.873576 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-dbcd685e-26f4-4b2c-82bb-0dd7e8688f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:12.960876 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 134/271] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:12.988231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf84471-6462-45ae-abd9-83bbd80db760 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:12.988884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf84471-6462-45ae-abd9-83bbd80db760 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:12.989261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf84471-6462-45ae-abd9-83bbd80db760 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:12.990129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd685e-26f4-4b2c-82bb-0dd7e8688f5f None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:12.990857 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 138/272] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:12.998128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f6591-bc93-4742-9cdc-c20c99f57eea None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:12.998533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f6591-bc93-4742-9cdc-c20c99f57eea None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:12.998954 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f6591-bc93-4742-9cdc-c20c99f57eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:13.020845 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-1e4f6591-bc93-4742-9cdc-c20c99f57eea None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:13.022763 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1e4f6591-bc93-4742-9cdc-c20c99f57eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:13.098087 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:13.107209 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 139/273] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:38:13.109477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd685e-26f4-4b2c-82bb-0dd7e8688f5f None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:13.143709 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:13.144070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f6591-bc93-4742-9cdc-c20c99f57eea None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:13.151674 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46aa59c-dc1d-4005-9142-50c68e585b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:13.152196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46aa59c-dc1d-4005-9142-50c68e585b64 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:13.152499 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46aa59c-dc1d-4005-9142-50c68e585b64 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:13.152767 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46aa59c-dc1d-4005-9142-50c68e585b64 None admin] PATH_INFO: `/v3/roles/member` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:13.165879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46aa59c-dc1d-4005-9142-50c68e585b64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:13.171454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-a46aa59c-dc1d-4005-9142-50c68e585b64 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:38:13.171454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:13.171454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:13.171454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:13.171454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:13.171454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:13.171454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:13.171454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:13.171454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:13.171454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:13.171454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:13.171454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:13.171454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:13.171454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:13.171454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:13.171454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:13.172361 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:13.172361 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:13.172361 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:13.172361 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:13.172361 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:13.172361 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:13.172361 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:13.172361 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:13.172361 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:13.172361 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:13.172361 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:13.172361 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:13.172361 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:13.172361 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:13.172361 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:13.172361 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:13.173143 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:13.173143 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:13.173143 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:13.173143 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:13.173143 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:13.173143 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:13.173143 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:13.173143 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:13.173143 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:13.173143 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:13.173143 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:38:13.173143 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:13.176088 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 135/274] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:38:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:38:13.182796 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46aa59c-dc1d-4005-9142-50c68e585b64 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:13.267867 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f6591-bc93-4742-9cdc-c20c99f57eea None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:13.305239 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b181f-bd61-4463-821e-e0f0ddbe61d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:13.306009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b181f-bd61-4463-821e-e0f0ddbe61d4 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:13.306302 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46aa59c-dc1d-4005-9142-50c68e585b64 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:13.306429 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b181f-bd61-4463-821e-e0f0ddbe61d4 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:13.306765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b181f-bd61-4463-821e-e0f0ddbe61d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:13.307956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b181f-bd61-4463-821e-e0f0ddbe61d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:13.311617 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b181f-bd61-4463-821e-e0f0ddbe61d4 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:13.313558 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 140/275] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:13.319954 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b181f-bd61-4463-821e-e0f0ddbe61d4 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:13.349515 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a214ae-8cd1-4ef2-b892-ed63b76c0534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:13.350342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a214ae-8cd1-4ef2-b892-ed63b76c0534 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:13.350806 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a214ae-8cd1-4ef2-b892-ed63b76c0534 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:13.351237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a214ae-8cd1-4ef2-b892-ed63b76c0534 None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:13.352089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a214ae-8cd1-4ef2-b892-ed63b76c0534 None admin] RBAC: Adding query filter params (name=member) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:13.352528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a214ae-8cd1-4ef2-b892-ed63b76c0534 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:13.354138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a214ae-8cd1-4ef2-b892-ed63b76c0534 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:13.364118 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 136/276] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Aug 6 20:38:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:13.369658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a214ae-8cd1-4ef2-b892-ed63b76c0534 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:13.390941 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:13.427136 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:13.433153 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b181f-bd61-4463-821e-e0f0ddbe61d4 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:13.469413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db244d20-c869-4edc-90cc-93a3970316c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:13.470212 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db244d20-c869-4edc-90cc-93a3970316c7 None admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:13.470987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db244d20-c869-4edc-90cc-93a3970316c7 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:13.470987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db244d20-c869-4edc-90cc-93a3970316c7 None admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:13.471829 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db244d20-c869-4edc-90cc-93a3970316c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:13.473354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db244d20-c869-4edc-90cc-93a3970316c7 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:13.485130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a214ae-8cd1-4ef2-b892-ed63b76c0534 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:13.502361 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 141/277] 10.222.0.33 () {60 vars in 1132 bytes} [Sat Aug 6 20:38:13 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:38:13.526393 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c0d3f-0caa-42f9-934d-aee503b33990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:13.527483 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c0d3f-0caa-42f9-934d-aee503b33990 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:13.528557 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c0d3f-0caa-42f9-934d-aee503b33990 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:13.528977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c0d3f-0caa-42f9-934d-aee503b33990 None admin] PATH_INFO: `/v3/users/432fda6008fb4e4b88e916aae9154214` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:13.546096 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388c0d3f-0caa-42f9-934d-aee503b33990 None admin] RBAC: Authorizing `identity:get_user(user_id=432fda6008fb4e4b88e916aae9154214)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:13.547884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388c0d3f-0caa-42f9-934d-aee503b33990 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:13.549781 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 137/278] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:38:13 2022] GET /identity/v3/users/432fda6008fb4e4b88e916aae9154214 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:13.555917 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db244d20-c869-4edc-90cc-93a3970316c7 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:13.568873 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96786e41-d648-4fff-bb45-3815db817e68 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:13.569185 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96786e41-d648-4fff-bb45-3815db817e68 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:13.569559 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96786e41-d648-4fff-bb45-3815db817e68 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:13.572539 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 138/279] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:13.578010 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74ee53-d1af-41ae-b1ac-8d4a3239b216 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:13.578281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74ee53-d1af-41ae-b1ac-8d4a3239b216 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:13.578574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74ee53-d1af-41ae-b1ac-8d4a3239b216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:13.599476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-5e74ee53-d1af-41ae-b1ac-8d4a3239b216 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:13.602030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5e74ee53-d1af-41ae-b1ac-8d4a3239b216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:13.683087 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 139/280] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:38:13.694613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db244d20-c869-4edc-90cc-93a3970316c7 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:13.707939 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74ee53-d1af-41ae-b1ac-8d4a3239b216 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:13.708818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:13.729294 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19f94c-6063-4ee2-8888-081ffa4f917d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:13.729912 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19f94c-6063-4ee2-8888-081ffa4f917d None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:13.730195 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19f94c-6063-4ee2-8888-081ffa4f917d None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:13.731313 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19f94c-6063-4ee2-8888-081ffa4f917d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:13.732349 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d19f94c-6063-4ee2-8888-081ffa4f917d None admin] RBAC: Adding query filter params (role.id=1a212772e06344478184ce7d44a58b40, user.id=432fda6008fb4e4b88e916aae9154214, scope.system=all) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:13.732668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d19f94c-6063-4ee2-8888-081ffa4f917d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:13.734181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d19f94c-6063-4ee2-8888-081ffa4f917d None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:13.741450 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 142/281] 10.222.0.33 () {56 vars in 1308 bytes} [Sat Aug 6 20:38:13 2022] GET /identity/v3/role_assignments?user.id=432fda6008fb4e4b88e916aae9154214&scope.system=all&role.id=1a212772e06344478184ce7d44a58b40 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:13.771355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:13.845160 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74ee53-d1af-41ae-b1ac-8d4a3239b216 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:13.889455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceef2d6-9b7e-4cd6-bf0c-b432443ca69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:13.890014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceef2d6-9b7e-4cd6-bf0c-b432443ca69f None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:13.890293 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceef2d6-9b7e-4cd6-bf0c-b432443ca69f None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:13.890592 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceef2d6-9b7e-4cd6-bf0c-b432443ca69f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:13.903681 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceef2d6-9b7e-4cd6-bf0c-b432443ca69f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:13.909263 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-7ceef2d6-9b7e-4cd6-bf0c-b432443ca69f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:38:13.909263 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:13.909263 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:13.909263 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:13.909263 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:13.909263 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:13.909263 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:13.909263 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:13.909263 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:13.909263 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:13.909263 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:13.909263 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:13.909263 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:13.909263 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:13.909263 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:13.909263 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:13.910215 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:13.910215 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:13.910215 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:13.910215 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:13.910215 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:13.910215 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:13.910215 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:13.910215 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:13.910215 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:13.910215 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:13.910215 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:13.910215 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:13.910215 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:13.910215 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:13.910215 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:13.910215 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:13.911052 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:13.911052 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:13.911052 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:13.911052 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:13.911052 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:13.911052 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:13.911052 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:13.911052 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:13.911052 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:13.911052 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:13.911052 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:38:13.911052 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:13.914697 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 140/282] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:38:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:13.919167 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19f94c-6063-4ee2-8888-081ffa4f917d None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:14.038606 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19f94c-6063-4ee2-8888-081ffa4f917d None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:14.083113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104145ef-2ce7-4b09-acd5-d7078aa2beac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:14.083756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104145ef-2ce7-4b09-acd5-d7078aa2beac None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:14.084040 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104145ef-2ce7-4b09-acd5-d7078aa2beac None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:14.084317 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104145ef-2ce7-4b09-acd5-d7078aa2beac None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:14.085016 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104145ef-2ce7-4b09-acd5-d7078aa2beac None admin] RBAC: Adding query filter params (name=reader) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:14.085325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104145ef-2ce7-4b09-acd5-d7078aa2beac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:14.086779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104145ef-2ce7-4b09-acd5-d7078aa2beac None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:14.098647 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 143/283] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Aug 6 20:38:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:14.102585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceef2d6-9b7e-4cd6-bf0c-b432443ca69f None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:14.227606 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:14.234467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceef2d6-9b7e-4cd6-bf0c-b432443ca69f None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:14.237910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa3e92-9508-42f1-bbc6-0c9d3e8b28ec None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:14.238223 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa3e92-9508-42f1-bbc6-0c9d3e8b28ec None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:14.238499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa3e92-9508-42f1-bbc6-0c9d3e8b28ec None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:14.240117 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 144/284] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:38:14.245299 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e07c2-2b2f-4475-898d-7e4bdad45b60 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:14.245818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e07c2-2b2f-4475-898d-7e4bdad45b60 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:14.247377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e07c2-2b2f-4475-898d-7e4bdad45b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:14.271784 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-662e07c2-2b2f-4475-898d-7e4bdad45b60 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:14.278625 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-662e07c2-2b2f-4475-898d-7e4bdad45b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:14.327785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dacd17-4942-49d0-8f58-111e71eff8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:14.328773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dacd17-4942-49d0-8f58-111e71eff8d8 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:14.329247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dacd17-4942-49d0-8f58-111e71eff8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:14.330879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dacd17-4942-49d0-8f58-111e71eff8d8 None admin] PATH_INFO: `/v3/users/b086f37d4fa9485daf06b0d957badc0e` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:14.335983 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dacd17-4942-49d0-8f58-111e71eff8d8 None admin] RBAC: Authorizing `identity:get_user(user_id=b086f37d4fa9485daf06b0d957badc0e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:14.337731 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dacd17-4942-49d0-8f58-111e71eff8d8 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:14.339624 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 141/285] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:38:14 2022] GET /identity/v3/users/b086f37d4fa9485daf06b0d957badc0e => generated 297 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:14.346795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dacd17-4942-49d0-8f58-111e71eff8d8 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:14.350903 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:14.393896 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 145/286] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:38:14.450757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e07c2-2b2f-4475-898d-7e4bdad45b60 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:14.512360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dacd17-4942-49d0-8f58-111e71eff8d8 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:14.550168 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b804e5-2912-4e20-ad6b-0863b9552bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:14.551186 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b804e5-2912-4e20-ad6b-0863b9552bdb None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:14.551664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b804e5-2912-4e20-ad6b-0863b9552bdb None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:14.552154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b804e5-2912-4e20-ad6b-0863b9552bdb None admin] PATH_INFO: `/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:14.553514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b804e5-2912-4e20-ad6b-0863b9552bdb None admin] RBAC: Authorizing `identity:get_project(project_id=cfb3fc3dc2a2444e8e451370bc40764d)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:14.555194 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b804e5-2912-4e20-ad6b-0863b9552bdb None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:14.557275 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 142/287] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:38:14 2022] GET /identity/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:14.567577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b804e5-2912-4e20-ad6b-0863b9552bdb None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:14.598573 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e07c2-2b2f-4475-898d-7e4bdad45b60 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:14.620040 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:14.632188 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7026a-1f39-4f12-8bb0-59af6780361b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:14.632773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7026a-1f39-4f12-8bb0-59af6780361b None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:14.633056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7026a-1f39-4f12-8bb0-59af6780361b None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:14.633331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7026a-1f39-4f12-8bb0-59af6780361b None admin] PATH_INFO: `/v3/roles/member` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:14.646974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f7026a-1f39-4f12-8bb0-59af6780361b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:14.654335 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-67f7026a-1f39-4f12-8bb0-59af6780361b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:38:14.654335 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:14.654335 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:14.654335 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:14.654335 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:14.654335 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:14.654335 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:14.654335 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:14.654335 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:14.654335 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:14.654335 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:14.654335 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:14.654335 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:14.654335 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:14.654335 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:14.654335 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:14.655287 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:14.655287 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:14.655287 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:14.655287 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:14.655287 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:14.655287 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:14.655287 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:14.655287 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:14.655287 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:14.655287 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:14.655287 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:14.655287 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:14.655287 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:14.655287 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:14.655287 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:14.655287 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:14.656086 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:14.656086 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:14.656086 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:14.656086 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:14.656086 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:14.656086 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:14.656086 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:14.656086 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:14.656086 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:14.656086 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:14.656086 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:38:14.656086 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:14.656086 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 146/288] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:38:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:38:14.661582 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7026a-1f39-4f12-8bb0-59af6780361b None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:14.698705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:14.704680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b804e5-2912-4e20-ad6b-0863b9552bdb None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:14.744670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc3a59-71f0-4630-9a9a-f707d48abc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:14.745746 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc3a59-71f0-4630-9a9a-f707d48abc60 None admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:14.746356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc3a59-71f0-4630-9a9a-f707d48abc60 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:14.747113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc3a59-71f0-4630-9a9a-f707d48abc60 None admin] PATH_INFO: `/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d/users/b086f37d4fa9485daf06b0d957badc0e/roles/c136f425b8234bfda1c7a8a99fcdc614` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:14.749516 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc3a59-71f0-4630-9a9a-f707d48abc60 None admin] RBAC: Authorizing `identity:create_grant(project_id=cfb3fc3dc2a2444e8e451370bc40764d, user_id=b086f37d4fa9485daf06b0d957badc0e, role_id=c136f425b8234bfda1c7a8a99fcdc614)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:14.751382 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc3a59-71f0-4630-9a9a-f707d48abc60 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:14.766944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7026a-1f39-4f12-8bb0-59af6780361b None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:14.775731 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 143/289] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Aug 6 20:38:14 2022] PUT /identity/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d/users/b086f37d4fa9485daf06b0d957badc0e/roles/c136f425b8234bfda1c7a8a99fcdc614 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:14.804811 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3528b5f-0064-4005-9b5c-8c94fe0792a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:14.805617 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3528b5f-0064-4005-9b5c-8c94fe0792a9 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:14.805987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3528b5f-0064-4005-9b5c-8c94fe0792a9 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:14.806361 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3528b5f-0064-4005-9b5c-8c94fe0792a9 None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:14.807175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3528b5f-0064-4005-9b5c-8c94fe0792a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:14.807580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3528b5f-0064-4005-9b5c-8c94fe0792a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:14.809137 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3528b5f-0064-4005-9b5c-8c94fe0792a9 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:14.819198 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 147/290] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Aug 6 20:38:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:14.825109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc3a59-71f0-4630-9a9a-f707d48abc60 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:14.953426 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:14.967506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc3a59-71f0-4630-9a9a-f707d48abc60 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:15.022280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd089cf-59b8-489f-83aa-dad0884f39b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:15.022877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd089cf-59b8-489f-83aa-dad0884f39b9 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:15.023157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd089cf-59b8-489f-83aa-dad0884f39b9 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:15.023430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd089cf-59b8-489f-83aa-dad0884f39b9 None admin] PATH_INFO: `/v3/users/d39097035c2246baa8e27ff38a69f4b8` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:15.024589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd089cf-59b8-489f-83aa-dad0884f39b9 None admin] RBAC: Authorizing `identity:get_user(user_id=d39097035c2246baa8e27ff38a69f4b8)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:15.026027 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd089cf-59b8-489f-83aa-dad0884f39b9 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:15.028473 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 144/291] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:38:14 2022] GET /identity/v3/users/d39097035c2246baa8e27ff38a69f4b8 => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:15.034254 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3528b5f-0064-4005-9b5c-8c94fe0792a9 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:15.139649 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:15.144184 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3528b5f-0064-4005-9b5c-8c94fe0792a9 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:15.180855 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d33134-49d3-4814-a68e-3e17d17f703c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:15.181474 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d33134-49d3-4814-a68e-3e17d17f703c None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:15.181819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d33134-49d3-4814-a68e-3e17d17f703c None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:15.182147 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d33134-49d3-4814-a68e-3e17d17f703c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:15.267669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d33134-49d3-4814-a68e-3e17d17f703c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:15.269140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d33134-49d3-4814-a68e-3e17d17f703c None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:15.388397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:15.395758 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 148/292] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:38:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:15.399477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd089cf-59b8-489f-83aa-dad0884f39b9 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:15.505145 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd089cf-59b8-489f-83aa-dad0884f39b9 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:15.540851 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5d331-0a42-48c3-ac54-022baf0833f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:15.541576 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5d331-0a42-48c3-ac54-022baf0833f9 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:15.541859 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5d331-0a42-48c3-ac54-022baf0833f9 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:15.542134 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5d331-0a42-48c3-ac54-022baf0833f9 None admin] PATH_INFO: `/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:15.543724 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5d331-0a42-48c3-ac54-022baf0833f9 None admin] RBAC: Authorizing `identity:get_project(project_id=cfb3fc3dc2a2444e8e451370bc40764d)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:15.545192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5d331-0a42-48c3-ac54-022baf0833f9 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:15.547049 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 145/293] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:38:15 2022] GET /identity/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:15.553099 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d33134-49d3-4814-a68e-3e17d17f703c None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:15.655567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d33134-49d3-4814-a68e-3e17d17f703c None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:15.709013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9a3ba-3fe0-4853-8c9e-1968cd23f06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:15.709856 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9a3ba-3fe0-4853-8c9e-1968cd23f06d None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:15.710356 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9a3ba-3fe0-4853-8c9e-1968cd23f06d None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:15.710814 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9a3ba-3fe0-4853-8c9e-1968cd23f06d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:15.711700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9a3ba-3fe0-4853-8c9e-1968cd23f06d None admin] RBAC: Adding query filter params (role.id=1a212772e06344478184ce7d44a58b40, scope.project.id=cfb3fc3dc2a2444e8e451370bc40764d, user.id=d39097035c2246baa8e27ff38a69f4b8) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:15.712156 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9a3ba-3fe0-4853-8c9e-1968cd23f06d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:15.713788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9a3ba-3fe0-4853-8c9e-1968cd23f06d None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:15.724345 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 149/294] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:38:15 2022] GET /identity/v3/role_assignments?user.id=d39097035c2246baa8e27ff38a69f4b8&scope.project.id=cfb3fc3dc2a2444e8e451370bc40764d&role.id=1a212772e06344478184ce7d44a58b40 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:16.598033 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f6c95-cd73-4959-a03e-56d10fa46a73 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:16.598616 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f6c95-cd73-4959-a03e-56d10fa46a73 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:16.598850 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f6c95-cd73-4959-a03e-56d10fa46a73 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:16.600377 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 146/295] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:16.608583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a89ca2-2ef4-41ef-ad02-d90b6f50afdc None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:16.609432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a89ca2-2ef4-41ef-ad02-d90b6f50afdc None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:16.610001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a89ca2-2ef4-41ef-ad02-d90b6f50afdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:16.613350 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e5189-3b95-4208-afc9-a1620e27a43b None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:16.613638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e5189-3b95-4208-afc9-a1620e27a43b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:16.613913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e5189-3b95-4208-afc9-a1620e27a43b None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:16.615467 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 147/296] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:16.620630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e2e57-e5a6-4563-b353-974f09e22330 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:16.621476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e2e57-e5a6-4563-b353-974f09e22330 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:16.621876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e2e57-e5a6-4563-b353-974f09e22330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:16.632456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-f0a89ca2-2ef4-41ef-ad02-d90b6f50afdc None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:16.633905 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f0a89ca2-2ef4-41ef-ad02-d90b6f50afdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:16.640394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-023e2e57-e5a6-4563-b353-974f09e22330 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:16.641557 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-023e2e57-e5a6-4563-b353-974f09e22330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:16.675095 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:16.719884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:16.729599 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 148/297] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:38:16.731434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b0339-7f2c-47ef-b273-4b3c1bc1b20c None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:16.731721 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b0339-7f2c-47ef-b273-4b3c1bc1b20c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:16.731995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b0339-7f2c-47ef-b273-4b3c1bc1b20c None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:16.733392 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 149/298] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:16.738225 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6105e58-0fc8-4809-88fd-5687f1f86284 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:16.738513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6105e58-0fc8-4809-88fd-5687f1f86284 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:16.738805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6105e58-0fc8-4809-88fd-5687f1f86284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:16.744852 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 150/299] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:38:16.756512 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a89ca2-2ef4-41ef-ad02-d90b6f50afdc None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:16.756863 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-c6105e58-0fc8-4809-88fd-5687f1f86284 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:16.758037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c6105e58-0fc8-4809-88fd-5687f1f86284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:16.834884 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 150/300] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:16.835880 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6105e58-0fc8-4809-88fd-5687f1f86284 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:16.863250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a89ca2-2ef4-41ef-ad02-d90b6f50afdc None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:16.899814 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeba0f3-6fd3-4457-845b-155c0d4182cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:16.900449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeba0f3-6fd3-4457-845b-155c0d4182cb None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:16.900724 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeba0f3-6fd3-4457-845b-155c0d4182cb None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:16.900995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeba0f3-6fd3-4457-845b-155c0d4182cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:16.912718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeba0f3-6fd3-4457-845b-155c0d4182cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:16.917628 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-ebeba0f3-6fd3-4457-845b-155c0d4182cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:38:16.917628 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:16.917628 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:16.917628 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:16.917628 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:16.917628 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:16.917628 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:16.917628 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:16.917628 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:16.917628 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:16.917628 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:16.917628 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:16.917628 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:16.917628 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:16.917628 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:16.917628 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:16.918511 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:16.918511 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:16.918511 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:16.918511 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:16.918511 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:16.918511 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:16.918511 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:16.918511 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:16.918511 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:16.918511 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:16.918511 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:16.918511 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:16.918511 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:16.918511 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:16.918511 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:16.918511 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:16.919450 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:16.919450 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:16.919450 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:16.919450 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:16.919450 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:16.919450 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:16.919450 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:16.919450 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:16.919450 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:16.919450 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:16.919450 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:38:16.919450 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:16.919450 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 151/301] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:38:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:38:16.920265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeba0f3-6fd3-4457-845b-155c0d4182cb None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:16.940110 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:16.952159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6105e58-0fc8-4809-88fd-5687f1f86284 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:16.979786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:16.991181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5bb11-ae3a-4b47-bc26-b58338983548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:16.991819 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5bb11-ae3a-4b47-bc26-b58338983548 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:16.992099 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5bb11-ae3a-4b47-bc26-b58338983548 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:16.992528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5bb11-ae3a-4b47-bc26-b58338983548 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:17.003131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf5bb11-ae3a-4b47-bc26-b58338983548 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:17.008174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-4cf5bb11-ae3a-4b47-bc26-b58338983548 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:38:17.008174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:17.008174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:17.008174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:17.008174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:17.008174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:17.008174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:17.008174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:17.008174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:17.008174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:17.008174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:17.008174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:17.008174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:17.008174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:17.008174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:17.008174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:17.009056 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:17.009056 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:17.009056 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:17.009056 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:17.009056 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:17.009056 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:17.009056 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:17.009056 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:17.009056 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:17.009056 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:17.009056 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:17.009056 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:17.009056 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:17.009056 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:17.009056 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:17.009056 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:17.009897 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:17.009897 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:17.009897 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:17.009897 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:17.009897 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:17.009897 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:17.009897 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:17.009897 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:17.009897 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:17.009897 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:17.009897 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:38:17.009897 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:17.009897 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 151/302] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:38:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:17.010575 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5bb11-ae3a-4b47-bc26-b58338983548 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:17.037771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeba0f3-6fd3-4457-845b-155c0d4182cb None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:17.073636 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e74eb-26b1-496a-92a8-d835986ebfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:17.074707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e74eb-26b1-496a-92a8-d835986ebfde None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:17.074985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e74eb-26b1-496a-92a8-d835986ebfde None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:17.075260 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e74eb-26b1-496a-92a8-d835986ebfde None admin] PATH_INFO: `/v3/domains/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:17.076371 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e74eb-26b1-496a-92a8-d835986ebfde None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:17.077882 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e74eb-26b1-496a-92a8-d835986ebfde None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:17.084454 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 152/303] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:17.085289 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e74eb-26b1-496a-92a8-d835986ebfde None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:17.120093 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5bb11-ae3a-4b47-bc26-b58338983548 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:17.160572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fc196-71db-4a40-b821-209646e52dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:17.161183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fc196-71db-4a40-b821-209646e52dbb None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:17.161461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fc196-71db-4a40-b821-209646e52dbb None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:17.161735 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fc196-71db-4a40-b821-209646e52dbb None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:17.162747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fc196-71db-4a40-b821-209646e52dbb None admin] RBAC: Adding query filter params (name=member) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:17.163055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fc196-71db-4a40-b821-209646e52dbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:17.164431 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fc196-71db-4a40-b821-209646e52dbb None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:17.174004 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 152/304] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Aug 6 20:38:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:17.174926 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fc196-71db-4a40-b821-209646e52dbb None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:17.195356 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e74eb-26b1-496a-92a8-d835986ebfde None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:17.197209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:17.219819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:17.237581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a3d86-83e2-4daf-bfb3-fd225dc6e8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:17.238209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a3d86-83e2-4daf-bfb3-fd225dc6e8ba None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:17.238492 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a3d86-83e2-4daf-bfb3-fd225dc6e8ba None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:17.238938 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a3d86-83e2-4daf-bfb3-fd225dc6e8ba None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:17.239480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a3d86-83e2-4daf-bfb3-fd225dc6e8ba None admin] RBAC: Adding query filter params (name=reader) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:17.240272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a3d86-83e2-4daf-bfb3-fd225dc6e8ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:17.241390 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a3d86-83e2-4daf-bfb3-fd225dc6e8ba None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:17.252394 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 153/305] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Aug 6 20:38:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:17.253173 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a3d86-83e2-4daf-bfb3-fd225dc6e8ba None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:17.297880 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fc196-71db-4a40-b821-209646e52dbb None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:17.333125 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc48f61-61c8-4a20-90bb-e08010553bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:17.333730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc48f61-61c8-4a20-90bb-e08010553bba None admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:17.334007 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc48f61-61c8-4a20-90bb-e08010553bba None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:17.334276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc48f61-61c8-4a20-90bb-e08010553bba None admin] PATH_INFO: `/v3/groups` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:17.334998 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc48f61-61c8-4a20-90bb-e08010553bba None admin] RBAC: Authorizing `identity:create_group()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:17.336433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc48f61-61c8-4a20-90bb-e08010553bba None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:17.354236 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 153/306] 10.222.0.33 () {60 vars in 1134 bytes} [Sat Aug 6 20:38:17 2022] POST /identity/v3/groups => generated 229 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:38:17.355382 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc48f61-61c8-4a20-90bb-e08010553bba None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:17.370033 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a3d86-83e2-4daf-bfb3-fd225dc6e8ba None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:17.412885 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17215e83-d370-48ea-a4de-d8460dc840c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:17.413388 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17215e83-d370-48ea-a4de-d8460dc840c1 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:17.413670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17215e83-d370-48ea-a4de-d8460dc840c1 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:17.413947 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17215e83-d370-48ea-a4de-d8460dc840c1 None admin] PATH_INFO: `/v3/users/432fda6008fb4e4b88e916aae9154214` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:17.415206 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17215e83-d370-48ea-a4de-d8460dc840c1 None admin] RBAC: Authorizing `identity:get_user(user_id=432fda6008fb4e4b88e916aae9154214)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:17.416692 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17215e83-d370-48ea-a4de-d8460dc840c1 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:17.418847 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 154/307] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:38:17 2022] GET /identity/v3/users/432fda6008fb4e4b88e916aae9154214 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:17.420223 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d60cc-8641-4432-bba6-4325e2f4157c None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:17.420574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d60cc-8641-4432-bba6-4325e2f4157c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:17.421803 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d60cc-8641-4432-bba6-4325e2f4157c None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:17.422577 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 155/308] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:17.428124 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5890ca-4650-4907-8dc8-9d4afd5f187c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:17.428863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5890ca-4650-4907-8dc8-9d4afd5f187c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:17.429148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5890ca-4650-4907-8dc8-9d4afd5f187c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:17.448139 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-3f5890ca-4650-4907-8dc8-9d4afd5f187c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:17.449913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3f5890ca-4650-4907-8dc8-9d4afd5f187c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:17.470111 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:17.504211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:17.507245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc48f61-61c8-4a20-90bb-e08010553bba None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:17.531526 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 156/309] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:17.532772 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5890ca-4650-4907-8dc8-9d4afd5f187c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:17.556502 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097713eb-6d1f-4ae7-b96c-07897971d1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:17.557846 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097713eb-6d1f-4ae7-b96c-07897971d1a3 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:17.557846 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097713eb-6d1f-4ae7-b96c-07897971d1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:17.557846 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097713eb-6d1f-4ae7-b96c-07897971d1a3 None admin] PATH_INFO: `/v3/users/763a130453714c99bc8d82836a401024` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:17.576131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097713eb-6d1f-4ae7-b96c-07897971d1a3 None admin] RBAC: Authorizing `identity:get_user(user_id=763a130453714c99bc8d82836a401024)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:17.577789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097713eb-6d1f-4ae7-b96c-07897971d1a3 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:17.583545 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 154/310] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:38:17 2022] GET /identity/v3/users/763a130453714c99bc8d82836a401024 => generated 293 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:17.583545 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097713eb-6d1f-4ae7-b96c-07897971d1a3 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:17.652637 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5890ca-4650-4907-8dc8-9d4afd5f187c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:17.686669 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097713eb-6d1f-4ae7-b96c-07897971d1a3 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:17.702320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea6672-53d6-448f-bdc3-0da25b839d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:17.703026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea6672-53d6-448f-bdc3-0da25b839d9a None admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:17.703303 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea6672-53d6-448f-bdc3-0da25b839d9a None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:17.703575 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea6672-53d6-448f-bdc3-0da25b839d9a None admin] PATH_INFO: `/v3/system/users/432fda6008fb4e4b88e916aae9154214/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:17.705032 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea6672-53d6-448f-bdc3-0da25b839d9a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=432fda6008fb4e4b88e916aae9154214, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:17.706443 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea6672-53d6-448f-bdc3-0da25b839d9a None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:17.716410 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 157/311] 10.222.0.33 () {58 vars in 1334 bytes} [Sat Aug 6 20:38:17 2022] PUT /identity/v3/system/users/432fda6008fb4e4b88e916aae9154214/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:17.717407 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea6672-53d6-448f-bdc3-0da25b839d9a None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:17.731149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:17.739405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1e579-4272-4188-8488-79301f14c38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:17.740391 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1e579-4272-4188-8488-79301f14c38d None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:17.740944 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1e579-4272-4188-8488-79301f14c38d None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:17.741393 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1e579-4272-4188-8488-79301f14c38d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:17.754437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1e579-4272-4188-8488-79301f14c38d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:17.760725 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-aed1e579-4272-4188-8488-79301f14c38d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:38:17.760725 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:17.760725 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:17.760725 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:17.760725 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:17.760725 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:17.760725 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:17.760725 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:17.760725 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:17.760725 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:17.760725 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:17.760725 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:17.760725 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:17.760725 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:17.760725 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:17.760725 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:17.761828 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:17.761828 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:17.761828 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:17.761828 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:17.761828 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:17.761828 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:17.761828 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:17.761828 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:17.761828 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:17.761828 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:17.761828 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:17.761828 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:17.761828 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:17.761828 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:17.761828 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:17.761828 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:17.762658 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:17.762658 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:17.762658 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:17.762658 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:17.762658 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:17.762658 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:17.762658 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:17.762658 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:17.762658 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:17.762658 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:17.762658 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:38:17.762658 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:17.765470 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 155/312] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:38:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:17.775615 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1e579-4272-4188-8488-79301f14c38d None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:17.784369 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:17.855989 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea6672-53d6-448f-bdc3-0da25b839d9a None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:17.897021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1e579-4272-4188-8488-79301f14c38d None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:17.898405 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b01a9a-f29d-4542-9536-d43f8bf98b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:17.899125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b01a9a-f29d-4542-9536-d43f8bf98b77 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:17.899766 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b01a9a-f29d-4542-9536-d43f8bf98b77 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:17.900114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b01a9a-f29d-4542-9536-d43f8bf98b77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:17.902500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b01a9a-f29d-4542-9536-d43f8bf98b77 None admin] RBAC: Adding query filter params (role.id=c136f425b8234bfda1c7a8a99fcdc614, user.id=763a130453714c99bc8d82836a401024, scope.system=all) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:17.903582 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b01a9a-f29d-4542-9536-d43f8bf98b77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:17.905123 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b01a9a-f29d-4542-9536-d43f8bf98b77 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:17.911561 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 158/313] 10.222.0.33 () {56 vars in 1308 bytes} [Sat Aug 6 20:38:17 2022] GET /identity/v3/role_assignments?user.id=763a130453714c99bc8d82836a401024&scope.system=all&role.id=c136f425b8234bfda1c7a8a99fcdc614 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:17.945394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7cd1b-887b-40c0-8032-8c3cdf36274b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:17.946258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7cd1b-887b-40c0-8032-8c3cdf36274b None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:17.946730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7cd1b-887b-40c0-8032-8c3cdf36274b None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:17.947139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7cd1b-887b-40c0-8032-8c3cdf36274b None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:17.948024 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7cd1b-887b-40c0-8032-8c3cdf36274b None admin] RBAC: Adding query filter params (name=reader) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:17.948466 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7cd1b-887b-40c0-8032-8c3cdf36274b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:17.950799 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7cd1b-887b-40c0-8032-8c3cdf36274b None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:17.960919 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 156/314] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Aug 6 20:38:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:17.967016 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b01a9a-f29d-4542-9536-d43f8bf98b77 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:18.085386 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b01a9a-f29d-4542-9536-d43f8bf98b77 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:18.095622 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:18.123920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27361164-9c87-4955-ac59-5aa0524515fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:18.124583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27361164-9c87-4955-ac59-5aa0524515fe None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:18.124832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27361164-9c87-4955-ac59-5aa0524515fe None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:18.125104 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27361164-9c87-4955-ac59-5aa0524515fe None admin] PATH_INFO: `/v3/users/b086f37d4fa9485daf06b0d957badc0e` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:18.126228 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27361164-9c87-4955-ac59-5aa0524515fe None admin] RBAC: Authorizing `identity:get_user(user_id=b086f37d4fa9485daf06b0d957badc0e)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:18.127693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27361164-9c87-4955-ac59-5aa0524515fe None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:18.129604 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 159/315] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:38:17 2022] GET /identity/v3/users/b086f37d4fa9485daf06b0d957badc0e => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:18.134935 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7cd1b-887b-40c0-8032-8c3cdf36274b None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:18.191331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:18.241117 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7cd1b-887b-40c0-8032-8c3cdf36274b None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:18.276710 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a72bd3-168c-4af8-a6fe-40e38d39efb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:18.278219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a72bd3-168c-4af8-a6fe-40e38d39efb9 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:18.278714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a72bd3-168c-4af8-a6fe-40e38d39efb9 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:18.279172 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a72bd3-168c-4af8-a6fe-40e38d39efb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:18.347702 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a72bd3-168c-4af8-a6fe-40e38d39efb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:18.349513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a72bd3-168c-4af8-a6fe-40e38d39efb9 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:18.403031 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:18.451847 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 157/316] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:38:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:18.458804 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27361164-9c87-4955-ac59-5aa0524515fe None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:18.566475 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27361164-9c87-4955-ac59-5aa0524515fe None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:18.608063 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795936a-4982-479b-9160-b67da838abba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:18.608698 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795936a-4982-479b-9160-b67da838abba None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:18.608978 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795936a-4982-479b-9160-b67da838abba None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:18.609250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795936a-4982-479b-9160-b67da838abba None admin] PATH_INFO: `/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:18.610375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795936a-4982-479b-9160-b67da838abba None admin] RBAC: Authorizing `identity:get_project(project_id=cfb3fc3dc2a2444e8e451370bc40764d)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:18.611852 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795936a-4982-479b-9160-b67da838abba None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:18.613474 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 160/317] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:38:18 2022] GET /identity/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:18.619632 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a72bd3-168c-4af8-a6fe-40e38d39efb9 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:18.727064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a72bd3-168c-4af8-a6fe-40e38d39efb9 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:18.763958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51c841-0365-4bd2-bde2-36ac0c92bc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:18.764563 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51c841-0365-4bd2-bde2-36ac0c92bc01 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:18.764839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51c841-0365-4bd2-bde2-36ac0c92bc01 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:18.765107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51c841-0365-4bd2-bde2-36ac0c92bc01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:18.765993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd51c841-0365-4bd2-bde2-36ac0c92bc01 None admin] RBAC: Adding query filter params (role.id=c136f425b8234bfda1c7a8a99fcdc614, scope.project.id=cfb3fc3dc2a2444e8e451370bc40764d, user.id=b086f37d4fa9485daf06b0d957badc0e) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:18.766309 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd51c841-0365-4bd2-bde2-36ac0c92bc01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:18.767768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd51c841-0365-4bd2-bde2-36ac0c92bc01 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:18.773792 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 158/318] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:38:18 2022] GET /identity/v3/role_assignments?user.id=b086f37d4fa9485daf06b0d957badc0e&scope.project.id=cfb3fc3dc2a2444e8e451370bc40764d&role.id=c136f425b8234bfda1c7a8a99fcdc614 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:19.686012 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa98578-6a97-4be1-bd9a-4df9f2c5fee3 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:19.686512 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa98578-6a97-4be1-bd9a-4df9f2c5fee3 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:19.686614 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa98578-6a97-4be1-bd9a-4df9f2c5fee3 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:19.687895 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 161/319] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:19.693104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb772be-40d1-4756-b624-cb2f14d3aca7 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:19.693393 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb772be-40d1-4756-b624-cb2f14d3aca7 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:19.693663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb772be-40d1-4756-b624-cb2f14d3aca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:19.711969 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-0bb772be-40d1-4756-b624-cb2f14d3aca7 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:19.713144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0bb772be-40d1-4756-b624-cb2f14d3aca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:19.724136 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:19.787827 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 159/320] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:19.812042 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa98578-6a97-4be1-bd9a-4df9f2c5fee3 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:19.860071 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:19.917048 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa98578-6a97-4be1-bd9a-4df9f2c5fee3 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:19.957638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771c06c-27b6-4d55-9a4b-c0a567817489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:19.958177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771c06c-27b6-4d55-9a4b-c0a567817489 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:19.958451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771c06c-27b6-4d55-9a4b-c0a567817489 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:19.958753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771c06c-27b6-4d55-9a4b-c0a567817489 None admin] PATH_INFO: `/v3/domains/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:19.959835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d771c06c-27b6-4d55-9a4b-c0a567817489 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:19.961261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d771c06c-27b6-4d55-9a4b-c0a567817489 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:19.963036 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 162/321] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:19.968639 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb772be-40d1-4756-b624-cb2f14d3aca7 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:20.070901 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb772be-40d1-4756-b624-cb2f14d3aca7 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:20.085500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df403e68-3b57-4110-86c4-80274616ce79 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:20.085500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df403e68-3b57-4110-86c4-80274616ce79 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:20.085500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df403e68-3b57-4110-86c4-80274616ce79 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:20.085500 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 163/322] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:20.091558 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03f75d-7398-448c-b40d-d65daa8542a9 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:20.091848 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03f75d-7398-448c-b40d-d65daa8542a9 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:20.092128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03f75d-7398-448c-b40d-d65daa8542a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:20.107432 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e1400-d825-4271-a881-1add3c505787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:20.108065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e1400-d825-4271-a881-1add3c505787 None admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:20.108342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e1400-d825-4271-a881-1add3c505787 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:20.108611 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e1400-d825-4271-a881-1add3c505787 None admin] PATH_INFO: `/v3/groups` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:20.109228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e1400-d825-4271-a881-1add3c505787 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:20.109997 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-8c03f75d-7398-448c-b40d-d65daa8542a9 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:20.110691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e1400-d825-4271-a881-1add3c505787 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:20.111205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8c03f75d-7398-448c-b40d-d65daa8542a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:20.134570 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 160/323] 10.222.0.33 () {60 vars in 1134 bytes} [Sat Aug 6 20:38:19 2022] POST /identity/v3/groups => generated 226 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:38:20.195931 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 164/324] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:38:20.211272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39645b-1776-46ea-9e91-8a1eb3b3a57d None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:20.211669 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39645b-1776-46ea-9e91-8a1eb3b3a57d None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:20.211933 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39645b-1776-46ea-9e91-8a1eb3b3a57d None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:20.214946 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 161/325] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:38:20.220016 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152509b9-ae94-4b84-835f-c1984be15da6 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:20.220333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152509b9-ae94-4b84-835f-c1984be15da6 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:20.220593 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152509b9-ae94-4b84-835f-c1984be15da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:20.223167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39645b-1776-46ea-9e91-8a1eb3b3a57d None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:20.233380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:20.239780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-152509b9-ae94-4b84-835f-c1984be15da6 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:20.240994 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-152509b9-ae94-4b84-835f-c1984be15da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:20.286991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:20.325804 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 165/326] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:20.350046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152509b9-ae94-4b84-835f-c1984be15da6 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:20.350242 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39645b-1776-46ea-9e91-8a1eb3b3a57d None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:20.390274 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866dea4-084f-43d1-b071-8cc2a785f145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:20.390950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866dea4-084f-43d1-b071-8cc2a785f145 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:20.391233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866dea4-084f-43d1-b071-8cc2a785f145 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:20.391509 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866dea4-084f-43d1-b071-8cc2a785f145 None admin] PATH_INFO: `/v3/roles/member` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:20.410686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866dea4-084f-43d1-b071-8cc2a785f145 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:20.416752 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-c866dea4-084f-43d1-b071-8cc2a785f145 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:38:20.416752 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:20.416752 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:20.416752 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:20.416752 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:20.416752 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:20.416752 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:20.416752 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:20.416752 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:20.416752 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:20.416752 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:20.416752 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:20.416752 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:20.416752 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:20.416752 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:20.416752 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:20.418268 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:20.418268 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:20.418268 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:20.418268 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:20.418268 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:20.418268 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:20.418268 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:20.418268 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:20.418268 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:20.418268 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:20.418268 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:20.418268 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:20.418268 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:20.418268 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:20.418268 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:20.418268 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:20.419207 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:20.419207 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:20.419207 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:20.419207 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:20.419207 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:20.419207 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:20.419207 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:20.419207 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:20.419207 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:20.419207 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:20.419207 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:38:20.419207 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:20.419207 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 162/327] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:38:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:38:20.424937 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866dea4-084f-43d1-b071-8cc2a785f145 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:20.476236 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152509b9-ae94-4b84-835f-c1984be15da6 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:20.508391 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:20.515349 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480c6f0-4451-4b93-a3e1-221e9e971b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:20.515998 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480c6f0-4451-4b93-a3e1-221e9e971b05 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:20.516281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480c6f0-4451-4b93-a3e1-221e9e971b05 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:20.516545 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480c6f0-4451-4b93-a3e1-221e9e971b05 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:20.528592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480c6f0-4451-4b93-a3e1-221e9e971b05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:20.533482 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-2480c6f0-4451-4b93-a3e1-221e9e971b05 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:38:20.533482 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:20.533482 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:20.533482 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:20.533482 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:20.533482 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:20.533482 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:20.533482 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:20.533482 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:20.533482 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:20.533482 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:20.533482 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:20.533482 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:20.533482 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:20.533482 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:20.533482 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:20.535798 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:20.535798 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:20.535798 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:20.535798 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:20.535798 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:20.535798 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:20.535798 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:20.535798 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:20.535798 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:20.535798 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:20.535798 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:20.535798 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:20.535798 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:20.535798 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:20.535798 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:20.535798 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:20.536835 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:20.536835 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:20.536835 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:20.536835 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:20.536835 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:20.536835 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:20.536835 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:20.536835 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:20.536835 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:20.536835 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:20.536835 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:38:20.536835 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:20.536835 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 166/328] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:38:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:38:20.540437 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480c6f0-4451-4b93-a3e1-221e9e971b05 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:20.557281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866dea4-084f-43d1-b071-8cc2a785f145 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:20.583321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:20.609283 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0c483-ca50-4894-8355-f1fac7d2e815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:20.609952 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0c483-ca50-4894-8355-f1fac7d2e815 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:20.610237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0c483-ca50-4894-8355-f1fac7d2e815 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:20.610514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0c483-ca50-4894-8355-f1fac7d2e815 None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:20.611225 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0c483-ca50-4894-8355-f1fac7d2e815 None admin] RBAC: Adding query filter params (name=member) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:20.611817 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0c483-ca50-4894-8355-f1fac7d2e815 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:20.613733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0c483-ca50-4894-8355-f1fac7d2e815 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:20.624363 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 163/329] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Aug 6 20:38:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:20.631484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0c483-ca50-4894-8355-f1fac7d2e815 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:20.682692 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480c6f0-4451-4b93-a3e1-221e9e971b05 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:20.733229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49732f8-be1d-474e-9370-7000b352834d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:20.734918 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49732f8-be1d-474e-9370-7000b352834d None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:20.735345 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49732f8-be1d-474e-9370-7000b352834d None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:20.735758 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49732f8-be1d-474e-9370-7000b352834d None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:20.736587 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49732f8-be1d-474e-9370-7000b352834d None admin] RBAC: Adding query filter params (name=reader) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:20.737286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49732f8-be1d-474e-9370-7000b352834d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:20.739494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49732f8-be1d-474e-9370-7000b352834d None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:20.752245 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 167/330] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Aug 6 20:38:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:20.759855 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49732f8-be1d-474e-9370-7000b352834d None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:20.791918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0c483-ca50-4894-8355-f1fac7d2e815 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:20.824221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:20.835578 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3dab89-dd66-4e7e-a8c8-62c4a60b0bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:20.836610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3dab89-dd66-4e7e-a8c8-62c4a60b0bda None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:20.837088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3dab89-dd66-4e7e-a8c8-62c4a60b0bda None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:20.837580 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3dab89-dd66-4e7e-a8c8-62c4a60b0bda None admin] PATH_INFO: `/v3/users/432fda6008fb4e4b88e916aae9154214` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:20.840556 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3dab89-dd66-4e7e-a8c8-62c4a60b0bda None admin] RBAC: Authorizing `identity:get_user(user_id=432fda6008fb4e4b88e916aae9154214)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:20.843068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3dab89-dd66-4e7e-a8c8-62c4a60b0bda None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:20.849835 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 164/331] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:38:20 2022] GET /identity/v3/users/432fda6008fb4e4b88e916aae9154214 => generated 293 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:20.851372 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3dab89-dd66-4e7e-a8c8-62c4a60b0bda None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:20.892182 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:20.901490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49732f8-be1d-474e-9370-7000b352834d None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:20.950072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263fc82-1655-4f1a-907f-ccd1cb010036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:20.953619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263fc82-1655-4f1a-907f-ccd1cb010036 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:20.953619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263fc82-1655-4f1a-907f-ccd1cb010036 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:20.953619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263fc82-1655-4f1a-907f-ccd1cb010036 None admin] PATH_INFO: `/v3/users/763a130453714c99bc8d82836a401024` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:20.953619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8263fc82-1655-4f1a-907f-ccd1cb010036 None admin] RBAC: Authorizing `identity:get_user(user_id=763a130453714c99bc8d82836a401024)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:20.954050 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8263fc82-1655-4f1a-907f-ccd1cb010036 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:20.956573 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 168/332] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:38:20 2022] GET /identity/v3/users/763a130453714c99bc8d82836a401024 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:20.962192 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263fc82-1655-4f1a-907f-ccd1cb010036 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:20.987753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3dab89-dd66-4e7e-a8c8-62c4a60b0bda None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:21.042615 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e2aa7-532c-486b-8269-9905bdb59370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:21.045407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e2aa7-532c-486b-8269-9905bdb59370 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:21.045407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e2aa7-532c-486b-8269-9905bdb59370 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:21.045407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e2aa7-532c-486b-8269-9905bdb59370 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:21.045407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e2aa7-532c-486b-8269-9905bdb59370 None admin] RBAC: Adding query filter params (role.id=1a212772e06344478184ce7d44a58b40, user.id=432fda6008fb4e4b88e916aae9154214, scope.system=all) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:21.045407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e2aa7-532c-486b-8269-9905bdb59370 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:21.046972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e2aa7-532c-486b-8269-9905bdb59370 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:21.074618 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 165/333] 10.222.0.33 () {56 vars in 1308 bytes} [Sat Aug 6 20:38:20 2022] GET /identity/v3/role_assignments?user.id=432fda6008fb4e4b88e916aae9154214&scope.system=all&role.id=1a212772e06344478184ce7d44a58b40 => generated 510 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:21.109266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263fc82-1655-4f1a-907f-ccd1cb010036 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:21.149839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76274e64-9101-4d64-a376-1d92ac6036ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:21.150524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76274e64-9101-4d64-a376-1d92ac6036ed None admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:21.150834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76274e64-9101-4d64-a376-1d92ac6036ed None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:21.151113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76274e64-9101-4d64-a376-1d92ac6036ed None admin] PATH_INFO: `/v3/system/users/763a130453714c99bc8d82836a401024/roles/c136f425b8234bfda1c7a8a99fcdc614` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:21.152884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76274e64-9101-4d64-a376-1d92ac6036ed None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=763a130453714c99bc8d82836a401024, role_id=c136f425b8234bfda1c7a8a99fcdc614)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:21.154307 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76274e64-9101-4d64-a376-1d92ac6036ed None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:21.164530 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 169/334] 10.222.0.33 () {58 vars in 1334 bytes} [Sat Aug 6 20:38:20 2022] PUT /identity/v3/system/users/763a130453714c99bc8d82836a401024/roles/c136f425b8234bfda1c7a8a99fcdc614 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:23.247256 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c8430-e44b-4413-a8b6-9fad94fb48c9 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:23.247800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c8430-e44b-4413-a8b6-9fad94fb48c9 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:23.247800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c8430-e44b-4413-a8b6-9fad94fb48c9 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:23.249415 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 166/335] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:23.254864 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20599089-4bf2-44f2-a6df-086c80b6b268 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:23.255278 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20599089-4bf2-44f2-a6df-086c80b6b268 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:23.255468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20599089-4bf2-44f2-a6df-086c80b6b268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:23.280230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-20599089-4bf2-44f2-a6df-086c80b6b268 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:23.281405 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-20599089-4bf2-44f2-a6df-086c80b6b268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:23.305717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:23.368350 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 170/336] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:23.406165 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c8430-e44b-4413-a8b6-9fad94fb48c9 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:23.498981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:23.570256 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c8430-e44b-4413-a8b6-9fad94fb48c9 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:23.618084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a99752-726d-423b-a546-4dc587c4ac06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:23.618988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a99752-726d-423b-a546-4dc587c4ac06 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:23.619405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a99752-726d-423b-a546-4dc587c4ac06 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:23.619896 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a99752-726d-423b-a546-4dc587c4ac06 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:23.637497 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a99752-726d-423b-a546-4dc587c4ac06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:23.643084 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-c1a99752-726d-423b-a546-4dc587c4ac06 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:38:23.643084 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:23.643084 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:23.643084 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:23.643084 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:23.643084 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:23.643084 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:23.643084 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:23.643084 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:23.643084 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:23.643084 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:23.643084 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:23.643084 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:23.643084 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:23.643084 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:23.643084 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:23.644170 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:23.644170 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:23.644170 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:23.644170 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:23.644170 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:23.644170 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:23.644170 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:23.644170 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:23.644170 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:23.644170 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:23.644170 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:23.644170 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:23.644170 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:23.644170 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:23.644170 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:23.644170 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:23.644955 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:23.644955 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:23.644955 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:23.644955 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:23.644955 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:23.644955 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:23.644955 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:23.644955 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:23.644955 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:23.644955 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:23.644955 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:38:23.644955 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:23.647078 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 167/337] 10.222.0.33 () {56 vars in 1114 bytes} [Sat Aug 6 20:38:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:23.655702 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20599089-4bf2-44f2-a6df-086c80b6b268 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:23.693175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821b353-ef30-4e68-b200-43886b6caa68 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:23.693175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821b353-ef30-4e68-b200-43886b6caa68 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:23.693175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821b353-ef30-4e68-b200-43886b6caa68 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:23.693842 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 168/338] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:23.698212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e142b5d-e492-40fe-9d41-f9eb9678e7ec None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:23.698922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e142b5d-e492-40fe-9d41-f9eb9678e7ec None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:23.699529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e142b5d-e492-40fe-9d41-f9eb9678e7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:23.732418 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-0e142b5d-e492-40fe-9d41-f9eb9678e7ec None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:23.734992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0e142b5d-e492-40fe-9d41-f9eb9678e7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:23.865329 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 169/339] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:23.899395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20599089-4bf2-44f2-a6df-086c80b6b268 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:23.905743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e142b5d-e492-40fe-9d41-f9eb9678e7ec None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:23.977463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637467fa-b650-433e-8614-ba0111c1bfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:23.978113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637467fa-b650-433e-8614-ba0111c1bfb3 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:23.978390 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637467fa-b650-433e-8614-ba0111c1bfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:23.978686 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637467fa-b650-433e-8614-ba0111c1bfb3 None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:23.981178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637467fa-b650-433e-8614-ba0111c1bfb3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:23.987320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637467fa-b650-433e-8614-ba0111c1bfb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:23.988924 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637467fa-b650-433e-8614-ba0111c1bfb3 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:24.006745 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 171/340] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:38:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:24.015994 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637467fa-b650-433e-8614-ba0111c1bfb3 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:24.022905 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:24.065150 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:24.150640 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e142b5d-e492-40fe-9d41-f9eb9678e7ec None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:24.225209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c57129-8f46-4c3d-b326-1793f965fdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:24.225912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c57129-8f46-4c3d-b326-1793f965fdd0 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:24.226171 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c57129-8f46-4c3d-b326-1793f965fdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:24.226443 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c57129-8f46-4c3d-b326-1793f965fdd0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:24.242867 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637467fa-b650-433e-8614-ba0111c1bfb3 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:24.256412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c57129-8f46-4c3d-b326-1793f965fdd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:24.261512 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-51c57129-8f46-4c3d-b326-1793f965fdd0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:38:24.261512 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:24.261512 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:24.261512 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:24.261512 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:24.261512 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:24.261512 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:24.261512 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:24.261512 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:24.261512 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:24.261512 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:24.261512 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:24.261512 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:24.261512 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:24.261512 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:24.261512 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:24.262478 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:24.262478 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:24.262478 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:24.262478 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:24.262478 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:24.262478 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:24.262478 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:24.262478 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:24.262478 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:24.262478 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:24.262478 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:24.262478 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:24.262478 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:24.262478 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:24.262478 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:24.262478 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:24.263301 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:24.263301 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:24.263301 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:24.263301 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:24.263301 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:24.263301 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:24.263301 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:24.263301 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:24.263301 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:24.263301 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:24.263301 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:38:24.263301 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:24.267087 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 170/341] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:38:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:24.270736 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c57129-8f46-4c3d-b326-1793f965fdd0 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:24.321238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4687c0-cf7c-4825-bd55-f337ef9afbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:24.322470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4687c0-cf7c-4825-bd55-f337ef9afbd9 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:24.322920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4687c0-cf7c-4825-bd55-f337ef9afbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:24.323378 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4687c0-cf7c-4825-bd55-f337ef9afbd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:24.435052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4687c0-cf7c-4825-bd55-f337ef9afbd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:24.437451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4687c0-cf7c-4825-bd55-f337ef9afbd9 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:24.474926 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:24.547145 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c57129-8f46-4c3d-b326-1793f965fdd0 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:24.550152 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:24.612174 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 172/342] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:38:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:24.621022 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4687c0-cf7c-4825-bd55-f337ef9afbd9 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:24.668180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824bafe5-5eb9-4560-848d-5dfc548502b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:24.669072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bafe5-5eb9-4560-848d-5dfc548502b9 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:24.669072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bafe5-5eb9-4560-848d-5dfc548502b9 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:24.669244 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bafe5-5eb9-4560-848d-5dfc548502b9 None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:24.669843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824bafe5-5eb9-4560-848d-5dfc548502b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:24.670149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824bafe5-5eb9-4560-848d-5dfc548502b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:24.671566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824bafe5-5eb9-4560-848d-5dfc548502b9 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:24.697189 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 171/343] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Aug 6 20:38:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:24.699113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18354722-8978-497c-8689-40998c252cbe None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:24.699416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18354722-8978-497c-8689-40998c252cbe None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:24.699704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18354722-8978-497c-8689-40998c252cbe None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:24.700925 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 172/344] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:24.707458 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18354722-8978-497c-8689-40998c252cbe None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:24.744091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4687c0-cf7c-4825-bd55-f337ef9afbd9 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:24.767917 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:24.795493 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34087364-4545-42f7-9dff-9ea51b0ea145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:24.796147 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34087364-4545-42f7-9dff-9ea51b0ea145 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:24.796427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34087364-4545-42f7-9dff-9ea51b0ea145 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:24.796701 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34087364-4545-42f7-9dff-9ea51b0ea145 None admin] PATH_INFO: `/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:24.799690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34087364-4545-42f7-9dff-9ea51b0ea145 None admin] RBAC: Authorizing `identity:get_project(project_id=e4eeeb6b2c9345388f01f51f75c671dc)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:24.801145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34087364-4545-42f7-9dff-9ea51b0ea145 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:24.811784 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 173/345] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:38:24 2022] GET /identity/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:24.813164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea52df-ae6d-4e3e-bf6d-8390840fe234 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:24.813453 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea52df-ae6d-4e3e-bf6d-8390840fe234 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:24.813729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea52df-ae6d-4e3e-bf6d-8390840fe234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:24.843938 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-29ea52df-ae6d-4e3e-bf6d-8390840fe234 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:24.845329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-29ea52df-ae6d-4e3e-bf6d-8390840fe234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:24.904697 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18354722-8978-497c-8689-40998c252cbe None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:24.937590 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 174/346] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:24.943205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea5a3c-0304-4d7f-9146-4c15dd232128 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:24.943492 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea5a3c-0304-4d7f-9146-4c15dd232128 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:24.943764 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea5a3c-0304-4d7f-9146-4c15dd232128 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:24.945204 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 175/347] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:24.945781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea5a3c-0304-4d7f-9146-4c15dd232128 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:24.948183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690c74f-831d-4e69-97ce-139343a39872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:24.949526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690c74f-831d-4e69-97ce-139343a39872 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:24.949804 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690c74f-831d-4e69-97ce-139343a39872 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:24.950069 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690c74f-831d-4e69-97ce-139343a39872 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:24.997220 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:25.040778 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f690c74f-831d-4e69-97ce-139343a39872 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:25.044910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f690c74f-831d-4e69-97ce-139343a39872 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:25.086045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea5a3c-0304-4d7f-9146-4c15dd232128 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:25.108680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:25.136634 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed975fc-0395-4269-a7dd-3ca616ef00f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:25.137291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed975fc-0395-4269-a7dd-3ca616ef00f5 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:25.137567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed975fc-0395-4269-a7dd-3ca616ef00f5 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:25.137833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed975fc-0395-4269-a7dd-3ca616ef00f5 None admin] PATH_INFO: `/v3/groups/3a28385a72574dc091ffe6edbf6cd23f` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:25.146309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed975fc-0395-4269-a7dd-3ca616ef00f5 None admin] RBAC: Authorizing `identity:get_group(group_id=3a28385a72574dc091ffe6edbf6cd23f)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:25.147851 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed975fc-0395-4269-a7dd-3ca616ef00f5 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:25.149932 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 176/348] 10.222.0.33 () {56 vars in 1180 bytes} [Sat Aug 6 20:38:24 2022] GET /identity/v3/groups/3a28385a72574dc091ffe6edbf6cd23f => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:25.151302 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772c1fb-cf2c-4958-bdfd-2ea74d094f48 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:25.152151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772c1fb-cf2c-4958-bdfd-2ea74d094f48 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:25.152398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772c1fb-cf2c-4958-bdfd-2ea74d094f48 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:25.153759 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 177/349] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:25.159202 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768a891-f4b2-4d48-a5e7-7412e047db4c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:25.159549 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768a891-f4b2-4d48-a5e7-7412e047db4c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:25.160067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768a891-f4b2-4d48-a5e7-7412e047db4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:25.179978 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 173/350] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:38:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:25.181230 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690c74f-831d-4e69-97ce-139343a39872 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:25.186206 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-c768a891-f4b2-4d48-a5e7-7412e047db4c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:25.187440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c768a891-f4b2-4d48-a5e7-7412e047db4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:25.267654 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:25.280978 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 178/351] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:25.284927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a56d8-881c-49e3-9c10-1b84cfe5ce62 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:25.284927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a56d8-881c-49e3-9c10-1b84cfe5ce62 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:25.284927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a56d8-881c-49e3-9c10-1b84cfe5ce62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:25.305408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-983a56d8-881c-49e3-9c10-1b84cfe5ce62 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:25.306631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-983a56d8-881c-49e3-9c10-1b84cfe5ce62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:25.315110 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690c74f-831d-4e69-97ce-139343a39872 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:25.354344 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f581e7-076c-42e9-aafb-070bf37976aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:25.356289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f581e7-076c-42e9-aafb-070bf37976aa None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:25.356581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f581e7-076c-42e9-aafb-070bf37976aa None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:25.356848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f581e7-076c-42e9-aafb-070bf37976aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:25.368611 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f581e7-076c-42e9-aafb-070bf37976aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:25.375949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-62f581e7-076c-42e9-aafb-070bf37976aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:38:25.375949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:25.375949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:25.375949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:25.375949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:25.375949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:25.375949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:25.375949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:25.375949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:25.375949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:25.375949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:25.375949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:25.375949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:25.375949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:25.375949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:25.375949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:25.376994 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:25.376994 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:25.376994 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:25.376994 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:25.376994 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:25.376994 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:25.376994 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:25.376994 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:25.376994 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:25.376994 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:25.376994 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:25.376994 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:25.376994 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:25.376994 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:25.376994 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:25.376994 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:25.377870 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:25.377870 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:25.377870 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:25.377870 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:25.377870 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:25.377870 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:25.377870 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:25.377870 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:25.377870 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:25.377870 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:25.377870 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:38:25.377870 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:25.377870 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 174/352] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:38:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:25.377870 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f581e7-076c-42e9-aafb-070bf37976aa None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:25.390934 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 179/353] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:25.395611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a56d8-881c-49e3-9c10-1b84cfe5ce62 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:25.447708 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:25.497674 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f581e7-076c-42e9-aafb-070bf37976aa None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:25.516953 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a56d8-881c-49e3-9c10-1b84cfe5ce62 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:25.525858 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:25.539186 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05ee11-306c-42ee-85d7-f25ed4f7b943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:25.539799 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05ee11-306c-42ee-85d7-f25ed4f7b943 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:25.540523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05ee11-306c-42ee-85d7-f25ed4f7b943 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:25.540814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05ee11-306c-42ee-85d7-f25ed4f7b943 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:25.541544 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed05ee11-306c-42ee-85d7-f25ed4f7b943 None admin] RBAC: Adding query filter params (group.id=3a28385a72574dc091ffe6edbf6cd23f, role.id=b9254dbd663046739a1ba48d8c0027ad, scope.project.id=e4eeeb6b2c9345388f01f51f75c671dc) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:25.541856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed05ee11-306c-42ee-85d7-f25ed4f7b943 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:25.543916 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed05ee11-306c-42ee-85d7-f25ed4f7b943 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:25.549570 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 175/354] 10.222.0.33 () {56 vars in 1376 bytes} [Sat Aug 6 20:38:25 2022] GET /identity/v3/role_assignments?group.id=3a28385a72574dc091ffe6edbf6cd23f&scope.project.id=e4eeeb6b2c9345388f01f51f75c671dc&role.id=b9254dbd663046739a1ba48d8c0027ad => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:25.550704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05ee11-306c-42ee-85d7-f25ed4f7b943 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:25.563471 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910db6b-4e42-4176-a567-ea4e59e02c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:25.564137 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910db6b-4e42-4176-a567-ea4e59e02c8b None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:25.564420 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910db6b-4e42-4176-a567-ea4e59e02c8b None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:25.564693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910db6b-4e42-4176-a567-ea4e59e02c8b None admin] PATH_INFO: `/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:25.567107 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910db6b-4e42-4176-a567-ea4e59e02c8b None admin] RBAC: Authorizing `identity:get_project(project_id=e4eeeb6b2c9345388f01f51f75c671dc)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:25.568383 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910db6b-4e42-4176-a567-ea4e59e02c8b None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:25.574647 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 180/355] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:38:25 2022] GET /identity/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:25.574647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b5bb1-04a6-4bf7-85ce-02efb2e99c4b None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:25.574647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b5bb1-04a6-4bf7-85ce-02efb2e99c4b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:25.574647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b5bb1-04a6-4bf7-85ce-02efb2e99c4b None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:25.576447 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 181/356] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:25.576447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b5bb1-04a6-4bf7-85ce-02efb2e99c4b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:25.682257 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05ee11-306c-42ee-85d7-f25ed4f7b943 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:25.732386 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ddff9-576e-4d66-92e1-b56a6c555460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:25.732622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ddff9-576e-4d66-92e1-b56a6c555460 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:25.732898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ddff9-576e-4d66-92e1-b56a6c555460 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:25.732997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ddff9-576e-4d66-92e1-b56a6c555460 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:25.733527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b5bb1-04a6-4bf7-85ce-02efb2e99c4b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:25.744924 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:25.750683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ddff9-576e-4d66-92e1-b56a6c555460 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:25.756474 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-6e8ddff9-576e-4d66-92e1-b56a6c555460 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:38:25.756474 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:25.756474 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:25.756474 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:25.756474 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:25.756474 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:25.756474 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:25.756474 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:25.756474 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:25.756474 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:25.756474 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:25.756474 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:25.756474 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:25.756474 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:25.756474 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:25.756474 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:25.757387 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:25.757387 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:25.757387 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:25.757387 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:25.757387 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:25.757387 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:25.757387 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:25.757387 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:25.757387 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:25.757387 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:25.757387 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:25.757387 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:25.757387 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:25.757387 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:25.757387 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:25.757387 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:25.758176 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:25.758176 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:25.758176 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:25.758176 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:25.758176 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:25.758176 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:25.758176 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:25.758176 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:25.758176 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:25.758176 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:25.758176 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:38:25.758176 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:25.758176 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 176/357] 10.222.0.33 () {56 vars in 1114 bytes} [Sat Aug 6 20:38:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:25.758940 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ddff9-576e-4d66-92e1-b56a6c555460 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:25.784861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fce078-c201-4916-8068-bdf1c9ef511c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:25.785495 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fce078-c201-4916-8068-bdf1c9ef511c None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:25.785846 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fce078-c201-4916-8068-bdf1c9ef511c None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:25.786195 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fce078-c201-4916-8068-bdf1c9ef511c None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:25.787002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fce078-c201-4916-8068-bdf1c9ef511c None admin] RBAC: Adding query filter params (name=member) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:25.787384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fce078-c201-4916-8068-bdf1c9ef511c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:25.790849 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fce078-c201-4916-8068-bdf1c9ef511c None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:25.800219 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 182/358] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Aug 6 20:38:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:25.801065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fce078-c201-4916-8068-bdf1c9ef511c None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:25.823817 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:25.889905 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ddff9-576e-4d66-92e1-b56a6c555460 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:25.926494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fce078-c201-4916-8068-bdf1c9ef511c None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:25.937847 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf24f8-f8c2-4f7f-978c-eb4533f0eebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:25.938891 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf24f8-f8c2-4f7f-978c-eb4533f0eebf None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:25.939390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf24f8-f8c2-4f7f-978c-eb4533f0eebf None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:25.939863 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf24f8-f8c2-4f7f-978c-eb4533f0eebf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:25.953671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cf24f8-f8c2-4f7f-978c-eb4533f0eebf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:25.960546 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-d1cf24f8-f8c2-4f7f-978c-eb4533f0eebf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:38:25.960546 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:25.960546 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:25.960546 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:25.960546 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:25.960546 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:25.960546 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:25.960546 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:25.960546 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:25.960546 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:25.960546 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:25.960546 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:25.960546 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:25.960546 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:25.960546 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:25.960546 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:25.961436 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:25.961436 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:25.961436 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:25.961436 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:25.961436 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:25.961436 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:25.961436 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:25.961436 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:25.961436 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:25.961436 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:25.961436 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:25.961436 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:25.961436 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:25.961436 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:25.961436 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:25.961436 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:25.962251 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:25.962251 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:25.962251 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:25.962251 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:25.962251 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:25.962251 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:25.962251 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:25.962251 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:25.962251 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:25.962251 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:25.962251 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:38:25.962251 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:25.962251 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 177/359] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:38:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:25.963005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64768b43-bb65-423d-aaf3-d634d2ef0e29 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:25.963005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64768b43-bb65-423d-aaf3-d634d2ef0e29 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:25.963675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64768b43-bb65-423d-aaf3-d634d2ef0e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:25.973154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7899e-8ebc-4591-a948-a740b07994c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:25.973787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7899e-8ebc-4591-a948-a740b07994c7 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:25.976491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7899e-8ebc-4591-a948-a740b07994c7 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:25.976491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7899e-8ebc-4591-a948-a740b07994c7 None admin] PATH_INFO: `/v3/groups/3a28385a72574dc091ffe6edbf6cd23f` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:25.979151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da7899e-8ebc-4591-a948-a740b07994c7 None admin] RBAC: Authorizing `identity:get_group(group_id=3a28385a72574dc091ffe6edbf6cd23f)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:25.980093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da7899e-8ebc-4591-a948-a740b07994c7 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:25.982038 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 183/360] 10.222.0.33 () {56 vars in 1180 bytes} [Sat Aug 6 20:38:25 2022] GET /identity/v3/groups/3a28385a72574dc091ffe6edbf6cd23f => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:25.982878 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7899e-8ebc-4591-a948-a740b07994c7 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:25.988658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-64768b43-bb65-423d-aaf3-d634d2ef0e29 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:25.988658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-64768b43-bb65-423d-aaf3-d634d2ef0e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:26.043379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:26.076818 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 178/361] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:26.077019 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64768b43-bb65-423d-aaf3-d634d2ef0e29 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:26.121420 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7899e-8ebc-4591-a948-a740b07994c7 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:26.144781 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:26.175274 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d810e46-1208-40d2-b073-0d93529fc728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:26.175900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d810e46-1208-40d2-b073-0d93529fc728 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:26.176178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d810e46-1208-40d2-b073-0d93529fc728 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:26.177184 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d810e46-1208-40d2-b073-0d93529fc728 None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:26.177184 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d810e46-1208-40d2-b073-0d93529fc728 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:26.177384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d810e46-1208-40d2-b073-0d93529fc728 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:26.179504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d810e46-1208-40d2-b073-0d93529fc728 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:26.188480 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 184/362] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:38:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:26.189322 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d810e46-1208-40d2-b073-0d93529fc728 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:26.223111 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64768b43-bb65-423d-aaf3-d634d2ef0e29 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:26.263716 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bbf934-0aea-4cde-b965-5434dbaf7e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:26.264425 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbf934-0aea-4cde-b965-5434dbaf7e1e None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:26.264778 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbf934-0aea-4cde-b965-5434dbaf7e1e None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:26.265139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbf934-0aea-4cde-b965-5434dbaf7e1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:26.322455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:26.326970 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d810e46-1208-40d2-b073-0d93529fc728 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:26.358765 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bbf934-0aea-4cde-b965-5434dbaf7e1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:26.360906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bbf934-0aea-4cde-b965-5434dbaf7e1e None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:26.375608 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac1873-5108-4ea6-bf08-fefd1e435008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:26.376223 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac1873-5108-4ea6-bf08-fefd1e435008 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:26.376509 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac1873-5108-4ea6-bf08-fefd1e435008 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:26.376782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac1873-5108-4ea6-bf08-fefd1e435008 None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:26.377449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eac1873-5108-4ea6-bf08-fefd1e435008 None admin] RBAC: Adding query filter params (name=reader) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:26.377754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eac1873-5108-4ea6-bf08-fefd1e435008 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:26.379183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eac1873-5108-4ea6-bf08-fefd1e435008 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:26.393227 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 185/363] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Aug 6 20:38:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:26.393227 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac1873-5108-4ea6-bf08-fefd1e435008 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:26.426085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:26.506212 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 179/364] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:38:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:26.507132 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bbf934-0aea-4cde-b965-5434dbaf7e1e None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:26.518762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac1873-5108-4ea6-bf08-fefd1e435008 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:26.570810 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774b481-2f86-4af8-8942-2fa90f90b61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:26.570810 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774b481-2f86-4af8-8942-2fa90f90b61e None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:26.571229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774b481-2f86-4af8-8942-2fa90f90b61e None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:26.571384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774b481-2f86-4af8-8942-2fa90f90b61e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:26.573090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774b481-2f86-4af8-8942-2fa90f90b61e None admin] RBAC: Adding query filter params (group.id=3a28385a72574dc091ffe6edbf6cd23f, role.id=1a212772e06344478184ce7d44a58b40, scope.project.id=e4eeeb6b2c9345388f01f51f75c671dc) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:26.573090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774b481-2f86-4af8-8942-2fa90f90b61e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:26.574664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774b481-2f86-4af8-8942-2fa90f90b61e None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:26.582594 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 186/365] 10.222.0.33 () {56 vars in 1376 bytes} [Sat Aug 6 20:38:26 2022] GET /identity/v3/role_assignments?group.id=3a28385a72574dc091ffe6edbf6cd23f&scope.project.id=e4eeeb6b2c9345388f01f51f75c671dc&role.id=1a212772e06344478184ce7d44a58b40 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:26.582594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774b481-2f86-4af8-8942-2fa90f90b61e None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:26.635969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:26.643260 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bbf934-0aea-4cde-b965-5434dbaf7e1e None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:26.696107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c21233-ddcd-480b-93f4-a4ff0c03e4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:26.696735 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c21233-ddcd-480b-93f4-a4ff0c03e4a8 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:26.697008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c21233-ddcd-480b-93f4-a4ff0c03e4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:26.697272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c21233-ddcd-480b-93f4-a4ff0c03e4a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:26.708453 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:26.713127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c21233-ddcd-480b-93f4-a4ff0c03e4a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:26.719362 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-88c21233-ddcd-480b-93f4-a4ff0c03e4a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:38:26.719362 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:26.719362 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:26.719362 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:26.719362 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:26.719362 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:26.719362 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:26.719362 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:26.719362 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:26.719362 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:26.719362 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:26.719362 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:26.719362 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:26.719362 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:26.719362 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:26.719362 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:26.720528 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:26.720528 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:26.720528 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:26.720528 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:26.720528 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:26.720528 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:26.720528 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:26.720528 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:26.720528 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:26.720528 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:26.720528 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:26.720528 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:26.720528 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:26.720528 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:26.720528 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:26.720528 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:26.721385 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:26.721385 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:26.721385 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:26.721385 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:26.721385 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:26.721385 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:26.721385 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:26.721385 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:26.721385 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:26.721385 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:26.721385 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:38:26.721385 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:26.721385 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 180/366] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Aug 6 20:38:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:26.721385 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c21233-ddcd-480b-93f4-a4ff0c03e4a8 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:26.743055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774b481-2f86-4af8-8942-2fa90f90b61e None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:26.792829 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c66428-284e-4f38-854d-ef76ab04ccb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:26.794126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c66428-284e-4f38-854d-ef76ab04ccb3 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:26.794583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c66428-284e-4f38-854d-ef76ab04ccb3 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:26.795004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c66428-284e-4f38-854d-ef76ab04ccb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:26.867370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c21233-ddcd-480b-93f4-a4ff0c03e4a8 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:26.901271 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c66428-284e-4f38-854d-ef76ab04ccb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:26.903085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c66428-284e-4f38-854d-ef76ab04ccb3 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:26.912800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0dab6-76ca-4d43-b04e-2e5e8dd53783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:26.913750 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0dab6-76ca-4d43-b04e-2e5e8dd53783 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:26.914240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0dab6-76ca-4d43-b04e-2e5e8dd53783 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:26.914763 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0dab6-76ca-4d43-b04e-2e5e8dd53783 None admin] PATH_INFO: `/v3/users/763a130453714c99bc8d82836a401024` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:26.918160 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0dab6-76ca-4d43-b04e-2e5e8dd53783 None admin] RBAC: Authorizing `identity:get_user(user_id=763a130453714c99bc8d82836a401024)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:26.920028 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0dab6-76ca-4d43-b04e-2e5e8dd53783 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:26.922178 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 181/367] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:38:26 2022] GET /identity/v3/users/763a130453714c99bc8d82836a401024 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:26.923224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0dab6-76ca-4d43-b04e-2e5e8dd53783 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:26.938892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:27.002098 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:27.028283 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 187/368] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:38:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:27.029447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c66428-284e-4f38-854d-ef76ab04ccb3 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:27.041377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0dab6-76ca-4d43-b04e-2e5e8dd53783 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:27.079819 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32efba-dc79-4fda-baf8-1fadb3a03871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:27.080545 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32efba-dc79-4fda-baf8-1fadb3a03871 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:27.080831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32efba-dc79-4fda-baf8-1fadb3a03871 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:27.081108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32efba-dc79-4fda-baf8-1fadb3a03871 None admin] PATH_INFO: `/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:27.082404 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef32efba-dc79-4fda-baf8-1fadb3a03871 None admin] RBAC: Authorizing `identity:get_project(project_id=cfb3fc3dc2a2444e8e451370bc40764d)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:27.083953 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef32efba-dc79-4fda-baf8-1fadb3a03871 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:27.085928 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 182/369] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:38:26 2022] GET /identity/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:27.090569 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32efba-dc79-4fda-baf8-1fadb3a03871 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:27.148636 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c66428-284e-4f38-854d-ef76ab04ccb3 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:27.185184 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:27.189332 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34d39a-3fd9-4d6a-8061-2d6700ca382e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:27.190183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34d39a-3fd9-4d6a-8061-2d6700ca382e None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:27.190690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34d39a-3fd9-4d6a-8061-2d6700ca382e None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:27.191373 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34d39a-3fd9-4d6a-8061-2d6700ca382e None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:27.192328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34d39a-3fd9-4d6a-8061-2d6700ca382e None admin] RBAC: Adding query filter params (name=admin) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:27.192818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34d39a-3fd9-4d6a-8061-2d6700ca382e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:27.194351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34d39a-3fd9-4d6a-8061-2d6700ca382e None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:27.205400 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 188/370] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:38:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:27.209973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34d39a-3fd9-4d6a-8061-2d6700ca382e None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:27.210097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32efba-dc79-4fda-baf8-1fadb3a03871 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:27.251201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c4b05-7b15-4c58-a7c5-689ee0fbe77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:27.252087 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c4b05-7b15-4c58-a7c5-689ee0fbe77a None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:27.252755 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c4b05-7b15-4c58-a7c5-689ee0fbe77a None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:27.253030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c4b05-7b15-4c58-a7c5-689ee0fbe77a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:27.254086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c4b05-7b15-4c58-a7c5-689ee0fbe77a None admin] RBAC: Adding query filter params (role.id=c136f425b8234bfda1c7a8a99fcdc614, user.id=763a130453714c99bc8d82836a401024, scope.system=all) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:27.254527 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c4b05-7b15-4c58-a7c5-689ee0fbe77a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:27.257907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c4b05-7b15-4c58-a7c5-689ee0fbe77a None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:27.270902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:27.274085 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 183/371] 10.222.0.33 () {56 vars in 1308 bytes} [Sat Aug 6 20:38:27 2022] GET /identity/v3/role_assignments?user.id=763a130453714c99bc8d82836a401024&scope.system=all&role.id=c136f425b8234bfda1c7a8a99fcdc614 => generated 510 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:27.279328 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c4b05-7b15-4c58-a7c5-689ee0fbe77a None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:27.381170 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34d39a-3fd9-4d6a-8061-2d6700ca382e None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:27.459628 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6879973-0e25-44e4-b56c-50c239e061ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:27.460231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6879973-0e25-44e4-b56c-50c239e061ed None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:27.460459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6879973-0e25-44e4-b56c-50c239e061ed None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:27.460738 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6879973-0e25-44e4-b56c-50c239e061ed None admin] PATH_INFO: `/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:27.462772 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6879973-0e25-44e4-b56c-50c239e061ed None admin] RBAC: Authorizing `identity:get_project(project_id=cfb3fc3dc2a2444e8e451370bc40764d)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:27.464898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6879973-0e25-44e4-b56c-50c239e061ed None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:27.469103 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 189/372] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:38:27 2022] GET /identity/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d => generated 302 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:27.469980 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6879973-0e25-44e4-b56c-50c239e061ed None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:27.490281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c4b05-7b15-4c58-a7c5-689ee0fbe77a None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:27.535066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733bca3-3bf2-4d7e-a5ff-a857f48d432f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:27.536113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733bca3-3bf2-4d7e-a5ff-a857f48d432f None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:27.536399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733bca3-3bf2-4d7e-a5ff-a857f48d432f None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:27.536675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733bca3-3bf2-4d7e-a5ff-a857f48d432f None admin] PATH_INFO: `/v3/groups/3a28385a72574dc091ffe6edbf6cd23f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:27.537814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c733bca3-3bf2-4d7e-a5ff-a857f48d432f None admin] RBAC: Authorizing `identity:get_group(group_id=3a28385a72574dc091ffe6edbf6cd23f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:27.540029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c733bca3-3bf2-4d7e-a5ff-a857f48d432f None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:27.542992 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 184/373] 10.222.0.33 () {56 vars in 1180 bytes} [Sat Aug 6 20:38:27 2022] GET /identity/v3/groups/3a28385a72574dc091ffe6edbf6cd23f => generated 226 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:27.543695 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:27.544902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733bca3-3bf2-4d7e-a5ff-a857f48d432f None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:27.611501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6879973-0e25-44e4-b56c-50c239e061ed None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:27.643493 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:27.654576 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0a9b4-d276-4d52-88bb-c28eecdfc546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:27.655208 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0a9b4-d276-4d52-88bb-c28eecdfc546 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:27.655603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0a9b4-d276-4d52-88bb-c28eecdfc546 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:27.655872 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0a9b4-d276-4d52-88bb-c28eecdfc546 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:27.700425 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733bca3-3bf2-4d7e-a5ff-a857f48d432f None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:27.748187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0a9b4-d276-4d52-88bb-c28eecdfc546 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:27.749291 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66697f66-1482-4b8d-8bd8-20bfaae2cf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:27.749648 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0a9b4-d276-4d52-88bb-c28eecdfc546 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:27.749944 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66697f66-1482-4b8d-8bd8-20bfaae2cf5b None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:27.750230 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66697f66-1482-4b8d-8bd8-20bfaae2cf5b None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:27.750501 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66697f66-1482-4b8d-8bd8-20bfaae2cf5b None admin] PATH_INFO: `/v3/groups/3a28385a72574dc091ffe6edbf6cd23f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:27.751690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66697f66-1482-4b8d-8bd8-20bfaae2cf5b None admin] RBAC: Authorizing `identity:get_group(group_id=3a28385a72574dc091ffe6edbf6cd23f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:27.753356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66697f66-1482-4b8d-8bd8-20bfaae2cf5b None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:27.755410 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 185/374] 10.222.0.33 () {56 vars in 1180 bytes} [Sat Aug 6 20:38:27 2022] GET /identity/v3/groups/3a28385a72574dc091ffe6edbf6cd23f => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:27.756201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66697f66-1482-4b8d-8bd8-20bfaae2cf5b None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:27.820887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:27.888350 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66697f66-1482-4b8d-8bd8-20bfaae2cf5b None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:27.896652 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 190/375] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:38:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:27.898509 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0a9b4-d276-4d52-88bb-c28eecdfc546 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:27.928001 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:27.936706 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee81b53-4fa8-4035-ae34-8060c628c7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:27.937595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee81b53-4fa8-4035-ae34-8060c628c7e9 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:27.937881 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee81b53-4fa8-4035-ae34-8060c628c7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:27.938159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee81b53-4fa8-4035-ae34-8060c628c7e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:27.938924 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee81b53-4fa8-4035-ae34-8060c628c7e9 None admin] RBAC: Adding query filter params (group.id=3a28385a72574dc091ffe6edbf6cd23f, role.id=1a212772e06344478184ce7d44a58b40, scope.project.id=cfb3fc3dc2a2444e8e451370bc40764d) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:27.939238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee81b53-4fa8-4035-ae34-8060c628c7e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:27.941197 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee81b53-4fa8-4035-ae34-8060c628c7e9 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:27.953158 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 186/376] 10.222.0.33 () {56 vars in 1376 bytes} [Sat Aug 6 20:38:27 2022] GET /identity/v3/role_assignments?group.id=3a28385a72574dc091ffe6edbf6cd23f&scope.project.id=cfb3fc3dc2a2444e8e451370bc40764d&role.id=1a212772e06344478184ce7d44a58b40 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:27.955826 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee81b53-4fa8-4035-ae34-8060c628c7e9 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:28.055306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0a9b4-d276-4d52-88bb-c28eecdfc546 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:28.099797 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f49e5e-a44a-4db7-af19-d78eb6f78f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:28.100417 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f49e5e-a44a-4db7-af19-d78eb6f78f82 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:28.100696 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f49e5e-a44a-4db7-af19-d78eb6f78f82 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:28.100974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f49e5e-a44a-4db7-af19-d78eb6f78f82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:28.101717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f49e5e-a44a-4db7-af19-d78eb6f78f82 None admin] RBAC: Adding query filter params (group.id=3a28385a72574dc091ffe6edbf6cd23f, role.id=b9254dbd663046739a1ba48d8c0027ad, scope.project.id=cfb3fc3dc2a2444e8e451370bc40764d) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:28.102030 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f49e5e-a44a-4db7-af19-d78eb6f78f82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:28.103843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f49e5e-a44a-4db7-af19-d78eb6f78f82 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:28.110576 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 191/377] 10.222.0.33 () {56 vars in 1376 bytes} [Sat Aug 6 20:38:27 2022] GET /identity/v3/role_assignments?group.id=3a28385a72574dc091ffe6edbf6cd23f&scope.project.id=cfb3fc3dc2a2444e8e451370bc40764d&role.id=b9254dbd663046739a1ba48d8c0027ad => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:28.111969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c83b4a-2e31-4196-9b0f-145e132215f1 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:28.112258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c83b4a-2e31-4196-9b0f-145e132215f1 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:28.112849 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c83b4a-2e31-4196-9b0f-145e132215f1 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:28.115153 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 192/378] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:28.118045 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee81b53-4fa8-4035-ae34-8060c628c7e9 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:28.129366 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f556ef5-28b4-4eed-9844-4ef28ac4039a None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:28.129989 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f556ef5-28b4-4eed-9844-4ef28ac4039a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:28.130499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f556ef5-28b4-4eed-9844-4ef28ac4039a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:28.164970 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-4f556ef5-28b4-4eed-9844-4ef28ac4039a None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:28.166264 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4f556ef5-28b4-4eed-9844-4ef28ac4039a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:28.181755 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be160c-7adf-438a-b4af-247232df85c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:28.183060 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be160c-7adf-438a-b4af-247232df85c6 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:28.183366 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be160c-7adf-438a-b4af-247232df85c6 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:28.183619 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be160c-7adf-438a-b4af-247232df85c6 None admin] PATH_INFO: `/v3/projects/39f3affb323c4555adb3a84fee8265cf` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:28.185099 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be160c-7adf-438a-b4af-247232df85c6 None admin] RBAC: Authorizing `identity:get_project(project_id=39f3affb323c4555adb3a84fee8265cf)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:28.187545 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be160c-7adf-438a-b4af-247232df85c6 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:28.189619 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 187/379] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:38:27 2022] GET /identity/v3/projects/39f3affb323c4555adb3a84fee8265cf => generated 344 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:28.196423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be160c-7adf-438a-b4af-247232df85c6 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:28.204287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:28.284757 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:28.350568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be160c-7adf-438a-b4af-247232df85c6 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:28.354978 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 193/380] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:28.378409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f556ef5-28b4-4eed-9844-4ef28ac4039a None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:28.394515 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b47f7-a896-4017-89bc-7ff3c0f70700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:28.395674 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b47f7-a896-4017-89bc-7ff3c0f70700 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:28.396164 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b47f7-a896-4017-89bc-7ff3c0f70700 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:28.396655 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b47f7-a896-4017-89bc-7ff3c0f70700 None admin] PATH_INFO: `/v3/groups/7e87e5c9e09c41f98fbcfaef88a9255e` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:28.405330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b47f7-a896-4017-89bc-7ff3c0f70700 None admin] RBAC: Authorizing `identity:get_group(group_id=7e87e5c9e09c41f98fbcfaef88a9255e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:28.407293 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b47f7-a896-4017-89bc-7ff3c0f70700 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:28.409744 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 188/381] 10.222.0.33 () {56 vars in 1180 bytes} [Sat Aug 6 20:38:28 2022] GET /identity/v3/groups/7e87e5c9e09c41f98fbcfaef88a9255e => generated 229 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:28.421243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b47f7-a896-4017-89bc-7ff3c0f70700 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:28.548232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f556ef5-28b4-4eed-9844-4ef28ac4039a None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:28.594003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b47f7-a896-4017-89bc-7ff3c0f70700 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:28.626213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:28.637962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f5557-7833-416e-9521-7fd93f1231b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:28.638145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1d8fb-6cb0-4a81-aa0c-5f19d00bc850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:28.638651 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1d8fb-6cb0-4a81-aa0c-5f19d00bc850 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:28.638936 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1d8fb-6cb0-4a81-aa0c-5f19d00bc850 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:28.639209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1d8fb-6cb0-4a81-aa0c-5f19d00bc850 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:28.639736 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f5557-7833-416e-9521-7fd93f1231b1 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:28.640209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f5557-7833-416e-9521-7fd93f1231b1 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:28.640672 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f5557-7833-416e-9521-7fd93f1231b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:28.641848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f5557-7833-416e-9521-7fd93f1231b1 None admin] RBAC: Adding query filter params (group.id=7e87e5c9e09c41f98fbcfaef88a9255e, role.id=ab245eea8a714462a00c4546309de9c9, scope.project.id=39f3affb323c4555adb3a84fee8265cf) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:28.642368 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f5557-7833-416e-9521-7fd93f1231b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:28.644042 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f5557-7833-416e-9521-7fd93f1231b1 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:28.650672 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 189/382] 10.222.0.33 () {56 vars in 1376 bytes} [Sat Aug 6 20:38:28 2022] GET /identity/v3/role_assignments?group.id=7e87e5c9e09c41f98fbcfaef88a9255e&scope.project.id=39f3affb323c4555adb3a84fee8265cf&role.id=ab245eea8a714462a00c4546309de9c9 => generated 260 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:28.663182 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1d8fb-6cb0-4a81-aa0c-5f19d00bc850 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:28.669112 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-bff1d8fb-6cb0-4a81-aa0c-5f19d00bc850 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:38:28.669112 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:28.669112 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:28.669112 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:28.669112 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:28.669112 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:28.669112 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:28.669112 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:28.669112 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:28.669112 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:28.669112 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:28.669112 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:28.669112 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:28.669112 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:28.669112 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:28.669112 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:28.670079 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:28.670079 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:28.670079 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:28.670079 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:28.670079 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:28.670079 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:28.670079 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:28.670079 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:28.670079 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:28.670079 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:28.670079 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:28.670079 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:28.670079 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:28.670079 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:28.670079 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:28.670079 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:28.670923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:28.670923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:28.670923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:28.670923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:28.670923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:28.670923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:28.670923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:28.670923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:28.670923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:28.670923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:28.670923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:38:28.670923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:28.673593 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 194/383] 10.222.0.33 () {56 vars in 1114 bytes} [Sat Aug 6 20:38:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:38:28.682577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f5557-7833-416e-9521-7fd93f1231b1 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:28.833802 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f5557-7833-416e-9521-7fd93f1231b1 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:28.871586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61685010-1682-4bd4-b35e-670000d1fb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:28.872200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61685010-1682-4bd4-b35e-670000d1fb13 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:28.872474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61685010-1682-4bd4-b35e-670000d1fb13 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:28.872739 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61685010-1682-4bd4-b35e-670000d1fb13 None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:28.873409 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61685010-1682-4bd4-b35e-670000d1fb13 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:28.873708 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61685010-1682-4bd4-b35e-670000d1fb13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:28.875121 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61685010-1682-4bd4-b35e-670000d1fb13 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:28.884562 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 190/384] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:38:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:28.890865 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1d8fb-6cb0-4a81-aa0c-5f19d00bc850 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:28.910472 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:29.030749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1d8fb-6cb0-4a81-aa0c-5f19d00bc850 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:29.077605 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b77392-d6cc-4ec4-a86d-fa69eaff2d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:29.078250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b77392-d6cc-4ec4-a86d-fa69eaff2d81 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:29.078528 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b77392-d6cc-4ec4-a86d-fa69eaff2d81 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:29.078820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b77392-d6cc-4ec4-a86d-fa69eaff2d81 None admin] PATH_INFO: `/v3/groups/3a28385a72574dc091ffe6edbf6cd23f` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:29.079938 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b77392-d6cc-4ec4-a86d-fa69eaff2d81 None admin] RBAC: Authorizing `identity:get_group(group_id=3a28385a72574dc091ffe6edbf6cd23f)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:29.081360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b77392-d6cc-4ec4-a86d-fa69eaff2d81 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:29.083490 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 195/385] 10.222.0.33 () {56 vars in 1180 bytes} [Sat Aug 6 20:38:28 2022] GET /identity/v3/groups/3a28385a72574dc091ffe6edbf6cd23f => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:29.089813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61685010-1682-4bd4-b35e-670000d1fb13 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:29.175779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:29.249947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61685010-1682-4bd4-b35e-670000d1fb13 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:29.298766 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8764b5-36c9-4d63-a36f-55b4c84744e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:29.299404 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8764b5-36c9-4d63-a36f-55b4c84744e6 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:29.299681 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8764b5-36c9-4d63-a36f-55b4c84744e6 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:29.299953 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8764b5-36c9-4d63-a36f-55b4c84744e6 None admin] PATH_INFO: `/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:29.301088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8764b5-36c9-4d63-a36f-55b4c84744e6 None admin] RBAC: Authorizing `identity:get_project(project_id=e4eeeb6b2c9345388f01f51f75c671dc)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:29.302532 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8764b5-36c9-4d63-a36f-55b4c84744e6 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:29.304481 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 191/386] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:38:29 2022] GET /identity/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:29.310770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b77392-d6cc-4ec4-a86d-fa69eaff2d81 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:29.382202 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5151ab4-fc98-4d82-8a3d-3a210ea663d6 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:29.382578 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5151ab4-fc98-4d82-8a3d-3a210ea663d6 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:29.382790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5151ab4-fc98-4d82-8a3d-3a210ea663d6 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:29.384520 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 192/387] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:38:29.390517 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383e118-f99f-4c53-9b3f-1d3e57e0b074 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:29.390841 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383e118-f99f-4c53-9b3f-1d3e57e0b074 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:29.391114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383e118-f99f-4c53-9b3f-1d3e57e0b074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:29.411279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-c383e118-f99f-4c53-9b3f-1d3e57e0b074 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:29.412457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c383e118-f99f-4c53-9b3f-1d3e57e0b074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:29.449685 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:29.503026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b77392-d6cc-4ec4-a86d-fa69eaff2d81 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:29.560609 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 193/388] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:38:29.572185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f181a1e-79fa-4a12-9688-519140e73248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:29.573374 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f181a1e-79fa-4a12-9688-519140e73248 None admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:29.573697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f181a1e-79fa-4a12-9688-519140e73248 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:29.574194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f181a1e-79fa-4a12-9688-519140e73248 None admin] PATH_INFO: `/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc/groups/3a28385a72574dc091ffe6edbf6cd23f/roles/b9254dbd663046739a1ba48d8c0027ad` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:29.576546 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f181a1e-79fa-4a12-9688-519140e73248 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4eeeb6b2c9345388f01f51f75c671dc, group_id=3a28385a72574dc091ffe6edbf6cd23f, role_id=b9254dbd663046739a1ba48d8c0027ad)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:29.577983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f181a1e-79fa-4a12-9688-519140e73248 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:29.597926 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 196/389] 10.222.0.33 () {58 vars in 1442 bytes} [Sat Aug 6 20:38:29 2022] PUT /identity/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc/groups/3a28385a72574dc091ffe6edbf6cd23f/roles/b9254dbd663046739a1ba48d8c0027ad => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:29.630910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383e118-f99f-4c53-9b3f-1d3e57e0b074 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:29.716085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:29.797481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383e118-f99f-4c53-9b3f-1d3e57e0b074 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:29.847026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914e117-54c6-4ce4-824d-dc106c2e8f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:29.847694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914e117-54c6-4ce4-824d-dc106c2e8f85 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:29.847960 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914e117-54c6-4ce4-824d-dc106c2e8f85 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:29.848238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914e117-54c6-4ce4-824d-dc106c2e8f85 None admin] PATH_INFO: `/v3/roles/member` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:29.860855 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8914e117-54c6-4ce4-824d-dc106c2e8f85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:29.865804 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-8914e117-54c6-4ce4-824d-dc106c2e8f85 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:38:29.865804 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:29.865804 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:29.865804 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:29.865804 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:29.865804 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:29.865804 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:29.865804 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:29.865804 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:29.865804 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:29.865804 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:29.865804 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:29.865804 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:29.865804 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:29.865804 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:29.865804 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:29.866767 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:29.866767 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:29.866767 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:29.866767 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:29.866767 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:29.866767 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:29.866767 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:29.866767 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:29.866767 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:29.866767 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:29.866767 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:29.866767 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:29.866767 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:29.866767 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:29.866767 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:29.866767 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:29.868683 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:29.868683 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:29.868683 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:29.868683 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:29.868683 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:29.868683 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:29.868683 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:29.868683 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:29.868683 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:29.868683 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:29.868683 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:38:29.868683 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:29.868683 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 194/390] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:38:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:38:29.873885 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f181a1e-79fa-4a12-9688-519140e73248 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:29.989872 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f181a1e-79fa-4a12-9688-519140e73248 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:30.033617 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3dae1d-b2ab-4ea2-bd06-df0face323ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:30.037074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3dae1d-b2ab-4ea2-bd06-df0face323ff None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:30.037352 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3dae1d-b2ab-4ea2-bd06-df0face323ff None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:30.037618 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3dae1d-b2ab-4ea2-bd06-df0face323ff None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:30.038502 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3dae1d-b2ab-4ea2-bd06-df0face323ff None admin] RBAC: Adding query filter params (name=member) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:30.038815 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3dae1d-b2ab-4ea2-bd06-df0face323ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:30.040323 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3dae1d-b2ab-4ea2-bd06-df0face323ff None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:30.048735 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:30.054604 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 197/391] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Aug 6 20:38:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:30.061613 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914e117-54c6-4ce4-824d-dc106c2e8f85 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:30.202283 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914e117-54c6-4ce4-824d-dc106c2e8f85 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:30.222810 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:30.292643 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea7865-7b49-41ab-adaa-c03f91bbf9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:30.293495 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea7865-7b49-41ab-adaa-c03f91bbf9f8 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:30.294522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea7865-7b49-41ab-adaa-c03f91bbf9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:30.296340 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea7865-7b49-41ab-adaa-c03f91bbf9f8 None admin] PATH_INFO: `/v3/groups/3a28385a72574dc091ffe6edbf6cd23f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:30.301714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea7865-7b49-41ab-adaa-c03f91bbf9f8 None admin] RBAC: Authorizing `identity:get_group(group_id=3a28385a72574dc091ffe6edbf6cd23f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:30.304635 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea7865-7b49-41ab-adaa-c03f91bbf9f8 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:30.305795 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 195/392] 10.222.0.33 () {56 vars in 1180 bytes} [Sat Aug 6 20:38:30 2022] GET /identity/v3/groups/3a28385a72574dc091ffe6edbf6cd23f => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:30.312860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3dae1d-b2ab-4ea2-bd06-df0face323ff None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:30.452876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3dae1d-b2ab-4ea2-bd06-df0face323ff None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:30.515989 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5f818-9d65-4e71-9789-deca629e1996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:30.516636 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5f818-9d65-4e71-9789-deca629e1996 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:30.516918 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5f818-9d65-4e71-9789-deca629e1996 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:30.517189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5f818-9d65-4e71-9789-deca629e1996 None admin] PATH_INFO: `/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:30.518362 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df5f818-9d65-4e71-9789-deca629e1996 None admin] RBAC: Authorizing `identity:get_project(project_id=e4eeeb6b2c9345388f01f51f75c671dc)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:30.519839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df5f818-9d65-4e71-9789-deca629e1996 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:30.521806 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 198/393] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:38:30 2022] GET /identity/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:30.529245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea7865-7b49-41ab-adaa-c03f91bbf9f8 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:30.685398 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea7865-7b49-41ab-adaa-c03f91bbf9f8 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:30.722150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6cdbe-2e35-4405-b2f1-20ec9c36e9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:30.722840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6cdbe-2e35-4405-b2f1-20ec9c36e9ea None admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:30.723116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6cdbe-2e35-4405-b2f1-20ec9c36e9ea None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:30.723388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6cdbe-2e35-4405-b2f1-20ec9c36e9ea None admin] PATH_INFO: `/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc/groups/3a28385a72574dc091ffe6edbf6cd23f/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:30.725287 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade6cdbe-2e35-4405-b2f1-20ec9c36e9ea None admin] RBAC: Authorizing `identity:create_grant(project_id=e4eeeb6b2c9345388f01f51f75c671dc, group_id=3a28385a72574dc091ffe6edbf6cd23f, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:30.726833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade6cdbe-2e35-4405-b2f1-20ec9c36e9ea None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:30.742478 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 196/394] 10.222.0.33 () {58 vars in 1442 bytes} [Sat Aug 6 20:38:30 2022] PUT /identity/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc/groups/3a28385a72574dc091ffe6edbf6cd23f/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:30.992895 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1568d50-abdb-427d-b884-e0b139c8bac6 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:30.993412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1568d50-abdb-427d-b884-e0b139c8bac6 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:30.993412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1568d50-abdb-427d-b884-e0b139c8bac6 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:30.994978 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 199/395] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:31.000275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566c957-41d4-4f93-ad47-9ab925d5ad0f None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:31.000561 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566c957-41d4-4f93-ad47-9ab925d5ad0f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:31.000832 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566c957-41d4-4f93-ad47-9ab925d5ad0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:31.023669 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-6566c957-41d4-4f93-ad47-9ab925d5ad0f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:31.024893 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6566c957-41d4-4f93-ad47-9ab925d5ad0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:31.065908 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:31.110615 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 197/396] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:31.137308 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1568d50-abdb-427d-b884-e0b139c8bac6 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:31.210196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:31.244098 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab65055-c6a7-4815-82a9-c20a0cce9ba5 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:31.244390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab65055-c6a7-4815-82a9-c20a0cce9ba5 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:31.245205 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab65055-c6a7-4815-82a9-c20a0cce9ba5 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:31.246454 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 198/397] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:38:31.252148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00633f-8353-4a70-a2c6-c3bdb9518efb None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:31.252430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00633f-8353-4a70-a2c6-c3bdb9518efb None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:31.252955 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00633f-8353-4a70-a2c6-c3bdb9518efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:31.261490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1568d50-abdb-427d-b884-e0b139c8bac6 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:31.283682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-1f00633f-8353-4a70-a2c6-c3bdb9518efb None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:31.285611 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1f00633f-8353-4a70-a2c6-c3bdb9518efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:31.328784 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ae5c7-4dd1-4c84-a05b-8dd019ad18a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:31.329428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ae5c7-4dd1-4c84-a05b-8dd019ad18a0 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:31.329707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ae5c7-4dd1-4c84-a05b-8dd019ad18a0 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:31.329981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ae5c7-4dd1-4c84-a05b-8dd019ad18a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:31.356141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ae5c7-4dd1-4c84-a05b-8dd019ad18a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:31.363143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-834ae5c7-4dd1-4c84-a05b-8dd019ad18a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:38:31.363143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:31.363143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:31.363143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:31.363143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:31.363143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:31.363143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:31.363143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:31.363143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:31.363143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:31.363143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:31.363143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:31.363143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:31.363143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:31.363143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:31.363143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:31.364034 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:31.364034 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:31.364034 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:31.364034 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:31.364034 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:31.364034 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:31.364034 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:31.364034 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:31.364034 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:31.364034 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:31.364034 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:31.364034 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:31.364034 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:31.364034 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:31.364034 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:31.364034 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:31.364839 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:31.364839 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:31.364839 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:31.364839 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:31.364839 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:31.364839 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:31.364839 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:31.364839 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:31.364839 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:31.364839 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:31.364839 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:38:31.364839 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:31.366651 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 200/398] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:38:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:31.374571 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ae5c7-4dd1-4c84-a05b-8dd019ad18a0 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:31.414687 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 199/399] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:31.435708 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00633f-8353-4a70-a2c6-c3bdb9518efb None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:31.485807 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ae5c7-4dd1-4c84-a05b-8dd019ad18a0 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:31.520509 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:31.538574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd779a1-5e3b-4a7a-b232-dd0c0ff4cb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:31.539866 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd779a1-5e3b-4a7a-b232-dd0c0ff4cb09 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:31.540353 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd779a1-5e3b-4a7a-b232-dd0c0ff4cb09 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:31.540935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd779a1-5e3b-4a7a-b232-dd0c0ff4cb09 None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:31.542097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd779a1-5e3b-4a7a-b232-dd0c0ff4cb09 None admin] RBAC: Adding query filter params (name=member) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:31.542664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd779a1-5e3b-4a7a-b232-dd0c0ff4cb09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:31.544297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd779a1-5e3b-4a7a-b232-dd0c0ff4cb09 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:31.556234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:31.562647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00633f-8353-4a70-a2c6-c3bdb9518efb None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:31.565254 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 201/400] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Aug 6 20:38:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:31.570440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd779a1-5e3b-4a7a-b232-dd0c0ff4cb09 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:31.609811 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d7e9f-3891-4f05-940c-3d67d0f84f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:31.610776 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d7e9f-3891-4f05-940c-3d67d0f84f9c None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:31.611261 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d7e9f-3891-4f05-940c-3d67d0f84f9c None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:31.611822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d7e9f-3891-4f05-940c-3d67d0f84f9c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:31.632331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d7e9f-3891-4f05-940c-3d67d0f84f9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:31.638026 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-6f4d7e9f-3891-4f05-940c-3d67d0f84f9c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:38:31.638026 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:31.638026 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:31.638026 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:31.638026 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:31.638026 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:31.638026 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:31.638026 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:31.638026 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:31.638026 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:31.638026 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:31.638026 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:31.638026 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:31.638026 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:31.638026 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:31.638026 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:31.638977 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:31.638977 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:31.638977 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:31.638977 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:31.638977 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:31.638977 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:31.638977 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:31.638977 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:31.638977 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:31.638977 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:31.638977 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:31.638977 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:31.638977 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:31.638977 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:31.638977 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:31.638977 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:31.639772 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:31.639772 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:31.639772 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:31.639772 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:31.639772 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:31.639772 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:31.639772 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:31.639772 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:31.639772 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:31.639772 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:31.639772 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:38:31.639772 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:31.646637 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 200/401] 10.222.0.33 () {56 vars in 1114 bytes} [Sat Aug 6 20:38:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:31.648120 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d7e9f-3891-4f05-940c-3d67d0f84f9c None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:31.739468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd779a1-5e3b-4a7a-b232-dd0c0ff4cb09 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:31.775730 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859e0a2-b4bf-4b75-938e-8b67df7af3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:31.776407 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859e0a2-b4bf-4b75-938e-8b67df7af3b5 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:31.776668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859e0a2-b4bf-4b75-938e-8b67df7af3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:31.776942 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859e0a2-b4bf-4b75-938e-8b67df7af3b5 None admin] PATH_INFO: `/v3/groups/3a28385a72574dc091ffe6edbf6cd23f` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:31.778036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859e0a2-b4bf-4b75-938e-8b67df7af3b5 None admin] RBAC: Authorizing `identity:get_group(group_id=3a28385a72574dc091ffe6edbf6cd23f)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:31.779496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859e0a2-b4bf-4b75-938e-8b67df7af3b5 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:31.781358 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 202/402] 10.222.0.33 () {56 vars in 1180 bytes} [Sat Aug 6 20:38:31 2022] GET /identity/v3/groups/3a28385a72574dc091ffe6edbf6cd23f => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:31.782540 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c564947-7047-4776-9b7d-0b25a63a107a None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:31.782842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c564947-7047-4776-9b7d-0b25a63a107a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:31.783111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c564947-7047-4776-9b7d-0b25a63a107a None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:31.784446 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 203/403] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:31.786728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c564947-7047-4776-9b7d-0b25a63a107a None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:31.809512 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d7e9f-3891-4f05-940c-3d67d0f84f9c None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:31.852602 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eecbab8-4498-41d0-a2e3-7f2e8f75297e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:31.853352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eecbab8-4498-41d0-a2e3-7f2e8f75297e None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:31.853628 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eecbab8-4498-41d0-a2e3-7f2e8f75297e None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:31.853927 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eecbab8-4498-41d0-a2e3-7f2e8f75297e None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:31.855032 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eecbab8-4498-41d0-a2e3-7f2e8f75297e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:31.855335 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eecbab8-4498-41d0-a2e3-7f2e8f75297e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:31.856986 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eecbab8-4498-41d0-a2e3-7f2e8f75297e None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:31.857522 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:31.872281 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 201/404] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:38:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:31.872281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227ff2f-157f-4d33-97a3-5905e32d93f0 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:31.872281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227ff2f-157f-4d33-97a3-5905e32d93f0 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:31.872281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227ff2f-157f-4d33-97a3-5905e32d93f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:31.891247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-3227ff2f-157f-4d33-97a3-5905e32d93f0 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:31.892425 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3227ff2f-157f-4d33-97a3-5905e32d93f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:31.910070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:31.916610 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c564947-7047-4776-9b7d-0b25a63a107a None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:31.963922 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3e937-0340-4d54-a86f-e3397a53fa9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:31.965317 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3e937-0340-4d54-a86f-e3397a53fa9e None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:31.966027 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3e937-0340-4d54-a86f-e3397a53fa9e None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:31.966562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3e937-0340-4d54-a86f-e3397a53fa9e None admin] PATH_INFO: `/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:31.968777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc3e937-0340-4d54-a86f-e3397a53fa9e None admin] RBAC: Authorizing `identity:get_project(project_id=cfb3fc3dc2a2444e8e451370bc40764d)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:31.970415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc3e937-0340-4d54-a86f-e3397a53fa9e None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:31.972666 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 202/406] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:31.972897 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 204/406] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:38:31 2022] GET /identity/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:31.973706 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227ff2f-157f-4d33-97a3-5905e32d93f0 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:31.978589 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3e937-0340-4d54-a86f-e3397a53fa9e None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:32.101227 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3e937-0340-4d54-a86f-e3397a53fa9e None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:32.102767 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227ff2f-157f-4d33-97a3-5905e32d93f0 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:32.132783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:32.143074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b901fe3-8d6d-41f1-af4b-4e98bdb37c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:32.143317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3135fee-46ec-4033-97bc-38d676bf7419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:32.144000 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b901fe3-8d6d-41f1-af4b-4e98bdb37c1a None admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:32.144253 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3135fee-46ec-4033-97bc-38d676bf7419 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:32.144453 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b901fe3-8d6d-41f1-af4b-4e98bdb37c1a None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:32.144818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b901fe3-8d6d-41f1-af4b-4e98bdb37c1a None admin] PATH_INFO: `/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d/groups/3a28385a72574dc091ffe6edbf6cd23f/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:32.144994 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3135fee-46ec-4033-97bc-38d676bf7419 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:32.145407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3135fee-46ec-4033-97bc-38d676bf7419 None admin] PATH_INFO: `/v3/groups/3a28385a72574dc091ffe6edbf6cd23f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:32.146885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3135fee-46ec-4033-97bc-38d676bf7419 None admin] RBAC: Authorizing `identity:get_group(group_id=3a28385a72574dc091ffe6edbf6cd23f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:32.147287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b901fe3-8d6d-41f1-af4b-4e98bdb37c1a None admin] RBAC: Authorizing `identity:create_grant(project_id=cfb3fc3dc2a2444e8e451370bc40764d, group_id=3a28385a72574dc091ffe6edbf6cd23f, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:32.148703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3135fee-46ec-4033-97bc-38d676bf7419 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:32.148936 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b901fe3-8d6d-41f1-af4b-4e98bdb37c1a None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:32.156666 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 203/407] 10.222.0.33 () {56 vars in 1180 bytes} [Sat Aug 6 20:38:31 2022] GET /identity/v3/groups/3a28385a72574dc091ffe6edbf6cd23f => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:32.156666 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3135fee-46ec-4033-97bc-38d676bf7419 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:32.170182 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 205/408] 10.222.0.33 () {58 vars in 1442 bytes} [Sat Aug 6 20:38:31 2022] PUT /identity/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d/groups/3a28385a72574dc091ffe6edbf6cd23f/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:38:32.170912 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b901fe3-8d6d-41f1-af4b-4e98bdb37c1a None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:32.189944 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:32.353476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b901fe3-8d6d-41f1-af4b-4e98bdb37c1a None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:32.391431 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3135fee-46ec-4033-97bc-38d676bf7419 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:32.408839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eccb6f-787e-454f-8b38-e5ec2a4a7f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:32.409502 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eccb6f-787e-454f-8b38-e5ec2a4a7f7f None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:32.409856 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eccb6f-787e-454f-8b38-e5ec2a4a7f7f None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:32.410132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eccb6f-787e-454f-8b38-e5ec2a4a7f7f None admin] PATH_INFO: `/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:32.411800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eccb6f-787e-454f-8b38-e5ec2a4a7f7f None admin] RBAC: Authorizing `identity:get_project(project_id=cfb3fc3dc2a2444e8e451370bc40764d)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:32.415567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eccb6f-787e-454f-8b38-e5ec2a4a7f7f None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:32.417664 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 206/409] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:38:32 2022] GET /identity/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:32.424175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eccb6f-787e-454f-8b38-e5ec2a4a7f7f None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:32.448822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6a815-1ebb-4efd-b6e2-0a7817b148cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:32.449448 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6a815-1ebb-4efd-b6e2-0a7817b148cd None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:32.449710 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6a815-1ebb-4efd-b6e2-0a7817b148cd None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:32.449977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6a815-1ebb-4efd-b6e2-0a7817b148cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:32.460883 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6a815-1ebb-4efd-b6e2-0a7817b148cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:32.466328 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-05b6a815-1ebb-4efd-b6e2-0a7817b148cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:38:32.466328 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:32.466328 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:32.466328 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:32.466328 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:32.466328 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:32.466328 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:32.466328 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:32.466328 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:32.466328 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:32.466328 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:32.466328 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:32.466328 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:32.466328 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:32.466328 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:32.466328 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:32.467311 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:32.467311 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:32.467311 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:32.467311 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:32.467311 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:32.467311 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:32.467311 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:32.467311 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:32.467311 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:32.467311 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:32.467311 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:32.467311 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:32.467311 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:32.467311 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:32.467311 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:32.467311 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:32.468129 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:32.468129 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:32.468129 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:32.468129 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:32.468129 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:32.468129 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:32.468129 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:32.468129 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:32.468129 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:32.468129 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:32.468129 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:38:32.468129 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:32.469508 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 204/410] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Aug 6 20:38:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:32.475277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6a815-1ebb-4efd-b6e2-0a7817b148cd None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:32.499855 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:32.565920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eccb6f-787e-454f-8b38-e5ec2a4a7f7f None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:32.582920 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:32.623686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6a815-1ebb-4efd-b6e2-0a7817b148cd None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:32.642496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c8d23-196b-4f00-87bc-263b0b6fd809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:32.643321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c8d23-196b-4f00-87bc-263b0b6fd809 None admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:32.643604 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c8d23-196b-4f00-87bc-263b0b6fd809 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:32.643877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c8d23-196b-4f00-87bc-263b0b6fd809 None admin] PATH_INFO: `/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d/groups/3a28385a72574dc091ffe6edbf6cd23f/roles/b9254dbd663046739a1ba48d8c0027ad` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:32.647254 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c8d23-196b-4f00-87bc-263b0b6fd809 None admin] RBAC: Authorizing `identity:create_grant(project_id=cfb3fc3dc2a2444e8e451370bc40764d, group_id=3a28385a72574dc091ffe6edbf6cd23f, role_id=b9254dbd663046739a1ba48d8c0027ad)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:32.648690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c8d23-196b-4f00-87bc-263b0b6fd809 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:32.678746 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 207/411] 10.222.0.33 () {58 vars in 1442 bytes} [Sat Aug 6 20:38:32 2022] PUT /identity/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d/groups/3a28385a72574dc091ffe6edbf6cd23f/roles/b9254dbd663046739a1ba48d8c0027ad => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:32.682754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e0da0-2e96-420b-820d-3306a8b8aa27 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:32.684265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e0da0-2e96-420b-820d-3306a8b8aa27 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:32.685135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e0da0-2e96-420b-820d-3306a8b8aa27 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:32.688893 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 208/412] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:32.690249 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155c186-9514-4f5e-93cb-9646d130aa55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:32.691068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155c186-9514-4f5e-93cb-9646d130aa55 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:32.691525 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155c186-9514-4f5e-93cb-9646d130aa55 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:32.691936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155c186-9514-4f5e-93cb-9646d130aa55 None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:32.692816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155c186-9514-4f5e-93cb-9646d130aa55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:32.693270 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155c186-9514-4f5e-93cb-9646d130aa55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:32.694832 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155c186-9514-4f5e-93cb-9646d130aa55 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:32.697139 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c37aeb-e046-4237-aac1-5f6d470b146e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:32.697581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c37aeb-e046-4237-aac1-5f6d470b146e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:32.698686 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c37aeb-e046-4237-aac1-5f6d470b146e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:32.727149 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 205/413] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:38:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:32.730952 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155c186-9514-4f5e-93cb-9646d130aa55 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:32.743934 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-39c37aeb-e046-4237-aac1-5f6d470b146e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:32.745468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-39c37aeb-e046-4237-aac1-5f6d470b146e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:32.893855 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 209/414] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:38:32.915450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155c186-9514-4f5e-93cb-9646d130aa55 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:32.920304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c37aeb-e046-4237-aac1-5f6d470b146e None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:32.955482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eefc885-1228-4923-8d0d-fc0c0561f52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:32.956361 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefc885-1228-4923-8d0d-fc0c0561f52c None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:32.956809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefc885-1228-4923-8d0d-fc0c0561f52c None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:32.957226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefc885-1228-4923-8d0d-fc0c0561f52c None admin] PATH_INFO: `/v3/groups/7e87e5c9e09c41f98fbcfaef88a9255e` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:32.958864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eefc885-1228-4923-8d0d-fc0c0561f52c None admin] RBAC: Authorizing `identity:get_group(group_id=7e87e5c9e09c41f98fbcfaef88a9255e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:32.960456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eefc885-1228-4923-8d0d-fc0c0561f52c None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:32.962461 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 206/415] 10.222.0.33 () {56 vars in 1180 bytes} [Sat Aug 6 20:38:32 2022] GET /identity/v3/groups/7e87e5c9e09c41f98fbcfaef88a9255e => generated 229 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:32.968243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eefc885-1228-4923-8d0d-fc0c0561f52c None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:32.972181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:32.981955 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:33.037880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c37aeb-e046-4237-aac1-5f6d470b146e None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:33.076846 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eefc885-1228-4923-8d0d-fc0c0561f52c None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:33.077439 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092bc72-0f2b-43ee-b6e9-45878bf8e316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:33.078360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092bc72-0f2b-43ee-b6e9-45878bf8e316 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:33.078821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092bc72-0f2b-43ee-b6e9-45878bf8e316 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:33.079319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092bc72-0f2b-43ee-b6e9-45878bf8e316 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:33.091039 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c092bc72-0f2b-43ee-b6e9-45878bf8e316 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:33.096588 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-c092bc72-0f2b-43ee-b6e9-45878bf8e316 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:38:33.096588 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:33.096588 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:33.096588 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:33.096588 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:33.096588 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:33.096588 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:33.096588 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:33.096588 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:33.096588 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:33.096588 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:33.096588 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:33.096588 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:33.096588 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:33.096588 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:33.096588 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:33.097464 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:33.097464 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:33.097464 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:33.097464 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:33.097464 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:33.097464 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:33.097464 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:33.097464 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:33.097464 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:33.097464 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:33.097464 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:33.097464 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:33.097464 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:33.097464 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:33.097464 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:33.097464 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:33.098244 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:33.098244 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:33.098244 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:33.098244 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:33.098244 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:33.098244 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:33.098244 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:33.098244 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:33.098244 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:33.098244 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:33.098244 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:38:33.098244 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:33.101034 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 210/416] 10.222.0.33 () {56 vars in 1114 bytes} [Sat Aug 6 20:38:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:38:33.108163 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092bc72-0f2b-43ee-b6e9-45878bf8e316 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:33.112864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a128f7-3f12-4546-8c31-ab06714ccd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:33.114326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a128f7-3f12-4546-8c31-ab06714ccd67 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:33.114642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a128f7-3f12-4546-8c31-ab06714ccd67 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:33.114922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a128f7-3f12-4546-8c31-ab06714ccd67 None admin] PATH_INFO: `/v3/projects/39f3affb323c4555adb3a84fee8265cf` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:33.116123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a128f7-3f12-4546-8c31-ab06714ccd67 None admin] RBAC: Authorizing `identity:get_project(project_id=39f3affb323c4555adb3a84fee8265cf)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:33.117585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a128f7-3f12-4546-8c31-ab06714ccd67 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:33.119581 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 207/417] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:38:32 2022] GET /identity/v3/projects/39f3affb323c4555adb3a84fee8265cf => generated 344 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:33.129257 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a128f7-3f12-4546-8c31-ab06714ccd67 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:33.220842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:33.249493 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a128f7-3f12-4546-8c31-ab06714ccd67 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:33.294692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54457464-64d0-41b3-a58d-8314dad68019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:33.295500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54457464-64d0-41b3-a58d-8314dad68019 None admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:33.295786 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54457464-64d0-41b3-a58d-8314dad68019 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:33.296062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54457464-64d0-41b3-a58d-8314dad68019 None admin] PATH_INFO: `/v3/projects/39f3affb323c4555adb3a84fee8265cf/groups/7e87e5c9e09c41f98fbcfaef88a9255e/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:33.298153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54457464-64d0-41b3-a58d-8314dad68019 None admin] RBAC: Authorizing `identity:create_grant(project_id=39f3affb323c4555adb3a84fee8265cf, group_id=7e87e5c9e09c41f98fbcfaef88a9255e, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:33.300029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54457464-64d0-41b3-a58d-8314dad68019 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:33.314017 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092bc72-0f2b-43ee-b6e9-45878bf8e316 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:33.320334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:33.324470 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 208/418] 10.222.0.33 () {58 vars in 1442 bytes} [Sat Aug 6 20:38:33 2022] PUT /identity/v3/projects/39f3affb323c4555adb3a84fee8265cf/groups/7e87e5c9e09c41f98fbcfaef88a9255e/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:33.367722 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c50879-e060-46d0-9a3a-29e4c2f171f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:33.368822 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c50879-e060-46d0-9a3a-29e4c2f171f8 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:33.370013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c50879-e060-46d0-9a3a-29e4c2f171f8 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:33.370597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c50879-e060-46d0-9a3a-29e4c2f171f8 None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:33.371988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c50879-e060-46d0-9a3a-29e4c2f171f8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:33.372622 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c50879-e060-46d0-9a3a-29e4c2f171f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:33.374971 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c50879-e060-46d0-9a3a-29e4c2f171f8 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:33.384385 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 211/419] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:38:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:33.390747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54457464-64d0-41b3-a58d-8314dad68019 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:33.502402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54457464-64d0-41b3-a58d-8314dad68019 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:33.546427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f403101-db7b-4824-b109-496bd7695ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:33.547150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f403101-db7b-4824-b109-496bd7695ec3 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:33.547714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f403101-db7b-4824-b109-496bd7695ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:33.547987 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f403101-db7b-4824-b109-496bd7695ec3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:33.552093 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:33.627734 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f403101-db7b-4824-b109-496bd7695ec3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:33.629232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f403101-db7b-4824-b109-496bd7695ec3 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:33.736033 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 209/420] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:38:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:33.741552 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c50879-e060-46d0-9a3a-29e4c2f171f8 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:33.798622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7b8b1-20c6-448f-961a-4c746537b2c7 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:33.799211 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7b8b1-20c6-448f-961a-4c746537b2c7 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:33.799694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7b8b1-20c6-448f-961a-4c746537b2c7 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:33.801630 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 210/421] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:33.806710 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb5388-2966-4f68-b5ec-d7f513032489 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:33.807822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb5388-2966-4f68-b5ec-d7f513032489 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:33.808305 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb5388-2966-4f68-b5ec-d7f513032489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:33.827388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-46eb5388-2966-4f68-b5ec-d7f513032489 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:33.828899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-46eb5388-2966-4f68-b5ec-d7f513032489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:33.873828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:33.911475 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c50879-e060-46d0-9a3a-29e4c2f171f8 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:33.939663 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 211/422] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:38:33.959178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed5fa8-32ce-4393-a892-2d62e147ec07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:33.960116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed5fa8-32ce-4393-a892-2d62e147ec07 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:33.960607 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed5fa8-32ce-4393-a892-2d62e147ec07 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:33.961086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed5fa8-32ce-4393-a892-2d62e147ec07 None admin] PATH_INFO: `/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:33.962464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed5fa8-32ce-4393-a892-2d62e147ec07 None admin] RBAC: Authorizing `identity:get_project(project_id=e4eeeb6b2c9345388f01f51f75c671dc)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:33.964569 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed5fa8-32ce-4393-a892-2d62e147ec07 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:33.966686 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 212/423] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:38:33 2022] GET /identity/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:33.972358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb5388-2966-4f68-b5ec-d7f513032489 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:33.993154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed5fa8-32ce-4393-a892-2d62e147ec07 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:34.040717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:34.113955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed5fa8-32ce-4393-a892-2d62e147ec07 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:34.169890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc8b13-1a0c-4886-9bda-f43ab0e3cb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:34.171173 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc8b13-1a0c-4886-9bda-f43ab0e3cb76 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:34.171931 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc8b13-1a0c-4886-9bda-f43ab0e3cb76 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:34.172835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc8b13-1a0c-4886-9bda-f43ab0e3cb76 None admin] PATH_INFO: `/v3/roles/member` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:34.186600 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb5388-2966-4f68-b5ec-d7f513032489 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:34.189789 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc8b13-1a0c-4886-9bda-f43ab0e3cb76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:34.194825 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-bcdc8b13-1a0c-4886-9bda-f43ab0e3cb76 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:38:34.194825 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:34.194825 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:34.194825 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:34.194825 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:34.194825 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:34.194825 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:34.194825 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:34.194825 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:34.194825 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:34.194825 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:34.194825 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:34.194825 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:34.194825 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:34.194825 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:34.194825 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:34.195892 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:34.195892 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:34.195892 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:34.195892 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:34.195892 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:34.195892 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:34.195892 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:34.195892 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:34.195892 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:34.195892 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:34.195892 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:34.195892 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:34.195892 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:34.195892 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:34.195892 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:34.195892 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:34.196896 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:34.196896 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:34.196896 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:34.196896 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:34.196896 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:34.196896 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:34.196896 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:34.196896 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:34.196896 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:34.196896 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:34.196896 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:38:34.196896 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:34.206620 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 213/424] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:38:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:38:34.211401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc8b13-1a0c-4886-9bda-f43ab0e3cb76 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:34.253745 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48a2d1-34a0-446d-afbd-94f468631b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:34.254647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48a2d1-34a0-446d-afbd-94f468631b33 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:34.255176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48a2d1-34a0-446d-afbd-94f468631b33 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:34.256428 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48a2d1-34a0-446d-afbd-94f468631b33 None admin] PATH_INFO: `/v3/groups/3a28385a72574dc091ffe6edbf6cd23f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:34.257840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a48a2d1-34a0-446d-afbd-94f468631b33 None admin] RBAC: Authorizing `identity:get_group(group_id=3a28385a72574dc091ffe6edbf6cd23f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:34.261362 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a48a2d1-34a0-446d-afbd-94f468631b33 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:34.263399 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 212/425] 10.222.0.33 () {56 vars in 1180 bytes} [Sat Aug 6 20:38:33 2022] GET /identity/v3/groups/3a28385a72574dc091ffe6edbf6cd23f => generated 226 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:34.269370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48a2d1-34a0-446d-afbd-94f468631b33 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:34.336454 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:34.365014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:34.382273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc8b13-1a0c-4886-9bda-f43ab0e3cb76 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:34.450234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b1026-aefa-4c75-bf0d-fe883de3ecc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:34.450867 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b1026-aefa-4c75-bf0d-fe883de3ecc6 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:34.451143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b1026-aefa-4c75-bf0d-fe883de3ecc6 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:34.451413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b1026-aefa-4c75-bf0d-fe883de3ecc6 None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:34.452139 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b1026-aefa-4c75-bf0d-fe883de3ecc6 None admin] RBAC: Adding query filter params (name=member) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:34.452443 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b1026-aefa-4c75-bf0d-fe883de3ecc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:34.453805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b1026-aefa-4c75-bf0d-fe883de3ecc6 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:34.467673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48a2d1-34a0-446d-afbd-94f468631b33 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:34.471990 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 214/426] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Aug 6 20:38:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:34.486046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b1026-aefa-4c75-bf0d-fe883de3ecc6 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:34.520349 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf68db-ddf9-49f1-b0c3-cbea1f5e634c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:34.521327 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf68db-ddf9-49f1-b0c3-cbea1f5e634c None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:34.521892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf68db-ddf9-49f1-b0c3-cbea1f5e634c None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:34.522356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf68db-ddf9-49f1-b0c3-cbea1f5e634c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:34.523294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf68db-ddf9-49f1-b0c3-cbea1f5e634c None admin] RBAC: Adding query filter params (group.id=3a28385a72574dc091ffe6edbf6cd23f, role.id=b9254dbd663046739a1ba48d8c0027ad, scope.project.id=e4eeeb6b2c9345388f01f51f75c671dc) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:34.523894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf68db-ddf9-49f1-b0c3-cbea1f5e634c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:34.525523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf68db-ddf9-49f1-b0c3-cbea1f5e634c None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:34.537530 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 213/427] 10.222.0.33 () {56 vars in 1376 bytes} [Sat Aug 6 20:38:34 2022] GET /identity/v3/role_assignments?group.id=3a28385a72574dc091ffe6edbf6cd23f&scope.project.id=e4eeeb6b2c9345388f01f51f75c671dc&role.id=b9254dbd663046739a1ba48d8c0027ad => generated 611 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:34.674092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b1026-aefa-4c75-bf0d-fe883de3ecc6 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:34.711091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7c36a-d00b-4328-943d-5129326a718a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:34.711711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7c36a-d00b-4328-943d-5129326a718a None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:34.711991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7c36a-d00b-4328-943d-5129326a718a None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:34.712263 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7c36a-d00b-4328-943d-5129326a718a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:34.749503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:34.808303 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c7c36a-d00b-4328-943d-5129326a718a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:34.810059 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c7c36a-d00b-4328-943d-5129326a718a None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:34.924092 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 215/428] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:38:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:34.929628 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf68db-ddf9-49f1-b0c3-cbea1f5e634c None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:34.936486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7d8c9-bf0a-4c36-93be-84c73f6380e2 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:34.936764 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7d8c9-bf0a-4c36-93be-84c73f6380e2 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:34.937036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7d8c9-bf0a-4c36-93be-84c73f6380e2 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:34.938518 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 216/429] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:38:34.943671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e0274-f7b1-468d-beab-e5908ac7f35b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:34.943951 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e0274-f7b1-468d-beab-e5908ac7f35b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:34.944220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e0274-f7b1-468d-beab-e5908ac7f35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:34.966356 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-769e0274-f7b1-468d-beab-e5908ac7f35b None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:34.967725 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-769e0274-f7b1-468d-beab-e5908ac7f35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:35.038210 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:35.062165 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 217/430] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:38:35.076391 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:35.083084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf68db-ddf9-49f1-b0c3-cbea1f5e634c None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:35.090823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e0274-f7b1-468d-beab-e5908ac7f35b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:35.134170 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aae418-84cc-489f-95fb-27affa89d2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:35.134835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aae418-84cc-489f-95fb-27affa89d2ba None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:35.135728 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aae418-84cc-489f-95fb-27affa89d2ba None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:35.135997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aae418-84cc-489f-95fb-27affa89d2ba None admin] PATH_INFO: `/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:35.137136 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aae418-84cc-489f-95fb-27affa89d2ba None admin] RBAC: Authorizing `identity:get_project(project_id=e4eeeb6b2c9345388f01f51f75c671dc)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:35.138865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aae418-84cc-489f-95fb-27affa89d2ba None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:35.141941 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 214/431] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:38:34 2022] GET /identity/v3/projects/e4eeeb6b2c9345388f01f51f75c671dc => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:35.147058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aae418-84cc-489f-95fb-27affa89d2ba None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:35.223095 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e0274-f7b1-468d-beab-e5908ac7f35b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:35.261396 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aae418-84cc-489f-95fb-27affa89d2ba None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:35.270423 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7bd95-b112-4c3a-b312-f605c38e75a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:35.271170 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7bd95-b112-4c3a-b312-f605c38e75a6 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:35.272036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7bd95-b112-4c3a-b312-f605c38e75a6 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:35.272378 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7bd95-b112-4c3a-b312-f605c38e75a6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:35.286563 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c7bd95-b112-4c3a-b312-f605c38e75a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:35.294660 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-82c7bd95-b112-4c3a-b312-f605c38e75a6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:38:35.294660 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:35.294660 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:35.294660 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:35.294660 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:35.294660 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:35.294660 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:35.294660 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:35.294660 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:35.294660 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:35.294660 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:35.294660 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:35.294660 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:35.294660 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:35.294660 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:35.294660 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:35.295546 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:35.295546 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:35.295546 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:35.295546 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:35.295546 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:35.295546 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:35.295546 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:35.295546 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:35.295546 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:35.295546 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:35.295546 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:35.295546 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:35.295546 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:35.295546 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:35.295546 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:35.295546 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:35.296361 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:35.296361 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:35.296361 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:35.296361 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:35.296361 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:35.296361 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:35.296361 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:35.296361 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:35.296361 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:35.296361 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:35.296361 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:38:35.296361 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:35.298620 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 218/432] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:38:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:35.301553 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7bd95-b112-4c3a-b312-f605c38e75a6 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:35.306098 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e6bcb-ea2a-4659-b075-bc0a5ddadad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:35.307552 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e6bcb-ea2a-4659-b075-bc0a5ddadad7 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:35.308040 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e6bcb-ea2a-4659-b075-bc0a5ddadad7 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:35.308601 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e6bcb-ea2a-4659-b075-bc0a5ddadad7 None admin] PATH_INFO: `/v3/groups/3a28385a72574dc091ffe6edbf6cd23f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:35.310224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e6bcb-ea2a-4659-b075-bc0a5ddadad7 None admin] RBAC: Authorizing `identity:get_group(group_id=3a28385a72574dc091ffe6edbf6cd23f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:35.311892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e6bcb-ea2a-4659-b075-bc0a5ddadad7 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:35.318673 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 215/433] 10.222.0.33 () {56 vars in 1180 bytes} [Sat Aug 6 20:38:35 2022] GET /identity/v3/groups/3a28385a72574dc091ffe6edbf6cd23f => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:35.320105 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e6bcb-ea2a-4659-b075-bc0a5ddadad7 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:35.361868 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:35.367302 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:35.442811 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e6bcb-ea2a-4659-b075-bc0a5ddadad7 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:35.443003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7bd95-b112-4c3a-b312-f605c38e75a6 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:35.484635 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98c019-a046-4dfb-b081-960ee84b7279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:35.485050 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17013062-daaa-4ee0-b91d-198d48b67e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:35.485664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17013062-daaa-4ee0-b91d-198d48b67e28 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:35.485943 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17013062-daaa-4ee0-b91d-198d48b67e28 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:35.486215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17013062-daaa-4ee0-b91d-198d48b67e28 None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:35.486429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98c019-a046-4dfb-b081-960ee84b7279 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:35.486908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17013062-daaa-4ee0-b91d-198d48b67e28 None admin] RBAC: Adding query filter params (name=member) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:35.487155 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98c019-a046-4dfb-b081-960ee84b7279 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:35.487259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17013062-daaa-4ee0-b91d-198d48b67e28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:35.487719 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98c019-a046-4dfb-b081-960ee84b7279 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:35.488552 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17013062-daaa-4ee0-b91d-198d48b67e28 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:35.489006 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f98c019-a046-4dfb-b081-960ee84b7279 None admin] RBAC: Adding query filter params (group.id=3a28385a72574dc091ffe6edbf6cd23f, role.id=1a212772e06344478184ce7d44a58b40, scope.project.id=e4eeeb6b2c9345388f01f51f75c671dc) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:35.489510 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f98c019-a046-4dfb-b081-960ee84b7279 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:35.491198 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f98c019-a046-4dfb-b081-960ee84b7279 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:35.502188 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 216/434] 10.222.0.33 () {56 vars in 1376 bytes} [Sat Aug 6 20:38:35 2022] GET /identity/v3/role_assignments?group.id=3a28385a72574dc091ffe6edbf6cd23f&scope.project.id=e4eeeb6b2c9345388f01f51f75c671dc&role.id=1a212772e06344478184ce7d44a58b40 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:35.502919 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 219/435] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Aug 6 20:38:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:35.504801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98c019-a046-4dfb-b081-960ee84b7279 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:35.509546 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb5e31-2cb5-4d0e-b0dc-c74d9e3b4743 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:35.509842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb5e31-2cb5-4d0e-b0dc-c74d9e3b4743 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:35.510698 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb5e31-2cb5-4d0e-b0dc-c74d9e3b4743 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:35.516504 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 220/436] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:38:35.517917 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2276f3-e0c8-4f7f-98de-10203c815f4c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:35.518199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2276f3-e0c8-4f7f-98de-10203c815f4c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:35.518473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2276f3-e0c8-4f7f-98de-10203c815f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:35.538515 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-1f2276f3-e0c8-4f7f-98de-10203c815f4c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:35.539904 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1f2276f3-e0c8-4f7f-98de-10203c815f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:35.626962 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 221/437] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:35.640360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:35.644975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2276f3-e0c8-4f7f-98de-10203c815f4c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:35.645156 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98c019-a046-4dfb-b081-960ee84b7279 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:35.697047 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd2652-ed95-4872-a628-217041865324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:35.697873 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd2652-ed95-4872-a628-217041865324 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:35.698399 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:35.698678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd2652-ed95-4872-a628-217041865324 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:35.698963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd2652-ed95-4872-a628-217041865324 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:35.777643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2276f3-e0c8-4f7f-98de-10203c815f4c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:35.783911 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd2652-ed95-4872-a628-217041865324 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:35.785659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd2652-ed95-4872-a628-217041865324 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:35.829652 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee4d052-63d7-4c5d-a51c-0ae61db91b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:35.830299 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4d052-63d7-4c5d-a51c-0ae61db91b03 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:35.833263 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4d052-63d7-4c5d-a51c-0ae61db91b03 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:35.833263 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4d052-63d7-4c5d-a51c-0ae61db91b03 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:35.847603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee4d052-63d7-4c5d-a51c-0ae61db91b03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:35.853844 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-2ee4d052-63d7-4c5d-a51c-0ae61db91b03 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:38:35.853844 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:35.853844 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:35.853844 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:35.853844 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:35.853844 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:35.853844 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:35.853844 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:35.853844 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:35.853844 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:35.853844 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:35.853844 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:35.853844 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:35.853844 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:35.853844 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:35.853844 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:35.855127 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:35.855127 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:35.855127 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:35.855127 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:35.855127 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:35.855127 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:35.855127 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:35.855127 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:35.855127 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:35.855127 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:35.855127 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:35.855127 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:35.855127 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:35.855127 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:35.855127 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:35.855127 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:35.855914 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:35.855914 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:35.855914 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:35.855914 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:35.855914 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:35.855914 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:35.855914 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:35.855914 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:35.855914 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:35.855914 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:35.855914 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:38:35.855914 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:35.855914 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 222/438] 10.222.0.33 () {56 vars in 1114 bytes} [Sat Aug 6 20:38:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:38:35.862441 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee4d052-63d7-4c5d-a51c-0ae61db91b03 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:35.904984 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:35.909313 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 217/439] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:38:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:35.915147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd2652-ed95-4872-a628-217041865324 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:35.988564 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:35.993421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee4d052-63d7-4c5d-a51c-0ae61db91b03 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:36.045271 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba9e91-ac6d-46ad-ad25-9e974667fe0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:36.046324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba9e91-ac6d-46ad-ad25-9e974667fe0f None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:36.046889 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba9e91-ac6d-46ad-ad25-9e974667fe0f None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:36.047356 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba9e91-ac6d-46ad-ad25-9e974667fe0f None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:36.048231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba9e91-ac6d-46ad-ad25-9e974667fe0f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:36.048786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba9e91-ac6d-46ad-ad25-9e974667fe0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:36.050412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba9e91-ac6d-46ad-ad25-9e974667fe0f None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:36.061927 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd2652-ed95-4872-a628-217041865324 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:36.067842 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 223/440] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:38:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:36.074408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba9e91-ac6d-46ad-ad25-9e974667fe0f None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:36.107327 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3916b1-195d-4428-a1c3-11e17434160a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:36.109118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3916b1-195d-4428-a1c3-11e17434160a None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:36.109554 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3916b1-195d-4428-a1c3-11e17434160a None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:36.109988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3916b1-195d-4428-a1c3-11e17434160a None admin] PATH_INFO: `/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:36.111226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3916b1-195d-4428-a1c3-11e17434160a None admin] RBAC: Authorizing `identity:get_project(project_id=cfb3fc3dc2a2444e8e451370bc40764d)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:36.112678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3916b1-195d-4428-a1c3-11e17434160a None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:36.114308 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 218/441] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:38:35 2022] GET /identity/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:36.122730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3916b1-195d-4428-a1c3-11e17434160a None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:36.200973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:36.209570 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba9e91-ac6d-46ad-ad25-9e974667fe0f None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:36.243370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3916b1-195d-4428-a1c3-11e17434160a None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:36.248800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532fb399-07f7-49e4-9fb0-7c13e4ec54f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:36.249408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fb399-07f7-49e4-9fb0-7c13e4ec54f9 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:36.249686 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fb399-07f7-49e4-9fb0-7c13e4ec54f9 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:36.249957 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fb399-07f7-49e4-9fb0-7c13e4ec54f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:36.279001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:36.279862 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40058ec4-4c98-4c7f-8ab7-3ec8549925af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:36.280649 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40058ec4-4c98-4c7f-8ab7-3ec8549925af None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:36.280884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40058ec4-4c98-4c7f-8ab7-3ec8549925af None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:36.281198 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40058ec4-4c98-4c7f-8ab7-3ec8549925af None admin] PATH_INFO: `/v3/groups/3a28385a72574dc091ffe6edbf6cd23f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:36.282399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40058ec4-4c98-4c7f-8ab7-3ec8549925af None admin] RBAC: Authorizing `identity:get_group(group_id=3a28385a72574dc091ffe6edbf6cd23f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:36.283905 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40058ec4-4c98-4c7f-8ab7-3ec8549925af None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:36.285466 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 219/442] 10.222.0.33 () {56 vars in 1180 bytes} [Sat Aug 6 20:38:36 2022] GET /identity/v3/groups/3a28385a72574dc091ffe6edbf6cd23f => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:36.286758 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3b65c-7fb0-46f4-83d4-d5773fcc22d3 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:36.287048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3b65c-7fb0-46f4-83d4-d5773fcc22d3 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:36.287318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3b65c-7fb0-46f4-83d4-d5773fcc22d3 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:36.288637 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 220/443] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:36.291170 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3b65c-7fb0-46f4-83d4-d5773fcc22d3 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:36.321580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532fb399-07f7-49e4-9fb0-7c13e4ec54f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:36.323534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532fb399-07f7-49e4-9fb0-7c13e4ec54f9 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:36.396888 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3b65c-7fb0-46f4-83d4-d5773fcc22d3 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:36.427339 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 224/444] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:38:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:36.428583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c9fcc-be0d-4f9c-a9a5-48a55793a53f None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:36.428869 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c9fcc-be0d-4f9c-a9a5-48a55793a53f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:36.429141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c9fcc-be0d-4f9c-a9a5-48a55793a53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:36.431355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93851d86-65b4-4ec1-8c68-e4fb0b66b654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:36.432907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93851d86-65b4-4ec1-8c68-e4fb0b66b654 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:36.433237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93851d86-65b4-4ec1-8c68-e4fb0b66b654 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:36.433509 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93851d86-65b4-4ec1-8c68-e4fb0b66b654 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:36.434520 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93851d86-65b4-4ec1-8c68-e4fb0b66b654 None admin] RBAC: Adding query filter params (group.id=3a28385a72574dc091ffe6edbf6cd23f, role.id=1a212772e06344478184ce7d44a58b40, scope.project.id=cfb3fc3dc2a2444e8e451370bc40764d) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:36.434857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93851d86-65b4-4ec1-8c68-e4fb0b66b654 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:36.436284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93851d86-65b4-4ec1-8c68-e4fb0b66b654 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:36.438137 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:36.451588 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 221/445] 10.222.0.33 () {56 vars in 1376 bytes} [Sat Aug 6 20:38:36 2022] GET /identity/v3/role_assignments?group.id=3a28385a72574dc091ffe6edbf6cd23f&scope.project.id=cfb3fc3dc2a2444e8e451370bc40764d&role.id=1a212772e06344478184ce7d44a58b40 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:36.451588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93851d86-65b4-4ec1-8c68-e4fb0b66b654 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:36.457054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-7c3c9fcc-be0d-4f9c-a9a5-48a55793a53f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:36.458719 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7c3c9fcc-be0d-4f9c-a9a5-48a55793a53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:36.523490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:36.537197 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 225/446] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:36.562345 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93851d86-65b4-4ec1-8c68-e4fb0b66b654 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:36.563287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c9fcc-be0d-4f9c-a9a5-48a55793a53f None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:36.600315 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec0e87-fa1b-44d0-b513-212bb08347b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:36.600869 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec0e87-fa1b-44d0-b513-212bb08347b0 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:36.601150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec0e87-fa1b-44d0-b513-212bb08347b0 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:36.601546 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec0e87-fa1b-44d0-b513-212bb08347b0 None admin] PATH_INFO: `/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:36.602845 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec0e87-fa1b-44d0-b513-212bb08347b0 None admin] RBAC: Authorizing `identity:get_project(project_id=cfb3fc3dc2a2444e8e451370bc40764d)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:36.605299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec0e87-fa1b-44d0-b513-212bb08347b0 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:36.611479 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 222/447] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:38:36 2022] GET /identity/v3/projects/cfb3fc3dc2a2444e8e451370bc40764d => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:36.612538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec0e87-fa1b-44d0-b513-212bb08347b0 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:36.684289 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c9fcc-be0d-4f9c-a9a5-48a55793a53f None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:36.698942 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:36.732070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39548dde-3840-4b0e-87ea-4e79495086ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:36.732709 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39548dde-3840-4b0e-87ea-4e79495086ff None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:36.732991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39548dde-3840-4b0e-87ea-4e79495086ff None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:36.733285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39548dde-3840-4b0e-87ea-4e79495086ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:36.739664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec0e87-fa1b-44d0-b513-212bb08347b0 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:36.746952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39548dde-3840-4b0e-87ea-4e79495086ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:36.753010 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-39548dde-3840-4b0e-87ea-4e79495086ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:38:36.753010 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:36.753010 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:36.753010 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:36.753010 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:36.753010 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:36.753010 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:36.753010 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:36.753010 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:36.753010 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:36.753010 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:36.753010 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:36.753010 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:36.753010 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:36.753010 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:36.753010 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:36.753897 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:36.753897 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:36.753897 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:36.753897 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:36.753897 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:36.753897 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:36.753897 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:36.753897 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:36.753897 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:36.753897 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:36.753897 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:36.753897 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:36.753897 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:36.753897 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:36.753897 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:36.753897 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:36.754891 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:36.754891 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:36.754891 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:36.754891 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:36.754891 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:36.754891 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:36.754891 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:36.754891 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:36.754891 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:36.754891 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:36.754891 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:38:36.754891 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:36.754891 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 226/448] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Aug 6 20:38:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:38:36.760431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39548dde-3840-4b0e-87ea-4e79495086ff None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:36.782752 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ceca1-fc4e-4b99-a534-d05189cee302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:36.783219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ceca1-fc4e-4b99-a534-d05189cee302 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:36.783701 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ceca1-fc4e-4b99-a534-d05189cee302 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:36.783815 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ceca1-fc4e-4b99-a534-d05189cee302 None admin] PATH_INFO: `/v3/groups/3a28385a72574dc091ffe6edbf6cd23f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:36.786322 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ceca1-fc4e-4b99-a534-d05189cee302 None admin] RBAC: Authorizing `identity:get_group(group_id=3a28385a72574dc091ffe6edbf6cd23f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:36.787190 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ceca1-fc4e-4b99-a534-d05189cee302 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:36.788764 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 223/449] 10.222.0.33 () {56 vars in 1180 bytes} [Sat Aug 6 20:38:36 2022] GET /identity/v3/groups/3a28385a72574dc091ffe6edbf6cd23f => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:36.795008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ceca1-fc4e-4b99-a534-d05189cee302 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:36.823739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:36.875393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39548dde-3840-4b0e-87ea-4e79495086ff None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:36.901949 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ceca1-fc4e-4b99-a534-d05189cee302 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:36.908852 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc80c38-5af9-474f-8f2d-a630dc30fc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:36.909451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc80c38-5af9-474f-8f2d-a630dc30fc54 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:36.909728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc80c38-5af9-474f-8f2d-a630dc30fc54 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:36.909999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc80c38-5af9-474f-8f2d-a630dc30fc54 None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:36.910697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc80c38-5af9-474f-8f2d-a630dc30fc54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:36.910996 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc80c38-5af9-474f-8f2d-a630dc30fc54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:36.912368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc80c38-5af9-474f-8f2d-a630dc30fc54 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:36.921590 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 227/450] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:38:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:36.926781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc80c38-5af9-474f-8f2d-a630dc30fc54 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:36.936897 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb868fe1-5b72-4dde-b09f-ccf9cf1da732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:36.937496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb868fe1-5b72-4dde-b09f-ccf9cf1da732 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:36.937777 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb868fe1-5b72-4dde-b09f-ccf9cf1da732 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:36.938055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb868fe1-5b72-4dde-b09f-ccf9cf1da732 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:36.938794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb868fe1-5b72-4dde-b09f-ccf9cf1da732 None admin] RBAC: Adding query filter params (group.id=3a28385a72574dc091ffe6edbf6cd23f, role.id=b9254dbd663046739a1ba48d8c0027ad, scope.project.id=cfb3fc3dc2a2444e8e451370bc40764d) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:36.939102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb868fe1-5b72-4dde-b09f-ccf9cf1da732 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:36.940538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb868fe1-5b72-4dde-b09f-ccf9cf1da732 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:36.942286 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:36.947131 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 224/451] 10.222.0.33 () {56 vars in 1376 bytes} [Sat Aug 6 20:38:36 2022] GET /identity/v3/role_assignments?group.id=3a28385a72574dc091ffe6edbf6cd23f&scope.project.id=cfb3fc3dc2a2444e8e451370bc40764d&role.id=b9254dbd663046739a1ba48d8c0027ad => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:37.032515 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc80c38-5af9-474f-8f2d-a630dc30fc54 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:37.047049 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:37.069456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef05c5-effe-41f2-9844-f8effacf4763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:37.070081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef05c5-effe-41f2-9844-f8effacf4763 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:37.070360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef05c5-effe-41f2-9844-f8effacf4763 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:37.070667 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef05c5-effe-41f2-9844-f8effacf4763 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:37.141377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef05c5-effe-41f2-9844-f8effacf4763 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:37.142850 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef05c5-effe-41f2-9844-f8effacf4763 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:37.247650 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 228/452] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:38:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:37.253353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb868fe1-5b72-4dde-b09f-ccf9cf1da732 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:37.356328 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb868fe1-5b72-4dde-b09f-ccf9cf1da732 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:37.389175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c88f0-3833-4923-ad7e-08a852a020f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:37.389798 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c88f0-3833-4923-ad7e-08a852a020f7 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:37.390080 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c88f0-3833-4923-ad7e-08a852a020f7 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:37.390356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c88f0-3833-4923-ad7e-08a852a020f7 None admin] PATH_INFO: `/v3/projects/39f3affb323c4555adb3a84fee8265cf` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:37.391553 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495c88f0-3833-4923-ad7e-08a852a020f7 None admin] RBAC: Authorizing `identity:get_project(project_id=39f3affb323c4555adb3a84fee8265cf)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:37.392954 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495c88f0-3833-4923-ad7e-08a852a020f7 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:37.394620 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 225/453] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:38:37 2022] GET /identity/v3/projects/39f3affb323c4555adb3a84fee8265cf => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:37.400205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef05c5-effe-41f2-9844-f8effacf4763 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:37.414048 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:37.497836 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef05c5-effe-41f2-9844-f8effacf4763 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:37.529882 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4580b9d-8a59-4882-a0c9-364a28997e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:37.530500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4580b9d-8a59-4882-a0c9-364a28997e36 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:37.530817 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4580b9d-8a59-4882-a0c9-364a28997e36 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:37.531093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4580b9d-8a59-4882-a0c9-364a28997e36 None admin] PATH_INFO: `/v3/groups/7e87e5c9e09c41f98fbcfaef88a9255e` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:37.532185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4580b9d-8a59-4882-a0c9-364a28997e36 None admin] RBAC: Authorizing `identity:get_group(group_id=7e87e5c9e09c41f98fbcfaef88a9255e)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:37.533627 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4580b9d-8a59-4882-a0c9-364a28997e36 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:37.535235 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 229/454] 10.222.0.33 () {56 vars in 1180 bytes} [Sat Aug 6 20:38:37 2022] GET /identity/v3/groups/7e87e5c9e09c41f98fbcfaef88a9255e => generated 229 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:37.541621 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c88f0-3833-4923-ad7e-08a852a020f7 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:37.605055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:37.639363 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c88f0-3833-4923-ad7e-08a852a020f7 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:37.671688 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f35fb-9603-4282-9fe6-0e34386169db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:37.671688 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f35fb-9603-4282-9fe6-0e34386169db None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:37.671938 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f35fb-9603-4282-9fe6-0e34386169db None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:37.672209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f35fb-9603-4282-9fe6-0e34386169db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:37.672919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f35fb-9603-4282-9fe6-0e34386169db None admin] RBAC: Adding query filter params (group.id=7e87e5c9e09c41f98fbcfaef88a9255e, role.id=ab245eea8a714462a00c4546309de9c9, scope.project.id=39f3affb323c4555adb3a84fee8265cf) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:37.673225 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f35fb-9603-4282-9fe6-0e34386169db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:37.674683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f35fb-9603-4282-9fe6-0e34386169db None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:37.680415 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 226/455] 10.222.0.33 () {56 vars in 1376 bytes} [Sat Aug 6 20:38:37 2022] GET /identity/v3/role_assignments?group.id=7e87e5c9e09c41f98fbcfaef88a9255e&scope.project.id=39f3affb323c4555adb3a84fee8265cf&role.id=ab245eea8a714462a00c4546309de9c9 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:40.397594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8004c-6b3a-42b4-9fff-91ef5559c688 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:40.398465 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8004c-6b3a-42b4-9fff-91ef5559c688 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:40.398906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8004c-6b3a-42b4-9fff-91ef5559c688 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:40.400839 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 230/456] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:40.405834 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857708ba-3a18-40ff-82fd-b552bcc9ede3 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:40.406598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857708ba-3a18-40ff-82fd-b552bcc9ede3 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:40.407022 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857708ba-3a18-40ff-82fd-b552bcc9ede3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:40.435565 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-857708ba-3a18-40ff-82fd-b552bcc9ede3 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:40.437014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-857708ba-3a18-40ff-82fd-b552bcc9ede3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:40.530051 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 227/457] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:40.567748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8004c-6b3a-42b4-9fff-91ef5559c688 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:40.674484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4f1d7-f655-4e97-baaa-cb0ca3a3e348 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:40.675054 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4f1d7-f655-4e97-baaa-cb0ca3a3e348 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:40.676011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4f1d7-f655-4e97-baaa-cb0ca3a3e348 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:40.678183 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 228/458] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:40.683416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c9721-373a-478c-a178-a5b4bf8cfa08 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:40.684204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c9721-373a-478c-a178-a5b4bf8cfa08 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:40.684685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c9721-373a-478c-a178-a5b4bf8cfa08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:40.689490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:40.712132 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-7c2c9721-373a-478c-a178-a5b4bf8cfa08 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:40.715318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7c2c9721-373a-478c-a178-a5b4bf8cfa08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:40.736570 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8004c-6b3a-42b4-9fff-91ef5559c688 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:40.782254 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:40.795599 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 229/459] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:38:40.815305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c6702-4cf5-44b2-9e32-fa84f145f997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:40.815963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c6702-4cf5-44b2-9e32-fa84f145f997 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:40.816243 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c6702-4cf5-44b2-9e32-fa84f145f997 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:40.816514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c6702-4cf5-44b2-9e32-fa84f145f997 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:40.823667 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c9721-373a-478c-a178-a5b4bf8cfa08 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:40.827696 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c6702-4cf5-44b2-9e32-fa84f145f997 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:40.829128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c6702-4cf5-44b2-9e32-fa84f145f997 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:40.855096 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-0d3c6702-4cf5-44b2-9e32-fa84f145f997 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:40.855096 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:40.855096 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:40.855096 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:40.855096 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:40.855096 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:40.855096 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:40.855096 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:40.855096 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:40.855096 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:40.855096 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:40.855096 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:40.855096 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:40.855096 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:40.855096 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:40.855096 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:40.856335 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:40.856335 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:40.856335 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:40.856335 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:40.856335 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:40.856335 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:40.856335 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:40.856335 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:40.856335 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:40.856335 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:40.856335 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:40.856335 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:40.856335 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:40.856335 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:40.856335 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:40.856335 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:40.856335 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:40.857387 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:40.857387 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:40.857387 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:40.859138 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 231/460] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:40.866007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c6702-4cf5-44b2-9e32-fa84f145f997 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:40.937588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c9721-373a-478c-a178-a5b4bf8cfa08 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:40.972800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e317093-105d-4e6a-85ee-4521230671e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:40.973766 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e317093-105d-4e6a-85ee-4521230671e9 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:40.974260 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e317093-105d-4e6a-85ee-4521230671e9 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:40.982842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e317093-105d-4e6a-85ee-4521230671e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:40.994744 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e317093-105d-4e6a-85ee-4521230671e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:40.996484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e317093-105d-4e6a-85ee-4521230671e9 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:41.011756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c6702-4cf5-44b2-9e32-fa84f145f997 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:41.012453 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-8e317093-105d-4e6a-85ee-4521230671e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:41.012453 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:41.012453 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:41.012453 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:41.012453 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:41.012453 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:41.012453 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:41.012453 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:41.012453 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:41.012453 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:41.012453 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:41.012453 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:41.012453 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:41.012453 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:41.012453 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:41.012453 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:41.013488 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:41.013488 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:41.013488 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:41.013488 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:41.013488 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:41.013488 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:41.013488 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:41.013488 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:41.013488 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:41.013488 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:41.013488 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:41.013488 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:41.013488 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:41.013488 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:41.013488 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:41.013488 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:41.013488 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:41.014345 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:41.014345 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:41.014345 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:41.014891 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 230/461] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:41.020617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e48ee9-499b-4772-98b7-0fcb07a0a2c9 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:41.021336 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e48ee9-499b-4772-98b7-0fcb07a0a2c9 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:41.021781 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e48ee9-499b-4772-98b7-0fcb07a0a2c9 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:41.023253 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 231/462] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:41.024139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e48ee9-499b-4772-98b7-0fcb07a0a2c9 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:41.050959 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff0543-c2d8-4f94-868a-f45b2d5f73b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:41.051682 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff0543-c2d8-4f94-868a-f45b2d5f73b7 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:41.052033 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff0543-c2d8-4f94-868a-f45b2d5f73b7 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:41.052413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff0543-c2d8-4f94-868a-f45b2d5f73b7 None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:41.053147 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff0543-c2d8-4f94-868a-f45b2d5f73b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:41.053523 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff0543-c2d8-4f94-868a-f45b2d5f73b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:41.055072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff0543-c2d8-4f94-868a-f45b2d5f73b7 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:41.059168 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:41.069842 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 232/463] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:41.075602 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928cc6e4-c76b-4d51-8b62-b660ef69036b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:41.075602 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928cc6e4-c76b-4d51-8b62-b660ef69036b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:41.075919 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928cc6e4-c76b-4d51-8b62-b660ef69036b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:41.083458 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:41.095427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-928cc6e4-c76b-4d51-8b62-b660ef69036b None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:41.096843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-928cc6e4-c76b-4d51-8b62-b660ef69036b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:41.148809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e48ee9-499b-4772-98b7-0fcb07a0a2c9 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:41.166831 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 233/464] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:41.167960 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928cc6e4-c76b-4d51-8b62-b660ef69036b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:41.186973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee0505-bedc-44b4-b59c-f81032b4239d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:41.187805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee0505-bedc-44b4-b59c-f81032b4239d None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:41.188490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee0505-bedc-44b4-b59c-f81032b4239d None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:41.188954 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee0505-bedc-44b4-b59c-f81032b4239d None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:41.189804 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee0505-bedc-44b4-b59c-f81032b4239d None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:41.190314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee0505-bedc-44b4-b59c-f81032b4239d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:41.191951 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee0505-bedc-44b4-b59c-f81032b4239d None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:41.212003 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 232/465] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:41.217521 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee0505-bedc-44b4-b59c-f81032b4239d None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:41.274024 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928cc6e4-c76b-4d51-8b62-b660ef69036b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:41.298828 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:41.313032 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a1afb-6e71-4671-9da2-caea42ee0ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:41.313531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a1afb-6e71-4671-9da2-caea42ee0ed1 None admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:41.313807 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a1afb-6e71-4671-9da2-caea42ee0ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:41.314074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a1afb-6e71-4671-9da2-caea42ee0ed1 None admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:41.314731 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a1afb-6e71-4671-9da2-caea42ee0ed1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:41.316145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a1afb-6e71-4671-9da2-caea42ee0ed1 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:41.325069 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee0505-bedc-44b4-b59c-f81032b4239d None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:41.327312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:41.338138 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 234/466] 10.222.0.33 () {60 vars in 1132 bytes} [Sat Aug 6 20:38:41 2022] POST /identity/v3/users => generated 246 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:38:41.347635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a1afb-6e71-4671-9da2-caea42ee0ed1 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:41.378356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa563e-85b9-4db2-8df0-fecd691cd232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:41.379699 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa563e-85b9-4db2-8df0-fecd691cd232 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:41.380608 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa563e-85b9-4db2-8df0-fecd691cd232 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:41.381088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa563e-85b9-4db2-8df0-fecd691cd232 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:41.400902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa563e-85b9-4db2-8df0-fecd691cd232 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:41.402396 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa563e-85b9-4db2-8df0-fecd691cd232 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:41.430436 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-7ffa563e-85b9-4db2-8df0-fecd691cd232 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:41.430436 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:41.430436 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:41.430436 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:41.430436 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:41.430436 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:41.430436 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:41.430436 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:41.430436 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:41.430436 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:41.430436 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:41.430436 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:41.430436 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:41.430436 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:41.430436 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:41.430436 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:41.432889 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:41.432889 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:41.432889 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:41.432889 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:41.432889 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:41.432889 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:41.432889 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:41.432889 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:41.432889 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:41.432889 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:41.432889 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:41.432889 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:41.432889 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:41.432889 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:41.432889 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:41.432889 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:41.432889 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:41.439913 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:41.439913 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:41.439913 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:41.439913 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 233/467] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:41.439913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffe394-e023-4514-8b6d-b4c23c9d4afc None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:41.439913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffe394-e023-4514-8b6d-b4c23c9d4afc None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:41.439913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffe394-e023-4514-8b6d-b4c23c9d4afc None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:41.439913 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 234/468] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:41.451860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ffe394-e023-4514-8b6d-b4c23c9d4afc None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:41.516830 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a1afb-6e71-4671-9da2-caea42ee0ed1 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:41.560992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b98ddd-a655-4c4f-b533-58d217715a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:41.561652 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b98ddd-a655-4c4f-b533-58d217715a52 None admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:41.561963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b98ddd-a655-4c4f-b533-58d217715a52 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:41.562203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b98ddd-a655-4c4f-b533-58d217715a52 None admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:41.562867 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b98ddd-a655-4c4f-b533-58d217715a52 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:41.564359 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b98ddd-a655-4c4f-b533-58d217715a52 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:41.590702 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 235/469] 10.222.0.33 () {60 vars in 1132 bytes} [Sat Aug 6 20:38:41 2022] POST /identity/v3/users => generated 248 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:38:41.592196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fc9ca-0ae8-470b-87a2-9775f1c381c8 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:41.592481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fc9ca-0ae8-470b-87a2-9775f1c381c8 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:41.592753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fc9ca-0ae8-470b-87a2-9775f1c381c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:41.604730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ffe394-e023-4514-8b6d-b4c23c9d4afc None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:41.616667 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-f49fc9ca-0ae8-470b-87a2-9775f1c381c8 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:41.617887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f49fc9ca-0ae8-470b-87a2-9775f1c381c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:41.653786 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4fdcf-9dcf-43b9-8057-455999eb2331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:41.654934 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4fdcf-9dcf-43b9-8057-455999eb2331 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:41.655685 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:41.656897 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4fdcf-9dcf-43b9-8057-455999eb2331 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:41.657577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4fdcf-9dcf-43b9-8057-455999eb2331 None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:41.659296 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d4fdcf-9dcf-43b9-8057-455999eb2331 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:41.660775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d4fdcf-9dcf-43b9-8057-455999eb2331 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:41.663052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d4fdcf-9dcf-43b9-8057-455999eb2331 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:41.690800 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 235/470] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:41.693243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4fdcf-9dcf-43b9-8057-455999eb2331 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:41.713801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:41.721701 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 236/471] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:41.768755 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49fc9ca-0ae8-470b-87a2-9775f1c381c8 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:41.822732 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4fdcf-9dcf-43b9-8057-455999eb2331 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:41.863706 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a79b0c-74eb-40a5-add5-7e283bd65e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:41.864697 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a79b0c-74eb-40a5-add5-7e283bd65e15 None admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:41.865214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a79b0c-74eb-40a5-add5-7e283bd65e15 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:41.865760 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a79b0c-74eb-40a5-add5-7e283bd65e15 None admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:41.866725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a79b0c-74eb-40a5-add5-7e283bd65e15 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:41.868361 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a79b0c-74eb-40a5-add5-7e283bd65e15 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:41.901189 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 236/472] 10.222.0.33 () {60 vars in 1132 bytes} [Sat Aug 6 20:38:41 2022] POST /identity/v3/users => generated 248 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:38:41.927275 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49fc9ca-0ae8-470b-87a2-9775f1c381c8 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:41.968767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94854f26-9518-485f-99f3-0a233a342ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:41.969787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94854f26-9518-485f-99f3-0a233a342ef0 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:41.970258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94854f26-9518-485f-99f3-0a233a342ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:41.970787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94854f26-9518-485f-99f3-0a233a342ef0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:41.983401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94854f26-9518-485f-99f3-0a233a342ef0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:41.985376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94854f26-9518-485f-99f3-0a233a342ef0 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:41.996291 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720ea31-c8cd-484a-a6a6-239a61b061fd None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:41.996599 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720ea31-c8cd-484a-a6a6-239a61b061fd None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:41.996854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720ea31-c8cd-484a-a6a6-239a61b061fd None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:41.998472 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 237/473] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:38:42.004803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f30895-b3cc-4330-bd72-b6009f743acb None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:42.005134 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f30895-b3cc-4330-bd72-b6009f743acb None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:42.005358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f30895-b3cc-4330-bd72-b6009f743acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:42.006406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-94854f26-9518-485f-99f3-0a233a342ef0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:42.006406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:42.006406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:42.006406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:42.006406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:42.006406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:42.006406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:42.006406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:42.006406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:42.006406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:42.006406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:42.006406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:42.006406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:42.006406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:42.006406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:42.006406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:42.007349 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:42.007349 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:42.007349 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:42.007349 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:42.007349 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:42.007349 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:42.007349 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:42.007349 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:42.007349 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:42.007349 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:42.007349 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:42.007349 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:42.007349 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:42.007349 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:42.007349 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:42.007349 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:42.007349 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:42.008191 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:42.008191 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:42.008191 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:42.016921 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 237/474] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:38:42.018283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94854f26-9518-485f-99f3-0a233a342ef0 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:42.026068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-94f30895-b3cc-4330-bd72-b6009f743acb None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:42.027392 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-94f30895-b3cc-4330-bd72-b6009f743acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:42.051170 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:42.117167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:42.124771 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 238/475] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:38:42.152114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f30895-b3cc-4330-bd72-b6009f743acb None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:42.167291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94854f26-9518-485f-99f3-0a233a342ef0 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:42.208700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec921c-de73-4fbf-b9f2-13217ab0dfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:42.209311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec921c-de73-4fbf-b9f2-13217ab0dfab None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:42.209642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec921c-de73-4fbf-b9f2-13217ab0dfab None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:42.209925 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec921c-de73-4fbf-b9f2-13217ab0dfab None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:42.210766 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec921c-de73-4fbf-b9f2-13217ab0dfab None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:42.211185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec921c-de73-4fbf-b9f2-13217ab0dfab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:42.213131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec921c-de73-4fbf-b9f2-13217ab0dfab None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:42.229871 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 238/476] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:42.235588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec921c-de73-4fbf-b9f2-13217ab0dfab None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:42.280109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f30895-b3cc-4330-bd72-b6009f743acb None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:42.321527 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae1812-fe74-44bb-b7ff-7e6f70043cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:42.323844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae1812-fe74-44bb-b7ff-7e6f70043cf4 None admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:42.324186 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae1812-fe74-44bb-b7ff-7e6f70043cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:42.324468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae1812-fe74-44bb-b7ff-7e6f70043cf4 None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:42.325150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae1812-fe74-44bb-b7ff-7e6f70043cf4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:42.326681 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae1812-fe74-44bb-b7ff-7e6f70043cf4 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:42.332891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:42.336374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.sql.core [None req-93ae1812-fe74-44bb-b7ff-7e6f70043cf4 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 06 20:38:42.336374 ncdv-master-1 devstack@keystone.service[102758]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 06 20:38:42.336374 ncdv-master-1 devstack@keystone.service[102758]: [parameters: {'id': 'df37e7b0bf634b2a90e5269f7609a640', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 06 20:38:42.336374 ncdv-master-1 devstack@keystone.service[102758]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=102758) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 06 20:38:42.354957 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-93ae1812-fe74-44bb-b7ff-7e6f70043cf4 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 06 20:38:42.354957 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:42.354957 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 06 20:38:42.354957 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 06 20:38:42.354957 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 06 20:38:42.354957 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 06 20:38:42.354957 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 06 20:38:42.354957 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application result = self._query(query) Aug 06 20:38:42.354957 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 06 20:38:42.354957 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application conn.query(q) Aug 06 20:38:42.354957 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 06 20:38:42.354957 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 06 20:38:42.354957 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 06 20:38:42.354957 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application result.read() Aug 06 20:38:42.354957 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 06 20:38:42.355895 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 06 20:38:42.355895 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 06 20:38:42.355895 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 06 20:38:42.355895 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 06 20:38:42.355895 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 06 20:38:42.355895 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 06 20:38:42.355895 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 06 20:38:42.355895 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 06 20:38:42.355895 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:42.355895 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 06 20:38:42.355895 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:42.355895 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:42.355895 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 06 20:38:42.355895 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 06 20:38:42.355895 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 06 20:38:42.355895 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return ref.to_dict() Aug 06 20:38:42.355895 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 06 20:38:42.355895 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application next(self.gen) Aug 06 20:38:42.357733 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 06 20:38:42.357733 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application yield resource Aug 06 20:38:42.357733 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 06 20:38:42.357733 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application next(self.gen) Aug 06 20:38:42.357733 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 06 20:38:42.357733 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self.session.rollback() Aug 06 20:38:42.357733 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:38:42.357733 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self.force_reraise() Aug 06 20:38:42.357733 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:38:42.357733 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise self.value Aug 06 20:38:42.357733 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 06 20:38:42.357733 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 06 20:38:42.357733 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 06 20:38:42.357733 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application session.commit() Aug 06 20:38:42.357733 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 06 20:38:42.357733 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 06 20:38:42.357733 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 06 20:38:42.359816 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._prepare_impl() Aug 06 20:38:42.359816 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 06 20:38:42.359816 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self.session.flush() Aug 06 20:38:42.359816 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 06 20:38:42.359816 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._flush(objects) Aug 06 20:38:42.359816 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 06 20:38:42.359816 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 06 20:38:42.359816 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 06 20:38:42.359816 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application compat.raise_( Aug 06 20:38:42.359816 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 06 20:38:42.359816 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception Aug 06 20:38:42.359816 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 06 20:38:42.359816 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application flush_context.execute() Aug 06 20:38:42.359816 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 06 20:38:42.359816 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rec.execute(self) Aug 06 20:38:42.359816 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 06 20:38:42.359816 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 06 20:38:42.364207 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 06 20:38:42.364207 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 06 20:38:42.364207 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 06 20:38:42.364207 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 06 20:38:42.364207 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 06 20:38:42.364207 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 06 20:38:42.364207 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 06 20:38:42.364207 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 06 20:38:42.364207 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 06 20:38:42.364207 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 06 20:38:42.364207 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 06 20:38:42.364207 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 06 20:38:42.364207 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 06 20:38:42.364207 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 06 20:38:42.364207 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 06 20:38:42.364207 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception Aug 06 20:38:42.366185 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 06 20:38:42.366185 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 06 20:38:42.366185 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 06 20:38:42.366185 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 06 20:38:42.366185 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 06 20:38:42.366185 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application result = self._query(query) Aug 06 20:38:42.366185 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 06 20:38:42.366185 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application conn.query(q) Aug 06 20:38:42.366185 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 06 20:38:42.366185 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 06 20:38:42.366185 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 06 20:38:42.366185 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application result.read() Aug 06 20:38:42.366185 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 06 20:38:42.366185 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 06 20:38:42.366185 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 06 20:38:42.366185 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 06 20:38:42.368079 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 06 20:38:42.368079 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 06 20:38:42.368079 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 06 20:38:42.368079 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 06 20:38:42.368079 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 06 20:38:42.368079 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 06 20:38:42.368079 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [parameters: {'id': 'df37e7b0bf634b2a90e5269f7609a640', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 06 20:38:42.368079 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 06 20:38:42.368079 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:42.368079 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:38:42.368079 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:42.368079 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:42.368079 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:42.368079 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:42.368079 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:42.368079 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:42.370602 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:42.370602 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:42.370602 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:42.370602 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:42.370602 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:42.370602 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:42.370602 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 06 20:38:42.370602 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 06 20:38:42.370602 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:42.370602 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:42.370602 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 06 20:38:42.370602 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 06 20:38:42.370602 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 06 20:38:42.370602 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 06 20:38:42.370602 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 06 20:38:42.370602 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:42.377453 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 239/477] 10.222.0.33 () {60 vars in 1131 bytes} [Sat Aug 6 20:38:42 2022] POST /identity/v3/roles => generated 144 bytes in 205 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:38:42.377625 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec921c-de73-4fbf-b9f2-13217ab0dfab None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:42.377792 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae1812-fe74-44bb-b7ff-7e6f70043cf4 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:42.401103 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0106cc-03a5-40dd-8128-c498c4ccfc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:42.401780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0106cc-03a5-40dd-8128-c498c4ccfc9a None admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:42.402003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0106cc-03a5-40dd-8128-c498c4ccfc9a None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:42.402281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0106cc-03a5-40dd-8128-c498c4ccfc9a None admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:42.402956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0106cc-03a5-40dd-8128-c498c4ccfc9a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:42.404406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0106cc-03a5-40dd-8128-c498c4ccfc9a None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:42.429387 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 239/478] 10.222.0.33 () {60 vars in 1132 bytes} [Sat Aug 6 20:38:42 2022] POST /identity/v3/users => generated 249 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:38:42.442298 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:42.488604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae1812-fe74-44bb-b7ff-7e6f70043cf4 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:42.528858 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9553f7-e45a-4739-8477-911e7d9d0787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:42.529517 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9553f7-e45a-4739-8477-911e7d9d0787 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:42.529798 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9553f7-e45a-4739-8477-911e7d9d0787 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:42.530134 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9553f7-e45a-4739-8477-911e7d9d0787 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:42.542990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9553f7-e45a-4739-8477-911e7d9d0787 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:42.548694 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-0e9553f7-e45a-4739-8477-911e7d9d0787 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:38:42.548694 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:42.548694 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:42.548694 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:42.548694 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:42.548694 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:42.548694 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:42.548694 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:42.548694 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:42.548694 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:42.548694 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:42.548694 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:42.548694 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:42.548694 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:42.548694 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:42.548694 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:42.550955 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:42.550955 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:42.550955 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:42.550955 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:42.550955 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:42.550955 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:42.550955 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:42.550955 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:42.550955 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:42.550955 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:42.550955 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:42.550955 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:42.550955 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:42.550955 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:42.550955 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:42.550955 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:42.552907 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:42.552907 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:42.552907 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:42.552907 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:42.552907 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:42.552907 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:42.552907 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:42.552907 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:42.552907 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:42.552907 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:42.552907 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:38:42.552907 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:42.552907 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 240/479] 10.222.0.33 () {56 vars in 1114 bytes} [Sat Aug 6 20:38:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:42.556940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0106cc-03a5-40dd-8128-c498c4ccfc9a None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:42.679259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0106cc-03a5-40dd-8128-c498c4ccfc9a None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:42.712433 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:42.722757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fe855-7bd7-4c61-9168-29b6ff50b3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:42.723499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fe855-7bd7-4c61-9168-29b6ff50b3b4 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:42.723669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fe855-7bd7-4c61-9168-29b6ff50b3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:42.723937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fe855-7bd7-4c61-9168-29b6ff50b3b4 None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:42.724665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632fe855-7bd7-4c61-9168-29b6ff50b3b4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:42.725185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632fe855-7bd7-4c61-9168-29b6ff50b3b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:42.726802 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632fe855-7bd7-4c61-9168-29b6ff50b3b4 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:42.736524 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 240/480] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:38:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:44.167442 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d349a9-b7d7-4c43-ab21-71943ad52ec7 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:44.168167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d349a9-b7d7-4c43-ab21-71943ad52ec7 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:44.168167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d349a9-b7d7-4c43-ab21-71943ad52ec7 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:44.169560 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 241/481] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:44.175051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b2f4b-ef3f-4b84-ad16-3ff9490f3332 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:44.175549 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b2f4b-ef3f-4b84-ad16-3ff9490f3332 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:44.175696 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b2f4b-ef3f-4b84-ad16-3ff9490f3332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:44.200718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-162b2f4b-ef3f-4b84-ad16-3ff9490f3332 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:44.201913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-162b2f4b-ef3f-4b84-ad16-3ff9490f3332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:44.307198 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 241/482] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:38:44.351412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d349a9-b7d7-4c43-ab21-71943ad52ec7 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:44.478718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d349a9-b7d7-4c43-ab21-71943ad52ec7 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:44.506883 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:44.521773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423a3a3-b8bf-4428-a378-1fc93330763f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:44.522411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423a3a3-b8bf-4428-a378-1fc93330763f None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:44.522718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423a3a3-b8bf-4428-a378-1fc93330763f None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:44.522991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423a3a3-b8bf-4428-a378-1fc93330763f None admin] PATH_INFO: `/v3/roles/service` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:44.538351 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423a3a3-b8bf-4428-a378-1fc93330763f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:44.544077 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-d423a3a3-b8bf-4428-a378-1fc93330763f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:38:44.544077 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:44.544077 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:44.544077 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:44.544077 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:44.544077 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:44.544077 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:44.544077 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:44.544077 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:44.544077 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:44.544077 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:44.544077 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:44.544077 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:44.544077 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:44.544077 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:44.544077 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:44.544949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:44.544949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:44.544949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:44.544949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:44.544949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:44.544949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:44.544949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:44.544949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:44.544949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:44.544949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:44.544949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:44.544949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:44.544949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:44.544949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:44.544949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:44.544949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:44.546113 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:44.546113 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:44.546113 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:44.546113 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:44.546113 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:44.546113 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:44.546113 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:44.546113 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:44.546113 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:44.546113 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:44.546113 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:38:44.546113 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:44.546113 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 242/483] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Aug 6 20:38:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:44.551266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b2f4b-ef3f-4b84-ad16-3ff9490f3332 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:44.584564 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c5d07-0cbf-4ad7-a1cc-c26acd59e4b1 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:44.584863 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c5d07-0cbf-4ad7-a1cc-c26acd59e4b1 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:44.585115 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c5d07-0cbf-4ad7-a1cc-c26acd59e4b1 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:44.586445 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 243/484] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:38:44.592598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb170330-eb10-4725-89e2-0f172390ca45 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:44.592882 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb170330-eb10-4725-89e2-0f172390ca45 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:44.593167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb170330-eb10-4725-89e2-0f172390ca45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:44.621630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-fb170330-eb10-4725-89e2-0f172390ca45 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:44.622865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-fb170330-eb10-4725-89e2-0f172390ca45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:44.673374 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b2f4b-ef3f-4b84-ad16-3ff9490f3332 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:44.702975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:44.709051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76be6f-6582-44aa-8eb3-a421fde8d360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:44.709875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76be6f-6582-44aa-8eb3-a421fde8d360 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:44.710168 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76be6f-6582-44aa-8eb3-a421fde8d360 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:44.710454 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76be6f-6582-44aa-8eb3-a421fde8d360 None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:44.711276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e76be6f-6582-44aa-8eb3-a421fde8d360 None admin] RBAC: Adding query filter params (name=service) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:44.711589 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e76be6f-6582-44aa-8eb3-a421fde8d360 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:44.713480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e76be6f-6582-44aa-8eb3-a421fde8d360 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:44.732158 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 242/485] 10.222.0.33 () {56 vars in 1103 bytes} [Sat Aug 6 20:38:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:44.737113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76be6f-6582-44aa-8eb3-a421fde8d360 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:44.751765 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 244/486] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:44.776774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb170330-eb10-4725-89e2-0f172390ca45 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:44.911831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb170330-eb10-4725-89e2-0f172390ca45 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:44.928740 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:44.934692 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76be6f-6582-44aa-8eb3-a421fde8d360 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:44.953217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23423a-7982-4b80-a5ed-fbd9c5c00c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:44.953862 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23423a-7982-4b80-a5ed-fbd9c5c00c97 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:44.954140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23423a-7982-4b80-a5ed-fbd9c5c00c97 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:44.954414 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23423a-7982-4b80-a5ed-fbd9c5c00c97 None admin] PATH_INFO: `/v3/roles/service` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:44.965969 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23423a-7982-4b80-a5ed-fbd9c5c00c97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:44.971022 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-bb23423a-7982-4b80-a5ed-fbd9c5c00c97 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:38:44.971022 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:44.971022 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:44.971022 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:44.971022 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:44.971022 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:44.971022 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:44.971022 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:44.971022 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:44.971022 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:44.971022 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:44.971022 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:44.971022 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:44.971022 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:44.971022 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:44.971022 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:44.971915 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:44.971915 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:44.971915 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:44.971915 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:44.971915 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:44.971915 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:44.971915 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:44.971915 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:44.971915 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:44.971915 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:44.971915 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:44.971915 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:44.971915 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:44.971915 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:44.971915 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:44.971915 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:44.973237 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:44.973237 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:44.973237 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:44.973237 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:44.973237 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:44.973237 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:44.973237 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:44.973237 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:44.973237 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:44.973237 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:44.973237 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:38:44.973237 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:44.973237 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 245/487] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Aug 6 20:38:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:38:44.979476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23423a-7982-4b80-a5ed-fbd9c5c00c97 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:45.000439 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e0dd18-06e5-4953-b450-408e7dfde1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:45.001001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0dd18-06e5-4953-b450-408e7dfde1ed None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:45.001280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0dd18-06e5-4953-b450-408e7dfde1ed None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:45.001603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0dd18-06e5-4953-b450-408e7dfde1ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:45.021702 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e0dd18-06e5-4953-b450-408e7dfde1ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:45.024226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e0dd18-06e5-4953-b450-408e7dfde1ed None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:45.054582 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-00e0dd18-06e5-4953-b450-408e7dfde1ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:45.054582 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:45.054582 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:45.054582 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:45.054582 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:45.054582 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:45.054582 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:45.054582 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:45.054582 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:45.054582 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:45.054582 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:45.054582 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:45.054582 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:45.054582 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:45.054582 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:45.054582 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:45.055736 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:45.055736 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:45.055736 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:45.055736 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:45.055736 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:45.055736 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:45.055736 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:45.055736 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:45.055736 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:45.055736 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:45.055736 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:45.055736 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:45.055736 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:45.055736 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:45.055736 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:45.055736 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:45.055736 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:45.058162 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:45.058162 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:45.058162 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:45.059053 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 243/488] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:45.062039 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e0dd18-06e5-4953-b450-408e7dfde1ed None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:45.142004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23423a-7982-4b80-a5ed-fbd9c5c00c97 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:45.163224 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:45.207405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98176317-71e9-4057-b821-e2c7e4c15b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:45.208111 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98176317-71e9-4057-b821-e2c7e4c15b75 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:45.208293 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98176317-71e9-4057-b821-e2c7e4c15b75 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:45.208566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98176317-71e9-4057-b821-e2c7e4c15b75 None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:45.209252 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98176317-71e9-4057-b821-e2c7e4c15b75 None admin] RBAC: Adding query filter params (name=service) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:45.209554 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98176317-71e9-4057-b821-e2c7e4c15b75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:45.211027 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98176317-71e9-4057-b821-e2c7e4c15b75 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:45.230012 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 246/489] 10.222.0.33 () {56 vars in 1103 bytes} [Sat Aug 6 20:38:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:45.236284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98176317-71e9-4057-b821-e2c7e4c15b75 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:45.282385 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e0dd18-06e5-4953-b450-408e7dfde1ed None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:45.307191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:45.365597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40ea0a-11c2-41f6-aa89-5b2c10991759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:45.366821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40ea0a-11c2-41f6-aa89-5b2c10991759 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:45.368473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40ea0a-11c2-41f6-aa89-5b2c10991759 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:45.369629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40ea0a-11c2-41f6-aa89-5b2c10991759 None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:45.370484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40ea0a-11c2-41f6-aa89-5b2c10991759 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:45.375914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40ea0a-11c2-41f6-aa89-5b2c10991759 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:45.377562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40ea0a-11c2-41f6-aa89-5b2c10991759 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:45.396673 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 244/490] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:45.397945 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ee7de-5a6b-48c4-9924-413163c6e99a None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:45.399176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ee7de-5a6b-48c4-9924-413163c6e99a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:45.399455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ee7de-5a6b-48c4-9924-413163c6e99a None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:45.404244 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 245/491] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:45.406137 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ee7de-5a6b-48c4-9924-413163c6e99a None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:45.420198 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98176317-71e9-4057-b821-e2c7e4c15b75 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:45.454938 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52f4ed-26df-4185-98ed-14242ec70d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:45.455556 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52f4ed-26df-4185-98ed-14242ec70d76 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:45.455831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52f4ed-26df-4185-98ed-14242ec70d76 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:45.456098 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52f4ed-26df-4185-98ed-14242ec70d76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:45.467695 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c52f4ed-26df-4185-98ed-14242ec70d76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:45.469225 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c52f4ed-26df-4185-98ed-14242ec70d76 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:45.488159 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-0c52f4ed-26df-4185-98ed-14242ec70d76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:45.488159 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:45.488159 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:45.488159 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:45.488159 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:45.488159 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:45.488159 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:45.488159 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:45.488159 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:45.488159 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:45.488159 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:45.488159 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:45.488159 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:45.488159 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:45.488159 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:45.488159 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:45.489115 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:45.489115 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:45.489115 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:45.489115 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:45.489115 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:45.489115 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:45.489115 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:45.489115 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:45.489115 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:45.489115 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:45.489115 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:45.489115 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:45.489115 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:45.489115 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:45.489115 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:45.489115 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:45.489115 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:45.489960 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:45.489960 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:45.489960 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:45.489960 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 247/492] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:38:45.490775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b110cd4-991a-4a53-8517-66827cdbd73c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:45.491052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b110cd4-991a-4a53-8517-66827cdbd73c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:45.491320 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b110cd4-991a-4a53-8517-66827cdbd73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:45.509014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-4b110cd4-991a-4a53-8517-66827cdbd73c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:45.510870 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4b110cd4-991a-4a53-8517-66827cdbd73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:45.524597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:45.529862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ee7de-5a6b-48c4-9924-413163c6e99a None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:45.563734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4b626-96ab-4542-85c6-658ba6f4b7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:45.564283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4b626-96ab-4542-85c6-658ba6f4b7bc None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:45.564562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4b626-96ab-4542-85c6-658ba6f4b7bc None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:45.564836 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4b626-96ab-4542-85c6-658ba6f4b7bc None admin] PATH_INFO: `/v3/users/nova` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:45.572321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4b626-96ab-4542-85c6-658ba6f4b7bc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:45.573624 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4b626-96ab-4542-85c6-658ba6f4b7bc None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:45.577397 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 248/493] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:45.578677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bf199-0beb-4541-a773-30badb7050e6 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:45.578966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bf199-0beb-4541-a773-30badb7050e6 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:45.579241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bf199-0beb-4541-a773-30badb7050e6 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:45.580485 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 249/494] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:45.581496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332299ab-32fe-4969-bf5c-f93cd441bd31 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:45.581777 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332299ab-32fe-4969-bf5c-f93cd441bd31 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:45.582048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332299ab-32fe-4969-bf5c-f93cd441bd31 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:45.583242 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 250/495] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:45.583942 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332299ab-32fe-4969-bf5c-f93cd441bd31 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:45.590041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-7be4b626-96ab-4542-85c6-658ba6f4b7bc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:38:45.590041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:45.590041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:45.590041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:45.590041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:45.590041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:45.590041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:45.590041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:45.590041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:45.590041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:45.590041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:45.590041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:45.590041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:38:45.590041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:38:45.590041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:38:45.590041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:38:45.595221 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:45.595221 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:45.595221 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:38:45.595221 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:38:45.595221 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:38:45.595221 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:38:45.595221 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:45.595221 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:45.595221 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:45.595221 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:45.595221 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:45.595221 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:45.595221 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:45.595221 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:45.595221 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:45.595221 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:45.595221 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:45.595221 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:45.596159 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:45.596159 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:45.596159 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:38:45.596159 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:38:45.596159 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:38:45.596159 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:38:45.596159 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:38:45.596159 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:38:45.596159 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:38:45.596159 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:45.596159 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 246/496] 10.222.0.33 () {56 vars in 1093 bytes} [Sat Aug 6 20:38:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:45.596159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fa1cc-7ecd-46d3-8d34-2286522a222f None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:45.596159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fa1cc-7ecd-46d3-8d34-2286522a222f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:45.596843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fa1cc-7ecd-46d3-8d34-2286522a222f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:45.611620 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:45.613824 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-308fa1cc-7ecd-46d3-8d34-2286522a222f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:45.615109 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-308fa1cc-7ecd-46d3-8d34-2286522a222f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:45.682292 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 247/497] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:45.683820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d62676-ebda-4933-aa70-135936331459 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:45.684104 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d62676-ebda-4933-aa70-135936331459 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:45.684377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d62676-ebda-4933-aa70-135936331459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:45.703563 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d8d62676-ebda-4933-aa70-135936331459 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:45.704741 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d8d62676-ebda-4933-aa70-135936331459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:45.705610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332299ab-32fe-4969-bf5c-f93cd441bd31 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:45.739475 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012310a-117e-4477-8b58-d2852e2046b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:45.740078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012310a-117e-4477-8b58-d2852e2046b6 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:45.740355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012310a-117e-4477-8b58-d2852e2046b6 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:45.740626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012310a-117e-4477-8b58-d2852e2046b6 None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:45.741261 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012310a-117e-4477-8b58-d2852e2046b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:45.741562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012310a-117e-4477-8b58-d2852e2046b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:45.742992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012310a-117e-4477-8b58-d2852e2046b6 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:45.754236 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 251/498] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:45.755058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012310a-117e-4477-8b58-d2852e2046b6 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:45.772175 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 248/499] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:45.773008 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d62676-ebda-4933-aa70-135936331459 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:45.795677 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:45.839084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:45.861593 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012310a-117e-4477-8b58-d2852e2046b6 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:45.877046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d62676-ebda-4933-aa70-135936331459 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:45.895358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f47964d-25e8-4b22-89fa-4e4eef63a4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:45.895952 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47964d-25e8-4b22-89fa-4e4eef63a4cb None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:45.896231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47964d-25e8-4b22-89fa-4e4eef63a4cb None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:45.896498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47964d-25e8-4b22-89fa-4e4eef63a4cb None admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:45.897204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f47964d-25e8-4b22-89fa-4e4eef63a4cb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:45.897504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f47964d-25e8-4b22-89fa-4e4eef63a4cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:45.898960 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f47964d-25e8-4b22-89fa-4e4eef63a4cb None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:45.909430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c1914-529a-4a8a-8ee8-29a11ee15649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:45.910054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c1914-529a-4a8a-8ee8-29a11ee15649 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:45.910333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c1914-529a-4a8a-8ee8-29a11ee15649 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:45.910630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c1914-529a-4a8a-8ee8-29a11ee15649 None admin] PATH_INFO: `/v3/roles/service` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:45.921114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c1914-529a-4a8a-8ee8-29a11ee15649 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:45.925833 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-636c1914-529a-4a8a-8ee8-29a11ee15649 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:38:45.925833 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:45.925833 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:45.925833 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:45.925833 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:45.925833 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:45.925833 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:45.925833 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:45.925833 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:45.925833 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:45.925833 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:45.925833 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:45.925833 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:45.925833 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:45.925833 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:45.925833 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:45.926759 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:45.926759 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:45.926759 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:45.926759 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:45.926759 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:45.926759 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:45.926759 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:45.926759 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:45.926759 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:45.926759 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:45.926759 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:45.926759 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:45.926759 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:45.926759 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:45.926759 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:45.926759 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:45.927653 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:45.927653 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:45.927653 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:45.927653 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:45.927653 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:45.927653 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:45.927653 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:45.927653 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:45.927653 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:45.927653 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:45.927653 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:38:45.927653 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:45.927653 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 249/500] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Aug 6 20:38:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:45.928342 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c1914-529a-4a8a-8ee8-29a11ee15649 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:45.935177 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 252/501] 10.222.0.33 () {56 vars in 1133 bytes} [Sat Aug 6 20:38:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:45.936055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f47964d-25e8-4b22-89fa-4e4eef63a4cb None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:46.011441 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:46.031795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f47964d-25e8-4b22-89fa-4e4eef63a4cb None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:46.034111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c1914-529a-4a8a-8ee8-29a11ee15649 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:46.068334 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c21728-e069-43e7-938d-7a10d1395b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:46.069216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c21728-e069-43e7-938d-7a10d1395b4a None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:46.069496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c21728-e069-43e7-938d-7a10d1395b4a None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:46.069777 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c21728-e069-43e7-938d-7a10d1395b4a None admin] PATH_INFO: `/v3/users/glance` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:46.072472 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:46.077336 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85973d76-6662-4bbe-be1a-15769ed831b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:46.077958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85973d76-6662-4bbe-be1a-15769ed831b0 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:46.078239 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85973d76-6662-4bbe-be1a-15769ed831b0 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:46.078453 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c21728-e069-43e7-938d-7a10d1395b4a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:46.078586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85973d76-6662-4bbe-be1a-15769ed831b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:46.079945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c21728-e069-43e7-938d-7a10d1395b4a None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:46.088943 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85973d76-6662-4bbe-be1a-15769ed831b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:46.093137 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-23c21728-e069-43e7-938d-7a10d1395b4a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 06 20:38:46.093137 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:46.093137 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:46.093137 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:46.093137 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:46.093137 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:46.093137 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:46.093137 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:46.093137 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:46.093137 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:46.093137 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:46.093137 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:46.093137 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:38:46.093137 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:38:46.093137 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:38:46.093137 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:38:46.094108 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:46.094108 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:46.094108 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:38:46.094108 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:38:46.094108 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:38:46.094108 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:38:46.094108 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:46.094108 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:46.094108 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:46.094108 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:46.094108 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:46.094108 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:46.094108 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:46.094108 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:46.094108 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:46.094108 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:46.094108 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:46.094108 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:46.095571 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:46.095571 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:46.095571 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:38:46.095571 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:38:46.095571 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:38:46.095571 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:38:46.095571 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:38:46.095571 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:38:46.095571 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 06 20:38:46.095571 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:46.096099 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-85973d76-6662-4bbe-be1a-15769ed831b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:38:46.096099 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:46.096099 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:46.096099 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:46.096099 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:46.096099 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:46.096099 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:46.096099 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:46.096099 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:46.096099 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:46.096099 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:46.096099 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:46.096099 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:46.096099 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:46.096099 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:46.096099 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:46.096884 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:46.096884 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:46.096884 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:46.096884 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:46.096884 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:46.096884 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:46.096884 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:46.096884 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:46.096884 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:46.096884 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:46.096884 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:46.096884 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:46.096884 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:46.096884 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:46.096884 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:46.096884 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:46.097700 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:46.097700 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:46.097700 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:46.097700 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:46.097700 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:46.097700 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:46.097700 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:46.097700 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:46.097700 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:46.097700 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:46.097700 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:38:46.097700 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:46.098306 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 253/502] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:38:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:46.098306 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c21728-e069-43e7-938d-7a10d1395b4a None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:46.099281 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 250/503] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Aug 6 20:38:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:46.099281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85973d76-6662-4bbe-be1a-15769ed831b0 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:46.195934 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c21728-e069-43e7-938d-7a10d1395b4a None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:46.200303 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85973d76-6662-4bbe-be1a-15769ed831b0 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:46.230309 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac9ed9-9f7c-4780-abe8-2c40e55d324b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:46.230962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac9ed9-9f7c-4780-abe8-2c40e55d324b None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:46.231238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac9ed9-9f7c-4780-abe8-2c40e55d324b None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:46.231505 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac9ed9-9f7c-4780-abe8-2c40e55d324b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:46.234692 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fc980-868b-4ec1-a942-68a8cebc8c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:46.235288 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fc980-868b-4ec1-a942-68a8cebc8c21 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:46.235567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fc980-868b-4ec1-a942-68a8cebc8c21 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:46.235841 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fc980-868b-4ec1-a942-68a8cebc8c21 None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:46.236497 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0fc980-868b-4ec1-a942-68a8cebc8c21 None admin] RBAC: Adding query filter params (name=service) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:46.236800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0fc980-868b-4ec1-a942-68a8cebc8c21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:46.238171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0fc980-868b-4ec1-a942-68a8cebc8c21 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:46.241735 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfac9ed9-9f7c-4780-abe8-2c40e55d324b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:46.243119 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:46.243226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfac9ed9-9f7c-4780-abe8-2c40e55d324b None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:46.246736 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 251/504] 10.222.0.33 () {56 vars in 1103 bytes} [Sat Aug 6 20:38:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:46.247818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fc980-868b-4ec1-a942-68a8cebc8c21 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:46.257745 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-dfac9ed9-9f7c-4780-abe8-2c40e55d324b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:46.257745 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:46.257745 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:46.257745 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:46.257745 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:46.257745 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:46.257745 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:46.257745 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:46.257745 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:46.257745 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:46.257745 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:46.257745 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:46.257745 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:46.257745 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:46.257745 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:46.257745 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:46.258774 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:46.258774 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:46.258774 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:46.258774 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:46.258774 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:46.258774 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:46.258774 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:46.258774 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:46.258774 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:46.258774 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:46.258774 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:46.258774 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:46.258774 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:46.258774 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:46.258774 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:46.258774 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:46.258774 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:46.259958 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:46.259958 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:46.259958 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:46.259958 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 254/505] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:46.261217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac9ed9-9f7c-4780-abe8-2c40e55d324b None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:46.311601 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:46.352174 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fc980-868b-4ec1-a942-68a8cebc8c21 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:46.363324 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac9ed9-9f7c-4780-abe8-2c40e55d324b None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:46.388520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96bf796-1f55-4715-acad-12acb17e30b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:46.389121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bf796-1f55-4715-acad-12acb17e30b0 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:46.389395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bf796-1f55-4715-acad-12acb17e30b0 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:46.389668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bf796-1f55-4715-acad-12acb17e30b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:46.398188 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdff1f-a600-4e0e-980c-e0293e2f423e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:46.398816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdff1f-a600-4e0e-980c-e0293e2f423e None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:46.399099 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdff1f-a600-4e0e-980c-e0293e2f423e None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:46.399369 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdff1f-a600-4e0e-980c-e0293e2f423e None admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:46.401051 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfdff1f-a600-4e0e-980c-e0293e2f423e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:46.401673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfdff1f-a600-4e0e-980c-e0293e2f423e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:46.403150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfdff1f-a600-4e0e-980c-e0293e2f423e None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:46.419972 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 255/506] 10.222.0.33 () {56 vars in 1137 bytes} [Sat Aug 6 20:38:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:46.420947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdff1f-a600-4e0e-980c-e0293e2f423e None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:46.455194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:46.457770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96bf796-1f55-4715-acad-12acb17e30b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:46.459300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96bf796-1f55-4715-acad-12acb17e30b0 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:46.520546 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdff1f-a600-4e0e-980c-e0293e2f423e None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:46.527572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:46.555042 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63894c-6070-420c-8d0f-2178560a3347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:46.555650 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63894c-6070-420c-8d0f-2178560a3347 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:46.555994 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63894c-6070-420c-8d0f-2178560a3347 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:46.556268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63894c-6070-420c-8d0f-2178560a3347 None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:46.556918 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 252/507] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:38:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:46.557046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63894c-6070-420c-8d0f-2178560a3347 None admin] RBAC: Adding query filter params (name=service) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:46.557213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63894c-6070-420c-8d0f-2178560a3347 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:46.557765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96bf796-1f55-4715-acad-12acb17e30b0 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:46.559497 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63894c-6070-420c-8d0f-2178560a3347 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:46.568767 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 256/508] 10.222.0.33 () {56 vars in 1103 bytes} [Sat Aug 6 20:38:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:46.569655 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63894c-6070-420c-8d0f-2178560a3347 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:46.653664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:46.656910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96bf796-1f55-4715-acad-12acb17e30b0 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:46.671504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63894c-6070-420c-8d0f-2178560a3347 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:46.693401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a99e02-c742-49a7-97be-f6b1b7227a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:46.694026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a99e02-c742-49a7-97be-f6b1b7227a0f None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:46.694301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a99e02-c742-49a7-97be-f6b1b7227a0f None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:46.694596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a99e02-c742-49a7-97be-f6b1b7227a0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:46.705207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a99e02-c742-49a7-97be-f6b1b7227a0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:46.705825 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38ec59-d065-4131-a2ef-17e2fa506ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:46.706428 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38ec59-d065-4131-a2ef-17e2fa506ed4 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:46.706679 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a99e02-c742-49a7-97be-f6b1b7227a0f None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:46.706773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38ec59-d065-4131-a2ef-17e2fa506ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:46.707068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38ec59-d065-4131-a2ef-17e2fa506ed4 None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:46.707680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c38ec59-d065-4131-a2ef-17e2fa506ed4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:46.707982 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c38ec59-d065-4131-a2ef-17e2fa506ed4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:46.709328 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c38ec59-d065-4131-a2ef-17e2fa506ed4 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:46.721639 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-23a99e02-c742-49a7-97be-f6b1b7227a0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:46.721639 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:46.721639 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:46.721639 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:46.721639 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:46.721639 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:46.721639 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:46.721639 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:46.721639 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:46.721639 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:46.721639 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:46.721639 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:46.721639 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:46.721639 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:46.721639 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:46.721639 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:46.722567 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:46.722567 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:46.722567 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:46.722567 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:46.722567 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:46.722567 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:46.722567 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:46.722567 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:46.722567 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:46.722567 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:46.722567 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:46.722567 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:46.722567 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:46.722567 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:46.722567 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:46.722567 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:46.722567 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:46.723426 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:46.723426 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:46.723426 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:46.723597 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 257/509] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:46.723597 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38ec59-d065-4131-a2ef-17e2fa506ed4 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:46.726680 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 253/510] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:46.728015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a99e02-c742-49a7-97be-f6b1b7227a0f None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:46.751553 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:46.822981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38ec59-d065-4131-a2ef-17e2fa506ed4 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:46.826822 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a99e02-c742-49a7-97be-f6b1b7227a0f None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:46.857922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111ec7e-7a51-4827-97e2-7c62a6a46d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:46.858518 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111ec7e-7a51-4827-97e2-7c62a6a46d91 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:46.858824 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111ec7e-7a51-4827-97e2-7c62a6a46d91 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:46.859098 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111ec7e-7a51-4827-97e2-7c62a6a46d91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:46.860557 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94039c6-738e-42d4-8786-caa56e59144e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:46.861171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94039c6-738e-42d4-8786-caa56e59144e None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:46.861454 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94039c6-738e-42d4-8786-caa56e59144e None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:46.861728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94039c6-738e-42d4-8786-caa56e59144e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:46.872598 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94039c6-738e-42d4-8786-caa56e59144e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:46.874052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94039c6-738e-42d4-8786-caa56e59144e None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:46.888544 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-f94039c6-738e-42d4-8786-caa56e59144e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:46.888544 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:46.888544 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:46.888544 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:46.888544 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:46.888544 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:46.888544 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:46.888544 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:46.888544 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:46.888544 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:46.888544 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:46.888544 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:46.888544 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:46.888544 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:46.888544 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:46.888544 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:46.889522 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:46.889522 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:46.889522 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:46.889522 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:46.889522 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:46.889522 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:46.889522 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:46.889522 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:46.889522 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:46.889522 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:46.889522 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:46.889522 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:46.889522 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:46.889522 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:46.889522 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:46.889522 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:46.889522 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:46.891007 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:46.891007 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:46.891007 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:46.891007 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 254/511] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:46.891007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94039c6-738e-42d4-8786-caa56e59144e None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:46.894015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:46.935614 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111ec7e-7a51-4827-97e2-7c62a6a46d91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:46.936998 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111ec7e-7a51-4827-97e2-7c62a6a46d91 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:46.963536 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:46.990695 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94039c6-738e-42d4-8786-caa56e59144e None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:47.024133 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d66334-7a2d-4e27-8ed6-823976375e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:47.024892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d66334-7a2d-4e27-8ed6-823976375e60 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:47.025140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d66334-7a2d-4e27-8ed6-823976375e60 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:47.025422 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d66334-7a2d-4e27-8ed6-823976375e60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:47.034574 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 258/512] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:38:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:47.034847 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111ec7e-7a51-4827-97e2-7c62a6a46d91 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:47.040439 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d66334-7a2d-4e27-8ed6-823976375e60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:47.042068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d66334-7a2d-4e27-8ed6-823976375e60 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:47.057454 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-21d66334-7a2d-4e27-8ed6-823976375e60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:47.057454 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:47.057454 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:47.057454 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:47.057454 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:47.057454 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:47.057454 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:47.057454 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:47.057454 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:47.057454 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:47.057454 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:47.057454 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:47.057454 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:47.057454 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:47.057454 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:47.057454 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:47.058651 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:47.058651 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:47.058651 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:47.058651 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:47.058651 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:47.058651 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:47.058651 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:47.058651 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:47.058651 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:47.058651 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:47.058651 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:47.058651 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:47.058651 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:47.058651 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:47.058651 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:47.058651 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:47.058651 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:47.059510 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:47.059510 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:47.059510 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:47.059510 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 255/513] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:47.059720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d66334-7a2d-4e27-8ed6-823976375e60 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:47.117445 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:47.133063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111ec7e-7a51-4827-97e2-7c62a6a46d91 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:47.159405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:47.162430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d66334-7a2d-4e27-8ed6-823976375e60 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:47.167946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adac3a-f2da-4a7d-ab7c-5d82a28ce36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:47.168552 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adac3a-f2da-4a7d-ab7c-5d82a28ce36c None admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:47.168833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adac3a-f2da-4a7d-ab7c-5d82a28ce36c None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:47.169112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adac3a-f2da-4a7d-ab7c-5d82a28ce36c None admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:47.169751 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9adac3a-f2da-4a7d-ab7c-5d82a28ce36c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:47.171254 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9adac3a-f2da-4a7d-ab7c-5d82a28ce36c None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:47.193401 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 259/514] 10.222.0.33 () {60 vars in 1132 bytes} [Sat Aug 6 20:38:47 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:38:47.194197 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adac3a-f2da-4a7d-ab7c-5d82a28ce36c None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:47.221033 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811c0ed-4049-4ce0-a1df-a9d3b16332d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:47.221684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811c0ed-4049-4ce0-a1df-a9d3b16332d2 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:47.221958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811c0ed-4049-4ce0-a1df-a9d3b16332d2 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:47.222234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811c0ed-4049-4ce0-a1df-a9d3b16332d2 None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:47.223048 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6811c0ed-4049-4ce0-a1df-a9d3b16332d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:47.223362 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6811c0ed-4049-4ce0-a1df-a9d3b16332d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:47.224849 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6811c0ed-4049-4ce0-a1df-a9d3b16332d2 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:47.243377 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 256/515] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:47.243377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811c0ed-4049-4ce0-a1df-a9d3b16332d2 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:47.314481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adac3a-f2da-4a7d-ab7c-5d82a28ce36c None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:47.354009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71c140-7e58-4ae1-b8a7-a162fa11335a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:47.354664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71c140-7e58-4ae1-b8a7-a162fa11335a None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:47.354949 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71c140-7e58-4ae1-b8a7-a162fa11335a None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:47.355430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71c140-7e58-4ae1-b8a7-a162fa11335a None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:47.355870 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a71c140-7e58-4ae1-b8a7-a162fa11335a None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:47.356176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a71c140-7e58-4ae1-b8a7-a162fa11335a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:47.357589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a71c140-7e58-4ae1-b8a7-a162fa11335a None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:47.361610 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811c0ed-4049-4ce0-a1df-a9d3b16332d2 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:47.375078 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 260/516] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:47.375078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71c140-7e58-4ae1-b8a7-a162fa11335a None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:47.380327 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:47.404741 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6ccb1-df51-42fd-87a1-a6356b78e294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:47.405384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6ccb1-df51-42fd-87a1-a6356b78e294 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:47.405666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6ccb1-df51-42fd-87a1-a6356b78e294 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:47.405939 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6ccb1-df51-42fd-87a1-a6356b78e294 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:47.418212 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6ccb1-df51-42fd-87a1-a6356b78e294 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:47.419652 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6ccb1-df51-42fd-87a1-a6356b78e294 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:47.430775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:47.435160 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-85f6ccb1-df51-42fd-87a1-a6356b78e294 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:47.435160 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:47.435160 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:47.435160 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:47.435160 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:47.435160 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:47.435160 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:47.435160 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:47.435160 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:47.435160 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:47.435160 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:47.435160 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:47.435160 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:47.435160 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:47.435160 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:47.435160 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:47.436068 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:47.436068 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:47.436068 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:47.436068 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:47.436068 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:47.436068 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:47.436068 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:47.436068 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:47.436068 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:47.436068 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:47.436068 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:47.436068 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:47.436068 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:47.436068 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:47.436068 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:47.436068 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:47.436068 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:47.436913 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:47.436913 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:47.436913 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:47.438624 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 257/517] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:47.439886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6ccb1-df51-42fd-87a1-a6356b78e294 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:47.487952 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71c140-7e58-4ae1-b8a7-a162fa11335a None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:47.525520 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233114e-7eb2-428a-b446-d79879347288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:47.526134 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233114e-7eb2-428a-b446-d79879347288 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:47.526422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233114e-7eb2-428a-b446-d79879347288 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:47.526733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233114e-7eb2-428a-b446-d79879347288 None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:47.527375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233114e-7eb2-428a-b446-d79879347288 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:47.527682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233114e-7eb2-428a-b446-d79879347288 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:47.529065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233114e-7eb2-428a-b446-d79879347288 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:47.546287 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 261/518] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:47.546287 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233114e-7eb2-428a-b446-d79879347288 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:47.555284 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6ccb1-df51-42fd-87a1-a6356b78e294 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:47.592874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103397b-ffda-424b-96a7-f2ef3209ef60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:47.593838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103397b-ffda-424b-96a7-f2ef3209ef60 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:47.594339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103397b-ffda-424b-96a7-f2ef3209ef60 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:47.594838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103397b-ffda-424b-96a7-f2ef3209ef60 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:47.603116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103397b-ffda-424b-96a7-f2ef3209ef60 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:47.604908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103397b-ffda-424b-96a7-f2ef3209ef60 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:47.616420 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-9103397b-ffda-424b-96a7-f2ef3209ef60 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 20:38:47.616420 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:47.616420 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:47.616420 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:47.616420 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:47.616420 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:47.616420 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:47.616420 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:47.616420 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:47.616420 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:47.616420 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:47.616420 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:47.616420 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:38:47.616420 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:38:47.616420 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:38:47.616420 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:38:47.617368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:47.617368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:47.617368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:38:47.617368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:38:47.617368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:38:47.617368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:38:47.617368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:47.617368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:47.617368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:47.617368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:47.617368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:47.617368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:47.617368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:47.617368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:47.617368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:47.617368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:47.617368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:47.617368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:47.619347 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:47.619347 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:47.619347 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:38:47.619347 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:38:47.619347 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:38:47.619347 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:38:47.619347 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:38:47.619347 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:38:47.619347 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 20:38:47.619347 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:47.619347 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 258/519] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:38:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:47.620149 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103397b-ffda-424b-96a7-f2ef3209ef60 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:47.652708 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:47.655596 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233114e-7eb2-428a-b446-d79879347288 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:47.657952 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:47.699423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645cbd0e-6a36-4fdc-b0a5-f4fb7721fea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:47.700054 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cbd0e-6a36-4fdc-b0a5-f4fb7721fea7 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:47.700326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cbd0e-6a36-4fdc-b0a5-f4fb7721fea7 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:47.700598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cbd0e-6a36-4fdc-b0a5-f4fb7721fea7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:47.707261 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645cbd0e-6a36-4fdc-b0a5-f4fb7721fea7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:47.708705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645cbd0e-6a36-4fdc-b0a5-f4fb7721fea7 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:47.722554 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-645cbd0e-6a36-4fdc-b0a5-f4fb7721fea7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:38:47.722554 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:47.722554 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:47.722554 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:47.722554 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:47.722554 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:47.722554 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:47.722554 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:47.722554 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:47.722554 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:47.722554 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:47.722554 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:47.722554 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:38:47.722554 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:38:47.722554 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:38:47.723441 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:38:47.723441 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:47.723441 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:47.723441 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:47.723441 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:47.723441 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:47.723441 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:47.723441 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:47.723441 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:47.723441 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:47.723441 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:47.723441 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:47.723441 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:47.723441 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:47.723441 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:47.723441 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:47.723441 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:47.729919 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:38:47.729919 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:38:47.729919 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:38:47.729919 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:38:47.729919 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:38:47.729919 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:38:47.729919 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:38:47.729919 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:47.729919 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 262/520] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:38:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:47.729919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645cbd0e-6a36-4fdc-b0a5-f4fb7721fea7 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:47.736366 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103397b-ffda-424b-96a7-f2ef3209ef60 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:47.772944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451f17a-a71a-4b44-8112-49394e565f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:47.773470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451f17a-a71a-4b44-8112-49394e565f8c None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:47.773752 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451f17a-a71a-4b44-8112-49394e565f8c None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:47.774049 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451f17a-a71a-4b44-8112-49394e565f8c None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:47.774774 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451f17a-a71a-4b44-8112-49394e565f8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:47.775081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451f17a-a71a-4b44-8112-49394e565f8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:47.776452 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451f17a-a71a-4b44-8112-49394e565f8c None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:47.789136 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 259/521] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:47.789825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451f17a-a71a-4b44-8112-49394e565f8c None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:47.844869 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645cbd0e-6a36-4fdc-b0a5-f4fb7721fea7 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:47.880790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472d778-5fc0-4add-9db4-db4942fddeb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:47.881421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472d778-5fc0-4add-9db4-db4942fddeb0 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:47.881696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472d778-5fc0-4add-9db4-db4942fddeb0 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:47.881963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472d778-5fc0-4add-9db4-db4942fddeb0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:47.884825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:47.890945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1472d778-5fc0-4add-9db4-db4942fddeb0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:47.892400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1472d778-5fc0-4add-9db4-db4942fddeb0 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:47.899246 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451f17a-a71a-4b44-8112-49394e565f8c None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:47.904045 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-1472d778-5fc0-4add-9db4-db4942fddeb0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 06 20:38:47.904045 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:47.904045 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:47.904045 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:47.904045 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:47.904045 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:47.904045 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:47.904045 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:47.904045 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:47.904045 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:47.904045 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:47.904045 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:47.904045 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:38:47.904045 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:38:47.904045 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:38:47.904045 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:38:47.905057 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:47.905057 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:47.905057 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:38:47.905057 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:38:47.905057 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:38:47.905057 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:38:47.905057 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:47.905057 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:47.905057 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:47.905057 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:47.905057 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:47.905057 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:47.905057 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:47.905057 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:47.905057 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:47.905057 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:47.905057 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:47.905057 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:47.905980 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:47.905980 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:47.905980 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:38:47.905980 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:38:47.905980 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:38:47.905980 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:38:47.905980 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:38:47.905980 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:38:47.905980 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 06 20:38:47.905980 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:47.905980 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 263/522] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Aug 6 20:38:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:47.905980 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472d778-5fc0-4add-9db4-db4942fddeb0 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:47.937148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:47.939436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b538c-0a2d-49a7-981c-47e15320d814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:47.940122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b538c-0a2d-49a7-981c-47e15320d814 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:47.940404 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b538c-0a2d-49a7-981c-47e15320d814 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:47.940669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b538c-0a2d-49a7-981c-47e15320d814 None admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:47.941392 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b538c-0a2d-49a7-981c-47e15320d814 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:47.941691 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b538c-0a2d-49a7-981c-47e15320d814 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:47.943182 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b538c-0a2d-49a7-981c-47e15320d814 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:47.981905 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 260/523] 10.222.0.33 () {56 vars in 1137 bytes} [Sat Aug 6 20:38:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:47.982792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b538c-0a2d-49a7-981c-47e15320d814 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:48.020760 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472d778-5fc0-4add-9db4-db4942fddeb0 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:48.054229 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f5d7b-e2dc-44fb-9472-5002a68640b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:48.054780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f5d7b-e2dc-44fb-9472-5002a68640b1 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:48.055057 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f5d7b-e2dc-44fb-9472-5002a68640b1 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:48.055325 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f5d7b-e2dc-44fb-9472-5002a68640b1 None admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:48.056208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f5d7b-e2dc-44fb-9472-5002a68640b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:48.056513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f5d7b-e2dc-44fb-9472-5002a68640b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:48.057953 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f5d7b-e2dc-44fb-9472-5002a68640b1 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:48.075761 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 264/524] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Aug 6 20:38:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:48.076560 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f5d7b-e2dc-44fb-9472-5002a68640b1 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:48.101509 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b538c-0a2d-49a7-981c-47e15320d814 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:48.137808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ecf529-caa7-4ae5-ae90-4287fd9c6a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:48.138708 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecf529-caa7-4ae5-ae90-4287fd9c6a41 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:48.139027 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecf529-caa7-4ae5-ae90-4287fd9c6a41 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:48.139261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecf529-caa7-4ae5-ae90-4287fd9c6a41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:48.146216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ecf529-caa7-4ae5-ae90-4287fd9c6a41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:48.147736 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ecf529-caa7-4ae5-ae90-4287fd9c6a41 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:48.162724 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-e3ecf529-caa7-4ae5-ae90-4287fd9c6a41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:38:48.162724 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:48.162724 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:48.162724 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:48.162724 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:48.162724 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:48.162724 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:48.162724 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:48.162724 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:48.162724 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:48.162724 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:48.162724 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:48.162724 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:38:48.162724 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:38:48.162724 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:38:48.163600 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:38:48.163600 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:48.163600 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:48.163600 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:48.163600 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:48.163600 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:48.163600 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:48.163600 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:48.163600 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:48.163600 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:48.163600 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:48.163600 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:48.163600 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:48.163600 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:48.163600 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:48.163600 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:48.163600 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:48.164435 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:38:48.164435 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:38:48.164435 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:38:48.164435 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:38:48.164435 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:38:48.164435 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:38:48.164435 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:38:48.164435 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:48.164435 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 261/525] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:38:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:48.165837 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ecf529-caa7-4ae5-ae90-4287fd9c6a41 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:48.171116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:48.175626 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:48.188084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f5d7b-e2dc-44fb-9472-5002a68640b1 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:48.232829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938826ca-2451-4229-8feb-f67eb0b667e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:48.233437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938826ca-2451-4229-8feb-f67eb0b667e7 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:48.233720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938826ca-2451-4229-8feb-f67eb0b667e7 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:48.233989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938826ca-2451-4229-8feb-f67eb0b667e7 None admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:48.234761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938826ca-2451-4229-8feb-f67eb0b667e7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:48.235069 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938826ca-2451-4229-8feb-f67eb0b667e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:48.236730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938826ca-2451-4229-8feb-f67eb0b667e7 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:48.258633 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 265/526] 10.222.0.33 () {56 vars in 1139 bytes} [Sat Aug 6 20:38:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:48.259727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938826ca-2451-4229-8feb-f67eb0b667e7 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:48.277665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ecf529-caa7-4ae5-ae90-4287fd9c6a41 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:48.318281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925ec9a-d6a0-4bf8-b53a-ab397db28ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:48.318740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925ec9a-d6a0-4bf8-b53a-ab397db28ecf None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:48.319015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925ec9a-d6a0-4bf8-b53a-ab397db28ecf None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:48.319280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925ec9a-d6a0-4bf8-b53a-ab397db28ecf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:48.366625 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938826ca-2451-4229-8feb-f67eb0b667e7 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:48.396475 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925ec9a-d6a0-4bf8-b53a-ab397db28ecf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:48.397953 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925ec9a-d6a0-4bf8-b53a-ab397db28ecf None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:48.406641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474d313-cc06-48c8-8c31-da82fe5d30a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:48.407251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474d313-cc06-48c8-8c31-da82fe5d30a4 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:48.407529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474d313-cc06-48c8-8c31-da82fe5d30a4 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:48.408005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:48.408236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474d313-cc06-48c8-8c31-da82fe5d30a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:48.408967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474d313-cc06-48c8-8c31-da82fe5d30a4 None admin] RBAC: Adding query filter params (role.id=55fe0e239bac413b90c785211607e1a4, scope.project.id=6c4962342201407a89793c5c9a6a6f36, user.id=5f9d53147a57402f8b9818590bc1fc1f) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:48.409278 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474d313-cc06-48c8-8c31-da82fe5d30a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:48.411391 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474d313-cc06-48c8-8c31-da82fe5d30a4 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:48.417651 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 266/527] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:38:48 2022] GET /identity/v3/role_assignments?user.id=5f9d53147a57402f8b9818590bc1fc1f&scope.project.id=6c4962342201407a89793c5c9a6a6f36&role.id=55fe0e239bac413b90c785211607e1a4 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:48.418453 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474d313-cc06-48c8-8c31-da82fe5d30a4 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:48.437559 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:48.547216 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 262/528] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:38:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:48.548311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925ec9a-d6a0-4bf8-b53a-ab397db28ecf None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:48.561143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474d313-cc06-48c8-8c31-da82fe5d30a4 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:48.609777 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96406f-7f79-4f55-a586-2aea968238f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:48.611066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96406f-7f79-4f55-a586-2aea968238f2 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:48.611340 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96406f-7f79-4f55-a586-2aea968238f2 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:48.611863 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96406f-7f79-4f55-a586-2aea968238f2 None admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:48.612557 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96406f-7f79-4f55-a586-2aea968238f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:48.612866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96406f-7f79-4f55-a586-2aea968238f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:48.614306 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96406f-7f79-4f55-a586-2aea968238f2 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:48.627560 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 267/529] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Aug 6 20:38:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:48.628157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96406f-7f79-4f55-a586-2aea968238f2 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:48.684295 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925ec9a-d6a0-4bf8-b53a-ab397db28ecf None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:48.695023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:48.708355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:48.732637 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb61c6-d3be-4b4d-aacd-7f3c68215d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:48.733407 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb61c6-d3be-4b4d-aacd-7f3c68215d87 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:48.733801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb61c6-d3be-4b4d-aacd-7f3c68215d87 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:48.734177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb61c6-d3be-4b4d-aacd-7f3c68215d87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:48.748881 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96406f-7f79-4f55-a586-2aea968238f2 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:48.794756 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498672ac-e3a6-4794-8a70-b42b56536704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:48.794756 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498672ac-e3a6-4794-8a70-b42b56536704 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:48.794756 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498672ac-e3a6-4794-8a70-b42b56536704 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:48.794756 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498672ac-e3a6-4794-8a70-b42b56536704 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:48.806802 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498672ac-e3a6-4794-8a70-b42b56536704 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:48.809388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498672ac-e3a6-4794-8a70-b42b56536704 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:48.819346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfb61c6-d3be-4b4d-aacd-7f3c68215d87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:48.821465 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfb61c6-d3be-4b4d-aacd-7f3c68215d87 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:48.829150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-498672ac-e3a6-4794-8a70-b42b56536704 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:48.829150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:48.829150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:48.829150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:48.829150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:48.829150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:48.829150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:48.829150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:48.829150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:48.829150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:48.829150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:48.829150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:48.829150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:48.829150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:48.829150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:48.829150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:48.830190 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:48.830190 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:48.830190 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:48.830190 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:48.830190 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:48.830190 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:48.830190 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:48.830190 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:48.830190 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:48.830190 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:48.830190 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:48.830190 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:48.830190 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:48.830190 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:48.830190 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:48.830190 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:48.830190 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:48.831088 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:48.831088 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:48.831088 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:48.832095 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 268/530] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:48.833539 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498672ac-e3a6-4794-8a70-b42b56536704 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:48.941709 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 263/531] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:38:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:48.947210 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb61c6-d3be-4b4d-aacd-7f3c68215d87 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:48.955887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:48.963690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498672ac-e3a6-4794-8a70-b42b56536704 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:48.982306 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:49.002296 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0dea65-e407-4381-8675-0a0e90c0a9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:49.003087 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0dea65-e407-4381-8675-0a0e90c0a9b7 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:49.003465 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0dea65-e407-4381-8675-0a0e90c0a9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:49.003852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0dea65-e407-4381-8675-0a0e90c0a9b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:49.004673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0dea65-e407-4381-8675-0a0e90c0a9b7 None admin] RBAC: Adding query filter params (role.id=55fe0e239bac413b90c785211607e1a4, scope.project.id=6c4962342201407a89793c5c9a6a6f36, user.id=1e10759b2abd4cafacf338551327775e) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:49.005082 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0dea65-e407-4381-8675-0a0e90c0a9b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:49.006755 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0dea65-e407-4381-8675-0a0e90c0a9b7 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:49.013304 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 269/532] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:38:48 2022] GET /identity/v3/role_assignments?user.id=1e10759b2abd4cafacf338551327775e&scope.project.id=6c4962342201407a89793c5c9a6a6f36&role.id=55fe0e239bac413b90c785211607e1a4 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:49.014492 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0dea65-e407-4381-8675-0a0e90c0a9b7 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:49.102798 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb61c6-d3be-4b4d-aacd-7f3c68215d87 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:49.130577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0dea65-e407-4381-8675-0a0e90c0a9b7 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:49.170283 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1f0c4-e247-4f9a-9367-034f310b14a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:49.172999 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1f0c4-e247-4f9a-9367-034f310b14a3 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:49.173388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1f0c4-e247-4f9a-9367-034f310b14a3 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:49.174157 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933ca34-6f68-4cb4-b6d4-a6c7e7bc14d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:49.174574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1f0c4-e247-4f9a-9367-034f310b14a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:49.175811 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933ca34-6f68-4cb4-b6d4-a6c7e7bc14d8 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:49.177597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933ca34-6f68-4cb4-b6d4-a6c7e7bc14d8 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:49.177985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933ca34-6f68-4cb4-b6d4-a6c7e7bc14d8 None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:49.178809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9933ca34-6f68-4cb4-b6d4-a6c7e7bc14d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:49.180372 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9933ca34-6f68-4cb4-b6d4-a6c7e7bc14d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:49.182141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9933ca34-6f68-4cb4-b6d4-a6c7e7bc14d8 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:49.200301 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1f0c4-e247-4f9a-9367-034f310b14a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:49.201866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1f0c4-e247-4f9a-9367-034f310b14a3 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:49.212957 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 264/533] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:49.217752 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933ca34-6f68-4cb4-b6d4-a6c7e7bc14d8 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:49.239175 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-91d1f0c4-e247-4f9a-9367-034f310b14a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:49.239175 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:49.239175 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:49.239175 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:49.239175 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:49.239175 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:49.239175 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:49.239175 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:49.239175 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:49.239175 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:49.239175 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:49.239175 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:49.239175 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:49.239175 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:49.239175 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:49.239175 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:49.240358 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:49.240358 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:49.240358 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:49.240358 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:49.240358 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:49.240358 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:49.240358 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:49.240358 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:49.240358 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:49.240358 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:49.240358 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:49.240358 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:49.240358 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:49.240358 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:49.240358 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:49.240358 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:49.240358 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:49.241232 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:49.241232 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:49.241232 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:49.242956 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 270/534] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:49.250693 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1f0c4-e247-4f9a-9367-034f310b14a3 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:49.301728 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:49.343105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:49.417600 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933ca34-6f68-4cb4-b6d4-a6c7e7bc14d8 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:49.434025 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1f0c4-e247-4f9a-9367-034f310b14a3 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:49.481917 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb1a5e-ba03-4421-886f-8a3b0ec198d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:49.482574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb1a5e-ba03-4421-886f-8a3b0ec198d0 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:49.482850 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb1a5e-ba03-4421-886f-8a3b0ec198d0 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:49.483117 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb1a5e-ba03-4421-886f-8a3b0ec198d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:49.499513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb1a5e-ba03-4421-886f-8a3b0ec198d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:49.501038 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb1a5e-ba03-4421-886f-8a3b0ec198d0 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:49.503018 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2db654-b4d3-4cc9-aac4-f7e91a53b48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:49.503626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2db654-b4d3-4cc9-aac4-f7e91a53b48f None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:49.503900 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2db654-b4d3-4cc9-aac4-f7e91a53b48f None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:49.504169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2db654-b4d3-4cc9-aac4-f7e91a53b48f None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:49.504815 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2db654-b4d3-4cc9-aac4-f7e91a53b48f None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:49.505113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2db654-b4d3-4cc9-aac4-f7e91a53b48f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:49.506965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2db654-b4d3-4cc9-aac4-f7e91a53b48f None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:49.529297 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-77bb1a5e-ba03-4421-886f-8a3b0ec198d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:38:49.529297 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:49.529297 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:49.529297 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:49.529297 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:49.529297 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:49.529297 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:49.529297 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:49.529297 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:49.529297 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:49.529297 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:49.529297 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:49.529297 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:38:49.529297 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:38:49.529297 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:38:49.530201 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:38:49.530201 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:49.530201 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:49.530201 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:49.530201 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:49.530201 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:49.530201 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:49.530201 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:49.530201 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:49.530201 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:49.530201 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:49.530201 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:49.530201 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:49.530201 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:49.530201 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:49.530201 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:49.530201 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:49.531739 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:38:49.531739 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:38:49.531739 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:38:49.531739 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:38:49.531739 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:38:49.531739 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:38:49.531739 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:38:49.531739 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:49.531739 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 265/535] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:38:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:38:49.536919 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 271/536] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:49.538253 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb1a5e-ba03-4421-886f-8a3b0ec198d0 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:49.544107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2db654-b4d3-4cc9-aac4-f7e91a53b48f None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:49.677623 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb1a5e-ba03-4421-886f-8a3b0ec198d0 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:49.679085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2db654-b4d3-4cc9-aac4-f7e91a53b48f None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:49.682888 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:49.706928 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:49.717772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e60944-6080-4428-9d9f-30af4b12a6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:49.718411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e60944-6080-4428-9d9f-30af4b12a6e4 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:49.718792 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e60944-6080-4428-9d9f-30af4b12a6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:49.719075 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e60944-6080-4428-9d9f-30af4b12a6e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:49.726128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e60944-6080-4428-9d9f-30af4b12a6e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:49.726938 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a59c8-2ebf-4f6d-8dfb-1a8a6f3bf174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:49.727676 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e60944-6080-4428-9d9f-30af4b12a6e4 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:49.728339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a59c8-2ebf-4f6d-8dfb-1a8a6f3bf174 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:49.728893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a59c8-2ebf-4f6d-8dfb-1a8a6f3bf174 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:49.729616 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a59c8-2ebf-4f6d-8dfb-1a8a6f3bf174 None admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:49.730958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a59c8-2ebf-4f6d-8dfb-1a8a6f3bf174 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:49.731464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a59c8-2ebf-4f6d-8dfb-1a8a6f3bf174 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:49.733192 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a59c8-2ebf-4f6d-8dfb-1a8a6f3bf174 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:49.739575 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-64e60944-6080-4428-9d9f-30af4b12a6e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:38:49.739575 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:49.739575 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:49.739575 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:49.739575 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:49.739575 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:49.739575 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:49.739575 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:49.739575 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:49.739575 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:49.739575 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:49.739575 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:49.739575 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:38:49.739575 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:38:49.739575 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:38:49.740409 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:38:49.740409 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:49.740409 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:49.740409 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:49.740409 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:49.740409 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:49.740409 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:49.740409 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:49.740409 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:49.740409 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:49.740409 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:49.740409 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:49.740409 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:49.740409 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:49.740409 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:49.740409 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:49.740409 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:49.741272 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:38:49.741272 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:38:49.741272 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:38:49.741272 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:38:49.741272 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:38:49.741272 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:38:49.741272 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:38:49.741272 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:49.745397 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 272/537] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:38:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:49.747121 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59154e83-4573-471f-8588-e6f01c768683 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:49.747416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59154e83-4573-471f-8588-e6f01c768683 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:49.747696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59154e83-4573-471f-8588-e6f01c768683 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:49.748973 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 273/538] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:49.749739 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59154e83-4573-471f-8588-e6f01c768683 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:49.757203 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 266/539] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Aug 6 20:38:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:49.758603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0aba5-c60f-4e3b-bcbe-aea9e53df4af None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:49.759488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0aba5-c60f-4e3b-bcbe-aea9e53df4af None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:49.759773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0aba5-c60f-4e3b-bcbe-aea9e53df4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:49.783504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-46b0aba5-c60f-4e3b-bcbe-aea9e53df4af None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:49.785697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-46b0aba5-c60f-4e3b-bcbe-aea9e53df4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:49.866956 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59154e83-4573-471f-8588-e6f01c768683 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:49.886580 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 267/540] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:49.886580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0aba5-c60f-4e3b-bcbe-aea9e53df4af None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:49.919589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba094a-bd5e-4a30-abc4-e16e411151c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:49.921009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba094a-bd5e-4a30-abc4-e16e411151c7 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:49.921495 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba094a-bd5e-4a30-abc4-e16e411151c7 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:49.922265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba094a-bd5e-4a30-abc4-e16e411151c7 None admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:49.923229 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba094a-bd5e-4a30-abc4-e16e411151c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:49.923811 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba094a-bd5e-4a30-abc4-e16e411151c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:49.926037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba094a-bd5e-4a30-abc4-e16e411151c7 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:49.941333 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 274/541] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Aug 6 20:38:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:49.947441 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba094a-bd5e-4a30-abc4-e16e411151c7 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:49.964072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:50.014770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0aba5-c60f-4e3b-bcbe-aea9e53df4af None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:50.033251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:50.057224 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fac455-ae95-4c2a-874d-9e44c01e2f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:50.058107 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fac455-ae95-4c2a-874d-9e44c01e2f45 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:50.058837 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fac455-ae95-4c2a-874d-9e44c01e2f45 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:50.059389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fac455-ae95-4c2a-874d-9e44c01e2f45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:50.060405 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fac455-ae95-4c2a-874d-9e44c01e2f45 None admin] RBAC: Adding query filter params (role.id=55fe0e239bac413b90c785211607e1a4, scope.project.id=6c4962342201407a89793c5c9a6a6f36, user.id=60cf8ac27ec04117937e87749d69fe3f) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:50.060927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fac455-ae95-4c2a-874d-9e44c01e2f45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:50.062701 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fac455-ae95-4c2a-874d-9e44c01e2f45 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:50.062808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba094a-bd5e-4a30-abc4-e16e411151c7 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:50.069262 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 268/542] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:38:49 2022] GET /identity/v3/role_assignments?user.id=60cf8ac27ec04117937e87749d69fe3f&scope.project.id=6c4962342201407a89793c5c9a6a6f36&role.id=55fe0e239bac413b90c785211607e1a4 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:50.070290 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fac455-ae95-4c2a-874d-9e44c01e2f45 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:50.103400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f9a19-9096-43ef-b82d-c685b653959e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:50.104226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f9a19-9096-43ef-b82d-c685b653959e None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:50.104497 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f9a19-9096-43ef-b82d-c685b653959e None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:50.104774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f9a19-9096-43ef-b82d-c685b653959e None admin] PATH_INFO: `/v3/roles/service` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:50.117500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f9a19-9096-43ef-b82d-c685b653959e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:50.122922 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-829f9a19-9096-43ef-b82d-c685b653959e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:38:50.122922 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:50.122922 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:50.122922 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:50.122922 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:50.122922 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:50.122922 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:50.122922 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:50.122922 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:50.122922 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:50.122922 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:50.122922 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:50.122922 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:50.122922 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:50.122922 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:50.122922 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:50.123814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:50.123814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:50.123814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:50.123814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:50.123814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:50.123814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:50.123814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:50.123814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:50.123814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:50.123814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:50.123814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:50.123814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:50.123814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:50.123814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:50.123814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:50.123814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:50.124620 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:50.124620 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:50.124620 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:50.124620 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:50.124620 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:50.124620 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:50.124620 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:50.124620 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:50.124620 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:50.124620 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:50.124620 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:38:50.124620 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:50.129168 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 275/543] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Aug 6 20:38:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:50.130975 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f9a19-9096-43ef-b82d-c685b653959e None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:50.192812 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fac455-ae95-4c2a-874d-9e44c01e2f45 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:50.218379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:50.237060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54345f12-db8e-4d0e-abf3-3b4e04e288f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:50.238287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54345f12-db8e-4d0e-abf3-3b4e04e288f8 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:50.238838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54345f12-db8e-4d0e-abf3-3b4e04e288f8 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:50.239328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54345f12-db8e-4d0e-abf3-3b4e04e288f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:50.240358 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54345f12-db8e-4d0e-abf3-3b4e04e288f8 None admin] RBAC: Adding query filter params (role.id=55fe0e239bac413b90c785211607e1a4, scope.project.id=6c4962342201407a89793c5c9a6a6f36, user.id=174e91100a184740b7c604730266dc7c) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:50.240910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54345f12-db8e-4d0e-abf3-3b4e04e288f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:50.242937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54345f12-db8e-4d0e-abf3-3b4e04e288f8 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:50.249493 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f9a19-9096-43ef-b82d-c685b653959e None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:50.250464 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 269/544] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:38:50 2022] GET /identity/v3/role_assignments?user.id=174e91100a184740b7c604730266dc7c&scope.project.id=6c4962342201407a89793c5c9a6a6f36&role.id=55fe0e239bac413b90c785211607e1a4 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:50.291541 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ea9a6-dc8b-4a50-810d-5be085160c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:50.292092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ea9a6-dc8b-4a50-810d-5be085160c5f None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:50.292374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ea9a6-dc8b-4a50-810d-5be085160c5f None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:50.292647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ea9a6-dc8b-4a50-810d-5be085160c5f None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:50.293336 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ea9a6-dc8b-4a50-810d-5be085160c5f None admin] RBAC: Adding query filter params (name=service) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:50.293645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ea9a6-dc8b-4a50-810d-5be085160c5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:50.295149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ea9a6-dc8b-4a50-810d-5be085160c5f None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:50.310029 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 276/545] 10.222.0.33 () {56 vars in 1103 bytes} [Sat Aug 6 20:38:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:50.311481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54345f12-db8e-4d0e-abf3-3b4e04e288f8 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:50.384351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:50.473298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54345f12-db8e-4d0e-abf3-3b4e04e288f8 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:50.513271 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c69bf9-25f1-49f6-a90c-cc7592832ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:50.513906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c69bf9-25f1-49f6-a90c-cc7592832ef2 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:50.514186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c69bf9-25f1-49f6-a90c-cc7592832ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:50.514454 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c69bf9-25f1-49f6-a90c-cc7592832ef2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:50.525861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c69bf9-25f1-49f6-a90c-cc7592832ef2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:50.527326 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c69bf9-25f1-49f6-a90c-cc7592832ef2 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:50.543516 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-58c69bf9-25f1-49f6-a90c-cc7592832ef2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:50.543516 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:50.543516 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:50.543516 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:50.543516 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:50.543516 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:50.543516 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:50.543516 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:50.543516 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:50.543516 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:50.543516 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:50.543516 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:50.543516 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:50.543516 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:50.543516 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:50.543516 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:50.544449 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:50.544449 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:50.544449 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:50.544449 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:50.544449 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:50.544449 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:50.544449 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:50.544449 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:50.544449 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:50.544449 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:50.544449 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:50.544449 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:50.544449 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:50.544449 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:50.544449 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:50.544449 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:50.544449 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:50.545788 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:50.545788 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:50.545788 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:50.545788 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 270/546] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:50.552065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ea9a6-dc8b-4a50-810d-5be085160c5f None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:50.686677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ea9a6-dc8b-4a50-810d-5be085160c5f None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:50.724018 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90197126-8c4f-4a25-b319-7be850d2e46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:50.724796 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90197126-8c4f-4a25-b319-7be850d2e46b None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:50.725192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90197126-8c4f-4a25-b319-7be850d2e46b None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:50.725566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90197126-8c4f-4a25-b319-7be850d2e46b None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:50.726353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90197126-8c4f-4a25-b319-7be850d2e46b None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:50.726788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90197126-8c4f-4a25-b319-7be850d2e46b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:50.728901 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90197126-8c4f-4a25-b319-7be850d2e46b None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:50.742888 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:50.744400 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 277/547] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:50.749096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c69bf9-25f1-49f6-a90c-cc7592832ef2 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:50.870865 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:50.878364 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c69bf9-25f1-49f6-a90c-cc7592832ef2 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:50.927291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed577b3-89c9-422a-b931-24593673b322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:50.927917 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed577b3-89c9-422a-b931-24593673b322 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:50.928193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed577b3-89c9-422a-b931-24593673b322 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:50.928464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed577b3-89c9-422a-b931-24593673b322 None admin] PATH_INFO: `/v3/users/swift` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:50.943624 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed577b3-89c9-422a-b931-24593673b322 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:50.945079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed577b3-89c9-422a-b931-24593673b322 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:50.959130 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-2ed577b3-89c9-422a-b931-24593673b322 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 06 20:38:50.959130 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:50.959130 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:50.959130 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:50.959130 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:50.959130 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:50.959130 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:50.959130 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:50.959130 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:50.959130 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:50.959130 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:50.959130 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:50.959130 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:38:50.959130 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:38:50.959130 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:38:50.959130 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:38:50.960069 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:50.960069 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:50.960069 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:38:50.960069 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:38:50.960069 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:38:50.960069 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:38:50.960069 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:50.960069 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:50.960069 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:50.960069 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:50.960069 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:50.960069 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:50.960069 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:50.960069 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:50.960069 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:50.960069 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:50.960069 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:50.960069 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:50.961610 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:50.961610 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:50.961610 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:38:50.961610 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:38:50.961610 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:38:50.961610 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:38:50.961610 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:38:50.961610 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:38:50.961610 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 06 20:38:50.961610 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:50.961610 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 271/548] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Aug 6 20:38:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:50.966064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90197126-8c4f-4a25-b319-7be850d2e46b None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:51.033827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5916b-51ef-44e4-b4e7-b9e6c0316aab None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:51.034149 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5916b-51ef-44e4-b4e7-b9e6c0316aab None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:51.034384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5916b-51ef-44e4-b4e7-b9e6c0316aab None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:51.035999 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 272/549] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:51.056040 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49a5c1-d2ea-49b0-af5d-fcb0e2de669f None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:51.056319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49a5c1-d2ea-49b0-af5d-fcb0e2de669f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:51.056597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49a5c1-d2ea-49b0-af5d-fcb0e2de669f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:51.104656 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90197126-8c4f-4a25-b319-7be850d2e46b None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:51.119530 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-4d49a5c1-d2ea-49b0-af5d-fcb0e2de669f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:51.120734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4d49a5c1-d2ea-49b0-af5d-fcb0e2de669f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:51.144582 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8f33e-ea30-45b7-ae28-064e82bba52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:51.146581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8f33e-ea30-45b7-ae28-064e82bba52e None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:51.147218 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8f33e-ea30-45b7-ae28-064e82bba52e None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:51.148855 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8f33e-ea30-45b7-ae28-064e82bba52e None admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:51.151004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8f33e-ea30-45b7-ae28-064e82bba52e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:51.152376 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8f33e-ea30-45b7-ae28-064e82bba52e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:51.154820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8f33e-ea30-45b7-ae28-064e82bba52e None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:51.189667 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 278/550] 10.222.0.33 () {56 vars in 1135 bytes} [Sat Aug 6 20:38:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:51.191031 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8f33e-ea30-45b7-ae28-064e82bba52e None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:51.249096 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:51.267374 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 273/551] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:38:51.298718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8f33e-ea30-45b7-ae28-064e82bba52e None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:51.316645 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d49a5c1-d2ea-49b0-af5d-fcb0e2de669f None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:51.334873 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc44051-23ba-4aa1-93bf-bdbd12ce2061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:51.335529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc44051-23ba-4aa1-93bf-bdbd12ce2061 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:51.335741 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc44051-23ba-4aa1-93bf-bdbd12ce2061 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:51.336008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc44051-23ba-4aa1-93bf-bdbd12ce2061 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:51.407469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc44051-23ba-4aa1-93bf-bdbd12ce2061 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:51.408997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc44051-23ba-4aa1-93bf-bdbd12ce2061 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:51.468309 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:51.525272 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 279/552] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:38:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:51.527143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc44051-23ba-4aa1-93bf-bdbd12ce2061 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:51.557552 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:51.589313 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d49a5c1-d2ea-49b0-af5d-fcb0e2de669f None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:51.641425 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc44051-23ba-4aa1-93bf-bdbd12ce2061 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:51.646026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d75a7d-a9b9-4f38-93eb-69251f7cb27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:51.646708 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d75a7d-a9b9-4f38-93eb-69251f7cb27e None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:51.646990 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d75a7d-a9b9-4f38-93eb-69251f7cb27e None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:51.647266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d75a7d-a9b9-4f38-93eb-69251f7cb27e None admin] PATH_INFO: `/v3/roles/service` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:51.659198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d75a7d-a9b9-4f38-93eb-69251f7cb27e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:51.663937 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-45d75a7d-a9b9-4f38-93eb-69251f7cb27e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:38:51.663937 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:51.663937 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:51.663937 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:51.663937 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:51.663937 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:51.663937 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:51.663937 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:51.663937 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:51.663937 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:51.663937 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:51.663937 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:51.663937 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:51.663937 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:51.663937 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:51.663937 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:51.665153 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:51.665153 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:51.665153 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:51.665153 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:51.665153 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:51.665153 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:51.665153 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:51.665153 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:51.665153 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:51.665153 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:51.665153 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:51.665153 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:51.665153 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:51.665153 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:51.665153 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:51.665153 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:51.666118 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:51.666118 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:51.666118 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:51.666118 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:51.666118 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:51.666118 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:51.666118 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:51.666118 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:51.666118 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:51.666118 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:51.666118 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:38:51.666118 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:51.666118 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 274/553] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Aug 6 20:38:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:38:51.671408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d75a7d-a9b9-4f38-93eb-69251f7cb27e None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:51.682572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432b25d-ae11-4657-995a-e23c63481b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:51.682572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432b25d-ae11-4657-995a-e23c63481b52 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:51.682572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432b25d-ae11-4657-995a-e23c63481b52 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:51.682572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432b25d-ae11-4657-995a-e23c63481b52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:51.700966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432b25d-ae11-4657-995a-e23c63481b52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:51.702433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432b25d-ae11-4657-995a-e23c63481b52 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:51.718788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-d432b25d-ae11-4657-995a-e23c63481b52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:51.718788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:51.718788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:51.718788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:51.718788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:51.718788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:51.718788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:51.718788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:51.718788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:51.718788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:51.718788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:51.718788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:51.718788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:51.718788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:51.718788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:51.718788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:51.719765 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:51.719765 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:51.719765 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:51.719765 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:51.719765 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:51.719765 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:51.719765 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:51.719765 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:51.719765 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:51.719765 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:51.719765 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:51.719765 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:51.719765 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:51.719765 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:51.719765 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:51.719765 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:51.719765 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:51.720708 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:51.720708 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:51.720708 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:51.724611 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 280/554] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:51.725874 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432b25d-ae11-4657-995a-e23c63481b52 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:51.750910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:51.847384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d75a7d-a9b9-4f38-93eb-69251f7cb27e None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:51.859685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432b25d-ae11-4657-995a-e23c63481b52 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:51.884933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62baf084-8f6a-4200-851a-02a61477777c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:51.885855 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62baf084-8f6a-4200-851a-02a61477777c None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:51.886327 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62baf084-8f6a-4200-851a-02a61477777c None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:51.886842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62baf084-8f6a-4200-851a-02a61477777c None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:51.887821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62baf084-8f6a-4200-851a-02a61477777c None admin] RBAC: Adding query filter params (name=service) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:51.888408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62baf084-8f6a-4200-851a-02a61477777c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:51.889962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62baf084-8f6a-4200-851a-02a61477777c None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:51.899761 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 275/555] 10.222.0.33 () {56 vars in 1103 bytes} [Sat Aug 6 20:38:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:51.905782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62baf084-8f6a-4200-851a-02a61477777c None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:51.940414 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e17841f-4afa-4b8a-b7c4-f33552209896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:51.940603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:51.940847 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17841f-4afa-4b8a-b7c4-f33552209896 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:51.941048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17841f-4afa-4b8a-b7c4-f33552209896 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:51.941326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17841f-4afa-4b8a-b7c4-f33552209896 None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:51.941973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e17841f-4afa-4b8a-b7c4-f33552209896 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:51.942271 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e17841f-4afa-4b8a-b7c4-f33552209896 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:51.943860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e17841f-4afa-4b8a-b7c4-f33552209896 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:51.959944 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 281/556] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:51.966093 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e17841f-4afa-4b8a-b7c4-f33552209896 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:52.100707 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:52.116729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62baf084-8f6a-4200-851a-02a61477777c None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:52.143797 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e17841f-4afa-4b8a-b7c4-f33552209896 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:52.160051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e135a-ff81-42d1-bcaa-84d2c21521ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:52.160687 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e135a-ff81-42d1-bcaa-84d2c21521ae None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:52.161112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e135a-ff81-42d1-bcaa-84d2c21521ae None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:52.161384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e135a-ff81-42d1-bcaa-84d2c21521ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:52.175552 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e135a-ff81-42d1-bcaa-84d2c21521ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:52.177726 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e135a-ff81-42d1-bcaa-84d2c21521ae None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:52.187741 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75688658-d827-4ea0-bcdd-c91ddde97d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:52.188388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75688658-d827-4ea0-bcdd-c91ddde97d42 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:52.189131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75688658-d827-4ea0-bcdd-c91ddde97d42 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:52.189415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75688658-d827-4ea0-bcdd-c91ddde97d42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:52.197540 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-eb0e135a-ff81-42d1-bcaa-84d2c21521ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:52.197540 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:52.197540 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:52.197540 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:52.197540 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:52.197540 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:52.197540 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:52.197540 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:52.197540 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:52.197540 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:52.197540 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:52.197540 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:52.197540 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:52.197540 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:52.197540 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:52.197540 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:52.198999 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:52.198999 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:52.198999 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:52.198999 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:52.198999 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:52.198999 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:52.198999 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:52.198999 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:52.198999 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:52.198999 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:52.198999 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:52.198999 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:52.198999 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:52.198999 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:52.198999 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:52.198999 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:52.198999 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:52.199896 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:52.199896 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:52.199896 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:52.200636 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75688658-d827-4ea0-bcdd-c91ddde97d42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:52.200779 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 276/557] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:52.200915 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75688658-d827-4ea0-bcdd-c91ddde97d42 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:52.201063 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f2397-31ec-408c-b79b-e0ab50fa88f3 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:52.201063 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f2397-31ec-408c-b79b-e0ab50fa88f3 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:52.201341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f2397-31ec-408c-b79b-e0ab50fa88f3 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:52.203282 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 277/558] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:52.207975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f2397-31ec-408c-b79b-e0ab50fa88f3 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:52.220370 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-75688658-d827-4ea0-bcdd-c91ddde97d42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:38:52.220370 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:52.220370 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:52.220370 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:52.220370 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:52.220370 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:52.220370 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:52.220370 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:52.220370 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:52.220370 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:52.220370 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:52.220370 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:52.220370 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:38:52.220370 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:38:52.220370 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:38:52.221490 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:38:52.221490 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:52.221490 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:52.221490 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:52.221490 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:52.221490 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:52.221490 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:52.221490 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:52.221490 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:52.221490 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:52.221490 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:52.221490 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:52.221490 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:52.221490 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:52.221490 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:52.221490 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:52.221490 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:52.222658 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:38:52.222658 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:38:52.222658 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:38:52.222658 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:38:52.222658 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:38:52.222658 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:38:52.222658 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:38:52.222658 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:52.228655 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 282/559] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:38:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:52.228655 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb6d7e-ad1a-426b-a230-c09f0b19c6f6 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:52.228655 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb6d7e-ad1a-426b-a230-c09f0b19c6f6 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:52.228655 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb6d7e-ad1a-426b-a230-c09f0b19c6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:52.248866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-53fb6d7e-ad1a-426b-a230-c09f0b19c6f6 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:52.250895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-53fb6d7e-ad1a-426b-a230-c09f0b19c6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:52.298699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:52.345299 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 283/560] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:52.345299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb6d7e-ad1a-426b-a230-c09f0b19c6f6 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:52.367125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f2397-31ec-408c-b79b-e0ab50fa88f3 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:52.416230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b70a10-e3bf-457a-a340-7e5289edff9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:52.417507 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b70a10-e3bf-457a-a340-7e5289edff9e None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:52.417958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b70a10-e3bf-457a-a340-7e5289edff9e None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:52.418376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b70a10-e3bf-457a-a340-7e5289edff9e None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:52.419202 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b70a10-e3bf-457a-a340-7e5289edff9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:52.419647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b70a10-e3bf-457a-a340-7e5289edff9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:52.422114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b70a10-e3bf-457a-a340-7e5289edff9e None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:52.424588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:52.441608 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 278/561] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:52.443593 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b70a10-e3bf-457a-a340-7e5289edff9e None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:52.482170 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb6d7e-ad1a-426b-a230-c09f0b19c6f6 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:52.519849 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800e041-c6f2-4202-9f2f-e3da888a8e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:52.520610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800e041-c6f2-4202-9f2f-e3da888a8e25 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:52.520978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800e041-c6f2-4202-9f2f-e3da888a8e25 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:52.521373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800e041-c6f2-4202-9f2f-e3da888a8e25 None admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:52.522136 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800e041-c6f2-4202-9f2f-e3da888a8e25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:52.522539 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800e041-c6f2-4202-9f2f-e3da888a8e25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:52.524151 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800e041-c6f2-4202-9f2f-e3da888a8e25 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:52.541962 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 284/562] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Aug 6 20:38:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:52.541962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800e041-c6f2-4202-9f2f-e3da888a8e25 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:52.595979 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b70a10-e3bf-457a-a340-7e5289edff9e None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:52.625641 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:52.645904 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055cbe6-4e31-4c76-a3a5-24882a531f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:52.647080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055cbe6-4e31-4c76-a3a5-24882a531f81 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:52.647903 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055cbe6-4e31-4c76-a3a5-24882a531f81 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:52.648340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055cbe6-4e31-4c76-a3a5-24882a531f81 None admin] PATH_INFO: `/v3/roles/service` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:52.654018 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800e041-c6f2-4202-9f2f-e3da888a8e25 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:52.667151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055cbe6-4e31-4c76-a3a5-24882a531f81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:52.672437 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-a055cbe6-4e31-4c76-a3a5-24882a531f81 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:38:52.672437 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:52.672437 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:52.672437 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:52.672437 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:52.672437 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:52.672437 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:52.672437 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:52.672437 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:52.672437 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:52.672437 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:52.672437 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:52.672437 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:52.672437 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:52.672437 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:52.672437 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:52.673386 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:52.673386 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:52.673386 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:52.673386 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:52.673386 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:52.673386 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:52.673386 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:52.673386 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:52.673386 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:52.673386 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:52.673386 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:52.673386 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:52.673386 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:52.673386 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:52.673386 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:52.673386 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:52.674218 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:52.674218 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:52.674218 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:52.674218 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:52.674218 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:52.674218 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:52.674218 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:52.674218 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:52.674218 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:52.674218 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:52.674218 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:38:52.674218 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:52.675773 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 279/563] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Aug 6 20:38:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:52.679447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055cbe6-4e31-4c76-a3a5-24882a531f81 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:52.689128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:52.713707 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337f05e-80ee-4bb6-8eb5-b65a71bb6aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:52.714894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337f05e-80ee-4bb6-8eb5-b65a71bb6aea None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:52.714894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337f05e-80ee-4bb6-8eb5-b65a71bb6aea None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:52.715085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337f05e-80ee-4bb6-8eb5-b65a71bb6aea None admin] PATH_INFO: `/v3/users/nova` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:52.724809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d337f05e-80ee-4bb6-8eb5-b65a71bb6aea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:52.726246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d337f05e-80ee-4bb6-8eb5-b65a71bb6aea None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:52.739629 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-d337f05e-80ee-4bb6-8eb5-b65a71bb6aea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:38:52.739629 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:52.739629 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:52.739629 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:52.739629 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:52.739629 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:52.739629 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:52.739629 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:52.739629 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:52.739629 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:52.739629 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:52.739629 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:52.739629 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:38:52.739629 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:38:52.739629 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:38:52.739629 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:38:52.741841 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:52.741841 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:52.741841 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:38:52.741841 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:38:52.741841 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:38:52.741841 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:38:52.741841 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:52.741841 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:52.741841 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:52.741841 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:52.741841 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:52.741841 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:52.741841 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:52.741841 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:52.741841 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:52.741841 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:52.741841 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:52.741841 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:52.744751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:52.744751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:52.744751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:38:52.744751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:38:52.744751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:38:52.744751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:38:52.744751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:38:52.744751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:38:52.744751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:38:52.744751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:52.744751 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 285/564] 10.222.0.33 () {56 vars in 1093 bytes} [Sat Aug 6 20:38:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:52.744751 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337f05e-80ee-4bb6-8eb5-b65a71bb6aea None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:52.807301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055cbe6-4e31-4c76-a3a5-24882a531f81 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:52.841400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4047206-0aea-4476-9c6f-9e24584765ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:52.842188 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4047206-0aea-4476-9c6f-9e24584765ce None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:52.842507 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4047206-0aea-4476-9c6f-9e24584765ce None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:52.842815 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4047206-0aea-4476-9c6f-9e24584765ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:52.843529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4047206-0aea-4476-9c6f-9e24584765ce None admin] RBAC: Adding query filter params (role.id=55fe0e239bac413b90c785211607e1a4, scope.project.id=6c4962342201407a89793c5c9a6a6f36, user.id=cd3e0e177f934f7ba5abe52ac8bf8bbb) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:52.843834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4047206-0aea-4476-9c6f-9e24584765ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:52.845259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4047206-0aea-4476-9c6f-9e24584765ce None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:52.850792 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 280/565] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:38:52 2022] GET /identity/v3/role_assignments?user.id=cd3e0e177f934f7ba5abe52ac8bf8bbb&scope.project.id=6c4962342201407a89793c5c9a6a6f36&role.id=55fe0e239bac413b90c785211607e1a4 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:52.852093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedfeb7-362c-4759-9fb3-c0494da6c9a1 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:52.852425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedfeb7-362c-4759-9fb3-c0494da6c9a1 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:52.852695 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedfeb7-362c-4759-9fb3-c0494da6c9a1 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:52.853909 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 281/566] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:52.854775 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dedfeb7-362c-4759-9fb3-c0494da6c9a1 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:52.865040 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337f05e-80ee-4bb6-8eb5-b65a71bb6aea None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:52.905432 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d2a6b-ae74-4fd4-86c5-e04e6483f85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:52.906153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d2a6b-ae74-4fd4-86c5-e04e6483f85c None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:52.906504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d2a6b-ae74-4fd4-86c5-e04e6483f85c None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:52.906878 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d2a6b-ae74-4fd4-86c5-e04e6483f85c None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:52.907748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d2a6b-ae74-4fd4-86c5-e04e6483f85c None admin] RBAC: Adding query filter params (name=service) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:52.908131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d2a6b-ae74-4fd4-86c5-e04e6483f85c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:52.909743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d2a6b-ae74-4fd4-86c5-e04e6483f85c None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:52.911282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:52.920399 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 286/567] 10.222.0.33 () {56 vars in 1103 bytes} [Sat Aug 6 20:38:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:52.921684 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe5a00-1583-4bfc-927a-a27a656ee5ce None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:52.922077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe5a00-1583-4bfc-927a-a27a656ee5ce None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:52.922457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe5a00-1583-4bfc-927a-a27a656ee5ce None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:52.923978 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 287/568] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:52.927997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b25000-c1cd-4167-96c5-c5575888aa29 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:52.928284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b25000-c1cd-4167-96c5-c5575888aa29 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:52.928559 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b25000-c1cd-4167-96c5-c5575888aa29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:52.948787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-17b25000-c1cd-4167-96c5-c5575888aa29 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:52.950110 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-17b25000-c1cd-4167-96c5-c5575888aa29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:52.982815 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:52.990044 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dedfeb7-362c-4759-9fb3-c0494da6c9a1 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:53.022276 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 288/569] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:53.023525 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b25000-c1cd-4167-96c5-c5575888aa29 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:53.034984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43f229-8a62-466e-a7e7-057da0768baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:53.035701 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43f229-8a62-466e-a7e7-057da0768baa None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:53.036063 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43f229-8a62-466e-a7e7-057da0768baa None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:53.036390 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43f229-8a62-466e-a7e7-057da0768baa None admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:53.037155 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43f229-8a62-466e-a7e7-057da0768baa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:53.037464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43f229-8a62-466e-a7e7-057da0768baa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:53.038932 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43f229-8a62-466e-a7e7-057da0768baa None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:53.062386 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 282/570] 10.222.0.33 () {56 vars in 1133 bytes} [Sat Aug 6 20:38:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:53.062386 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cca039-3e41-4804-8802-ddc78a5fbc66 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:53.062386 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cca039-3e41-4804-8802-ddc78a5fbc66 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:53.062386 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cca039-3e41-4804-8802-ddc78a5fbc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:53.078350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a8cca039-3e41-4804-8802-ddc78a5fbc66 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:53.079668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a8cca039-3e41-4804-8802-ddc78a5fbc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:53.138567 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b25000-c1cd-4167-96c5-c5575888aa29 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:53.150214 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 283/571] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:53.151288 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cca039-3e41-4804-8802-ddc78a5fbc66 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:53.187686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32940e1e-e7ff-4458-8f20-6e84e94cd8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:53.188542 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32940e1e-e7ff-4458-8f20-6e84e94cd8eb None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:53.188945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32940e1e-e7ff-4458-8f20-6e84e94cd8eb None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:53.189275 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:53.189394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32940e1e-e7ff-4458-8f20-6e84e94cd8eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:53.200582 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32940e1e-e7ff-4458-8f20-6e84e94cd8eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:53.202043 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32940e1e-e7ff-4458-8f20-6e84e94cd8eb None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:53.217607 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-32940e1e-e7ff-4458-8f20-6e84e94cd8eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:53.217607 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:53.217607 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:53.217607 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:53.217607 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:53.217607 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:53.217607 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:53.217607 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:53.217607 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:53.217607 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:53.217607 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:53.217607 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:53.217607 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:53.217607 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:53.217607 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:53.217607 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:53.218665 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:53.218665 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:53.218665 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:53.218665 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:53.218665 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:53.218665 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:53.218665 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:53.218665 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:53.218665 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:53.218665 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:53.218665 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:53.218665 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:53.218665 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:53.218665 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:53.218665 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:53.218665 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:53.218665 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:53.224368 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:53.224368 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:53.224368 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:53.224368 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 289/572] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:53.224368 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32940e1e-e7ff-4458-8f20-6e84e94cd8eb None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:53.245346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:53.270407 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cca039-3e41-4804-8802-ddc78a5fbc66 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:53.308648 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fca55b-a2c3-43fb-a85c-76fe1a645b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:53.309282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fca55b-a2c3-43fb-a85c-76fe1a645b4e None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:53.309553 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fca55b-a2c3-43fb-a85c-76fe1a645b4e None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:53.309823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fca55b-a2c3-43fb-a85c-76fe1a645b4e None admin] PATH_INFO: `/v3/roles/service` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:53.320279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fca55b-a2c3-43fb-a85c-76fe1a645b4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:53.325831 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-02fca55b-a2c3-43fb-a85c-76fe1a645b4e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:38:53.325831 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:53.325831 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:53.325831 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:53.325831 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:53.325831 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:53.325831 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:53.325831 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:53.325831 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:53.325831 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:53.325831 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:53.325831 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:53.325831 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:53.325831 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:53.325831 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:53.325831 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:53.327113 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:53.327113 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:53.327113 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:53.327113 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:53.327113 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:53.327113 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:53.327113 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:53.327113 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:53.327113 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:53.327113 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:53.327113 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:53.327113 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:53.327113 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:53.327113 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:53.327113 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:53.327113 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:53.328147 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:53.328147 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:53.328147 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:53.328147 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:53.328147 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:53.328147 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:53.328147 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:53.328147 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:53.328147 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:53.328147 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:53.328147 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:38:53.328147 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:53.328147 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 284/573] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Aug 6 20:38:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:53.328147 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fca55b-a2c3-43fb-a85c-76fe1a645b4e None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:53.340583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32940e1e-e7ff-4458-8f20-6e84e94cd8eb None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:53.379140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0eb07-4516-4d0b-801d-5792e1194b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:53.379776 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0eb07-4516-4d0b-801d-5792e1194b9d None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:53.380056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0eb07-4516-4d0b-801d-5792e1194b9d None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:53.380326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0eb07-4516-4d0b-801d-5792e1194b9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:53.391100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0eb07-4516-4d0b-801d-5792e1194b9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:53.392543 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0eb07-4516-4d0b-801d-5792e1194b9d None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:53.406922 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-15a0eb07-4516-4d0b-801d-5792e1194b9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:53.406922 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:53.406922 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:53.406922 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:53.406922 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:53.406922 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:53.406922 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:53.406922 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:53.406922 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:53.406922 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:53.406922 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:53.406922 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:53.406922 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:53.406922 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:53.406922 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:53.406922 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:53.407906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:53.407906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:53.407906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:53.407906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:53.407906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:53.407906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:53.407906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:53.407906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:53.407906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:53.407906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:53.407906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:53.407906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:53.407906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:53.407906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:53.407906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:53.407906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:53.407906 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:53.408790 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:53.408790 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:53.408790 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:53.408790 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 290/574] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:53.408790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0eb07-4516-4d0b-801d-5792e1194b9d None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:53.434424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:53.444793 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fca55b-a2c3-43fb-a85c-76fe1a645b4e None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:53.480442 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5121cf-2788-4b33-84e8-9c08913aa087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:53.480806 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:53.481805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5121cf-2788-4b33-84e8-9c08913aa087 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:53.482090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5121cf-2788-4b33-84e8-9c08913aa087 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:53.482367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5121cf-2788-4b33-84e8-9c08913aa087 None admin] PATH_INFO: `/v3/roles/service` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:53.494132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5121cf-2788-4b33-84e8-9c08913aa087 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:53.498999 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-bd5121cf-2788-4b33-84e8-9c08913aa087 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:38:53.498999 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:53.498999 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:53.498999 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:53.498999 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:53.498999 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:53.498999 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:53.498999 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:53.498999 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:53.498999 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:53.498999 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:53.498999 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:53.498999 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:53.498999 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:53.498999 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:53.498999 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:53.499920 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:53.499920 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:53.499920 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:53.499920 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:53.499920 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:53.499920 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:53.499920 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:53.499920 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:53.499920 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:53.499920 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:53.499920 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:53.499920 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:53.499920 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:53.499920 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:53.499920 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:53.499920 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:53.506270 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:53.506270 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:53.506270 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:53.506270 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:53.506270 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:53.506270 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:53.506270 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:53.506270 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:53.506270 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:53.506270 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:53.506270 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:38:53.506270 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:53.506270 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 285/575] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Aug 6 20:38:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:53.506270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5121cf-2788-4b33-84e8-9c08913aa087 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:53.518780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0eb07-4516-4d0b-801d-5792e1194b9d None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:53.553643 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33dc55a-f3ad-4138-8404-a8f04928ecba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:53.554405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dc55a-f3ad-4138-8404-a8f04928ecba None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:53.554801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dc55a-f3ad-4138-8404-a8f04928ecba None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:53.555168 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dc55a-f3ad-4138-8404-a8f04928ecba None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:53.556007 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33dc55a-f3ad-4138-8404-a8f04928ecba None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:53.556458 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33dc55a-f3ad-4138-8404-a8f04928ecba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:53.558237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33dc55a-f3ad-4138-8404-a8f04928ecba None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:53.571501 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 291/576] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:53.572655 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33dc55a-f3ad-4138-8404-a8f04928ecba None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:53.616125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5121cf-2788-4b33-84e8-9c08913aa087 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:53.655379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacf8cb-0bf9-40ce-8b18-e12294a0a4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:53.655989 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacf8cb-0bf9-40ce-8b18-e12294a0a4ed None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:53.656270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacf8cb-0bf9-40ce-8b18-e12294a0a4ed None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:53.656544 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacf8cb-0bf9-40ce-8b18-e12294a0a4ed None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:53.657387 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bacf8cb-0bf9-40ce-8b18-e12294a0a4ed None admin] RBAC: Adding query filter params (name=service) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:53.657516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bacf8cb-0bf9-40ce-8b18-e12294a0a4ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:53.658901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bacf8cb-0bf9-40ce-8b18-e12294a0a4ed None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:53.668122 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 286/577] 10.222.0.33 () {56 vars in 1103 bytes} [Sat Aug 6 20:38:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:53.669023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacf8cb-0bf9-40ce-8b18-e12294a0a4ed None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:53.689770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:53.693566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33dc55a-f3ad-4138-8404-a8f04928ecba None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:53.724606 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:53.730699 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff577fd-983c-4277-a9fd-eea628c8d13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:53.731381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff577fd-983c-4277-a9fd-eea628c8d13c None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:53.731730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff577fd-983c-4277-a9fd-eea628c8d13c None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:53.732107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff577fd-983c-4277-a9fd-eea628c8d13c None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:53.732817 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff577fd-983c-4277-a9fd-eea628c8d13c None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:53.733218 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff577fd-983c-4277-a9fd-eea628c8d13c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:53.734693 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff577fd-983c-4277-a9fd-eea628c8d13c None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:53.747623 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 292/578] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:53.747623 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff577fd-983c-4277-a9fd-eea628c8d13c None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:53.786767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacf8cb-0bf9-40ce-8b18-e12294a0a4ed None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:53.822510 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90233f69-4dce-4c8a-b0fa-4ecf958a94de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:53.823130 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90233f69-4dce-4c8a-b0fa-4ecf958a94de None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:53.823409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90233f69-4dce-4c8a-b0fa-4ecf958a94de None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:53.823678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90233f69-4dce-4c8a-b0fa-4ecf958a94de None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:53.824333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90233f69-4dce-4c8a-b0fa-4ecf958a94de None admin] RBAC: Adding query filter params (name=service) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:53.824631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90233f69-4dce-4c8a-b0fa-4ecf958a94de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:53.825973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90233f69-4dce-4c8a-b0fa-4ecf958a94de None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:53.834497 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 287/579] 10.222.0.33 () {56 vars in 1103 bytes} [Sat Aug 6 20:38:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:53.835134 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90233f69-4dce-4c8a-b0fa-4ecf958a94de None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:53.863477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff577fd-983c-4277-a9fd-eea628c8d13c None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:53.898161 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6716022-29d3-4e54-860c-038f2c08d0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:53.898806 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6716022-29d3-4e54-860c-038f2c08d0c1 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:53.899714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6716022-29d3-4e54-860c-038f2c08d0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:53.899945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6716022-29d3-4e54-860c-038f2c08d0c1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:53.907400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6716022-29d3-4e54-860c-038f2c08d0c1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:53.908884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6716022-29d3-4e54-860c-038f2c08d0c1 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:53.916955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:53.920522 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-c6716022-29d3-4e54-860c-038f2c08d0c1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 06 20:38:53.920522 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:53.920522 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:53.920522 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:53.920522 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:53.920522 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:53.920522 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:53.920522 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:53.920522 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:53.920522 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:53.920522 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:53.920522 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:53.920522 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:38:53.920522 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:38:53.920522 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:38:53.920522 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:38:53.921473 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:53.921473 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:53.921473 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:38:53.921473 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:38:53.921473 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:38:53.921473 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:38:53.921473 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:53.921473 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:53.921473 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:53.921473 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:53.921473 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:53.921473 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:53.921473 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:53.921473 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:53.921473 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:53.921473 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:53.921473 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:53.921473 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:53.922429 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:53.922429 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:53.922429 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:38:53.922429 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:38:53.922429 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:38:53.922429 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:38:53.922429 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:38:53.922429 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:38:53.922429 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 06 20:38:53.922429 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:53.922429 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 293/580] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:38:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:53.922429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6716022-29d3-4e54-860c-038f2c08d0c1 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:53.948997 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90233f69-4dce-4c8a-b0fa-4ecf958a94de None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:53.977792 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:53.986934 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886b4f9-a0ff-4c93-b855-8255646cbdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:53.987559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886b4f9-a0ff-4c93-b855-8255646cbdad None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:53.987834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886b4f9-a0ff-4c93-b855-8255646cbdad None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:53.988106 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886b4f9-a0ff-4c93-b855-8255646cbdad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:53.999389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886b4f9-a0ff-4c93-b855-8255646cbdad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:54.000945 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886b4f9-a0ff-4c93-b855-8255646cbdad None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:54.017743 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-5886b4f9-a0ff-4c93-b855-8255646cbdad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:54.017743 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:54.017743 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:54.017743 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:54.017743 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:54.017743 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:54.017743 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:54.017743 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:54.017743 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:54.017743 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:54.017743 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:54.017743 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:54.017743 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:54.017743 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:54.017743 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:54.017743 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:54.018813 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:54.018813 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:54.018813 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:54.018813 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:54.018813 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:54.018813 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:54.018813 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:54.018813 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:54.018813 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:54.018813 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:54.018813 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:54.018813 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:54.018813 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:54.018813 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:54.018813 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:54.018813 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:54.018813 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:54.020498 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:54.020498 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:54.020498 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:54.020498 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 288/581] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:54.020498 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886b4f9-a0ff-4c93-b855-8255646cbdad None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:54.033718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6716022-29d3-4e54-860c-038f2c08d0c1 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:54.071750 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce78c0-44b2-4078-a89e-a72ad9fdb2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:54.072411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce78c0-44b2-4078-a89e-a72ad9fdb2c1 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:54.072659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce78c0-44b2-4078-a89e-a72ad9fdb2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:54.072882 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce78c0-44b2-4078-a89e-a72ad9fdb2c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:54.084145 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce78c0-44b2-4078-a89e-a72ad9fdb2c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:54.085746 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce78c0-44b2-4078-a89e-a72ad9fdb2c1 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:54.097713 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-0cce78c0-44b2-4078-a89e-a72ad9fdb2c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:38:54.097713 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:54.097713 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:54.097713 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:54.097713 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:54.097713 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:54.097713 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:54.097713 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:54.097713 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:54.097713 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:54.097713 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:54.097713 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:54.097713 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:38:54.097713 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:38:54.097713 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:38:54.098937 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:38:54.098937 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:54.098937 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:54.098937 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:54.098937 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:54.098937 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:54.098937 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:54.098937 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:54.098937 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:54.098937 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:54.098937 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:54.098937 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:54.098937 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:54.098937 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:54.098937 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:54.098937 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:54.098937 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:54.099830 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:38:54.099830 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:38:54.099830 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:38:54.099830 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:38:54.099830 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:38:54.099830 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:38:54.099830 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:38:54.099830 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:54.099830 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 294/582] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:38:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:54.100317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce78c0-44b2-4078-a89e-a72ad9fdb2c1 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:54.134615 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886b4f9-a0ff-4c93-b855-8255646cbdad None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:54.160995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:54.169297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56278335-91fb-4ee9-90e5-413a9f9cb503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:54.170000 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56278335-91fb-4ee9-90e5-413a9f9cb503 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:54.170344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56278335-91fb-4ee9-90e5-413a9f9cb503 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:54.170710 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56278335-91fb-4ee9-90e5-413a9f9cb503 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:54.184328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56278335-91fb-4ee9-90e5-413a9f9cb503 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:54.185835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56278335-91fb-4ee9-90e5-413a9f9cb503 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:54.202430 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-56278335-91fb-4ee9-90e5-413a9f9cb503 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:54.202430 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:54.202430 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:54.202430 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:54.202430 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:54.202430 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:54.202430 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:54.202430 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:54.202430 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:54.202430 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:54.202430 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:54.202430 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:54.202430 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:54.202430 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:54.202430 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:54.202430 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:54.204516 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:54.204516 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:54.204516 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:54.204516 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:54.204516 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:54.204516 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:54.204516 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:54.204516 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:54.204516 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:54.204516 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:54.204516 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:54.204516 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:54.204516 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:54.204516 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:54.204516 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:54.204516 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:54.204516 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:54.206580 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:54.206580 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:54.206580 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:54.206951 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 289/583] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:54.207927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56278335-91fb-4ee9-90e5-413a9f9cb503 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:54.220207 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce78c0-44b2-4078-a89e-a72ad9fdb2c1 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:54.235644 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:54.261222 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c624903-6186-49f1-8feb-92174cb4ee7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:54.261912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c624903-6186-49f1-8feb-92174cb4ee7d None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:54.262272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c624903-6186-49f1-8feb-92174cb4ee7d None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:54.262574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c624903-6186-49f1-8feb-92174cb4ee7d None admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:54.263516 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c624903-6186-49f1-8feb-92174cb4ee7d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:54.263649 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c624903-6186-49f1-8feb-92174cb4ee7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:54.265036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c624903-6186-49f1-8feb-92174cb4ee7d None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:54.287393 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 295/584] 10.222.0.33 () {56 vars in 1137 bytes} [Sat Aug 6 20:38:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:54.287393 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c624903-6186-49f1-8feb-92174cb4ee7d None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:54.325064 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56278335-91fb-4ee9-90e5-413a9f9cb503 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:54.363393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb49ba2-0e8c-4c53-ab45-db34b68556ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:54.364247 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb49ba2-0e8c-4c53-ab45-db34b68556ce None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:54.364783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb49ba2-0e8c-4c53-ab45-db34b68556ce None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:54.365063 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb49ba2-0e8c-4c53-ab45-db34b68556ce None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:54.365839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb49ba2-0e8c-4c53-ab45-db34b68556ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:54.366143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb49ba2-0e8c-4c53-ab45-db34b68556ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:54.367541 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb49ba2-0e8c-4c53-ab45-db34b68556ce None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:54.385544 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 290/585] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:54.385544 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb49ba2-0e8c-4c53-ab45-db34b68556ce None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:54.401474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c624903-6186-49f1-8feb-92174cb4ee7d None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:54.427610 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:54.438920 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96ffd3-f480-4b9d-8aa9-352c481f76e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:54.439627 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96ffd3-f480-4b9d-8aa9-352c481f76e2 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:54.439972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96ffd3-f480-4b9d-8aa9-352c481f76e2 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:54.440306 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96ffd3-f480-4b9d-8aa9-352c481f76e2 None admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:54.441171 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96ffd3-f480-4b9d-8aa9-352c481f76e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:54.441465 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96ffd3-f480-4b9d-8aa9-352c481f76e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:54.443021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96ffd3-f480-4b9d-8aa9-352c481f76e2 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:54.454883 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 296/586] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Aug 6 20:38:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:54.455680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96ffd3-f480-4b9d-8aa9-352c481f76e2 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:54.487604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:54.496503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb49ba2-0e8c-4c53-ab45-db34b68556ce None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:54.531584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480243d9-59b6-4956-a74e-17b6dab91724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:54.532311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480243d9-59b6-4956-a74e-17b6dab91724 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:54.532664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480243d9-59b6-4956-a74e-17b6dab91724 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:54.533004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480243d9-59b6-4956-a74e-17b6dab91724 None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:54.533714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480243d9-59b6-4956-a74e-17b6dab91724 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:54.534088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480243d9-59b6-4956-a74e-17b6dab91724 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:54.535547 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480243d9-59b6-4956-a74e-17b6dab91724 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:54.552041 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 291/587] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:54.552956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480243d9-59b6-4956-a74e-17b6dab91724 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:54.561457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96ffd3-f480-4b9d-8aa9-352c481f76e2 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:54.598731 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb8fad-dbf0-4be5-b674-96fc35e362e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:54.599282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb8fad-dbf0-4be5-b674-96fc35e362e0 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:54.599556 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb8fad-dbf0-4be5-b674-96fc35e362e0 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:54.599821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb8fad-dbf0-4be5-b674-96fc35e362e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:54.610906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb8fad-dbf0-4be5-b674-96fc35e362e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:54.612340 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb8fad-dbf0-4be5-b674-96fc35e362e0 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:54.627612 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-73eb8fad-dbf0-4be5-b674-96fc35e362e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:54.627612 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:54.627612 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:54.627612 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:54.627612 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:54.627612 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:54.627612 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:54.627612 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:54.627612 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:54.627612 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:54.627612 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:54.627612 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:54.627612 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:54.627612 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:54.627612 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:54.627612 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:54.633717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:54.633717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:54.633717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:54.633717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:54.633717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:54.633717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:54.633717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:54.633717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:54.633717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:54.633717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:54.633717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:54.633717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:54.633717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:54.633717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:54.633717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:54.633717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:54.633717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:54.634861 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:54.634861 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:54.634861 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:54.634861 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 297/588] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:54.634861 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb8fad-dbf0-4be5-b674-96fc35e362e0 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:54.662148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:54.665881 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480243d9-59b6-4956-a74e-17b6dab91724 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:54.705302 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885c9e1-603d-49ea-9c7e-0a598024da7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:54.705937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885c9e1-603d-49ea-9c7e-0a598024da7e None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:54.706221 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885c9e1-603d-49ea-9c7e-0a598024da7e None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:54.706497 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885c9e1-603d-49ea-9c7e-0a598024da7e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:54.714122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885c9e1-603d-49ea-9c7e-0a598024da7e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:54.715592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885c9e1-603d-49ea-9c7e-0a598024da7e None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:54.726684 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-f885c9e1-603d-49ea-9c7e-0a598024da7e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 20:38:54.726684 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:54.726684 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:54.726684 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:54.726684 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:54.726684 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:54.726684 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:54.726684 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:54.726684 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:54.726684 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:54.726684 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:54.726684 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:54.726684 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:38:54.726684 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:38:54.726684 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:38:54.726684 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:38:54.728323 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:54.728323 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:54.728323 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:38:54.728323 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:38:54.728323 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:38:54.728323 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:38:54.728323 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:54.728323 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:54.728323 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:54.728323 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:54.728323 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:54.728323 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:54.728323 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:54.728323 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:54.728323 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:54.728323 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:54.728323 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:54.728323 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:54.729262 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:54.729262 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:54.729262 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:38:54.729262 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:38:54.729262 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:38:54.729262 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:38:54.729262 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:38:54.729262 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:38:54.729262 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 20:38:54.729262 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:54.729262 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 292/589] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:38:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:54.729929 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885c9e1-603d-49ea-9c7e-0a598024da7e None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:54.734916 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:54.755265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb8fad-dbf0-4be5-b674-96fc35e362e0 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:54.791511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a701819-1954-44ff-8ed0-e4cf16f36510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:54.792161 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a701819-1954-44ff-8ed0-e4cf16f36510 None admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:54.792437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a701819-1954-44ff-8ed0-e4cf16f36510 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:54.792706 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a701819-1954-44ff-8ed0-e4cf16f36510 None admin] PATH_INFO: `/v3/projects/6c4962342201407a89793c5c9a6a6f36/users/5f9d53147a57402f8b9818590bc1fc1f/roles/55fe0e239bac413b90c785211607e1a4` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:54.808589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a701819-1954-44ff-8ed0-e4cf16f36510 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c4962342201407a89793c5c9a6a6f36, user_id=5f9d53147a57402f8b9818590bc1fc1f, role_id=55fe0e239bac413b90c785211607e1a4)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:54.810157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a701819-1954-44ff-8ed0-e4cf16f36510 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:54.825140 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 298/590] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Aug 6 20:38:54 2022] PUT /identity/v3/projects/6c4962342201407a89793c5c9a6a6f36/users/5f9d53147a57402f8b9818590bc1fc1f/roles/55fe0e239bac413b90c785211607e1a4 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:54.826055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a701819-1954-44ff-8ed0-e4cf16f36510 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:54.870106 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885c9e1-603d-49ea-9c7e-0a598024da7e None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:54.922779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e976ca-8e07-47fd-8132-9e81099f0daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:54.923440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e976ca-8e07-47fd-8132-9e81099f0daf None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:54.923764 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e976ca-8e07-47fd-8132-9e81099f0daf None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:54.924032 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e976ca-8e07-47fd-8132-9e81099f0daf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:54.936808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e976ca-8e07-47fd-8132-9e81099f0daf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:54.938328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e976ca-8e07-47fd-8132-9e81099f0daf None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:54.952247 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-b3e976ca-8e07-47fd-8132-9e81099f0daf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 06 20:38:54.952247 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:54.952247 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:54.952247 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:54.952247 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:54.952247 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:54.952247 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:54.952247 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:54.952247 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:54.952247 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:54.952247 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:54.952247 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:54.952247 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:38:54.952247 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:38:54.952247 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:38:54.952247 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:38:54.953309 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:54.953309 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:54.953309 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:38:54.953309 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:38:54.953309 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:38:54.953309 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:38:54.953309 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:54.953309 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:54.953309 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:54.953309 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:54.953309 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:54.953309 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:54.953309 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:54.953309 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:54.953309 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:54.953309 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:54.953309 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:54.953309 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:54.954271 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:54.954271 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:54.954271 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:38:54.954271 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:38:54.954271 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:38:54.954271 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:38:54.954271 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:38:54.954271 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:38:54.954271 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 06 20:38:54.954271 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:54.957199 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 293/591] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Aug 6 20:38:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:54.958759 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e976ca-8e07-47fd-8132-9e81099f0daf None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:54.958884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a701819-1954-44ff-8ed0-e4cf16f36510 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:54.985980 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:55.007567 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:55.016553 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7b35a-6b1d-4724-b0ad-cb73a6604b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:55.017553 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7b35a-6b1d-4724-b0ad-cb73a6604b6a None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:55.017942 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7b35a-6b1d-4724-b0ad-cb73a6604b6a None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:55.018214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7b35a-6b1d-4724-b0ad-cb73a6604b6a None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:55.018890 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7b35a-6b1d-4724-b0ad-cb73a6604b6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:55.019192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7b35a-6b1d-4724-b0ad-cb73a6604b6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:55.020743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7b35a-6b1d-4724-b0ad-cb73a6604b6a None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:55.037499 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 299/592] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:55.038201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7b35a-6b1d-4724-b0ad-cb73a6604b6a None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:55.092777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e976ca-8e07-47fd-8132-9e81099f0daf None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:55.128058 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8aa362-471d-47c1-a8c1-9735e8932ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:55.128583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8aa362-471d-47c1-a8c1-9735e8932ee1 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:55.128858 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8aa362-471d-47c1-a8c1-9735e8932ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:55.129126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8aa362-471d-47c1-a8c1-9735e8932ee1 None admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:55.129845 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8aa362-471d-47c1-a8c1-9735e8932ee1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:55.130143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8aa362-471d-47c1-a8c1-9735e8932ee1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:55.131578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8aa362-471d-47c1-a8c1-9735e8932ee1 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:55.150910 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 294/593] 10.222.0.33 () {56 vars in 1137 bytes} [Sat Aug 6 20:38:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:55.151751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8aa362-471d-47c1-a8c1-9735e8932ee1 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:55.172860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7b35a-6b1d-4724-b0ad-cb73a6604b6a None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:55.206734 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a459b-998c-421b-a1e9-e8e992ef1a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:55.207339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a459b-998c-421b-a1e9-e8e992ef1a76 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:55.207618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a459b-998c-421b-a1e9-e8e992ef1a76 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:55.207895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a459b-998c-421b-a1e9-e8e992ef1a76 None admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:55.208609 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a459b-998c-421b-a1e9-e8e992ef1a76 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:55.208908 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a459b-998c-421b-a1e9-e8e992ef1a76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:55.210341 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a459b-998c-421b-a1e9-e8e992ef1a76 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:55.232838 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 300/594] 10.222.0.33 () {56 vars in 1139 bytes} [Sat Aug 6 20:38:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:55.233969 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279b0de-c565-49a0-aaf5-c676ebbac360 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:55.234254 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279b0de-c565-49a0-aaf5-c676ebbac360 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:55.234529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279b0de-c565-49a0-aaf5-c676ebbac360 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:55.235819 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 301/595] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:55.238711 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279b0de-c565-49a0-aaf5-c676ebbac360 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:55.239221 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:55.269561 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8aa362-471d-47c1-a8c1-9735e8932ee1 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:55.296192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:55.310861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed61e91-4eef-4d7b-9677-fd9d1ea8ae87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:55.311491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed61e91-4eef-4d7b-9677-fd9d1ea8ae87 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:55.311771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed61e91-4eef-4d7b-9677-fd9d1ea8ae87 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:55.312187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed61e91-4eef-4d7b-9677-fd9d1ea8ae87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:55.319851 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed61e91-4eef-4d7b-9677-fd9d1ea8ae87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:55.321466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed61e91-4eef-4d7b-9677-fd9d1ea8ae87 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:55.332813 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-fed61e91-4eef-4d7b-9677-fd9d1ea8ae87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:38:55.332813 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:55.332813 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:55.332813 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:55.332813 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:55.332813 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:55.332813 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:55.332813 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:55.332813 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:55.332813 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:55.332813 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:55.332813 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:55.332813 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:38:55.332813 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:38:55.332813 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:38:55.333982 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:38:55.333982 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:55.333982 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:55.333982 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:55.333982 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:55.333982 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:55.333982 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:55.333982 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:55.333982 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:55.333982 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:55.333982 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:55.333982 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:55.333982 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:55.333982 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:55.333982 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:55.333982 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:55.333982 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:55.335206 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:38:55.335206 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:38:55.335206 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:38:55.335206 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:38:55.335206 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:38:55.335206 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:38:55.335206 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:38:55.335206 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:55.341596 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 295/596] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:38:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:55.341596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed61e91-4eef-4d7b-9677-fd9d1ea8ae87 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:55.356568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279b0de-c565-49a0-aaf5-c676ebbac360 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:55.394141 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc0793-2670-4f3a-b5cf-9c7302813f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:55.394661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc0793-2670-4f3a-b5cf-9c7302813f3a None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:55.394936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc0793-2670-4f3a-b5cf-9c7302813f3a None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:55.395204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc0793-2670-4f3a-b5cf-9c7302813f3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:55.407514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc0793-2670-4f3a-b5cf-9c7302813f3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:55.409095 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc0793-2670-4f3a-b5cf-9c7302813f3a None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:55.424754 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-84bc0793-2670-4f3a-b5cf-9c7302813f3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:55.424754 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:55.424754 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:55.424754 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:55.424754 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:55.424754 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:55.424754 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:55.424754 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:55.424754 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:55.424754 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:55.424754 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:55.424754 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:55.424754 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:55.424754 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:55.424754 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:55.424754 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:55.425787 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:55.425787 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:55.425787 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:55.425787 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:55.425787 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:55.425787 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:55.425787 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:55.425787 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:55.425787 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:55.425787 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:55.425787 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:55.425787 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:55.425787 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:55.425787 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:55.425787 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:55.425787 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:55.425787 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:55.426726 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:55.426726 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:55.426726 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:55.426726 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 302/597] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:55.427610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2719233-0e5c-4180-ac99-76946b0f8b32 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:55.427610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2719233-0e5c-4180-ac99-76946b0f8b32 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:55.427948 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2719233-0e5c-4180-ac99-76946b0f8b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:55.445572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-e2719233-0e5c-4180-ac99-76946b0f8b32 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:55.447380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e2719233-0e5c-4180-ac99-76946b0f8b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:55.458375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed61e91-4eef-4d7b-9677-fd9d1ea8ae87 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:55.496774 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d27680-122e-4edd-85e8-926994890a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:55.497440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d27680-122e-4edd-85e8-926994890a13 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:55.497679 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d27680-122e-4edd-85e8-926994890a13 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:55.497950 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d27680-122e-4edd-85e8-926994890a13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:55.505655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:55.511303 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d27680-122e-4edd-85e8-926994890a13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:55.513369 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d27680-122e-4edd-85e8-926994890a13 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:55.522610 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 303/598] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:55.522610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2719233-0e5c-4180-ac99-76946b0f8b32 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:55.535686 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-88d27680-122e-4edd-85e8-926994890a13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:55.535686 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:55.535686 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:55.535686 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:55.535686 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:55.535686 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:55.535686 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:55.535686 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:55.535686 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:55.535686 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:55.535686 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:55.535686 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:55.535686 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:55.535686 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:55.535686 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:55.535686 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:55.536820 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:55.536820 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:55.536820 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:55.536820 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:55.536820 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:55.536820 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:55.536820 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:55.536820 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:55.536820 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:55.536820 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:55.536820 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:55.536820 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:55.536820 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:55.536820 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:55.536820 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:55.536820 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:55.536820 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:55.537844 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:55.537844 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:55.537844 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:55.542473 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 296/599] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:55.543632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d27680-122e-4edd-85e8-926994890a13 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:55.568985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:55.645158 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2719233-0e5c-4180-ac99-76946b0f8b32 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:55.651834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d27680-122e-4edd-85e8-926994890a13 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:55.686701 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc9256-c2d8-47b2-a76a-870699cd330d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:55.687407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc9256-c2d8-47b2-a76a-870699cd330d None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:55.687687 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc9256-c2d8-47b2-a76a-870699cd330d None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:55.688083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc9256-c2d8-47b2-a76a-870699cd330d None admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:55.688771 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc9256-c2d8-47b2-a76a-870699cd330d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:55.689079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc9256-c2d8-47b2-a76a-870699cd330d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:55.690633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc9256-c2d8-47b2-a76a-870699cd330d None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:55.695895 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b271f-806d-4a7f-8d48-8f2c050637d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:55.696610 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b271f-806d-4a7f-8d48-8f2c050637d8 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:55.696947 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b271f-806d-4a7f-8d48-8f2c050637d8 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:55.697279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b271f-806d-4a7f-8d48-8f2c050637d8 None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:55.697985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b271f-806d-4a7f-8d48-8f2c050637d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:55.698290 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b271f-806d-4a7f-8d48-8f2c050637d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:55.699684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b271f-806d-4a7f-8d48-8f2c050637d8 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:55.703384 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 304/600] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Aug 6 20:38:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:55.704349 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc9256-c2d8-47b2-a76a-870699cd330d None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:55.713312 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 297/601] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:55.714127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b271f-806d-4a7f-8d48-8f2c050637d8 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:55.774775 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:55.804011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:55.814044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc9256-c2d8-47b2-a76a-870699cd330d None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:55.828380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b271f-806d-4a7f-8d48-8f2c050637d8 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:55.848401 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aade5e5-edfb-47ee-acfb-1098bc1095bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:55.848999 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aade5e5-edfb-47ee-acfb-1098bc1095bc None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:55.849274 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aade5e5-edfb-47ee-acfb-1098bc1095bc None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:55.849542 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aade5e5-edfb-47ee-acfb-1098bc1095bc None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:55.850183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aade5e5-edfb-47ee-acfb-1098bc1095bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:55.850469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aade5e5-edfb-47ee-acfb-1098bc1095bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:55.851915 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aade5e5-edfb-47ee-acfb-1098bc1095bc None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:55.863789 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 305/602] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:55.864714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c330a9-8ea7-4dd1-8437-09299bfd884f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:55.865334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c330a9-8ea7-4dd1-8437-09299bfd884f None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:55.865613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c330a9-8ea7-4dd1-8437-09299bfd884f None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:55.865880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c330a9-8ea7-4dd1-8437-09299bfd884f None admin] PATH_INFO: `/v3/roles/service` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:55.867404 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aade5e5-edfb-47ee-acfb-1098bc1095bc None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:55.877808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c330a9-8ea7-4dd1-8437-09299bfd884f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:55.882487 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-72c330a9-8ea7-4dd1-8437-09299bfd884f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:38:55.882487 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:55.882487 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:55.882487 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:55.882487 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:55.882487 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:55.882487 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:55.882487 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:55.882487 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:55.882487 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:55.882487 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:55.882487 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:55.882487 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:55.882487 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:55.882487 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:55.882487 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:55.883517 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:55.883517 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:55.883517 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:55.883517 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:55.883517 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:55.883517 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:55.883517 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:55.883517 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:55.883517 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:55.883517 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:55.883517 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:55.883517 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:55.883517 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:55.883517 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:55.883517 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:55.883517 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:55.884368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:55.884368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:55.884368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:55.884368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:55.884368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:55.884368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:55.884368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:55.884368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:55.884368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:55.884368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:55.884368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:38:55.884368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:55.884368 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 298/603] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Aug 6 20:38:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:55.885103 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c330a9-8ea7-4dd1-8437-09299bfd884f None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:55.975376 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aade5e5-edfb-47ee-acfb-1098bc1095bc None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:55.991357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c330a9-8ea7-4dd1-8437-09299bfd884f None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:56.002567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:56.012782 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b7a71-9d51-4fe7-b9a6-f00c5d88b637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:56.013449 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b7a71-9d51-4fe7-b9a6-f00c5d88b637 None admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:56.013726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b7a71-9d51-4fe7-b9a6-f00c5d88b637 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:56.014001 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b7a71-9d51-4fe7-b9a6-f00c5d88b637 None admin] PATH_INFO: `/v3/projects/6c4962342201407a89793c5c9a6a6f36/users/1e10759b2abd4cafacf338551327775e/roles/55fe0e239bac413b90c785211607e1a4` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:56.028975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51a255-37d7-42f5-bb1a-f7c4804bdd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:56.029712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51a255-37d7-42f5-bb1a-f7c4804bdd5d None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:56.030049 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51a255-37d7-42f5-bb1a-f7c4804bdd5d None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:56.030381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51a255-37d7-42f5-bb1a-f7c4804bdd5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:56.030520 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b7a71-9d51-4fe7-b9a6-f00c5d88b637 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c4962342201407a89793c5c9a6a6f36, user_id=1e10759b2abd4cafacf338551327775e, role_id=55fe0e239bac413b90c785211607e1a4)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:56.032075 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b7a71-9d51-4fe7-b9a6-f00c5d88b637 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:56.037578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a51a255-37d7-42f5-bb1a-f7c4804bdd5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:56.039256 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a51a255-37d7-42f5-bb1a-f7c4804bdd5d None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:56.054103 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 306/604] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Aug 6 20:38:55 2022] PUT /identity/v3/projects/6c4962342201407a89793c5c9a6a6f36/users/1e10759b2abd4cafacf338551327775e/roles/55fe0e239bac413b90c785211607e1a4 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:56.054103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b7a71-9d51-4fe7-b9a6-f00c5d88b637 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:56.054421 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-5a51a255-37d7-42f5-bb1a-f7c4804bdd5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:38:56.054421 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:56.054421 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:56.054421 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:56.054421 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:56.054421 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:56.054421 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:56.054421 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:56.054421 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:56.054421 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:56.054421 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:56.054421 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:56.054421 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:38:56.054421 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:38:56.054421 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:38:56.055998 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:38:56.055998 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:56.055998 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:56.055998 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:56.055998 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:56.055998 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:56.055998 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:56.055998 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:56.055998 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:56.055998 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:56.055998 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:56.055998 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:56.055998 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:56.055998 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:56.055998 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:56.055998 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:56.055998 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:56.056901 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:38:56.056901 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:38:56.056901 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:38:56.056901 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:38:56.056901 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:38:56.056901 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:38:56.056901 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:38:56.056901 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:56.061295 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 299/605] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:38:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:56.062443 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:56.062603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51a255-37d7-42f5-bb1a-f7c4804bdd5d None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:56.186591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51a255-37d7-42f5-bb1a-f7c4804bdd5d None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:56.215407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b7a71-9d51-4fe7-b9a6-f00c5d88b637 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:56.222334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a781f7d-f837-4953-a17d-d9dfd0897366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:56.223086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a781f7d-f837-4953-a17d-d9dfd0897366 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:56.223425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a781f7d-f837-4953-a17d-d9dfd0897366 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:56.223768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a781f7d-f837-4953-a17d-d9dfd0897366 None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:56.224523 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a781f7d-f837-4953-a17d-d9dfd0897366 None admin] RBAC: Adding query filter params (name=service) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:56.224908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a781f7d-f837-4953-a17d-d9dfd0897366 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:56.226448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a781f7d-f837-4953-a17d-d9dfd0897366 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:56.241270 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 300/606] 10.222.0.33 () {56 vars in 1103 bytes} [Sat Aug 6 20:38:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:56.242329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a781f7d-f837-4953-a17d-d9dfd0897366 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:56.259963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a48adc4-f666-486a-90d8-83316ede5456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:56.260927 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48adc4-f666-486a-90d8-83316ede5456 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:56.261354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48adc4-f666-486a-90d8-83316ede5456 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:56.261776 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48adc4-f666-486a-90d8-83316ede5456 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:56.269402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a48adc4-f666-486a-90d8-83316ede5456 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:56.270931 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a48adc4-f666-486a-90d8-83316ede5456 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:56.276694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:56.284677 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-3a48adc4-f666-486a-90d8-83316ede5456 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:38:56.284677 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:56.284677 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:56.284677 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:56.284677 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:56.284677 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:56.284677 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:56.284677 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:56.284677 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:56.284677 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:56.284677 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:56.284677 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:56.284677 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:38:56.284677 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:38:56.284677 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:38:56.285643 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:38:56.285643 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:56.285643 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:56.285643 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:56.285643 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:56.285643 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:56.285643 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:56.285643 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:56.285643 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:56.285643 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:56.285643 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:56.285643 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:56.285643 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:56.285643 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:56.285643 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:56.285643 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:56.285643 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:56.286594 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:38:56.286594 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:38:56.286594 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:38:56.286594 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:38:56.286594 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:38:56.286594 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:38:56.286594 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:38:56.286594 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:56.286594 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 307/607] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:38:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:56.286594 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a48adc4-f666-486a-90d8-83316ede5456 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:56.361082 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:56.373178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a781f7d-f837-4953-a17d-d9dfd0897366 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:56.404380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a48adc4-f666-486a-90d8-83316ede5456 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:56.415400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a35c7-94c3-4cd1-af81-86c087d23be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:56.416315 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a35c7-94c3-4cd1-af81-86c087d23be6 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:56.416863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a35c7-94c3-4cd1-af81-86c087d23be6 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:56.417137 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a35c7-94c3-4cd1-af81-86c087d23be6 None admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:56.417820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a35c7-94c3-4cd1-af81-86c087d23be6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:56.418122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a35c7-94c3-4cd1-af81-86c087d23be6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:56.420152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a35c7-94c3-4cd1-af81-86c087d23be6 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:56.438636 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 301/608] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Aug 6 20:38:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:56.439580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a35c7-94c3-4cd1-af81-86c087d23be6 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:56.447243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b5581-6eb4-4e84-8b1f-8696729b517e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:56.447922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b5581-6eb4-4e84-8b1f-8696729b517e None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:56.448199 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b5581-6eb4-4e84-8b1f-8696729b517e None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:56.448470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b5581-6eb4-4e84-8b1f-8696729b517e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:56.468312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b5581-6eb4-4e84-8b1f-8696729b517e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:56.470566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b5581-6eb4-4e84-8b1f-8696729b517e None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:56.489377 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-a41b5581-6eb4-4e84-8b1f-8696729b517e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:56.489377 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:56.489377 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:56.489377 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:56.489377 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:56.489377 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:56.489377 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:56.489377 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:56.489377 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:56.489377 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:56.489377 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:56.489377 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:56.489377 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:56.489377 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:56.489377 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:56.489377 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:56.490333 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:56.490333 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:56.490333 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:56.490333 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:56.490333 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:56.490333 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:56.490333 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:56.490333 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:56.490333 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:56.490333 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:56.490333 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:56.490333 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:56.490333 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:56.490333 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:56.490333 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:56.490333 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:56.490333 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:56.491259 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:56.491259 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:56.491259 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:56.497470 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 308/609] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:56.497470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b5581-6eb4-4e84-8b1f-8696729b517e None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:56.558139 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:56.569964 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a35c7-94c3-4cd1-af81-86c087d23be6 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:56.612681 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a984ae-6436-467d-aa91-6183e995257f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:56.613317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b5581-6eb4-4e84-8b1f-8696729b517e None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:56.613521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a984ae-6436-467d-aa91-6183e995257f None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:56.613894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a984ae-6436-467d-aa91-6183e995257f None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:56.614260 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a984ae-6436-467d-aa91-6183e995257f None admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:56.615121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a984ae-6436-467d-aa91-6183e995257f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:56.615524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a984ae-6436-467d-aa91-6183e995257f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:56.618631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a984ae-6436-467d-aa91-6183e995257f None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:56.630156 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:56.638596 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 302/610] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Aug 6 20:38:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:56.639958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a984ae-6436-467d-aa91-6183e995257f None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:56.659554 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c6ce3-4c91-4323-970f-4b9d14c6bb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:56.660519 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c6ce3-4c91-4323-970f-4b9d14c6bb2b None admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:56.660960 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c6ce3-4c91-4323-970f-4b9d14c6bb2b None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:56.661445 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c6ce3-4c91-4323-970f-4b9d14c6bb2b None admin] PATH_INFO: `/v3/projects/6c4962342201407a89793c5c9a6a6f36/users/60cf8ac27ec04117937e87749d69fe3f/roles/55fe0e239bac413b90c785211607e1a4` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:56.687505 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c6ce3-4c91-4323-970f-4b9d14c6bb2b None admin] RBAC: Authorizing `identity:create_grant(project_id=6c4962342201407a89793c5c9a6a6f36, user_id=60cf8ac27ec04117937e87749d69fe3f, role_id=55fe0e239bac413b90c785211607e1a4)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:56.689524 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c6ce3-4c91-4323-970f-4b9d14c6bb2b None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:56.709088 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 309/611] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Aug 6 20:38:56 2022] PUT /identity/v3/projects/6c4962342201407a89793c5c9a6a6f36/users/60cf8ac27ec04117937e87749d69fe3f/roles/55fe0e239bac413b90c785211607e1a4 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:56.710400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c6ce3-4c91-4323-970f-4b9d14c6bb2b None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:56.787629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a984ae-6436-467d-aa91-6183e995257f None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:56.828234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd021eb9-31dd-41d3-8e75-015ce1419786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:56.828845 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd021eb9-31dd-41d3-8e75-015ce1419786 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:56.829119 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd021eb9-31dd-41d3-8e75-015ce1419786 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:56.829385 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd021eb9-31dd-41d3-8e75-015ce1419786 None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:56.830026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd021eb9-31dd-41d3-8e75-015ce1419786 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:56.830326 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd021eb9-31dd-41d3-8e75-015ce1419786 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:56.831727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd021eb9-31dd-41d3-8e75-015ce1419786 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:56.836453 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c6ce3-4c91-4323-970f-4b9d14c6bb2b None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:56.844301 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 303/612] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:56.850097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd021eb9-31dd-41d3-8e75-015ce1419786 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:56.866471 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:56.883171 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4d702-cb64-41da-b903-765b02163740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:56.884483 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4d702-cb64-41da-b903-765b02163740 None admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:56.885015 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4d702-cb64-41da-b903-765b02163740 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:56.885503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4d702-cb64-41da-b903-765b02163740 None admin] PATH_INFO: `/v3/projects/6c4962342201407a89793c5c9a6a6f36/users/174e91100a184740b7c604730266dc7c/roles/55fe0e239bac413b90c785211607e1a4` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:56.904955 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4d702-cb64-41da-b903-765b02163740 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c4962342201407a89793c5c9a6a6f36, user_id=174e91100a184740b7c604730266dc7c, role_id=55fe0e239bac413b90c785211607e1a4)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:56.906935 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4d702-cb64-41da-b903-765b02163740 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:56.937133 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 310/613] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Aug 6 20:38:56 2022] PUT /identity/v3/projects/6c4962342201407a89793c5c9a6a6f36/users/174e91100a184740b7c604730266dc7c/roles/55fe0e239bac413b90c785211607e1a4 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:56.970070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd021eb9-31dd-41d3-8e75-015ce1419786 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:57.014384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02e27c-b5da-41a3-88af-900b52082567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:57.015055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02e27c-b5da-41a3-88af-900b52082567 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:57.015329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02e27c-b5da-41a3-88af-900b52082567 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:57.015643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02e27c-b5da-41a3-88af-900b52082567 None admin] PATH_INFO: `/v3/users/swift` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:57.027315 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb02e27c-b5da-41a3-88af-900b52082567 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:57.028778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb02e27c-b5da-41a3-88af-900b52082567 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:57.043899 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-bb02e27c-b5da-41a3-88af-900b52082567 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 06 20:38:57.043899 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:57.043899 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:57.043899 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:57.043899 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:57.043899 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:57.043899 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:57.043899 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:57.043899 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:57.043899 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:57.043899 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:57.043899 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:57.043899 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:38:57.043899 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:38:57.043899 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:38:57.043899 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:38:57.044906 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:57.044906 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:57.044906 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:38:57.044906 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:38:57.044906 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:38:57.044906 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:38:57.044906 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:57.044906 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:57.044906 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:57.044906 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:57.044906 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:57.044906 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:57.044906 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:57.044906 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:57.044906 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:57.044906 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:57.044906 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:57.044906 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:57.045909 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:57.045909 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:57.045909 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:38:57.045909 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:38:57.045909 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:38:57.045909 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:38:57.045909 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:38:57.045909 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:38:57.045909 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 06 20:38:57.045909 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:57.045909 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 304/614] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Aug 6 20:38:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:38:57.051159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4d702-cb64-41da-b903-765b02163740 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:57.072729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:57.181859 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4d702-cb64-41da-b903-765b02163740 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:57.242942 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13275081-c3ec-402e-a18a-4c8e9b6899d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:57.244137 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13275081-c3ec-402e-a18a-4c8e9b6899d5 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:57.244648 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13275081-c3ec-402e-a18a-4c8e9b6899d5 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:57.245129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13275081-c3ec-402e-a18a-4c8e9b6899d5 None admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:57.246059 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13275081-c3ec-402e-a18a-4c8e9b6899d5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:57.246594 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13275081-c3ec-402e-a18a-4c8e9b6899d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:57.248293 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13275081-c3ec-402e-a18a-4c8e9b6899d5 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:57.271481 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 311/615] 10.222.0.33 () {56 vars in 1135 bytes} [Sat Aug 6 20:38:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:57.276696 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02e27c-b5da-41a3-88af-900b52082567 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:57.316856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a649f9-b093-40a1-894c-de962bf8b693 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:57.317050 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a649f9-b093-40a1-894c-de962bf8b693 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:57.317320 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a649f9-b093-40a1-894c-de962bf8b693 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:57.319978 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 312/616] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:57.325028 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16adc0e-582f-4dc2-a1a5-a9a1c16f47f5 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:57.325315 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16adc0e-582f-4dc2-a1a5-a9a1c16f47f5 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:57.325581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16adc0e-582f-4dc2-a1a5-a9a1c16f47f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:57.344966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-b16adc0e-582f-4dc2-a1a5-a9a1c16f47f5 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:57.346191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b16adc0e-582f-4dc2-a1a5-a9a1c16f47f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:57.397044 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:57.461862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02e27c-b5da-41a3-88af-900b52082567 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:57.477540 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 313/617] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:38:57.514609 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87d081-74df-4ae5-905b-5393df480c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:57.515247 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87d081-74df-4ae5-905b-5393df480c3e None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:57.515527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87d081-74df-4ae5-905b-5393df480c3e None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:57.515802 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87d081-74df-4ae5-905b-5393df480c3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:57.534107 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87d081-74df-4ae5-905b-5393df480c3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:57.535674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87d081-74df-4ae5-905b-5393df480c3e None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:57.552555 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-df87d081-74df-4ae5-905b-5393df480c3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:57.552555 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:57.552555 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:57.552555 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:57.552555 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:57.552555 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:57.552555 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:57.552555 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:57.552555 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:57.552555 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:57.552555 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:57.552555 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:57.552555 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:57.552555 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:57.552555 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:57.552555 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:57.553532 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:57.553532 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:57.553532 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:57.553532 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:57.553532 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:57.553532 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:57.553532 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:57.553532 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:57.553532 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:57.553532 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:57.553532 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:57.553532 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:57.553532 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:57.553532 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:57.553532 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:57.553532 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:57.553532 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:57.555487 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:57.555487 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:57.555487 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:57.556736 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 305/618] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:57.558404 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16adc0e-582f-4dc2-a1a5-a9a1c16f47f5 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:57.560670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:57.571322 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87d081-74df-4ae5-905b-5393df480c3e None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:57.749016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16adc0e-582f-4dc2-a1a5-a9a1c16f47f5 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:57.790952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87d081-74df-4ae5-905b-5393df480c3e None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:57.793390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c25d6-4bba-4dc7-8a39-01546e1a58ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:57.794031 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c25d6-4bba-4dc7-8a39-01546e1a58ba None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:57.794314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c25d6-4bba-4dc7-8a39-01546e1a58ba None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:57.794623 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c25d6-4bba-4dc7-8a39-01546e1a58ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:57.809166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c25d6-4bba-4dc7-8a39-01546e1a58ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:57.815023 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-d57c25d6-4bba-4dc7-8a39-01546e1a58ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:38:57.815023 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:57.815023 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:57.815023 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:57.815023 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:57.815023 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:57.815023 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:57.815023 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:57.815023 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:57.815023 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:57.815023 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:57.815023 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:57.815023 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:57.815023 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:57.815023 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:57.815023 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:57.816088 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:57.816088 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:57.816088 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:57.816088 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:57.816088 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:57.816088 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:57.816088 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:57.816088 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:57.816088 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:57.816088 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:57.816088 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:57.816088 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:57.816088 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:57.816088 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:57.816088 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:57.816088 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:57.816944 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:57.816944 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:57.816944 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:57.816944 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:57.816944 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:57.816944 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:57.816944 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:57.816944 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:57.816944 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:57.816944 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:57.816944 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:38:57.816944 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:57.816944 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 314/619] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Aug 6 20:38:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:57.825602 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c25d6-4bba-4dc7-8a39-01546e1a58ba None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:57.835156 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:57.847910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98afc0d6-4d09-4f5f-850b-b31f36e6e529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:57.848518 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98afc0d6-4d09-4f5f-850b-b31f36e6e529 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:57.848799 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98afc0d6-4d09-4f5f-850b-b31f36e6e529 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:57.849075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98afc0d6-4d09-4f5f-850b-b31f36e6e529 None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:57.849720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98afc0d6-4d09-4f5f-850b-b31f36e6e529 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:57.850022 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98afc0d6-4d09-4f5f-850b-b31f36e6e529 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:57.851532 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98afc0d6-4d09-4f5f-850b-b31f36e6e529 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:57.864944 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 306/620] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:57.871077 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98afc0d6-4d09-4f5f-850b-b31f36e6e529 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:57.952382 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:58.010748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98afc0d6-4d09-4f5f-850b-b31f36e6e529 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:58.021618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c25d6-4bba-4dc7-8a39-01546e1a58ba None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:58.047857 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb42670-12b5-432e-8b16-e34c829b7435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:58.048487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb42670-12b5-432e-8b16-e34c829b7435 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:58.048772 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb42670-12b5-432e-8b16-e34c829b7435 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:58.049049 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb42670-12b5-432e-8b16-e34c829b7435 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:58.062314 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb42670-12b5-432e-8b16-e34c829b7435 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:58.064708 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb42670-12b5-432e-8b16-e34c829b7435 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:58.087499 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-0bb42670-12b5-432e-8b16-e34c829b7435 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:38:58.087499 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:58.087499 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:58.087499 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:58.087499 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:58.087499 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:58.087499 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:58.087499 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:58.087499 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:58.087499 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:58.087499 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:58.087499 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:58.087499 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:38:58.087499 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:38:58.087499 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:38:58.088452 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:38:58.088452 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:58.088452 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:58.088452 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:58.088452 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:58.088452 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:58.088452 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:58.088452 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:58.088452 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:58.088452 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:58.088452 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:58.088452 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:58.088452 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:58.088452 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:58.088452 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:58.088452 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:58.088452 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:58.089339 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:38:58.089339 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:38:58.089339 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:38:58.089339 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:38:58.089339 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:38:58.089339 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:38:58.089339 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:38:58.089339 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:58.089339 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 307/621] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:38:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:38:58.094701 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb42670-12b5-432e-8b16-e34c829b7435 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:58.096482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0fac2-a11f-483d-8650-10960b88a116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:58.097093 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0fac2-a11f-483d-8650-10960b88a116 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:58.097373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0fac2-a11f-483d-8650-10960b88a116 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:58.097645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0fac2-a11f-483d-8650-10960b88a116 None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:58.098315 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0fac2-a11f-483d-8650-10960b88a116 None admin] RBAC: Adding query filter params (name=service) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:58.098643 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0fac2-a11f-483d-8650-10960b88a116 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:58.100020 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0fac2-a11f-483d-8650-10960b88a116 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:58.126681 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 315/622] 10.222.0.33 () {56 vars in 1103 bytes} [Sat Aug 6 20:38:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:58.143539 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0fac2-a11f-483d-8650-10960b88a116 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:58.181956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:58.249111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb42670-12b5-432e-8b16-e34c829b7435 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:58.285589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0fac2-a11f-483d-8650-10960b88a116 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:58.285827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3493e63-4055-4f62-b435-e6de49e7f24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:58.286212 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3493e63-4055-4f62-b435-e6de49e7f24d None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:58.286493 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3493e63-4055-4f62-b435-e6de49e7f24d None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:58.286800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3493e63-4055-4f62-b435-e6de49e7f24d None admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:58.287595 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3493e63-4055-4f62-b435-e6de49e7f24d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:58.288051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3493e63-4055-4f62-b435-e6de49e7f24d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:58.289681 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3493e63-4055-4f62-b435-e6de49e7f24d None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:58.302466 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 308/623] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Aug 6 20:38:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:58.309461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3493e63-4055-4f62-b435-e6de49e7f24d None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:58.326785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:58.369566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1fced5-74df-4687-bcf6-5393778dd1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:58.370144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1fced5-74df-4687-bcf6-5393778dd1c4 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:58.370429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1fced5-74df-4687-bcf6-5393778dd1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:58.370794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1fced5-74df-4687-bcf6-5393778dd1c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:58.407519 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1fced5-74df-4687-bcf6-5393778dd1c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:58.409264 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1fced5-74df-4687-bcf6-5393778dd1c4 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:58.426862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3493e63-4055-4f62-b435-e6de49e7f24d None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:58.451047 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:58.451717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-9f1fced5-74df-4687-bcf6-5393778dd1c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:58.451717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:58.451717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:58.451717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:58.451717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:58.451717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:58.451717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:58.451717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:58.451717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:58.451717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:58.451717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:58.451717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:58.451717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:58.451717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:58.451717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:58.451717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:58.452862 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:58.452862 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:58.452862 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:58.452862 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:58.452862 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:58.452862 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:58.452862 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:58.452862 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:58.452862 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:58.452862 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:58.452862 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:58.452862 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:58.452862 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:58.452862 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:58.452862 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:58.452862 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:58.452862 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:58.455393 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:58.455393 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:58.455393 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:58.455393 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 316/624] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:58.470797 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3635d30-99c3-4180-9509-9d7e9f3e05b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:58.471466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3635d30-99c3-4180-9509-9d7e9f3e05b8 None admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:58.471645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1fced5-74df-4687-bcf6-5393778dd1c4 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:58.471801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3635d30-99c3-4180-9509-9d7e9f3e05b8 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:58.472065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3635d30-99c3-4180-9509-9d7e9f3e05b8 None admin] PATH_INFO: `/v3/projects/6c4962342201407a89793c5c9a6a6f36/users/cd3e0e177f934f7ba5abe52ac8bf8bbb/roles/55fe0e239bac413b90c785211607e1a4` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:58.488193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3635d30-99c3-4180-9509-9d7e9f3e05b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c4962342201407a89793c5c9a6a6f36, user_id=cd3e0e177f934f7ba5abe52ac8bf8bbb, role_id=55fe0e239bac413b90c785211607e1a4)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:58.489726 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3635d30-99c3-4180-9509-9d7e9f3e05b8 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:58.515526 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 309/625] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Aug 6 20:38:58 2022] PUT /identity/v3/projects/6c4962342201407a89793c5c9a6a6f36/users/cd3e0e177f934f7ba5abe52ac8bf8bbb/roles/55fe0e239bac413b90c785211607e1a4 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:38:58.570020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0440f3e-d516-422a-8f8e-404c4eaf249a None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:58.570346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0440f3e-d516-422a-8f8e-404c4eaf249a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:58.570733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0440f3e-d516-422a-8f8e-404c4eaf249a None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:58.573670 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 310/626] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:58.578374 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9accb-7d90-47c5-8af6-60b258fb8460 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:58.578703 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9accb-7d90-47c5-8af6-60b258fb8460 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:58.578986 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9accb-7d90-47c5-8af6-60b258fb8460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:58.604662 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-43b9accb-7d90-47c5-8af6-60b258fb8460 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:58.606034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-43b9accb-7d90-47c5-8af6-60b258fb8460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:58.640491 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1fced5-74df-4687-bcf6-5393778dd1c4 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:58.691381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d9d73-cacb-4815-9bbb-bc8ee6defc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:58.692118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d9d73-cacb-4815-9bbb-bc8ee6defc0c None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:58.692402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d9d73-cacb-4815-9bbb-bc8ee6defc0c None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:58.692678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d9d73-cacb-4815-9bbb-bc8ee6defc0c None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:58.693348 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d9d73-cacb-4815-9bbb-bc8ee6defc0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:58.693655 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d9d73-cacb-4815-9bbb-bc8ee6defc0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:58.695186 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d9d73-cacb-4815-9bbb-bc8ee6defc0c None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:58.708930 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 311/627] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:38:58.723861 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 317/628] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:58.729850 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9accb-7d90-47c5-8af6-60b258fb8460 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:58.744755 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d9d73-cacb-4815-9bbb-bc8ee6defc0c None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:58.785098 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:58.832250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:58.851778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9accb-7d90-47c5-8af6-60b258fb8460 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:58.860920 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d9d73-cacb-4815-9bbb-bc8ee6defc0c None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:58.891194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260c26e-b303-491c-b904-96781dc5f7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:58.891960 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260c26e-b303-491c-b904-96781dc5f7a5 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:58.892175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260c26e-b303-491c-b904-96781dc5f7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:58.892452 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260c26e-b303-491c-b904-96781dc5f7a5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:58.900601 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a146c0-d3be-4a51-af5e-b4c3c13b7efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:58.900790 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260c26e-b303-491c-b904-96781dc5f7a5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:58.901562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a146c0-d3be-4a51-af5e-b4c3c13b7efe None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:58.902010 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a146c0-d3be-4a51-af5e-b4c3c13b7efe None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:58.902258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260c26e-b303-491c-b904-96781dc5f7a5 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:58.902611 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a146c0-d3be-4a51-af5e-b4c3c13b7efe None admin] PATH_INFO: `/v3/roles/service` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:58.913808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a146c0-d3be-4a51-af5e-b4c3c13b7efe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:38:58.916088 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-a260c26e-b303-491c-b904-96781dc5f7a5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:38:58.916088 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:58.916088 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:58.916088 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:58.916088 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:58.916088 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:58.916088 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:58.916088 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:58.916088 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:58.916088 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:58.916088 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:58.916088 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:58.916088 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:38:58.916088 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:38:58.916088 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:38:58.916088 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:38:58.917313 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:58.917313 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:58.917313 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:38:58.917313 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:38:58.917313 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:38:58.917313 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:38:58.917313 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:58.917313 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:58.917313 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:58.917313 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:58.917313 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:58.917313 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:58.917313 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:58.917313 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:58.917313 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:58.917313 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:58.917313 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:58.917313 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:58.918512 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:58.918512 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:58.918512 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:38:58.918512 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:38:58.918512 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:38:58.918512 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:38:58.918512 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:38:58.918512 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:38:58.918512 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:38:58.918512 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:58.919800 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 312/629] 10.222.0.33 () {56 vars in 1093 bytes} [Sat Aug 6 20:38:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:58.922517 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-a0a146c0-d3be-4a51-af5e-b4c3c13b7efe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:38:58.922517 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:58.922517 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:58.922517 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:58.922517 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:58.922517 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:58.922517 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:58.922517 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:58.922517 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:58.922517 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:58.922517 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:58.922517 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:58.922517 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:38:58.922517 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:38:58.922517 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:38:58.922517 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:38:58.923687 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:38:58.923687 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:38:58.923687 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:38:58.923687 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:38:58.923687 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:58.923687 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:58.923687 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:58.923687 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:58.923687 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:58.923687 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:58.923687 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:58.923687 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:58.923687 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:58.923687 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:58.923687 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:58.923687 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:58.924543 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:58.924543 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:58.924543 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:58.924543 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:58.924543 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:38:58.924543 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:38:58.924543 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:38:58.924543 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:38:58.924543 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:38:58.924543 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:38:58.924543 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:38:58.924543 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:58.928316 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260c26e-b303-491c-b904-96781dc5f7a5 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:58.928929 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 318/630] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Aug 6 20:38:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:38:58.935628 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a146c0-d3be-4a51-af5e-b4c3c13b7efe None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:59.094079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:59.103128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a146c0-d3be-4a51-af5e-b4c3c13b7efe None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:59.108149 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260c26e-b303-491c-b904-96781dc5f7a5 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:59.173217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d4251-c0e6-4b20-ae03-cd34ddcbe6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:59.173754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d4251-c0e6-4b20-ae03-cd34ddcbe6d9 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:59.174036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d4251-c0e6-4b20-ae03-cd34ddcbe6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:59.174312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d4251-c0e6-4b20-ae03-cd34ddcbe6d9 None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:59.175025 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d4251-c0e6-4b20-ae03-cd34ddcbe6d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:59.175334 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d4251-c0e6-4b20-ae03-cd34ddcbe6d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:59.176705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d4251-c0e6-4b20-ae03-cd34ddcbe6d9 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:59.181257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fdde1-c1d8-4603-9dfb-0bd7f067958f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:59.181865 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fdde1-c1d8-4603-9dfb-0bd7f067958f None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:59.182145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fdde1-c1d8-4603-9dfb-0bd7f067958f None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:59.182420 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fdde1-c1d8-4603-9dfb-0bd7f067958f None admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:59.183479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6fdde1-c1d8-4603-9dfb-0bd7f067958f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:59.183788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6fdde1-c1d8-4603-9dfb-0bd7f067958f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:59.185204 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6fdde1-c1d8-4603-9dfb-0bd7f067958f None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:59.203051 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 319/631] 10.222.0.33 () {56 vars in 1103 bytes} [Sat Aug 6 20:38:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:59.205659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d4251-c0e6-4b20-ae03-cd34ddcbe6d9 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:59.240891 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 313/632] 10.222.0.33 () {56 vars in 1133 bytes} [Sat Aug 6 20:38:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:59.250191 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fdde1-c1d8-4603-9dfb-0bd7f067958f None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:59.259835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:59.385102 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fdde1-c1d8-4603-9dfb-0bd7f067958f None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:59.392689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d4251-c0e6-4b20-ae03-cd34ddcbe6d9 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:59.419573 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6887cda-3b33-446b-bb77-6aa4f1c24487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:59.420180 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6887cda-3b33-446b-bb77-6aa4f1c24487 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:59.420454 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6887cda-3b33-446b-bb77-6aa4f1c24487 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:59.420723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6887cda-3b33-446b-bb77-6aa4f1c24487 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:59.476607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c44dee-c4a8-481e-ba59-c4c09bc62de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:59.477504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c44dee-c4a8-481e-ba59-c4c09bc62de9 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:59.477720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c44dee-c4a8-481e-ba59-c4c09bc62de9 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:59.477997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c44dee-c4a8-481e-ba59-c4c09bc62de9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:59.488618 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6887cda-3b33-446b-bb77-6aa4f1c24487 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:59.490068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6887cda-3b33-446b-bb77-6aa4f1c24487 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:59.492064 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:59.515769 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c44dee-c4a8-481e-ba59-c4c09bc62de9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:59.517277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c44dee-c4a8-481e-ba59-c4c09bc62de9 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:59.551601 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-33c44dee-c4a8-481e-ba59-c4c09bc62de9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:59.551601 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:59.551601 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:59.551601 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:59.551601 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:59.551601 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:59.551601 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:59.551601 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:59.551601 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:59.551601 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:59.551601 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:59.551601 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:59.551601 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:59.551601 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:59.551601 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:59.551601 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:59.552619 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:59.552619 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:59.552619 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:59.552619 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:59.552619 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:59.552619 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:59.552619 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:59.552619 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:59.552619 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:59.552619 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:59.552619 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:59.552619 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:59.552619 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:59.552619 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:59.552619 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:59.552619 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:59.552619 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:59.553535 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:59.553535 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:59.553535 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:38:59.557086 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 320/633] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:59.559889 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c44dee-c4a8-481e-ba59-c4c09bc62de9 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:59.584467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:59.641033 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 314/634] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:38:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:59.647634 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6887cda-3b33-446b-bb77-6aa4f1c24487 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:59.746980 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c44dee-c4a8-481e-ba59-c4c09bc62de9 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:59.790999 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e213fa7-a1ef-45dd-a792-794388a58e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:59.792044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e213fa7-a1ef-45dd-a792-794388a58e40 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:59.792433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e213fa7-a1ef-45dd-a792-794388a58e40 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:59.792892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e213fa7-a1ef-45dd-a792-794388a58e40 None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:59.793537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e213fa7-a1ef-45dd-a792-794388a58e40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:59.793836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e213fa7-a1ef-45dd-a792-794388a58e40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:59.796059 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e213fa7-a1ef-45dd-a792-794388a58e40 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:59.801528 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6887cda-3b33-446b-bb77-6aa4f1c24487 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:59.803401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:59.814022 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 321/635] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:59.815379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a84821-22cc-4ab8-bfb6-8805949b0913 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:59.815659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a84821-22cc-4ab8-bfb6-8805949b0913 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:59.816546 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a84821-22cc-4ab8-bfb6-8805949b0913 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:59.819781 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 322/636] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:59.821302 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a84821-22cc-4ab8-bfb6-8805949b0913 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:59.851307 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b873fcc-1b95-4429-8f43-98efd8def117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:59.852114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b873fcc-1b95-4429-8f43-98efd8def117 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:59.852474 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b873fcc-1b95-4429-8f43-98efd8def117 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:59.852866 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b873fcc-1b95-4429-8f43-98efd8def117 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:59.863925 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b873fcc-1b95-4429-8f43-98efd8def117 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:59.865481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b873fcc-1b95-4429-8f43-98efd8def117 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:59.881837 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-9b873fcc-1b95-4429-8f43-98efd8def117 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:59.881837 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:59.881837 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:59.881837 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:59.881837 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:59.881837 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:59.881837 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:59.881837 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:59.881837 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:59.881837 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:59.881837 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:59.881837 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:59.881837 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:38:59.881837 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:38:59.881837 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:38:59.881837 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:38:59.882944 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:59.882944 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:59.882944 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:59.882944 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:59.882944 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:59.882944 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:59.882944 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:59.882944 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:59.882944 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:59.882944 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:59.882944 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:59.882944 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:59.882944 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:59.882944 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:38:59.882944 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:38:59.882944 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:38:59.882944 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:38:59.884351 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:38:59.884351 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:38:59.884351 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:38:59.884351 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 315/637] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:38:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:38:59.884997 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f9002-0334-452d-922d-7e2c467169dc None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:59.885154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f9002-0334-452d-922d-7e2c467169dc None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:59.885411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f9002-0334-452d-922d-7e2c467169dc None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:59.886777 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 316/638] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:38:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:38:59.887629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e513cf-a3ca-4cc0-be3a-596476d03812 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:59.887902 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e513cf-a3ca-4cc0-be3a-596476d03812 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:59.888165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e513cf-a3ca-4cc0-be3a-596476d03812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:59.902893 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:59.906575 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-25e513cf-a3ca-4cc0-be3a-596476d03812 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:59.907795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-25e513cf-a3ca-4cc0-be3a-596476d03812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:59.938581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a84821-22cc-4ab8-bfb6-8805949b0913 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:59.974118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e1e6f-8666-4118-bb07-edfeda9192a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:59.974767 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e1e6f-8666-4118-bb07-edfeda9192a4 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:59.975044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e1e6f-8666-4118-bb07-edfeda9192a4 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:59.975311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e1e6f-8666-4118-bb07-edfeda9192a4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:59.978127 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 317/639] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:38:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:38:59.983445 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e1e6f-8666-4118-bb07-edfeda9192a4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:59.983839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e513cf-a3ca-4cc0-be3a-596476d03812 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:59.984889 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e1e6f-8666-4118-bb07-edfeda9192a4 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:59.998991 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-2c7e1e6f-8666-4118-bb07-edfeda9192a4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 06 20:38:59.998991 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:38:59.998991 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:38:59.998991 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:38:59.998991 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:38:59.998991 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:38:59.998991 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:38:59.998991 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:38:59.998991 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:38:59.998991 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:38:59.998991 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:38:59.998991 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:38:59.998991 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:38:59.998991 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:38:59.998991 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:38:59.998991 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:38:59.999980 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:38:59.999980 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:38:59.999980 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:38:59.999980 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:38:59.999980 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:38:59.999980 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:38:59.999980 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:38:59.999980 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:38:59.999980 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:38:59.999980 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:38:59.999980 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:38:59.999980 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:38:59.999980 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:38:59.999980 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:38:59.999980 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:38:59.999980 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:38:59.999980 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:38:59.999980 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:00.000931 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:00.000931 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:00.000931 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:39:00.000931 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:39:00.000931 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:39:00.000931 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:39:00.000931 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:39:00.000931 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:39:00.000931 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 06 20:39:00.000931 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:00.004316 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 323/640] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:38:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:00.005547 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b69a5-6eaa-4a3b-a802-132bd6d99fc3 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:00.005907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b69a5-6eaa-4a3b-a802-132bd6d99fc3 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:00.006092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b69a5-6eaa-4a3b-a802-132bd6d99fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:00.025456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d82b69a5-6eaa-4a3b-a802-132bd6d99fc3 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:00.026709 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d82b69a5-6eaa-4a3b-a802-132bd6d99fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:00.092198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:00.106829 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 324/641] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:39:00.106829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b69a5-6eaa-4a3b-a802-132bd6d99fc3 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:00.119433 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e513cf-a3ca-4cc0-be3a-596476d03812 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:00.157155 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42edc976-3306-4e72-a8b4-07f6b46993d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:00.157761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42edc976-3306-4e72-a8b4-07f6b46993d9 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:00.158035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42edc976-3306-4e72-a8b4-07f6b46993d9 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:00.158302 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42edc976-3306-4e72-a8b4-07f6b46993d9 None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:00.158967 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42edc976-3306-4e72-a8b4-07f6b46993d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:00.159269 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42edc976-3306-4e72-a8b4-07f6b46993d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:00.160622 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42edc976-3306-4e72-a8b4-07f6b46993d9 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:00.170168 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:00.174178 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 318/642] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:00.174861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42edc976-3306-4e72-a8b4-07f6b46993d9 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:00.216153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b69a5-6eaa-4a3b-a802-132bd6d99fc3 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:00.254247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e21bc-9460-4e02-b40b-ccf3c49cc5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:00.254835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e21bc-9460-4e02-b40b-ccf3c49cc5f0 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:00.255117 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e21bc-9460-4e02-b40b-ccf3c49cc5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:00.255388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e21bc-9460-4e02-b40b-ccf3c49cc5f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:00.265938 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e21bc-9460-4e02-b40b-ccf3c49cc5f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:39:00.270750 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-9c9e21bc-9460-4e02-b40b-ccf3c49cc5f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:39:00.270750 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:00.270750 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:00.270750 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:00.270750 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:00.270750 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:00.270750 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:00.270750 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:00.270750 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:00.270750 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:00.270750 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:00.270750 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:00.270750 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:39:00.270750 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:39:00.270750 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:39:00.270750 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:39:00.271768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:39:00.271768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:39:00.271768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:39:00.271768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:39:00.271768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:00.271768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:00.271768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:00.271768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:00.271768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:00.271768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:00.271768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:00.271768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:00.271768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:00.271768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:00.271768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:00.271768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:00.272647 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:00.272647 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:00.272647 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:00.272647 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:00.272647 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:39:00.272647 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:39:00.272647 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:39:00.272647 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:39:00.272647 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:39:00.272647 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:39:00.272647 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:39:00.272647 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:00.277131 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 325/643] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Aug 6 20:39:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:00.277975 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e21bc-9460-4e02-b40b-ccf3c49cc5f0 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:00.295974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42edc976-3306-4e72-a8b4-07f6b46993d9 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:00.331521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61948c61-7a99-4bd0-9fba-8577070d100d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:00.332231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61948c61-7a99-4bd0-9fba-8577070d100d None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:00.332511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61948c61-7a99-4bd0-9fba-8577070d100d None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:00.332813 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61948c61-7a99-4bd0-9fba-8577070d100d None admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:00.333606 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61948c61-7a99-4bd0-9fba-8577070d100d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:00.333907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61948c61-7a99-4bd0-9fba-8577070d100d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:00.335361 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61948c61-7a99-4bd0-9fba-8577070d100d None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:00.359958 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 319/644] 10.222.0.33 () {56 vars in 1137 bytes} [Sat Aug 6 20:39:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:00.359958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61948c61-7a99-4bd0-9fba-8577070d100d None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:00.363539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:00.389771 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e21bc-9460-4e02-b40b-ccf3c49cc5f0 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:00.409877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:00.425213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a252d257-9388-45f2-8254-31b79837e21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:00.426005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252d257-9388-45f2-8254-31b79837e21f None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:00.426294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252d257-9388-45f2-8254-31b79837e21f None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:00.426898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252d257-9388-45f2-8254-31b79837e21f None admin] PATH_INFO: `/v3/roles/service` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:00.438632 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a252d257-9388-45f2-8254-31b79837e21f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:39:00.444469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-a252d257-9388-45f2-8254-31b79837e21f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:39:00.444469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:00.444469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:00.444469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:00.444469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:00.444469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:00.444469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:00.444469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:00.444469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:00.444469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:00.444469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:00.444469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:00.444469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:39:00.444469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:39:00.444469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:39:00.444469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:39:00.445947 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:39:00.445947 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:39:00.445947 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:39:00.445947 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:39:00.445947 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:00.445947 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:00.445947 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:00.445947 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:00.445947 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:00.445947 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:00.445947 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:00.445947 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:00.445947 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:00.445947 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:00.445947 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:00.445947 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:00.451701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:00.451701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:00.451701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:00.451701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:00.451701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:39:00.451701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:39:00.451701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:39:00.451701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:39:00.451701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:39:00.451701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:39:00.451701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:39:00.451701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:00.451701 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 326/645] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Aug 6 20:39:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:00.451701 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a252d257-9388-45f2-8254-31b79837e21f None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:00.472336 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61948c61-7a99-4bd0-9fba-8577070d100d None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:00.510462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab9436-f668-498f-8ced-49cccdf28acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:00.511035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab9436-f668-498f-8ced-49cccdf28acc None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:00.511316 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab9436-f668-498f-8ced-49cccdf28acc None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:00.511590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab9436-f668-498f-8ced-49cccdf28acc None admin] PATH_INFO: `/v3/projects/service` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:00.518183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab9436-f668-498f-8ced-49cccdf28acc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:00.519637 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab9436-f668-498f-8ced-49cccdf28acc None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:00.531046 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-29ab9436-f668-498f-8ced-49cccdf28acc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:00.531046 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:00.531046 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:00.531046 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:00.531046 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:00.531046 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:00.531046 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:00.531046 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:00.531046 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:00.531046 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:00.531046 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:00.531046 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:00.531046 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:39:00.531046 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:39:00.531046 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:39:00.531940 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:39:00.531940 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:00.531940 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:00.531940 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:00.531940 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:00.531940 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:00.531940 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:00.531940 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:00.531940 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:00.531940 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:00.531940 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:00.531940 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:00.531940 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:00.531940 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:00.531940 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:00.531940 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:00.531940 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:00.532847 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:39:00.532847 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:39:00.532847 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:39:00.532847 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:39:00.532847 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:39:00.532847 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:39:00.532847 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:00.532847 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:00.532847 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 320/646] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:39:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:00.533335 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab9436-f668-498f-8ced-49cccdf28acc None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:00.561225 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a252d257-9388-45f2-8254-31b79837e21f None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:00.596821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:00.597643 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35263338-17a9-46d3-8065-e9beac7c5d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:00.598253 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35263338-17a9-46d3-8065-e9beac7c5d9b None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:00.598534 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35263338-17a9-46d3-8065-e9beac7c5d9b None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:00.599028 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35263338-17a9-46d3-8065-e9beac7c5d9b None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:00.599500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35263338-17a9-46d3-8065-e9beac7c5d9b None admin] RBAC: Adding query filter params (name=service) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:00.599807 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35263338-17a9-46d3-8065-e9beac7c5d9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:00.601184 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35263338-17a9-46d3-8065-e9beac7c5d9b None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:00.610259 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 327/647] 10.222.0.33 () {56 vars in 1103 bytes} [Sat Aug 6 20:39:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:00.611111 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35263338-17a9-46d3-8065-e9beac7c5d9b None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:00.641119 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab9436-f668-498f-8ced-49cccdf28acc None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:00.659525 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:00.683642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ee023-d238-40c6-b331-58c95ab67f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:00.684497 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ee023-d238-40c6-b331-58c95ab67f15 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:00.684968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ee023-d238-40c6-b331-58c95ab67f15 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:00.685329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ee023-d238-40c6-b331-58c95ab67f15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:00.725625 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35263338-17a9-46d3-8065-e9beac7c5d9b None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:00.754798 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ee023-d238-40c6-b331-58c95ab67f15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:00.756252 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ee023-d238-40c6-b331-58c95ab67f15 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:00.760829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2b9f8-6a9f-4370-93cf-62c74d9e1199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:00.761416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2b9f8-6a9f-4370-93cf-62c74d9e1199 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:00.761696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2b9f8-6a9f-4370-93cf-62c74d9e1199 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:00.761965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2b9f8-6a9f-4370-93cf-62c74d9e1199 None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:00.762642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2b9f8-6a9f-4370-93cf-62c74d9e1199 None admin] RBAC: Adding query filter params (name=service) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:00.762946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2b9f8-6a9f-4370-93cf-62c74d9e1199 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:00.764296 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2b9f8-6a9f-4370-93cf-62c74d9e1199 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:00.773098 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 328/648] 10.222.0.33 () {56 vars in 1103 bytes} [Sat Aug 6 20:39:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:00.777799 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2b9f8-6a9f-4370-93cf-62c74d9e1199 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:00.826843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:00.873783 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 321/649] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:39:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:00.873783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ee023-d238-40c6-b331-58c95ab67f15 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:00.887849 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2b9f8-6a9f-4370-93cf-62c74d9e1199 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:00.890286 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:00.926200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b100c34-7679-4d0c-bf3f-adcb34abbedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:00.926903 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b100c34-7679-4d0c-bf3f-adcb34abbedd None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:00.927183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b100c34-7679-4d0c-bf3f-adcb34abbedd None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:00.927453 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b100c34-7679-4d0c-bf3f-adcb34abbedd None admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:00.928136 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b100c34-7679-4d0c-bf3f-adcb34abbedd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:00.928550 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b100c34-7679-4d0c-bf3f-adcb34abbedd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:00.930663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b100c34-7679-4d0c-bf3f-adcb34abbedd None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:00.944004 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 329/650] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Aug 6 20:39:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:00.944800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b100c34-7679-4d0c-bf3f-adcb34abbedd None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:00.983021 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ee023-d238-40c6-b331-58c95ab67f15 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:01.024601 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d3035-5b84-4563-8e47-355f7c1a5f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:01.025007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d3035-5b84-4563-8e47-355f7c1a5f25 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:01.025280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d3035-5b84-4563-8e47-355f7c1a5f25 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:01.025544 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d3035-5b84-4563-8e47-355f7c1a5f25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:01.036779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d3035-5b84-4563-8e47-355f7c1a5f25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:01.038274 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d3035-5b84-4563-8e47-355f7c1a5f25 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:01.053762 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-9d0d3035-5b84-4563-8e47-355f7c1a5f25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:01.053762 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:01.053762 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:01.053762 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:01.053762 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:01.053762 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:01.053762 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:01.053762 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:01.053762 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:01.053762 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:01.053762 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:01.053762 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:01.053762 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:39:01.053762 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:39:01.053762 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:39:01.053762 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:39:01.055511 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:01.055511 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:01.055511 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:01.055511 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:01.055511 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:01.055511 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:01.055511 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:01.055511 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:01.055511 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:01.055511 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:01.055511 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:01.055511 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:01.055511 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:01.055511 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:01.055511 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:01.055511 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:01.055511 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:39:01.056426 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:39:01.056426 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:01.056426 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:01.056426 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 322/651] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:01.056426 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d3035-5b84-4563-8e47-355f7c1a5f25 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:01.066323 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b100c34-7679-4d0c-bf3f-adcb34abbedd None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:01.073180 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:01.104972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f12629-8cc0-4f5b-9a28-e542c7bec264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:01.105597 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f12629-8cc0-4f5b-9a28-e542c7bec264 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:01.105874 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f12629-8cc0-4f5b-9a28-e542c7bec264 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:01.106145 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f12629-8cc0-4f5b-9a28-e542c7bec264 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:01.116734 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f12629-8cc0-4f5b-9a28-e542c7bec264 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:01.118231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f12629-8cc0-4f5b-9a28-e542c7bec264 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:01.134394 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-97f12629-8cc0-4f5b-9a28-e542c7bec264 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:01.134394 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:01.134394 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:01.134394 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:01.134394 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:01.134394 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:01.134394 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:01.134394 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:01.134394 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:01.134394 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:01.134394 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:01.134394 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:01.134394 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:39:01.134394 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:39:01.134394 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:39:01.134394 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:39:01.135524 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:01.135524 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:01.135524 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:01.135524 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:01.135524 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:01.135524 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:01.135524 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:01.135524 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:01.135524 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:01.135524 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:01.135524 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:01.135524 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:01.135524 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:01.135524 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:01.135524 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:01.135524 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:01.135524 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:39:01.141669 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:39:01.141669 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:01.141669 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:01.141669 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 330/652] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:01.141669 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f12629-8cc0-4f5b-9a28-e542c7bec264 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:01.161658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:01.169736 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d3035-5b84-4563-8e47-355f7c1a5f25 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:01.203193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7d632-aa69-4c25-9879-e2111003ff37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:01.203814 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7d632-aa69-4c25-9879-e2111003ff37 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:01.204094 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7d632-aa69-4c25-9879-e2111003ff37 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:01.204366 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7d632-aa69-4c25-9879-e2111003ff37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:01.215219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc7d632-aa69-4c25-9879-e2111003ff37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:01.216663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc7d632-aa69-4c25-9879-e2111003ff37 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:01.231734 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-bcc7d632-aa69-4c25-9879-e2111003ff37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:01.231734 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:01.231734 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:01.231734 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:01.231734 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:01.231734 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:01.231734 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:01.231734 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:01.231734 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:01.231734 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:01.231734 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:01.231734 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:01.231734 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:39:01.231734 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:39:01.231734 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:39:01.231734 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:39:01.232864 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:01.232864 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:01.232864 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:01.232864 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:01.232864 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:01.232864 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:01.232864 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:01.232864 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:01.232864 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:01.232864 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:01.232864 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:01.232864 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:01.232864 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:01.232864 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:01.232864 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:01.232864 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:01.232864 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:39:01.233774 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:39:01.233774 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:01.233774 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:01.233774 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 323/653] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:01.234194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7d632-aa69-4c25-9879-e2111003ff37 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:01.250974 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f12629-8cc0-4f5b-9a28-e542c7bec264 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:01.284656 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d987b-1ccf-4586-b672-60fdfa4c7bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:01.285189 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d987b-1ccf-4586-b672-60fdfa4c7bc0 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:01.285468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d987b-1ccf-4586-b672-60fdfa4c7bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:01.285740 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d987b-1ccf-4586-b672-60fdfa4c7bc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:01.286456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d987b-1ccf-4586-b672-60fdfa4c7bc0 None admin] RBAC: Adding query filter params (role.id=55fe0e239bac413b90c785211607e1a4, scope.project.id=6c4962342201407a89793c5c9a6a6f36, user.id=5f9d53147a57402f8b9818590bc1fc1f) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:01.286793 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d987b-1ccf-4586-b672-60fdfa4c7bc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:01.288224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d987b-1ccf-4586-b672-60fdfa4c7bc0 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:01.293869 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 331/654] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:39:01 2022] GET /identity/v3/role_assignments?user.id=5f9d53147a57402f8b9818590bc1fc1f&scope.project.id=6c4962342201407a89793c5c9a6a6f36&role.id=55fe0e239bac413b90c785211607e1a4 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:01.294670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d987b-1ccf-4586-b672-60fdfa4c7bc0 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:01.300541 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:01.344929 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7d632-aa69-4c25-9879-e2111003ff37 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:01.388787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428166e-11b3-4dfa-905c-2c91b3d7b9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:01.389804 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428166e-11b3-4dfa-905c-2c91b3d7b9cd None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:01.390283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428166e-11b3-4dfa-905c-2c91b3d7b9cd None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:01.390810 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428166e-11b3-4dfa-905c-2c91b3d7b9cd None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:01.391682 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f428166e-11b3-4dfa-905c-2c91b3d7b9cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:01.392195 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f428166e-11b3-4dfa-905c-2c91b3d7b9cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:01.393834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f428166e-11b3-4dfa-905c-2c91b3d7b9cd None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:01.401198 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:01.412591 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 324/655] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:01.414098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6fc78-1b0f-4bd0-9ab0-9ac2c35ddee4 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:01.414944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6fc78-1b0f-4bd0-9ab0-9ac2c35ddee4 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:01.415244 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6fc78-1b0f-4bd0-9ab0-9ac2c35ddee4 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:01.418589 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 325/656] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:01.418589 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6fc78-1b0f-4bd0-9ab0-9ac2c35ddee4 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:01.430698 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d987b-1ccf-4586-b672-60fdfa4c7bc0 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:01.470147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97309b46-7368-4c63-8eb6-84e9f369d1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:01.470804 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97309b46-7368-4c63-8eb6-84e9f369d1f1 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:01.471087 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97309b46-7368-4c63-8eb6-84e9f369d1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:01.471360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97309b46-7368-4c63-8eb6-84e9f369d1f1 None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:01.472014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97309b46-7368-4c63-8eb6-84e9f369d1f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:01.472327 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97309b46-7368-4c63-8eb6-84e9f369d1f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:01.473699 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97309b46-7368-4c63-8eb6-84e9f369d1f1 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:01.492806 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 332/657] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:01.492806 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97309b46-7368-4c63-8eb6-84e9f369d1f1 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:01.541155 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6fc78-1b0f-4bd0-9ab0-9ac2c35ddee4 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:01.573577 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:01.583919 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b514374-9226-4660-87b8-1148e8461fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:01.584528 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b514374-9226-4660-87b8-1148e8461fe4 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:01.584809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b514374-9226-4660-87b8-1148e8461fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:01.585080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b514374-9226-4660-87b8-1148e8461fe4 None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:01.585714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b514374-9226-4660-87b8-1148e8461fe4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:01.586632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b514374-9226-4660-87b8-1148e8461fe4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:01.588396 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b514374-9226-4660-87b8-1148e8461fe4 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:01.600024 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 326/658] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:01.601204 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497274c-8212-4b01-94c7-d5b0759b9660 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:01.601521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497274c-8212-4b01-94c7-d5b0759b9660 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:01.601828 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497274c-8212-4b01-94c7-d5b0759b9660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:01.608086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97309b46-7368-4c63-8eb6-84e9f369d1f1 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:01.624913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-2497274c-8212-4b01-94c7-d5b0759b9660 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:01.626274 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2497274c-8212-4b01-94c7-d5b0759b9660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:01.645304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038896b-a964-496d-9890-37e3faf40a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:01.645938 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038896b-a964-496d-9890-37e3faf40a8e None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:01.646277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038896b-a964-496d-9890-37e3faf40a8e None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:01.646571 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038896b-a964-496d-9890-37e3faf40a8e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:01.655416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a038896b-a964-496d-9890-37e3faf40a8e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:01.657293 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a038896b-a964-496d-9890-37e3faf40a8e None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:01.660139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:01.672559 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-a038896b-a964-496d-9890-37e3faf40a8e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 20:39:01.672559 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:01.672559 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:01.672559 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:01.672559 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:01.672559 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:01.672559 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:01.672559 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:01.672559 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:01.672559 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:01.672559 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:01.672559 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:01.672559 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:39:01.672559 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:39:01.672559 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:39:01.672559 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:39:01.673552 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:01.673552 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:01.673552 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:39:01.673552 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:01.673552 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:39:01.673552 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:01.673552 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:01.673552 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:01.673552 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:01.673552 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:01.673552 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:01.673552 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:01.673552 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:01.673552 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:01.673552 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:01.673552 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:01.673552 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:01.673552 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:01.679358 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:01.679358 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:01.679358 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:39:01.679358 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:39:01.679358 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:39:01.679358 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:39:01.679358 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:39:01.679358 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:39:01.679358 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 20:39:01.679358 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:01.679358 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 333/659] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:39:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:01.679358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038896b-a964-496d-9890-37e3faf40a8e None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:01.703893 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 327/660] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:39:01.707728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497274c-8212-4b01-94c7-d5b0759b9660 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:01.789609 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038896b-a964-496d-9890-37e3faf40a8e None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:01.825393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497274c-8212-4b01-94c7-d5b0759b9660 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:01.826378 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615808e3-491c-4bad-a228-60c80e06e371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:01.827043 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615808e3-491c-4bad-a228-60c80e06e371 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:01.827324 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615808e3-491c-4bad-a228-60c80e06e371 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:01.827603 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615808e3-491c-4bad-a228-60c80e06e371 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:01.835321 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615808e3-491c-4bad-a228-60c80e06e371 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:01.837877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615808e3-491c-4bad-a228-60c80e06e371 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:01.846688 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:01.849629 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-615808e3-491c-4bad-a228-60c80e06e371 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 06 20:39:01.849629 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:01.849629 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:01.849629 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:01.849629 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:01.849629 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:01.849629 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:01.849629 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:01.849629 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:01.849629 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:01.849629 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:01.849629 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:01.849629 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:39:01.849629 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:39:01.849629 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:39:01.849629 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:39:01.850604 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:01.850604 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:01.850604 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:39:01.850604 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:01.850604 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:39:01.850604 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:01.850604 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:01.850604 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:01.850604 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:01.850604 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:01.850604 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:01.850604 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:01.850604 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:01.850604 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:01.850604 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:01.850604 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:01.850604 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:01.850604 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:01.852622 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:01.852622 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:01.852622 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:39:01.852622 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:39:01.852622 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:39:01.852622 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:39:01.852622 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:39:01.852622 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:39:01.852622 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 06 20:39:01.852622 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:01.852622 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 334/661] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Aug 6 20:39:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:01.852622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615808e3-491c-4bad-a228-60c80e06e371 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:01.873885 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269ce35-3ff9-477c-8ce8-0e4b3c9750fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:01.874933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269ce35-3ff9-477c-8ce8-0e4b3c9750fe None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:01.875216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269ce35-3ff9-477c-8ce8-0e4b3c9750fe None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:01.875489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269ce35-3ff9-477c-8ce8-0e4b3c9750fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:01.885432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0269ce35-3ff9-477c-8ce8-0e4b3c9750fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:01.886891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0269ce35-3ff9-477c-8ce8-0e4b3c9750fe None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:01.899299 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-0269ce35-3ff9-477c-8ce8-0e4b3c9750fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:01.899299 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:01.899299 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:01.899299 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:01.899299 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:01.899299 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:01.899299 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:01.899299 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:01.899299 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:01.899299 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:01.899299 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:01.899299 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:01.899299 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:39:01.899299 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:39:01.899299 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:39:01.900258 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:39:01.900258 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:01.900258 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:01.900258 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:01.900258 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:01.900258 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:01.900258 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:01.900258 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:01.900258 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:01.900258 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:01.900258 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:01.900258 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:01.900258 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:01.900258 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:01.900258 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:01.900258 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:01.900258 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:01.901148 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:39:01.901148 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:39:01.901148 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:39:01.901148 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:39:01.901148 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:39:01.901148 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:39:01.901148 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:01.901148 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:01.901148 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 328/662] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:39:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:01.901641 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269ce35-3ff9-477c-8ce8-0e4b3c9750fe None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:01.920535 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:01.968205 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615808e3-491c-4bad-a228-60c80e06e371 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:02.001326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ae176-e93c-4f50-aebd-d372c2f17771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:02.001931 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ae176-e93c-4f50-aebd-d372c2f17771 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:02.002210 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ae176-e93c-4f50-aebd-d372c2f17771 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:02.002484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ae176-e93c-4f50-aebd-d372c2f17771 None admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:02.003234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ae176-e93c-4f50-aebd-d372c2f17771 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:02.003543 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ae176-e93c-4f50-aebd-d372c2f17771 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:02.004994 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ae176-e93c-4f50-aebd-d372c2f17771 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:02.017790 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269ce35-3ff9-477c-8ce8-0e4b3c9750fe None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:02.022912 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 335/663] 10.222.0.33 () {56 vars in 1137 bytes} [Sat Aug 6 20:39:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:02.024284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ae176-e93c-4f50-aebd-d372c2f17771 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:02.059666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfeac9-46d1-4346-937b-90e3f3e16ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:02.060717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfeac9-46d1-4346-937b-90e3f3e16ac7 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:02.060717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfeac9-46d1-4346-937b-90e3f3e16ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:02.060996 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfeac9-46d1-4346-937b-90e3f3e16ac7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:02.071857 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cfeac9-46d1-4346-937b-90e3f3e16ac7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:39:02.077097 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-f0cfeac9-46d1-4346-937b-90e3f3e16ac7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:39:02.077097 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:02.077097 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:02.077097 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:02.077097 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:02.077097 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:02.077097 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:02.077097 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:02.077097 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:02.077097 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:02.077097 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:02.077097 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:02.077097 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:39:02.077097 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:39:02.077097 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:39:02.077097 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:39:02.078025 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:39:02.078025 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:39:02.078025 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:39:02.078025 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:39:02.078025 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:02.078025 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:02.078025 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:02.078025 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:02.078025 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:02.078025 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:02.078025 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:02.078025 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:02.078025 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:02.078025 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:02.078025 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:02.078025 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:02.078918 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:02.078918 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:02.078918 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:02.078918 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:02.078918 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:39:02.078918 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:39:02.078918 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:39:02.078918 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:39:02.078918 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:39:02.078918 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:39:02.078918 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:39:02.078918 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:02.078918 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 329/664] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Aug 6 20:39:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:02.078918 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfeac9-46d1-4346-937b-90e3f3e16ac7 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:02.118687 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:02.135719 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ae176-e93c-4f50-aebd-d372c2f17771 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:02.154094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:02.173521 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210080c-6298-43f0-933a-454f68222bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:02.174129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210080c-6298-43f0-933a-454f68222bd7 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:02.174407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210080c-6298-43f0-933a-454f68222bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:02.174942 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210080c-6298-43f0-933a-454f68222bd7 None admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:02.175428 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210080c-6298-43f0-933a-454f68222bd7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:02.175737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210080c-6298-43f0-933a-454f68222bd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:02.177167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210080c-6298-43f0-933a-454f68222bd7 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:02.195203 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 336/665] 10.222.0.33 () {56 vars in 1139 bytes} [Sat Aug 6 20:39:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:02.196521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfeac9-46d1-4346-937b-90e3f3e16ac7 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:02.196636 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210080c-6298-43f0-933a-454f68222bd7 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:02.235815 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ca14d-0f6b-48a7-a6bb-244801261649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:02.236742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ca14d-0f6b-48a7-a6bb-244801261649 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:02.237249 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ca14d-0f6b-48a7-a6bb-244801261649 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:02.237738 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ca14d-0f6b-48a7-a6bb-244801261649 None admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:02.238728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ca14d-0f6b-48a7-a6bb-244801261649 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:02.239132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ca14d-0f6b-48a7-a6bb-244801261649 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:02.240898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ca14d-0f6b-48a7-a6bb-244801261649 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:02.253929 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 330/666] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Aug 6 20:39:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:02.254770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ca14d-0f6b-48a7-a6bb-244801261649 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:02.315163 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210080c-6298-43f0-933a-454f68222bd7 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:02.353047 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0eb25-fc2c-4492-8f6a-ae70289b7cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:02.353724 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0eb25-fc2c-4492-8f6a-ae70289b7cee None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:02.353997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0eb25-fc2c-4492-8f6a-ae70289b7cee None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:02.354268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0eb25-fc2c-4492-8f6a-ae70289b7cee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:02.357481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:02.363663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ca14d-0f6b-48a7-a6bb-244801261649 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:02.401785 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf61ee-66ff-4b5d-9c07-3cd7a45d6f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:02.402558 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf61ee-66ff-4b5d-9c07-3cd7a45d6f70 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:02.402845 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf61ee-66ff-4b5d-9c07-3cd7a45d6f70 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:02.403118 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf61ee-66ff-4b5d-9c07-3cd7a45d6f70 None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:02.403823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf61ee-66ff-4b5d-9c07-3cd7a45d6f70 None admin] RBAC: Adding query filter params (name=service) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:02.404192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:02.404305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf61ee-66ff-4b5d-9c07-3cd7a45d6f70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:02.406122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf61ee-66ff-4b5d-9c07-3cd7a45d6f70 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:02.415318 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 331/667] 10.222.0.33 () {56 vars in 1103 bytes} [Sat Aug 6 20:39:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:02.415932 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf61ee-66ff-4b5d-9c07-3cd7a45d6f70 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:02.435621 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d0eb25-fc2c-4492-8f6a-ae70289b7cee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:02.437072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d0eb25-fc2c-4492-8f6a-ae70289b7cee None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:02.520387 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf61ee-66ff-4b5d-9c07-3cd7a45d6f70 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:02.554039 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 337/668] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:39:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:02.554039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0eb25-fc2c-4492-8f6a-ae70289b7cee None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:02.559145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77ca53-5690-4ace-bf96-512776bc881c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:02.559752 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77ca53-5690-4ace-bf96-512776bc881c None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:02.560030 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77ca53-5690-4ace-bf96-512776bc881c None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:02.560300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77ca53-5690-4ace-bf96-512776bc881c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:02.592910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:02.635879 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc77ca53-5690-4ace-bf96-512776bc881c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:02.637252 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc77ca53-5690-4ace-bf96-512776bc881c None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:02.644509 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:02.676894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0eb25-fc2c-4492-8f6a-ae70289b7cee None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:02.715919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d58846-fc92-4f62-b68d-460f5e18caf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:02.716516 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d58846-fc92-4f62-b68d-460f5e18caf3 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:02.716790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d58846-fc92-4f62-b68d-460f5e18caf3 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:02.717058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d58846-fc92-4f62-b68d-460f5e18caf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:02.717771 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d58846-fc92-4f62-b68d-460f5e18caf3 None admin] RBAC: Adding query filter params (role.id=55fe0e239bac413b90c785211607e1a4, scope.project.id=6c4962342201407a89793c5c9a6a6f36, user.id=1e10759b2abd4cafacf338551327775e) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:02.718164 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d58846-fc92-4f62-b68d-460f5e18caf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:02.719950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d58846-fc92-4f62-b68d-460f5e18caf3 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:02.727257 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 338/669] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:39:02 2022] GET /identity/v3/role_assignments?user.id=1e10759b2abd4cafacf338551327775e&scope.project.id=6c4962342201407a89793c5c9a6a6f36&role.id=55fe0e239bac413b90c785211607e1a4 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:02.728101 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d58846-fc92-4f62-b68d-460f5e18caf3 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:02.761254 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 332/670] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:39:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:02.762792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77ca53-5690-4ace-bf96-512776bc881c None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:02.846440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:02.850654 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d58846-fc92-4f62-b68d-460f5e18caf3 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:02.898902 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77ca53-5690-4ace-bf96-512776bc881c None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:02.901743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968ebf1-6254-4d78-a241-cca8cf826716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:02.902724 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968ebf1-6254-4d78-a241-cca8cf826716 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:02.903007 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968ebf1-6254-4d78-a241-cca8cf826716 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:02.903282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968ebf1-6254-4d78-a241-cca8cf826716 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:02.916828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:02.921078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968ebf1-6254-4d78-a241-cca8cf826716 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:02.923238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968ebf1-6254-4d78-a241-cca8cf826716 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:02.940601 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-4968ebf1-6254-4d78-a241-cca8cf826716 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:02.940601 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:02.940601 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:02.940601 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:02.940601 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:02.940601 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:02.940601 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:02.940601 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:02.940601 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:02.940601 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:02.940601 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:02.940601 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:02.940601 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:39:02.940601 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:39:02.940601 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:39:02.940601 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:39:02.941589 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:02.941589 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:02.941589 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:02.941589 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:02.941589 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:02.941589 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:02.941589 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:02.941589 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:02.941589 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:02.941589 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:02.941589 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:02.941589 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:02.941589 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:02.941589 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:02.941589 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:02.941589 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:02.941589 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:39:02.942457 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:39:02.942457 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:02.942457 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:02.942457 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 339/671] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:02.943322 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968ebf1-6254-4d78-a241-cca8cf826716 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:02.958486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72fad4-cc16-4fec-a17f-28a3ad5cc879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:02.959089 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72fad4-cc16-4fec-a17f-28a3ad5cc879 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:02.959465 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72fad4-cc16-4fec-a17f-28a3ad5cc879 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:02.959837 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72fad4-cc16-4fec-a17f-28a3ad5cc879 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:02.973014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72fad4-cc16-4fec-a17f-28a3ad5cc879 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:02.974915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72fad4-cc16-4fec-a17f-28a3ad5cc879 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:02.997258 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-9a72fad4-cc16-4fec-a17f-28a3ad5cc879 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:02.997258 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:02.997258 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:02.997258 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:02.997258 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:02.997258 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:02.997258 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:02.997258 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:02.997258 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:02.997258 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:02.997258 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:02.997258 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:02.997258 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:39:02.997258 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:39:02.997258 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:39:02.997258 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:39:02.998264 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:02.998264 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:02.998264 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:02.998264 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:02.998264 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:02.998264 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:02.998264 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:02.998264 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:02.998264 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:02.998264 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:02.998264 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:02.998264 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:02.998264 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:02.998264 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:02.998264 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:02.998264 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:02.998264 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:39:02.999222 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:39:02.999222 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:02.999222 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:02.999222 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 333/672] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:02.999869 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72fad4-cc16-4fec-a17f-28a3ad5cc879 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:03.077561 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968ebf1-6254-4d78-a241-cca8cf826716 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:03.114326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f853f-b67d-4711-a349-5abd8319af56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:03.115003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f853f-b67d-4711-a349-5abd8319af56 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:03.115276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f853f-b67d-4711-a349-5abd8319af56 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:03.115542 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f853f-b67d-4711-a349-5abd8319af56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:03.126971 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f853f-b67d-4711-a349-5abd8319af56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:03.128418 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f853f-b67d-4711-a349-5abd8319af56 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:03.135074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72fad4-cc16-4fec-a17f-28a3ad5cc879 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:03.144565 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-5b0f853f-b67d-4711-a349-5abd8319af56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:03.144565 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:03.144565 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:03.144565 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:03.144565 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:03.144565 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:03.144565 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:03.144565 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:03.144565 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:03.144565 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:03.144565 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:03.144565 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:03.144565 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:39:03.144565 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:39:03.144565 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:39:03.144565 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:39:03.145859 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:03.145859 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:03.145859 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:03.145859 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:03.145859 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:03.145859 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:03.145859 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:03.145859 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:03.145859 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:03.145859 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:03.145859 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:03.145859 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:03.145859 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:03.145859 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:03.145859 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:03.145859 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:03.145859 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:39:03.146799 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:39:03.146799 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:03.146799 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:03.146799 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 340/673] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:03.146799 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f853f-b67d-4711-a349-5abd8319af56 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:03.147994 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:03.184200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7824f2-ffe6-4f3c-8dcb-7398b74b165b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:03.185299 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7824f2-ffe6-4f3c-8dcb-7398b74b165b None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:03.186631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7824f2-ffe6-4f3c-8dcb-7398b74b165b None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:03.187148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7824f2-ffe6-4f3c-8dcb-7398b74b165b None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:03.187956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7824f2-ffe6-4f3c-8dcb-7398b74b165b None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:03.188412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7824f2-ffe6-4f3c-8dcb-7398b74b165b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:03.189942 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7824f2-ffe6-4f3c-8dcb-7398b74b165b None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:03.200804 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:03.213231 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 334/674] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:03.214179 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7824f2-ffe6-4f3c-8dcb-7398b74b165b None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:03.276386 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f853f-b67d-4711-a349-5abd8319af56 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:03.321538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccf62e-a211-48fd-982a-054c0dc113e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:03.322811 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccf62e-a211-48fd-982a-054c0dc113e4 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:03.323419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccf62e-a211-48fd-982a-054c0dc113e4 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:03.323868 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccf62e-a211-48fd-982a-054c0dc113e4 None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:03.325114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dccf62e-a211-48fd-982a-054c0dc113e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:03.325678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dccf62e-a211-48fd-982a-054c0dc113e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:03.327713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dccf62e-a211-48fd-982a-054c0dc113e4 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:03.330080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7824f2-ffe6-4f3c-8dcb-7398b74b165b None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:03.348818 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 341/675] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:03.348818 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccf62e-a211-48fd-982a-054c0dc113e4 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:03.376072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286bb6b-517c-41e0-b1a9-a9bab2cedf03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:03.376972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286bb6b-517c-41e0-b1a9-a9bab2cedf03 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:03.377279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286bb6b-517c-41e0-b1a9-a9bab2cedf03 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:03.377646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286bb6b-517c-41e0-b1a9-a9bab2cedf03 None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:03.378374 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286bb6b-517c-41e0-b1a9-a9bab2cedf03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:03.378833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286bb6b-517c-41e0-b1a9-a9bab2cedf03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:03.380280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286bb6b-517c-41e0-b1a9-a9bab2cedf03 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:03.391965 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 335/676] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:03.392906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286bb6b-517c-41e0-b1a9-a9bab2cedf03 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:03.445583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:03.479389 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccf62e-a211-48fd-982a-054c0dc113e4 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:03.483892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:03.520178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286bb6b-517c-41e0-b1a9-a9bab2cedf03 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:03.527783 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de0c99-4fb2-4789-805d-afa3f3f1b354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:03.528531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de0c99-4fb2-4789-805d-afa3f3f1b354 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:03.528878 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de0c99-4fb2-4789-805d-afa3f3f1b354 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:03.529217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de0c99-4fb2-4789-805d-afa3f3f1b354 None admin] PATH_INFO: `/v3/users/swift` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:03.537088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de0c99-4fb2-4789-805d-afa3f3f1b354 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:03.539557 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de0c99-4fb2-4789-805d-afa3f3f1b354 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:03.552756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-24de0c99-4fb2-4789-805d-afa3f3f1b354 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 06 20:39:03.552756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:03.552756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:03.552756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:03.552756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:03.552756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:03.552756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:03.552756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:03.552756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:03.552756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:03.552756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:03.552756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:03.552756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:39:03.552756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:39:03.552756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:39:03.552756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:39:03.553768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:03.553768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:03.553768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:39:03.553768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:03.553768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:39:03.553768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:03.553768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:03.553768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:03.553768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:03.553768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:03.553768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:03.553768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:03.553768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:03.553768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:03.553768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:03.553768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:03.553768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:03.553768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:03.555827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:03.555827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:03.555827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:39:03.555827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:39:03.555827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:39:03.555827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:39:03.555827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:39:03.555827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:39:03.555827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 06 20:39:03.555827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:03.558859 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 342/677] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Aug 6 20:39:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:03.559783 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de0c99-4fb2-4789-805d-afa3f3f1b354 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:03.569819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac1c87-ee32-49d2-940f-c53c70ee5c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:03.572049 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac1c87-ee32-49d2-940f-c53c70ee5c21 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:03.572518 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac1c87-ee32-49d2-940f-c53c70ee5c21 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:03.572967 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac1c87-ee32-49d2-940f-c53c70ee5c21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:03.583408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac1c87-ee32-49d2-940f-c53c70ee5c21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:03.585810 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac1c87-ee32-49d2-940f-c53c70ee5c21 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:03.604159 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-56ac1c87-ee32-49d2-940f-c53c70ee5c21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:03.604159 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:03.604159 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:03.604159 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:03.604159 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:03.604159 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:03.604159 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:03.604159 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:03.604159 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:03.604159 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:03.604159 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:03.604159 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:03.604159 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:39:03.604159 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:39:03.604159 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:39:03.605112 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:39:03.605112 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:03.605112 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:03.605112 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:03.605112 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:03.605112 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:03.605112 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:03.605112 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:03.605112 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:03.605112 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:03.605112 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:03.605112 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:03.605112 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:03.605112 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:03.605112 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:03.605112 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:03.605112 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:03.606023 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:39:03.606023 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:39:03.606023 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:39:03.606023 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:39:03.606023 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:39:03.606023 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:39:03.606023 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:03.606023 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:03.613684 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 336/678] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:39:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:03.613684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac1c87-ee32-49d2-940f-c53c70ee5c21 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:03.686569 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de0c99-4fb2-4789-805d-afa3f3f1b354 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:03.723152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:03.725416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b829a32-04b3-4e25-b8f4-bf7fdc479026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:03.726824 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b829a32-04b3-4e25-b8f4-bf7fdc479026 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:03.727811 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b829a32-04b3-4e25-b8f4-bf7fdc479026 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:03.728283 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b829a32-04b3-4e25-b8f4-bf7fdc479026 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:03.733937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac1c87-ee32-49d2-940f-c53c70ee5c21 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:03.735123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b829a32-04b3-4e25-b8f4-bf7fdc479026 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:03.736570 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b829a32-04b3-4e25-b8f4-bf7fdc479026 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:03.748887 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-0b829a32-04b3-4e25-b8f4-bf7fdc479026 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:03.748887 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:03.748887 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:03.748887 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:03.748887 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:03.748887 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:03.748887 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:03.748887 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:03.748887 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:03.748887 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:03.748887 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:03.748887 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:03.748887 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:39:03.748887 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:39:03.748887 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:39:03.749972 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:39:03.749972 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:03.749972 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:03.749972 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:03.749972 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:03.749972 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:03.749972 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:03.749972 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:03.749972 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:03.749972 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:03.749972 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:03.749972 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:03.749972 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:03.749972 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:03.749972 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:03.749972 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:03.749972 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:03.751117 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:39:03.751117 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:39:03.751117 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:39:03.751117 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:39:03.751117 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:39:03.751117 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:39:03.751117 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:03.751117 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:03.755181 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 343/679] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:39:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:03.756009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b829a32-04b3-4e25-b8f4-bf7fdc479026 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:03.772948 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a58a1b-d489-401d-a8c0-969385d4504a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:03.774138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a58a1b-d489-401d-a8c0-969385d4504a None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:03.774512 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a58a1b-d489-401d-a8c0-969385d4504a None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:03.774823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a58a1b-d489-401d-a8c0-969385d4504a None admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:03.775541 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a58a1b-d489-401d-a8c0-969385d4504a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:03.775852 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a58a1b-d489-401d-a8c0-969385d4504a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:03.777311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a58a1b-d489-401d-a8c0-969385d4504a None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:03.784358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:03.795508 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 337/680] 10.222.0.33 () {56 vars in 1135 bytes} [Sat Aug 6 20:39:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:03.796813 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb558b8-6750-4fa4-a554-33e38782cc1d None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:03.797102 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb558b8-6750-4fa4-a554-33e38782cc1d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:03.797377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb558b8-6750-4fa4-a554-33e38782cc1d None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:03.798717 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 338/681] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:03.799353 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb558b8-6750-4fa4-a554-33e38782cc1d None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:03.871724 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b829a32-04b3-4e25-b8f4-bf7fdc479026 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:03.906234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfb7d5-d0b6-4f58-bbf4-8d7dc03a58c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:03.906863 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfb7d5-d0b6-4f58-bbf4-8d7dc03a58c3 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:03.907138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfb7d5-d0b6-4f58-bbf4-8d7dc03a58c3 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:03.907404 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfb7d5-d0b6-4f58-bbf4-8d7dc03a58c3 None admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:03.908082 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfb7d5-d0b6-4f58-bbf4-8d7dc03a58c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:03.908384 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfb7d5-d0b6-4f58-bbf4-8d7dc03a58c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:03.909836 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb558b8-6750-4fa4-a554-33e38782cc1d None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:03.910271 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfb7d5-d0b6-4f58-bbf4-8d7dc03a58c3 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:03.927582 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 344/682] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Aug 6 20:39:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:03.927582 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfb7d5-d0b6-4f58-bbf4-8d7dc03a58c3 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:03.952034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309e11a-3163-492b-876a-fe93e2cb3970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:03.952751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309e11a-3163-492b-876a-fe93e2cb3970 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:03.953031 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309e11a-3163-492b-876a-fe93e2cb3970 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:03.953310 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309e11a-3163-492b-876a-fe93e2cb3970 None admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:03.953993 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309e11a-3163-492b-876a-fe93e2cb3970 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:03.954303 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309e11a-3163-492b-876a-fe93e2cb3970 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:03.956036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309e11a-3163-492b-876a-fe93e2cb3970 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:03.974290 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 339/683] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Aug 6 20:39:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:03.975626 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00caf3-c47a-46d1-88c6-bf51f7092c63 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:03.975914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00caf3-c47a-46d1-88c6-bf51f7092c63 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:03.976197 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00caf3-c47a-46d1-88c6-bf51f7092c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:03.993484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-8a00caf3-c47a-46d1-88c6-bf51f7092c63 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:03.994715 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8a00caf3-c47a-46d1-88c6-bf51f7092c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:03.996718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:04.011097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:04.030036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfb7d5-d0b6-4f58-bbf4-8d7dc03a58c3 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:04.068488 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 340/684] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:39:04.069344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00caf3-c47a-46d1-88c6-bf51f7092c63 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:04.077201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189e606-d9b3-4ea5-9ed1-6e8fc844aa0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:04.078170 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189e606-d9b3-4ea5-9ed1-6e8fc844aa0f None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:04.079128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189e606-d9b3-4ea5-9ed1-6e8fc844aa0f None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:04.079555 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189e606-d9b3-4ea5-9ed1-6e8fc844aa0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:04.152592 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9189e606-d9b3-4ea5-9ed1-6e8fc844aa0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:04.154050 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9189e606-d9b3-4ea5-9ed1-6e8fc844aa0f None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:04.181277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00caf3-c47a-46d1-88c6-bf51f7092c63 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:04.221169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0c82f-11a1-40fc-83e6-786d443a3983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:04.221760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0c82f-11a1-40fc-83e6-786d443a3983 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:04.222036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0c82f-11a1-40fc-83e6-786d443a3983 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:04.222304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0c82f-11a1-40fc-83e6-786d443a3983 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:04.223205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c0c82f-11a1-40fc-83e6-786d443a3983 None admin] RBAC: Adding query filter params (role.id=55fe0e239bac413b90c785211607e1a4, scope.project.id=6c4962342201407a89793c5c9a6a6f36, user.id=60cf8ac27ec04117937e87749d69fe3f) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:04.223507 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c0c82f-11a1-40fc-83e6-786d443a3983 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:04.225507 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c0c82f-11a1-40fc-83e6-786d443a3983 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:04.242576 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 341/685] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:39:04 2022] GET /identity/v3/role_assignments?user.id=60cf8ac27ec04117937e87749d69fe3f&scope.project.id=6c4962342201407a89793c5c9a6a6f36&role.id=55fe0e239bac413b90c785211607e1a4 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:04.242576 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0c82f-11a1-40fc-83e6-786d443a3983 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:04.243799 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:04.246383 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:04.263984 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 345/686] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:39:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:04.265024 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189e606-d9b3-4ea5-9ed1-6e8fc844aa0f None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:04.369209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0c82f-11a1-40fc-83e6-786d443a3983 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:04.384547 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189e606-d9b3-4ea5-9ed1-6e8fc844aa0f None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:04.407758 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d4647-63a3-4d6d-a597-abd5950493a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:04.408518 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d4647-63a3-4d6d-a597-abd5950493a6 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:04.408893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d4647-63a3-4d6d-a597-abd5950493a6 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:04.409313 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d4647-63a3-4d6d-a597-abd5950493a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:04.410272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d4647-63a3-4d6d-a597-abd5950493a6 None admin] RBAC: Adding query filter params (role.id=55fe0e239bac413b90c785211607e1a4, scope.project.id=6c4962342201407a89793c5c9a6a6f36, user.id=174e91100a184740b7c604730266dc7c) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:04.410753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d4647-63a3-4d6d-a597-abd5950493a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:04.412417 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d4647-63a3-4d6d-a597-abd5950493a6 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:04.419605 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 342/687] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:39:04 2022] GET /identity/v3/role_assignments?user.id=174e91100a184740b7c604730266dc7c&scope.project.id=6c4962342201407a89793c5c9a6a6f36&role.id=55fe0e239bac413b90c785211607e1a4 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:04.420685 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d4647-63a3-4d6d-a597-abd5950493a6 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:04.421044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b230e-816c-4369-9700-d5aa371ef77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:04.421683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b230e-816c-4369-9700-d5aa371ef77f None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:04.421957 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b230e-816c-4369-9700-d5aa371ef77f None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:04.422307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b230e-816c-4369-9700-d5aa371ef77f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:04.436829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b230e-816c-4369-9700-d5aa371ef77f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:39:04.442027 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-c96b230e-816c-4369-9700-d5aa371ef77f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:39:04.442027 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:04.442027 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:04.442027 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:04.442027 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:04.442027 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:04.442027 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:04.442027 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:04.442027 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:04.442027 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:04.442027 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:04.442027 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:04.442027 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:39:04.442027 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:39:04.442027 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:39:04.442027 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:39:04.443147 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:39:04.443147 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:39:04.443147 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:39:04.443147 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:39:04.443147 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:04.443147 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:04.443147 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:04.443147 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:04.443147 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:04.443147 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:04.443147 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:04.443147 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:04.443147 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:04.443147 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:04.443147 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:04.443147 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:04.444175 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:04.444175 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:04.444175 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:04.444175 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:04.444175 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:39:04.444175 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:39:04.444175 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:39:04.444175 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:39:04.444175 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:39:04.444175 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:39:04.444175 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:39:04.444175 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:04.444175 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 346/688] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Aug 6 20:39:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:04.456351 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b230e-816c-4369-9700-d5aa371ef77f None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:04.519655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:04.528436 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:04.565402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d4647-63a3-4d6d-a597-abd5950493a6 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:04.601929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b230e-816c-4369-9700-d5aa371ef77f None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:04.615108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c229a-40ab-4fe2-9776-7a650f2d73c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:04.616724 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c229a-40ab-4fe2-9776-7a650f2d73c6 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:04.618028 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c229a-40ab-4fe2-9776-7a650f2d73c6 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:04.618499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c229a-40ab-4fe2-9776-7a650f2d73c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:04.639584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c229a-40ab-4fe2-9776-7a650f2d73c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:04.641597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c229a-40ab-4fe2-9776-7a650f2d73c6 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:04.654743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146aba2-631d-43c2-8459-9f5fb32f1412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:04.655367 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146aba2-631d-43c2-8459-9f5fb32f1412 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:04.655648 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146aba2-631d-43c2-8459-9f5fb32f1412 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:04.656001 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146aba2-631d-43c2-8459-9f5fb32f1412 None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:04.656581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146aba2-631d-43c2-8459-9f5fb32f1412 None admin] RBAC: Adding query filter params (name=admin) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:04.656884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146aba2-631d-43c2-8459-9f5fb32f1412 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:04.658275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146aba2-631d-43c2-8459-9f5fb32f1412 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:04.662101 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-359c229a-40ab-4fe2-9776-7a650f2d73c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:04.662101 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:04.662101 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:04.662101 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:04.662101 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:04.662101 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:04.662101 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:04.662101 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:04.662101 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:04.662101 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:04.662101 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:04.662101 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:04.662101 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:39:04.662101 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:39:04.662101 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:39:04.662101 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:39:04.663236 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:04.663236 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:04.663236 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:04.663236 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:04.663236 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:04.663236 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:04.663236 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:04.663236 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:04.663236 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:04.663236 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:04.663236 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:04.663236 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:04.663236 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:04.663236 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:04.663236 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:04.663236 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:04.663236 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:39:04.664713 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:39:04.664713 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:04.664713 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:04.666871 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 343/689] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:04.675409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c229a-40ab-4fe2-9776-7a650f2d73c6 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:04.679129 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 347/690] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:39:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:04.685611 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146aba2-631d-43c2-8459-9f5fb32f1412 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:04.802468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146aba2-631d-43c2-8459-9f5fb32f1412 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:04.807852 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c229a-40ab-4fe2-9776-7a650f2d73c6 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:04.810694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:04.832075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:04.848643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2480656-44fe-4e63-a66f-d3c96ab05e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:04.849590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2480656-44fe-4e63-a66f-d3c96ab05e5c None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:04.850243 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2480656-44fe-4e63-a66f-d3c96ab05e5c None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:04.850888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2480656-44fe-4e63-a66f-d3c96ab05e5c None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:04.852287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2480656-44fe-4e63-a66f-d3c96ab05e5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:04.852806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2480656-44fe-4e63-a66f-d3c96ab05e5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:04.854374 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2480656-44fe-4e63-a66f-d3c96ab05e5c None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:04.868759 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 344/691] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:04.873919 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2480656-44fe-4e63-a66f-d3c96ab05e5c None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:04.881449 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce6044-f2f4-42a5-9eab-f9e6fc0603a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:04.882107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce6044-f2f4-42a5-9eab-f9e6fc0603a3 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:04.882392 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce6044-f2f4-42a5-9eab-f9e6fc0603a3 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:04.883304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce6044-f2f4-42a5-9eab-f9e6fc0603a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:04.900311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce6044-f2f4-42a5-9eab-f9e6fc0603a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:04.901864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce6044-f2f4-42a5-9eab-f9e6fc0603a3 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:04.938863 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-13ce6044-f2f4-42a5-9eab-f9e6fc0603a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:04.938863 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:04.938863 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:04.938863 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:04.938863 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:04.938863 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:04.938863 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:04.938863 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:04.938863 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:04.938863 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:04.938863 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:04.938863 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:04.938863 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:39:04.938863 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:39:04.938863 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:39:04.938863 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:39:04.939885 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:04.939885 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:04.939885 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:04.939885 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:04.939885 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:04.939885 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:04.939885 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:04.939885 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:04.939885 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:04.939885 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:04.939885 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:04.939885 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:04.939885 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:04.939885 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:04.939885 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:04.939885 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:04.939885 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:39:04.940862 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:39:04.940862 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:04.940862 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:04.940862 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 348/692] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:39:04.947689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce6044-f2f4-42a5-9eab-f9e6fc0603a3 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:04.990512 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2480656-44fe-4e63-a66f-d3c96ab05e5c None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:05.030179 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f16fa-0185-481b-9226-2694e8a4148e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:05.031189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f16fa-0185-481b-9226-2694e8a4148e None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:05.031703 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f16fa-0185-481b-9226-2694e8a4148e None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:05.032196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f16fa-0185-481b-9226-2694e8a4148e None admin] PATH_INFO: `/v3/projects/service` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:05.040551 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f16fa-0185-481b-9226-2694e8a4148e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:05.042507 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f16fa-0185-481b-9226-2694e8a4148e None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:05.056594 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-456f16fa-0185-481b-9226-2694e8a4148e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:05.056594 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:05.056594 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:05.056594 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:05.056594 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:05.056594 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:05.056594 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:05.056594 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:05.056594 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:05.056594 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:05.056594 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:05.056594 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:05.056594 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:39:05.056594 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:39:05.056594 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:39:05.057804 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:39:05.057804 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:05.057804 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:05.057804 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:05.057804 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:05.057804 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:05.057804 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:05.057804 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:05.057804 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:05.057804 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:05.057804 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:05.057804 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:05.057804 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:05.057804 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:05.057804 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:05.057804 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:05.057804 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:05.058706 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:39:05.058706 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:39:05.058706 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:39:05.058706 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:39:05.058706 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:39:05.058706 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:39:05.058706 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:05.058706 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:05.061286 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 345/693] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:39:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:39:05.067029 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f16fa-0185-481b-9226-2694e8a4148e None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:05.120562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:05.223924 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f16fa-0185-481b-9226-2694e8a4148e None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:05.243494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce6044-f2f4-42a5-9eab-f9e6fc0603a3 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:05.267715 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7bcf9c-b8cb-45e1-ae3a-d14b146f52b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:05.268324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7bcf9c-b8cb-45e1-ae3a-d14b146f52b4 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:05.268603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7bcf9c-b8cb-45e1-ae3a-d14b146f52b4 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:05.268875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7bcf9c-b8cb-45e1-ae3a-d14b146f52b4 None admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:05.269861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7bcf9c-b8cb-45e1-ae3a-d14b146f52b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:05.270169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7bcf9c-b8cb-45e1-ae3a-d14b146f52b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:05.271629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7bcf9c-b8cb-45e1-ae3a-d14b146f52b4 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:05.293872 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 346/694] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Aug 6 20:39:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:05.299550 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7bcf9c-b8cb-45e1-ae3a-d14b146f52b4 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:05.301379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875368f-6dd3-4299-9763-27e42639382d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:05.302092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875368f-6dd3-4299-9763-27e42639382d None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:05.302438 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875368f-6dd3-4299-9763-27e42639382d None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:05.302880 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875368f-6dd3-4299-9763-27e42639382d None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:05.303595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e875368f-6dd3-4299-9763-27e42639382d None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:05.303966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e875368f-6dd3-4299-9763-27e42639382d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:05.306433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e875368f-6dd3-4299-9763-27e42639382d None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:05.320701 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 349/695] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:05.325907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875368f-6dd3-4299-9763-27e42639382d None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:05.353788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:05.434769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:05.440449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7bcf9c-b8cb-45e1-ae3a-d14b146f52b4 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:05.464802 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875368f-6dd3-4299-9763-27e42639382d None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:05.488287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182477e-3edc-4db7-a0bf-4cfd4318d993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:05.489351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182477e-3edc-4db7-a0bf-4cfd4318d993 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:05.489703 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182477e-3edc-4db7-a0bf-4cfd4318d993 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:05.490038 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182477e-3edc-4db7-a0bf-4cfd4318d993 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:05.490850 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182477e-3edc-4db7-a0bf-4cfd4318d993 None admin] RBAC: Adding query filter params (role.id=55fe0e239bac413b90c785211607e1a4, scope.project.id=6c4962342201407a89793c5c9a6a6f36, user.id=cd3e0e177f934f7ba5abe52ac8bf8bbb) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:05.491224 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182477e-3edc-4db7-a0bf-4cfd4318d993 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:05.493527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182477e-3edc-4db7-a0bf-4cfd4318d993 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:05.501968 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 347/696] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:39:05 2022] GET /identity/v3/role_assignments?user.id=cd3e0e177f934f7ba5abe52ac8bf8bbb&scope.project.id=6c4962342201407a89793c5c9a6a6f36&role.id=55fe0e239bac413b90c785211607e1a4 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:05.503563 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d708f-235f-472b-b4c1-7c204ffd98f9 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:05.504313 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d708f-235f-472b-b4c1-7c204ffd98f9 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:05.504760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d708f-235f-472b-b4c1-7c204ffd98f9 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:05.509770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe856e7-aeaa-456c-9fc9-0156eb75b704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:05.510725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe856e7-aeaa-456c-9fc9-0156eb75b704 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:05.511051 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 348/697] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:05.511380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe856e7-aeaa-456c-9fc9-0156eb75b704 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:05.511822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe856e7-aeaa-456c-9fc9-0156eb75b704 None admin] PATH_INFO: `/v3/users/nova` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:05.514964 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154e15e-60f1-41dc-94cf-928ff994cf5a None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:05.515249 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154e15e-60f1-41dc-94cf-928ff994cf5a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:05.515518 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154e15e-60f1-41dc-94cf-928ff994cf5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:05.521192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe856e7-aeaa-456c-9fc9-0156eb75b704 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:05.522873 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe856e7-aeaa-456c-9fc9-0156eb75b704 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:05.548736 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-5154e15e-60f1-41dc-94cf-928ff994cf5a None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:05.549983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5154e15e-60f1-41dc-94cf-928ff994cf5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:05.554914 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-7fe856e7-aeaa-456c-9fc9-0156eb75b704 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:39:05.554914 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:05.554914 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:05.554914 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:05.554914 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:05.554914 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:05.554914 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:05.554914 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:05.554914 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:05.554914 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:05.554914 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:05.554914 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:05.554914 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:39:05.554914 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:39:05.554914 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:39:05.554914 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:39:05.555905 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:05.555905 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:05.555905 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:39:05.555905 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:05.555905 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:39:05.555905 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:05.555905 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:05.555905 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:05.555905 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:05.555905 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:05.555905 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:05.555905 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:05.555905 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:05.555905 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:05.555905 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:05.555905 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:05.555905 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:05.555905 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:05.556853 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:05.556853 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:05.556853 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:39:05.556853 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:39:05.556853 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:39:05.556853 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:39:05.556853 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:39:05.556853 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:39:05.556853 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:39:05.556853 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:05.559722 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 350/698] 10.222.0.33 () {56 vars in 1093 bytes} [Sat Aug 6 20:39:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:05.562719 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe856e7-aeaa-456c-9fc9-0156eb75b704 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:05.691840 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 349/699] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:39:05.715067 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:05.738989 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154e15e-60f1-41dc-94cf-928ff994cf5a None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:05.743624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe856e7-aeaa-456c-9fc9-0156eb75b704 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:05.789521 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b4e91-03d1-4bf6-94ab-b11e70c9ff84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:05.790122 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b4e91-03d1-4bf6-94ab-b11e70c9ff84 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:05.790405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b4e91-03d1-4bf6-94ab-b11e70c9ff84 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:05.790713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b4e91-03d1-4bf6-94ab-b11e70c9ff84 None admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:05.791442 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b4e91-03d1-4bf6-94ab-b11e70c9ff84 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:05.791748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b4e91-03d1-4bf6-94ab-b11e70c9ff84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:05.793187 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b4e91-03d1-4bf6-94ab-b11e70c9ff84 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:05.812016 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 351/700] 10.222.0.33 () {56 vars in 1133 bytes} [Sat Aug 6 20:39:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:05.817204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b4e91-03d1-4bf6-94ab-b11e70c9ff84 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:05.877517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:05.885432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154e15e-60f1-41dc-94cf-928ff994cf5a None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:05.934184 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c53ce26-6ee9-4f8b-905c-27fe52f0737b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:05.935218 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53ce26-6ee9-4f8b-905c-27fe52f0737b None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:05.935502 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53ce26-6ee9-4f8b-905c-27fe52f0737b None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:05.935773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53ce26-6ee9-4f8b-905c-27fe52f0737b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:05.948456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b4e91-03d1-4bf6-94ab-b11e70c9ff84 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:05.949928 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c53ce26-6ee9-4f8b-905c-27fe52f0737b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:05.952296 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c53ce26-6ee9-4f8b-905c-27fe52f0737b None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:05.971585 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-5c53ce26-6ee9-4f8b-905c-27fe52f0737b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:05.971585 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:05.971585 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:05.971585 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:05.971585 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:05.971585 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:05.971585 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:05.971585 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:05.971585 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:05.971585 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:05.971585 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:05.971585 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:05.971585 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:39:05.971585 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:39:05.971585 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:39:05.971585 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:39:05.972796 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:05.972796 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:05.972796 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:05.972796 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:05.972796 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:05.972796 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:05.972796 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:05.972796 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:05.972796 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:05.972796 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:05.972796 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:05.972796 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:05.972796 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:05.972796 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:05.972796 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:05.972796 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:05.972796 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:39:05.973881 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:39:05.973881 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:05.973881 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:05.976037 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 350/701] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:39:05.981477 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c53ce26-6ee9-4f8b-905c-27fe52f0737b None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:05.995257 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6083b7b-277a-49bb-9443-6691c4b1c010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:05.996231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6083b7b-277a-49bb-9443-6691c4b1c010 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:05.996511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6083b7b-277a-49bb-9443-6691c4b1c010 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:05.996784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6083b7b-277a-49bb-9443-6691c4b1c010 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:06.004459 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:06.115832 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6083b7b-277a-49bb-9443-6691c4b1c010 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:06.119046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6083b7b-277a-49bb-9443-6691c4b1c010 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:06.158936 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c53ce26-6ee9-4f8b-905c-27fe52f0737b None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:06.244715 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 352/702] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:39:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 06 20:39:06.249048 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e133a-9be4-48d5-85bf-1b1c5d10b62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:06.249585 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e133a-9be4-48d5-85bf-1b1c5d10b62b None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:06.249873 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e133a-9be4-48d5-85bf-1b1c5d10b62b None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:06.250151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e133a-9be4-48d5-85bf-1b1c5d10b62b None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:06.250834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e133a-9be4-48d5-85bf-1b1c5d10b62b None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:06.251148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e133a-9be4-48d5-85bf-1b1c5d10b62b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:06.252098 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6083b7b-277a-49bb-9443-6691c4b1c010 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:06.252538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e133a-9be4-48d5-85bf-1b1c5d10b62b None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:06.276661 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 351/703] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:06.282151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e133a-9be4-48d5-85bf-1b1c5d10b62b None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:06.289651 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:06.291588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:06.400614 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6083b7b-277a-49bb-9443-6691c4b1c010 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:06.429621 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e133a-9be4-48d5-85bf-1b1c5d10b62b None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:06.467404 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385e528-a51d-4f88-9cc5-573cf013edd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:06.468548 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385e528-a51d-4f88-9cc5-573cf013edd2 None admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:06.469039 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385e528-a51d-4f88-9cc5-573cf013edd2 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:06.469539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385e528-a51d-4f88-9cc5-573cf013edd2 None admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:06.470367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f385e528-a51d-4f88-9cc5-573cf013edd2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:06.472059 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f385e528-a51d-4f88-9cc5-573cf013edd2 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:06.496294 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 352/704] 10.222.0.33 () {60 vars in 1132 bytes} [Sat Aug 6 20:39:06 2022] POST /identity/v3/users => generated 254 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:39:06.497305 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f8c8e-0617-4de8-9d31-56b41db8bc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:06.497957 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f8c8e-0617-4de8-9d31-56b41db8bc77 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:06.498239 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f8c8e-0617-4de8-9d31-56b41db8bc77 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:06.498508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f8c8e-0617-4de8-9d31-56b41db8bc77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:06.524558 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f8c8e-0617-4de8-9d31-56b41db8bc77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:06.526043 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f8c8e-0617-4de8-9d31-56b41db8bc77 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:06.552225 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-576f8c8e-0617-4de8-9d31-56b41db8bc77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:06.552225 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:06.552225 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:06.552225 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:06.552225 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:06.552225 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:06.552225 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:06.552225 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:06.552225 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:06.552225 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:06.552225 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:06.552225 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:06.552225 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:39:06.552225 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:39:06.552225 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:39:06.552225 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:39:06.553290 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:06.553290 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:06.553290 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:06.553290 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:06.553290 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:06.553290 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:06.553290 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:06.553290 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:06.553290 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:06.553290 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:06.553290 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:06.553290 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:06.553290 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:06.553290 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:06.553290 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:06.553290 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:06.553290 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:39:06.554812 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:39:06.554812 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:06.554812 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:06.556726 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 353/705] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:39:06.562613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385e528-a51d-4f88-9cc5-573cf013edd2 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:06.699688 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:06.720649 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385e528-a51d-4f88-9cc5-573cf013edd2 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:06.757222 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9526c-7e70-4be0-90c9-7f052d460822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:06.757789 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9526c-7e70-4be0-90c9-7f052d460822 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:06.758087 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9526c-7e70-4be0-90c9-7f052d460822 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:06.758399 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9526c-7e70-4be0-90c9-7f052d460822 None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:06.759036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9526c-7e70-4be0-90c9-7f052d460822 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:06.759347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9526c-7e70-4be0-90c9-7f052d460822 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:06.760864 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9526c-7e70-4be0-90c9-7f052d460822 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:06.773645 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 353/706] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:06.779105 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f8c8e-0617-4de8-9d31-56b41db8bc77 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:06.886537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:06.899907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f8c8e-0617-4de8-9d31-56b41db8bc77 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:06.940718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eed348-af68-43cc-b1e5-de0b9d9d3b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:06.941381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eed348-af68-43cc-b1e5-de0b9d9d3b84 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:06.941664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eed348-af68-43cc-b1e5-de0b9d9d3b84 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:06.941938 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eed348-af68-43cc-b1e5-de0b9d9d3b84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:06.950728 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eed348-af68-43cc-b1e5-de0b9d9d3b84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:06.952219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eed348-af68-43cc-b1e5-de0b9d9d3b84 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:06.965247 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-a5eed348-af68-43cc-b1e5-de0b9d9d3b84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:06.965247 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:06.965247 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:06.965247 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:06.965247 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:06.965247 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:06.965247 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:06.965247 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:06.965247 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:06.965247 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:06.965247 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:06.965247 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:06.965247 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:39:06.965247 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:39:06.965247 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:39:06.966210 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:39:06.966210 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:06.966210 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:06.966210 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:06.966210 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:06.966210 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:06.966210 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:06.966210 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:06.966210 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:06.966210 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:06.966210 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:06.966210 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:06.966210 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:06.966210 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:06.966210 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:06.966210 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:06.966210 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:06.967161 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:39:06.967161 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:39:06.967161 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:39:06.967161 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:39:06.967161 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:39:06.967161 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:39:06.967161 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:06.967161 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:06.967161 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 354/707] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:39:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:06.973904 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9526c-7e70-4be0-90c9-7f052d460822 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:07.081644 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9526c-7e70-4be0-90c9-7f052d460822 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:07.100216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c65c2-04fa-450a-85c4-ba417b2d2266 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:07.100507 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c65c2-04fa-450a-85c4-ba417b2d2266 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:07.100768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c65c2-04fa-450a-85c4-ba417b2d2266 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:07.104345 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 355/708] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:39:07.108627 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a079bf2-14b3-4f43-bbb1-8c771f88d9b6 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:07.108910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a079bf2-14b3-4f43-bbb1-8c771f88d9b6 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:07.109184 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a079bf2-14b3-4f43-bbb1-8c771f88d9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:07.112512 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:07.130839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-3a079bf2-14b3-4f43-bbb1-8c771f88d9b6 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:07.132388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3a079bf2-14b3-4f43-bbb1-8c771f88d9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:07.141085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86da7f4-3775-4001-9ee6-7403b00685f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:07.141758 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86da7f4-3775-4001-9ee6-7403b00685f0 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:07.142093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86da7f4-3775-4001-9ee6-7403b00685f0 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:07.142375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86da7f4-3775-4001-9ee6-7403b00685f0 None admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:07.143098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86da7f4-3775-4001-9ee6-7403b00685f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:07.143409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86da7f4-3775-4001-9ee6-7403b00685f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:07.144840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86da7f4-3775-4001-9ee6-7403b00685f0 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:07.171903 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 354/709] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Aug 6 20:39:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:07.178588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86da7f4-3775-4001-9ee6-7403b00685f0 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:07.273295 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 356/710] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:39:07.313161 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a079bf2-14b3-4f43-bbb1-8c771f88d9b6 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:07.369276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86da7f4-3775-4001-9ee6-7403b00685f0 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:07.410066 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8392d-a3de-402f-9051-b1d41dcf0714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:07.411073 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8392d-a3de-402f-9051-b1d41dcf0714 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:07.411580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8392d-a3de-402f-9051-b1d41dcf0714 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:07.412057 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8392d-a3de-402f-9051-b1d41dcf0714 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:07.413095 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a8392d-a3de-402f-9051-b1d41dcf0714 None admin] RBAC: Adding query filter params (role.id=ab245eea8a714462a00c4546309de9c9, scope.project.id=6c4962342201407a89793c5c9a6a6f36, user.id=5f9d53147a57402f8b9818590bc1fc1f) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:07.413752 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a8392d-a3de-402f-9051-b1d41dcf0714 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:07.415421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a8392d-a3de-402f-9051-b1d41dcf0714 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:07.421954 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 355/711] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:39:07 2022] GET /identity/v3/role_assignments?user.id=5f9d53147a57402f8b9818590bc1fc1f&scope.project.id=6c4962342201407a89793c5c9a6a6f36&role.id=ab245eea8a714462a00c4546309de9c9 => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:07.423684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72769b0d-2252-47bb-9db1-50852401b629 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:07.424208 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72769b0d-2252-47bb-9db1-50852401b629 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:07.424689 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72769b0d-2252-47bb-9db1-50852401b629 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:07.426956 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:07.428012 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 356/712] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:07.433809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47860234-a549-464d-848e-214a8fa67cdd None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:07.434138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47860234-a549-464d-848e-214a8fa67cdd None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:07.434363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47860234-a549-464d-848e-214a8fa67cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:07.455040 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-47860234-a549-464d-848e-214a8fa67cdd None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:07.458574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-47860234-a549-464d-848e-214a8fa67cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:07.481600 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a079bf2-14b3-4f43-bbb1-8c771f88d9b6 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:07.508316 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:07.538118 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 357/713] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:39:07.553997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e464b-7568-4553-891f-03383c7d95af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:07.555261 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e464b-7568-4553-891f-03383c7d95af None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:07.555533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e464b-7568-4553-891f-03383c7d95af None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:07.555806 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e464b-7568-4553-891f-03383c7d95af None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:07.556403 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e464b-7568-4553-891f-03383c7d95af None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:07.558084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e464b-7568-4553-891f-03383c7d95af None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:07.570318 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-211e464b-7568-4553-891f-03383c7d95af None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 20:39:07.570318 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:07.570318 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:39:07.570318 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:39:07.570318 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:39:07.570318 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:39:07.570318 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:39:07.570318 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:07.570318 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 20:39:07.570318 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:07.570318 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:39:07.570318 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:07.570318 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:07.570318 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:07.570318 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:07.570318 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:07.570318 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:07.571691 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:07.571691 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:07.571691 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:07.571691 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:07.571691 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:07.571691 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:07.571691 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:39:07.571691 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:39:07.571691 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:39:07.571691 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:39:07.571691 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:07.571691 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:07.571691 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:07.571691 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:07.571691 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:07.571691 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:07.573260 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:07.573260 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:07.573260 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:07.573260 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:07.573260 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:07.573260 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:07.573260 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:07.573260 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:07.573260 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:07.573260 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:07.573260 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:39:07.573260 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:07.573260 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 20:39:07.573260 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:07.573260 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 357/714] 10.222.0.33 () {56 vars in 1129 bytes} [Sat Aug 6 20:39:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:39:07.575279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47860234-a549-464d-848e-214a8fa67cdd None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:07.587444 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e464b-7568-4553-891f-03383c7d95af None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:07.750616 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e464b-7568-4553-891f-03383c7d95af None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:07.789720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47860234-a549-464d-848e-214a8fa67cdd None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:07.801004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89609316-af39-4f14-8595-76ff0dfb4201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:07.801621 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89609316-af39-4f14-8595-76ff0dfb4201 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:07.801898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89609316-af39-4f14-8595-76ff0dfb4201 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:07.802167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89609316-af39-4f14-8595-76ff0dfb4201 None admin] PATH_INFO: `/v3/services` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:07.802829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89609316-af39-4f14-8595-76ff0dfb4201 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:07.803133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89609316-af39-4f14-8595-76ff0dfb4201 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:07.804773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89609316-af39-4f14-8595-76ff0dfb4201 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:07.816794 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 358/715] 10.222.0.33 () {56 vars in 1124 bytes} [Sat Aug 6 20:39:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:07.822377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89609316-af39-4f14-8595-76ff0dfb4201 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:07.837082 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:07.857757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900efe95-22be-4739-af72-dc3587fd4157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:07.858402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900efe95-22be-4739-af72-dc3587fd4157 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:07.858720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900efe95-22be-4739-af72-dc3587fd4157 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:07.858996 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900efe95-22be-4739-af72-dc3587fd4157 None admin] PATH_INFO: `/v3/services/network` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:07.859586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900efe95-22be-4739-af72-dc3587fd4157 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:07.861028 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900efe95-22be-4739-af72-dc3587fd4157 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:07.878070 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-900efe95-22be-4739-af72-dc3587fd4157 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 20:39:07.878070 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:07.878070 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:39:07.878070 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:39:07.878070 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:39:07.878070 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:39:07.878070 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:39:07.878070 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:07.878070 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 20:39:07.878070 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:07.878070 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:39:07.878070 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:07.878070 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:07.878070 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:07.878070 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:07.878070 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:07.878070 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:07.879155 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:07.879155 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:07.879155 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:07.879155 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:07.879155 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:07.879155 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:07.879155 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:39:07.879155 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:39:07.879155 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:39:07.879155 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:39:07.879155 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:07.879155 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:07.879155 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:07.879155 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:07.879155 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:07.879155 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:07.880650 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:07.880650 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:07.880650 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:07.880650 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:07.880650 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:07.880650 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:07.880650 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:07.880650 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:07.880650 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:07.880650 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:07.880650 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:39:07.880650 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:07.880650 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 20:39:07.880650 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:07.880650 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 358/716] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:39:07 2022] GET /identity/v3/services/network => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:39:07.887468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900efe95-22be-4739-af72-dc3587fd4157 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:07.935045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:07.986409 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89609316-af39-4f14-8595-76ff0dfb4201 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:08.025721 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106acd7-9d23-4d0d-b8e5-6c064ced14ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:08.026456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106acd7-9d23-4d0d-b8e5-6c064ced14ae None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:08.026780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106acd7-9d23-4d0d-b8e5-6c064ced14ae None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:08.027053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106acd7-9d23-4d0d-b8e5-6c064ced14ae None admin] PATH_INFO: `/v3/services` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:08.027693 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106acd7-9d23-4d0d-b8e5-6c064ced14ae None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:08.027996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106acd7-9d23-4d0d-b8e5-6c064ced14ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:08.029378 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106acd7-9d23-4d0d-b8e5-6c064ced14ae None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:08.036286 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 359/717] 10.222.0.33 () {56 vars in 1124 bytes} [Sat Aug 6 20:39:07 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:08.084690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900efe95-22be-4739-af72-dc3587fd4157 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:08.140503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3103a0f-1350-45b2-8d2d-b1ab95c09ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:08.141125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3103a0f-1350-45b2-8d2d-b1ab95c09ac5 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:08.141404 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3103a0f-1350-45b2-8d2d-b1ab95c09ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:08.141676 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3103a0f-1350-45b2-8d2d-b1ab95c09ac5 None admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:08.142307 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3103a0f-1350-45b2-8d2d-b1ab95c09ac5 None admin] RBAC: Adding query filter params (name=network) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:08.142632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3103a0f-1350-45b2-8d2d-b1ab95c09ac5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:08.144061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3103a0f-1350-45b2-8d2d-b1ab95c09ac5 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:08.151302 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 359/718] 10.222.0.33 () {56 vars in 1112 bytes} [Sat Aug 6 20:39:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:08.156998 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106acd7-9d23-4d0d-b8e5-6c064ced14ae None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:08.283372 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:08.327610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106acd7-9d23-4d0d-b8e5-6c064ced14ae None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:08.368202 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f73d7f-448d-4808-bf4d-8a8f02a30a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:08.368840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f73d7f-448d-4808-bf4d-8a8f02a30a7d None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:08.369125 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f73d7f-448d-4808-bf4d-8a8f02a30a7d None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:08.369400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f73d7f-448d-4808-bf4d-8a8f02a30a7d None admin] PATH_INFO: `/v3/services` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:08.370046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f73d7f-448d-4808-bf4d-8a8f02a30a7d None admin] RBAC: Adding query filter params (type=network) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:08.370353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f73d7f-448d-4808-bf4d-8a8f02a30a7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:08.371785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f73d7f-448d-4808-bf4d-8a8f02a30a7d None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:08.379600 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 360/719] 10.222.0.33 () {56 vars in 1112 bytes} [Sat Aug 6 20:39:08 2022] GET /identity/v3/services?type=network => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:08.572415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6e85f-73e9-459e-8f79-0a9ed63a6edb None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:08.572900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6e85f-73e9-459e-8f79-0a9ed63a6edb None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:08.572900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6e85f-73e9-459e-8f79-0a9ed63a6edb None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:08.574444 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 360/720] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:08.580761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6fbc0-fec4-410c-a0d9-6b0f4fe35c17 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:08.581050 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6fbc0-fec4-410c-a0d9-6b0f4fe35c17 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:08.581333 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6fbc0-fec4-410c-a0d9-6b0f4fe35c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:08.604660 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-63c6fbc0-fec4-410c-a0d9-6b0f4fe35c17 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:08.605862 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-63c6fbc0-fec4-410c-a0d9-6b0f4fe35c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:08.708422 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 361/721] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:39:08.752182 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6e85f-73e9-459e-8f79-0a9ed63a6edb None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:08.901444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6e85f-73e9-459e-8f79-0a9ed63a6edb None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:08.902991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:08.945921 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51c731-cca7-408e-adc5-797d1d96c1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:08.946576 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51c731-cca7-408e-adc5-797d1d96c1b7 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:08.946873 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51c731-cca7-408e-adc5-797d1d96c1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:08.947151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51c731-cca7-408e-adc5-797d1d96c1b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:08.957668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51c731-cca7-408e-adc5-797d1d96c1b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:39:08.963911 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-cf51c731-cca7-408e-adc5-797d1d96c1b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:39:08.963911 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:08.963911 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:08.963911 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:08.963911 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:08.963911 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:08.963911 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:08.963911 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:08.963911 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:08.963911 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:08.963911 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:08.963911 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:08.963911 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:39:08.963911 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:39:08.963911 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:39:08.963911 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:39:08.964892 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:39:08.964892 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:39:08.964892 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:39:08.964892 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:39:08.964892 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:08.964892 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:08.964892 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:08.964892 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:08.964892 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:08.964892 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:08.964892 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:08.964892 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:08.964892 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:08.964892 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:08.964892 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:08.964892 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:08.965739 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:08.965739 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:08.965739 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:08.965739 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:08.965739 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:39:08.965739 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:39:08.965739 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:39:08.965739 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:39:08.965739 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:39:08.965739 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:39:08.965739 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:39:08.965739 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:08.965739 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 361/722] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Aug 6 20:39:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:08.975664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6fbc0-fec4-410c-a0d9-6b0f4fe35c17 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:09.080345 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:09.126771 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6fbc0-fec4-410c-a0d9-6b0f4fe35c17 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:09.179525 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccdf585-5a03-4522-818c-fe433aea9967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:09.180061 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdf585-5a03-4522-818c-fe433aea9967 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:09.180341 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdf585-5a03-4522-818c-fe433aea9967 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:09.180614 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdf585-5a03-4522-818c-fe433aea9967 None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:09.181287 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccdf585-5a03-4522-818c-fe433aea9967 None admin] RBAC: Adding query filter params (name=admin) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:09.181592 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccdf585-5a03-4522-818c-fe433aea9967 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:09.183244 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccdf585-5a03-4522-818c-fe433aea9967 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:09.198921 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 362/723] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:39:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:09.203961 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51c731-cca7-408e-adc5-797d1d96c1b7 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:09.360660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51c731-cca7-408e-adc5-797d1d96c1b7 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:09.404189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fca667-875a-48f9-b76b-409f6227b975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:09.404829 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fca667-875a-48f9-b76b-409f6227b975 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:09.405108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fca667-875a-48f9-b76b-409f6227b975 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:09.405384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fca667-875a-48f9-b76b-409f6227b975 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:09.416057 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fca667-875a-48f9-b76b-409f6227b975 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:09.417498 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fca667-875a-48f9-b76b-409f6227b975 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:09.433362 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-b0fca667-875a-48f9-b76b-409f6227b975 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:09.433362 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:09.433362 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:09.433362 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:09.433362 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:09.433362 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:09.433362 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:09.433362 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:09.433362 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:09.433362 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:09.433362 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:09.433362 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:09.433362 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:39:09.433362 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:39:09.433362 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:39:09.433362 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:39:09.434360 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:09.434360 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:09.434360 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:09.434360 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:09.434360 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:09.434360 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:09.434360 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:09.434360 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:09.434360 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:09.434360 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:09.434360 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:09.434360 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:09.434360 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:09.434360 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:09.434360 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:09.434360 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:09.434360 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:39:09.435576 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:39:09.435576 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:09.435576 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:09.435576 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 362/724] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:09.443626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccdf585-5a03-4522-818c-fe433aea9967 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:09.621910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccdf585-5a03-4522-818c-fe433aea9967 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:09.660561 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:09.662991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf8499-5651-4140-bacb-5c63d371f98a None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:09.663526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf8499-5651-4140-bacb-5c63d371f98a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:09.663900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf8499-5651-4140-bacb-5c63d371f98a None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:09.665659 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 363/725] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:09.670885 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564e991-1e7d-456c-8c12-644c59a7681c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:09.671164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564e991-1e7d-456c-8c12-644c59a7681c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:09.671436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564e991-1e7d-456c-8c12-644c59a7681c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:09.691489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-5564e991-1e7d-456c-8c12-644c59a7681c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:09.692594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5564e991-1e7d-456c-8c12-644c59a7681c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:09.696950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a014c-1886-4d63-851d-892a19baa505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:09.697576 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a014c-1886-4d63-851d-892a19baa505 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:09.697860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a014c-1886-4d63-851d-892a19baa505 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:09.698132 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a014c-1886-4d63-851d-892a19baa505 None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:09.698810 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a014c-1886-4d63-851d-892a19baa505 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:09.699117 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a014c-1886-4d63-851d-892a19baa505 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:09.700494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a014c-1886-4d63-851d-892a19baa505 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:09.702689 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:09.724804 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 363/726] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:09.732350 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a014c-1886-4d63-851d-892a19baa505 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:09.782641 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 364/727] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:39:09.818371 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564e991-1e7d-456c-8c12-644c59a7681c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:09.879835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a014c-1886-4d63-851d-892a19baa505 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:09.937470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a32e1-6f27-402d-a9a4-daa9d38644c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:09.938733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a32e1-6f27-402d-a9a4-daa9d38644c7 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:09.939684 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a32e1-6f27-402d-a9a4-daa9d38644c7 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:09.940187 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a32e1-6f27-402d-a9a4-daa9d38644c7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:09.950219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a32e1-6f27-402d-a9a4-daa9d38644c7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:09.952437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a32e1-6f27-402d-a9a4-daa9d38644c7 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:09.968047 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-650a32e1-6f27-402d-a9a4-daa9d38644c7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 06 20:39:09.968047 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:09.968047 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:09.968047 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:09.968047 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:09.968047 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:09.968047 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:09.968047 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:09.968047 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:09.968047 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:09.968047 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:09.968047 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:09.968047 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:39:09.968047 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:39:09.968047 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:39:09.968047 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:39:09.969092 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:09.969092 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:09.969092 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:39:09.969092 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:09.969092 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:39:09.969092 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:09.969092 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:09.969092 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:09.969092 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:09.969092 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:09.969092 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:09.969092 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:09.969092 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:09.969092 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:09.969092 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:09.969092 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:09.969092 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:09.969092 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:09.970037 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:09.970037 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:09.970037 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:39:09.970037 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:39:09.970037 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:39:09.970037 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:39:09.970037 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:39:09.970037 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:39:09.970037 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 06 20:39:09.970037 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:09.973078 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 364/728] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Aug 6 20:39:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:09.979154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a32e1-6f27-402d-a9a4-daa9d38644c7 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:10.050358 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564e991-1e7d-456c-8c12-644c59a7681c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:10.083546 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:10.095260 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513dbfb2-4cd9-4f47-8fa3-695f06636877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:10.096296 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dbfb2-4cd9-4f47-8fa3-695f06636877 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:10.096779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dbfb2-4cd9-4f47-8fa3-695f06636877 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:10.097267 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dbfb2-4cd9-4f47-8fa3-695f06636877 None admin] PATH_INFO: `/v3/roles/service` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:10.117927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513dbfb2-4cd9-4f47-8fa3-695f06636877 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:39:10.123028 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-513dbfb2-4cd9-4f47-8fa3-695f06636877 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:39:10.123028 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:10.123028 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:10.123028 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:10.123028 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:10.123028 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:10.123028 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:10.123028 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:10.123028 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:10.123028 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:10.123028 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:10.123028 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:10.123028 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:39:10.123028 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:39:10.123028 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:39:10.123028 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:39:10.123988 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:39:10.123988 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:39:10.123988 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:39:10.123988 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:39:10.123988 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:10.123988 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:10.123988 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:10.123988 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:10.123988 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:10.123988 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:10.123988 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:10.123988 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:10.123988 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:10.123988 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:10.123988 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:10.123988 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:10.124852 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:10.124852 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:10.124852 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:10.124852 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:10.124852 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:39:10.124852 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:39:10.124852 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:39:10.124852 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:39:10.124852 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:39:10.124852 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:39:10.124852 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:39:10.124852 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:10.129123 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 365/729] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Aug 6 20:39:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:39:10.130374 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c72f6d-0052-4746-9016-d9773c3c82ab None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:10.130706 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c72f6d-0052-4746-9016-d9773c3c82ab None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:10.130991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c72f6d-0052-4746-9016-d9773c3c82ab None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:10.136307 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 366/730] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:10.137808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a159c2-8201-49ac-b72a-d4168454f1d1 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:10.138092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a159c2-8201-49ac-b72a-d4168454f1d1 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:10.138574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a159c2-8201-49ac-b72a-d4168454f1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:10.147061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:10.158915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-84a159c2-8201-49ac-b72a-d4168454f1d1 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:10.160105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-84a159c2-8201-49ac-b72a-d4168454f1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:10.164775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a32e1-6f27-402d-a9a4-daa9d38644c7 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:10.209089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dcada7-f530-47b3-9180-6f1d958798c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:10.210927 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcada7-f530-47b3-9180-6f1d958798c6 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:10.211869 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcada7-f530-47b3-9180-6f1d958798c6 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:10.212603 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcada7-f530-47b3-9180-6f1d958798c6 None admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:10.213555 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dcada7-f530-47b3-9180-6f1d958798c6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:10.214284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dcada7-f530-47b3-9180-6f1d958798c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:10.216339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dcada7-f530-47b3-9180-6f1d958798c6 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:10.240952 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 365/731] 10.222.0.33 () {56 vars in 1135 bytes} [Sat Aug 6 20:39:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:10.242475 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dcada7-f530-47b3-9180-6f1d958798c6 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:10.249567 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 367/732] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:39:10.250686 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a159c2-8201-49ac-b72a-d4168454f1d1 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:10.362345 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dcada7-f530-47b3-9180-6f1d958798c6 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:10.365089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:10.378055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a159c2-8201-49ac-b72a-d4168454f1d1 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:10.401869 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc632b8-b314-4dd8-8bd8-4ab0134347d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:10.402851 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc632b8-b314-4dd8-8bd8-4ab0134347d4 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:10.403333 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc632b8-b314-4dd8-8bd8-4ab0134347d4 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:10.403958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc632b8-b314-4dd8-8bd8-4ab0134347d4 None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:10.404833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc632b8-b314-4dd8-8bd8-4ab0134347d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:10.405332 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc632b8-b314-4dd8-8bd8-4ab0134347d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:10.406912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc632b8-b314-4dd8-8bd8-4ab0134347d4 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:10.415395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97558c20-e8ed-4642-8cc8-8b3632ac3813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:10.416008 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97558c20-e8ed-4642-8cc8-8b3632ac3813 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:10.416291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97558c20-e8ed-4642-8cc8-8b3632ac3813 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:10.416567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97558c20-e8ed-4642-8cc8-8b3632ac3813 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:10.417596 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 366/733] 10.222.0.33 () {56 vars in 1103 bytes} [Sat Aug 6 20:39:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:10.418618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc632b8-b314-4dd8-8bd8-4ab0134347d4 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:10.424204 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:10.497022 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97558c20-e8ed-4642-8cc8-8b3632ac3813 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:10.498531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97558c20-e8ed-4642-8cc8-8b3632ac3813 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:10.526306 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc632b8-b314-4dd8-8bd8-4ab0134347d4 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:10.563536 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5232d7-d960-4062-a718-0b1554dcd9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:10.564572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5232d7-d960-4062-a718-0b1554dcd9a9 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:10.565052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5232d7-d960-4062-a718-0b1554dcd9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:10.565523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5232d7-d960-4062-a718-0b1554dcd9a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:10.576855 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5232d7-d960-4062-a718-0b1554dcd9a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:39:10.582437 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-fe5232d7-d960-4062-a718-0b1554dcd9a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:39:10.582437 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:10.582437 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:10.582437 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:10.582437 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:10.582437 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:10.582437 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:10.582437 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:10.582437 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:10.582437 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:10.582437 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:10.582437 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:10.582437 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:39:10.582437 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:39:10.582437 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:39:10.582437 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:39:10.583568 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:39:10.583568 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:39:10.583568 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:39:10.583568 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:39:10.583568 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:10.583568 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:10.583568 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:10.583568 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:10.583568 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:10.583568 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:10.583568 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:10.583568 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:10.583568 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:10.583568 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:10.583568 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:10.583568 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:10.584413 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:10.584413 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:10.584413 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:10.584413 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:10.584413 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:39:10.584413 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:39:10.584413 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:39:10.584413 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:39:10.584413 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:39:10.584413 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:39:10.584413 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:39:10.584413 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:10.587414 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 367/734] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Aug 6 20:39:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:10.588423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5232d7-d960-4062-a718-0b1554dcd9a9 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:10.612015 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 368/735] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:39:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:10.612673 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97558c20-e8ed-4642-8cc8-8b3632ac3813 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:10.618947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:10.649436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:10.699043 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5232d7-d960-4062-a718-0b1554dcd9a9 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:10.733880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97558c20-e8ed-4642-8cc8-8b3632ac3813 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:10.736214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a80ce-0427-4996-acf4-e1ba87ac4da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:10.737104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a80ce-0427-4996-acf4-e1ba87ac4da2 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:10.737581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a80ce-0427-4996-acf4-e1ba87ac4da2 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:10.738048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a80ce-0427-4996-acf4-e1ba87ac4da2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:10.750435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a80ce-0427-4996-acf4-e1ba87ac4da2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:10.752253 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a80ce-0427-4996-acf4-e1ba87ac4da2 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:10.767724 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-ea6a80ce-0427-4996-acf4-e1ba87ac4da2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:10.767724 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:10.767724 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:10.767724 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:10.767724 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:10.767724 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:10.767724 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:10.767724 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:10.767724 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:10.767724 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:10.767724 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:10.767724 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:10.767724 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:39:10.767724 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:39:10.767724 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:39:10.767724 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:39:10.768738 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:10.768738 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:10.768738 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:10.768738 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:10.768738 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:10.768738 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:10.768738 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:10.768738 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:10.768738 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:10.768738 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:10.768738 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:10.768738 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:10.768738 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:10.768738 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:10.768738 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:10.768738 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:10.768738 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:39:10.769631 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:39:10.769631 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:10.769631 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:10.771956 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 368/736] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:10.773869 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a80ce-0427-4996-acf4-e1ba87ac4da2 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:10.779461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4ac83-cebe-4cf3-b657-c4e428353d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:10.780145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4ac83-cebe-4cf3-b657-c4e428353d23 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:10.780432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4ac83-cebe-4cf3-b657-c4e428353d23 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:10.780709 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4ac83-cebe-4cf3-b657-c4e428353d23 None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:10.781413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4ac83-cebe-4cf3-b657-c4e428353d23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:10.781723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4ac83-cebe-4cf3-b657-c4e428353d23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:10.783189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4ac83-cebe-4cf3-b657-c4e428353d23 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:10.798390 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 369/737] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:39:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:10.799469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4ac83-cebe-4cf3-b657-c4e428353d23 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:10.862997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:10.888290 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a80ce-0427-4996-acf4-e1ba87ac4da2 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:10.908688 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:10.916831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4ac83-cebe-4cf3-b657-c4e428353d23 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:10.924303 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58913ef7-3753-4598-b4dc-40bed94d8564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:10.925281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58913ef7-3753-4598-b4dc-40bed94d8564 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:10.925776 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58913ef7-3753-4598-b4dc-40bed94d8564 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:10.926260 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58913ef7-3753-4598-b4dc-40bed94d8564 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:10.939725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58913ef7-3753-4598-b4dc-40bed94d8564 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:10.941628 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58913ef7-3753-4598-b4dc-40bed94d8564 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:10.958871 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12dea0-8a7f-47f2-b0a0-af881220fbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:10.959367 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-58913ef7-3753-4598-b4dc-40bed94d8564 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:10.959367 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:10.959367 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:10.959367 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:10.959367 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:10.959367 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:10.959367 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:10.959367 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:10.959367 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:10.959367 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:10.959367 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:10.959367 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:10.959367 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:39:10.959367 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:39:10.959367 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:39:10.959367 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:39:10.960427 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:10.960427 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:10.960427 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:10.960427 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:10.960427 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:10.960427 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:10.960427 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:10.960427 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:10.960427 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:10.960427 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:10.960427 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:10.960427 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:10.960427 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:10.960427 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:10.960427 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:10.960427 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:10.960427 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:39:10.961328 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:39:10.961328 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:10.961328 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:10.961501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12dea0-8a7f-47f2-b0a0-af881220fbd3 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:10.961501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12dea0-8a7f-47f2-b0a0-af881220fbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:10.961501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12dea0-8a7f-47f2-b0a0-af881220fbd3 None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:10.961501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e12dea0-8a7f-47f2-b0a0-af881220fbd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:10.961501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e12dea0-8a7f-47f2-b0a0-af881220fbd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:10.962397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e12dea0-8a7f-47f2-b0a0-af881220fbd3 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:10.963797 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 369/738] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:10.964860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58913ef7-3753-4598-b4dc-40bed94d8564 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:10.979696 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 370/739] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:10.981261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14dd5a-00aa-45b3-8cc6-5ad40c82b279 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:10.981638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14dd5a-00aa-45b3-8cc6-5ad40c82b279 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:10.981987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14dd5a-00aa-45b3-8cc6-5ad40c82b279 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:10.983564 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 371/740] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:10.984761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14dd5a-00aa-45b3-8cc6-5ad40c82b279 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:11.075947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58913ef7-3753-4598-b4dc-40bed94d8564 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:11.092989 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14dd5a-00aa-45b3-8cc6-5ad40c82b279 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:11.105238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:11.111522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca33b3-f840-4a87-a636-07bf8629dd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:11.112146 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca33b3-f840-4a87-a636-07bf8629dd86 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:11.112427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca33b3-f840-4a87-a636-07bf8629dd86 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:11.112700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca33b3-f840-4a87-a636-07bf8629dd86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:11.123835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca33b3-f840-4a87-a636-07bf8629dd86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:11.125281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca33b3-f840-4a87-a636-07bf8629dd86 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:11.127272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28fd1e-f580-49fb-8bd8-356820738ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:11.127864 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28fd1e-f580-49fb-8bd8-356820738ded None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:11.128140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28fd1e-f580-49fb-8bd8-356820738ded None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:11.128408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28fd1e-f580-49fb-8bd8-356820738ded None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:11.129033 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d28fd1e-f580-49fb-8bd8-356820738ded None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:11.129331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d28fd1e-f580-49fb-8bd8-356820738ded None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:11.130685 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d28fd1e-f580-49fb-8bd8-356820738ded None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:11.139814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-c9ca33b3-f840-4a87-a636-07bf8629dd86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:11.139814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:11.139814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:11.139814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:11.139814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:11.139814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:11.139814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:11.139814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:11.139814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:11.139814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:11.139814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:11.139814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:11.139814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:39:11.139814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:39:11.139814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:39:11.139814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:39:11.140880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:11.140880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:11.140880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:11.140880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:11.140880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:11.140880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:11.140880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:11.140880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:11.140880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:11.140880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:11.140880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:11.140880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:11.140880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:11.140880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:11.140880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:11.140880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:11.140880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:39:11.141754 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:39:11.141754 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:11.141754 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:11.141754 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 370/741] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:11.141988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca33b3-f840-4a87-a636-07bf8629dd86 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:11.142528 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 372/742] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:11.143733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6404f0f-b895-47e5-a2fd-b1a7a104e804 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:11.144015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6404f0f-b895-47e5-a2fd-b1a7a104e804 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:11.144285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6404f0f-b895-47e5-a2fd-b1a7a104e804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:11.162333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-c6404f0f-b895-47e5-a2fd-b1a7a104e804 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:11.163629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c6404f0f-b895-47e5-a2fd-b1a7a104e804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:11.173970 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:11.231652 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 373/743] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:39:11.232699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14e864-fb18-47a9-bad2-f2d998b4dbd7 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:11.232985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14e864-fb18-47a9-bad2-f2d998b4dbd7 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:11.233259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14e864-fb18-47a9-bad2-f2d998b4dbd7 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:11.234470 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 374/744] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:11.235196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14e864-fb18-47a9-bad2-f2d998b4dbd7 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:11.259992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca33b3-f840-4a87-a636-07bf8629dd86 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:11.294241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837120eb-595a-430d-a978-30f09ea52dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:11.294906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837120eb-595a-430d-a978-30f09ea52dd2 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:11.295193 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837120eb-595a-430d-a978-30f09ea52dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:11.295459 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837120eb-595a-430d-a978-30f09ea52dd2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:11.302797 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837120eb-595a-430d-a978-30f09ea52dd2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:11.305078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837120eb-595a-430d-a978-30f09ea52dd2 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:11.316208 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-837120eb-595a-430d-a978-30f09ea52dd2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 20:39:11.316208 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:11.316208 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:11.316208 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:11.316208 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:11.316208 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:11.316208 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:11.316208 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:11.316208 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:11.316208 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:11.316208 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:11.316208 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:11.316208 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:39:11.316208 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:39:11.316208 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:39:11.316208 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:39:11.317296 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:11.317296 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:11.317296 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:39:11.317296 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:11.317296 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:39:11.317296 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:11.317296 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:11.317296 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:11.317296 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:11.317296 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:11.317296 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:11.317296 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:11.317296 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:11.317296 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:11.317296 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:11.317296 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:11.317296 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:11.317296 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:11.318244 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:11.318244 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:11.318244 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:39:11.318244 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:39:11.318244 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:39:11.318244 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:39:11.318244 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:39:11.318244 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:39:11.318244 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 20:39:11.318244 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:11.318244 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 371/745] 10.222.0.33 () {56 vars in 1117 bytes} [Sat Aug 6 20:39:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:11.318244 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837120eb-595a-430d-a978-30f09ea52dd2 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:11.345194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14e864-fb18-47a9-bad2-f2d998b4dbd7 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:11.360761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:11.379954 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3259f-9c6c-4bed-8d16-a79fd616d3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:11.380556 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3259f-9c6c-4bed-8d16-a79fd616d3bc None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:11.380837 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3259f-9c6c-4bed-8d16-a79fd616d3bc None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:11.381112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3259f-9c6c-4bed-8d16-a79fd616d3bc None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:11.381747 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb3259f-9c6c-4bed-8d16-a79fd616d3bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:11.382077 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb3259f-9c6c-4bed-8d16-a79fd616d3bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:11.383475 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb3259f-9c6c-4bed-8d16-a79fd616d3bc None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:11.394557 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 375/746] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:11.395835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43c0b9-d790-4d10-a9ad-677909e5e6de None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:11.396130 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43c0b9-d790-4d10-a9ad-677909e5e6de None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:11.396406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43c0b9-d790-4d10-a9ad-677909e5e6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:11.408951 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:11.414922 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-6e43c0b9-d790-4d10-a9ad-677909e5e6de None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:11.416105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6e43c0b9-d790-4d10-a9ad-677909e5e6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:11.422774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837120eb-595a-430d-a978-30f09ea52dd2 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:11.455904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1dff4-d52a-4caa-b04d-af77f62bf99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:11.456526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1dff4-d52a-4caa-b04d-af77f62bf99e None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:11.456807 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1dff4-d52a-4caa-b04d-af77f62bf99e None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:11.457081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1dff4-d52a-4caa-b04d-af77f62bf99e None admin] PATH_INFO: `/v3/projects/service` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:11.463675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1dff4-d52a-4caa-b04d-af77f62bf99e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:11.465119 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1dff4-d52a-4caa-b04d-af77f62bf99e None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:11.477088 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-d9a1dff4-d52a-4caa-b04d-af77f62bf99e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:11.477088 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:11.477088 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:11.477088 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:11.477088 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:11.477088 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:11.477088 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:11.477088 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:11.477088 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:11.477088 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:11.477088 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:11.477088 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:11.477088 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:39:11.477088 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:39:11.477088 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:39:11.478053 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:39:11.478053 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:11.478053 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:11.478053 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:11.478053 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:11.478053 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:11.478053 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:11.478053 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:11.478053 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:11.478053 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:11.478053 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:11.478053 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:11.478053 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:11.478053 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:11.478053 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:11.478053 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:11.478053 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:11.479000 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:39:11.479000 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:39:11.479000 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:39:11.479000 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:39:11.479000 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:39:11.479000 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:39:11.479000 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:11.479000 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:11.479000 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 372/747] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:39:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:11.479527 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1dff4-d52a-4caa-b04d-af77f62bf99e None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:11.487449 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 376/748] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:39:11.488291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43c0b9-d790-4d10-a9ad-677909e5e6de None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:11.585481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1dff4-d52a-4caa-b04d-af77f62bf99e None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:11.586455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43c0b9-d790-4d10-a9ad-677909e5e6de None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:11.587697 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:11.621024 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e383dd-b6b6-420f-9b1f-c28edcb1585b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:11.621351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24ca6e-6a93-4b47-8b61-914934d74742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:11.621550 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e383dd-b6b6-420f-9b1f-c28edcb1585b None admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:11.621824 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e383dd-b6b6-420f-9b1f-c28edcb1585b None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:11.621947 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24ca6e-6a93-4b47-8b61-914934d74742 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:11.622092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e383dd-b6b6-420f-9b1f-c28edcb1585b None admin] PATH_INFO: `/v3/services` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:11.622227 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24ca6e-6a93-4b47-8b61-914934d74742 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:11.622500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24ca6e-6a93-4b47-8b61-914934d74742 None admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:11.622748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e383dd-b6b6-420f-9b1f-c28edcb1585b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:11.623249 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24ca6e-6a93-4b47-8b61-914934d74742 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:11.623556 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24ca6e-6a93-4b47-8b61-914934d74742 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:11.624111 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e383dd-b6b6-420f-9b1f-c28edcb1585b None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:11.624951 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24ca6e-6a93-4b47-8b61-914934d74742 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:11.628381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:11.639614 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 373/749] 10.222.0.33 () {60 vars in 1141 bytes} [Sat Aug 6 20:39:11 2022] POST /identity/v3/services => generated 240 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:39:11.640431 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e383dd-b6b6-420f-9b1f-c28edcb1585b None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:11.658343 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 377/750] 10.222.0.33 () {56 vars in 1149 bytes} [Sat Aug 6 20:39:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:11.658343 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24ca6e-6a93-4b47-8b61-914934d74742 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:11.778062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24ca6e-6a93-4b47-8b61-914934d74742 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:11.781504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e383dd-b6b6-420f-9b1f-c28edcb1585b None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:11.818400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd08e4c-23ba-4e03-9d7c-d43cf60c5415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:11.819044 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd08e4c-23ba-4e03-9d7c-d43cf60c5415 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:11.819352 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd08e4c-23ba-4e03-9d7c-d43cf60c5415 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:11.819838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd08e4c-23ba-4e03-9d7c-d43cf60c5415 None admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:11.820927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd08e4c-23ba-4e03-9d7c-d43cf60c5415 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:11.821238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd08e4c-23ba-4e03-9d7c-d43cf60c5415 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:11.822688 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd08e4c-23ba-4e03-9d7c-d43cf60c5415 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:11.828615 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6adaaa5-cc8e-445d-8419-a3abb8ed5613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:11.829255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adaaa5-cc8e-445d-8419-a3abb8ed5613 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:11.830017 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adaaa5-cc8e-445d-8419-a3abb8ed5613 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:11.831076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adaaa5-cc8e-445d-8419-a3abb8ed5613 None admin] PATH_INFO: `/v3/users/nova` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:11.834729 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 378/751] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Aug 6 20:39:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:11.836582 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd08e4c-23ba-4e03-9d7c-d43cf60c5415 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:11.840299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6adaaa5-cc8e-445d-8419-a3abb8ed5613 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:11.842322 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6adaaa5-cc8e-445d-8419-a3abb8ed5613 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:11.857174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-d6adaaa5-cc8e-445d-8419-a3abb8ed5613 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:39:11.857174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:11.857174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:11.857174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:11.857174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:11.857174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:11.857174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:11.857174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:11.857174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:11.857174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:11.857174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:11.857174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:11.857174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:39:11.857174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:39:11.857174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:39:11.857174 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:39:11.858191 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:11.858191 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:11.858191 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:39:11.858191 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:11.858191 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:39:11.858191 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:11.858191 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:11.858191 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:11.858191 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:11.858191 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:11.858191 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:11.858191 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:11.858191 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:11.858191 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:11.858191 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:11.858191 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:11.858191 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:11.858191 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:11.859199 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:11.859199 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:11.859199 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:39:11.859199 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:39:11.859199 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:39:11.859199 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:39:11.859199 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:39:11.859199 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:39:11.859199 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:39:11.859199 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:11.859199 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 374/752] 10.222.0.33 () {56 vars in 1093 bytes} [Sat Aug 6 20:39:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:11.859199 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6adaaa5-cc8e-445d-8419-a3abb8ed5613 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:11.879023 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:11.902687 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:11.953454 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd08e4c-23ba-4e03-9d7c-d43cf60c5415 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:11.974143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6adaaa5-cc8e-445d-8419-a3abb8ed5613 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:11.988356 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433c8ce-1649-46b3-91c8-d64aea70b749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:11.988966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433c8ce-1649-46b3-91c8-d64aea70b749 None admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:11.989245 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433c8ce-1649-46b3-91c8-d64aea70b749 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:11.989516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433c8ce-1649-46b3-91c8-d64aea70b749 None admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:11.990154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a433c8ce-1649-46b3-91c8-d64aea70b749 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:11.991705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a433c8ce-1649-46b3-91c8-d64aea70b749 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:12.008945 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 379/753] 10.222.0.33 () {60 vars in 1141 bytes} [Sat Aug 6 20:39:11 2022] POST /identity/v3/services => generated 251 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:39:12.009676 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433c8ce-1649-46b3-91c8-d64aea70b749 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:12.028509 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d86d39-e8f5-41f4-a986-fbbb8f408904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:12.029634 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d86d39-e8f5-41f4-a986-fbbb8f408904 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:12.030268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d86d39-e8f5-41f4-a986-fbbb8f408904 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:12.030768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d86d39-e8f5-41f4-a986-fbbb8f408904 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:12.119010 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d86d39-e8f5-41f4-a986-fbbb8f408904 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:12.120519 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d86d39-e8f5-41f4-a986-fbbb8f408904 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:12.141324 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:12.152289 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433c8ce-1649-46b3-91c8-d64aea70b749 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:12.170487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:12.201800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a31fa-1238-4483-a558-d8fa4367bb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:12.202935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a31fa-1238-4483-a558-d8fa4367bb52 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:12.203435 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a31fa-1238-4483-a558-d8fa4367bb52 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:12.203904 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a31fa-1238-4483-a558-d8fa4367bb52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:12.204942 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a31fa-1238-4483-a558-d8fa4367bb52 None admin] RBAC: Adding query filter params (role.id=ab245eea8a714462a00c4546309de9c9, scope.project.id=6c4962342201407a89793c5c9a6a6f36, user.id=cd3e0e177f934f7ba5abe52ac8bf8bbb) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:12.205255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a31fa-1238-4483-a558-d8fa4367bb52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:12.206807 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a31fa-1238-4483-a558-d8fa4367bb52 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:12.213982 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 380/754] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:39:12 2022] GET /identity/v3/role_assignments?user.id=cd3e0e177f934f7ba5abe52ac8bf8bbb&scope.project.id=6c4962342201407a89793c5c9a6a6f36&role.id=ab245eea8a714462a00c4546309de9c9 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:12.214882 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a31fa-1238-4483-a558-d8fa4367bb52 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:12.252610 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 375/755] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:39:11 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 20:39:12.259683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d86d39-e8f5-41f4-a986-fbbb8f408904 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:12.377980 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a31fa-1238-4483-a558-d8fa4367bb52 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:12.430656 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d86d39-e8f5-41f4-a986-fbbb8f408904 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:12.436001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10733f-400b-49e3-81fe-845bf4b938e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:12.436878 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10733f-400b-49e3-81fe-845bf4b938e5 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:12.437352 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10733f-400b-49e3-81fe-845bf4b938e5 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:12.437885 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10733f-400b-49e3-81fe-845bf4b938e5 None admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:12.439094 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10733f-400b-49e3-81fe-845bf4b938e5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:12.439597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10733f-400b-49e3-81fe-845bf4b938e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:12.441215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10733f-400b-49e3-81fe-845bf4b938e5 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:12.449526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:12.474343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787da5d-b10f-4356-86b5-2a92a4306633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:12.475014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787da5d-b10f-4356-86b5-2a92a4306633 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:12.475350 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787da5d-b10f-4356-86b5-2a92a4306633 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:12.478482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787da5d-b10f-4356-86b5-2a92a4306633 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:12.484979 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 381/756] 10.222.0.33 () {56 vars in 1133 bytes} [Sat Aug 6 20:39:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:12.492909 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787da5d-b10f-4356-86b5-2a92a4306633 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:12.494616 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787da5d-b10f-4356-86b5-2a92a4306633 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:12.495574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10733f-400b-49e3-81fe-845bf4b938e5 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:12.510558 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-5787da5d-b10f-4356-86b5-2a92a4306633 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:12.510558 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:12.510558 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:12.510558 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:12.510558 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:12.510558 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:12.510558 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:12.510558 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:12.510558 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:12.510558 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:12.510558 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:12.510558 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:12.510558 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:39:12.510558 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:39:12.510558 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:39:12.510558 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:39:12.511633 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:12.511633 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:12.511633 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:12.511633 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:12.511633 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:12.511633 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:12.511633 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:12.511633 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:12.511633 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:12.511633 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:12.511633 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:12.511633 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:12.511633 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:12.511633 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:12.511633 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:12.511633 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:12.511633 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:39:12.513761 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:39:12.513761 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:12.513761 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:12.513761 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 376/757] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:12.520122 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787da5d-b10f-4356-86b5-2a92a4306633 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:12.575452 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:12.713071 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10733f-400b-49e3-81fe-845bf4b938e5 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:12.719102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787da5d-b10f-4356-86b5-2a92a4306633 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:12.760148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87914655-76d1-45df-b9cd-7489fa895ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:12.760789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87914655-76d1-45df-b9cd-7489fa895ed1 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:12.761069 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87914655-76d1-45df-b9cd-7489fa895ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:12.761339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87914655-76d1-45df-b9cd-7489fa895ed1 None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:12.761984 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87914655-76d1-45df-b9cd-7489fa895ed1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:12.762287 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87914655-76d1-45df-b9cd-7489fa895ed1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:12.763696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87914655-76d1-45df-b9cd-7489fa895ed1 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:12.777345 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 377/758] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:12.782741 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87914655-76d1-45df-b9cd-7489fa895ed1 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:12.795617 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f2829-6148-4a0d-bdc3-ef303b8b29ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:12.796269 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f2829-6148-4a0d-bdc3-ef303b8b29ab None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:12.796534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f2829-6148-4a0d-bdc3-ef303b8b29ab None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:12.796806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f2829-6148-4a0d-bdc3-ef303b8b29ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:12.809374 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f2829-6148-4a0d-bdc3-ef303b8b29ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:12.811257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f2829-6148-4a0d-bdc3-ef303b8b29ab None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:12.828812 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-814f2829-6148-4a0d-bdc3-ef303b8b29ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:12.828812 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:12.828812 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:12.828812 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:12.828812 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:12.828812 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:12.828812 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:12.828812 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:12.828812 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:12.828812 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:12.828812 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:12.828812 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:12.828812 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:39:12.828812 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:39:12.828812 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:39:12.828812 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:39:12.829799 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:12.829799 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:12.829799 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:12.829799 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:12.829799 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:12.829799 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:12.829799 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:12.829799 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:12.829799 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:12.829799 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:12.829799 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:12.829799 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:12.829799 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:12.829799 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:12.829799 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:12.829799 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:12.829799 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:39:12.831155 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:39:12.831155 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:12.831155 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:12.831155 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 382/759] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:12.835963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f2829-6148-4a0d-bdc3-ef303b8b29ab None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:12.840155 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:12.946075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:12.976169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f2829-6148-4a0d-bdc3-ef303b8b29ab None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:13.005901 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87914655-76d1-45df-b9cd-7489fa895ed1 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:13.046337 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4437be6-08f5-41a2-9607-3b42c6a1d855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:13.047207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4437be6-08f5-41a2-9607-3b42c6a1d855 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:13.047655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4437be6-08f5-41a2-9607-3b42c6a1d855 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:13.048065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4437be6-08f5-41a2-9607-3b42c6a1d855 None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:13.049113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4437be6-08f5-41a2-9607-3b42c6a1d855 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:13.049556 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4437be6-08f5-41a2-9607-3b42c6a1d855 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:13.051089 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4437be6-08f5-41a2-9607-3b42c6a1d855 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:13.077593 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d5eae-56f3-47aa-a28d-4a547663db9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:13.078532 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d5eae-56f3-47aa-a28d-4a547663db9b None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:13.078978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d5eae-56f3-47aa-a28d-4a547663db9b None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:13.079406 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 383/760] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:13.079862 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d5eae-56f3-47aa-a28d-4a547663db9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:13.082057 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4437be6-08f5-41a2-9607-3b42c6a1d855 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:13.092627 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d5eae-56f3-47aa-a28d-4a547663db9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:13.098490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d5eae-56f3-47aa-a28d-4a547663db9b None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:13.116009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-710d5eae-56f3-47aa-a28d-4a547663db9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:13.116009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:13.116009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:13.116009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:13.116009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:13.116009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:13.116009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:13.116009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:13.116009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:13.116009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:13.116009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:13.116009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:13.116009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:39:13.116009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:39:13.116009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:39:13.117786 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:39:13.117786 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:13.117786 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:13.117786 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:13.117786 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:13.117786 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:13.117786 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:13.117786 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:13.117786 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:13.117786 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:13.117786 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:13.117786 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:13.117786 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:13.117786 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:13.117786 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:13.117786 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:13.117786 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:13.118899 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:39:13.118899 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:39:13.118899 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:39:13.118899 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:39:13.118899 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:39:13.118899 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:39:13.118899 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:13.118899 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:13.132147 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 378/761] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:39:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:13.133236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d5eae-56f3-47aa-a28d-4a547663db9b None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:13.260209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4437be6-08f5-41a2-9607-3b42c6a1d855 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:13.290990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:13.305450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69884c56-a333-4c46-8f4b-8ec9fce3754f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:13.306495 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69884c56-a333-4c46-8f4b-8ec9fce3754f None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:13.306803 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69884c56-a333-4c46-8f4b-8ec9fce3754f None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:13.307339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69884c56-a333-4c46-8f4b-8ec9fce3754f None admin] PATH_INFO: `/v3/projects/service` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:13.314289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d5eae-56f3-47aa-a28d-4a547663db9b None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:13.323909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69884c56-a333-4c46-8f4b-8ec9fce3754f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:13.325365 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69884c56-a333-4c46-8f4b-8ec9fce3754f None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:13.350003 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-69884c56-a333-4c46-8f4b-8ec9fce3754f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:13.350003 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:13.350003 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:13.350003 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:13.350003 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:13.350003 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:13.350003 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:13.350003 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:13.350003 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:13.350003 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:13.350003 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:13.350003 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:13.350003 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:39:13.350003 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:39:13.350003 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:39:13.351029 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:39:13.351029 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:13.351029 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:13.351029 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:13.351029 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:13.351029 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:13.351029 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:13.351029 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:13.351029 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:13.351029 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:13.351029 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:13.351029 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:13.351029 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:13.351029 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:13.351029 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:13.351029 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:13.351029 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:13.351924 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:39:13.351924 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:39:13.351924 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:39:13.351924 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:39:13.351924 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:39:13.351924 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:39:13.351924 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:13.351924 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:13.351924 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 384/762] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:39:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:13.359831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69884c56-a333-4c46-8f4b-8ec9fce3754f None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:13.386890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:13.387721 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788f571-cbe2-4bc1-9c15-0af91a0282f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:13.388347 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788f571-cbe2-4bc1-9c15-0af91a0282f8 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:13.388626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788f571-cbe2-4bc1-9c15-0af91a0282f8 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:13.391512 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788f571-cbe2-4bc1-9c15-0af91a0282f8 None admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:13.392231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788f571-cbe2-4bc1-9c15-0af91a0282f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:13.392547 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788f571-cbe2-4bc1-9c15-0af91a0282f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:13.396147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788f571-cbe2-4bc1-9c15-0af91a0282f8 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:13.427189 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 379/763] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Aug 6 20:39:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:13.432604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788f571-cbe2-4bc1-9c15-0af91a0282f8 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:13.550141 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788f571-cbe2-4bc1-9c15-0af91a0282f8 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:13.590766 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f205803-91ca-454c-8e9d-0999aa742fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:13.591380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f205803-91ca-454c-8e9d-0999aa742fcc None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:13.591803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f205803-91ca-454c-8e9d-0999aa742fcc None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:13.592183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f205803-91ca-454c-8e9d-0999aa742fcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:13.592915 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f205803-91ca-454c-8e9d-0999aa742fcc None admin] RBAC: Adding query filter params (role.id=55fe0e239bac413b90c785211607e1a4, scope.project.id=6c4962342201407a89793c5c9a6a6f36, user.id=384893600b094d9982c2f98cdac52c77) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:13.593312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f205803-91ca-454c-8e9d-0999aa742fcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:13.594973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f205803-91ca-454c-8e9d-0999aa742fcc None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:13.602664 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 380/764] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:39:13 2022] GET /identity/v3/role_assignments?user.id=384893600b094d9982c2f98cdac52c77&scope.project.id=6c4962342201407a89793c5c9a6a6f36&role.id=55fe0e239bac413b90c785211607e1a4 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:13.629027 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69884c56-a333-4c46-8f4b-8ec9fce3754f None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:13.685221 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0cdfa6-3a37-4144-a414-c454926dc899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:13.685859 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0cdfa6-3a37-4144-a414-c454926dc899 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:13.686140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0cdfa6-3a37-4144-a414-c454926dc899 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:13.686411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0cdfa6-3a37-4144-a414-c454926dc899 None admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:13.687214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0cdfa6-3a37-4144-a414-c454926dc899 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:13.687519 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0cdfa6-3a37-4144-a414-c454926dc899 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:13.688948 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0cdfa6-3a37-4144-a414-c454926dc899 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:13.705381 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 385/765] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Aug 6 20:39:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:13.712137 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f205803-91ca-454c-8e9d-0999aa742fcc None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:13.737269 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:14.017286 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f205803-91ca-454c-8e9d-0999aa742fcc None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:14.073322 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10b4f5-086b-4f38-9d81-5ff07aa311cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:14.073908 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10b4f5-086b-4f38-9d81-5ff07aa311cc None admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:14.074184 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10b4f5-086b-4f38-9d81-5ff07aa311cc None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:14.074456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10b4f5-086b-4f38-9d81-5ff07aa311cc None admin] PATH_INFO: `/v3/projects/6c4962342201407a89793c5c9a6a6f36/users/5f9d53147a57402f8b9818590bc1fc1f/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:14.079839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10b4f5-086b-4f38-9d81-5ff07aa311cc None admin] RBAC: Authorizing `identity:create_grant(project_id=6c4962342201407a89793c5c9a6a6f36, user_id=5f9d53147a57402f8b9818590bc1fc1f, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:14.081297 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10b4f5-086b-4f38-9d81-5ff07aa311cc None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:14.090022 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299a621-7ebb-4628-bf1e-938ab53db614 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:14.090516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299a621-7ebb-4628-bf1e-938ab53db614 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:14.090636 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299a621-7ebb-4628-bf1e-938ab53db614 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:14.092192 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 386/766] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:14.097250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc88956-1d37-4b67-bbc6-2952bf16d869 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:14.097534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc88956-1d37-4b67-bbc6-2952bf16d869 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:14.097806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc88956-1d37-4b67-bbc6-2952bf16d869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:14.099613 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 381/767] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Aug 6 20:39:13 2022] PUT /identity/v3/projects/6c4962342201407a89793c5c9a6a6f36/users/5f9d53147a57402f8b9818590bc1fc1f/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:39:14.135685 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-dcc88956-1d37-4b67-bbc6-2952bf16d869 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:14.136913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-dcc88956-1d37-4b67-bbc6-2952bf16d869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:14.244266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:14.250493 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 387/768] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 20:39:14.275213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10b4f5-086b-4f38-9d81-5ff07aa311cc None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:14.399144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:14.443248 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10b4f5-086b-4f38-9d81-5ff07aa311cc None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:14.481457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41aa763-7d73-4319-9681-8597962acdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:14.482098 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41aa763-7d73-4319-9681-8597962acdf1 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:14.482436 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41aa763-7d73-4319-9681-8597962acdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:14.482769 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41aa763-7d73-4319-9681-8597962acdf1 None admin] PATH_INFO: `/v3/services/network` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:14.483360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41aa763-7d73-4319-9681-8597962acdf1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:14.484735 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41aa763-7d73-4319-9681-8597962acdf1 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:14.494784 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-b41aa763-7d73-4319-9681-8597962acdf1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 20:39:14.494784 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:14.494784 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:39:14.494784 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:39:14.494784 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:39:14.494784 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:39:14.494784 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:39:14.494784 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:14.494784 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 20:39:14.494784 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:14.494784 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:39:14.494784 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:14.494784 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:14.494784 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:14.494784 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:14.494784 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:14.494784 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:14.495822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:14.495822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:14.495822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:14.495822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:14.495822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:14.495822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:14.495822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:39:14.495822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:39:14.495822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:39:14.495822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:39:14.495822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:14.495822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:14.495822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:14.495822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:14.495822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:14.495822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:14.497241 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:14.497241 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:14.497241 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:14.497241 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:14.497241 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:14.497241 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:14.497241 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:14.497241 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:14.497241 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:14.497241 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:14.497241 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:39:14.497241 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:14.497241 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 20:39:14.497241 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:14.497241 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 382/769] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:39:14 2022] GET /identity/v3/services/network => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:14.501926 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc88956-1d37-4b67-bbc6-2952bf16d869 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:14.623303 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc88956-1d37-4b67-bbc6-2952bf16d869 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:14.669461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24054777-8c6d-4dee-b95d-be1ae9208b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:14.669461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24054777-8c6d-4dee-b95d-be1ae9208b2d None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:14.669461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24054777-8c6d-4dee-b95d-be1ae9208b2d None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:14.669461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24054777-8c6d-4dee-b95d-be1ae9208b2d None admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:14.669842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24054777-8c6d-4dee-b95d-be1ae9208b2d None admin] RBAC: Adding query filter params (name=network) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:14.669842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24054777-8c6d-4dee-b95d-be1ae9208b2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:14.669842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24054777-8c6d-4dee-b95d-be1ae9208b2d None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:14.673830 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 388/770] 10.222.0.33 () {56 vars in 1112 bytes} [Sat Aug 6 20:39:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:14.683662 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41aa763-7d73-4319-9681-8597962acdf1 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:14.786470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68383695-c229-44dd-8839-e5a9ea932adc None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:14.786843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68383695-c229-44dd-8839-e5a9ea932adc None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:14.787051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68383695-c229-44dd-8839-e5a9ea932adc None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:14.788719 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 389/771] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:39:14.795704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e25e94-58b0-4837-a056-4e39e15689e9 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:14.795989 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e25e94-58b0-4837-a056-4e39e15689e9 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:14.796263 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e25e94-58b0-4837-a056-4e39e15689e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:14.827567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-06e25e94-58b0-4837-a056-4e39e15689e9 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:14.828771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-06e25e94-58b0-4837-a056-4e39e15689e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:14.865394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41aa763-7d73-4319-9681-8597962acdf1 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:14.921986 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ee3e7-9a2d-4fcf-8eb3-939043157138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:14.922991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ee3e7-9a2d-4fcf-8eb3-939043157138 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:14.923473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ee3e7-9a2d-4fcf-8eb3-939043157138 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:14.924202 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ee3e7-9a2d-4fcf-8eb3-939043157138 None admin] PATH_INFO: `/v3/services` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:14.925205 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ee3e7-9a2d-4fcf-8eb3-939043157138 None admin] RBAC: Adding query filter params (type=network) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:14.925710 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ee3e7-9a2d-4fcf-8eb3-939043157138 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:14.926067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:14.927940 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ee3e7-9a2d-4fcf-8eb3-939043157138 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:14.929726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:14.936612 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 383/772] 10.222.0.33 () {56 vars in 1112 bytes} [Sat Aug 6 20:39:14 2022] GET /identity/v3/services?type=network => generated 350 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:14.942527 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ee3e7-9a2d-4fcf-8eb3-939043157138 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:14.962124 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 390/773] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 20:39:14.984702 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e25e94-58b0-4837-a056-4e39e15689e9 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:15.090188 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ee3e7-9a2d-4fcf-8eb3-939043157138 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:15.123199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e25e94-58b0-4837-a056-4e39e15689e9 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:15.128425 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef3cfa-46b7-4513-add2-c4db539a8ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:15.129178 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef3cfa-46b7-4513-add2-c4db539a8ed8 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:15.129523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef3cfa-46b7-4513-add2-c4db539a8ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:15.129856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef3cfa-46b7-4513-add2-c4db539a8ed8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:15.130660 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef3cfa-46b7-4513-add2-c4db539a8ed8 None admin] RBAC: Adding query filter params (interface=public, service_id=102a6b667c9540ae8fb11f46ab934c6e, region_id=RegionOne) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:15.131035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef3cfa-46b7-4513-add2-c4db539a8ed8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:15.133004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef3cfa-46b7-4513-add2-c4db539a8ed8 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:15.146243 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 384/774] 10.222.0.33 () {56 vars in 1251 bytes} [Sat Aug 6 20:39:14 2022] GET /identity/v3/endpoints?service_id=102a6b667c9540ae8fb11f46ab934c6e&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:15.146243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefd8c8-04cd-4e9b-9ef3-d02d120fb10e None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:15.146243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefd8c8-04cd-4e9b-9ef3-d02d120fb10e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:15.146243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefd8c8-04cd-4e9b-9ef3-d02d120fb10e None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:15.146243 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 385/775] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:15.148086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aefd8c8-04cd-4e9b-9ef3-d02d120fb10e None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:15.173669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de667b-177a-4a41-bd7e-3866a8543de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:15.174861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de667b-177a-4a41-bd7e-3866a8543de2 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:15.175317 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de667b-177a-4a41-bd7e-3866a8543de2 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:15.175892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de667b-177a-4a41-bd7e-3866a8543de2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:15.190539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de667b-177a-4a41-bd7e-3866a8543de2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:39:15.197194 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-c4de667b-177a-4a41-bd7e-3866a8543de2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:39:15.197194 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:15.197194 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:15.197194 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:15.197194 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:15.197194 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:15.197194 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:15.197194 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:15.197194 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:15.197194 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:15.197194 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:15.197194 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:15.197194 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:39:15.197194 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:39:15.197194 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:39:15.197194 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:39:15.198154 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:39:15.198154 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:39:15.198154 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:39:15.198154 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:39:15.198154 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:15.198154 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:15.198154 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:15.198154 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:15.198154 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:15.198154 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:15.198154 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:15.198154 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:15.198154 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:15.198154 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:15.198154 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:15.198154 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:15.199052 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:15.199052 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:15.199052 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:15.199052 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:15.199052 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:39:15.199052 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:39:15.199052 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:39:15.199052 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:39:15.199052 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:39:15.199052 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:39:15.199052 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:39:15.199052 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:15.200519 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 391/776] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Aug 6 20:39:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:39:15.202663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f01ec-d118-43c6-ac5a-dedfdd619ef9 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:15.202942 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f01ec-d118-43c6-ac5a-dedfdd619ef9 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:15.203214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f01ec-d118-43c6-ac5a-dedfdd619ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:15.223036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-343f01ec-d118-43c6-ac5a-dedfdd619ef9 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:15.224364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:15.224554 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-343f01ec-d118-43c6-ac5a-dedfdd619ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:15.275947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aefd8c8-04cd-4e9b-9ef3-d02d120fb10e None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:15.279195 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:15.303621 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 392/777] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:39:15.305391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f01ec-d118-43c6-ac5a-dedfdd619ef9 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:15.317545 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b27fe-e930-4a70-b3c6-3c86c70993a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:15.318157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b27fe-e930-4a70-b3c6-3c86c70993a7 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:15.318436 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b27fe-e930-4a70-b3c6-3c86c70993a7 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:15.318757 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b27fe-e930-4a70-b3c6-3c86c70993a7 None admin] PATH_INFO: `/v3/services` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:15.319886 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b27fe-e930-4a70-b3c6-3c86c70993a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:15.321852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b27fe-e930-4a70-b3c6-3c86c70993a7 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:15.328513 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 386/778] 10.222.0.33 () {56 vars in 1087 bytes} [Sat Aug 6 20:39:15 2022] GET /identity/v3/services => generated 772 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:15.345229 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b27fe-e930-4a70-b3c6-3c86c70993a7 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:15.422620 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f01ec-d118-43c6-ac5a-dedfdd619ef9 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:15.470393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3091c7-62fe-4ae6-becd-aaa867d9a6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:15.471418 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3091c7-62fe-4ae6-becd-aaa867d9a6bb None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:15.471911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3091c7-62fe-4ae6-becd-aaa867d9a6bb None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:15.472408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3091c7-62fe-4ae6-becd-aaa867d9a6bb None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:15.477102 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3091c7-62fe-4ae6-becd-aaa867d9a6bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:15.477840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3091c7-62fe-4ae6-becd-aaa867d9a6bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:15.479615 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3091c7-62fe-4ae6-becd-aaa867d9a6bb None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:15.495216 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 393/779] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:39:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:15.500497 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3091c7-62fe-4ae6-becd-aaa867d9a6bb None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:15.501150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b27fe-e930-4a70-b3c6-3c86c70993a7 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:15.528457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:15.537495 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbfd29-bc92-431d-8a74-602ca408b425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:15.538183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbfd29-bc92-431d-8a74-602ca408b425 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:15.538966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbfd29-bc92-431d-8a74-602ca408b425 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:15.539495 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbfd29-bc92-431d-8a74-602ca408b425 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:15.540539 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cbfd29-bc92-431d-8a74-602ca408b425 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:15.543286 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cbfd29-bc92-431d-8a74-602ca408b425 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:15.552498 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-f9cbfd29-bc92-431d-8a74-602ca408b425 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 20:39:15.552498 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:15.552498 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:39:15.552498 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:39:15.552498 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:39:15.552498 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:39:15.552498 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:39:15.552498 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:15.552498 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 20:39:15.552498 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:15.552498 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:39:15.552498 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:15.552498 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:15.552498 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:15.552498 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:15.552498 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:15.552498 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:15.554224 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:15.554224 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:15.554224 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:15.554224 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:15.554224 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:15.554224 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:15.554224 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:39:15.554224 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:39:15.554224 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:39:15.554224 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:39:15.554224 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:15.554224 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:15.554224 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:15.554224 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:15.554224 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:15.554224 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:15.555937 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:15.555937 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:15.555937 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:15.555937 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:15.555937 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:15.555937 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:15.555937 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:15.555937 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:15.555937 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:15.555937 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:15.555937 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:39:15.555937 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:15.555937 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 20:39:15.555937 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:15.555937 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 387/780] 10.222.0.33 () {56 vars in 1129 bytes} [Sat Aug 6 20:39:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:15.571638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbfd29-bc92-431d-8a74-602ca408b425 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:15.576688 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:15.686398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3091c7-62fe-4ae6-becd-aaa867d9a6bb None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:15.719332 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbfd29-bc92-431d-8a74-602ca408b425 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:15.724161 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59825845-d9a5-4315-8292-7cb254dfac50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:15.725006 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59825845-d9a5-4315-8292-7cb254dfac50 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:15.725990 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59825845-d9a5-4315-8292-7cb254dfac50 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:15.726412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59825845-d9a5-4315-8292-7cb254dfac50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:15.740092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59825845-d9a5-4315-8292-7cb254dfac50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:15.742100 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59825845-d9a5-4315-8292-7cb254dfac50 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:15.759143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-59825845-d9a5-4315-8292-7cb254dfac50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:15.759143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:15.759143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:15.759143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:15.759143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:15.759143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:15.759143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:15.759143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:15.759143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:15.759143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:15.759143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:15.759143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:15.759143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:39:15.759143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:39:15.759143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:39:15.759143 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:39:15.760186 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:15.760186 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:15.760186 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:15.760186 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:15.760186 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:15.760186 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:15.760186 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:15.760186 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:15.760186 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:15.760186 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:15.760186 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:15.760186 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:15.760186 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:15.760186 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:15.760186 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:15.760186 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:15.760186 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:39:15.761094 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:39:15.761094 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:15.761094 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:15.761265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5783c995-0bcc-4997-8798-76b4150ef0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:15.761265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783c995-0bcc-4997-8798-76b4150ef0c7 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:15.761265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783c995-0bcc-4997-8798-76b4150ef0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:15.761265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783c995-0bcc-4997-8798-76b4150ef0c7 None admin] PATH_INFO: `/v3/services` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:15.762368 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5783c995-0bcc-4997-8798-76b4150ef0c7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:15.762951 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5783c995-0bcc-4997-8798-76b4150ef0c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:15.763951 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 394/781] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:39:15.764903 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5783c995-0bcc-4997-8798-76b4150ef0c7 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:15.771619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59825845-d9a5-4315-8292-7cb254dfac50 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:15.775418 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 388/782] 10.222.0.33 () {56 vars in 1124 bytes} [Sat Aug 6 20:39:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:15.784105 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5783c995-0bcc-4997-8798-76b4150ef0c7 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:15.847997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:15.878089 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:15.893106 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59825845-d9a5-4315-8292-7cb254dfac50 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:15.897615 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5783c995-0bcc-4997-8798-76b4150ef0c7 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:15.941456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcb7bc-ff3a-4dec-b8b0-6b2b432406ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:15.942066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcb7bc-ff3a-4dec-b8b0-6b2b432406ed None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:15.942401 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcb7bc-ff3a-4dec-b8b0-6b2b432406ed None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:15.942704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcb7bc-ff3a-4dec-b8b0-6b2b432406ed None admin] PATH_INFO: `/v3/services` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:15.943341 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebcb7bc-ff3a-4dec-b8b0-6b2b432406ed None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:15.943862 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebcb7bc-ff3a-4dec-b8b0-6b2b432406ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:15.945604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebcb7bc-ff3a-4dec-b8b0-6b2b432406ed None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:15.958828 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 389/783] 10.222.0.33 () {56 vars in 1124 bytes} [Sat Aug 6 20:39:15 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:15.959952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1f17a-f694-4a1a-878e-b76bd82c63d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:15.960912 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1f17a-f694-4a1a-878e-b76bd82c63d2 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:15.961403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1f17a-f694-4a1a-878e-b76bd82c63d2 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:15.961880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1f17a-f694-4a1a-878e-b76bd82c63d2 None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:15.962767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1f17a-f694-4a1a-878e-b76bd82c63d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:15.963292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1f17a-f694-4a1a-878e-b76bd82c63d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:15.964873 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1f17a-f694-4a1a-878e-b76bd82c63d2 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:15.965968 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcb7bc-ff3a-4dec-b8b0-6b2b432406ed None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:15.997153 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 395/784] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:16.002294 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1f17a-f694-4a1a-878e-b76bd82c63d2 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:16.086880 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcb7bc-ff3a-4dec-b8b0-6b2b432406ed None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:16.112122 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:16.139726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8eb53d-67be-49b4-897d-b5945c8d772a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:16.140709 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8eb53d-67be-49b4-897d-b5945c8d772a None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:16.141193 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8eb53d-67be-49b4-897d-b5945c8d772a None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:16.141676 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8eb53d-67be-49b4-897d-b5945c8d772a None admin] PATH_INFO: `/v3/endpoints` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:16.142662 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8eb53d-67be-49b4-897d-b5945c8d772a None admin] RBAC: Adding query filter params (interface=public, service_id=754004e7e8d4429da25089e2eaf68199, region_id=RegionOne) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:16.144279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8eb53d-67be-49b4-897d-b5945c8d772a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:16.146129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8eb53d-67be-49b4-897d-b5945c8d772a None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:16.158440 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 390/785] 10.222.0.33 () {56 vars in 1251 bytes} [Sat Aug 6 20:39:15 2022] GET /identity/v3/endpoints?service_id=754004e7e8d4429da25089e2eaf68199&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:16.166371 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8eb53d-67be-49b4-897d-b5945c8d772a None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:16.228780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1f17a-f694-4a1a-878e-b76bd82c63d2 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:16.281121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655dae0a-9cd7-452b-9adc-79ea70f6b59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:16.281935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dae0a-9cd7-452b-9adc-79ea70f6b59b None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:16.282215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dae0a-9cd7-452b-9adc-79ea70f6b59b None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:16.282484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dae0a-9cd7-452b-9adc-79ea70f6b59b None admin] PATH_INFO: `/v3/users/swift` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:16.291060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655dae0a-9cd7-452b-9adc-79ea70f6b59b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:16.292607 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655dae0a-9cd7-452b-9adc-79ea70f6b59b None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:16.296014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8eb53d-67be-49b4-897d-b5945c8d772a None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:16.306744 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-655dae0a-9cd7-452b-9adc-79ea70f6b59b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 06 20:39:16.306744 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:16.306744 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:16.306744 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:16.306744 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:16.306744 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:16.306744 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:16.306744 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:16.306744 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:16.306744 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:16.306744 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:16.306744 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:16.306744 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:39:16.306744 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:39:16.306744 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:39:16.306744 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:39:16.307989 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:16.307989 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:16.307989 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:39:16.307989 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:16.307989 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:39:16.307989 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:16.307989 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:16.307989 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:16.307989 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:16.307989 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:16.307989 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:16.307989 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:16.307989 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:16.307989 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:16.307989 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:16.307989 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:16.307989 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:16.307989 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:16.308939 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:16.308939 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:16.308939 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:39:16.308939 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:39:16.308939 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:39:16.308939 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:39:16.308939 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:39:16.308939 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:39:16.308939 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 06 20:39:16.308939 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:16.308939 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 396/786] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Aug 6 20:39:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:39:16.310011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f317d5-75dc-4a8c-873a-869bf9d6fc7b None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:16.310011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f317d5-75dc-4a8c-873a-869bf9d6fc7b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:16.310238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f317d5-75dc-4a8c-873a-869bf9d6fc7b None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:16.311833 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 397/787] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:16.318595 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f317d5-75dc-4a8c-873a-869bf9d6fc7b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:16.340842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45a42e-5904-46f5-b1a7-113f44bd0bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:16.341847 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45a42e-5904-46f5-b1a7-113f44bd0bc9 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:16.342276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:16.342528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45a42e-5904-46f5-b1a7-113f44bd0bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:16.343018 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45a42e-5904-46f5-b1a7-113f44bd0bc9 None admin] PATH_INFO: `/v3/services` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:16.343801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a45a42e-5904-46f5-b1a7-113f44bd0bc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:16.345398 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a45a42e-5904-46f5-b1a7-113f44bd0bc9 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:16.351771 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 391/788] 10.222.0.33 () {56 vars in 1087 bytes} [Sat Aug 6 20:39:16 2022] GET /identity/v3/services => generated 772 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:16.354479 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd5da8-ba1b-4465-bb4f-307055d861ce None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:16.354806 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd5da8-ba1b-4465-bb4f-307055d861ce None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:16.355072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd5da8-ba1b-4465-bb4f-307055d861ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:16.383418 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-95dd5da8-ba1b-4465-bb4f-307055d861ce None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:16.386186 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-95dd5da8-ba1b-4465-bb4f-307055d861ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:16.446397 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:16.481280 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 392/789] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:39:16.518447 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd5da8-ba1b-4465-bb4f-307055d861ce None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:16.525564 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f317d5-75dc-4a8c-873a-869bf9d6fc7b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:16.581613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9bd36-3f26-4ebf-b54a-aa892e719d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:16.582272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9bd36-3f26-4ebf-b54a-aa892e719d04 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:16.582664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9bd36-3f26-4ebf-b54a-aa892e719d04 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:16.583011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9bd36-3f26-4ebf-b54a-aa892e719d04 None admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:16.583812 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9bd36-3f26-4ebf-b54a-aa892e719d04 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:16.584191 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9bd36-3f26-4ebf-b54a-aa892e719d04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:16.585882 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9bd36-3f26-4ebf-b54a-aa892e719d04 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:16.607048 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 398/790] 10.222.0.33 () {56 vars in 1135 bytes} [Sat Aug 6 20:39:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:16.613658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9bd36-3f26-4ebf-b54a-aa892e719d04 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:16.660539 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd5da8-ba1b-4465-bb4f-307055d861ce None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:16.702022 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815a6f4-de2b-4f1d-9d81-fe74a38f7529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:16.702708 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815a6f4-de2b-4f1d-9d81-fe74a38f7529 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:16.702998 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815a6f4-de2b-4f1d-9d81-fe74a38f7529 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:16.703268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815a6f4-de2b-4f1d-9d81-fe74a38f7529 None admin] PATH_INFO: `/v3/roles/service` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:16.715387 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815a6f4-de2b-4f1d-9d81-fe74a38f7529 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:39:16.717574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:16.720576 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-f815a6f4-de2b-4f1d-9d81-fe74a38f7529 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:39:16.720576 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:16.720576 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:16.720576 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:16.720576 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:16.720576 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:16.720576 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:16.720576 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:16.720576 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:16.720576 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:16.720576 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:16.720576 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:16.720576 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:39:16.720576 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:39:16.720576 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:39:16.720576 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:39:16.721567 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:39:16.721567 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:39:16.721567 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:39:16.721567 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:39:16.721567 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:16.721567 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:16.721567 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:16.721567 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:16.721567 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:16.721567 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:16.721567 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:16.721567 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:16.721567 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:16.721567 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:16.721567 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:16.721567 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:16.722402 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:16.722402 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:16.722402 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:16.722402 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:16.722402 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:39:16.722402 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:39:16.722402 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:39:16.722402 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:39:16.722402 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:39:16.722402 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:39:16.722402 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:39:16.722402 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:16.722402 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 393/791] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Aug 6 20:39:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:39:16.728151 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815a6f4-de2b-4f1d-9d81-fe74a38f7529 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:16.753540 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9bd36-3f26-4ebf-b54a-aa892e719d04 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:16.766910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:16.796060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd924e35-c676-42fb-ad80-a8310f0618dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:16.797152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd924e35-c676-42fb-ad80-a8310f0618dd None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:16.797613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd924e35-c676-42fb-ad80-a8310f0618dd None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:16.798437 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd924e35-c676-42fb-ad80-a8310f0618dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:16.810270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd924e35-c676-42fb-ad80-a8310f0618dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:16.812329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd924e35-c676-42fb-ad80-a8310f0618dd None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:16.828681 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-dd924e35-c676-42fb-ad80-a8310f0618dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:16.828681 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:16.828681 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:16.828681 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:16.828681 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:16.828681 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:16.828681 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:16.828681 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:16.828681 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:16.828681 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:16.828681 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:16.828681 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:16.828681 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:39:16.828681 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:39:16.828681 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:39:16.828681 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:39:16.829673 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:16.829673 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:16.829673 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:16.829673 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:16.829673 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:16.829673 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:16.829673 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:16.829673 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:16.829673 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:16.829673 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:16.829673 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:16.829673 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:16.829673 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:16.829673 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:16.829673 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:16.829673 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:16.829673 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:39:16.830596 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:39:16.830596 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:16.830596 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:16.833019 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 399/792] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:16.840296 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd924e35-c676-42fb-ad80-a8310f0618dd None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:16.935973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815a6f4-de2b-4f1d-9d81-fe74a38f7529 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:16.963519 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd924e35-c676-42fb-ad80-a8310f0618dd None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:16.981284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631aaa9-1fae-4a67-beec-813a13f9b011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:16.981921 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631aaa9-1fae-4a67-beec-813a13f9b011 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:16.982204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631aaa9-1fae-4a67-beec-813a13f9b011 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:16.982477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631aaa9-1fae-4a67-beec-813a13f9b011 None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:16.983203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631aaa9-1fae-4a67-beec-813a13f9b011 None admin] RBAC: Adding query filter params (name=service) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:16.983514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631aaa9-1fae-4a67-beec-813a13f9b011 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:16.985182 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631aaa9-1fae-4a67-beec-813a13f9b011 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:16.995638 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 394/793] 10.222.0.33 () {56 vars in 1103 bytes} [Sat Aug 6 20:39:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:17.003476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631aaa9-1fae-4a67-beec-813a13f9b011 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:17.026991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:17.035786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc350f9-dc59-4d00-b491-b6222d7f4e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:17.036783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc350f9-dc59-4d00-b491-b6222d7f4e83 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:17.037171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc350f9-dc59-4d00-b491-b6222d7f4e83 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:17.037546 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc350f9-dc59-4d00-b491-b6222d7f4e83 None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:17.038642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc350f9-dc59-4d00-b491-b6222d7f4e83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:17.039054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc350f9-dc59-4d00-b491-b6222d7f4e83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:17.040570 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc350f9-dc59-4d00-b491-b6222d7f4e83 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:17.055393 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 400/794] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:17.061168 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc350f9-dc59-4d00-b491-b6222d7f4e83 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:17.187925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631aaa9-1fae-4a67-beec-813a13f9b011 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:17.190932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:17.222194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc350f9-dc59-4d00-b491-b6222d7f4e83 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:17.235289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254db807-de98-4af4-bff3-ce76eec8c943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:17.235959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254db807-de98-4af4-bff3-ce76eec8c943 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:17.236528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254db807-de98-4af4-bff3-ce76eec8c943 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:17.236807 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254db807-de98-4af4-bff3-ce76eec8c943 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:17.252544 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254db807-de98-4af4-bff3-ce76eec8c943 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:17.255539 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254db807-de98-4af4-bff3-ce76eec8c943 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:17.261458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc8afa-b7b3-4329-a083-aa4b65469609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:17.262151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc8afa-b7b3-4329-a083-aa4b65469609 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:17.262376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc8afa-b7b3-4329-a083-aa4b65469609 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:17.262703 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc8afa-b7b3-4329-a083-aa4b65469609 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:17.271118 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc8afa-b7b3-4329-a083-aa4b65469609 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:17.271641 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-254db807-de98-4af4-bff3-ce76eec8c943 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:17.271641 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:17.271641 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:17.271641 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:17.271641 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:17.271641 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:17.271641 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:17.271641 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:17.271641 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:17.271641 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:17.271641 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:17.271641 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:17.271641 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:39:17.271641 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:39:17.271641 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:39:17.271641 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:39:17.273176 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:17.273176 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:17.273176 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:17.273176 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:17.273176 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:17.273176 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:17.273176 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:17.273176 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:17.273176 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:17.273176 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:17.273176 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:17.273176 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:17.273176 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:17.273176 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:17.273176 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:17.273176 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:17.273176 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:39:17.274217 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:39:17.274217 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:17.274217 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:17.274402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc8afa-b7b3-4329-a083-aa4b65469609 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:17.274472 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 395/795] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:17.278563 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37823d29-c44e-4ea1-b008-e2385d76f7ca None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:17.278563 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37823d29-c44e-4ea1-b008-e2385d76f7ca None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:17.278563 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37823d29-c44e-4ea1-b008-e2385d76f7ca None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:17.281174 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 396/796] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:17.282422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37823d29-c44e-4ea1-b008-e2385d76f7ca None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:17.296960 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-6acc8afa-b7b3-4329-a083-aa4b65469609 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:17.296960 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:17.296960 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:17.296960 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:17.296960 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:17.296960 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:17.296960 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:17.296960 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:17.296960 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:17.296960 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:17.296960 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:17.296960 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:17.296960 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:39:17.296960 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:39:17.296960 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:39:17.299010 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:39:17.299010 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:17.299010 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:17.299010 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:17.299010 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:17.299010 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:17.299010 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:17.299010 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:17.299010 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:17.299010 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:17.299010 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:17.299010 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:17.299010 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:17.299010 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:17.299010 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:17.299010 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:17.299010 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:17.301102 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:39:17.301102 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:39:17.301102 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:39:17.301102 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:39:17.301102 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:39:17.301102 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:39:17.301102 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:17.301102 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:17.301102 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 401/797] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:39:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:17.301102 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba521fe-388f-4d36-aae5-c8c45638ff1a None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:17.301102 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba521fe-388f-4d36-aae5-c8c45638ff1a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:17.302475 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba521fe-388f-4d36-aae5-c8c45638ff1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:17.326791 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-aba521fe-388f-4d36-aae5-c8c45638ff1a None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:17.328544 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-aba521fe-388f-4d36-aae5-c8c45638ff1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:17.379266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:17.406851 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37823d29-c44e-4ea1-b008-e2385d76f7ca None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:17.408314 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 402/798] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:39:17.409279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba521fe-388f-4d36-aae5-c8c45638ff1a None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:17.442953 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c4460-9568-4af9-9f59-29758619e51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:17.444449 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c4460-9568-4af9-9f59-29758619e51d None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:17.444929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c4460-9568-4af9-9f59-29758619e51d None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:17.445394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c4460-9568-4af9-9f59-29758619e51d None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:17.446229 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c4460-9568-4af9-9f59-29758619e51d None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:17.446836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c4460-9568-4af9-9f59-29758619e51d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:17.448467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c4460-9568-4af9-9f59-29758619e51d None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:17.462184 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 397/799] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:17.463325 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c4460-9568-4af9-9f59-29758619e51d None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:17.475574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:17.525514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba521fe-388f-4d36-aae5-c8c45638ff1a None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:17.563372 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a1ee9-dd4d-4ad3-8357-3c214fa28d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:17.564346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a1ee9-dd4d-4ad3-8357-3c214fa28d6d None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:17.564817 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a1ee9-dd4d-4ad3-8357-3c214fa28d6d None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:17.565370 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a1ee9-dd4d-4ad3-8357-3c214fa28d6d None admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:17.566235 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a1ee9-dd4d-4ad3-8357-3c214fa28d6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:17.566760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a1ee9-dd4d-4ad3-8357-3c214fa28d6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:17.568382 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c4460-9568-4af9-9f59-29758619e51d None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:17.568673 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a1ee9-dd4d-4ad3-8357-3c214fa28d6d None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:17.582288 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 403/800] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Aug 6 20:39:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:17.583478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a1ee9-dd4d-4ad3-8357-3c214fa28d6d None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:17.614470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac49268-2cb5-4270-802b-debbdecad1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:17.615525 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac49268-2cb5-4270-802b-debbdecad1a1 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:17.617051 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac49268-2cb5-4270-802b-debbdecad1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:17.617533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac49268-2cb5-4270-802b-debbdecad1a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:17.631862 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac49268-2cb5-4270-802b-debbdecad1a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:39:17.633396 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:17.638821 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-4ac49268-2cb5-4270-802b-debbdecad1a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:39:17.638821 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:17.638821 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:17.638821 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:17.638821 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:17.638821 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:17.638821 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:17.638821 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:17.638821 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:17.638821 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:17.638821 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:17.638821 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:17.638821 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:39:17.638821 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:39:17.638821 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:39:17.638821 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:39:17.639964 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:39:17.639964 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:39:17.639964 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:39:17.639964 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:39:17.639964 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:17.639964 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:17.639964 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:17.639964 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:17.639964 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:17.639964 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:17.639964 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:17.639964 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:17.639964 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:17.639964 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:17.639964 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:17.639964 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:17.640877 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:17.640877 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:17.640877 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:17.640877 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:17.640877 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:39:17.640877 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:39:17.640877 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:39:17.640877 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:39:17.640877 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:39:17.640877 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:39:17.640877 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:39:17.640877 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:17.644007 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 398/801] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Aug 6 20:39:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:17.645691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac49268-2cb5-4270-802b-debbdecad1a1 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:17.718169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a1ee9-dd4d-4ad3-8357-3c214fa28d6d None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:17.753700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:17.759253 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de1a37-5932-4ef0-a2ac-a84ba48da6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:17.763863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de1a37-5932-4ef0-a2ac-a84ba48da6d5 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:17.764387 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de1a37-5932-4ef0-a2ac-a84ba48da6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:17.764865 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de1a37-5932-4ef0-a2ac-a84ba48da6d5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:17.776754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de1a37-5932-4ef0-a2ac-a84ba48da6d5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:17.778510 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de1a37-5932-4ef0-a2ac-a84ba48da6d5 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:17.795693 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac49268-2cb5-4270-802b-debbdecad1a1 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:17.801710 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-84de1a37-5932-4ef0-a2ac-a84ba48da6d5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 20:39:17.801710 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:17.801710 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:17.801710 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:17.801710 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:17.801710 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:17.801710 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:17.801710 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:17.801710 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:17.801710 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:17.801710 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:17.801710 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:17.801710 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:39:17.801710 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:39:17.801710 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:39:17.801710 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:39:17.802689 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:17.802689 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:17.802689 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:39:17.802689 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:17.802689 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:39:17.802689 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:17.802689 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:17.802689 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:17.802689 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:17.802689 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:17.802689 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:17.802689 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:17.802689 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:17.802689 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:17.802689 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:17.802689 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:17.802689 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:17.802689 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:17.803677 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:17.803677 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:17.803677 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:39:17.803677 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:39:17.803677 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:39:17.803677 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:39:17.803677 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:39:17.803677 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:39:17.803677 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 20:39:17.803677 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:17.807984 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 404/802] 10.222.0.33 () {56 vars in 1117 bytes} [Sat Aug 6 20:39:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:17.808859 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de1a37-5932-4ef0-a2ac-a84ba48da6d5 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:17.840481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86617cf3-4194-440c-b485-6d4b5f199807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:17.841533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86617cf3-4194-440c-b485-6d4b5f199807 None admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:17.842013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86617cf3-4194-440c-b485-6d4b5f199807 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:17.842515 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86617cf3-4194-440c-b485-6d4b5f199807 None admin] PATH_INFO: `/v3/projects/6c4962342201407a89793c5c9a6a6f36/users/cd3e0e177f934f7ba5abe52ac8bf8bbb/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:17.844663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86617cf3-4194-440c-b485-6d4b5f199807 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c4962342201407a89793c5c9a6a6f36, user_id=cd3e0e177f934f7ba5abe52ac8bf8bbb, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:17.846312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86617cf3-4194-440c-b485-6d4b5f199807 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:17.862469 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 399/803] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Aug 6 20:39:17 2022] PUT /identity/v3/projects/6c4962342201407a89793c5c9a6a6f36/users/cd3e0e177f934f7ba5abe52ac8bf8bbb/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:39:17.868062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86617cf3-4194-440c-b485-6d4b5f199807 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:17.913691 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:17.919893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de1a37-5932-4ef0-a2ac-a84ba48da6d5 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:18.015918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86617cf3-4194-440c-b485-6d4b5f199807 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:18.040388 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50771220-d946-4c41-a336-f8998713c1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:18.041022 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50771220-d946-4c41-a336-f8998713c1a0 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:18.041300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50771220-d946-4c41-a336-f8998713c1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:18.041574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50771220-d946-4c41-a336-f8998713c1a0 None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:18.042259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50771220-d946-4c41-a336-f8998713c1a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:18.042591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50771220-d946-4c41-a336-f8998713c1a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:18.044160 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50771220-d946-4c41-a336-f8998713c1a0 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:18.054287 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:18.064922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa654522-4677-4834-8376-0e568be30aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:18.065959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa654522-4677-4834-8376-0e568be30aad None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:18.066452 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa654522-4677-4834-8376-0e568be30aad None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:18.067008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa654522-4677-4834-8376-0e568be30aad None admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:18.068080 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa654522-4677-4834-8376-0e568be30aad None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:18.068618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa654522-4677-4834-8376-0e568be30aad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:18.068946 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 405/804] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:39:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:18.070610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa654522-4677-4834-8376-0e568be30aad None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:18.074783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50771220-d946-4c41-a336-f8998713c1a0 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:18.093518 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 400/805] 10.222.0.33 () {56 vars in 1149 bytes} [Sat Aug 6 20:39:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:18.099680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa654522-4677-4834-8376-0e568be30aad None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:18.212180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa654522-4677-4834-8376-0e568be30aad None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:18.251635 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8e87f-e74b-4830-a83d-c7d2f1af4979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:18.252649 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8e87f-e74b-4830-a83d-c7d2f1af4979 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:18.253156 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8e87f-e74b-4830-a83d-c7d2f1af4979 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:18.253631 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8e87f-e74b-4830-a83d-c7d2f1af4979 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:18.264669 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8e87f-e74b-4830-a83d-c7d2f1af4979 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:18.266476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8e87f-e74b-4830-a83d-c7d2f1af4979 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:18.281792 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-e1d8e87f-e74b-4830-a83d-c7d2f1af4979 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:18.281792 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:18.281792 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:18.281792 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:18.281792 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:18.281792 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:18.281792 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:18.281792 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:18.281792 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:18.281792 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:18.281792 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:18.281792 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:18.281792 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:39:18.281792 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:39:18.281792 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:39:18.281792 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:39:18.282843 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:18.282843 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:18.282843 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:18.282843 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:18.282843 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:18.282843 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:18.282843 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:18.282843 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:18.282843 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:18.282843 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:18.282843 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:18.282843 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:18.282843 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:18.282843 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:18.282843 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:18.282843 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:18.282843 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:39:18.283747 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:39:18.283747 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:18.283747 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:18.283747 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 401/806] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:39:18.286817 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50771220-d946-4c41-a336-f8998713c1a0 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:18.287491 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040b2f2-00b1-4e32-a790-88b918173683 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:18.288502 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040b2f2-00b1-4e32-a790-88b918173683 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:18.288981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040b2f2-00b1-4e32-a790-88b918173683 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:18.294315 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 402/807] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:18.294315 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040b2f2-00b1-4e32-a790-88b918173683 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:18.331827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24df4e-23c0-4ce2-9502-9a637c7e0ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:18.332715 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24df4e-23c0-4ce2-9502-9a637c7e0ce3 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:18.333188 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24df4e-23c0-4ce2-9502-9a637c7e0ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:18.333558 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24df4e-23c0-4ce2-9502-9a637c7e0ce3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:18.345046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:18.346382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d24df4e-23c0-4ce2-9502-9a637c7e0ce3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:18.349143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d24df4e-23c0-4ce2-9502-9a637c7e0ce3 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:18.366660 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-4d24df4e-23c0-4ce2-9502-9a637c7e0ce3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:18.366660 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:18.366660 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:18.366660 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:18.366660 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:18.366660 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:18.366660 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:18.366660 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:18.366660 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:18.366660 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:18.366660 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:18.366660 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:18.366660 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:39:18.366660 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:39:18.366660 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:39:18.366660 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:39:18.367682 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:18.367682 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:18.367682 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:18.367682 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:18.367682 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:18.367682 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:18.367682 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:18.367682 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:18.367682 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:18.367682 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:18.367682 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:18.367682 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:18.367682 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:18.367682 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:18.367682 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:18.367682 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:18.367682 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:39:18.368748 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:39:18.368748 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:18.368748 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:18.368748 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 406/808] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:39:18.374405 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a7c3d-b896-427f-88e2-afc07bc71d01 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:18.374828 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a7c3d-b896-427f-88e2-afc07bc71d01 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:18.375201 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a7c3d-b896-427f-88e2-afc07bc71d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:18.396373 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-1a8a7c3d-b896-427f-88e2-afc07bc71d01 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:18.398114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1a8a7c3d-b896-427f-88e2-afc07bc71d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:18.401487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:18.418441 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040b2f2-00b1-4e32-a790-88b918173683 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:18.457828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599eac1-83a8-4e78-a242-7311ca3e96fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:18.458724 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599eac1-83a8-4e78-a242-7311ca3e96fa None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:18.459179 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599eac1-83a8-4e78-a242-7311ca3e96fa None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:18.459691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599eac1-83a8-4e78-a242-7311ca3e96fa None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:18.460661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599eac1-83a8-4e78-a242-7311ca3e96fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:18.461228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599eac1-83a8-4e78-a242-7311ca3e96fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:18.463038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599eac1-83a8-4e78-a242-7311ca3e96fa None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:18.480405 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 407/809] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:39:18.480405 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a7c3d-b896-427f-88e2-afc07bc71d01 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:18.480693 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 403/810] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:18.491855 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599eac1-83a8-4e78-a242-7311ca3e96fa None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:18.597752 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:18.601828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599eac1-83a8-4e78-a242-7311ca3e96fa None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:18.617817 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a7c3d-b896-427f-88e2-afc07bc71d01 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:18.638456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311e995-1ed7-4206-b435-131ba8c7403d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:18.639124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311e995-1ed7-4206-b435-131ba8c7403d None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:18.639408 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311e995-1ed7-4206-b435-131ba8c7403d None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:18.639682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311e995-1ed7-4206-b435-131ba8c7403d None admin] PATH_INFO: `/v3/projects/service` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:18.648567 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7311e995-1ed7-4206-b435-131ba8c7403d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:18.650209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7311e995-1ed7-4206-b435-131ba8c7403d None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:18.663344 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-7311e995-1ed7-4206-b435-131ba8c7403d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:18.663344 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:18.663344 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:18.663344 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:18.663344 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:18.663344 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:18.663344 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:18.663344 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:18.663344 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:18.663344 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:18.663344 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:18.663344 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:18.663344 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:39:18.663344 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:39:18.663344 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:39:18.664506 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:39:18.664506 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:18.664506 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:18.664506 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:18.664506 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:18.664506 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:18.664506 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:18.664506 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:18.664506 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:18.664506 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:18.664506 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:18.664506 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:18.664506 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:18.664506 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:18.664506 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:18.664506 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:18.664506 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:18.665847 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:39:18.665847 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:39:18.665847 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:39:18.665847 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:39:18.665847 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:39:18.665847 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:39:18.665847 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:18.665847 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:18.669652 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 404/811] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:39:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:39:18.673383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311e995-1ed7-4206-b435-131ba8c7403d None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:18.676773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dafafdf-9118-4af7-bdaa-7a37be1cd312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:18.677419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafafdf-9118-4af7-bdaa-7a37be1cd312 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:18.679089 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafafdf-9118-4af7-bdaa-7a37be1cd312 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:18.679585 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafafdf-9118-4af7-bdaa-7a37be1cd312 None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:18.680480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dafafdf-9118-4af7-bdaa-7a37be1cd312 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:18.681514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dafafdf-9118-4af7-bdaa-7a37be1cd312 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:18.683861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dafafdf-9118-4af7-bdaa-7a37be1cd312 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:18.696494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:18.702918 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 408/812] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:18.704808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dafafdf-9118-4af7-bdaa-7a37be1cd312 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:18.789133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311e995-1ed7-4206-b435-131ba8c7403d None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:18.831352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5923bc-ccec-4a83-b194-a1a23ff0c114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:18.831992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5923bc-ccec-4a83-b194-a1a23ff0c114 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:18.832276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5923bc-ccec-4a83-b194-a1a23ff0c114 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:18.832686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5923bc-ccec-4a83-b194-a1a23ff0c114 None admin] PATH_INFO: `/v3/services/network` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:18.833304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5923bc-ccec-4a83-b194-a1a23ff0c114 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:18.835001 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5923bc-ccec-4a83-b194-a1a23ff0c114 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:18.838421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dafafdf-9118-4af7-bdaa-7a37be1cd312 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:18.844269 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-4b5923bc-ccec-4a83-b194-a1a23ff0c114 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 20:39:18.844269 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:18.844269 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:39:18.844269 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:39:18.844269 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:39:18.844269 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:39:18.844269 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:39:18.844269 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:18.844269 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 20:39:18.844269 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:18.844269 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:39:18.844269 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:18.844269 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:18.844269 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:18.844269 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:18.844269 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:18.844269 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:18.845264 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:18.845264 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:18.845264 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:18.845264 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:18.845264 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:18.845264 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:18.845264 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:39:18.845264 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:39:18.845264 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:39:18.845264 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:39:18.845264 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:18.845264 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:18.845264 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:18.845264 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:18.845264 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:18.845264 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:18.846082 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:18.846082 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:18.846082 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:18.846082 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:18.846082 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:18.846082 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:18.846082 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:18.846082 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:18.846082 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:18.846082 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:18.846082 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:39:18.846082 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:18.846082 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 20:39:18.846082 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:18.851114 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 405/813] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:39:18 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:18.851932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5923bc-ccec-4a83-b194-a1a23ff0c114 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:18.885608 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:18.888242 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379e06f-faba-4317-babe-837239ad04b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:18.889077 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379e06f-faba-4317-babe-837239ad04b1 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:18.889725 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379e06f-faba-4317-babe-837239ad04b1 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:18.890504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379e06f-faba-4317-babe-837239ad04b1 None admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:18.891789 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d379e06f-faba-4317-babe-837239ad04b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:18.892464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d379e06f-faba-4317-babe-837239ad04b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:18.894719 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d379e06f-faba-4317-babe-837239ad04b1 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:18.910806 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 409/814] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Aug 6 20:39:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:18.911962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379e06f-faba-4317-babe-837239ad04b1 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:18.979405 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:18.983019 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5923bc-ccec-4a83-b194-a1a23ff0c114 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:19.019034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6b530-1d48-4b6c-8b17-7e0306157ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:19.019665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6b530-1d48-4b6c-8b17-7e0306157ff7 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:19.019932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6b530-1d48-4b6c-8b17-7e0306157ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:19.020211 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6b530-1d48-4b6c-8b17-7e0306157ff7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:19.021910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379e06f-faba-4317-babe-837239ad04b1 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:19.028911 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb6b530-1d48-4b6c-8b17-7e0306157ff7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:19.030580 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb6b530-1d48-4b6c-8b17-7e0306157ff7 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:19.043001 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-4cb6b530-1d48-4b6c-8b17-7e0306157ff7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:39:19.043001 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:19.043001 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:19.043001 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:19.043001 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:19.043001 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:19.043001 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:19.043001 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:19.043001 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:19.043001 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:19.043001 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:19.043001 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:19.043001 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:39:19.043001 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:39:19.043001 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:39:19.043001 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:39:19.043991 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:19.043991 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:19.043991 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:39:19.043991 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:19.043991 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:39:19.043991 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:19.043991 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:19.043991 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:19.043991 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:19.043991 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:19.043991 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:19.043991 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:19.043991 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:19.043991 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:19.043991 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:19.043991 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:19.043991 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:19.043991 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:19.044963 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:19.044963 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:19.044963 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:39:19.044963 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:39:19.044963 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:39:19.044963 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:39:19.044963 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:39:19.044963 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:39:19.044963 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:39:19.044963 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:19.047583 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 406/815] 10.222.0.33 () {56 vars in 1093 bytes} [Sat Aug 6 20:39:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:19.048364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6b530-1d48-4b6c-8b17-7e0306157ff7 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:19.059028 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b1a03-92f2-4492-be73-c5684598e689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:19.059640 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b1a03-92f2-4492-be73-c5684598e689 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:19.059922 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b1a03-92f2-4492-be73-c5684598e689 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:19.060198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b1a03-92f2-4492-be73-c5684598e689 None admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:19.060867 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b1a03-92f2-4492-be73-c5684598e689 None admin] RBAC: Adding query filter params (name=network) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:19.061176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b1a03-92f2-4492-be73-c5684598e689 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:19.062526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b1a03-92f2-4492-be73-c5684598e689 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:19.067100 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 410/816] 10.222.0.33 () {56 vars in 1112 bytes} [Sat Aug 6 20:39:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:19.068241 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116d04d-5f8f-4420-a7f2-d84f8caa9e58 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:19.068526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116d04d-5f8f-4420-a7f2-d84f8caa9e58 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:19.069387 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116d04d-5f8f-4420-a7f2-d84f8caa9e58 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:19.071004 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 411/817] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:19.075491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116d04d-5f8f-4420-a7f2-d84f8caa9e58 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:19.147667 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:19.167249 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6b530-1d48-4b6c-8b17-7e0306157ff7 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:19.184726 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116d04d-5f8f-4420-a7f2-d84f8caa9e58 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:19.205827 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4020ad-3a86-4c4d-8f0f-17a4e0ff2f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:19.206646 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4020ad-3a86-4c4d-8f0f-17a4e0ff2f17 None admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:19.206992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4020ad-3a86-4c4d-8f0f-17a4e0ff2f17 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:19.207344 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4020ad-3a86-4c4d-8f0f-17a4e0ff2f17 None admin] PATH_INFO: `/v3/projects/6c4962342201407a89793c5c9a6a6f36/users/384893600b094d9982c2f98cdac52c77/roles/55fe0e239bac413b90c785211607e1a4` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:19.212661 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:19.224006 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4020ad-3a86-4c4d-8f0f-17a4e0ff2f17 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c4962342201407a89793c5c9a6a6f36, user_id=384893600b094d9982c2f98cdac52c77, role_id=55fe0e239bac413b90c785211607e1a4)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:19.225719 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758b70d-fbc8-4795-800a-118609b24739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:19.226345 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4020ad-3a86-4c4d-8f0f-17a4e0ff2f17 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:19.226944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758b70d-fbc8-4795-800a-118609b24739 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:19.226944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758b70d-fbc8-4795-800a-118609b24739 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:19.227130 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758b70d-fbc8-4795-800a-118609b24739 None admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:19.227739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758b70d-fbc8-4795-800a-118609b24739 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:19.228020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758b70d-fbc8-4795-800a-118609b24739 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:19.231014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758b70d-fbc8-4795-800a-118609b24739 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:19.243748 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 407/818] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Aug 6 20:39:19 2022] PUT /identity/v3/projects/6c4962342201407a89793c5c9a6a6f36/users/384893600b094d9982c2f98cdac52c77/roles/55fe0e239bac413b90c785211607e1a4 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:39:19.250687 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 412/819] 10.222.0.33 () {56 vars in 1133 bytes} [Sat Aug 6 20:39:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:19.251938 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2254e0c-1b20-4e48-b75b-ee40844fef58 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:19.252230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2254e0c-1b20-4e48-b75b-ee40844fef58 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:19.252504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2254e0c-1b20-4e48-b75b-ee40844fef58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:19.255807 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4020ad-3a86-4c4d-8f0f-17a4e0ff2f17 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:19.274903 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-f2254e0c-1b20-4e48-b75b-ee40844fef58 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:19.276277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f2254e0c-1b20-4e48-b75b-ee40844fef58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:19.366891 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 413/820] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:39:19.368061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2254e0c-1b20-4e48-b75b-ee40844fef58 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:19.407589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4020ad-3a86-4c4d-8f0f-17a4e0ff2f17 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:19.459865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35da39b-d4ec-42c6-8894-d43c78d01283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:19.461002 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35da39b-d4ec-42c6-8894-d43c78d01283 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:19.461488 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35da39b-d4ec-42c6-8894-d43c78d01283 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:19.461763 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35da39b-d4ec-42c6-8894-d43c78d01283 None admin] PATH_INFO: `/v3/services` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:19.462747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35da39b-d4ec-42c6-8894-d43c78d01283 None admin] RBAC: Adding query filter params (type=network) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:19.463311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35da39b-d4ec-42c6-8894-d43c78d01283 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:19.464691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35da39b-d4ec-42c6-8894-d43c78d01283 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:19.466214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:19.473521 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 408/821] 10.222.0.33 () {56 vars in 1112 bytes} [Sat Aug 6 20:39:19 2022] GET /identity/v3/services?type=network => generated 350 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:19.474403 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35da39b-d4ec-42c6-8894-d43c78d01283 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:19.511855 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2254e0c-1b20-4e48-b75b-ee40844fef58 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:19.527058 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:19.551210 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366e1da-0c55-4bb0-8be0-5f67f313330c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:19.552003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366e1da-0c55-4bb0-8be0-5f67f313330c None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:19.552349 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366e1da-0c55-4bb0-8be0-5f67f313330c None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:19.552627 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366e1da-0c55-4bb0-8be0-5f67f313330c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:19.609038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35da39b-d4ec-42c6-8894-d43c78d01283 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:19.631890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366e1da-0c55-4bb0-8be0-5f67f313330c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:19.633545 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366e1da-0c55-4bb0-8be0-5f67f313330c None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:19.649308 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ca9cb-ce80-4271-89b1-92e70cd87c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:19.650390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ca9cb-ce80-4271-89b1-92e70cd87c0d None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:19.650900 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ca9cb-ce80-4271-89b1-92e70cd87c0d None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:19.651412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ca9cb-ce80-4271-89b1-92e70cd87c0d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:19.652195 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ca9cb-ce80-4271-89b1-92e70cd87c0d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:19.653970 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ca9cb-ce80-4271-89b1-92e70cd87c0d None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:19.663814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-aa7ca9cb-ce80-4271-89b1-92e70cd87c0d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 20:39:19.663814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:19.663814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:39:19.663814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:39:19.663814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:39:19.663814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:39:19.663814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:39:19.663814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:19.663814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 20:39:19.663814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:19.663814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:39:19.663814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:19.663814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:19.663814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:19.663814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:19.663814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:19.663814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:19.664838 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:19.664838 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:19.664838 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:19.664838 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:19.664838 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:19.664838 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:19.664838 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:39:19.664838 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:39:19.664838 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:39:19.664838 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:39:19.664838 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:19.664838 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:19.664838 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:19.664838 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:19.664838 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:19.664838 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:19.665696 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:19.665696 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:19.665696 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:19.665696 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:19.665696 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:19.665696 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:19.665696 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:19.665696 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:19.665696 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:19.665696 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:19.665696 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:39:19.665696 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:19.665696 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 20:39:19.665696 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:19.668611 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 409/822] 10.222.0.33 () {56 vars in 1129 bytes} [Sat Aug 6 20:39:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:19.669709 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ca9cb-ce80-4271-89b1-92e70cd87c0d None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:19.747963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:19.766126 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 414/823] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:39:19 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 20:39:19.767386 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366e1da-0c55-4bb0-8be0-5f67f313330c None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:19.786368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:19.805450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ca9cb-ce80-4271-89b1-92e70cd87c0d None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:19.854060 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ee331-9a2c-4369-9392-ddd296f97fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:19.855620 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ee331-9a2c-4369-9392-ddd296f97fe9 None admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:19.855904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ee331-9a2c-4369-9392-ddd296f97fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:19.856180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ee331-9a2c-4369-9392-ddd296f97fe9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:19.856845 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ee331-9a2c-4369-9392-ddd296f97fe9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:19.858219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ee331-9a2c-4369-9392-ddd296f97fe9 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:19.888788 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 410/824] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:39:19 2022] POST /identity/v3/endpoints => generated 337 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:39:19.889653 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ee331-9a2c-4369-9392-ddd296f97fe9 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:19.892958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366e1da-0c55-4bb0-8be0-5f67f313330c None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:20.035856 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b419a92-bb00-4414-af23-590ead077240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:20.038525 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b419a92-bb00-4414-af23-590ead077240 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:20.039011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b419a92-bb00-4414-af23-590ead077240 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:20.039455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b419a92-bb00-4414-af23-590ead077240 None admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:20.040783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b419a92-bb00-4414-af23-590ead077240 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:20.042021 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b419a92-bb00-4414-af23-590ead077240 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:20.043648 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b419a92-bb00-4414-af23-590ead077240 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:20.054590 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 415/825] 10.222.0.33 () {56 vars in 1124 bytes} [Sat Aug 6 20:39:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:20.055874 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ee331-9a2c-4369-9392-ddd296f97fe9 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:20.060983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b419a92-bb00-4414-af23-590ead077240 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:20.096038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:20.128726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be34b04-400b-4f5e-bb34-f2d9c75dc835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:20.129666 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be34b04-400b-4f5e-bb34-f2d9c75dc835 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:20.130148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be34b04-400b-4f5e-bb34-f2d9c75dc835 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:20.130576 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be34b04-400b-4f5e-bb34-f2d9c75dc835 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:20.145644 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be34b04-400b-4f5e-bb34-f2d9c75dc835 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:20.147543 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be34b04-400b-4f5e-bb34-f2d9c75dc835 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:20.163210 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-1be34b04-400b-4f5e-bb34-f2d9c75dc835 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:20.163210 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:20.163210 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:20.163210 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:20.163210 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:20.163210 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:20.163210 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:20.163210 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:20.163210 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:20.163210 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:20.163210 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:20.163210 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:20.163210 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:39:20.163210 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:39:20.163210 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:39:20.163210 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:39:20.164391 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:20.164391 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:20.164391 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:20.164391 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:20.164391 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:20.164391 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:20.164391 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:20.164391 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:20.164391 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:20.164391 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:20.164391 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:20.164391 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:20.164391 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:20.164391 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:20.164391 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:20.164391 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:20.164391 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:39:20.165471 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:39:20.165471 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:20.165471 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:20.165640 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:20.172323 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 411/826] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:20.173911 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be34b04-400b-4f5e-bb34-f2d9c75dc835 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:20.199708 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b419a92-bb00-4414-af23-590ead077240 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:20.244559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588ae3c-9061-44d3-8a7d-61cf98a3fd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:20.245177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588ae3c-9061-44d3-8a7d-61cf98a3fd90 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:20.245458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588ae3c-9061-44d3-8a7d-61cf98a3fd90 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:20.245729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588ae3c-9061-44d3-8a7d-61cf98a3fd90 None admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:20.246360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588ae3c-9061-44d3-8a7d-61cf98a3fd90 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:20.246696 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588ae3c-9061-44d3-8a7d-61cf98a3fd90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:20.248150 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588ae3c-9061-44d3-8a7d-61cf98a3fd90 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:20.254805 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 416/827] 10.222.0.33 () {56 vars in 1124 bytes} [Sat Aug 6 20:39:20 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:20.263522 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588ae3c-9061-44d3-8a7d-61cf98a3fd90 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:20.296170 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be34b04-400b-4f5e-bb34-f2d9c75dc835 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:20.332585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c84d14-6cc9-4871-82f7-a490d4222d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:20.333586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c84d14-6cc9-4871-82f7-a490d4222d5f None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:20.334135 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c84d14-6cc9-4871-82f7-a490d4222d5f None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:20.335178 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c84d14-6cc9-4871-82f7-a490d4222d5f None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:20.336013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c84d14-6cc9-4871-82f7-a490d4222d5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:20.336523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c84d14-6cc9-4871-82f7-a490d4222d5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:20.338444 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c84d14-6cc9-4871-82f7-a490d4222d5f None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:20.354332 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 412/828] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:20.358496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c84d14-6cc9-4871-82f7-a490d4222d5f None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:20.382845 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588ae3c-9061-44d3-8a7d-61cf98a3fd90 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:20.391402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:20.423826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f1cbe-bede-47e7-97be-3075d0834a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:20.424514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f1cbe-bede-47e7-97be-3075d0834a61 None admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:20.424713 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f1cbe-bede-47e7-97be-3075d0834a61 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:20.425015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f1cbe-bede-47e7-97be-3075d0834a61 None admin] PATH_INFO: `/v3/endpoints` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:20.425658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f1cbe-bede-47e7-97be-3075d0834a61 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:20.427063 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f1cbe-bede-47e7-97be-3075d0834a61 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:20.433480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:20.451083 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 417/829] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:39:20 2022] POST /identity/v3/endpoints => generated 346 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:39:20.466638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbf6e5-86c6-4ee1-9d4a-16ce5ec8c4ad None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:20.466638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbf6e5-86c6-4ee1-9d4a-16ce5ec8c4ad None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:20.466638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbf6e5-86c6-4ee1-9d4a-16ce5ec8c4ad None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:20.466638 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 418/830] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:20 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:20.468722 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621b9e1-a273-4632-b8fe-98e7f253299a None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:20.469015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621b9e1-a273-4632-b8fe-98e7f253299a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:20.469293 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621b9e1-a273-4632-b8fe-98e7f253299a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:20.470913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c84d14-6cc9-4871-82f7-a490d4222d5f None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:20.494215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a621b9e1-a273-4632-b8fe-98e7f253299a None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:20.495516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a621b9e1-a273-4632-b8fe-98e7f253299a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:20.532092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273a705-1b85-41b9-9767-11b1ac7dfe2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:20.532756 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273a705-1b85-41b9-9767-11b1ac7dfe2a None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:20.533031 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273a705-1b85-41b9-9767-11b1ac7dfe2a None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:20.533298 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273a705-1b85-41b9-9767-11b1ac7dfe2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:20.544558 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e273a705-1b85-41b9-9767-11b1ac7dfe2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:20.546013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e273a705-1b85-41b9-9767-11b1ac7dfe2a None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:20.559445 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-e273a705-1b85-41b9-9767-11b1ac7dfe2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:20.559445 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:20.559445 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:20.559445 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:20.559445 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:20.559445 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:20.559445 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:20.559445 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:20.559445 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:20.559445 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:20.559445 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:20.559445 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:20.559445 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:39:20.559445 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:39:20.559445 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:39:20.560453 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:39:20.560453 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:20.560453 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:20.560453 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:20.560453 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:20.560453 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:20.560453 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:20.560453 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:20.560453 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:20.560453 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:20.560453 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:20.560453 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:20.560453 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:20.560453 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:20.560453 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:20.560453 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:20.560453 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:20.561353 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:39:20.561353 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:39:20.561353 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:39:20.561353 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:39:20.561353 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:39:20.561353 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:39:20.561353 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:20.561353 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:20.565360 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 413/831] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:39:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:39:20.566743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273a705-1b85-41b9-9767-11b1ac7dfe2a None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:20.610822 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 419/832] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 20:39:20.639175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621b9e1-a273-4632-b8fe-98e7f253299a None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:20.680550 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:20.702613 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273a705-1b85-41b9-9767-11b1ac7dfe2a None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:20.741568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f1565-9993-4c0c-bc70-7af11cf0c9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:20.742355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f1565-9993-4c0c-bc70-7af11cf0c9df None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:20.742669 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f1565-9993-4c0c-bc70-7af11cf0c9df None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:20.743091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f1565-9993-4c0c-bc70-7af11cf0c9df None admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:20.743826 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f1565-9993-4c0c-bc70-7af11cf0c9df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:20.744136 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f1565-9993-4c0c-bc70-7af11cf0c9df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:20.745791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f1565-9993-4c0c-bc70-7af11cf0c9df None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:20.763944 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 414/833] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Aug 6 20:39:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:20.765470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f1565-9993-4c0c-bc70-7af11cf0c9df None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:20.767592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621b9e1-a273-4632-b8fe-98e7f253299a None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:20.796225 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:20.813117 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88826cfd-5497-4fd8-a27f-3d6361f6d106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:20.814322 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88826cfd-5497-4fd8-a27f-3d6361f6d106 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:20.814827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88826cfd-5497-4fd8-a27f-3d6361f6d106 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:20.815551 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88826cfd-5497-4fd8-a27f-3d6361f6d106 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:20.828563 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88826cfd-5497-4fd8-a27f-3d6361f6d106 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:39:20.836006 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-88826cfd-5497-4fd8-a27f-3d6361f6d106 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:39:20.836006 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:20.836006 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:20.836006 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:20.836006 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:20.836006 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:20.836006 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:20.836006 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:20.836006 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:20.836006 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:20.836006 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:20.836006 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:20.836006 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:39:20.836006 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:39:20.836006 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:39:20.836006 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:39:20.836941 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:39:20.836941 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:39:20.836941 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:39:20.836941 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:39:20.836941 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:20.836941 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:20.836941 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:20.836941 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:20.836941 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:20.836941 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:20.836941 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:20.836941 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:20.836941 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:20.836941 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:20.836941 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:20.836941 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:20.837780 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:20.837780 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:20.837780 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:20.837780 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:20.837780 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:39:20.837780 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:39:20.837780 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:39:20.837780 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:39:20.837780 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:39:20.837780 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:39:20.837780 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:39:20.837780 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:20.840366 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 420/834] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Aug 6 20:39:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:20.846797 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88826cfd-5497-4fd8-a27f-3d6361f6d106 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:20.887626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f1565-9993-4c0c-bc70-7af11cf0c9df None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:20.932054 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0196ed8-33ab-47db-87f8-87124b2904ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:20.933089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0196ed8-33ab-47db-87f8-87124b2904ed None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:20.934277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0196ed8-33ab-47db-87f8-87124b2904ed None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:20.934721 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0196ed8-33ab-47db-87f8-87124b2904ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:20.935599 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0196ed8-33ab-47db-87f8-87124b2904ed None admin] RBAC: Adding query filter params (role.id=ab245eea8a714462a00c4546309de9c9, scope.project.id=6c4962342201407a89793c5c9a6a6f36, user.id=5f9d53147a57402f8b9818590bc1fc1f) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:20.936048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0196ed8-33ab-47db-87f8-87124b2904ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:20.937688 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0196ed8-33ab-47db-87f8-87124b2904ed None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:20.955163 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 415/835] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:39:20 2022] GET /identity/v3/role_assignments?user.id=5f9d53147a57402f8b9818590bc1fc1f&scope.project.id=6c4962342201407a89793c5c9a6a6f36&role.id=ab245eea8a714462a00c4546309de9c9 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:20.976896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88826cfd-5497-4fd8-a27f-3d6361f6d106 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:21.016300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083db2b-d0b9-4eee-ad84-335c10226682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:21.017124 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083db2b-d0b9-4eee-ad84-335c10226682 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:21.017410 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083db2b-d0b9-4eee-ad84-335c10226682 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:21.017684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083db2b-d0b9-4eee-ad84-335c10226682 None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:21.018362 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083db2b-d0b9-4eee-ad84-335c10226682 None admin] RBAC: Adding query filter params (name=admin) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:21.018710 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083db2b-d0b9-4eee-ad84-335c10226682 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:21.020114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083db2b-d0b9-4eee-ad84-335c10226682 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:21.030794 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 421/836] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:39:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:21.036509 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0196ed8-33ab-47db-87f8-87124b2904ed None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:21.050787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:21.151052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0196ed8-33ab-47db-87f8-87124b2904ed None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:21.188567 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1207dbb-6f75-4ac0-bd21-9dcfc4f05a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:21.189558 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1207dbb-6f75-4ac0-bd21-9dcfc4f05a7f None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:21.190051 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1207dbb-6f75-4ac0-bd21-9dcfc4f05a7f None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:21.190514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1207dbb-6f75-4ac0-bd21-9dcfc4f05a7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:21.203218 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1207dbb-6f75-4ac0-bd21-9dcfc4f05a7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:21.204962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1207dbb-6f75-4ac0-bd21-9dcfc4f05a7f None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:21.220834 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-d1207dbb-6f75-4ac0-bd21-9dcfc4f05a7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:21.220834 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:21.220834 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:21.220834 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:21.220834 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:21.220834 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:21.220834 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:21.220834 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:21.220834 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:21.220834 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:21.220834 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:21.220834 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:21.220834 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:39:21.220834 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:39:21.220834 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:39:21.220834 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:39:21.221822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:21.221822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:21.221822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:21.221822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:21.221822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:21.221822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:21.221822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:21.221822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:21.221822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:21.221822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:21.221822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:21.221822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:21.221822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:21.221822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:21.221822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:21.221822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:21.221822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:39:21.222768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:39:21.222768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:21.222768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:21.223457 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 416/837] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:21.228937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083db2b-d0b9-4eee-ad84-335c10226682 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:21.289403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:21.348416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083db2b-d0b9-4eee-ad84-335c10226682 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:21.384596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999edda-7070-4ae6-9ca7-1958ebe3f925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:21.385222 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999edda-7070-4ae6-9ca7-1958ebe3f925 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:21.385472 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999edda-7070-4ae6-9ca7-1958ebe3f925 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:21.385747 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999edda-7070-4ae6-9ca7-1958ebe3f925 None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:21.386390 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999edda-7070-4ae6-9ca7-1958ebe3f925 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:21.386743 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999edda-7070-4ae6-9ca7-1958ebe3f925 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:21.388122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999edda-7070-4ae6-9ca7-1958ebe3f925 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:21.401657 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 422/838] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:21.407069 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1207dbb-6f75-4ac0-bd21-9dcfc4f05a7f None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:21.472149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:21.515551 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1207dbb-6f75-4ac0-bd21-9dcfc4f05a7f None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:21.556140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1b971-2110-44fd-8a59-c78919f73873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:21.557085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1b971-2110-44fd-8a59-c78919f73873 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:21.557375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1b971-2110-44fd-8a59-c78919f73873 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:21.557647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1b971-2110-44fd-8a59-c78919f73873 None admin] PATH_INFO: `/v3/users/swift` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:21.565736 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1b971-2110-44fd-8a59-c78919f73873 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:21.567227 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1b971-2110-44fd-8a59-c78919f73873 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:21.579312 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-05e1b971-2110-44fd-8a59-c78919f73873 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 06 20:39:21.579312 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:21.579312 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:21.579312 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:21.579312 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:21.579312 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:21.579312 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:21.579312 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:21.579312 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:21.579312 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:21.579312 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:21.579312 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:21.579312 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:39:21.579312 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:39:21.579312 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:39:21.579312 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:39:21.580275 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:21.580275 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:21.580275 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:39:21.580275 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:21.580275 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:39:21.580275 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:21.580275 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:21.580275 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:21.580275 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:21.580275 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:21.580275 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:21.580275 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:21.580275 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:21.580275 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:21.580275 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:21.580275 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:21.580275 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:21.580275 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:21.581593 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:21.581593 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:21.581593 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:39:21.581593 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:39:21.581593 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:39:21.581593 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:39:21.581593 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:39:21.581593 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:39:21.581593 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 06 20:39:21.581593 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:21.581593 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 417/839] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Aug 6 20:39:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:21.587777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999edda-7070-4ae6-9ca7-1958ebe3f925 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:21.677397 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2e5ea-cd99-4c29-8917-aa17b7cdd3f3 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:21.677397 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2e5ea-cd99-4c29-8917-aa17b7cdd3f3 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:21.677397 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2e5ea-cd99-4c29-8917-aa17b7cdd3f3 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:21.677397 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 418/840] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:21.683978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ea0fa-931d-4a3e-bbc9-4bc8045fc5c1 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:21.684260 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ea0fa-931d-4a3e-bbc9-4bc8045fc5c1 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:21.684537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ea0fa-931d-4a3e-bbc9-4bc8045fc5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:21.695858 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999edda-7070-4ae6-9ca7-1958ebe3f925 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:21.699251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:21.713550 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-0f4ea0fa-931d-4a3e-bbc9-4bc8045fc5c1 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:21.714898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0f4ea0fa-931d-4a3e-bbc9-4bc8045fc5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:21.734207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0cf290-53dd-49b7-a5b7-8378a135a922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:21.735174 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cf290-53dd-49b7-a5b7-8378a135a922 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:21.735447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cf290-53dd-49b7-a5b7-8378a135a922 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:21.735776 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cf290-53dd-49b7-a5b7-8378a135a922 None admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:21.736517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0cf290-53dd-49b7-a5b7-8378a135a922 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:21.736821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0cf290-53dd-49b7-a5b7-8378a135a922 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:21.738864 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0cf290-53dd-49b7-a5b7-8378a135a922 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:21.768144 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 423/841] 10.222.0.33 () {56 vars in 1135 bytes} [Sat Aug 6 20:39:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:21.774579 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0cf290-53dd-49b7-a5b7-8378a135a922 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:21.804613 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 419/842] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:39:21.838219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ea0fa-931d-4a3e-bbc9-4bc8045fc5c1 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:21.906731 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0cf290-53dd-49b7-a5b7-8378a135a922 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:21.907689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:21.958654 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ea0fa-931d-4a3e-bbc9-4bc8045fc5c1 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:21.958824 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72594e30-a85e-4e86-a06a-2c76d656dd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:21.959379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72594e30-a85e-4e86-a06a-2c76d656dd76 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:21.959659 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72594e30-a85e-4e86-a06a-2c76d656dd76 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:21.960106 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72594e30-a85e-4e86-a06a-2c76d656dd76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:21.995472 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbe7c8-0e17-49de-800d-1ecc9e01408b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:21.996280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbe7c8-0e17-49de-800d-1ecc9e01408b None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:21.996626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbe7c8-0e17-49de-800d-1ecc9e01408b None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:21.997008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbe7c8-0e17-49de-800d-1ecc9e01408b None admin] PATH_INFO: `/v3/roles/service` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:22.000690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:22.010358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bbe7c8-0e17-49de-800d-1ecc9e01408b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:39:22.015578 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-18bbe7c8-0e17-49de-800d-1ecc9e01408b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:39:22.015578 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:22.015578 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:22.015578 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:22.015578 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:22.015578 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:22.015578 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:22.015578 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:22.015578 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:22.015578 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:22.015578 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:22.015578 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:22.015578 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:39:22.015578 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:39:22.015578 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:39:22.015578 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:39:22.016501 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:39:22.016501 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:39:22.016501 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:39:22.016501 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:39:22.016501 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:22.016501 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:22.016501 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:22.016501 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:22.016501 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:22.016501 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:22.016501 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:22.016501 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:22.016501 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:22.016501 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:22.016501 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:22.016501 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:22.017488 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:22.017488 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:22.017488 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:22.017488 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:22.017488 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:39:22.017488 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:39:22.017488 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:39:22.017488 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:39:22.017488 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:39:22.017488 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:39:22.017488 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:39:22.017488 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:22.017488 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 420/843] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Aug 6 20:39:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:39:22.023154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbe7c8-0e17-49de-800d-1ecc9e01408b None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:22.069931 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72594e30-a85e-4e86-a06a-2c76d656dd76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:22.071432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72594e30-a85e-4e86-a06a-2c76d656dd76 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:22.161991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbe7c8-0e17-49de-800d-1ecc9e01408b None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:22.176279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:22.202728 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 424/844] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:39:21 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 06 20:39:22.203950 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72594e30-a85e-4e86-a06a-2c76d656dd76 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:22.206460 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13868d22-61b8-4cb7-b101-d6402f5d5f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:22.208281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13868d22-61b8-4cb7-b101-d6402f5d5f51 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:22.208777 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13868d22-61b8-4cb7-b101-d6402f5d5f51 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:22.209721 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13868d22-61b8-4cb7-b101-d6402f5d5f51 None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:22.210559 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13868d22-61b8-4cb7-b101-d6402f5d5f51 None admin] RBAC: Adding query filter params (name=service) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:22.211028 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13868d22-61b8-4cb7-b101-d6402f5d5f51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:22.212576 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13868d22-61b8-4cb7-b101-d6402f5d5f51 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:22.230181 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 421/845] 10.222.0.33 () {56 vars in 1103 bytes} [Sat Aug 6 20:39:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:22.230700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13868d22-61b8-4cb7-b101-d6402f5d5f51 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:22.280268 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:22.322889 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72594e30-a85e-4e86-a06a-2c76d656dd76 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:22.351802 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13868d22-61b8-4cb7-b101-d6402f5d5f51 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:22.361674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ba1e9-925a-44af-a80b-95d530f21224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:22.362643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ba1e9-925a-44af-a80b-95d530f21224 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:22.363163 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ba1e9-925a-44af-a80b-95d530f21224 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:22.363651 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ba1e9-925a-44af-a80b-95d530f21224 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:22.375031 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ba1e9-925a-44af-a80b-95d530f21224 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:22.376740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ba1e9-925a-44af-a80b-95d530f21224 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:22.390017 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b5add-39de-40c9-b06b-402feb041e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:22.390683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b5add-39de-40c9-b06b-402feb041e92 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:22.391025 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b5add-39de-40c9-b06b-402feb041e92 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:22.391309 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b5add-39de-40c9-b06b-402feb041e92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:22.393997 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-010ba1e9-925a-44af-a80b-95d530f21224 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:22.393997 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:22.393997 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:22.393997 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:22.393997 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:22.393997 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:22.393997 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:22.393997 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:22.393997 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:22.393997 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:22.393997 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:22.393997 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:22.393997 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:39:22.393997 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:39:22.393997 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:39:22.393997 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:39:22.395394 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:22.395394 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:22.395394 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:22.395394 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:22.395394 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:22.395394 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:22.395394 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:22.395394 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:22.395394 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:22.395394 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:22.395394 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:22.395394 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:22.395394 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:22.395394 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:22.395394 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:22.395394 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:22.395394 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:39:22.396279 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:39:22.396279 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:22.396279 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:22.402903 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 425/846] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:39:22.403764 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b5add-39de-40c9-b06b-402feb041e92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:22.404817 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ba1e9-925a-44af-a80b-95d530f21224 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:22.405356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b5add-39de-40c9-b06b-402feb041e92 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:22.421348 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-614b5add-39de-40c9-b06b-402feb041e92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:22.421348 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:22.421348 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:22.421348 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:22.421348 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:22.421348 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:22.421348 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:22.421348 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:22.421348 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:22.421348 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:22.421348 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:22.421348 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:22.421348 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:39:22.421348 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:39:22.421348 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:39:22.421348 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:39:22.422328 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:22.422328 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:22.422328 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:22.422328 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:22.422328 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:22.422328 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:22.422328 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:22.422328 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:22.422328 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:22.422328 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:22.422328 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:22.422328 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:22.422328 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:22.422328 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:22.422328 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:22.422328 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:22.422328 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:39:22.423271 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:39:22.423271 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:22.423271 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:22.429766 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 422/847] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:39:22.430885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b5add-39de-40c9-b06b-402feb041e92 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:22.462763 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:22.521142 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ba1e9-925a-44af-a80b-95d530f21224 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:22.536150 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:22.543146 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b5add-39de-40c9-b06b-402feb041e92 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:22.561411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cc56e-923a-4d26-9c0a-64fbd76725ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:22.562360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cc56e-923a-4d26-9c0a-64fbd76725ce None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:22.562868 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cc56e-923a-4d26-9c0a-64fbd76725ce None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:22.563370 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cc56e-923a-4d26-9c0a-64fbd76725ce None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:22.564294 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977cc56e-923a-4d26-9c0a-64fbd76725ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:22.564795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977cc56e-923a-4d26-9c0a-64fbd76725ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:22.566370 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977cc56e-923a-4d26-9c0a-64fbd76725ce None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:22.583696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b845503-99e2-4c09-8220-65489035446d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:22.583696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b845503-99e2-4c09-8220-65489035446d None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:22.583696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b845503-99e2-4c09-8220-65489035446d None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:22.583696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b845503-99e2-4c09-8220-65489035446d None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:22.584753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b845503-99e2-4c09-8220-65489035446d None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:22.584753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b845503-99e2-4c09-8220-65489035446d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:22.585560 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 426/848] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:22.585665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b845503-99e2-4c09-8220-65489035446d None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:22.586759 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cc56e-923a-4d26-9c0a-64fbd76725ce None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:22.603214 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 423/849] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:22.604303 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b845503-99e2-4c09-8220-65489035446d None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:22.715195 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:22.728400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cc56e-923a-4d26-9c0a-64fbd76725ce None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:22.734113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b845503-99e2-4c09-8220-65489035446d None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:22.766587 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24372f-e406-49c2-9c13-acfc29f17d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:22.767502 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24372f-e406-49c2-9c13-acfc29f17d5d None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:22.767502 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24372f-e406-49c2-9c13-acfc29f17d5d None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:22.767795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24372f-e406-49c2-9c13-acfc29f17d5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:22.776337 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24372f-e406-49c2-9c13-acfc29f17d5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:22.777805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24372f-e406-49c2-9c13-acfc29f17d5d None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:22.778118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437d0f9-ab50-4425-9923-43eb8b3cc3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:22.779207 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437d0f9-ab50-4425-9923-43eb8b3cc3d5 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:22.779801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437d0f9-ab50-4425-9923-43eb8b3cc3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:22.780281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437d0f9-ab50-4425-9923-43eb8b3cc3d5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:22.788833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437d0f9-ab50-4425-9923-43eb8b3cc3d5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:22.790717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437d0f9-ab50-4425-9923-43eb8b3cc3d5 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:22.790828 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-8a24372f-e406-49c2-9c13-acfc29f17d5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:22.790828 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:22.790828 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:22.790828 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:22.790828 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:22.790828 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:22.790828 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:22.790828 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:22.790828 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:22.790828 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:22.790828 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:22.790828 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:22.790828 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:39:22.790828 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:39:22.790828 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:39:22.791786 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:39:22.791786 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:22.791786 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:22.791786 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:22.791786 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:22.791786 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:22.791786 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:22.791786 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:22.791786 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:22.791786 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:22.791786 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:22.791786 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:22.791786 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:22.791786 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:22.791786 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:22.791786 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:22.791786 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:22.792716 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:39:22.792716 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:39:22.792716 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:39:22.792716 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:39:22.792716 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:39:22.792716 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:39:22.792716 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:22.792716 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:22.792716 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 427/850] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:39:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:22.804859 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24372f-e406-49c2-9c13-acfc29f17d5d None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:22.807005 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-5437d0f9-ab50-4425-9923-43eb8b3cc3d5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 20:39:22.807005 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:22.807005 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:22.807005 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:22.807005 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:22.807005 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:22.807005 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:22.807005 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:22.807005 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:22.807005 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:22.807005 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:22.807005 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:22.807005 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:39:22.807005 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:39:22.807005 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:39:22.807005 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:39:22.808077 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:22.808077 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:22.808077 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:39:22.808077 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:22.808077 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:39:22.808077 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:22.808077 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:22.808077 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:22.808077 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:22.808077 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:22.808077 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:22.808077 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:22.808077 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:22.808077 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:22.808077 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:22.808077 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:22.808077 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:22.808077 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:22.809048 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:22.809048 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:22.809048 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:39:22.809048 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:39:22.809048 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:39:22.809048 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:39:22.809048 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:39:22.809048 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:39:22.809048 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 20:39:22.809048 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:22.809048 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 424/851] 10.222.0.33 () {56 vars in 1117 bytes} [Sat Aug 6 20:39:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:22.817822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437d0f9-ab50-4425-9923-43eb8b3cc3d5 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:22.842488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:22.914249 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24372f-e406-49c2-9c13-acfc29f17d5d None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:22.932425 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437d0f9-ab50-4425-9923-43eb8b3cc3d5 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:22.951112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc25b2-b437-4c1c-8b70-eeb45126c378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:22.951711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc25b2-b437-4c1c-8b70-eeb45126c378 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:22.951985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc25b2-b437-4c1c-8b70-eeb45126c378 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:22.952254 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc25b2-b437-4c1c-8b70-eeb45126c378 None admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:22.952939 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc25b2-b437-4c1c-8b70-eeb45126c378 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:22.953241 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc25b2-b437-4c1c-8b70-eeb45126c378 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:22.954680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc25b2-b437-4c1c-8b70-eeb45126c378 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:22.971412 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 428/852] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Aug 6 20:39:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:22.971412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41392ec1-af0b-4c9f-bb7e-0fe3fb136855 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:22.971412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41392ec1-af0b-4c9f-bb7e-0fe3fb136855 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:22.971412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41392ec1-af0b-4c9f-bb7e-0fe3fb136855 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:22.971412 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 429/853] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:22.974912 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41392ec1-af0b-4c9f-bb7e-0fe3fb136855 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:22.975571 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65be8df-ce77-464f-b799-3d4b89d81746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:22.976199 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65be8df-ce77-464f-b799-3d4b89d81746 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:22.976483 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65be8df-ce77-464f-b799-3d4b89d81746 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:22.976759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65be8df-ce77-464f-b799-3d4b89d81746 None admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:22.977492 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65be8df-ce77-464f-b799-3d4b89d81746 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:22.977801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65be8df-ce77-464f-b799-3d4b89d81746 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:22.979284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65be8df-ce77-464f-b799-3d4b89d81746 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:22.997365 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 425/854] 10.222.0.33 () {56 vars in 1149 bytes} [Sat Aug 6 20:39:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:22.998629 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576a258-526f-47cf-b3ec-4c9ea2231364 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:22.998919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576a258-526f-47cf-b3ec-4c9ea2231364 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:22.999192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576a258-526f-47cf-b3ec-4c9ea2231364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:23.007295 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:23.018411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-2576a258-526f-47cf-b3ec-4c9ea2231364 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:23.019638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2576a258-526f-47cf-b3ec-4c9ea2231364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:23.086755 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 426/855] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:22 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:39:23.087611 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576a258-526f-47cf-b3ec-4c9ea2231364 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:23.091449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:23.105706 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41392ec1-af0b-4c9f-bb7e-0fe3fb136855 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:23.142317 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b3b4d-1395-41be-a250-9cab4dad1a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:23.142952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b3b4d-1395-41be-a250-9cab4dad1a70 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:23.143234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b3b4d-1395-41be-a250-9cab4dad1a70 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:23.143508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b3b4d-1395-41be-a250-9cab4dad1a70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:23.144231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b3b4d-1395-41be-a250-9cab4dad1a70 None admin] RBAC: Adding query filter params (role.id=ab245eea8a714462a00c4546309de9c9, scope.project.id=6c4962342201407a89793c5c9a6a6f36, user.id=cd3e0e177f934f7ba5abe52ac8bf8bbb) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:23.144701 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b3b4d-1395-41be-a250-9cab4dad1a70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:23.145976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b3b4d-1395-41be-a250-9cab4dad1a70 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:23.152500 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 430/856] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:39:22 2022] GET /identity/v3/role_assignments?user.id=cd3e0e177f934f7ba5abe52ac8bf8bbb&scope.project.id=6c4962342201407a89793c5c9a6a6f36&role.id=ab245eea8a714462a00c4546309de9c9 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:23.153308 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b3b4d-1395-41be-a250-9cab4dad1a70 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:23.253358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576a258-526f-47cf-b3ec-4c9ea2231364 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:23.285778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b3b4d-1395-41be-a250-9cab4dad1a70 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:23.310946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13555d4e-1344-4a8c-a895-7bb0e0bd1b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:23.312236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13555d4e-1344-4a8c-a895-7bb0e0bd1b93 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:23.312721 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13555d4e-1344-4a8c-a895-7bb0e0bd1b93 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:23.313420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13555d4e-1344-4a8c-a895-7bb0e0bd1b93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:23.318260 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:23.328476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d166cd-20a2-40d6-9084-68687f772a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:23.329784 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d166cd-20a2-40d6-9084-68687f772a38 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:23.330213 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d166cd-20a2-40d6-9084-68687f772a38 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:23.330653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d166cd-20a2-40d6-9084-68687f772a38 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:23.331723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d166cd-20a2-40d6-9084-68687f772a38 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:23.333548 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d166cd-20a2-40d6-9084-68687f772a38 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:23.345971 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-34d166cd-20a2-40d6-9084-68687f772a38 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 20:39:23.345971 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:23.345971 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:39:23.345971 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:39:23.345971 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:39:23.345971 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:39:23.345971 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:39:23.345971 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:23.345971 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 20:39:23.345971 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:23.345971 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:39:23.345971 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:23.345971 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:23.345971 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:23.345971 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:23.345971 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:23.345971 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:23.347236 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:23.347236 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:23.347236 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:23.347236 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:23.347236 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:23.347236 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:23.347236 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:39:23.347236 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:39:23.347236 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:39:23.347236 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:39:23.347236 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:23.347236 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:23.347236 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:23.347236 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:23.347236 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:23.347236 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:23.348122 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:23.348122 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:23.348122 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:23.348122 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:23.348122 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:23.348122 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:23.348122 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:23.348122 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:23.348122 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:23.348122 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:23.348122 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:39:23.348122 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:23.348122 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 20:39:23.348122 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:23.350973 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 431/857] 10.222.0.33 () {56 vars in 1114 bytes} [Sat Aug 6 20:39:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:23.358990 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d166cd-20a2-40d6-9084-68687f772a38 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:23.389422 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:23.398912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13555d4e-1344-4a8c-a895-7bb0e0bd1b93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:23.400387 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13555d4e-1344-4a8c-a895-7bb0e0bd1b93 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:23.473166 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d166cd-20a2-40d6-9084-68687f772a38 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:23.511454 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 427/858] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:39:23 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 20:39:23.511454 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e307c8-4643-4269-9655-f85c566437ad None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:23.511454 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e307c8-4643-4269-9655-f85c566437ad None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:23.511454 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e307c8-4643-4269-9655-f85c566437ad None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:23.511454 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 428/859] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:23.514959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e307c8-4643-4269-9655-f85c566437ad None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:23.515480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588289b-2ad6-4d2f-ab0c-b6f54ec95618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:23.516089 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588289b-2ad6-4d2f-ab0c-b6f54ec95618 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:23.516369 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588289b-2ad6-4d2f-ab0c-b6f54ec95618 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:23.516643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588289b-2ad6-4d2f-ab0c-b6f54ec95618 None admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:23.517280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588289b-2ad6-4d2f-ab0c-b6f54ec95618 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:23.517603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588289b-2ad6-4d2f-ab0c-b6f54ec95618 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:23.518979 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588289b-2ad6-4d2f-ab0c-b6f54ec95618 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:23.524214 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 432/860] 10.222.0.33 () {56 vars in 1114 bytes} [Sat Aug 6 20:39:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:23.525389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45f6eb-897b-49b1-91e4-885745a74f67 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:23.525674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45f6eb-897b-49b1-91e4-885745a74f67 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:23.525947 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45f6eb-897b-49b1-91e4-885745a74f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:23.544590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-9c45f6eb-897b-49b1-91e4-885745a74f67 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:23.545796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9c45f6eb-897b-49b1-91e4-885745a74f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:23.555958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:23.620378 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 433/861] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:23 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:39:23.621411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45f6eb-897b-49b1-91e4-885745a74f67 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:23.636176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e307c8-4643-4269-9655-f85c566437ad None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:23.646076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:23.684704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b08b60-ff4a-4314-89ae-c00224d77560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:23.685333 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b08b60-ff4a-4314-89ae-c00224d77560 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:23.685609 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b08b60-ff4a-4314-89ae-c00224d77560 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:23.685877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b08b60-ff4a-4314-89ae-c00224d77560 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:23.697435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b08b60-ff4a-4314-89ae-c00224d77560 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:23.698952 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b08b60-ff4a-4314-89ae-c00224d77560 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:23.714828 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-b7b08b60-ff4a-4314-89ae-c00224d77560 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:23.714828 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:23.714828 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:23.714828 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:23.714828 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:23.714828 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:23.714828 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:23.714828 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:23.714828 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:23.714828 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:23.714828 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:23.714828 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:23.714828 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:39:23.714828 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:39:23.714828 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:39:23.714828 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:39:23.721060 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:23.721060 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:23.721060 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:23.721060 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:23.721060 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:23.721060 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:23.721060 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:23.721060 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:23.721060 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:23.721060 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:23.721060 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:23.721060 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:23.721060 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:23.721060 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:23.721060 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:23.721060 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:23.721060 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:39:23.722020 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:39:23.722020 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:23.722020 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:23.722020 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 429/862] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:23.722020 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b08b60-ff4a-4314-89ae-c00224d77560 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:23.744328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45f6eb-897b-49b1-91e4-885745a74f67 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:23.784862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741c144-d785-4b2d-a7cd-e7e9746aad0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:23.785403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741c144-d785-4b2d-a7cd-e7e9746aad0a None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:23.785681 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741c144-d785-4b2d-a7cd-e7e9746aad0a None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:23.785956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741c144-d785-4b2d-a7cd-e7e9746aad0a None admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:23.786723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741c144-d785-4b2d-a7cd-e7e9746aad0a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:23.787031 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741c144-d785-4b2d-a7cd-e7e9746aad0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:23.788648 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741c144-d785-4b2d-a7cd-e7e9746aad0a None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:23.802689 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 434/863] 10.222.0.33 () {56 vars in 1114 bytes} [Sat Aug 6 20:39:23 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:23.802689 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741c144-d785-4b2d-a7cd-e7e9746aad0a None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:23.825121 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:23.844540 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b08b60-ff4a-4314-89ae-c00224d77560 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:23.883805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a106aa4-f888-48fa-b2d2-db39026880e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:23.884464 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a106aa4-f888-48fa-b2d2-db39026880e8 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:23.884809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a106aa4-f888-48fa-b2d2-db39026880e8 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:23.885091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a106aa4-f888-48fa-b2d2-db39026880e8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:23.885747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a106aa4-f888-48fa-b2d2-db39026880e8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:23.887220 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a106aa4-f888-48fa-b2d2-db39026880e8 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:23.897401 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-1a106aa4-f888-48fa-b2d2-db39026880e8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 20:39:23.897401 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:23.897401 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:39:23.897401 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:39:23.897401 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:39:23.897401 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:39:23.897401 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:39:23.897401 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:23.897401 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 20:39:23.897401 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:23.897401 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:39:23.897401 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:23.897401 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:23.897401 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:23.897401 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:23.897401 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:23.898568 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:23.898568 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:23.898568 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:23.898568 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:23.898568 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:23.898568 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:23.898568 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:23.898568 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:39:23.898568 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:39:23.898568 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:39:23.898568 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:39:23.898568 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:23.898568 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:23.898568 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:23.898568 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:23.898568 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:23.898568 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:23.899461 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:23.899461 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:23.899461 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:23.899461 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:23.899461 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:23.899461 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:23.899461 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:23.899461 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:23.899461 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:23.899461 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:23.899461 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:39:23.899461 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:23.899461 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 20:39:23.899461 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:23.903740 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 430/864] 10.222.0.33 () {56 vars in 1132 bytes} [Sat Aug 6 20:39:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:23.904685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a106aa4-f888-48fa-b2d2-db39026880e8 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:23.910177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:23.944444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741c144-d785-4b2d-a7cd-e7e9746aad0a None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:24.048434 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c6e4c-8c0f-4918-bcb4-4a1639065f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:24.048983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c6e4c-8c0f-4918-bcb4-4a1639065f12 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:24.049263 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c6e4c-8c0f-4918-bcb4-4a1639065f12 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:24.049535 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c6e4c-8c0f-4918-bcb4-4a1639065f12 None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:24.050185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c6e4c-8c0f-4918-bcb4-4a1639065f12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:24.050488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c6e4c-8c0f-4918-bcb4-4a1639065f12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:24.051880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c6e4c-8c0f-4918-bcb4-4a1639065f12 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:24.074571 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 435/865] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:24.074571 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c6e4c-8c0f-4918-bcb4-4a1639065f12 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:24.103153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a106aa4-f888-48fa-b2d2-db39026880e8 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:24.139511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c25c39-421f-48b7-ad70-ca3368044e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:24.140283 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c25c39-421f-48b7-ad70-ca3368044e03 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:24.140656 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c25c39-421f-48b7-ad70-ca3368044e03 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:24.141026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c25c39-421f-48b7-ad70-ca3368044e03 None admin] PATH_INFO: `/v3/services` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:24.141757 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c25c39-421f-48b7-ad70-ca3368044e03 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:24.142163 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c25c39-421f-48b7-ad70-ca3368044e03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:24.143850 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c25c39-421f-48b7-ad70-ca3368044e03 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:24.154673 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 431/866] 10.222.0.33 () {56 vars in 1126 bytes} [Sat Aug 6 20:39:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:24.155673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c25c39-421f-48b7-ad70-ca3368044e03 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:24.172674 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:24.197250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c6e4c-8c0f-4918-bcb4-4a1639065f12 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:24.241801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a5d17-15b6-467e-9378-3b7b4146c0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:24.242409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a5d17-15b6-467e-9378-3b7b4146c0bd None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:24.242740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a5d17-15b6-467e-9378-3b7b4146c0bd None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:24.243015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a5d17-15b6-467e-9378-3b7b4146c0bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:24.252200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a5d17-15b6-467e-9378-3b7b4146c0bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:24.253628 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a5d17-15b6-467e-9378-3b7b4146c0bd None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:24.259287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:24.273795 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-1f1a5d17-15b6-467e-9378-3b7b4146c0bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:24.273795 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:24.273795 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:24.273795 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:24.273795 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:24.273795 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:24.273795 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:24.273795 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:24.273795 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:24.273795 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:24.273795 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:24.273795 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:24.273795 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:39:24.273795 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:39:24.273795 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:39:24.274784 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:39:24.274784 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:24.274784 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:24.274784 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:24.274784 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:24.274784 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:24.274784 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:24.274784 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:24.274784 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:24.274784 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:24.274784 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:24.274784 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:24.274784 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:24.274784 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:24.274784 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:24.274784 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:24.274784 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:24.275710 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:39:24.275710 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:39:24.275710 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:39:24.275710 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:39:24.275710 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:39:24.275710 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:39:24.275710 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:24.275710 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:24.278639 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 436/867] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:39:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:24.281746 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a5d17-15b6-467e-9378-3b7b4146c0bd None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:24.306330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c25c39-421f-48b7-ad70-ca3368044e03 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:24.346889 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c0a861-6927-4e09-bd22-b9950ca3e5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:24.347814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0a861-6927-4e09-bd22-b9950ca3e5ba None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:24.348373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0a861-6927-4e09-bd22-b9950ca3e5ba None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:24.348846 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0a861-6927-4e09-bd22-b9950ca3e5ba None admin] PATH_INFO: `/v3/services` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:24.350084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c0a861-6927-4e09-bd22-b9950ca3e5ba None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:24.351066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c0a861-6927-4e09-bd22-b9950ca3e5ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:24.352835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c0a861-6927-4e09-bd22-b9950ca3e5ba None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:24.365066 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 432/868] 10.222.0.33 () {56 vars in 1126 bytes} [Sat Aug 6 20:39:24 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:24.400984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a5d17-15b6-467e-9378-3b7b4146c0bd None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:24.440519 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f3768-ea0c-4720-9159-0c6cc0128e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:24.441144 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f3768-ea0c-4720-9159-0c6cc0128e1a None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:24.441427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f3768-ea0c-4720-9159-0c6cc0128e1a None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:24.441697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f3768-ea0c-4720-9159-0c6cc0128e1a None admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:24.442396 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f3768-ea0c-4720-9159-0c6cc0128e1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:24.444999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f3768-ea0c-4720-9159-0c6cc0128e1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:24.444999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f3768-ea0c-4720-9159-0c6cc0128e1a None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:24.459461 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 437/869] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Aug 6 20:39:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:24.465863 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c0a861-6927-4e09-bd22-b9950ca3e5ba None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:24.556856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:24.579165 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c0a861-6927-4e09-bd22-b9950ca3e5ba None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:24.614475 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9870e-727b-41d0-a7b8-ff8b1354a116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:24.615671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9870e-727b-41d0-a7b8-ff8b1354a116 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:24.616235 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9870e-727b-41d0-a7b8-ff8b1354a116 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:24.616235 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9870e-727b-41d0-a7b8-ff8b1354a116 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:24.616973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9870e-727b-41d0-a7b8-ff8b1354a116 None admin] RBAC: Adding query filter params (role.id=55fe0e239bac413b90c785211607e1a4, scope.project.id=6c4962342201407a89793c5c9a6a6f36, user.id=384893600b094d9982c2f98cdac52c77) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:24.617283 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9870e-727b-41d0-a7b8-ff8b1354a116 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:24.618738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9870e-727b-41d0-a7b8-ff8b1354a116 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:24.625041 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 433/870] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:39:24 2022] GET /identity/v3/role_assignments?user.id=384893600b094d9982c2f98cdac52c77&scope.project.id=6c4962342201407a89793c5c9a6a6f36&role.id=55fe0e239bac413b90c785211607e1a4 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:25.583591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffd21c-6183-4aa5-b99f-38e4723c435a None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:25.585388 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffd21c-6183-4aa5-b99f-38e4723c435a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:25.585388 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffd21c-6183-4aa5-b99f-38e4723c435a None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:25.586491 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 438/871] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:25.592955 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09253547-b30f-4bb9-bd78-dcfbc78378bf None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:25.593449 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09253547-b30f-4bb9-bd78-dcfbc78378bf None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:25.593525 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09253547-b30f-4bb9-bd78-dcfbc78378bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:25.613224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-09253547-b30f-4bb9-bd78-dcfbc78378bf None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:25.614413 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-09253547-b30f-4bb9-bd78-dcfbc78378bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:25.688194 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 434/872] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:25 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:39:25.711764 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dffd21c-6183-4aa5-b99f-38e4723c435a None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:25.778499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:25.823071 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dffd21c-6183-4aa5-b99f-38e4723c435a None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:25.860332 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8591dae-bf48-40e5-bd07-8a0b906850a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:25.860911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8591dae-bf48-40e5-bd07-8a0b906850a9 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:25.861184 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8591dae-bf48-40e5-bd07-8a0b906850a9 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:25.861460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8591dae-bf48-40e5-bd07-8a0b906850a9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:25.862036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8591dae-bf48-40e5-bd07-8a0b906850a9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:25.863427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8591dae-bf48-40e5-bd07-8a0b906850a9 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:25.873557 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-b8591dae-bf48-40e5-bd07-8a0b906850a9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 20:39:25.873557 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:25.873557 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:39:25.873557 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:39:25.873557 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:39:25.873557 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:39:25.873557 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:39:25.873557 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:25.873557 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 20:39:25.873557 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:25.873557 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:39:25.873557 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:25.873557 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:25.873557 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:25.873557 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:25.873557 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:25.873557 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:25.874709 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:25.874709 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:25.874709 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:25.874709 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:25.874709 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:25.874709 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:25.874709 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:39:25.874709 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:39:25.874709 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:39:25.874709 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:39:25.874709 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:25.874709 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:25.874709 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:25.874709 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:25.874709 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:25.874709 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:25.875577 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:25.875577 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:25.875577 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:25.875577 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:25.875577 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:25.875577 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:25.875577 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:25.875577 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:25.875577 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:25.875577 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:25.875577 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:39:25.875577 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:25.875577 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 20:39:25.875577 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:25.875577 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 439/873] 10.222.0.33 () {56 vars in 1126 bytes} [Sat Aug 6 20:39:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:25.880675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09253547-b30f-4bb9-bd78-dcfbc78378bf None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:25.955306 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:25.992334 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09253547-b30f-4bb9-bd78-dcfbc78378bf None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:26.027870 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1699ffb-0e6e-4e06-807e-4bce15decf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:26.028836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1699ffb-0e6e-4e06-807e-4bce15decf3e None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:26.029317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1699ffb-0e6e-4e06-807e-4bce15decf3e None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:26.029788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1699ffb-0e6e-4e06-807e-4bce15decf3e None admin] PATH_INFO: `/v3/services` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:26.030641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1699ffb-0e6e-4e06-807e-4bce15decf3e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:26.031177 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1699ffb-0e6e-4e06-807e-4bce15decf3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:26.032852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1699ffb-0e6e-4e06-807e-4bce15decf3e None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:26.038222 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 435/874] 10.222.0.33 () {56 vars in 1122 bytes} [Sat Aug 6 20:39:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:26.043740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8591dae-bf48-40e5-bd07-8a0b906850a9 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:26.155551 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8591dae-bf48-40e5-bd07-8a0b906850a9 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:26.186641 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:26.201520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c0982-6225-4f8a-b04a-85f924b7ebb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:26.202499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c0982-6225-4f8a-b04a-85f924b7ebb5 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:26.203017 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c0982-6225-4f8a-b04a-85f924b7ebb5 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:26.203507 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c0982-6225-4f8a-b04a-85f924b7ebb5 None admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:26.204358 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c0982-6225-4f8a-b04a-85f924b7ebb5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:26.204886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c0982-6225-4f8a-b04a-85f924b7ebb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:26.206462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c0982-6225-4f8a-b04a-85f924b7ebb5 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:26.211825 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 440/875] 10.222.0.33 () {56 vars in 1122 bytes} [Sat Aug 6 20:39:26 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:26.327293 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0a064-ad66-4037-9e11-96926b3ea8da None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:26.327959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0a064-ad66-4037-9e11-96926b3ea8da None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:26.328473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0a064-ad66-4037-9e11-96926b3ea8da None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:26.330377 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 436/876] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:26.336469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a66b3-f55a-47cc-97dd-7d574070ab77 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:26.336790 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a66b3-f55a-47cc-97dd-7d574070ab77 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:26.337029 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a66b3-f55a-47cc-97dd-7d574070ab77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:26.357682 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-4f8a66b3-f55a-47cc-97dd-7d574070ab77 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:26.358919 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4f8a66b3-f55a-47cc-97dd-7d574070ab77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:26.435780 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 441/877] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:39:26.461573 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0a064-ad66-4037-9e11-96926b3ea8da None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:26.569956 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0a064-ad66-4037-9e11-96926b3ea8da None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:26.605504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16885dd5-e5a6-4a7e-b0b8-787f515c0ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:26.606150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16885dd5-e5a6-4a7e-b0b8-787f515c0ae8 None admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:26.606398 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16885dd5-e5a6-4a7e-b0b8-787f515c0ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:26.606679 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16885dd5-e5a6-4a7e-b0b8-787f515c0ae8 None admin] PATH_INFO: `/v3/services` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:26.607324 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16885dd5-e5a6-4a7e-b0b8-787f515c0ae8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:26.608737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16885dd5-e5a6-4a7e-b0b8-787f515c0ae8 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:26.613185 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:26.626237 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 437/878] 10.222.0.33 () {60 vars in 1141 bytes} [Sat Aug 6 20:39:26 2022] POST /identity/v3/services => generated 251 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:39:26.810756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c09ab7-6bb5-4985-a824-a276e689632a None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:26.811813 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c09ab7-6bb5-4985-a824-a276e689632a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:26.812308 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c09ab7-6bb5-4985-a824-a276e689632a None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:26.814186 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 442/879] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:26.820044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e306f-9efd-409d-8262-d6597bb5a20b None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:26.820606 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e306f-9efd-409d-8262-d6597bb5a20b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:26.821090 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e306f-9efd-409d-8262-d6597bb5a20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:26.841121 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-5e3e306f-9efd-409d-8262-d6597bb5a20b None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:26.842640 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5e3e306f-9efd-409d-8262-d6597bb5a20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:26.920806 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 438/880] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:26 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:39:26.944839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c09ab7-6bb5-4985-a824-a276e689632a None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:27.054827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c09ab7-6bb5-4985-a824-a276e689632a None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:27.074933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:27.093659 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41fa53e-dda4-4d77-be23-d3da074851de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:27.094658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fa53e-dda4-4d77-be23-d3da074851de None admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:27.095153 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fa53e-dda4-4d77-be23-d3da074851de None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:27.095634 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fa53e-dda4-4d77-be23-d3da074851de None admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:27.096484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41fa53e-dda4-4d77-be23-d3da074851de None admin] RBAC: Authorizing `identity:create_service()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:27.098045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41fa53e-dda4-4d77-be23-d3da074851de None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:27.116335 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 443/881] 10.222.0.33 () {60 vars in 1141 bytes} [Sat Aug 6 20:39:26 2022] POST /identity/v3/services => generated 269 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:39:27.409348 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146f335-fecc-4460-8143-a690c31b60b7 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:27.410012 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146f335-fecc-4460-8143-a690c31b60b7 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:27.410510 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146f335-fecc-4460-8143-a690c31b60b7 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:27.412485 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 439/882] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:27.418178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9d3f2-5d4a-42ac-b792-f488dec6835a None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:27.418731 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9d3f2-5d4a-42ac-b792-f488dec6835a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:27.419209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9d3f2-5d4a-42ac-b792-f488dec6835a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:27.438828 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-5de9d3f2-5d4a-42ac-b792-f488dec6835a None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:27.440345 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5de9d3f2-5d4a-42ac-b792-f488dec6835a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:27.517023 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 444/883] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:27 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:39:27.541318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146f335-fecc-4460-8143-a690c31b60b7 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:27.650886 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146f335-fecc-4460-8143-a690c31b60b7 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:27.681084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:27.693328 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed8379-a7a3-4184-9a48-6c85203d7075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:27.694330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed8379-a7a3-4184-9a48-6c85203d7075 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:27.694642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed8379-a7a3-4184-9a48-6c85203d7075 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:27.694922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed8379-a7a3-4184-9a48-6c85203d7075 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:27.705243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed8379-a7a3-4184-9a48-6c85203d7075 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:39:27.710257 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-e8ed8379-a7a3-4184-9a48-6c85203d7075 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 20:39:27.710257 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:27.710257 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:27.710257 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:27.710257 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:27.710257 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:27.710257 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:27.710257 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:27.710257 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:27.710257 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:27.710257 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:27.710257 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:27.710257 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:39:27.710257 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:39:27.710257 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:39:27.710257 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:39:27.711269 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:39:27.711269 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:39:27.711269 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:39:27.711269 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:39:27.711269 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:27.711269 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:27.711269 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:27.711269 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:27.711269 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:27.711269 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:27.711269 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:27.711269 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:27.711269 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:27.711269 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:27.711269 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:27.711269 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:27.712184 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:27.712184 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:27.712184 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:27.712184 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:27.712184 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:39:27.712184 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:39:27.712184 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:39:27.712184 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:39:27.712184 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:39:27.712184 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:39:27.712184 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 20:39:27.712184 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:27.712184 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 440/884] 10.222.0.33 () {56 vars in 1120 bytes} [Sat Aug 6 20:39:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:27.719040 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9d3f2-5d4a-42ac-b792-f488dec6835a None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:27.820685 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9d3f2-5d4a-42ac-b792-f488dec6835a None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:27.823837 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:27.857835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1c162-08ea-41f8-9118-d2c67b82d22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:27.858448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1c162-08ea-41f8-9118-d2c67b82d22d None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:27.858757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1c162-08ea-41f8-9118-d2c67b82d22d None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:27.859029 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1c162-08ea-41f8-9118-d2c67b82d22d None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:27.859692 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1c162-08ea-41f8-9118-d2c67b82d22d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:27.859995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1c162-08ea-41f8-9118-d2c67b82d22d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:27.861344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1c162-08ea-41f8-9118-d2c67b82d22d None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:27.870763 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 445/885] 10.222.0.33 () {56 vars in 1115 bytes} [Sat Aug 6 20:39:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:27.879303 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed8379-a7a3-4184-9a48-6c85203d7075 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:27.998577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed8379-a7a3-4184-9a48-6c85203d7075 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:28.035737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220ebd3-76a7-4e6d-9a8c-8dfb6a100808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:28.036376 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220ebd3-76a7-4e6d-9a8c-8dfb6a100808 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:28.036741 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220ebd3-76a7-4e6d-9a8c-8dfb6a100808 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:28.037089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220ebd3-76a7-4e6d-9a8c-8dfb6a100808 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:28.047767 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2220ebd3-76a7-4e6d-9a8c-8dfb6a100808 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:28.049212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2220ebd3-76a7-4e6d-9a8c-8dfb6a100808 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:28.064399 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-2220ebd3-76a7-4e6d-9a8c-8dfb6a100808 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:28.064399 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:28.064399 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:28.064399 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:28.064399 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:28.064399 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:28.064399 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:28.064399 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:28.064399 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:28.064399 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:28.064399 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:28.064399 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:28.064399 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:39:28.064399 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:39:28.064399 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:39:28.064399 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:39:28.065374 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:28.065374 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:28.065374 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:28.065374 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:28.065374 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:28.065374 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:28.065374 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:28.065374 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:28.065374 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:28.065374 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:28.065374 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:28.065374 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:28.065374 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:28.065374 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:28.065374 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:28.065374 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:28.065374 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:39:28.066344 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:39:28.066344 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:28.066344 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:28.066344 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 441/886] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:28.071680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1c162-08ea-41f8-9118-d2c67b82d22d None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:28.180184 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1c162-08ea-41f8-9118-d2c67b82d22d None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:28.215239 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662c2a2-592b-425c-911e-df3366228b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:28.215849 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662c2a2-592b-425c-911e-df3366228b69 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:28.216124 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662c2a2-592b-425c-911e-df3366228b69 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:28.216397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662c2a2-592b-425c-911e-df3366228b69 None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:28.217044 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662c2a2-592b-425c-911e-df3366228b69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:28.217346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662c2a2-592b-425c-911e-df3366228b69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:28.219017 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662c2a2-592b-425c-911e-df3366228b69 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:28.232859 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 446/887] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:28.239630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220ebd3-76a7-4e6d-9a8c-8dfb6a100808 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:28.275755 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:28.350972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220ebd3-76a7-4e6d-9a8c-8dfb6a100808 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:28.386857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc08fc3-318f-4487-91e8-83740d8fe394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:28.387552 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc08fc3-318f-4487-91e8-83740d8fe394 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:28.387833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc08fc3-318f-4487-91e8-83740d8fe394 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:28.388159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc08fc3-318f-4487-91e8-83740d8fe394 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:28.395880 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc08fc3-318f-4487-91e8-83740d8fe394 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:28.397930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc08fc3-318f-4487-91e8-83740d8fe394 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:28.411026 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-adc08fc3-318f-4487-91e8-83740d8fe394 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 20:39:28.411026 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:28.411026 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:28.411026 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:28.411026 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:28.411026 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:28.411026 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:28.411026 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:28.411026 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:28.411026 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:28.411026 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:28.411026 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:28.411026 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:39:28.411026 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:39:28.411026 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:39:28.411026 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:39:28.412708 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:28.412708 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:28.412708 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:39:28.412708 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:28.412708 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:39:28.412708 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:28.412708 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:28.412708 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:28.412708 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:28.412708 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:28.412708 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:28.412708 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:28.412708 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:28.412708 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:28.412708 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:28.412708 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:28.412708 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:28.412708 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:28.413686 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:28.413686 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:28.413686 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:39:28.413686 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:39:28.413686 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:39:28.413686 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:39:28.413686 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:39:28.413686 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:39:28.413686 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 20:39:28.413686 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:28.413686 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 442/888] 10.222.0.33 () {56 vars in 1117 bytes} [Sat Aug 6 20:39:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:28.418761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662c2a2-592b-425c-911e-df3366228b69 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:28.450776 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:28.527154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662c2a2-592b-425c-911e-df3366228b69 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:28.563580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7a6fb-934d-4aa8-b7f3-79673be0adf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:28.564462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7a6fb-934d-4aa8-b7f3-79673be0adf2 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:28.564900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7a6fb-934d-4aa8-b7f3-79673be0adf2 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:28.565326 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7a6fb-934d-4aa8-b7f3-79673be0adf2 None admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:28.566211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7a6fb-934d-4aa8-b7f3-79673be0adf2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:28.566704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7a6fb-934d-4aa8-b7f3-79673be0adf2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:28.568300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7a6fb-934d-4aa8-b7f3-79673be0adf2 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:28.579345 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2b3eb-b218-449e-985f-93f4cf2e49c4 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:28.579767 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2b3eb-b218-449e-985f-93f4cf2e49c4 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:28.580150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2b3eb-b218-449e-985f-93f4cf2e49c4 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:28.581840 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 443/889] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:39:28.587363 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d1135-3426-48c5-ad37-c719537be566 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:28.587552 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 447/890] 10.222.0.33 () {56 vars in 1149 bytes} [Sat Aug 6 20:39:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:28.591129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d1135-3426-48c5-ad37-c719537be566 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:28.591129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d1135-3426-48c5-ad37-c719537be566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:28.593089 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7a6fb-934d-4aa8-b7f3-79673be0adf2 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:28.608230 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-236d1135-3426-48c5-ad37-c719537be566 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:28.609536 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-236d1135-3426-48c5-ad37-c719537be566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:28.680542 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:28.691933 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 444/891] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:28 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 20:39:28.701411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7a6fb-934d-4aa8-b7f3-79673be0adf2 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:28.715980 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d1135-3426-48c5-ad37-c719537be566 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:28.741474 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b73ded-abd3-43a4-8212-6fd1cc77feef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:28.742460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b73ded-abd3-43a4-8212-6fd1cc77feef None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:28.743053 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b73ded-abd3-43a4-8212-6fd1cc77feef None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:28.743528 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b73ded-abd3-43a4-8212-6fd1cc77feef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:28.779035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:28.822871 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b73ded-abd3-43a4-8212-6fd1cc77feef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:28.825047 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b73ded-abd3-43a4-8212-6fd1cc77feef None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:28.847035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d1135-3426-48c5-ad37-c719537be566 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:28.899453 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ffc16a-4be8-4825-989c-36aa6f97e048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:28.900097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffc16a-4be8-4825-989c-36aa6f97e048 None admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:28.900989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffc16a-4be8-4825-989c-36aa6f97e048 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:28.901389 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffc16a-4be8-4825-989c-36aa6f97e048 None admin] PATH_INFO: `/v3/services` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:28.903091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ffc16a-4be8-4825-989c-36aa6f97e048 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:28.904527 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ffc16a-4be8-4825-989c-36aa6f97e048 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:28.925290 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:28.928340 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 445/892] 10.222.0.33 () {60 vars in 1141 bytes} [Sat Aug 6 20:39:28 2022] POST /identity/v3/services => generated 241 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:39:28.948736 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 448/893] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:39:28 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 06 20:39:28.958658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ffc16a-4be8-4825-989c-36aa6f97e048 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:29.047283 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:29.075432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c46ae-424c-45a3-8a01-8c8dfa0640c3 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:29.075432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c46ae-424c-45a3-8a01-8c8dfa0640c3 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:29.078273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c46ae-424c-45a3-8a01-8c8dfa0640c3 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:29.078417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ffc16a-4be8-4825-989c-36aa6f97e048 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:29.078520 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 449/894] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:29.083221 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a55ee6-aa7f-4b4a-87d3-24e09e692290 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:29.083877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a55ee6-aa7f-4b4a-87d3-24e09e692290 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:29.084646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a55ee6-aa7f-4b4a-87d3-24e09e692290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:29.104244 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-14a55ee6-aa7f-4b4a-87d3-24e09e692290 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:29.105848 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-14a55ee6-aa7f-4b4a-87d3-24e09e692290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:29.120746 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d785f41-fc95-4e26-89b8-57ec1d60b680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:29.121421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d785f41-fc95-4e26-89b8-57ec1d60b680 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:29.121716 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d785f41-fc95-4e26-89b8-57ec1d60b680 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:29.121993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d785f41-fc95-4e26-89b8-57ec1d60b680 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:29.134602 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d785f41-fc95-4e26-89b8-57ec1d60b680 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:29.136055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d785f41-fc95-4e26-89b8-57ec1d60b680 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:29.152945 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-2d785f41-fc95-4e26-89b8-57ec1d60b680 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:29.152945 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:29.152945 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:29.152945 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:29.152945 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:29.152945 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:29.152945 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:29.152945 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:29.152945 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:29.152945 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:29.152945 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:29.152945 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:29.152945 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:39:29.152945 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:39:29.152945 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:39:29.152945 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:39:29.153960 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:29.153960 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:29.153960 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:29.153960 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:29.153960 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:29.153960 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:29.153960 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:29.153960 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:29.153960 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:29.153960 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:29.153960 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:29.153960 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:29.153960 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:29.153960 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:29.153960 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:29.153960 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:29.153960 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:39:29.154904 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:39:29.154904 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:29.154904 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:29.154904 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 446/895] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:39:29.159749 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d785f41-fc95-4e26-89b8-57ec1d60b680 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:29.199861 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 450/896] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:39:29.223677 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a55ee6-aa7f-4b4a-87d3-24e09e692290 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:29.284501 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d785f41-fc95-4e26-89b8-57ec1d60b680 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:29.327291 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:29.335432 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a21a2-8067-4288-b106-42a6b9c47cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:29.336615 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a21a2-8067-4288-b106-42a6b9c47cab None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:29.336899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a21a2-8067-4288-b106-42a6b9c47cab None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:29.337178 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a21a2-8067-4288-b106-42a6b9c47cab None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:29.338394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600a21a2-8067-4288-b106-42a6b9c47cab None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:29.339257 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600a21a2-8067-4288-b106-42a6b9c47cab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:29.341818 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600a21a2-8067-4288-b106-42a6b9c47cab None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:29.344229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a55ee6-aa7f-4b4a-87d3-24e09e692290 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:29.359231 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 447/897] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:29.365988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a21a2-8067-4288-b106-42a6b9c47cab None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:29.367910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:29.391425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789561a-46a5-4940-b26b-093fa2f76b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:29.392116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789561a-46a5-4940-b26b-093fa2f76b44 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:29.392418 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789561a-46a5-4940-b26b-093fa2f76b44 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:29.392721 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789561a-46a5-4940-b26b-093fa2f76b44 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:29.393316 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a789561a-46a5-4940-b26b-093fa2f76b44 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:29.394734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a789561a-46a5-4940-b26b-093fa2f76b44 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:29.405213 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-a789561a-46a5-4940-b26b-093fa2f76b44 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 20:39:29.405213 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:29.405213 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:39:29.405213 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:39:29.405213 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:39:29.405213 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:39:29.405213 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:39:29.405213 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:29.405213 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 20:39:29.405213 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:29.405213 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:39:29.405213 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:29.405213 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:29.405213 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:29.405213 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:29.405213 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:29.405213 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:29.406315 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:29.406315 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:29.406315 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:29.406315 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:29.406315 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:29.406315 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:29.406315 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:39:29.406315 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:39:29.406315 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:39:29.406315 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:39:29.406315 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:29.406315 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:29.406315 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:29.406315 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:29.406315 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:29.406315 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:29.407229 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:29.407229 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:29.407229 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:29.407229 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:29.407229 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:29.407229 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:29.407229 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:29.407229 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:29.407229 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:29.407229 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:29.407229 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:39:29.407229 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:29.407229 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 20:39:29.407229 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:29.411460 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 451/898] 10.222.0.33 () {56 vars in 1114 bytes} [Sat Aug 6 20:39:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:29.413155 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789561a-46a5-4940-b26b-093fa2f76b44 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:29.508051 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a21a2-8067-4288-b106-42a6b9c47cab None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:29.528447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789561a-46a5-4940-b26b-093fa2f76b44 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:29.545701 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd96d7-8ef4-419c-96f1-bd1a8bc7029b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:29.546341 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd96d7-8ef4-419c-96f1-bd1a8bc7029b None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:29.546649 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd96d7-8ef4-419c-96f1-bd1a8bc7029b None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:29.546921 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd96d7-8ef4-419c-96f1-bd1a8bc7029b None admin] PATH_INFO: `/v3/projects/service` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:29.555874 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd96d7-8ef4-419c-96f1-bd1a8bc7029b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:29.557715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd96d7-8ef4-419c-96f1-bd1a8bc7029b None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:29.568756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab826b-1e03-43f4-84c3-708269f0ba0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:29.569359 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab826b-1e03-43f4-84c3-708269f0ba0a None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:29.569635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab826b-1e03-43f4-84c3-708269f0ba0a None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:29.569906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab826b-1e03-43f4-84c3-708269f0ba0a None admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:29.570401 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-afdd96d7-8ef4-419c-96f1-bd1a8bc7029b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:29.570401 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:29.570401 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:29.570401 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:29.570401 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:29.570401 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:29.570401 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:29.570401 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:29.570401 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:29.570401 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:29.570401 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:29.570401 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:29.570401 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:39:29.570401 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:39:29.570401 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:39:29.571461 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:39:29.571461 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:29.571461 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:29.571461 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:29.571461 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:29.571461 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:29.571461 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:29.571461 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:29.571461 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:29.571461 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:29.571461 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:29.571461 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:29.571461 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:29.571461 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:29.571461 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:29.571461 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:29.571461 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:29.572564 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:39:29.572564 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:39:29.572564 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:39:29.572564 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:39:29.572564 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:39:29.572564 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:39:29.572564 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:29.572564 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:29.573093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ab826b-1e03-43f4-84c3-708269f0ba0a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:29.573093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ab826b-1e03-43f4-84c3-708269f0ba0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:29.573093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ab826b-1e03-43f4-84c3-708269f0ba0a None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:29.579617 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 448/899] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:39:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:29.579617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443785c-00c5-48de-95b9-c8ca9269caa0 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:29.579617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443785c-00c5-48de-95b9-c8ca9269caa0 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:29.579617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443785c-00c5-48de-95b9-c8ca9269caa0 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:29.579617 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 449/900] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:29.581928 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443785c-00c5-48de-95b9-c8ca9269caa0 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:29.584779 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 452/901] 10.222.0.33 () {56 vars in 1114 bytes} [Sat Aug 6 20:39:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:29.584956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f489c-eb35-4a8d-849a-ad8d0ed7aa33 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:29.585112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f489c-eb35-4a8d-849a-ad8d0ed7aa33 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:29.588511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f489c-eb35-4a8d-849a-ad8d0ed7aa33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:29.603525 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-ce1f489c-eb35-4a8d-849a-ad8d0ed7aa33 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:29.604890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ce1f489c-eb35-4a8d-849a-ad8d0ed7aa33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:29.649352 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:29.653717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:29.691246 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 453/902] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:39:29.692403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f489c-eb35-4a8d-849a-ad8d0ed7aa33 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:29.727531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443785c-00c5-48de-95b9-c8ca9269caa0 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:29.771823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722212fe-3d2a-4b4c-9e9c-1676e0448fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:29.772435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722212fe-3d2a-4b4c-9e9c-1676e0448fd2 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:29.772715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722212fe-3d2a-4b4c-9e9c-1676e0448fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:29.773043 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722212fe-3d2a-4b4c-9e9c-1676e0448fd2 None admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:29.774954 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722212fe-3d2a-4b4c-9e9c-1676e0448fd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:29.779016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722212fe-3d2a-4b4c-9e9c-1676e0448fd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:29.780490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722212fe-3d2a-4b4c-9e9c-1676e0448fd2 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:29.794954 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 450/903] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Aug 6 20:39:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:29.795164 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722212fe-3d2a-4b4c-9e9c-1676e0448fd2 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:29.846195 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f489c-eb35-4a8d-849a-ad8d0ed7aa33 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:29.901733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f362318-3f90-4660-9ede-fc0c5ca25b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:29.902347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f362318-3f90-4660-9ede-fc0c5ca25b06 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:29.902665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f362318-3f90-4660-9ede-fc0c5ca25b06 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:29.903028 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f362318-3f90-4660-9ede-fc0c5ca25b06 None admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:29.903678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f362318-3f90-4660-9ede-fc0c5ca25b06 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:29.903983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f362318-3f90-4660-9ede-fc0c5ca25b06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:29.905347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f362318-3f90-4660-9ede-fc0c5ca25b06 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:29.916506 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 454/904] 10.222.0.33 () {56 vars in 1114 bytes} [Sat Aug 6 20:39:29 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:29.917034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f362318-3f90-4660-9ede-fc0c5ca25b06 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:29.940170 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722212fe-3d2a-4b4c-9e9c-1676e0448fd2 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:29.956754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:29.972601 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:29.987794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf658e-fff6-4b73-8cb6-6f0decb3a3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:29.988469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf658e-fff6-4b73-8cb6-6f0decb3a3c4 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:29.988858 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf658e-fff6-4b73-8cb6-6f0decb3a3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:29.989422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf658e-fff6-4b73-8cb6-6f0decb3a3c4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:29.990280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf658e-fff6-4b73-8cb6-6f0decb3a3c4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:29.991832 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf658e-fff6-4b73-8cb6-6f0decb3a3c4 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:30.002414 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-01bf658e-fff6-4b73-8cb6-6f0decb3a3c4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 20:39:30.002414 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:30.002414 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:39:30.002414 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:39:30.002414 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:39:30.002414 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:39:30.002414 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:39:30.002414 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:30.002414 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 20:39:30.002414 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:30.002414 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:39:30.002414 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:30.002414 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:30.002414 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:30.002414 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:30.002414 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:30.003940 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:30.003940 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:30.003940 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:30.003940 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:30.003940 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:30.003940 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:30.003940 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:30.003940 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:39:30.003940 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:39:30.003940 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:39:30.003940 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:39:30.003940 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:30.003940 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:30.003940 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:30.003940 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:30.003940 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:30.003940 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:30.004858 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:30.004858 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:30.004858 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:30.004858 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:30.004858 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:30.004858 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:30.004858 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:30.004858 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:30.004858 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:30.004858 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:30.004858 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:39:30.004858 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:30.004858 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 20:39:30.004858 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:30.004858 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 451/905] 10.222.0.33 () {56 vars in 1132 bytes} [Sat Aug 6 20:39:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:30.006248 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf658e-fff6-4b73-8cb6-6f0decb3a3c4 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:30.074091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f362318-3f90-4660-9ede-fc0c5ca25b06 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:30.125395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5a7ca-b19c-4b23-bf04-71137d1b2a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:30.125924 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5a7ca-b19c-4b23-bf04-71137d1b2a5c None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:30.126353 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5a7ca-b19c-4b23-bf04-71137d1b2a5c None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:30.126536 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5a7ca-b19c-4b23-bf04-71137d1b2a5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:30.127283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5a7ca-b19c-4b23-bf04-71137d1b2a5c None admin] RBAC: Adding query filter params (role.id=df403794156d44e7bf81058ba5d5f806, scope.project.id=6c4962342201407a89793c5c9a6a6f36, user.id=384893600b094d9982c2f98cdac52c77) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:30.127598 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5a7ca-b19c-4b23-bf04-71137d1b2a5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:30.129074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5a7ca-b19c-4b23-bf04-71137d1b2a5c None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:30.139690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf658e-fff6-4b73-8cb6-6f0decb3a3c4 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:30.150845 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 455/906] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:39:29 2022] GET /identity/v3/role_assignments?user.id=384893600b094d9982c2f98cdac52c77&scope.project.id=6c4962342201407a89793c5c9a6a6f36&role.id=df403794156d44e7bf81058ba5d5f806 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:30.150845 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5a7ca-b19c-4b23-bf04-71137d1b2a5c None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:30.214657 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d566e-91b7-4366-b63a-bd549dbc2367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:30.215395 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d566e-91b7-4366-b63a-bd549dbc2367 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:30.215742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d566e-91b7-4366-b63a-bd549dbc2367 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:30.216080 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d566e-91b7-4366-b63a-bd549dbc2367 None admin] PATH_INFO: `/v3/endpoints` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:30.218683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d566e-91b7-4366-b63a-bd549dbc2367 None admin] RBAC: Adding query filter params (interface=public, service_id=792b20b8ac5c4b248e57ad92e9a0b822, region_id=RegionOne) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:30.219071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d566e-91b7-4366-b63a-bd549dbc2367 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:30.220573 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d566e-91b7-4366-b63a-bd549dbc2367 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:30.228060 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 452/907] 10.222.0.33 () {56 vars in 1251 bytes} [Sat Aug 6 20:39:30 2022] GET /identity/v3/endpoints?service_id=792b20b8ac5c4b248e57ad92e9a0b822&interface=public®ion_id=RegionOne => generated 194 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:30.241983 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d566e-91b7-4366-b63a-bd549dbc2367 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:30.300936 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:30.303179 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:30.308986 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5a7ca-b19c-4b23-bf04-71137d1b2a5c None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:30.352067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c085c24-2450-4188-a0da-f30ec884fdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:30.352869 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c085c24-2450-4188-a0da-f30ec884fdaa None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:30.353246 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c085c24-2450-4188-a0da-f30ec884fdaa None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:30.354223 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c085c24-2450-4188-a0da-f30ec884fdaa None admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:30.354607 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c085c24-2450-4188-a0da-f30ec884fdaa None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:30.355041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c085c24-2450-4188-a0da-f30ec884fdaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:30.358108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c085c24-2450-4188-a0da-f30ec884fdaa None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:30.369620 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 456/908] 10.222.0.33 () {56 vars in 1126 bytes} [Sat Aug 6 20:39:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:30.371271 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c085c24-2450-4188-a0da-f30ec884fdaa None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:30.384519 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d566e-91b7-4366-b63a-bd549dbc2367 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:30.425831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc5bc8-e16a-450b-b023-27178021f674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:30.427001 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc5bc8-e16a-450b-b023-27178021f674 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:30.428280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc5bc8-e16a-450b-b023-27178021f674 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:30.428733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc5bc8-e16a-450b-b023-27178021f674 None admin] PATH_INFO: `/v3/services` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:30.429531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc5bc8-e16a-450b-b023-27178021f674 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:30.431476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc5bc8-e16a-450b-b023-27178021f674 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:30.439503 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 453/909] 10.222.0.33 () {56 vars in 1087 bytes} [Sat Aug 6 20:39:30 2022] GET /identity/v3/services => generated 1497 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:39:30.494680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c085c24-2450-4188-a0da-f30ec884fdaa None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:30.535278 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85f6e5-0dc2-4118-accc-a75109d983a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:30.535906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85f6e5-0dc2-4118-accc-a75109d983a7 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:30.536185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85f6e5-0dc2-4118-accc-a75109d983a7 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:30.536782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85f6e5-0dc2-4118-accc-a75109d983a7 None admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:30.537478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd85f6e5-0dc2-4118-accc-a75109d983a7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:30.537787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd85f6e5-0dc2-4118-accc-a75109d983a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:30.539221 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd85f6e5-0dc2-4118-accc-a75109d983a7 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:30.550009 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 457/910] 10.222.0.33 () {56 vars in 1126 bytes} [Sat Aug 6 20:39:30 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:30.551552 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc5bc8-e16a-450b-b023-27178021f674 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:30.665950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc5bc8-e16a-450b-b023-27178021f674 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:30.670012 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:30.707401 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3259d8-1513-44ca-b770-a4d866d6b2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:30.708009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3259d8-1513-44ca-b770-a4d866d6b2c5 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:30.708288 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3259d8-1513-44ca-b770-a4d866d6b2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:30.708626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3259d8-1513-44ca-b770-a4d866d6b2c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:30.709342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3259d8-1513-44ca-b770-a4d866d6b2c5 None admin] RBAC: Adding query filter params (interface=public, service_id=0bac3cf5afcb45398502f67400f4ac00, region_id=RegionOne) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:30.709653 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3259d8-1513-44ca-b770-a4d866d6b2c5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:30.711080 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3259d8-1513-44ca-b770-a4d866d6b2c5 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:30.718425 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 454/911] 10.222.0.33 () {56 vars in 1251 bytes} [Sat Aug 6 20:39:30 2022] GET /identity/v3/endpoints?service_id=0bac3cf5afcb45398502f67400f4ac00&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:30.723858 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85f6e5-0dc2-4118-accc-a75109d983a7 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:30.758784 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:30.837144 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85f6e5-0dc2-4118-accc-a75109d983a7 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:30.877032 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e6b6b-9538-41cf-bacf-05b7176a8d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:30.877705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e6b6b-9538-41cf-bacf-05b7176a8d21 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:30.877924 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e6b6b-9538-41cf-bacf-05b7176a8d21 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:30.878185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e6b6b-9538-41cf-bacf-05b7176a8d21 None admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:30.878820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e6b6b-9538-41cf-bacf-05b7176a8d21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:30.880809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e6b6b-9538-41cf-bacf-05b7176a8d21 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:30.887227 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 458/912] 10.222.0.33 () {56 vars in 1087 bytes} [Sat Aug 6 20:39:30 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:39:31.425388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b8e3f-0567-4001-9cb5-bf373d8fa718 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:31.425905 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b8e3f-0567-4001-9cb5-bf373d8fa718 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:31.425905 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b8e3f-0567-4001-9cb5-bf373d8fa718 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:31.427968 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 455/913] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:31.433327 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb102c-75d2-44a5-9355-8c3dc5b1dd73 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:31.433618 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb102c-75d2-44a5-9355-8c3dc5b1dd73 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:31.433956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb102c-75d2-44a5-9355-8c3dc5b1dd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:31.452811 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a2bb102c-75d2-44a5-9355-8c3dc5b1dd73 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:31.454043 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a2bb102c-75d2-44a5-9355-8c3dc5b1dd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:31.522095 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 459/914] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:39:31.549088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b8e3f-0567-4001-9cb5-bf373d8fa718 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:31.658938 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b8e3f-0567-4001-9cb5-bf373d8fa718 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:31.700967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62242f7-989a-4c30-9d2a-10cd9f1f0af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:31.700967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62242f7-989a-4c30-9d2a-10cd9f1f0af1 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:31.700967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62242f7-989a-4c30-9d2a-10cd9f1f0af1 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:31.700967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62242f7-989a-4c30-9d2a-10cd9f1f0af1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:31.701369 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62242f7-989a-4c30-9d2a-10cd9f1f0af1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:31.701369 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62242f7-989a-4c30-9d2a-10cd9f1f0af1 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:31.708469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-e62242f7-989a-4c30-9d2a-10cd9f1f0af1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 20:39:31.708469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:31.708469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:39:31.708469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:39:31.708469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:39:31.708469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:39:31.708469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:39:31.708469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:31.708469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 20:39:31.708469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:31.708469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:39:31.708469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:31.708469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:31.708469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:31.708469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:31.708469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:31.708469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:31.709615 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:31.709615 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:31.709615 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:31.709615 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:31.709615 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:31.709615 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:31.709615 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:39:31.709615 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:39:31.709615 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:39:31.709615 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:39:31.709615 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:31.709615 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:31.709615 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:31.709615 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:31.709615 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:31.709615 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:31.710462 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:31.710462 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:31.710462 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:31.710462 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:31.710462 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:31.710462 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:31.710462 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:31.710462 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:31.710462 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:31.710462 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:31.710462 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:39:31.710462 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:31.710462 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 20:39:31.710462 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:31.710462 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 456/915] 10.222.0.33 () {56 vars in 1126 bytes} [Sat Aug 6 20:39:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:31.715550 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb102c-75d2-44a5-9355-8c3dc5b1dd73 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:31.741228 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:31.820872 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb102c-75d2-44a5-9355-8c3dc5b1dd73 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:31.856430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5eeae5-e54b-4b66-9fb0-48aed113268d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:31.857098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5eeae5-e54b-4b66-9fb0-48aed113268d None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:31.857385 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5eeae5-e54b-4b66-9fb0-48aed113268d None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:31.857657 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5eeae5-e54b-4b66-9fb0-48aed113268d None admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:31.858283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5eeae5-e54b-4b66-9fb0-48aed113268d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:31.858669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5eeae5-e54b-4b66-9fb0-48aed113268d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:31.860036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5eeae5-e54b-4b66-9fb0-48aed113268d None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:31.866373 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 460/916] 10.222.0.33 () {56 vars in 1122 bytes} [Sat Aug 6 20:39:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:31.871669 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62242f7-989a-4c30-9d2a-10cd9f1f0af1 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:31.905762 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:31.985240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62242f7-989a-4c30-9d2a-10cd9f1f0af1 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:32.021477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d276af-a194-4da4-85d8-df33af788b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:32.022100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d276af-a194-4da4-85d8-df33af788b85 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:32.022427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d276af-a194-4da4-85d8-df33af788b85 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:32.022723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d276af-a194-4da4-85d8-df33af788b85 None admin] PATH_INFO: `/v3/services` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:32.023352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d276af-a194-4da4-85d8-df33af788b85 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:32.023653 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d276af-a194-4da4-85d8-df33af788b85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:32.025035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d276af-a194-4da4-85d8-df33af788b85 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:32.030386 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 457/917] 10.222.0.33 () {56 vars in 1122 bytes} [Sat Aug 6 20:39:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:32.035824 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5eeae5-e54b-4b66-9fb0-48aed113268d None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:32.131388 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:32.147877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5eeae5-e54b-4b66-9fb0-48aed113268d None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:32.187432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d65f79-43b4-4492-9bec-0afa5d1c672f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:32.188040 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d65f79-43b4-4492-9bec-0afa5d1c672f None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:32.188327 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d65f79-43b4-4492-9bec-0afa5d1c672f None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:32.188598 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d65f79-43b4-4492-9bec-0afa5d1c672f None admin] PATH_INFO: `/v3/endpoints` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:32.189307 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d65f79-43b4-4492-9bec-0afa5d1c672f None admin] RBAC: Adding query filter params (interface=public, service_id=2344dc2b00c14947aedfefc335c47d6e, region_id=RegionOne) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:32.189618 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d65f79-43b4-4492-9bec-0afa5d1c672f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:32.191016 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d65f79-43b4-4492-9bec-0afa5d1c672f None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:32.199427 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 461/918] 10.222.0.33 () {56 vars in 1251 bytes} [Sat Aug 6 20:39:32 2022] GET /identity/v3/endpoints?service_id=2344dc2b00c14947aedfefc335c47d6e&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:32.204862 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d276af-a194-4da4-85d8-df33af788b85 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:32.311591 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:32.318402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d276af-a194-4da4-85d8-df33af788b85 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:32.354606 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed7af7-fa44-4e9d-ad63-4d2e830d7f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:32.355603 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed7af7-fa44-4e9d-ad63-4d2e830d7f94 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:32.356129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed7af7-fa44-4e9d-ad63-4d2e830d7f94 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:32.356661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed7af7-fa44-4e9d-ad63-4d2e830d7f94 None admin] PATH_INFO: `/v3/services` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:32.357591 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed7af7-fa44-4e9d-ad63-4d2e830d7f94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:32.359198 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed7af7-fa44-4e9d-ad63-4d2e830d7f94 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:32.366514 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 458/919] 10.222.0.33 () {56 vars in 1087 bytes} [Sat Aug 6 20:39:32 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:39:32.559191 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843678af-978c-4d9b-a0f2-a06ca0e0dd1f None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:32.559534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843678af-978c-4d9b-a0f2-a06ca0e0dd1f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:32.559757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843678af-978c-4d9b-a0f2-a06ca0e0dd1f None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:32.561224 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 462/920] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:32.566326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3afff-17b1-47a7-8d6f-1ec56fdd0a9b None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:32.566880 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3afff-17b1-47a7-8d6f-1ec56fdd0a9b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:32.566880 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3afff-17b1-47a7-8d6f-1ec56fdd0a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:32.587460 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-3ee3afff-17b1-47a7-8d6f-1ec56fdd0a9b None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:32.589041 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3ee3afff-17b1-47a7-8d6f-1ec56fdd0a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:32.665963 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 459/921] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:39:32.690351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843678af-978c-4d9b-a0f2-a06ca0e0dd1f None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:32.799001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843678af-978c-4d9b-a0f2-a06ca0e0dd1f None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:32.842359 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9c57d-3ac1-4f75-8107-5617f8da7f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:32.842937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9c57d-3ac1-4f75-8107-5617f8da7f79 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:32.843219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9c57d-3ac1-4f75-8107-5617f8da7f79 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:32.843496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9c57d-3ac1-4f75-8107-5617f8da7f79 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:32.854943 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d9c57d-3ac1-4f75-8107-5617f8da7f79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:39:32.859815 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-59d9c57d-3ac1-4f75-8107-5617f8da7f79 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 20:39:32.859815 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:32.859815 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:32.859815 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:32.859815 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:32.859815 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:32.859815 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:32.859815 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:32.859815 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:32.859815 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:32.859815 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:32.859815 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:32.859815 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:39:32.859815 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:39:32.859815 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:39:32.859815 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:39:32.860754 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:39:32.860754 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:39:32.860754 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:39:32.860754 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:39:32.860754 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:32.860754 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:32.860754 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:32.860754 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:32.860754 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:32.860754 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:32.860754 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:32.860754 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:32.860754 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:32.860754 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:32.860754 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:32.860754 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:32.861626 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:32.861626 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:32.861626 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:32.861626 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:32.861626 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:39:32.861626 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:39:32.861626 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:39:32.861626 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:39:32.861626 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:39:32.861626 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:39:32.861626 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 20:39:32.861626 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:32.861626 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 463/922] 10.222.0.33 () {56 vars in 1120 bytes} [Sat Aug 6 20:39:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:32.866994 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3afff-17b1-47a7-8d6f-1ec56fdd0a9b None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:32.965009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e774239-148f-4487-9a51-597c4723902a None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:32.965354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e774239-148f-4487-9a51-597c4723902a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:32.965566 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e774239-148f-4487-9a51-597c4723902a None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:32.968179 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 464/923] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:39:32.972201 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009de68f-a337-47cc-8c91-458c0644ac0f None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:32.972486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009de68f-a337-47cc-8c91-458c0644ac0f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:32.972767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009de68f-a337-47cc-8c91-458c0644ac0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:32.972902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:32.979645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3afff-17b1-47a7-8d6f-1ec56fdd0a9b None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:32.993323 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-009de68f-a337-47cc-8c91-458c0644ac0f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:32.994525 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-009de68f-a337-47cc-8c91-458c0644ac0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:33.002895 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:33.017199 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79fe680-f6e9-45da-9b07-0afd01b2c27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:33.018132 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fe680-f6e9-45da-9b07-0afd01b2c27e None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:33.018758 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fe680-f6e9-45da-9b07-0afd01b2c27e None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:33.019286 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fe680-f6e9-45da-9b07-0afd01b2c27e None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:33.020205 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79fe680-f6e9-45da-9b07-0afd01b2c27e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:33.020757 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79fe680-f6e9-45da-9b07-0afd01b2c27e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:33.022580 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79fe680-f6e9-45da-9b07-0afd01b2c27e None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:33.031836 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 460/924] 10.222.0.33 () {56 vars in 1115 bytes} [Sat Aug 6 20:39:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:33.039043 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79fe680-f6e9-45da-9b07-0afd01b2c27e None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:33.074702 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 465/925] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 20:39:33.092147 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009de68f-a337-47cc-8c91-458c0644ac0f None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:33.145130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79fe680-f6e9-45da-9b07-0afd01b2c27e None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:33.186203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f28d7-b6e3-40b0-988e-c2251772d589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:33.187255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f28d7-b6e3-40b0-988e-c2251772d589 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:33.187747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f28d7-b6e3-40b0-988e-c2251772d589 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:33.188227 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f28d7-b6e3-40b0-988e-c2251772d589 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:33.201942 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16f28d7-b6e3-40b0-988e-c2251772d589 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:33.203832 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16f28d7-b6e3-40b0-988e-c2251772d589 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:33.207402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009de68f-a337-47cc-8c91-458c0644ac0f None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:33.219839 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-a16f28d7-b6e3-40b0-988e-c2251772d589 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:33.219839 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:33.219839 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:33.219839 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:33.219839 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:33.219839 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:33.219839 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:33.219839 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:33.219839 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:33.219839 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:33.219839 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:33.219839 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:33.219839 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:39:33.219839 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:39:33.219839 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:39:33.219839 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:39:33.220856 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:33.220856 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:33.220856 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:33.220856 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:33.220856 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:33.220856 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:33.220856 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:33.220856 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:33.220856 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:33.220856 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:33.220856 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:33.220856 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:33.220856 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:33.220856 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:33.220856 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:33.220856 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:33.220856 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:39:33.221776 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:39:33.221776 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:33.221776 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:33.228923 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 461/926] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:39:33.230482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f28d7-b6e3-40b0-988e-c2251772d589 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:33.234596 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:33.249787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69604f-21e0-4a11-a3d0-bf906ade6365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:33.250735 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69604f-21e0-4a11-a3d0-bf906ade6365 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:33.251179 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69604f-21e0-4a11-a3d0-bf906ade6365 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:33.251697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69604f-21e0-4a11-a3d0-bf906ade6365 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:33.252525 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a69604f-21e0-4a11-a3d0-bf906ade6365 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:33.254017 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a69604f-21e0-4a11-a3d0-bf906ade6365 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:33.266835 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-9a69604f-21e0-4a11-a3d0-bf906ade6365 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 20:39:33.266835 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:33.266835 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:39:33.266835 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:39:33.266835 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:39:33.266835 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:39:33.266835 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:39:33.266835 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:33.266835 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 20:39:33.266835 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:33.266835 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:39:33.266835 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:33.266835 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:33.266835 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:33.266835 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:33.266835 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:33.266835 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:33.268504 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:33.268504 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:33.268504 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:33.268504 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:33.268504 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:33.268504 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:33.268504 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:39:33.268504 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:39:33.268504 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:39:33.268504 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:39:33.268504 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:33.268504 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:33.268504 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:33.268504 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:33.268504 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:33.268504 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:33.269670 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:33.269670 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:33.269670 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:33.269670 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:33.269670 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:33.269670 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:33.269670 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:33.269670 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:33.269670 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:33.269670 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:33.269670 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:39:33.269670 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:33.269670 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 20:39:33.269670 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:33.277384 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 466/927] 10.222.0.33 () {56 vars in 1114 bytes} [Sat Aug 6 20:39:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:39:33.279736 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69604f-21e0-4a11-a3d0-bf906ade6365 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:33.283813 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:33.346005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f28d7-b6e3-40b0-988e-c2251772d589 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:33.382115 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264eb45-2408-4684-ad96-cb8f46c7a3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:33.382809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264eb45-2408-4684-ad96-cb8f46c7a3bc None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:33.383095 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264eb45-2408-4684-ad96-cb8f46c7a3bc None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:33.383373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264eb45-2408-4684-ad96-cb8f46c7a3bc None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:33.384063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d264eb45-2408-4684-ad96-cb8f46c7a3bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:33.384374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d264eb45-2408-4684-ad96-cb8f46c7a3bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:33.385739 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d264eb45-2408-4684-ad96-cb8f46c7a3bc None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:33.393110 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69604f-21e0-4a11-a3d0-bf906ade6365 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:33.398638 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 462/928] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:33.404071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f3ef7-472d-46cb-a41b-176fff96dcc8 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:33.404354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f3ef7-472d-46cb-a41b-176fff96dcc8 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:33.404626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f3ef7-472d-46cb-a41b-176fff96dcc8 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:33.406073 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 463/929] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:33.406737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f3ef7-472d-46cb-a41b-176fff96dcc8 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:33.434889 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bef68-9bdc-42ea-aafe-272e18e58a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:33.435486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bef68-9bdc-42ea-aafe-272e18e58a2c None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:33.435771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bef68-9bdc-42ea-aafe-272e18e58a2c None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:33.436052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bef68-9bdc-42ea-aafe-272e18e58a2c None admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:33.436673 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194bef68-9bdc-42ea-aafe-272e18e58a2c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:33.436980 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194bef68-9bdc-42ea-aafe-272e18e58a2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:33.438363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194bef68-9bdc-42ea-aafe-272e18e58a2c None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:33.443894 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 467/930] 10.222.0.33 () {56 vars in 1114 bytes} [Sat Aug 6 20:39:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:33.445058 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae7a85-02cb-493e-994a-a2baf5505c45 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:33.445344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae7a85-02cb-493e-994a-a2baf5505c45 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:33.445617 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae7a85-02cb-493e-994a-a2baf5505c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:33.463333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d4ae7a85-02cb-493e-994a-a2baf5505c45 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:33.464516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d4ae7a85-02cb-493e-994a-a2baf5505c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:33.485464 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:33.530604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f3ef7-472d-46cb-a41b-176fff96dcc8 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:33.532987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:33.542970 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 468/931] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:39:33.543834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae7a85-02cb-493e-994a-a2baf5505c45 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:33.582281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ee176-443a-45e2-be31-2401004b9bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:33.583014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ee176-443a-45e2-be31-2401004b9bcf None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:33.583415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ee176-443a-45e2-be31-2401004b9bcf None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:33.583759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ee176-443a-45e2-be31-2401004b9bcf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:33.591825 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ee176-443a-45e2-be31-2401004b9bcf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:33.593295 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ee176-443a-45e2-be31-2401004b9bcf None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:33.606374 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-f49ee176-443a-45e2-be31-2401004b9bcf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 20:39:33.606374 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:33.606374 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:33.606374 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:33.606374 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:33.606374 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:33.606374 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:33.606374 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:33.606374 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:33.606374 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:33.606374 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:33.606374 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:33.606374 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:39:33.606374 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:39:33.606374 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:39:33.606374 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:39:33.607550 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:33.607550 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:33.607550 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:39:33.607550 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:33.607550 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:39:33.607550 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:33.607550 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:33.607550 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:33.607550 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:33.607550 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:33.607550 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:33.607550 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:33.607550 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:33.607550 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:33.607550 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:33.607550 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:33.607550 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:33.607550 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:33.608501 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:33.608501 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:33.608501 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:39:33.608501 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:39:33.608501 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:39:33.608501 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:39:33.608501 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:39:33.608501 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:39:33.608501 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 20:39:33.608501 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:33.612420 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 464/932] 10.222.0.33 () {56 vars in 1117 bytes} [Sat Aug 6 20:39:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:33.613031 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ee176-443a-45e2-be31-2401004b9bcf None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:33.656913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae7a85-02cb-493e-994a-a2baf5505c45 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:33.702853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57933e7-630f-43b4-b292-64f5999b5b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:33.703468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57933e7-630f-43b4-b292-64f5999b5b8e None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:33.703749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57933e7-630f-43b4-b292-64f5999b5b8e None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:33.704025 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57933e7-630f-43b4-b292-64f5999b5b8e None admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:33.704660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57933e7-630f-43b4-b292-64f5999b5b8e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:33.704973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57933e7-630f-43b4-b292-64f5999b5b8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:33.706331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57933e7-630f-43b4-b292-64f5999b5b8e None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:33.711597 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 469/933] 10.222.0.33 () {56 vars in 1114 bytes} [Sat Aug 6 20:39:33 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:33.712225 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57933e7-630f-43b4-b292-64f5999b5b8e None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:33.730988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ee176-443a-45e2-be31-2401004b9bcf None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:33.756152 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:33.769536 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed1879-81ce-4688-93aa-7175402a3d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:33.770252 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed1879-81ce-4688-93aa-7175402a3d11 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:33.770662 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed1879-81ce-4688-93aa-7175402a3d11 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:33.770940 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed1879-81ce-4688-93aa-7175402a3d11 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:33.771523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed1879-81ce-4688-93aa-7175402a3d11 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:33.772915 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed1879-81ce-4688-93aa-7175402a3d11 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:33.777241 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:33.782099 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-caed1879-81ce-4688-93aa-7175402a3d11 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 20:39:33.782099 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:33.782099 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:39:33.782099 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:39:33.782099 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:39:33.782099 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:39:33.782099 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:39:33.782099 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:33.782099 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 20:39:33.782099 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:33.782099 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:39:33.782099 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:33.782099 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:33.782099 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:33.782099 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:33.782099 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:33.783321 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:33.783321 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:33.783321 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:33.783321 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:33.783321 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:33.783321 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:33.783321 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:33.783321 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:39:33.783321 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:39:33.783321 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:39:33.783321 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:39:33.783321 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:33.783321 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:33.783321 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:33.783321 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:33.783321 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:33.783321 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:33.784756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:33.784756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:33.784756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:33.784756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:33.784756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:33.784756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:33.784756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:33.784756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:33.784756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:33.784756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:33.784756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:39:33.784756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:33.784756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 20:39:33.784756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:33.789143 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 465/934] 10.222.0.33 () {56 vars in 1132 bytes} [Sat Aug 6 20:39:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:33.789907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed1879-81ce-4688-93aa-7175402a3d11 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:33.824596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57933e7-630f-43b4-b292-64f5999b5b8e None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:33.861153 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e62075-ba60-4f4d-a921-b9fd3758985a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:33.861756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e62075-ba60-4f4d-a921-b9fd3758985a None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:33.862040 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e62075-ba60-4f4d-a921-b9fd3758985a None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:33.862311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e62075-ba60-4f4d-a921-b9fd3758985a None admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:33.863067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e62075-ba60-4f4d-a921-b9fd3758985a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:33.863854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e62075-ba60-4f4d-a921-b9fd3758985a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:33.865361 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e62075-ba60-4f4d-a921-b9fd3758985a None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:33.883087 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 470/935] 10.222.0.33 () {56 vars in 1149 bytes} [Sat Aug 6 20:39:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:33.883901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e62075-ba60-4f4d-a921-b9fd3758985a None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:33.905959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed1879-81ce-4688-93aa-7175402a3d11 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:33.943917 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2603bf-ebc4-424a-86e6-af19f52fa2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:33.944506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2603bf-ebc4-424a-86e6-af19f52fa2b9 None admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:33.944781 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2603bf-ebc4-424a-86e6-af19f52fa2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:33.945050 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2603bf-ebc4-424a-86e6-af19f52fa2b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:33.945700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2603bf-ebc4-424a-86e6-af19f52fa2b9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:33.947307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2603bf-ebc4-424a-86e6-af19f52fa2b9 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:33.978579 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 466/936] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:39:33 2022] POST /identity/v3/endpoints => generated 346 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:39:33.978579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2603bf-ebc4-424a-86e6-af19f52fa2b9 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:34.014939 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e62075-ba60-4f4d-a921-b9fd3758985a None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:34.046027 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:34.054968 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:34.079345 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eda1ad-f334-4370-8b17-d70b14259291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:34.080500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eda1ad-f334-4370-8b17-d70b14259291 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:34.080782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eda1ad-f334-4370-8b17-d70b14259291 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:34.081052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eda1ad-f334-4370-8b17-d70b14259291 None admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:34.081684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eda1ad-f334-4370-8b17-d70b14259291 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:34.081984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eda1ad-f334-4370-8b17-d70b14259291 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:34.084349 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eda1ad-f334-4370-8b17-d70b14259291 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:34.091156 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 471/937] 10.222.0.33 () {56 vars in 1126 bytes} [Sat Aug 6 20:39:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:34.098076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eda1ad-f334-4370-8b17-d70b14259291 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:34.126264 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2603bf-ebc4-424a-86e6-af19f52fa2b9 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:34.180447 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384fc6d-603d-4328-800c-7e7d41c9ada3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:34.181557 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384fc6d-603d-4328-800c-7e7d41c9ada3 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:34.181853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384fc6d-603d-4328-800c-7e7d41c9ada3 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:34.182149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384fc6d-603d-4328-800c-7e7d41c9ada3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:34.195146 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4384fc6d-603d-4328-800c-7e7d41c9ada3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:34.196535 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4384fc6d-603d-4328-800c-7e7d41c9ada3 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:34.214095 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-4384fc6d-603d-4328-800c-7e7d41c9ada3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:34.214095 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:34.214095 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:34.214095 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:34.214095 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:34.214095 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:34.214095 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:34.214095 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:34.214095 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:34.214095 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:34.214095 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:34.214095 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:34.214095 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:39:34.214095 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:39:34.214095 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:39:34.214095 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:39:34.215309 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:34.215309 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:34.215309 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:34.215309 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:34.215309 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:34.215309 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:34.215309 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:34.215309 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:34.215309 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:34.215309 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:34.215309 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:34.215309 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:34.215309 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:34.215309 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:34.215309 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:34.215309 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:34.215309 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:39:34.216347 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:39:34.216347 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:34.216347 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:34.216347 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 467/938] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:34.220862 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384fc6d-603d-4328-800c-7e7d41c9ada3 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:34.239276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eda1ad-f334-4370-8b17-d70b14259291 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:34.287321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a86bd-9193-4940-a100-3114b7825154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:34.288533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a86bd-9193-4940-a100-3114b7825154 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:34.289212 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a86bd-9193-4940-a100-3114b7825154 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:34.289590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a86bd-9193-4940-a100-3114b7825154 None admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:34.290328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a86bd-9193-4940-a100-3114b7825154 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:34.290758 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a86bd-9193-4940-a100-3114b7825154 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:34.293032 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a86bd-9193-4940-a100-3114b7825154 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:34.302698 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 472/939] 10.222.0.33 () {56 vars in 1126 bytes} [Sat Aug 6 20:39:34 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:34.306767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a86bd-9193-4940-a100-3114b7825154 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:34.357286 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:34.365411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384fc6d-603d-4328-800c-7e7d41c9ada3 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:34.371115 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:34.403170 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75351613-9637-4675-b835-826e48d4f755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:34.404191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75351613-9637-4675-b835-826e48d4f755 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:34.404613 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75351613-9637-4675-b835-826e48d4f755 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:34.405036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75351613-9637-4675-b835-826e48d4f755 None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:34.405841 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75351613-9637-4675-b835-826e48d4f755 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:34.406354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75351613-9637-4675-b835-826e48d4f755 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:34.407959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75351613-9637-4675-b835-826e48d4f755 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:34.421314 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 468/940] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:34.427467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75351613-9637-4675-b835-826e48d4f755 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:34.445890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a86bd-9193-4940-a100-3114b7825154 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:34.481706 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4700dcd-9550-45d2-924b-e28eb12fd9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:34.482312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4700dcd-9550-45d2-924b-e28eb12fd9c8 None admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:34.482614 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4700dcd-9550-45d2-924b-e28eb12fd9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:34.482896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4700dcd-9550-45d2-924b-e28eb12fd9c8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:34.483558 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4700dcd-9550-45d2-924b-e28eb12fd9c8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:34.484909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4700dcd-9550-45d2-924b-e28eb12fd9c8 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:34.511445 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 473/941] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:39:34 2022] POST /identity/v3/endpoints => generated 347 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:39:34.555778 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75351613-9637-4675-b835-826e48d4f755 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:34.608056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd50808-2a8b-4826-bfa3-52598f388cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:34.609460 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd50808-2a8b-4826-bfa3-52598f388cb6 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:34.609895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd50808-2a8b-4826-bfa3-52598f388cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:34.610388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd50808-2a8b-4826-bfa3-52598f388cb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:34.619069 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd50808-2a8b-4826-bfa3-52598f388cb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:34.620879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd50808-2a8b-4826-bfa3-52598f388cb6 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:34.634297 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-afd50808-2a8b-4826-bfa3-52598f388cb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:34.634297 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:34.634297 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:34.634297 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:34.634297 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:34.634297 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:34.634297 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:34.634297 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:34.634297 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:34.634297 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:34.634297 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:34.634297 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:34.634297 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:39:34.634297 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:39:34.634297 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:39:34.635512 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:39:34.635512 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:34.635512 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:34.635512 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:34.635512 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:34.635512 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:34.635512 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:34.635512 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:34.635512 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:34.635512 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:34.635512 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:34.635512 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:34.635512 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:34.635512 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:34.635512 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:34.635512 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:34.635512 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:34.636638 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:39:34.636638 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:39:34.636638 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:39:34.636638 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:39:34.636638 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:39:34.636638 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:39:34.636638 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:34.636638 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:34.638792 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 469/942] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:39:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:34.644594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4700dcd-9550-45d2-924b-e28eb12fd9c8 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:34.706405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177d194-cba9-4b5c-a247-1617d9c76dde None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:34.706631 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177d194-cba9-4b5c-a247-1617d9c76dde None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:34.706889 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177d194-cba9-4b5c-a247-1617d9c76dde None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:34.710269 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 470/943] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:39:34.716466 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffff02-7f5f-4960-a688-5f435033b385 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:34.716881 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffff02-7f5f-4960-a688-5f435033b385 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:34.717238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffff02-7f5f-4960-a688-5f435033b385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:34.739503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-97ffff02-7f5f-4960-a688-5f435033b385 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:34.740867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-97ffff02-7f5f-4960-a688-5f435033b385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:34.749027 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:34.775225 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:34.779444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4700dcd-9550-45d2-924b-e28eb12fd9c8 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:34.823708 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e15bf8-10b3-439a-bc74-484b1ae0dc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:34.823971 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 471/944] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:39:34.824355 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e15bf8-10b3-439a-bc74-484b1ae0dc8c None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:34.824642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e15bf8-10b3-439a-bc74-484b1ae0dc8c None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:34.824969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e15bf8-10b3-439a-bc74-484b1ae0dc8c None admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:34.825664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e15bf8-10b3-439a-bc74-484b1ae0dc8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:34.825968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e15bf8-10b3-439a-bc74-484b1ae0dc8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:34.830591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e15bf8-10b3-439a-bc74-484b1ae0dc8c None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:34.843079 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 474/945] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Aug 6 20:39:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:34.848824 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ffff02-7f5f-4960-a688-5f435033b385 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:34.852476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e15bf8-10b3-439a-bc74-484b1ae0dc8c None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:34.969178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e15bf8-10b3-439a-bc74-484b1ae0dc8c None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:34.979765 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ffff02-7f5f-4960-a688-5f435033b385 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:35.013874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbec63d-e869-46f6-88ba-c5604538f61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:35.014562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbec63d-e869-46f6-88ba-c5604538f61e None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:35.014869 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbec63d-e869-46f6-88ba-c5604538f61e None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:35.015144 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbec63d-e869-46f6-88ba-c5604538f61e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:35.015782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbec63d-e869-46f6-88ba-c5604538f61e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:35.017397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbec63d-e869-46f6-88ba-c5604538f61e None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:35.023024 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a6156-4eb7-42e1-be42-c8ba5ba65b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:35.023943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a6156-4eb7-42e1-be42-c8ba5ba65b75 None admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:35.024428 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a6156-4eb7-42e1-be42-c8ba5ba65b75 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:35.024901 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a6156-4eb7-42e1-be42-c8ba5ba65b75 None admin] PATH_INFO: `/v3/projects/6c4962342201407a89793c5c9a6a6f36/users/384893600b094d9982c2f98cdac52c77/roles/df403794156d44e7bf81058ba5d5f806` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:35.027237 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-6cbec63d-e869-46f6-88ba-c5604538f61e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 20:39:35.027237 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:35.027237 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:39:35.027237 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:39:35.027237 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:39:35.027237 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:39:35.027237 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:39:35.027237 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:35.027237 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 20:39:35.027237 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:35.027237 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:39:35.027237 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:35.027237 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:35.027237 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:35.027237 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:35.027237 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:35.027237 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:35.028281 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:35.028281 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:35.028281 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:35.028281 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:35.028281 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:35.028281 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:35.028281 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:39:35.028281 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:39:35.028281 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:39:35.028281 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:39:35.028281 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:35.028281 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:35.028281 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:35.028281 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:35.028281 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:35.028281 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:35.029178 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:35.029178 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:35.029178 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:35.029178 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:35.029178 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:35.029178 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:35.029178 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:35.029178 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:35.029178 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:35.029178 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:35.029178 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:39:35.029178 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:35.029178 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 20:39:35.029178 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:35.030605 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a6156-4eb7-42e1-be42-c8ba5ba65b75 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c4962342201407a89793c5c9a6a6f36, user_id=384893600b094d9982c2f98cdac52c77, role_id=df403794156d44e7bf81058ba5d5f806)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:35.032281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a6156-4eb7-42e1-be42-c8ba5ba65b75 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:35.033375 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 475/946] 10.222.0.33 () {56 vars in 1126 bytes} [Sat Aug 6 20:39:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:35.034219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbec63d-e869-46f6-88ba-c5604538f61e None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:35.051377 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 472/947] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Aug 6 20:39:34 2022] PUT /identity/v3/projects/6c4962342201407a89793c5c9a6a6f36/users/384893600b094d9982c2f98cdac52c77/roles/df403794156d44e7bf81058ba5d5f806 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:39:35.078769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:35.164775 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbec63d-e869-46f6-88ba-c5604538f61e None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:35.203305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08329bcb-f142-4a70-9071-3d92198f593a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:35.203920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08329bcb-f142-4a70-9071-3d92198f593a None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:35.204202 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08329bcb-f142-4a70-9071-3d92198f593a None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:35.204526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08329bcb-f142-4a70-9071-3d92198f593a None admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:35.205167 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08329bcb-f142-4a70-9071-3d92198f593a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:35.205473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08329bcb-f142-4a70-9071-3d92198f593a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:35.206867 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08329bcb-f142-4a70-9071-3d92198f593a None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:35.213310 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 476/948] 10.222.0.33 () {56 vars in 1122 bytes} [Sat Aug 6 20:39:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:35.219491 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a6156-4eb7-42e1-be42-c8ba5ba65b75 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:35.225786 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:35.341973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a6156-4eb7-42e1-be42-c8ba5ba65b75 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:35.378891 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd8728-0769-4935-91ba-829639228d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:35.380470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd8728-0769-4935-91ba-829639228d47 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:35.381132 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd8728-0769-4935-91ba-829639228d47 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:35.381668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd8728-0769-4935-91ba-829639228d47 None admin] PATH_INFO: `/v3/services` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:35.382604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd8728-0769-4935-91ba-829639228d47 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:35.383131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd8728-0769-4935-91ba-829639228d47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:35.384816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd8728-0769-4935-91ba-829639228d47 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:35.390782 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 473/949] 10.222.0.33 () {56 vars in 1122 bytes} [Sat Aug 6 20:39:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:35.397618 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08329bcb-f142-4a70-9071-3d92198f593a None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:35.495838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:35.506107 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08329bcb-f142-4a70-9071-3d92198f593a None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:35.543178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90883467-55bc-436c-9fbf-abdb3d08bbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:35.543783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90883467-55bc-436c-9fbf-abdb3d08bbf8 None admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:35.544063 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90883467-55bc-436c-9fbf-abdb3d08bbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:35.544493 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90883467-55bc-436c-9fbf-abdb3d08bbf8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:35.545167 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90883467-55bc-436c-9fbf-abdb3d08bbf8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:35.546592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90883467-55bc-436c-9fbf-abdb3d08bbf8 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:35.570113 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 477/950] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:39:35 2022] POST /identity/v3/endpoints => generated 349 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:39:36.454290 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0472b1-255f-4d72-bd0a-e7b678006200 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:36.454919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0472b1-255f-4d72-bd0a-e7b678006200 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:36.455433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0472b1-255f-4d72-bd0a-e7b678006200 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:36.458439 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 474/951] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:36.463969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd9f0d-67f8-439f-920a-d22277e4faed None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:36.464842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd9f0d-67f8-439f-920a-d22277e4faed None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:36.465334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd9f0d-67f8-439f-920a-d22277e4faed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:36.484012 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-7efd9f0d-67f8-439f-920a-d22277e4faed None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:36.485525 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7efd9f0d-67f8-439f-920a-d22277e4faed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:36.566017 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 478/952] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 20:39:36.586534 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0472b1-255f-4d72-bd0a-e7b678006200 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:36.656089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:36.697101 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0472b1-255f-4d72-bd0a-e7b678006200 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:36.733839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4ee7f-3889-40b9-a009-08bad68b3ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:36.734537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4ee7f-3889-40b9-a009-08bad68b3ea2 None admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:36.734864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4ee7f-3889-40b9-a009-08bad68b3ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:36.735139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4ee7f-3889-40b9-a009-08bad68b3ea2 None admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:36.735809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4ee7f-3889-40b9-a009-08bad68b3ea2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:36.737285 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4ee7f-3889-40b9-a009-08bad68b3ea2 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:36.741015 ncdv-master-1 devstack@keystone.service[102758]: WARNING keystone.server.flask.common [None req-6be4ee7f-3889-40b9-a009-08bad68b3ea2 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 06 20:39:36.761548 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.sql.core [None req-6be4ee7f-3889-40b9-a009-08bad68b3ea2 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 06 20:39:36.761548 ncdv-master-1 devstack@keystone.service[102758]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 06 20:39:36.761548 ncdv-master-1 devstack@keystone.service[102758]: [parameters: {'id': '0473f4ce0aca479a99505c306d79babc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 06 20:39:36.761548 ncdv-master-1 devstack@keystone.service[102758]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=102758) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 06 20:39:36.768701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-6be4ee7f-3889-40b9-a009-08bad68b3ea2 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0473f4ce0aca479a99505c306d79babc.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0473f4ce0aca479a99505c306d79babc. Aug 06 20:39:36.768701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:36.768701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 06 20:39:36.768701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 06 20:39:36.768701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 06 20:39:36.768701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 06 20:39:36.768701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 06 20:39:36.768701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application result = self._query(query) Aug 06 20:39:36.768701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 06 20:39:36.768701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application conn.query(q) Aug 06 20:39:36.768701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 06 20:39:36.768701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 06 20:39:36.768701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 06 20:39:36.769514 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application result.read() Aug 06 20:39:36.769514 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 06 20:39:36.769514 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 06 20:39:36.769514 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 06 20:39:36.769514 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 06 20:39:36.769514 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 06 20:39:36.769514 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 06 20:39:36.769514 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 06 20:39:36.769514 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 06 20:39:36.769514 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 06 20:39:36.769514 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:36.769514 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 06 20:39:36.769514 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:36.769514 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:36.769514 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 06 20:39:36.769514 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 06 20:39:36.769514 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 06 20:39:36.769514 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 06 20:39:36.770619 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 06 20:39:36.770619 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application next(self.gen) Aug 06 20:39:36.770619 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 06 20:39:36.770619 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application yield resource Aug 06 20:39:36.770619 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 06 20:39:36.770619 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application next(self.gen) Aug 06 20:39:36.770619 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 06 20:39:36.770619 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self.session.rollback() Aug 06 20:39:36.770619 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:39:36.770619 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self.force_reraise() Aug 06 20:39:36.770619 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:39:36.770619 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise self.value Aug 06 20:39:36.770619 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 06 20:39:36.770619 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 06 20:39:36.770619 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 06 20:39:36.770619 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application session.commit() Aug 06 20:39:36.770619 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 06 20:39:36.772013 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 06 20:39:36.772013 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 06 20:39:36.772013 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._prepare_impl() Aug 06 20:39:36.772013 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 06 20:39:36.772013 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self.session.flush() Aug 06 20:39:36.772013 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 06 20:39:36.772013 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._flush(objects) Aug 06 20:39:36.772013 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 06 20:39:36.772013 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 06 20:39:36.772013 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 06 20:39:36.772013 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application compat.raise_( Aug 06 20:39:36.772013 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 06 20:39:36.772013 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception Aug 06 20:39:36.772013 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 06 20:39:36.772013 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application flush_context.execute() Aug 06 20:39:36.772013 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 06 20:39:36.772013 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rec.execute(self) Aug 06 20:39:36.772974 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 06 20:39:36.772974 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 06 20:39:36.772974 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 06 20:39:36.772974 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 06 20:39:36.772974 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 06 20:39:36.772974 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 06 20:39:36.772974 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 06 20:39:36.772974 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 06 20:39:36.772974 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 06 20:39:36.772974 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 06 20:39:36.772974 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 06 20:39:36.772974 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 06 20:39:36.772974 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 06 20:39:36.772974 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 06 20:39:36.772974 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 06 20:39:36.773790 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 06 20:39:36.773790 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 06 20:39:36.773790 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception Aug 06 20:39:36.773790 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 06 20:39:36.773790 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 06 20:39:36.773790 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 06 20:39:36.773790 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 06 20:39:36.773790 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 06 20:39:36.773790 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application result = self._query(query) Aug 06 20:39:36.773790 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 06 20:39:36.773790 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application conn.query(q) Aug 06 20:39:36.773790 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 06 20:39:36.773790 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 06 20:39:36.773790 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 06 20:39:36.773790 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application result.read() Aug 06 20:39:36.773790 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 06 20:39:36.773790 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 06 20:39:36.775826 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 06 20:39:36.775826 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 06 20:39:36.775826 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 06 20:39:36.775826 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 06 20:39:36.775826 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 06 20:39:36.775826 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 06 20:39:36.775826 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 06 20:39:36.775826 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 06 20:39:36.775826 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [parameters: {'id': '0473f4ce0aca479a99505c306d79babc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 06 20:39:36.775826 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 06 20:39:36.775826 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:36.775826 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:39:36.775826 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:36.775826 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:36.775826 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 06 20:39:36.777717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 06 20:39:36.777717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 06 20:39:36.777717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 06 20:39:36.777717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 06 20:39:36.777717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:36.777717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:39:36.777717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:36.777717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:36.777717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:36.777717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:36.777717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:36.777717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:36.777717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:36.777717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:36.777717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:36.777717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:36.777717 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:36.787799 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:36.787799 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 06 20:39:36.787799 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 06 20:39:36.787799 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:36.787799 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:36.787799 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 06 20:39:36.787799 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 06 20:39:36.787799 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0473f4ce0aca479a99505c306d79babc. Aug 06 20:39:36.787799 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:36.787799 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 475/953] 10.222.0.33 () {60 vars in 1140 bytes} [Sat Aug 6 20:39:36 2022] POST /identity/v3/projects => generated 262 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:36.788426 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd9f0d-67f8-439f-920a-d22277e4faed None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:36.866919 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:36.896609 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83928b2-50d7-409e-bc42-b0f8d08ba83e None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:36.897011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83928b2-50d7-409e-bc42-b0f8d08ba83e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:36.897233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83928b2-50d7-409e-bc42-b0f8d08ba83e None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:36.905413 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 476/954] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:39:36.906673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc91a7-4595-4ec5-8242-e322152da22c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:36.906959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc91a7-4595-4ec5-8242-e322152da22c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:36.907231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc91a7-4595-4ec5-8242-e322152da22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:36.907962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd9f0d-67f8-439f-920a-d22277e4faed None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:36.926716 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f7fc91a7-4595-4ec5-8242-e322152da22c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:36.928917 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f7fc91a7-4595-4ec5-8242-e322152da22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:36.945769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c520d4-da05-4772-be8d-02eac4114dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:36.946768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c520d4-da05-4772-be8d-02eac4114dd4 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:36.947246 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c520d4-da05-4772-be8d-02eac4114dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:36.947723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c520d4-da05-4772-be8d-02eac4114dd4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:36.955019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c520d4-da05-4772-be8d-02eac4114dd4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:36.956463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c520d4-da05-4772-be8d-02eac4114dd4 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:36.968215 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-76c520d4-da05-4772-be8d-02eac4114dd4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:36.968215 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:36.968215 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:36.968215 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:36.968215 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:36.968215 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:36.968215 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:36.968215 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:36.968215 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:36.968215 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:36.968215 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:36.968215 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:36.968215 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:39:36.968215 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:39:36.968215 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:39:36.975464 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:39:36.975464 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:36.975464 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:36.975464 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:36.975464 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:36.975464 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:36.975464 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:36.975464 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:36.975464 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:36.975464 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:36.975464 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:36.975464 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:36.975464 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:36.975464 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:36.975464 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:36.975464 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:36.975464 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:36.977013 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:39:36.977013 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:39:36.977013 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:39:36.977013 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:39:36.977013 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:39:36.977013 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:39:36.977013 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:36.977013 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:36.977013 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 479/955] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:39:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:36.983356 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c520d4-da05-4772-be8d-02eac4114dd4 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:37.016991 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 477/956] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:39:37.043478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc91a7-4595-4ec5-8242-e322152da22c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:37.105907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c520d4-da05-4772-be8d-02eac4114dd4 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:37.111077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:37.141998 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:37.148971 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2d929-c1df-474a-a75b-b113d47408dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:37.149586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2d929-c1df-474a-a75b-b113d47408dd None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:37.149868 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2d929-c1df-474a-a75b-b113d47408dd None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:37.150141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2d929-c1df-474a-a75b-b113d47408dd None admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:37.151067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2d929-c1df-474a-a75b-b113d47408dd None admin] RBAC: Adding query filter params (name=service) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:37.151262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2d929-c1df-474a-a75b-b113d47408dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:37.152680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2d929-c1df-474a-a75b-b113d47408dd None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:37.171688 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 480/957] 10.222.0.33 () {56 vars in 1112 bytes} [Sat Aug 6 20:39:36 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:37.183871 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc91a7-4595-4ec5-8242-e322152da22c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:37.227936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd2e0c-dc92-455e-af71-d6b41f43ba53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:37.229066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd2e0c-dc92-455e-af71-d6b41f43ba53 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:37.229584 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd2e0c-dc92-455e-af71-d6b41f43ba53 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:37.230067 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd2e0c-dc92-455e-af71-d6b41f43ba53 None admin] PATH_INFO: `/v3/services/compute` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:37.230975 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd2e0c-dc92-455e-af71-d6b41f43ba53 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:37.232703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd2e0c-dc92-455e-af71-d6b41f43ba53 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:37.243534 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-1dbd2e0c-dc92-455e-af71-d6b41f43ba53 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 20:39:37.243534 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:37.243534 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:39:37.243534 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:39:37.243534 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:39:37.243534 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:39:37.243534 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:39:37.243534 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:37.243534 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 20:39:37.243534 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:37.243534 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:39:37.243534 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:37.243534 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:37.243534 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:37.243534 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:37.243534 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:37.243534 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:37.244598 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:37.244598 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:37.244598 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:37.244598 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:37.244598 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:37.244598 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:37.244598 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:39:37.244598 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:39:37.244598 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:39:37.244598 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:39:37.244598 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:37.244598 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:37.244598 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:37.244598 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:37.244598 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:37.244598 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:37.245454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:37.245454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:37.245454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:37.245454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:37.245454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:37.245454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:37.245454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:37.245454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:37.245454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:37.245454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:37.245454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:39:37.245454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:37.245454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 20:39:37.245454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:37.249234 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 478/958] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:39:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:39:37.262840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2d929-c1df-474a-a75b-b113d47408dd None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:37.415457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2d929-c1df-474a-a75b-b113d47408dd None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:37.459133 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2122b4e-6f07-4608-bc58-b69128e9b01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:37.460046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2122b4e-6f07-4608-bc58-b69128e9b01e None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:37.460322 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2122b4e-6f07-4608-bc58-b69128e9b01e None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:37.460598 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2122b4e-6f07-4608-bc58-b69128e9b01e None admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:37.461240 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2122b4e-6f07-4608-bc58-b69128e9b01e None admin] RBAC: Adding query filter params (name=compute) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:37.461546 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2122b4e-6f07-4608-bc58-b69128e9b01e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:37.462984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2122b4e-6f07-4608-bc58-b69128e9b01e None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:37.468314 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 481/959] 10.222.0.33 () {56 vars in 1112 bytes} [Sat Aug 6 20:39:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:37.476249 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd2e0c-dc92-455e-af71-d6b41f43ba53 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:37.540434 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99daf570-7164-4cdc-bb37-bd6ef3a001e2 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:37.540718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99daf570-7164-4cdc-bb37-bd6ef3a001e2 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:37.540996 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99daf570-7164-4cdc-bb37-bd6ef3a001e2 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:37.542477 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 482/960] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:37.548929 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4450ce-143f-4cae-8f82-c47d62e888dd None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:37.549214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4450ce-143f-4cae-8f82-c47d62e888dd None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:37.549547 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4450ce-143f-4cae-8f82-c47d62e888dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:37.571709 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-de4450ce-143f-4cae-8f82-c47d62e888dd None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:37.572912 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-de4450ce-143f-4cae-8f82-c47d62e888dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:37.595959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd2e0c-dc92-455e-af71-d6b41f43ba53 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:37.614952 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:37.632487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:37.640298 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ee4ad-816d-4af2-8ec1-aa2ec6c9d251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:37.640920 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ee4ad-816d-4af2-8ec1-aa2ec6c9d251 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:37.641201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ee4ad-816d-4af2-8ec1-aa2ec6c9d251 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:37.641525 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ee4ad-816d-4af2-8ec1-aa2ec6c9d251 None admin] PATH_INFO: `/v3/services` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:37.642270 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ee4ad-816d-4af2-8ec1-aa2ec6c9d251 None admin] RBAC: Adding query filter params (type=compute) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:37.642602 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ee4ad-816d-4af2-8ec1-aa2ec6c9d251 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:37.643985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ee4ad-816d-4af2-8ec1-aa2ec6c9d251 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:37.650263 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 479/961] 10.222.0.33 () {56 vars in 1112 bytes} [Sat Aug 6 20:39:37 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:37.660600 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 483/962] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:39:37.685790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ee4ad-816d-4af2-8ec1-aa2ec6c9d251 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:37.802153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ee4ad-816d-4af2-8ec1-aa2ec6c9d251 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:37.846994 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c2a42-bc18-4a79-aa44-33de48f099c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:37.847635 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c2a42-bc18-4a79-aa44-33de48f099c3 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:37.847915 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c2a42-bc18-4a79-aa44-33de48f099c3 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:37.848188 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c2a42-bc18-4a79-aa44-33de48f099c3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:37.860438 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c2a42-bc18-4a79-aa44-33de48f099c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:39:37.865796 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-8c7c2a42-bc18-4a79-aa44-33de48f099c3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 20:39:37.865796 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:37.865796 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:37.865796 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:37.865796 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:37.865796 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:37.865796 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:37.865796 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:37.865796 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:37.865796 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:37.865796 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:37.865796 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:37.865796 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:39:37.865796 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:39:37.865796 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:39:37.865796 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:39:37.866830 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:39:37.866830 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:39:37.866830 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:39:37.866830 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:39:37.866830 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:37.866830 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:37.866830 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:37.866830 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:37.866830 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:37.866830 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:37.866830 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:37.866830 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:37.866830 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:37.866830 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:37.866830 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:37.866830 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:37.867681 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:37.867681 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:37.867681 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:37.867681 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:37.867681 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:39:37.867681 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:39:37.867681 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:39:37.867681 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:39:37.867681 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:39:37.867681 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:39:37.867681 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 20:39:37.867681 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:37.867681 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 480/963] 10.222.0.33 () {56 vars in 1120 bytes} [Sat Aug 6 20:39:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:37.875325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4450ce-143f-4cae-8f82-c47d62e888dd None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:37.990584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4450ce-143f-4cae-8f82-c47d62e888dd None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:38.027362 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240dd540-6021-4f1c-999a-a35c83c3a82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:38.027965 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240dd540-6021-4f1c-999a-a35c83c3a82c None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:38.028234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240dd540-6021-4f1c-999a-a35c83c3a82c None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:38.028503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240dd540-6021-4f1c-999a-a35c83c3a82c None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:38.029156 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240dd540-6021-4f1c-999a-a35c83c3a82c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:38.029453 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240dd540-6021-4f1c-999a-a35c83c3a82c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:38.030845 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240dd540-6021-4f1c-999a-a35c83c3a82c None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:38.044991 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 484/964] 10.222.0.33 () {56 vars in 1115 bytes} [Sat Aug 6 20:39:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:38.050570 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c2a42-bc18-4a79-aa44-33de48f099c3 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:38.069769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0926d-14c2-43e3-99eb-a72af107236f None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:38.070080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0926d-14c2-43e3-99eb-a72af107236f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:38.070309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0926d-14c2-43e3-99eb-a72af107236f None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:38.072463 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 485/965] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:39:38.077890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da19b86-4ee7-49fa-bf50-91b50ef99809 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:38.078169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da19b86-4ee7-49fa-bf50-91b50ef99809 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:38.078442 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da19b86-4ee7-49fa-bf50-91b50ef99809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:38.102948 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-4da19b86-4ee7-49fa-bf50-91b50ef99809 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:38.104340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4da19b86-4ee7-49fa-bf50-91b50ef99809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:38.105742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:38.163152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:38.172577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c2a42-bc18-4a79-aa44-33de48f099c3 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:38.197613 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 486/966] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 20:39:38.218409 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b5d96-70d9-4a11-bd4d-73242e61853e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:38.219104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b5d96-70d9-4a11-bd4d-73242e61853e None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:38.219380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b5d96-70d9-4a11-bd4d-73242e61853e None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:38.219650 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b5d96-70d9-4a11-bd4d-73242e61853e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:38.221513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da19b86-4ee7-49fa-bf50-91b50ef99809 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:38.232537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b5d96-70d9-4a11-bd4d-73242e61853e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:38.234694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b5d96-70d9-4a11-bd4d-73242e61853e None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:38.259420 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-d45b5d96-70d9-4a11-bd4d-73242e61853e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:38.259420 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:38.259420 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:38.259420 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:38.259420 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:38.259420 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:38.259420 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:38.259420 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:38.259420 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:38.259420 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:38.259420 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:38.259420 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:38.259420 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:39:38.259420 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:39:38.259420 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:39:38.259420 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:39:38.260419 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:38.260419 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:38.260419 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:38.260419 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:38.260419 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:38.260419 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:38.260419 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:38.260419 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:38.260419 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:38.260419 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:38.260419 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:38.260419 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:38.260419 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:38.260419 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:38.260419 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:38.260419 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:38.260419 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:39:38.261338 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:39:38.261338 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:38.261338 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:38.263443 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 481/967] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:38.269457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b5d96-70d9-4a11-bd4d-73242e61853e None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:38.368132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da19b86-4ee7-49fa-bf50-91b50ef99809 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:38.401228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:38.413402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfd429-a82a-453b-a295-9010e40b6aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:38.414173 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfd429-a82a-453b-a295-9010e40b6aab None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:38.414444 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b5d96-70d9-4a11-bd4d-73242e61853e None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:38.414670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfd429-a82a-453b-a295-9010e40b6aab None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:38.415036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfd429-a82a-453b-a295-9010e40b6aab None admin] PATH_INFO: `/v3/services/object-store` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:38.415718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcfd429-a82a-453b-a295-9010e40b6aab None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:38.418112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcfd429-a82a-453b-a295-9010e40b6aab None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:38.429259 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-cfcfd429-a82a-453b-a295-9010e40b6aab None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 20:39:38.429259 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:38.429259 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:39:38.429259 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:39:38.429259 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:39:38.429259 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:39:38.429259 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:39:38.429259 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:38.429259 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 20:39:38.429259 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:38.429259 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:39:38.429259 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:38.429259 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:38.429259 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:38.429259 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:38.429259 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:38.429259 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:38.430303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:38.430303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:38.430303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:38.430303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:38.430303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:38.430303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:38.430303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:39:38.430303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:39:38.430303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:39:38.430303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:39:38.430303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:38.430303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:38.430303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:38.430303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:38.430303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:38.430303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:38.431528 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:38.431528 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:38.431528 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:38.431528 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:38.431528 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:38.431528 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:38.431528 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:38.431528 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:38.431528 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:38.431528 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:38.431528 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:39:38.431528 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:38.431528 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 20:39:38.431528 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:38.434701 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 487/968] 10.222.0.33 () {56 vars in 1126 bytes} [Sat Aug 6 20:39:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:39:38.436597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfd429-a82a-453b-a295-9010e40b6aab None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:38.464969 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f22b08-a93e-4a90-8710-14b28750ee8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:38.466089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f22b08-a93e-4a90-8710-14b28750ee8d None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:38.466371 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f22b08-a93e-4a90-8710-14b28750ee8d None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:38.466698 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f22b08-a93e-4a90-8710-14b28750ee8d None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:38.467340 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f22b08-a93e-4a90-8710-14b28750ee8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:38.467639 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f22b08-a93e-4a90-8710-14b28750ee8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:38.469557 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f22b08-a93e-4a90-8710-14b28750ee8d None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:38.490633 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 482/969] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:38.493302 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f22b08-a93e-4a90-8710-14b28750ee8d None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:38.496206 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:38.577335 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfd429-a82a-453b-a295-9010e40b6aab None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:38.616823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f092b-4d58-40af-8267-da16949ca8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:38.617435 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f092b-4d58-40af-8267-da16949ca8f0 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:38.617714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f092b-4d58-40af-8267-da16949ca8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:38.617987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f092b-4d58-40af-8267-da16949ca8f0 None admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:38.618658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27f092b-4d58-40af-8267-da16949ca8f0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:38.618966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27f092b-4d58-40af-8267-da16949ca8f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:38.620334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27f092b-4d58-40af-8267-da16949ca8f0 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:38.625596 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 488/970] 10.222.0.33 () {56 vars in 1122 bytes} [Sat Aug 6 20:39:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:38.631796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f092b-4d58-40af-8267-da16949ca8f0 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:38.633765 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f22b08-a93e-4a90-8710-14b28750ee8d None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:38.682371 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52cd45-22c1-4d14-824f-ddb751f9b041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:38.683047 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52cd45-22c1-4d14-824f-ddb751f9b041 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:38.683330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52cd45-22c1-4d14-824f-ddb751f9b041 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:38.683606 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52cd45-22c1-4d14-824f-ddb751f9b041 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:38.692770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a52cd45-22c1-4d14-824f-ddb751f9b041 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:38.694605 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a52cd45-22c1-4d14-824f-ddb751f9b041 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:38.710891 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-8a52cd45-22c1-4d14-824f-ddb751f9b041 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 20:39:38.710891 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:38.710891 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:38.710891 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:38.710891 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:38.710891 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:38.710891 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:38.710891 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:38.710891 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:38.710891 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:38.710891 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:38.710891 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:38.710891 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:39:38.710891 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:39:38.710891 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:39:38.710891 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:39:38.712070 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:38.712070 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:38.712070 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:39:38.712070 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:38.712070 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:39:38.712070 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:38.712070 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:38.712070 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:38.712070 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:38.712070 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:38.712070 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:38.712070 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:38.712070 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:38.712070 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:38.712070 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:38.712070 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:38.712070 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:38.712070 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:38.713222 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:38.713222 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:38.713222 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:39:38.713222 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:39:38.713222 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:39:38.713222 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:39:38.713222 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:39:38.713222 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:39:38.713222 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 20:39:38.713222 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:38.713222 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 483/971] 10.222.0.33 () {56 vars in 1117 bytes} [Sat Aug 6 20:39:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:39:38.718430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52cd45-22c1-4d14-824f-ddb751f9b041 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:38.735378 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:38.765753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f092b-4d58-40af-8267-da16949ca8f0 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:38.768674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:38.806973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b3641-c51e-4a61-8c7b-8bc21a6d6e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:38.807716 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b3641-c51e-4a61-8c7b-8bc21a6d6e84 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:38.808088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b3641-c51e-4a61-8c7b-8bc21a6d6e84 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:38.808452 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b3641-c51e-4a61-8c7b-8bc21a6d6e84 None admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:38.809174 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b3641-c51e-4a61-8c7b-8bc21a6d6e84 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:38.809560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b3641-c51e-4a61-8c7b-8bc21a6d6e84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:38.811041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b3641-c51e-4a61-8c7b-8bc21a6d6e84 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:38.821364 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 489/972] 10.222.0.33 () {56 vars in 1122 bytes} [Sat Aug 6 20:39:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:38.822533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b3641-c51e-4a61-8c7b-8bc21a6d6e84 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:38.840498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52cd45-22c1-4d14-824f-ddb751f9b041 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:38.888160 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c728b3-17d3-4fce-8004-07050657e82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:38.888946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c728b3-17d3-4fce-8004-07050657e82e None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:38.889957 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c728b3-17d3-4fce-8004-07050657e82e None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:38.890335 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c728b3-17d3-4fce-8004-07050657e82e None admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:38.891526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c728b3-17d3-4fce-8004-07050657e82e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:38.891952 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c728b3-17d3-4fce-8004-07050657e82e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:38.894729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c728b3-17d3-4fce-8004-07050657e82e None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:38.921298 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 484/973] 10.222.0.33 () {56 vars in 1149 bytes} [Sat Aug 6 20:39:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:38.927950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c728b3-17d3-4fce-8004-07050657e82e None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:38.948782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b3641-c51e-4a61-8c7b-8bc21a6d6e84 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:38.998258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788ce39-0c46-4a57-bd42-afea088adf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:38.998947 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788ce39-0c46-4a57-bd42-afea088adf4f None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:38.999229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788ce39-0c46-4a57-bd42-afea088adf4f None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:38.999499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788ce39-0c46-4a57-bd42-afea088adf4f None admin] PATH_INFO: `/v3/endpoints` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:39.000403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7788ce39-0c46-4a57-bd42-afea088adf4f None admin] RBAC: Adding query filter params (interface=admin, service_id=2344dc2b00c14947aedfefc335c47d6e, region_id=RegionOne) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:39.000716 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7788ce39-0c46-4a57-bd42-afea088adf4f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:39.002895 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7788ce39-0c46-4a57-bd42-afea088adf4f None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:39.003689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:39.010965 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 490/974] 10.222.0.33 () {56 vars in 1249 bytes} [Sat Aug 6 20:39:38 2022] GET /identity/v3/endpoints?service_id=2344dc2b00c14947aedfefc335c47d6e&interface=admin®ion_id=RegionOne => generated 193 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:39.026840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788ce39-0c46-4a57-bd42-afea088adf4f None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:39.038017 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c728b3-17d3-4fce-8004-07050657e82e None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:39.069810 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:39.074814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a20a8-25e1-4c6c-8c65-feb45c741be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:39.075429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a20a8-25e1-4c6c-8c65-feb45c741be2 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:39.075709 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a20a8-25e1-4c6c-8c65-feb45c741be2 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:39.075986 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a20a8-25e1-4c6c-8c65-feb45c741be2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:39.152070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a20a8-25e1-4c6c-8c65-feb45c741be2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:39.153671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a20a8-25e1-4c6c-8c65-feb45c741be2 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:39.159061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788ce39-0c46-4a57-bd42-afea088adf4f None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:39.197962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197faf6-1eeb-4394-97d0-67bab6f3f280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:39.198596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197faf6-1eeb-4394-97d0-67bab6f3f280 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:39.198880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197faf6-1eeb-4394-97d0-67bab6f3f280 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:39.199152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197faf6-1eeb-4394-97d0-67bab6f3f280 None admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:39.200115 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197faf6-1eeb-4394-97d0-67bab6f3f280 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:39.201847 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197faf6-1eeb-4394-97d0-67bab6f3f280 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:39.210791 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 491/975] 10.222.0.33 () {56 vars in 1087 bytes} [Sat Aug 6 20:39:39 2022] GET /identity/v3/services => generated 1497 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:39:39.236670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:39.274727 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 485/976] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:39:38 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 20:39:39.280256 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197faf6-1eeb-4394-97d0-67bab6f3f280 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:39.390949 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:39.398378 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197faf6-1eeb-4394-97d0-67bab6f3f280 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:39.434300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca998d78-9cbe-4256-a9dc-b2790b8eda47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:39.434879 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca998d78-9cbe-4256-a9dc-b2790b8eda47 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:39.435159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca998d78-9cbe-4256-a9dc-b2790b8eda47 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:39.435433 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca998d78-9cbe-4256-a9dc-b2790b8eda47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:39.446710 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca998d78-9cbe-4256-a9dc-b2790b8eda47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:39.448163 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca998d78-9cbe-4256-a9dc-b2790b8eda47 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:39.463634 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-ca998d78-9cbe-4256-a9dc-b2790b8eda47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:39.463634 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:39.463634 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:39.463634 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:39.463634 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:39.463634 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:39.463634 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:39.463634 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:39.463634 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:39.463634 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:39.463634 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:39.463634 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:39.463634 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:39:39.463634 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:39:39.463634 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:39:39.463634 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:39:39.464637 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:39.464637 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:39.464637 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:39.464637 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:39.464637 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:39.464637 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:39.464637 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:39.464637 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:39.464637 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:39.464637 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:39.464637 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:39.464637 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:39.464637 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:39.464637 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:39.464637 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:39.464637 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:39.464637 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:39:39.465538 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:39:39.465538 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:39.465538 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:39.465538 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 492/977] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:39.470716 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a20a8-25e1-4c6c-8c65-feb45c741be2 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:39.579329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a20a8-25e1-4c6c-8c65-feb45c741be2 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:39.620481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b7d6f-1b56-45fa-853c-62ebc303e389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:39.621567 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b7d6f-1b56-45fa-853c-62ebc303e389 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:39.622039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b7d6f-1b56-45fa-853c-62ebc303e389 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:39.622514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b7d6f-1b56-45fa-853c-62ebc303e389 None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:39.623243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b7d6f-1b56-45fa-853c-62ebc303e389 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:39.623553 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b7d6f-1b56-45fa-853c-62ebc303e389 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:39.624941 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b7d6f-1b56-45fa-853c-62ebc303e389 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:39.638000 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 486/978] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:39:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:39.643624 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca998d78-9cbe-4256-a9dc-b2790b8eda47 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:39.757680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca998d78-9cbe-4256-a9dc-b2790b8eda47 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:39.768180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa019869-71ed-4d66-a020-22dc35ac8c43 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:39.768481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa019869-71ed-4d66-a020-22dc35ac8c43 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:39.768739 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa019869-71ed-4d66-a020-22dc35ac8c43 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:39.770779 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 487/979] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:39:39.776159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a2f7e-5571-4317-936c-04ef227f3137 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:39.776675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a2f7e-5571-4317-936c-04ef227f3137 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:39.777056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a2f7e-5571-4317-936c-04ef227f3137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:39.795332 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-625a2f7e-5571-4317-936c-04ef227f3137 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:39.796670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-625a2f7e-5571-4317-936c-04ef227f3137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:39.800561 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1d5e5-62e9-424a-8b77-55a4665b8420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:39.801408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1d5e5-62e9-424a-8b77-55a4665b8420 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:39.801869 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1d5e5-62e9-424a-8b77-55a4665b8420 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:39.802273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1d5e5-62e9-424a-8b77-55a4665b8420 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:39.811322 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1d5e5-62e9-424a-8b77-55a4665b8420 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:39.813195 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1d5e5-62e9-424a-8b77-55a4665b8420 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:39.828267 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-14b1d5e5-62e9-424a-8b77-55a4665b8420 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:39.828267 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:39.828267 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:39.828267 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:39.828267 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:39.828267 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:39.828267 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:39.828267 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:39.828267 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:39.828267 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:39.828267 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:39.828267 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:39.828267 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:39:39.828267 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:39:39.828267 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:39:39.829264 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:39:39.829264 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:39.829264 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:39.829264 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:39.829264 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:39.829264 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:39.829264 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:39.829264 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:39.829264 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:39.829264 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:39.829264 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:39.829264 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:39.829264 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:39.829264 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:39.829264 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:39.829264 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:39.829264 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:39.830274 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:39:39.830274 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:39:39.830274 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:39:39.830274 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:39:39.830274 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:39:39.830274 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:39:39.830274 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:39.830274 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:39.830274 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 493/980] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:39:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:39.831033 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:39.838347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1d5e5-62e9-424a-8b77-55a4665b8420 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:39.857712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:39.883337 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 488/981] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 20:39:39.909301 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a2f7e-5571-4317-936c-04ef227f3137 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:39.955033 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1d5e5-62e9-424a-8b77-55a4665b8420 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:39.994157 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b45828-839b-4849-85a5-5ba620fddd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:39.995173 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b45828-839b-4849-85a5-5ba620fddd4c None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:39.995661 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b45828-839b-4849-85a5-5ba620fddd4c None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:39.996138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b45828-839b-4849-85a5-5ba620fddd4c None admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:39.997046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b45828-839b-4849-85a5-5ba620fddd4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:39.997568 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b45828-839b-4849-85a5-5ba620fddd4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:39.999269 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b45828-839b-4849-85a5-5ba620fddd4c None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:40.024071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a2f7e-5571-4317-936c-04ef227f3137 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:40.065638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f904b-72e4-42da-96d9-5f06e803c6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:40.066296 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f904b-72e4-42da-96d9-5f06e803c6ba None admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:40.066607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f904b-72e4-42da-96d9-5f06e803c6ba None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:40.066886 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f904b-72e4-42da-96d9-5f06e803c6ba None admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:40.068079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27f904b-72e4-42da-96d9-5f06e803c6ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:40.069540 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27f904b-72e4-42da-96d9-5f06e803c6ba None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:40.085944 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.sql.core [None req-a27f904b-72e4-42da-96d9-5f06e803c6ba None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 06 20:39:40.085944 ncdv-master-1 devstack@keystone.service[102758]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 06 20:39:40.085944 ncdv-master-1 devstack@keystone.service[102758]: [parameters: {'user_id': '76ae9fe0167d4565a21ef9916474b827', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 06 20:39:40.085944 ncdv-master-1 devstack@keystone.service[102758]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=102758) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 06 20:39:40.097979 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-a27f904b-72e4-42da-96d9-5f06e803c6ba None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 06 20:39:40.097979 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:40.097979 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 06 20:39:40.097979 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 06 20:39:40.097979 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 06 20:39:40.097979 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 06 20:39:40.097979 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 06 20:39:40.097979 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application result = self._query(query) Aug 06 20:39:40.097979 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 06 20:39:40.097979 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application conn.query(q) Aug 06 20:39:40.097979 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 06 20:39:40.097979 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 06 20:39:40.097979 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 06 20:39:40.097979 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application result.read() Aug 06 20:39:40.097979 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 06 20:39:40.099503 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 06 20:39:40.099503 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 06 20:39:40.099503 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 06 20:39:40.099503 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 06 20:39:40.099503 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 06 20:39:40.099503 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 06 20:39:40.099503 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 06 20:39:40.099503 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 06 20:39:40.099503 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:40.099503 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 06 20:39:40.099503 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:40.099503 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:40.099503 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 06 20:39:40.099503 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 06 20:39:40.099503 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 06 20:39:40.099503 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 06 20:39:40.099503 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 06 20:39:40.099503 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application next(self.gen) Aug 06 20:39:40.100497 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 06 20:39:40.100497 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application yield resource Aug 06 20:39:40.100497 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 06 20:39:40.100497 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application next(self.gen) Aug 06 20:39:40.100497 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 06 20:39:40.100497 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self.session.rollback() Aug 06 20:39:40.100497 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:39:40.100497 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self.force_reraise() Aug 06 20:39:40.100497 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:39:40.100497 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise self.value Aug 06 20:39:40.100497 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 06 20:39:40.100497 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 06 20:39:40.100497 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 06 20:39:40.100497 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application session.commit() Aug 06 20:39:40.100497 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 06 20:39:40.100497 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 06 20:39:40.100497 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 06 20:39:40.101388 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._prepare_impl() Aug 06 20:39:40.101388 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 06 20:39:40.101388 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self.session.flush() Aug 06 20:39:40.101388 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 06 20:39:40.101388 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._flush(objects) Aug 06 20:39:40.101388 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 06 20:39:40.101388 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 06 20:39:40.101388 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 06 20:39:40.101388 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application compat.raise_( Aug 06 20:39:40.101388 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 06 20:39:40.101388 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception Aug 06 20:39:40.101388 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 06 20:39:40.101388 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application flush_context.execute() Aug 06 20:39:40.101388 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 06 20:39:40.101388 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rec.execute(self) Aug 06 20:39:40.101388 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 06 20:39:40.101388 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 06 20:39:40.103370 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 06 20:39:40.103370 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 06 20:39:40.103370 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 06 20:39:40.103370 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 06 20:39:40.103370 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 06 20:39:40.103370 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 06 20:39:40.103370 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 06 20:39:40.103370 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 06 20:39:40.103370 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 06 20:39:40.103370 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 06 20:39:40.103370 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 06 20:39:40.103370 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 06 20:39:40.103370 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 06 20:39:40.103370 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 06 20:39:40.103370 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 06 20:39:40.103370 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception Aug 06 20:39:40.105069 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 06 20:39:40.105069 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 06 20:39:40.105069 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 06 20:39:40.105069 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 06 20:39:40.105069 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 06 20:39:40.105069 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application result = self._query(query) Aug 06 20:39:40.105069 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 06 20:39:40.105069 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application conn.query(q) Aug 06 20:39:40.105069 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 06 20:39:40.105069 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 06 20:39:40.105069 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 06 20:39:40.105069 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application result.read() Aug 06 20:39:40.105069 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 06 20:39:40.105069 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 06 20:39:40.105069 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 06 20:39:40.105069 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 06 20:39:40.106670 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 06 20:39:40.106670 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 06 20:39:40.106670 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 06 20:39:40.106670 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 06 20:39:40.106670 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 06 20:39:40.106670 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 06 20:39:40.106670 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [parameters: {'user_id': '76ae9fe0167d4565a21ef9916474b827', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 06 20:39:40.106670 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 06 20:39:40.106670 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:40.106670 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:39:40.106670 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:40.106670 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:40.106670 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:40.106670 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:40.106670 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:40.108321 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:40.108321 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:40.108321 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:40.108321 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:40.108321 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:40.108321 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:40.108321 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:40.108321 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 06 20:39:40.108321 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 06 20:39:40.108321 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:40.108321 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:40.108321 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:39:40.108321 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:40.108321 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:39:40.108321 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:40.108321 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 06 20:39:40.108321 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 06 20:39:40.110635 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 06 20:39:40.110635 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 06 20:39:40.110635 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 06 20:39:40.110635 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 06 20:39:40.110635 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 06 20:39:40.110635 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:40.110635 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 489/982] 10.222.0.33 () {60 vars in 1131 bytes} [Sat Aug 6 20:39:39 2022] POST /identity/v3/users => generated 160 bytes in 192 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:39:40.110635 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f904b-72e4-42da-96d9-5f06e803c6ba None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:40.138930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:40.153408 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 494/983] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Aug 6 20:39:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:40.155089 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb4716-f213-4fa3-b23d-81786a46804e None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:40.155556 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb4716-f213-4fa3-b23d-81786a46804e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:40.156012 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb4716-f213-4fa3-b23d-81786a46804e None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:40.157649 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 495/984] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:40.159208 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb4716-f213-4fa3-b23d-81786a46804e None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:40.226227 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f904b-72e4-42da-96d9-5f06e803c6ba None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:40.233433 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:40.267375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70769d-c821-4cd1-90a3-fe8684af76df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:40.268009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70769d-c821-4cd1-90a3-fe8684af76df None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:40.268282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70769d-c821-4cd1-90a3-fe8684af76df None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:40.268562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70769d-c821-4cd1-90a3-fe8684af76df None admin] PATH_INFO: `/v3/users/cinder` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:40.276269 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70769d-c821-4cd1-90a3-fe8684af76df None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:40.277843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70769d-c821-4cd1-90a3-fe8684af76df None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:40.279339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb4716-f213-4fa3-b23d-81786a46804e None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:40.289363 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-db70769d-c821-4cd1-90a3-fe8684af76df None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 20:39:40.289363 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:40.289363 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:40.289363 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:40.289363 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:40.289363 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:40.289363 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:40.289363 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:40.289363 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:40.289363 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:40.289363 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:40.289363 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:40.289363 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:39:40.289363 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:39:40.289363 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:39:40.289363 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:39:40.291726 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:40.291726 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:40.291726 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:39:40.291726 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:40.291726 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:39:40.291726 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:40.291726 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:40.291726 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:40.291726 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:40.291726 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:40.291726 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:40.291726 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:40.291726 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:40.291726 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:40.291726 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:40.291726 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:40.291726 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:40.291726 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:40.292770 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:40.292770 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:40.292770 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:39:40.292770 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:39:40.292770 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:39:40.292770 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:39:40.292770 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:39:40.292770 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:39:40.292770 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 20:39:40.292770 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:40.292770 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 490/985] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:39:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:40.292770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e09fc2-c2ed-4853-9380-bdf32d606709 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:40.292770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e09fc2-c2ed-4853-9380-bdf32d606709 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:40.293497 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e09fc2-c2ed-4853-9380-bdf32d606709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:40.312108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f7e09fc2-c2ed-4853-9380-bdf32d606709 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:40.313623 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f7e09fc2-c2ed-4853-9380-bdf32d606709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:40.326635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e316d-bbf7-4cfe-b73f-2e2d7af011b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:40.327342 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e316d-bbf7-4cfe-b73f-2e2d7af011b4 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:40.327619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e316d-bbf7-4cfe-b73f-2e2d7af011b4 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:40.327883 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e316d-bbf7-4cfe-b73f-2e2d7af011b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:40.328584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e316d-bbf7-4cfe-b73f-2e2d7af011b4 None admin] RBAC: Adding query filter params (role.id=df403794156d44e7bf81058ba5d5f806, scope.project.id=6c4962342201407a89793c5c9a6a6f36, user.id=384893600b094d9982c2f98cdac52c77) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:40.328887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e316d-bbf7-4cfe-b73f-2e2d7af011b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:40.330333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e316d-bbf7-4cfe-b73f-2e2d7af011b4 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:40.346594 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 496/986] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:39:40 2022] GET /identity/v3/role_assignments?user.id=384893600b094d9982c2f98cdac52c77&scope.project.id=6c4962342201407a89793c5c9a6a6f36&role.id=df403794156d44e7bf81058ba5d5f806 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:40.346594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e316d-bbf7-4cfe-b73f-2e2d7af011b4 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:40.409164 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 491/987] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:39:40.430493 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e09fc2-c2ed-4853-9380-bdf32d606709 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:40.448634 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:40.477551 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e316d-bbf7-4cfe-b73f-2e2d7af011b4 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:40.514236 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:40.521533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4a120-5eb8-43aa-bdf9-85568f0d4cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:40.522690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4a120-5eb8-43aa-bdf9-85568f0d4cb5 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:40.523035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4a120-5eb8-43aa-bdf9-85568f0d4cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:40.523310 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4a120-5eb8-43aa-bdf9-85568f0d4cb5 None admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:40.524076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c4a120-5eb8-43aa-bdf9-85568f0d4cb5 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:40.524387 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c4a120-5eb8-43aa-bdf9-85568f0d4cb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:40.525986 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c4a120-5eb8-43aa-bdf9-85568f0d4cb5 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:40.550818 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e09fc2-c2ed-4853-9380-bdf32d606709 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:40.565981 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 497/988] 10.222.0.33 () {56 vars in 1101 bytes} [Sat Aug 6 20:39:40 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:40.597853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057b5d5-d374-484c-8397-8c66b90415cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:40.599157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057b5d5-d374-484c-8397-8c66b90415cf None admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:40.602579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057b5d5-d374-484c-8397-8c66b90415cf None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:40.602579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057b5d5-d374-484c-8397-8c66b90415cf None admin] PATH_INFO: `/v3/services` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:40.602579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057b5d5-d374-484c-8397-8c66b90415cf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:40.602579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057b5d5-d374-484c-8397-8c66b90415cf None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:40.623485 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 492/989] 10.222.0.33 () {60 vars in 1141 bytes} [Sat Aug 6 20:39:40 2022] POST /identity/v3/services => generated 242 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:39:41.616380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f74b96-49a1-495a-8370-2e040e2a209c None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:41.616913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f74b96-49a1-495a-8370-2e040e2a209c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:41.616913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f74b96-49a1-495a-8370-2e040e2a209c None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:41.618395 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 498/990] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:41.623425 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29200a-783c-4205-a6bc-121964e02357 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:41.623814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29200a-783c-4205-a6bc-121964e02357 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:41.623973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29200a-783c-4205-a6bc-121964e02357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:41.643160 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-ad29200a-783c-4205-a6bc-121964e02357 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:41.644408 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ad29200a-783c-4205-a6bc-121964e02357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:41.720024 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:41.730607 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 493/991] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:41 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:39:41.754214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f74b96-49a1-495a-8370-2e040e2a209c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:41.861484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f74b96-49a1-495a-8370-2e040e2a209c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:41.896189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c5597-b87b-4ae7-a202-304a325c5b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:41.896733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c5597-b87b-4ae7-a202-304a325c5b78 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:41.897003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c5597-b87b-4ae7-a202-304a325c5b78 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:41.897265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c5597-b87b-4ae7-a202-304a325c5b78 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:41.897905 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c5597-b87b-4ae7-a202-304a325c5b78 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:41.899269 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c5597-b87b-4ae7-a202-304a325c5b78 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:41.907945 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-2c6c5597-b87b-4ae7-a202-304a325c5b78 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 20:39:41.907945 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:41.907945 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:39:41.907945 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:39:41.907945 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:39:41.907945 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:39:41.907945 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:39:41.907945 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:41.907945 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 20:39:41.907945 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:41.907945 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:39:41.907945 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:41.907945 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:41.907945 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:41.907945 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:41.907945 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:41.907945 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:41.908935 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:41.908935 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:41.908935 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:41.908935 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:41.908935 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:41.908935 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:41.908935 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:39:41.908935 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:39:41.908935 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:39:41.908935 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:39:41.908935 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:41.908935 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:41.908935 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:41.908935 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:41.908935 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:41.908935 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:41.909796 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:41.909796 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:41.909796 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:41.909796 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:41.909796 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:41.909796 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:41.909796 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:41.909796 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:41.909796 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:41.909796 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:41.909796 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:39:41.909796 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:41.909796 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 20:39:41.909796 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:41.914825 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 499/992] 10.222.0.33 () {56 vars in 1126 bytes} [Sat Aug 6 20:39:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:41.915568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad29200a-783c-4205-a6bc-121964e02357 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:42.012688 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad29200a-783c-4205-a6bc-121964e02357 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:42.045672 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f72bb0-0e45-45c7-bffb-681810c835c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:42.046274 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f72bb0-0e45-45c7-bffb-681810c835c9 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:42.046561 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f72bb0-0e45-45c7-bffb-681810c835c9 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:42.046840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f72bb0-0e45-45c7-bffb-681810c835c9 None admin] PATH_INFO: `/v3/services` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:42.047463 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f72bb0-0e45-45c7-bffb-681810c835c9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:42.047763 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f72bb0-0e45-45c7-bffb-681810c835c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:42.049436 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f72bb0-0e45-45c7-bffb-681810c835c9 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:42.059659 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 494/993] 10.222.0.33 () {56 vars in 1122 bytes} [Sat Aug 6 20:39:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:42.063649 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c5597-b87b-4ae7-a202-304a325c5b78 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:42.120557 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:42.167374 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c5597-b87b-4ae7-a202-304a325c5b78 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:42.200653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e312e5b-9dba-4ef0-b2f8-547233df5722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:42.201254 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e312e5b-9dba-4ef0-b2f8-547233df5722 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:42.201532 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e312e5b-9dba-4ef0-b2f8-547233df5722 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:42.201800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e312e5b-9dba-4ef0-b2f8-547233df5722 None admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:42.202420 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e312e5b-9dba-4ef0-b2f8-547233df5722 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:42.202746 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e312e5b-9dba-4ef0-b2f8-547233df5722 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:42.204096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e312e5b-9dba-4ef0-b2f8-547233df5722 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:42.209607 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 500/994] 10.222.0.33 () {56 vars in 1122 bytes} [Sat Aug 6 20:39:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:42.215107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f72bb0-0e45-45c7-bffb-681810c835c9 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:42.285357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:42.325556 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f72bb0-0e45-45c7-bffb-681810c835c9 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:42.360608 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e9d80-69e5-46db-9e37-88194433a065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:42.361211 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e9d80-69e5-46db-9e37-88194433a065 None admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:42.361486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e9d80-69e5-46db-9e37-88194433a065 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:42.361752 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e9d80-69e5-46db-9e37-88194433a065 None admin] PATH_INFO: `/v3/endpoints` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:42.362729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e9d80-69e5-46db-9e37-88194433a065 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:42.365145 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e9d80-69e5-46db-9e37-88194433a065 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:42.386586 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 495/995] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:39:42 2022] POST /identity/v3/endpoints => generated 325 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:39:42.770906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007de5d-d9a1-4b39-af38-5a6530b2da74 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:42.771450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007de5d-d9a1-4b39-af38-5a6530b2da74 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:42.771450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007de5d-d9a1-4b39-af38-5a6530b2da74 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:42.772835 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 501/996] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:42.778059 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a172ea6-48c2-4184-87a0-2d41af209066 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:42.778470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a172ea6-48c2-4184-87a0-2d41af209066 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:42.778658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a172ea6-48c2-4184-87a0-2d41af209066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:42.797015 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-9a172ea6-48c2-4184-87a0-2d41af209066 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:42.798200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9a172ea6-48c2-4184-87a0-2d41af209066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:42.877219 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 496/997] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:42 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:39:42.901412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007de5d-d9a1-4b39-af38-5a6530b2da74 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:42.992894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691705c-fbbb-43a3-bd56-e38e1d8860bd None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:42.993242 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691705c-fbbb-43a3-bd56-e38e1d8860bd None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:42.993487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691705c-fbbb-43a3-bd56-e38e1d8860bd None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:42.994951 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 497/998] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:42.999609 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f9a73-7a7d-4371-9cb2-0d368cff90c1 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:42.999847 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f9a73-7a7d-4371-9cb2-0d368cff90c1 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:43.000121 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f9a73-7a7d-4371-9cb2-0d368cff90c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:43.007605 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007de5d-d9a1-4b39-af38-5a6530b2da74 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:43.019494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-ee5f9a73-7a7d-4371-9cb2-0d368cff90c1 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:43.021265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ee5f9a73-7a7d-4371-9cb2-0d368cff90c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:43.025704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:43.044108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1df315-dc17-48b7-846e-7bc8f914dbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:43.044734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1df315-dc17-48b7-846e-7bc8f914dbb0 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:43.045019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1df315-dc17-48b7-846e-7bc8f914dbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:43.045294 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1df315-dc17-48b7-846e-7bc8f914dbb0 None admin] PATH_INFO: `/v3/services/image` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:43.045878 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1df315-dc17-48b7-846e-7bc8f914dbb0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:43.047265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1df315-dc17-48b7-846e-7bc8f914dbb0 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:43.056971 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-ee1df315-dc17-48b7-846e-7bc8f914dbb0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 20:39:43.056971 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:43.056971 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:39:43.056971 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:39:43.056971 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:39:43.056971 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:39:43.056971 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:39:43.056971 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:43.056971 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 20:39:43.056971 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:43.056971 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:39:43.056971 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:43.056971 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:43.056971 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:43.056971 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:43.056971 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:43.056971 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:43.058176 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:43.058176 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:43.058176 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:43.058176 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:43.058176 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:43.058176 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:43.058176 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:39:43.058176 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:39:43.058176 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:39:43.058176 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:39:43.058176 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:43.058176 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:43.058176 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:43.058176 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:43.058176 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:43.058176 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:43.059085 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:43.059085 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:43.059085 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:43.059085 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:43.059085 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:43.059085 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:43.059085 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:43.059085 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:43.059085 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:43.059085 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:43.059085 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:39:43.059085 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:43.059085 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 20:39:43.059085 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:43.059085 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 502/999] 10.222.0.33 () {56 vars in 1105 bytes} [Sat Aug 6 20:39:42 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:43.063833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1df315-dc17-48b7-846e-7bc8f914dbb0 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:43.076368 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:43.105810 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 498/1000] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:42 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 20:39:43.130085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f9a73-7a7d-4371-9cb2-0d368cff90c1 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:43.173174 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1df315-dc17-48b7-846e-7bc8f914dbb0 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:43.212200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6741a9-6b5d-4ea3-bda7-c3e930bb5d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:43.213205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6741a9-6b5d-4ea3-bda7-c3e930bb5d90 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:43.213486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6741a9-6b5d-4ea3-bda7-c3e930bb5d90 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:43.213756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6741a9-6b5d-4ea3-bda7-c3e930bb5d90 None admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:43.214755 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6741a9-6b5d-4ea3-bda7-c3e930bb5d90 None admin] RBAC: Adding query filter params (name=image) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:43.215062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6741a9-6b5d-4ea3-bda7-c3e930bb5d90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:43.216730 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6741a9-6b5d-4ea3-bda7-c3e930bb5d90 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:43.227242 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 503/1001] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:43.228237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6741a9-6b5d-4ea3-bda7-c3e930bb5d90 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:43.245555 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f9a73-7a7d-4371-9cb2-0d368cff90c1 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:43.280727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:43.289174 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7544c5-d17b-4777-8189-8335a1cf38b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:43.290092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7544c5-d17b-4777-8189-8335a1cf38b3 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:43.290378 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7544c5-d17b-4777-8189-8335a1cf38b3 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:43.290712 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7544c5-d17b-4777-8189-8335a1cf38b3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:43.291457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7544c5-d17b-4777-8189-8335a1cf38b3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:43.293457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7544c5-d17b-4777-8189-8335a1cf38b3 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:43.304891 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-5d7544c5-d17b-4777-8189-8335a1cf38b3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 20:39:43.304891 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:43.304891 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:39:43.304891 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:39:43.304891 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:39:43.304891 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:39:43.304891 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:39:43.304891 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:43.304891 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 20:39:43.304891 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:43.304891 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:39:43.304891 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:43.304891 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:43.304891 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:43.304891 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:43.304891 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:43.304891 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:43.306527 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:43.306527 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:43.306527 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:43.306527 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:43.306527 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:43.306527 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:43.306527 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:39:43.306527 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:39:43.306527 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:39:43.306527 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:39:43.306527 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:43.306527 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:43.306527 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:43.306527 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:43.306527 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:43.306527 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:43.307526 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:43.307526 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:43.307526 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:43.307526 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:43.307526 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:43.307526 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:43.307526 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:43.307526 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:43.307526 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:43.307526 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:43.307526 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:39:43.307526 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:43.307526 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 20:39:43.307526 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:43.307526 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 499/1002] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:39:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:43.312178 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7544c5-d17b-4777-8189-8335a1cf38b3 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:43.345416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6741a9-6b5d-4ea3-bda7-c3e930bb5d90 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:43.361077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:43.384553 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd0001-edcb-4d8f-a9cd-216263d13240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:43.385158 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd0001-edcb-4d8f-a9cd-216263d13240 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:43.385560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd0001-edcb-4d8f-a9cd-216263d13240 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:43.385840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd0001-edcb-4d8f-a9cd-216263d13240 None admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:43.386476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd0001-edcb-4d8f-a9cd-216263d13240 None admin] RBAC: Adding query filter params (type=image) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:43.386809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd0001-edcb-4d8f-a9cd-216263d13240 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:43.388161 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd0001-edcb-4d8f-a9cd-216263d13240 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:43.393423 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 504/1003] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:43 2022] GET /identity/v3/services?type=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:43.422687 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7544c5-d17b-4777-8189-8335a1cf38b3 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:43.460787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086df43-fa39-41f2-b84e-6586a4f4d09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:43.461415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086df43-fa39-41f2-b84e-6586a4f4d09b None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:43.461693 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086df43-fa39-41f2-b84e-6586a4f4d09b None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:43.461962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086df43-fa39-41f2-b84e-6586a4f4d09b None admin] PATH_INFO: `/v3/services` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:43.462659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086df43-fa39-41f2-b84e-6586a4f4d09b None admin] RBAC: Adding query filter params (name=compute) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:43.462964 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086df43-fa39-41f2-b84e-6586a4f4d09b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:43.464351 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086df43-fa39-41f2-b84e-6586a4f4d09b None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:43.474811 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 500/1004] 10.222.0.33 () {56 vars in 1112 bytes} [Sat Aug 6 20:39:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:43.476462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd0001-edcb-4d8f-a9cd-216263d13240 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:43.590928 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd0001-edcb-4d8f-a9cd-216263d13240 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:43.601721 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:43.625886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375c19a-bf3c-415a-870e-0af9072f5949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:43.626501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375c19a-bf3c-415a-870e-0af9072f5949 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:43.626801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375c19a-bf3c-415a-870e-0af9072f5949 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:43.627073 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375c19a-bf3c-415a-870e-0af9072f5949 None admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:43.627701 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375c19a-bf3c-415a-870e-0af9072f5949 None admin] RBAC: Adding query filter params (type=compute) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:43.628003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375c19a-bf3c-415a-870e-0af9072f5949 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:43.630014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375c19a-bf3c-415a-870e-0af9072f5949 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:43.635055 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 505/1005] 10.222.0.33 () {56 vars in 1112 bytes} [Sat Aug 6 20:39:43 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:43.646573 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086df43-fa39-41f2-b84e-6586a4f4d09b None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:43.751144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086df43-fa39-41f2-b84e-6586a4f4d09b None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:43.759042 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:43.788001 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2e216-81a9-4d7a-9352-415009c76a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:43.788623 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2e216-81a9-4d7a-9352-415009c76a76 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:43.788882 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2e216-81a9-4d7a-9352-415009c76a76 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:43.789159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2e216-81a9-4d7a-9352-415009c76a76 None admin] PATH_INFO: `/v3/endpoints` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:43.789925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2e216-81a9-4d7a-9352-415009c76a76 None admin] RBAC: Adding query filter params (interface=public, service_id=f04af00539f34d14a22c273b3f00d2f1, region_id=RegionOne) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:43.790244 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2e216-81a9-4d7a-9352-415009c76a76 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:43.791645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2e216-81a9-4d7a-9352-415009c76a76 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:43.796911 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 501/1006] 10.222.0.33 () {56 vars in 1251 bytes} [Sat Aug 6 20:39:43 2022] GET /identity/v3/endpoints?service_id=f04af00539f34d14a22c273b3f00d2f1&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:43.802288 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375c19a-bf3c-415a-870e-0af9072f5949 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:43.908777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375c19a-bf3c-415a-870e-0af9072f5949 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:43.945046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492ba01-38a9-4b41-aed8-7dce24823c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:43.945700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492ba01-38a9-4b41-aed8-7dce24823c70 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:43.945983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492ba01-38a9-4b41-aed8-7dce24823c70 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:43.946256 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492ba01-38a9-4b41-aed8-7dce24823c70 None admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:43.946885 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492ba01-38a9-4b41-aed8-7dce24823c70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:43.948250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492ba01-38a9-4b41-aed8-7dce24823c70 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:43.954704 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 506/1007] 10.222.0.33 () {56 vars in 1087 bytes} [Sat Aug 6 20:39:43 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:39:44.706838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079431b9-756f-4f5a-ab7e-5e34cbba5217 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:44.707177 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079431b9-756f-4f5a-ab7e-5e34cbba5217 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:44.707425 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079431b9-756f-4f5a-ab7e-5e34cbba5217 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:44.709003 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 502/1008] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:44.713998 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04b5eb-be68-437e-8076-cd5ed98c8bf9 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:44.714295 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04b5eb-be68-437e-8076-cd5ed98c8bf9 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:44.714589 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04b5eb-be68-437e-8076-cd5ed98c8bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:44.732541 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-5c04b5eb-be68-437e-8076-cd5ed98c8bf9 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:44.733712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5c04b5eb-be68-437e-8076-cd5ed98c8bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:44.765931 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:44.804713 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 507/1009] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:44 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:39:44.829055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079431b9-756f-4f5a-ab7e-5e34cbba5217 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:44.930271 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079431b9-756f-4f5a-ab7e-5e34cbba5217 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:44.963363 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc35d33-6f97-47bd-97f8-21f4d2ece54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:44.963985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc35d33-6f97-47bd-97f8-21f4d2ece54d None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:44.964263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc35d33-6f97-47bd-97f8-21f4d2ece54d None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:44.964534 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc35d33-6f97-47bd-97f8-21f4d2ece54d None admin] PATH_INFO: `/v3/domains/default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:44.965645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc35d33-6f97-47bd-97f8-21f4d2ece54d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:44.967110 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc35d33-6f97-47bd-97f8-21f4d2ece54d None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:44.968875 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 503/1010] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:44.974954 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c04b5eb-be68-437e-8076-cd5ed98c8bf9 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:45.075651 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c04b5eb-be68-437e-8076-cd5ed98c8bf9 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:45.117719 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3d3c0-4425-4dfe-9558-00044640d223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:45.118348 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3d3c0-4425-4dfe-9558-00044640d223 None admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:45.118659 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3d3c0-4425-4dfe-9558-00044640d223 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:45.118934 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3d3c0-4425-4dfe-9558-00044640d223 None admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:45.119601 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3d3c0-4425-4dfe-9558-00044640d223 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:45.121060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3d3c0-4425-4dfe-9558-00044640d223 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:45.149790 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 508/1011] 10.222.0.33 () {60 vars in 1141 bytes} [Sat Aug 6 20:39:44 2022] POST /identity/v3/projects => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:39:45.673407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed469fda-e7df-4502-8701-f8a2b26ad381 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:45.673700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed469fda-e7df-4502-8701-f8a2b26ad381 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:45.673980 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed469fda-e7df-4502-8701-f8a2b26ad381 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:45.675561 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 504/1012] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:45.681021 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d4aba-e475-41fe-af78-c58ff5730bb0 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:45.681313 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d4aba-e475-41fe-af78-c58ff5730bb0 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:45.681589 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d4aba-e475-41fe-af78-c58ff5730bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:45.700942 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-002d4aba-e475-41fe-af78-c58ff5730bb0 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:45.702165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-002d4aba-e475-41fe-af78-c58ff5730bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:45.717603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:45.776639 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 509/1013] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:45 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:39:45.800549 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed469fda-e7df-4502-8701-f8a2b26ad381 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:45.845533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:45.911912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed469fda-e7df-4502-8701-f8a2b26ad381 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:45.948832 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0fb0c7-5cfc-4a26-ba2c-3067177013dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:45.949351 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0fb0c7-5cfc-4a26-ba2c-3067177013dd None admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:45.949624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0fb0c7-5cfc-4a26-ba2c-3067177013dd None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:45.949885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0fb0c7-5cfc-4a26-ba2c-3067177013dd None admin] PATH_INFO: `/v3/services` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:45.950520 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0fb0c7-5cfc-4a26-ba2c-3067177013dd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:45.951899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0fb0c7-5cfc-4a26-ba2c-3067177013dd None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:45.974010 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 505/1014] 10.222.0.33 () {60 vars in 1141 bytes} [Sat Aug 6 20:39:45 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:39:46.280082 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c48e08-4839-4ec7-84fe-f5e25610c775 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:46.280628 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c48e08-4839-4ec7-84fe-f5e25610c775 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:46.280711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c48e08-4839-4ec7-84fe-f5e25610c775 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:46.282225 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 510/1015] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:46.287393 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e52e9b-c9a4-423c-ab0f-151546864357 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:46.287682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e52e9b-c9a4-423c-ab0f-151546864357 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:46.287957 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e52e9b-c9a4-423c-ab0f-151546864357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:46.307324 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d6e52e9b-c9a4-423c-ab0f-151546864357 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:46.308514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d6e52e9b-c9a4-423c-ab0f-151546864357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:46.387016 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 506/1016] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:46 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:39:46.411801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c48e08-4839-4ec7-84fe-f5e25610c775 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:46.521543 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c48e08-4839-4ec7-84fe-f5e25610c775 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:46.558787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f6f29-3737-496c-acb0-ac9de1eaa9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:46.559339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f6f29-3737-496c-acb0-ac9de1eaa9d1 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:46.559617 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f6f29-3737-496c-acb0-ac9de1eaa9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:46.559888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f6f29-3737-496c-acb0-ac9de1eaa9d1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:46.560468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0f6f29-3737-496c-acb0-ac9de1eaa9d1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:46.561886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0f6f29-3737-496c-acb0-ac9de1eaa9d1 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:46.570880 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-6a0f6f29-3737-496c-acb0-ac9de1eaa9d1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 20:39:46.570880 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:46.570880 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:39:46.570880 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:39:46.570880 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:39:46.570880 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:39:46.570880 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:39:46.570880 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:46.570880 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 20:39:46.570880 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:46.570880 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:39:46.570880 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:46.570880 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:46.570880 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:46.570880 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:46.570880 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:46.570880 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:46.571852 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:46.571852 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:46.571852 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:46.571852 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:46.571852 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:46.571852 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:46.571852 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:39:46.571852 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:39:46.571852 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:39:46.571852 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:39:46.571852 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:46.571852 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:46.571852 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:46.571852 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:46.571852 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:46.571852 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:46.572779 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:46.572779 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:46.572779 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:46.572779 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:46.572779 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:46.572779 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:46.572779 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:46.572779 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:46.572779 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:46.572779 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:46.572779 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:39:46.572779 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:46.572779 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 20:39:46.572779 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:46.572779 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 511/1017] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:39:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:46.578174 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e52e9b-c9a4-423c-ab0f-151546864357 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:46.603052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:46.691185 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e52e9b-c9a4-423c-ab0f-151546864357 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:46.726187 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ee970-b2ff-4ce5-972f-b197f83be094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:46.726843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ee970-b2ff-4ce5-972f-b197f83be094 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:46.727315 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ee970-b2ff-4ce5-972f-b197f83be094 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:46.727596 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ee970-b2ff-4ce5-972f-b197f83be094 None admin] PATH_INFO: `/v3/services` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:46.728234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ee970-b2ff-4ce5-972f-b197f83be094 None admin] RBAC: Adding query filter params (name=compute) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:46.728538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ee970-b2ff-4ce5-972f-b197f83be094 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:46.729907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ee970-b2ff-4ce5-972f-b197f83be094 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:46.735106 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 507/1018] 10.222.0.33 () {56 vars in 1112 bytes} [Sat Aug 6 20:39:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:46.741425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f6f29-3737-496c-acb0-ac9de1eaa9d1 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:46.758870 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:46.846650 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f6f29-3737-496c-acb0-ac9de1eaa9d1 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:46.881485 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541a316-ed0d-4809-9178-328b6b723dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:46.882063 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541a316-ed0d-4809-9178-328b6b723dc6 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:46.883669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541a316-ed0d-4809-9178-328b6b723dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:46.883952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541a316-ed0d-4809-9178-328b6b723dc6 None admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:46.884585 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541a316-ed0d-4809-9178-328b6b723dc6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:46.884947 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541a316-ed0d-4809-9178-328b6b723dc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:46.886313 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541a316-ed0d-4809-9178-328b6b723dc6 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:46.896820 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 512/1019] 10.222.0.33 () {56 vars in 1112 bytes} [Sat Aug 6 20:39:46 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:46.897831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ee970-b2ff-4ce5-972f-b197f83be094 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:46.990158 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:47.003022 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ee970-b2ff-4ce5-972f-b197f83be094 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:47.036761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3893094-8c5e-456e-96ec-531c1815a124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:47.037364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3893094-8c5e-456e-96ec-531c1815a124 None admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:47.037638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3893094-8c5e-456e-96ec-531c1815a124 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:47.037905 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3893094-8c5e-456e-96ec-531c1815a124 None admin] PATH_INFO: `/v3/endpoints` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:47.038566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3893094-8c5e-456e-96ec-531c1815a124 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:47.039929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3893094-8c5e-456e-96ec-531c1815a124 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:47.059885 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 508/1020] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:39:46 2022] POST /identity/v3/endpoints => generated 334 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:39:47.453218 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04730c86-2acd-48fd-bb48-c13dc110c883 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:47.453762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04730c86-2acd-48fd-bb48-c13dc110c883 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:47.453762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04730c86-2acd-48fd-bb48-c13dc110c883 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:47.455162 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 513/1021] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:47.460654 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd14012-ca00-437b-aac7-94306d18bd81 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:47.460931 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd14012-ca00-437b-aac7-94306d18bd81 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:47.461210 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd14012-ca00-437b-aac7-94306d18bd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:47.479566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-efd14012-ca00-437b-aac7-94306d18bd81 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:47.480753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-efd14012-ca00-437b-aac7-94306d18bd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:47.560317 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 509/1022] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:39:47.586453 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04730c86-2acd-48fd-bb48-c13dc110c883 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:47.671932 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:47.700624 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04730c86-2acd-48fd-bb48-c13dc110c883 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:47.735596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187f19f-30a6-4b13-a65f-81015cdb71e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:47.736204 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187f19f-30a6-4b13-a65f-81015cdb71e2 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:47.736476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187f19f-30a6-4b13-a65f-81015cdb71e2 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:47.736740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187f19f-30a6-4b13-a65f-81015cdb71e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:47.737833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2187f19f-30a6-4b13-a65f-81015cdb71e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:47.739807 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2187f19f-30a6-4b13-a65f-81015cdb71e2 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:47.741666 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 514/1023] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:47.747091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd14012-ca00-437b-aac7-94306d18bd81 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:47.817513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:47.851629 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd14012-ca00-437b-aac7-94306d18bd81 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:47.891805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63fbb9-267c-4498-8366-78ec83d8b0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:47.892420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63fbb9-267c-4498-8366-78ec83d8b0cd None admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:47.892697 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63fbb9-267c-4498-8366-78ec83d8b0cd None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:47.892967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63fbb9-267c-4498-8366-78ec83d8b0cd None admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:47.893622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63fbb9-267c-4498-8366-78ec83d8b0cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:47.895808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63fbb9-267c-4498-8366-78ec83d8b0cd None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:47.918422 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 510/1024] 10.222.0.33 () {60 vars in 1132 bytes} [Sat Aug 6 20:39:47 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:39:48.323621 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d123a-55ac-44f0-ae6a-572a1bc0a1f3 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:48.324063 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d123a-55ac-44f0-ae6a-572a1bc0a1f3 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:48.324209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d123a-55ac-44f0-ae6a-572a1bc0a1f3 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:48.325523 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 515/1025] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:48.332716 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286860e3-71e7-48cd-a4fc-a512e4bd17ed None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:48.333060 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286860e3-71e7-48cd-a4fc-a512e4bd17ed None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:48.333317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286860e3-71e7-48cd-a4fc-a512e4bd17ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:48.351305 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-286860e3-71e7-48cd-a4fc-a512e4bd17ed None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:48.352472 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-286860e3-71e7-48cd-a4fc-a512e4bd17ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:48.423770 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 511/1026] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:48 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:39:48.448783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d123a-55ac-44f0-ae6a-572a1bc0a1f3 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:48.555269 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d123a-55ac-44f0-ae6a-572a1bc0a1f3 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:48.590018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06ab8b-aa1e-4b59-8b99-b02f386956b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:48.590583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06ab8b-aa1e-4b59-8b99-b02f386956b3 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:48.590860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06ab8b-aa1e-4b59-8b99-b02f386956b3 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:48.591125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06ab8b-aa1e-4b59-8b99-b02f386956b3 None admin] PATH_INFO: `/v3/services/image` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:48.591687 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a06ab8b-aa1e-4b59-8b99-b02f386956b3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:48.593030 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a06ab8b-aa1e-4b59-8b99-b02f386956b3 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:48.601608 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-7a06ab8b-aa1e-4b59-8b99-b02f386956b3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 20:39:48.601608 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:48.601608 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:39:48.601608 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:39:48.601608 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:39:48.601608 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:39:48.601608 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:39:48.601608 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:48.601608 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 20:39:48.601608 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:48.601608 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:39:48.601608 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:48.601608 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:48.601608 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:48.601608 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:48.601608 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:48.601608 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:48.602623 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:48.602623 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:48.602623 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:48.602623 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:48.602623 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:48.602623 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:48.602623 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:39:48.602623 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:39:48.602623 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:39:48.602623 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:39:48.602623 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:48.602623 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:48.602623 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:48.602623 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:48.602623 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:48.602623 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:48.603499 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:48.603499 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:48.603499 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:48.603499 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:48.603499 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:48.603499 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:48.603499 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:48.603499 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:48.603499 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:48.603499 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:48.603499 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:39:48.603499 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:48.603499 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 20:39:48.603499 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:48.604903 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 516/1027] 10.222.0.33 () {56 vars in 1105 bytes} [Sat Aug 6 20:39:48 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:48.608743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286860e3-71e7-48cd-a4fc-a512e4bd17ed None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:48.673476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:48.720670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286860e3-71e7-48cd-a4fc-a512e4bd17ed None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:48.755646 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaba1aa-cb83-4ddb-8ecb-7c9bf70841a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:48.756264 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaba1aa-cb83-4ddb-8ecb-7c9bf70841a3 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:48.756545 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaba1aa-cb83-4ddb-8ecb-7c9bf70841a3 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:48.756814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaba1aa-cb83-4ddb-8ecb-7c9bf70841a3 None admin] PATH_INFO: `/v3/services` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:48.757447 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaba1aa-cb83-4ddb-8ecb-7c9bf70841a3 None admin] RBAC: Adding query filter params (name=image) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:48.757826 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaba1aa-cb83-4ddb-8ecb-7c9bf70841a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:48.759353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaba1aa-cb83-4ddb-8ecb-7c9bf70841a3 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:48.764559 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 512/1028] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:48.770649 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06ab8b-aa1e-4b59-8b99-b02f386956b3 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:48.783898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:48.871551 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06ab8b-aa1e-4b59-8b99-b02f386956b3 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:48.906216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f3f53-5c9c-4892-8565-3104d49b79c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:48.906857 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f3f53-5c9c-4892-8565-3104d49b79c3 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:48.907139 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f3f53-5c9c-4892-8565-3104d49b79c3 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:48.907410 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f3f53-5c9c-4892-8565-3104d49b79c3 None admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:48.908037 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f3f53-5c9c-4892-8565-3104d49b79c3 None admin] RBAC: Adding query filter params (type=image) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:48.908340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f3f53-5c9c-4892-8565-3104d49b79c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:48.909685 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f3f53-5c9c-4892-8565-3104d49b79c3 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:48.919622 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 517/1029] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:48.920781 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaba1aa-cb83-4ddb-8ecb-7c9bf70841a3 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:49.022478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaba1aa-cb83-4ddb-8ecb-7c9bf70841a3 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:49.042518 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:49.057882 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffb707-edbf-49c9-b19b-7a59f45cfece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:49.058494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffb707-edbf-49c9-b19b-7a59f45cfece None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:49.058802 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffb707-edbf-49c9-b19b-7a59f45cfece None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:49.059074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffb707-edbf-49c9-b19b-7a59f45cfece None admin] PATH_INFO: `/v3/endpoints` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:49.059772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ffb707-edbf-49c9-b19b-7a59f45cfece None admin] RBAC: Adding query filter params (interface=public, service_id=3d876c38fa494f68acffd372b8726102, region_id=RegionOne) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:49.060081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ffb707-edbf-49c9-b19b-7a59f45cfece None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:49.061450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ffb707-edbf-49c9-b19b-7a59f45cfece None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:49.071736 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 513/1030] 10.222.0.33 () {56 vars in 1251 bytes} [Sat Aug 6 20:39:48 2022] GET /identity/v3/endpoints?service_id=3d876c38fa494f68acffd372b8726102&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:49.072902 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f3f53-5c9c-4892-8565-3104d49b79c3 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:49.152230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:49.179348 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f3f53-5c9c-4892-8565-3104d49b79c3 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:49.213858 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51cebee-5006-40e4-8934-2e419fe77ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:49.214466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cebee-5006-40e4-8934-2e419fe77ed8 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:49.214775 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cebee-5006-40e4-8934-2e419fe77ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:49.215051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cebee-5006-40e4-8934-2e419fe77ed8 None admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:49.215660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51cebee-5006-40e4-8934-2e419fe77ed8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:49.217021 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51cebee-5006-40e4-8934-2e419fe77ed8 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:49.224438 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 518/1031] 10.222.0.33 () {56 vars in 1087 bytes} [Sat Aug 6 20:39:49 2022] GET /identity/v3/services => generated 1957 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:39:49.423700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64dd69e-2331-4a33-b645-71732b4fe707 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:49.423905 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64dd69e-2331-4a33-b645-71732b4fe707 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:49.424182 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64dd69e-2331-4a33-b645-71732b4fe707 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:49.426270 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 514/1032] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:49.431693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b1509-61a6-4d7d-b129-e5adff51ed85 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:49.431970 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b1509-61a6-4d7d-b129-e5adff51ed85 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:49.432240 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b1509-61a6-4d7d-b129-e5adff51ed85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:49.451539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-e45b1509-61a6-4d7d-b129-e5adff51ed85 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:49.452700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e45b1509-61a6-4d7d-b129-e5adff51ed85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:49.519908 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 519/1033] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:49 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 20:39:49.544566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64dd69e-2331-4a33-b645-71732b4fe707 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:49.646388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64dd69e-2331-4a33-b645-71732b4fe707 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:49.689011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b2791-40be-4a01-89cc-d76ee6dcc7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:49.689563 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b2791-40be-4a01-89cc-d76ee6dcc7e4 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:49.689839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b2791-40be-4a01-89cc-d76ee6dcc7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:49.690106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b2791-40be-4a01-89cc-d76ee6dcc7e4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:49.700856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b2791-40be-4a01-89cc-d76ee6dcc7e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:39:49.705577 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-753b2791-40be-4a01-89cc-d76ee6dcc7e4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 20:39:49.705577 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:49.705577 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:49.705577 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:49.705577 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:49.705577 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:49.705577 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:49.705577 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:49.705577 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:49.705577 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:49.705577 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:49.705577 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:49.705577 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:39:49.705577 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:39:49.705577 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:39:49.705577 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:39:49.706498 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:39:49.706498 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:39:49.706498 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:39:49.706498 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:39:49.706498 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:49.706498 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:49.706498 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:49.706498 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:49.706498 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:49.706498 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:49.706498 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:49.706498 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:49.706498 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:49.706498 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:49.706498 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:49.706498 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:49.707674 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:49.707674 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:49.707674 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:49.707674 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:49.707674 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:39:49.707674 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:39:49.707674 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:39:49.707674 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:39:49.707674 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:39:49.707674 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:39:49.707674 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 20:39:49.707674 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:49.708758 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 515/1034] 10.222.0.33 () {56 vars in 1120 bytes} [Sat Aug 6 20:39:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:49.713001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b1509-61a6-4d7d-b129-e5adff51ed85 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:49.783439 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:49.818722 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b1509-61a6-4d7d-b129-e5adff51ed85 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:49.854043 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5d70f-036a-4cb3-bf52-dcd24ffaf820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:49.854677 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5d70f-036a-4cb3-bf52-dcd24ffaf820 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:49.854957 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5d70f-036a-4cb3-bf52-dcd24ffaf820 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:49.855229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5d70f-036a-4cb3-bf52-dcd24ffaf820 None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:49.855890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5d70f-036a-4cb3-bf52-dcd24ffaf820 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:49.856193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5d70f-036a-4cb3-bf52-dcd24ffaf820 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:49.857541 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5d70f-036a-4cb3-bf52-dcd24ffaf820 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:49.870165 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 520/1035] 10.222.0.33 () {56 vars in 1115 bytes} [Sat Aug 6 20:39:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:49.871333 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b2791-40be-4a01-89cc-d76ee6dcc7e4 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:49.918025 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:49.974853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b2791-40be-4a01-89cc-d76ee6dcc7e4 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:50.011214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d41698-eacb-4b14-a709-3375fcf721e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:50.012161 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d41698-eacb-4b14-a709-3375fcf721e8 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:50.012619 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d41698-eacb-4b14-a709-3375fcf721e8 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:50.013068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d41698-eacb-4b14-a709-3375fcf721e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:50.024020 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d41698-eacb-4b14-a709-3375fcf721e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:50.025768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d41698-eacb-4b14-a709-3375fcf721e8 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:50.040939 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-72d41698-eacb-4b14-a709-3375fcf721e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:50.040939 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:50.040939 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:50.040939 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:50.040939 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:50.040939 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:50.040939 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:50.040939 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:50.040939 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:50.040939 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:50.040939 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:50.040939 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:50.040939 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:39:50.040939 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:39:50.040939 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:39:50.040939 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:39:50.041962 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:50.041962 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:50.041962 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:50.041962 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:50.041962 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:50.041962 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:50.041962 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:50.041962 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:50.041962 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:50.041962 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:50.041962 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:50.041962 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:50.041962 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:50.041962 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:50.041962 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:50.041962 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:50.041962 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:39:50.042928 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:39:50.042928 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:50.042928 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:50.044005 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 516/1036] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:39:50.049397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5d70f-036a-4cb3-bf52-dcd24ffaf820 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:50.157453 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5d70f-036a-4cb3-bf52-dcd24ffaf820 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:50.186781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:50.194174 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f842ef-6ee4-49e4-a3e8-f309ca66dcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:50.194800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f842ef-6ee4-49e4-a3e8-f309ca66dcdc None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:50.195077 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f842ef-6ee4-49e4-a3e8-f309ca66dcdc None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:50.195344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f842ef-6ee4-49e4-a3e8-f309ca66dcdc None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:50.195974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f842ef-6ee4-49e4-a3e8-f309ca66dcdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:50.196271 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f842ef-6ee4-49e4-a3e8-f309ca66dcdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:50.197619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f842ef-6ee4-49e4-a3e8-f309ca66dcdc None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:50.210417 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 521/1037] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:50.215768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d41698-eacb-4b14-a709-3375fcf721e8 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:50.262322 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2c618-e840-4dfa-95f4-549e6a955e7c None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:50.262511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2c618-e840-4dfa-95f4-549e6a955e7c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:50.262826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2c618-e840-4dfa-95f4-549e6a955e7c None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:50.264357 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 522/1038] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:39:50.270603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4e0c0-aeab-4365-8eb4-2dc3d03a0f4c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:50.270922 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4e0c0-aeab-4365-8eb4-2dc3d03a0f4c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:50.271572 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4e0c0-aeab-4365-8eb4-2dc3d03a0f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:50.290919 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-acc4e0c0-aeab-4365-8eb4-2dc3d03a0f4c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:50.292114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-acc4e0c0-aeab-4365-8eb4-2dc3d03a0f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:50.319520 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:50.326675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d41698-eacb-4b14-a709-3375fcf721e8 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:50.364119 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d9b50-97d4-4373-8fad-147585f12736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:50.364748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d9b50-97d4-4373-8fad-147585f12736 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:50.365030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d9b50-97d4-4373-8fad-147585f12736 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:50.365297 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d9b50-97d4-4373-8fad-147585f12736 None admin] PATH_INFO: `/v3/users/nova` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:50.366582 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 523/1039] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:50 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 20:39:50.374704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15d9b50-97d4-4373-8fad-147585f12736 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:50.376314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15d9b50-97d4-4373-8fad-147585f12736 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:50.388465 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-c15d9b50-97d4-4373-8fad-147585f12736 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:39:50.388465 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:50.388465 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:50.388465 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:50.388465 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:50.388465 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:50.388465 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:50.388465 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:50.388465 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:50.388465 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:50.388465 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:50.388465 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:50.388465 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:39:50.388465 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:39:50.388465 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:39:50.388465 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:39:50.389628 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:50.389628 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:50.389628 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:39:50.389628 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:50.389628 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:39:50.389628 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:50.389628 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:50.389628 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:50.389628 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:50.389628 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:50.389628 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:50.389628 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:50.389628 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:50.389628 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:50.389628 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:50.389628 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:50.389628 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:50.389628 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:50.390814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:50.390814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:50.390814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:39:50.390814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:39:50.390814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:39:50.390814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:39:50.390814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:39:50.390814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:39:50.390814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:39:50.390814 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:50.392073 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 517/1040] 10.222.0.33 () {56 vars in 1093 bytes} [Sat Aug 6 20:39:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:50.392670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4e0c0-aeab-4365-8eb4-2dc3d03a0f4c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:50.399413 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d9b50-97d4-4373-8fad-147585f12736 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:50.501814 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4e0c0-aeab-4365-8eb4-2dc3d03a0f4c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:50.508608 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d9b50-97d4-4373-8fad-147585f12736 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:50.524248 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:50.541027 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f0364-f053-48af-83ac-df409869899e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:50.541653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f0364-f053-48af-83ac-df409869899e None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:50.541930 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f0364-f053-48af-83ac-df409869899e None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:50.542195 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f0364-f053-48af-83ac-df409869899e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:50.544887 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe045a-3391-496d-9098-a4f832de5b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:50.545494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe045a-3391-496d-9098-a4f832de5b77 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:50.545771 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe045a-3391-496d-9098-a4f832de5b77 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:50.546043 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe045a-3391-496d-9098-a4f832de5b77 None admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:50.546793 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe045a-3391-496d-9098-a4f832de5b77 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:50.547105 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe045a-3391-496d-9098-a4f832de5b77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:50.548523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe045a-3391-496d-9098-a4f832de5b77 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:50.554956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f0364-f053-48af-83ac-df409869899e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:39:50.559978 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-456f0364-f053-48af-83ac-df409869899e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:39:50.559978 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:50.559978 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:50.559978 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:50.559978 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:50.559978 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:50.559978 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:50.559978 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:50.559978 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:50.559978 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:50.559978 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:50.559978 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:50.559978 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:39:50.559978 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:39:50.559978 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:39:50.559978 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:39:50.560923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:39:50.560923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:39:50.560923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:39:50.560923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:39:50.560923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:50.560923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:50.560923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:50.560923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:50.560923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:50.560923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:50.560923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:50.560923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:50.560923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:50.560923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:50.560923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:50.560923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:50.561861 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:50.561861 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:50.561861 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:50.561861 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:50.561861 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:39:50.561861 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:39:50.561861 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:39:50.561861 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:39:50.561861 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:39:50.561861 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:39:50.561861 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:39:50.561861 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:50.566794 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 524/1041] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Aug 6 20:39:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:50.567961 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 518/1042] 10.222.0.33 () {56 vars in 1133 bytes} [Sat Aug 6 20:39:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:50.570895 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f0364-f053-48af-83ac-df409869899e None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:50.573499 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe045a-3391-496d-9098-a4f832de5b77 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:50.588956 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:50.684757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f0364-f053-48af-83ac-df409869899e None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:50.685528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe045a-3391-496d-9098-a4f832de5b77 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:50.720050 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c50a7a-c9dc-45a5-ab75-b6cb1a58158e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:50.720650 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c50a7a-c9dc-45a5-ab75-b6cb1a58158e None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:50.720920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c50a7a-c9dc-45a5-ab75-b6cb1a58158e None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:50.721186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c50a7a-c9dc-45a5-ab75-b6cb1a58158e None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:50.721837 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c50a7a-c9dc-45a5-ab75-b6cb1a58158e None admin] RBAC: Adding query filter params (name=admin) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:50.722136 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c50a7a-c9dc-45a5-ab75-b6cb1a58158e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:50.723154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e8962-0ec1-4eba-806d-63fa4fc48a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:50.723560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c50a7a-c9dc-45a5-ab75-b6cb1a58158e None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:50.723752 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e8962-0ec1-4eba-806d-63fa4fc48a71 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:50.724029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e8962-0ec1-4eba-806d-63fa4fc48a71 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:50.724299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e8962-0ec1-4eba-806d-63fa4fc48a71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:50.732086 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 525/1043] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:39:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:50.737575 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c50a7a-c9dc-45a5-ab75-b6cb1a58158e None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:50.781443 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:50.798209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e8962-0ec1-4eba-806d-63fa4fc48a71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:50.800110 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e8962-0ec1-4eba-806d-63fa4fc48a71 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:50.819309 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:50.842746 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c50a7a-c9dc-45a5-ab75-b6cb1a58158e None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:50.879591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a613a22-ec4d-4626-99fe-f737cf98b6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:50.880321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a613a22-ec4d-4626-99fe-f737cf98b6d5 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:50.880608 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a613a22-ec4d-4626-99fe-f737cf98b6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:50.880887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a613a22-ec4d-4626-99fe-f737cf98b6d5 None admin] PATH_INFO: `/v3/users/bcd78fc9e134407bb8448ceb53c069df` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:50.895704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a613a22-ec4d-4626-99fe-f737cf98b6d5 None admin] RBAC: Authorizing `identity:get_user(user_id=bcd78fc9e134407bb8448ceb53c069df)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:50.897141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a613a22-ec4d-4626-99fe-f737cf98b6d5 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:50.898821 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 526/1044] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:39:50 2022] GET /identity/v3/users/bcd78fc9e134407bb8448ceb53c069df => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:50.905186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a613a22-ec4d-4626-99fe-f737cf98b6d5 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:50.915916 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 519/1045] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:39:50 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 06 20:39:50.921174 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e8962-0ec1-4eba-806d-63fa4fc48a71 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:51.012591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:51.015548 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a613a22-ec4d-4626-99fe-f737cf98b6d5 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:51.028032 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e8962-0ec1-4eba-806d-63fa4fc48a71 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:51.044421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:51.054078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdaf892-4df7-471f-b43a-ea0bac38569b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:51.054718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaf892-4df7-471f-b43a-ea0bac38569b None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:51.054999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaf892-4df7-471f-b43a-ea0bac38569b None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:51.055533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaf892-4df7-471f-b43a-ea0bac38569b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:51.068373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109dbc18-3eb0-48d8-99ca-c92911d32d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:51.069115 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109dbc18-3eb0-48d8-99ca-c92911d32d0e None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:51.069310 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109dbc18-3eb0-48d8-99ca-c92911d32d0e None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:51.069530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109dbc18-3eb0-48d8-99ca-c92911d32d0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:51.085094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109dbc18-3eb0-48d8-99ca-c92911d32d0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:51.086530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109dbc18-3eb0-48d8-99ca-c92911d32d0e None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:51.103181 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-109dbc18-3eb0-48d8-99ca-c92911d32d0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:51.103181 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:51.103181 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:51.103181 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:51.103181 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:51.103181 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:51.103181 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:51.103181 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:51.103181 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:51.103181 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:51.103181 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:51.103181 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:51.103181 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:39:51.103181 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:39:51.103181 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:39:51.103181 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:39:51.104313 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:51.104313 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:51.104313 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:51.104313 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:51.104313 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:51.104313 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:51.104313 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:51.104313 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:51.104313 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:51.104313 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:51.104313 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:51.104313 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:51.104313 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:51.104313 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:51.104313 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:51.104313 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:51.104313 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:39:51.105262 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:39:51.105262 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:51.105262 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:51.105262 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 520/1046] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:39:51.110601 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109dbc18-3eb0-48d8-99ca-c92911d32d0e None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:51.133562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdaf892-4df7-471f-b43a-ea0bac38569b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:51.135500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdaf892-4df7-471f-b43a-ea0bac38569b None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:51.220570 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109dbc18-3eb0-48d8-99ca-c92911d32d0e None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:51.241162 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:51.249813 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 527/1047] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:39:50 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 06 20:39:51.256655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdaf892-4df7-471f-b43a-ea0bac38569b None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:51.266271 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b9d57-8498-4be4-a5f6-eccc365ea692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:51.267183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b9d57-8498-4be4-a5f6-eccc365ea692 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:51.267618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b9d57-8498-4be4-a5f6-eccc365ea692 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:51.268142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b9d57-8498-4be4-a5f6-eccc365ea692 None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:51.268916 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b9d57-8498-4be4-a5f6-eccc365ea692 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:51.270131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b9d57-8498-4be4-a5f6-eccc365ea692 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:51.271838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b9d57-8498-4be4-a5f6-eccc365ea692 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:51.284455 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 521/1048] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:51.290210 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b9d57-8498-4be4-a5f6-eccc365ea692 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:51.319598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:51.359771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdaf892-4df7-471f-b43a-ea0bac38569b None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:51.401813 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22783896-bb8c-46fb-83a3-eac518c86c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:51.402027 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b9d57-8498-4be4-a5f6-eccc365ea692 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:51.402461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22783896-bb8c-46fb-83a3-eac518c86c9c None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:51.402786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22783896-bb8c-46fb-83a3-eac518c86c9c None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:51.403060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22783896-bb8c-46fb-83a3-eac518c86c9c None admin] PATH_INFO: `/v3/projects/52f7eab3f1084d94a80d2f5ed906f8e2` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:51.405220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22783896-bb8c-46fb-83a3-eac518c86c9c None admin] RBAC: Authorizing `identity:get_project(project_id=52f7eab3f1084d94a80d2f5ed906f8e2)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:51.406702 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22783896-bb8c-46fb-83a3-eac518c86c9c None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:51.408509 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 528/1049] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:39:51 2022] GET /identity/v3/projects/52f7eab3f1084d94a80d2f5ed906f8e2 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:51.414644 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22783896-bb8c-46fb-83a3-eac518c86c9c None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:51.442102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9c5eb-5bce-4c97-96d2-57410089af34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:51.443084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9c5eb-5bce-4c97-96d2-57410089af34 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:51.443369 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9c5eb-5bce-4c97-96d2-57410089af34 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:51.443962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9c5eb-5bce-4c97-96d2-57410089af34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:51.451169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e9c5eb-5bce-4c97-96d2-57410089af34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:51.452630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e9c5eb-5bce-4c97-96d2-57410089af34 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:51.464043 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-d4e9c5eb-5bce-4c97-96d2-57410089af34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:51.464043 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:51.464043 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:51.464043 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:51.464043 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:51.464043 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:51.464043 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:51.464043 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:51.464043 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:51.464043 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:51.464043 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:51.464043 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:51.464043 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:39:51.464043 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:39:51.464043 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:39:51.464990 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:39:51.464990 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:51.464990 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:51.464990 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:51.464990 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:51.464990 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:51.464990 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:51.464990 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:51.464990 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:51.464990 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:51.464990 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:51.464990 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:51.464990 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:51.464990 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:51.464990 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:51.464990 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:51.464990 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:51.465915 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:39:51.465915 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:39:51.465915 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:39:51.465915 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:39:51.465915 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:39:51.465915 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:39:51.465915 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:51.465915 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:51.465915 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 522/1050] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:39:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:39:51.470948 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9c5eb-5bce-4c97-96d2-57410089af34 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:51.489904 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:51.525682 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22783896-bb8c-46fb-83a3-eac518c86c9c None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:51.559504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:51.562925 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bfbd2d-e5e3-4f8a-be56-40d60a516304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:51.563531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bfbd2d-e5e3-4f8a-be56-40d60a516304 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:51.563807 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bfbd2d-e5e3-4f8a-be56-40d60a516304 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:51.564079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bfbd2d-e5e3-4f8a-be56-40d60a516304 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:51.564796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bfbd2d-e5e3-4f8a-be56-40d60a516304 None admin] RBAC: Adding query filter params (role.id=ab245eea8a714462a00c4546309de9c9, scope.project.id=52f7eab3f1084d94a80d2f5ed906f8e2, user.id=bcd78fc9e134407bb8448ceb53c069df) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:51.565106 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bfbd2d-e5e3-4f8a-be56-40d60a516304 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:51.567169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bfbd2d-e5e3-4f8a-be56-40d60a516304 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:51.572580 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 529/1051] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:39:51 2022] GET /identity/v3/role_assignments?user.id=bcd78fc9e134407bb8448ceb53c069df&scope.project.id=52f7eab3f1084d94a80d2f5ed906f8e2&role.id=ab245eea8a714462a00c4546309de9c9 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:51.575880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7048d3-48a4-49cf-9280-0d0b7ae12e71 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:51.576170 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7048d3-48a4-49cf-9280-0d0b7ae12e71 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:51.576272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9c5eb-5bce-4c97-96d2-57410089af34 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:51.576471 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7048d3-48a4-49cf-9280-0d0b7ae12e71 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:51.578121 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 530/1052] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:51.584020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c163fb-4165-4a7c-80b9-a77601cd71bd None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:51.584388 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c163fb-4165-4a7c-80b9-a77601cd71bd None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:51.584572 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c163fb-4165-4a7c-80b9-a77601cd71bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:51.605002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-57c163fb-4165-4a7c-80b9-a77601cd71bd None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:51.606237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-57c163fb-4165-4a7c-80b9-a77601cd71bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:51.620365 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4164ffc-3147-416d-b2bd-35a9910e66ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:51.620979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4164ffc-3147-416d-b2bd-35a9910e66ad None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:51.621254 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4164ffc-3147-416d-b2bd-35a9910e66ad None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:51.621522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4164ffc-3147-416d-b2bd-35a9910e66ad None admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:51.622213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4164ffc-3147-416d-b2bd-35a9910e66ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:51.622515 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4164ffc-3147-416d-b2bd-35a9910e66ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:51.624276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4164ffc-3147-416d-b2bd-35a9910e66ad None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:51.638354 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 523/1053] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Aug 6 20:39:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:51.644430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4164ffc-3147-416d-b2bd-35a9910e66ad None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:51.694588 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 531/1054] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:51 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 20:39:51.719143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c163fb-4165-4a7c-80b9-a77601cd71bd None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:51.764626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4164ffc-3147-416d-b2bd-35a9910e66ad None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:51.792409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:51.801766 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff4005-03c1-4e47-b2fb-dce225ecbc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:51.802439 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff4005-03c1-4e47-b2fb-dce225ecbc9c None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:51.802763 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff4005-03c1-4e47-b2fb-dce225ecbc9c None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:51.803030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff4005-03c1-4e47-b2fb-dce225ecbc9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:51.803754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff4005-03c1-4e47-b2fb-dce225ecbc9c None admin] RBAC: Adding query filter params (role.id=df403794156d44e7bf81058ba5d5f806, scope.project.id=6c4962342201407a89793c5c9a6a6f36, user.id=5f9d53147a57402f8b9818590bc1fc1f) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:51.804063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff4005-03c1-4e47-b2fb-dce225ecbc9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:51.805756 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff4005-03c1-4e47-b2fb-dce225ecbc9c None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:51.822577 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 524/1055] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:39:51 2022] GET /identity/v3/role_assignments?user.id=5f9d53147a57402f8b9818590bc1fc1f&scope.project.id=6c4962342201407a89793c5c9a6a6f36&role.id=df403794156d44e7bf81058ba5d5f806 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:51.850713 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c163fb-4165-4a7c-80b9-a77601cd71bd None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:51.895862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225beb0-1e17-4cc5-890e-58831ab515c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:51.896585 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225beb0-1e17-4cc5-890e-58831ab515c6 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:51.896869 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225beb0-1e17-4cc5-890e-58831ab515c6 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:51.897141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225beb0-1e17-4cc5-890e-58831ab515c6 None admin] PATH_INFO: `/v3/services/image` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:51.897734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c225beb0-1e17-4cc5-890e-58831ab515c6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:51.899152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c225beb0-1e17-4cc5-890e-58831ab515c6 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:51.908774 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-c225beb0-1e17-4cc5-890e-58831ab515c6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 20:39:51.908774 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:51.908774 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:39:51.908774 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:39:51.908774 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:39:51.908774 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:39:51.908774 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:39:51.908774 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:51.908774 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 20:39:51.908774 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:51.908774 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:39:51.908774 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:51.908774 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:51.908774 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:51.908774 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:51.908774 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:51.908774 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:51.910398 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:51.910398 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:51.910398 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:51.910398 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:51.910398 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:51.910398 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:51.910398 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:39:51.910398 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:39:51.910398 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:39:51.910398 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:39:51.910398 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:51.910398 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:51.910398 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:51.910398 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:51.910398 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:51.910398 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:51.911283 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:51.911283 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:51.911283 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:51.911283 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:51.911283 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:51.911283 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:51.911283 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:51.911283 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:51.911283 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:51.911283 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:51.911283 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:39:51.911283 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:39:51.911283 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 20:39:51.911283 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:51.911283 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 532/1056] 10.222.0.33 () {56 vars in 1105 bytes} [Sat Aug 6 20:39:51 2022] GET /identity/v3/services/image => generated 86 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:39:51.920349 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff4005-03c1-4e47-b2fb-dce225ecbc9c None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:51.937474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:52.040250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff4005-03c1-4e47-b2fb-dce225ecbc9c None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:52.077038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed656e-b839-45d8-b9a3-18bb05470da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:52.077704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed656e-b839-45d8-b9a3-18bb05470da2 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:52.077980 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed656e-b839-45d8-b9a3-18bb05470da2 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:52.078251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed656e-b839-45d8-b9a3-18bb05470da2 None admin] PATH_INFO: `/v3/services` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:52.078958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed656e-b839-45d8-b9a3-18bb05470da2 None admin] RBAC: Adding query filter params (name=image) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:52.079265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed656e-b839-45d8-b9a3-18bb05470da2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:52.080630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed656e-b839-45d8-b9a3-18bb05470da2 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:52.091519 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 525/1057] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:52.092807 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225beb0-1e17-4cc5-890e-58831ab515c6 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:52.200612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225beb0-1e17-4cc5-890e-58831ab515c6 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:52.227450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:52.237343 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0235e2-e2b4-461b-b314-4a1a82313b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:52.238169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0235e2-e2b4-461b-b314-4a1a82313b1a None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:52.238827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0235e2-e2b4-461b-b314-4a1a82313b1a None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:52.239103 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0235e2-e2b4-461b-b314-4a1a82313b1a None admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:52.239733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0235e2-e2b4-461b-b314-4a1a82313b1a None admin] RBAC: Adding query filter params (type=image) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:52.240037 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0235e2-e2b4-461b-b314-4a1a82313b1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:52.241410 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0235e2-e2b4-461b-b314-4a1a82313b1a None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:52.246593 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 533/1058] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:52 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:52.252305 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed656e-b839-45d8-b9a3-18bb05470da2 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:52.342795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:52.370578 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed656e-b839-45d8-b9a3-18bb05470da2 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:52.405010 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9c4ae-714c-4202-87da-1f864b70088b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:52.405612 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9c4ae-714c-4202-87da-1f864b70088b None admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:52.405886 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9c4ae-714c-4202-87da-1f864b70088b None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:52.406153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9c4ae-714c-4202-87da-1f864b70088b None admin] PATH_INFO: `/v3/endpoints` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:52.406832 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d9c4ae-714c-4202-87da-1f864b70088b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:52.408304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d9c4ae-714c-4202-87da-1f864b70088b None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:52.438217 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 526/1059] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:39:52 2022] POST /identity/v3/endpoints => generated 327 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:39:53.824204 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18e17d-7051-4aab-9bd3-580bffb23b44 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:53.824711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18e17d-7051-4aab-9bd3-580bffb23b44 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:53.824823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18e17d-7051-4aab-9bd3-580bffb23b44 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:53.826274 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 534/1060] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:39:53.831329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ff614-6ede-4e37-855a-389f0982dc0c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:53.831810 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ff614-6ede-4e37-855a-389f0982dc0c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:53.832021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ff614-6ede-4e37-855a-389f0982dc0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:53.849794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-ae6ff614-6ede-4e37-855a-389f0982dc0c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:53.850997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ae6ff614-6ede-4e37-855a-389f0982dc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:53.931095 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 527/1061] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:39:53.955083 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18e17d-7051-4aab-9bd3-580bffb23b44 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:54.054866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28661831-1cff-40ef-bcbe-614c4f9ebaa2 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:54.055417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28661831-1cff-40ef-bcbe-614c4f9ebaa2 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:54.055693 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28661831-1cff-40ef-bcbe-614c4f9ebaa2 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:54.057271 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 528/1062] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:54.058845 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18e17d-7051-4aab-9bd3-580bffb23b44 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:54.061852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63d7e3-54fb-434e-bf66-cd5cb806da8d None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:54.062131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63d7e3-54fb-434e-bf66-cd5cb806da8d None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:54.062402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63d7e3-54fb-434e-bf66-cd5cb806da8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:54.080448 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-da63d7e3-54fb-434e-bf66-cd5cb806da8d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:54.082378 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-da63d7e3-54fb-434e-bf66-cd5cb806da8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:54.096158 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f319c5-2188-4a1d-8c9e-5f4de27701c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:54.096790 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f319c5-2188-4a1d-8c9e-5f4de27701c7 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:54.097105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f319c5-2188-4a1d-8c9e-5f4de27701c7 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:54.097385 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f319c5-2188-4a1d-8c9e-5f4de27701c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:54.108092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f319c5-2188-4a1d-8c9e-5f4de27701c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:39:54.113219 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-e3f319c5-2188-4a1d-8c9e-5f4de27701c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:39:54.113219 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:54.113219 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:54.113219 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:54.113219 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:54.113219 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:54.113219 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:54.113219 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:54.113219 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:54.113219 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:54.113219 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:54.113219 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:54.113219 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:39:54.113219 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:39:54.113219 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:39:54.113219 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:39:54.114189 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:39:54.114189 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:39:54.114189 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:39:54.114189 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:39:54.114189 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:54.114189 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:54.114189 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:54.114189 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:54.114189 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:54.114189 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:54.114189 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:54.114189 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:54.114189 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:54.114189 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:54.114189 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:54.114189 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:54.115073 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:54.115073 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:54.115073 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:54.115073 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:54.115073 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:39:54.115073 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:39:54.115073 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:39:54.115073 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:39:54.115073 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:39:54.115073 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:39:54.115073 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:39:54.115073 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:54.115073 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 535/1063] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Aug 6 20:39:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:54.121209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f319c5-2188-4a1d-8c9e-5f4de27701c7 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:54.138987 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:54.165220 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 529/1064] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 20:39:54.178827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:54.184742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63d7e3-54fb-434e-bf66-cd5cb806da8d None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:54.233456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f319c5-2188-4a1d-8c9e-5f4de27701c7 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:54.275626 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0def88-76a8-4922-94b0-7a076e111d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:54.276551 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0def88-76a8-4922-94b0-7a076e111d45 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:54.276840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0def88-76a8-4922-94b0-7a076e111d45 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:54.277099 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0def88-76a8-4922-94b0-7a076e111d45 None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:54.277762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0def88-76a8-4922-94b0-7a076e111d45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:54.278069 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0def88-76a8-4922-94b0-7a076e111d45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:54.279463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0def88-76a8-4922-94b0-7a076e111d45 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:54.289122 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 536/1065] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:39:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:54.294857 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0def88-76a8-4922-94b0-7a076e111d45 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:54.299194 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63d7e3-54fb-434e-bf66-cd5cb806da8d None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:54.336945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb34185-6e74-4832-8f45-c7fef41ddd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:54.337578 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb34185-6e74-4832-8f45-c7fef41ddd60 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:54.337859 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb34185-6e74-4832-8f45-c7fef41ddd60 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:54.338130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb34185-6e74-4832-8f45-c7fef41ddd60 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:54.349135 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb34185-6e74-4832-8f45-c7fef41ddd60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:39:54.353876 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-bcb34185-6e74-4832-8f45-c7fef41ddd60 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 20:39:54.353876 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:54.353876 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:54.353876 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:54.353876 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:54.353876 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:54.353876 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:54.353876 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:54.353876 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:54.353876 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:54.353876 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:54.353876 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:54.353876 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:39:54.353876 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:39:54.353876 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:39:54.353876 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:39:54.355054 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:39:54.355054 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:39:54.355054 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:39:54.355054 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:39:54.355054 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:54.355054 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:54.355054 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:54.355054 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:54.355054 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:54.355054 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:54.355054 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:54.355054 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:54.355054 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:54.355054 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:54.355054 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:54.355054 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:54.355960 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:54.355960 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:54.355960 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:54.355960 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:54.355960 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:39:54.355960 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:39:54.355960 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:39:54.355960 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:39:54.355960 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:39:54.355960 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:39:54.355960 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 20:39:54.355960 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:54.355960 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 530/1066] 10.222.0.33 () {56 vars in 1120 bytes} [Sat Aug 6 20:39:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:39:54.361685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb34185-6e74-4832-8f45-c7fef41ddd60 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:54.413167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:54.415838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0def88-76a8-4922-94b0-7a076e111d45 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:54.430688 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:54.455446 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc8950-3aaa-442c-b69a-79961a0a85d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:54.456004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc8950-3aaa-442c-b69a-79961a0a85d4 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:54.456806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc8950-3aaa-442c-b69a-79961a0a85d4 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:54.457182 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc8950-3aaa-442c-b69a-79961a0a85d4 None admin] PATH_INFO: `/v3/users/bcd78fc9e134407bb8448ceb53c069df` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:54.458428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc8950-3aaa-442c-b69a-79961a0a85d4 None admin] RBAC: Authorizing `identity:get_user(user_id=bcd78fc9e134407bb8448ceb53c069df)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:54.459886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc8950-3aaa-442c-b69a-79961a0a85d4 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:54.461465 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 537/1067] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:39:54 2022] GET /identity/v3/users/bcd78fc9e134407bb8448ceb53c069df => generated 285 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:54.467114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc8950-3aaa-442c-b69a-79961a0a85d4 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:54.475769 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb34185-6e74-4832-8f45-c7fef41ddd60 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:54.513670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e7949-1e26-4968-98fd-aba232083195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:54.514270 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e7949-1e26-4968-98fd-aba232083195 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:54.514578 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e7949-1e26-4968-98fd-aba232083195 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:54.514858 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e7949-1e26-4968-98fd-aba232083195 None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:54.515526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e7949-1e26-4968-98fd-aba232083195 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:54.515820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e7949-1e26-4968-98fd-aba232083195 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:54.517186 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e7949-1e26-4968-98fd-aba232083195 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:54.526821 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 531/1068] 10.222.0.33 () {56 vars in 1115 bytes} [Sat Aug 6 20:39:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:54.532452 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e7949-1e26-4968-98fd-aba232083195 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:54.577982 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc8950-3aaa-442c-b69a-79961a0a85d4 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:54.618264 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac2b87-ab03-4e4b-94ad-f0efe6d63db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:54.618944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac2b87-ab03-4e4b-94ad-f0efe6d63db9 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:54.619224 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac2b87-ab03-4e4b-94ad-f0efe6d63db9 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:54.619496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac2b87-ab03-4e4b-94ad-f0efe6d63db9 None admin] PATH_INFO: `/v3/projects/52f7eab3f1084d94a80d2f5ed906f8e2` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:54.620674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac2b87-ab03-4e4b-94ad-f0efe6d63db9 None admin] RBAC: Authorizing `identity:get_project(project_id=52f7eab3f1084d94a80d2f5ed906f8e2)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:54.622130 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac2b87-ab03-4e4b-94ad-f0efe6d63db9 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:54.624021 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 538/1069] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:39:54 2022] GET /identity/v3/projects/52f7eab3f1084d94a80d2f5ed906f8e2 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:54.630696 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac2b87-ab03-4e4b-94ad-f0efe6d63db9 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:54.694795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:54.755466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac2b87-ab03-4e4b-94ad-f0efe6d63db9 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:54.774887 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e7949-1e26-4968-98fd-aba232083195 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:54.784877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:54.789544 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8d1af-938b-483f-bc1a-a6af8560b991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:54.790201 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8d1af-938b-483f-bc1a-a6af8560b991 None admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:54.790776 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8d1af-938b-483f-bc1a-a6af8560b991 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:54.791054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8d1af-938b-483f-bc1a-a6af8560b991 None admin] PATH_INFO: `/v3/projects/52f7eab3f1084d94a80d2f5ed906f8e2/users/bcd78fc9e134407bb8448ceb53c069df/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:54.792970 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8d1af-938b-483f-bc1a-a6af8560b991 None admin] RBAC: Authorizing `identity:create_grant(project_id=52f7eab3f1084d94a80d2f5ed906f8e2, user_id=bcd78fc9e134407bb8448ceb53c069df, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:54.794391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8d1af-938b-483f-bc1a-a6af8560b991 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:54.807768 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 539/1070] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Aug 6 20:39:54 2022] PUT /identity/v3/projects/52f7eab3f1084d94a80d2f5ed906f8e2/users/bcd78fc9e134407bb8448ceb53c069df/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:39:54.809042 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25db72f-59e2-449e-be5a-799985f84d0a None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:54.809334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25db72f-59e2-449e-be5a-799985f84d0a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:54.809611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25db72f-59e2-449e-be5a-799985f84d0a None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:54.811025 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 540/1071] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:54.812766 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5f267-00c7-45d9-81c5-31a1ed5fc966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:54.813589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5f267-00c7-45d9-81c5-31a1ed5fc966 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:54.814013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5f267-00c7-45d9-81c5-31a1ed5fc966 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:54.814424 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5f267-00c7-45d9-81c5-31a1ed5fc966 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:54.817167 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349053e2-547d-4814-a020-db0ee650e516 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:54.817454 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349053e2-547d-4814-a020-db0ee650e516 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:54.817734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349053e2-547d-4814-a020-db0ee650e516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:54.828122 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e5f267-00c7-45d9-81c5-31a1ed5fc966 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:54.829861 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e5f267-00c7-45d9-81c5-31a1ed5fc966 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:54.837296 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-349053e2-547d-4814-a020-db0ee650e516 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:54.838619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-349053e2-547d-4814-a020-db0ee650e516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:54.849735 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-42e5f267-00c7-45d9-81c5-31a1ed5fc966 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:54.849735 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:54.849735 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:54.849735 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:54.849735 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:54.849735 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:54.849735 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:54.849735 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:54.849735 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:54.849735 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:54.849735 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:54.849735 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:54.849735 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:39:54.849735 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:39:54.849735 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:39:54.849735 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:39:54.851198 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:54.851198 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:54.851198 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:54.851198 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:54.851198 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:54.851198 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:54.851198 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:54.851198 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:54.851198 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:54.851198 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:54.851198 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:54.851198 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:54.851198 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:54.851198 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:54.851198 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:54.851198 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:54.851198 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:39:54.857394 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:39:54.857394 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:54.857394 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:54.857394 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 532/1072] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:39:54.857670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5f267-00c7-45d9-81c5-31a1ed5fc966 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:54.917204 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 541/1073] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:39:54.942444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349053e2-547d-4814-a020-db0ee650e516 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:54.977626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5f267-00c7-45d9-81c5-31a1ed5fc966 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:54.990160 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:55.021669 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72a436-dc9a-4bb1-b611-77a89585245d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:55.022365 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72a436-dc9a-4bb1-b611-77a89585245d None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:55.022705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72a436-dc9a-4bb1-b611-77a89585245d None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:55.022985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72a436-dc9a-4bb1-b611-77a89585245d None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:55.024115 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72a436-dc9a-4bb1-b611-77a89585245d None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:55.024699 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72a436-dc9a-4bb1-b611-77a89585245d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:55.026240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72a436-dc9a-4bb1-b611-77a89585245d None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:55.046404 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 533/1074] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:55.048575 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72a436-dc9a-4bb1-b611-77a89585245d None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:55.056783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349053e2-547d-4814-a020-db0ee650e516 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:55.074834 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:55.094589 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ece97-d329-4468-b10a-2cf1d00bc02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:55.095619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ece97-d329-4468-b10a-2cf1d00bc02b None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:55.095619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ece97-d329-4468-b10a-2cf1d00bc02b None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:55.096023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ece97-d329-4468-b10a-2cf1d00bc02b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:55.163573 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72a436-dc9a-4bb1-b611-77a89585245d None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:55.176190 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ece97-d329-4468-b10a-2cf1d00bc02b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:55.177762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ece97-d329-4468-b10a-2cf1d00bc02b None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:55.200184 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f67cb-d295-4c88-8d19-0f17e3d38db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:55.200896 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f67cb-d295-4c88-8d19-0f17e3d38db6 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:55.201232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f67cb-d295-4c88-8d19-0f17e3d38db6 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:55.201502 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f67cb-d295-4c88-8d19-0f17e3d38db6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:55.208994 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f67cb-d295-4c88-8d19-0f17e3d38db6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:55.210381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f67cb-d295-4c88-8d19-0f17e3d38db6 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:55.218510 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:55.222875 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-749f67cb-d295-4c88-8d19-0f17e3d38db6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:39:55.222875 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:55.222875 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:55.222875 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:55.222875 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:55.222875 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:55.222875 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:55.222875 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:55.222875 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:55.222875 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:55.222875 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:55.222875 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:55.222875 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:39:55.222875 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:39:55.222875 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:39:55.222875 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:39:55.224029 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:55.224029 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:55.224029 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:39:55.224029 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:55.224029 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:39:55.224029 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:55.224029 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:55.224029 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:55.224029 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:55.224029 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:55.224029 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:55.224029 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:55.224029 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:55.224029 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:55.224029 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:55.224029 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:55.224029 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:55.224029 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:55.225009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:55.225009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:55.225009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:39:55.225009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:39:55.225009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:39:55.225009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:39:55.225009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:39:55.225009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:39:55.225009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:39:55.225009 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:55.225009 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 534/1075] 10.222.0.33 () {56 vars in 1093 bytes} [Sat Aug 6 20:39:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:55.230099 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f67cb-d295-4c88-8d19-0f17e3d38db6 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:55.291918 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 542/1076] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:39:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 20:39:55.297718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ece97-d329-4468-b10a-2cf1d00bc02b None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:55.321246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:55.341442 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f67cb-d295-4c88-8d19-0f17e3d38db6 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:55.379022 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01534d5-62ff-448a-bb55-113cfd06b0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:55.379774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01534d5-62ff-448a-bb55-113cfd06b0a7 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:55.380153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01534d5-62ff-448a-bb55-113cfd06b0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:55.380525 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01534d5-62ff-448a-bb55-113cfd06b0a7 None admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:55.381349 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01534d5-62ff-448a-bb55-113cfd06b0a7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:55.381754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01534d5-62ff-448a-bb55-113cfd06b0a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:55.383399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01534d5-62ff-448a-bb55-113cfd06b0a7 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:55.403893 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 535/1077] 10.222.0.33 () {56 vars in 1133 bytes} [Sat Aug 6 20:39:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:55.409007 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01534d5-62ff-448a-bb55-113cfd06b0a7 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:55.411614 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ece97-d329-4468-b10a-2cf1d00bc02b None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:55.455554 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44179533-f6c0-48f6-b45e-f57f38260e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:55.456307 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44179533-f6c0-48f6-b45e-f57f38260e83 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:55.457171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44179533-f6c0-48f6-b45e-f57f38260e83 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:55.457445 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44179533-f6c0-48f6-b45e-f57f38260e83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:55.464897 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:55.469603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44179533-f6c0-48f6-b45e-f57f38260e83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:55.471111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44179533-f6c0-48f6-b45e-f57f38260e83 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:55.485628 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-44179533-f6c0-48f6-b45e-f57f38260e83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:55.485628 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:55.485628 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:55.485628 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:55.485628 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:55.485628 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:55.485628 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:55.485628 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:55.485628 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:55.485628 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:55.485628 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:55.485628 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:55.485628 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:39:55.485628 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:39:55.485628 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:39:55.485628 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:39:55.486760 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:55.486760 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:55.486760 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:55.486760 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:55.486760 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:55.486760 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:55.486760 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:55.486760 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:55.486760 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:55.486760 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:55.486760 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:55.486760 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:55.486760 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:55.486760 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:55.486760 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:55.486760 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:55.486760 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:39:55.487744 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:39:55.487744 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:55.487744 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:55.487744 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 543/1078] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:39:55.492720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44179533-f6c0-48f6-b45e-f57f38260e83 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:55.520844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01534d5-62ff-448a-bb55-113cfd06b0a7 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:55.556431 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ede0cb-fd6f-4842-93f0-fa5f87861e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:55.556996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ede0cb-fd6f-4842-93f0-fa5f87861e7e None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:55.557359 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ede0cb-fd6f-4842-93f0-fa5f87861e7e None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:55.557627 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ede0cb-fd6f-4842-93f0-fa5f87861e7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:55.566186 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:55.571923 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ede0cb-fd6f-4842-93f0-fa5f87861e7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:55.573375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ede0cb-fd6f-4842-93f0-fa5f87861e7e None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:55.590040 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-76ede0cb-fd6f-4842-93f0-fa5f87861e7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:55.590040 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:55.590040 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:55.590040 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:55.590040 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:55.590040 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:55.590040 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:55.590040 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:55.590040 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:55.590040 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:55.590040 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:55.590040 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:55.590040 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:39:55.590040 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:39:55.590040 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:39:55.590040 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:39:55.591213 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:55.591213 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:55.591213 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:55.591213 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:55.591213 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:55.591213 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:55.591213 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:55.591213 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:55.591213 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:55.591213 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:55.591213 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:55.591213 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:55.591213 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:55.591213 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:55.591213 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:55.591213 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:55.591213 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:39:55.592308 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:39:55.592308 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:55.592308 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:55.596212 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 536/1079] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:39:55.597631 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ede0cb-fd6f-4842-93f0-fa5f87861e7e None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:55.603926 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44179533-f6c0-48f6-b45e-f57f38260e83 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:55.639826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f29bd4-75ce-4a36-b709-0a5d4b0b7f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:55.640428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f29bd4-75ce-4a36-b709-0a5d4b0b7f5d None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:55.640709 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f29bd4-75ce-4a36-b709-0a5d4b0b7f5d None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:55.640981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f29bd4-75ce-4a36-b709-0a5d4b0b7f5d None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:55.641620 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f29bd4-75ce-4a36-b709-0a5d4b0b7f5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:55.641924 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f29bd4-75ce-4a36-b709-0a5d4b0b7f5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:55.643301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f29bd4-75ce-4a36-b709-0a5d4b0b7f5d None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:55.655882 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 544/1080] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:55.715223 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ede0cb-fd6f-4842-93f0-fa5f87861e7e None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:55.753912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43e646-b2a5-4e0c-93f3-91bb2dea1acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:55.754580 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43e646-b2a5-4e0c-93f3-91bb2dea1acc None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:55.754849 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43e646-b2a5-4e0c-93f3-91bb2dea1acc None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:55.755123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43e646-b2a5-4e0c-93f3-91bb2dea1acc None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:55.755779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb43e646-b2a5-4e0c-93f3-91bb2dea1acc None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:55.756083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb43e646-b2a5-4e0c-93f3-91bb2dea1acc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:55.757475 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb43e646-b2a5-4e0c-93f3-91bb2dea1acc None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:55.770791 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 537/1081] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:55.776611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f29bd4-75ce-4a36-b709-0a5d4b0b7f5d None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:55.836611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:55.890733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f29bd4-75ce-4a36-b709-0a5d4b0b7f5d None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:55.928599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8906953-b4f4-41e1-8d5b-6f48ec1e6358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:55.929228 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8906953-b4f4-41e1-8d5b-6f48ec1e6358 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:55.929504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8906953-b4f4-41e1-8d5b-6f48ec1e6358 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:55.929773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8906953-b4f4-41e1-8d5b-6f48ec1e6358 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:55.937163 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8906953-b4f4-41e1-8d5b-6f48ec1e6358 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:55.938677 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8906953-b4f4-41e1-8d5b-6f48ec1e6358 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:55.951279 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-b8906953-b4f4-41e1-8d5b-6f48ec1e6358 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:55.951279 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:55.951279 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:55.951279 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:55.951279 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:55.951279 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:55.951279 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:55.951279 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:55.951279 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:55.951279 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:55.951279 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:55.951279 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:55.951279 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:39:55.951279 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:39:55.951279 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:39:55.952261 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:39:55.952261 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:55.952261 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:55.952261 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:55.952261 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:55.952261 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:55.952261 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:55.952261 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:55.952261 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:55.952261 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:55.952261 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:55.952261 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:55.952261 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:55.952261 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:55.952261 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:55.952261 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:55.952261 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:55.953172 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:39:55.953172 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:39:55.953172 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:39:55.953172 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:39:55.953172 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:39:55.953172 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:39:55.953172 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:39:55.953172 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:39:55.953172 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 545/1082] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:39:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:55.958812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43e646-b2a5-4e0c-93f3-91bb2dea1acc None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:56.012061 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:56.060808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43e646-b2a5-4e0c-93f3-91bb2dea1acc None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:56.093415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624bd7c-af26-4763-a3dc-c5b68c60ed1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:56.093938 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624bd7c-af26-4763-a3dc-c5b68c60ed1a None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:56.094210 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624bd7c-af26-4763-a3dc-c5b68c60ed1a None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:56.094474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624bd7c-af26-4763-a3dc-c5b68c60ed1a None admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:56.095186 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624bd7c-af26-4763-a3dc-c5b68c60ed1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:56.095486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624bd7c-af26-4763-a3dc-c5b68c60ed1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:56.097499 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624bd7c-af26-4763-a3dc-c5b68c60ed1a None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:56.111929 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 538/1083] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Aug 6 20:39:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:56.118410 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8906953-b4f4-41e1-8d5b-6f48ec1e6358 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:56.221544 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8906953-b4f4-41e1-8d5b-6f48ec1e6358 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:56.231595 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:56.255425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e336fa9-6afd-4c76-a0f7-8f3c9f7c8b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:56.256073 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e336fa9-6afd-4c76-a0f7-8f3c9f7c8b9b None admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:56.256354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e336fa9-6afd-4c76-a0f7-8f3c9f7c8b9b None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:56.256669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e336fa9-6afd-4c76-a0f7-8f3c9f7c8b9b None admin] PATH_INFO: `/v3/projects/6c4962342201407a89793c5c9a6a6f36/users/5f9d53147a57402f8b9818590bc1fc1f/roles/df403794156d44e7bf81058ba5d5f806` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:56.258780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e336fa9-6afd-4c76-a0f7-8f3c9f7c8b9b None admin] RBAC: Authorizing `identity:create_grant(project_id=6c4962342201407a89793c5c9a6a6f36, user_id=5f9d53147a57402f8b9818590bc1fc1f, role_id=df403794156d44e7bf81058ba5d5f806)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:56.260188 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e336fa9-6afd-4c76-a0f7-8f3c9f7c8b9b None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:56.273412 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 546/1084] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Aug 6 20:39:56 2022] PUT /identity/v3/projects/6c4962342201407a89793c5c9a6a6f36/users/5f9d53147a57402f8b9818590bc1fc1f/roles/df403794156d44e7bf81058ba5d5f806 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:39:57.063601 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b0af3-780d-462e-a051-7c6c45b71951 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:57.064237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b0af3-780d-462e-a051-7c6c45b71951 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:57.064237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b0af3-780d-462e-a051-7c6c45b71951 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:57.065499 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 539/1085] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:57.071409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e8d1a-92d5-48b3-93c9-c86a8ca72f0e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:57.071845 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e8d1a-92d5-48b3-93c9-c86a8ca72f0e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:57.071946 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e8d1a-92d5-48b3-93c9-c86a8ca72f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:57.090118 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-de5e8d1a-92d5-48b3-93c9-c86a8ca72f0e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:57.091325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-de5e8d1a-92d5-48b3-93c9-c86a8ca72f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:57.155333 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 547/1086] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:39:57.180516 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b0af3-780d-462e-a051-7c6c45b71951 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:57.283637 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b0af3-780d-462e-a051-7c6c45b71951 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:57.294184 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:57.318730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384400ab-2b41-44da-a7a2-a7f44b7eaadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:57.319259 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384400ab-2b41-44da-a7a2-a7f44b7eaadf None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:57.319534 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384400ab-2b41-44da-a7a2-a7f44b7eaadf None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:57.319801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384400ab-2b41-44da-a7a2-a7f44b7eaadf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:57.329504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384400ab-2b41-44da-a7a2-a7f44b7eaadf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:39:57.334815 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-384400ab-2b41-44da-a7a2-a7f44b7eaadf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:39:57.334815 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:57.334815 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:57.334815 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:57.334815 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:57.334815 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:57.334815 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:57.334815 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:57.334815 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:57.334815 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:57.334815 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:57.334815 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:57.334815 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:39:57.334815 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:39:57.334815 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:39:57.334815 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:39:57.336014 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:39:57.336014 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:39:57.336014 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:39:57.336014 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:39:57.336014 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:57.336014 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:57.336014 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:57.336014 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:57.336014 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:57.336014 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:57.336014 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:57.336014 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:57.336014 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:57.336014 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:57.336014 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:57.336014 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:57.337462 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:57.337462 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:57.337462 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:57.337462 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:57.337462 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:39:57.337462 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:39:57.337462 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:39:57.337462 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:39:57.337462 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:39:57.337462 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:39:57.337462 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:39:57.337462 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:57.337462 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 540/1087] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Aug 6 20:39:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:57.341975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e8d1a-92d5-48b3-93c9-c86a8ca72f0e None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:57.439893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:57.443348 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e8d1a-92d5-48b3-93c9-c86a8ca72f0e None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:57.478992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a608bae-e460-4e09-9fde-19613d4d3b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:57.479594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a608bae-e460-4e09-9fde-19613d4d3b24 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:57.479875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a608bae-e460-4e09-9fde-19613d4d3b24 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:57.480149 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a608bae-e460-4e09-9fde-19613d4d3b24 None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:57.480812 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a608bae-e460-4e09-9fde-19613d4d3b24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:57.481118 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a608bae-e460-4e09-9fde-19613d4d3b24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:57.482482 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a608bae-e460-4e09-9fde-19613d4d3b24 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:57.490430 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 548/1088] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:39:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:57.496289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384400ab-2b41-44da-a7a2-a7f44b7eaadf None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:57.593307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384400ab-2b41-44da-a7a2-a7f44b7eaadf None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:57.625436 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0c8ea-0de0-4b59-a82d-4e36764dc0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:57.626039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0c8ea-0de0-4b59-a82d-4e36764dc0a8 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:57.626309 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0c8ea-0de0-4b59-a82d-4e36764dc0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:57.626599 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0c8ea-0de0-4b59-a82d-4e36764dc0a8 None admin] PATH_INFO: `/v3/users/bcd78fc9e134407bb8448ceb53c069df` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:57.627691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0c8ea-0de0-4b59-a82d-4e36764dc0a8 None admin] RBAC: Authorizing `identity:get_user(user_id=bcd78fc9e134407bb8448ceb53c069df)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:57.629304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0c8ea-0de0-4b59-a82d-4e36764dc0a8 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:57.630881 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 541/1089] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:39:57 2022] GET /identity/v3/users/bcd78fc9e134407bb8448ceb53c069df => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:57.636570 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a608bae-e460-4e09-9fde-19613d4d3b24 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:57.739338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a608bae-e460-4e09-9fde-19613d4d3b24 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:57.771692 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdafdd-86cf-4d08-a5c1-122afe340526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:57.772290 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdafdd-86cf-4d08-a5c1-122afe340526 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:57.772570 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdafdd-86cf-4d08-a5c1-122afe340526 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:57.772841 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdafdd-86cf-4d08-a5c1-122afe340526 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:57.802655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:57.840143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cdafdd-86cf-4d08-a5c1-122afe340526 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:57.841583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cdafdd-86cf-4d08-a5c1-122afe340526 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:57.938682 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 549/1090] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:39:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 06 20:39:57.944116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0c8ea-0de0-4b59-a82d-4e36764dc0a8 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:57.985155 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:58.047630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0c8ea-0de0-4b59-a82d-4e36764dc0a8 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:58.082088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee23409-c530-4f76-ba24-6a9ede741f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:58.082754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee23409-c530-4f76-ba24-6a9ede741f9b None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:58.082996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee23409-c530-4f76-ba24-6a9ede741f9b None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:58.083263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee23409-c530-4f76-ba24-6a9ede741f9b None admin] PATH_INFO: `/v3/projects/52f7eab3f1084d94a80d2f5ed906f8e2` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:58.084380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee23409-c530-4f76-ba24-6a9ede741f9b None admin] RBAC: Authorizing `identity:get_project(project_id=52f7eab3f1084d94a80d2f5ed906f8e2)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:58.085792 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee23409-c530-4f76-ba24-6a9ede741f9b None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:58.087429 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 542/1091] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:39:57 2022] GET /identity/v3/projects/52f7eab3f1084d94a80d2f5ed906f8e2 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:58.093498 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdafdd-86cf-4d08-a5c1-122afe340526 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:58.155085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:58.197658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdafdd-86cf-4d08-a5c1-122afe340526 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:58.236484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea3a5cb-68a8-4ea5-97fb-f35cefe9fa25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:58.237085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3a5cb-68a8-4ea5-97fb-f35cefe9fa25 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:58.237887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3a5cb-68a8-4ea5-97fb-f35cefe9fa25 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:58.238299 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3a5cb-68a8-4ea5-97fb-f35cefe9fa25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:58.239043 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea3a5cb-68a8-4ea5-97fb-f35cefe9fa25 None admin] RBAC: Adding query filter params (role.id=ab245eea8a714462a00c4546309de9c9, scope.project.id=52f7eab3f1084d94a80d2f5ed906f8e2, user.id=bcd78fc9e134407bb8448ceb53c069df) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:58.239351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea3a5cb-68a8-4ea5-97fb-f35cefe9fa25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:58.240772 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea3a5cb-68a8-4ea5-97fb-f35cefe9fa25 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:58.246653 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 550/1092] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:39:58 2022] GET /identity/v3/role_assignments?user.id=bcd78fc9e134407bb8448ceb53c069df&scope.project.id=52f7eab3f1084d94a80d2f5ed906f8e2&role.id=ab245eea8a714462a00c4546309de9c9 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:58.501981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303089f-cb7c-454a-9e40-15470607e25f None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:58.502260 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303089f-cb7c-454a-9e40-15470607e25f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:58.502532 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303089f-cb7c-454a-9e40-15470607e25f None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:58.504910 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 543/1093] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:39:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:58.510142 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925be70-746e-48ae-839b-ed7c8b6ff2a1 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:58.510424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925be70-746e-48ae-839b-ed7c8b6ff2a1 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:58.510725 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925be70-746e-48ae-839b-ed7c8b6ff2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:58.529382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-3925be70-746e-48ae-839b-ed7c8b6ff2a1 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:58.530567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3925be70-746e-48ae-839b-ed7c8b6ff2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:58.597627 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 551/1094] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:39:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:39:58.623011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303089f-cb7c-454a-9e40-15470607e25f None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:58.729572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303089f-cb7c-454a-9e40-15470607e25f None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:58.737031 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:58.766248 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62fea9-77da-4bc4-b42a-6779e8dda018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:58.766820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62fea9-77da-4bc4-b42a-6779e8dda018 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:58.767092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62fea9-77da-4bc4-b42a-6779e8dda018 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:58.767356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62fea9-77da-4bc4-b42a-6779e8dda018 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:58.778228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62fea9-77da-4bc4-b42a-6779e8dda018 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:39:58.782898 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-ce62fea9-77da-4bc4-b42a-6779e8dda018 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 20:39:58.782898 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:58.782898 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:58.782898 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:58.782898 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:58.782898 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:58.782898 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:58.782898 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:58.782898 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:58.782898 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:58.782898 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:58.782898 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:58.782898 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:39:58.782898 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:39:58.782898 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:39:58.782898 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:39:58.784023 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:39:58.784023 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:39:58.784023 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:39:58.784023 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:39:58.784023 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:58.784023 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:58.784023 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:58.784023 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:58.784023 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:58.784023 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:58.784023 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:58.784023 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:58.784023 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:58.784023 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:58.784023 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:58.784023 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:58.785762 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:58.785762 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:58.785762 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:58.785762 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:58.785762 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:39:58.785762 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:39:58.785762 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:39:58.785762 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:39:58.785762 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:39:58.785762 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:39:58.785762 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 20:39:58.785762 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:58.785762 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 544/1095] 10.222.0.33 () {56 vars in 1120 bytes} [Sat Aug 6 20:39:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:58.790735 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925be70-746e-48ae-839b-ed7c8b6ff2a1 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:58.844694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:58.887520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925be70-746e-48ae-839b-ed7c8b6ff2a1 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:58.922921 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364cf83e-1ecb-400d-8edf-b991673193b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:58.923525 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364cf83e-1ecb-400d-8edf-b991673193b8 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:58.923806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364cf83e-1ecb-400d-8edf-b991673193b8 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:58.924078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364cf83e-1ecb-400d-8edf-b991673193b8 None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:58.924741 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364cf83e-1ecb-400d-8edf-b991673193b8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:58.925043 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364cf83e-1ecb-400d-8edf-b991673193b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:58.926398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364cf83e-1ecb-400d-8edf-b991673193b8 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:58.939354 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 552/1096] 10.222.0.33 () {56 vars in 1115 bytes} [Sat Aug 6 20:39:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:58.940564 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62fea9-77da-4bc4-b42a-6779e8dda018 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:59.040530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62fea9-77da-4bc4-b42a-6779e8dda018 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:59.074759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3076b-bbb9-4c5e-bf8a-df6bb0f29b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:59.075375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3076b-bbb9-4c5e-bf8a-df6bb0f29b26 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:59.075656 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3076b-bbb9-4c5e-bf8a-df6bb0f29b26 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:59.075931 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3076b-bbb9-4c5e-bf8a-df6bb0f29b26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:59.085705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3076b-bbb9-4c5e-bf8a-df6bb0f29b26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:59.087178 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3076b-bbb9-4c5e-bf8a-df6bb0f29b26 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:59.101238 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-92a3076b-bbb9-4c5e-bf8a-df6bb0f29b26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:59.101238 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:59.101238 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:59.101238 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:59.101238 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:59.101238 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:59.101238 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:59.101238 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:59.101238 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:59.101238 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:59.101238 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:59.101238 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:59.101238 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:39:59.101238 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:39:59.101238 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:39:59.101238 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:39:59.107008 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:59.107008 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:59.107008 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:59.107008 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:59.107008 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:59.107008 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:59.107008 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:59.107008 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:59.107008 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:59.107008 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:59.107008 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:59.107008 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:59.107008 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:59.107008 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:59.107008 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:59.107008 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:59.107008 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:39:59.107974 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:39:59.107974 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:39:59.107974 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:59.107974 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 545/1097] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:59.108223 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364cf83e-1ecb-400d-8edf-b991673193b8 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:59.205270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364cf83e-1ecb-400d-8edf-b991673193b8 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:59.226664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:59.245210 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c66f3a-57cb-4f3b-86a8-a40e44cbc4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:59.245804 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c66f3a-57cb-4f3b-86a8-a40e44cbc4c3 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:59.246079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c66f3a-57cb-4f3b-86a8-a40e44cbc4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:59.246349 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c66f3a-57cb-4f3b-86a8-a40e44cbc4c3 None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:59.247013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c66f3a-57cb-4f3b-86a8-a40e44cbc4c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:59.247314 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c66f3a-57cb-4f3b-86a8-a40e44cbc4c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:59.248670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c66f3a-57cb-4f3b-86a8-a40e44cbc4c3 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:59.264590 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 553/1098] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:59.265785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3076b-bbb9-4c5e-bf8a-df6bb0f29b26 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:59.285532 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:59.367057 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3076b-bbb9-4c5e-bf8a-df6bb0f29b26 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:59.399854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b5062-6e7d-495e-9f0b-f73cdec08132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:59.400470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b5062-6e7d-495e-9f0b-f73cdec08132 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:59.400747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b5062-6e7d-495e-9f0b-f73cdec08132 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:59.401013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b5062-6e7d-495e-9f0b-f73cdec08132 None admin] PATH_INFO: `/v3/users/nova` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:59.408507 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b5062-6e7d-495e-9f0b-f73cdec08132 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:59.410576 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b5062-6e7d-495e-9f0b-f73cdec08132 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:59.422788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-e53b5062-6e7d-495e-9f0b-f73cdec08132 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:39:59.422788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:39:59.422788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:39:59.422788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:39:59.422788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:39:59.422788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:39:59.422788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:39:59.422788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:39:59.422788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:39:59.422788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:39:59.422788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:39:59.422788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:39:59.422788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:39:59.422788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:39:59.422788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:39:59.422788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:39:59.424002 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:39:59.424002 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:39:59.424002 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:39:59.424002 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:59.424002 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:39:59.424002 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:39:59.424002 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:39:59.424002 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:39:59.424002 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:39:59.424002 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:39:59.424002 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:39:59.424002 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:39:59.424002 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:39:59.424002 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:39:59.424002 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:39:59.424002 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:39:59.424002 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:39:59.424002 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:39:59.426466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:39:59.426466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:39:59.426466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:39:59.426466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:39:59.426466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:39:59.426466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:39:59.426466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:39:59.426466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:39:59.426466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:39:59.426466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:39:59.426466 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 546/1099] 10.222.0.33 () {56 vars in 1093 bytes} [Sat Aug 6 20:39:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:39:59.430732 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c66f3a-57cb-4f3b-86a8-a40e44cbc4c3 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:59.527585 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c66f3a-57cb-4f3b-86a8-a40e44cbc4c3 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:59.560907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6e5e7-7dc2-4bc1-880a-d905f59036d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:59.561504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6e5e7-7dc2-4bc1-880a-d905f59036d9 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:59.561782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6e5e7-7dc2-4bc1-880a-d905f59036d9 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:59.562055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6e5e7-7dc2-4bc1-880a-d905f59036d9 None admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:59.562805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6e5e7-7dc2-4bc1-880a-d905f59036d9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:59.563112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6e5e7-7dc2-4bc1-880a-d905f59036d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:59.564556 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6e5e7-7dc2-4bc1-880a-d905f59036d9 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:59.582213 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 554/1100] 10.222.0.33 () {56 vars in 1133 bytes} [Sat Aug 6 20:39:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:59.587703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b5062-6e7d-495e-9f0b-f73cdec08132 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:59.663601 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:59.689800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b5062-6e7d-495e-9f0b-f73cdec08132 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:59.722817 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aad9e7-96db-4ed7-9813-604fe22ff4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:59.723411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aad9e7-96db-4ed7-9813-604fe22ff4ad None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:59.723684 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aad9e7-96db-4ed7-9813-604fe22ff4ad None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:59.723950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aad9e7-96db-4ed7-9813-604fe22ff4ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:59.788572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aad9e7-96db-4ed7-9813-604fe22ff4ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:59.790001 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aad9e7-96db-4ed7-9813-604fe22ff4ad None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:59.864013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:59.887244 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 547/1101] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:39:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 20:39:59.893081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6e5e7-7dc2-4bc1-880a-d905f59036d9 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:59.928611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:59.993697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6e5e7-7dc2-4bc1-880a-d905f59036d9 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:00.025996 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f39dd1-32b8-4f4e-84cf-4e3c5fd0bdcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:00.026636 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f39dd1-32b8-4f4e-84cf-4e3c5fd0bdcc None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:00.026912 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f39dd1-32b8-4f4e-84cf-4e3c5fd0bdcc None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:00.027177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f39dd1-32b8-4f4e-84cf-4e3c5fd0bdcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:00.037728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f39dd1-32b8-4f4e-84cf-4e3c5fd0bdcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:00.039207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f39dd1-32b8-4f4e-84cf-4e3c5fd0bdcc None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:00.052994 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-d9f39dd1-32b8-4f4e-84cf-4e3c5fd0bdcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:40:00.052994 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:40:00.052994 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:40:00.052994 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:40:00.052994 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:40:00.052994 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:40:00.052994 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:40:00.052994 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:40:00.052994 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:40:00.052994 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:40:00.052994 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:40:00.052994 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:40:00.052994 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:40:00.052994 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:40:00.052994 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:40:00.052994 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:40:00.054041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:40:00.054041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:40:00.054041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:40:00.054041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:40:00.054041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:40:00.054041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:40:00.054041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:40:00.054041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:40:00.054041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:40:00.054041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:40:00.054041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:40:00.054041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:40:00.054041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:40:00.054041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:40:00.054041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:40:00.054041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:40:00.054041 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:40:00.055260 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:40:00.055260 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:40:00.055260 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:40:00.055260 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 555/1102] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:39:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:40:00.060297 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aad9e7-96db-4ed7-9813-604fe22ff4ad None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:00.161770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aad9e7-96db-4ed7-9813-604fe22ff4ad None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:00.199961 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134488de-da73-4a0f-bc8c-86299f350e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:00.200480 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134488de-da73-4a0f-bc8c-86299f350e8a None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:00.200757 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134488de-da73-4a0f-bc8c-86299f350e8a None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:00.201023 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134488de-da73-4a0f-bc8c-86299f350e8a None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:00.201657 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134488de-da73-4a0f-bc8c-86299f350e8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:40:00.201958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134488de-da73-4a0f-bc8c-86299f350e8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:00.203334 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134488de-da73-4a0f-bc8c-86299f350e8a None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:00.215479 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 548/1103] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:00.220909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f39dd1-32b8-4f4e-84cf-4e3c5fd0bdcc None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:00.311303 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:00.324262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f39dd1-32b8-4f4e-84cf-4e3c5fd0bdcc None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:00.359024 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b917e51-a475-418d-b7b4-02db0a8158a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:00.359769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b917e51-a475-418d-b7b4-02db0a8158a1 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:00.360177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b917e51-a475-418d-b7b4-02db0a8158a1 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:00.360487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b917e51-a475-418d-b7b4-02db0a8158a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:00.368237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b917e51-a475-418d-b7b4-02db0a8158a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:00.369670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b917e51-a475-418d-b7b4-02db0a8158a1 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:00.381912 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-1b917e51-a475-418d-b7b4-02db0a8158a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:40:00.381912 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:40:00.381912 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:40:00.381912 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:40:00.381912 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:40:00.381912 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:40:00.381912 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:40:00.381912 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:40:00.381912 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:40:00.381912 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:40:00.381912 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:40:00.381912 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:40:00.381912 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:40:00.381912 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:40:00.381912 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:40:00.383042 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:40:00.383042 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:40:00.383042 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:40:00.383042 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:40:00.383042 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:40:00.383042 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:40:00.383042 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:40:00.383042 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:40:00.383042 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:40:00.383042 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:40:00.383042 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:40:00.383042 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:40:00.383042 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:40:00.383042 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:40:00.383042 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:40:00.383042 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:40:00.383042 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:40:00.383973 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:40:00.383973 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:40:00.383973 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:40:00.383973 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:40:00.383973 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:40:00.383973 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:40:00.383973 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:40:00.383973 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:40:00.383973 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 556/1104] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:40:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:40:00.389252 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134488de-da73-4a0f-bc8c-86299f350e8a None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:00.431682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:00.489359 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134488de-da73-4a0f-bc8c-86299f350e8a None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:00.527834 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8c394-458e-481e-a12f-6b86fad996e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:00.528439 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8c394-458e-481e-a12f-6b86fad996e2 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:00.528719 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8c394-458e-481e-a12f-6b86fad996e2 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:00.528990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8c394-458e-481e-a12f-6b86fad996e2 None admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:00.529678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8c394-458e-481e-a12f-6b86fad996e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:40:00.529986 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8c394-458e-481e-a12f-6b86fad996e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:00.531449 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8c394-458e-481e-a12f-6b86fad996e2 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:00.546971 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 549/1105] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Aug 6 20:40:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:00.547163 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf659771-599a-48d8-96ae-cf2e697d5f00 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:00.547163 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf659771-599a-48d8-96ae-cf2e697d5f00 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:00.547163 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf659771-599a-48d8-96ae-cf2e697d5f00 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:00.547163 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 557/1106] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:40:00.550601 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8c394-458e-481e-a12f-6b86fad996e2 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:00.554078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2cd33-bce1-4dba-8ad5-be262bc491c4 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:00.554078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2cd33-bce1-4dba-8ad5-be262bc491c4 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:00.554078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2cd33-bce1-4dba-8ad5-be262bc491c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:00.570556 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-24b2cd33-bce1-4dba-8ad5-be262bc491c4 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:00.571761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-24b2cd33-bce1-4dba-8ad5-be262bc491c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:00.639697 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 558/1107] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:40:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 20:40:00.647805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:00.651955 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8c394-458e-481e-a12f-6b86fad996e2 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:00.667841 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2cd33-bce1-4dba-8ad5-be262bc491c4 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:00.690674 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cd67d-f4aa-4ca2-9db1-cf410f389cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:00.691277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cd67d-f4aa-4ca2-9db1-cf410f389cd7 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:00.691549 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cd67d-f4aa-4ca2-9db1-cf410f389cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:00.691813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cd67d-f4aa-4ca2-9db1-cf410f389cd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:00.692523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689cd67d-f4aa-4ca2-9db1-cf410f389cd7 None admin] RBAC: Adding query filter params (role.id=df403794156d44e7bf81058ba5d5f806, scope.project.id=6c4962342201407a89793c5c9a6a6f36, user.id=5f9d53147a57402f8b9818590bc1fc1f) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:40:00.692825 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689cd67d-f4aa-4ca2-9db1-cf410f389cd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:00.694235 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689cd67d-f4aa-4ca2-9db1-cf410f389cd7 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:00.699816 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 550/1108] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:40:00 2022] GET /identity/v3/role_assignments?user.id=5f9d53147a57402f8b9818590bc1fc1f&scope.project.id=6c4962342201407a89793c5c9a6a6f36&role.id=df403794156d44e7bf81058ba5d5f806 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:00.754723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:00.779201 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2cd33-bce1-4dba-8ad5-be262bc491c4 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:00.816776 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d0b44-31c8-4648-b4cd-0dd4269cae23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:00.817420 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d0b44-31c8-4648-b4cd-0dd4269cae23 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:00.817698 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d0b44-31c8-4648-b4cd-0dd4269cae23 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:00.817971 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d0b44-31c8-4648-b4cd-0dd4269cae23 None admin] PATH_INFO: `/v3/domains/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:00.819177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d0b44-31c8-4648-b4cd-0dd4269cae23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:00.820629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d0b44-31c8-4648-b4cd-0dd4269cae23 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:00.822239 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 559/1109] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:40:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:00.828153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cd67d-f4aa-4ca2-9db1-cf410f389cd7 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:00.934113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cd67d-f4aa-4ca2-9db1-cf410f389cd7 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:00.967899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597396a-0078-408e-ac38-6ae64bc64636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:00.968507 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597396a-0078-408e-ac38-6ae64bc64636 None admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:00.968783 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597396a-0078-408e-ac38-6ae64bc64636 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:00.969053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597396a-0078-408e-ac38-6ae64bc64636 None admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:00.969696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1597396a-0078-408e-ac38-6ae64bc64636 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:00.971233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1597396a-0078-408e-ac38-6ae64bc64636 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:00.994309 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 551/1110] 10.222.0.33 () {60 vars in 1132 bytes} [Sat Aug 6 20:40:00 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:40:03.284408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fa8d4-3c09-472a-934a-bcfc1eab999c None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:03.284931 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fa8d4-3c09-472a-934a-bcfc1eab999c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:03.284931 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fa8d4-3c09-472a-934a-bcfc1eab999c None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:03.286265 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 560/1111] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:40:03.291451 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e551b6-20ec-4276-a370-e86dffd5325c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:03.291835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e551b6-20ec-4276-a370-e86dffd5325c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:03.292011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e551b6-20ec-4276-a370-e86dffd5325c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:03.310000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-38e551b6-20ec-4276-a370-e86dffd5325c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:03.311222 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-38e551b6-20ec-4276-a370-e86dffd5325c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:03.324537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:03.381059 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 552/1112] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:40:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:40:03.406480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fa8d4-3c09-472a-934a-bcfc1eab999c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:03.505103 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fa8d4-3c09-472a-934a-bcfc1eab999c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:03.538479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc8a5e-ae49-47f3-9490-233b382564cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:03.539053 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc8a5e-ae49-47f3-9490-233b382564cc None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:03.539329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc8a5e-ae49-47f3-9490-233b382564cc None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:03.539596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc8a5e-ae49-47f3-9490-233b382564cc None admin] PATH_INFO: `/v3/roles/b9254dbd663046739a1ba48d8c0027ad` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:03.540963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc8a5e-ae49-47f3-9490-233b382564cc None admin] RBAC: Authorizing `identity:get_role(role_id=b9254dbd663046739a1ba48d8c0027ad)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:03.542390 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc8a5e-ae49-47f3-9490-233b382564cc None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:03.543713 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 561/1113] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:40:03 2022] GET /identity/v3/roles/b9254dbd663046739a1ba48d8c0027ad => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:03.549836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e551b6-20ec-4276-a370-e86dffd5325c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:03.645058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e551b6-20ec-4276-a370-e86dffd5325c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:03.678337 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b70cc8-dc18-4c45-8df3-c1137b5aab02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:03.679004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b70cc8-dc18-4c45-8df3-c1137b5aab02 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:03.679290 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b70cc8-dc18-4c45-8df3-c1137b5aab02 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:03.679822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b70cc8-dc18-4c45-8df3-c1137b5aab02 None admin] PATH_INFO: `/v3/users/6938f08b5ac6496a854f4782633cc281` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:03.693207 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b70cc8-dc18-4c45-8df3-c1137b5aab02 None admin] RBAC: Authorizing `identity:get_user(user_id=6938f08b5ac6496a854f4782633cc281)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:03.694688 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b70cc8-dc18-4c45-8df3-c1137b5aab02 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:03.696265 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 553/1114] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:40:03 2022] GET /identity/v3/users/6938f08b5ac6496a854f4782633cc281 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:03.702009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc8a5e-ae49-47f3-9490-233b382564cc None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:03.718198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:03.798022 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc8a5e-ae49-47f3-9490-233b382564cc None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:03.830094 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78797d5-e878-4e8c-b4e6-fb2c3d5ab323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:03.830782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78797d5-e878-4e8c-b4e6-fb2c3d5ab323 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:03.831055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78797d5-e878-4e8c-b4e6-fb2c3d5ab323 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:03.831323 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78797d5-e878-4e8c-b4e6-fb2c3d5ab323 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:03.895119 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78797d5-e878-4e8c-b4e6-fb2c3d5ab323 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:03.896533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78797d5-e878-4e8c-b4e6-fb2c3d5ab323 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:03.910710 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:03.993341 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 562/1115] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:40:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 20:40:03.999213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b70cc8-dc18-4c45-8df3-c1137b5aab02 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:04.008356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:04.095541 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b70cc8-dc18-4c45-8df3-c1137b5aab02 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:04.127833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835286e6-22b6-439d-a280-96e3649b718b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:04.128412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835286e6-22b6-439d-a280-96e3649b718b None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:04.128691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835286e6-22b6-439d-a280-96e3649b718b None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:04.128963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835286e6-22b6-439d-a280-96e3649b718b None admin] PATH_INFO: `/v3/projects/52f7eab3f1084d94a80d2f5ed906f8e2` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:04.130071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835286e6-22b6-439d-a280-96e3649b718b None admin] RBAC: Authorizing `identity:get_project(project_id=52f7eab3f1084d94a80d2f5ed906f8e2)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:04.131533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835286e6-22b6-439d-a280-96e3649b718b None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:04.133126 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 554/1116] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:40:03 2022] GET /identity/v3/projects/52f7eab3f1084d94a80d2f5ed906f8e2 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:04.139208 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78797d5-e878-4e8c-b4e6-fb2c3d5ab323 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:04.237021 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78797d5-e878-4e8c-b4e6-fb2c3d5ab323 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:04.251187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:04.271901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22705914-e78b-4c71-b063-00afb2757a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:04.272502 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22705914-e78b-4c71-b063-00afb2757a67 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:04.272781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22705914-e78b-4c71-b063-00afb2757a67 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:04.273057 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22705914-e78b-4c71-b063-00afb2757a67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:04.273768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22705914-e78b-4c71-b063-00afb2757a67 None admin] RBAC: Adding query filter params (role.id=b9254dbd663046739a1ba48d8c0027ad, scope.project.id=52f7eab3f1084d94a80d2f5ed906f8e2, user.id=6938f08b5ac6496a854f4782633cc281) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:40:04.274080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22705914-e78b-4c71-b063-00afb2757a67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:04.275529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22705914-e78b-4c71-b063-00afb2757a67 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:04.280828 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 563/1117] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:40:04 2022] GET /identity/v3/role_assignments?user.id=6938f08b5ac6496a854f4782633cc281&scope.project.id=52f7eab3f1084d94a80d2f5ed906f8e2&role.id=b9254dbd663046739a1ba48d8c0027ad => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:40:06.488810 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06007a73-a9a7-40f5-8941-d97364209b4b None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:06.489378 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06007a73-a9a7-40f5-8941-d97364209b4b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:06.489378 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06007a73-a9a7-40f5-8941-d97364209b4b None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:06.490712 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 555/1118] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:40:06.495882 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb336e-c01e-46b1-a133-943a1c4c267a None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:06.496301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb336e-c01e-46b1-a133-943a1c4c267a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:06.496450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb336e-c01e-46b1-a133-943a1c4c267a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:06.514384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-94cb336e-c01e-46b1-a133-943a1c4c267a None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:06.515584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-94cb336e-c01e-46b1-a133-943a1c4c267a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:06.580024 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 564/1119] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:40:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 20:40:06.604245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06007a73-a9a7-40f5-8941-d97364209b4b None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:06.678676 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:06.704504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06007a73-a9a7-40f5-8941-d97364209b4b None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:06.738759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33deb393-1255-483b-a7c9-30ab819ffe9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:06.739429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33deb393-1255-483b-a7c9-30ab819ffe9a None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:06.739654 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33deb393-1255-483b-a7c9-30ab819ffe9a None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:06.739924 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33deb393-1255-483b-a7c9-30ab819ffe9a None admin] PATH_INFO: `/v3/roles/b9254dbd663046739a1ba48d8c0027ad` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:06.741302 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33deb393-1255-483b-a7c9-30ab819ffe9a None admin] RBAC: Authorizing `identity:get_role(role_id=b9254dbd663046739a1ba48d8c0027ad)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:06.742696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33deb393-1255-483b-a7c9-30ab819ffe9a None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:06.743991 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 556/1120] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:40:06 2022] GET /identity/v3/roles/b9254dbd663046739a1ba48d8c0027ad => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:06.749831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb336e-c01e-46b1-a133-943a1c4c267a None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:06.846056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb336e-c01e-46b1-a133-943a1c4c267a None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:06.854964 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:06.879516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58582cf-bc15-4c6e-a427-f3eaace7a388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:06.880129 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58582cf-bc15-4c6e-a427-f3eaace7a388 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:06.880405 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58582cf-bc15-4c6e-a427-f3eaace7a388 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:06.880675 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58582cf-bc15-4c6e-a427-f3eaace7a388 None admin] PATH_INFO: `/v3/users/6938f08b5ac6496a854f4782633cc281` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:06.881810 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58582cf-bc15-4c6e-a427-f3eaace7a388 None admin] RBAC: Authorizing `identity:get_user(user_id=6938f08b5ac6496a854f4782633cc281)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:06.883253 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58582cf-bc15-4c6e-a427-f3eaace7a388 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:06.887532 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 565/1121] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:40:06 2022] GET /identity/v3/users/6938f08b5ac6496a854f4782633cc281 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:06.890805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33deb393-1255-483b-a7c9-30ab819ffe9a None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:06.987885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33deb393-1255-483b-a7c9-30ab819ffe9a None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:07.021051 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc80b5-b5be-4cfe-94b4-6b95473b399b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:07.021620 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc80b5-b5be-4cfe-94b4-6b95473b399b None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:07.021893 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc80b5-b5be-4cfe-94b4-6b95473b399b None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:07.022158 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc80b5-b5be-4cfe-94b4-6b95473b399b None admin] PATH_INFO: `/v3/projects/52f7eab3f1084d94a80d2f5ed906f8e2` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:07.023267 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc80b5-b5be-4cfe-94b4-6b95473b399b None admin] RBAC: Authorizing `identity:get_project(project_id=52f7eab3f1084d94a80d2f5ed906f8e2)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:07.024670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc80b5-b5be-4cfe-94b4-6b95473b399b None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:07.026243 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 557/1122] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:40:06 2022] GET /identity/v3/projects/52f7eab3f1084d94a80d2f5ed906f8e2 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:07.032224 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58582cf-bc15-4c6e-a427-f3eaace7a388 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:07.128114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58582cf-bc15-4c6e-a427-f3eaace7a388 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:07.160458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb68553-1483-4457-a7c8-198d494dc21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:07.161098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb68553-1483-4457-a7c8-198d494dc21c None admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:07.161375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb68553-1483-4457-a7c8-198d494dc21c None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:07.161644 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb68553-1483-4457-a7c8-198d494dc21c None admin] PATH_INFO: `/v3/projects/52f7eab3f1084d94a80d2f5ed906f8e2/users/6938f08b5ac6496a854f4782633cc281/roles/b9254dbd663046739a1ba48d8c0027ad` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:07.163778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb68553-1483-4457-a7c8-198d494dc21c None admin] RBAC: Authorizing `identity:create_grant(project_id=52f7eab3f1084d94a80d2f5ed906f8e2, user_id=6938f08b5ac6496a854f4782633cc281, role_id=b9254dbd663046739a1ba48d8c0027ad)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:07.165185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb68553-1483-4457-a7c8-198d494dc21c None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:07.178020 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 566/1123] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Aug 6 20:40:07 2022] PUT /identity/v3/projects/52f7eab3f1084d94a80d2f5ed906f8e2/users/6938f08b5ac6496a854f4782633cc281/roles/b9254dbd663046739a1ba48d8c0027ad => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:40:09.390513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff682836-8b0f-498f-bbc1-4688ae36135d None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:09.391102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff682836-8b0f-498f-bbc1-4688ae36135d None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:09.391102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff682836-8b0f-498f-bbc1-4688ae36135d None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:09.392407 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 558/1124] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:40:09.397723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1f664-312e-4e86-b661-6d2176e02512 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:09.398114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1f664-312e-4e86-b661-6d2176e02512 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:09.398270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1f664-312e-4e86-b661-6d2176e02512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:09.416523 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-27b1f664-312e-4e86-b661-6d2176e02512 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:09.417685 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-27b1f664-312e-4e86-b661-6d2176e02512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:09.446774 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:09.483770 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 567/1125] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:40:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:40:09.509720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff682836-8b0f-498f-bbc1-4688ae36135d None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:09.521712 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:09.607796 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff682836-8b0f-498f-bbc1-4688ae36135d None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:09.640900 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691142f7-3a01-456f-9b87-53e405155867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:09.641455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691142f7-3a01-456f-9b87-53e405155867 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:09.641733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691142f7-3a01-456f-9b87-53e405155867 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:09.642007 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691142f7-3a01-456f-9b87-53e405155867 None admin] PATH_INFO: `/v3/roles/b9254dbd663046739a1ba48d8c0027ad` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:09.643532 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691142f7-3a01-456f-9b87-53e405155867 None admin] RBAC: Authorizing `identity:get_role(role_id=b9254dbd663046739a1ba48d8c0027ad)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:09.644884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691142f7-3a01-456f-9b87-53e405155867 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:09.646173 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 559/1126] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:40:09 2022] GET /identity/v3/roles/b9254dbd663046739a1ba48d8c0027ad => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:09.652184 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1f664-312e-4e86-b661-6d2176e02512 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:09.754062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1f664-312e-4e86-b661-6d2176e02512 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:09.787660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f5c29-1827-4a9c-9872-b37eedf509eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:09.788275 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f5c29-1827-4a9c-9872-b37eedf509eb None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:09.788554 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f5c29-1827-4a9c-9872-b37eedf509eb None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:09.788827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f5c29-1827-4a9c-9872-b37eedf509eb None admin] PATH_INFO: `/v3/users/6938f08b5ac6496a854f4782633cc281` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:09.789926 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f5c29-1827-4a9c-9872-b37eedf509eb None admin] RBAC: Authorizing `identity:get_user(user_id=6938f08b5ac6496a854f4782633cc281)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:09.791381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f5c29-1827-4a9c-9872-b37eedf509eb None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:09.792925 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 568/1127] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:40:09 2022] GET /identity/v3/users/6938f08b5ac6496a854f4782633cc281 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:09.798801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691142f7-3a01-456f-9b87-53e405155867 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:09.874606 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:09.896066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691142f7-3a01-456f-9b87-53e405155867 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:09.930342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f17ba-459b-4d11-b583-1b2d2566cc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:09.930973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f17ba-459b-4d11-b583-1b2d2566cc4e None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:09.931256 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f17ba-459b-4d11-b583-1b2d2566cc4e None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:09.931528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f17ba-459b-4d11-b583-1b2d2566cc4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:09.996067 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f17ba-459b-4d11-b583-1b2d2566cc4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:09.997506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f17ba-459b-4d11-b583-1b2d2566cc4e None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:10.070330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:10.092123 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 560/1128] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:40:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 20:40:10.098808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f5c29-1827-4a9c-9872-b37eedf509eb None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:10.131925 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:10.196232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f5c29-1827-4a9c-9872-b37eedf509eb None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:10.228832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb18c1-f58e-4f18-8703-a3e326851d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:10.229445 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb18c1-f58e-4f18-8703-a3e326851d3a None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:10.229717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb18c1-f58e-4f18-8703-a3e326851d3a None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:10.229987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb18c1-f58e-4f18-8703-a3e326851d3a None admin] PATH_INFO: `/v3/projects/52f7eab3f1084d94a80d2f5ed906f8e2` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:10.231167 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdb18c1-f58e-4f18-8703-a3e326851d3a None admin] RBAC: Authorizing `identity:get_project(project_id=52f7eab3f1084d94a80d2f5ed906f8e2)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:10.232576 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdb18c1-f58e-4f18-8703-a3e326851d3a None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:10.234164 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 569/1129] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:40:10 2022] GET /identity/v3/projects/52f7eab3f1084d94a80d2f5ed906f8e2 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:10.241568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f17ba-459b-4d11-b583-1b2d2566cc4e None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:10.338741 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f17ba-459b-4d11-b583-1b2d2566cc4e None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:10.372631 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64c2e1-1f87-4674-8ee4-64d37bcf0674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:10.373260 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64c2e1-1f87-4674-8ee4-64d37bcf0674 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:10.373534 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64c2e1-1f87-4674-8ee4-64d37bcf0674 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:10.373802 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64c2e1-1f87-4674-8ee4-64d37bcf0674 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:10.374518 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64c2e1-1f87-4674-8ee4-64d37bcf0674 None admin] RBAC: Adding query filter params (role.id=b9254dbd663046739a1ba48d8c0027ad, scope.project.id=52f7eab3f1084d94a80d2f5ed906f8e2, user.id=6938f08b5ac6496a854f4782633cc281) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:40:10.374847 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64c2e1-1f87-4674-8ee4-64d37bcf0674 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:10.376258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64c2e1-1f87-4674-8ee4-64d37bcf0674 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:10.382677 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 561/1130] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:40:10 2022] GET /identity/v3/role_assignments?user.id=6938f08b5ac6496a854f4782633cc281&scope.project.id=52f7eab3f1084d94a80d2f5ed906f8e2&role.id=b9254dbd663046739a1ba48d8c0027ad => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:12.632790 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70539cd-8aaf-4144-9a0a-16e1631d8e87 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:12.633316 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70539cd-8aaf-4144-9a0a-16e1631d8e87 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:12.633316 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70539cd-8aaf-4144-9a0a-16e1631d8e87 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:12.634693 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 570/1131] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:40:12.639876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37599bb4-410d-43a0-9ac9-bc5baa2963df None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:12.640283 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37599bb4-410d-43a0-9ac9-bc5baa2963df None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:12.640432 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37599bb4-410d-43a0-9ac9-bc5baa2963df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:12.659914 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-37599bb4-410d-43a0-9ac9-bc5baa2963df None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:12.661091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-37599bb4-410d-43a0-9ac9-bc5baa2963df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:12.696459 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:12.727032 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 562/1132] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:40:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:40:12.751572 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70539cd-8aaf-4144-9a0a-16e1631d8e87 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:12.851131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70539cd-8aaf-4144-9a0a-16e1631d8e87 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:12.852606 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:12.884509 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08586b-c5db-446c-8d56-1bf9e04d062d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:12.885050 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08586b-c5db-446c-8d56-1bf9e04d062d None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:12.885324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08586b-c5db-446c-8d56-1bf9e04d062d None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:12.885596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08586b-c5db-446c-8d56-1bf9e04d062d None admin] PATH_INFO: `/v3/domains/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:12.886714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08586b-c5db-446c-8d56-1bf9e04d062d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:12.888122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08586b-c5db-446c-8d56-1bf9e04d062d None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:12.889642 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 571/1133] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:40:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:12.896209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37599bb4-410d-43a0-9ac9-bc5baa2963df None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:12.989602 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37599bb4-410d-43a0-9ac9-bc5baa2963df None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:13.022568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00aba36-83bc-49e0-b98b-023db2d0ba16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:13.023179 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00aba36-83bc-49e0-b98b-023db2d0ba16 None admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:13.023456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00aba36-83bc-49e0-b98b-023db2d0ba16 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:13.023727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00aba36-83bc-49e0-b98b-023db2d0ba16 None admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:13.024360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00aba36-83bc-49e0-b98b-023db2d0ba16 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:13.025774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00aba36-83bc-49e0-b98b-023db2d0ba16 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:13.052317 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 563/1134] 10.222.0.33 () {60 vars in 1141 bytes} [Sat Aug 6 20:40:12 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:40:15.306808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd6cbd-e20b-40be-a7bb-c6773f6510dc None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:15.307363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd6cbd-e20b-40be-a7bb-c6773f6510dc None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:15.307363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd6cbd-e20b-40be-a7bb-c6773f6510dc None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:15.308659 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 572/1135] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:40:15.313761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e611643-99f6-40cb-8bb6-0f9101bfa1a1 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:15.314716 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e611643-99f6-40cb-8bb6-0f9101bfa1a1 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:15.315144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e611643-99f6-40cb-8bb6-0f9101bfa1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:15.333253 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-5e611643-99f6-40cb-8bb6-0f9101bfa1a1 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:15.334423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5e611643-99f6-40cb-8bb6-0f9101bfa1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:15.351108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:15.400362 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 564/1136] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:40:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:40:15.426818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd6cbd-e20b-40be-a7bb-c6773f6510dc None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:15.523737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd6cbd-e20b-40be-a7bb-c6773f6510dc None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:15.556247 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68372d37-6a5d-4ce0-a927-05f0afd37f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:15.556910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68372d37-6a5d-4ce0-a927-05f0afd37f2a None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:15.557132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68372d37-6a5d-4ce0-a927-05f0afd37f2a None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:15.557401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68372d37-6a5d-4ce0-a927-05f0afd37f2a None admin] PATH_INFO: `/v3/domains/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:15.558486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68372d37-6a5d-4ce0-a927-05f0afd37f2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:15.559919 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68372d37-6a5d-4ce0-a927-05f0afd37f2a None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:15.561427 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 573/1137] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:40:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:15.567807 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e611643-99f6-40cb-8bb6-0f9101bfa1a1 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:15.661277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e611643-99f6-40cb-8bb6-0f9101bfa1a1 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:15.696275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62e498-355a-47e4-bb6b-a388d370630e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:15.696876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62e498-355a-47e4-bb6b-a388d370630e None admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:15.697153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62e498-355a-47e4-bb6b-a388d370630e None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:15.697423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62e498-355a-47e4-bb6b-a388d370630e None admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:15.698064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62e498-355a-47e4-bb6b-a388d370630e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:15.699520 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62e498-355a-47e4-bb6b-a388d370630e None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:15.721137 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 565/1138] 10.222.0.33 () {60 vars in 1132 bytes} [Sat Aug 6 20:40:15 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:40:17.982782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7cd6a-20ea-4ca3-a8e9-7036438082f1 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:17.983317 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7cd6a-20ea-4ca3-a8e9-7036438082f1 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:17.983317 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7cd6a-20ea-4ca3-a8e9-7036438082f1 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:17.984656 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 574/1139] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:40:17.990315 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662c50e-c4f7-4916-8b23-f9411a8e5769 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:17.990764 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662c50e-c4f7-4916-8b23-f9411a8e5769 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:17.990915 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662c50e-c4f7-4916-8b23-f9411a8e5769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:18.008648 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-2662c50e-c4f7-4916-8b23-f9411a8e5769 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:18.009820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2662c50e-c4f7-4916-8b23-f9411a8e5769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:18.012504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:18.075689 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 566/1140] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:40:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:40:18.104754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7cd6a-20ea-4ca3-a8e9-7036438082f1 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:18.145041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:18.204086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7cd6a-20ea-4ca3-a8e9-7036438082f1 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:18.238619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8579ff-f888-41ee-a00e-90e1f0efc5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:18.239171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8579ff-f888-41ee-a00e-90e1f0efc5f9 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:18.239446 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8579ff-f888-41ee-a00e-90e1f0efc5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:18.239713 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8579ff-f888-41ee-a00e-90e1f0efc5f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:18.249442 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8579ff-f888-41ee-a00e-90e1f0efc5f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:40:18.254858 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-7d8579ff-f888-41ee-a00e-90e1f0efc5f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:40:18.254858 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:40:18.254858 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:40:18.254858 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:40:18.254858 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:40:18.254858 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:40:18.254858 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:40:18.254858 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:40:18.254858 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:40:18.254858 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:40:18.254858 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:40:18.254858 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:40:18.254858 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:40:18.254858 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:40:18.254858 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:40:18.254858 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:40:18.255957 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:40:18.255957 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:40:18.255957 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:40:18.255957 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:40:18.255957 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:40:18.255957 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:40:18.255957 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:40:18.255957 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:40:18.255957 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:40:18.255957 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:40:18.255957 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:40:18.255957 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:40:18.255957 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:40:18.255957 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:40:18.255957 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:40:18.255957 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:40:18.257013 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:40:18.257013 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:40:18.257013 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:40:18.257013 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:40:18.257013 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:40:18.257013 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:40:18.257013 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:40:18.257013 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:40:18.257013 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:40:18.257013 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:40:18.257013 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:40:18.257013 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:40:18.257013 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 575/1141] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Aug 6 20:40:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:40:18.262107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662c50e-c4f7-4916-8b23-f9411a8e5769 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:18.358699 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662c50e-c4f7-4916-8b23-f9411a8e5769 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:18.393361 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de102b2b-eff1-4a80-a1d7-9efb87d96d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:18.394081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de102b2b-eff1-4a80-a1d7-9efb87d96d80 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:18.394362 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de102b2b-eff1-4a80-a1d7-9efb87d96d80 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:18.394674 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de102b2b-eff1-4a80-a1d7-9efb87d96d80 None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:18.395333 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de102b2b-eff1-4a80-a1d7-9efb87d96d80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:40:18.395636 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de102b2b-eff1-4a80-a1d7-9efb87d96d80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:18.398190 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de102b2b-eff1-4a80-a1d7-9efb87d96d80 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:18.408630 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 567/1142] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:40:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:18.414485 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8579ff-f888-41ee-a00e-90e1f0efc5f9 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:18.509317 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:18.512972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8579ff-f888-41ee-a00e-90e1f0efc5f9 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:18.546013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4f131-fa78-4c72-a959-f9a9e67fb280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:18.546682 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4f131-fa78-4c72-a959-f9a9e67fb280 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:18.546962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4f131-fa78-4c72-a959-f9a9e67fb280 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:18.547235 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4f131-fa78-4c72-a959-f9a9e67fb280 None admin] PATH_INFO: `/v3/users/5a6a54be49b949769fb64cd08afcd2f4` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:18.560714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af4f131-fa78-4c72-a959-f9a9e67fb280 None admin] RBAC: Authorizing `identity:get_user(user_id=5a6a54be49b949769fb64cd08afcd2f4)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:18.562136 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af4f131-fa78-4c72-a959-f9a9e67fb280 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:18.564384 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 576/1143] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:40:18 2022] GET /identity/v3/users/5a6a54be49b949769fb64cd08afcd2f4 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:18.570177 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de102b2b-eff1-4a80-a1d7-9efb87d96d80 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:18.572974 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:18.668465 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de102b2b-eff1-4a80-a1d7-9efb87d96d80 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:18.701630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effeac7-684a-4201-9bf0-1bee8f60e06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:18.702212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effeac7-684a-4201-9bf0-1bee8f60e06e None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:18.702483 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effeac7-684a-4201-9bf0-1bee8f60e06e None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:18.702776 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effeac7-684a-4201-9bf0-1bee8f60e06e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:18.766641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4effeac7-684a-4201-9bf0-1bee8f60e06e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:18.767972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4effeac7-684a-4201-9bf0-1bee8f60e06e None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:18.769663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:18.864699 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 568/1144] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:40:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 20:40:18.870660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4f131-fa78-4c72-a959-f9a9e67fb280 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:18.968937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4f131-fa78-4c72-a959-f9a9e67fb280 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:19.002531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2b206-5d77-431e-93bf-c9ebb8ef36fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:19.003165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2b206-5d77-431e-93bf-c9ebb8ef36fe None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:19.003439 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2b206-5d77-431e-93bf-c9ebb8ef36fe None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:19.003706 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2b206-5d77-431e-93bf-c9ebb8ef36fe None admin] PATH_INFO: `/v3/projects/009c6f1a72bb4c5bad35650030a0fede` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:19.004789 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee2b206-5d77-431e-93bf-c9ebb8ef36fe None admin] RBAC: Authorizing `identity:get_project(project_id=009c6f1a72bb4c5bad35650030a0fede)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:19.006190 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee2b206-5d77-431e-93bf-c9ebb8ef36fe None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:19.007826 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 577/1145] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:40:18 2022] GET /identity/v3/projects/009c6f1a72bb4c5bad35650030a0fede => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:19.013877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effeac7-684a-4201-9bf0-1bee8f60e06e None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:19.108321 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effeac7-684a-4201-9bf0-1bee8f60e06e None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:19.109719 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:19.142605 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0aacec-c1f7-4468-8f7c-3ee42e02ae85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:19.143192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0aacec-c1f7-4468-8f7c-3ee42e02ae85 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:19.143466 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0aacec-c1f7-4468-8f7c-3ee42e02ae85 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:19.143735 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0aacec-c1f7-4468-8f7c-3ee42e02ae85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:19.144441 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0aacec-c1f7-4468-8f7c-3ee42e02ae85 None admin] RBAC: Adding query filter params (role.id=ab245eea8a714462a00c4546309de9c9, scope.project.id=009c6f1a72bb4c5bad35650030a0fede, user.id=5a6a54be49b949769fb64cd08afcd2f4) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:40:19.144745 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0aacec-c1f7-4468-8f7c-3ee42e02ae85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:19.146163 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0aacec-c1f7-4468-8f7c-3ee42e02ae85 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:19.151312 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 569/1146] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:40:19 2022] GET /identity/v3/role_assignments?user.id=5a6a54be49b949769fb64cd08afcd2f4&scope.project.id=009c6f1a72bb4c5bad35650030a0fede&role.id=ab245eea8a714462a00c4546309de9c9 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:21.347304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4e2d5-7831-4300-a864-52015b4d1b3b None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:21.347857 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4e2d5-7831-4300-a864-52015b4d1b3b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:21.347857 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4e2d5-7831-4300-a864-52015b4d1b3b None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:21.349157 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 578/1147] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:40:21.354399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16b7e2-17f9-444c-ad67-b2ddbb09a655 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:21.354813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16b7e2-17f9-444c-ad67-b2ddbb09a655 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:21.354982 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16b7e2-17f9-444c-ad67-b2ddbb09a655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:21.373054 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-9f16b7e2-17f9-444c-ad67-b2ddbb09a655 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:21.374216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9f16b7e2-17f9-444c-ad67-b2ddbb09a655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:21.438017 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 570/1148] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:40:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:40:21.461696 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4e2d5-7831-4300-a864-52015b4d1b3b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:21.486658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:21.560479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4e2d5-7831-4300-a864-52015b4d1b3b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:21.594109 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca9cb5-6b4e-4e0d-9f91-0b150da49cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:21.594969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca9cb5-6b4e-4e0d-9f91-0b150da49cf5 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:21.595253 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca9cb5-6b4e-4e0d-9f91-0b150da49cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:21.595521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca9cb5-6b4e-4e0d-9f91-0b150da49cf5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:21.605269 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca9cb5-6b4e-4e0d-9f91-0b150da49cf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:40:21.609903 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-ebca9cb5-6b4e-4e0d-9f91-0b150da49cf5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:40:21.609903 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:40:21.609903 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:40:21.609903 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:40:21.609903 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:40:21.609903 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:40:21.609903 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:40:21.609903 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:40:21.609903 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:40:21.609903 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:40:21.609903 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:40:21.609903 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:40:21.609903 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:40:21.609903 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:40:21.609903 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:40:21.609903 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:40:21.616488 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:40:21.616488 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:40:21.616488 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:40:21.616488 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:40:21.616488 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:40:21.616488 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:40:21.616488 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:40:21.616488 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:40:21.616488 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:40:21.616488 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:40:21.616488 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:40:21.616488 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:40:21.616488 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:40:21.616488 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:40:21.616488 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:40:21.616488 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:40:21.617608 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:40:21.617608 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:40:21.617608 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:40:21.617608 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:40:21.617608 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:40:21.617608 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:40:21.617608 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:40:21.617608 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:40:21.617608 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:40:21.617608 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:40:21.617608 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:40:21.617608 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:40:21.617608 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 579/1149] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Aug 6 20:40:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:40:21.618484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16b7e2-17f9-444c-ad67-b2ddbb09a655 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:21.710392 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:21.716429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16b7e2-17f9-444c-ad67-b2ddbb09a655 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:21.749152 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247c4d4-5b8f-46cc-ad27-90f5474e2830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:21.749740 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247c4d4-5b8f-46cc-ad27-90f5474e2830 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:21.750014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247c4d4-5b8f-46cc-ad27-90f5474e2830 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:21.750280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247c4d4-5b8f-46cc-ad27-90f5474e2830 None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:21.751049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247c4d4-5b8f-46cc-ad27-90f5474e2830 None admin] RBAC: Adding query filter params (name=admin) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:40:21.751342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247c4d4-5b8f-46cc-ad27-90f5474e2830 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:21.752696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247c4d4-5b8f-46cc-ad27-90f5474e2830 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:21.760405 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 571/1150] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:40:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:40:21.766194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca9cb5-6b4e-4e0d-9f91-0b150da49cf5 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:21.847833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:21.863784 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca9cb5-6b4e-4e0d-9f91-0b150da49cf5 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:21.895696 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9747a6-b397-438d-bae0-4bdb1bb4ab7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:21.896303 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9747a6-b397-438d-bae0-4bdb1bb4ab7f None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:21.896579 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9747a6-b397-438d-bae0-4bdb1bb4ab7f None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:21.896848 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9747a6-b397-438d-bae0-4bdb1bb4ab7f None admin] PATH_INFO: `/v3/users/5a6a54be49b949769fb64cd08afcd2f4` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:21.897931 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9747a6-b397-438d-bae0-4bdb1bb4ab7f None admin] RBAC: Authorizing `identity:get_user(user_id=5a6a54be49b949769fb64cd08afcd2f4)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:21.899380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9747a6-b397-438d-bae0-4bdb1bb4ab7f None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:21.900912 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 580/1151] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:40:21 2022] GET /identity/v3/users/5a6a54be49b949769fb64cd08afcd2f4 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:21.906594 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247c4d4-5b8f-46cc-ad27-90f5474e2830 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:22.004274 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247c4d4-5b8f-46cc-ad27-90f5474e2830 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:22.036352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78cbc7-21ae-4125-bc19-0fe0c70f6d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:22.036968 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78cbc7-21ae-4125-bc19-0fe0c70f6d08 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:22.037246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78cbc7-21ae-4125-bc19-0fe0c70f6d08 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:22.037517 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78cbc7-21ae-4125-bc19-0fe0c70f6d08 None admin] PATH_INFO: `/v3/projects/009c6f1a72bb4c5bad35650030a0fede` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:22.038683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78cbc7-21ae-4125-bc19-0fe0c70f6d08 None admin] RBAC: Authorizing `identity:get_project(project_id=009c6f1a72bb4c5bad35650030a0fede)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:22.040100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78cbc7-21ae-4125-bc19-0fe0c70f6d08 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:22.041696 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 572/1152] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:40:21 2022] GET /identity/v3/projects/009c6f1a72bb4c5bad35650030a0fede => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:22.047510 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9747a6-b397-438d-bae0-4bdb1bb4ab7f None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:22.144449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9747a6-b397-438d-bae0-4bdb1bb4ab7f None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:22.177451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b4996-741b-454a-8bdd-41c2c632e16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:22.178089 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b4996-741b-454a-8bdd-41c2c632e16d None admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:22.178363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b4996-741b-454a-8bdd-41c2c632e16d None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:22.178920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b4996-741b-454a-8bdd-41c2c632e16d None admin] PATH_INFO: `/v3/projects/009c6f1a72bb4c5bad35650030a0fede/users/5a6a54be49b949769fb64cd08afcd2f4/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:22.180764 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b4996-741b-454a-8bdd-41c2c632e16d None admin] RBAC: Authorizing `identity:create_grant(project_id=009c6f1a72bb4c5bad35650030a0fede, user_id=5a6a54be49b949769fb64cd08afcd2f4, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:22.182166 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b4996-741b-454a-8bdd-41c2c632e16d None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:22.195809 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 581/1153] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Aug 6 20:40:22 2022] PUT /identity/v3/projects/009c6f1a72bb4c5bad35650030a0fede/users/5a6a54be49b949769fb64cd08afcd2f4/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:40:24.389589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f020cbc-d13f-46de-b526-8e84e031839e None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:24.390228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f020cbc-d13f-46de-b526-8e84e031839e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:24.390228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f020cbc-d13f-46de-b526-8e84e031839e None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:24.391424 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 573/1154] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:40:24.396604 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4098bb-1999-4682-ac35-2f2906ed77bb None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:24.397051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4098bb-1999-4682-ac35-2f2906ed77bb None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:24.397143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4098bb-1999-4682-ac35-2f2906ed77bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:24.414833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-7b4098bb-1999-4682-ac35-2f2906ed77bb None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:24.416020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7b4098bb-1999-4682-ac35-2f2906ed77bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:24.424225 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:24.482620 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 582/1155] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:40:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:40:24.508041 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f020cbc-d13f-46de-b526-8e84e031839e None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:24.534577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:24.606532 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f020cbc-d13f-46de-b526-8e84e031839e None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:24.637960 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658fa20-86b6-4f28-8692-cfc6d92a84bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:24.638598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658fa20-86b6-4f28-8692-cfc6d92a84bf None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:24.638876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658fa20-86b6-4f28-8692-cfc6d92a84bf None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:24.639142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658fa20-86b6-4f28-8692-cfc6d92a84bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:24.649354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658fa20-86b6-4f28-8692-cfc6d92a84bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:40:24.654008 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-8658fa20-86b6-4f28-8692-cfc6d92a84bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:40:24.654008 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:40:24.654008 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:40:24.654008 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:40:24.654008 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:40:24.654008 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:40:24.654008 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:40:24.654008 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:40:24.654008 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:40:24.654008 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:40:24.654008 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:40:24.654008 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:40:24.654008 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:40:24.654008 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:40:24.654008 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:40:24.654008 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:40:24.655060 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:40:24.655060 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:40:24.655060 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:40:24.655060 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:40:24.655060 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:40:24.655060 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:40:24.655060 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:40:24.655060 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:40:24.655060 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:40:24.655060 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:40:24.655060 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:40:24.655060 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:40:24.655060 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:40:24.655060 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:40:24.655060 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:40:24.655060 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:40:24.656308 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:40:24.656308 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:40:24.656308 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:40:24.656308 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:40:24.656308 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:40:24.656308 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:40:24.656308 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:40:24.656308 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:40:24.656308 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:40:24.656308 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:40:24.656308 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:40:24.656308 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:40:24.656308 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 574/1156] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Aug 6 20:40:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:40:24.661604 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4098bb-1999-4682-ac35-2f2906ed77bb None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:24.757580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4098bb-1999-4682-ac35-2f2906ed77bb None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:24.790438 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e52401-f40c-4df9-95ae-826b99bede2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:24.791065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e52401-f40c-4df9-95ae-826b99bede2f None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:24.791346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e52401-f40c-4df9-95ae-826b99bede2f None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:24.791619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e52401-f40c-4df9-95ae-826b99bede2f None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:24.792277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e52401-f40c-4df9-95ae-826b99bede2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:40:24.792580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e52401-f40c-4df9-95ae-826b99bede2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:24.793933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e52401-f40c-4df9-95ae-826b99bede2f None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:24.801843 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 583/1157] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:40:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:24.807857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658fa20-86b6-4f28-8692-cfc6d92a84bf None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:24.889642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:24.904794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658fa20-86b6-4f28-8692-cfc6d92a84bf None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:24.937315 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11feed85-b0be-480e-b839-26807bbb7c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:24.937921 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11feed85-b0be-480e-b839-26807bbb7c67 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:24.938835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11feed85-b0be-480e-b839-26807bbb7c67 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:24.939108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11feed85-b0be-480e-b839-26807bbb7c67 None admin] PATH_INFO: `/v3/users/5a6a54be49b949769fb64cd08afcd2f4` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:24.940215 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11feed85-b0be-480e-b839-26807bbb7c67 None admin] RBAC: Authorizing `identity:get_user(user_id=5a6a54be49b949769fb64cd08afcd2f4)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:24.941636 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11feed85-b0be-480e-b839-26807bbb7c67 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:24.943285 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 575/1158] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:40:24 2022] GET /identity/v3/users/5a6a54be49b949769fb64cd08afcd2f4 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:24.948901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e52401-f40c-4df9-95ae-826b99bede2f None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:24.952675 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:25.046439 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e52401-f40c-4df9-95ae-826b99bede2f None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:25.079931 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd67be7-eb05-49c2-a3b1-2b652e9a389d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:25.080517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd67be7-eb05-49c2-a3b1-2b652e9a389d None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:25.080798 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd67be7-eb05-49c2-a3b1-2b652e9a389d None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:25.081070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd67be7-eb05-49c2-a3b1-2b652e9a389d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:25.145943 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd67be7-eb05-49c2-a3b1-2b652e9a389d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:25.147407 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd67be7-eb05-49c2-a3b1-2b652e9a389d None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:25.149948 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:25.248670 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 584/1159] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:40:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 20:40:25.255471 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11feed85-b0be-480e-b839-26807bbb7c67 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:25.357010 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11feed85-b0be-480e-b839-26807bbb7c67 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:25.392735 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fd968-7657-4261-9805-08196d5b91cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:25.395566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fd968-7657-4261-9805-08196d5b91cb None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:25.395566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fd968-7657-4261-9805-08196d5b91cb None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:25.395566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fd968-7657-4261-9805-08196d5b91cb None admin] PATH_INFO: `/v3/projects/009c6f1a72bb4c5bad35650030a0fede` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:25.396557 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fd968-7657-4261-9805-08196d5b91cb None admin] RBAC: Authorizing `identity:get_project(project_id=009c6f1a72bb4c5bad35650030a0fede)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:25.398005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fd968-7657-4261-9805-08196d5b91cb None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:25.399685 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 576/1160] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:40:25 2022] GET /identity/v3/projects/009c6f1a72bb4c5bad35650030a0fede => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:25.405785 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd67be7-eb05-49c2-a3b1-2b652e9a389d None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:25.509953 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd67be7-eb05-49c2-a3b1-2b652e9a389d None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:25.512159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:25.544053 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f69422-e498-4398-a204-dd878b8fe833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:25.544649 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f69422-e498-4398-a204-dd878b8fe833 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:25.544927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f69422-e498-4398-a204-dd878b8fe833 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:25.545197 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f69422-e498-4398-a204-dd878b8fe833 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:25.545914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f69422-e498-4398-a204-dd878b8fe833 None admin] RBAC: Adding query filter params (role.id=ab245eea8a714462a00c4546309de9c9, scope.project.id=009c6f1a72bb4c5bad35650030a0fede, user.id=5a6a54be49b949769fb64cd08afcd2f4) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:40:25.546224 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f69422-e498-4398-a204-dd878b8fe833 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:25.548276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f69422-e498-4398-a204-dd878b8fe833 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:25.554265 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 585/1161] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:40:25 2022] GET /identity/v3/role_assignments?user.id=5a6a54be49b949769fb64cd08afcd2f4&scope.project.id=009c6f1a72bb4c5bad35650030a0fede&role.id=ab245eea8a714462a00c4546309de9c9 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:27.777508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab53cba-869c-4478-b4c9-d8ce0bc2d792 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:27.778070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab53cba-869c-4478-b4c9-d8ce0bc2d792 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:27.778070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab53cba-869c-4478-b4c9-d8ce0bc2d792 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:27.779392 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 577/1162] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:40:27.784790 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f615e5-eba4-47d7-bdf1-15f4dd72d7d3 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:27.785234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f615e5-eba4-47d7-bdf1-15f4dd72d7d3 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:27.785334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f615e5-eba4-47d7-bdf1-15f4dd72d7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:27.802776 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-95f615e5-eba4-47d7-bdf1-15f4dd72d7d3 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:27.804210 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-95f615e5-eba4-47d7-bdf1-15f4dd72d7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:27.868426 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 586/1163] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:40:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:40:27.892099 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab53cba-869c-4478-b4c9-d8ce0bc2d792 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:27.915345 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:27.989991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab53cba-869c-4478-b4c9-d8ce0bc2d792 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:28.022768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f32879-69b0-4fab-831a-d4bfed90a0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:28.023353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f32879-69b0-4fab-831a-d4bfed90a0fd None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:28.023632 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f32879-69b0-4fab-831a-d4bfed90a0fd None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:28.023901 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f32879-69b0-4fab-831a-d4bfed90a0fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:28.087227 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f32879-69b0-4fab-831a-d4bfed90a0fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:28.088656 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f32879-69b0-4fab-831a-d4bfed90a0fd None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:28.111272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:28.183192 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 578/1164] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:40:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 20:40:28.189872 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f615e5-eba4-47d7-bdf1-15f4dd72d7d3 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:28.282119 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:28.286038 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f615e5-eba4-47d7-bdf1-15f4dd72d7d3 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:28.319346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1553f-d264-445b-950a-ccce920f7b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:28.319958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1553f-d264-445b-950a-ccce920f7b55 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:28.320230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1553f-d264-445b-950a-ccce920f7b55 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:28.320500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1553f-d264-445b-950a-ccce920f7b55 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:28.327128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1553f-d264-445b-950a-ccce920f7b55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:28.328759 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1553f-d264-445b-950a-ccce920f7b55 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:28.339887 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-ccf1553f-d264-445b-950a-ccce920f7b55 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 06 20:40:28.339887 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:40:28.339887 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 06 20:40:28.339887 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 06 20:40:28.339887 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:40:28.339887 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:40:28.339887 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:40:28.339887 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:40:28.339887 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 06 20:40:28.339887 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:40:28.339887 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:40:28.339887 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:40:28.339887 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:40:28.339887 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:40:28.339887 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:40:28.339887 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:40:28.339887 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:40:28.341134 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:40:28.341134 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:40:28.341134 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:40:28.341134 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:40:28.341134 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:40:28.341134 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:40:28.341134 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:40:28.341134 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:40:28.341134 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:40:28.341134 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:40:28.341134 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:40:28.341134 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:40:28.341134 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:40:28.341134 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:40:28.341134 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:40:28.341134 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:40:28.342227 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:40:28.342227 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:40:28.342227 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:40:28.342227 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:40:28.342227 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:40:28.342227 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:40:28.342227 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:40:28.342227 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:40:28.342227 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:40:28.342227 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:40:28.342227 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 06 20:40:28.342227 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:40:28.342227 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 06 20:40:28.342227 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:40:28.342227 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 587/1165] 10.222.0.33 () {56 vars in 1117 bytes} [Sat Aug 6 20:40:28 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:40:28.347047 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f32879-69b0-4fab-831a-d4bfed90a0fd None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:28.443314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f32879-69b0-4fab-831a-d4bfed90a0fd None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:28.464549 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:28.476624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfaf5bb-7ff2-447b-b8be-5b5e3768cd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:28.477214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfaf5bb-7ff2-447b-b8be-5b5e3768cd85 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:28.477487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfaf5bb-7ff2-447b-b8be-5b5e3768cd85 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:28.477751 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfaf5bb-7ff2-447b-b8be-5b5e3768cd85 None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:28.478377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfaf5bb-7ff2-447b-b8be-5b5e3768cd85 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:40:28.478701 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfaf5bb-7ff2-447b-b8be-5b5e3768cd85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:28.480051 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfaf5bb-7ff2-447b-b8be-5b5e3768cd85 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:28.487475 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 579/1166] 10.222.0.33 () {56 vars in 1115 bytes} [Sat Aug 6 20:40:28 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:30.681601 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566a261-401e-4271-9ed8-022d1e24a4b2 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:30.682106 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566a261-401e-4271-9ed8-022d1e24a4b2 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:30.682217 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566a261-401e-4271-9ed8-022d1e24a4b2 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:30.683495 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 588/1167] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:40:30.689326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0430e-f204-4fee-9297-f038159c9596 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:30.689757 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0430e-f204-4fee-9297-f038159c9596 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:30.689860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0430e-f204-4fee-9297-f038159c9596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:30.712888 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-0ca0430e-f204-4fee-9297-f038159c9596 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:30.714447 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0ca0430e-f204-4fee-9297-f038159c9596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:30.788446 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 580/1168] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:40:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:40:30.814374 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566a261-401e-4271-9ed8-022d1e24a4b2 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:30.925908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566a261-401e-4271-9ed8-022d1e24a4b2 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:30.961991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e8ba3-e2cd-464d-947b-6bcad9c5bf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:30.962997 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e8ba3-e2cd-464d-947b-6bcad9c5bf0f None admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:30.963389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e8ba3-e2cd-464d-947b-6bcad9c5bf0f None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:30.963667 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e8ba3-e2cd-464d-947b-6bcad9c5bf0f None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:30.964326 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e8ba3-e2cd-464d-947b-6bcad9c5bf0f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:30.965678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e8ba3-e2cd-464d-947b-6bcad9c5bf0f None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:30.982167 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 589/1169] 10.222.0.33 () {60 vars in 1138 bytes} [Sat Aug 6 20:40:30 2022] POST /identity/v3/domains => generated 267 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:40:33.305270 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699991e-6bd2-4354-9ff1-919866af7c13 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:33.305832 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699991e-6bd2-4354-9ff1-919866af7c13 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:33.305832 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699991e-6bd2-4354-9ff1-919866af7c13 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:33.307159 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 581/1170] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:40:33.312265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefaa74-4f8d-4865-bb74-82535af2b4fc None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:33.313243 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefaa74-4f8d-4865-bb74-82535af2b4fc None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:33.313395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefaa74-4f8d-4865-bb74-82535af2b4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:33.331451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-afefaa74-4f8d-4865-bb74-82535af2b4fc None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:33.332635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-afefaa74-4f8d-4865-bb74-82535af2b4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:33.345957 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:33.399101 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 590/1171] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:40:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:40:33.424362 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699991e-6bd2-4354-9ff1-919866af7c13 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:33.524340 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699991e-6bd2-4354-9ff1-919866af7c13 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:33.540231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:33.558653 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c622c-b47c-4681-bfc5-262ce7ea3745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:33.559205 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c622c-b47c-4681-bfc5-262ce7ea3745 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:33.559483 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c622c-b47c-4681-bfc5-262ce7ea3745 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:33.559781 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c622c-b47c-4681-bfc5-262ce7ea3745 None admin] PATH_INFO: `/v3/domains/4632a4eef8d5466fb92f1657d6f693e4` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:33.570978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c622c-b47c-4681-bfc5-262ce7ea3745 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4632a4eef8d5466fb92f1657d6f693e4)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:33.572419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c622c-b47c-4681-bfc5-262ce7ea3745 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:33.573974 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 582/1172] 10.222.0.33 () {56 vars in 1183 bytes} [Sat Aug 6 20:40:33 2022] GET /identity/v3/domains/4632a4eef8d5466fb92f1657d6f693e4 => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:33.579972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afefaa74-4f8d-4865-bb74-82535af2b4fc None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:33.675154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afefaa74-4f8d-4865-bb74-82535af2b4fc None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:33.710095 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015e513-afe2-4e31-8701-67eb273820ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:33.710727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015e513-afe2-4e31-8701-67eb273820ef None admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:33.711009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015e513-afe2-4e31-8701-67eb273820ef None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:33.711281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015e513-afe2-4e31-8701-67eb273820ef None admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:33.711909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015e513-afe2-4e31-8701-67eb273820ef None admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:33.713317 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015e513-afe2-4e31-8701-67eb273820ef None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:33.733693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:33.741067 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 591/1173] 10.222.0.33 () {60 vars in 1141 bytes} [Sat Aug 6 20:40:33 2022] POST /identity/v3/projects => generated 361 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:40:35.970192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcd8a6-1462-46a4-9de1-e039a06365e6 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:35.970778 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcd8a6-1462-46a4-9de1-e039a06365e6 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:35.970778 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcd8a6-1462-46a4-9de1-e039a06365e6 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:35.972134 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 583/1174] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:40:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:40:35.977259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1fb18-fb3f-42db-8e22-a65c869f2eaf None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:35.977695 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1fb18-fb3f-42db-8e22-a65c869f2eaf None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:35.977795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1fb18-fb3f-42db-8e22-a65c869f2eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:35.996044 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b1d1fb18-fb3f-42db-8e22-a65c869f2eaf None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:35.997217 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b1d1fb18-fb3f-42db-8e22-a65c869f2eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:36.061462 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 592/1175] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:40:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:40:36.086803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcd8a6-1462-46a4-9de1-e039a06365e6 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:36.188151 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcd8a6-1462-46a4-9de1-e039a06365e6 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:36.221268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef2549-ff21-4c42-a91f-20dd8a947268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:36.221813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef2549-ff21-4c42-a91f-20dd8a947268 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:36.222093 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef2549-ff21-4c42-a91f-20dd8a947268 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:36.222365 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef2549-ff21-4c42-a91f-20dd8a947268 None admin] PATH_INFO: `/v3/domains/4632a4eef8d5466fb92f1657d6f693e4` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:36.223497 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef2549-ff21-4c42-a91f-20dd8a947268 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4632a4eef8d5466fb92f1657d6f693e4)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:36.224931 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef2549-ff21-4c42-a91f-20dd8a947268 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:36.226477 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 584/1176] 10.222.0.33 () {56 vars in 1183 bytes} [Sat Aug 6 20:40:36 2022] GET /identity/v3/domains/4632a4eef8d5466fb92f1657d6f693e4 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:36.232355 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1fb18-fb3f-42db-8e22-a65c869f2eaf None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:36.326893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1fb18-fb3f-42db-8e22-a65c869f2eaf None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:36.356398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:36.365389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19815d4-f7e8-4c8a-97c1-f335d0efc3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:36.365996 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19815d4-f7e8-4c8a-97c1-f335d0efc3f1 None admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:36.366275 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19815d4-f7e8-4c8a-97c1-f335d0efc3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:36.366573 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19815d4-f7e8-4c8a-97c1-f335d0efc3f1 None admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:36.367212 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19815d4-f7e8-4c8a-97c1-f335d0efc3f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:36.368628 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19815d4-f7e8-4c8a-97c1-f335d0efc3f1 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:36.388977 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 593/1177] 10.222.0.33 () {60 vars in 1132 bytes} [Sat Aug 6 20:40:36 2022] POST /identity/v3/users => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:40:38.664743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d9cc2-b7a5-4826-922b-d51fe04edcc2 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:38.665300 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d9cc2-b7a5-4826-922b-d51fe04edcc2 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:38.665300 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d9cc2-b7a5-4826-922b-d51fe04edcc2 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:38.666806 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 585/1178] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:40:38.672640 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3a659-84c1-48bb-8485-32d95e3f8c9d None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:38.673167 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3a659-84c1-48bb-8485-32d95e3f8c9d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:38.673167 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3a659-84c1-48bb-8485-32d95e3f8c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:38.691944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-eda3a659-84c1-48bb-8485-32d95e3f8c9d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:38.693131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-eda3a659-84c1-48bb-8485-32d95e3f8c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:38.758716 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 594/1179] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:40:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:40:38.783319 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d9cc2-b7a5-4826-922b-d51fe04edcc2 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:38.829564 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:38.882670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d9cc2-b7a5-4826-922b-d51fe04edcc2 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:38.916048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e86af-5851-465e-884a-b26cfeb6fc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:38.916591 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e86af-5851-465e-884a-b26cfeb6fc84 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:38.916865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e86af-5851-465e-884a-b26cfeb6fc84 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:38.917131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e86af-5851-465e-884a-b26cfeb6fc84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:38.927436 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e86af-5851-465e-884a-b26cfeb6fc84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:40:38.932330 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-712e86af-5851-465e-884a-b26cfeb6fc84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:40:38.932330 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:40:38.932330 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:40:38.932330 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:40:38.932330 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:40:38.932330 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:40:38.932330 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:40:38.932330 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:40:38.932330 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:40:38.932330 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:40:38.932330 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:40:38.932330 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:40:38.932330 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:40:38.932330 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:40:38.932330 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:40:38.932330 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:40:38.933411 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:40:38.933411 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:40:38.933411 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:40:38.933411 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:40:38.933411 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:40:38.933411 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:40:38.933411 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:40:38.933411 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:40:38.933411 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:40:38.933411 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:40:38.933411 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:40:38.933411 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:40:38.933411 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:40:38.933411 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:40:38.933411 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:40:38.933411 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:40:38.934454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:40:38.934454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:40:38.934454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:40:38.934454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:40:38.934454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:40:38.934454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:40:38.934454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:40:38.934454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:40:38.934454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:40:38.934454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:40:38.934454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:40:38.934454 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:40:38.934454 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 586/1180] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Aug 6 20:40:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:40:38.940135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3a659-84c1-48bb-8485-32d95e3f8c9d None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:39.036909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3a659-84c1-48bb-8485-32d95e3f8c9d None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:39.053447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:39.071246 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24cc2c6-8a3c-4f8a-bc40-7aa5337b349a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:39.071841 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24cc2c6-8a3c-4f8a-bc40-7aa5337b349a None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:39.072116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24cc2c6-8a3c-4f8a-bc40-7aa5337b349a None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:39.072385 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24cc2c6-8a3c-4f8a-bc40-7aa5337b349a None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:39.073034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24cc2c6-8a3c-4f8a-bc40-7aa5337b349a None admin] RBAC: Adding query filter params (name=admin) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:40:39.073333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24cc2c6-8a3c-4f8a-bc40-7aa5337b349a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:39.074748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24cc2c6-8a3c-4f8a-bc40-7aa5337b349a None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:39.082766 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 595/1181] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:40:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:39.088506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e86af-5851-465e-884a-b26cfeb6fc84 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:39.185546 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e86af-5851-465e-884a-b26cfeb6fc84 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:39.187808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:39.219138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a94ee-283f-4076-87a2-35e5bcf51841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:39.219756 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a94ee-283f-4076-87a2-35e5bcf51841 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:39.220039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a94ee-283f-4076-87a2-35e5bcf51841 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:39.220314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a94ee-283f-4076-87a2-35e5bcf51841 None admin] PATH_INFO: `/v3/users/68bb86a2e7ff4478beed6ed90d64ce2f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:39.233626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6a94ee-283f-4076-87a2-35e5bcf51841 None admin] RBAC: Authorizing `identity:get_user(user_id=68bb86a2e7ff4478beed6ed90d64ce2f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:39.235797 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6a94ee-283f-4076-87a2-35e5bcf51841 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:39.237428 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 587/1182] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:40:39 2022] GET /identity/v3/users/68bb86a2e7ff4478beed6ed90d64ce2f => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:39.243354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24cc2c6-8a3c-4f8a-bc40-7aa5337b349a None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:39.341054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24cc2c6-8a3c-4f8a-bc40-7aa5337b349a None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:39.375431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5729db-218f-4d73-ab0f-6fdfb4fe09c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:39.376032 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5729db-218f-4d73-ab0f-6fdfb4fe09c5 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:39.376314 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5729db-218f-4d73-ab0f-6fdfb4fe09c5 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:39.376612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5729db-218f-4d73-ab0f-6fdfb4fe09c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:39.421304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:39.444080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5729db-218f-4d73-ab0f-6fdfb4fe09c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:39.445468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5729db-218f-4d73-ab0f-6fdfb4fe09c5 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:39.541076 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 596/1183] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:40:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 20:40:39.547046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a94ee-283f-4076-87a2-35e5bcf51841 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:39.643901 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a94ee-283f-4076-87a2-35e5bcf51841 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:39.677435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b73cfa-b11f-4770-8c41-7c6737390008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:39.678317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b73cfa-b11f-4770-8c41-7c6737390008 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:39.678626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b73cfa-b11f-4770-8c41-7c6737390008 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:39.678903 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b73cfa-b11f-4770-8c41-7c6737390008 None admin] PATH_INFO: `/v3/projects/3846efee1ca04e1e996cde03e475be01` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:39.680008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b73cfa-b11f-4770-8c41-7c6737390008 None admin] RBAC: Authorizing `identity:get_project(project_id=3846efee1ca04e1e996cde03e475be01)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:39.681437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b73cfa-b11f-4770-8c41-7c6737390008 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:39.683094 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 588/1184] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:40:39 2022] GET /identity/v3/projects/3846efee1ca04e1e996cde03e475be01 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:39.689782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5729db-218f-4d73-ab0f-6fdfb4fe09c5 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:39.765111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:39.786805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5729db-218f-4d73-ab0f-6fdfb4fe09c5 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:39.820035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574712f-04e5-42b6-a776-21fb47e902ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:39.820627 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574712f-04e5-42b6-a776-21fb47e902ad None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:39.820908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574712f-04e5-42b6-a776-21fb47e902ad None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:39.821181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574712f-04e5-42b6-a776-21fb47e902ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:39.821895 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a574712f-04e5-42b6-a776-21fb47e902ad None admin] RBAC: Adding query filter params (role.id=ab245eea8a714462a00c4546309de9c9, scope.project.id=3846efee1ca04e1e996cde03e475be01, user.id=68bb86a2e7ff4478beed6ed90d64ce2f) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:40:39.822207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a574712f-04e5-42b6-a776-21fb47e902ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:39.823658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a574712f-04e5-42b6-a776-21fb47e902ad None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:39.829354 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 597/1185] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:40:39 2022] GET /identity/v3/role_assignments?user.id=68bb86a2e7ff4478beed6ed90d64ce2f&scope.project.id=3846efee1ca04e1e996cde03e475be01&role.id=ab245eea8a714462a00c4546309de9c9 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:42.042686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d98cb-ae65-4d39-9270-ae1e1541a6ed None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:42.043236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d98cb-ae65-4d39-9270-ae1e1541a6ed None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:42.043236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d98cb-ae65-4d39-9270-ae1e1541a6ed None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:42.044564 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 589/1186] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:40:42.049727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c451948-42cd-44d3-ae04-951531536c35 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:42.050159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c451948-42cd-44d3-ae04-951531536c35 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:42.050270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c451948-42cd-44d3-ae04-951531536c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:42.069281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-7c451948-42cd-44d3-ae04-951531536c35 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:42.070462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7c451948-42cd-44d3-ae04-951531536c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:42.135267 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 598/1187] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:40:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:40:42.159482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d98cb-ae65-4d39-9270-ae1e1541a6ed None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:42.189632 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:42.259094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d98cb-ae65-4d39-9270-ae1e1541a6ed None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:42.291812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a7802-7b5e-4392-bdf2-a2cd481686cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:42.292445 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a7802-7b5e-4392-bdf2-a2cd481686cd None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:42.292769 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a7802-7b5e-4392-bdf2-a2cd481686cd None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:42.292984 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a7802-7b5e-4392-bdf2-a2cd481686cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:42.303028 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a7802-7b5e-4392-bdf2-a2cd481686cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:40:42.307660 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-895a7802-7b5e-4392-bdf2-a2cd481686cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:40:42.307660 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:40:42.307660 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:40:42.307660 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:40:42.307660 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:40:42.307660 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:40:42.307660 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:40:42.307660 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:40:42.307660 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:40:42.307660 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:40:42.307660 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:40:42.307660 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:40:42.307660 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:40:42.307660 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:40:42.307660 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:40:42.307660 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:40:42.308768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:40:42.308768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:40:42.308768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:40:42.308768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:40:42.308768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:40:42.308768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:40:42.308768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:40:42.308768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:40:42.308768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:40:42.308768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:40:42.308768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:40:42.308768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:40:42.308768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:40:42.308768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:40:42.308768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:40:42.308768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:40:42.309908 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:40:42.309908 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:40:42.309908 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:40:42.309908 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:40:42.309908 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:40:42.309908 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:40:42.309908 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:40:42.309908 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:40:42.309908 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:40:42.309908 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:40:42.309908 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:40:42.309908 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:40:42.309908 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 590/1188] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Aug 6 20:40:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:40:42.315543 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c451948-42cd-44d3-ae04-951531536c35 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:42.383349 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:42.411743 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c451948-42cd-44d3-ae04-951531536c35 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:42.450406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7757ef-919d-4dc1-810b-e6a46ec4d303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:42.451043 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7757ef-919d-4dc1-810b-e6a46ec4d303 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:42.451321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7757ef-919d-4dc1-810b-e6a46ec4d303 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:42.451590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7757ef-919d-4dc1-810b-e6a46ec4d303 None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:42.452244 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7757ef-919d-4dc1-810b-e6a46ec4d303 None admin] RBAC: Adding query filter params (name=admin) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:40:42.452588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7757ef-919d-4dc1-810b-e6a46ec4d303 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:42.454109 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7757ef-919d-4dc1-810b-e6a46ec4d303 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:42.461812 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 599/1189] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:40:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:42.467663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a7802-7b5e-4392-bdf2-a2cd481686cd None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:42.559433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:42.569664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a7802-7b5e-4392-bdf2-a2cd481686cd None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:42.602193 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134dd30-eade-41d2-857d-12de8a5d9a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:42.602825 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134dd30-eade-41d2-857d-12de8a5d9a0c None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:42.603100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134dd30-eade-41d2-857d-12de8a5d9a0c None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:42.603369 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134dd30-eade-41d2-857d-12de8a5d9a0c None admin] PATH_INFO: `/v3/users/68bb86a2e7ff4478beed6ed90d64ce2f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:42.604472 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134dd30-eade-41d2-857d-12de8a5d9a0c None admin] RBAC: Authorizing `identity:get_user(user_id=68bb86a2e7ff4478beed6ed90d64ce2f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:42.605889 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134dd30-eade-41d2-857d-12de8a5d9a0c None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:42.607456 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 591/1190] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:40:42 2022] GET /identity/v3/users/68bb86a2e7ff4478beed6ed90d64ce2f => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:42.614125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7757ef-919d-4dc1-810b-e6a46ec4d303 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:42.711154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7757ef-919d-4dc1-810b-e6a46ec4d303 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:42.743723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2bc0b-7370-488b-b9b4-29eb394b54e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:42.744337 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2bc0b-7370-488b-b9b4-29eb394b54e9 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:42.744613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2bc0b-7370-488b-b9b4-29eb394b54e9 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:42.744887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2bc0b-7370-488b-b9b4-29eb394b54e9 None admin] PATH_INFO: `/v3/projects/3846efee1ca04e1e996cde03e475be01` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:42.745981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2bc0b-7370-488b-b9b4-29eb394b54e9 None admin] RBAC: Authorizing `identity:get_project(project_id=3846efee1ca04e1e996cde03e475be01)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:42.747421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2bc0b-7370-488b-b9b4-29eb394b54e9 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:42.749020 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 600/1191] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:40:42 2022] GET /identity/v3/projects/3846efee1ca04e1e996cde03e475be01 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:42.755061 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134dd30-eade-41d2-857d-12de8a5d9a0c None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:42.849971 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134dd30-eade-41d2-857d-12de8a5d9a0c None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:42.882327 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654ce89-1439-452a-9c8a-e6866d6f24e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:42.883007 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654ce89-1439-452a-9c8a-e6866d6f24e8 None admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:42.883284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654ce89-1439-452a-9c8a-e6866d6f24e8 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:42.883553 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654ce89-1439-452a-9c8a-e6866d6f24e8 None admin] PATH_INFO: `/v3/projects/3846efee1ca04e1e996cde03e475be01/users/68bb86a2e7ff4478beed6ed90d64ce2f/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:42.885435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654ce89-1439-452a-9c8a-e6866d6f24e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=3846efee1ca04e1e996cde03e475be01, user_id=68bb86a2e7ff4478beed6ed90d64ce2f, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:42.886882 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654ce89-1439-452a-9c8a-e6866d6f24e8 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:42.900107 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 592/1192] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Aug 6 20:40:42 2022] PUT /identity/v3/projects/3846efee1ca04e1e996cde03e475be01/users/68bb86a2e7ff4478beed6ed90d64ce2f/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:40:45.110099 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a36838-f785-4183-9efa-63e5699c330b None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:45.110655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a36838-f785-4183-9efa-63e5699c330b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:45.110771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a36838-f785-4183-9efa-63e5699c330b None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:45.112644 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 601/1193] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:40:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:40:45.117843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5517998-bd3c-4458-a396-a5aaf6fc1d49 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:45.118250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5517998-bd3c-4458-a396-a5aaf6fc1d49 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:45.118389 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5517998-bd3c-4458-a396-a5aaf6fc1d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:45.136641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-e5517998-bd3c-4458-a396-a5aaf6fc1d49 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:45.137810 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e5517998-bd3c-4458-a396-a5aaf6fc1d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:45.150830 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:45.204812 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 593/1194] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:40:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:40:45.229289 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a36838-f785-4183-9efa-63e5699c330b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:45.232172 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:45.331330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a36838-f785-4183-9efa-63e5699c330b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:45.366069 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e5fe9-9593-49ea-a7fa-47d0de60ac44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:45.366654 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e5fe9-9593-49ea-a7fa-47d0de60ac44 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:45.366934 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e5fe9-9593-49ea-a7fa-47d0de60ac44 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:45.367204 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e5fe9-9593-49ea-a7fa-47d0de60ac44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:45.377344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e5fe9-9593-49ea-a7fa-47d0de60ac44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:40:45.382016 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-e03e5fe9-9593-49ea-a7fa-47d0de60ac44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:40:45.382016 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:40:45.382016 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:40:45.382016 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:40:45.382016 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:40:45.382016 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:40:45.382016 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:40:45.382016 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:40:45.382016 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:40:45.382016 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:40:45.382016 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:40:45.382016 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:40:45.382016 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:40:45.382016 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:40:45.382016 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:40:45.382016 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:40:45.383192 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:40:45.383192 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:40:45.383192 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:40:45.383192 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:40:45.383192 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:40:45.383192 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:40:45.383192 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:40:45.383192 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:40:45.383192 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:40:45.383192 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:40:45.383192 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:40:45.383192 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:40:45.383192 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:40:45.383192 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:40:45.383192 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:40:45.383192 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:40:45.384486 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:40:45.384486 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:40:45.384486 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:40:45.384486 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:40:45.384486 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:40:45.384486 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:40:45.384486 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:40:45.384486 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:40:45.384486 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:40:45.384486 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:40:45.384486 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:40:45.384486 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:40:45.384486 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 602/1195] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Aug 6 20:40:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:40:45.389286 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5517998-bd3c-4458-a396-a5aaf6fc1d49 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:45.484295 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5517998-bd3c-4458-a396-a5aaf6fc1d49 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:45.516616 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333dcc69-b8a8-41a0-8513-db1484fbe8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:45.517200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333dcc69-b8a8-41a0-8513-db1484fbe8ec None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:45.517474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333dcc69-b8a8-41a0-8513-db1484fbe8ec None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:45.517741 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333dcc69-b8a8-41a0-8513-db1484fbe8ec None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:45.518385 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333dcc69-b8a8-41a0-8513-db1484fbe8ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:40:45.518714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333dcc69-b8a8-41a0-8513-db1484fbe8ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:45.520063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333dcc69-b8a8-41a0-8513-db1484fbe8ec None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:45.527730 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 594/1196] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:40:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:45.534216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e5fe9-9593-49ea-a7fa-47d0de60ac44 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:45.593767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:45.631033 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e5fe9-9593-49ea-a7fa-47d0de60ac44 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:45.664339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447d145-9de3-45a8-9de5-60de7dc7ba36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:45.664957 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447d145-9de3-45a8-9de5-60de7dc7ba36 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:45.665236 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447d145-9de3-45a8-9de5-60de7dc7ba36 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:45.665511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447d145-9de3-45a8-9de5-60de7dc7ba36 None admin] PATH_INFO: `/v3/users/68bb86a2e7ff4478beed6ed90d64ce2f` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:45.666672 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9447d145-9de3-45a8-9de5-60de7dc7ba36 None admin] RBAC: Authorizing `identity:get_user(user_id=68bb86a2e7ff4478beed6ed90d64ce2f)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:45.668116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9447d145-9de3-45a8-9de5-60de7dc7ba36 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:45.669697 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 603/1197] 10.222.0.33 () {56 vars in 1177 bytes} [Sat Aug 6 20:40:45 2022] GET /identity/v3/users/68bb86a2e7ff4478beed6ed90d64ce2f => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:45.675575 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333dcc69-b8a8-41a0-8513-db1484fbe8ec None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:45.688902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:45.772578 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333dcc69-b8a8-41a0-8513-db1484fbe8ec None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:45.803902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b1d59-d43a-4a65-aded-4028400f9830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:45.804486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b1d59-d43a-4a65-aded-4028400f9830 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:45.804758 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b1d59-d43a-4a65-aded-4028400f9830 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:45.805025 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b1d59-d43a-4a65-aded-4028400f9830 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:45.868632 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b1d59-d43a-4a65-aded-4028400f9830 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:45.870049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b1d59-d43a-4a65-aded-4028400f9830 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:45.880434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:45.963893 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 595/1198] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:40:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 20:40:45.970363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447d145-9de3-45a8-9de5-60de7dc7ba36 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:46.066708 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447d145-9de3-45a8-9de5-60de7dc7ba36 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:46.093893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:46.099968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6e52c-3d8a-469a-8ba0-0381916e25d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:46.100578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6e52c-3d8a-469a-8ba0-0381916e25d9 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:46.100853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6e52c-3d8a-469a-8ba0-0381916e25d9 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:46.101119 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6e52c-3d8a-469a-8ba0-0381916e25d9 None admin] PATH_INFO: `/v3/projects/3846efee1ca04e1e996cde03e475be01` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:46.102456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b6e52c-3d8a-469a-8ba0-0381916e25d9 None admin] RBAC: Authorizing `identity:get_project(project_id=3846efee1ca04e1e996cde03e475be01)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:46.103899 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b6e52c-3d8a-469a-8ba0-0381916e25d9 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:46.105477 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 604/1199] 10.222.0.33 () {56 vars in 1186 bytes} [Sat Aug 6 20:40:45 2022] GET /identity/v3/projects/3846efee1ca04e1e996cde03e475be01 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:46.111552 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b1d59-d43a-4a65-aded-4028400f9830 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:46.208294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b1d59-d43a-4a65-aded-4028400f9830 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:46.219913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:46.242085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df434c-e776-494a-9ee3-d4f1126a222e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:46.242706 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df434c-e776-494a-9ee3-d4f1126a222e None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:46.242984 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df434c-e776-494a-9ee3-d4f1126a222e None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:46.243249 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df434c-e776-494a-9ee3-d4f1126a222e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:46.243955 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df434c-e776-494a-9ee3-d4f1126a222e None admin] RBAC: Adding query filter params (role.id=ab245eea8a714462a00c4546309de9c9, scope.project.id=3846efee1ca04e1e996cde03e475be01, user.id=68bb86a2e7ff4478beed6ed90d64ce2f) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:40:46.244257 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df434c-e776-494a-9ee3-d4f1126a222e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:46.245657 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df434c-e776-494a-9ee3-d4f1126a222e None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:46.251292 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 596/1200] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:40:46 2022] GET /identity/v3/role_assignments?user.id=68bb86a2e7ff4478beed6ed90d64ce2f&scope.project.id=3846efee1ca04e1e996cde03e475be01&role.id=ab245eea8a714462a00c4546309de9c9 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:40:56.098141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:56.248834 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=13 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:47.644014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be1308-56c6-41b6-8cab-c57f4fddeae6 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:47.644634 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be1308-56c6-41b6-8cab-c57f4fddeae6 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:47.644634 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be1308-56c6-41b6-8cab-c57f4fddeae6 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:47.645885 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 605/1201] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:41:47.652528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead3d23-a806-4ef6-b8ea-181ea012d272 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:47.653039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead3d23-a806-4ef6-b8ea-181ea012d272 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:47.653129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead3d23-a806-4ef6-b8ea-181ea012d272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:47.676189 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-6ead3d23-a806-4ef6-b8ea-181ea012d272 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:41:47.677525 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6ead3d23-a806-4ef6-b8ea-181ea012d272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:41:47.764228 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 597/1202] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:41:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:41:47.796490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be1308-56c6-41b6-8cab-c57f4fddeae6 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:47.918810 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be1308-56c6-41b6-8cab-c57f4fddeae6 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:47.961508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb659324-b1c5-401b-b3a3-72339db71b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:47.967425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb659324-b1c5-401b-b3a3-72339db71b42 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:47.967425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb659324-b1c5-401b-b3a3-72339db71b42 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:47.967425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb659324-b1c5-401b-b3a3-72339db71b42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:47.984171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb659324-b1c5-401b-b3a3-72339db71b42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:47.986028 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb659324-b1c5-401b-b3a3-72339db71b42 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:48.008683 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-eb659324-b1c5-401b-b3a3-72339db71b42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:41:48.008683 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:41:48.008683 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:41:48.008683 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:41:48.008683 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:41:48.008683 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:41:48.008683 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:41:48.008683 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:41:48.008683 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:41:48.008683 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:41:48.008683 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:41:48.008683 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:41:48.008683 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:41:48.008683 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:41:48.008683 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:41:48.008683 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:41:48.009866 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:41:48.009866 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:41:48.009866 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:41:48.009866 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:41:48.009866 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:41:48.009866 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:41:48.009866 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:41:48.009866 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:41:48.009866 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:41:48.009866 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:41:48.009866 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:41:48.009866 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:41:48.009866 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:41:48.009866 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:41:48.009866 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:41:48.009866 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:41:48.009866 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:41:48.011431 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:41:48.011431 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:41:48.011431 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:41:48.011431 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 606/1203] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:41:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:41:48.020617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead3d23-a806-4ef6-b8ea-181ea012d272 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:48.145942 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead3d23-a806-4ef6-b8ea-181ea012d272 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:48.184009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:48.193684 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44abfac2-d53c-4cc6-b8f4-7a1b02869a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:48.194315 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44abfac2-d53c-4cc6-b8f4-7a1b02869a86 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:48.194619 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44abfac2-d53c-4cc6-b8f4-7a1b02869a86 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:48.195090 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44abfac2-d53c-4cc6-b8f4-7a1b02869a86 None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:48.195857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44abfac2-d53c-4cc6-b8f4-7a1b02869a86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:41:48.196174 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44abfac2-d53c-4cc6-b8f4-7a1b02869a86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:48.197948 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44abfac2-d53c-4cc6-b8f4-7a1b02869a86 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:48.216827 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 598/1204] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:41:48.223268 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb659324-b1c5-401b-b3a3-72339db71b42 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:48.300363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:48.375005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb659324-b1c5-401b-b3a3-72339db71b42 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:48.424438 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4177649-1abf-47fc-a2ad-1f2001e7ef96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:48.425133 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4177649-1abf-47fc-a2ad-1f2001e7ef96 None admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:48.425478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4177649-1abf-47fc-a2ad-1f2001e7ef96 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:48.425918 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4177649-1abf-47fc-a2ad-1f2001e7ef96 None admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:48.427030 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4177649-1abf-47fc-a2ad-1f2001e7ef96 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:48.428711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4177649-1abf-47fc-a2ad-1f2001e7ef96 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:48.462659 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 607/1205] 10.222.0.33 () {60 vars in 1132 bytes} [Sat Aug 6 20:41:48 2022] POST /identity/v3/users => generated 251 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:41:51.040096 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0f98b-8221-47a4-98b8-67440b7a429e None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:51.040702 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0f98b-8221-47a4-98b8-67440b7a429e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:51.040702 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0f98b-8221-47a4-98b8-67440b7a429e None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:51.042516 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 599/1206] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:41:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:41:51.049324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365fe9f-a8ae-437c-b86d-8ac2fb1322b6 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:51.050080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365fe9f-a8ae-437c-b86d-8ac2fb1322b6 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:51.050194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365fe9f-a8ae-437c-b86d-8ac2fb1322b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:51.070938 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-7365fe9f-a8ae-437c-b86d-8ac2fb1322b6 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:41:51.072204 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7365fe9f-a8ae-437c-b86d-8ac2fb1322b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:41:51.154389 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 608/1207] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:41:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:41:51.181780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0f98b-8221-47a4-98b8-67440b7a429e None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:51.311897 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0f98b-8221-47a4-98b8-67440b7a429e None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:51.351250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd04c0-c2cd-4035-ba81-8dfd8fbdd3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:51.351904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd04c0-c2cd-4035-ba81-8dfd8fbdd3c7 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:51.352180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd04c0-c2cd-4035-ba81-8dfd8fbdd3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:51.352448 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd04c0-c2cd-4035-ba81-8dfd8fbdd3c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:51.366390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd04c0-c2cd-4035-ba81-8dfd8fbdd3c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:41:51.371466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-36fd04c0-c2cd-4035-ba81-8dfd8fbdd3c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:41:51.371466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:41:51.371466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:41:51.371466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:41:51.371466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:41:51.371466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:41:51.371466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:41:51.371466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:41:51.371466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:41:51.371466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:41:51.371466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:41:51.371466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:41:51.371466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:41:51.371466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:41:51.371466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:41:51.371466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:41:51.373544 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:41:51.373544 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:41:51.373544 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:41:51.373544 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:41:51.373544 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:41:51.373544 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:41:51.373544 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:41:51.373544 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:41:51.373544 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:41:51.373544 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:41:51.373544 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:41:51.373544 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:41:51.373544 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:41:51.373544 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:41:51.373544 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:41:51.373544 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:41:51.374792 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:41:51.374792 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:41:51.374792 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:41:51.374792 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:41:51.374792 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:41:51.374792 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:41:51.374792 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:41:51.374792 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:41:51.374792 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:41:51.374792 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:41:51.374792 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:41:51.374792 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:41:51.374792 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 600/1208] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Aug 6 20:41:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:41:51.378943 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365fe9f-a8ae-437c-b86d-8ac2fb1322b6 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:51.434205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:51.504048 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365fe9f-a8ae-437c-b86d-8ac2fb1322b6 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:51.543671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0575f89-e425-4dc7-a38a-d7f9dd99c702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:51.544331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0575f89-e425-4dc7-a38a-d7f9dd99c702 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:51.544686 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0575f89-e425-4dc7-a38a-d7f9dd99c702 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:51.544969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0575f89-e425-4dc7-a38a-d7f9dd99c702 None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:51.545641 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0575f89-e425-4dc7-a38a-d7f9dd99c702 None admin] RBAC: Adding query filter params (name=service) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:41:51.545993 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0575f89-e425-4dc7-a38a-d7f9dd99c702 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:51.547577 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0575f89-e425-4dc7-a38a-d7f9dd99c702 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:51.556739 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 609/1209] 10.222.0.33 () {56 vars in 1103 bytes} [Sat Aug 6 20:41:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:41:51.563573 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd04c0-c2cd-4035-ba81-8dfd8fbdd3c7 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:51.632635 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:51.691757 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd04c0-c2cd-4035-ba81-8dfd8fbdd3c7 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:51.733541 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1e2df-592f-4b77-b28a-d7e31685d882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:51.734196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1e2df-592f-4b77-b28a-d7e31685d882 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:51.734453 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1e2df-592f-4b77-b28a-d7e31685d882 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:51.734802 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1e2df-592f-4b77-b28a-d7e31685d882 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:51.747449 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1e2df-592f-4b77-b28a-d7e31685d882 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:51.749179 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1e2df-592f-4b77-b28a-d7e31685d882 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:51.765783 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-87b1e2df-592f-4b77-b28a-d7e31685d882 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:41:51.765783 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:41:51.765783 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:41:51.765783 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:41:51.765783 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:41:51.765783 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:41:51.765783 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:41:51.765783 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:41:51.765783 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:41:51.765783 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:41:51.765783 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:41:51.765783 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:41:51.765783 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:41:51.765783 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:41:51.765783 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:41:51.765783 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:41:51.767434 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:41:51.767434 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:41:51.767434 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:41:51.767434 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:41:51.767434 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:41:51.767434 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:41:51.767434 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:41:51.767434 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:41:51.767434 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:41:51.767434 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:41:51.767434 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:41:51.767434 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:41:51.767434 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:41:51.767434 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:41:51.767434 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:41:51.767434 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:41:51.767434 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:41:51.768598 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:41:51.768598 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:41:51.768598 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:41:51.768598 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 601/1210] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:41:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:41:51.773152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0575f89-e425-4dc7-a38a-d7f9dd99c702 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:51.882407 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:51.885369 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0575f89-e425-4dc7-a38a-d7f9dd99c702 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:51.922427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b625bd-4f8a-4e81-8acd-9ac146a930ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:51.923061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b625bd-4f8a-4e81-8acd-9ac146a930ba None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:51.923347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b625bd-4f8a-4e81-8acd-9ac146a930ba None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:51.923631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b625bd-4f8a-4e81-8acd-9ac146a930ba None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:51.924272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b625bd-4f8a-4e81-8acd-9ac146a930ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:41:51.924851 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b625bd-4f8a-4e81-8acd-9ac146a930ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:51.926221 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b625bd-4f8a-4e81-8acd-9ac146a930ba None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:51.940841 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 610/1211] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:41:51.946508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1e2df-592f-4b77-b28a-d7e31685d882 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:52.062156 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1e2df-592f-4b77-b28a-d7e31685d882 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:52.063906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:52.101437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e027c11-8ef0-4a22-9eda-751408bf3d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:52.102645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e027c11-8ef0-4a22-9eda-751408bf3d2b None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:52.102645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e027c11-8ef0-4a22-9eda-751408bf3d2b None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:52.102840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e027c11-8ef0-4a22-9eda-751408bf3d2b None admin] PATH_INFO: `/v3/users/placement` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:52.112239 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e027c11-8ef0-4a22-9eda-751408bf3d2b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:52.113712 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e027c11-8ef0-4a22-9eda-751408bf3d2b None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:52.125732 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-7e027c11-8ef0-4a22-9eda-751408bf3d2b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 06 20:41:52.125732 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:41:52.125732 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:41:52.125732 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:41:52.125732 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:41:52.125732 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:41:52.125732 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:41:52.125732 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:41:52.125732 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:41:52.125732 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:41:52.125732 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:41:52.125732 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:41:52.125732 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:41:52.125732 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:41:52.125732 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:41:52.125732 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:41:52.127046 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:41:52.127046 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:41:52.127046 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:41:52.127046 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:41:52.127046 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:41:52.127046 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:41:52.127046 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:41:52.127046 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:41:52.127046 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:41:52.127046 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:41:52.127046 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:41:52.127046 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:41:52.127046 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:41:52.127046 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:41:52.127046 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:41:52.127046 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:41:52.127046 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:41:52.127046 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:41:52.128487 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:41:52.128487 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:41:52.128487 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:41:52.128487 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:41:52.128487 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:41:52.128487 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:41:52.128487 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:41:52.128487 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:41:52.128487 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 06 20:41:52.128487 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:41:52.128487 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 602/1212] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:41:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:41:52.132721 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b625bd-4f8a-4e81-8acd-9ac146a930ba None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:52.259253 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b625bd-4f8a-4e81-8acd-9ac146a930ba None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:52.318793 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0aed2-09cf-4dad-8567-e0ef9beed202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:52.319436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0aed2-09cf-4dad-8567-e0ef9beed202 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:52.319783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0aed2-09cf-4dad-8567-e0ef9beed202 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:52.320141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0aed2-09cf-4dad-8567-e0ef9beed202 None admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:52.325277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0aed2-09cf-4dad-8567-e0ef9beed202 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:41:52.325277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0aed2-09cf-4dad-8567-e0ef9beed202 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:52.325277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0aed2-09cf-4dad-8567-e0ef9beed202 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:52.349721 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 611/1213] 10.222.0.33 () {56 vars in 1143 bytes} [Sat Aug 6 20:41:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:41:52.350960 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e027c11-8ef0-4a22-9eda-751408bf3d2b None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:52.479879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e027c11-8ef0-4a22-9eda-751408bf3d2b None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:52.535655 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397dce2-22a2-4ab4-ab47-df8fab511c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:52.536278 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397dce2-22a2-4ab4-ab47-df8fab511c43 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:52.536550 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397dce2-22a2-4ab4-ab47-df8fab511c43 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:52.536849 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397dce2-22a2-4ab4-ab47-df8fab511c43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:52.572390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:52.615236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a397dce2-22a2-4ab4-ab47-df8fab511c43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:52.616684 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a397dce2-22a2-4ab4-ab47-df8fab511c43 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:52.737477 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 603/1214] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:41:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 06 20:41:52.743433 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0aed2-09cf-4dad-8567-e0ef9beed202 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:52.767273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:52.865970 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0aed2-09cf-4dad-8567-e0ef9beed202 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:52.917742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995cf1c-88ff-4a5d-ac48-0877ff258e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:52.918452 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995cf1c-88ff-4a5d-ac48-0877ff258e9f None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:52.918784 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995cf1c-88ff-4a5d-ac48-0877ff258e9f None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:52.919059 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995cf1c-88ff-4a5d-ac48-0877ff258e9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:52.933337 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995cf1c-88ff-4a5d-ac48-0877ff258e9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:52.935070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995cf1c-88ff-4a5d-ac48-0877ff258e9f None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:52.954822 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-c995cf1c-88ff-4a5d-ac48-0877ff258e9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:41:52.954822 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:41:52.954822 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:41:52.954822 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:41:52.954822 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:41:52.954822 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:41:52.954822 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:41:52.954822 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:41:52.954822 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:41:52.954822 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:41:52.954822 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:41:52.954822 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:41:52.954822 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:41:52.954822 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:41:52.954822 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:41:52.954822 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:41:52.957035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:41:52.957035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:41:52.957035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:41:52.957035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:41:52.957035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:41:52.957035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:41:52.957035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:41:52.957035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:41:52.957035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:41:52.957035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:41:52.957035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:41:52.957035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:41:52.957035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:41:52.957035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:41:52.957035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:41:52.957035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:41:52.957035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:41:52.958157 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:41:52.958157 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:41:52.958157 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:41:52.958157 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 612/1215] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:41:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:41:52.964390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397dce2-22a2-4ab4-ab47-df8fab511c43 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:53.036410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:53.075498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397dce2-22a2-4ab4-ab47-df8fab511c43 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:53.111849 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dcf215-26bb-43ab-8f9c-7496a12a8da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:53.112821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dcf215-26bb-43ab-8f9c-7496a12a8da5 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:53.113255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dcf215-26bb-43ab-8f9c-7496a12a8da5 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:53.113759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dcf215-26bb-43ab-8f9c-7496a12a8da5 None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:53.114607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dcf215-26bb-43ab-8f9c-7496a12a8da5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:41:53.115083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dcf215-26bb-43ab-8f9c-7496a12a8da5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:53.116744 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dcf215-26bb-43ab-8f9c-7496a12a8da5 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:53.130143 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 604/1216] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:41:53.135682 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995cf1c-88ff-4a5d-ac48-0877ff258e9f None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:53.214122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:53.251323 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995cf1c-88ff-4a5d-ac48-0877ff258e9f None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:53.288590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79150c0c-0d8d-45c4-b063-7739e8ba25df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:53.289292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79150c0c-0d8d-45c4-b063-7739e8ba25df None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:53.289694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79150c0c-0d8d-45c4-b063-7739e8ba25df None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:53.290068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79150c0c-0d8d-45c4-b063-7739e8ba25df None admin] PATH_INFO: `/v3/projects/service` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:53.299194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79150c0c-0d8d-45c4-b063-7739e8ba25df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:53.301068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79150c0c-0d8d-45c4-b063-7739e8ba25df None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:53.315867 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-79150c0c-0d8d-45c4-b063-7739e8ba25df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:41:53.315867 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:41:53.315867 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:41:53.315867 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:41:53.315867 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:41:53.315867 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:41:53.315867 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:41:53.315867 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:41:53.315867 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:41:53.315867 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:41:53.315867 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:41:53.315867 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:41:53.315867 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:41:53.315867 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:41:53.315867 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:41:53.317175 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:41:53.317175 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:41:53.317175 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:41:53.317175 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:41:53.317175 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:41:53.317175 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:41:53.317175 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:41:53.317175 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:41:53.317175 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:41:53.317175 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:41:53.317175 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:41:53.317175 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:41:53.317175 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:41:53.317175 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:41:53.317175 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:41:53.317175 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:41:53.317175 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:41:53.318353 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:41:53.318353 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:41:53.318353 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:41:53.318353 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:41:53.318353 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:41:53.318353 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:41:53.318353 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:41:53.318353 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:41:53.319798 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 613/1217] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:41:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:41:53.329796 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dcf215-26bb-43ab-8f9c-7496a12a8da5 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:53.449001 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dcf215-26bb-43ab-8f9c-7496a12a8da5 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:53.476556 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:53.490979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc4be3-b428-4039-8f00-3704f1f45f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:53.491808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc4be3-b428-4039-8f00-3704f1f45f49 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:53.492208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc4be3-b428-4039-8f00-3704f1f45f49 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:53.492639 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc4be3-b428-4039-8f00-3704f1f45f49 None admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:53.493749 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc4be3-b428-4039-8f00-3704f1f45f49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:41:53.494188 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc4be3-b428-4039-8f00-3704f1f45f49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:53.496659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc4be3-b428-4039-8f00-3704f1f45f49 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:53.517169 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 605/1218] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Aug 6 20:41:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:41:53.519649 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79150c0c-0d8d-45c4-b063-7739e8ba25df None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:53.631480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79150c0c-0d8d-45c4-b063-7739e8ba25df None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:53.662535 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:53.677530 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191d587-292b-48b5-96cf-5985a11d469c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:53.678142 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191d587-292b-48b5-96cf-5985a11d469c None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:53.678426 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191d587-292b-48b5-96cf-5985a11d469c None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:53.678752 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191d587-292b-48b5-96cf-5985a11d469c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:53.679495 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191d587-292b-48b5-96cf-5985a11d469c None admin] RBAC: Adding query filter params (role.id=55fe0e239bac413b90c785211607e1a4, scope.project.id=6c4962342201407a89793c5c9a6a6f36, user.id=aeafb87d52414c979a774861a2d49ab0) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:41:53.679792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191d587-292b-48b5-96cf-5985a11d469c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:53.681249 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191d587-292b-48b5-96cf-5985a11d469c None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:53.687899 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 614/1219] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:41:53 2022] GET /identity/v3/role_assignments?user.id=aeafb87d52414c979a774861a2d49ab0&scope.project.id=6c4962342201407a89793c5c9a6a6f36&role.id=55fe0e239bac413b90c785211607e1a4 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:41:55.988393 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9791a-91bd-4844-b8f5-6d00dcb23875 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:55.988960 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9791a-91bd-4844-b8f5-6d00dcb23875 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:55.988960 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9791a-91bd-4844-b8f5-6d00dcb23875 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:55.990528 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 606/1220] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:41:55.996469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139a870-5cab-4f86-a0e7-1d4b9fbdae4d None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:55.996924 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139a870-5cab-4f86-a0e7-1d4b9fbdae4d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:55.997036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139a870-5cab-4f86-a0e7-1d4b9fbdae4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:56.017430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d139a870-5cab-4f86-a0e7-1d4b9fbdae4d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:41:56.018650 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d139a870-5cab-4f86-a0e7-1d4b9fbdae4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:41:56.092995 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 615/1221] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:41:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:41:56.119685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9791a-91bd-4844-b8f5-6d00dcb23875 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:56.232290 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9791a-91bd-4844-b8f5-6d00dcb23875 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:56.278591 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715195e5-47b2-4a29-bfbf-c618c0f9fb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:56.279594 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715195e5-47b2-4a29-bfbf-c618c0f9fb59 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:56.280109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715195e5-47b2-4a29-bfbf-c618c0f9fb59 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:56.280591 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715195e5-47b2-4a29-bfbf-c618c0f9fb59 None admin] PATH_INFO: `/v3/roles/service` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:56.293521 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715195e5-47b2-4a29-bfbf-c618c0f9fb59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:41:56.300798 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-715195e5-47b2-4a29-bfbf-c618c0f9fb59 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:41:56.300798 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:41:56.300798 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:41:56.300798 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:41:56.300798 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:41:56.300798 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:41:56.300798 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:41:56.300798 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:41:56.300798 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:41:56.300798 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:41:56.300798 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:41:56.300798 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:41:56.300798 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:41:56.300798 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:41:56.300798 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:41:56.300798 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:41:56.301770 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:41:56.301770 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:41:56.301770 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:41:56.301770 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:41:56.301770 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:41:56.301770 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:41:56.301770 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:41:56.301770 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:41:56.301770 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:41:56.301770 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:41:56.301770 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:41:56.301770 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:41:56.301770 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:41:56.301770 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:41:56.301770 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:41:56.301770 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:41:56.302673 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:41:56.302673 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:41:56.302673 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:41:56.302673 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:41:56.302673 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:41:56.302673 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:41:56.302673 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:41:56.302673 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:41:56.302673 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:41:56.302673 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:41:56.302673 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:41:56.302673 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:41:56.305476 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 607/1222] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Aug 6 20:41:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:41:56.312238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139a870-5cab-4f86-a0e7-1d4b9fbdae4d None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:56.428941 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139a870-5cab-4f86-a0e7-1d4b9fbdae4d None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:56.453664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:56.465173 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7bcae-1ab5-4643-a2f8-3d767dd0e2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:56.465879 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7bcae-1ab5-4643-a2f8-3d767dd0e2cc None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:56.466164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7bcae-1ab5-4643-a2f8-3d767dd0e2cc None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:56.466445 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7bcae-1ab5-4643-a2f8-3d767dd0e2cc None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:56.467176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7bcae-1ab5-4643-a2f8-3d767dd0e2cc None admin] RBAC: Adding query filter params (name=service) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:41:56.467514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7bcae-1ab5-4643-a2f8-3d767dd0e2cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:56.468866 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7bcae-1ab5-4643-a2f8-3d767dd0e2cc None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:56.484206 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 616/1223] 10.222.0.33 () {56 vars in 1103 bytes} [Sat Aug 6 20:41:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:41:56.484391 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715195e5-47b2-4a29-bfbf-c618c0f9fb59 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:56.535568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:56.598277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715195e5-47b2-4a29-bfbf-c618c0f9fb59 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:56.634467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e14ef9-3a58-4dba-a771-b3ca78409e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:56.635275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e14ef9-3a58-4dba-a771-b3ca78409e83 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:56.635667 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e14ef9-3a58-4dba-a771-b3ca78409e83 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:56.636693 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e14ef9-3a58-4dba-a771-b3ca78409e83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:56.647467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e14ef9-3a58-4dba-a771-b3ca78409e83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:56.651410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e14ef9-3a58-4dba-a771-b3ca78409e83 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:56.678288 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-78e14ef9-3a58-4dba-a771-b3ca78409e83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:41:56.678288 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:41:56.678288 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:41:56.678288 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:41:56.678288 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:41:56.678288 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:41:56.678288 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:41:56.678288 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:41:56.678288 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:41:56.678288 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:41:56.678288 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:41:56.678288 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:41:56.678288 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:41:56.678288 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:41:56.678288 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:41:56.678288 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:41:56.679880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:41:56.679880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:41:56.679880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:41:56.679880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:41:56.679880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:41:56.679880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:41:56.679880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:41:56.679880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:41:56.679880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:41:56.679880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:41:56.679880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:41:56.679880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:41:56.679880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:41:56.679880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:41:56.679880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:41:56.679880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:41:56.679880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:41:56.680919 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:41:56.680919 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:41:56.680919 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:41:56.680919 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 608/1224] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:41:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:41:56.685868 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7bcae-1ab5-4643-a2f8-3d767dd0e2cc None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:56.824967 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7bcae-1ab5-4643-a2f8-3d767dd0e2cc None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:56.871091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71666eb-58ee-4f38-867b-f620115a571f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:56.871650 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71666eb-58ee-4f38-867b-f620115a571f None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:56.872007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71666eb-58ee-4f38-867b-f620115a571f None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:56.872219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71666eb-58ee-4f38-867b-f620115a571f None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:56.872872 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71666eb-58ee-4f38-867b-f620115a571f None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:41:56.873180 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71666eb-58ee-4f38-867b-f620115a571f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:56.874565 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71666eb-58ee-4f38-867b-f620115a571f None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:56.887835 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 617/1225] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:41:56.893624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e14ef9-3a58-4dba-a771-b3ca78409e83 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:57.009134 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:57.017604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e14ef9-3a58-4dba-a771-b3ca78409e83 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:57.055895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2686d-8fc4-46a5-8b69-fbe310d139ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:57.056615 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2686d-8fc4-46a5-8b69-fbe310d139ec None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:57.056929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2686d-8fc4-46a5-8b69-fbe310d139ec None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:57.057240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2686d-8fc4-46a5-8b69-fbe310d139ec None admin] PATH_INFO: `/v3/users/placement` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:57.066459 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2686d-8fc4-46a5-8b69-fbe310d139ec None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:57.068038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2686d-8fc4-46a5-8b69-fbe310d139ec None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:57.081332 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-24f2686d-8fc4-46a5-8b69-fbe310d139ec None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 06 20:41:57.081332 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:41:57.081332 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:41:57.081332 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:41:57.081332 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:41:57.081332 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:41:57.081332 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:41:57.081332 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:41:57.081332 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:41:57.081332 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:41:57.081332 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:41:57.081332 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:41:57.081332 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:41:57.081332 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:41:57.081332 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:41:57.081332 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:41:57.082446 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:41:57.082446 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:41:57.082446 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:41:57.082446 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:41:57.082446 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:41:57.082446 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:41:57.082446 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:41:57.082446 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:41:57.082446 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:41:57.082446 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:41:57.082446 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:41:57.082446 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:41:57.082446 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:41:57.082446 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:41:57.082446 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:41:57.082446 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:41:57.082446 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:41:57.082446 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:41:57.083661 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:41:57.083661 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:41:57.083661 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:41:57.083661 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:41:57.083661 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:41:57.083661 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:41:57.083661 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:41:57.083661 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:41:57.083661 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 06 20:41:57.083661 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:41:57.083661 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 609/1226] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:41:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:41:57.092045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71666eb-58ee-4f38-867b-f620115a571f None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:57.143117 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:57.208245 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71666eb-58ee-4f38-867b-f620115a571f None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:57.246187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0dd0da-6a77-48f9-99d5-d4b3974f5ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:57.246978 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dd0da-6a77-48f9-99d5-d4b3974f5ee8 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:57.247300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dd0da-6a77-48f9-99d5-d4b3974f5ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:57.247697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dd0da-6a77-48f9-99d5-d4b3974f5ee8 None admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:57.248538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0dd0da-6a77-48f9-99d5-d4b3974f5ee8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:41:57.248841 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0dd0da-6a77-48f9-99d5-d4b3974f5ee8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:57.250389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0dd0da-6a77-48f9-99d5-d4b3974f5ee8 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:57.269076 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 618/1227] 10.222.0.33 () {56 vars in 1143 bytes} [Sat Aug 6 20:41:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:41:57.274874 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2686d-8fc4-46a5-8b69-fbe310d139ec None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:57.397546 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2686d-8fc4-46a5-8b69-fbe310d139ec None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:57.438009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2459b-28e9-49c2-9bff-cd3a278f557e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:57.438673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2459b-28e9-49c2-9bff-cd3a278f557e None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:57.438954 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2459b-28e9-49c2-9bff-cd3a278f557e None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:57.439226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2459b-28e9-49c2-9bff-cd3a278f557e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:57.451766 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b2459b-28e9-49c2-9bff-cd3a278f557e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:57.453213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b2459b-28e9-49c2-9bff-cd3a278f557e None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:57.469336 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-f7b2459b-28e9-49c2-9bff-cd3a278f557e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:41:57.469336 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:41:57.469336 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:41:57.469336 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:41:57.469336 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:41:57.469336 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:41:57.469336 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:41:57.469336 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:41:57.469336 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:41:57.469336 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:41:57.469336 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:41:57.469336 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:41:57.469336 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:41:57.469336 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:41:57.469336 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:41:57.469336 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:41:57.470647 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:41:57.470647 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:41:57.470647 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:41:57.470647 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:41:57.470647 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:41:57.470647 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:41:57.470647 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:41:57.470647 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:41:57.470647 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:41:57.470647 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:41:57.470647 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:41:57.470647 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:41:57.470647 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:41:57.470647 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:41:57.470647 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:41:57.470647 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:41:57.470647 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:41:57.471922 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:41:57.471922 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:41:57.471922 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:41:57.471922 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 610/1228] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:41:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:41:57.477490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0dd0da-6a77-48f9-99d5-d4b3974f5ee8 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:57.586776 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0dd0da-6a77-48f9-99d5-d4b3974f5ee8 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:57.590183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:57.624511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85f5e4-6538-4c5b-aa6d-69c7eb9b5044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:57.625114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85f5e4-6538-4c5b-aa6d-69c7eb9b5044 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:57.625400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85f5e4-6538-4c5b-aa6d-69c7eb9b5044 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:57.625699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85f5e4-6538-4c5b-aa6d-69c7eb9b5044 None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:57.626308 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85f5e4-6538-4c5b-aa6d-69c7eb9b5044 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:41:57.626644 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85f5e4-6538-4c5b-aa6d-69c7eb9b5044 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:57.628044 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85f5e4-6538-4c5b-aa6d-69c7eb9b5044 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:57.639673 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 619/1229] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:41:57.645455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2459b-28e9-49c2-9bff-cd3a278f557e None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:57.656107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:57.764694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2459b-28e9-49c2-9bff-cd3a278f557e None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:57.805252 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d599d3-da56-4b0d-b9eb-d3aa8db6bb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:57.805950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d599d3-da56-4b0d-b9eb-d3aa8db6bb1d None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:57.806318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d599d3-da56-4b0d-b9eb-d3aa8db6bb1d None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:57.806629 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d599d3-da56-4b0d-b9eb-d3aa8db6bb1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:57.814825 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d599d3-da56-4b0d-b9eb-d3aa8db6bb1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:57.816714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d599d3-da56-4b0d-b9eb-d3aa8db6bb1d None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:57.830403 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-74d599d3-da56-4b0d-b9eb-d3aa8db6bb1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:41:57.830403 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:41:57.830403 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:41:57.830403 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:41:57.830403 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:41:57.830403 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:41:57.830403 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:41:57.830403 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:41:57.830403 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:41:57.830403 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:41:57.830403 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:41:57.830403 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:41:57.830403 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:41:57.830403 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:41:57.830403 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:41:57.831536 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:41:57.831536 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:41:57.831536 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:41:57.831536 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:41:57.831536 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:41:57.831536 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:41:57.831536 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:41:57.831536 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:41:57.831536 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:41:57.831536 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:41:57.831536 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:41:57.831536 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:41:57.831536 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:41:57.831536 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:41:57.831536 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:41:57.831536 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:41:57.831536 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:41:57.832649 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:41:57.832649 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:41:57.832649 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:41:57.832649 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:41:57.832649 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:41:57.832649 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:41:57.832649 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:41:57.832649 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:41:57.832649 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 611/1230] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:41:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:41:57.838243 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85f5e4-6538-4c5b-aa6d-69c7eb9b5044 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:57.948402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85f5e4-6538-4c5b-aa6d-69c7eb9b5044 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:57.989641 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390eaae-5ab9-4d01-96f4-703c06294cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:57.990283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390eaae-5ab9-4d01-96f4-703c06294cba None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:57.990668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390eaae-5ab9-4d01-96f4-703c06294cba None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:57.990947 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390eaae-5ab9-4d01-96f4-703c06294cba None admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:57.991638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1390eaae-5ab9-4d01-96f4-703c06294cba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:41:57.991944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1390eaae-5ab9-4d01-96f4-703c06294cba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:57.993812 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1390eaae-5ab9-4d01-96f4-703c06294cba None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:58.007637 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 620/1231] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Aug 6 20:41:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:41:58.015232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d599d3-da56-4b0d-b9eb-d3aa8db6bb1d None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:41:58.088211 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:58.127286 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d599d3-da56-4b0d-b9eb-d3aa8db6bb1d None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:41:58.161568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23b681-8fbc-45fa-a858-14062ea47cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:41:58.162235 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23b681-8fbc-45fa-a858-14062ea47cd7 None admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:58.162497 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23b681-8fbc-45fa-a858-14062ea47cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:58.162793 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23b681-8fbc-45fa-a858-14062ea47cd7 None admin] PATH_INFO: `/v3/projects/6c4962342201407a89793c5c9a6a6f36/users/aeafb87d52414c979a774861a2d49ab0/roles/55fe0e239bac413b90c785211607e1a4` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:58.177757 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23b681-8fbc-45fa-a858-14062ea47cd7 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c4962342201407a89793c5c9a6a6f36, user_id=aeafb87d52414c979a774861a2d49ab0, role_id=55fe0e239bac413b90c785211607e1a4)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:41:58.179268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23b681-8fbc-45fa-a858-14062ea47cd7 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:41:58.194164 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 612/1232] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Aug 6 20:41:58 2022] PUT /identity/v3/projects/6c4962342201407a89793c5c9a6a6f36/users/aeafb87d52414c979a774861a2d49ab0/roles/55fe0e239bac413b90c785211607e1a4 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:42:00.664105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d40d7c-e306-4b23-ac35-413cd014fa5d None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:00.664729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d40d7c-e306-4b23-ac35-413cd014fa5d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:00.664729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d40d7c-e306-4b23-ac35-413cd014fa5d None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:00.668808 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 621/1233] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:42:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:42:00.673027 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a84788-869f-4162-a809-e61dc981539e None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:00.673418 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a84788-869f-4162-a809-e61dc981539e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:00.673569 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a84788-869f-4162-a809-e61dc981539e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:00.692091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-e2a84788-869f-4162-a809-e61dc981539e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:42:00.693319 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e2a84788-869f-4162-a809-e61dc981539e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:00.765621 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 613/1234] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:42:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:42:00.790921 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d40d7c-e306-4b23-ac35-413cd014fa5d None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:00.820558 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:00.909940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d40d7c-e306-4b23-ac35-413cd014fa5d None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:00.955481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590aec5-da59-47ec-81ea-54eef5c548d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:00.956053 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590aec5-da59-47ec-81ea-54eef5c548d2 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:00.956331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590aec5-da59-47ec-81ea-54eef5c548d2 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:00.956601 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590aec5-da59-47ec-81ea-54eef5c548d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:00.967225 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5590aec5-da59-47ec-81ea-54eef5c548d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:42:00.972194 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-5590aec5-da59-47ec-81ea-54eef5c548d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:42:00.972194 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:42:00.972194 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:42:00.972194 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:42:00.972194 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:42:00.972194 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:42:00.972194 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:42:00.972194 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:42:00.972194 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:42:00.972194 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:42:00.972194 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:42:00.972194 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:42:00.972194 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:42:00.972194 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:42:00.972194 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:42:00.972194 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:42:00.973535 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:42:00.973535 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:42:00.973535 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:42:00.973535 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:42:00.973535 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:42:00.973535 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:42:00.973535 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:42:00.973535 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:42:00.973535 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:42:00.973535 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:42:00.973535 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:42:00.973535 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:42:00.973535 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:42:00.973535 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:42:00.973535 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:42:00.973535 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:42:00.974679 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:42:00.974679 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:42:00.974679 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:42:00.974679 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:42:00.974679 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:42:00.974679 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:42:00.974679 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:42:00.974679 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:42:00.974679 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:42:00.974679 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:42:00.974679 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:42:00.974679 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:42:00.974679 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 622/1235] 10.222.0.33 () {56 vars in 1102 bytes} [Sat Aug 6 20:42:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:42:00.979622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a84788-869f-4162-a809-e61dc981539e None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:01.033954 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:01.092703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a84788-869f-4162-a809-e61dc981539e None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:01.131039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00349187-7867-4364-973f-76ff22ed49c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:01.131805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00349187-7867-4364-973f-76ff22ed49c0 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:01.132181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00349187-7867-4364-973f-76ff22ed49c0 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:01.132552 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00349187-7867-4364-973f-76ff22ed49c0 None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:01.133313 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00349187-7867-4364-973f-76ff22ed49c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:42:01.133624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00349187-7867-4364-973f-76ff22ed49c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:01.135189 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00349187-7867-4364-973f-76ff22ed49c0 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:01.144460 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 614/1236] 10.222.0.33 () {56 vars in 1103 bytes} [Sat Aug 6 20:42:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:42:01.150116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590aec5-da59-47ec-81ea-54eef5c548d2 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:01.255545 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:01.273206 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590aec5-da59-47ec-81ea-54eef5c548d2 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:01.313316 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eef0ab-8f95-4112-abef-8bb4b57a727c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:01.313999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eef0ab-8f95-4112-abef-8bb4b57a727c None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:01.314281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eef0ab-8f95-4112-abef-8bb4b57a727c None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:01.314658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eef0ab-8f95-4112-abef-8bb4b57a727c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:01.326857 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eef0ab-8f95-4112-abef-8bb4b57a727c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:01.328618 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eef0ab-8f95-4112-abef-8bb4b57a727c None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:01.348237 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-b5eef0ab-8f95-4112-abef-8bb4b57a727c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:42:01.348237 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:42:01.348237 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:42:01.348237 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:42:01.348237 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:42:01.348237 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:42:01.348237 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:42:01.348237 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:42:01.348237 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:42:01.348237 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:42:01.348237 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:42:01.348237 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:42:01.348237 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:42:01.348237 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:42:01.348237 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:42:01.348237 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:42:01.349320 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:42:01.349320 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:42:01.349320 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:42:01.349320 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:42:01.349320 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:42:01.349320 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:42:01.349320 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:42:01.349320 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:42:01.349320 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:42:01.349320 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:42:01.349320 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:42:01.349320 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:42:01.349320 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:42:01.349320 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:42:01.349320 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:42:01.349320 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:42:01.349320 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:42:01.350228 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:42:01.350228 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:42:01.350228 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:42:01.350228 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 623/1237] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:42:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:42:01.356475 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00349187-7867-4364-973f-76ff22ed49c0 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:01.480276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00349187-7867-4364-973f-76ff22ed49c0 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:01.489636 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:01.515839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7341f1-70f9-4f0d-b777-0ee7020b4b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:01.516367 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7341f1-70f9-4f0d-b777-0ee7020b4b1c None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:01.516645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7341f1-70f9-4f0d-b777-0ee7020b4b1c None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:01.516912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7341f1-70f9-4f0d-b777-0ee7020b4b1c None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:01.517547 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7341f1-70f9-4f0d-b777-0ee7020b4b1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:42:01.517847 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7341f1-70f9-4f0d-b777-0ee7020b4b1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:01.519254 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7341f1-70f9-4f0d-b777-0ee7020b4b1c None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:01.531963 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 615/1238] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:42:01.538802 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eef0ab-8f95-4112-abef-8bb4b57a727c None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:01.655057 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eef0ab-8f95-4112-abef-8bb4b57a727c None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:01.692858 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1b174-e8bb-4ce1-b2c3-c7e64aa2ce1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:01.693718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1b174-e8bb-4ce1-b2c3-c7e64aa2ce1a None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:01.694043 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1b174-e8bb-4ce1-b2c3-c7e64aa2ce1a None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:01.694433 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1b174-e8bb-4ce1-b2c3-c7e64aa2ce1a None admin] PATH_INFO: `/v3/users/placement` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:01.698143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:01.705427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1b174-e8bb-4ce1-b2c3-c7e64aa2ce1a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:01.707913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1b174-e8bb-4ce1-b2c3-c7e64aa2ce1a None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:01.720440 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-66b1b174-e8bb-4ce1-b2c3-c7e64aa2ce1a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 06 20:42:01.720440 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:42:01.720440 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:42:01.720440 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:42:01.720440 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:42:01.720440 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:42:01.720440 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:42:01.720440 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:42:01.720440 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:42:01.720440 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:42:01.720440 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:42:01.720440 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:42:01.720440 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:42:01.720440 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:42:01.720440 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:42:01.720440 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:42:01.721876 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:42:01.721876 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:42:01.721876 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:42:01.721876 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:42:01.721876 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:42:01.721876 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:42:01.721876 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:42:01.721876 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:42:01.721876 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:42:01.721876 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:42:01.721876 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:42:01.721876 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:42:01.721876 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:42:01.721876 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:42:01.721876 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:42:01.721876 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:42:01.721876 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:42:01.721876 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:42:01.723190 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:42:01.723190 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:42:01.723190 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:42:01.723190 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:42:01.723190 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:42:01.723190 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:42:01.723190 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:42:01.723190 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:42:01.723190 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 06 20:42:01.723190 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:42:01.723190 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 624/1239] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:42:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:42:01.727733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7341f1-70f9-4f0d-b777-0ee7020b4b1c None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:01.834374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7341f1-70f9-4f0d-b777-0ee7020b4b1c None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:01.870477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a2c32-54b0-48d1-8d36-7f6d84a914a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:01.871168 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a2c32-54b0-48d1-8d36-7f6d84a914a7 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:01.871457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a2c32-54b0-48d1-8d36-7f6d84a914a7 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:01.871719 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a2c32-54b0-48d1-8d36-7f6d84a914a7 None admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:01.872486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a2c32-54b0-48d1-8d36-7f6d84a914a7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:42:01.872758 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a2c32-54b0-48d1-8d36-7f6d84a914a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:01.874184 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a2c32-54b0-48d1-8d36-7f6d84a914a7 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:01.892235 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 616/1240] 10.222.0.33 () {56 vars in 1143 bytes} [Sat Aug 6 20:42:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:42:01.898129 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1b174-e8bb-4ce1-b2c3-c7e64aa2ce1a None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:02.007377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1b174-e8bb-4ce1-b2c3-c7e64aa2ce1a None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:02.044480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e87b7d-7a25-487b-ada9-390a7a1950cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:02.045085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e87b7d-7a25-487b-ada9-390a7a1950cc None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:02.045364 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e87b7d-7a25-487b-ada9-390a7a1950cc None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:02.045634 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e87b7d-7a25-487b-ada9-390a7a1950cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:02.112266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:02.119508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e87b7d-7a25-487b-ada9-390a7a1950cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:02.121687 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e87b7d-7a25-487b-ada9-390a7a1950cc None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:02.224677 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 625/1241] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:42:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 20:42:02.231678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a2c32-54b0-48d1-8d36-7f6d84a914a7 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:02.259513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:02.336196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a2c32-54b0-48d1-8d36-7f6d84a914a7 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:02.373982 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b2d5a-9cc1-4a5d-a1c3-052f49def220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:02.374530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b2d5a-9cc1-4a5d-a1c3-052f49def220 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:02.374940 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b2d5a-9cc1-4a5d-a1c3-052f49def220 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:02.375121 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b2d5a-9cc1-4a5d-a1c3-052f49def220 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:02.387407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b2d5a-9cc1-4a5d-a1c3-052f49def220 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:02.388865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b2d5a-9cc1-4a5d-a1c3-052f49def220 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:02.406835 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-427b2d5a-9cc1-4a5d-a1c3-052f49def220 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:42:02.406835 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:42:02.406835 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:42:02.406835 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:42:02.406835 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:42:02.406835 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:42:02.406835 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:42:02.406835 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:42:02.406835 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:42:02.406835 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:42:02.406835 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:42:02.406835 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:42:02.406835 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:42:02.406835 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:42:02.406835 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:42:02.406835 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:42:02.408237 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:42:02.408237 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:42:02.408237 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:42:02.408237 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:42:02.408237 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:42:02.408237 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:42:02.408237 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:42:02.408237 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:42:02.408237 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:42:02.408237 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:42:02.408237 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:42:02.408237 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:42:02.408237 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:42:02.408237 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:42:02.408237 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:42:02.408237 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:42:02.408237 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:42:02.409941 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:42:02.409941 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:42:02.409941 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:42:02.411703 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 617/1242] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:42:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:42:02.419418 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e87b7d-7a25-487b-ada9-390a7a1950cc None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:02.531995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:02.538476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e87b7d-7a25-487b-ada9-390a7a1950cc None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:02.575220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb7902-ee78-4f8c-b0d7-98a1a292e9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:02.575821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb7902-ee78-4f8c-b0d7-98a1a292e9a4 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:02.576103 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb7902-ee78-4f8c-b0d7-98a1a292e9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:02.576376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb7902-ee78-4f8c-b0d7-98a1a292e9a4 None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:02.577014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb7902-ee78-4f8c-b0d7-98a1a292e9a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:42:02.577318 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb7902-ee78-4f8c-b0d7-98a1a292e9a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:02.580227 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb7902-ee78-4f8c-b0d7-98a1a292e9a4 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:02.592715 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 626/1243] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:42:02.598615 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b2d5a-9cc1-4a5d-a1c3-052f49def220 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:02.686040 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:02.711812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b2d5a-9cc1-4a5d-a1c3-052f49def220 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:02.745951 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75792f-36f4-40c8-9d14-83b1529ef1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:02.746861 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75792f-36f4-40c8-9d14-83b1529ef1da None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:02.747142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75792f-36f4-40c8-9d14-83b1529ef1da None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:02.747412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75792f-36f4-40c8-9d14-83b1529ef1da None admin] PATH_INFO: `/v3/projects/service` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:02.755027 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75792f-36f4-40c8-9d14-83b1529ef1da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:02.756610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75792f-36f4-40c8-9d14-83b1529ef1da None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:02.768751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-ec75792f-36f4-40c8-9d14-83b1529ef1da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:42:02.768751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:42:02.768751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:42:02.768751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:42:02.768751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:42:02.768751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:42:02.768751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:42:02.768751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:42:02.768751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:42:02.768751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:42:02.768751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:42:02.768751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:42:02.768751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:42:02.768751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:42:02.768751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:42:02.769783 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:42:02.769783 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:42:02.769783 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:42:02.769783 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:42:02.769783 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:42:02.769783 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:42:02.769783 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:42:02.769783 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:42:02.769783 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:42:02.769783 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:42:02.769783 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:42:02.769783 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:42:02.769783 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:42:02.769783 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:42:02.769783 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:42:02.769783 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:42:02.769783 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:42:02.770779 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:42:02.770779 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:42:02.770779 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:42:02.770779 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:42:02.770779 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:42:02.770779 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:42:02.770779 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:42:02.770779 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:42:02.770779 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 618/1244] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:42:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:42:02.775797 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb7902-ee78-4f8c-b0d7-98a1a292e9a4 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:02.888320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb7902-ee78-4f8c-b0d7-98a1a292e9a4 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:02.924592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ce0bc-8bee-4810-9abd-fc67fe205e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:02.925097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ce0bc-8bee-4810-9abd-fc67fe205e76 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:02.925693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ce0bc-8bee-4810-9abd-fc67fe205e76 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:02.925969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ce0bc-8bee-4810-9abd-fc67fe205e76 None admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:02.926685 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ce0bc-8bee-4810-9abd-fc67fe205e76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:42:02.926992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ce0bc-8bee-4810-9abd-fc67fe205e76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:02.928516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ce0bc-8bee-4810-9abd-fc67fe205e76 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:02.940736 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 627/1245] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Aug 6 20:42:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:42:02.947042 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75792f-36f4-40c8-9d14-83b1529ef1da None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:03.062921 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75792f-36f4-40c8-9d14-83b1529ef1da None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:03.101885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fadfb-ed0c-4da0-a927-5ee15a72a915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:03.102494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fadfb-ed0c-4da0-a927-5ee15a72a915 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:03.102824 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fadfb-ed0c-4da0-a927-5ee15a72a915 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:03.103095 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fadfb-ed0c-4da0-a927-5ee15a72a915 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:03.103865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fadfb-ed0c-4da0-a927-5ee15a72a915 None admin] RBAC: Adding query filter params (role.id=55fe0e239bac413b90c785211607e1a4, scope.project.id=6c4962342201407a89793c5c9a6a6f36, user.id=aeafb87d52414c979a774861a2d49ab0) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:42:03.104163 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fadfb-ed0c-4da0-a927-5ee15a72a915 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:03.106142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fadfb-ed0c-4da0-a927-5ee15a72a915 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:03.112402 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 619/1246] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:42:02 2022] GET /identity/v3/role_assignments?user.id=aeafb87d52414c979a774861a2d49ab0&scope.project.id=6c4962342201407a89793c5c9a6a6f36&role.id=55fe0e239bac413b90c785211607e1a4 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:42:05.733703 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee8c81-9fbe-4dcf-83aa-5acb7569c7d8 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:05.734250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee8c81-9fbe-4dcf-83aa-5acb7569c7d8 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:05.734250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee8c81-9fbe-4dcf-83aa-5acb7569c7d8 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:05.735696 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 628/1247] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:42:05.742148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb1df4-c858-4e66-8348-26ddcb922d78 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:05.742692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb1df4-c858-4e66-8348-26ddcb922d78 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:05.742801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb1df4-c858-4e66-8348-26ddcb922d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:05.749967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:05.764021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d2cb1df4-c858-4e66-8348-26ddcb922d78 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:42:05.765208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d2cb1df4-c858-4e66-8348-26ddcb922d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:05.837329 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 620/1248] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:42:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:42:05.863603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee8c81-9fbe-4dcf-83aa-5acb7569c7d8 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:05.882689 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:05.976718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee8c81-9fbe-4dcf-83aa-5acb7569c7d8 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:06.016415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8de0c2-31b8-4492-8be9-c81166268f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:06.017053 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8de0c2-31b8-4492-8be9-c81166268f2b None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:06.017340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8de0c2-31b8-4492-8be9-c81166268f2b None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:06.017612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8de0c2-31b8-4492-8be9-c81166268f2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:06.029399 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8de0c2-31b8-4492-8be9-c81166268f2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:42:06.034188 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-9d8de0c2-31b8-4492-8be9-c81166268f2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:42:06.034188 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:42:06.034188 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:42:06.034188 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:42:06.034188 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:42:06.034188 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:42:06.034188 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:42:06.034188 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:42:06.034188 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:42:06.034188 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:42:06.034188 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:42:06.034188 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:42:06.034188 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:42:06.034188 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:42:06.034188 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:42:06.034188 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:42:06.035342 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:42:06.035342 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:42:06.035342 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:42:06.035342 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:42:06.035342 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:42:06.035342 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:42:06.035342 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:42:06.035342 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:42:06.035342 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:42:06.035342 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:42:06.035342 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:42:06.035342 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:42:06.035342 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:42:06.035342 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:42:06.035342 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:42:06.035342 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:42:06.036325 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:42:06.036325 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:42:06.036325 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:42:06.036325 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:42:06.036325 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:42:06.036325 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:42:06.036325 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:42:06.036325 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:42:06.036325 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:42:06.036325 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:42:06.036325 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:42:06.036325 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:42:06.036325 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 629/1249] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Aug 6 20:42:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:42:06.041399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb1df4-c858-4e66-8348-26ddcb922d78 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:06.143505 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb1df4-c858-4e66-8348-26ddcb922d78 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:06.174224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:06.179906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256ae7f-dd6d-4bf2-b9fd-2d9dd49aa11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:06.180509 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256ae7f-dd6d-4bf2-b9fd-2d9dd49aa11b None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:06.180788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256ae7f-dd6d-4bf2-b9fd-2d9dd49aa11b None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:06.181059 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256ae7f-dd6d-4bf2-b9fd-2d9dd49aa11b None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:06.181717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256ae7f-dd6d-4bf2-b9fd-2d9dd49aa11b None admin] RBAC: Adding query filter params (name=admin) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:42:06.182018 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256ae7f-dd6d-4bf2-b9fd-2d9dd49aa11b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:06.183495 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256ae7f-dd6d-4bf2-b9fd-2d9dd49aa11b None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:06.192475 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 621/1250] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:42:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:42:06.198317 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8de0c2-31b8-4492-8be9-c81166268f2b None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:06.291835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:06.320531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8de0c2-31b8-4492-8be9-c81166268f2b None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:06.358886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25eabb4-1203-4ad1-b29d-f7b05a48e48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:06.359602 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25eabb4-1203-4ad1-b29d-f7b05a48e48a None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:06.359895 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25eabb4-1203-4ad1-b29d-f7b05a48e48a None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:06.360167 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25eabb4-1203-4ad1-b29d-f7b05a48e48a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:06.372505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25eabb4-1203-4ad1-b29d-f7b05a48e48a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:06.373933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25eabb4-1203-4ad1-b29d-f7b05a48e48a None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:06.389613 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-f25eabb4-1203-4ad1-b29d-f7b05a48e48a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:42:06.389613 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:42:06.389613 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:42:06.389613 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:42:06.389613 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:42:06.389613 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:42:06.389613 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:42:06.389613 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:42:06.389613 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:42:06.389613 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:42:06.389613 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:42:06.389613 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:42:06.389613 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:42:06.389613 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:42:06.389613 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:42:06.389613 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:42:06.391224 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:42:06.391224 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:42:06.391224 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:42:06.391224 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:42:06.391224 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:42:06.391224 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:42:06.391224 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:42:06.391224 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:42:06.391224 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:42:06.391224 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:42:06.391224 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:42:06.391224 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:42:06.391224 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:42:06.391224 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:42:06.391224 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:42:06.391224 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:42:06.391224 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:42:06.392564 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:42:06.392564 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:42:06.392564 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:42:06.392564 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 630/1251] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:42:06.396906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256ae7f-dd6d-4bf2-b9fd-2d9dd49aa11b None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:06.508740 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256ae7f-dd6d-4bf2-b9fd-2d9dd49aa11b None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:06.546533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9a7cb-6e75-4681-90a2-ad215b32949d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:06.547095 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9a7cb-6e75-4681-90a2-ad215b32949d None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:06.547373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9a7cb-6e75-4681-90a2-ad215b32949d None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:06.547650 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9a7cb-6e75-4681-90a2-ad215b32949d None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:06.548278 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9a7cb-6e75-4681-90a2-ad215b32949d None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:42:06.548584 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9a7cb-6e75-4681-90a2-ad215b32949d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:06.549949 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9a7cb-6e75-4681-90a2-ad215b32949d None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:06.562790 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 622/1252] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:42:06.568519 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25eabb4-1203-4ad1-b29d-f7b05a48e48a None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:06.673562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25eabb4-1203-4ad1-b29d-f7b05a48e48a None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:06.705211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:06.713262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196b878-277d-4ed8-908c-d7564dfc9718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:06.713898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196b878-277d-4ed8-908c-d7564dfc9718 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:06.714179 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196b878-277d-4ed8-908c-d7564dfc9718 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:06.714455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196b878-277d-4ed8-908c-d7564dfc9718 None admin] PATH_INFO: `/v3/users/placement` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:06.723433 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4196b878-277d-4ed8-908c-d7564dfc9718 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:06.724964 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4196b878-277d-4ed8-908c-d7564dfc9718 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:06.737414 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-4196b878-277d-4ed8-908c-d7564dfc9718 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 06 20:42:06.737414 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:42:06.737414 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:42:06.737414 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:42:06.737414 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:42:06.737414 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:42:06.737414 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:42:06.737414 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:42:06.737414 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:42:06.737414 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:42:06.737414 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:42:06.737414 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:42:06.737414 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:42:06.737414 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:42:06.737414 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:42:06.737414 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:42:06.743271 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:42:06.743271 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:42:06.743271 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:42:06.743271 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:42:06.743271 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:42:06.743271 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:42:06.743271 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:42:06.743271 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:42:06.743271 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:42:06.743271 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:42:06.743271 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:42:06.743271 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:42:06.743271 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:42:06.743271 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:42:06.743271 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:42:06.743271 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:42:06.743271 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:42:06.743271 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:42:06.744452 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:42:06.744452 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:42:06.744452 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:42:06.744452 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:42:06.744452 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:42:06.744452 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:42:06.744452 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:42:06.744452 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:42:06.744452 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 06 20:42:06.744452 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:42:06.744452 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 631/1253] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:42:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:42:06.745183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9a7cb-6e75-4681-90a2-ad215b32949d None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:06.802901 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:06.850876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9a7cb-6e75-4681-90a2-ad215b32949d None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:06.889684 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358d123-fe4d-4f40-99ad-9621e3a5d10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:06.890439 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358d123-fe4d-4f40-99ad-9621e3a5d10b None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:06.890801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358d123-fe4d-4f40-99ad-9621e3a5d10b None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:06.891068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358d123-fe4d-4f40-99ad-9621e3a5d10b None admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:06.891790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358d123-fe4d-4f40-99ad-9621e3a5d10b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:42:06.892094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358d123-fe4d-4f40-99ad-9621e3a5d10b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:06.893723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358d123-fe4d-4f40-99ad-9621e3a5d10b None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:06.912071 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 623/1254] 10.222.0.33 () {56 vars in 1143 bytes} [Sat Aug 6 20:42:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:42:06.918671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196b878-277d-4ed8-908c-d7564dfc9718 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:07.031232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196b878-277d-4ed8-908c-d7564dfc9718 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:07.066705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e856544-875c-4c68-97dd-08aec6426b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:07.067180 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e856544-875c-4c68-97dd-08aec6426b7f None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:07.067459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e856544-875c-4c68-97dd-08aec6426b7f None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:07.067735 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e856544-875c-4c68-97dd-08aec6426b7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:07.132545 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:07.145051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e856544-875c-4c68-97dd-08aec6426b7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:07.146535 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e856544-875c-4c68-97dd-08aec6426b7f None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:07.265890 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 632/1255] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:42:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 06 20:42:07.271772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358d123-fe4d-4f40-99ad-9621e3a5d10b None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:07.376072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358d123-fe4d-4f40-99ad-9621e3a5d10b None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:07.391933 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:07.419791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489025fa-0143-4bcc-a1fc-31478198af22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:07.420428 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489025fa-0143-4bcc-a1fc-31478198af22 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:07.420705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489025fa-0143-4bcc-a1fc-31478198af22 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:07.421015 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489025fa-0143-4bcc-a1fc-31478198af22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:07.432252 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489025fa-0143-4bcc-a1fc-31478198af22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:07.433767 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489025fa-0143-4bcc-a1fc-31478198af22 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:07.448746 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-489025fa-0143-4bcc-a1fc-31478198af22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:42:07.448746 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:42:07.448746 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:42:07.448746 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:42:07.448746 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:42:07.448746 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:42:07.448746 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:42:07.448746 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:42:07.448746 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:42:07.448746 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:42:07.448746 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:42:07.448746 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:42:07.448746 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:42:07.448746 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:42:07.448746 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:42:07.448746 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:42:07.450569 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:42:07.450569 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:42:07.450569 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:42:07.450569 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:42:07.450569 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:42:07.450569 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:42:07.450569 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:42:07.450569 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:42:07.450569 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:42:07.450569 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:42:07.450569 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:42:07.450569 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:42:07.450569 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:42:07.450569 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:42:07.450569 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:42:07.450569 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:42:07.450569 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:42:07.451659 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:42:07.451659 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:42:07.451659 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:42:07.451659 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 624/1256] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:42:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:42:07.456326 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e856544-875c-4c68-97dd-08aec6426b7f None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:07.551603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:07.564575 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e856544-875c-4c68-97dd-08aec6426b7f None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:07.601524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed776a5-210c-4c11-b399-7e0276b94fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:07.602134 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed776a5-210c-4c11-b399-7e0276b94fb1 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:07.602415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed776a5-210c-4c11-b399-7e0276b94fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:07.602723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed776a5-210c-4c11-b399-7e0276b94fb1 None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:07.603375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed776a5-210c-4c11-b399-7e0276b94fb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:42:07.603680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed776a5-210c-4c11-b399-7e0276b94fb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:07.605046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed776a5-210c-4c11-b399-7e0276b94fb1 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:07.621903 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 633/1257] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:42:07.623382 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489025fa-0143-4bcc-a1fc-31478198af22 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:07.733271 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489025fa-0143-4bcc-a1fc-31478198af22 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:07.771251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7338623-9c1e-426d-bd06-cca2f590d37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:07.771924 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7338623-9c1e-426d-bd06-cca2f590d37c None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:07.772167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7338623-9c1e-426d-bd06-cca2f590d37c None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:07.772437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7338623-9c1e-426d-bd06-cca2f590d37c None admin] PATH_INFO: `/v3/projects/service` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:07.781253 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7338623-9c1e-426d-bd06-cca2f590d37c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:07.782763 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7338623-9c1e-426d-bd06-cca2f590d37c None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:07.795740 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-a7338623-9c1e-426d-bd06-cca2f590d37c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:42:07.795740 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:42:07.795740 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:42:07.795740 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:42:07.795740 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:42:07.795740 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:42:07.795740 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:42:07.795740 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:42:07.795740 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:42:07.795740 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:42:07.795740 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:42:07.795740 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:42:07.795740 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:42:07.795740 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:42:07.795740 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:42:07.796897 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:42:07.796897 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:42:07.796897 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:42:07.796897 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:42:07.796897 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:42:07.796897 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:42:07.796897 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:42:07.796897 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:42:07.796897 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:42:07.796897 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:42:07.796897 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:42:07.796897 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:42:07.796897 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:42:07.796897 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:42:07.796897 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:42:07.796897 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:42:07.796897 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:42:07.797822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:42:07.797822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:42:07.797822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:42:07.797822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:42:07.797822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:42:07.797822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:42:07.797822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:42:07.797822 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:42:07.797822 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 625/1258] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:42:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:42:07.803360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed776a5-210c-4c11-b399-7e0276b94fb1 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:07.910018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed776a5-210c-4c11-b399-7e0276b94fb1 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:07.945118 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aff2d4-4146-4aa6-89e5-20408bb55522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:07.945640 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aff2d4-4146-4aa6-89e5-20408bb55522 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:07.945918 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aff2d4-4146-4aa6-89e5-20408bb55522 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:07.946194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aff2d4-4146-4aa6-89e5-20408bb55522 None admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:07.946906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aff2d4-4146-4aa6-89e5-20408bb55522 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:42:07.947216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aff2d4-4146-4aa6-89e5-20408bb55522 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:07.948641 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aff2d4-4146-4aa6-89e5-20408bb55522 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:07.960923 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 634/1259] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Aug 6 20:42:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:42:07.969275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7338623-9c1e-426d-bd06-cca2f590d37c None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:07.996413 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:08.076350 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7338623-9c1e-426d-bd06-cca2f590d37c None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:08.109701 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7c24c-35bd-4db3-bd0a-29421f9b5eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:08.110304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7c24c-35bd-4db3-bd0a-29421f9b5eb0 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:08.110642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7c24c-35bd-4db3-bd0a-29421f9b5eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:08.110885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7c24c-35bd-4db3-bd0a-29421f9b5eb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:08.111597 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7c24c-35bd-4db3-bd0a-29421f9b5eb0 None admin] RBAC: Adding query filter params (role.id=ab245eea8a714462a00c4546309de9c9, scope.project.id=6c4962342201407a89793c5c9a6a6f36, user.id=aeafb87d52414c979a774861a2d49ab0) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:42:08.111902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7c24c-35bd-4db3-bd0a-29421f9b5eb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:08.113314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7c24c-35bd-4db3-bd0a-29421f9b5eb0 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:08.118839 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 626/1260] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:42:07 2022] GET /identity/v3/role_assignments?user.id=aeafb87d52414c979a774861a2d49ab0&scope.project.id=6c4962342201407a89793c5c9a6a6f36&role.id=ab245eea8a714462a00c4546309de9c9 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:42:10.284503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f74d7-4359-422c-94b3-a384b0ccd7d7 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:10.285058 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f74d7-4359-422c-94b3-a384b0ccd7d7 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:10.285058 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f74d7-4359-422c-94b3-a384b0ccd7d7 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:10.286378 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 635/1261] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:42:10.291725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd7b59-146d-468e-a8d5-33a34c616ad5 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:10.292117 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd7b59-146d-468e-a8d5-33a34c616ad5 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:10.292262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd7b59-146d-468e-a8d5-33a34c616ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:10.312922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-00cd7b59-146d-468e-a8d5-33a34c616ad5 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:42:10.314140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-00cd7b59-146d-468e-a8d5-33a34c616ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:10.380886 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 627/1262] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:42:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:42:10.404995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f74d7-4359-422c-94b3-a384b0ccd7d7 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:10.417250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:10.514425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f74d7-4359-422c-94b3-a384b0ccd7d7 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:10.549157 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a703422-0206-4e3c-8c4f-9c27c66bb5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:10.549709 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a703422-0206-4e3c-8c4f-9c27c66bb5aa None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:10.549984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a703422-0206-4e3c-8c4f-9c27c66bb5aa None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:10.550251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a703422-0206-4e3c-8c4f-9c27c66bb5aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:10.560739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a703422-0206-4e3c-8c4f-9c27c66bb5aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:42:10.565436 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-8a703422-0206-4e3c-8c4f-9c27c66bb5aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:42:10.565436 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:42:10.565436 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:42:10.565436 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:42:10.565436 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:42:10.565436 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:42:10.565436 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:42:10.565436 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:42:10.565436 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:42:10.565436 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:42:10.565436 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:42:10.565436 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:42:10.565436 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:42:10.565436 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:42:10.565436 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:42:10.565436 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:42:10.566609 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:42:10.566609 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:42:10.566609 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:42:10.566609 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:42:10.566609 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:42:10.566609 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:42:10.566609 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:42:10.566609 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:42:10.566609 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:42:10.566609 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:42:10.566609 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:42:10.566609 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:42:10.566609 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:42:10.566609 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:42:10.566609 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:42:10.566609 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:42:10.567816 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:42:10.567816 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:42:10.567816 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:42:10.567816 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:42:10.567816 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:42:10.567816 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:42:10.567816 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:42:10.567816 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:42:10.567816 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:42:10.567816 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:42:10.567816 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:42:10.567816 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:42:10.567816 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 636/1263] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Aug 6 20:42:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:42:10.572684 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd7b59-146d-468e-a8d5-33a34c616ad5 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:10.592401 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:10.670915 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd7b59-146d-468e-a8d5-33a34c616ad5 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:10.707669 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd03a8f-2903-4c80-befa-55d5ef0bc5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:10.708266 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd03a8f-2903-4c80-befa-55d5ef0bc5c2 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:10.708545 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd03a8f-2903-4c80-befa-55d5ef0bc5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:10.708818 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd03a8f-2903-4c80-befa-55d5ef0bc5c2 None admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:10.709477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd03a8f-2903-4c80-befa-55d5ef0bc5c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:42:10.709780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd03a8f-2903-4c80-befa-55d5ef0bc5c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:10.711179 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd03a8f-2903-4c80-befa-55d5ef0bc5c2 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:10.719621 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 628/1264] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:42:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:42:10.725259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a703422-0206-4e3c-8c4f-9c27c66bb5aa None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:10.788985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:10.821354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a703422-0206-4e3c-8c4f-9c27c66bb5aa None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:10.854329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c402222-e51b-4234-8d89-16514aa08d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:10.854958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c402222-e51b-4234-8d89-16514aa08d5d None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:10.855232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c402222-e51b-4234-8d89-16514aa08d5d None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:10.855618 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c402222-e51b-4234-8d89-16514aa08d5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:10.865199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c402222-e51b-4234-8d89-16514aa08d5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:10.866642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c402222-e51b-4234-8d89-16514aa08d5d None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:10.881116 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-1c402222-e51b-4234-8d89-16514aa08d5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:42:10.881116 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:42:10.881116 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:42:10.881116 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:42:10.881116 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:42:10.881116 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:42:10.881116 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:42:10.881116 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:42:10.881116 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:42:10.881116 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:42:10.881116 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:42:10.881116 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:42:10.881116 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:42:10.881116 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:42:10.881116 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:42:10.881116 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:42:10.882241 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:42:10.882241 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:42:10.882241 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:42:10.882241 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:42:10.882241 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:42:10.882241 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:42:10.882241 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:42:10.882241 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:42:10.882241 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:42:10.882241 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:42:10.882241 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:42:10.882241 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:42:10.882241 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:42:10.882241 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:42:10.882241 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:42:10.882241 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:42:10.882241 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:42:10.883376 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:42:10.883376 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:42:10.883376 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:42:10.883376 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 637/1265] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:42:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:42:10.888685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd03a8f-2903-4c80-befa-55d5ef0bc5c2 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:10.967331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:10.987023 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd03a8f-2903-4c80-befa-55d5ef0bc5c2 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:11.020922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719a12c-709a-4728-a5bd-fa034ce464d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:11.021518 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719a12c-709a-4728-a5bd-fa034ce464d4 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:11.021798 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719a12c-709a-4728-a5bd-fa034ce464d4 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:11.022070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719a12c-709a-4728-a5bd-fa034ce464d4 None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:11.022733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719a12c-709a-4728-a5bd-fa034ce464d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:42:11.023037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719a12c-709a-4728-a5bd-fa034ce464d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:11.024416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719a12c-709a-4728-a5bd-fa034ce464d4 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:11.035936 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 629/1266] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:42:11.041611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c402222-e51b-4234-8d89-16514aa08d5d None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:11.140161 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c402222-e51b-4234-8d89-16514aa08d5d None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:11.159040 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:11.173724 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da5705-2176-4e4a-87b5-29fea5c84ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:11.174334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da5705-2176-4e4a-87b5-29fea5c84ab9 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:11.174658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da5705-2176-4e4a-87b5-29fea5c84ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:11.174918 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da5705-2176-4e4a-87b5-29fea5c84ab9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:11.182231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da5705-2176-4e4a-87b5-29fea5c84ab9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:11.184390 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da5705-2176-4e4a-87b5-29fea5c84ab9 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:11.195266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-a2da5705-2176-4e4a-87b5-29fea5c84ab9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 06 20:42:11.195266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:42:11.195266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:42:11.195266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:42:11.195266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:42:11.195266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:42:11.195266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:42:11.195266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:42:11.195266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:42:11.195266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:42:11.195266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:42:11.195266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:42:11.195266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:42:11.195266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:42:11.195266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:42:11.195266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:42:11.196366 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:42:11.196366 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:42:11.196366 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:42:11.196366 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:42:11.196366 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:42:11.196366 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:42:11.196366 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:42:11.196366 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:42:11.196366 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:42:11.196366 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:42:11.196366 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:42:11.196366 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:42:11.196366 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:42:11.196366 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:42:11.196366 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:42:11.196366 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:42:11.196366 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:42:11.196366 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:42:11.197347 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:42:11.197347 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:42:11.197347 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:42:11.197347 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:42:11.197347 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:42:11.197347 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:42:11.197347 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:42:11.197347 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:42:11.197347 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 06 20:42:11.197347 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:42:11.197347 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 638/1267] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:42:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:42:11.202475 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719a12c-709a-4728-a5bd-fa034ce464d4 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:11.297342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719a12c-709a-4728-a5bd-fa034ce464d4 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:11.329756 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef1dda-4021-4138-b9c7-d69e8724112c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:11.330341 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef1dda-4021-4138-b9c7-d69e8724112c None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:11.330653 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef1dda-4021-4138-b9c7-d69e8724112c None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:11.330920 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef1dda-4021-4138-b9c7-d69e8724112c None admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:11.331620 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef1dda-4021-4138-b9c7-d69e8724112c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:42:11.331915 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef1dda-4021-4138-b9c7-d69e8724112c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:11.333321 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef1dda-4021-4138-b9c7-d69e8724112c None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:11.341647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:11.350174 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 630/1268] 10.222.0.33 () {56 vars in 1143 bytes} [Sat Aug 6 20:42:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:42:11.356621 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da5705-2176-4e4a-87b5-29fea5c84ab9 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:11.461788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da5705-2176-4e4a-87b5-29fea5c84ab9 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:11.494006 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07899df8-b0f6-4bf5-a44d-8b39ad31124e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:11.494646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07899df8-b0f6-4bf5-a44d-8b39ad31124e None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:11.494925 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07899df8-b0f6-4bf5-a44d-8b39ad31124e None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:11.495196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07899df8-b0f6-4bf5-a44d-8b39ad31124e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:11.505950 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07899df8-b0f6-4bf5-a44d-8b39ad31124e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:11.507392 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07899df8-b0f6-4bf5-a44d-8b39ad31124e None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:11.521135 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-07899df8-b0f6-4bf5-a44d-8b39ad31124e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:42:11.521135 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:42:11.521135 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:42:11.521135 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:42:11.521135 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:42:11.521135 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:42:11.521135 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:42:11.521135 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:42:11.521135 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:42:11.521135 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:42:11.521135 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:42:11.521135 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:42:11.521135 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:42:11.521135 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:42:11.521135 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:42:11.521135 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:42:11.522238 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:42:11.522238 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:42:11.522238 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:42:11.522238 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:42:11.522238 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:42:11.522238 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:42:11.522238 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:42:11.522238 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:42:11.522238 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:42:11.522238 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:42:11.522238 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:42:11.522238 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:42:11.522238 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:42:11.522238 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:42:11.522238 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:42:11.522238 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:42:11.522238 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:42:11.523371 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:42:11.523371 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:42:11.523371 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:42:11.523371 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 639/1269] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:42:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:42:11.528069 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef1dda-4021-4138-b9c7-d69e8724112c None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:11.625644 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef1dda-4021-4138-b9c7-d69e8724112c None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:11.658019 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb4d0d-adee-4838-9d33-054ff5f09d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:11.658633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb4d0d-adee-4838-9d33-054ff5f09d31 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:11.658911 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb4d0d-adee-4838-9d33-054ff5f09d31 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:11.659179 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb4d0d-adee-4838-9d33-054ff5f09d31 None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:11.659804 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb4d0d-adee-4838-9d33-054ff5f09d31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:42:11.660102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb4d0d-adee-4838-9d33-054ff5f09d31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:11.661445 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb4d0d-adee-4838-9d33-054ff5f09d31 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:11.674244 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 631/1270] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:42:11.680101 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07899df8-b0f6-4bf5-a44d-8b39ad31124e None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:11.710993 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:11.781213 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07899df8-b0f6-4bf5-a44d-8b39ad31124e None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:11.814452 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33c493-3eb3-4104-acf2-6e4ca6468879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:11.815087 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33c493-3eb3-4104-acf2-6e4ca6468879 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:11.815386 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33c493-3eb3-4104-acf2-6e4ca6468879 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:11.815655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33c493-3eb3-4104-acf2-6e4ca6468879 None admin] PATH_INFO: `/v3/projects/service` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:11.821994 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33c493-3eb3-4104-acf2-6e4ca6468879 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:11.823445 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33c493-3eb3-4104-acf2-6e4ca6468879 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:11.834253 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-bd33c493-3eb3-4104-acf2-6e4ca6468879 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:42:11.834253 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:42:11.834253 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:42:11.834253 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:42:11.834253 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:42:11.834253 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:42:11.834253 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:42:11.834253 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:42:11.834253 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:42:11.834253 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:42:11.834253 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:42:11.834253 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:42:11.834253 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:42:11.834253 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:42:11.834253 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:42:11.835374 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:42:11.835374 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:42:11.835374 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:42:11.835374 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:42:11.835374 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:42:11.835374 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:42:11.835374 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:42:11.835374 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:42:11.835374 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:42:11.835374 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:42:11.835374 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:42:11.835374 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:42:11.835374 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:42:11.835374 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:42:11.835374 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:42:11.835374 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:42:11.835374 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:42:11.836281 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:42:11.836281 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:42:11.836281 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:42:11.836281 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:42:11.836281 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:42:11.836281 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:42:11.836281 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:42:11.836281 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:42:11.836281 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 640/1271] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:42:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:42:11.841922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb4d0d-adee-4838-9d33-054ff5f09d31 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:11.898143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:11.939261 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb4d0d-adee-4838-9d33-054ff5f09d31 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:11.971975 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538dfa5f-62f7-4c51-a5dd-7fa637711c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:11.972558 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538dfa5f-62f7-4c51-a5dd-7fa637711c88 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:11.972833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538dfa5f-62f7-4c51-a5dd-7fa637711c88 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:11.973098 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538dfa5f-62f7-4c51-a5dd-7fa637711c88 None admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:11.973800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538dfa5f-62f7-4c51-a5dd-7fa637711c88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:42:11.974100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538dfa5f-62f7-4c51-a5dd-7fa637711c88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:11.975651 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538dfa5f-62f7-4c51-a5dd-7fa637711c88 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:11.988204 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 632/1272] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Aug 6 20:42:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:42:11.994417 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33c493-3eb3-4104-acf2-6e4ca6468879 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:12.084567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:12.094306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33c493-3eb3-4104-acf2-6e4ca6468879 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:12.127300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5e152-70c0-4ca5-82b8-fe7f07199953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:12.127944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5e152-70c0-4ca5-82b8-fe7f07199953 None admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:12.128219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5e152-70c0-4ca5-82b8-fe7f07199953 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:12.128491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5e152-70c0-4ca5-82b8-fe7f07199953 None admin] PATH_INFO: `/v3/projects/6c4962342201407a89793c5c9a6a6f36/users/aeafb87d52414c979a774861a2d49ab0/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:12.130325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5e152-70c0-4ca5-82b8-fe7f07199953 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c4962342201407a89793c5c9a6a6f36, user_id=aeafb87d52414c979a774861a2d49ab0, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:12.131987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5e152-70c0-4ca5-82b8-fe7f07199953 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:12.144739 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 641/1273] 10.222.0.33 () {58 vars in 1439 bytes} [Sat Aug 6 20:42:11 2022] PUT /identity/v3/projects/6c4962342201407a89793c5c9a6a6f36/users/aeafb87d52414c979a774861a2d49ab0/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:42:14.346779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff21d6-1eb5-40a3-a33a-76039db7a99a None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:14.347309 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff21d6-1eb5-40a3-a33a-76039db7a99a None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:14.347309 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff21d6-1eb5-40a3-a33a-76039db7a99a None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:14.348644 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 633/1274] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:42:14.353729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1130c7-5738-4513-92b5-1ed0ab707b21 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:14.354101 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1130c7-5738-4513-92b5-1ed0ab707b21 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:14.354278 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1130c7-5738-4513-92b5-1ed0ab707b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:14.372073 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-8e1130c7-5738-4513-92b5-1ed0ab707b21 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:42:14.373315 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8e1130c7-5738-4513-92b5-1ed0ab707b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:14.451066 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 642/1275] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:42:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:42:14.476173 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff21d6-1eb5-40a3-a33a-76039db7a99a None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:14.574092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff21d6-1eb5-40a3-a33a-76039db7a99a None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:14.591349 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:14.607789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d572d-aee6-42e6-801a-2b908fe29f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:14.608339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d572d-aee6-42e6-801a-2b908fe29f95 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:14.608613 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d572d-aee6-42e6-801a-2b908fe29f95 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:14.608882 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d572d-aee6-42e6-801a-2b908fe29f95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:14.618613 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d572d-aee6-42e6-801a-2b908fe29f95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:42:14.623751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-5f6d572d-aee6-42e6-801a-2b908fe29f95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:42:14.623751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:42:14.623751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:42:14.623751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:42:14.623751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:42:14.623751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:42:14.623751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:42:14.623751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:42:14.623751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:42:14.623751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:42:14.623751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:42:14.623751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:42:14.623751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:42:14.623751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:42:14.623751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:42:14.623751 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:42:14.624856 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:42:14.624856 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:42:14.624856 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:42:14.624856 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:42:14.624856 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:42:14.624856 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:42:14.624856 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:42:14.624856 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:42:14.624856 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:42:14.624856 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:42:14.624856 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:42:14.624856 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:42:14.624856 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:42:14.624856 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:42:14.624856 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:42:14.624856 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:42:14.625757 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:42:14.625757 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:42:14.625757 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:42:14.625757 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:42:14.625757 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:42:14.625757 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:42:14.625757 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:42:14.625757 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:42:14.625757 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:42:14.625757 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:42:14.625757 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:42:14.625757 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:42:14.625757 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 634/1276] 10.222.0.33 () {56 vars in 1096 bytes} [Sat Aug 6 20:42:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:42:14.631082 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1130c7-5738-4513-92b5-1ed0ab707b21 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:14.709494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:14.727510 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1130c7-5738-4513-92b5-1ed0ab707b21 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:14.759818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c6217-2371-4d82-9bb2-79cceedaa84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:14.760406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c6217-2371-4d82-9bb2-79cceedaa84c None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:14.760681 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c6217-2371-4d82-9bb2-79cceedaa84c None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:14.760950 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c6217-2371-4d82-9bb2-79cceedaa84c None admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:14.761597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c6217-2371-4d82-9bb2-79cceedaa84c None admin] RBAC: Adding query filter params (name=admin) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:42:14.762431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c6217-2371-4d82-9bb2-79cceedaa84c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:14.763810 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c6217-2371-4d82-9bb2-79cceedaa84c None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:14.771516 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 643/1277] 10.222.0.33 () {56 vars in 1099 bytes} [Sat Aug 6 20:42:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:42:14.777426 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d572d-aee6-42e6-801a-2b908fe29f95 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:14.875036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d572d-aee6-42e6-801a-2b908fe29f95 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:14.907698 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c859a-8391-4cc4-937c-5b8f13e86942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:14.908310 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c859a-8391-4cc4-937c-5b8f13e86942 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:14.908586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c859a-8391-4cc4-937c-5b8f13e86942 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:14.908857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c859a-8391-4cc4-937c-5b8f13e86942 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:14.919963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c859a-8391-4cc4-937c-5b8f13e86942 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:14.921398 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c859a-8391-4cc4-937c-5b8f13e86942 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:14.936185 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-cd3c859a-8391-4cc4-937c-5b8f13e86942 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:42:14.936185 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:42:14.936185 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:42:14.936185 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:42:14.936185 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:42:14.936185 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:42:14.936185 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:42:14.936185 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:42:14.936185 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:42:14.936185 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:42:14.936185 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:42:14.936185 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:42:14.936185 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:42:14.936185 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:42:14.936185 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:42:14.936185 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:42:14.937316 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:42:14.937316 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:42:14.937316 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:42:14.937316 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:42:14.937316 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:42:14.937316 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:42:14.937316 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:42:14.937316 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:42:14.937316 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:42:14.937316 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:42:14.937316 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:42:14.937316 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:42:14.937316 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:42:14.937316 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:42:14.937316 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:42:14.937316 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:42:14.937316 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:42:14.938222 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:42:14.938222 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:42:14.938222 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:42:14.938222 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 635/1278] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:42:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:42:14.943114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c6217-2371-4d82-9bb2-79cceedaa84c None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:15.040450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c6217-2371-4d82-9bb2-79cceedaa84c None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:15.073279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b1340-c1fa-475d-a566-94d6f1763fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:15.073875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b1340-c1fa-475d-a566-94d6f1763fa3 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:15.074157 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b1340-c1fa-475d-a566-94d6f1763fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:15.074453 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b1340-c1fa-475d-a566-94d6f1763fa3 None admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:15.075305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b1340-c1fa-475d-a566-94d6f1763fa3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:42:15.075609 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b1340-c1fa-475d-a566-94d6f1763fa3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:15.076969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b1340-c1fa-475d-a566-94d6f1763fa3 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:15.088239 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 644/1279] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:42:15.093884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c859a-8391-4cc4-937c-5b8f13e86942 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:15.124597 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:15.192505 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c859a-8391-4cc4-937c-5b8f13e86942 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:15.225375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51435216-6e83-49d6-847b-2960bd09a075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:15.225990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51435216-6e83-49d6-847b-2960bd09a075 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:15.226268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51435216-6e83-49d6-847b-2960bd09a075 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:15.226560 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51435216-6e83-49d6-847b-2960bd09a075 None admin] PATH_INFO: `/v3/users/placement` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:15.234281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51435216-6e83-49d6-847b-2960bd09a075 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:15.235759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51435216-6e83-49d6-847b-2960bd09a075 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:15.247108 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-51435216-6e83-49d6-847b-2960bd09a075 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 06 20:42:15.247108 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:42:15.247108 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:42:15.247108 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:42:15.247108 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:42:15.247108 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:42:15.247108 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:42:15.247108 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:42:15.247108 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:42:15.247108 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:42:15.247108 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:42:15.247108 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:42:15.247108 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:42:15.247108 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:42:15.247108 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:42:15.247108 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:42:15.248265 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:42:15.248265 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:42:15.248265 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:42:15.248265 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:42:15.248265 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:42:15.248265 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:42:15.248265 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:42:15.248265 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:42:15.248265 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:42:15.248265 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:42:15.248265 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:42:15.248265 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:42:15.248265 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:42:15.248265 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:42:15.248265 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:42:15.248265 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:42:15.248265 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:42:15.248265 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:42:15.249329 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:42:15.249329 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:42:15.249329 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:42:15.249329 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:42:15.249329 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:42:15.249329 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:42:15.249329 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:42:15.249329 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:42:15.249329 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 06 20:42:15.249329 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:42:15.249329 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 636/1280] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:42:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:42:15.254032 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b1340-c1fa-475d-a566-94d6f1763fa3 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:15.257806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:15.352556 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b1340-c1fa-475d-a566-94d6f1763fa3 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:15.392300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018dcd63-43d1-47ae-97b2-126191e0fbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:15.392904 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018dcd63-43d1-47ae-97b2-126191e0fbb7 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:15.393161 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018dcd63-43d1-47ae-97b2-126191e0fbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:15.393431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018dcd63-43d1-47ae-97b2-126191e0fbb7 None admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:15.394153 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018dcd63-43d1-47ae-97b2-126191e0fbb7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:42:15.394454 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018dcd63-43d1-47ae-97b2-126191e0fbb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:15.395894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018dcd63-43d1-47ae-97b2-126191e0fbb7 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:15.413112 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 645/1281] 10.222.0.33 () {56 vars in 1143 bytes} [Sat Aug 6 20:42:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:42:15.419573 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51435216-6e83-49d6-847b-2960bd09a075 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:15.507292 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:15.516841 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51435216-6e83-49d6-847b-2960bd09a075 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:15.550087 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769beee5-1b31-4f51-9790-0a7af71920f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:15.550723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769beee5-1b31-4f51-9790-0a7af71920f4 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:15.551003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769beee5-1b31-4f51-9790-0a7af71920f4 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:15.551276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769beee5-1b31-4f51-9790-0a7af71920f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:15.616746 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769beee5-1b31-4f51-9790-0a7af71920f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:15.618183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769beee5-1b31-4f51-9790-0a7af71920f4 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:15.704837 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:15.715606 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 637/1282] 10.222.0.33 () {58 vars in 1282 bytes} [Sat Aug 6 20:42:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 20:42:15.721478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018dcd63-43d1-47ae-97b2-126191e0fbb7 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:15.781724 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:15.820098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018dcd63-43d1-47ae-97b2-126191e0fbb7 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:15.853842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c78a1-a821-4cc4-8b4b-184d18b7158e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:15.854458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c78a1-a821-4cc4-8b4b-184d18b7158e None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:15.854763 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c78a1-a821-4cc4-8b4b-184d18b7158e None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:15.855039 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c78a1-a821-4cc4-8b4b-184d18b7158e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:15.864814 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c78a1-a821-4cc4-8b4b-184d18b7158e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:15.866244 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c78a1-a821-4cc4-8b4b-184d18b7158e None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:15.880386 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-693c78a1-a821-4cc4-8b4b-184d18b7158e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:42:15.880386 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:42:15.880386 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:42:15.880386 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:42:15.880386 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:42:15.880386 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:42:15.880386 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:42:15.880386 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:42:15.880386 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:42:15.880386 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:42:15.880386 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:42:15.880386 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:42:15.880386 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:42:15.880386 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:42:15.880386 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:42:15.880386 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:42:15.881477 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:42:15.881477 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:42:15.881477 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:42:15.881477 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:42:15.881477 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:42:15.881477 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:42:15.881477 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:42:15.881477 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:42:15.881477 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:42:15.881477 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:42:15.881477 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:42:15.881477 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:42:15.881477 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:42:15.881477 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:42:15.881477 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:42:15.881477 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:42:15.881477 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:42:15.882756 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:42:15.882756 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:42:15.882756 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:42:15.882756 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 646/1283] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:42:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:42:15.887738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769beee5-1b31-4f51-9790-0a7af71920f4 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:15.983273 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769beee5-1b31-4f51-9790-0a7af71920f4 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:16.016378 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27903b9a-8dec-4f4c-9faa-55353aa2c038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:16.016968 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27903b9a-8dec-4f4c-9faa-55353aa2c038 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:16.017243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27903b9a-8dec-4f4c-9faa-55353aa2c038 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:16.017511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27903b9a-8dec-4f4c-9faa-55353aa2c038 None admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:16.018137 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27903b9a-8dec-4f4c-9faa-55353aa2c038 None admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:42:16.018435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27903b9a-8dec-4f4c-9faa-55353aa2c038 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:16.019808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27903b9a-8dec-4f4c-9faa-55353aa2c038 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:16.031127 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 638/1284] 10.222.0.33 () {56 vars in 1109 bytes} [Sat Aug 6 20:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:42:16.036786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c78a1-a821-4cc4-8b4b-184d18b7158e None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:16.133090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c78a1-a821-4cc4-8b4b-184d18b7158e None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:16.146560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:16.166196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8a42d-a75a-4a23-ba0d-0a134ffb1fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:16.166832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8a42d-a75a-4a23-ba0d-0a134ffb1fcc None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:16.167107 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8a42d-a75a-4a23-ba0d-0a134ffb1fcc None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:16.167378 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8a42d-a75a-4a23-ba0d-0a134ffb1fcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:16.173790 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8a42d-a75a-4a23-ba0d-0a134ffb1fcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:16.175244 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8a42d-a75a-4a23-ba0d-0a134ffb1fcc None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:16.186982 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-33b8a42d-a75a-4a23-ba0d-0a134ffb1fcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:42:16.186982 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:42:16.186982 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:42:16.186982 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:42:16.186982 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:42:16.186982 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:42:16.186982 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:42:16.186982 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:42:16.186982 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:42:16.186982 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:42:16.186982 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:42:16.186982 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:42:16.186982 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:42:16.186982 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:42:16.186982 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:42:16.188035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:42:16.188035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:42:16.188035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:42:16.188035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:42:16.188035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:42:16.188035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:42:16.188035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:42:16.188035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:42:16.188035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 20:42:16.188035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:42:16.188035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:42:16.188035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:42:16.188035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:42:16.188035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:42:16.188035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:42:16.188035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:42:16.188035 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:42:16.189313 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:42:16.189313 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:42:16.189313 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:42:16.189313 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:42:16.189313 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:42:16.189313 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:42:16.189313 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:42:16.189313 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 20:42:16.189313 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 647/1285] 10.222.0.33 () {56 vars in 1111 bytes} [Sat Aug 6 20:42:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:42:16.193888 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27903b9a-8dec-4f4c-9faa-55353aa2c038 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:16.242507 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:16.291707 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27903b9a-8dec-4f4c-9faa-55353aa2c038 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:16.325338 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb8d98-02cf-43f5-b3c1-3585bccf0451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:16.325921 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb8d98-02cf-43f5-b3c1-3585bccf0451 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:16.326200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb8d98-02cf-43f5-b3c1-3585bccf0451 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:16.326471 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb8d98-02cf-43f5-b3c1-3585bccf0451 None admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:16.327179 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eb8d98-02cf-43f5-b3c1-3585bccf0451 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:42:16.327484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eb8d98-02cf-43f5-b3c1-3585bccf0451 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:16.328907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eb8d98-02cf-43f5-b3c1-3585bccf0451 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:16.340637 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 639/1286] 10.222.0.33 () {56 vars in 1148 bytes} [Sat Aug 6 20:42:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:42:16.346681 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8a42d-a75a-4a23-ba0d-0a134ffb1fcc None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:16.450006 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8a42d-a75a-4a23-ba0d-0a134ffb1fcc None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:16.483710 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef325701-d83d-4cfa-a253-186c359a4a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:16.484311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef325701-d83d-4cfa-a253-186c359a4a5c None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:16.484608 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef325701-d83d-4cfa-a253-186c359a4a5c None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:16.484865 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef325701-d83d-4cfa-a253-186c359a4a5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:16.485577 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef325701-d83d-4cfa-a253-186c359a4a5c None admin] RBAC: Adding query filter params (role.id=ab245eea8a714462a00c4546309de9c9, scope.project.id=6c4962342201407a89793c5c9a6a6f36, user.id=aeafb87d52414c979a774861a2d49ab0) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:42:16.485886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef325701-d83d-4cfa-a253-186c359a4a5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:16.487364 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef325701-d83d-4cfa-a253-186c359a4a5c None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:16.492943 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 648/1287] 10.222.0.33 () {56 vars in 1374 bytes} [Sat Aug 6 20:42:16 2022] GET /identity/v3/role_assignments?user.id=aeafb87d52414c979a774861a2d49ab0&scope.project.id=6c4962342201407a89793c5c9a6a6f36&role.id=ab245eea8a714462a00c4546309de9c9 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:42:18.726209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e624a-feb6-4444-a3bb-4ce6ccbf3970 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:18.726733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e624a-feb6-4444-a3bb-4ce6ccbf3970 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:18.726824 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e624a-feb6-4444-a3bb-4ce6ccbf3970 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:18.728135 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 640/1288] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:42:18.733527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a6194-3718-4bb5-a1a8-7b8ca2c427a3 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:18.733944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a6194-3718-4bb5-a1a8-7b8ca2c427a3 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:18.734070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a6194-3718-4bb5-a1a8-7b8ca2c427a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:18.752024 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-737a6194-3718-4bb5-a1a8-7b8ca2c427a3 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:42:18.753187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-737a6194-3718-4bb5-a1a8-7b8ca2c427a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:18.781644 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:18.818117 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 649/1289] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:42:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:42:18.841359 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e624a-feb6-4444-a3bb-4ce6ccbf3970 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:18.940360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e624a-feb6-4444-a3bb-4ce6ccbf3970 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:18.952284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:18.975148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9e54e-efdf-41c6-ae03-f77217c10d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:18.975766 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9e54e-efdf-41c6-ae03-f77217c10d45 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:18.976039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9e54e-efdf-41c6-ae03-f77217c10d45 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:18.976313 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9e54e-efdf-41c6-ae03-f77217c10d45 None admin] PATH_INFO: `/v3/services/placement` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:18.976886 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9e54e-efdf-41c6-ae03-f77217c10d45 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:18.978236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9e54e-efdf-41c6-ae03-f77217c10d45 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:18.986682 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-73b9e54e-efdf-41c6-ae03-f77217c10d45 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 20:42:18.986682 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:42:18.986682 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:42:18.986682 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:42:18.986682 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:42:18.986682 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:42:18.986682 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:42:18.986682 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:42:18.986682 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 20:42:18.986682 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:42:18.986682 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:42:18.986682 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:42:18.986682 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:42:18.986682 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:42:18.986682 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:42:18.986682 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:42:18.986682 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:42:18.987909 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:42:18.987909 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:42:18.987909 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:42:18.987909 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:42:18.987909 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:42:18.987909 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:42:18.987909 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:42:18.987909 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:42:18.987909 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:42:18.987909 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:42:18.987909 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:42:18.987909 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:42:18.987909 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:42:18.987909 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:42:18.987909 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:42:18.987909 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:42:18.988981 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:42:18.988981 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:42:18.988981 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:42:18.988981 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:42:18.988981 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:42:18.988981 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:42:18.988981 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:42:18.988981 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:42:18.988981 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:42:18.988981 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:42:18.988981 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:42:18.988981 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:42:18.988981 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 20:42:18.988981 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:42:18.988981 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 641/1290] 10.222.0.33 () {56 vars in 1117 bytes} [Sat Aug 6 20:42:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:42:18.993820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a6194-3718-4bb5-a1a8-7b8ca2c427a3 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:19.093397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a6194-3718-4bb5-a1a8-7b8ca2c427a3 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:19.126076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62437a7f-117c-49c5-8fea-b7050aff6575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:19.126693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62437a7f-117c-49c5-8fea-b7050aff6575 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:19.126971 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62437a7f-117c-49c5-8fea-b7050aff6575 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:19.127239 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62437a7f-117c-49c5-8fea-b7050aff6575 None admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:19.127854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62437a7f-117c-49c5-8fea-b7050aff6575 None admin] RBAC: Adding query filter params (name=placement) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:42:19.128152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62437a7f-117c-49c5-8fea-b7050aff6575 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:19.129496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62437a7f-117c-49c5-8fea-b7050aff6575 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:19.134169 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 650/1291] 10.222.0.33 () {56 vars in 1116 bytes} [Sat Aug 6 20:42:18 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:42:19.139963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9e54e-efdf-41c6-ae03-f77217c10d45 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:19.236276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9e54e-efdf-41c6-ae03-f77217c10d45 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:19.268317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e6b89-f4b5-4a2e-be03-c2f2284710a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:19.269096 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e6b89-f4b5-4a2e-be03-c2f2284710a4 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:19.269427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e6b89-f4b5-4a2e-be03-c2f2284710a4 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:19.269702 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e6b89-f4b5-4a2e-be03-c2f2284710a4 None admin] PATH_INFO: `/v3/services` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:19.270313 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e6b89-f4b5-4a2e-be03-c2f2284710a4 None admin] RBAC: Adding query filter params (type=placement) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:42:19.270638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e6b89-f4b5-4a2e-be03-c2f2284710a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:19.271989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e6b89-f4b5-4a2e-be03-c2f2284710a4 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:19.276203 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 642/1292] 10.222.0.33 () {56 vars in 1116 bytes} [Sat Aug 6 20:42:19 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:42:21.498728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40454fc3-086c-4fce-9d0c-15fdc1ea5391 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:21.499260 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40454fc3-086c-4fce-9d0c-15fdc1ea5391 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:21.499374 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40454fc3-086c-4fce-9d0c-15fdc1ea5391 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:21.500681 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 651/1293] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:42:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:42:21.505945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f490f-96cd-43a3-840e-fc6aa41fa565 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:21.506321 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f490f-96cd-43a3-840e-fc6aa41fa565 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:21.506482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f490f-96cd-43a3-840e-fc6aa41fa565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:21.524210 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-e20f490f-96cd-43a3-840e-fc6aa41fa565 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:42:21.525370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e20f490f-96cd-43a3-840e-fc6aa41fa565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:21.554147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:21.590209 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 643/1294] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:42:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:42:21.614368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40454fc3-086c-4fce-9d0c-15fdc1ea5391 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:21.645526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:21.714564 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40454fc3-086c-4fce-9d0c-15fdc1ea5391 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:21.747762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8678f-0667-4924-bb4c-3c72d3c8bfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:21.748497 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8678f-0667-4924-bb4c-3c72d3c8bfe0 None admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:21.748827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8678f-0667-4924-bb4c-3c72d3c8bfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:21.749049 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8678f-0667-4924-bb4c-3c72d3c8bfe0 None admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:21.749676 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd8678f-0667-4924-bb4c-3c72d3c8bfe0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:21.751056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd8678f-0667-4924-bb4c-3c72d3c8bfe0 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:21.765066 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 652/1295] 10.222.0.33 () {60 vars in 1141 bytes} [Sat Aug 6 20:42:21 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:42:24.002933 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63627102-43c9-4b30-867d-53789ce91c69 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:24.003474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63627102-43c9-4b30-867d-53789ce91c69 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:24.003474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63627102-43c9-4b30-867d-53789ce91c69 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:24.004815 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 644/1296] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:42:24.009913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be404a1-1c72-4c39-8c36-68557d5e761c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:24.010320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be404a1-1c72-4c39-8c36-68557d5e761c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:24.010470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be404a1-1c72-4c39-8c36-68557d5e761c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:24.028712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-3be404a1-1c72-4c39-8c36-68557d5e761c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:42:24.029966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3be404a1-1c72-4c39-8c36-68557d5e761c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:24.099933 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 653/1297] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:42:24 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:42:24.123396 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63627102-43c9-4b30-867d-53789ce91c69 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:24.220073 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63627102-43c9-4b30-867d-53789ce91c69 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:24.252114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e7d58-8ffa-4308-b78b-7066dde3205a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:24.252717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e7d58-8ffa-4308-b78b-7066dde3205a None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:24.253040 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e7d58-8ffa-4308-b78b-7066dde3205a None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:24.253258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e7d58-8ffa-4308-b78b-7066dde3205a None admin] PATH_INFO: `/v3/services/placement` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:24.253827 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e7d58-8ffa-4308-b78b-7066dde3205a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:24.255197 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e7d58-8ffa-4308-b78b-7066dde3205a None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:24.264135 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-701e7d58-8ffa-4308-b78b-7066dde3205a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 20:42:24.264135 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:42:24.264135 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:42:24.264135 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:42:24.264135 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:42:24.264135 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:42:24.264135 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:42:24.264135 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:42:24.264135 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 20:42:24.264135 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:42:24.264135 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:42:24.264135 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:42:24.264135 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:42:24.264135 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:42:24.264135 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:42:24.264135 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:42:24.264135 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:42:24.265464 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:42:24.265464 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:42:24.265464 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:42:24.265464 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:42:24.265464 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:42:24.265464 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:42:24.265464 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:42:24.265464 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:42:24.265464 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:42:24.265464 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:42:24.265464 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:42:24.265464 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:42:24.265464 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:42:24.265464 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:42:24.265464 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:42:24.265464 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:42:24.266613 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:42:24.266613 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:42:24.266613 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:42:24.266613 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:42:24.266613 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:42:24.266613 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:42:24.266613 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:42:24.266613 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:42:24.266613 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:42:24.266613 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:42:24.266613 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:42:24.266613 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:42:24.266613 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 20:42:24.266613 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:42:24.266613 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 645/1298] 10.222.0.33 () {56 vars in 1117 bytes} [Sat Aug 6 20:42:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:42:24.271145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be404a1-1c72-4c39-8c36-68557d5e761c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:24.289273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:24.369929 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be404a1-1c72-4c39-8c36-68557d5e761c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:24.411501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868afdf3-a2c4-406e-a3cf-3986de308519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:24.412104 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868afdf3-a2c4-406e-a3cf-3986de308519 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:24.412382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868afdf3-a2c4-406e-a3cf-3986de308519 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:24.412655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868afdf3-a2c4-406e-a3cf-3986de308519 None admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:24.413277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868afdf3-a2c4-406e-a3cf-3986de308519 None admin] RBAC: Adding query filter params (name=placement) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:42:24.413579 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868afdf3-a2c4-406e-a3cf-3986de308519 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:24.414977 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868afdf3-a2c4-406e-a3cf-3986de308519 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:24.420924 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 654/1299] 10.222.0.33 () {56 vars in 1116 bytes} [Sat Aug 6 20:42:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:42:24.426976 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e7d58-8ffa-4308-b78b-7066dde3205a None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:24.459248 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:24.527680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e7d58-8ffa-4308-b78b-7066dde3205a None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:24.560231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8ac12-5ffd-46f7-91fa-7d945dbc9bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:24.561392 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8ac12-5ffd-46f7-91fa-7d945dbc9bca None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:24.561708 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8ac12-5ffd-46f7-91fa-7d945dbc9bca None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:24.561980 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8ac12-5ffd-46f7-91fa-7d945dbc9bca None admin] PATH_INFO: `/v3/endpoints` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:24.562708 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8ac12-5ffd-46f7-91fa-7d945dbc9bca None admin] RBAC: Adding query filter params (interface=public, service_id=2beb220ed8164808ac5042bfbbd3c03d, region_id=RegionOne) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:42:24.563022 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8ac12-5ffd-46f7-91fa-7d945dbc9bca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:24.564391 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8ac12-5ffd-46f7-91fa-7d945dbc9bca None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:24.569222 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 646/1300] 10.222.0.33 () {56 vars in 1251 bytes} [Sat Aug 6 20:42:24 2022] GET /identity/v3/endpoints?service_id=2beb220ed8164808ac5042bfbbd3c03d&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:42:24.574896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868afdf3-a2c4-406e-a3cf-3986de308519 None admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:24.655207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:24.673639 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868afdf3-a2c4-406e-a3cf-3986de308519 None admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:24.706389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd710ec8-3cb6-4a69-b7b5-99dc37af4576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:24.707008 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd710ec8-3cb6-4a69-b7b5-99dc37af4576 None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:24.707285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd710ec8-3cb6-4a69-b7b5-99dc37af4576 None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:24.707553 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd710ec8-3cb6-4a69-b7b5-99dc37af4576 None admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:24.708143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd710ec8-3cb6-4a69-b7b5-99dc37af4576 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:24.709484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd710ec8-3cb6-4a69-b7b5-99dc37af4576 None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:24.715970 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 655/1301] 10.222.0.33 () {56 vars in 1087 bytes} [Sat Aug 6 20:42:24 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:42:26.937297 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fff4b-7155-4850-8868-95b36a0a4a15 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:26.937809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fff4b-7155-4850-8868-95b36a0a4a15 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:26.937809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fff4b-7155-4850-8868-95b36a0a4a15 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:26.939135 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 647/1302] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:42:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:42:26.944292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e67745-d229-4e52-a11e-7a917ea98969 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:26.944675 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e67745-d229-4e52-a11e-7a917ea98969 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:26.944850 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e67745-d229-4e52-a11e-7a917ea98969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:26.963021 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d2e67745-d229-4e52-a11e-7a917ea98969 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:42:26.964178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d2e67745-d229-4e52-a11e-7a917ea98969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:27.028393 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 656/1303] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:42:26 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:42:27.051887 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69fff4b-7155-4850-8868-95b36a0a4a15 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:27.146611 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:27.153203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69fff4b-7155-4850-8868-95b36a0a4a15 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:27.187035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ba9b0-7d47-426c-a13b-3f921c635972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:27.187701 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ba9b0-7d47-426c-a13b-3f921c635972 None admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:27.187959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ba9b0-7d47-426c-a13b-3f921c635972 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:27.188235 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ba9b0-7d47-426c-a13b-3f921c635972 None admin] PATH_INFO: `/v3/services/placement` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:27.188814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ba9b0-7d47-426c-a13b-3f921c635972 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:27.190170 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ba9b0-7d47-426c-a13b-3f921c635972 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:27.198714 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-cc9ba9b0-7d47-426c-a13b-3f921c635972 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 20:42:27.198714 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:42:27.198714 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:42:27.198714 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:42:27.198714 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:42:27.198714 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:42:27.198714 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:42:27.198714 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:42:27.198714 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 20:42:27.198714 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:42:27.198714 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:42:27.198714 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:42:27.198714 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:42:27.198714 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:42:27.198714 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:42:27.198714 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:42:27.198714 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:42:27.199859 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:42:27.199859 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:42:27.199859 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:42:27.199859 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:42:27.199859 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:42:27.199859 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:42:27.199859 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:42:27.199859 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:42:27.199859 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:42:27.199859 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:42:27.199859 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:42:27.199859 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:42:27.199859 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:42:27.199859 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:42:27.199859 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:42:27.199859 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:42:27.200975 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:42:27.200975 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 20:42:27.200975 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:42:27.200975 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:42:27.200975 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:42:27.200975 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:42:27.200975 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:42:27.200975 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:42:27.200975 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:42:27.200975 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:42:27.200975 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:42:27.200975 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:42:27.200975 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 20:42:27.200975 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 20:42:27.200975 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 648/1304] 10.222.0.33 () {56 vars in 1117 bytes} [Sat Aug 6 20:42:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:42:27.206733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e67745-d229-4e52-a11e-7a917ea98969 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:27.281043 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:27.303977 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e67745-d229-4e52-a11e-7a917ea98969 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:27.336855 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b308b-9c19-40e6-bd63-da672cf22e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:27.337442 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b308b-9c19-40e6-bd63-da672cf22e3f None admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:27.337718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b308b-9c19-40e6-bd63-da672cf22e3f None admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:27.337985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b308b-9c19-40e6-bd63-da672cf22e3f None admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:27.338627 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b308b-9c19-40e6-bd63-da672cf22e3f None admin] RBAC: Adding query filter params (name=placement) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:42:27.338927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b308b-9c19-40e6-bd63-da672cf22e3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:27.340265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b308b-9c19-40e6-bd63-da672cf22e3f None admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:27.345191 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 657/1305] 10.222.0.33 () {56 vars in 1116 bytes} [Sat Aug 6 20:42:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:42:27.351013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ba9b0-7d47-426c-a13b-3f921c635972 None admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:27.449427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ba9b0-7d47-426c-a13b-3f921c635972 None admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:27.481318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbbb39d-5c09-4542-b90a-5d4041e14c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:27.481908 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbb39d-5c09-4542-b90a-5d4041e14c53 None admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:27.482188 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbb39d-5c09-4542-b90a-5d4041e14c53 None admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:27.483104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbb39d-5c09-4542-b90a-5d4041e14c53 None admin] PATH_INFO: `/v3/endpoints` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:27.483748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbbb39d-5c09-4542-b90a-5d4041e14c53 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:27.485131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbbb39d-5c09-4542-b90a-5d4041e14c53 None admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:27.504683 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 649/1306] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:42:27 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:42:37.343647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=30 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:37.500347 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:43:39.155217 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9bb34e-1246-4a8a-8f19-d5a3c17d9b0c None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:43:39.155697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9bb34e-1246-4a8a-8f19-d5a3c17d9b0c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:43:39.155798 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9bb34e-1246-4a8a-8f19-d5a3c17d9b0c None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:43:39.163010 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95716a0-000d-491d-8560-66bd38abc4fc None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:43:39.163430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95716a0-000d-491d-8560-66bd38abc4fc None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:43:39.163559 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95716a0-000d-491d-8560-66bd38abc4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:43:39.168312 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 658/1307] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:43:39 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:43:39.288713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d95716a0-000d-491d-8560-66bd38abc4fc None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:43:39.289588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d95716a0-000d-491d-8560-66bd38abc4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:43:39.415775 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 650/1308] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:43:39.469321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e750e9d-60ea-4d8a-bce8-72582f4b0d10 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:43:39.469880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e750e9d-60ea-4d8a-bce8-72582f4b0d10 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:43:39.470152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e750e9d-60ea-4d8a-bce8-72582f4b0d10 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:43:39.472722 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 659/1309] 10.222.0.33 () {54 vars in 965 bytes} [Sat Aug 6 20:43:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:43:39.485012 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c148ddb-207f-4f80-ad2b-8497a626177c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:43:39.485406 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c148ddb-207f-4f80-ad2b-8497a626177c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:43:39.486242 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c148ddb-207f-4f80-ad2b-8497a626177c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:43:39.578137 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-4c148ddb-207f-4f80-ad2b-8497a626177c None None] MFA Rules not processed for user `174e91100a184740b7c604730266dc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:43:39.579485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4c148ddb-207f-4f80-ad2b-8497a626177c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:43:39.601776 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:43:39.660703 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 651/1310] 10.222.0.33 () {58 vars in 1062 bytes} [Sat Aug 6 20:43:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:43:39.669942 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e750e9d-60ea-4d8a-bce8-72582f4b0d10 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:43:39.671952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9e750e9d-60ea-4d8a-bce8-72582f4b0d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:43:39.797134 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e750e9d-60ea-4d8a-bce8-72582f4b0d10 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:43:39.873909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89d78f-842d-43fc-a817-c548379f465c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:43:39.874513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89d78f-842d-43fc-a817-c548379f465c service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:43:39.874815 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89d78f-842d-43fc-a817-c548379f465c service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:43:39.875086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89d78f-842d-43fc-a817-c548379f465c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:43:39.876657 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1e89d78f-842d-43fc-a817-c548379f465c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:43:39.933531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:43:39.992739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89d78f-842d-43fc-a817-c548379f465c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:43:39.994211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89d78f-842d-43fc-a817-c548379f465c service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:43:40.015915 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 660/1311] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:43:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:43:42.610035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76a48f-d069-45f1-9edd-400dff3f5212 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:43:42.610726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76a48f-d069-45f1-9edd-400dff3f5212 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:43:42.610726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76a48f-d069-45f1-9edd-400dff3f5212 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:43:42.612227 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 652/1312] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:43:42.617708 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbd066-16bc-4802-b293-386d4f0f4ee8 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:43:42.618232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbd066-16bc-4802-b293-386d4f0f4ee8 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:43:42.618322 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbd066-16bc-4802-b293-386d4f0f4ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:43:42.714254 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-84fbd066-16bc-4802-b293-386d4f0f4ee8 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:43:42.715653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-84fbd066-16bc-4802-b293-386d4f0f4ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:43:42.823907 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 661/1313] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:43:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:43:42.864559 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76a48f-d069-45f1-9edd-400dff3f5212 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:43:42.866032 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-bc76a48f-d069-45f1-9edd-400dff3f5212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:43:42.977153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76a48f-d069-45f1-9edd-400dff3f5212 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:43:43.054530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:43:43.057894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4a296-530d-4c14-bea3-ece4aa00aa41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:43:43.058465 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4a296-530d-4c14-bea3-ece4aa00aa41 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:43:43.059276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4a296-530d-4c14-bea3-ece4aa00aa41 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:43:43.059919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4a296-530d-4c14-bea3-ece4aa00aa41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:43:43.062053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a2c4a296-530d-4c14-bea3-ece4aa00aa41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:43:43.187575 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4a296-530d-4c14-bea3-ece4aa00aa41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:43:43.188948 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4a296-530d-4c14-bea3-ece4aa00aa41 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:43:43.209485 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 653/1314] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:43:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:43:45.803958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f271c-a73f-43c1-8c07-a71c6841572d None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:43:45.804470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f271c-a73f-43c1-8c07-a71c6841572d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:43:45.804575 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f271c-a73f-43c1-8c07-a71c6841572d None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:43:45.805842 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 662/1315] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:43:45.811428 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6bc73-9f47-4a1f-b0d5-966dd9f88578 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:43:45.811908 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6bc73-9f47-4a1f-b0d5-966dd9f88578 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:43:45.812331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6bc73-9f47-4a1f-b0d5-966dd9f88578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:43:45.878566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-23e6bc73-9f47-4a1f-b0d5-966dd9f88578 None None] MFA Rules not processed for user `7c8e7c536115407885851d0e16fabe30`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:43:45.879785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-23e6bc73-9f47-4a1f-b0d5-966dd9f88578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:43:45.931243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:43:45.976512 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 654/1316] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:43:45 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:43:46.018592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f271c-a73f-43c1-8c07-a71c6841572d None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:43:46.020116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-839f271c-a73f-43c1-8c07-a71c6841572d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:43:46.029756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:43:46.121964 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f271c-a73f-43c1-8c07-a71c6841572d None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:43:46.195000 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6d972-f0f4-4482-84f4-94f0c469ab55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:43:46.195529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6d972-f0f4-4482-84f4-94f0c469ab55 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:43:46.195805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6d972-f0f4-4482-84f4-94f0c469ab55 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:43:46.196073 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6d972-f0f4-4482-84f4-94f0c469ab55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:43:46.197653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-25d6d972-f0f4-4482-84f4-94f0c469ab55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:43:46.258914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:43:46.305632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6d972-f0f4-4482-84f4-94f0c469ab55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:43:46.307353 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6d972-f0f4-4482-84f4-94f0c469ab55 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:43:46.325985 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 663/1317] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:43:46 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:43:49.140647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bd51e-a0fc-4c0a-982a-dbff90a441c5 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:43:49.141182 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bd51e-a0fc-4c0a-982a-dbff90a441c5 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:43:49.141182 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bd51e-a0fc-4c0a-982a-dbff90a441c5 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:43:49.142514 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 655/1318] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:43:49.148609 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9394b1-86e0-488b-8930-28048d1b793f None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:43:49.149051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9394b1-86e0-488b-8930-28048d1b793f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:43:49.149147 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9394b1-86e0-488b-8930-28048d1b793f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:43:49.214386 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-ab9394b1-86e0-488b-8930-28048d1b793f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:43:49.215605 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ab9394b1-86e0-488b-8930-28048d1b793f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:43:49.308465 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 664/1319] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:43:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:43:49.348632 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0bd51e-a0fc-4c0a-982a-dbff90a441c5 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:43:49.350196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-cb0bd51e-a0fc-4c0a-982a-dbff90a441c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:43:49.460377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0bd51e-a0fc-4c0a-982a-dbff90a441c5 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:43:49.532116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ccf81-a022-4942-a709-82e6e3db6731 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:43:49.532711 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ccf81-a022-4942-a709-82e6e3db6731 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:43:49.532984 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ccf81-a022-4942-a709-82e6e3db6731 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:43:49.533254 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ccf81-a022-4942-a709-82e6e3db6731 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:43:49.535208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-632ccf81-a022-4942-a709-82e6e3db6731 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:43:49.543589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:43:49.645202 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ccf81-a022-4942-a709-82e6e3db6731 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:43:49.646686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ccf81-a022-4942-a709-82e6e3db6731 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:43:49.664209 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 656/1320] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:43:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:43:52.571207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5a471-5762-4e5e-b7e4-a8e6eeb3c789 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:43:52.571767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5a471-5762-4e5e-b7e4-a8e6eeb3c789 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:43:52.571767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5a471-5762-4e5e-b7e4-a8e6eeb3c789 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:43:52.573073 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 665/1321] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:43:52.578466 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100d732-2161-4fb2-ae15-880a04297277 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:43:52.578898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100d732-2161-4fb2-ae15-880a04297277 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:43:52.579052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100d732-2161-4fb2-ae15-880a04297277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:43:52.644887 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-4100d732-2161-4fb2-ae15-880a04297277 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:43:52.646132 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4100d732-2161-4fb2-ae15-880a04297277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:43:52.709527 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:43:52.750019 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 657/1322] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:43:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:43:52.788432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5a471-5762-4e5e-b7e4-a8e6eeb3c789 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:43:52.789963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-49d5a471-5762-4e5e-b7e4-a8e6eeb3c789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:43:52.809399 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:43:52.894127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5a471-5762-4e5e-b7e4-a8e6eeb3c789 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:43:52.968003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82db8c-7a3b-4130-b633-063381cb8943 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:43:52.968603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82db8c-7a3b-4130-b633-063381cb8943 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:43:52.968881 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82db8c-7a3b-4130-b633-063381cb8943 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:43:52.969147 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82db8c-7a3b-4130-b633-063381cb8943 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:43:52.970804 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1e82db8c-7a3b-4130-b633-063381cb8943 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:43:53.041688 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:43:53.081677 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82db8c-7a3b-4130-b633-063381cb8943 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:43:53.083225 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82db8c-7a3b-4130-b633-063381cb8943 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:43:53.101442 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 666/1323] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:43:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:43:55.421945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32dbe19-d323-45fc-a460-91ac8a31e163 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:43:55.422504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32dbe19-d323-45fc-a460-91ac8a31e163 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:43:55.422504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32dbe19-d323-45fc-a460-91ac8a31e163 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:43:55.424480 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 658/1324] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:43:55.430249 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdace3-4d40-4eb1-b6ba-65ac9a790973 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:43:55.430835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdace3-4d40-4eb1-b6ba-65ac9a790973 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:43:55.430835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdace3-4d40-4eb1-b6ba-65ac9a790973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:43:55.496841 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-58bdace3-4d40-4eb1-b6ba-65ac9a790973 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:43:55.498038 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-58bdace3-4d40-4eb1-b6ba-65ac9a790973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:43:55.603076 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 667/1325] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:43:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:43:55.655524 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be090673-ef51-4caf-bd3d-4478c88aa9d6 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:43:55.655803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be090673-ef51-4caf-bd3d-4478c88aa9d6 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:43:55.656066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be090673-ef51-4caf-bd3d-4478c88aa9d6 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:43:55.657396 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 659/1326] 10.222.0.33 () {54 vars in 965 bytes} [Sat Aug 6 20:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:43:55.663745 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822bee6-51a1-429e-84e2-54db5d448d69 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:43:55.664048 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822bee6-51a1-429e-84e2-54db5d448d69 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:43:55.664304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822bee6-51a1-429e-84e2-54db5d448d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:43:55.700083 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:43:55.745496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b822bee6-51a1-429e-84e2-54db5d448d69 None None] MFA Rules not processed for user `174e91100a184740b7c604730266dc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:43:55.746726 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b822bee6-51a1-429e-84e2-54db5d448d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:43:55.822817 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 668/1327] 10.222.0.33 () {58 vars in 1062 bytes} [Sat Aug 6 20:43:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:43:55.831671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be090673-ef51-4caf-bd3d-4478c88aa9d6 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:43:55.833169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-be090673-ef51-4caf-bd3d-4478c88aa9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:43:55.935579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be090673-ef51-4caf-bd3d-4478c88aa9d6 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:43:56.008427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50509f7c-b045-4788-b30d-d2b5940de50a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:43:56.009031 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50509f7c-b045-4788-b30d-d2b5940de50a service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:43:56.009312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50509f7c-b045-4788-b30d-d2b5940de50a service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:43:56.009589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50509f7c-b045-4788-b30d-d2b5940de50a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:43:56.011219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-50509f7c-b045-4788-b30d-d2b5940de50a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:43:56.027720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:43:56.122657 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50509f7c-b045-4788-b30d-d2b5940de50a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:43:56.124085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50509f7c-b045-4788-b30d-d2b5940de50a service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:43:56.141789 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 660/1328] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:43:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:43:58.657230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337a28a-607b-4a48-8f3b-70ccc63f5ae3 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:43:58.657765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337a28a-607b-4a48-8f3b-70ccc63f5ae3 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:43:58.657765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337a28a-607b-4a48-8f3b-70ccc63f5ae3 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:43:58.659377 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 669/1329] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:43:58.664577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1b8bd-d30a-4631-a4e5-8238ded88329 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:43:58.664965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1b8bd-d30a-4631-a4e5-8238ded88329 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:43:58.665588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1b8bd-d30a-4631-a4e5-8238ded88329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:43:58.734065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-42c1b8bd-d30a-4631-a4e5-8238ded88329 None None] MFA Rules not processed for user `7c8e7c536115407885851d0e16fabe30`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:43:58.735287 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-42c1b8bd-d30a-4631-a4e5-8238ded88329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:43:58.800906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:43:58.832997 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 661/1330] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:43:58 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:43:58.872221 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8337a28a-607b-4a48-8f3b-70ccc63f5ae3 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:43:58.873764 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8337a28a-607b-4a48-8f3b-70ccc63f5ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:43:58.979286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8337a28a-607b-4a48-8f3b-70ccc63f5ae3 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:43:58.999888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:43:59.055547 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b94a2-7629-4e78-9c4b-d8673c176813 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:43:59.056167 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b94a2-7629-4e78-9c4b-d8673c176813 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:43:59.056447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b94a2-7629-4e78-9c4b-d8673c176813 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:43:59.056719 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b94a2-7629-4e78-9c4b-d8673c176813 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:43:59.058559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ac0b94a2-7629-4e78-9c4b-d8673c176813 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:43:59.168014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b94a2-7629-4e78-9c4b-d8673c176813 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:43:59.169450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b94a2-7629-4e78-9c4b-d8673c176813 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:43:59.188640 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 670/1331] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:43:58 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:44:01.695770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8400b1-2755-46d2-87ec-a65d651e10df None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:01.696302 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8400b1-2755-46d2-87ec-a65d651e10df None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:01.696302 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8400b1-2755-46d2-87ec-a65d651e10df None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:01.697657 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 662/1332] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:44:01.702799 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb4ef6-f902-4182-9c41-48f9a764aedb None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:01.703190 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb4ef6-f902-4182-9c41-48f9a764aedb None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:01.703336 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb4ef6-f902-4182-9c41-48f9a764aedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:01.768626 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:01.771346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-c4bb4ef6-f902-4182-9c41-48f9a764aedb None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:44:01.773017 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c4bb4ef6-f902-4182-9c41-48f9a764aedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:01.869786 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 671/1333] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:44:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:44:01.908175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8400b1-2755-46d2-87ec-a65d651e10df None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:44:01.909932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7b8400b1-2755-46d2-87ec-a65d651e10df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:02.016247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8400b1-2755-46d2-87ec-a65d651e10df None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:44:02.097646 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf29018-0326-41cb-8779-487304b112ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:44:02.098247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf29018-0326-41cb-8779-487304b112ac service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:02.098592 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf29018-0326-41cb-8779-487304b112ac service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:02.098954 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf29018-0326-41cb-8779-487304b112ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:02.100588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7cf29018-0326-41cb-8779-487304b112ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:02.130931 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:02.220250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf29018-0326-41cb-8779-487304b112ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:44:02.222110 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf29018-0326-41cb-8779-487304b112ac service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:44:02.241463 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 663/1334] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:44:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:44:04.531222 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824b6f3-bcf7-4f8d-847d-5a5ca3d7a53c None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:04.531830 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824b6f3-bcf7-4f8d-847d-5a5ca3d7a53c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:04.531830 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824b6f3-bcf7-4f8d-847d-5a5ca3d7a53c None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:04.533090 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 672/1335] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:44:04.538656 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30e4ac-fe0d-4452-b23a-314d5b1e51b6 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:04.539094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30e4ac-fe0d-4452-b23a-314d5b1e51b6 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:04.539206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30e4ac-fe0d-4452-b23a-314d5b1e51b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:04.604685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-7b30e4ac-fe0d-4452-b23a-314d5b1e51b6 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:44:04.605885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7b30e4ac-fe0d-4452-b23a-314d5b1e51b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:04.680601 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:04.703628 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 664/1336] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:44:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:44:04.745985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824b6f3-bcf7-4f8d-847d-5a5ca3d7a53c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:44:04.747520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9824b6f3-bcf7-4f8d-847d-5a5ca3d7a53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:04.852309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824b6f3-bcf7-4f8d-847d-5a5ca3d7a53c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:44:04.881297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:04.928041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c2672-2a14-4c13-89b3-f2b1e7875ca6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:44:04.928646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c2672-2a14-4c13-89b3-f2b1e7875ca6 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:04.928927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c2672-2a14-4c13-89b3-f2b1e7875ca6 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:04.929396 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c2672-2a14-4c13-89b3-f2b1e7875ca6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:04.931054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-431c2672-2a14-4c13-89b3-f2b1e7875ca6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:05.041777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c2672-2a14-4c13-89b3-f2b1e7875ca6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:44:05.043181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c2672-2a14-4c13-89b3-f2b1e7875ca6 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:44:05.061710 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 673/1337] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:44:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:44:07.637408 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df7c10-ea79-49eb-9b2b-2c3ad08e1f51 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:07.637980 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df7c10-ea79-49eb-9b2b-2c3ad08e1f51 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:07.637980 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df7c10-ea79-49eb-9b2b-2c3ad08e1f51 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:07.639325 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 665/1338] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:44:07.645103 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a6795-dec8-4a3f-94cf-cd60af068f91 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:07.645503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a6795-dec8-4a3f-94cf-cd60af068f91 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:07.645643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a6795-dec8-4a3f-94cf-cd60af068f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:07.711498 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a35a6795-dec8-4a3f-94cf-cd60af068f91 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:44:07.712680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a35a6795-dec8-4a3f-94cf-cd60af068f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:07.720667 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:07.806569 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 674/1339] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:44:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:44:07.844587 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df7c10-ea79-49eb-9b2b-2c3ad08e1f51 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:44:07.846340 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-98df7c10-ea79-49eb-9b2b-2c3ad08e1f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:07.947453 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df7c10-ea79-49eb-9b2b-2c3ad08e1f51 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:44:08.020387 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d6f62-5934-4876-b310-24a7f8ebbc78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:44:08.020989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d6f62-5934-4876-b310-24a7f8ebbc78 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:08.021272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d6f62-5934-4876-b310-24a7f8ebbc78 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:08.021542 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d6f62-5934-4876-b310-24a7f8ebbc78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:08.023161 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-969d6f62-5934-4876-b310-24a7f8ebbc78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:08.059478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:08.133787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d6f62-5934-4876-b310-24a7f8ebbc78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:44:08.135258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d6f62-5934-4876-b310-24a7f8ebbc78 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:44:08.153408 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 666/1340] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:44:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:44:12.291841 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce59e8d-5246-4d29-9d8f-cd5d5c37752c None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:12.292404 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce59e8d-5246-4d29-9d8f-cd5d5c37752c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:12.292404 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce59e8d-5246-4d29-9d8f-cd5d5c37752c None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:12.293750 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 675/1341] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:44:12.299622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a46174-00fd-49fc-a98b-341039945cab None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:12.300039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a46174-00fd-49fc-a98b-341039945cab None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:12.300357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a46174-00fd-49fc-a98b-341039945cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:12.366883 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-71a46174-00fd-49fc-a98b-341039945cab None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:44:12.368077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-71a46174-00fd-49fc-a98b-341039945cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:12.454373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:12.467071 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 667/1342] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:44:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:44:12.508586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce59e8d-5246-4d29-9d8f-cd5d5c37752c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:44:12.510112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-bce59e8d-5246-4d29-9d8f-cd5d5c37752c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:12.615031 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce59e8d-5246-4d29-9d8f-cd5d5c37752c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:44:12.652393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:12.695248 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ee7f9-d3ef-46d3-b11e-4f43d5d22a97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:44:12.696092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ee7f9-d3ef-46d3-b11e-4f43d5d22a97 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:12.696376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ee7f9-d3ef-46d3-b11e-4f43d5d22a97 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:12.696655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ee7f9-d3ef-46d3-b11e-4f43d5d22a97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:12.698236 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-166ee7f9-d3ef-46d3-b11e-4f43d5d22a97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:12.813074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ee7f9-d3ef-46d3-b11e-4f43d5d22a97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:44:12.814661 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ee7f9-d3ef-46d3-b11e-4f43d5d22a97 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:44:12.835047 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 676/1343] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:44:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:44:15.708296 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b907b-1ba0-4acc-9850-278902cd0d8e None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:15.708872 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b907b-1ba0-4acc-9850-278902cd0d8e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:15.708872 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b907b-1ba0-4acc-9850-278902cd0d8e None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:15.710426 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 668/1344] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:44:15.716086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d22c2-df3d-48fa-bfc1-45bf95ae1ff4 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:15.716632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d22c2-df3d-48fa-bfc1-45bf95ae1ff4 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:15.716632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d22c2-df3d-48fa-bfc1-45bf95ae1ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:15.790200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-ee6d22c2-df3d-48fa-bfc1-45bf95ae1ff4 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:44:15.791458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ee6d22c2-df3d-48fa-bfc1-45bf95ae1ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:15.809569 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:15.890583 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 677/1345] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:44:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:44:15.929662 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b907b-1ba0-4acc-9850-278902cd0d8e None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:44:15.931216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-676b907b-1ba0-4acc-9850-278902cd0d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:16.039072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b907b-1ba0-4acc-9850-278902cd0d8e None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:44:16.112415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6fb45-0b4f-4374-8424-fb9ccfdf9a50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:44:16.113034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6fb45-0b4f-4374-8424-fb9ccfdf9a50 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:16.113312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6fb45-0b4f-4374-8424-fb9ccfdf9a50 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:16.113586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6fb45-0b4f-4374-8424-fb9ccfdf9a50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:16.115258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c7c6fb45-0b4f-4374-8424-fb9ccfdf9a50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:16.161005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:16.231950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6fb45-0b4f-4374-8424-fb9ccfdf9a50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:44:16.233390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6fb45-0b4f-4374-8424-fb9ccfdf9a50 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:44:16.252735 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 669/1346] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:44:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:44:20.447451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c731ba-58c7-4eeb-9e97-4c6509cf1f37 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:20.447995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c731ba-58c7-4eeb-9e97-4c6509cf1f37 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:20.447995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c731ba-58c7-4eeb-9e97-4c6509cf1f37 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:20.449317 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 678/1347] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:44:20.454427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569be073-5f37-40d1-a489-615fe146f1d5 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:20.454914 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569be073-5f37-40d1-a489-615fe146f1d5 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:20.455034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569be073-5f37-40d1-a489-615fe146f1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:20.519733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-569be073-5f37-40d1-a489-615fe146f1d5 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:44:20.520920 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-569be073-5f37-40d1-a489-615fe146f1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:20.617790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:20.620479 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 670/1348] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:44:20.659674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c731ba-58c7-4eeb-9e97-4c6509cf1f37 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:44:20.661199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-38c731ba-58c7-4eeb-9e97-4c6509cf1f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:20.765922 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c731ba-58c7-4eeb-9e97-4c6509cf1f37 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:44:20.824392 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:20.846586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25034bf-225c-448f-9eaa-4477b4cf40c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:44:20.847408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25034bf-225c-448f-9eaa-4477b4cf40c2 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:20.847784 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25034bf-225c-448f-9eaa-4477b4cf40c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:20.848156 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25034bf-225c-448f-9eaa-4477b4cf40c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:20.849881 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b25034bf-225c-448f-9eaa-4477b4cf40c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:20.977219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25034bf-225c-448f-9eaa-4477b4cf40c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:44:20.978684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25034bf-225c-448f-9eaa-4477b4cf40c2 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:44:20.999820 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 679/1349] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:44:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:44:26.546235 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe2796-1218-411e-b26b-73204fae142c None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:26.546714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe2796-1218-411e-b26b-73204fae142c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:26.547022 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe2796-1218-411e-b26b-73204fae142c None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:26.548677 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 671/1350] 10.222.0.33 () {54 vars in 921 bytes} [Sat Aug 6 20:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:44:26.570719 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5b38c-a070-4cd5-a760-a6d672c65680 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:26.570719 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5b38c-a070-4cd5-a760-a6d672c65680 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:26.570719 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5b38c-a070-4cd5-a760-a6d672c65680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:26.757518 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-19c5b38c-a070-4cd5-a760-a6d672c65680 None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:44:26.760751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-19c5b38c-a070-4cd5-a760-a6d672c65680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:26.789346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:26.946271 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 680/1351] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 20:44:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:44:31.365566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407bbdc7-7af8-485f-81cf-a350cef194d1 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:31.366059 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407bbdc7-7af8-485f-81cf-a350cef194d1 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:31.366059 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407bbdc7-7af8-485f-81cf-a350cef194d1 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:31.368085 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 672/1352] 10.222.0.33 () {54 vars in 921 bytes} [Sat Aug 6 20:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:44:31.373267 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157a10d-65cc-4d66-ab03-b7e1877e0f44 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:31.374911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157a10d-65cc-4d66-ab03-b7e1877e0f44 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:31.375417 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157a10d-65cc-4d66-ab03-b7e1877e0f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:31.471254 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-3157a10d-65cc-4d66-ab03-b7e1877e0f44 None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:44:31.473346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3157a10d-65cc-4d66-ab03-b7e1877e0f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:31.550586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:31.590523 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 681/1353] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 20:44:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:44:32.916390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cde461-89a1-4f3a-a6c2-0ef2b0f13968 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:32.916932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cde461-89a1-4f3a-a6c2-0ef2b0f13968 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:32.916932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cde461-89a1-4f3a-a6c2-0ef2b0f13968 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:32.918244 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 673/1354] 10.222.0.33 () {54 vars in 921 bytes} [Sat Aug 6 20:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:44:32.923313 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bb7a5-863c-4aa1-a0bd-8e779b2c99e4 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:32.924270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bb7a5-863c-4aa1-a0bd-8e779b2c99e4 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:32.924358 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bb7a5-863c-4aa1-a0bd-8e779b2c99e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:33.001304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-2b5bb7a5-863c-4aa1-a0bd-8e779b2c99e4 None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:44:33.003338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2b5bb7a5-863c-4aa1-a0bd-8e779b2c99e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:33.117149 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 682/1355] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 20:44:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:44:36.884180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b596c13-16d4-4b61-ac53-0c3d7b678530 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:36.884732 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b596c13-16d4-4b61-ac53-0c3d7b678530 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:36.884732 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b596c13-16d4-4b61-ac53-0c3d7b678530 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:36.885950 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 674/1356] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:44:36.891225 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923c756-1660-4d34-a0ab-ce43debde1ab None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:36.891653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923c756-1660-4d34-a0ab-ce43debde1ab None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:36.891836 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923c756-1660-4d34-a0ab-ce43debde1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:36.931674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:36.965195 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b923c756-1660-4d34-a0ab-ce43debde1ab None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:44:36.966505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b923c756-1660-4d34-a0ab-ce43debde1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:37.074591 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 683/1357] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:44:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:44:37.127729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d667e-ac3e-4850-8bd1-d552e8312586 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:37.129165 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d667e-ac3e-4850-8bd1-d552e8312586 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:37.129763 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d667e-ac3e-4850-8bd1-d552e8312586 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:37.131638 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 675/1358] 10.222.0.33 () {54 vars in 962 bytes} [Sat Aug 6 20:44:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:44:37.139866 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bfe8e-b511-4327-b3ad-f26361119e87 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:37.140124 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bfe8e-b511-4327-b3ad-f26361119e87 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:37.140358 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bfe8e-b511-4327-b3ad-f26361119e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:37.221396 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-7b6bfe8e-b511-4327-b3ad-f26361119e87 None None] MFA Rules not processed for user `5f9d53147a57402f8b9818590bc1fc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:44:37.222583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7b6bfe8e-b511-4327-b3ad-f26361119e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:37.281251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:37.363787 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 684/1359] 10.222.0.33 () {58 vars in 1059 bytes} [Sat Aug 6 20:44:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:44:37.371838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d667e-ac3e-4850-8bd1-d552e8312586 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:44:37.373744 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9e6d667e-ac3e-4850-8bd1-d552e8312586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:37.529396 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d667e-ac3e-4850-8bd1-d552e8312586 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:44:37.605834 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:37.658494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be4d81-c1fa-4938-953a-b0f3d17edd95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:44:37.659139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be4d81-c1fa-4938-953a-b0f3d17edd95 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:37.659422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be4d81-c1fa-4938-953a-b0f3d17edd95 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:37.659698 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be4d81-c1fa-4938-953a-b0f3d17edd95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:37.661335 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e1be4d81-c1fa-4938-953a-b0f3d17edd95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:37.765852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be4d81-c1fa-4938-953a-b0f3d17edd95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:44:37.767606 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be4d81-c1fa-4938-953a-b0f3d17edd95 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:44:37.787413 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 676/1360] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:44:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:44:40.245876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755f8a0-1892-44c4-af94-e30101a82d5a None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:40.246408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755f8a0-1892-44c4-af94-e30101a82d5a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:40.246408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755f8a0-1892-44c4-af94-e30101a82d5a None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:40.247939 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 685/1361] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:44:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:44:40.253269 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05574fe4-a442-4f2f-8f4a-9a02dca887d8 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:40.253715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05574fe4-a442-4f2f-8f4a-9a02dca887d8 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:40.253807 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05574fe4-a442-4f2f-8f4a-9a02dca887d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:40.325447 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-05574fe4-a442-4f2f-8f4a-9a02dca887d8 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:44:40.325447 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-05574fe4-a442-4f2f-8f4a-9a02dca887d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:40.366064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:40.448471 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 677/1362] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:44:40.494519 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755f8a0-1892-44c4-af94-e30101a82d5a None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:44:40.496140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d755f8a0-1892-44c4-af94-e30101a82d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:40.675780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755f8a0-1892-44c4-af94-e30101a82d5a None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:44:40.686172 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:40.811220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582620c-7cb3-462e-8bbe-024c2a53e3f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:44:40.812156 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582620c-7cb3-462e-8bbe-024c2a53e3f3 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:40.812647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582620c-7cb3-462e-8bbe-024c2a53e3f3 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:40.812927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582620c-7cb3-462e-8bbe-024c2a53e3f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:40.815232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e582620c-7cb3-462e-8bbe-024c2a53e3f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:40.925376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582620c-7cb3-462e-8bbe-024c2a53e3f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:44:40.927130 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582620c-7cb3-462e-8bbe-024c2a53e3f3 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:44:40.950277 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 686/1363] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:44:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:44:43.543913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f56faf-e3db-4163-873d-4ca60e83cf01 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:43.544442 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f56faf-e3db-4163-873d-4ca60e83cf01 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:43.544442 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f56faf-e3db-4163-873d-4ca60e83cf01 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:43.546052 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 678/1364] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:44:43.551695 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcdda4-aa52-4a56-9ea7-06063c69c9c7 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:43.552121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcdda4-aa52-4a56-9ea7-06063c69c9c7 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:43.552230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcdda4-aa52-4a56-9ea7-06063c69c9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:43.569815 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:43.639769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-3cbcdda4-aa52-4a56-9ea7-06063c69c9c7 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:44:43.641067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3cbcdda4-aa52-4a56-9ea7-06063c69c9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:43.759446 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 687/1365] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:44:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:44:43.807630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299f3aa-9384-4d4b-90b6-62246a4b42fe None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:43.808188 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299f3aa-9384-4d4b-90b6-62246a4b42fe None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:43.808930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299f3aa-9384-4d4b-90b6-62246a4b42fe None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:43.810504 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 679/1366] 10.222.0.33 () {54 vars in 962 bytes} [Sat Aug 6 20:44:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:44:43.817352 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065804ae-a012-41ef-99ad-95695b07205b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:43.817979 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065804ae-a012-41ef-99ad-95695b07205b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:43.818329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065804ae-a012-41ef-99ad-95695b07205b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:43.926165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-065804ae-a012-41ef-99ad-95695b07205b None None] MFA Rules not processed for user `5f9d53147a57402f8b9818590bc1fc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:44:43.927409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-065804ae-a012-41ef-99ad-95695b07205b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:43.971229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:44.060418 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 688/1367] 10.222.0.33 () {58 vars in 1059 bytes} [Sat Aug 6 20:44:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:44:44.068652 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7299f3aa-9384-4d4b-90b6-62246a4b42fe None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:44:44.070159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7299f3aa-9384-4d4b-90b6-62246a4b42fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:44.241156 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7299f3aa-9384-4d4b-90b6-62246a4b42fe None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:44:44.265431 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:44.405131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41789fff-8ee8-48f4-94f0-4c1f33eb6fa8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:44:44.405568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41789fff-8ee8-48f4-94f0-4c1f33eb6fa8 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:44.405849 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41789fff-8ee8-48f4-94f0-4c1f33eb6fa8 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:44.406118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41789fff-8ee8-48f4-94f0-4c1f33eb6fa8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:44.407821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-41789fff-8ee8-48f4-94f0-4c1f33eb6fa8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:44.504417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41789fff-8ee8-48f4-94f0-4c1f33eb6fa8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:44:44.506019 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41789fff-8ee8-48f4-94f0-4c1f33eb6fa8 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:44:44.524891 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 680/1368] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:44:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:44:47.124169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339c176-705b-4f38-b410-7b9a4395c35f None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:47.125348 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339c176-705b-4f38-b410-7b9a4395c35f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:47.126107 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339c176-705b-4f38-b410-7b9a4395c35f None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:47.130292 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 689/1369] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:44:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:44:47.136241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a49674-df1d-4040-8803-2b6373d83c4f None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:47.137259 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a49674-df1d-4040-8803-2b6373d83c4f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:47.137925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a49674-df1d-4040-8803-2b6373d83c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:47.221250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:47.293180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-70a49674-df1d-4040-8803-2b6373d83c4f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:44:47.294717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-70a49674-df1d-4040-8803-2b6373d83c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:47.455692 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 681/1370] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:44:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:44:47.497534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339c176-705b-4f38-b410-7b9a4395c35f None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:44:47.499080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2339c176-705b-4f38-b410-7b9a4395c35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:47.771249 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:47.779111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339c176-705b-4f38-b410-7b9a4395c35f None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:44:47.910482 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6cac62-8127-403a-a562-daa609d24337 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:44:47.911324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6cac62-8127-403a-a562-daa609d24337 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:47.911712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6cac62-8127-403a-a562-daa609d24337 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:47.912090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6cac62-8127-403a-a562-daa609d24337 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:47.914076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3e6cac62-8127-403a-a562-daa609d24337 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:48.021642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6cac62-8127-403a-a562-daa609d24337 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:44:48.023559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6cac62-8127-403a-a562-daa609d24337 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:44:48.040123 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:48.043870 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 690/1371] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:44:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:44:49.102298 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbdf0ef-5072-45fc-8f3e-5e9a40245aa2 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:49.102761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbdf0ef-5072-45fc-8f3e-5e9a40245aa2 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:49.102877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbdf0ef-5072-45fc-8f3e-5e9a40245aa2 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:49.104698 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 682/1372] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:44:49.110038 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaeb8a5-dbca-4ea4-9840-10d691c03bdc None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:49.110799 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaeb8a5-dbca-4ea4-9840-10d691c03bdc None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:49.111458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaeb8a5-dbca-4ea4-9840-10d691c03bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:49.188379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-adaeb8a5-dbca-4ea4-9840-10d691c03bdc None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:44:49.190107 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-adaeb8a5-dbca-4ea4-9840-10d691c03bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:49.338590 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 691/1373] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:44:49.654932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a3ef2-0aba-4b67-b089-e5456d47673c None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:49.654932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a3ef2-0aba-4b67-b089-e5456d47673c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:49.654932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a3ef2-0aba-4b67-b089-e5456d47673c None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:49.657505 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 683/1374] 10.222.0.33 () {54 vars in 964 bytes} [Sat Aug 6 20:44:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:44:49.662595 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ac695-196a-49f5-b634-45e9e84404df None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:49.662595 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ac695-196a-49f5-b634-45e9e84404df None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:49.662595 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ac695-196a-49f5-b634-45e9e84404df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:49.756900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-c89ac695-196a-49f5-b634-45e9e84404df None None] MFA Rules not processed for user `60cf8ac27ec04117937e87749d69fe3f`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:44:49.759125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c89ac695-196a-49f5-b634-45e9e84404df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:49.784762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:49.849021 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 692/1375] 10.222.0.33 () {58 vars in 1061 bytes} [Sat Aug 6 20:44:49 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:44:49.856503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a3ef2-0aba-4b67-b089-e5456d47673c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:44:49.858027 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-867a3ef2-0aba-4b67-b089-e5456d47673c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:50.005162 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a3ef2-0aba-4b67-b089-e5456d47673c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:44:50.008860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:50.085760 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94484567-4de0-49d3-b77d-1c59b94bcc7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:44:50.086711 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94484567-4de0-49d3-b77d-1c59b94bcc7a service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:50.086995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94484567-4de0-49d3-b77d-1c59b94bcc7a service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:50.087276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94484567-4de0-49d3-b77d-1c59b94bcc7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:50.088892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-94484567-4de0-49d3-b77d-1c59b94bcc7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:50.210829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94484567-4de0-49d3-b77d-1c59b94bcc7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:44:50.212277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94484567-4de0-49d3-b77d-1c59b94bcc7a service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:44:50.231647 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 684/1376] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:44:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:44:50.476281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad676b-ffd7-4e74-aa4b-157a648051a4 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:50.476847 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad676b-ffd7-4e74-aa4b-157a648051a4 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:50.476943 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad676b-ffd7-4e74-aa4b-157a648051a4 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:50.478581 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 693/1377] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:44:50.483843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bc0fc-a2e6-4f1c-99dc-f3b4fe834ce0 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:50.484238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bc0fc-a2e6-4f1c-99dc-f3b4fe834ce0 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:50.484434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bc0fc-a2e6-4f1c-99dc-f3b4fe834ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:50.531082 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:50.555776 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-1d8bc0fc-a2e6-4f1c-99dc-f3b4fe834ce0 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:44:50.556989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1d8bc0fc-a2e6-4f1c-99dc-f3b4fe834ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:50.657725 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 685/1378] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:44:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:44:50.703538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad676b-ffd7-4e74-aa4b-157a648051a4 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:44:50.705715 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8fad676b-ffd7-4e74-aa4b-157a648051a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:50.882940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad676b-ffd7-4e74-aa4b-157a648051a4 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:44:50.914306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:51.213473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365fe58-02a9-4c9a-b88b-40fa140686b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:44:51.213473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365fe58-02a9-4c9a-b88b-40fa140686b7 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:51.213473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365fe58-02a9-4c9a-b88b-40fa140686b7 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:51.213473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365fe58-02a9-4c9a-b88b-40fa140686b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:51.214801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c365fe58-02a9-4c9a-b88b-40fa140686b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:51.214801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365fe58-02a9-4c9a-b88b-40fa140686b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:44:51.214801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365fe58-02a9-4c9a-b88b-40fa140686b7 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:44:51.214801 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 694/1379] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:44:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:44:53.608587 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3dd293-a98c-4b79-8e0c-35e5ae7f7422 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:53.609131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3dd293-a98c-4b79-8e0c-35e5ae7f7422 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:53.609131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3dd293-a98c-4b79-8e0c-35e5ae7f7422 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:53.610416 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 686/1380] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:44:53.615750 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8096d90-fd58-46df-9029-917b8cd985ee None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:53.616189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8096d90-fd58-46df-9029-917b8cd985ee None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:53.616310 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8096d90-fd58-46df-9029-917b8cd985ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:53.657904 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:53.685574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-c8096d90-fd58-46df-9029-917b8cd985ee None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:44:53.686854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c8096d90-fd58-46df-9029-917b8cd985ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:53.793671 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 695/1381] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:44:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:44:53.840870 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3dd293-a98c-4b79-8e0c-35e5ae7f7422 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:44:53.842383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3f3dd293-a98c-4b79-8e0c-35e5ae7f7422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:53.980894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:54.037417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3dd293-a98c-4b79-8e0c-35e5ae7f7422 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:44:54.182110 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7fad0e-6344-4a60-aa7c-ca8c065a4696 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:44:54.182738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7fad0e-6344-4a60-aa7c-ca8c065a4696 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:54.183160 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7fad0e-6344-4a60-aa7c-ca8c065a4696 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:54.183428 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7fad0e-6344-4a60-aa7c-ca8c065a4696 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:54.185473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4f7fad0e-6344-4a60-aa7c-ca8c065a4696 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:54.273243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:54.291646 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7fad0e-6344-4a60-aa7c-ca8c065a4696 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:44:54.293236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7fad0e-6344-4a60-aa7c-ca8c065a4696 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:44:54.317765 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 687/1382] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:44:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:44:56.611092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79ae23-92e2-47bf-8345-df20c42ee104 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:56.611092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79ae23-92e2-47bf-8345-df20c42ee104 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:56.611092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79ae23-92e2-47bf-8345-df20c42ee104 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:56.614036 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 696/1383] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:44:56.618511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536c144-695d-4e2b-ad2c-a239c5ab560a None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:56.618511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536c144-695d-4e2b-ad2c-a239c5ab560a None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:56.618511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536c144-695d-4e2b-ad2c-a239c5ab560a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:56.700761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f536c144-695d-4e2b-ad2c-a239c5ab560a None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:44:56.701934 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f536c144-695d-4e2b-ad2c-a239c5ab560a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:56.803942 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 688/1384] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:44:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:44:56.849178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79ae23-92e2-47bf-8345-df20c42ee104 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:44:56.850719 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-fd79ae23-92e2-47bf-8345-df20c42ee104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:56.978561 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:57.028661 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79ae23-92e2-47bf-8345-df20c42ee104 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:44:57.153685 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49624e-6edd-4ba2-9a39-4e4888471ac6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:44:57.154216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49624e-6edd-4ba2-9a39-4e4888471ac6 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:57.154644 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49624e-6edd-4ba2-9a39-4e4888471ac6 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:57.154802 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49624e-6edd-4ba2-9a39-4e4888471ac6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:57.156417 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0c49624e-6edd-4ba2-9a39-4e4888471ac6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:57.242882 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:57.261743 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49624e-6edd-4ba2-9a39-4e4888471ac6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:44:57.263484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49624e-6edd-4ba2-9a39-4e4888471ac6 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:44:57.283369 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 697/1385] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:44:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:44:59.912365 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fe4c2-b908-4340-8511-26ead86091ff None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:59.912987 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fe4c2-b908-4340-8511-26ead86091ff None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:59.913145 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fe4c2-b908-4340-8511-26ead86091ff None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:59.915138 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 689/1386] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:44:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:44:59.921800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e2fbf-5ce0-4629-8932-de54334dac81 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:59.922258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e2fbf-5ce0-4629-8932-de54334dac81 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:59.922539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e2fbf-5ce0-4629-8932-de54334dac81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:00.002174 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-805e2fbf-5ce0-4629-8932-de54334dac81 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:00.003757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-805e2fbf-5ce0-4629-8932-de54334dac81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:00.117954 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 698/1387] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:45:00.167162 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4fe4c2-b908-4340-8511-26ead86091ff None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:00.169230 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-db4fe4c2-b908-4340-8511-26ead86091ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:00.247352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:00.368231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4fe4c2-b908-4340-8511-26ead86091ff None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:00.508353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fbfe9-b620-4840-9996-f3f404293231 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:00.508962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fbfe9-b620-4840-9996-f3f404293231 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:00.509270 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fbfe9-b620-4840-9996-f3f404293231 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:00.509548 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fbfe9-b620-4840-9996-f3f404293231 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:00.511212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-714fbfe9-b620-4840-9996-f3f404293231 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:00.524690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:00.612213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714fbfe9-b620-4840-9996-f3f404293231 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:00.614372 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714fbfe9-b620-4840-9996-f3f404293231 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:00.638995 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 690/1388] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:45:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:45:03.528837 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a9277-e9ce-4149-a189-a82f1a8069bc None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:03.529477 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a9277-e9ce-4149-a189-a82f1a8069bc None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:03.529477 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a9277-e9ce-4149-a189-a82f1a8069bc None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:03.530765 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 699/1389] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:45:03.536542 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64d24a-7703-4a09-8dfc-356482b28047 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:03.537021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64d24a-7703-4a09-8dfc-356482b28047 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:03.537128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64d24a-7703-4a09-8dfc-356482b28047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:03.618859 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-7c64d24a-7703-4a09-8dfc-356482b28047 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:03.620349 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7c64d24a-7703-4a09-8dfc-356482b28047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:03.722999 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:03.737490 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 691/1390] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:45:03.784775 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a9277-e9ce-4149-a189-a82f1a8069bc None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:03.786251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-075a9277-e9ce-4149-a189-a82f1a8069bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:03.841984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:03.941949 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a9277-e9ce-4149-a189-a82f1a8069bc None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:04.092295 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0dc63-ecf7-47a2-8dbf-9a08ce417186 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:04.093013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0dc63-ecf7-47a2-8dbf-9a08ce417186 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:04.093371 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0dc63-ecf7-47a2-8dbf-9a08ce417186 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:04.093795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0dc63-ecf7-47a2-8dbf-9a08ce417186 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:04.096338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-92b0dc63-ecf7-47a2-8dbf-9a08ce417186 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:04.110535 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:04.197994 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0dc63-ecf7-47a2-8dbf-9a08ce417186 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:04.199646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0dc63-ecf7-47a2-8dbf-9a08ce417186 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:04.219003 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 700/1391] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:45:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:45:06.399252 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6636d-2760-4365-900d-32f7cbd3bcca None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:06.399839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6636d-2760-4365-900d-32f7cbd3bcca None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:06.399839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6636d-2760-4365-900d-32f7cbd3bcca None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:06.401196 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 692/1392] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:45:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:45:06.407448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb10989-b89a-49c7-832e-f9d57ea68489 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:06.408810 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb10989-b89a-49c7-832e-f9d57ea68489 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:06.408810 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb10989-b89a-49c7-832e-f9d57ea68489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:06.476064 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-dcb10989-b89a-49c7-832e-f9d57ea68489 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:06.477289 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-dcb10989-b89a-49c7-832e-f9d57ea68489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:06.488618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc575cb-bbbe-4eff-b2ca-a6e21a982e83 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:06.488901 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc575cb-bbbe-4eff-b2ca-a6e21a982e83 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:06.489177 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc575cb-bbbe-4eff-b2ca-a6e21a982e83 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:06.490522 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 693/1393] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:45:06.495678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ade619-5aa6-4d89-a3e3-6ca2347f9792 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:06.495869 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ade619-5aa6-4d89-a3e3-6ca2347f9792 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:06.496142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ade619-5aa6-4d89-a3e3-6ca2347f9792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:06.565509 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-c8ade619-5aa6-4d89-a3e3-6ca2347f9792 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:06.565887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:06.566895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c8ade619-5aa6-4d89-a3e3-6ca2347f9792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:06.578844 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 701/1394] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:45:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:45:06.638757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9dfb8-8dd6-4613-93a5-b98838ffccd7 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:06.639123 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9dfb8-8dd6-4613-93a5-b98838ffccd7 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:06.639400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9dfb8-8dd6-4613-93a5-b98838ffccd7 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:06.641169 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 702/1395] 10.222.0.33 () {54 vars in 966 bytes} [Sat Aug 6 20:45:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:45:06.646943 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432f5bd-65db-4ec5-9263-d9beab50d52e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:06.647242 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432f5bd-65db-4ec5-9263-d9beab50d52e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:06.647501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432f5bd-65db-4ec5-9263-d9beab50d52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:06.666951 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 694/1396] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:45:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:45:06.712794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ade619-5aa6-4d89-a3e3-6ca2347f9792 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:06.713998 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c8ade619-5aa6-4d89-a3e3-6ca2347f9792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:06.731525 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-9432f5bd-65db-4ec5-9263-d9beab50d52e None None] MFA Rules not processed for user `1e10759b2abd4cafacf338551327775e`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:06.732724 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9432f5bd-65db-4ec5-9263-d9beab50d52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:06.785585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:06.809655 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 703/1397] 10.222.0.33 () {58 vars in 1063 bytes} [Sat Aug 6 20:45:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:45:06.817747 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9432f5bd-65db-4ec5-9263-d9beab50d52e None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:06.825470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9432f5bd-65db-4ec5-9263-d9beab50d52e None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:06.831264 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ade619-5aa6-4d89-a3e3-6ca2347f9792 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:06.902939 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa453a5-1e08-49ce-8952-69930e25b24f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10759b2abd4cafacf338551327775e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:06.903543 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa453a5-1e08-49ce-8952-69930e25b24f service glance] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:06.903827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa453a5-1e08-49ce-8952-69930e25b24f service glance] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:06.904102 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa453a5-1e08-49ce-8952-69930e25b24f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:06.905708 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7fa453a5-1e08-49ce-8952-69930e25b24f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:06.908826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:06.948848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0312e85-a2ee-4b15-8797-dbd8c3f87367 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:06.949373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0312e85-a2ee-4b15-8797-dbd8c3f87367 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:06.949651 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0312e85-a2ee-4b15-8797-dbd8c3f87367 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:06.949952 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0312e85-a2ee-4b15-8797-dbd8c3f87367 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:06.951581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d0312e85-a2ee-4b15-8797-dbd8c3f87367 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:07.021582 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa453a5-1e08-49ce-8952-69930e25b24f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:07.023069 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa453a5-1e08-49ce-8952-69930e25b24f service glance] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:07.024860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:07.043040 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 704/1398] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:45:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:45:07.049514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0312e85-a2ee-4b15-8797-dbd8c3f87367 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:07.051139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0312e85-a2ee-4b15-8797-dbd8c3f87367 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:07.069439 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 695/1399] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:45:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:45:07.638487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ec1e5-60a9-4cc9-ba4f-7fcd414cecda None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:07.639039 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ec1e5-60a9-4cc9-ba4f-7fcd414cecda None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:07.639039 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ec1e5-60a9-4cc9-ba4f-7fcd414cecda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:07.709597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-4e1ec1e5-60a9-4cc9-ba4f-7fcd414cecda None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:07.710895 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4e1ec1e5-60a9-4cc9-ba4f-7fcd414cecda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:07.764891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:07.797561 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 705/1400] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 20:45:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:45:07.845827 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d77d85-54fb-4c42-aaa7-7a17ebeecac1 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:07.846372 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d77d85-54fb-4c42-aaa7-7a17ebeecac1 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:07.846468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d77d85-54fb-4c42-aaa7-7a17ebeecac1 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:07.848013 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 696/1401] 10.222.0.33 () {54 vars in 943 bytes} [Sat Aug 6 20:45:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:45:07.854437 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a25aa-5292-4918-8d71-373cd1583f54 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:07.854849 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a25aa-5292-4918-8d71-373cd1583f54 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:07.855131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a25aa-5292-4918-8d71-373cd1583f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:07.934432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-247a25aa-5292-4918-8d71-373cd1583f54 None None] MFA Rules not processed for user `cd3e0e177f934f7ba5abe52ac8bf8bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:07.935664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-247a25aa-5292-4918-8d71-373cd1583f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:08.043832 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 706/1402] 10.222.0.33 () {58 vars in 1040 bytes} [Sat Aug 6 20:45:07 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:45:08.054873 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d77d85-54fb-4c42-aaa7-7a17ebeecac1 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:08.056448 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-18d77d85-54fb-4c42-aaa7-7a17ebeecac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:08.205799 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d77d85-54fb-4c42-aaa7-7a17ebeecac1 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:08.262996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:08.315448 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fdf844-8184-46cc-af67-ba3aaec88f60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:08.315979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdf844-8184-46cc-af67-ba3aaec88f60 service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:08.316260 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdf844-8184-46cc-af67-ba3aaec88f60 service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:08.316532 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdf844-8184-46cc-af67-ba3aaec88f60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:08.318194 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-69fdf844-8184-46cc-af67-ba3aaec88f60 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:08.405629 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fdf844-8184-46cc-af67-ba3aaec88f60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:08.407264 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fdf844-8184-46cc-af67-ba3aaec88f60 service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:08.415248 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 697/1403] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 20:45:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 20:45:09.361676 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6076f03-75eb-4a74-aba3-a49ade2e6606 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:09.362265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6076f03-75eb-4a74-aba3-a49ade2e6606 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:09.363008 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6076f03-75eb-4a74-aba3-a49ade2e6606 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:09.367821 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 707/1404] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:45:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:45:09.369497 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf574a-4f9c-4839-b5a8-be2f8ea6519d None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:09.370265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf574a-4f9c-4839-b5a8-be2f8ea6519d None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:09.370737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf574a-4f9c-4839-b5a8-be2f8ea6519d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:09.500700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-adcf574a-4f9c-4839-b5a8-be2f8ea6519d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:09.502824 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-adcf574a-4f9c-4839-b5a8-be2f8ea6519d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:09.545685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:09.615576 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 698/1405] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:45:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:45:09.661063 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6076f03-75eb-4a74-aba3-a49ade2e6606 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:09.662821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b6076f03-75eb-4a74-aba3-a49ade2e6606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:09.699060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:09.831068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6076f03-75eb-4a74-aba3-a49ade2e6606 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:09.953807 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:09.966687 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f61c2-ec67-4d17-b5df-3a12c1c81bfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:09.967300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f61c2-ec67-4d17-b5df-3a12c1c81bfb service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:09.967580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f61c2-ec67-4d17-b5df-3a12c1c81bfb service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:09.967853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f61c2-ec67-4d17-b5df-3a12c1c81bfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:09.969447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a64f61c2-ec67-4d17-b5df-3a12c1c81bfb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:10.070090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f61c2-ec67-4d17-b5df-3a12c1c81bfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:10.071705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f61c2-ec67-4d17-b5df-3a12c1c81bfb service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:10.092538 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 708/1406] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:45:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:45:12.451939 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96160145-04e7-45f3-bbaa-023e4bcb06c1 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:12.452583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96160145-04e7-45f3-bbaa-023e4bcb06c1 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:12.452583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96160145-04e7-45f3-bbaa-023e4bcb06c1 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:12.453770 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 699/1407] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:45:12.459693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c65f0-ff4f-47ac-882f-b733048ca092 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:12.460170 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c65f0-ff4f-47ac-882f-b733048ca092 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:12.460270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c65f0-ff4f-47ac-882f-b733048ca092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:12.531224 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-805c65f0-ff4f-47ac-882f-b733048ca092 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:12.533497 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-805c65f0-ff4f-47ac-882f-b733048ca092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:12.608240 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:12.647268 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 709/1408] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:45:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:45:12.695212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96160145-04e7-45f3-bbaa-023e4bcb06c1 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:12.697124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-96160145-04e7-45f3-bbaa-023e4bcb06c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:12.885961 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96160145-04e7-45f3-bbaa-023e4bcb06c1 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:12.912281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:13.023206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6734b57-8565-465f-86e4-fc1d1890cbfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:13.023803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6734b57-8565-465f-86e4-fc1d1890cbfc service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:13.024080 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6734b57-8565-465f-86e4-fc1d1890cbfc service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:13.024351 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6734b57-8565-465f-86e4-fc1d1890cbfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:13.025960 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c6734b57-8565-465f-86e4-fc1d1890cbfc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:13.125824 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6734b57-8565-465f-86e4-fc1d1890cbfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:13.127582 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6734b57-8565-465f-86e4-fc1d1890cbfc service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:13.149549 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 700/1409] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:45:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:45:22.645371 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=14 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:23.146508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=88 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:31.818842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65722ef4-28cf-46df-9d0a-4b0f81f81475 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:31.819412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65722ef4-28cf-46df-9d0a-4b0f81f81475 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:31.819412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65722ef4-28cf-46df-9d0a-4b0f81f81475 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:31.820715 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 710/1410] 10.222.0.33 () {54 vars in 918 bytes} [Sat Aug 6 20:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:45:31.825907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950bb86-0e37-447b-9cc6-2a2b5e17367d None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:31.826326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950bb86-0e37-447b-9cc6-2a2b5e17367d None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:31.826464 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950bb86-0e37-447b-9cc6-2a2b5e17367d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:31.901462 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-4950bb86-0e37-447b-9cc6-2a2b5e17367d None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:31.902698 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4950bb86-0e37-447b-9cc6-2a2b5e17367d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:32.005941 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 701/1411] 10.222.0.33 () {58 vars in 1015 bytes} [Sat Aug 6 20:45:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:45:32.020100 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aca8dd-fac3-4370-b519-dc8ecaedb9d8 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:32.020414 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aca8dd-fac3-4370-b519-dc8ecaedb9d8 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:32.020697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aca8dd-fac3-4370-b519-dc8ecaedb9d8 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:32.022049 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 711/1412] 10.222.0.33 () {54 vars in 918 bytes} [Sat Aug 6 20:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:45:32.026702 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1fc5b-49de-4ea6-9575-9219769d586f None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:32.026990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1fc5b-49de-4ea6-9575-9219769d586f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:32.027261 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1fc5b-49de-4ea6-9575-9219769d586f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:32.099733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:32.102425 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-afa1fc5b-49de-4ea6-9575-9219769d586f None None] MFA Rules not processed for user `5f9d53147a57402f8b9818590bc1fc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:32.104232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-afa1fc5b-49de-4ea6-9575-9219769d586f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:32.218444 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 702/1413] 10.222.0.33 () {58 vars in 1015 bytes} [Sat Aug 6 20:45:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:45:34.946583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040b5c3-a282-4375-af31-2bd96e1fb528 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:34.947086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040b5c3-a282-4375-af31-2bd96e1fb528 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:34.947086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040b5c3-a282-4375-af31-2bd96e1fb528 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:34.948377 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 712/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:45:34.953809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e7a45-842d-4d52-bf59-da1eb9148bef None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:34.954421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e7a45-842d-4d52-bf59-da1eb9148bef None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:34.954421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e7a45-842d-4d52-bf59-da1eb9148bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:35.018740 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a86e7a45-842d-4d52-bf59-da1eb9148bef None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:35.019923 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a86e7a45-842d-4d52-bf59-da1eb9148bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:35.073388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:35.115186 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 703/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:45:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:45:35.160102 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040b5c3-a282-4375-af31-2bd96e1fb528 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:35.161662 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d040b5c3-a282-4375-af31-2bd96e1fb528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:35.304302 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040b5c3-a282-4375-af31-2bd96e1fb528 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:35.376779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:35.419055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072054c-1de9-4888-8161-c3683059e060 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:35.419661 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072054c-1de9-4888-8161-c3683059e060 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:35.419941 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072054c-1de9-4888-8161-c3683059e060 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:35.420217 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072054c-1de9-4888-8161-c3683059e060 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:35.422133 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0072054c-1de9-4888-8161-c3683059e060 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:35.515524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0072054c-1de9-4888-8161-c3683059e060 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:35.517145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0072054c-1de9-4888-8161-c3683059e060 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:35.535848 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 713/1416] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:45:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:45:36.568428 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6f45a-7a22-41a4-8d84-82cfbf846b7a None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:36.569001 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6f45a-7a22-41a4-8d84-82cfbf846b7a None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:36.569001 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6f45a-7a22-41a4-8d84-82cfbf846b7a None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:36.570315 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 704/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 20:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:45:36.575376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b820cb8-bbf6-4d59-aa1f-342f25f261a8 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:36.575783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b820cb8-bbf6-4d59-aa1f-342f25f261a8 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:36.575954 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b820cb8-bbf6-4d59-aa1f-342f25f261a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:36.651077 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-5b820cb8-bbf6-4d59-aa1f-342f25f261a8 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:36.652286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5b820cb8-bbf6-4d59-aa1f-342f25f261a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:36.680447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:36.750377 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 714/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 20:45:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:45:36.965249 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c6f45a-7a22-41a4-8d84-82cfbf846b7a None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:36.966805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-03c6f45a-7a22-41a4-8d84-82cfbf846b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:37.109382 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c6f45a-7a22-41a4-8d84-82cfbf846b7a None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:37.149684 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:37.221211 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568bb31-906f-4e9a-a603-a7f0deb588f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:37.221809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568bb31-906f-4e9a-a603-a7f0deb588f8 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:37.222084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568bb31-906f-4e9a-a603-a7f0deb588f8 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:37.222347 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568bb31-906f-4e9a-a603-a7f0deb588f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:37.224029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b568bb31-906f-4e9a-a603-a7f0deb588f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:37.313931 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568bb31-906f-4e9a-a603-a7f0deb588f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:37.315574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568bb31-906f-4e9a-a603-a7f0deb588f8 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:37.334415 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 705/1419] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:45:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:45:38.236273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c6a6e-7063-43c2-9bd1-c279c8660dfe None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:38.236833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c6a6e-7063-43c2-9bd1-c279c8660dfe None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:38.236833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c6a6e-7063-43c2-9bd1-c279c8660dfe None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:38.238173 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 715/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 20:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:45:38.243195 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944e316-86b2-4d57-aeb4-05f5e99803c2 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:38.243610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944e316-86b2-4d57-aeb4-05f5e99803c2 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:38.243746 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944e316-86b2-4d57-aeb4-05f5e99803c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:38.298819 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:38.321335 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f944e316-86b2-4d57-aeb4-05f5e99803c2 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:38.322690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f944e316-86b2-4d57-aeb4-05f5e99803c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:38.424918 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 706/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 20:45:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:45:38.590772 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c6a6e-7063-43c2-9bd1-c279c8660dfe None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:38.592415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-280c6a6e-7063-43c2-9bd1-c279c8660dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:38.741854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c6a6e-7063-43c2-9bd1-c279c8660dfe None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:38.753704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:38.855757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa875213-e438-4638-b027-6d9a27363b2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:38.856297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa875213-e438-4638-b027-6d9a27363b2c service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:38.856570 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa875213-e438-4638-b027-6d9a27363b2c service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:38.856836 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa875213-e438-4638-b027-6d9a27363b2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:38.858415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-aa875213-e438-4638-b027-6d9a27363b2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:38.953306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa875213-e438-4638-b027-6d9a27363b2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:38.954905 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa875213-e438-4638-b027-6d9a27363b2c service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:38.972403 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 716/1422] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:45:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:45:39.858303 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822ee56-f989-46d9-a4b0-49fcd95369fc None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:39.858867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822ee56-f989-46d9-a4b0-49fcd95369fc None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:39.858867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822ee56-f989-46d9-a4b0-49fcd95369fc None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:39.860130 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 707/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 20:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:45:39.865372 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73fd96a-070a-4f1f-b765-bd753f3f1243 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:39.865802 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73fd96a-070a-4f1f-b765-bd753f3f1243 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:39.865908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73fd96a-070a-4f1f-b765-bd753f3f1243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:39.886251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:39.943015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a73fd96a-070a-4f1f-b765-bd753f3f1243 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:39.944388 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a73fd96a-070a-4f1f-b765-bd753f3f1243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:40.040769 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 717/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 20:45:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:45:40.199065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822ee56-f989-46d9-a4b0-49fcd95369fc None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:40.200574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d822ee56-f989-46d9-a4b0-49fcd95369fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:40.310215 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:40.350022 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822ee56-f989-46d9-a4b0-49fcd95369fc None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:40.471415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77287424-84af-47ad-b7eb-7abcc4fdeabc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:40.472025 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77287424-84af-47ad-b7eb-7abcc4fdeabc service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:40.472307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77287424-84af-47ad-b7eb-7abcc4fdeabc service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:40.472582 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77287424-84af-47ad-b7eb-7abcc4fdeabc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:40.474183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-77287424-84af-47ad-b7eb-7abcc4fdeabc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:40.550302 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:40.565640 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77287424-84af-47ad-b7eb-7abcc4fdeabc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:40.567895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77287424-84af-47ad-b7eb-7abcc4fdeabc service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:40.586522 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 708/1425] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:45:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:45:41.454843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e16b4-8aae-4857-a039-bc68f5790ba7 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:41.455382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e16b4-8aae-4857-a039-bc68f5790ba7 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:41.455382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e16b4-8aae-4857-a039-bc68f5790ba7 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:41.456770 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 718/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 20:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:45:41.461850 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa571da6-e770-4358-b6a2-38630811cbc5 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:41.462274 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa571da6-e770-4358-b6a2-38630811cbc5 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:41.462390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa571da6-e770-4358-b6a2-38630811cbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:41.537311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-aa571da6-e770-4358-b6a2-38630811cbc5 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:41.538550 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-aa571da6-e770-4358-b6a2-38630811cbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:41.636736 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 709/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 20:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:45:41.796174 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e16b4-8aae-4857-a039-bc68f5790ba7 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:41.797760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1a3e16b4-8aae-4857-a039-bc68f5790ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:41.880655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:41.942931 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e16b4-8aae-4857-a039-bc68f5790ba7 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:42.056594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c981ebd-ef32-4afd-aaa4-f9ea80cbdef8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:42.057108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c981ebd-ef32-4afd-aaa4-f9ea80cbdef8 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:42.057382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c981ebd-ef32-4afd-aaa4-f9ea80cbdef8 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:42.057648 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c981ebd-ef32-4afd-aaa4-f9ea80cbdef8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:42.059520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1c981ebd-ef32-4afd-aaa4-f9ea80cbdef8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:42.111293 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:42.153422 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c981ebd-ef32-4afd-aaa4-f9ea80cbdef8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:42.155071 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c981ebd-ef32-4afd-aaa4-f9ea80cbdef8 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:42.174069 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 719/1428] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:45:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:45:42.997457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55148c31-1bdb-4315-a90b-64645dd39ef8 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:42.998033 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55148c31-1bdb-4315-a90b-64645dd39ef8 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:42.998033 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55148c31-1bdb-4315-a90b-64645dd39ef8 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:42.999399 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 710/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 20:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:45:43.004398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e25aa2-7ec5-4c0d-b5ef-870cf51573ee None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:43.005325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e25aa2-7ec5-4c0d-b5ef-870cf51573ee None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:43.005521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e25aa2-7ec5-4c0d-b5ef-870cf51573ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:43.080547 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-68e25aa2-7ec5-4c0d-b5ef-870cf51573ee None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:43.081732 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-68e25aa2-7ec5-4c0d-b5ef-870cf51573ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:43.178398 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 720/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 20:45:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:45:43.340400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55148c31-1bdb-4315-a90b-64645dd39ef8 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:43.341905 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-55148c31-1bdb-4315-a90b-64645dd39ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:43.391023 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:43.490240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55148c31-1bdb-4315-a90b-64645dd39ef8 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:43.606012 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034e36c-c58a-4299-8d1a-8d1445f3ff91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:43.606705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034e36c-c58a-4299-8d1a-8d1445f3ff91 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:43.606980 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034e36c-c58a-4299-8d1a-8d1445f3ff91 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:43.607248 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034e36c-c58a-4299-8d1a-8d1445f3ff91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:43.608861 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5034e36c-c58a-4299-8d1a-8d1445f3ff91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:43.615743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:43.700616 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5034e36c-c58a-4299-8d1a-8d1445f3ff91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:43.702216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5034e36c-c58a-4299-8d1a-8d1445f3ff91 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:43.720454 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 711/1431] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:45:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:45:44.552600 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d9210-54d2-4f9d-b309-6aa251115212 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:44.553351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d9210-54d2-4f9d-b309-6aa251115212 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:44.553351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d9210-54d2-4f9d-b309-6aa251115212 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:44.554461 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 721/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 20:45:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:45:44.560012 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7b873-06dc-4619-96b9-d2a4f54c1708 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:44.560442 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7b873-06dc-4619-96b9-d2a4f54c1708 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:44.560552 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7b873-06dc-4619-96b9-d2a4f54c1708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:44.636620 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-51e7b873-06dc-4619-96b9-d2a4f54c1708 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:44.637824 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-51e7b873-06dc-4619-96b9-d2a4f54c1708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:44.707144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:44.736562 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 712/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 20:45:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:45:44.901074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d9210-54d2-4f9d-b309-6aa251115212 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:44.902638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e81d9210-54d2-4f9d-b309-6aa251115212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:44.921398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:45.048244 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d9210-54d2-4f9d-b309-6aa251115212 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:45.135799 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:45.162982 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59476b38-1807-4a7e-8288-f3ccbd9dbd68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:45.163589 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59476b38-1807-4a7e-8288-f3ccbd9dbd68 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:45.163866 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59476b38-1807-4a7e-8288-f3ccbd9dbd68 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:45.164139 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59476b38-1807-4a7e-8288-f3ccbd9dbd68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:45.165740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-59476b38-1807-4a7e-8288-f3ccbd9dbd68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:45.253937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59476b38-1807-4a7e-8288-f3ccbd9dbd68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:45.255560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59476b38-1807-4a7e-8288-f3ccbd9dbd68 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:45.273104 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 722/1434] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:45:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:45:46.088828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94888ea0-6d88-4bfd-8613-579bdc1287a7 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:46.089422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94888ea0-6d88-4bfd-8613-579bdc1287a7 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:46.089422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94888ea0-6d88-4bfd-8613-579bdc1287a7 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:46.090780 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 713/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 20:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:45:46.095743 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed1c82-2361-4a4b-83d2-b602d4b0d2ac None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:46.096173 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed1c82-2361-4a4b-83d2-b602d4b0d2ac None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:46.096277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed1c82-2361-4a4b-83d2-b602d4b0d2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:46.170988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-efed1c82-2361-4a4b-83d2-b602d4b0d2ac None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:46.172189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-efed1c82-2361-4a4b-83d2-b602d4b0d2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:46.212536 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:46.267294 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 723/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 20:45:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:45:46.427189 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94888ea0-6d88-4bfd-8613-579bdc1287a7 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:46.428688 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-94888ea0-6d88-4bfd-8613-579bdc1287a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:46.572486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94888ea0-6d88-4bfd-8613-579bdc1287a7 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:46.630490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:46.693193 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b61a19-d5f0-4a7e-8076-2493fc2fc294 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:46.693660 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b61a19-d5f0-4a7e-8076-2493fc2fc294 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:46.693929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b61a19-d5f0-4a7e-8076-2493fc2fc294 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:46.694191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b61a19-d5f0-4a7e-8076-2493fc2fc294 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:46.695791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-31b61a19-d5f0-4a7e-8076-2493fc2fc294 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:46.783961 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b61a19-d5f0-4a7e-8076-2493fc2fc294 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:46.785636 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b61a19-d5f0-4a7e-8076-2493fc2fc294 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:46.804216 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 714/1437] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:45:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:45:47.632223 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456b471-ba0e-465b-afc8-814559ead98b None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:47.632759 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456b471-ba0e-465b-afc8-814559ead98b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:47.632759 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456b471-ba0e-465b-afc8-814559ead98b None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:47.634064 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 724/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 20:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:45:47.639971 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e30b40-124d-4b7d-998e-a565a7a9ea48 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:47.640415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e30b40-124d-4b7d-998e-a565a7a9ea48 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:47.640851 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e30b40-124d-4b7d-998e-a565a7a9ea48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:47.720064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-b1e30b40-124d-4b7d-998e-a565a7a9ea48 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:47.721250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b1e30b40-124d-4b7d-998e-a565a7a9ea48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:47.723252 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:47.818674 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 715/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 20:45:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:45:47.975847 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456b471-ba0e-465b-afc8-814559ead98b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:47.977373 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f456b471-ba0e-465b-afc8-814559ead98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:48.121192 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456b471-ba0e-465b-afc8-814559ead98b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:48.148686 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:48.235439 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d4a11-bb5e-4ea8-92f8-2303d171378b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:48.235964 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d4a11-bb5e-4ea8-92f8-2303d171378b service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:48.236237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d4a11-bb5e-4ea8-92f8-2303d171378b service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:48.236501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d4a11-bb5e-4ea8-92f8-2303d171378b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:48.238093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-973d4a11-bb5e-4ea8-92f8-2303d171378b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:48.325496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d4a11-bb5e-4ea8-92f8-2303d171378b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:48.327130 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d4a11-bb5e-4ea8-92f8-2303d171378b service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:48.344624 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 725/1440] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:45:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:45:50.483513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e522876-b7c6-43ae-a1b8-b0f26b2f70eb None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:50.484073 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e522876-b7c6-43ae-a1b8-b0f26b2f70eb None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:50.484073 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e522876-b7c6-43ae-a1b8-b0f26b2f70eb None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:50.485460 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 716/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:45:50.491695 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b5153-67e5-44bf-99b7-0dd8b7a20427 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:50.492134 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b5153-67e5-44bf-99b7-0dd8b7a20427 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:50.492236 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b5153-67e5-44bf-99b7-0dd8b7a20427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:50.532240 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:50.558470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-4c1b5153-67e5-44bf-99b7-0dd8b7a20427 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:50.559976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4c1b5153-67e5-44bf-99b7-0dd8b7a20427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:50.655568 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 726/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:45:50.697044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e522876-b7c6-43ae-a1b8-b0f26b2f70eb None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:50.698608 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6e522876-b7c6-43ae-a1b8-b0f26b2f70eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:50.799160 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e522876-b7c6-43ae-a1b8-b0f26b2f70eb None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:50.829974 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:50.871659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851a1f8-c5bc-409e-99e9-6fbb561cfdcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:50.872405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851a1f8-c5bc-409e-99e9-6fbb561cfdcb service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:50.872691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851a1f8-c5bc-409e-99e9-6fbb561cfdcb service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:50.872962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851a1f8-c5bc-409e-99e9-6fbb561cfdcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:50.874652 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7851a1f8-c5bc-409e-99e9-6fbb561cfdcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:50.986212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851a1f8-c5bc-409e-99e9-6fbb561cfdcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:50.987725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851a1f8-c5bc-409e-99e9-6fbb561cfdcb service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:51.006749 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 717/1443] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:45:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:45:53.432292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143207a8-f1d9-49d2-a078-f9e2f648d26c None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:53.432860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143207a8-f1d9-49d2-a078-f9e2f648d26c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:53.432860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143207a8-f1d9-49d2-a078-f9e2f648d26c None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:53.434183 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 727/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:45:53.439782 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15472e2-64a1-491a-ba50-af55e4a3b194 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:53.440221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15472e2-64a1-491a-ba50-af55e4a3b194 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:53.440349 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15472e2-64a1-491a-ba50-af55e4a3b194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:53.505097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d15472e2-64a1-491a-ba50-af55e4a3b194 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:53.506277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d15472e2-64a1-491a-ba50-af55e4a3b194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:53.518567 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:53.602996 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 718/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:45:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:45:53.644768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143207a8-f1d9-49d2-a078-f9e2f648d26c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:53.646834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-143207a8-f1d9-49d2-a078-f9e2f648d26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:53.751601 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143207a8-f1d9-49d2-a078-f9e2f648d26c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:53.764118 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:53.825748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be892f-1f9f-48ca-9d80-b37c31cca044 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:53.826345 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be892f-1f9f-48ca-9d80-b37c31cca044 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:53.826658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be892f-1f9f-48ca-9d80-b37c31cca044 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:53.826927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be892f-1f9f-48ca-9d80-b37c31cca044 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:53.828520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c9be892f-1f9f-48ca-9d80-b37c31cca044 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:53.939403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be892f-1f9f-48ca-9d80-b37c31cca044 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:53.940819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be892f-1f9f-48ca-9d80-b37c31cca044 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:53.961594 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 728/1446] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:45:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:45:56.504555 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a985b47-0e30-4b36-bc10-8bb046ccc456 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:56.505242 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a985b47-0e30-4b36-bc10-8bb046ccc456 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:56.505242 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a985b47-0e30-4b36-bc10-8bb046ccc456 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:56.506435 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 719/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:45:56.511794 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151fa0b-84d2-4017-a8b6-ea1aa3cd1a72 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:56.512222 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151fa0b-84d2-4017-a8b6-ea1aa3cd1a72 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:56.512345 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151fa0b-84d2-4017-a8b6-ea1aa3cd1a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:56.560488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:56.578078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d151fa0b-84d2-4017-a8b6-ea1aa3cd1a72 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:56.579304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d151fa0b-84d2-4017-a8b6-ea1aa3cd1a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:56.675216 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 729/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:45:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:45:56.716816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a985b47-0e30-4b36-bc10-8bb046ccc456 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:56.718350 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6a985b47-0e30-4b36-bc10-8bb046ccc456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:56.824086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a985b47-0e30-4b36-bc10-8bb046ccc456 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:56.864679 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:56.899216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cda3e9-1aa7-4685-a844-fec8ce18d7d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:56.899848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cda3e9-1aa7-4685-a844-fec8ce18d7d1 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:56.900122 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cda3e9-1aa7-4685-a844-fec8ce18d7d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:56.900390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cda3e9-1aa7-4685-a844-fec8ce18d7d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:56.901986 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-58cda3e9-1aa7-4685-a844-fec8ce18d7d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:57.008352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cda3e9-1aa7-4685-a844-fec8ce18d7d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:57.009768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cda3e9-1aa7-4685-a844-fec8ce18d7d1 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:57.027537 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 720/1449] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:45:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:45:59.430795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f556d53-9c17-4518-9b23-4c8dd629ce96 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:59.431341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f556d53-9c17-4518-9b23-4c8dd629ce96 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:59.431341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f556d53-9c17-4518-9b23-4c8dd629ce96 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:59.432862 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 730/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:45:59.438566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0b282-fea8-459c-9891-4604238a28ac None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:59.439015 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0b282-fea8-459c-9891-4604238a28ac None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:59.439144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0b282-fea8-459c-9891-4604238a28ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:59.506078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-74b0b282-fea8-459c-9891-4604238a28ac None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:59.507302 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-74b0b282-fea8-459c-9891-4604238a28ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:59.526939 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:59.604329 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 721/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:45:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:45:59.644657 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f556d53-9c17-4518-9b23-4c8dd629ce96 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:59.646808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5f556d53-9c17-4518-9b23-4c8dd629ce96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:59.750322 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f556d53-9c17-4518-9b23-4c8dd629ce96 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:59.769371 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:59.822943 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a735d96-a77b-4320-a24a-0a373b96380a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:59.823544 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a735d96-a77b-4320-a24a-0a373b96380a service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:59.823824 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a735d96-a77b-4320-a24a-0a373b96380a service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:59.824120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a735d96-a77b-4320-a24a-0a373b96380a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:59.825730 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9a735d96-a77b-4320-a24a-0a373b96380a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:59.931786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a735d96-a77b-4320-a24a-0a373b96380a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:59.933138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a735d96-a77b-4320-a24a-0a373b96380a service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:59.952390 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 731/1452] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:45:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:46:02.266907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915341ff-ef66-473c-925d-57d91381fd0b None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:02.267476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915341ff-ef66-473c-925d-57d91381fd0b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:02.267476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915341ff-ef66-473c-925d-57d91381fd0b None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:02.268825 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 722/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:46:02.274939 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538ae95-ddcd-4bf6-84a3-4d8e79dd49d2 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:02.275391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538ae95-ddcd-4bf6-84a3-4d8e79dd49d2 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:02.275505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538ae95-ddcd-4bf6-84a3-4d8e79dd49d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:02.340762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:02.344191 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-9538ae95-ddcd-4bf6-84a3-4d8e79dd49d2 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:02.345756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9538ae95-ddcd-4bf6-84a3-4d8e79dd49d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:02.442448 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 732/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:46:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:46:02.482333 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915341ff-ef66-473c-925d-57d91381fd0b None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:02.483971 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-915341ff-ef66-473c-925d-57d91381fd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:02.588833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915341ff-ef66-473c-925d-57d91381fd0b None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:02.637945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:02.663633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3107bb-677c-4245-85f0-d50a58861b88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:02.664455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3107bb-677c-4245-85f0-d50a58861b88 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:02.664736 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3107bb-677c-4245-85f0-d50a58861b88 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:02.665007 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3107bb-677c-4245-85f0-d50a58861b88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:02.666838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-fd3107bb-677c-4245-85f0-d50a58861b88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:02.775010 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3107bb-677c-4245-85f0-d50a58861b88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:02.776449 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3107bb-677c-4245-85f0-d50a58861b88 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:02.793767 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 723/1455] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:46:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:46:05.088854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3734261-0ac5-4151-9c34-e85362e58a60 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:05.089417 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3734261-0ac5-4151-9c34-e85362e58a60 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:05.089417 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3734261-0ac5-4151-9c34-e85362e58a60 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:05.090772 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 733/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:46:05.096293 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c08ea2-6422-48f2-a5e5-43c629c71b86 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:05.096745 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c08ea2-6422-48f2-a5e5-43c629c71b86 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:05.096843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c08ea2-6422-48f2-a5e5-43c629c71b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:05.162934 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-c4c08ea2-6422-48f2-a5e5-43c629c71b86 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:05.164149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c4c08ea2-6422-48f2-a5e5-43c629c71b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:05.195059 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:05.262386 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 724/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:46:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:46:05.302116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3734261-0ac5-4151-9c34-e85362e58a60 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:05.303687 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e3734261-0ac5-4151-9c34-e85362e58a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:05.410110 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3734261-0ac5-4151-9c34-e85362e58a60 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:05.439258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:05.483958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2a884-425b-48c3-aefc-8905c5a65cd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:05.484555 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2a884-425b-48c3-aefc-8905c5a65cd7 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:05.484832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2a884-425b-48c3-aefc-8905c5a65cd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:05.485101 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2a884-425b-48c3-aefc-8905c5a65cd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:05.486715 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f6d2a884-425b-48c3-aefc-8905c5a65cd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:05.597134 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d2a884-425b-48c3-aefc-8905c5a65cd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:05.599158 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d2a884-425b-48c3-aefc-8905c5a65cd7 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:05.618582 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 734/1458] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:46:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:46:08.033835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb3ea8-6c02-4f9f-8f11-4411708acce5 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:08.034388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb3ea8-6c02-4f9f-8f11-4411708acce5 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:08.034388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb3ea8-6c02-4f9f-8f11-4411708acce5 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:08.036409 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 725/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:46:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:46:08.041722 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf96ebc-b9aa-4f84-a393-6eb8812cc885 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:08.042148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf96ebc-b9aa-4f84-a393-6eb8812cc885 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:08.042259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf96ebc-b9aa-4f84-a393-6eb8812cc885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:08.108072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-ebf96ebc-b9aa-4f84-a393-6eb8812cc885 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:08.109264 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ebf96ebc-b9aa-4f84-a393-6eb8812cc885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:08.117501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:08.205167 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 735/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:46:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:46:08.244162 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb3ea8-6c02-4f9f-8f11-4411708acce5 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:08.245750 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f7eb3ea8-6c02-4f9f-8f11-4411708acce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:08.352137 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb3ea8-6c02-4f9f-8f11-4411708acce5 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:08.409955 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:08.430060 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc43cb6-5460-4685-a29f-6abaea2bae37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:08.430697 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc43cb6-5460-4685-a29f-6abaea2bae37 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:08.430971 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc43cb6-5460-4685-a29f-6abaea2bae37 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:08.431234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc43cb6-5460-4685-a29f-6abaea2bae37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:08.432816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-dfc43cb6-5460-4685-a29f-6abaea2bae37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:08.540583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc43cb6-5460-4685-a29f-6abaea2bae37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:08.542179 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc43cb6-5460-4685-a29f-6abaea2bae37 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:08.561043 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 726/1461] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:46:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:46:10.848516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a67bfc-c24f-4bfe-a21d-b75efd5ec483 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:10.849063 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a67bfc-c24f-4bfe-a21d-b75efd5ec483 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:10.849063 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a67bfc-c24f-4bfe-a21d-b75efd5ec483 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:10.850378 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 736/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:46:10.855630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9749cd8-9113-4ea0-9299-354b5ec46d80 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:10.856074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9749cd8-9113-4ea0-9299-354b5ec46d80 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:10.856172 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9749cd8-9113-4ea0-9299-354b5ec46d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:10.921743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f9749cd8-9113-4ea0-9299-354b5ec46d80 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:10.923272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f9749cd8-9113-4ea0-9299-354b5ec46d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:10.962290 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:11.022088 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 727/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:46:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:46:11.061874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a67bfc-c24f-4bfe-a21d-b75efd5ec483 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:11.063494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c2a67bfc-c24f-4bfe-a21d-b75efd5ec483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:11.164998 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a67bfc-c24f-4bfe-a21d-b75efd5ec483 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:11.203144 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:11.239490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47f918-4ecb-4ae6-abab-f18125b32468 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:11.240092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47f918-4ecb-4ae6-abab-f18125b32468 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:11.240369 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47f918-4ecb-4ae6-abab-f18125b32468 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:11.240639 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47f918-4ecb-4ae6-abab-f18125b32468 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:11.242225 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-cb47f918-4ecb-4ae6-abab-f18125b32468 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:11.351426 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47f918-4ecb-4ae6-abab-f18125b32468 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:11.352892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47f918-4ecb-4ae6-abab-f18125b32468 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:11.371500 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 737/1464] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:46:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:46:13.651891 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cae233-82fb-454f-962d-0857eceb25ce None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:13.652463 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cae233-82fb-454f-962d-0857eceb25ce None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:13.652463 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cae233-82fb-454f-962d-0857eceb25ce None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:13.653774 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 728/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:46:13.659157 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760bc1c-b71e-45db-a6cf-62520fa08297 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:13.659569 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760bc1c-b71e-45db-a6cf-62520fa08297 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:13.659707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760bc1c-b71e-45db-a6cf-62520fa08297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:13.730700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-f760bc1c-b71e-45db-a6cf-62520fa08297 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:13.731914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f760bc1c-b71e-45db-a6cf-62520fa08297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:13.750114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:13.828023 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 738/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:46:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:46:13.866872 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cae233-82fb-454f-962d-0857eceb25ce None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:13.868409 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-92cae233-82fb-454f-962d-0857eceb25ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:13.970355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cae233-82fb-454f-962d-0857eceb25ce None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:14.037295 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:14.044780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a831e-e878-416a-87aa-90955d337c43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:14.045375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a831e-e878-416a-87aa-90955d337c43 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:14.045650 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a831e-e878-416a-87aa-90955d337c43 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:14.045918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a831e-e878-416a-87aa-90955d337c43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:14.047531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d79a831e-e878-416a-87aa-90955d337c43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:14.154260 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a831e-e878-416a-87aa-90955d337c43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:14.155773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a831e-e878-416a-87aa-90955d337c43 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:14.173520 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 729/1467] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:46:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:46:16.431819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d643b7-58e2-4449-97be-af3d3c127fd5 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:16.432421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d643b7-58e2-4449-97be-af3d3c127fd5 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:16.432421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d643b7-58e2-4449-97be-af3d3c127fd5 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:16.433697 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 739/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:46:16.439368 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3caf055-d966-4dbe-be04-fccbd96e2dd3 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:16.439812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3caf055-d966-4dbe-be04-fccbd96e2dd3 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:16.439913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3caf055-d966-4dbe-be04-fccbd96e2dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:16.506402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a3caf055-d966-4dbe-be04-fccbd96e2dd3 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:16.507645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a3caf055-d966-4dbe-be04-fccbd96e2dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:16.555621 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:16.604806 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 730/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:46:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:46:16.644743 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d643b7-58e2-4449-97be-af3d3c127fd5 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:16.646359 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-74d643b7-58e2-4449-97be-af3d3c127fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:16.750735 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d643b7-58e2-4449-97be-af3d3c127fd5 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:16.797758 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:16.824457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088386d-dac5-4fdf-8035-08bbf1796b86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:16.825057 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088386d-dac5-4fdf-8035-08bbf1796b86 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:16.825333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088386d-dac5-4fdf-8035-08bbf1796b86 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:16.825600 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088386d-dac5-4fdf-8035-08bbf1796b86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:16.827217 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9088386d-dac5-4fdf-8035-08bbf1796b86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:16.932956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088386d-dac5-4fdf-8035-08bbf1796b86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:16.934389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088386d-dac5-4fdf-8035-08bbf1796b86 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:16.953227 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 740/1470] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:46:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:46:26.603001 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=22 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:26.950998 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=66 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:41.208210 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c050e57-7f5e-4cd6-8d83-40b85093be96 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:41.208772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c050e57-7f5e-4cd6-8d83-40b85093be96 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:41.208772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c050e57-7f5e-4cd6-8d83-40b85093be96 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:41.210148 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 731/1471] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:46:41.215595 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af02df-92ef-470f-a42f-b535aa32224d None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:41.216028 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af02df-92ef-470f-a42f-b535aa32224d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:41.216139 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af02df-92ef-470f-a42f-b535aa32224d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:41.281557 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-70af02df-92ef-470f-a42f-b535aa32224d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:41.282765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-70af02df-92ef-470f-a42f-b535aa32224d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:41.380613 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 741/1472] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:46:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:46:41.431446 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8943d-ebf4-4369-b6ff-a64026c40863 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:41.431754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8943d-ebf4-4369-b6ff-a64026c40863 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:41.432024 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8943d-ebf4-4369-b6ff-a64026c40863 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:41.433336 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 732/1473] 10.222.0.33 () {54 vars in 966 bytes} [Sat Aug 6 20:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:46:41.438416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c476bf3-f341-443f-9ddf-5008e4216871 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:41.438742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c476bf3-f341-443f-9ddf-5008e4216871 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:41.439024 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c476bf3-f341-443f-9ddf-5008e4216871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:41.514306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-0c476bf3-f341-443f-9ddf-5008e4216871 None None] MFA Rules not processed for user `1e10759b2abd4cafacf338551327775e`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:41.515538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0c476bf3-f341-443f-9ddf-5008e4216871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:41.536550 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:41.593332 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 742/1474] 10.222.0.33 () {58 vars in 1063 bytes} [Sat Aug 6 20:46:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:46:41.601485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8943d-ebf4-4369-b6ff-a64026c40863 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:41.603029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-dae8943d-ebf4-4369-b6ff-a64026c40863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:41.707954 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8943d-ebf4-4369-b6ff-a64026c40863 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:41.783233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eefbb12-18be-4b17-8994-07c9262939b9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10759b2abd4cafacf338551327775e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:41.783754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefbb12-18be-4b17-8994-07c9262939b9 service glance] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:41.784661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefbb12-18be-4b17-8994-07c9262939b9 service glance] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:41.784937 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefbb12-18be-4b17-8994-07c9262939b9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:41.786530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4eefbb12-18be-4b17-8994-07c9262939b9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:41.840292 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:41.896002 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eefbb12-18be-4b17-8994-07c9262939b9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:41.897479 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eefbb12-18be-4b17-8994-07c9262939b9 service glance] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:41.916444 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 733/1475] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:46:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:46:44.304118 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48066b1-8282-441e-9937-99ad1516fda1 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:44.304706 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48066b1-8282-441e-9937-99ad1516fda1 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:44.304706 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48066b1-8282-441e-9937-99ad1516fda1 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:44.305984 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 743/1476] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:46:44.311575 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972434e-e09b-4495-a544-cf2a2e5cea01 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:44.311966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972434e-e09b-4495-a544-cf2a2e5cea01 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:44.312140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972434e-e09b-4495-a544-cf2a2e5cea01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:44.379054 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-c972434e-e09b-4495-a544-cf2a2e5cea01 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:44.380256 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c972434e-e09b-4495-a544-cf2a2e5cea01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:44.477411 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 734/1477] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:46:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:46:44.502076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48066b1-8282-441e-9937-99ad1516fda1 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:44.503679 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f48066b1-8282-441e-9937-99ad1516fda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:44.628029 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48066b1-8282-441e-9937-99ad1516fda1 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:44.676998 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:44.721942 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd343c8a-055e-4c7e-b218-416e7cc9ac5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:44.722571 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd343c8a-055e-4c7e-b218-416e7cc9ac5d admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:44.722851 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd343c8a-055e-4c7e-b218-416e7cc9ac5d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:44.723122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd343c8a-055e-4c7e-b218-416e7cc9ac5d admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:44.723774 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd343c8a-055e-4c7e-b218-416e7cc9ac5d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:44.725516 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-dd343c8a-055e-4c7e-b218-416e7cc9ac5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:46:44.725516 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 20:46:44.725516 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 20:46:44.726778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd343c8a-055e-4c7e-b218-416e7cc9ac5d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:44.747318 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 744/1478] 10.222.0.33 () {56 vars in 1108 bytes} [Sat Aug 6 20:46:44 2022] GET /identity/v3/projects => generated 2553 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:46:46.998604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959df0f8-0329-434a-b2f0-12f1b164439a None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:46.999177 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959df0f8-0329-434a-b2f0-12f1b164439a None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:46.999177 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959df0f8-0329-434a-b2f0-12f1b164439a None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:47.000491 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 735/1479] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:46:47.006775 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad70d44-27ee-4172-bd26-de5f22664d7e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:47.007201 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad70d44-27ee-4172-bd26-de5f22664d7e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:47.007341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad70d44-27ee-4172-bd26-de5f22664d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:47.072756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-8ad70d44-27ee-4172-bd26-de5f22664d7e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:47.073975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8ad70d44-27ee-4172-bd26-de5f22664d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:47.168500 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 745/1480] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:46:47.213459 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959df0f8-0329-434a-b2f0-12f1b164439a None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:47.215089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-959df0f8-0329-434a-b2f0-12f1b164439a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:47.224910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:47.362476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959df0f8-0329-434a-b2f0-12f1b164439a None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:47.448295 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:47.481959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b11d6b-365c-488a-a28e-567b4fe2c752 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:47.482586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b11d6b-365c-488a-a28e-567b4fe2c752 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:47.482862 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b11d6b-365c-488a-a28e-567b4fe2c752 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:47.483132 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b11d6b-365c-488a-a28e-567b4fe2c752 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:47.484752 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-92b11d6b-365c-488a-a28e-567b4fe2c752 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:47.574591 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b11d6b-365c-488a-a28e-567b4fe2c752 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:47.576167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b11d6b-365c-488a-a28e-567b4fe2c752 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:47.594165 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 736/1481] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:46:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:46:50.023791 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fb89a-7b3b-4b65-8bdb-c2e87cba0337 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:50.024378 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fb89a-7b3b-4b65-8bdb-c2e87cba0337 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:50.024378 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fb89a-7b3b-4b65-8bdb-c2e87cba0337 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:50.025674 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 746/1482] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:46:50.031246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c64cfb-ec8d-4b11-95ec-b0a0540cf555 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:50.031661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c64cfb-ec8d-4b11-95ec-b0a0540cf555 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:50.031790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c64cfb-ec8d-4b11-95ec-b0a0540cf555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:50.097317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-16c64cfb-ec8d-4b11-95ec-b0a0540cf555 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:50.098505 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-16c64cfb-ec8d-4b11-95ec-b0a0540cf555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:50.142733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:50.194945 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 737/1483] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:46:50.234536 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5fb89a-7b3b-4b65-8bdb-c2e87cba0337 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:50.236089 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6d5fb89a-7b3b-4b65-8bdb-c2e87cba0337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:50.259553 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:50.339381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5fb89a-7b3b-4b65-8bdb-c2e87cba0337 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:50.415277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9596551-ab7b-40ca-8b33-d1aa73a6e687 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:50.415885 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9596551-ab7b-40ca-8b33-d1aa73a6e687 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:50.416167 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9596551-ab7b-40ca-8b33-d1aa73a6e687 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:50.416441 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9596551-ab7b-40ca-8b33-d1aa73a6e687 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:50.418040 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f9596551-ab7b-40ca-8b33-d1aa73a6e687 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:50.498331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:50.535973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9596551-ab7b-40ca-8b33-d1aa73a6e687 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:50.537422 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9596551-ab7b-40ca-8b33-d1aa73a6e687 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:50.556928 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 747/1484] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:46:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:46:52.867578 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6f01d-ad5a-4c18-9f9d-1d06be929d8e None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:52.868242 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6f01d-ad5a-4c18-9f9d-1d06be929d8e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:52.868242 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6f01d-ad5a-4c18-9f9d-1d06be929d8e None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:52.869490 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 738/1485] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:46:52.874649 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487412e-fa78-428f-9a46-110fe7766f7a None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:52.875081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487412e-fa78-428f-9a46-110fe7766f7a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:52.875220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487412e-fa78-428f-9a46-110fe7766f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:52.944127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-7487412e-fa78-428f-9a46-110fe7766f7a None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:52.945274 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7487412e-fa78-428f-9a46-110fe7766f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:53.040478 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 748/1486] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:46:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:46:53.081223 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6f01d-ad5a-4c18-9f9d-1d06be929d8e None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:53.082770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-12d6f01d-ad5a-4c18-9f9d-1d06be929d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:53.185067 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6f01d-ad5a-4c18-9f9d-1d06be929d8e None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:53.255856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:53.257727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be25fe1-bd53-4804-9c74-84c609cd1913 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:53.258311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be25fe1-bd53-4804-9c74-84c609cd1913 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:53.258809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be25fe1-bd53-4804-9c74-84c609cd1913 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:53.259295 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be25fe1-bd53-4804-9c74-84c609cd1913 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:53.261164 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7be25fe1-bd53-4804-9c74-84c609cd1913 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:53.370734 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be25fe1-bd53-4804-9c74-84c609cd1913 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:53.372171 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be25fe1-bd53-4804-9c74-84c609cd1913 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:53.390248 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 739/1487] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:46:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:46:55.810675 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1b54c-a0a9-49bf-8a6c-b6b913eaeb13 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:55.811230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1b54c-a0a9-49bf-8a6c-b6b913eaeb13 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:55.811230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1b54c-a0a9-49bf-8a6c-b6b913eaeb13 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:55.812552 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 749/1488] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:46:55.818252 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0bf4b-e21d-428e-ad59-f4875e3b55e7 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:55.818724 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0bf4b-e21d-428e-ad59-f4875e3b55e7 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:55.818834 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0bf4b-e21d-428e-ad59-f4875e3b55e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:55.883746 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-6aa0bf4b-e21d-428e-ad59-f4875e3b55e7 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:55.884942 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6aa0bf4b-e21d-428e-ad59-f4875e3b55e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:55.937513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:55.981917 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 740/1489] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:46:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:46:56.025687 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1b54c-a0a9-49bf-8a6c-b6b913eaeb13 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:56.027257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-77c1b54c-a0a9-49bf-8a6c-b6b913eaeb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:56.063262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:56.134902 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1b54c-a0a9-49bf-8a6c-b6b913eaeb13 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:56.208618 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6b902-b8b2-41b6-ad39-1e73ca507346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:56.209148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6b902-b8b2-41b6-ad39-1e73ca507346 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:56.209429 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6b902-b8b2-41b6-ad39-1e73ca507346 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:56.209704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6b902-b8b2-41b6-ad39-1e73ca507346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:56.211340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f5e6b902-b8b2-41b6-ad39-1e73ca507346 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:56.293196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:56.323608 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6b902-b8b2-41b6-ad39-1e73ca507346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:56.325278 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6b902-b8b2-41b6-ad39-1e73ca507346 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:56.343423 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 750/1490] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:46:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:46:58.783926 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ef0ee-f8bb-4b3b-87e9-f47ab6e4fbe2 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:58.784472 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ef0ee-f8bb-4b3b-87e9-f47ab6e4fbe2 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:58.784472 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ef0ee-f8bb-4b3b-87e9-f47ab6e4fbe2 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:58.785840 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 741/1491] 10.222.0.33 () {54 vars in 927 bytes} [Sat Aug 6 20:46:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:46:58.791300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b31749-53ec-44ea-8d7f-63def890d830 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:58.791697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b31749-53ec-44ea-8d7f-63def890d830 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:58.791848 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b31749-53ec-44ea-8d7f-63def890d830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:58.859290 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b7b31749-53ec-44ea-8d7f-63def890d830 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:58.860426 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b7b31749-53ec-44ea-8d7f-63def890d830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:58.958827 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 751/1492] 10.222.0.33 () {58 vars in 1024 bytes} [Sat Aug 6 20:46:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:46:58.999864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ef0ee-f8bb-4b3b-87e9-f47ab6e4fbe2 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:59.001423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e40ef0ee-f8bb-4b3b-87e9-f47ab6e4fbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:59.105637 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ef0ee-f8bb-4b3b-87e9-f47ab6e4fbe2 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:59.177390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d064e3-9a92-46e7-8174-d8b5e4c044ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:59.177928 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d064e3-9a92-46e7-8174-d8b5e4c044ee service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:59.178213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d064e3-9a92-46e7-8174-d8b5e4c044ee service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:59.178485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d064e3-9a92-46e7-8174-d8b5e4c044ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:59.180112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e5d064e3-9a92-46e7-8174-d8b5e4c044ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:59.189535 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:59.289237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d064e3-9a92-46e7-8174-d8b5e4c044ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:59.290701 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d064e3-9a92-46e7-8174-d8b5e4c044ee service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:59.308567 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 742/1493] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:46:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:47:08.957039 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=82 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:09.306218 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=50 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:12.765786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10282f54-b670-4522-862c-40b6508bef9e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:12.766351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10282f54-b670-4522-862c-40b6508bef9e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:12.766351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10282f54-b670-4522-862c-40b6508bef9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:12.846207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-10282f54-b670-4522-862c-40b6508bef9e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:12.847349 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-10282f54-b670-4522-862c-40b6508bef9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:12.944424 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 752/1494] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:48:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:12.953357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95809d-ecff-4df3-aace-53425fc045db None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:12.953864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95809d-ecff-4df3-aace-53425fc045db None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:12.954476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95809d-ecff-4df3-aace-53425fc045db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:13.029347 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-6e95809d-ecff-4df3-aace-53425fc045db None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:13.030597 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6e95809d-ecff-4df3-aace-53425fc045db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:13.125345 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 743/1495] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:48:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:13.130071 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10282f54-b670-4522-862c-40b6508bef9e None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:13.131370 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-10282f54-b670-4522-862c-40b6508bef9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:13.143946 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10282f54-b670-4522-862c-40b6508bef9e None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:13.203167 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:13.236861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25715c-3665-4710-aa76-0ce503c4a7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:13.237460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25715c-3665-4710-aa76-0ce503c4a7ce admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:13.237735 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25715c-3665-4710-aa76-0ce503c4a7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:13.238001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25715c-3665-4710-aa76-0ce503c4a7ce admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:13.238667 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25715c-3665-4710-aa76-0ce503c4a7ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:48:13.238964 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25715c-3665-4710-aa76-0ce503c4a7ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:13.239960 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-ed25715c-3665-4710-aa76-0ce503c4a7ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:48:13.239960 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 20:48:13.239960 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 20:48:13.240838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25715c-3665-4710-aa76-0ce503c4a7ce admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:13.252308 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 753/1496] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:48:13.260848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95809d-ecff-4df3-aace-53425fc045db None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:13.270034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95809d-ecff-4df3-aace-53425fc045db None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:13.331143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:13.375169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a702c39-c239-464f-b583-e9ef8bf46ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:13.375854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a702c39-c239-464f-b583-e9ef8bf46ba5 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:13.376082 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a702c39-c239-464f-b583-e9ef8bf46ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:13.376353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a702c39-c239-464f-b583-e9ef8bf46ba5 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:13.376973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a702c39-c239-464f-b583-e9ef8bf46ba5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:13.378812 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-3a702c39-c239-464f-b583-e9ef8bf46ba5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:48:13.378812 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 20:48:13.378812 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 20:48:13.380067 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a702c39-c239-464f-b583-e9ef8bf46ba5 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:13.438047 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 744/1497] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:48:13 2022] POST /identity/v3/projects => generated 379 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:48:13.442301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25715c-3665-4710-aa76-0ce503c4a7ce admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:13.443862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ed25715c-3665-4710-aa76-0ce503c4a7ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:13.477151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25715c-3665-4710-aa76-0ce503c4a7ce admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:13.577375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1934c-1388-40bf-a3dd-68c521be2956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:13.577874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1934c-1388-40bf-a3dd-68c521be2956 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:13.578146 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1934c-1388-40bf-a3dd-68c521be2956 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:13.578417 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1934c-1388-40bf-a3dd-68c521be2956 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:13.579058 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1934c-1388-40bf-a3dd-68c521be2956 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:13.580052 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-7ca1934c-1388-40bf-a3dd-68c521be2956 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:48:13.580052 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 20:48:13.580052 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 20:48:13.581252 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1934c-1388-40bf-a3dd-68c521be2956 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:13.622131 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 754/1498] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:48:13 2022] POST /identity/v3/users => generated 290 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:48:13.627011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a702c39-c239-464f-b583-e9ef8bf46ba5 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:13.628592 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3a702c39-c239-464f-b583-e9ef8bf46ba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:13.691751 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a702c39-c239-464f-b583-e9ef8bf46ba5 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:13.774770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:13.785958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e1b4b-c155-4080-8a68-663cc63e51a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:13.786598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e1b4b-c155-4080-8a68-663cc63e51a2 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:13.786965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e1b4b-c155-4080-8a68-663cc63e51a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:13.787362 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e1b4b-c155-4080-8a68-663cc63e51a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:13.788038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e1b4b-c155-4080-8a68-663cc63e51a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:13.789252 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-5b9e1b4b-c155-4080-8a68-663cc63e51a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:48:13.789252 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 20:48:13.789252 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 20:48:13.790131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e1b4b-c155-4080-8a68-663cc63e51a2 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:13.802602 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 745/1499] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:48:13.806563 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1934c-1388-40bf-a3dd-68c521be2956 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:13.808068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7ca1934c-1388-40bf-a3dd-68c521be2956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:13.820240 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1934c-1388-40bf-a3dd-68c521be2956 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:13.844997 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:13.913605 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa549a-63ab-42a4-9594-32cf668c9f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:13.914126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa549a-63ab-42a4-9594-32cf668c9f91 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:13.914400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa549a-63ab-42a4-9594-32cf668c9f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:13.914705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa549a-63ab-42a4-9594-32cf668c9f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:13.915330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa549a-63ab-42a4-9594-32cf668c9f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:13.916329 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-56fa549a-63ab-42a4-9594-32cf668c9f91 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:48:13.916329 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 20:48:13.916329 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 20:48:13.917207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa549a-63ab-42a4-9594-32cf668c9f91 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:13.929235 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 755/1500] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:48:13.933438 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e1b4b-c155-4080-8a68-663cc63e51a2 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:13.935267 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5b9e1b4b-c155-4080-8a68-663cc63e51a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:13.970906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e1b4b-c155-4080-8a68-663cc63e51a2 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:14.065523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced4579-caa4-460a-b37b-3a3295dcb945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:14.066184 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced4579-caa4-460a-b37b-3a3295dcb945 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:14.066461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced4579-caa4-460a-b37b-3a3295dcb945 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:14.066764 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced4579-caa4-460a-b37b-3a3295dcb945 admin admin] PATH_INFO: `/v3/projects/d91cee89a1f746a29d952f7b343a0bf3/users/f9721caa63324a0ab809adf7cb999ec7/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:14.087962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced4579-caa4-460a-b37b-3a3295dcb945 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d91cee89a1f746a29d952f7b343a0bf3, user_id=f9721caa63324a0ab809adf7cb999ec7, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:14.088986 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-7ced4579-caa4-460a-b37b-3a3295dcb945 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:48:14.088986 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 20:48:14.088986 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 20:48:14.090965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced4579-caa4-460a-b37b-3a3295dcb945 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:14.115430 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 746/1501] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:48:13 2022] PUT /identity/v3/projects/d91cee89a1f746a29d952f7b343a0bf3/users/f9721caa63324a0ab809adf7cb999ec7/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:48:14.128094 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696471c9-2702-449c-912c-5a21f97912f2 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:14.128371 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696471c9-2702-449c-912c-5a21f97912f2 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:14.128636 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696471c9-2702-449c-912c-5a21f97912f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:14.184679 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-696471c9-2702-449c-912c-5a21f97912f2 None None] MFA Rules not processed for user `f9721caa63324a0ab809adf7cb999ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:14.185812 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-696471c9-2702-449c-912c-5a21f97912f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:14.262158 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 756/1502] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:48:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:14.275932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e458d-3858-4641-9348-2b688c788a74 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:14.276214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e458d-3858-4641-9348-2b688c788a74 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:14.276484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e458d-3858-4641-9348-2b688c788a74 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:14.277811 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 747/1503] 10.222.0.33 () {54 vars in 964 bytes} [Sat Aug 6 20:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:48:14.282753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d7976-74df-441f-860f-bf8b484819af None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:14.283035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d7976-74df-441f-860f-bf8b484819af None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:14.283305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d7976-74df-441f-860f-bf8b484819af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:14.315545 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:14.360015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-855d7976-74df-441f-860f-bf8b484819af None None] MFA Rules not processed for user `60cf8ac27ec04117937e87749d69fe3f`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:14.361219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-855d7976-74df-441f-860f-bf8b484819af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:14.438727 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 757/1504] 10.222.0.33 () {58 vars in 1061 bytes} [Sat Aug 6 20:48:14 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:48:14.446305 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e458d-3858-4641-9348-2b688c788a74 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:14.447863 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-864e458d-3858-4641-9348-2b688c788a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:14.498273 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:14.553769 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e458d-3858-4641-9348-2b688c788a74 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:14.627711 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f08d6-8434-4d35-9a21-ba37acd61849 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:14.628308 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f08d6-8434-4d35-9a21-ba37acd61849 service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:14.628613 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f08d6-8434-4d35-9a21-ba37acd61849 service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:14.628890 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f08d6-8434-4d35-9a21-ba37acd61849 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:14.630472 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-099f08d6-8434-4d35-9a21-ba37acd61849 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:14.731894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099f08d6-8434-4d35-9a21-ba37acd61849 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:14.734407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099f08d6-8434-4d35-9a21-ba37acd61849 service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:14.737864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:14.752254 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 748/1505] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:48:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:48:14.801179 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a4b6b-6716-412b-83d2-4a4563e2de8f None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:14.801494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a4b6b-6716-412b-83d2-4a4563e2de8f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:14.801768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a4b6b-6716-412b-83d2-4a4563e2de8f None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:14.803041 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 758/1506] 10.222.0.33 () {52 vars in 830 bytes} [Sat Aug 6 20:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:48:14.806724 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f08d6-8434-4d35-9a21-ba37acd61849 service cinder] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:14.807955 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-099f08d6-8434-4d35-9a21-ba37acd61849 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:14.907214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f08d6-8434-4d35-9a21-ba37acd61849 service cinder] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:14.999989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfecba7-fb08-4d6c-97db-f4b87f1a9bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:15.000561 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfecba7-fb08-4d6c-97db-f4b87f1a9bbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:15.000798 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfecba7-fb08-4d6c-97db-f4b87f1a9bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:15.001063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfecba7-fb08-4d6c-97db-f4b87f1a9bbb admin admin] PATH_INFO: `/v3/users/f9721caa63324a0ab809adf7cb999ec7` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:15.012808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfecba7-fb08-4d6c-97db-f4b87f1a9bbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9721caa63324a0ab809adf7cb999ec7)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:15.013818 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-4bfecba7-fb08-4d6c-97db-f4b87f1a9bbb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:48:15.013818 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 20:48:15.013818 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 20:48:15.015594 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfecba7-fb08-4d6c-97db-f4b87f1a9bbb admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:15.024925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:15.080707 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4bfecba7-fb08-4d6c-97db-f4b87f1a9bbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9721caa63324a0ab809adf7cb999ec7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:15.081146 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4bfecba7-fb08-4d6c-97db-f4b87f1a9bbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9721caa63324a0ab809adf7cb999ec7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:15.081666 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4bfecba7-fb08-4d6c-97db-f4b87f1a9bbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9721caa63324a0ab809adf7cb999ec7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:15.091238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4bfecba7-fb08-4d6c-97db-f4b87f1a9bbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9721caa63324a0ab809adf7cb999ec7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:15.115469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4bfecba7-fb08-4d6c-97db-f4b87f1a9bbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9721caa63324a0ab809adf7cb999ec7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:15.135870 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 749/1507] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:48:14 2022] DELETE /identity/v3/users/f9721caa63324a0ab809adf7cb999ec7 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:48:15.141218 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c297367-3d52-4d1f-8602-0b4298fcda63 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:15.141700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c297367-3d52-4d1f-8602-0b4298fcda63 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:15.141807 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c297367-3d52-4d1f-8602-0b4298fcda63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:15.199031 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-2c297367-3d52-4d1f-8602-0b4298fcda63 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:15.200254 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2c297367-3d52-4d1f-8602-0b4298fcda63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:15.274525 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:15.288083 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 759/1508] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:15.298736 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfecba7-fb08-4d6c-97db-f4b87f1a9bbb admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:15.300002 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4bfecba7-fb08-4d6c-97db-f4b87f1a9bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:15.411622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfecba7-fb08-4d6c-97db-f4b87f1a9bbb admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:15.466173 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:15.486863 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979115c-3516-449b-8bb4-4445a7a09ac5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:15.487485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979115c-3516-449b-8bb4-4445a7a09ac5 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:15.487765 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979115c-3516-449b-8bb4-4445a7a09ac5 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:15.488036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979115c-3516-449b-8bb4-4445a7a09ac5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:15.489619 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7979115c-3516-449b-8bb4-4445a7a09ac5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:15.603306 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979115c-3516-449b-8bb4-4445a7a09ac5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:15.604651 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979115c-3516-449b-8bb4-4445a7a09ac5 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:15.623411 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 750/1509] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:48:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:48:15.992330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c297367-3d52-4d1f-8602-0b4298fcda63 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:15.993566 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2c297367-3d52-4d1f-8602-0b4298fcda63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:16.005581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c297367-3d52-4d1f-8602-0b4298fcda63 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:16.103857 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6dfa2d-e839-4be5-87e7-cd52eb080855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:16.104483 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6dfa2d-e839-4be5-87e7-cd52eb080855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:16.104762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6dfa2d-e839-4be5-87e7-cd52eb080855 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:16.105034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6dfa2d-e839-4be5-87e7-cd52eb080855 admin admin] PATH_INFO: `/v3/projects/d91cee89a1f746a29d952f7b343a0bf3` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:16.114992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6dfa2d-e839-4be5-87e7-cd52eb080855 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d91cee89a1f746a29d952f7b343a0bf3)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:16.116008 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-0e6dfa2d-e839-4be5-87e7-cd52eb080855 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:48:16.116008 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 20:48:16.116008 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 20:48:16.117244 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6dfa2d-e839-4be5-87e7-cd52eb080855 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:16.173541 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0e6dfa2d-e839-4be5-87e7-cd52eb080855 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd91cee89a1f746a29d952f7b343a0bf3', 'request_id': 'req-0e6dfa2d-e839-4be5-87e7-cd52eb080855'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:16.179350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0e6dfa2d-e839-4be5-87e7-cd52eb080855 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd91cee89a1f746a29d952f7b343a0bf3', 'request_id': 'req-0e6dfa2d-e839-4be5-87e7-cd52eb080855'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:16.189564 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0e6dfa2d-e839-4be5-87e7-cd52eb080855 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd91cee89a1f746a29d952f7b343a0bf3', 'request_id': 'req-0e6dfa2d-e839-4be5-87e7-cd52eb080855'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:16.219649 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0e6dfa2d-e839-4be5-87e7-cd52eb080855 admin admin] The token cache is being invalidate because project d91cee89a1f746a29d952f7b343a0bf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:48:16.219938 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0e6dfa2d-e839-4be5-87e7-cd52eb080855 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:16.220369 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0e6dfa2d-e839-4be5-87e7-cd52eb080855 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:16.221774 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 760/1510] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:48:15 2022] DELETE /identity/v3/projects/d91cee89a1f746a29d952f7b343a0bf3 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:48:25.621029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=62 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:26.217437 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:51:23.105658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3597c3e-8777-4e3f-a8df-569706427771 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:51:23.106156 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3597c3e-8777-4e3f-a8df-569706427771 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:51:23.106258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3597c3e-8777-4e3f-a8df-569706427771 None None] PATH_INFO: `/v3` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:51:23.107636 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 751/1511] 10.222.0.23 () {54 vars in 925 bytes} [Sat Aug 6 20:51:23 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:51:23.113641 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19405fe-4da6-4648-b5b4-ceed50e40c69 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:51:23.114091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19405fe-4da6-4648-b5b4-ceed50e40c69 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:51:23.114195 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19405fe-4da6-4648-b5b4-ceed50e40c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:51:23.196208 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-c19405fe-4da6-4648-b5b4-ceed50e40c69 None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:51:23.197440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c19405fe-4da6-4648-b5b4-ceed50e40c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:51:23.310932 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 761/1512] 10.222.0.23 () {58 vars in 1015 bytes} [Sat Aug 6 20:51:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:51:23.889566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822ca96-ba43-4d2e-9cef-d009a3b25c45 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:51:23.889958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822ca96-ba43-4d2e-9cef-d009a3b25c45 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:51:23.890233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822ca96-ba43-4d2e-9cef-d009a3b25c45 None None] PATH_INFO: `/v3` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:51:23.891647 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 752/1513] 10.222.0.40 () {54 vars in 925 bytes} [Sat Aug 6 20:51:23 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:51:23.898703 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae2e93-fab2-45c8-b081-7c3993b4bf7d None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:51:23.898996 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae2e93-fab2-45c8-b081-7c3993b4bf7d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:51:23.899277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae2e93-fab2-45c8-b081-7c3993b4bf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:51:23.918972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-2bae2e93-fab2-45c8-b081-7c3993b4bf7d None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:51:23.920217 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2bae2e93-fab2-45c8-b081-7c3993b4bf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:51:23.929548 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 762/1514] 10.222.0.40 () {58 vars in 1015 bytes} [Sat Aug 6 20:51:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:51:27.196264 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569bdd7-394b-474b-9356-48d4e617ced1 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:51:27.196785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569bdd7-394b-474b-9356-48d4e617ced1 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:51:27.196908 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569bdd7-394b-474b-9356-48d4e617ced1 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:51:27.198171 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 753/1515] 10.222.0.33 () {54 vars in 961 bytes} [Sat Aug 6 20:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:51:27.203248 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78801e-cfde-4c59-a258-9e384846d45d None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:51:27.204232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78801e-cfde-4c59-a258-9e384846d45d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:51:27.204488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78801e-cfde-4c59-a258-9e384846d45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:51:27.224011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-0d78801e-cfde-4c59-a258-9e384846d45d None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:51:27.225203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0d78801e-cfde-4c59-a258-9e384846d45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:51:27.233610 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 763/1516] 10.222.0.33 () {58 vars in 1058 bytes} [Sat Aug 6 20:51:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:51:27.242240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569bdd7-394b-474b-9356-48d4e617ced1 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:51:27.256771 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569bdd7-394b-474b-9356-48d4e617ced1 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:51:27.262228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566e20f-7be4-47a2-be03-316c1a6f5f5d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:51:27.263115 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566e20f-7be4-47a2-be03-316c1a6f5f5d service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:51:27.263606 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566e20f-7be4-47a2-be03-316c1a6f5f5d service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:51:27.264074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566e20f-7be4-47a2-be03-316c1a6f5f5d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:51:27.273879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566e20f-7be4-47a2-be03-316c1a6f5f5d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:51:27.275556 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566e20f-7be4-47a2-be03-316c1a6f5f5d service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:51:27.286008 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 754/1517] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:51:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:51:27.388501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d78801e-cfde-4c59-a258-9e384846d45d None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:51:27.399168 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d78801e-cfde-4c59-a258-9e384846d45d None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:51:27.404457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c830c97-3579-4634-a0f9-252a9e059118 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:51:27.405062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c830c97-3579-4634-a0f9-252a9e059118 service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:51:27.405388 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c830c97-3579-4634-a0f9-252a9e059118 service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:51:27.405611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c830c97-3579-4634-a0f9-252a9e059118 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:51:27.415006 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c830c97-3579-4634-a0f9-252a9e059118 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:51:27.416582 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c830c97-3579-4634-a0f9-252a9e059118 service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:51:27.426593 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 764/1518] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:51:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:51:37.281238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:51:37.422284 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=86 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:52:03.986358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadf45c-97aa-481d-adb7-c71b029b4449 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:03.986987 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadf45c-97aa-481d-adb7-c71b029b4449 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:03.986987 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadf45c-97aa-481d-adb7-c71b029b4449 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:03.988264 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 755/1519] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 20:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:52:03.993478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb918ac-b439-4181-bf40-83af0abab75d None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:03.993874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb918ac-b439-4181-bf40-83af0abab75d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:03.994017 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb918ac-b439-4181-bf40-83af0abab75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:04.051846 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-9cb918ac-b439-4181-bf40-83af0abab75d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:52:04.053041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9cb918ac-b439-4181-bf40-83af0abab75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:52:04.130077 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 765/1520] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 20:52:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:52:04.295379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeadf45c-97aa-481d-adb7-c71b029b4449 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:52:04.297165 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-aeadf45c-97aa-481d-adb7-c71b029b4449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:52:04.400188 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeadf45c-97aa-481d-adb7-c71b029b4449 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:52:04.405614 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4021e9-7abd-40a0-b812-63910761308a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:52:04.406206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4021e9-7abd-40a0-b812-63910761308a service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:04.406483 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4021e9-7abd-40a0-b812-63910761308a service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:04.406788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4021e9-7abd-40a0-b812-63910761308a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:04.415143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4021e9-7abd-40a0-b812-63910761308a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:52:04.416706 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4021e9-7abd-40a0-b812-63910761308a service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:52:04.425927 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 756/1521] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:52:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:52:05.273956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd47535-e07c-4cb9-9060-85be4e8b5d88 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:05.274489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd47535-e07c-4cb9-9060-85be4e8b5d88 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:05.274489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd47535-e07c-4cb9-9060-85be4e8b5d88 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:05.275908 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 766/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 20:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:52:05.280795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a33de-05b1-4fb2-ab93-b367fdd88a61 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:05.281232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a33de-05b1-4fb2-ab93-b367fdd88a61 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:05.281343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a33de-05b1-4fb2-ab93-b367fdd88a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:05.300991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-cc0a33de-05b1-4fb2-ab93-b367fdd88a61 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:52:05.302286 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-cc0a33de-05b1-4fb2-ab93-b367fdd88a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:52:05.310294 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 757/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 20:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:52:05.473669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd47535-e07c-4cb9-9060-85be4e8b5d88 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:52:05.487674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd47535-e07c-4cb9-9060-85be4e8b5d88 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:52:05.493991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee88f9-2973-43f4-8ec9-b8ff9d25893e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:52:05.494598 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee88f9-2973-43f4-8ec9-b8ff9d25893e service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:05.494878 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee88f9-2973-43f4-8ec9-b8ff9d25893e service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:05.495148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee88f9-2973-43f4-8ec9-b8ff9d25893e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:05.503333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee88f9-2973-43f4-8ec9-b8ff9d25893e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:52:05.505625 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee88f9-2973-43f4-8ec9-b8ff9d25893e service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:52:05.514941 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 767/1524] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:52:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:52:09.393020 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1760bce-4d06-4c33-b52f-dc1f9eefb42c None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:09.393672 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1760bce-4d06-4c33-b52f-dc1f9eefb42c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:09.393672 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1760bce-4d06-4c33-b52f-dc1f9eefb42c None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:09.395006 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 758/1525] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:52:09.400333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8ff58-090b-43fe-b9a2-05bea34be933 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:09.400763 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8ff58-090b-43fe-b9a2-05bea34be933 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:09.400889 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8ff58-090b-43fe-b9a2-05bea34be933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:09.421019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-29b8ff58-090b-43fe-b9a2-05bea34be933 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:52:09.422270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-29b8ff58-090b-43fe-b9a2-05bea34be933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:52:09.432196 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 768/1526] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:52:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:52:09.470041 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1760bce-4d06-4c33-b52f-dc1f9eefb42c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:52:09.471813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c1760bce-4d06-4c33-b52f-dc1f9eefb42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:52:09.554673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1760bce-4d06-4c33-b52f-dc1f9eefb42c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:52:09.558177 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a75ba-97f8-46cb-878e-b4446252bac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:52:09.558803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a75ba-97f8-46cb-878e-b4446252bac4 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:09.559076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a75ba-97f8-46cb-878e-b4446252bac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:09.559344 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a75ba-97f8-46cb-878e-b4446252bac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:09.568036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a75ba-97f8-46cb-878e-b4446252bac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:52:09.569450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a75ba-97f8-46cb-878e-b4446252bac4 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:52:09.578917 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 759/1527] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:52:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:52:11.853070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae765303-eaa5-40b5-8a1f-c317c1d99a24 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:11.853575 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae765303-eaa5-40b5-8a1f-c317c1d99a24 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:11.853697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae765303-eaa5-40b5-8a1f-c317c1d99a24 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:11.854975 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 769/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:52:11.860276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29e060-2239-459f-b729-612ed52fb8c4 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:11.860706 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29e060-2239-459f-b729-612ed52fb8c4 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:11.860834 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29e060-2239-459f-b729-612ed52fb8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:11.880867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-cc29e060-2239-459f-b729-612ed52fb8c4 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:52:11.882062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-cc29e060-2239-459f-b729-612ed52fb8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:52:11.889861 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 760/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:52:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:52:11.928885 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae765303-eaa5-40b5-8a1f-c317c1d99a24 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:52:11.930513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ae765303-eaa5-40b5-8a1f-c317c1d99a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:52:11.943666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae765303-eaa5-40b5-8a1f-c317c1d99a24 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:52:11.947146 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4640f03-21a9-45df-96cd-b0346d022d7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:52:11.947760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4640f03-21a9-45df-96cd-b0346d022d7e service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:11.948038 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4640f03-21a9-45df-96cd-b0346d022d7e service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:11.948304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4640f03-21a9-45df-96cd-b0346d022d7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:11.957543 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4640f03-21a9-45df-96cd-b0346d022d7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:52:11.959120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4640f03-21a9-45df-96cd-b0346d022d7e service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:52:11.968556 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 770/1530] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:52:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:52:21.875970 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=87 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:52:21.964332 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=65 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:04.299994 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ec56d-cfda-49a1-ae51-6763a536e318 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:04.300509 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ec56d-cfda-49a1-ae51-6763a536e318 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:04.300690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ec56d-cfda-49a1-ae51-6763a536e318 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:04.303061 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 761/1531] 10.222.0.33 () {54 vars in 921 bytes} [Sat Aug 6 20:53:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:53:04.308187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ac8a2-9560-4e8d-8b4a-576ed3c9377e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:04.308614 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ac8a2-9560-4e8d-8b4a-576ed3c9377e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:04.308748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ac8a2-9560-4e8d-8b4a-576ed3c9377e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:04.328285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-4d0ac8a2-9560-4e8d-8b4a-576ed3c9377e None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:04.329459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4d0ac8a2-9560-4e8d-8b4a-576ed3c9377e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:04.337990 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 771/1532] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 20:53:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:53:14.323579 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:37.930600 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a7a89-2985-42de-9c4d-af18b35d0e45 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:37.931124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a7a89-2985-42de-9c4d-af18b35d0e45 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:37.931124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a7a89-2985-42de-9c4d-af18b35d0e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:37.935372 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c1fc0-aaa4-4830-91a1-3dd05674cb0e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:37.935896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c1fc0-aaa4-4830-91a1-3dd05674cb0e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:37.935896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c1fc0-aaa4-4830-91a1-3dd05674cb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:37.953533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-bc2a7a89-2985-42de-9c4d-af18b35d0e45 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:37.959017 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-bc2a7a89-2985-42de-9c4d-af18b35d0e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:37.964393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-c28c1fc0-aaa4-4830-91a1-3dd05674cb0e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:37.965935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c28c1fc0-aaa4-4830-91a1-3dd05674cb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:37.970171 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 762/1533] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:37.973762 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cdeb0-b302-41e6-a604-730b27e0d56f None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:37.974114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cdeb0-b302-41e6-a604-730b27e0d56f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:37.974564 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cdeb0-b302-41e6-a604-730b27e0d56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:37.984543 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 772/1534] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:37.986663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df51e2-3f35-4787-8768-2f9650bc9300 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:37.987185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df51e2-3f35-4787-8768-2f9650bc9300 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:37.987643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df51e2-3f35-4787-8768-2f9650bc9300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:38.007623 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-388cdeb0-b302-41e6-a604-730b27e0d56f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:38.008822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-388cdeb0-b302-41e6-a604-730b27e0d56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:38.025766 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 763/1535] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:38.027203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc867fd7-7ad4-4115-835c-c65556f1fa52 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:38.027495 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc867fd7-7ad4-4115-835c-c65556f1fa52 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:38.027897 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc867fd7-7ad4-4115-835c-c65556f1fa52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:38.038274 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-38df51e2-3f35-4787-8768-2f9650bc9300 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:38.038274 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-38df51e2-3f35-4787-8768-2f9650bc9300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:38.061003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-fc867fd7-7ad4-4115-835c-c65556f1fa52 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:38.062433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-fc867fd7-7ad4-4115-835c-c65556f1fa52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:38.065863 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 773/1536] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:38.067319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74694065-cca8-4184-b14b-2eddae03ff5f None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:38.067604 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74694065-cca8-4184-b14b-2eddae03ff5f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:38.067878 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74694065-cca8-4184-b14b-2eddae03ff5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:38.081029 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 764/1537] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:38.082076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc867fd7-7ad4-4115-835c-c65556f1fa52 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:38.092947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc867fd7-7ad4-4115-835c-c65556f1fa52 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:38.108514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9dc057-9d15-4d3a-a3e7-b74b2f69688d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:38.109486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9dc057-9d15-4d3a-a3e7-b74b2f69688d admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:38.109770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9dc057-9d15-4d3a-a3e7-b74b2f69688d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:38.110042 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9dc057-9d15-4d3a-a3e7-b74b2f69688d admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:38.112461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9dc057-9d15-4d3a-a3e7-b74b2f69688d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:53:38.112767 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9dc057-9d15-4d3a-a3e7-b74b2f69688d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:38.113942 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-db9dc057-9d15-4d3a-a3e7-b74b2f69688d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:38.113942 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 20:53:38.113942 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 20:53:38.114873 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9dc057-9d15-4d3a-a3e7-b74b2f69688d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:38.119676 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-74694065-cca8-4184-b14b-2eddae03ff5f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:38.120929 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-74694065-cca8-4184-b14b-2eddae03ff5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:38.139295 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 765/1538] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:53:38.140453 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9dc057-9d15-4d3a-a3e7-b74b2f69688d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:38.152325 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9dc057-9d15-4d3a-a3e7-b74b2f69688d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:38.163210 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e3f02-9585-45f9-8c1f-dc48c90f6778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:38.163933 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e3f02-9585-45f9-8c1f-dc48c90f6778 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:38.164221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e3f02-9585-45f9-8c1f-dc48c90f6778 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:38.165147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e3f02-9585-45f9-8c1f-dc48c90f6778 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:38.165837 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e3f02-9585-45f9-8c1f-dc48c90f6778 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:53:38.166138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e3f02-9585-45f9-8c1f-dc48c90f6778 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:38.168104 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 774/1539] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:38.169011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74694065-cca8-4184-b14b-2eddae03ff5f None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:38.169821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e3f02-9585-45f9-8c1f-dc48c90f6778 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:38.180286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74694065-cca8-4184-b14b-2eddae03ff5f None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:38.188420 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 766/1540] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:53:38.189399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e3f02-9585-45f9-8c1f-dc48c90f6778 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:38.209284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e3f02-9585-45f9-8c1f-dc48c90f6778 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:38.211398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326eae44-7d96-4ff2-a064-c5ed685a513c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:38.212046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326eae44-7d96-4ff2-a064-c5ed685a513c admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:38.212330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326eae44-7d96-4ff2-a064-c5ed685a513c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:38.212606 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326eae44-7d96-4ff2-a064-c5ed685a513c admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:38.213251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326eae44-7d96-4ff2-a064-c5ed685a513c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:38.214287 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-326eae44-7d96-4ff2-a064-c5ed685a513c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:38.214287 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 20:53:38.214287 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 20:53:38.215691 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326eae44-7d96-4ff2-a064-c5ed685a513c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:38.224704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21653580-f891-4e42-a8c8-618175c9eb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:38.225687 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21653580-f891-4e42-a8c8-618175c9eb17 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:38.226138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21653580-f891-4e42-a8c8-618175c9eb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:38.226658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21653580-f891-4e42-a8c8-618175c9eb17 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:38.227429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21653580-f891-4e42-a8c8-618175c9eb17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:53:38.227745 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21653580-f891-4e42-a8c8-618175c9eb17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:38.229426 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21653580-f891-4e42-a8c8-618175c9eb17 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:38.244898 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 767/1541] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:53:38.253089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21653580-f891-4e42-a8c8-618175c9eb17 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:38.269058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21653580-f891-4e42-a8c8-618175c9eb17 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:38.280243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de195254-79a7-4295-963c-00cba2a5a5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:38.280905 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de195254-79a7-4295-963c-00cba2a5a5f3 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:38.281198 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de195254-79a7-4295-963c-00cba2a5a5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:38.281467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de195254-79a7-4295-963c-00cba2a5a5f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:38.282607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de195254-79a7-4295-963c-00cba2a5a5f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:38.285275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de195254-79a7-4295-963c-00cba2a5a5f3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:38.313461 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 775/1542] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:53:38 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:38.314913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326eae44-7d96-4ff2-a064-c5ed685a513c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:38.342411 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 768/1543] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:53:38 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:38.354404 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de195254-79a7-4295-963c-00cba2a5a5f3 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:38.429704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326eae44-7d96-4ff2-a064-c5ed685a513c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:38.502661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de195254-79a7-4295-963c-00cba2a5a5f3 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:38.515168 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302ffe7-bbfd-4ccf-9d64-4ce09f791eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:38.515797 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302ffe7-bbfd-4ccf-9d64-4ce09f791eb0 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:38.516112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302ffe7-bbfd-4ccf-9d64-4ce09f791eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:38.516700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302ffe7-bbfd-4ccf-9d64-4ce09f791eb0 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:38.517819 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302ffe7-bbfd-4ccf-9d64-4ce09f791eb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:38.519282 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-c302ffe7-bbfd-4ccf-9d64-4ce09f791eb0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:38.519282 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 20:53:38.519282 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 20:53:38.520469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302ffe7-bbfd-4ccf-9d64-4ce09f791eb0 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:38.523479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43fae04-fca8-467b-b4d6-01fd5a0b923f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:38.524100 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fae04-fca8-467b-b4d6-01fd5a0b923f admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:38.524380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fae04-fca8-467b-b4d6-01fd5a0b923f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:38.524650 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fae04-fca8-467b-b4d6-01fd5a0b923f admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:38.525271 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43fae04-fca8-467b-b4d6-01fd5a0b923f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:38.527278 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43fae04-fca8-467b-b4d6-01fd5a0b923f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:38.544382 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 769/1544] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:53:38 2022] POST /identity/v3/users => generated 291 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:38.545821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302ffe7-bbfd-4ccf-9d64-4ce09f791eb0 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:38.557474 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 776/1545] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:53:38 2022] POST /identity/v3/projects => generated 397 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:38.557788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302ffe7-bbfd-4ccf-9d64-4ce09f791eb0 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:38.559404 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6bf4a-6eab-42d5-a4c6-f82319ec442e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:38.559883 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6bf4a-6eab-42d5-a4c6-f82319ec442e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:38.560323 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6bf4a-6eab-42d5-a4c6-f82319ec442e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:38.581956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-afe6bf4a-6eab-42d5-a4c6-f82319ec442e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:38.583184 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-afe6bf4a-6eab-42d5-a4c6-f82319ec442e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:38.623327 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:38.628890 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392cb992-c033-4b14-987f-884287237190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:38.629505 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392cb992-c033-4b14-987f-884287237190 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:38.629927 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392cb992-c033-4b14-987f-884287237190 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:38.630211 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392cb992-c033-4b14-987f-884287237190 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:38.631529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392cb992-c033-4b14-987f-884287237190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:38.635398 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392cb992-c033-4b14-987f-884287237190 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:38.648030 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 777/1546] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:38.649634 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ec0b7-ff47-4917-8941-fc6af83bb018 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:38.649923 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ec0b7-ff47-4917-8941-fc6af83bb018 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:38.650253 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ec0b7-ff47-4917-8941-fc6af83bb018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:38.660025 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:38.669788 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 770/1547] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:53:38 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:38.670179 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-4c7ec0b7-ff47-4917-8941-fc6af83bb018 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:38.671425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4c7ec0b7-ff47-4917-8941-fc6af83bb018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:38.672986 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6633112-e9b8-4d2b-a9ce-36ff86e8aa09 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:38.674029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6633112-e9b8-4d2b-a9ce-36ff86e8aa09 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:38.674029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6633112-e9b8-4d2b-a9ce-36ff86e8aa09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:38.681052 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 778/1548] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:38.682256 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125c534-b752-4f14-8d33-de5d3ee167e2 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:38.682570 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125c534-b752-4f14-8d33-de5d3ee167e2 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:38.682837 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125c534-b752-4f14-8d33-de5d3ee167e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:38.694639 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-b6633112-e9b8-4d2b-a9ce-36ff86e8aa09 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:38.695853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b6633112-e9b8-4d2b-a9ce-36ff86e8aa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:38.703774 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 771/1549] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:38.705614 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e137c0-0c31-4de5-9022-8b5dbc1969a7 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:38.705889 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e137c0-0c31-4de5-9022-8b5dbc1969a7 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:38.706161 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e137c0-0c31-4de5-9022-8b5dbc1969a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:38.708106 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-6125c534-b752-4f14-8d33-de5d3ee167e2 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:38.709298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6125c534-b752-4f14-8d33-de5d3ee167e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:38.717536 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 779/1550] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:38.718433 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6125c534-b752-4f14-8d33-de5d3ee167e2 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:38.725590 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-92e137c0-0c31-4de5-9022-8b5dbc1969a7 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:38.726791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-92e137c0-0c31-4de5-9022-8b5dbc1969a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:38.733728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6125c534-b752-4f14-8d33-de5d3ee167e2 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:38.738023 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 772/1551] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:38.738848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e137c0-0c31-4de5-9022-8b5dbc1969a7 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:38.739988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a557f66-bfca-48c8-9b0e-a9154f57f5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:38.740596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a557f66-bfca-48c8-9b0e-a9154f57f5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:38.740877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a557f66-bfca-48c8-9b0e-a9154f57f5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:38.741148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a557f66-bfca-48c8-9b0e-a9154f57f5c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:38.741798 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a557f66-bfca-48c8-9b0e-a9154f57f5c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:38.743577 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a557f66-bfca-48c8-9b0e-a9154f57f5c4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:38.751751 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e137c0-0c31-4de5-9022-8b5dbc1969a7 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:38.754489 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 780/1552] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:38.755697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082925fe-13ce-4b86-8a08-6b63e0d2507d None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:38.755983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082925fe-13ce-4b86-8a08-6b63e0d2507d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:38.756259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082925fe-13ce-4b86-8a08-6b63e0d2507d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:38.756695 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beef24e-7660-4fdb-a5c5-e0acae657204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:38.757367 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beef24e-7660-4fdb-a5c5-e0acae657204 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:38.757558 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beef24e-7660-4fdb-a5c5-e0acae657204 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:38.757825 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beef24e-7660-4fdb-a5c5-e0acae657204 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:38.758429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beef24e-7660-4fdb-a5c5-e0acae657204 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:38.760370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beef24e-7660-4fdb-a5c5-e0acae657204 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:38.775056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-082925fe-13ce-4b86-8a08-6b63e0d2507d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:38.776251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-082925fe-13ce-4b86-8a08-6b63e0d2507d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:38.780933 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 773/1553] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:53:38 2022] POST /identity/v3/users => generated 299 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:38.781742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beef24e-7660-4fdb-a5c5-e0acae657204 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:38.785266 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 781/1554] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:38.786499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467dead-3ce9-4b6f-8eca-6eea317e90bb None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:38.786825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467dead-3ce9-4b6f-8eca-6eea317e90bb None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:38.787265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467dead-3ce9-4b6f-8eca-6eea317e90bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:38.794087 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beef24e-7660-4fdb-a5c5-e0acae657204 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:38.799549 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518bd085-e572-4013-830e-69831d22b6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:38.800236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518bd085-e572-4013-830e-69831d22b6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:38.800777 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518bd085-e572-4013-830e-69831d22b6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:38.801050 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518bd085-e572-4013-830e-69831d22b6d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:38.801687 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518bd085-e572-4013-830e-69831d22b6d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:38.803310 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518bd085-e572-4013-830e-69831d22b6d5 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:38.807184 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-7467dead-3ce9-4b6f-8eca-6eea317e90bb None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:38.808387 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7467dead-3ce9-4b6f-8eca-6eea317e90bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:38.813940 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 774/1555] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:38.815332 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da202c-6b41-463c-90ad-558e2a94339a None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:38.815622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da202c-6b41-463c-90ad-558e2a94339a None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:38.815898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da202c-6b41-463c-90ad-558e2a94339a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:38.818507 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 782/1556] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:38.819730 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb97a3b-7a36-4700-bee2-9c6bab3c6c40 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:38.820007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb97a3b-7a36-4700-bee2-9c6bab3c6c40 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:38.820287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb97a3b-7a36-4700-bee2-9c6bab3c6c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:38.834945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-93da202c-6b41-463c-90ad-558e2a94339a None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:38.836061 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-93da202c-6b41-463c-90ad-558e2a94339a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:38.839198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-4eb97a3b-7a36-4700-bee2-9c6bab3c6c40 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:38.840356 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4eb97a3b-7a36-4700-bee2-9c6bab3c6c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:38.844126 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 775/1557] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:38.845975 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26118e9-edc6-4af8-ace0-1837898dd3f5 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:38.846340 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26118e9-edc6-4af8-ace0-1837898dd3f5 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:38.846648 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26118e9-edc6-4af8-ace0-1837898dd3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:38.849456 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 783/1558] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:38.851501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb97a3b-7a36-4700-bee2-9c6bab3c6c40 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:38.861603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb97a3b-7a36-4700-bee2-9c6bab3c6c40 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:38.866073 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d26118e9-edc6-4af8-ace0-1837898dd3f5 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:38.866477 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2182c3-4ade-4d08-923a-ab164ff5ff03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:38.867099 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2182c3-4ade-4d08-923a-ab164ff5ff03 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:38.867385 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2182c3-4ade-4d08-923a-ab164ff5ff03 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:38.867483 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d26118e9-edc6-4af8-ace0-1837898dd3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:38.867656 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2182c3-4ade-4d08-923a-ab164ff5ff03 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:38.868290 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2182c3-4ade-4d08-923a-ab164ff5ff03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:38.869885 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2182c3-4ade-4d08-923a-ab164ff5ff03 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:38.875510 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 776/1559] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:38.876284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26118e9-edc6-4af8-ace0-1837898dd3f5 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:38.880444 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 784/1560] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:38.881214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2182c3-4ade-4d08-923a-ab164ff5ff03 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:38.886339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26118e9-edc6-4af8-ace0-1837898dd3f5 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:38.890692 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2182c3-4ade-4d08-923a-ab164ff5ff03 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:38.891126 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a6abe-9bc1-4dce-a228-dafa47eeed0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:38.891715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a6abe-9bc1-4dce-a228-dafa47eeed0c admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:38.891992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a6abe-9bc1-4dce-a228-dafa47eeed0c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:38.892319 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a6abe-9bc1-4dce-a228-dafa47eeed0c admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:38.893157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a6abe-9bc1-4dce-a228-dafa47eeed0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:38.894769 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a6abe-9bc1-4dce-a228-dafa47eeed0c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:38.895914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f527c9-1726-4a5b-8874-b46d077b11ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:38.896747 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f527c9-1726-4a5b-8874-b46d077b11ee admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:38.897171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f527c9-1726-4a5b-8874-b46d077b11ee admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:38.897438 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f527c9-1726-4a5b-8874-b46d077b11ee admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:38.898065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f527c9-1726-4a5b-8874-b46d077b11ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:53:38.898365 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f527c9-1726-4a5b-8874-b46d077b11ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:38.899960 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f527c9-1726-4a5b-8874-b46d077b11ee admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:38.905036 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 777/1561] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:38.905836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a6abe-9bc1-4dce-a228-dafa47eeed0c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:38.915883 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 785/1562] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:53:38.916678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a6abe-9bc1-4dce-a228-dafa47eeed0c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:38.916777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f527c9-1726-4a5b-8874-b46d077b11ee admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:38.921253 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9f22b-bd13-464b-9f03-429c8cf40221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:38.921840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9f22b-bd13-464b-9f03-429c8cf40221 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:38.922125 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9f22b-bd13-464b-9f03-429c8cf40221 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:38.922398 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9f22b-bd13-464b-9f03-429c8cf40221 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:38.923064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f9f22b-bd13-464b-9f03-429c8cf40221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:38.925222 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f9f22b-bd13-464b-9f03-429c8cf40221 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:38.932809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f527c9-1726-4a5b-8874-b46d077b11ee admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:38.938946 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 778/1563] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:38.938946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9f22b-bd13-464b-9f03-429c8cf40221 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:38.939913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24bea3-64d3-4439-a953-28f468d9656a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:38.939913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24bea3-64d3-4439-a953-28f468d9656a admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:38.939913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24bea3-64d3-4439-a953-28f468d9656a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:38.939913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24bea3-64d3-4439-a953-28f468d9656a admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:38.940500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b24bea3-64d3-4439-a953-28f468d9656a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:53:38.940500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b24bea3-64d3-4439-a953-28f468d9656a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:38.941602 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b24bea3-64d3-4439-a953-28f468d9656a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:38.945988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9f22b-bd13-464b-9f03-429c8cf40221 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:38.950651 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749d399-d676-4837-bbe5-dfb8d346543b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:38.951226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749d399-d676-4837-bbe5-dfb8d346543b admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:38.951501 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749d399-d676-4837-bbe5-dfb8d346543b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:38.951770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749d399-d676-4837-bbe5-dfb8d346543b admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:38.952395 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749d399-d676-4837-bbe5-dfb8d346543b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:53:38.952694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749d399-d676-4837-bbe5-dfb8d346543b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:38.958708 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 786/1564] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:53:38.958708 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24bea3-64d3-4439-a953-28f468d9656a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:38.958898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749d399-d676-4837-bbe5-dfb8d346543b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:38.967177 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 779/1565] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:53:38.967859 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749d399-d676-4837-bbe5-dfb8d346543b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:38.968113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24bea3-64d3-4439-a953-28f468d9656a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:38.976185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2bc0b-bc82-460f-bbbd-09667df40170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:38.976776 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2bc0b-bc82-460f-bbbd-09667df40170 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:38.977189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2bc0b-bc82-460f-bbbd-09667df40170 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:38.977311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2bc0b-bc82-460f-bbbd-09667df40170 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:38.977944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f2bc0b-bc82-460f-bbbd-09667df40170 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:53:38.978244 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f2bc0b-bc82-460f-bbbd-09667df40170 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:38.979914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f2bc0b-bc82-460f-bbbd-09667df40170 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:38.982284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749d399-d676-4837-bbe5-dfb8d346543b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:38.986944 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de854a6f-f353-4fc0-8c40-96ed046c7e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:38.987592 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de854a6f-f353-4fc0-8c40-96ed046c7e39 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:38.987877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de854a6f-f353-4fc0-8c40-96ed046c7e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:38.988151 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de854a6f-f353-4fc0-8c40-96ed046c7e39 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:38.988790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de854a6f-f353-4fc0-8c40-96ed046c7e39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:53:38.989104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de854a6f-f353-4fc0-8c40-96ed046c7e39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:38.990707 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de854a6f-f353-4fc0-8c40-96ed046c7e39 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:38.991959 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 787/1566] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:53:38.992733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2bc0b-bc82-460f-bbbd-09667df40170 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:39.001967 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2bc0b-bc82-460f-bbbd-09667df40170 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:39.006620 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c221a6-7e10-4348-9823-bb6a8aaf10f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:39.014079 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 780/1567] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:53:39.014231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c221a6-7e10-4348-9823-bb6a8aaf10f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:39.014231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c221a6-7e10-4348-9823-bb6a8aaf10f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:39.014231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c221a6-7e10-4348-9823-bb6a8aaf10f6 admin admin] PATH_INFO: `/v3/projects/e95c49afa6f7467fb74adef67a9b4910/users/07d2a43d97f242e5a725eb5e12ba1cc2/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:39.014458 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de854a6f-f353-4fc0-8c40-96ed046c7e39 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:39.017790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de854a6f-f353-4fc0-8c40-96ed046c7e39 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:39.022391 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f0f07-d6fe-4693-87bd-459210f083f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:39.023062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f0f07-d6fe-4693-87bd-459210f083f8 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:39.023342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f0f07-d6fe-4693-87bd-459210f083f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:39.023614 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f0f07-d6fe-4693-87bd-459210f083f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:39.024244 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f0f07-d6fe-4693-87bd-459210f083f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:39.025839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f0f07-d6fe-4693-87bd-459210f083f8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:39.027279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c221a6-7e10-4348-9823-bb6a8aaf10f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e95c49afa6f7467fb74adef67a9b4910, user_id=07d2a43d97f242e5a725eb5e12ba1cc2, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:39.028307 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-92c221a6-7e10-4348-9823-bb6a8aaf10f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:39.028307 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 20:53:39.028307 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 20:53:39.030220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c221a6-7e10-4348-9823-bb6a8aaf10f6 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:39.036921 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 781/1568] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:39.037713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f0f07-d6fe-4693-87bd-459210f083f8 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:39.045986 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 788/1569] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:38 2022] PUT /identity/v3/projects/e95c49afa6f7467fb74adef67a9b4910/users/07d2a43d97f242e5a725eb5e12ba1cc2/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:39.046837 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c221a6-7e10-4348-9823-bb6a8aaf10f6 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:39.052434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f0f07-d6fe-4693-87bd-459210f083f8 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:39.109045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c221a6-7e10-4348-9823-bb6a8aaf10f6 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:39.112367 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24acd4-6ceb-4e83-9b70-ac0865e31d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:39.112984 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24acd4-6ceb-4e83-9b70-ac0865e31d84 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:39.113264 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24acd4-6ceb-4e83-9b70-ac0865e31d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:39.113531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24acd4-6ceb-4e83-9b70-ac0865e31d84 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:39.114171 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24acd4-6ceb-4e83-9b70-ac0865e31d84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:39.114377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c605f86-d84b-410b-a6b4-9e339e937a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:39.115072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c605f86-d84b-410b-a6b4-9e339e937a34 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:39.115353 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c605f86-d84b-410b-a6b4-9e339e937a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:39.115623 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c605f86-d84b-410b-a6b4-9e339e937a34 admin admin] PATH_INFO: `/v3/projects/c7125ce2f8e24dbfb979eb53578320f2/users/51644512697e4f9da16a3f977ea54db9/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:39.116096 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24acd4-6ceb-4e83-9b70-ac0865e31d84 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:39.130804 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c605f86-d84b-410b-a6b4-9e339e937a34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7125ce2f8e24dbfb979eb53578320f2, user_id=51644512697e4f9da16a3f977ea54db9, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:39.133468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c605f86-d84b-410b-a6b4-9e339e937a34 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:39.147400 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 789/1570] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:39 2022] PUT /identity/v3/projects/c7125ce2f8e24dbfb979eb53578320f2/users/51644512697e4f9da16a3f977ea54db9/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:39.148213 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c605f86-d84b-410b-a6b4-9e339e937a34 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:39.159085 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 782/1571] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:53:39 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:39.160047 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24acd4-6ceb-4e83-9b70-ac0865e31d84 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:39.163406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:39.195014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:39.216159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c605f86-d84b-410b-a6b4-9e339e937a34 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:39.227448 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24acd4-6ceb-4e83-9b70-ac0865e31d84 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:39.232032 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1125bee-9c5c-4bd2-af4f-83053623216b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:39.232990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1125bee-9c5c-4bd2-af4f-83053623216b admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:39.232990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1125bee-9c5c-4bd2-af4f-83053623216b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:39.233182 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1125bee-9c5c-4bd2-af4f-83053623216b admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:39.233788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1125bee-9c5c-4bd2-af4f-83053623216b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:39.236432 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1125bee-9c5c-4bd2-af4f-83053623216b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:39.263376 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 783/1572] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:53:39 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:39.264122 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1125bee-9c5c-4bd2-af4f-83053623216b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:39.277834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a859d6a-e0d8-4e8b-a720-445dc0372de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:39.278995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a859d6a-e0d8-4e8b-a720-445dc0372de7 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:39.279323 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a859d6a-e0d8-4e8b-a720-445dc0372de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:39.279594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a859d6a-e0d8-4e8b-a720-445dc0372de7 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:39.280243 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a859d6a-e0d8-4e8b-a720-445dc0372de7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:39.282154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a859d6a-e0d8-4e8b-a720-445dc0372de7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:39.314458 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 790/1573] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:53:39 2022] POST /identity/v3/projects => generated 369 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:39.314458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a859d6a-e0d8-4e8b-a720-445dc0372de7 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:39.328290 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1125bee-9c5c-4bd2-af4f-83053623216b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:39.375604 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a859d6a-e0d8-4e8b-a720-445dc0372de7 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:39.380433 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a81541-8646-4162-9505-94136ea1f58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:39.381038 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a81541-8646-4162-9505-94136ea1f58d admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:39.381318 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a81541-8646-4162-9505-94136ea1f58d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:39.381597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a81541-8646-4162-9505-94136ea1f58d admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:39.382210 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a81541-8646-4162-9505-94136ea1f58d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:39.384283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a81541-8646-4162-9505-94136ea1f58d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:39.385467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea0962-a4d2-4d02-ac71-8232af7030e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:39.386064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea0962-a4d2-4d02-ac71-8232af7030e4 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:39.386340 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea0962-a4d2-4d02-ac71-8232af7030e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:39.386668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea0962-a4d2-4d02-ac71-8232af7030e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:39.387294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea0962-a4d2-4d02-ac71-8232af7030e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:39.389183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea0962-a4d2-4d02-ac71-8232af7030e4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:39.411863 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 791/1574] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:53:39 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:39.411863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a81541-8646-4162-9505-94136ea1f58d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:39.415778 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 784/1575] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:53:39 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:39.417170 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae759d-3b56-4603-8300-ed4db0545507 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:39.417581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae759d-3b56-4603-8300-ed4db0545507 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:39.417860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae759d-3b56-4603-8300-ed4db0545507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:39.441898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:39.448804 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-80ae759d-3b56-4603-8300-ed4db0545507 None None] MFA Rules not processed for user `07d2a43d97f242e5a725eb5e12ba1cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:39.450805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-80ae759d-3b56-4603-8300-ed4db0545507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:39.479606 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a81541-8646-4162-9505-94136ea1f58d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:39.483602 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:39.521021 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 785/1576] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:39.522233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed3380-0104-4def-8f43-e3e769bfcfae None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:39.522529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed3380-0104-4def-8f43-e3e769bfcfae None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:39.522821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed3380-0104-4def-8f43-e3e769bfcfae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:39.545570 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4164c-1531-410a-88b4-d811ed4c88f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:39.546230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4164c-1531-410a-88b4-d811ed4c88f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:39.546506 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4164c-1531-410a-88b4-d811ed4c88f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:39.546809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4164c-1531-410a-88b4-d811ed4c88f6 admin admin] PATH_INFO: `/v3/projects/9378dadc4e7a44d38180c953f18f80bd/users/c2fe3cd1577a42d3907c4d62ddb79833/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:39.551983 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-cfed3380-0104-4def-8f43-e3e769bfcfae None None] MFA Rules not processed for user `51644512697e4f9da16a3f977ea54db9`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:39.553200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-cfed3380-0104-4def-8f43-e3e769bfcfae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:39.563258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a4164c-1531-410a-88b4-d811ed4c88f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9378dadc4e7a44d38180c953f18f80bd, user_id=c2fe3cd1577a42d3907c4d62ddb79833, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:39.566854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a4164c-1531-410a-88b4-d811ed4c88f6 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:39.580423 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 792/1577] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:39 2022] PUT /identity/v3/projects/9378dadc4e7a44d38180c953f18f80bd/users/c2fe3cd1577a42d3907c4d62ddb79833/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:39.581208 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4164c-1531-410a-88b4-d811ed4c88f6 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:39.620717 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 786/1578] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:39.621665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed3380-0104-4def-8f43-e3e769bfcfae None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:39.634741 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed3380-0104-4def-8f43-e3e769bfcfae None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:39.698307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4a5d2-e048-4910-b29e-55a526c85727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:39.698967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4a5d2-e048-4910-b29e-55a526c85727 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:39.699248 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4a5d2-e048-4910-b29e-55a526c85727 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:39.699523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4a5d2-e048-4910-b29e-55a526c85727 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:39.700157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4a5d2-e048-4910-b29e-55a526c85727 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:39.702160 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4a5d2-e048-4910-b29e-55a526c85727 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:39.729000 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 787/1579] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:53:39 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:39.729894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4a5d2-e048-4910-b29e-55a526c85727 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:39.741284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4a5d2-e048-4910-b29e-55a526c85727 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:39.745929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b0fe1-f225-4c14-8305-77194d40326a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:39.746528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b0fe1-f225-4c14-8305-77194d40326a admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:39.746838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b0fe1-f225-4c14-8305-77194d40326a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:39.747106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b0fe1-f225-4c14-8305-77194d40326a admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:39.747718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b0fe1-f225-4c14-8305-77194d40326a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:39.749625 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b0fe1-f225-4c14-8305-77194d40326a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:39.771537 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 788/1580] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:53:39 2022] POST /identity/v3/users => generated 285 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:39.772263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b0fe1-f225-4c14-8305-77194d40326a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:39.777591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4164c-1531-410a-88b4-d811ed4c88f6 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:39.781488 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b0fe1-f225-4c14-8305-77194d40326a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:39.782368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08277a-6f74-4821-aeca-0f73440e89d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:39.783618 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08277a-6f74-4821-aeca-0f73440e89d3 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:39.783890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08277a-6f74-4821-aeca-0f73440e89d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:39.784161 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08277a-6f74-4821-aeca-0f73440e89d3 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:39.784785 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08277a-6f74-4821-aeca-0f73440e89d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:39.786737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08277a-6f74-4821-aeca-0f73440e89d3 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:39.787024 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb215a0d-d6ad-40e7-8ddf-39c067985ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:39.787601 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb215a0d-d6ad-40e7-8ddf-39c067985ad5 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:39.787876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb215a0d-d6ad-40e7-8ddf-39c067985ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:39.788173 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb215a0d-d6ad-40e7-8ddf-39c067985ad5 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:39.788775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb215a0d-d6ad-40e7-8ddf-39c067985ad5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:39.790692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb215a0d-d6ad-40e7-8ddf-39c067985ad5 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:39.809529 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 793/1581] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:53:39 2022] POST /identity/v3/users => generated 287 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:39.810324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08277a-6f74-4821-aeca-0f73440e89d3 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:39.815026 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 789/1582] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:53:39 2022] POST /identity/v3/users => generated 291 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:39.815026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb215a0d-d6ad-40e7-8ddf-39c067985ad5 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:39.819763 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08277a-6f74-4821-aeca-0f73440e89d3 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:39.824190 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb215a0d-d6ad-40e7-8ddf-39c067985ad5 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:39.824316 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a2561-b8ee-4315-b273-c56b88de8735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:39.824853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a2561-b8ee-4315-b273-c56b88de8735 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:39.825130 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a2561-b8ee-4315-b273-c56b88de8735 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:39.825393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a2561-b8ee-4315-b273-c56b88de8735 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:39.825987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a2561-b8ee-4315-b273-c56b88de8735 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:39.827894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a2561-b8ee-4315-b273-c56b88de8735 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:39.828844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2411e9b-94c7-4069-b7a9-348d0bb4b7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:39.829424 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2411e9b-94c7-4069-b7a9-348d0bb4b7d1 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:39.830248 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2411e9b-94c7-4069-b7a9-348d0bb4b7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:39.830522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2411e9b-94c7-4069-b7a9-348d0bb4b7d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:39.831246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2411e9b-94c7-4069-b7a9-348d0bb4b7d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:39.833128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2411e9b-94c7-4069-b7a9-348d0bb4b7d1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:39.853169 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 794/1583] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:53:39 2022] POST /identity/v3/users => generated 292 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:39.854410 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8d2ae-5bc2-47f1-a231-5e194302f61d None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:39.854717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8d2ae-5bc2-47f1-a231-5e194302f61d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:39.854988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8d2ae-5bc2-47f1-a231-5e194302f61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:39.859136 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:39.865603 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 790/1584] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:53:39 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:39.866702 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2411e9b-94c7-4069-b7a9-348d0bb4b7d1 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:39.883895 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-f4e8d2ae-5bc2-47f1-a231-5e194302f61d None None] MFA Rules not processed for user `c2fe3cd1577a42d3907c4d62ddb79833`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:39.885358 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f4e8d2ae-5bc2-47f1-a231-5e194302f61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:39.903430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:39.938478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2411e9b-94c7-4069-b7a9-348d0bb4b7d1 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:39.943892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a626bf1-f147-467f-9371-31880de3ee66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:39.944494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a626bf1-f147-467f-9371-31880de3ee66 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:39.944765 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a626bf1-f147-467f-9371-31880de3ee66 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:39.945187 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a626bf1-f147-467f-9371-31880de3ee66 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:39.945814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a626bf1-f147-467f-9371-31880de3ee66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:39.947737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a626bf1-f147-467f-9371-31880de3ee66 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:39.958006 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 795/1585] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:39 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:39.962068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8d2ae-5bc2-47f1-a231-5e194302f61d None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:39.968852 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8d2ae-5bc2-47f1-a231-5e194302f61d None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:39.974205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69baee-e888-47e1-babf-1b2545260c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:39.974821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69baee-e888-47e1-babf-1b2545260c50 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:39.975093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69baee-e888-47e1-babf-1b2545260c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:39.975361 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69baee-e888-47e1-babf-1b2545260c50 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:39.975990 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69baee-e888-47e1-babf-1b2545260c50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:39.977563 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69baee-e888-47e1-babf-1b2545260c50 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:39.981959 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 791/1586] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:53:39 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:39.981959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a626bf1-f147-467f-9371-31880de3ee66 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:39.994351 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 796/1587] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:39.995491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69baee-e888-47e1-babf-1b2545260c50 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:40.005471 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69baee-e888-47e1-babf-1b2545260c50 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:40.046949 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a626bf1-f147-467f-9371-31880de3ee66 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:40.052420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37ba83-503b-4209-a45d-0815855085d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:40.053024 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37ba83-503b-4209-a45d-0815855085d2 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:40.053299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37ba83-503b-4209-a45d-0815855085d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:40.053565 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37ba83-503b-4209-a45d-0815855085d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:40.054194 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d37ba83-503b-4209-a45d-0815855085d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:40.055842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d37ba83-503b-4209-a45d-0815855085d2 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:40.064918 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6ecf4-c7ca-4235-8bcb-2ab2bc658491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:40.065706 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6ecf4-c7ca-4235-8bcb-2ab2bc658491 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:40.065985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6ecf4-c7ca-4235-8bcb-2ab2bc658491 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:40.066524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6ecf4-c7ca-4235-8bcb-2ab2bc658491 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:40.066646 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 792/1588] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:40.066919 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca6ecf4-c7ca-4235-8bcb-2ab2bc658491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:40.067159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37ba83-503b-4209-a45d-0815855085d2 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:40.068538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca6ecf4-c7ca-4235-8bcb-2ab2bc658491 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:40.076229 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37ba83-503b-4209-a45d-0815855085d2 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:40.081819 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 797/1589] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:40.081819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6ecf4-c7ca-4235-8bcb-2ab2bc658491 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:40.084461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f33967-db5a-477a-b5cb-1f9a3f0cac4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:40.085049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f33967-db5a-477a-b5cb-1f9a3f0cac4f admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:40.085322 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f33967-db5a-477a-b5cb-1f9a3f0cac4f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:40.085591 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f33967-db5a-477a-b5cb-1f9a3f0cac4f admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:40.086212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f33967-db5a-477a-b5cb-1f9a3f0cac4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:40.087883 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f33967-db5a-477a-b5cb-1f9a3f0cac4f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:40.089421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6ecf4-c7ca-4235-8bcb-2ab2bc658491 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:40.094121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d12692-eeaf-4a4f-8c9a-d81caef553fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:40.094731 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d12692-eeaf-4a4f-8c9a-d81caef553fa admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:40.095014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d12692-eeaf-4a4f-8c9a-d81caef553fa admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:40.095830 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d12692-eeaf-4a4f-8c9a-d81caef553fa admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:40.096457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d12692-eeaf-4a4f-8c9a-d81caef553fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:40.098010 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d12692-eeaf-4a4f-8c9a-d81caef553fa admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:40.102365 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 793/1590] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:40.102365 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f33967-db5a-477a-b5cb-1f9a3f0cac4f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:40.111545 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 798/1591] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:40.111545 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d12692-eeaf-4a4f-8c9a-d81caef553fa admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:40.113116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f33967-db5a-477a-b5cb-1f9a3f0cac4f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:40.117829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db58e89-ec2a-436b-aa08-3f9cc4267772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:40.118418 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db58e89-ec2a-436b-aa08-3f9cc4267772 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:40.118753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db58e89-ec2a-436b-aa08-3f9cc4267772 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:40.119030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db58e89-ec2a-436b-aa08-3f9cc4267772 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:40.119123 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d12692-eeaf-4a4f-8c9a-d81caef553fa admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:40.119645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db58e89-ec2a-436b-aa08-3f9cc4267772 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:40.121586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db58e89-ec2a-436b-aa08-3f9cc4267772 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:40.123669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9802072-cf8b-4006-8053-9fa898caea38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:40.124246 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9802072-cf8b-4006-8053-9fa898caea38 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:40.124521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9802072-cf8b-4006-8053-9fa898caea38 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:40.124801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9802072-cf8b-4006-8053-9fa898caea38 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:40.125409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9802072-cf8b-4006-8053-9fa898caea38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:40.127331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9802072-cf8b-4006-8053-9fa898caea38 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:40.143566 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 794/1592] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:53:40 2022] POST /identity/v3/users => generated 297 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:40.144587 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db58e89-ec2a-436b-aa08-3f9cc4267772 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:40.155010 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db58e89-ec2a-436b-aa08-3f9cc4267772 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:40.161309 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 799/1593] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:53:40 2022] POST /identity/v3/projects => generated 399 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:40.161309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9802072-cf8b-4006-8053-9fa898caea38 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:40.161520 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d82be-95c3-46aa-acab-1acb89d2f7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:40.161520 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d82be-95c3-46aa-acab-1acb89d2f7b5 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:40.161520 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d82be-95c3-46aa-acab-1acb89d2f7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:40.161772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d82be-95c3-46aa-acab-1acb89d2f7b5 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:40.162674 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d82be-95c3-46aa-acab-1acb89d2f7b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:40.164572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d82be-95c3-46aa-acab-1acb89d2f7b5 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:40.188357 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 795/1594] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:53:40 2022] POST /identity/v3/users => generated 300 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:40.188357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d82be-95c3-46aa-acab-1acb89d2f7b5 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:40.196505 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d82be-95c3-46aa-acab-1acb89d2f7b5 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:40.225770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9802072-cf8b-4006-8053-9fa898caea38 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:40.228599 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:40.230719 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ccdb47-3b85-4b63-96ab-5facfcd238a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:40.231384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ccdb47-3b85-4b63-96ab-5facfcd238a9 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:40.231579 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ccdb47-3b85-4b63-96ab-5facfcd238a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:40.231851 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ccdb47-3b85-4b63-96ab-5facfcd238a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:40.232498 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ccdb47-3b85-4b63-96ab-5facfcd238a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:40.234098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ccdb47-3b85-4b63-96ab-5facfcd238a9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:40.244901 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 800/1595] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:40.245714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ccdb47-3b85-4b63-96ab-5facfcd238a9 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:40.252465 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:40.256175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ccdb47-3b85-4b63-96ab-5facfcd238a9 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:40.259716 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496a0e6-8ba6-469a-9a40-9de5ec66e347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:40.260329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496a0e6-8ba6-469a-9a40-9de5ec66e347 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:40.260605 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496a0e6-8ba6-469a-9a40-9de5ec66e347 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:40.260872 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496a0e6-8ba6-469a-9a40-9de5ec66e347 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:40.261505 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496a0e6-8ba6-469a-9a40-9de5ec66e347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:40.262197 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d03c6-29bc-42b9-9495-a23e061fd9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:40.262804 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d03c6-29bc-42b9-9495-a23e061fd9a4 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:40.263080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d03c6-29bc-42b9-9495-a23e061fd9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:40.263181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496a0e6-8ba6-469a-9a40-9de5ec66e347 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:40.263347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d03c6-29bc-42b9-9495-a23e061fd9a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:40.263970 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d03c6-29bc-42b9-9495-a23e061fd9a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:40.265520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d03c6-29bc-42b9-9495-a23e061fd9a4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:40.274724 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 796/1596] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:40.275633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496a0e6-8ba6-469a-9a40-9de5ec66e347 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:40.276717 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 801/1597] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:40.277424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d03c6-29bc-42b9-9495-a23e061fd9a4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:40.287041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d03c6-29bc-42b9-9495-a23e061fd9a4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:40.288303 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496a0e6-8ba6-469a-9a40-9de5ec66e347 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:40.291755 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367dc816-0258-4492-9977-d5b318dc6f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:40.292350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367dc816-0258-4492-9977-d5b318dc6f8d admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:40.292607 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367dc816-0258-4492-9977-d5b318dc6f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:40.292876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367dc816-0258-4492-9977-d5b318dc6f8d admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:40.293211 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8445a1-5d1e-406b-8c96-b8751a8e4c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:40.293499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367dc816-0258-4492-9977-d5b318dc6f8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:40.293829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8445a1-5d1e-406b-8c96-b8751a8e4c7e admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:40.294132 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8445a1-5d1e-406b-8c96-b8751a8e4c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:40.294437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8445a1-5d1e-406b-8c96-b8751a8e4c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:40.295121 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8445a1-5d1e-406b-8c96-b8751a8e4c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:40.295225 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367dc816-0258-4492-9977-d5b318dc6f8d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:40.296692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8445a1-5d1e-406b-8c96-b8751a8e4c7e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:40.305300 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 802/1598] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:40.306101 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367dc816-0258-4492-9977-d5b318dc6f8d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:40.307863 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 797/1599] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:40.308529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8445a1-5d1e-406b-8c96-b8751a8e4c7e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:40.318664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8445a1-5d1e-406b-8c96-b8751a8e4c7e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:40.321039 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367dc816-0258-4492-9977-d5b318dc6f8d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:40.323185 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd376b-7f45-4d80-9966-a0c57b1bfd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:40.323766 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd376b-7f45-4d80-9966-a0c57b1bfd47 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:40.324054 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd376b-7f45-4d80-9966-a0c57b1bfd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:40.324305 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd376b-7f45-4d80-9966-a0c57b1bfd47 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:40.324910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd376b-7f45-4d80-9966-a0c57b1bfd47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:40.326358 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014cd1a4-b66b-4b1f-918f-5f54f721c3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:40.326816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd376b-7f45-4d80-9966-a0c57b1bfd47 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:40.327055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cd1a4-b66b-4b1f-918f-5f54f721c3f9 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:40.327329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cd1a4-b66b-4b1f-918f-5f54f721c3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:40.327594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cd1a4-b66b-4b1f-918f-5f54f721c3f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:40.328220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014cd1a4-b66b-4b1f-918f-5f54f721c3f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:40.330402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014cd1a4-b66b-4b1f-918f-5f54f721c3f9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:40.340990 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 803/1600] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:40.341960 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014cd1a4-b66b-4b1f-918f-5f54f721c3f9 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:40.352267 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014cd1a4-b66b-4b1f-918f-5f54f721c3f9 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:40.354320 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 798/1601] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:53:40 2022] POST /identity/v3/users => generated 306 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:40.356945 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf405f42-2dc5-4153-985d-80005c0e66c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:40.357537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf405f42-2dc5-4153-985d-80005c0e66c5 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:40.357820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf405f42-2dc5-4153-985d-80005c0e66c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:40.358123 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf405f42-2dc5-4153-985d-80005c0e66c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:40.358790 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf405f42-2dc5-4153-985d-80005c0e66c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:40.358884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd376b-7f45-4d80-9966-a0c57b1bfd47 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:40.360433 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf405f42-2dc5-4153-985d-80005c0e66c5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:40.368925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd376b-7f45-4d80-9966-a0c57b1bfd47 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:40.371233 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 804/1602] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:40.372072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf405f42-2dc5-4153-985d-80005c0e66c5 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:40.376011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c408c6b-c6a6-45fa-8858-77c42ef4be20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:40.377343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c408c6b-c6a6-45fa-8858-77c42ef4be20 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:40.377615 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c408c6b-c6a6-45fa-8858-77c42ef4be20 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:40.377887 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c408c6b-c6a6-45fa-8858-77c42ef4be20 admin admin] PATH_INFO: `/v3/projects/14ded09d02714f33bad32ed516e1981e/users/e58dc1fca46b4cb7ad023caa3c762fce/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:40.382331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf405f42-2dc5-4153-985d-80005c0e66c5 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:40.387054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ccdc1-faad-4ab2-a8b0-f352782cb882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:40.387680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ccdc1-faad-4ab2-a8b0-f352782cb882 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:40.387945 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ccdc1-faad-4ab2-a8b0-f352782cb882 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:40.388217 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ccdc1-faad-4ab2-a8b0-f352782cb882 admin admin] PATH_INFO: `/v3/projects/509f8960df214976b58edbce0de6d2bb/users/71f21ff3a8fb4296902f4eeb0c23cd98/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:40.394865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c408c6b-c6a6-45fa-8858-77c42ef4be20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14ded09d02714f33bad32ed516e1981e, user_id=e58dc1fca46b4cb7ad023caa3c762fce, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:40.399407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c408c6b-c6a6-45fa-8858-77c42ef4be20 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:40.403778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9ccdc1-faad-4ab2-a8b0-f352782cb882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=509f8960df214976b58edbce0de6d2bb, user_id=71f21ff3a8fb4296902f4eeb0c23cd98, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:40.406683 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9ccdc1-faad-4ab2-a8b0-f352782cb882 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:40.415569 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 799/1603] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:40 2022] PUT /identity/v3/projects/14ded09d02714f33bad32ed516e1981e/users/e58dc1fca46b4cb7ad023caa3c762fce/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:40.419332 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 805/1604] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:40 2022] PUT /identity/v3/projects/509f8960df214976b58edbce0de6d2bb/users/71f21ff3a8fb4296902f4eeb0c23cd98/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:40.419456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c408c6b-c6a6-45fa-8858-77c42ef4be20 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:40.420160 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ccdc1-faad-4ab2-a8b0-f352782cb882 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:40.492977 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ccdc1-faad-4ab2-a8b0-f352782cb882 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:40.495492 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c408c6b-c6a6-45fa-8858-77c42ef4be20 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:40.497844 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67bdca-6e42-4270-8fc9-95510e195e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:40.498500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67bdca-6e42-4270-8fc9-95510e195e93 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:40.498839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67bdca-6e42-4270-8fc9-95510e195e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:40.499118 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67bdca-6e42-4270-8fc9-95510e195e93 admin admin] PATH_INFO: `/v3/projects/8df3c89fd9b64e7fabe13faf7fd63080/users/5ab74a18992d4a7a9f460e98efe9e0ea/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:40.500034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb3e09-1e25-483d-9151-f371ba7ef886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:40.500681 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb3e09-1e25-483d-9151-f371ba7ef886 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:40.500956 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb3e09-1e25-483d-9151-f371ba7ef886 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:40.501229 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb3e09-1e25-483d-9151-f371ba7ef886 admin admin] PATH_INFO: `/v3/projects/d6719194184a469980d1e28b1b841628/users/c9aae35d370942b0ab5c41cd231c42a6/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:40.515348 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67bdca-6e42-4270-8fc9-95510e195e93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8df3c89fd9b64e7fabe13faf7fd63080, user_id=5ab74a18992d4a7a9f460e98efe9e0ea, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:40.516387 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb3e09-1e25-483d-9151-f371ba7ef886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6719194184a469980d1e28b1b841628, user_id=c9aae35d370942b0ab5c41cd231c42a6, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:40.518579 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67bdca-6e42-4270-8fc9-95510e195e93 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:40.519889 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb3e09-1e25-483d-9151-f371ba7ef886 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:40.531932 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 806/1605] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:40 2022] PUT /identity/v3/projects/8df3c89fd9b64e7fabe13faf7fd63080/users/5ab74a18992d4a7a9f460e98efe9e0ea/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:40.544190 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 800/1606] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:40 2022] PUT /identity/v3/projects/d6719194184a469980d1e28b1b841628/users/c9aae35d370942b0ab5c41cd231c42a6/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:40.544190 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb3e09-1e25-483d-9151-f371ba7ef886 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:40.544465 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67bdca-6e42-4270-8fc9-95510e195e93 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:40.602013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb3e09-1e25-483d-9151-f371ba7ef886 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:40.606910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571f5eb-ed2f-4055-832c-98bf87dd9e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:40.607574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571f5eb-ed2f-4055-832c-98bf87dd9e21 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:40.607868 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571f5eb-ed2f-4055-832c-98bf87dd9e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:40.608130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571f5eb-ed2f-4055-832c-98bf87dd9e21 admin admin] PATH_INFO: `/v3/projects/ae4c799b4d834fa19b81fedf13f0aa88/users/77ba04dfce9247ac9eba07003dd45faf/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:40.610496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:40.614017 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67bdca-6e42-4270-8fc9-95510e195e93 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:40.619102 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a0622-d43e-4ebb-ac2f-e99424d87f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:40.619904 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a0622-d43e-4ebb-ac2f-e99424d87f9e admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:40.620149 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a0622-d43e-4ebb-ac2f-e99424d87f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:40.620343 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a0622-d43e-4ebb-ac2f-e99424d87f9e admin admin] PATH_INFO: `/v3/projects/9a5ec0446ba94bd798fe16bd5de8941a/users/9f575e58b4cf458e8d55eaf976ea4055/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:40.629358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c571f5eb-ed2f-4055-832c-98bf87dd9e21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae4c799b4d834fa19b81fedf13f0aa88, user_id=77ba04dfce9247ac9eba07003dd45faf, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:40.632159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c571f5eb-ed2f-4055-832c-98bf87dd9e21 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:40.636259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a0622-d43e-4ebb-ac2f-e99424d87f9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a5ec0446ba94bd798fe16bd5de8941a, user_id=9f575e58b4cf458e8d55eaf976ea4055, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:40.639929 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a0622-d43e-4ebb-ac2f-e99424d87f9e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:40.648732 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 801/1607] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:40 2022] PUT /identity/v3/projects/ae4c799b4d834fa19b81fedf13f0aa88/users/77ba04dfce9247ac9eba07003dd45faf/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:40.649616 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571f5eb-ed2f-4055-832c-98bf87dd9e21 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:40.658637 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 807/1608] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:40 2022] PUT /identity/v3/projects/9a5ec0446ba94bd798fe16bd5de8941a/users/9f575e58b4cf458e8d55eaf976ea4055/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:40.659842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a0622-d43e-4ebb-ac2f-e99424d87f9e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:40.667746 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:40.735165 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571f5eb-ed2f-4055-832c-98bf87dd9e21 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:40.738609 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a0622-d43e-4ebb-ac2f-e99424d87f9e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:40.740109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc5b75-c6da-485e-9a30-423cf4b0e871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:40.740725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc5b75-c6da-485e-9a30-423cf4b0e871 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:40.741005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc5b75-c6da-485e-9a30-423cf4b0e871 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:40.741304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc5b75-c6da-485e-9a30-423cf4b0e871 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:40.741946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc5b75-c6da-485e-9a30-423cf4b0e871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:40.743281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c093c6d-54cf-4b13-8f62-f2f0e85ec88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:40.743588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc5b75-c6da-485e-9a30-423cf4b0e871 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:40.743939 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c093c6d-54cf-4b13-8f62-f2f0e85ec88b admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:40.744214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c093c6d-54cf-4b13-8f62-f2f0e85ec88b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:40.744483 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c093c6d-54cf-4b13-8f62-f2f0e85ec88b admin admin] PATH_INFO: `/v3/projects/2179f93397254aadab09569e2814b7af/users/dcba5f912cd743379093fd3a1b463f4c/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:40.755046 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 802/1609] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:40.756510 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb1853-7e2d-4713-a227-f4e5ebe384c1 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:40.756906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb1853-7e2d-4713-a227-f4e5ebe384c1 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:40.757103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb1853-7e2d-4713-a227-f4e5ebe384c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:40.763959 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c093c6d-54cf-4b13-8f62-f2f0e85ec88b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2179f93397254aadab09569e2814b7af, user_id=dcba5f912cd743379093fd3a1b463f4c, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:40.768574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c093c6d-54cf-4b13-8f62-f2f0e85ec88b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:40.785154 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 808/1610] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:40 2022] PUT /identity/v3/projects/2179f93397254aadab09569e2814b7af/users/dcba5f912cd743379093fd3a1b463f4c/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:40.786735 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe0319-c7b1-4a64-8ede-1e0c21e85aa5 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:40.787016 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe0319-c7b1-4a64-8ede-1e0c21e85aa5 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:40.787319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe0319-c7b1-4a64-8ede-1e0c21e85aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:40.792560 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-dffb1853-7e2d-4713-a227-f4e5ebe384c1 None None] MFA Rules not processed for user `e58dc1fca46b4cb7ad023caa3c762fce`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:40.793802 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-dffb1853-7e2d-4713-a227-f4e5ebe384c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:40.816726 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-69fe0319-c7b1-4a64-8ede-1e0c21e85aa5 None None] MFA Rules not processed for user `71f21ff3a8fb4296902f4eeb0c23cd98`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:40.818092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-69fe0319-c7b1-4a64-8ede-1e0c21e85aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:40.869211 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 803/1611] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:40.870381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f107d4-def5-4a58-ac62-7f3f078c515c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:40.870699 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f107d4-def5-4a58-ac62-7f3f078c515c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:40.870974 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f107d4-def5-4a58-ac62-7f3f078c515c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:40.897649 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 809/1612] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:40.899014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec39b3-ffb6-4b57-bfab-6214bd32b413 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:40.899301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec39b3-ffb6-4b57-bfab-6214bd32b413 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:40.899573 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec39b3-ffb6-4b57-bfab-6214bd32b413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:40.905906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d4f107d4-def5-4a58-ac62-7f3f078c515c None None] MFA Rules not processed for user `5ab74a18992d4a7a9f460e98efe9e0ea`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:40.907277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d4f107d4-def5-4a58-ac62-7f3f078c515c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:40.931073 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-41ec39b3-ffb6-4b57-bfab-6214bd32b413 None None] MFA Rules not processed for user `c9aae35d370942b0ab5c41cd231c42a6`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:40.932378 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-41ec39b3-ffb6-4b57-bfab-6214bd32b413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:40.975667 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:40.983008 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 804/1613] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:40.984509 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f107d4-def5-4a58-ac62-7f3f078c515c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:41.007300 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 810/1614] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:41.011086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6fb81-8acc-4dff-81b9-88f4ad617dd1 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:41.011086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6fb81-8acc-4dff-81b9-88f4ad617dd1 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:41.011086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6fb81-8acc-4dff-81b9-88f4ad617dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:41.017261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:41.043111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-0ff6fb81-8acc-4dff-81b9-88f4ad617dd1 None None] MFA Rules not processed for user `9f575e58b4cf458e8d55eaf976ea4055`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:41.044626 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0ff6fb81-8acc-4dff-81b9-88f4ad617dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:41.069772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f107d4-def5-4a58-ac62-7f3f078c515c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:41.076422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff87d2-c2c5-4aa9-a0b7-11cc6158f4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:41.077151 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff87d2-c2c5-4aa9-a0b7-11cc6158f4f1 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:41.077431 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff87d2-c2c5-4aa9-a0b7-11cc6158f4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:41.077723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff87d2-c2c5-4aa9-a0b7-11cc6158f4f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:41.078361 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff87d2-c2c5-4aa9-a0b7-11cc6158f4f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:41.080827 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff87d2-c2c5-4aa9-a0b7-11cc6158f4f1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:41.094282 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 805/1615] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:41.094282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff87d2-c2c5-4aa9-a0b7-11cc6158f4f1 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:41.103599 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff87d2-c2c5-4aa9-a0b7-11cc6158f4f1 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:41.109751 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3378b-40a4-4b56-9784-36d31715e00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:41.111639 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3378b-40a4-4b56-9784-36d31715e00c admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:41.112096 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3378b-40a4-4b56-9784-36d31715e00c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:41.112645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3378b-40a4-4b56-9784-36d31715e00c admin admin] PATH_INFO: `/v3/projects/cc8895257b064c5dafd5a756473fd31c/users/7cf7bbbf0c0e4bafb47caa177a0ff6fc/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:41.119062 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 811/1616] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:41.119975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6fb81-8acc-4dff-81b9-88f4ad617dd1 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:41.131073 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e3378b-40a4-4b56-9784-36d31715e00c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc8895257b064c5dafd5a756473fd31c, user_id=7cf7bbbf0c0e4bafb47caa177a0ff6fc, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:41.133847 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e3378b-40a4-4b56-9784-36d31715e00c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:41.134721 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6fb81-8acc-4dff-81b9-88f4ad617dd1 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:41.140185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdc34a-16c7-4838-8116-e0f8b8c2c740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:41.140977 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdc34a-16c7-4838-8116-e0f8b8c2c740 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:41.141264 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdc34a-16c7-4838-8116-e0f8b8c2c740 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:41.141632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdc34a-16c7-4838-8116-e0f8b8c2c740 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:41.142766 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdc34a-16c7-4838-8116-e0f8b8c2c740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:41.144816 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdc34a-16c7-4838-8116-e0f8b8c2c740 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:41.150248 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 806/1617] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:41 2022] PUT /identity/v3/projects/cc8895257b064c5dafd5a756473fd31c/users/7cf7bbbf0c0e4bafb47caa177a0ff6fc/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:41.151182 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3378b-40a4-4b56-9784-36d31715e00c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:41.155567 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 812/1618] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:41.156695 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdc34a-16c7-4838-8116-e0f8b8c2c740 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:41.174020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdc34a-16c7-4838-8116-e0f8b8c2c740 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:41.219690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3378b-40a4-4b56-9784-36d31715e00c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:41.226074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ed3b4-0461-488d-bf2b-3cf9984c4629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:41.226778 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ed3b4-0461-488d-bf2b-3cf9984c4629 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:41.227059 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ed3b4-0461-488d-bf2b-3cf9984c4629 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:41.227328 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ed3b4-0461-488d-bf2b-3cf9984c4629 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:41.227946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ed3b4-0461-488d-bf2b-3cf9984c4629 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:41.229843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ed3b4-0461-488d-bf2b-3cf9984c4629 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:41.242146 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6a8a8-549e-42d2-9d85-b29765063f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:41.242876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6a8a8-549e-42d2-9d85-b29765063f68 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:41.243051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6a8a8-549e-42d2-9d85-b29765063f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:41.243453 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6a8a8-549e-42d2-9d85-b29765063f68 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:41.244485 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb6a8a8-549e-42d2-9d85-b29765063f68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:41.247200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb6a8a8-549e-42d2-9d85-b29765063f68 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:41.261613 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 807/1619] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:53:41 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:41.262434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ed3b4-0461-488d-bf2b-3cf9984c4629 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:41.281420 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 813/1620] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:53:41 2022] POST /identity/v3/projects => generated 369 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:41.282140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6a8a8-549e-42d2-9d85-b29765063f68 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:41.327309 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:41.333991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ed3b4-0461-488d-bf2b-3cf9984c4629 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:41.358679 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6a8a8-549e-42d2-9d85-b29765063f68 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:41.365810 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b629f-f61d-457a-8d8e-ec663be998c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:41.366448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b629f-f61d-457a-8d8e-ec663be998c4 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:41.366753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b629f-f61d-457a-8d8e-ec663be998c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:41.367023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b629f-f61d-457a-8d8e-ec663be998c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:41.367653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b629f-f61d-457a-8d8e-ec663be998c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:41.369782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b629f-f61d-457a-8d8e-ec663be998c4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:41.390845 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:41.403885 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 814/1621] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:53:41 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:41.404830 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b629f-f61d-457a-8d8e-ec663be998c4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:41.409896 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ac990-28d3-49a5-96c6-e759111be519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:41.410510 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ac990-28d3-49a5-96c6-e759111be519 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:41.410815 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ac990-28d3-49a5-96c6-e759111be519 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:41.411088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ac990-28d3-49a5-96c6-e759111be519 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:41.411708 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ac990-28d3-49a5-96c6-e759111be519 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:41.413664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ac990-28d3-49a5-96c6-e759111be519 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:41.448435 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 808/1622] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:53:41 2022] POST /identity/v3/projects => generated 381 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:41.448435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ac990-28d3-49a5-96c6-e759111be519 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:41.472580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b629f-f61d-457a-8d8e-ec663be998c4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:41.501274 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ac990-28d3-49a5-96c6-e759111be519 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:41.505578 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d5fce-38b8-4f37-adbf-98c6f1fbad65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:41.506176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d5fce-38b8-4f37-adbf-98c6f1fbad65 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:41.506456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d5fce-38b8-4f37-adbf-98c6f1fbad65 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:41.506757 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d5fce-38b8-4f37-adbf-98c6f1fbad65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:41.531072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51cd5b-d7f3-4b97-abe0-ae6451aeb2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:41.531752 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51cd5b-d7f3-4b97-abe0-ae6451aeb2fb admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:41.532016 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51cd5b-d7f3-4b97-abe0-ae6451aeb2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:41.532292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51cd5b-d7f3-4b97-abe0-ae6451aeb2fb admin admin] PATH_INFO: `/v3/projects/ae4c799b4d834fa19b81fedf13f0aa88/users/77ba04dfce9247ac9eba07003dd45faf/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:41.534975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a51cd5b-d7f3-4b97-abe0-ae6451aeb2fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae4c799b4d834fa19b81fedf13f0aa88, user_id=77ba04dfce9247ac9eba07003dd45faf, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:41.537664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a51cd5b-d7f3-4b97-abe0-ae6451aeb2fb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:41.548460 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 815/1623] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:41 2022] PUT /identity/v3/projects/ae4c799b4d834fa19b81fedf13f0aa88/users/77ba04dfce9247ac9eba07003dd45faf/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:41.549348 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51cd5b-d7f3-4b97-abe0-ae6451aeb2fb admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:41.572674 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d5fce-38b8-4f37-adbf-98c6f1fbad65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:41.574124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d5fce-38b8-4f37-adbf-98c6f1fbad65 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:41.584182 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 809/1624] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:53:41.585108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d5fce-38b8-4f37-adbf-98c6f1fbad65 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:41.596125 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d5fce-38b8-4f37-adbf-98c6f1fbad65 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:41.614829 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51cd5b-d7f3-4b97-abe0-ae6451aeb2fb admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:41.621355 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e70c8-03ca-4502-a9b5-ca5a294b9057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:41.622055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e70c8-03ca-4502-a9b5-ca5a294b9057 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:41.622409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e70c8-03ca-4502-a9b5-ca5a294b9057 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:41.622778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e70c8-03ca-4502-a9b5-ca5a294b9057 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:41.623524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e70c8-03ca-4502-a9b5-ca5a294b9057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:41.625189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e70c8-03ca-4502-a9b5-ca5a294b9057 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:41.638613 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 816/1625] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:41.639398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e70c8-03ca-4502-a9b5-ca5a294b9057 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:41.647801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:41.650381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e70c8-03ca-4502-a9b5-ca5a294b9057 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:41.655300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2cdec-80ee-4f6e-b468-f37a4a36527e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:41.655985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2cdec-80ee-4f6e-b468-f37a4a36527e admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:41.656328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2cdec-80ee-4f6e-b468-f37a4a36527e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:41.656827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2cdec-80ee-4f6e-b468-f37a4a36527e admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:41.657870 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a2cdec-80ee-4f6e-b468-f37a4a36527e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:41.659531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a2cdec-80ee-4f6e-b468-f37a4a36527e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:41.681663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db29a54-5209-4fa8-813f-47c1bc377d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:41.682448 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db29a54-5209-4fa8-813f-47c1bc377d67 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:41.682864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db29a54-5209-4fa8-813f-47c1bc377d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:41.683243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db29a54-5209-4fa8-813f-47c1bc377d67 admin admin] PATH_INFO: `/v3/projects/2179f93397254aadab09569e2814b7af/users/dcba5f912cd743379093fd3a1b463f4c/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:41.685456 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 817/1626] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:53:41 2022] POST /identity/v3/users => generated 299 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:41.685567 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db29a54-5209-4fa8-813f-47c1bc377d67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2179f93397254aadab09569e2814b7af, user_id=dcba5f912cd743379093fd3a1b463f4c, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:41.686030 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2cdec-80ee-4f6e-b468-f37a4a36527e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:41.688410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db29a54-5209-4fa8-813f-47c1bc377d67 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:41.696823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2cdec-80ee-4f6e-b468-f37a4a36527e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:41.701005 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 810/1627] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:41 2022] PUT /identity/v3/projects/2179f93397254aadab09569e2814b7af/users/dcba5f912cd743379093fd3a1b463f4c/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:41.701821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db29a54-5209-4fa8-813f-47c1bc377d67 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:41.707787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:41.763743 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04930964-bdd7-4d30-b2cd-e27b18d528c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:41.764925 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04930964-bdd7-4d30-b2cd-e27b18d528c0 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:41.764925 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04930964-bdd7-4d30-b2cd-e27b18d528c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:41.765130 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04930964-bdd7-4d30-b2cd-e27b18d528c0 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:41.765639 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04930964-bdd7-4d30-b2cd-e27b18d528c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:41.768587 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04930964-bdd7-4d30-b2cd-e27b18d528c0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:41.778178 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db29a54-5209-4fa8-813f-47c1bc377d67 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:41.784001 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f0ee5-46d6-42ec-9ba7-e8d359b32ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:41.784718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f0ee5-46d6-42ec-9ba7-e8d359b32ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:41.784996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f0ee5-46d6-42ec-9ba7-e8d359b32ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:41.785265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f0ee5-46d6-42ec-9ba7-e8d359b32ca5 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:41.785881 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f0ee5-46d6-42ec-9ba7-e8d359b32ca5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:41.788017 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f0ee5-46d6-42ec-9ba7-e8d359b32ca5 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:41.812062 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 818/1628] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:53:41 2022] POST /identity/v3/users => generated 291 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:41.812062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04930964-bdd7-4d30-b2cd-e27b18d528c0 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:41.815944 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 811/1629] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:53:41 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:41.817331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01b85e-3769-4898-8ad5-922d3037d5ff None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:41.817843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01b85e-3769-4898-8ad5-922d3037d5ff None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:41.818192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01b85e-3769-4898-8ad5-922d3037d5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:41.822951 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04930964-bdd7-4d30-b2cd-e27b18d528c0 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:41.828786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a8d56-6513-4e21-9412-210fe2b46280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:41.829560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a8d56-6513-4e21-9412-210fe2b46280 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:41.830258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a8d56-6513-4e21-9412-210fe2b46280 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:41.830539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a8d56-6513-4e21-9412-210fe2b46280 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:41.831200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a8d56-6513-4e21-9412-210fe2b46280 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:41.833165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a8d56-6513-4e21-9412-210fe2b46280 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:41.854141 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-7c01b85e-3769-4898-8ad5-922d3037d5ff None None] MFA Rules not processed for user `77ba04dfce9247ac9eba07003dd45faf`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:41.855453 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7c01b85e-3769-4898-8ad5-922d3037d5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:41.862808 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 819/1630] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:53:41 2022] POST /identity/v3/users => generated 297 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:41.863717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a8d56-6513-4e21-9412-210fe2b46280 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:41.874861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a8d56-6513-4e21-9412-210fe2b46280 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:41.882364 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abfdd3-5f6d-4211-8d28-a9f1c7d7a772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:41.883339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abfdd3-5f6d-4211-8d28-a9f1c7d7a772 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:41.883620 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abfdd3-5f6d-4211-8d28-a9f1c7d7a772 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:41.883941 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abfdd3-5f6d-4211-8d28-a9f1c7d7a772 admin admin] PATH_INFO: `/v3/projects/cc8895257b064c5dafd5a756473fd31c/users/7cf7bbbf0c0e4bafb47caa177a0ff6fc/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:41.887047 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9abfdd3-5f6d-4211-8d28-a9f1c7d7a772 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc8895257b064c5dafd5a756473fd31c, user_id=7cf7bbbf0c0e4bafb47caa177a0ff6fc, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:41.890336 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9abfdd3-5f6d-4211-8d28-a9f1c7d7a772 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:41.908397 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 820/1631] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:41 2022] PUT /identity/v3/projects/cc8895257b064c5dafd5a756473fd31c/users/7cf7bbbf0c0e4bafb47caa177a0ff6fc/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:41.909513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abfdd3-5f6d-4211-8d28-a9f1c7d7a772 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:41.947494 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 812/1632] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:41 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:41.948962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016a5ed-de31-48a9-86cc-8931010b33a9 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:41.949256 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016a5ed-de31-48a9-86cc-8931010b33a9 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:41.949534 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016a5ed-de31-48a9-86cc-8931010b33a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:41.979480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abfdd3-5f6d-4211-8d28-a9f1c7d7a772 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:41.982876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-5016a5ed-de31-48a9-86cc-8931010b33a9 None None] MFA Rules not processed for user `dcba5f912cd743379093fd3a1b463f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:41.984086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5016a5ed-de31-48a9-86cc-8931010b33a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:41.985410 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed4646-cc59-4db8-9a25-b3fda001b534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:41.986183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed4646-cc59-4db8-9a25-b3fda001b534 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:41.986666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed4646-cc59-4db8-9a25-b3fda001b534 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:41.986940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed4646-cc59-4db8-9a25-b3fda001b534 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:41.987604 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed4646-cc59-4db8-9a25-b3fda001b534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:41.989261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed4646-cc59-4db8-9a25-b3fda001b534 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:41.999828 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 821/1633] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:42.000301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed4646-cc59-4db8-9a25-b3fda001b534 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:42.010428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed4646-cc59-4db8-9a25-b3fda001b534 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:42.015073 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abe4f6-c1a9-4ffe-8887-8e37995bfee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:42.015653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abe4f6-c1a9-4ffe-8887-8e37995bfee1 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:42.015930 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abe4f6-c1a9-4ffe-8887-8e37995bfee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:42.016202 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abe4f6-c1a9-4ffe-8887-8e37995bfee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:42.016828 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abe4f6-c1a9-4ffe-8887-8e37995bfee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:42.019066 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abe4f6-c1a9-4ffe-8887-8e37995bfee1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:42.028657 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 822/1634] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:42.029169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:42.029440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abe4f6-c1a9-4ffe-8887-8e37995bfee1 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:42.039626 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abe4f6-c1a9-4ffe-8887-8e37995bfee1 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:42.044448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab58e2d-1052-4d70-8d8b-08ab0a006959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:42.045025 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab58e2d-1052-4d70-8d8b-08ab0a006959 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:42.045302 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab58e2d-1052-4d70-8d8b-08ab0a006959 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:42.045574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab58e2d-1052-4d70-8d8b-08ab0a006959 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:42.046196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab58e2d-1052-4d70-8d8b-08ab0a006959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:42.047789 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab58e2d-1052-4d70-8d8b-08ab0a006959 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:42.062009 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 823/1635] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:42.062867 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab58e2d-1052-4d70-8d8b-08ab0a006959 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:42.063248 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 813/1636] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:41 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:42.064720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582e197-f44f-4f4b-8fb8-9258e583c0a3 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:42.065139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582e197-f44f-4f4b-8fb8-9258e583c0a3 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:42.065468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582e197-f44f-4f4b-8fb8-9258e583c0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:42.081132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab58e2d-1052-4d70-8d8b-08ab0a006959 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:42.086260 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599cc30-8ecc-402e-8228-3912215f0336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:42.086902 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599cc30-8ecc-402e-8228-3912215f0336 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:42.087181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599cc30-8ecc-402e-8228-3912215f0336 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:42.087454 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599cc30-8ecc-402e-8228-3912215f0336 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:42.088086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599cc30-8ecc-402e-8228-3912215f0336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:42.089663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599cc30-8ecc-402e-8228-3912215f0336 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:42.097990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-0582e197-f44f-4f4b-8fb8-9258e583c0a3 None None] MFA Rules not processed for user `7cf7bbbf0c0e4bafb47caa177a0ff6fc`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:42.099208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0582e197-f44f-4f4b-8fb8-9258e583c0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:42.100739 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 824/1637] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:42.101975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599cc30-8ecc-402e-8228-3912215f0336 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:42.113379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599cc30-8ecc-402e-8228-3912215f0336 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:42.118368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2a6d5-f0c5-43d4-b6f1-6bf0e66953b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:42.119093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2a6d5-f0c5-43d4-b6f1-6bf0e66953b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:42.119435 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2a6d5-f0c5-43d4-b6f1-6bf0e66953b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:42.119782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2a6d5-f0c5-43d4-b6f1-6bf0e66953b5 admin admin] PATH_INFO: `/v3/users/9f575e58b4cf458e8d55eaf976ea4055` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:42.121082 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2a6d5-f0c5-43d4-b6f1-6bf0e66953b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f575e58b4cf458e8d55eaf976ea4055)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:42.122172 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-eeb2a6d5-f0c5-43d4-b6f1-6bf0e66953b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:42.122172 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 20:53:42.122172 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 20:53:42.123582 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2a6d5-f0c5-43d4-b6f1-6bf0e66953b5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:42.172054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=88,keystone:INSERT=7,keystone:DELETE=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:42.186728 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 814/1638] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:42 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:42.187993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa054a-bdf4-4c1e-a60b-ad49fdc874af None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:42.188282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa054a-bdf4-4c1e-a60b-ad49fdc874af None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:42.188606 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa054a-bdf4-4c1e-a60b-ad49fdc874af None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:42.191167 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 815/1639] 10.222.0.33 () {54 vars in 962 bytes} [Sat Aug 6 20:53:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:53:42.191920 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa054a-bdf4-4c1e-a60b-ad49fdc874af None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:42.192760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-eeb2a6d5-f0c5-43d4-b6f1-6bf0e66953b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f575e58b4cf458e8d55eaf976ea4055'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:42.203529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-eeb2a6d5-f0c5-43d4-b6f1-6bf0e66953b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f575e58b4cf458e8d55eaf976ea4055'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:42.204222 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-eeb2a6d5-f0c5-43d4-b6f1-6bf0e66953b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f575e58b4cf458e8d55eaf976ea4055'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:42.204919 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-eeb2a6d5-f0c5-43d4-b6f1-6bf0e66953b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f575e58b4cf458e8d55eaf976ea4055'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:42.205745 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa054a-bdf4-4c1e-a60b-ad49fdc874af None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:42.210372 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad70c9f-5055-47e4-8f53-8699b5618423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:42.211117 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad70c9f-5055-47e4-8f53-8699b5618423 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:42.211373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad70c9f-5055-47e4-8f53-8699b5618423 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:42.211692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad70c9f-5055-47e4-8f53-8699b5618423 admin admin] PATH_INFO: `/v3/projects/f59b759a2f9e459f80ca6ddb78cc310a/users/e2a79f462917429ab8e5fedc86e170b2/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:42.213151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-eeb2a6d5-f0c5-43d4-b6f1-6bf0e66953b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f575e58b4cf458e8d55eaf976ea4055'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:42.227498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad70c9f-5055-47e4-8f53-8699b5618423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f59b759a2f9e459f80ca6ddb78cc310a, user_id=e2a79f462917429ab8e5fedc86e170b2, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:42.230146 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad70c9f-5055-47e4-8f53-8699b5618423 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:42.238079 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 825/1640] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:53:42 2022] DELETE /identity/v3/users/9f575e58b4cf458e8d55eaf976ea4055 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:42.239107 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2a6d5-f0c5-43d4-b6f1-6bf0e66953b5 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:42.240453 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-eeb2a6d5-f0c5-43d4-b6f1-6bf0e66953b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:42.246778 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 816/1641] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:42 2022] PUT /identity/v3/projects/f59b759a2f9e459f80ca6ddb78cc310a/users/e2a79f462917429ab8e5fedc86e170b2/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:42.247612 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad70c9f-5055-47e4-8f53-8699b5618423 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:42.249357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0ad70c9f-5055-47e4-8f53-8699b5618423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:42.306764 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2a6d5-f0c5-43d4-b6f1-6bf0e66953b5 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:42.311811 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f186097-85bb-464a-a006-9dbf93c4705a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:42.312473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f186097-85bb-464a-a006-9dbf93c4705a admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:42.312868 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f186097-85bb-464a-a006-9dbf93c4705a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:42.313152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f186097-85bb-464a-a006-9dbf93c4705a admin admin] PATH_INFO: `/v3/projects/2950c56f39294460979ec191c18c7857/users/fb9c420d021d4d4aa8008bf24f6814b4/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:42.314513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad70c9f-5055-47e4-8f53-8699b5618423 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:42.319052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6fc81-9288-4aef-9288-d1487bf60e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:42.319704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6fc81-9288-4aef-9288-d1487bf60e39 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:42.319979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6fc81-9288-4aef-9288-d1487bf60e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:42.320248 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6fc81-9288-4aef-9288-d1487bf60e39 admin admin] PATH_INFO: `/v3/projects/125b3d3311b14ea89d160629d3c71ca3/users/75e6d55b14714a99b4a529e391b6c3ea/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:42.328611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f186097-85bb-464a-a006-9dbf93c4705a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2950c56f39294460979ec191c18c7857, user_id=fb9c420d021d4d4aa8008bf24f6814b4, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:42.332036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f186097-85bb-464a-a006-9dbf93c4705a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:42.334384 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6fc81-9288-4aef-9288-d1487bf60e39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=125b3d3311b14ea89d160629d3c71ca3, user_id=75e6d55b14714a99b4a529e391b6c3ea, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:42.337251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6fc81-9288-4aef-9288-d1487bf60e39 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:42.346944 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 826/1642] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:42 2022] PUT /identity/v3/projects/2950c56f39294460979ec191c18c7857/users/fb9c420d021d4d4aa8008bf24f6814b4/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:42.347753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f186097-85bb-464a-a006-9dbf93c4705a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:42.349460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4f186097-85bb-464a-a006-9dbf93c4705a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:42.350875 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 817/1643] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:42 2022] PUT /identity/v3/projects/125b3d3311b14ea89d160629d3c71ca3/users/75e6d55b14714a99b4a529e391b6c3ea/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:42.352149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bf5ce-41b7-41fc-884b-9ba1c4206f93 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:42.352428 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bf5ce-41b7-41fc-884b-9ba1c4206f93 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:42.352701 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bf5ce-41b7-41fc-884b-9ba1c4206f93 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:42.354511 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 818/1644] 10.222.0.33 () {54 vars in 962 bytes} [Sat Aug 6 20:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:53:42.356119 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c32f4-46d3-4e72-8563-7e4db705168d None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:42.356403 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c32f4-46d3-4e72-8563-7e4db705168d None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:42.356794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c32f4-46d3-4e72-8563-7e4db705168d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:42.390807 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:42.394513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-173c32f4-46d3-4e72-8563-7e4db705168d None None] MFA Rules not processed for user `5f9d53147a57402f8b9818590bc1fc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:42.397223 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-173c32f4-46d3-4e72-8563-7e4db705168d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:42.415217 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f186097-85bb-464a-a006-9dbf93c4705a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:42.449413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:42.466788 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 819/1645] 10.222.0.33 () {58 vars in 1059 bytes} [Sat Aug 6 20:53:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:42.468044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d834b9-ef2b-412e-ba2c-3bf3a360f03d None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:42.468316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d834b9-ef2b-412e-ba2c-3bf3a360f03d None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:42.468590 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d834b9-ef2b-412e-ba2c-3bf3a360f03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:42.477540 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4b200-4a77-49b5-a94a-2591e4814777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:42.478209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4b200-4a77-49b5-a94a-2591e4814777 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:42.478487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4b200-4a77-49b5-a94a-2591e4814777 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:42.478805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4b200-4a77-49b5-a94a-2591e4814777 admin admin] PATH_INFO: `/v3/projects/b8caf528671c45c1ab579a7ca47c25e9/users/acdb663b8a424e42b95f086b8d418cb0/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:42.488511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-22d834b9-ef2b-412e-ba2c-3bf3a360f03d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:42.489726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-22d834b9-ef2b-412e-ba2c-3bf3a360f03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:42.493624 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4b200-4a77-49b5-a94a-2591e4814777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8caf528671c45c1ab579a7ca47c25e9, user_id=acdb663b8a424e42b95f086b8d418cb0, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:42.496302 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4b200-4a77-49b5-a94a-2591e4814777 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:42.497528 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 820/1646] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:42.498316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d834b9-ef2b-412e-ba2c-3bf3a360f03d None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:42.499607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-22d834b9-ef2b-412e-ba2c-3bf3a360f03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:42.511927 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 827/1647] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:42 2022] PUT /identity/v3/projects/b8caf528671c45c1ab579a7ca47c25e9/users/acdb663b8a424e42b95f086b8d418cb0/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:42.512747 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4b200-4a77-49b5-a94a-2591e4814777 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:42.513085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d834b9-ef2b-412e-ba2c-3bf3a360f03d None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:42.572694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8204e-65f8-41ec-9f56-afac7312072c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:42.573302 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8204e-65f8-41ec-9f56-afac7312072c admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:42.573581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8204e-65f8-41ec-9f56-afac7312072c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:42.573848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8204e-65f8-41ec-9f56-afac7312072c admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:42.574273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4b200-4a77-49b5-a94a-2591e4814777 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:42.574480 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8204e-65f8-41ec-9f56-afac7312072c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:42.576130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8204e-65f8-41ec-9f56-afac7312072c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:42.579145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b6d226-a985-422b-afda-59f4a1b1910c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:42.579748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6d226-a985-422b-afda-59f4a1b1910c admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:42.580140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6d226-a985-422b-afda-59f4a1b1910c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:42.580305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6d226-a985-422b-afda-59f4a1b1910c admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:42.580939 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b6d226-a985-422b-afda-59f4a1b1910c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:42.582530 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b6d226-a985-422b-afda-59f4a1b1910c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:42.586379 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 821/1648] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:42.587092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8204e-65f8-41ec-9f56-afac7312072c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:42.597563 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8204e-65f8-41ec-9f56-afac7312072c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:42.601344 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 828/1649] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:42.601344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518bb9d7-5b0c-42d7-ac73-2e0473e827a8 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:42.601344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518bb9d7-5b0c-42d7-ac73-2e0473e827a8 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:42.601344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518bb9d7-5b0c-42d7-ac73-2e0473e827a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:42.605308 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44204b75-5f97-4256-b75a-3b6e202c6c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:42.605912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44204b75-5f97-4256-b75a-3b6e202c6c45 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:42.606189 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44204b75-5f97-4256-b75a-3b6e202c6c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:42.606486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44204b75-5f97-4256-b75a-3b6e202c6c45 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:42.607172 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44204b75-5f97-4256-b75a-3b6e202c6c45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:42.608794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44204b75-5f97-4256-b75a-3b6e202c6c45 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:42.622212 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 822/1650] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:42.622212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44204b75-5f97-4256-b75a-3b6e202c6c45 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:42.622460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-518bb9d7-5b0c-42d7-ac73-2e0473e827a8 None None] MFA Rules not processed for user `5f9d53147a57402f8b9818590bc1fc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:42.622460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-518bb9d7-5b0c-42d7-ac73-2e0473e827a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:42.692514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44204b75-5f97-4256-b75a-3b6e202c6c45 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:42.694983 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 829/1651] 10.222.0.33 () {58 vars in 1059 bytes} [Sat Aug 6 20:53:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:42.695828 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518bb9d7-5b0c-42d7-ac73-2e0473e827a8 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:42.697148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-518bb9d7-5b0c-42d7-ac73-2e0473e827a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:42.698730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a359795-4ee5-4a60-a2c9-2c16a4354891 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:42.699466 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a359795-4ee5-4a60-a2c9-2c16a4354891 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:42.699747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a359795-4ee5-4a60-a2c9-2c16a4354891 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:42.700085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a359795-4ee5-4a60-a2c9-2c16a4354891 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:42.701861 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1a359795-4ee5-4a60-a2c9-2c16a4354891 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:42.714803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:42.750816 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:42.755643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518bb9d7-5b0c-42d7-ac73-2e0473e827a8 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:42.759923 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d961cdb-7582-4339-b015-e07f66e43d5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:42.760562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d961cdb-7582-4339-b015-e07f66e43d5b service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:42.761065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d961cdb-7582-4339-b015-e07f66e43d5b service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:42.761403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d961cdb-7582-4339-b015-e07f66e43d5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:42.768560 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a359795-4ee5-4a60-a2c9-2c16a4354891 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:42.770154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a359795-4ee5-4a60-a2c9-2c16a4354891 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:42.770995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d961cdb-7582-4339-b015-e07f66e43d5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:42.772402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d961cdb-7582-4339-b015-e07f66e43d5b service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:42.779629 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 823/1652] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:42 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:53:42.780417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a359795-4ee5-4a60-a2c9-2c16a4354891 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:42.781858 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 830/1653] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:53:42.782762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d961cdb-7582-4339-b015-e07f66e43d5b service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:42.790360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a359795-4ee5-4a60-a2c9-2c16a4354891 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:42.792562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d961cdb-7582-4339-b015-e07f66e43d5b service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:42.795693 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49884ba-de9c-42d8-bb9f-1f092aa8b86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:42.796391 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49884ba-de9c-42d8-bb9f-1f092aa8b86a admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:42.796731 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49884ba-de9c-42d8-bb9f-1f092aa8b86a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:42.797079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49884ba-de9c-42d8-bb9f-1f092aa8b86a admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:42.797748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102ca37-9398-4a33-bb3f-316bf4f3a6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:42.798053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49884ba-de9c-42d8-bb9f-1f092aa8b86a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:42.799489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102ca37-9398-4a33-bb3f-316bf4f3a6a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:42.799654 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102ca37-9398-4a33-bb3f-316bf4f3a6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:42.799926 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102ca37-9398-4a33-bb3f-316bf4f3a6a1 admin admin] PATH_INFO: `/v3/projects/f59b759a2f9e459f80ca6ddb78cc310a/users/e2a79f462917429ab8e5fedc86e170b2/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:42.800942 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49884ba-de9c-42d8-bb9f-1f092aa8b86a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:42.802083 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102ca37-9398-4a33-bb3f-316bf4f3a6a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f59b759a2f9e459f80ca6ddb78cc310a, user_id=e2a79f462917429ab8e5fedc86e170b2, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:42.804727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102ca37-9398-4a33-bb3f-316bf4f3a6a1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:42.812490 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 824/1654] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:42.813417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49884ba-de9c-42d8-bb9f-1f092aa8b86a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:42.817179 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 831/1655] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:42 2022] PUT /identity/v3/projects/f59b759a2f9e459f80ca6ddb78cc310a/users/e2a79f462917429ab8e5fedc86e170b2/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:42.818086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102ca37-9398-4a33-bb3f-316bf4f3a6a1 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:42.830501 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49884ba-de9c-42d8-bb9f-1f092aa8b86a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:42.906476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbbef9-c546-4cd8-9601-8564eda9d1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:42.907350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102ca37-9398-4a33-bb3f-316bf4f3a6a1 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:42.908125 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbbef9-c546-4cd8-9601-8564eda9d1d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:42.908792 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbbef9-c546-4cd8-9601-8564eda9d1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:42.908987 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbbef9-c546-4cd8-9601-8564eda9d1d6 admin admin] PATH_INFO: `/v3/projects/2950c56f39294460979ec191c18c7857/users/fb9c420d021d4d4aa8008bf24f6814b4/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:42.911933 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cbbef9-c546-4cd8-9601-8564eda9d1d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2950c56f39294460979ec191c18c7857, user_id=fb9c420d021d4d4aa8008bf24f6814b4, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:42.915574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cbbef9-c546-4cd8-9601-8564eda9d1d6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:42.923473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da892693-5eeb-4b04-be57-c463358f4ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:42.924861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da892693-5eeb-4b04-be57-c463358f4ef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:42.924861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da892693-5eeb-4b04-be57-c463358f4ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:42.926316 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da892693-5eeb-4b04-be57-c463358f4ef0 admin admin] PATH_INFO: `/v3/projects/125b3d3311b14ea89d160629d3c71ca3/users/75e6d55b14714a99b4a529e391b6c3ea/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:42.929873 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da892693-5eeb-4b04-be57-c463358f4ef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=125b3d3311b14ea89d160629d3c71ca3, user_id=75e6d55b14714a99b4a529e391b6c3ea, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:42.933096 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 825/1656] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:42 2022] PUT /identity/v3/projects/2950c56f39294460979ec191c18c7857/users/fb9c420d021d4d4aa8008bf24f6814b4/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:42.934099 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbbef9-c546-4cd8-9601-8564eda9d1d6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:42.937018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da892693-5eeb-4b04-be57-c463358f4ef0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:42.956090 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 832/1657] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:42 2022] PUT /identity/v3/projects/125b3d3311b14ea89d160629d3c71ca3/users/75e6d55b14714a99b4a529e391b6c3ea/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:42.957368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da892693-5eeb-4b04-be57-c463358f4ef0 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:43.033244 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da892693-5eeb-4b04-be57-c463358f4ef0 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:43.035681 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbbef9-c546-4cd8-9601-8564eda9d1d6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:43.039097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ced06-cfbe-4ce0-8a92-b1fc1ddb6585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:43.039768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ced06-cfbe-4ce0-8a92-b1fc1ddb6585 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:43.040037 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ced06-cfbe-4ce0-8a92-b1fc1ddb6585 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:43.040310 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ced06-cfbe-4ce0-8a92-b1fc1ddb6585 admin admin] PATH_INFO: `/v3/projects/b8caf528671c45c1ab579a7ca47c25e9/users/acdb663b8a424e42b95f086b8d418cb0/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:43.042458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ced06-cfbe-4ce0-8a92-b1fc1ddb6585 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8caf528671c45c1ab579a7ca47c25e9, user_id=acdb663b8a424e42b95f086b8d418cb0, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:43.046772 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ced06-cfbe-4ce0-8a92-b1fc1ddb6585 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:43.061055 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 833/1658] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:42 2022] PUT /identity/v3/projects/b8caf528671c45c1ab579a7ca47c25e9/users/acdb663b8a424e42b95f086b8d418cb0/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:43.062461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b0112-fbb5-4422-981d-84ad87fc51c1 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:43.062908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b0112-fbb5-4422-981d-84ad87fc51c1 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:43.063189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b0112-fbb5-4422-981d-84ad87fc51c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:43.075869 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:43.102581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-201b0112-fbb5-4422-981d-84ad87fc51c1 None None] MFA Rules not processed for user `e2a79f462917429ab8e5fedc86e170b2`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:43.104088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-201b0112-fbb5-4422-981d-84ad87fc51c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:43.154497 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208c9dc-dedd-425c-987a-4caedf4096b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:43.155273 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208c9dc-dedd-425c-987a-4caedf4096b5 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:43.155653 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208c9dc-dedd-425c-987a-4caedf4096b5 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:43.156150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208c9dc-dedd-425c-987a-4caedf4096b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:43.158497 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d208c9dc-dedd-425c-987a-4caedf4096b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:43.179609 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:43.207648 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 834/1659] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:43.212670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0d49e-2f93-4c3d-852c-bdd44fdf862c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:43.213136 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0d49e-2f93-4c3d-852c-bdd44fdf862c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:43.213416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0d49e-2f93-4c3d-852c-bdd44fdf862c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:43.236527 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208c9dc-dedd-425c-987a-4caedf4096b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:43.238231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208c9dc-dedd-425c-987a-4caedf4096b5 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:43.242240 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-8eb0d49e-2f93-4c3d-852c-bdd44fdf862c None None] MFA Rules not processed for user `fb9c420d021d4d4aa8008bf24f6814b4`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:43.243500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8eb0d49e-2f93-4c3d-852c-bdd44fdf862c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:43.248439 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 826/1660] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:42 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:53:43.249878 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4694b2-c202-4692-a987-de875c05e040 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:43.250167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4694b2-c202-4692-a987-de875c05e040 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:43.250437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4694b2-c202-4692-a987-de875c05e040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:43.280826 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-ab4694b2-c202-4692-a987-de875c05e040 None None] MFA Rules not processed for user `75e6d55b14714a99b4a529e391b6c3ea`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:43.282188 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ab4694b2-c202-4692-a987-de875c05e040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:43.323670 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 835/1661] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:43.325450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae802f-7284-458f-a58e-d1664c739ad3 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:43.326090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae802f-7284-458f-a58e-d1664c739ad3 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:43.326585 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae802f-7284-458f-a58e-d1664c739ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:43.357660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-cfae802f-7284-458f-a58e-d1664c739ad3 None None] MFA Rules not processed for user `acdb663b8a424e42b95f086b8d418cb0`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:43.359303 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-cfae802f-7284-458f-a58e-d1664c739ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:43.365139 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 827/1662] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:43 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:43.366186 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4694b2-c202-4692-a987-de875c05e040 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:43.424963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:43.454181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4694b2-c202-4692-a987-de875c05e040 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:43.458744 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 836/1663] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:43 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:43.459998 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae802f-7284-458f-a58e-d1664c739ad3 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:43.461892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-cfae802f-7284-458f-a58e-d1664c739ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:43.463217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c08f4c-117b-416f-aea9-fd8704983b89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:43.464018 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c08f4c-117b-416f-aea9-fd8704983b89 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:43.464413 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c08f4c-117b-416f-aea9-fd8704983b89 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:43.464795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c08f4c-117b-416f-aea9-fd8704983b89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:43.467014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-41c08f4c-117b-416f-aea9-fd8704983b89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:43.539546 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae802f-7284-458f-a58e-d1664c739ad3 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:43.543506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c08f4c-117b-416f-aea9-fd8704983b89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:43.544515 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0a368-71fc-442d-bb75-431c7b3e4d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:43.545209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0a368-71fc-442d-bb75-431c7b3e4d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:43.545557 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0a368-71fc-442d-bb75-431c7b3e4d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:43.545895 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0a368-71fc-442d-bb75-431c7b3e4d44 admin admin] PATH_INFO: `/v3/projects/9a5ec0446ba94bd798fe16bd5de8941a` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:43.546478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c08f4c-117b-416f-aea9-fd8704983b89 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:43.547158 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0a368-71fc-442d-bb75-431c7b3e4d44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a5ec0446ba94bd798fe16bd5de8941a)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:43.549651 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0a368-71fc-442d-bb75-431c7b3e4d44 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:43.552850 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:43.557662 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 828/1664] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:43 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:53:43.611302 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c08f4c-117b-416f-aea9-fd8704983b89 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:43.617248 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-82f0a368-71fc-442d-bb75-431c7b3e4d44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a5ec0446ba94bd798fe16bd5de8941a', 'request_id': 'req-82f0a368-71fc-442d-bb75-431c7b3e4d44'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:43.623244 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c08f4c-117b-416f-aea9-fd8704983b89 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:43.625036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-82f0a368-71fc-442d-bb75-431c7b3e4d44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a5ec0446ba94bd798fe16bd5de8941a', 'request_id': 'req-82f0a368-71fc-442d-bb75-431c7b3e4d44'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:43.637143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-82f0a368-71fc-442d-bb75-431c7b3e4d44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a5ec0446ba94bd798fe16bd5de8941a', 'request_id': 'req-82f0a368-71fc-442d-bb75-431c7b3e4d44'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:43.653884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-82f0a368-71fc-442d-bb75-431c7b3e4d44 admin admin] The token cache is being invalidate because project 9a5ec0446ba94bd798fe16bd5de8941a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:53:43.654174 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-82f0a368-71fc-442d-bb75-431c7b3e4d44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:43.654871 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-82f0a368-71fc-442d-bb75-431c7b3e4d44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:43.656682 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 837/1665] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:53:43 2022] DELETE /identity/v3/projects/9a5ec0446ba94bd798fe16bd5de8941a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:43.662938 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0a368-71fc-442d-bb75-431c7b3e4d44 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:43.664442 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-82f0a368-71fc-442d-bb75-431c7b3e4d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:43.707821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07305822-42cd-4d73-8bce-76ecf4ca2a54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:43.708431 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07305822-42cd-4d73-8bce-76ecf4ca2a54 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:43.708707 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07305822-42cd-4d73-8bce-76ecf4ca2a54 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:43.709027 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07305822-42cd-4d73-8bce-76ecf4ca2a54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:43.710760 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-07305822-42cd-4d73-8bce-76ecf4ca2a54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:43.741069 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0a368-71fc-442d-bb75-431c7b3e4d44 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:43.746825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276eac4-7a86-4a6b-af75-e151a1dcdc8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:43.747428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276eac4-7a86-4a6b-af75-e151a1dcdc8f service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:43.747709 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276eac4-7a86-4a6b-af75-e151a1dcdc8f service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:43.747984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276eac4-7a86-4a6b-af75-e151a1dcdc8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:43.749730 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3276eac4-7a86-4a6b-af75-e151a1dcdc8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:43.773752 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07305822-42cd-4d73-8bce-76ecf4ca2a54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:43.775414 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07305822-42cd-4d73-8bce-76ecf4ca2a54 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:43.785737 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 829/1666] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:43 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:53:43.787019 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4055ba-fbbd-40ad-b056-cb2f7ed1d47f None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:43.787305 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4055ba-fbbd-40ad-b056-cb2f7ed1d47f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:43.787592 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4055ba-fbbd-40ad-b056-cb2f7ed1d47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:43.811840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-2f4055ba-fbbd-40ad-b056-cb2f7ed1d47f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:43.813035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2f4055ba-fbbd-40ad-b056-cb2f7ed1d47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:43.819372 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276eac4-7a86-4a6b-af75-e151a1dcdc8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:43.820645 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276eac4-7a86-4a6b-af75-e151a1dcdc8f service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:43.822935 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:43.832061 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 838/1667] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:43 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:53:43.837778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276eac4-7a86-4a6b-af75-e151a1dcdc8f service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:43.840834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3276eac4-7a86-4a6b-af75-e151a1dcdc8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:43.856212 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276eac4-7a86-4a6b-af75-e151a1dcdc8f service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:43.863486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7cf48-f057-4f65-b793-cffc6aaf8c94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:43.866024 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7cf48-f057-4f65-b793-cffc6aaf8c94 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:43.866313 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7cf48-f057-4f65-b793-cffc6aaf8c94 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:43.866650 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7cf48-f057-4f65-b793-cffc6aaf8c94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:43.868657 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-61f7cf48-f057-4f65-b793-cffc6aaf8c94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:43.892795 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 830/1668] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:43.893832 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4055ba-fbbd-40ad-b056-cb2f7ed1d47f None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:43.903970 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:43.905620 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4055ba-fbbd-40ad-b056-cb2f7ed1d47f None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:43.911760 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460110fe-162a-4cda-8d1c-085b852b7c1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:43.912447 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460110fe-162a-4cda-8d1c-085b852b7c1b service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:43.912731 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460110fe-162a-4cda-8d1c-085b852b7c1b service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:43.912959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460110fe-162a-4cda-8d1c-085b852b7c1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:43.914741 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-460110fe-162a-4cda-8d1c-085b852b7c1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:43.949640 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7cf48-f057-4f65-b793-cffc6aaf8c94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:43.951300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7cf48-f057-4f65-b793-cffc6aaf8c94 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:43.962065 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 839/1669] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:43 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:53:43.963511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6ec02-5a05-4b9d-8aea-4d3685b1a03e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:43.963804 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6ec02-5a05-4b9d-8aea-4d3685b1a03e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:43.964080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6ec02-5a05-4b9d-8aea-4d3685b1a03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:43.981328 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460110fe-162a-4cda-8d1c-085b852b7c1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:43.982958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460110fe-162a-4cda-8d1c-085b852b7c1b service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:43.984282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-95f6ec02-5a05-4b9d-8aea-4d3685b1a03e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:43.985489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-95f6ec02-5a05-4b9d-8aea-4d3685b1a03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:43.999638 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 840/1670] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:43.999638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6ec02-5a05-4b9d-8aea-4d3685b1a03e None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:44.004623 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 831/1671] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:43 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:53:44.009521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6ec02-5a05-4b9d-8aea-4d3685b1a03e None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:44.014653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10afa180-86c0-4662-a332-b6d53387548e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:44.015779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10afa180-86c0-4662-a332-b6d53387548e admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:44.016182 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10afa180-86c0-4662-a332-b6d53387548e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:44.016805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10afa180-86c0-4662-a332-b6d53387548e admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:44.018162 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10afa180-86c0-4662-a332-b6d53387548e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:53:44.018468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10afa180-86c0-4662-a332-b6d53387548e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:44.020150 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10afa180-86c0-4662-a332-b6d53387548e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:44.039575 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 841/1672] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:53:44.040150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460110fe-162a-4cda-8d1c-085b852b7c1b service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:44.053964 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460110fe-162a-4cda-8d1c-085b852b7c1b service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:44.058896 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ef1dd-bb63-4214-af78-b442739d27b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:44.059506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ef1dd-bb63-4214-af78-b442739d27b9 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:44.059787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ef1dd-bb63-4214-af78-b442739d27b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:44.060049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ef1dd-bb63-4214-af78-b442739d27b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:44.060673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ef1dd-bb63-4214-af78-b442739d27b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:44.062596 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ef1dd-bb63-4214-af78-b442739d27b9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:44.109400 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 832/1673] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:53:44 2022] POST /identity/v3/projects => generated 387 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:53:44.111405 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10afa180-86c0-4662-a332-b6d53387548e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:44.122073 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10afa180-86c0-4662-a332-b6d53387548e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:44.199670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dcfcc6-3d74-4f21-a39d-fc50a47d80fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:44.200278 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcfcc6-3d74-4f21-a39d-fc50a47d80fc admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:44.200555 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcfcc6-3d74-4f21-a39d-fc50a47d80fc admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:44.200827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcfcc6-3d74-4f21-a39d-fc50a47d80fc admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:44.201453 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dcfcc6-3d74-4f21-a39d-fc50a47d80fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:44.203400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dcfcc6-3d74-4f21-a39d-fc50a47d80fc admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:44.208229 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ef1dd-bb63-4214-af78-b442739d27b9 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:44.234726 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 842/1674] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:53:44 2022] POST /identity/v3/users => generated 294 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:44.234726 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dcfcc6-3d74-4f21-a39d-fc50a47d80fc admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:44.236468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c2dcfcc6-3d74-4f21-a39d-fc50a47d80fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:44.251115 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dcfcc6-3d74-4f21-a39d-fc50a47d80fc admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:44.256902 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b161db-a304-4793-9848-fc02eae89666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:44.257854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b161db-a304-4793-9848-fc02eae89666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:44.258147 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b161db-a304-4793-9848-fc02eae89666 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:44.258427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b161db-a304-4793-9848-fc02eae89666 admin admin] PATH_INFO: `/v3/users/71f21ff3a8fb4296902f4eeb0c23cd98` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:44.259591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b161db-a304-4793-9848-fc02eae89666 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71f21ff3a8fb4296902f4eeb0c23cd98)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:44.261523 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b161db-a304-4793-9848-fc02eae89666 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:44.293970 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ef1dd-bb63-4214-af78-b442739d27b9 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:44.301466 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd246995-5424-42a4-9959-aeea264ab2d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:44.302360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd246995-5424-42a4-9959-aeea264ab2d9 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:44.302823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd246995-5424-42a4-9959-aeea264ab2d9 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:44.303465 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd246995-5424-42a4-9959-aeea264ab2d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:44.305397 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-fd246995-5424-42a4-9959-aeea264ab2d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:44.316466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e1b161db-a304-4793-9848-fc02eae89666 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71f21ff3a8fb4296902f4eeb0c23cd98'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:44.324674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e1b161db-a304-4793-9848-fc02eae89666 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71f21ff3a8fb4296902f4eeb0c23cd98'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:44.325435 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e1b161db-a304-4793-9848-fc02eae89666 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71f21ff3a8fb4296902f4eeb0c23cd98'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:44.326082 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e1b161db-a304-4793-9848-fc02eae89666 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71f21ff3a8fb4296902f4eeb0c23cd98'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:44.328785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:44.342996 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e1b161db-a304-4793-9848-fc02eae89666 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71f21ff3a8fb4296902f4eeb0c23cd98'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:44.362629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:44.369559 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 843/1675] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:53:44 2022] DELETE /identity/v3/users/71f21ff3a8fb4296902f4eeb0c23cd98 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:44.373336 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b161db-a304-4793-9848-fc02eae89666 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:44.375308 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd246995-5424-42a4-9959-aeea264ab2d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:44.376186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e1b161db-a304-4793-9848-fc02eae89666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:44.377492 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd246995-5424-42a4-9959-aeea264ab2d9 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:44.388847 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 833/1676] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:53:44.389968 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efeb754-64b6-4da2-8057-d3c057c4c785 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:44.390239 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efeb754-64b6-4da2-8057-d3c057c4c785 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:44.390657 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efeb754-64b6-4da2-8057-d3c057c4c785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:44.413409 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-9efeb754-64b6-4da2-8057-d3c057c4c785 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:44.414737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9efeb754-64b6-4da2-8057-d3c057c4c785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:44.454796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b161db-a304-4793-9848-fc02eae89666 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:44.460396 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd92a8-8e09-4333-834e-25b007f5eeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:44.461403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd92a8-8e09-4333-834e-25b007f5eeca admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:44.461742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd92a8-8e09-4333-834e-25b007f5eeca admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:44.462031 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd92a8-8e09-4333-834e-25b007f5eeca admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:44.463088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd92a8-8e09-4333-834e-25b007f5eeca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:44.464689 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd92a8-8e09-4333-834e-25b007f5eeca admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:44.475115 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 844/1677] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:44.475795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd92a8-8e09-4333-834e-25b007f5eeca admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:44.477472 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-83fd92a8-8e09-4333-834e-25b007f5eeca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:44.497739 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 834/1678] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:44.499119 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d850f-03d9-4292-b2ec-4390adbaa731 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:44.499410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d850f-03d9-4292-b2ec-4390adbaa731 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:44.499695 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d850f-03d9-4292-b2ec-4390adbaa731 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:44.502683 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 835/1679] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 20:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:53:44.503413 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d850f-03d9-4292-b2ec-4390adbaa731 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:44.515803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d850f-03d9-4292-b2ec-4390adbaa731 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:44.520923 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c3922-d0ba-4ec7-9b6a-14ac9252b178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:44.521250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c3922-d0ba-4ec7-9b6a-14ac9252b178 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:44.521527 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c3922-d0ba-4ec7-9b6a-14ac9252b178 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:44.521800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c3922-d0ba-4ec7-9b6a-14ac9252b178 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:44.522440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c3922-d0ba-4ec7-9b6a-14ac9252b178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:44.524081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c3922-d0ba-4ec7-9b6a-14ac9252b178 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:44.534787 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 836/1680] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:44.539316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3173bb-9261-4e6d-b162-84cfedbcb785 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:44.539607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3173bb-9261-4e6d-b162-84cfedbcb785 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:44.539882 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3173bb-9261-4e6d-b162-84cfedbcb785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:44.559417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-6b3173bb-9261-4e6d-b162-84cfedbcb785 None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:44.560596 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6b3173bb-9261-4e6d-b162-84cfedbcb785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:44.561009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd92a8-8e09-4333-834e-25b007f5eeca admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:44.567231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c275f-bfd3-46eb-a470-8456a1e48e41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:44.567868 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c275f-bfd3-46eb-a470-8456a1e48e41 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:44.568126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c275f-bfd3-46eb-a470-8456a1e48e41 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:44.568401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c275f-bfd3-46eb-a470-8456a1e48e41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:44.570151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-218c275f-bfd3-46eb-a470-8456a1e48e41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:44.624944 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 837/1681] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 20:53:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:44.625735 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3173bb-9261-4e6d-b162-84cfedbcb785 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:44.628008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6b3173bb-9261-4e6d-b162-84cfedbcb785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:44.630519 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c275f-bfd3-46eb-a470-8456a1e48e41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:44.632152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c275f-bfd3-46eb-a470-8456a1e48e41 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:44.644901 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 845/1682] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:53:44.645513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c275f-bfd3-46eb-a470-8456a1e48e41 service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:44.656630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c275f-bfd3-46eb-a470-8456a1e48e41 service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:44.662394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3413056-ac38-4ebb-8ee8-014251b5c0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:44.668205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3413056-ac38-4ebb-8ee8-014251b5c0c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:44.668205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3413056-ac38-4ebb-8ee8-014251b5c0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:44.668205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3413056-ac38-4ebb-8ee8-014251b5c0c5 admin admin] PATH_INFO: `/v3/projects/3f0afc603122424da744092d8ac29cee/users/f5f7743570b2465ea4d4397840485758/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:44.684630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3413056-ac38-4ebb-8ee8-014251b5c0c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f0afc603122424da744092d8ac29cee, user_id=f5f7743570b2465ea4d4397840485758, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:44.687502 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3413056-ac38-4ebb-8ee8-014251b5c0c5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:44.702718 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 846/1683] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:44 2022] PUT /identity/v3/projects/3f0afc603122424da744092d8ac29cee/users/f5f7743570b2465ea4d4397840485758/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:44.703552 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3413056-ac38-4ebb-8ee8-014251b5c0c5 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:44.705955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a3413056-ac38-4ebb-8ee8-014251b5c0c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:44.708663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:44.713254 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3173bb-9261-4e6d-b162-84cfedbcb785 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:44.718797 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:44.771025 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb503d1-eded-4102-aea4-79e3f9329c15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:44.771637 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb503d1-eded-4102-aea4-79e3f9329c15 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:44.771911 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb503d1-eded-4102-aea4-79e3f9329c15 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:44.772181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb503d1-eded-4102-aea4-79e3f9329c15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:44.805632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3413056-ac38-4ebb-8ee8-014251b5c0c5 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:44.811992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25fb5d-3c2a-4c53-aece-381c35ba9940 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:44.812886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25fb5d-3c2a-4c53-aece-381c35ba9940 service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:44.813451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25fb5d-3c2a-4c53-aece-381c35ba9940 service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:44.814620 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25fb5d-3c2a-4c53-aece-381c35ba9940 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:44.825910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25fb5d-3c2a-4c53-aece-381c35ba9940 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:44.827873 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25fb5d-3c2a-4c53-aece-381c35ba9940 service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:44.840833 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 847/1684] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:53:44.842738 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f168f-6601-4ce1-ac1c-de451b69a002 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:44.843365 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f168f-6601-4ce1-ac1c-de451b69a002 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:44.843813 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f168f-6601-4ce1-ac1c-de451b69a002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:44.848508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb503d1-eded-4102-aea4-79e3f9329c15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:44.850366 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb503d1-eded-4102-aea4-79e3f9329c15 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:44.874855 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 838/1685] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:53:44.891473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-2f7f168f-6601-4ce1-ac1c-de451b69a002 None None] MFA Rules not processed for user `f5f7743570b2465ea4d4397840485758`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:44.897102 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2f7f168f-6601-4ce1-ac1c-de451b69a002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:44.914277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb503d1-eded-4102-aea4-79e3f9329c15 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:44.916265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1eb503d1-eded-4102-aea4-79e3f9329c15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:44.935654 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb503d1-eded-4102-aea4-79e3f9329c15 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:44.942596 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8964367-0ae4-4dad-9d94-333df115ce4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:44.943259 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8964367-0ae4-4dad-9d94-333df115ce4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:44.943536 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8964367-0ae4-4dad-9d94-333df115ce4d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:44.943996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8964367-0ae4-4dad-9d94-333df115ce4d admin admin] PATH_INFO: `/v3/users/51644512697e4f9da16a3f977ea54db9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:44.945426 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8964367-0ae4-4dad-9d94-333df115ce4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=51644512697e4f9da16a3f977ea54db9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:44.948426 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8964367-0ae4-4dad-9d94-333df115ce4d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:45.009764 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 848/1686] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:45.014481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f168f-6601-4ce1-ac1c-de451b69a002 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:45.030088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b8964367-0ae4-4dad-9d94-333df115ce4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51644512697e4f9da16a3f977ea54db9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:45.031565 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f168f-6601-4ce1-ac1c-de451b69a002 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:45.037997 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75d461-3b67-488a-838a-a1cb83e3602f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:45.038687 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75d461-3b67-488a-838a-a1cb83e3602f admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:45.038969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75d461-3b67-488a-838a-a1cb83e3602f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:45.039242 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75d461-3b67-488a-838a-a1cb83e3602f admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:45.040326 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75d461-3b67-488a-838a-a1cb83e3602f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:45.042457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75d461-3b67-488a-838a-a1cb83e3602f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:45.045935 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b8964367-0ae4-4dad-9d94-333df115ce4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51644512697e4f9da16a3f977ea54db9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:45.048934 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b8964367-0ae4-4dad-9d94-333df115ce4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51644512697e4f9da16a3f977ea54db9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:45.080024 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 849/1687] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:53:45 2022] POST /identity/v3/projects => generated 389 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:45.081207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75d461-3b67-488a-838a-a1cb83e3602f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:45.084041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3c75d461-3b67-488a-838a-a1cb83e3602f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:45.086093 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b8964367-0ae4-4dad-9d94-333df115ce4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51644512697e4f9da16a3f977ea54db9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:45.114732 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b8964367-0ae4-4dad-9d94-333df115ce4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51644512697e4f9da16a3f977ea54db9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:45.150117 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 839/1688] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:53:44 2022] DELETE /identity/v3/users/51644512697e4f9da16a3f977ea54db9 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:53:45.151992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc16e43-7e8f-44e3-aaee-d7423ed95b24 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:45.152279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc16e43-7e8f-44e3-aaee-d7423ed95b24 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:45.152562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc16e43-7e8f-44e3-aaee-d7423ed95b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:45.213277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75d461-3b67-488a-838a-a1cb83e3602f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:45.220740 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-0dc16e43-7e8f-44e3-aaee-d7423ed95b24 None None] MFA Rules not processed for user `07d2a43d97f242e5a725eb5e12ba1cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:45.222483 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0dc16e43-7e8f-44e3-aaee-d7423ed95b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:45.225228 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:45.259891 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:45.311768 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 840/1689] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:45.314855 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774290c-c149-4589-9e56-3fd5bfda1836 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:45.314855 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774290c-c149-4589-9e56-3fd5bfda1836 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:45.314855 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774290c-c149-4589-9e56-3fd5bfda1836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:45.316400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438de611-1769-4dff-bd2c-fbe2546a7746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:45.317134 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438de611-1769-4dff-bd2c-fbe2546a7746 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:45.317643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438de611-1769-4dff-bd2c-fbe2546a7746 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:45.318028 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438de611-1769-4dff-bd2c-fbe2546a7746 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:45.318696 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438de611-1769-4dff-bd2c-fbe2546a7746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:45.320651 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438de611-1769-4dff-bd2c-fbe2546a7746 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:45.336859 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-6774290c-c149-4589-9e56-3fd5bfda1836 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:45.338410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6774290c-c149-4589-9e56-3fd5bfda1836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:45.351329 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 841/1690] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:45.351329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774290c-c149-4589-9e56-3fd5bfda1836 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:45.351329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6774290c-c149-4589-9e56-3fd5bfda1836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:45.361240 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 850/1691] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:53:45 2022] POST /identity/v3/users => generated 301 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:53:45.361240 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438de611-1769-4dff-bd2c-fbe2546a7746 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:45.365521 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774290c-c149-4589-9e56-3fd5bfda1836 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:45.367295 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-438de611-1769-4dff-bd2c-fbe2546a7746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:45.370353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e67d4-e934-4a7b-99e8-71bf006cd184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:45.371098 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e67d4-e934-4a7b-99e8-71bf006cd184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:45.371376 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e67d4-e934-4a7b-99e8-71bf006cd184 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:45.371642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e67d4-e934-4a7b-99e8-71bf006cd184 admin admin] PATH_INFO: `/v3/users/c9aae35d370942b0ab5c41cd231c42a6` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:45.372765 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633e67d4-e934-4a7b-99e8-71bf006cd184 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9aae35d370942b0ab5c41cd231c42a6)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:45.375132 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633e67d4-e934-4a7b-99e8-71bf006cd184 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:45.454992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-633e67d4-e934-4a7b-99e8-71bf006cd184 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9aae35d370942b0ab5c41cd231c42a6'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:45.455877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-633e67d4-e934-4a7b-99e8-71bf006cd184 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9aae35d370942b0ab5c41cd231c42a6'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:45.456576 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-633e67d4-e934-4a7b-99e8-71bf006cd184 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9aae35d370942b0ab5c41cd231c42a6'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:45.464422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-633e67d4-e934-4a7b-99e8-71bf006cd184 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9aae35d370942b0ab5c41cd231c42a6'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:45.477479 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-633e67d4-e934-4a7b-99e8-71bf006cd184 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9aae35d370942b0ab5c41cd231c42a6'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:45.478206 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438de611-1769-4dff-bd2c-fbe2546a7746 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:45.484087 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab381bf-63cd-48ba-9b45-4394a2825c93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:45.484712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab381bf-63cd-48ba-9b45-4394a2825c93 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:45.484988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab381bf-63cd-48ba-9b45-4394a2825c93 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:45.485263 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab381bf-63cd-48ba-9b45-4394a2825c93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:45.487854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3ab381bf-63cd-48ba-9b45-4394a2825c93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:45.490535 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 842/1692] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:53:45 2022] DELETE /identity/v3/users/c9aae35d370942b0ab5c41cd231c42a6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:45.491422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e67d4-e934-4a7b-99e8-71bf006cd184 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:45.492697 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-633e67d4-e934-4a7b-99e8-71bf006cd184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:45.498853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab381bf-63cd-48ba-9b45-4394a2825c93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:45.500536 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab381bf-63cd-48ba-9b45-4394a2825c93 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:45.510118 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 851/1693] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:53:45.514391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab381bf-63cd-48ba-9b45-4394a2825c93 service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:45.515849 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3ab381bf-63cd-48ba-9b45-4394a2825c93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:45.535918 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab381bf-63cd-48ba-9b45-4394a2825c93 service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:45.559983 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e67d4-e934-4a7b-99e8-71bf006cd184 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:45.564612 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e208c8c-0a81-4290-a30e-04174c0bd5fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:45.565469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e208c8c-0a81-4290-a30e-04174c0bd5fe service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:45.565748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e208c8c-0a81-4290-a30e-04174c0bd5fe service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:45.566020 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e208c8c-0a81-4290-a30e-04174c0bd5fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:45.567932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8e208c8c-0a81-4290-a30e-04174c0bd5fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:45.607352 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3dba40-1a5a-43b5-a072-39508c4b9700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:45.607965 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3dba40-1a5a-43b5-a072-39508c4b9700 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:45.608245 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3dba40-1a5a-43b5-a072-39508c4b9700 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:45.608517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3dba40-1a5a-43b5-a072-39508c4b9700 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:45.609178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3dba40-1a5a-43b5-a072-39508c4b9700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:45.611507 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3dba40-1a5a-43b5-a072-39508c4b9700 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:45.618444 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:45.622522 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 852/1694] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:45.623436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3dba40-1a5a-43b5-a072-39508c4b9700 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:45.625075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-bd3dba40-1a5a-43b5-a072-39508c4b9700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:45.638187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3dba40-1a5a-43b5-a072-39508c4b9700 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:45.639080 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e208c8c-0a81-4290-a30e-04174c0bd5fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:45.640503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e208c8c-0a81-4290-a30e-04174c0bd5fe service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:45.644001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f9268-444a-4e02-ba2e-12c238363757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:45.644625 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f9268-444a-4e02-ba2e-12c238363757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:45.644906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f9268-444a-4e02-ba2e-12c238363757 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:45.645180 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f9268-444a-4e02-ba2e-12c238363757 admin admin] PATH_INFO: `/v3/projects/509f8960df214976b58edbce0de6d2bb` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:45.646279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f9268-444a-4e02-ba2e-12c238363757 admin admin] RBAC: Authorizing `identity:delete_project(project_id=509f8960df214976b58edbce0de6d2bb)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:45.648225 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f9268-444a-4e02-ba2e-12c238363757 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:45.650786 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 843/1695] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:53:45.651651 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e208c8c-0a81-4290-a30e-04174c0bd5fe service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:45.652966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8e208c8c-0a81-4290-a30e-04174c0bd5fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:45.667784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e208c8c-0a81-4290-a30e-04174c0bd5fe service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:45.676895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d009ec-9cbe-4516-b437-a78309e20736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:45.677537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d009ec-9cbe-4516-b437-a78309e20736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:45.677816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d009ec-9cbe-4516-b437-a78309e20736 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:45.678089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d009ec-9cbe-4516-b437-a78309e20736 admin admin] PATH_INFO: `/v3/users/e58dc1fca46b4cb7ad023caa3c762fce` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:45.678333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:45.679292 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d009ec-9cbe-4516-b437-a78309e20736 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e58dc1fca46b4cb7ad023caa3c762fce)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:45.681570 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d009ec-9cbe-4516-b437-a78309e20736 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:45.716734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-393f9268-444a-4e02-ba2e-12c238363757 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '509f8960df214976b58edbce0de6d2bb', 'request_id': 'req-393f9268-444a-4e02-ba2e-12c238363757'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:45.723551 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-393f9268-444a-4e02-ba2e-12c238363757 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '509f8960df214976b58edbce0de6d2bb', 'request_id': 'req-393f9268-444a-4e02-ba2e-12c238363757'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:45.731206 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-393f9268-444a-4e02-ba2e-12c238363757 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '509f8960df214976b58edbce0de6d2bb', 'request_id': 'req-393f9268-444a-4e02-ba2e-12c238363757'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:45.741350 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-25d009ec-9cbe-4516-b437-a78309e20736 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e58dc1fca46b4cb7ad023caa3c762fce'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:45.742312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-25d009ec-9cbe-4516-b437-a78309e20736 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e58dc1fca46b4cb7ad023caa3c762fce'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:45.743258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-25d009ec-9cbe-4516-b437-a78309e20736 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e58dc1fca46b4cb7ad023caa3c762fce'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:45.745145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-393f9268-444a-4e02-ba2e-12c238363757 admin admin] The token cache is being invalidate because project 509f8960df214976b58edbce0de6d2bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:53:45.745492 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-393f9268-444a-4e02-ba2e-12c238363757 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:45.746424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-393f9268-444a-4e02-ba2e-12c238363757 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:45.748424 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 853/1696] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:53:45 2022] DELETE /identity/v3/projects/509f8960df214976b58edbce0de6d2bb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:45.749657 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8dabb5-334b-4646-a415-0bf32fb6636d None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:45.750237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8dabb5-334b-4646-a415-0bf32fb6636d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:45.750396 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8dabb5-334b-4646-a415-0bf32fb6636d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:45.753951 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-25d009ec-9cbe-4516-b437-a78309e20736 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e58dc1fca46b4cb7ad023caa3c762fce'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:45.772337 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-3e8dabb5-334b-4646-a415-0bf32fb6636d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:45.773922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-25d009ec-9cbe-4516-b437-a78309e20736 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e58dc1fca46b4cb7ad023caa3c762fce'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:45.774043 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3e8dabb5-334b-4646-a415-0bf32fb6636d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:45.790467 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 844/1697] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:53:45 2022] DELETE /identity/v3/users/e58dc1fca46b4cb7ad023caa3c762fce => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:45.791947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6754a-7708-47c1-ab3a-bbdfeeaba662 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:45.792364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6754a-7708-47c1-ab3a-bbdfeeaba662 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:45.792942 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6754a-7708-47c1-ab3a-bbdfeeaba662 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:45.794738 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 845/1698] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 20:53:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:53:45.802044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6754a-7708-47c1-ab3a-bbdfeeaba662 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:45.804259 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7cd6754a-7708-47c1-ab3a-bbdfeeaba662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:45.846574 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 854/1699] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:45.848128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8dabb5-334b-4646-a415-0bf32fb6636d None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:45.850484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3e8dabb5-334b-4646-a415-0bf32fb6636d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:45.863472 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8dabb5-334b-4646-a415-0bf32fb6636d None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:45.885432 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6754a-7708-47c1-ab3a-bbdfeeaba662 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:45.890081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c496da0-fd93-4eed-ba1c-b88cc8120ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:45.890777 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c496da0-fd93-4eed-ba1c-b88cc8120ae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:45.891051 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c496da0-fd93-4eed-ba1c-b88cc8120ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:45.891316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c496da0-fd93-4eed-ba1c-b88cc8120ae2 admin admin] PATH_INFO: `/v3/projects/a6ba6b85faa84d33abbd01a2b327fdbe/users/a26c3c59c0644e4984543cb26f000425/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:45.911032 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c496da0-fd93-4eed-ba1c-b88cc8120ae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ba6b85faa84d33abbd01a2b327fdbe, user_id=a26c3c59c0644e4984543cb26f000425, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:45.914077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c496da0-fd93-4eed-ba1c-b88cc8120ae2 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:45.929819 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 846/1700] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:45 2022] PUT /identity/v3/projects/a6ba6b85faa84d33abbd01a2b327fdbe/users/a26c3c59c0644e4984543cb26f000425/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:45.931268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64e6ef-eac0-4189-8cb7-63ab2913cd01 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:45.931691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64e6ef-eac0-4189-8cb7-63ab2913cd01 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:45.931870 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64e6ef-eac0-4189-8cb7-63ab2913cd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:45.933466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d7b18-320d-4709-a85d-1bfcd8008323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:45.934291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d7b18-320d-4709-a85d-1bfcd8008323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:45.934831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d7b18-320d-4709-a85d-1bfcd8008323 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:45.935146 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d7b18-320d-4709-a85d-1bfcd8008323 admin admin] PATH_INFO: `/v3/users/fb9c420d021d4d4aa8008bf24f6814b4` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:45.936452 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d7b18-320d-4709-a85d-1bfcd8008323 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb9c420d021d4d4aa8008bf24f6814b4)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:45.938735 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d7b18-320d-4709-a85d-1bfcd8008323 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:45.953837 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-6a64e6ef-eac0-4189-8cb7-63ab2913cd01 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:45.955911 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6a64e6ef-eac0-4189-8cb7-63ab2913cd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:45.994500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b70d7b18-320d-4709-a85d-1bfcd8008323 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb9c420d021d4d4aa8008bf24f6814b4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:45.996569 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:46.001173 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:46.002584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b70d7b18-320d-4709-a85d-1bfcd8008323 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb9c420d021d4d4aa8008bf24f6814b4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:46.003521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b70d7b18-320d-4709-a85d-1bfcd8008323 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb9c420d021d4d4aa8008bf24f6814b4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:46.004878 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b70d7b18-320d-4709-a85d-1bfcd8008323 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb9c420d021d4d4aa8008bf24f6814b4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:46.013999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b70d7b18-320d-4709-a85d-1bfcd8008323 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb9c420d021d4d4aa8008bf24f6814b4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:46.026983 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 847/1701] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:46.028222 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10aa023-63ca-48b9-8a29-4a1c21f01901 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:46.028511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10aa023-63ca-48b9-8a29-4a1c21f01901 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:46.028784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10aa023-63ca-48b9-8a29-4a1c21f01901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:46.034718 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 855/1702] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:53:45 2022] DELETE /identity/v3/users/fb9c420d021d4d4aa8008bf24f6814b4 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:46.035231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d7b18-320d-4709-a85d-1bfcd8008323 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:46.036900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b70d7b18-320d-4709-a85d-1bfcd8008323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:46.051461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a10aa023-63ca-48b9-8a29-4a1c21f01901 None None] MFA Rules not processed for user `5f9d53147a57402f8b9818590bc1fc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:46.052683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a10aa023-63ca-48b9-8a29-4a1c21f01901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:46.116581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d7b18-320d-4709-a85d-1bfcd8008323 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:46.120961 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d10235-d764-4234-a730-c6a3b73894d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:46.121569 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d10235-d764-4234-a730-c6a3b73894d9 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:46.121848 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d10235-d764-4234-a730-c6a3b73894d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:46.122312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d10235-d764-4234-a730-c6a3b73894d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:46.124106 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c2d10235-d764-4234-a730-c6a3b73894d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:46.140174 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 848/1703] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 20:53:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:46.141056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10aa023-63ca-48b9-8a29-4a1c21f01901 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:46.143204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a10aa023-63ca-48b9-8a29-4a1c21f01901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:46.208675 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d10235-d764-4234-a730-c6a3b73894d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:46.210157 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d10235-d764-4234-a730-c6a3b73894d9 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:46.220837 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 856/1704] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:53:46.221883 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d10235-d764-4234-a730-c6a3b73894d9 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:46.223816 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c2d10235-d764-4234-a730-c6a3b73894d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:46.224935 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10aa023-63ca-48b9-8a29-4a1c21f01901 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:46.230042 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ed61b-1f9f-42d9-893b-fa33c9fbd9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:46.230810 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ed61b-1f9f-42d9-893b-fa33c9fbd9ac admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:46.231228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ed61b-1f9f-42d9-893b-fa33c9fbd9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:46.231572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ed61b-1f9f-42d9-893b-fa33c9fbd9ac admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:46.232486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ed61b-1f9f-42d9-893b-fa33c9fbd9ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:46.234704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ed61b-1f9f-42d9-893b-fa33c9fbd9ac admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:46.237385 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d10235-d764-4234-a730-c6a3b73894d9 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:46.243153 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8815830-b282-46f8-8fbc-80ed643c3517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:46.244278 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8815830-b282-46f8-8fbc-80ed643c3517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:46.244745 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8815830-b282-46f8-8fbc-80ed643c3517 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:46.245201 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8815830-b282-46f8-8fbc-80ed643c3517 admin admin] PATH_INFO: `/v3/projects/c7125ce2f8e24dbfb979eb53578320f2` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:46.247863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8815830-b282-46f8-8fbc-80ed643c3517 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7125ce2f8e24dbfb979eb53578320f2)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:46.248786 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 849/1705] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:46.249717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ed61b-1f9f-42d9-893b-fa33c9fbd9ac admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:46.251644 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8815830-b282-46f8-8fbc-80ed643c3517 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:46.265439 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ed61b-1f9f-42d9-893b-fa33c9fbd9ac admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:46.270277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc20c23-5d5d-45ba-8e59-10ff5c60bee0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:46.270808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc20c23-5d5d-45ba-8e59-10ff5c60bee0 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:46.271082 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc20c23-5d5d-45ba-8e59-10ff5c60bee0 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:46.271360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc20c23-5d5d-45ba-8e59-10ff5c60bee0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:46.282833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc20c23-5d5d-45ba-8e59-10ff5c60bee0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:46.285164 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc20c23-5d5d-45ba-8e59-10ff5c60bee0 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:46.298737 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 850/1706] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:53:46.300075 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc20c23-5d5d-45ba-8e59-10ff5c60bee0 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:46.301490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9bc20c23-5d5d-45ba-8e59-10ff5c60bee0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:46.326877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c8815830-b282-46f8-8fbc-80ed643c3517 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7125ce2f8e24dbfb979eb53578320f2', 'request_id': 'req-c8815830-b282-46f8-8fbc-80ed643c3517'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:46.334904 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c8815830-b282-46f8-8fbc-80ed643c3517 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7125ce2f8e24dbfb979eb53578320f2', 'request_id': 'req-c8815830-b282-46f8-8fbc-80ed643c3517'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:46.350072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c8815830-b282-46f8-8fbc-80ed643c3517 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7125ce2f8e24dbfb979eb53578320f2', 'request_id': 'req-c8815830-b282-46f8-8fbc-80ed643c3517'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:46.364077 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:46.369327 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c8815830-b282-46f8-8fbc-80ed643c3517 admin admin] The token cache is being invalidate because project c7125ce2f8e24dbfb979eb53578320f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:53:46.369619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c8815830-b282-46f8-8fbc-80ed643c3517 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:46.370441 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c8815830-b282-46f8-8fbc-80ed643c3517 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:46.372857 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 857/1707] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:53:46 2022] DELETE /identity/v3/projects/c7125ce2f8e24dbfb979eb53578320f2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:46.378456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8815830-b282-46f8-8fbc-80ed643c3517 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:46.380836 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c8815830-b282-46f8-8fbc-80ed643c3517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:46.412907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:46.435216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc20c23-5d5d-45ba-8e59-10ff5c60bee0 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:46.465328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8815830-b282-46f8-8fbc-80ed643c3517 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:46.472150 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18f4b8-8f1a-4355-9361-b1dd9e985871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:46.473139 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18f4b8-8f1a-4355-9361-b1dd9e985871 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:46.473498 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18f4b8-8f1a-4355-9361-b1dd9e985871 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:46.473847 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18f4b8-8f1a-4355-9361-b1dd9e985871 admin admin] PATH_INFO: `/v3/projects/a6ba6b85faa84d33abbd01a2b327fdbe/users/a26c3c59c0644e4984543cb26f000425/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:46.476236 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18f4b8-8f1a-4355-9361-b1dd9e985871 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ba6b85faa84d33abbd01a2b327fdbe, user_id=a26c3c59c0644e4984543cb26f000425, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:46.479553 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18f4b8-8f1a-4355-9361-b1dd9e985871 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:46.502906 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 858/1708] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:46 2022] PUT /identity/v3/projects/a6ba6b85faa84d33abbd01a2b327fdbe/users/a26c3c59c0644e4984543cb26f000425/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:46.502906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18f4b8-8f1a-4355-9361-b1dd9e985871 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:46.502906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1d18f4b8-8f1a-4355-9361-b1dd9e985871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:46.503503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c306f-6912-409a-b7af-46d6e99a595a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10759b2abd4cafacf338551327775e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:46.503503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c306f-6912-409a-b7af-46d6e99a595a service glance] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:46.503503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c306f-6912-409a-b7af-46d6e99a595a service glance] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:46.503503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c306f-6912-409a-b7af-46d6e99a595a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:46.504173 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c40c306f-6912-409a-b7af-46d6e99a595a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:46.575771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18f4b8-8f1a-4355-9361-b1dd9e985871 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:46.581054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73c64a-f28e-4790-aa15-ff4ed8f7d80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:46.581819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73c64a-f28e-4790-aa15-ff4ed8f7d80d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:46.582222 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73c64a-f28e-4790-aa15-ff4ed8f7d80d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:46.582222 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73c64a-f28e-4790-aa15-ff4ed8f7d80d admin admin] PATH_INFO: `/v3/projects/2950c56f39294460979ec191c18c7857` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:46.583444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73c64a-f28e-4790-aa15-ff4ed8f7d80d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2950c56f39294460979ec191c18c7857)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:46.585391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73c64a-f28e-4790-aa15-ff4ed8f7d80d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:46.619304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c306f-6912-409a-b7af-46d6e99a595a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:46.621282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c306f-6912-409a-b7af-46d6e99a595a service glance] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:46.634153 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 851/1709] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:53:46.635233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c306f-6912-409a-b7af-46d6e99a595a service glance] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:46.636638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c40c306f-6912-409a-b7af-46d6e99a595a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:46.638730 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7c73c64a-f28e-4790-aa15-ff4ed8f7d80d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2950c56f39294460979ec191c18c7857', 'request_id': 'req-7c73c64a-f28e-4790-aa15-ff4ed8f7d80d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:46.645562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7c73c64a-f28e-4790-aa15-ff4ed8f7d80d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2950c56f39294460979ec191c18c7857', 'request_id': 'req-7c73c64a-f28e-4790-aa15-ff4ed8f7d80d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:46.652484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c306f-6912-409a-b7af-46d6e99a595a service glance] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:46.656347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7c73c64a-f28e-4790-aa15-ff4ed8f7d80d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2950c56f39294460979ec191c18c7857', 'request_id': 'req-7c73c64a-f28e-4790-aa15-ff4ed8f7d80d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:46.681011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7c73c64a-f28e-4790-aa15-ff4ed8f7d80d admin admin] The token cache is being invalidate because project 2950c56f39294460979ec191c18c7857 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:53:46.681713 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7c73c64a-f28e-4790-aa15-ff4ed8f7d80d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:46.683339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7c73c64a-f28e-4790-aa15-ff4ed8f7d80d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:46.686058 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 859/1710] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:53:46 2022] DELETE /identity/v3/projects/2950c56f39294460979ec191c18c7857 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:46.688391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcaed20-f2b8-4bc8-b0c6-2adc06fc84d8 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:46.689471 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcaed20-f2b8-4bc8-b0c6-2adc06fc84d8 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:46.692118 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcaed20-f2b8-4bc8-b0c6-2adc06fc84d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:46.734357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-8dcaed20-f2b8-4bc8-b0c6-2adc06fc84d8 None None] MFA Rules not processed for user `a26c3c59c0644e4984543cb26f000425`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:46.736410 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8dcaed20-f2b8-4bc8-b0c6-2adc06fc84d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:46.755717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:46.763628 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce6ac3-f8d7-4c6b-a5b3-61f5933ad7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:46.764170 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce6ac3-f8d7-4c6b-a5b3-61f5933ad7c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:46.764556 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce6ac3-f8d7-4c6b-a5b3-61f5933ad7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:46.764760 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce6ac3-f8d7-4c6b-a5b3-61f5933ad7c9 admin admin] PATH_INFO: `/v3/users/dcba5f912cd743379093fd3a1b463f4c` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:46.765977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce6ac3-f8d7-4c6b-a5b3-61f5933ad7c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcba5f912cd743379093fd3a1b463f4c)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:46.768508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce6ac3-f8d7-4c6b-a5b3-61f5933ad7c9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:46.827344 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:46.841319 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1cce6ac3-f8d7-4c6b-a5b3-61f5933ad7c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcba5f912cd743379093fd3a1b463f4c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:46.841319 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1cce6ac3-f8d7-4c6b-a5b3-61f5933ad7c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcba5f912cd743379093fd3a1b463f4c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:46.841979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1cce6ac3-f8d7-4c6b-a5b3-61f5933ad7c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcba5f912cd743379093fd3a1b463f4c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:46.855969 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1cce6ac3-f8d7-4c6b-a5b3-61f5933ad7c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcba5f912cd743379093fd3a1b463f4c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:46.861378 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 860/1711] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:46 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:46.862953 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef7d63-5c9f-4370-8f8d-033b064b762b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:46.863338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef7d63-5c9f-4370-8f8d-033b064b762b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:46.863716 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef7d63-5c9f-4370-8f8d-033b064b762b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:46.871992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1cce6ac3-f8d7-4c6b-a5b3-61f5933ad7c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcba5f912cd743379093fd3a1b463f4c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:46.885548 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-6cef7d63-5c9f-4370-8f8d-033b064b762b None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:46.886005 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 852/1712] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:53:46 2022] DELETE /identity/v3/users/dcba5f912cd743379093fd3a1b463f4c => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:46.886854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6cef7d63-5c9f-4370-8f8d-033b064b762b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:46.886959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce6ac3-f8d7-4c6b-a5b3-61f5933ad7c9 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:46.889853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1cce6ac3-f8d7-4c6b-a5b3-61f5933ad7c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:46.985459 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce6ac3-f8d7-4c6b-a5b3-61f5933ad7c9 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:46.990404 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd090b5-6e16-4c0b-bd9d-9f6ff94c52e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:46.991184 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd090b5-6e16-4c0b-bd9d-9f6ff94c52e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:46.991491 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd090b5-6e16-4c0b-bd9d-9f6ff94c52e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:46.991734 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd090b5-6e16-4c0b-bd9d-9f6ff94c52e4 admin admin] PATH_INFO: `/v3/projects/d6719194184a469980d1e28b1b841628` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:46.993093 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd090b5-6e16-4c0b-bd9d-9f6ff94c52e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6719194184a469980d1e28b1b841628)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:46.994128 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-1dd090b5-6e16-4c0b-bd9d-9f6ff94c52e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:46.994128 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 20:53:46.994128 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 20:53:46.994710 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 861/1713] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:46.995346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd090b5-6e16-4c0b-bd9d-9f6ff94c52e4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:46.995784 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef7d63-5c9f-4370-8f8d-033b064b762b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:46.997217 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6cef7d63-5c9f-4370-8f8d-033b064b762b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:47.027217 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef7d63-5c9f-4370-8f8d-033b064b762b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:47.033890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191eb152-16ab-4f44-b275-f5c40ff01abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:47.034760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191eb152-16ab-4f44-b275-f5c40ff01abe admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:47.035236 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191eb152-16ab-4f44-b275-f5c40ff01abe admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:47.036273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191eb152-16ab-4f44-b275-f5c40ff01abe admin admin] PATH_INFO: `/v3/projects/14ded09d02714f33bad32ed516e1981e` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:47.038824 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191eb152-16ab-4f44-b275-f5c40ff01abe admin admin] RBAC: Authorizing `identity:delete_project(project_id=14ded09d02714f33bad32ed516e1981e)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:47.042397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191eb152-16ab-4f44-b275-f5c40ff01abe admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:47.064481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1dd090b5-6e16-4c0b-bd9d-9f6ff94c52e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6719194184a469980d1e28b1b841628', 'request_id': 'req-1dd090b5-6e16-4c0b-bd9d-9f6ff94c52e4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:47.074227 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1dd090b5-6e16-4c0b-bd9d-9f6ff94c52e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6719194184a469980d1e28b1b841628', 'request_id': 'req-1dd090b5-6e16-4c0b-bd9d-9f6ff94c52e4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:47.091054 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1dd090b5-6e16-4c0b-bd9d-9f6ff94c52e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6719194184a469980d1e28b1b841628', 'request_id': 'req-1dd090b5-6e16-4c0b-bd9d-9f6ff94c52e4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:47.116757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-191eb152-16ab-4f44-b275-f5c40ff01abe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14ded09d02714f33bad32ed516e1981e', 'request_id': 'req-191eb152-16ab-4f44-b275-f5c40ff01abe'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:47.118244 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1dd090b5-6e16-4c0b-bd9d-9f6ff94c52e4 admin admin] The token cache is being invalidate because project d6719194184a469980d1e28b1b841628 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:53:47.119495 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1dd090b5-6e16-4c0b-bd9d-9f6ff94c52e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:47.120748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1dd090b5-6e16-4c0b-bd9d-9f6ff94c52e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:47.123739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-191eb152-16ab-4f44-b275-f5c40ff01abe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14ded09d02714f33bad32ed516e1981e', 'request_id': 'req-191eb152-16ab-4f44-b275-f5c40ff01abe'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:47.123916 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 853/1714] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:53:46 2022] DELETE /identity/v3/projects/d6719194184a469980d1e28b1b841628 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:47.128647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a95b3b-ef0e-4b93-9e68-93314bd2d8ef None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:47.129524 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a95b3b-ef0e-4b93-9e68-93314bd2d8ef None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:47.129877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a95b3b-ef0e-4b93-9e68-93314bd2d8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:47.137027 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-191eb152-16ab-4f44-b275-f5c40ff01abe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14ded09d02714f33bad32ed516e1981e', 'request_id': 'req-191eb152-16ab-4f44-b275-f5c40ff01abe'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:47.156328 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d0a95b3b-ef0e-4b93-9e68-93314bd2d8ef None None] MFA Rules not processed for user `f5f7743570b2465ea4d4397840485758`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:47.156933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-191eb152-16ab-4f44-b275-f5c40ff01abe admin admin] The token cache is being invalidate because project 14ded09d02714f33bad32ed516e1981e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:53:47.157801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-191eb152-16ab-4f44-b275-f5c40ff01abe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:47.158657 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-191eb152-16ab-4f44-b275-f5c40ff01abe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:47.159867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d0a95b3b-ef0e-4b93-9e68-93314bd2d8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:47.164002 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 862/1715] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:53:46 2022] DELETE /identity/v3/projects/14ded09d02714f33bad32ed516e1981e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:47.166245 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406e08c-5e6e-4e76-8c3b-8727c51acf99 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:47.166532 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406e08c-5e6e-4e76-8c3b-8727c51acf99 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:47.166874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406e08c-5e6e-4e76-8c3b-8727c51acf99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:47.198224 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a406e08c-5e6e-4e76-8c3b-8727c51acf99 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:47.199487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a406e08c-5e6e-4e76-8c3b-8727c51acf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:47.228254 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:47.249789 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:47.272959 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 854/1716] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:47.278156 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a95b3b-ef0e-4b93-9e68-93314bd2d8ef None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:47.280842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d0a95b3b-ef0e-4b93-9e68-93314bd2d8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:47.309077 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 863/1717] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:47.309997 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406e08c-5e6e-4e76-8c3b-8727c51acf99 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:47.312495 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a406e08c-5e6e-4e76-8c3b-8727c51acf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:47.334891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406e08c-5e6e-4e76-8c3b-8727c51acf99 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:47.342144 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4bddf-de12-4844-8fcf-68cb86624479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:47.342891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4bddf-de12-4844-8fcf-68cb86624479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:47.343174 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4bddf-de12-4844-8fcf-68cb86624479 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:47.343445 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4bddf-de12-4844-8fcf-68cb86624479 admin admin] PATH_INFO: `/v3/users/e2a79f462917429ab8e5fedc86e170b2` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:47.344578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a4bddf-de12-4844-8fcf-68cb86624479 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2a79f462917429ab8e5fedc86e170b2)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:47.348570 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a4bddf-de12-4844-8fcf-68cb86624479 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:47.376258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a95b3b-ef0e-4b93-9e68-93314bd2d8ef None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:47.381728 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3664f-6431-4528-a946-f18835691e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:47.382354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3664f-6431-4528-a946-f18835691e3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:47.382657 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3664f-6431-4528-a946-f18835691e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:47.382928 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3664f-6431-4528-a946-f18835691e3d admin admin] PATH_INFO: `/v3/users/75e6d55b14714a99b4a529e391b6c3ea` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:47.384050 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3664f-6431-4528-a946-f18835691e3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=75e6d55b14714a99b4a529e391b6c3ea)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:47.385956 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3664f-6431-4528-a946-f18835691e3d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:47.395454 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-30a4bddf-de12-4844-8fcf-68cb86624479 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2a79f462917429ab8e5fedc86e170b2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:47.402241 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-30a4bddf-de12-4844-8fcf-68cb86624479 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2a79f462917429ab8e5fedc86e170b2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:47.402948 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-30a4bddf-de12-4844-8fcf-68cb86624479 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2a79f462917429ab8e5fedc86e170b2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:47.404262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-30a4bddf-de12-4844-8fcf-68cb86624479 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2a79f462917429ab8e5fedc86e170b2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:47.412892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-30a4bddf-de12-4844-8fcf-68cb86624479 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2a79f462917429ab8e5fedc86e170b2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:47.432041 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 864/1718] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:53:47 2022] DELETE /identity/v3/users/e2a79f462917429ab8e5fedc86e170b2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:47.433038 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4bddf-de12-4844-8fcf-68cb86624479 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:47.434367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-30a4bddf-de12-4844-8fcf-68cb86624479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:47.447848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5ba3664f-6431-4528-a946-f18835691e3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75e6d55b14714a99b4a529e391b6c3ea'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:47.449304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5ba3664f-6431-4528-a946-f18835691e3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75e6d55b14714a99b4a529e391b6c3ea'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:47.450848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5ba3664f-6431-4528-a946-f18835691e3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75e6d55b14714a99b4a529e391b6c3ea'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:47.461221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5ba3664f-6431-4528-a946-f18835691e3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75e6d55b14714a99b4a529e391b6c3ea'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:47.479307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5ba3664f-6431-4528-a946-f18835691e3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75e6d55b14714a99b4a529e391b6c3ea'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:47.496215 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 855/1719] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:53:47 2022] DELETE /identity/v3/users/75e6d55b14714a99b4a529e391b6c3ea => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:47.497624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa35c57-e433-444b-a7a7-c4d3037b2867 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:47.497912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa35c57-e433-444b-a7a7-c4d3037b2867 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:47.498189 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa35c57-e433-444b-a7a7-c4d3037b2867 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:47.500501 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 856/1720] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 20:53:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:53:47.502175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa35c57-e433-444b-a7a7-c4d3037b2867 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:47.504110 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4fa35c57-e433-444b-a7a7-c4d3037b2867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:47.518084 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4bddf-de12-4844-8fcf-68cb86624479 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:47.582879 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:47.602376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2220886-e62c-4772-99bf-b8d2bb020ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:47.603608 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2220886-e62c-4772-99bf-b8d2bb020ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:47.603891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2220886-e62c-4772-99bf-b8d2bb020ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:47.604148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2220886-e62c-4772-99bf-b8d2bb020ac5 admin admin] PATH_INFO: `/v3/projects/2179f93397254aadab09569e2814b7af` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:47.605712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2220886-e62c-4772-99bf-b8d2bb020ac5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2179f93397254aadab09569e2814b7af)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:47.607663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2220886-e62c-4772-99bf-b8d2bb020ac5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:47.632615 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa35c57-e433-444b-a7a7-c4d3037b2867 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:47.640501 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b26198-0c56-4f85-81f6-1367c261182e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:47.641607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b26198-0c56-4f85-81f6-1367c261182e service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:47.643044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b26198-0c56-4f85-81f6-1367c261182e service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:47.643549 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b26198-0c56-4f85-81f6-1367c261182e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:47.646522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c3b26198-0c56-4f85-81f6-1367c261182e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:47.654718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:47.674994 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d2220886-e62c-4772-99bf-b8d2bb020ac5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2179f93397254aadab09569e2814b7af', 'request_id': 'req-d2220886-e62c-4772-99bf-b8d2bb020ac5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:47.688233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d2220886-e62c-4772-99bf-b8d2bb020ac5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2179f93397254aadab09569e2814b7af', 'request_id': 'req-d2220886-e62c-4772-99bf-b8d2bb020ac5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:47.700122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d2220886-e62c-4772-99bf-b8d2bb020ac5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2179f93397254aadab09569e2814b7af', 'request_id': 'req-d2220886-e62c-4772-99bf-b8d2bb020ac5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:47.720389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d2220886-e62c-4772-99bf-b8d2bb020ac5 admin admin] The token cache is being invalidate because project 2179f93397254aadab09569e2814b7af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:53:47.720688 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d2220886-e62c-4772-99bf-b8d2bb020ac5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:47.721432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d2220886-e62c-4772-99bf-b8d2bb020ac5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:47.726480 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 865/1721] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:53:47 2022] DELETE /identity/v3/projects/2179f93397254aadab09569e2814b7af => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:47.727385 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2220886-e62c-4772-99bf-b8d2bb020ac5 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:47.728759 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d2220886-e62c-4772-99bf-b8d2bb020ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:47.737829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b26198-0c56-4f85-81f6-1367c261182e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:47.739977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b26198-0c56-4f85-81f6-1367c261182e service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:47.750866 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 857/1722] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:47 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:53:47.766417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84a831-e010-4e24-94b5-2e56c940d6a9 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:47.767037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84a831-e010-4e24-94b5-2e56c940d6a9 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:47.767537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84a831-e010-4e24-94b5-2e56c940d6a9 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:47.769190 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 858/1723] 10.222.0.33 () {54 vars in 961 bytes} [Sat Aug 6 20:53:47 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:53:47.770508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da99217-9f18-43d4-b4c7-4ff30d54cd58 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:47.771125 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da99217-9f18-43d4-b4c7-4ff30d54cd58 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:47.771604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da99217-9f18-43d4-b4c7-4ff30d54cd58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:47.796517 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-0da99217-9f18-43d4-b4c7-4ff30d54cd58 None None] MFA Rules not processed for user `5f9d53147a57402f8b9818590bc1fc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:47.799084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0da99217-9f18-43d4-b4c7-4ff30d54cd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:47.822209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2220886-e62c-4772-99bf-b8d2bb020ac5 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:47.827915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aacd3d-d55a-44d6-b251-9626f572ab31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:47.828532 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aacd3d-d55a-44d6-b251-9626f572ab31 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:47.828848 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aacd3d-d55a-44d6-b251-9626f572ab31 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:47.829536 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aacd3d-d55a-44d6-b251-9626f572ab31 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:47.830317 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aacd3d-d55a-44d6-b251-9626f572ab31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:53:47.831407 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aacd3d-d55a-44d6-b251-9626f572ab31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:47.833427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aacd3d-d55a-44d6-b251-9626f572ab31 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:47.854435 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 866/1724] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:53:47.856383 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d6041-8f38-4a0d-974f-564ff8713a2e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:47.856833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d6041-8f38-4a0d-974f-564ff8713a2e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:47.857207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d6041-8f38-4a0d-974f-564ff8713a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:47.892859 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b26d6041-8f38-4a0d-974f-564ff8713a2e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:47.894803 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b26d6041-8f38-4a0d-974f-564ff8713a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:47.906151 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 859/1725] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 20:53:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:47.907973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8332e-745c-49a3-bdda-aacf099faea4 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:47.908522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8332e-745c-49a3-bdda-aacf099faea4 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:47.908992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8332e-745c-49a3-bdda-aacf099faea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:47.918711 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 867/1726] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:47.921602 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d6041-8f38-4a0d-974f-564ff8713a2e None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:47.924870 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b26d6041-8f38-4a0d-974f-564ff8713a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:47.940249 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-c8f8332e-745c-49a3-bdda-aacf099faea4 None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:47.940378 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d6041-8f38-4a0d-974f-564ff8713a2e None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:47.941567 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c8f8332e-745c-49a3-bdda-aacf099faea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:47.945334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee938eab-f562-462f-aca7-5e0d9b1efffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:47.946049 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee938eab-f562-462f-aca7-5e0d9b1efffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:47.947090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee938eab-f562-462f-aca7-5e0d9b1efffa admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:47.947474 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee938eab-f562-462f-aca7-5e0d9b1efffa admin admin] PATH_INFO: `/v3/projects/f59b759a2f9e459f80ca6ddb78cc310a` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:47.948744 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee938eab-f562-462f-aca7-5e0d9b1efffa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f59b759a2f9e459f80ca6ddb78cc310a)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:47.951698 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee938eab-f562-462f-aca7-5e0d9b1efffa admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:48.006176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ee938eab-f562-462f-aca7-5e0d9b1efffa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f59b759a2f9e459f80ca6ddb78cc310a', 'request_id': 'req-ee938eab-f562-462f-aca7-5e0d9b1efffa'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:48.013274 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ee938eab-f562-462f-aca7-5e0d9b1efffa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f59b759a2f9e459f80ca6ddb78cc310a', 'request_id': 'req-ee938eab-f562-462f-aca7-5e0d9b1efffa'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:48.013982 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 860/1727] 10.222.0.33 () {58 vars in 1058 bytes} [Sat Aug 6 20:53:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:48.014746 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8332e-745c-49a3-bdda-aacf099faea4 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:48.021855 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ee938eab-f562-462f-aca7-5e0d9b1efffa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f59b759a2f9e459f80ca6ddb78cc310a', 'request_id': 'req-ee938eab-f562-462f-aca7-5e0d9b1efffa'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:48.023464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:48.025788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8332e-745c-49a3-bdda-aacf099faea4 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:48.038505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ee938eab-f562-462f-aca7-5e0d9b1efffa admin admin] The token cache is being invalidate because project f59b759a2f9e459f80ca6ddb78cc310a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:53:48.039284 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ee938eab-f562-462f-aca7-5e0d9b1efffa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:48.040515 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ee938eab-f562-462f-aca7-5e0d9b1efffa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:48.042894 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 868/1728] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:53:47 2022] DELETE /identity/v3/projects/f59b759a2f9e459f80ca6ddb78cc310a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:48.043787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee938eab-f562-462f-aca7-5e0d9b1efffa admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:48.045285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ee938eab-f562-462f-aca7-5e0d9b1efffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:48.064828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:48.103145 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed86f5c-5637-4335-afa5-c086bed7026f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:48.103906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed86f5c-5637-4335-afa5-c086bed7026f admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:48.104204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed86f5c-5637-4335-afa5-c086bed7026f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:48.104452 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed86f5c-5637-4335-afa5-c086bed7026f admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:48.106589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed86f5c-5637-4335-afa5-c086bed7026f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:48.107112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed86f5c-5637-4335-afa5-c086bed7026f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:48.124956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee938eab-f562-462f-aca7-5e0d9b1efffa admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:48.131801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cdffb3-d0e1-47e6-a7d7-c6480f6f1cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:48.132456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdffb3-d0e1-47e6-a7d7-c6480f6f1cca admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:48.132740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdffb3-d0e1-47e6-a7d7-c6480f6f1cca admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:48.133019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdffb3-d0e1-47e6-a7d7-c6480f6f1cca admin admin] PATH_INFO: `/v3/projects/125b3d3311b14ea89d160629d3c71ca3` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:48.134186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cdffb3-d0e1-47e6-a7d7-c6480f6f1cca admin admin] RBAC: Authorizing `identity:delete_project(project_id=125b3d3311b14ea89d160629d3c71ca3)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:48.136249 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cdffb3-d0e1-47e6-a7d7-c6480f6f1cca admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:48.141133 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 861/1729] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:53:48 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:48.141133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb835d-5049-4507-8745-99e7d9c2de85 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:48.141133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb835d-5049-4507-8745-99e7d9c2de85 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:48.141133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb835d-5049-4507-8745-99e7d9c2de85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:48.162068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a0eb835d-5049-4507-8745-99e7d9c2de85 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:48.163324 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a0eb835d-5049-4507-8745-99e7d9c2de85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:48.198939 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-32cdffb3-d0e1-47e6-a7d7-c6480f6f1cca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '125b3d3311b14ea89d160629d3c71ca3', 'request_id': 'req-32cdffb3-d0e1-47e6-a7d7-c6480f6f1cca'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:48.206359 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-32cdffb3-d0e1-47e6-a7d7-c6480f6f1cca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '125b3d3311b14ea89d160629d3c71ca3', 'request_id': 'req-32cdffb3-d0e1-47e6-a7d7-c6480f6f1cca'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:48.217174 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-32cdffb3-d0e1-47e6-a7d7-c6480f6f1cca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '125b3d3311b14ea89d160629d3c71ca3', 'request_id': 'req-32cdffb3-d0e1-47e6-a7d7-c6480f6f1cca'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:48.230740 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 862/1730] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:48.231376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-32cdffb3-d0e1-47e6-a7d7-c6480f6f1cca admin admin] The token cache is being invalidate because project 125b3d3311b14ea89d160629d3c71ca3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:53:48.231678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-32cdffb3-d0e1-47e6-a7d7-c6480f6f1cca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:48.232033 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb835d-5049-4507-8745-99e7d9c2de85 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:48.232316 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-32cdffb3-d0e1-47e6-a7d7-c6480f6f1cca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:48.233337 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a0eb835d-5049-4507-8745-99e7d9c2de85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:48.237786 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 869/1731] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:53:48 2022] DELETE /identity/v3/projects/125b3d3311b14ea89d160629d3c71ca3 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:48.237786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cdffb3-d0e1-47e6-a7d7-c6480f6f1cca admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:48.237786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-32cdffb3-d0e1-47e6-a7d7-c6480f6f1cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:48.299749 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb835d-5049-4507-8745-99e7d9c2de85 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:48.332370 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cdffb3-d0e1-47e6-a7d7-c6480f6f1cca admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:48.355193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63126e-8119-444e-8108-bb8e3edacbe0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:48.356059 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63126e-8119-444e-8108-bb8e3edacbe0 service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:48.356159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63126e-8119-444e-8108-bb8e3edacbe0 service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:48.356387 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63126e-8119-444e-8108-bb8e3edacbe0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:48.358274 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-dc63126e-8119-444e-8108-bb8e3edacbe0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:48.363510 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f307e-23e8-4280-9b60-ed8222f00a8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:48.364481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f307e-23e8-4280-9b60-ed8222f00a8f service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:48.364955 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f307e-23e8-4280-9b60-ed8222f00a8f service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:48.365229 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f307e-23e8-4280-9b60-ed8222f00a8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:48.371355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0a8f307e-23e8-4280-9b60-ed8222f00a8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:48.371473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63126e-8119-444e-8108-bb8e3edacbe0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:48.373061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63126e-8119-444e-8108-bb8e3edacbe0 service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:48.384875 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 870/1732] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:53:48.386014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24da3bf-0127-4334-85d1-a4dc8515447a None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:48.386255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24da3bf-0127-4334-85d1-a4dc8515447a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:48.386648 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24da3bf-0127-4334-85d1-a4dc8515447a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:48.406744 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:48.409448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-f24da3bf-0127-4334-85d1-a4dc8515447a None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:48.410861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f24da3bf-0127-4334-85d1-a4dc8515447a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:48.420795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:48.456183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f307e-23e8-4280-9b60-ed8222f00a8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:48.457657 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f307e-23e8-4280-9b60-ed8222f00a8f service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:48.470360 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 863/1733] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:53:48.476249 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f307e-23e8-4280-9b60-ed8222f00a8f service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:48.478454 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0a8f307e-23e8-4280-9b60-ed8222f00a8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:48.489227 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 871/1734] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:48.490213 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24da3bf-0127-4334-85d1-a4dc8515447a None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:48.492186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f24da3bf-0127-4334-85d1-a4dc8515447a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:48.499038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f307e-23e8-4280-9b60-ed8222f00a8f service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:48.506826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24da3bf-0127-4334-85d1-a4dc8515447a None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:48.508370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf59d45-8d31-4339-b1ca-7457bdc1bed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:48.509291 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf59d45-8d31-4339-b1ca-7457bdc1bed5 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:48.510002 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf59d45-8d31-4339-b1ca-7457bdc1bed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:48.510532 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf59d45-8d31-4339-b1ca-7457bdc1bed5 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:48.511424 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf59d45-8d31-4339-b1ca-7457bdc1bed5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:48.513572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf59d45-8d31-4339-b1ca-7457bdc1bed5 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:48.515716 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8a968-c0a7-44f6-9627-bdb73625faca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:48.516185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8a968-c0a7-44f6-9627-bdb73625faca admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:48.516496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8a968-c0a7-44f6-9627-bdb73625faca admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:48.516778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8a968-c0a7-44f6-9627-bdb73625faca admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:48.517434 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8a968-c0a7-44f6-9627-bdb73625faca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:53:48.517757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8a968-c0a7-44f6-9627-bdb73625faca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:48.519517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8a968-c0a7-44f6-9627-bdb73625faca admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:48.535046 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 872/1735] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:53:48.536333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c760648-e8e6-4521-a058-a7246aed5727 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:48.536620 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c760648-e8e6-4521-a058-a7246aed5727 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:48.536899 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c760648-e8e6-4521-a058-a7246aed5727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:48.554822 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 864/1736] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:53:48 2022] POST /identity/v3/users => generated 289 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:48.555710 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf59d45-8d31-4339-b1ca-7457bdc1bed5 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:48.557503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1bf59d45-8d31-4339-b1ca-7457bdc1bed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:48.570933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-9c760648-e8e6-4521-a058-a7246aed5727 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:48.574164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9c760648-e8e6-4521-a058-a7246aed5727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:48.581304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf59d45-8d31-4339-b1ca-7457bdc1bed5 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:48.586716 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad539bc-fd68-416b-8cd1-be0fd5d9ffcb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:48.593817 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 873/1737] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:48.593995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad539bc-fd68-416b-8cd1-be0fd5d9ffcb service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:48.593995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad539bc-fd68-416b-8cd1-be0fd5d9ffcb service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:48.593995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad539bc-fd68-416b-8cd1-be0fd5d9ffcb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:48.594178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d41cf-ce37-47c4-8449-3b2e8346deb9 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:48.594178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d41cf-ce37-47c4-8449-3b2e8346deb9 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:48.594178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d41cf-ce37-47c4-8449-3b2e8346deb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:48.598478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad539bc-fd68-416b-8cd1-be0fd5d9ffcb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:48.600137 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad539bc-fd68-416b-8cd1-be0fd5d9ffcb service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:48.610909 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 865/1738] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:53:48.611943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad539bc-fd68-416b-8cd1-be0fd5d9ffcb service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:48.620188 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-469d41cf-ce37-47c4-8449-3b2e8346deb9 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:48.621674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-469d41cf-ce37-47c4-8449-3b2e8346deb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:48.622413 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad539bc-fd68-416b-8cd1-be0fd5d9ffcb service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:48.628003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc1c51-ea2c-40d9-ba2d-55090315e15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:48.628602 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc1c51-ea2c-40d9-ba2d-55090315e15d admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:48.628899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc1c51-ea2c-40d9-ba2d-55090315e15d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:48.629142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc1c51-ea2c-40d9-ba2d-55090315e15d admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:48.629760 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc1c51-ea2c-40d9-ba2d-55090315e15d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:48.631691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc1c51-ea2c-40d9-ba2d-55090315e15d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:48.633641 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 874/1739] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:48.634675 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d41cf-ce37-47c4-8449-3b2e8346deb9 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:48.648692 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d41cf-ce37-47c4-8449-3b2e8346deb9 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:48.655590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3c743-ff5d-49bc-b337-acb704a4af1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:48.656316 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3c743-ff5d-49bc-b337-acb704a4af1d admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:48.656536 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3c743-ff5d-49bc-b337-acb704a4af1d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:48.656824 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3c743-ff5d-49bc-b337-acb704a4af1d admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:48.657776 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3c743-ff5d-49bc-b337-acb704a4af1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:48.659538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3c743-ff5d-49bc-b337-acb704a4af1d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:48.676383 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 866/1740] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:53:48 2022] POST /identity/v3/projects => generated 391 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:48.678008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc9053-9a3d-47f1-b729-8eafc9a0a7c7 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:48.678140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc9053-9a3d-47f1-b729-8eafc9a0a7c7 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:48.678385 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc9053-9a3d-47f1-b729-8eafc9a0a7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:48.682709 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 875/1741] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:48.683971 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3c743-ff5d-49bc-b337-acb704a4af1d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:48.698776 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3c743-ff5d-49bc-b337-acb704a4af1d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:48.704174 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-67bc9053-9a3d-47f1-b729-8eafc9a0a7c7 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:48.706672 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-67bc9053-9a3d-47f1-b729-8eafc9a0a7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:48.775509 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc4236-6a98-48c2-9d05-05772d74e039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:48.776235 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc4236-6a98-48c2-9d05-05772d74e039 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:48.776582 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc4236-6a98-48c2-9d05-05772d74e039 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:48.777010 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc4236-6a98-48c2-9d05-05772d74e039 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:48.777986 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc4236-6a98-48c2-9d05-05772d74e039 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:53:48.778297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc4236-6a98-48c2-9d05-05772d74e039 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:48.780076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc4236-6a98-48c2-9d05-05772d74e039 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:48.790058 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 867/1742] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:48.790058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc9053-9a3d-47f1-b729-8eafc9a0a7c7 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:48.799604 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 876/1743] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:53:48.801016 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc4236-6a98-48c2-9d05-05772d74e039 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:48.802801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc9053-9a3d-47f1-b729-8eafc9a0a7c7 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:48.808331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df338f5-bbb9-4348-bdf7-4fea80ec9499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:48.809098 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df338f5-bbb9-4348-bdf7-4fea80ec9499 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:48.809495 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df338f5-bbb9-4348-bdf7-4fea80ec9499 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:48.809779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df338f5-bbb9-4348-bdf7-4fea80ec9499 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:48.810502 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df338f5-bbb9-4348-bdf7-4fea80ec9499 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:48.813078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df338f5-bbb9-4348-bdf7-4fea80ec9499 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:48.823984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc4236-6a98-48c2-9d05-05772d74e039 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:48.831067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24370a41-2d77-43a4-b631-3780e24f9838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:48.831806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24370a41-2d77-43a4-b631-3780e24f9838 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:48.832423 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24370a41-2d77-43a4-b631-3780e24f9838 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:48.832770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24370a41-2d77-43a4-b631-3780e24f9838 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:48.833517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24370a41-2d77-43a4-b631-3780e24f9838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:48.835530 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24370a41-2d77-43a4-b631-3780e24f9838 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:48.841778 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 868/1744] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:53:48 2022] POST /identity/v3/users => generated 296 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:48.842773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df338f5-bbb9-4348-bdf7-4fea80ec9499 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:48.853690 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 877/1745] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:48.854887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24370a41-2d77-43a4-b631-3780e24f9838 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:48.862233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df338f5-bbb9-4348-bdf7-4fea80ec9499 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:48.868393 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea9b1a-55f9-4fc3-be97-92c6c0c5c125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:48.869198 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea9b1a-55f9-4fc3-be97-92c6c0c5c125 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:48.869417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea9b1a-55f9-4fc3-be97-92c6c0c5c125 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:48.869733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24370a41-2d77-43a4-b631-3780e24f9838 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:48.869842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea9b1a-55f9-4fc3-be97-92c6c0c5c125 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:48.870477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea9b1a-55f9-4fc3-be97-92c6c0c5c125 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:53:48.870907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea9b1a-55f9-4fc3-be97-92c6c0c5c125 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:48.872418 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea9b1a-55f9-4fc3-be97-92c6c0c5c125 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:48.875742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3ce5a-45d1-4420-878e-eef4b06a1faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:48.877476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3ce5a-45d1-4420-878e-eef4b06a1faf admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:48.878198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3ce5a-45d1-4420-878e-eef4b06a1faf admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:48.879241 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3ce5a-45d1-4420-878e-eef4b06a1faf admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:48.880106 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3ce5a-45d1-4420-878e-eef4b06a1faf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:48.882921 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3ce5a-45d1-4420-878e-eef4b06a1faf admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:48.906057 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 869/1746] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:53:48.906057 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea9b1a-55f9-4fc3-be97-92c6c0c5c125 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:48.917682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea9b1a-55f9-4fc3-be97-92c6c0c5c125 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:48.924550 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f109a37-cf91-4779-bcb8-ca0ba77cce53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:48.925451 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f109a37-cf91-4779-bcb8-ca0ba77cce53 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:48.925730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f109a37-cf91-4779-bcb8-ca0ba77cce53 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:48.925999 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f109a37-cf91-4779-bcb8-ca0ba77cce53 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:48.926820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f109a37-cf91-4779-bcb8-ca0ba77cce53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:48.928712 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f109a37-cf91-4779-bcb8-ca0ba77cce53 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:48.937567 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 878/1747] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:53:48 2022] POST /identity/v3/projects => generated 391 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:48.938653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3ce5a-45d1-4420-878e-eef4b06a1faf admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:48.942801 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 870/1748] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:48.943711 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f109a37-cf91-4779-bcb8-ca0ba77cce53 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:48.962205 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f109a37-cf91-4779-bcb8-ca0ba77cce53 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:48.989689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:48.995366 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:49.023632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3ce5a-45d1-4420-878e-eef4b06a1faf admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:49.031732 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b789c-0d0a-4e23-b2f6-05b1b241e534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:49.033645 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b789c-0d0a-4e23-b2f6-05b1b241e534 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:49.034099 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b789c-0d0a-4e23-b2f6-05b1b241e534 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:49.034694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b789c-0d0a-4e23-b2f6-05b1b241e534 admin admin] PATH_INFO: `/v3/projects/473c326e84db4af9bd35a553fe9a2204/users/7ca328f6f2ae4f74930b7abba8180cae/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:49.044806 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d86e3f-53c7-47c7-a732-500fa28f6eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:49.045638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d86e3f-53c7-47c7-a732-500fa28f6eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:49.046009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d86e3f-53c7-47c7-a732-500fa28f6eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:49.046328 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d86e3f-53c7-47c7-a732-500fa28f6eb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:49.047229 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d86e3f-53c7-47c7-a732-500fa28f6eb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:49.049598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d86e3f-53c7-47c7-a732-500fa28f6eb3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:49.054896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b789c-0d0a-4e23-b2f6-05b1b241e534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=473c326e84db4af9bd35a553fe9a2204, user_id=7ca328f6f2ae4f74930b7abba8180cae, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:49.059386 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b789c-0d0a-4e23-b2f6-05b1b241e534 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:49.077030 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 879/1749] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:48 2022] PUT /identity/v3/projects/473c326e84db4af9bd35a553fe9a2204/users/7ca328f6f2ae4f74930b7abba8180cae/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:49.091876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b789c-0d0a-4e23-b2f6-05b1b241e534 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:49.105542 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 871/1750] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:53:48 2022] POST /identity/v3/projects => generated 381 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:49.106464 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d86e3f-53c7-47c7-a732-500fa28f6eb3 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:49.202277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d86e3f-53c7-47c7-a732-500fa28f6eb3 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:49.210948 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c629d4-1b7a-40a3-a64b-62dbc6e91181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:49.211614 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c629d4-1b7a-40a3-a64b-62dbc6e91181 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:49.211893 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c629d4-1b7a-40a3-a64b-62dbc6e91181 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:49.212181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c629d4-1b7a-40a3-a64b-62dbc6e91181 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:49.212999 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c629d4-1b7a-40a3-a64b-62dbc6e91181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:49.214654 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c629d4-1b7a-40a3-a64b-62dbc6e91181 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:49.226009 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 872/1751] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:49.230626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fed2d9-0c22-4a0a-be7f-00afca3e5c34 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:49.230918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fed2d9-0c22-4a0a-be7f-00afca3e5c34 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:49.231200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fed2d9-0c22-4a0a-be7f-00afca3e5c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:49.232186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b789c-0d0a-4e23-b2f6-05b1b241e534 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:49.239041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c506370-be7a-4f9f-a460-d66e8b77aee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:49.239750 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c506370-be7a-4f9f-a460-d66e8b77aee8 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:49.240104 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c506370-be7a-4f9f-a460-d66e8b77aee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:49.241284 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c506370-be7a-4f9f-a460-d66e8b77aee8 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:49.241284 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c506370-be7a-4f9f-a460-d66e8b77aee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:49.243658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c506370-be7a-4f9f-a460-d66e8b77aee8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:49.265519 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-44fed2d9-0c22-4a0a-be7f-00afca3e5c34 None None] MFA Rules not processed for user `7ca328f6f2ae4f74930b7abba8180cae`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:49.267420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-44fed2d9-0c22-4a0a-be7f-00afca3e5c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:49.271835 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 880/1752] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:53:49 2022] POST /identity/v3/users => generated 296 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:49.272934 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c506370-be7a-4f9f-a460-d66e8b77aee8 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:49.285660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c506370-be7a-4f9f-a460-d66e8b77aee8 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:49.291987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9db7b8-f6ed-4007-82c5-132f28f2cce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:49.292713 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9db7b8-f6ed-4007-82c5-132f28f2cce9 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:49.293041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9db7b8-f6ed-4007-82c5-132f28f2cce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:49.293323 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9db7b8-f6ed-4007-82c5-132f28f2cce9 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:49.294289 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9db7b8-f6ed-4007-82c5-132f28f2cce9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:49.296189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9db7b8-f6ed-4007-82c5-132f28f2cce9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:49.334336 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 881/1753] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:53:49 2022] POST /identity/v3/users => generated 291 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:49.335848 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9db7b8-f6ed-4007-82c5-132f28f2cce9 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:49.348095 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9db7b8-f6ed-4007-82c5-132f28f2cce9 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:49.350150 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 873/1754] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:49.351112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fed2d9-0c22-4a0a-be7f-00afca3e5c34 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:49.355508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cff9ab-dc50-4615-8b9c-9b7020a76749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:49.356574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cff9ab-dc50-4615-8b9c-9b7020a76749 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:49.357173 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cff9ab-dc50-4615-8b9c-9b7020a76749 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:49.357818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cff9ab-dc50-4615-8b9c-9b7020a76749 admin admin] PATH_INFO: `/v3/projects/35ffa77d7887486dbb30387455757c32/users/012f20ffe53640a3be67f9d3cff4e28a/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:49.362994 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fed2d9-0c22-4a0a-be7f-00afca3e5c34 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:49.369223 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471082e2-bf0e-4175-833b-370a396eeb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:49.370139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471082e2-bf0e-4175-833b-370a396eeb0e admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:49.370430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471082e2-bf0e-4175-833b-370a396eeb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:49.370763 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471082e2-bf0e-4175-833b-370a396eeb0e admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:49.371468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471082e2-bf0e-4175-833b-370a396eeb0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:49.373092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471082e2-bf0e-4175-833b-370a396eeb0e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:49.380854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cff9ab-dc50-4615-8b9c-9b7020a76749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35ffa77d7887486dbb30387455757c32, user_id=012f20ffe53640a3be67f9d3cff4e28a, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:49.384985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cff9ab-dc50-4615-8b9c-9b7020a76749 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:49.393221 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 874/1755] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:49.394315 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471082e2-bf0e-4175-833b-370a396eeb0e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:49.405610 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 882/1756] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:49 2022] PUT /identity/v3/projects/35ffa77d7887486dbb30387455757c32/users/012f20ffe53640a3be67f9d3cff4e28a/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:49.406690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cff9ab-dc50-4615-8b9c-9b7020a76749 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:49.431519 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471082e2-bf0e-4175-833b-370a396eeb0e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:49.484066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:49.529234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cff9ab-dc50-4615-8b9c-9b7020a76749 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:49.543129 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7cc9c2-be77-4968-ae81-f21f79134cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:49.544002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7cc9c2-be77-4968-ae81-f21f79134cd7 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:49.544282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7cc9c2-be77-4968-ae81-f21f79134cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:49.544609 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7cc9c2-be77-4968-ae81-f21f79134cd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:49.545809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7cc9c2-be77-4968-ae81-f21f79134cd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:49.548301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7cc9c2-be77-4968-ae81-f21f79134cd7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:49.550865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970215b-b04a-4e6b-aa03-e22ddebc766b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:49.552135 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970215b-b04a-4e6b-aa03-e22ddebc766b admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:49.552571 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970215b-b04a-4e6b-aa03-e22ddebc766b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:49.552983 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970215b-b04a-4e6b-aa03-e22ddebc766b admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:49.553904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a970215b-b04a-4e6b-aa03-e22ddebc766b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:49.556042 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a970215b-b04a-4e6b-aa03-e22ddebc766b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:49.567431 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 875/1757] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:49.568288 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970215b-b04a-4e6b-aa03-e22ddebc766b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:49.571985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:49.586625 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970215b-b04a-4e6b-aa03-e22ddebc766b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:49.593167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a90b3-bc62-4316-be2d-76cbc9c663d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:49.593878 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a90b3-bc62-4316-be2d-76cbc9c663d4 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:49.594306 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a90b3-bc62-4316-be2d-76cbc9c663d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:49.595399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a90b3-bc62-4316-be2d-76cbc9c663d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:49.596383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a90b3-bc62-4316-be2d-76cbc9c663d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:49.598348 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a90b3-bc62-4316-be2d-76cbc9c663d4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:49.600511 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 883/1758] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:53:49 2022] POST /identity/v3/projects => generated 379 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:49.602997 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8ae81-2174-457d-8e58-d662777a240d None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:49.603685 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8ae81-2174-457d-8e58-d662777a240d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:49.604747 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8ae81-2174-457d-8e58-d662777a240d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:49.614629 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 876/1759] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:49.614629 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a90b3-bc62-4316-be2d-76cbc9c663d4 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:49.623943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a90b3-bc62-4316-be2d-76cbc9c663d4 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:49.644083 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-3ed8ae81-2174-457d-8e58-d662777a240d None None] MFA Rules not processed for user `012f20ffe53640a3be67f9d3cff4e28a`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:49.645412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3ed8ae81-2174-457d-8e58-d662777a240d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:49.723953 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04912c42-7c2e-4566-9e4f-2264d6b1a044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:49.725143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04912c42-7c2e-4566-9e4f-2264d6b1a044 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:49.725495 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04912c42-7c2e-4566-9e4f-2264d6b1a044 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:49.727294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04912c42-7c2e-4566-9e4f-2264d6b1a044 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:49.728096 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04912c42-7c2e-4566-9e4f-2264d6b1a044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:49.728406 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 884/1760] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:49 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:49.731932 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8ae81-2174-457d-8e58-d662777a240d None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:49.732054 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04912c42-7c2e-4566-9e4f-2264d6b1a044 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:49.743599 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 877/1761] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:49.743910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8ae81-2174-457d-8e58-d662777a240d None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:49.748002 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04912c42-7c2e-4566-9e4f-2264d6b1a044 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:49.752956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f70da-8481-4eb3-a551-9b83c6f15826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:49.753576 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f70da-8481-4eb3-a551-9b83c6f15826 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:49.753851 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f70da-8481-4eb3-a551-9b83c6f15826 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:49.754120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f70da-8481-4eb3-a551-9b83c6f15826 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:49.755116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f70da-8481-4eb3-a551-9b83c6f15826 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:49.757334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f70da-8481-4eb3-a551-9b83c6f15826 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:49.766218 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04912c42-7c2e-4566-9e4f-2264d6b1a044 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:49.775899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f17120-f48e-4a6f-a4d6-a6b9f8712986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:49.776888 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f17120-f48e-4a6f-a4d6-a6b9f8712986 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:49.778381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f17120-f48e-4a6f-a4d6-a6b9f8712986 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:49.779048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f17120-f48e-4a6f-a4d6-a6b9f8712986 admin admin] PATH_INFO: `/v3/projects/77cd16c709be47fb95b108f0db305565/users/3a296e817c0842dda50d4d2e11fadafc/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:49.786314 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 885/1762] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:53:49 2022] POST /identity/v3/users => generated 296 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:49.787514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f70da-8481-4eb3-a551-9b83c6f15826 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:49.804267 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f17120-f48e-4a6f-a4d6-a6b9f8712986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77cd16c709be47fb95b108f0db305565, user_id=3a296e817c0842dda50d4d2e11fadafc, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:49.807686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f17120-f48e-4a6f-a4d6-a6b9f8712986 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:49.812610 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f70da-8481-4eb3-a551-9b83c6f15826 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:49.819283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25976ad-0345-4071-91e1-123eca203e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:49.819997 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25976ad-0345-4071-91e1-123eca203e5b admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:49.820469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25976ad-0345-4071-91e1-123eca203e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:49.820854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25976ad-0345-4071-91e1-123eca203e5b admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:49.821476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25976ad-0345-4071-91e1-123eca203e5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:49.823615 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25976ad-0345-4071-91e1-123eca203e5b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:49.827500 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 878/1763] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:49 2022] PUT /identity/v3/projects/77cd16c709be47fb95b108f0db305565/users/3a296e817c0842dda50d4d2e11fadafc/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:49.837409 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f17120-f48e-4a6f-a4d6-a6b9f8712986 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:49.858572 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 886/1764] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:53:49 2022] POST /identity/v3/projects => generated 393 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:49.859586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25976ad-0345-4071-91e1-123eca203e5b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:49.912110 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f17120-f48e-4a6f-a4d6-a6b9f8712986 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:49.941255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25976ad-0345-4071-91e1-123eca203e5b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:49.942441 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:49.950835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449aa141-7a8c-47f6-92c5-20a32d9b35f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:49.951727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449aa141-7a8c-47f6-92c5-20a32d9b35f5 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:49.952205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449aa141-7a8c-47f6-92c5-20a32d9b35f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:49.952613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449aa141-7a8c-47f6-92c5-20a32d9b35f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:49.953284 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449aa141-7a8c-47f6-92c5-20a32d9b35f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:49.955704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449aa141-7a8c-47f6-92c5-20a32d9b35f5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:49.969241 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 887/1765] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:49.971778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1296a-b03b-429c-875e-66d07e275d9a None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:49.972137 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1296a-b03b-429c-875e-66d07e275d9a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:49.972515 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1296a-b03b-429c-875e-66d07e275d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:49.986730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c72de3-eead-49c7-aa83-c8173de903b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:49.987405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c72de3-eead-49c7-aa83-c8173de903b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:49.987679 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c72de3-eead-49c7-aa83-c8173de903b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:49.987947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c72de3-eead-49c7-aa83-c8173de903b4 admin admin] PATH_INFO: `/v3/projects/1e7f91382c8542e899d5ac3d782ca99d/users/c19cd2627416432ebb31aae9585ba454/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:50.003205 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c72de3-eead-49c7-aa83-c8173de903b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e7f91382c8542e899d5ac3d782ca99d, user_id=c19cd2627416432ebb31aae9585ba454, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:50.003422 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-2dc1296a-b03b-429c-875e-66d07e275d9a None None] MFA Rules not processed for user `3a296e817c0842dda50d4d2e11fadafc`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:50.004712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2dc1296a-b03b-429c-875e-66d07e275d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:50.005873 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c72de3-eead-49c7-aa83-c8173de903b4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:50.021010 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 879/1766] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:49 2022] PUT /identity/v3/projects/1e7f91382c8542e899d5ac3d782ca99d/users/c19cd2627416432ebb31aae9585ba454/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:50.030220 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c72de3-eead-49c7-aa83-c8173de903b4 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:50.036284 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:50.078106 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 888/1767] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:49 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:50.079902 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1296a-b03b-429c-875e-66d07e275d9a None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:50.093846 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1296a-b03b-429c-875e-66d07e275d9a None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:50.099979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c72de3-eead-49c7-aa83-c8173de903b4 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:50.100107 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9729a-75a8-4146-9ffd-4e7fa83a94e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:50.100786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9729a-75a8-4146-9ffd-4e7fa83a94e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:50.101130 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9729a-75a8-4146-9ffd-4e7fa83a94e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:50.101474 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9729a-75a8-4146-9ffd-4e7fa83a94e6 admin admin] PATH_INFO: `/v3/projects/5350318c4f7146199a598d17d0bd6251/users/b3745ec475b14e6ab1c91c30587e4ce7/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:50.104691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12df415-66f7-4993-bb6b-49d3b0db070c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:50.105290 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12df415-66f7-4993-bb6b-49d3b0db070c admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:50.105566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12df415-66f7-4993-bb6b-49d3b0db070c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:50.106132 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12df415-66f7-4993-bb6b-49d3b0db070c admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:50.106440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12df415-66f7-4993-bb6b-49d3b0db070c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:50.108400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12df415-66f7-4993-bb6b-49d3b0db070c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:50.123784 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb9729a-75a8-4146-9ffd-4e7fa83a94e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5350318c4f7146199a598d17d0bd6251, user_id=b3745ec475b14e6ab1c91c30587e4ce7, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:50.127403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb9729a-75a8-4146-9ffd-4e7fa83a94e6 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:50.138425 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 880/1768] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:53:50 2022] POST /identity/v3/users => generated 303 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:50.140207 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aea74a-e89a-4951-a858-24023912ff75 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:50.140698 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aea74a-e89a-4951-a858-24023912ff75 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:50.140993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aea74a-e89a-4951-a858-24023912ff75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:50.148612 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 889/1769] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:50 2022] PUT /identity/v3/projects/5350318c4f7146199a598d17d0bd6251/users/b3745ec475b14e6ab1c91c30587e4ce7/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:50.148612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9729a-75a8-4146-9ffd-4e7fa83a94e6 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:50.177430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-14aea74a-e89a-4951-a858-24023912ff75 None None] MFA Rules not processed for user `c19cd2627416432ebb31aae9585ba454`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:50.179217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-14aea74a-e89a-4951-a858-24023912ff75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:50.240192 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9729a-75a8-4146-9ffd-4e7fa83a94e6 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:50.249635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e8ed4-1630-46b0-ba72-6a2bc2bfcfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:50.250476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e8ed4-1630-46b0-ba72-6a2bc2bfcfd7 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:50.252418 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e8ed4-1630-46b0-ba72-6a2bc2bfcfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:50.253138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e8ed4-1630-46b0-ba72-6a2bc2bfcfd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:50.253914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e8ed4-1630-46b0-ba72-6a2bc2bfcfd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:50.259206 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e8ed4-1630-46b0-ba72-6a2bc2bfcfd7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:50.306932 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 890/1770] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:53:50 2022] POST /identity/v3/projects => generated 391 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:50.307610 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e8ed4-1630-46b0-ba72-6a2bc2bfcfd7 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:50.318195 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 881/1771] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:50.322948 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aea74a-e89a-4951-a858-24023912ff75 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:50.345969 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aea74a-e89a-4951-a858-24023912ff75 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:50.388177 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:50.399641 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e8ed4-1630-46b0-ba72-6a2bc2bfcfd7 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:50.409305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7924bc-3e9e-48cb-99d1-092e3965051b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:50.410998 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7924bc-3e9e-48cb-99d1-092e3965051b admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:50.411732 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7924bc-3e9e-48cb-99d1-092e3965051b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:50.412223 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7924bc-3e9e-48cb-99d1-092e3965051b admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:50.413144 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7924bc-3e9e-48cb-99d1-092e3965051b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:50.417373 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7924bc-3e9e-48cb-99d1-092e3965051b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:50.435128 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 891/1772] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:50.446157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490eb2be-4d1f-4287-ab6c-80aef45be3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:50.446857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490eb2be-4d1f-4287-ab6c-80aef45be3ae admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:50.447135 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490eb2be-4d1f-4287-ab6c-80aef45be3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:50.447407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490eb2be-4d1f-4287-ab6c-80aef45be3ae admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:50.448110 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490eb2be-4d1f-4287-ab6c-80aef45be3ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:50.448539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7924bc-3e9e-48cb-99d1-092e3965051b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:50.449925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490eb2be-4d1f-4287-ab6c-80aef45be3ae admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:50.464711 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 882/1773] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:50.465873 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490eb2be-4d1f-4287-ab6c-80aef45be3ae admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:50.476939 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7924bc-3e9e-48cb-99d1-092e3965051b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:50.478438 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490eb2be-4d1f-4287-ab6c-80aef45be3ae admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:50.483499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb5598-1b75-419c-9118-b7a81f89adf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:50.484288 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb5598-1b75-419c-9118-b7a81f89adf0 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:50.484712 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f7b7b-d230-4dc9-b579-8e6d0055c975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:50.486853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f7b7b-d230-4dc9-b579-8e6d0055c975 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:50.486853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f7b7b-d230-4dc9-b579-8e6d0055c975 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:50.487042 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb5598-1b75-419c-9118-b7a81f89adf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:50.487114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f7b7b-d230-4dc9-b579-8e6d0055c975 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:50.487201 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb5598-1b75-419c-9118-b7a81f89adf0 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:50.487625 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f7b7b-d230-4dc9-b579-8e6d0055c975 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:50.487717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb5598-1b75-419c-9118-b7a81f89adf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:50.489656 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb5598-1b75-419c-9118-b7a81f89adf0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:50.489753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f7b7b-d230-4dc9-b579-8e6d0055c975 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:50.560049 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 892/1774] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:53:50 2022] POST /identity/v3/users => generated 302 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:50.560911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb5598-1b75-419c-9118-b7a81f89adf0 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:50.590383 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 883/1775] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:53:50 2022] POST /identity/v3/projects => generated 381 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:50.590584 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f7b7b-d230-4dc9-b579-8e6d0055c975 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:50.593564 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb5598-1b75-419c-9118-b7a81f89adf0 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:50.601320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:50.692136 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ad605-6db7-496c-8131-37cab1ba477c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:50.693029 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ad605-6db7-496c-8131-37cab1ba477c admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:50.693408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ad605-6db7-496c-8131-37cab1ba477c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:50.694239 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ad605-6db7-496c-8131-37cab1ba477c admin admin] PATH_INFO: `/v3/projects/820687a76e6640c7976c03f7b686471b/users/0679f6344f42438f8cb4852763260fb6/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:50.705747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f7b7b-d230-4dc9-b579-8e6d0055c975 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:50.710951 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801756b-7694-4563-9872-089014e9e63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:50.711618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801756b-7694-4563-9872-089014e9e63e admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:50.712192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801756b-7694-4563-9872-089014e9e63e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:50.712566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801756b-7694-4563-9872-089014e9e63e admin admin] PATH_INFO: `/v3/projects/5350318c4f7146199a598d17d0bd6251/users/b3745ec475b14e6ab1c91c30587e4ce7/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:50.714691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801756b-7694-4563-9872-089014e9e63e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5350318c4f7146199a598d17d0bd6251, user_id=b3745ec475b14e6ab1c91c30587e4ce7, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:50.714962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ad605-6db7-496c-8131-37cab1ba477c admin admin] RBAC: Authorizing `identity:create_grant(project_id=820687a76e6640c7976c03f7b686471b, user_id=0679f6344f42438f8cb4852763260fb6, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:50.717366 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801756b-7694-4563-9872-089014e9e63e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:50.717804 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ad605-6db7-496c-8131-37cab1ba477c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:50.728196 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 884/1776] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:50 2022] PUT /identity/v3/projects/5350318c4f7146199a598d17d0bd6251/users/b3745ec475b14e6ab1c91c30587e4ce7/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:50.729029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801756b-7694-4563-9872-089014e9e63e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:50.742754 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 893/1777] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:50 2022] PUT /identity/v3/projects/820687a76e6640c7976c03f7b686471b/users/0679f6344f42438f8cb4852763260fb6/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:50.744040 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b10081-05b1-4000-9c80-78160c97b304 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:50.744323 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b10081-05b1-4000-9c80-78160c97b304 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:50.744596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b10081-05b1-4000-9c80-78160c97b304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:50.803612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-45b10081-05b1-4000-9c80-78160c97b304 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:50.805718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-45b10081-05b1-4000-9c80-78160c97b304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:50.832416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801756b-7694-4563-9872-089014e9e63e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:50.912318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:50.919687 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 894/1778] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 20:53:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:50.921647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b10081-05b1-4000-9c80-78160c97b304 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:50.935820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5266e71-6b4c-4cb1-9ddf-4d81f4fad742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:50.936625 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5266e71-6b4c-4cb1-9ddf-4d81f4fad742 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:50.937006 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5266e71-6b4c-4cb1-9ddf-4d81f4fad742 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:50.937541 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5266e71-6b4c-4cb1-9ddf-4d81f4fad742 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:50.938752 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5266e71-6b4c-4cb1-9ddf-4d81f4fad742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:50.940717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5266e71-6b4c-4cb1-9ddf-4d81f4fad742 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:50.953053 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 885/1779] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:50.955461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac712d-9b9d-4d24-9692-6e31be0830af None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:50.955851 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac712d-9b9d-4d24-9692-6e31be0830af None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:50.956241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac712d-9b9d-4d24-9692-6e31be0830af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:50.980177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b10081-05b1-4000-9c80-78160c97b304 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:50.991415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2e6f9-8619-4877-a300-d9c5a3470772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:50.992190 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2e6f9-8619-4877-a300-d9c5a3470772 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:50.992568 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2e6f9-8619-4877-a300-d9c5a3470772 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:50.993137 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2e6f9-8619-4877-a300-d9c5a3470772 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:50.993325 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-64ac712d-9b9d-4d24-9692-6e31be0830af None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:50.994618 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a2e6f9-8619-4877-a300-d9c5a3470772 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:50.995473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-64ac712d-9b9d-4d24-9692-6e31be0830af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:50.996974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a2e6f9-8619-4877-a300-d9c5a3470772 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:51.007478 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 886/1780] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 20:53:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:51.010488 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2331fb-c3e6-43a1-b605-dd24d916586b None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:51.010907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2331fb-c3e6-43a1-b605-dd24d916586b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:51.011256 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2331fb-c3e6-43a1-b605-dd24d916586b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:51.027356 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 895/1781] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:53:50 2022] POST /identity/v3/users => generated 297 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:51.028628 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2e6f9-8619-4877-a300-d9c5a3470772 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:51.040766 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2e6f9-8619-4877-a300-d9c5a3470772 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:51.046697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c1e73-4e12-4b69-8d66-8be8098059fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:51.048286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c1e73-4e12-4b69-8d66-8be8098059fe admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:51.048782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c1e73-4e12-4b69-8d66-8be8098059fe admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:51.049418 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c1e73-4e12-4b69-8d66-8be8098059fe admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:51.050708 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c1e73-4e12-4b69-8d66-8be8098059fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:51.053035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c1e73-4e12-4b69-8d66-8be8098059fe admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:51.056910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-ad2331fb-c3e6-43a1-b605-dd24d916586b None None] MFA Rules not processed for user `b3745ec475b14e6ab1c91c30587e4ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:51.058181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ad2331fb-c3e6-43a1-b605-dd24d916586b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:51.066637 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 896/1782] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:51.067909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c1e73-4e12-4b69-8d66-8be8098059fe admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:51.096196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c1e73-4e12-4b69-8d66-8be8098059fe admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:51.114359 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f748ca8-eb8e-461c-9256-f23126ee7c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:51.115408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f748ca8-eb8e-461c-9256-f23126ee7c9f admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:51.115791 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f748ca8-eb8e-461c-9256-f23126ee7c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:51.116196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f748ca8-eb8e-461c-9256-f23126ee7c9f admin admin] PATH_INFO: `/v3/projects/9817d06c5d8049868975c4abfe80a51a/users/ec3495b161844701992325ec1846ea10/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:51.139995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f748ca8-eb8e-461c-9256-f23126ee7c9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9817d06c5d8049868975c4abfe80a51a, user_id=ec3495b161844701992325ec1846ea10, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:51.145214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f748ca8-eb8e-461c-9256-f23126ee7c9f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:51.177491 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 897/1783] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:51 2022] PUT /identity/v3/projects/9817d06c5d8049868975c4abfe80a51a/users/ec3495b161844701992325ec1846ea10/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:51.177491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f748ca8-eb8e-461c-9256-f23126ee7c9f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:51.192192 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 887/1784] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:51 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:51.193019 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2331fb-c3e6-43a1-b605-dd24d916586b None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:51.206948 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:51.217070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2331fb-c3e6-43a1-b605-dd24d916586b None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:51.291784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7bb380-6365-4ce4-9f1c-e88de508793d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:51.292671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bb380-6365-4ce4-9f1c-e88de508793d admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:51.293057 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bb380-6365-4ce4-9f1c-e88de508793d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:51.293489 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bb380-6365-4ce4-9f1c-e88de508793d admin admin] PATH_INFO: `/v3/projects/820687a76e6640c7976c03f7b686471b/users/0679f6344f42438f8cb4852763260fb6/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:51.295684 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7bb380-6365-4ce4-9f1c-e88de508793d admin admin] RBAC: Authorizing `identity:create_grant(project_id=820687a76e6640c7976c03f7b686471b, user_id=0679f6344f42438f8cb4852763260fb6, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:51.301448 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7bb380-6365-4ce4-9f1c-e88de508793d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:51.309053 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f748ca8-eb8e-461c-9256-f23126ee7c9f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:51.322627 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 888/1785] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:51 2022] PUT /identity/v3/projects/820687a76e6640c7976c03f7b686471b/users/0679f6344f42438f8cb4852763260fb6/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:51.323982 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7bb380-6365-4ce4-9f1c-e88de508793d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:51.326775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8e7bb380-6365-4ce4-9f1c-e88de508793d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:51.404080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c52fb9-1d0f-4af6-9181-3955de1aaf8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:51.405148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c52fb9-1d0f-4af6-9181-3955de1aaf8c admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:51.405323 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c52fb9-1d0f-4af6-9181-3955de1aaf8c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:51.405858 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c52fb9-1d0f-4af6-9181-3955de1aaf8c admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:51.406681 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c52fb9-1d0f-4af6-9181-3955de1aaf8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:51.407440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:51.408471 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c52fb9-1d0f-4af6-9181-3955de1aaf8c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:51.423817 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 898/1786] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:51.424956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c52fb9-1d0f-4af6-9181-3955de1aaf8c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:51.438892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c52fb9-1d0f-4af6-9181-3955de1aaf8c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:51.444940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb232361-9ebb-45e1-88bb-89d96c92b95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:51.445552 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb232361-9ebb-45e1-88bb-89d96c92b95c admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:51.445826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb232361-9ebb-45e1-88bb-89d96c92b95c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:51.446095 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb232361-9ebb-45e1-88bb-89d96c92b95c admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:51.446755 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb232361-9ebb-45e1-88bb-89d96c92b95c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:51.448379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb232361-9ebb-45e1-88bb-89d96c92b95c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:51.461965 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 899/1787] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:51.462330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7bb380-6365-4ce4-9f1c-e88de508793d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:51.463010 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb232361-9ebb-45e1-88bb-89d96c92b95c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:51.474504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54384a0-3918-4b61-8d0f-2377c79f0e14 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:51.475284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54384a0-3918-4b61-8d0f-2377c79f0e14 service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:51.475680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54384a0-3918-4b61-8d0f-2377c79f0e14 service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:51.475852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54384a0-3918-4b61-8d0f-2377c79f0e14 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:51.477477 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb232361-9ebb-45e1-88bb-89d96c92b95c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:51.484490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1197fc-00aa-4113-b793-44f30d3c8e67 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:51.485824 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1197fc-00aa-4113-b793-44f30d3c8e67 service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:51.486111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1197fc-00aa-4113-b793-44f30d3c8e67 service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:51.486379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1197fc-00aa-4113-b793-44f30d3c8e67 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:51.552962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54384a0-3918-4b61-8d0f-2377c79f0e14 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:51.554932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54384a0-3918-4b61-8d0f-2377c79f0e14 service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:51.561951 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1197fc-00aa-4113-b793-44f30d3c8e67 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:51.564742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1197fc-00aa-4113-b793-44f30d3c8e67 service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:51.565680 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 889/1788] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 20:53:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 20:53:51.566629 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54384a0-3918-4b61-8d0f-2377c79f0e14 service swift] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:51.568665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b54384a0-3918-4b61-8d0f-2377c79f0e14 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:51.575530 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 900/1789] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 20:53:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 20:53:51.577853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec081a42-b390-45ab-b161-847b1871cb3e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:51.578925 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec081a42-b390-45ab-b161-847b1871cb3e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:51.579821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec081a42-b390-45ab-b161-847b1871cb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:51.613959 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-ec081a42-b390-45ab-b161-847b1871cb3e None None] MFA Rules not processed for user `0679f6344f42438f8cb4852763260fb6`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:51.615208 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ec081a42-b390-45ab-b161-847b1871cb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:51.667480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:51.712771 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54384a0-3918-4b61-8d0f-2377c79f0e14 service swift] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:51.721134 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc73cdb-6957-45b1-978d-4901cec25e2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:51.721811 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc73cdb-6957-45b1-978d-4901cec25e2c service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:51.722290 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc73cdb-6957-45b1-978d-4901cec25e2c service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:51.722561 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc73cdb-6957-45b1-978d-4901cec25e2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:51.759253 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 901/1790] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:51 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:51.772752 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec081a42-b390-45ab-b161-847b1871cb3e None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:51.811890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec081a42-b390-45ab-b161-847b1871cb3e None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:51.826140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b67f6-490b-4c9c-a98d-21c2149cf7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:51.826830 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b67f6-490b-4c9c-a98d-21c2149cf7b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:51.827646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b67f6-490b-4c9c-a98d-21c2149cf7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:51.827951 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b67f6-490b-4c9c-a98d-21c2149cf7b6 admin admin] PATH_INFO: `/v3/projects/d9a2fab477774c5d92558233744dd41a/users/a71ca26f10204adabd52fbbc1a90b313/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:51.849921 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b67f6-490b-4c9c-a98d-21c2149cf7b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9a2fab477774c5d92558233744dd41a, user_id=a71ca26f10204adabd52fbbc1a90b313, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:51.852968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b67f6-490b-4c9c-a98d-21c2149cf7b6 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:51.885670 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 902/1791] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:51 2022] PUT /identity/v3/projects/d9a2fab477774c5d92558233744dd41a/users/a71ca26f10204adabd52fbbc1a90b313/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:51.885670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b67f6-490b-4c9c-a98d-21c2149cf7b6 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:51.951959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc73cdb-6957-45b1-978d-4901cec25e2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:51.961549 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc73cdb-6957-45b1-978d-4901cec25e2c service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:52.016939 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 890/1792] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:51 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:53:52.018313 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13df9c-9876-45e9-a2bf-26449f4a9229 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:52.018610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13df9c-9876-45e9-a2bf-26449f4a9229 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:52.018882 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13df9c-9876-45e9-a2bf-26449f4a9229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:52.045363 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:52.063000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-ec13df9c-9876-45e9-a2bf-26449f4a9229 None None] MFA Rules not processed for user `012f20ffe53640a3be67f9d3cff4e28a`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:52.065781 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ec13df9c-9876-45e9-a2bf-26449f4a9229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:52.129582 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b67f6-490b-4c9c-a98d-21c2149cf7b6 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:52.149318 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19408be5-4239-4a00-bac4-0151a383f926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:52.149927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19408be5-4239-4a00-bac4-0151a383f926 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:52.150206 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19408be5-4239-4a00-bac4-0151a383f926 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:52.150476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19408be5-4239-4a00-bac4-0151a383f926 admin admin] PATH_INFO: `/v3/projects/9817d06c5d8049868975c4abfe80a51a/users/ec3495b161844701992325ec1846ea10/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:52.154179 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19408be5-4239-4a00-bac4-0151a383f926 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9817d06c5d8049868975c4abfe80a51a, user_id=ec3495b161844701992325ec1846ea10, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:52.156913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19408be5-4239-4a00-bac4-0151a383f926 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:52.205372 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 903/1793] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:51 2022] PUT /identity/v3/projects/9817d06c5d8049868975c4abfe80a51a/users/ec3495b161844701992325ec1846ea10/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:52.206154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19408be5-4239-4a00-bac4-0151a383f926 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:52.253930 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 891/1794] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:52.255456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09674201-cfb5-420a-b056-01c0c080b682 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:52.255784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09674201-cfb5-420a-b056-01c0c080b682 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:52.256144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09674201-cfb5-420a-b056-01c0c080b682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:52.379258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19408be5-4239-4a00-bac4-0151a383f926 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:52.401934 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20dfdb-e09b-4e30-ad99-ff95fc40ab0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:52.402601 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-09674201-cfb5-420a-b056-01c0c080b682 None None] MFA Rules not processed for user `174e91100a184740b7c604730266dc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:52.403756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20dfdb-e09b-4e30-ad99-ff95fc40ab0f admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:52.405368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20dfdb-e09b-4e30-ad99-ff95fc40ab0f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:52.405889 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20dfdb-e09b-4e30-ad99-ff95fc40ab0f admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:52.407108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-09674201-cfb5-420a-b056-01c0c080b682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:52.408042 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20dfdb-e09b-4e30-ad99-ff95fc40ab0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:52.412826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20dfdb-e09b-4e30-ad99-ff95fc40ab0f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:52.448083 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 904/1795] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:52.452605 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd94071-f72c-4264-b422-247a72790e0b None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:52.453144 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd94071-f72c-4264-b422-247a72790e0b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:52.453648 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd94071-f72c-4264-b422-247a72790e0b None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:52.457616 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 905/1796] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 20:53:52 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:53:52.462330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88010bd8-53b8-4225-b6e3-236f2b9d1d62 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:52.463052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88010bd8-53b8-4225-b6e3-236f2b9d1d62 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:52.463543 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88010bd8-53b8-4225-b6e3-236f2b9d1d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:52.548506 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-88010bd8-53b8-4225-b6e3-236f2b9d1d62 None None] MFA Rules not processed for user `ec3495b161844701992325ec1846ea10`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:52.550458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-88010bd8-53b8-4225-b6e3-236f2b9d1d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:52.588575 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 892/1797] 10.222.0.23 () {58 vars in 1015 bytes} [Sat Aug 6 20:53:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:52.589694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09674201-cfb5-420a-b056-01c0c080b682 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:52.607588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:52.619279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09674201-cfb5-420a-b056-01c0c080b682 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:52.630785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1813b-4bb9-4722-bbb0-e67dd1354198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:52.631595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1813b-4bb9-4722-bbb0-e67dd1354198 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:52.632972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1813b-4bb9-4722-bbb0-e67dd1354198 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:52.633840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1813b-4bb9-4722-bbb0-e67dd1354198 admin admin] PATH_INFO: `/v3/projects/d9a2fab477774c5d92558233744dd41a/users/a71ca26f10204adabd52fbbc1a90b313/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:52.638691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1813b-4bb9-4722-bbb0-e67dd1354198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9a2fab477774c5d92558233744dd41a, user_id=a71ca26f10204adabd52fbbc1a90b313, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:52.646938 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1813b-4bb9-4722-bbb0-e67dd1354198 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:52.691457 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 893/1798] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:52 2022] PUT /identity/v3/projects/d9a2fab477774c5d92558233744dd41a/users/a71ca26f10204adabd52fbbc1a90b313/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:52.694615 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1813b-4bb9-4722-bbb0-e67dd1354198 admin admin] Authenticating service token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 20:53:52.701063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-21f1813b-4bb9-4722-bbb0-e67dd1354198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:52.802246 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 906/1799] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:52 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:52.803303 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88010bd8-53b8-4225-b6e3-236f2b9d1d62 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:52.806835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-88010bd8-53b8-4225-b6e3-236f2b9d1d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:52.840287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88010bd8-53b8-4225-b6e3-236f2b9d1d62 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:52.948589 ncdv-master-1 devstack@keystone.service[102758]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-21f1813b-4bb9-4722-bbb0-e67dd1354198 admin admin] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Aug 06 20:53:52.950147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1813b-4bb9-4722-bbb0-e67dd1354198 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:52.968583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34225a3d-8972-4342-9682-19b4ab29b247 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:52.970073 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34225a3d-8972-4342-9682-19b4ab29b247 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:52.972417 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34225a3d-8972-4342-9682-19b4ab29b247 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:52.973696 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34225a3d-8972-4342-9682-19b4ab29b247 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:53.005935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34225a3d-8972-4342-9682-19b4ab29b247 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:53.008246 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34225a3d-8972-4342-9682-19b4ab29b247 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:53.020870 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 907/1800] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:53:53.025355 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4102cd-75cd-4a6a-a3a5-944b74d3156f None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:53.027717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4102cd-75cd-4a6a-a3a5-944b74d3156f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:53.029089 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4102cd-75cd-4a6a-a3a5-944b74d3156f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:53.085051 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:53.157463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-2c4102cd-75cd-4a6a-a3a5-944b74d3156f None None] MFA Rules not processed for user `a71ca26f10204adabd52fbbc1a90b313`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:53.159264 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2c4102cd-75cd-4a6a-a3a5-944b74d3156f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:53.208131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1813b-4bb9-4722-bbb0-e67dd1354198 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:53.237129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cea90a-d596-45e8-bcdf-d70414196b08 tempest-FlavorsAccessTestJSON-1193632277 tempest-FlavorsAccessTestJSON-1193632277-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3745ec475b14e6ab1c91c30587e4ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5350318c4f7146199a598d17d0bd6251', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:53.237717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cea90a-d596-45e8-bcdf-d70414196b08 tempest-FlavorsAccessTestJSON-1193632277 tempest-FlavorsAccessTestJSON-1193632277-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:53.238002 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cea90a-d596-45e8-bcdf-d70414196b08 tempest-FlavorsAccessTestJSON-1193632277 tempest-FlavorsAccessTestJSON-1193632277-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:53.238289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cea90a-d596-45e8-bcdf-d70414196b08 tempest-FlavorsAccessTestJSON-1193632277 tempest-FlavorsAccessTestJSON-1193632277-project-admin] PATH_INFO: `/v3/projects/473c326e84db4af9bd35a553fe9a2204` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:53.247292 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cea90a-d596-45e8-bcdf-d70414196b08 tempest-FlavorsAccessTestJSON-1193632277 tempest-FlavorsAccessTestJSON-1193632277-project-admin] RBAC: Authorizing `identity:get_project(project_id=473c326e84db4af9bd35a553fe9a2204)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:53.249434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cea90a-d596-45e8-bcdf-d70414196b08 tempest-FlavorsAccessTestJSON-1193632277 tempest-FlavorsAccessTestJSON-1193632277-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:53.271040 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 894/1801] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 20:53:52 2022] GET /identity/v3/projects/473c326e84db4af9bd35a553fe9a2204 => generated 377 bytes in 578 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:53:53.272039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cea90a-d596-45e8-bcdf-d70414196b08 tempest-FlavorsAccessTestJSON-1193632277 tempest-FlavorsAccessTestJSON-1193632277-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:53.282941 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 908/1802] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:53 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:53.285964 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e34344-c297-4684-9a15-e29a214c2985 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:53.290011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e34344-c297-4684-9a15-e29a214c2985 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:53.292874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e34344-c297-4684-9a15-e29a214c2985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:53.298846 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cea90a-d596-45e8-bcdf-d70414196b08 tempest-FlavorsAccessTestJSON-1193632277 tempest-FlavorsAccessTestJSON-1193632277-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:53.321208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fd337-1629-456c-82a7-9f970b18fa37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:53.321208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fd337-1629-456c-82a7-9f970b18fa37 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:53.321208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fd337-1629-456c-82a7-9f970b18fa37 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:53.321208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fd337-1629-456c-82a7-9f970b18fa37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:53.332242 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-13e34344-c297-4684-9a15-e29a214c2985 None None] MFA Rules not processed for user `174e91100a184740b7c604730266dc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:53.333879 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-13e34344-c297-4684-9a15-e29a214c2985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:53.366201 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 909/1803] 10.222.0.40 () {58 vars in 1015 bytes} [Sat Aug 6 20:53:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:53.370033 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e34344-c297-4684-9a15-e29a214c2985 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:53.450354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3fd337-1629-456c-82a7-9f970b18fa37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:53.454876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3fd337-1629-456c-82a7-9f970b18fa37 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:53.481974 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 895/1804] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:53 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:53:53.482889 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fd337-1629-456c-82a7-9f970b18fa37 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:53.486729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3c3fd337-1629-456c-82a7-9f970b18fa37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:53.515168 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fd337-1629-456c-82a7-9f970b18fa37 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:53.532409 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101cd02-dec3-4465-b0d5-5a1cf78d81b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:53.532975 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101cd02-dec3-4465-b0d5-5a1cf78d81b5 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:53.533254 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101cd02-dec3-4465-b0d5-5a1cf78d81b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:53.533917 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101cd02-dec3-4465-b0d5-5a1cf78d81b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:53.535789 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:53.562108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101cd02-dec3-4465-b0d5-5a1cf78d81b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:53.570094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101cd02-dec3-4465-b0d5-5a1cf78d81b5 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:53.604682 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 896/1805] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:53:53.610348 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e34344-c297-4684-9a15-e29a214c2985 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:53.626724 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac26a70-d837-4d8e-b241-89601e514352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:53.628448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac26a70-d837-4d8e-b241-89601e514352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:53.628789 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac26a70-d837-4d8e-b241-89601e514352 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:53.629755 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac26a70-d837-4d8e-b241-89601e514352 admin admin] PATH_INFO: `/v3/users/3a296e817c0842dda50d4d2e11fadafc` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:53.635926 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac26a70-d837-4d8e-b241-89601e514352 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a296e817c0842dda50d4d2e11fadafc)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:53.640412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac26a70-d837-4d8e-b241-89601e514352 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:53.752553 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1ac26a70-d837-4d8e-b241-89601e514352 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a296e817c0842dda50d4d2e11fadafc'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:53.771265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1ac26a70-d837-4d8e-b241-89601e514352 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a296e817c0842dda50d4d2e11fadafc'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:53.772459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1ac26a70-d837-4d8e-b241-89601e514352 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a296e817c0842dda50d4d2e11fadafc'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:53.777046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1ac26a70-d837-4d8e-b241-89601e514352 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a296e817c0842dda50d4d2e11fadafc'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:53.796109 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1ac26a70-d837-4d8e-b241-89601e514352 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a296e817c0842dda50d4d2e11fadafc'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:53.807646 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101cd02-dec3-4465-b0d5-5a1cf78d81b5 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:53.826198 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101cd02-dec3-4465-b0d5-5a1cf78d81b5 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:53.835782 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 910/1806] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:53:53 2022] DELETE /identity/v3/users/3a296e817c0842dda50d4d2e11fadafc => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:53.836308 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1682f-10d6-4840-ae8b-02f47f699afa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:53.837099 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1682f-10d6-4840-ae8b-02f47f699afa service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:53.837776 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1682f-10d6-4840-ae8b-02f47f699afa service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:53.838253 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1682f-10d6-4840-ae8b-02f47f699afa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:53.841101 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-03b1682f-10d6-4840-ae8b-02f47f699afa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:53.850770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61709e-0fc5-4cef-adc8-8b07bfd8860a None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:53.851583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61709e-0fc5-4cef-adc8-8b07bfd8860a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:53.851883 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61709e-0fc5-4cef-adc8-8b07bfd8860a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:53.860583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1682f-10d6-4840-ae8b-02f47f699afa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:53.862306 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1682f-10d6-4840-ae8b-02f47f699afa service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:53.874864 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 897/1807] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:53 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:53:53.885138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-5a61709e-0fc5-4cef-adc8-8b07bfd8860a None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:53.886350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5a61709e-0fc5-4cef-adc8-8b07bfd8860a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:54.027490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1682f-10d6-4840-ae8b-02f47f699afa service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:54.028603 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 911/1808] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:54.030683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-03b1682f-10d6-4840-ae8b-02f47f699afa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:54.061428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61709e-0fc5-4cef-adc8-8b07bfd8860a None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:54.063707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5a61709e-0fc5-4cef-adc8-8b07bfd8860a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:54.066840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1682f-10d6-4840-ae8b-02f47f699afa service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:54.240730 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61709e-0fc5-4cef-adc8-8b07bfd8860a None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:54.258334 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73369a-e34b-4007-9147-27d0947a0ca1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:54.259617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73369a-e34b-4007-9147-27d0947a0ca1 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:54.259906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73369a-e34b-4007-9147-27d0947a0ca1 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:54.260285 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73369a-e34b-4007-9147-27d0947a0ca1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:54.261798 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7317e-5c35-457f-9adc-21187c673299 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:54.264311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7317e-5c35-457f-9adc-21187c673299 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:54.264591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7317e-5c35-457f-9adc-21187c673299 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:54.264692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-dc73369a-e34b-4007-9147-27d0947a0ca1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:54.264857 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7317e-5c35-457f-9adc-21187c673299 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:54.284260 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c7317e-5c35-457f-9adc-21187c673299 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:54.286341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c7317e-5c35-457f-9adc-21187c673299 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:54.315251 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 912/1809] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:53:54.365802 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:54.464143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73369a-e34b-4007-9147-27d0947a0ca1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:54.472457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73369a-e34b-4007-9147-27d0947a0ca1 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:54.508007 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 898/1810] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:53:55.195030 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6d4c5-5e35-4615-bf8f-b19067f1db8c None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:55.195692 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6d4c5-5e35-4615-bf8f-b19067f1db8c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:55.196085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6d4c5-5e35-4615-bf8f-b19067f1db8c None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:55.197922 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 913/1811] 10.222.0.33 () {54 vars in 921 bytes} [Sat Aug 6 20:53:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:53:55.229336 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e50e8-f2c2-4d1d-a3e6-82ebf03ff3c4 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:55.229698 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e50e8-f2c2-4d1d-a3e6-82ebf03ff3c4 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:55.229994 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e50e8-f2c2-4d1d-a3e6-82ebf03ff3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:55.295911 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-e32e50e8-f2c2-4d1d-a3e6-82ebf03ff3c4 None None] MFA Rules not processed for user `5f9d53147a57402f8b9818590bc1fc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:55.297973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e32e50e8-f2c2-4d1d-a3e6-82ebf03ff3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:55.306340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1e66f-a9b0-4b7e-9051-dc7ce7b35174 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:55.306803 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1e66f-a9b0-4b7e-9051-dc7ce7b35174 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:55.307038 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1e66f-a9b0-4b7e-9051-dc7ce7b35174 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:55.308723 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 914/1812] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 20:53:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:53:55.316921 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1e66f-a9b0-4b7e-9051-dc7ce7b35174 None None] Authenticating service token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 20:53:55.331489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:55.343890 ncdv-master-1 devstack@keystone.service[102759]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1e66f-a9b0-4b7e-9051-dc7ce7b35174 None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Aug 06 20:53:55.345151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1e66f-a9b0-4b7e-9051-dc7ce7b35174 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:55.347956 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 899/1813] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 20:53:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:53:55.350062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a3a1e66f-a9b0-4b7e-9051-dc7ce7b35174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:55.383482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc716a3e-1378-4a12-be8d-c4adc6274557 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:55.384055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc716a3e-1378-4a12-be8d-c4adc6274557 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:55.384055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc716a3e-1378-4a12-be8d-c4adc6274557 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:55.385759 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 900/1814] 10.222.0.33 () {54 vars in 921 bytes} [Sat Aug 6 20:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:53:55.418932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672bec3-d9b5-4e4e-9d91-30ef21431410 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:55.419139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672bec3-d9b5-4e4e-9d91-30ef21431410 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:55.419413 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672bec3-d9b5-4e4e-9d91-30ef21431410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:55.475436 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-8672bec3-d9b5-4e4e-9d91-30ef21431410 None None] MFA Rules not processed for user `5f9d53147a57402f8b9818590bc1fc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:55.476680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8672bec3-d9b5-4e4e-9d91-30ef21431410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:55.513986 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 901/1815] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 20:53:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:53:55.566823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672bec3-d9b5-4e4e-9d91-30ef21431410 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:55.568369 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8672bec3-d9b5-4e4e-9d91-30ef21431410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:55.569982 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1e66f-a9b0-4b7e-9051-dc7ce7b35174 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:55.579736 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242fe97-c26c-4d8a-bfcf-ef955de2d155 tempest-FlavorsAccessTestJSON-1193632277 tempest-FlavorsAccessTestJSON-1193632277-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3745ec475b14e6ab1c91c30587e4ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5350318c4f7146199a598d17d0bd6251', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:55.580955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242fe97-c26c-4d8a-bfcf-ef955de2d155 tempest-FlavorsAccessTestJSON-1193632277 tempest-FlavorsAccessTestJSON-1193632277-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:55.581458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242fe97-c26c-4d8a-bfcf-ef955de2d155 tempest-FlavorsAccessTestJSON-1193632277 tempest-FlavorsAccessTestJSON-1193632277-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:55.582167 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242fe97-c26c-4d8a-bfcf-ef955de2d155 tempest-FlavorsAccessTestJSON-1193632277 tempest-FlavorsAccessTestJSON-1193632277-project-admin] PATH_INFO: `/v3/projects/473c326e84db4af9bd35a553fe9a2204` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:55.584196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242fe97-c26c-4d8a-bfcf-ef955de2d155 tempest-FlavorsAccessTestJSON-1193632277 tempest-FlavorsAccessTestJSON-1193632277-project-admin] RBAC: Authorizing `identity:get_project(project_id=473c326e84db4af9bd35a553fe9a2204)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:55.590756 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672bec3-d9b5-4e4e-9d91-30ef21431410 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:55.599996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a28b6e-7fff-4605-ae36-20f2aa4db2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:55.600663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a28b6e-7fff-4605-ae36-20f2aa4db2ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:55.600961 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a28b6e-7fff-4605-ae36-20f2aa4db2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:55.601274 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a28b6e-7fff-4605-ae36-20f2aa4db2ec admin admin] PATH_INFO: `/v3/projects/77cd16c709be47fb95b108f0db305565` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:55.604379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a28b6e-7fff-4605-ae36-20f2aa4db2ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=77cd16c709be47fb95b108f0db305565)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:55.606963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a28b6e-7fff-4605-ae36-20f2aa4db2ec admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:55.615428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242fe97-c26c-4d8a-bfcf-ef955de2d155 tempest-FlavorsAccessTestJSON-1193632277 tempest-FlavorsAccessTestJSON-1193632277-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:55.622883 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 915/1816] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 20:53:55 2022] GET /identity/v3/projects/473c326e84db4af9bd35a553fe9a2204 => generated 377 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:53:55.703630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-85a28b6e-7fff-4605-ae36-20f2aa4db2ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77cd16c709be47fb95b108f0db305565', 'request_id': 'req-85a28b6e-7fff-4605-ae36-20f2aa4db2ec'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:55.717137 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-85a28b6e-7fff-4605-ae36-20f2aa4db2ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77cd16c709be47fb95b108f0db305565', 'request_id': 'req-85a28b6e-7fff-4605-ae36-20f2aa4db2ec'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:55.749564 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-85a28b6e-7fff-4605-ae36-20f2aa4db2ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77cd16c709be47fb95b108f0db305565', 'request_id': 'req-85a28b6e-7fff-4605-ae36-20f2aa4db2ec'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:55.773186 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-85a28b6e-7fff-4605-ae36-20f2aa4db2ec admin admin] The token cache is being invalidate because project 77cd16c709be47fb95b108f0db305565 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:53:55.773511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-85a28b6e-7fff-4605-ae36-20f2aa4db2ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:55.776667 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-85a28b6e-7fff-4605-ae36-20f2aa4db2ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:55.784291 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 902/1817] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:53:55 2022] DELETE /identity/v3/projects/77cd16c709be47fb95b108f0db305565 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:53:55.785625 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242fe97-c26c-4d8a-bfcf-ef955de2d155 tempest-FlavorsAccessTestJSON-1193632277 tempest-FlavorsAccessTestJSON-1193632277-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:55.787823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c242fe97-c26c-4d8a-bfcf-ef955de2d155 tempest-FlavorsAccessTestJSON-1193632277 tempest-FlavorsAccessTestJSON-1193632277-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:55.822039 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242fe97-c26c-4d8a-bfcf-ef955de2d155 tempest-FlavorsAccessTestJSON-1193632277 tempest-FlavorsAccessTestJSON-1193632277-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:55.964984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190780c-1bea-4c81-b506-d1ceb246d4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:55.965795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190780c-1bea-4c81-b506-d1ceb246d4ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:55.966181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190780c-1bea-4c81-b506-d1ceb246d4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:55.966580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190780c-1bea-4c81-b506-d1ceb246d4ce admin admin] PATH_INFO: `/v3/users/ec3495b161844701992325ec1846ea10` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:55.967888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9190780c-1bea-4c81-b506-d1ceb246d4ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec3495b161844701992325ec1846ea10)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:55.970942 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9190780c-1bea-4c81-b506-d1ceb246d4ce admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:56.068061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9190780c-1bea-4c81-b506-d1ceb246d4ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec3495b161844701992325ec1846ea10'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:56.080521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9190780c-1bea-4c81-b506-d1ceb246d4ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec3495b161844701992325ec1846ea10'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:56.080972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9190780c-1bea-4c81-b506-d1ceb246d4ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec3495b161844701992325ec1846ea10'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:56.082910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9190780c-1bea-4c81-b506-d1ceb246d4ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec3495b161844701992325ec1846ea10'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:56.096590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9190780c-1bea-4c81-b506-d1ceb246d4ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec3495b161844701992325ec1846ea10'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:56.145855 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 916/1818] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:53:55 2022] DELETE /identity/v3/users/ec3495b161844701992325ec1846ea10 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:56.352019 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a28b6e-7fff-4605-ae36-20f2aa4db2ec admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:56.353434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-85a28b6e-7fff-4605-ae36-20f2aa4db2ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:56.535863 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a28b6e-7fff-4605-ae36-20f2aa4db2ec admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:56.673382 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:56.724540 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09e317-7a86-467c-bb53-250b10d19a1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:56.725273 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09e317-7a86-467c-bb53-250b10d19a1c service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:56.725682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09e317-7a86-467c-bb53-250b10d19a1c service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:56.725925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09e317-7a86-467c-bb53-250b10d19a1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:56.728063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-bb09e317-7a86-467c-bb53-250b10d19a1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:56.735597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190780c-1bea-4c81-b506-d1ceb246d4ce admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:56.737070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9190780c-1bea-4c81-b506-d1ceb246d4ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:56.751106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09e317-7a86-467c-bb53-250b10d19a1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:56.753104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09e317-7a86-467c-bb53-250b10d19a1c service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:56.768140 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 903/1819] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:53:56.781969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:56.843631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190780c-1bea-4c81-b506-d1ceb246d4ce admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:56.857853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f6fc1-da22-49e3-878e-6662c7c57c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:56.859034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f6fc1-da22-49e3-878e-6662c7c57c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:56.859295 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f6fc1-da22-49e3-878e-6662c7c57c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:56.859689 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f6fc1-da22-49e3-878e-6662c7c57c13 admin admin] PATH_INFO: `/v3/projects/9817d06c5d8049868975c4abfe80a51a` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:56.861748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f6fc1-da22-49e3-878e-6662c7c57c13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9817d06c5d8049868975c4abfe80a51a)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:56.863960 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f6fc1-da22-49e3-878e-6662c7c57c13 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:56.932828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09e317-7a86-467c-bb53-250b10d19a1c service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:56.934782 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-bb09e317-7a86-467c-bb53-250b10d19a1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:56.935996 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-701f6fc1-da22-49e3-878e-6662c7c57c13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9817d06c5d8049868975c4abfe80a51a', 'request_id': 'req-701f6fc1-da22-49e3-878e-6662c7c57c13'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:56.950641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09e317-7a86-467c-bb53-250b10d19a1c service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:56.973243 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-701f6fc1-da22-49e3-878e-6662c7c57c13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9817d06c5d8049868975c4abfe80a51a', 'request_id': 'req-701f6fc1-da22-49e3-878e-6662c7c57c13'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:56.987992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-701f6fc1-da22-49e3-878e-6662c7c57c13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9817d06c5d8049868975c4abfe80a51a', 'request_id': 'req-701f6fc1-da22-49e3-878e-6662c7c57c13'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:57.011401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-701f6fc1-da22-49e3-878e-6662c7c57c13 admin admin] The token cache is being invalidate because project 9817d06c5d8049868975c4abfe80a51a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:53:57.011755 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-701f6fc1-da22-49e3-878e-6662c7c57c13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:57.012413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-701f6fc1-da22-49e3-878e-6662c7c57c13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:57.014457 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 917/1820] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:53:56 2022] DELETE /identity/v3/projects/9817d06c5d8049868975c4abfe80a51a => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:53:57.020767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6b609-3d1a-4601-9c01-ce973583b36d None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:57.021193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6b609-3d1a-4601-9c01-ce973583b36d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:57.021481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6b609-3d1a-4601-9c01-ce973583b36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:57.045862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-f7a6b609-3d1a-4601-9c01-ce973583b36d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:57.047812 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f7a6b609-3d1a-4601-9c01-ce973583b36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:57.078106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b3c37-97bd-48a3-b992-e600eb0bebd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:57.080885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b3c37-97bd-48a3-b992-e600eb0bebd3 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:57.082144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b3c37-97bd-48a3-b992-e600eb0bebd3 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:57.082836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b3c37-97bd-48a3-b992-e600eb0bebd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:57.085389 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-cc6b3c37-97bd-48a3-b992-e600eb0bebd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:57.104485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b3c37-97bd-48a3-b992-e600eb0bebd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:57.107296 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b3c37-97bd-48a3-b992-e600eb0bebd3 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:57.138765 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 904/1821] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:53:57.154972 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 918/1822] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:57.157666 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55792c1-9d8b-45f0-890f-a111b7ee6c8c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:57.158004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55792c1-9d8b-45f0-890f-a111b7ee6c8c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:57.158769 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55792c1-9d8b-45f0-890f-a111b7ee6c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:57.196533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-c55792c1-9d8b-45f0-890f-a111b7ee6c8c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:57.197972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c55792c1-9d8b-45f0-890f-a111b7ee6c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:57.219661 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 905/1823] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:57.227734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6b609-3d1a-4601-9c01-ce973583b36d None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:57.265253 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6b609-3d1a-4601-9c01-ce973583b36d None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:57.280259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f20f8a-cd33-4bd2-992e-7ee28b98ee1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:57.280939 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f20f8a-cd33-4bd2-992e-7ee28b98ee1f admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:57.281311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f20f8a-cd33-4bd2-992e-7ee28b98ee1f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:57.282725 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f20f8a-cd33-4bd2-992e-7ee28b98ee1f admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:57.283527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f20f8a-cd33-4bd2-992e-7ee28b98ee1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:53:57.290586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f20f8a-cd33-4bd2-992e-7ee28b98ee1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:57.293606 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f20f8a-cd33-4bd2-992e-7ee28b98ee1f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:57.319012 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55792c1-9d8b-45f0-890f-a111b7ee6c8c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:57.325455 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 919/1824] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:53:57.337161 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55792c1-9d8b-45f0-890f-a111b7ee6c8c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:57.344084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5826c8-4c9f-4dfe-b7e5-ab0b5011fa4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:57.345271 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5826c8-4c9f-4dfe-b7e5-ab0b5011fa4c admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:57.345556 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5826c8-4c9f-4dfe-b7e5-ab0b5011fa4c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:57.346126 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5826c8-4c9f-4dfe-b7e5-ab0b5011fa4c admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:57.347293 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5826c8-4c9f-4dfe-b7e5-ab0b5011fa4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:57.351777 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5826c8-4c9f-4dfe-b7e5-ab0b5011fa4c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:57.452851 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 906/1825] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:53:57 2022] POST /identity/v3/projects => generated 371 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:57.454699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f20f8a-cd33-4bd2-992e-7ee28b98ee1f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:57.471477 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f20f8a-cd33-4bd2-992e-7ee28b98ee1f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:57.549198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:57.611757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46846db8-9134-4769-b68d-c516de4ead70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:57.611757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46846db8-9134-4769-b68d-c516de4ead70 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:57.611757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46846db8-9134-4769-b68d-c516de4ead70 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:57.611757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46846db8-9134-4769-b68d-c516de4ead70 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:57.612231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46846db8-9134-4769-b68d-c516de4ead70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:57.612231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46846db8-9134-4769-b68d-c516de4ead70 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:57.641519 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 920/1826] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:53:57 2022] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:53:57.645972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5826c8-4c9f-4dfe-b7e5-ab0b5011fa4c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:57.660129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5826c8-4c9f-4dfe-b7e5-ab0b5011fa4c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:57.677249 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e84c5-c2b6-4c47-94a2-fb4545a1e99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:57.678221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e84c5-c2b6-4c47-94a2-fb4545a1e99f admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:57.678709 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e84c5-c2b6-4c47-94a2-fb4545a1e99f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:57.679818 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e84c5-c2b6-4c47-94a2-fb4545a1e99f admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:57.680692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25e84c5-c2b6-4c47-94a2-fb4545a1e99f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:57.682295 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25e84c5-c2b6-4c47-94a2-fb4545a1e99f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:57.702584 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 907/1827] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:57.707389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46846db8-9134-4769-b68d-c516de4ead70 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:57.720657 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46846db8-9134-4769-b68d-c516de4ead70 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:57.727141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a446a-3626-4346-a0bb-4f18e80ef358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:57.728078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a446a-3626-4346-a0bb-4f18e80ef358 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:57.728431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a446a-3626-4346-a0bb-4f18e80ef358 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:57.728829 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a446a-3626-4346-a0bb-4f18e80ef358 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:57.729698 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a446a-3626-4346-a0bb-4f18e80ef358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:57.731761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a446a-3626-4346-a0bb-4f18e80ef358 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:57.768109 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 921/1828] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:57.769769 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e84c5-c2b6-4c47-94a2-fb4545a1e99f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:57.789107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e84c5-c2b6-4c47-94a2-fb4545a1e99f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:57.799405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f56a7-e122-40c8-b472-b43a5de53162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:57.801144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f56a7-e122-40c8-b472-b43a5de53162 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:57.801716 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f56a7-e122-40c8-b472-b43a5de53162 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:57.802410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f56a7-e122-40c8-b472-b43a5de53162 admin admin] PATH_INFO: `/v3/projects/19b72ba11e904abebb2bfd558261b5b1/users/2f338f404c5340d6903d71d16832bb1a/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:57.830176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1f56a7-e122-40c8-b472-b43a5de53162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19b72ba11e904abebb2bfd558261b5b1, user_id=2f338f404c5340d6903d71d16832bb1a, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:57.844821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1f56a7-e122-40c8-b472-b43a5de53162 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:57.882157 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 908/1829] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:57 2022] PUT /identity/v3/projects/19b72ba11e904abebb2bfd558261b5b1/users/2f338f404c5340d6903d71d16832bb1a/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:57.896993 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a223309-46e8-4f94-96bd-7b24fd159ad1 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:57.897688 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a223309-46e8-4f94-96bd-7b24fd159ad1 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:57.898251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a223309-46e8-4f94-96bd-7b24fd159ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:57.940247 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-0a223309-46e8-4f94-96bd-7b24fd159ad1 None None] MFA Rules not processed for user `2f338f404c5340d6903d71d16832bb1a`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:57.941467 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0a223309-46e8-4f94-96bd-7b24fd159ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:58.045349 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 922/1830] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:58.050167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f56a7-e122-40c8-b472-b43a5de53162 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:58.152141 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:58.166576 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f56a7-e122-40c8-b472-b43a5de53162 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:58.177085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743771ca-6f3f-4db9-86f0-f80ddd1d76f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:58.183274 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743771ca-6f3f-4db9-86f0-f80ddd1d76f1 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:58.183559 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743771ca-6f3f-4db9-86f0-f80ddd1d76f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:58.183830 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743771ca-6f3f-4db9-86f0-f80ddd1d76f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:58.184483 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743771ca-6f3f-4db9-86f0-f80ddd1d76f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:58.187174 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743771ca-6f3f-4db9-86f0-f80ddd1d76f1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:58.244679 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 909/1831] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:53:58 2022] POST /identity/v3/projects => generated 373 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:58.246165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a223309-46e8-4f94-96bd-7b24fd159ad1 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:58.264895 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a223309-46e8-4f94-96bd-7b24fd159ad1 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:58.384962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240f852-e5c2-4fbb-935a-36c415528704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:58.385650 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240f852-e5c2-4fbb-935a-36c415528704 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:58.385910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240f852-e5c2-4fbb-935a-36c415528704 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:58.386205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240f852-e5c2-4fbb-935a-36c415528704 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:58.386857 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f240f852-e5c2-4fbb-935a-36c415528704 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:58.388798 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f240f852-e5c2-4fbb-935a-36c415528704 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:58.478681 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 923/1832] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:53:58 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:53:58.481756 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743771ca-6f3f-4db9-86f0-f80ddd1d76f1 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:58.496292 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743771ca-6f3f-4db9-86f0-f80ddd1d76f1 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:58.521011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde2be0-df5a-4a55-9b65-452059c15231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:58.524047 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde2be0-df5a-4a55-9b65-452059c15231 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:58.524047 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde2be0-df5a-4a55-9b65-452059c15231 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:58.524941 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde2be0-df5a-4a55-9b65-452059c15231 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:58.525832 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde2be0-df5a-4a55-9b65-452059c15231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:58.532817 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde2be0-df5a-4a55-9b65-452059c15231 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:58.564205 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 910/1833] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:58.569265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240f852-e5c2-4fbb-935a-36c415528704 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:58.603688 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240f852-e5c2-4fbb-935a-36c415528704 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:58.626645 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f8cf1-bf1b-4bf7-9645-871d18cbbb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:58.628582 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f8cf1-bf1b-4bf7-9645-871d18cbbb21 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:58.629783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f8cf1-bf1b-4bf7-9645-871d18cbbb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:58.631338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f8cf1-bf1b-4bf7-9645-871d18cbbb21 admin admin] PATH_INFO: `/v3/projects/ce386f9bb1654c03b083f070d587bd30/users/89fc5615ddc64689b26e01c8e6e14dae/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:58.682458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f8cf1-bf1b-4bf7-9645-871d18cbbb21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce386f9bb1654c03b083f070d587bd30, user_id=89fc5615ddc64689b26e01c8e6e14dae, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:58.690766 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f8cf1-bf1b-4bf7-9645-871d18cbbb21 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:58.733546 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 924/1834] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:58 2022] PUT /identity/v3/projects/ce386f9bb1654c03b083f070d587bd30/users/89fc5615ddc64689b26e01c8e6e14dae/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:58.738603 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde2be0-df5a-4a55-9b65-452059c15231 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:58.751215 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde2be0-df5a-4a55-9b65-452059c15231 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:58.947540 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032bdb10-266d-4000-a29b-c35408372e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:58.948912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032bdb10-266d-4000-a29b-c35408372e18 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:58.949573 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032bdb10-266d-4000-a29b-c35408372e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:58.950153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032bdb10-266d-4000-a29b-c35408372e18 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:58.952116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032bdb10-266d-4000-a29b-c35408372e18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:58.955564 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032bdb10-266d-4000-a29b-c35408372e18 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:58.982963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f8cf1-bf1b-4bf7-9645-871d18cbbb21 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:58.994376 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 911/1835] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:53:58.998193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f8cf1-bf1b-4bf7-9645-871d18cbbb21 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:59.004877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3e230-c776-4e47-b559-18cf5cb83088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:59.005876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3e230-c776-4e47-b559-18cf5cb83088 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:59.006304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3e230-c776-4e47-b559-18cf5cb83088 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:59.006798 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3e230-c776-4e47-b559-18cf5cb83088 admin admin] PATH_INFO: `/v3/projects/ce386f9bb1654c03b083f070d587bd30/users/89fc5615ddc64689b26e01c8e6e14dae/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:59.010070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3e230-c776-4e47-b559-18cf5cb83088 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce386f9bb1654c03b083f070d587bd30, user_id=89fc5615ddc64689b26e01c8e6e14dae, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:59.013770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3e230-c776-4e47-b559-18cf5cb83088 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:59.021297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:59.037023 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 925/1836] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:53:58 2022] PUT /identity/v3/projects/ce386f9bb1654c03b083f070d587bd30/users/89fc5615ddc64689b26e01c8e6e14dae/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:59.048381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c4236-775b-42dc-b43e-7f600c104e4b None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:59.048781 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c4236-775b-42dc-b43e-7f600c104e4b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:59.049154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c4236-775b-42dc-b43e-7f600c104e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:59.119540 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-126c4236-775b-42dc-b43e-7f600c104e4b None None] MFA Rules not processed for user `89fc5615ddc64689b26e01c8e6e14dae`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:59.124508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-126c4236-775b-42dc-b43e-7f600c104e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:59.312493 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3e230-c776-4e47-b559-18cf5cb83088 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:59.316858 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-aba3e230-c776-4e47-b559-18cf5cb83088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:59.355301 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 912/1837] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:59.366114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c4236-775b-42dc-b43e-7f600c104e4b None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:59.369544 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-126c4236-775b-42dc-b43e-7f600c104e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:59.485354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3e230-c776-4e47-b559-18cf5cb83088 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:59.486377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:59.493615 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c83681-74a1-47e5-9e52-e572935defd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:59.494954 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c83681-74a1-47e5-9e52-e572935defd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:59.496249 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c83681-74a1-47e5-9e52-e572935defd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:59.497282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c83681-74a1-47e5-9e52-e572935defd0 admin admin] PATH_INFO: `/v3/users/c19cd2627416432ebb31aae9585ba454` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:59.499892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c83681-74a1-47e5-9e52-e572935defd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c19cd2627416432ebb31aae9585ba454)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:59.503724 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c83681-74a1-47e5-9e52-e572935defd0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:59.505078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c4236-775b-42dc-b43e-7f600c104e4b None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:59.518750 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa585c-53b0-49f6-b287-19c2e962e3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:59.519232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa585c-53b0-49f6-b287-19c2e962e3f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:59.519854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa585c-53b0-49f6-b287-19c2e962e3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:59.519854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa585c-53b0-49f6-b287-19c2e962e3f2 admin admin] PATH_INFO: `/v3/users/7ca328f6f2ae4f74930b7abba8180cae` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:59.522363 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fa585c-53b0-49f6-b287-19c2e962e3f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ca328f6f2ae4f74930b7abba8180cae)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:59.525857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fa585c-53b0-49f6-b287-19c2e962e3f2 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:59.658225 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-63c83681-74a1-47e5-9e52-e572935defd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c19cd2627416432ebb31aae9585ba454'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:59.666150 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-63c83681-74a1-47e5-9e52-e572935defd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c19cd2627416432ebb31aae9585ba454'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:59.666959 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-63c83681-74a1-47e5-9e52-e572935defd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c19cd2627416432ebb31aae9585ba454'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:59.668019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-63c83681-74a1-47e5-9e52-e572935defd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c19cd2627416432ebb31aae9585ba454'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:59.763856 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-63c83681-74a1-47e5-9e52-e572935defd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c19cd2627416432ebb31aae9585ba454'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:59.806322 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 926/1838] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:53:59 2022] DELETE /identity/v3/users/c19cd2627416432ebb31aae9585ba454 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:59.808805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c83681-74a1-47e5-9e52-e572935defd0 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:59.812864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b4fa585c-53b0-49f6-b287-19c2e962e3f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ca328f6f2ae4f74930b7abba8180cae'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:59.813872 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b4fa585c-53b0-49f6-b287-19c2e962e3f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ca328f6f2ae4f74930b7abba8180cae'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:59.814534 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b4fa585c-53b0-49f6-b287-19c2e962e3f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ca328f6f2ae4f74930b7abba8180cae'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:59.814796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-63c83681-74a1-47e5-9e52-e572935defd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:59.826960 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b4fa585c-53b0-49f6-b287-19c2e962e3f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ca328f6f2ae4f74930b7abba8180cae'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:59.848403 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b4fa585c-53b0-49f6-b287-19c2e962e3f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ca328f6f2ae4f74930b7abba8180cae'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:59.885548 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 913/1839] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:53:59 2022] DELETE /identity/v3/users/7ca328f6f2ae4f74930b7abba8180cae => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:59.885548 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993b0d0-a34c-4f54-8aec-d03f23dbd723 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:59.885548 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993b0d0-a34c-4f54-8aec-d03f23dbd723 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:59.887586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993b0d0-a34c-4f54-8aec-d03f23dbd723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:59.943230 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-c993b0d0-a34c-4f54-8aec-d03f23dbd723 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:59.945135 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c993b0d0-a34c-4f54-8aec-d03f23dbd723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:59.984510 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c83681-74a1-47e5-9e52-e572935defd0 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:00.011875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:00.041284 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 914/1840] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:00.043145 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fb29d-6fb0-47a0-9bbc-e845b972f6a9 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:00.043530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fb29d-6fb0-47a0-9bbc-e845b972f6a9 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:00.044756 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fb29d-6fb0-47a0-9bbc-e845b972f6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:00.073104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-5b9fb29d-6fb0-47a0-9bbc-e845b972f6a9 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:00.074622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5b9fb29d-6fb0-47a0-9bbc-e845b972f6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:00.086003 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 915/1841] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:00.087147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9fb29d-6fb0-47a0-9bbc-e845b972f6a9 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:00.097478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5b9fb29d-6fb0-47a0-9bbc-e845b972f6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:00.226097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9fb29d-6fb0-47a0-9bbc-e845b972f6a9 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:00.231645 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492eaf2f-53a5-430d-bdcd-44fc4905e177 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:00.232501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492eaf2f-53a5-430d-bdcd-44fc4905e177 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:00.232947 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492eaf2f-53a5-430d-bdcd-44fc4905e177 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:00.233375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492eaf2f-53a5-430d-bdcd-44fc4905e177 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:00.234307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4bbe81-6acc-410c-b6e3-31f659a8105b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:00.236351 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4bbe81-6acc-410c-b6e3-31f659a8105b service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:00.236841 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4bbe81-6acc-410c-b6e3-31f659a8105b service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:00.237720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-492eaf2f-53a5-430d-bdcd-44fc4905e177 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:00.238149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4bbe81-6acc-410c-b6e3-31f659a8105b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:00.266481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4bbe81-6acc-410c-b6e3-31f659a8105b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:00.272582 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4bbe81-6acc-410c-b6e3-31f659a8105b service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:00.286977 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 916/1842] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:00.300737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4bbe81-6acc-410c-b6e3-31f659a8105b service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:00.315622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4bbe81-6acc-410c-b6e3-31f659a8105b service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:00.328451 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ccab1-0491-4384-9c10-7c9fac905b61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:00.329714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ccab1-0491-4384-9c10-7c9fac905b61 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:00.330215 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ccab1-0491-4384-9c10-7c9fac905b61 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:00.330772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ccab1-0491-4384-9c10-7c9fac905b61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:00.335382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492eaf2f-53a5-430d-bdcd-44fc4905e177 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:00.339495 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492eaf2f-53a5-430d-bdcd-44fc4905e177 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:00.347183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:00.357007 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ccab1-0491-4384-9c10-7c9fac905b61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:00.359265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ccab1-0491-4384-9c10-7c9fac905b61 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:00.362022 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 927/1843] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:00.408562 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 917/1844] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:00.895080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492eaf2f-53a5-430d-bdcd-44fc4905e177 service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:00.908006 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-492eaf2f-53a5-430d-bdcd-44fc4905e177 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:00.933892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492eaf2f-53a5-430d-bdcd-44fc4905e177 service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:00.939162 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0423b-1c16-4564-b580-05975031e85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:00.939863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0423b-1c16-4564-b580-05975031e85d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:00.940148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0423b-1c16-4564-b580-05975031e85d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:00.940422 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0423b-1c16-4564-b580-05975031e85d admin admin] PATH_INFO: `/v3/projects/1e7f91382c8542e899d5ac3d782ca99d` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:00.948411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0423b-1c16-4564-b580-05975031e85d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e7f91382c8542e899d5ac3d782ca99d)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:00.950430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0423b-1c16-4564-b580-05975031e85d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:01.054097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-96c0423b-1c16-4564-b580-05975031e85d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e7f91382c8542e899d5ac3d782ca99d', 'request_id': 'req-96c0423b-1c16-4564-b580-05975031e85d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:01.060248 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-96c0423b-1c16-4564-b580-05975031e85d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e7f91382c8542e899d5ac3d782ca99d', 'request_id': 'req-96c0423b-1c16-4564-b580-05975031e85d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:01.069431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-96c0423b-1c16-4564-b580-05975031e85d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e7f91382c8542e899d5ac3d782ca99d', 'request_id': 'req-96c0423b-1c16-4564-b580-05975031e85d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:01.086842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-96c0423b-1c16-4564-b580-05975031e85d admin admin] The token cache is being invalidate because project 1e7f91382c8542e899d5ac3d782ca99d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:54:01.087212 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-96c0423b-1c16-4564-b580-05975031e85d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:01.087869 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-96c0423b-1c16-4564-b580-05975031e85d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:01.093218 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 928/1845] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:54:00 2022] DELETE /identity/v3/projects/1e7f91382c8542e899d5ac3d782ca99d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:01.094510 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ccab1-0491-4384-9c10-7c9fac905b61 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:01.113734 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ccab1-0491-4384-9c10-7c9fac905b61 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:01.190067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0423b-1c16-4564-b580-05975031e85d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:01.193489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-96c0423b-1c16-4564-b580-05975031e85d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:01.273937 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412447dd-add1-41cd-b6c2-2fb48f0d74d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:01.274720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412447dd-add1-41cd-b6c2-2fb48f0d74d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:01.275142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412447dd-add1-41cd-b6c2-2fb48f0d74d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:01.275426 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412447dd-add1-41cd-b6c2-2fb48f0d74d7 admin admin] PATH_INFO: `/v3/users/a71ca26f10204adabd52fbbc1a90b313` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:01.276741 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412447dd-add1-41cd-b6c2-2fb48f0d74d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a71ca26f10204adabd52fbbc1a90b313)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:01.279537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412447dd-add1-41cd-b6c2-2fb48f0d74d7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:01.309702 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:01.375646 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-412447dd-add1-41cd-b6c2-2fb48f0d74d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a71ca26f10204adabd52fbbc1a90b313'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:01.376375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-412447dd-add1-41cd-b6c2-2fb48f0d74d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a71ca26f10204adabd52fbbc1a90b313'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:01.377712 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-412447dd-add1-41cd-b6c2-2fb48f0d74d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a71ca26f10204adabd52fbbc1a90b313'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:01.395904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-412447dd-add1-41cd-b6c2-2fb48f0d74d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a71ca26f10204adabd52fbbc1a90b313'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:01.398949 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0423b-1c16-4564-b580-05975031e85d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:01.418602 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fcd48-e356-405c-9f4b-74c603f54d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:01.419537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fcd48-e356-405c-9f4b-74c603f54d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:01.419916 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fcd48-e356-405c-9f4b-74c603f54d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:01.420309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fcd48-e356-405c-9f4b-74c603f54d51 admin admin] PATH_INFO: `/v3/projects/473c326e84db4af9bd35a553fe9a2204` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:01.426724 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219fcd48-e356-405c-9f4b-74c603f54d51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=473c326e84db4af9bd35a553fe9a2204)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:01.429179 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219fcd48-e356-405c-9f4b-74c603f54d51 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:01.429606 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-412447dd-add1-41cd-b6c2-2fb48f0d74d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a71ca26f10204adabd52fbbc1a90b313'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:01.471134 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 918/1846] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:54:01 2022] DELETE /identity/v3/users/a71ca26f10204adabd52fbbc1a90b313 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:01.575576 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-219fcd48-e356-405c-9f4b-74c603f54d51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '473c326e84db4af9bd35a553fe9a2204', 'request_id': 'req-219fcd48-e356-405c-9f4b-74c603f54d51'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:01.591714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-219fcd48-e356-405c-9f4b-74c603f54d51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '473c326e84db4af9bd35a553fe9a2204', 'request_id': 'req-219fcd48-e356-405c-9f4b-74c603f54d51'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:01.621594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-219fcd48-e356-405c-9f4b-74c603f54d51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '473c326e84db4af9bd35a553fe9a2204', 'request_id': 'req-219fcd48-e356-405c-9f4b-74c603f54d51'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:01.641198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-219fcd48-e356-405c-9f4b-74c603f54d51 admin admin] The token cache is being invalidate because project 473c326e84db4af9bd35a553fe9a2204 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:54:01.642033 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-219fcd48-e356-405c-9f4b-74c603f54d51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:01.643129 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-219fcd48-e356-405c-9f4b-74c603f54d51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:01.645266 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 929/1847] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:54:01 2022] DELETE /identity/v3/projects/473c326e84db4af9bd35a553fe9a2204 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:54:01.649458 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412447dd-add1-41cd-b6c2-2fb48f0d74d7 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:01.652051 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-412447dd-add1-41cd-b6c2-2fb48f0d74d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:01.762577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412447dd-add1-41cd-b6c2-2fb48f0d74d7 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:01.835100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:01.974219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921065c8-3969-4d94-8a17-e1701ce3d504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:01.976154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921065c8-3969-4d94-8a17-e1701ce3d504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:01.976871 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921065c8-3969-4d94-8a17-e1701ce3d504 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:01.979005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921065c8-3969-4d94-8a17-e1701ce3d504 admin admin] PATH_INFO: `/v3/users/b3745ec475b14e6ab1c91c30587e4ce7` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:01.982019 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921065c8-3969-4d94-8a17-e1701ce3d504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3745ec475b14e6ab1c91c30587e4ce7)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:01.988216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921065c8-3969-4d94-8a17-e1701ce3d504 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:02.050521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fcd48-e356-405c-9f4b-74c603f54d51 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:02.052174 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-219fcd48-e356-405c-9f4b-74c603f54d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:02.086047 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fcd48-e356-405c-9f4b-74c603f54d51 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:02.099447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ecf1e-2ac9-4a1c-a866-b5baa48cb612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:02.100633 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ecf1e-2ac9-4a1c-a866-b5baa48cb612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:02.100633 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ecf1e-2ac9-4a1c-a866-b5baa48cb612 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:02.100849 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ecf1e-2ac9-4a1c-a866-b5baa48cb612 admin admin] PATH_INFO: `/v3/projects/d9a2fab477774c5d92558233744dd41a` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:02.103722 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ecf1e-2ac9-4a1c-a866-b5baa48cb612 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9a2fab477774c5d92558233744dd41a)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:02.106193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ecf1e-2ac9-4a1c-a866-b5baa48cb612 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:02.149417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-921065c8-3969-4d94-8a17-e1701ce3d504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3745ec475b14e6ab1c91c30587e4ce7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:02.151385 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-921065c8-3969-4d94-8a17-e1701ce3d504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3745ec475b14e6ab1c91c30587e4ce7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:02.152985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-921065c8-3969-4d94-8a17-e1701ce3d504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3745ec475b14e6ab1c91c30587e4ce7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:02.170250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-921065c8-3969-4d94-8a17-e1701ce3d504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3745ec475b14e6ab1c91c30587e4ce7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:02.186955 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-921065c8-3969-4d94-8a17-e1701ce3d504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3745ec475b14e6ab1c91c30587e4ce7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:02.206587 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 919/1848] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:54:01 2022] DELETE /identity/v3/users/b3745ec475b14e6ab1c91c30587e4ce7 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:02.231534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-876ecf1e-2ac9-4a1c-a866-b5baa48cb612 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9a2fab477774c5d92558233744dd41a', 'request_id': 'req-876ecf1e-2ac9-4a1c-a866-b5baa48cb612'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:02.239990 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-876ecf1e-2ac9-4a1c-a866-b5baa48cb612 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9a2fab477774c5d92558233744dd41a', 'request_id': 'req-876ecf1e-2ac9-4a1c-a866-b5baa48cb612'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:02.273653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-876ecf1e-2ac9-4a1c-a866-b5baa48cb612 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9a2fab477774c5d92558233744dd41a', 'request_id': 'req-876ecf1e-2ac9-4a1c-a866-b5baa48cb612'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:02.295504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-876ecf1e-2ac9-4a1c-a866-b5baa48cb612 admin admin] The token cache is being invalidate because project d9a2fab477774c5d92558233744dd41a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:54:02.295937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-876ecf1e-2ac9-4a1c-a866-b5baa48cb612 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:02.297334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-876ecf1e-2ac9-4a1c-a866-b5baa48cb612 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:02.300587 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 930/1849] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:54:02 2022] DELETE /identity/v3/projects/d9a2fab477774c5d92558233744dd41a => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:02.305999 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0af6ff-57a4-4b54-b833-7205a832c8fb None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:02.306316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0af6ff-57a4-4b54-b833-7205a832c8fb None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:02.306624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0af6ff-57a4-4b54-b833-7205a832c8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:02.333774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-de0af6ff-57a4-4b54-b833-7205a832c8fb None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:02.335458 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-de0af6ff-57a4-4b54-b833-7205a832c8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:02.430924 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 920/1850] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:54:02.435289 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c0174-df45-448a-ad3d-f6cd833f38ab None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:02.435609 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c0174-df45-448a-ad3d-f6cd833f38ab None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:02.435867 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c0174-df45-448a-ad3d-f6cd833f38ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:02.474081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a76c0174-df45-448a-ad3d-f6cd833f38ab None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:02.476876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a76c0174-df45-448a-ad3d-f6cd833f38ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:02.493590 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 931/1851] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:02.497538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0af6ff-57a4-4b54-b833-7205a832c8fb None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:02.516870 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0af6ff-57a4-4b54-b833-7205a832c8fb None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:02.524572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e4252-1447-4a76-9721-646b3bd84895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:02.526026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e4252-1447-4a76-9721-646b3bd84895 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:02.528006 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e4252-1447-4a76-9721-646b3bd84895 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:02.528713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e4252-1447-4a76-9721-646b3bd84895 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:02.530071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e4252-1447-4a76-9721-646b3bd84895 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:54:02.530661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e4252-1447-4a76-9721-646b3bd84895 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:02.534869 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e4252-1447-4a76-9721-646b3bd84895 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:02.556273 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 921/1852] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:54:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:54:02.560712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c0174-df45-448a-ad3d-f6cd833f38ab None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:02.607008 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c0174-df45-448a-ad3d-f6cd833f38ab None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:02.619472 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911245d6-ce69-4029-b66b-316d4989c26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:02.634515 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911245d6-ce69-4029-b66b-316d4989c26c admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:02.634900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911245d6-ce69-4029-b66b-316d4989c26c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:02.635175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911245d6-ce69-4029-b66b-316d4989c26c admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:02.636470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911245d6-ce69-4029-b66b-316d4989c26c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:02.637822 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911245d6-ce69-4029-b66b-316d4989c26c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:02.705866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e4252-1447-4a76-9721-646b3bd84895 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:02.707272 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 932/1853] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:54:02 2022] POST /identity/v3/projects => generated 393 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:54:02.722019 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e4252-1447-4a76-9721-646b3bd84895 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:02.772091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:02.829638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50176bc-0c25-45cd-876e-90bb2884b87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:02.830571 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50176bc-0c25-45cd-876e-90bb2884b87a admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:02.831115 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50176bc-0c25-45cd-876e-90bb2884b87a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:02.832022 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50176bc-0c25-45cd-876e-90bb2884b87a admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:02.833184 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50176bc-0c25-45cd-876e-90bb2884b87a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:02.836419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50176bc-0c25-45cd-876e-90bb2884b87a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:02.856252 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911245d6-ce69-4029-b66b-316d4989c26c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:02.858880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-911245d6-ce69-4029-b66b-316d4989c26c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:02.892337 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 922/1854] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:54:02 2022] POST /identity/v3/users => generated 297 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:02.896625 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50176bc-0c25-45cd-876e-90bb2884b87a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:02.897793 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911245d6-ce69-4029-b66b-316d4989c26c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:02.911460 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50176bc-0c25-45cd-876e-90bb2884b87a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:02.918530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab92913-8781-4a88-9a96-c4e92af5352e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:02.919416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab92913-8781-4a88-9a96-c4e92af5352e admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:02.919763 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab92913-8781-4a88-9a96-c4e92af5352e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:02.920139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab92913-8781-4a88-9a96-c4e92af5352e admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:02.921191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab92913-8781-4a88-9a96-c4e92af5352e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:02.921310 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281eb98-c60f-442e-9264-747179754a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:02.922422 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281eb98-c60f-442e-9264-747179754a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:02.923379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281eb98-c60f-442e-9264-747179754a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:02.923665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281eb98-c60f-442e-9264-747179754a1b admin admin] PATH_INFO: `/v3/projects/5350318c4f7146199a598d17d0bd6251` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:02.924236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab92913-8781-4a88-9a96-c4e92af5352e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:02.925310 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281eb98-c60f-442e-9264-747179754a1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5350318c4f7146199a598d17d0bd6251)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:02.927285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281eb98-c60f-442e-9264-747179754a1b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:02.957458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:02.973727 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 923/1855] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:02.977467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab92913-8781-4a88-9a96-c4e92af5352e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:03.002341 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab92913-8781-4a88-9a96-c4e92af5352e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:03.018810 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9281eb98-c60f-442e-9264-747179754a1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5350318c4f7146199a598d17d0bd6251', 'request_id': 'req-9281eb98-c60f-442e-9264-747179754a1b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:03.029087 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9281eb98-c60f-442e-9264-747179754a1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5350318c4f7146199a598d17d0bd6251', 'request_id': 'req-9281eb98-c60f-442e-9264-747179754a1b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:03.053533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9281eb98-c60f-442e-9264-747179754a1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5350318c4f7146199a598d17d0bd6251', 'request_id': 'req-9281eb98-c60f-442e-9264-747179754a1b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:03.073292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9281eb98-c60f-442e-9264-747179754a1b admin admin] The token cache is being invalidate because project 5350318c4f7146199a598d17d0bd6251 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:54:03.073578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9281eb98-c60f-442e-9264-747179754a1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:03.074409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9281eb98-c60f-442e-9264-747179754a1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:03.078600 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 933/1856] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:54:02 2022] DELETE /identity/v3/projects/5350318c4f7146199a598d17d0bd6251 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:54:03.083649 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25c2c2-1a27-4d9b-958f-0e12089f040d None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:03.084115 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25c2c2-1a27-4d9b-958f-0e12089f040d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:03.084543 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25c2c2-1a27-4d9b-958f-0e12089f040d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:03.095115 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49aff0-5003-4c37-a6d9-b0523ca1d80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:03.095735 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49aff0-5003-4c37-a6d9-b0523ca1d80f admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:03.096104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49aff0-5003-4c37-a6d9-b0523ca1d80f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:03.096296 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49aff0-5003-4c37-a6d9-b0523ca1d80f admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:03.096946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49aff0-5003-4c37-a6d9-b0523ca1d80f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:03.098732 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49aff0-5003-4c37-a6d9-b0523ca1d80f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:03.114783 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 924/1857] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:03.116432 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49aff0-5003-4c37-a6d9-b0523ca1d80f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:03.118640 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-db49aff0-5003-4c37-a6d9-b0523ca1d80f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:03.130836 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-7d25c2c2-1a27-4d9b-958f-0e12089f040d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:03.132048 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7d25c2c2-1a27-4d9b-958f-0e12089f040d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:03.149204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49aff0-5003-4c37-a6d9-b0523ca1d80f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:03.154260 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 934/1858] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:54:03.166182 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bab54-7161-4c87-8f18-4292986def40 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:03.166423 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bab54-7161-4c87-8f18-4292986def40 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:03.166760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bab54-7161-4c87-8f18-4292986def40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:03.177301 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc1aae-0ae7-4537-87a0-acc51e9fe398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:03.178052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc1aae-0ae7-4537-87a0-acc51e9fe398 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:03.178496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc1aae-0ae7-4537-87a0-acc51e9fe398 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:03.179181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc1aae-0ae7-4537-87a0-acc51e9fe398 admin admin] PATH_INFO: `/v3/projects/13b4edcd2ab9416fb3330337a4a4c53e/users/bc5fb6225ca345399dc652d9b72cfa0d/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:03.202105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-886bab54-7161-4c87-8f18-4292986def40 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:03.204637 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-886bab54-7161-4c87-8f18-4292986def40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:03.212901 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfc1aae-0ae7-4537-87a0-acc51e9fe398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13b4edcd2ab9416fb3330337a4a4c53e, user_id=bc5fb6225ca345399dc652d9b72cfa0d, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:03.213546 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 935/1859] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:54:03.220831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886bab54-7161-4c87-8f18-4292986def40 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:03.225013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfc1aae-0ae7-4537-87a0-acc51e9fe398 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:03.233761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886bab54-7161-4c87-8f18-4292986def40 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:03.239450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce8934-94a6-4936-8c4b-e2cb5fc40892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:03.241397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce8934-94a6-4936-8c4b-e2cb5fc40892 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:03.241397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce8934-94a6-4936-8c4b-e2cb5fc40892 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:03.241397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce8934-94a6-4936-8c4b-e2cb5fc40892 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:03.241397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce8934-94a6-4936-8c4b-e2cb5fc40892 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:54:03.241884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce8934-94a6-4936-8c4b-e2cb5fc40892 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:03.246901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce8934-94a6-4936-8c4b-e2cb5fc40892 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:03.258373 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 925/1860] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:03 2022] PUT /identity/v3/projects/13b4edcd2ab9416fb3330337a4a4c53e/users/bc5fb6225ca345399dc652d9b72cfa0d/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:03.260256 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3170d0b-0120-4dad-bf67-8cced94f5826 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:03.260594 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3170d0b-0120-4dad-bf67-8cced94f5826 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:03.260867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3170d0b-0120-4dad-bf67-8cced94f5826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:03.296339 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 936/1861] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:54:03.299376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce8934-94a6-4936-8c4b-e2cb5fc40892 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:03.321985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-c3170d0b-0120-4dad-bf67-8cced94f5826 None None] MFA Rules not processed for user `bc5fb6225ca345399dc652d9b72cfa0d`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:03.323245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c3170d0b-0120-4dad-bf67-8cced94f5826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:03.324208 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce8934-94a6-4936-8c4b-e2cb5fc40892 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:03.434993 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe349e-a18e-4284-941c-e45338170766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:03.435796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe349e-a18e-4284-941c-e45338170766 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:03.436526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe349e-a18e-4284-941c-e45338170766 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:03.436832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe349e-a18e-4284-941c-e45338170766 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:03.438154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe349e-a18e-4284-941c-e45338170766 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:03.440200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe349e-a18e-4284-941c-e45338170766 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:03.468700 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 926/1862] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:03 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:03.473661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3170d0b-0120-4dad-bf67-8cced94f5826 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:03.498588 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 937/1863] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:54:03 2022] POST /identity/v3/projects => generated 391 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:03.500297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe349e-a18e-4284-941c-e45338170766 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:03.516693 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3170d0b-0120-4dad-bf67-8cced94f5826 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:03.524048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:03.652286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:03.659305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe349e-a18e-4284-941c-e45338170766 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:03.667930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a198d07-b0fc-476e-80d5-494272dcf4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:03.667930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a198d07-b0fc-476e-80d5-494272dcf4c8 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:03.667930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a198d07-b0fc-476e-80d5-494272dcf4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:03.667930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a198d07-b0fc-476e-80d5-494272dcf4c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:03.668296 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a198d07-b0fc-476e-80d5-494272dcf4c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:03.670410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a198d07-b0fc-476e-80d5-494272dcf4c8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:03.677790 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324406e5-f5fa-4ad3-8ee4-b246439c075a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:03.677973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324406e5-f5fa-4ad3-8ee4-b246439c075a admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:03.678584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324406e5-f5fa-4ad3-8ee4-b246439c075a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:03.678584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324406e5-f5fa-4ad3-8ee4-b246439c075a admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:03.679616 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324406e5-f5fa-4ad3-8ee4-b246439c075a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:03.681310 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324406e5-f5fa-4ad3-8ee4-b246439c075a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:03.728178 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 938/1864] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:54:03 2022] POST /identity/v3/users => generated 296 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:54:03.731905 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324406e5-f5fa-4ad3-8ee4-b246439c075a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:03.739072 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 927/1865] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:54:03 2022] POST /identity/v3/projects => generated 395 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:03.743207 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a198d07-b0fc-476e-80d5-494272dcf4c8 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:03.744471 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324406e5-f5fa-4ad3-8ee4-b246439c075a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:03.824424 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a198d07-b0fc-476e-80d5-494272dcf4c8 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:03.824683 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ebbbe5-1146-46b8-a76e-7088e2d56ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:03.824683 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebbbe5-1146-46b8-a76e-7088e2d56ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:03.825789 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebbbe5-1146-46b8-a76e-7088e2d56ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:03.826126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebbbe5-1146-46b8-a76e-7088e2d56ca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:03.827127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ebbbe5-1146-46b8-a76e-7088e2d56ca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:03.830662 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac3d61-ead2-4773-88b9-8d13a13296da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:03.832459 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac3d61-ead2-4773-88b9-8d13a13296da admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:03.832614 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ebbbe5-1146-46b8-a76e-7088e2d56ca0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:03.832729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac3d61-ead2-4773-88b9-8d13a13296da admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:03.832729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac3d61-ead2-4773-88b9-8d13a13296da admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:03.833139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac3d61-ead2-4773-88b9-8d13a13296da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:03.835265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac3d61-ead2-4773-88b9-8d13a13296da admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:03.846888 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 939/1866] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:54:03.848325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ebbbe5-1146-46b8-a76e-7088e2d56ca0 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:03.859905 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ebbbe5-1146-46b8-a76e-7088e2d56ca0 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:03.861496 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 928/1867] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:54:03 2022] POST /identity/v3/users => generated 304 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:03.865879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac3d61-ead2-4773-88b9-8d13a13296da admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:03.875686 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af15b8a-c2c0-49c5-8e21-92aa796b2ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:03.876328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af15b8a-c2c0-49c5-8e21-92aa796b2ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:03.876595 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af15b8a-c2c0-49c5-8e21-92aa796b2ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:03.876875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af15b8a-c2c0-49c5-8e21-92aa796b2ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:03.877515 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af15b8a-c2c0-49c5-8e21-92aa796b2ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:03.879087 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac3d61-ead2-4773-88b9-8d13a13296da admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:03.879224 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af15b8a-c2c0-49c5-8e21-92aa796b2ed3 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:03.885792 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6226d10f-a817-4071-96bc-e4ad3ab40eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:03.887247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226d10f-a817-4071-96bc-e4ad3ab40eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:03.887630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226d10f-a817-4071-96bc-e4ad3ab40eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:03.888076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226d10f-a817-4071-96bc-e4ad3ab40eb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:03.889417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6226d10f-a817-4071-96bc-e4ad3ab40eb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:03.891202 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6226d10f-a817-4071-96bc-e4ad3ab40eb9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:03.893748 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 940/1868] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:54:03.899149 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af15b8a-c2c0-49c5-8e21-92aa796b2ed3 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:03.912627 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af15b8a-c2c0-49c5-8e21-92aa796b2ed3 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:03.914734 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 929/1869] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:54:03.916792 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6226d10f-a817-4071-96bc-e4ad3ab40eb9 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:03.920249 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd641410-746e-4556-ad98-ab0dd44df29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:03.921000 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd641410-746e-4556-ad98-ab0dd44df29b admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:03.921520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd641410-746e-4556-ad98-ab0dd44df29b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:03.922206 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd641410-746e-4556-ad98-ab0dd44df29b admin admin] PATH_INFO: `/v3/projects/a9a98197762f43ebb2d16b69afd05a23/users/59c31f71a22b43b5ba8c98b831147fbd/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:03.931245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6226d10f-a817-4071-96bc-e4ad3ab40eb9 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:03.937804 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd2e8a-6bc8-435c-a575-e53f4032a11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:03.938650 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd2e8a-6bc8-435c-a575-e53f4032a11c admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:03.938957 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd2e8a-6bc8-435c-a575-e53f4032a11c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:03.939740 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd2e8a-6bc8-435c-a575-e53f4032a11c admin admin] PATH_INFO: `/v3/projects/f99f37cc9e6641f8a6b2fbcd1198df8d/users/8ecb0415b81e4205b9a69afee267d8fc/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:03.944615 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd641410-746e-4556-ad98-ab0dd44df29b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9a98197762f43ebb2d16b69afd05a23, user_id=59c31f71a22b43b5ba8c98b831147fbd, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:03.954402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd641410-746e-4556-ad98-ab0dd44df29b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:03.966527 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd2e8a-6bc8-435c-a575-e53f4032a11c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f99f37cc9e6641f8a6b2fbcd1198df8d, user_id=8ecb0415b81e4205b9a69afee267d8fc, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:03.970490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd2e8a-6bc8-435c-a575-e53f4032a11c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:03.971143 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 941/1870] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:03 2022] PUT /identity/v3/projects/a9a98197762f43ebb2d16b69afd05a23/users/59c31f71a22b43b5ba8c98b831147fbd/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:03.982861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105eb28c-8780-40cd-8a8d-62bd6ae389fe None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:03.983166 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105eb28c-8780-40cd-8a8d-62bd6ae389fe None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:03.983694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105eb28c-8780-40cd-8a8d-62bd6ae389fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:03.993454 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 930/1871] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:03 2022] PUT /identity/v3/projects/f99f37cc9e6641f8a6b2fbcd1198df8d/users/8ecb0415b81e4205b9a69afee267d8fc/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:03.997598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd2e8a-6bc8-435c-a575-e53f4032a11c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:04.012882 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-105eb28c-8780-40cd-8a8d-62bd6ae389fe None None] MFA Rules not processed for user `59c31f71a22b43b5ba8c98b831147fbd`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:04.014090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-105eb28c-8780-40cd-8a8d-62bd6ae389fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:04.049879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:04.069463 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd2e8a-6bc8-435c-a575-e53f4032a11c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:04.074417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd8d0f-9a87-4ebb-adc2-bdaddfab9cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:04.075064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd8d0f-9a87-4ebb-adc2-bdaddfab9cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:04.075453 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd8d0f-9a87-4ebb-adc2-bdaddfab9cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:04.075739 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd8d0f-9a87-4ebb-adc2-bdaddfab9cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:04.076389 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd8d0f-9a87-4ebb-adc2-bdaddfab9cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:04.078609 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd8d0f-9a87-4ebb-adc2-bdaddfab9cb4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:04.090614 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 931/1872] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:04.094940 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd8d0f-9a87-4ebb-adc2-bdaddfab9cb4 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:04.095529 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 942/1873] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:03 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:04.100476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105eb28c-8780-40cd-8a8d-62bd6ae389fe None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:04.105273 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd8d0f-9a87-4ebb-adc2-bdaddfab9cb4 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:04.110617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4bf30-1e7a-4c04-93a5-823b195bd966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:04.111553 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4bf30-1e7a-4c04-93a5-823b195bd966 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:04.111998 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4bf30-1e7a-4c04-93a5-823b195bd966 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:04.112572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4bf30-1e7a-4c04-93a5-823b195bd966 admin admin] PATH_INFO: `/v3/projects/f99f37cc9e6641f8a6b2fbcd1198df8d/users/8ecb0415b81e4205b9a69afee267d8fc/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:04.114359 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105eb28c-8780-40cd-8a8d-62bd6ae389fe None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:04.114647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4bf30-1e7a-4c04-93a5-823b195bd966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f99f37cc9e6641f8a6b2fbcd1198df8d, user_id=8ecb0415b81e4205b9a69afee267d8fc, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:04.117369 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4bf30-1e7a-4c04-93a5-823b195bd966 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:04.119871 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f2133-0797-476d-b35f-3589a1c68483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:04.120559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f2133-0797-476d-b35f-3589a1c68483 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:04.120837 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f2133-0797-476d-b35f-3589a1c68483 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:04.121121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f2133-0797-476d-b35f-3589a1c68483 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:04.121914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f2133-0797-476d-b35f-3589a1c68483 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:04.124055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f2133-0797-476d-b35f-3589a1c68483 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:04.129011 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 932/1874] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:04 2022] PUT /identity/v3/projects/f99f37cc9e6641f8a6b2fbcd1198df8d/users/8ecb0415b81e4205b9a69afee267d8fc/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:04.139279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16929d2e-c3a9-4300-b95b-896bbfc4e18f None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:04.139762 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16929d2e-c3a9-4300-b95b-896bbfc4e18f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:04.140217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16929d2e-c3a9-4300-b95b-896bbfc4e18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:04.161073 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 943/1875] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:54:04 2022] POST /identity/v3/projects => generated 391 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:04.162104 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f2133-0797-476d-b35f-3589a1c68483 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:04.178219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-16929d2e-c3a9-4300-b95b-896bbfc4e18f None None] MFA Rules not processed for user `8ecb0415b81e4205b9a69afee267d8fc`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:04.179523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-16929d2e-c3a9-4300-b95b-896bbfc4e18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:04.194241 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:04.246775 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f2133-0797-476d-b35f-3589a1c68483 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:04.251870 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385d3de-e769-4840-8c6f-0285895be02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:04.252614 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385d3de-e769-4840-8c6f-0285895be02c admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:04.252963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385d3de-e769-4840-8c6f-0285895be02c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:04.253303 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385d3de-e769-4840-8c6f-0285895be02c admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:04.253996 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4385d3de-e769-4840-8c6f-0285895be02c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:04.256206 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4385d3de-e769-4840-8c6f-0285895be02c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:04.263297 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 933/1876] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:04 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:54:04.271133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16929d2e-c3a9-4300-b95b-896bbfc4e18f None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:04.272531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-16929d2e-c3a9-4300-b95b-896bbfc4e18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:04.282936 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 944/1877] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:54:04 2022] POST /identity/v3/users => generated 302 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:04.286898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385d3de-e769-4840-8c6f-0285895be02c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:04.300798 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385d3de-e769-4840-8c6f-0285895be02c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:04.310459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0be8a-36cd-473f-8597-2f2326b7d6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:04.311133 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0be8a-36cd-473f-8597-2f2326b7d6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:04.311620 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0be8a-36cd-473f-8597-2f2326b7d6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:04.311805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0be8a-36cd-473f-8597-2f2326b7d6a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:04.312544 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0be8a-36cd-473f-8597-2f2326b7d6a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:04.314292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0be8a-36cd-473f-8597-2f2326b7d6a6 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:04.324495 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 945/1878] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:54:04.329097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0be8a-36cd-473f-8597-2f2326b7d6a6 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:04.339284 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0be8a-36cd-473f-8597-2f2326b7d6a6 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:04.344455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b5eae-d313-4829-9d6c-69555693e6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:04.345088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b5eae-d313-4829-9d6c-69555693e6f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:04.345370 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b5eae-d313-4829-9d6c-69555693e6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:04.345642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b5eae-d313-4829-9d6c-69555693e6f4 admin admin] PATH_INFO: `/v3/projects/2edd3df091ee4fd391c170332ab3ade4/users/3d0382d1018f4878b5f64679164b3350/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:04.355252 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16929d2e-c3a9-4300-b95b-896bbfc4e18f None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:04.361876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b5eae-d313-4829-9d6c-69555693e6f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2edd3df091ee4fd391c170332ab3ade4, user_id=3d0382d1018f4878b5f64679164b3350, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:04.362671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98c98b-f799-45b4-9243-e82224c3894d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:04.363291 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98c98b-f799-45b4-9243-e82224c3894d service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:04.363573 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98c98b-f799-45b4-9243-e82224c3894d service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:04.363849 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98c98b-f799-45b4-9243-e82224c3894d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:04.364728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b5eae-d313-4829-9d6c-69555693e6f4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:04.372423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98c98b-f799-45b4-9243-e82224c3894d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:04.374013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98c98b-f799-45b4-9243-e82224c3894d service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:04.378822 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 946/1879] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:04 2022] PUT /identity/v3/projects/2edd3df091ee4fd391c170332ab3ade4/users/3d0382d1018f4878b5f64679164b3350/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:04.382874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b5eae-d313-4829-9d6c-69555693e6f4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:04.384214 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 934/1880] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:04 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:04.448300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b5eae-d313-4829-9d6c-69555693e6f4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:04.455004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41746736-e5b5-495c-a919-71c1e74de167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:04.456035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41746736-e5b5-495c-a919-71c1e74de167 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:04.456321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41746736-e5b5-495c-a919-71c1e74de167 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:04.456596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41746736-e5b5-495c-a919-71c1e74de167 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:04.457590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41746736-e5b5-495c-a919-71c1e74de167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:04.457944 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98c98b-f799-45b4-9243-e82224c3894d service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:04.459266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41746736-e5b5-495c-a919-71c1e74de167 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:04.468814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98c98b-f799-45b4-9243-e82224c3894d service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:04.469953 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 947/1881] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:54:04.473596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41746736-e5b5-495c-a919-71c1e74de167 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:04.473711 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e10a2-42ce-42d8-9976-159ce84fa378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:04.474304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e10a2-42ce-42d8-9976-159ce84fa378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:04.474613 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e10a2-42ce-42d8-9976-159ce84fa378 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:04.474887 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e10a2-42ce-42d8-9976-159ce84fa378 admin admin] PATH_INFO: `/v3/users/bc5fb6225ca345399dc652d9b72cfa0d` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:04.476009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e10a2-42ce-42d8-9976-159ce84fa378 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc5fb6225ca345399dc652d9b72cfa0d)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:04.477916 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e10a2-42ce-42d8-9976-159ce84fa378 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:04.484600 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41746736-e5b5-495c-a919-71c1e74de167 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:04.489456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ef5ec-3b92-4621-9a84-79120c13a08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:04.490094 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ef5ec-3b92-4621-9a84-79120c13a08b admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:04.490376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ef5ec-3b92-4621-9a84-79120c13a08b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:04.490692 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ef5ec-3b92-4621-9a84-79120c13a08b admin admin] PATH_INFO: `/v3/projects/2edd3df091ee4fd391c170332ab3ade4/users/3d0382d1018f4878b5f64679164b3350/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:04.492594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ef5ec-3b92-4621-9a84-79120c13a08b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2edd3df091ee4fd391c170332ab3ade4, user_id=3d0382d1018f4878b5f64679164b3350, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:04.495293 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ef5ec-3b92-4621-9a84-79120c13a08b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:04.506400 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 948/1882] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:04 2022] PUT /identity/v3/projects/2edd3df091ee4fd391c170332ab3ade4/users/3d0382d1018f4878b5f64679164b3350/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:54:04.522637 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:04.524857 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f8f30-cc7a-4fcc-a638-ede1d089bbc4 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:04.525340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f8f30-cc7a-4fcc-a638-ede1d089bbc4 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:04.525900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f8f30-cc7a-4fcc-a638-ede1d089bbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:04.536680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-169e10a2-42ce-42d8-9976-159ce84fa378 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc5fb6225ca345399dc652d9b72cfa0d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:04.537669 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-169e10a2-42ce-42d8-9976-159ce84fa378 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc5fb6225ca345399dc652d9b72cfa0d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:04.538311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-169e10a2-42ce-42d8-9976-159ce84fa378 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc5fb6225ca345399dc652d9b72cfa0d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:04.548169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-169e10a2-42ce-42d8-9976-159ce84fa378 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc5fb6225ca345399dc652d9b72cfa0d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:04.559652 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b98f8f30-cc7a-4fcc-a638-ede1d089bbc4 None None] MFA Rules not processed for user `3d0382d1018f4878b5f64679164b3350`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:04.560921 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b98f8f30-cc7a-4fcc-a638-ede1d089bbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:04.562127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-169e10a2-42ce-42d8-9976-159ce84fa378 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc5fb6225ca345399dc652d9b72cfa0d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:04.576290 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 935/1883] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:54:04 2022] DELETE /identity/v3/users/bc5fb6225ca345399dc652d9b72cfa0d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:54:04.580456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8f4c1-126a-4b67-95ec-e5088c071f7c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:04.580743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8f4c1-126a-4b67-95ec-e5088c071f7c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:04.581018 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8f4c1-126a-4b67-95ec-e5088c071f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:04.599469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-bef8f4c1-126a-4b67-95ec-e5088c071f7c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:04.600795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-bef8f4c1-126a-4b67-95ec-e5088c071f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:04.607159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:04.639428 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 949/1884] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:04 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:54:04.644093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f8f30-cc7a-4fcc-a638-ede1d089bbc4 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:04.645666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b98f8f30-cc7a-4fcc-a638-ede1d089bbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:04.694654 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 936/1885] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:54:04.697447 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8f4c1-126a-4b67-95ec-e5088c071f7c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:04.699499 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-bef8f4c1-126a-4b67-95ec-e5088c071f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:04.720128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f8f30-cc7a-4fcc-a638-ede1d089bbc4 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:04.725720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9539d1-00a8-4dc2-b042-a74873ada061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:04.726411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9539d1-00a8-4dc2-b042-a74873ada061 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:04.726814 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9539d1-00a8-4dc2-b042-a74873ada061 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:04.727161 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9539d1-00a8-4dc2-b042-a74873ada061 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:04.727903 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9539d1-00a8-4dc2-b042-a74873ada061 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:04.729779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9539d1-00a8-4dc2-b042-a74873ada061 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:04.760768 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 950/1886] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:54:04 2022] POST /identity/v3/projects => generated 395 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:04.764818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9539d1-00a8-4dc2-b042-a74873ada061 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:04.769909 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8f4c1-126a-4b67-95ec-e5088c071f7c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:04.828463 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e90ce-a32a-4ff3-a4c0-b3df228caccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:04.829147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e90ce-a32a-4ff3-a4c0-b3df228caccf service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:04.829490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e90ce-a32a-4ff3-a4c0-b3df228caccf service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:04.829847 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e90ce-a32a-4ff3-a4c0-b3df228caccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:04.847824 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9539d1-00a8-4dc2-b042-a74873ada061 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:04.851464 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:04.855105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9865c5d-2cb8-410e-84db-c6aa90df34e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:04.855740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9865c5d-2cb8-410e-84db-c6aa90df34e5 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:04.856755 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9865c5d-2cb8-410e-84db-c6aa90df34e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:04.856755 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9865c5d-2cb8-410e-84db-c6aa90df34e5 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:04.857572 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9865c5d-2cb8-410e-84db-c6aa90df34e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:04.861186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9865c5d-2cb8-410e-84db-c6aa90df34e5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:04.886751 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 951/1887] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:54:04 2022] POST /identity/v3/users => generated 298 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:54:04.891091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9865c5d-2cb8-410e-84db-c6aa90df34e5 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:04.903460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9865c5d-2cb8-410e-84db-c6aa90df34e5 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:04.906733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e90ce-a32a-4ff3-a4c0-b3df228caccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:04.908243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e90ce-a32a-4ff3-a4c0-b3df228caccf service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:04.908787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dce8d5-be3f-47bc-9cdb-571b101585ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:04.909443 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dce8d5-be3f-47bc-9cdb-571b101585ce admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:04.909729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dce8d5-be3f-47bc-9cdb-571b101585ce admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:04.910004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dce8d5-be3f-47bc-9cdb-571b101585ce admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:04.910706 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dce8d5-be3f-47bc-9cdb-571b101585ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:04.912835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dce8d5-be3f-47bc-9cdb-571b101585ce admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:04.920828 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 937/1888] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:54:04.926061 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 952/1889] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:54:04.930253 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e90ce-a32a-4ff3-a4c0-b3df228caccf service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:04.941756 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e90ce-a32a-4ff3-a4c0-b3df228caccf service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:04.946606 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f2276-d7d2-4b69-838f-7ef80c1fed54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:04.947223 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f2276-d7d2-4b69-838f-7ef80c1fed54 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:04.947504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f2276-d7d2-4b69-838f-7ef80c1fed54 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:04.947776 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f2276-d7d2-4b69-838f-7ef80c1fed54 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:04.948424 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f2276-d7d2-4b69-838f-7ef80c1fed54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:04.950090 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f2276-d7d2-4b69-838f-7ef80c1fed54 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:04.964895 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 938/1890] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:04.966388 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dce8d5-be3f-47bc-9cdb-571b101585ce admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:04.978094 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dce8d5-be3f-47bc-9cdb-571b101585ce admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:04.983051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005b2ea-0a58-406e-8eac-323a990a3166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:04.983706 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005b2ea-0a58-406e-8eac-323a990a3166 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:04.984051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005b2ea-0a58-406e-8eac-323a990a3166 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:04.984910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005b2ea-0a58-406e-8eac-323a990a3166 admin admin] PATH_INFO: `/v3/projects/4d138283e1c34da39c090ddf384697eb/users/b8cd3396187b4f34998acced1587aba2/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:05.000703 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005b2ea-0a58-406e-8eac-323a990a3166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d138283e1c34da39c090ddf384697eb, user_id=b8cd3396187b4f34998acced1587aba2, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:05.003535 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005b2ea-0a58-406e-8eac-323a990a3166 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:05.019430 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 953/1891] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:04 2022] PUT /identity/v3/projects/4d138283e1c34da39c090ddf384697eb/users/b8cd3396187b4f34998acced1587aba2/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:05.032673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d233583-10e6-47c8-8ab2-1e1c3f58d83c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:05.033271 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d233583-10e6-47c8-8ab2-1e1c3f58d83c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:05.033548 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d233583-10e6-47c8-8ab2-1e1c3f58d83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:05.065912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-6d233583-10e6-47c8-8ab2-1e1c3f58d83c None None] MFA Rules not processed for user `b8cd3396187b4f34998acced1587aba2`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:05.067275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6d233583-10e6-47c8-8ab2-1e1c3f58d83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:05.147207 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 939/1892] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:05 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:05.165351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005b2ea-0a58-406e-8eac-323a990a3166 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:05.167856 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0005b2ea-0a58-406e-8eac-323a990a3166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:05.190115 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:05.249430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005b2ea-0a58-406e-8eac-323a990a3166 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:05.255243 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd376c-3a7a-4977-9b91-4535f36f1909 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:05.256111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd376c-3a7a-4977-9b91-4535f36f1909 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:05.256577 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd376c-3a7a-4977-9b91-4535f36f1909 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:05.256876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd376c-3a7a-4977-9b91-4535f36f1909 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:05.287588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d233583-10e6-47c8-8ab2-1e1c3f58d83c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:05.289160 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6d233583-10e6-47c8-8ab2-1e1c3f58d83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:05.336062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dd376c-3a7a-4977-9b91-4535f36f1909 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:05.337677 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dd376c-3a7a-4977-9b91-4535f36f1909 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:05.347991 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 954/1893] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:05 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:05.362501 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d233583-10e6-47c8-8ab2-1e1c3f58d83c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:05.368049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea9cb7-cdad-42b1-9c4b-c368ed891c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:05.368933 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea9cb7-cdad-42b1-9c4b-c368ed891c59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:05.369044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea9cb7-cdad-42b1-9c4b-c368ed891c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:05.369320 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea9cb7-cdad-42b1-9c4b-c368ed891c59 admin admin] PATH_INFO: `/v3/projects/13b4edcd2ab9416fb3330337a4a4c53e` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:05.370430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea9cb7-cdad-42b1-9c4b-c368ed891c59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13b4edcd2ab9416fb3330337a4a4c53e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:05.372356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea9cb7-cdad-42b1-9c4b-c368ed891c59 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:05.398255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91b918-9aed-4e99-be84-86df6313456c None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:05.398746 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91b918-9aed-4e99-be84-86df6313456c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:05.399030 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91b918-9aed-4e99-be84-86df6313456c None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:05.400375 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 955/1894] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 20:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:54:05.405655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91b918-9aed-4e99-be84-86df6313456c None None] Authenticating service token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 20:54:05.407791 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2c91b918-9aed-4e99-be84-86df6313456c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:05.424322 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:05.433607 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91b918-9aed-4e99-be84-86df6313456c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:05.433863 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a3ea9cb7-cdad-42b1-9c4b-c368ed891c59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13b4edcd2ab9416fb3330337a4a4c53e', 'request_id': 'req-a3ea9cb7-cdad-42b1-9c4b-c368ed891c59'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:05.440707 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a3ea9cb7-cdad-42b1-9c4b-c368ed891c59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13b4edcd2ab9416fb3330337a4a4c53e', 'request_id': 'req-a3ea9cb7-cdad-42b1-9c4b-c368ed891c59'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:05.444753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91b918-9aed-4e99-be84-86df6313456c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:05.447491 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a3ea9cb7-cdad-42b1-9c4b-c368ed891c59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13b4edcd2ab9416fb3330337a4a4c53e', 'request_id': 'req-a3ea9cb7-cdad-42b1-9c4b-c368ed891c59'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:05.461339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a3ea9cb7-cdad-42b1-9c4b-c368ed891c59 admin admin] The token cache is being invalidate because project 13b4edcd2ab9416fb3330337a4a4c53e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:54:05.461630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a3ea9cb7-cdad-42b1-9c4b-c368ed891c59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:05.462257 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a3ea9cb7-cdad-42b1-9c4b-c368ed891c59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:05.463809 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 940/1895] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:54:05 2022] DELETE /identity/v3/projects/13b4edcd2ab9416fb3330337a4a4c53e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:54:05.467844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea9cb7-cdad-42b1-9c4b-c368ed891c59 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:05.469208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a3ea9cb7-cdad-42b1-9c4b-c368ed891c59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:05.505169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4c17a-546b-42af-a944-ea1ce77f5177 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d0382d1018f4878b5f64679164b3350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2edd3df091ee4fd391c170332ab3ade4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:05.505800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4c17a-546b-42af-a944-ea1ce77f5177 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:05.506076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4c17a-546b-42af-a944-ea1ce77f5177 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:05.506345 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4c17a-546b-42af-a944-ea1ce77f5177 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] PATH_INFO: `/v3/projects/a9a98197762f43ebb2d16b69afd05a23` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:05.507488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4c17a-546b-42af-a944-ea1ce77f5177 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] RBAC: Authorizing `identity:get_project(project_id=a9a98197762f43ebb2d16b69afd05a23)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:05.509580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4c17a-546b-42af-a944-ea1ce77f5177 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:05.511438 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 956/1896] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 20:54:05 2022] GET /identity/v3/projects/a9a98197762f43ebb2d16b69afd05a23 => generated 391 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:54:05.533131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea9cb7-cdad-42b1-9c4b-c368ed891c59 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:05.537834 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87979246-dbc7-4a35-9cf7-029f4a88c7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:05.538470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87979246-dbc7-4a35-9cf7-029f4a88c7b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:05.538779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87979246-dbc7-4a35-9cf7-029f4a88c7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:05.539051 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87979246-dbc7-4a35-9cf7-029f4a88c7b9 admin admin] PATH_INFO: `/v3/users/8ecb0415b81e4205b9a69afee267d8fc` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:05.540202 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87979246-dbc7-4a35-9cf7-029f4a88c7b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ecb0415b81e4205b9a69afee267d8fc)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:05.542255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87979246-dbc7-4a35-9cf7-029f4a88c7b9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:05.553200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c705a-87fa-4102-ad0e-a325f6740c7d None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:05.553482 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c705a-87fa-4102-ad0e-a325f6740c7d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:05.553754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c705a-87fa-4102-ad0e-a325f6740c7d None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:05.555741 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 957/1897] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 20:54:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:54:05.561899 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c705a-87fa-4102-ad0e-a325f6740c7d None None] Authenticating service token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 20:54:05.564367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7b5c705a-87fa-4102-ad0e-a325f6740c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:05.593233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-87979246-dbc7-4a35-9cf7-029f4a88c7b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ecb0415b81e4205b9a69afee267d8fc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:05.593911 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-87979246-dbc7-4a35-9cf7-029f4a88c7b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ecb0415b81e4205b9a69afee267d8fc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:05.594600 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-87979246-dbc7-4a35-9cf7-029f4a88c7b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ecb0415b81e4205b9a69afee267d8fc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:05.602590 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-87979246-dbc7-4a35-9cf7-029f4a88c7b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ecb0415b81e4205b9a69afee267d8fc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:05.615144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-87979246-dbc7-4a35-9cf7-029f4a88c7b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ecb0415b81e4205b9a69afee267d8fc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:05.619638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:05.635127 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 941/1898] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:54:05 2022] DELETE /identity/v3/users/8ecb0415b81e4205b9a69afee267d8fc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:54:05.647591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c705a-87fa-4102-ad0e-a325f6740c7d None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:05.648997 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7b5c705a-87fa-4102-ad0e-a325f6740c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:05.662668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c705a-87fa-4102-ad0e-a325f6740c7d None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:05.747008 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3de7c-cc55-4531-8b33-1f9f78510029 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d0382d1018f4878b5f64679164b3350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2edd3df091ee4fd391c170332ab3ade4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:05.747991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3de7c-cc55-4531-8b33-1f9f78510029 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:05.748278 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3de7c-cc55-4531-8b33-1f9f78510029 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:05.748567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3de7c-cc55-4531-8b33-1f9f78510029 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] PATH_INFO: `/v3/projects/a9a98197762f43ebb2d16b69afd05a23` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:05.750302 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae3de7c-cc55-4531-8b33-1f9f78510029 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] RBAC: Authorizing `identity:get_project(project_id=a9a98197762f43ebb2d16b69afd05a23)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:05.752795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae3de7c-cc55-4531-8b33-1f9f78510029 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:05.754508 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 958/1899] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 20:54:05 2022] GET /identity/v3/projects/a9a98197762f43ebb2d16b69afd05a23 => generated 391 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:54:05.894498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a918069-39f6-491f-960f-7503a2029cd8 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:05.894816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a918069-39f6-491f-960f-7503a2029cd8 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:05.895094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a918069-39f6-491f-960f-7503a2029cd8 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:05.896433 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 942/1900] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 20:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:54:05.901152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3de7c-cc55-4531-8b33-1f9f78510029 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] Authenticating service token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 20:54:05.903114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2ae3de7c-cc55-4531-8b33-1f9f78510029 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:05.992833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3de7c-cc55-4531-8b33-1f9f78510029 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:05.994071 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2ae3de7c-cc55-4531-8b33-1f9f78510029 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:06.007225 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3de7c-cc55-4531-8b33-1f9f78510029 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:06.013350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9055536-67d4-4100-8ff9-f10e2e28b448 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d0382d1018f4878b5f64679164b3350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2edd3df091ee4fd391c170332ab3ade4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:06.015091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9055536-67d4-4100-8ff9-f10e2e28b448 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:06.015091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9055536-67d4-4100-8ff9-f10e2e28b448 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:06.015091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9055536-67d4-4100-8ff9-f10e2e28b448 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] PATH_INFO: `/v3/projects/a9a98197762f43ebb2d16b69afd05a23` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:06.019331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9055536-67d4-4100-8ff9-f10e2e28b448 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] RBAC: Authorizing `identity:get_project(project_id=a9a98197762f43ebb2d16b69afd05a23)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:06.022096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9055536-67d4-4100-8ff9-f10e2e28b448 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:06.024054 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 959/1901] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 20:54:05 2022] GET /identity/v3/projects/a9a98197762f43ebb2d16b69afd05a23 => generated 391 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:54:06.115377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a918069-39f6-491f-960f-7503a2029cd8 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:06.117856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2a918069-39f6-491f-960f-7503a2029cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:06.193209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:06.216974 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a918069-39f6-491f-960f-7503a2029cd8 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:06.222998 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9a47b-dc4d-4cdf-84a0-24f6f218e8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:06.223771 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9a47b-dc4d-4cdf-84a0-24f6f218e8cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:06.224141 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9a47b-dc4d-4cdf-84a0-24f6f218e8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:06.224509 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9a47b-dc4d-4cdf-84a0-24f6f218e8cc admin admin] PATH_INFO: `/v3/projects/f99f37cc9e6641f8a6b2fbcd1198df8d` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:06.225757 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc9a47b-dc4d-4cdf-84a0-24f6f218e8cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f99f37cc9e6641f8a6b2fbcd1198df8d)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:06.227833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc9a47b-dc4d-4cdf-84a0-24f6f218e8cc admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:06.291592 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ddc9a47b-dc4d-4cdf-84a0-24f6f218e8cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f99f37cc9e6641f8a6b2fbcd1198df8d', 'request_id': 'req-ddc9a47b-dc4d-4cdf-84a0-24f6f218e8cc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:06.307415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ddc9a47b-dc4d-4cdf-84a0-24f6f218e8cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f99f37cc9e6641f8a6b2fbcd1198df8d', 'request_id': 'req-ddc9a47b-dc4d-4cdf-84a0-24f6f218e8cc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:06.311870 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ddc9a47b-dc4d-4cdf-84a0-24f6f218e8cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f99f37cc9e6641f8a6b2fbcd1198df8d', 'request_id': 'req-ddc9a47b-dc4d-4cdf-84a0-24f6f218e8cc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:06.333210 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ddc9a47b-dc4d-4cdf-84a0-24f6f218e8cc admin admin] The token cache is being invalidate because project f99f37cc9e6641f8a6b2fbcd1198df8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:54:06.333543 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ddc9a47b-dc4d-4cdf-84a0-24f6f218e8cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:06.334839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ddc9a47b-dc4d-4cdf-84a0-24f6f218e8cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:06.336501 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 943/1902] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:54:06 2022] DELETE /identity/v3/projects/f99f37cc9e6641f8a6b2fbcd1198df8d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:06.341549 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937ffd8-c45d-4a81-915f-e83868c0258e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:06.341970 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937ffd8-c45d-4a81-915f-e83868c0258e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:06.342391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937ffd8-c45d-4a81-915f-e83868c0258e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:06.365782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-1937ffd8-c45d-4a81-915f-e83868c0258e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:06.367031 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1937ffd8-c45d-4a81-915f-e83868c0258e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:06.450945 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 960/1903] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:06.457210 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818fe8b-8c48-4a6c-a9fa-03c1c284ada8 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:06.457410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818fe8b-8c48-4a6c-a9fa-03c1c284ada8 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:06.457676 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818fe8b-8c48-4a6c-a9fa-03c1c284ada8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:06.484091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-5818fe8b-8c48-4a6c-a9fa-03c1c284ada8 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:06.485687 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5818fe8b-8c48-4a6c-a9fa-03c1c284ada8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:06.494358 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 944/1904] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:06.498580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937ffd8-c45d-4a81-915f-e83868c0258e None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:06.503402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818fe8b-8c48-4a6c-a9fa-03c1c284ada8 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:06.505142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5818fe8b-8c48-4a6c-a9fa-03c1c284ada8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:06.509291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937ffd8-c45d-4a81-915f-e83868c0258e None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:06.514026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539f2ad-cca0-4742-ab43-2cc9eafe2adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:06.514696 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539f2ad-cca0-4742-ab43-2cc9eafe2adb admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:06.514976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539f2ad-cca0-4742-ab43-2cc9eafe2adb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:06.516168 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539f2ad-cca0-4742-ab43-2cc9eafe2adb admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:06.516872 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539f2ad-cca0-4742-ab43-2cc9eafe2adb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:54:06.517182 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539f2ad-cca0-4742-ab43-2cc9eafe2adb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:06.518809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539f2ad-cca0-4742-ab43-2cc9eafe2adb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:06.531615 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 961/1905] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:54:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:54:06.536530 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539f2ad-cca0-4742-ab43-2cc9eafe2adb admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:06.542132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:06.549002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539f2ad-cca0-4742-ab43-2cc9eafe2adb admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:06.554673 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea5ba2-ab30-40de-9aab-de6f1db9e0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:06.555284 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea5ba2-ab30-40de-9aab-de6f1db9e0b6 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:06.555565 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea5ba2-ab30-40de-9aab-de6f1db9e0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:06.555856 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea5ba2-ab30-40de-9aab-de6f1db9e0b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:06.556458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea5ba2-ab30-40de-9aab-de6f1db9e0b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:06.558358 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea5ba2-ab30-40de-9aab-de6f1db9e0b6 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:06.589913 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 962/1906] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:54:06 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:54:06.594802 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea5ba2-ab30-40de-9aab-de6f1db9e0b6 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:06.597866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818fe8b-8c48-4a6c-a9fa-03c1c284ada8 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:06.670954 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea5ba2-ab30-40de-9aab-de6f1db9e0b6 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:06.677928 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ef112-14db-48c7-ab17-48936404124d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:06.678573 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ef112-14db-48c7-ab17-48936404124d admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:06.678933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ef112-14db-48c7-ab17-48936404124d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:06.679202 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ef112-14db-48c7-ab17-48936404124d admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:06.679826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ef112-14db-48c7-ab17-48936404124d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:06.681785 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ef112-14db-48c7-ab17-48936404124d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:06.686316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331b771-87ce-49b6-862d-d1280627b0e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:06.687214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331b771-87ce-49b6-862d-d1280627b0e8 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:06.688146 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331b771-87ce-49b6-862d-d1280627b0e8 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:06.688503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331b771-87ce-49b6-862d-d1280627b0e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:06.690674 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d331b771-87ce-49b6-862d-d1280627b0e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:06.698452 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:06.714131 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 963/1907] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:54:06 2022] POST /identity/v3/users => generated 288 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:06.718340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ef112-14db-48c7-ab17-48936404124d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:06.731150 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ef112-14db-48c7-ab17-48936404124d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:06.737196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89d194-e6cb-47d4-bb1d-fbc5639f2002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:06.738349 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89d194-e6cb-47d4-bb1d-fbc5639f2002 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:06.738819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89d194-e6cb-47d4-bb1d-fbc5639f2002 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:06.739276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89d194-e6cb-47d4-bb1d-fbc5639f2002 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:06.739933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89d194-e6cb-47d4-bb1d-fbc5639f2002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:06.741546 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89d194-e6cb-47d4-bb1d-fbc5639f2002 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:06.753519 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 964/1908] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:54:06.758321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89d194-e6cb-47d4-bb1d-fbc5639f2002 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:06.766021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d331b771-87ce-49b6-862d-d1280627b0e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:06.767810 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d331b771-87ce-49b6-862d-d1280627b0e8 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:06.768902 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89d194-e6cb-47d4-bb1d-fbc5639f2002 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:06.773671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcedfa8-8117-47aa-b572-f32a50662068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:06.774386 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcedfa8-8117-47aa-b572-f32a50662068 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:06.774790 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcedfa8-8117-47aa-b572-f32a50662068 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:06.775134 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcedfa8-8117-47aa-b572-f32a50662068 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:06.775843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcedfa8-8117-47aa-b572-f32a50662068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:06.777562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcedfa8-8117-47aa-b572-f32a50662068 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:06.778025 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 945/1909] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:06 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:54:06.792875 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 965/1910] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:06.794018 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331b771-87ce-49b6-862d-d1280627b0e8 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:06.807282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331b771-87ce-49b6-862d-d1280627b0e8 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:06.815810 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766c254-c461-41df-996f-dfda417b71b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:06.816486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766c254-c461-41df-996f-dfda417b71b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:06.816774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766c254-c461-41df-996f-dfda417b71b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:06.817051 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766c254-c461-41df-996f-dfda417b71b0 admin admin] PATH_INFO: `/v3/projects/aa51632a6bbf4d26b3db87902d6a17d2/users/0701f31766dd4eeab9a63f6411c26d6e/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:06.836437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8766c254-c461-41df-996f-dfda417b71b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa51632a6bbf4d26b3db87902d6a17d2, user_id=0701f31766dd4eeab9a63f6411c26d6e, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:06.839496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8766c254-c461-41df-996f-dfda417b71b0 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:06.853736 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 946/1911] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:06 2022] PUT /identity/v3/projects/aa51632a6bbf4d26b3db87902d6a17d2/users/0701f31766dd4eeab9a63f6411c26d6e/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:54:06.864792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056c775-8af8-4ecf-8e7f-29a2c714b212 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:06.865111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056c775-8af8-4ecf-8e7f-29a2c714b212 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:06.865390 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056c775-8af8-4ecf-8e7f-29a2c714b212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:06.905199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-1056c775-8af8-4ecf-8e7f-29a2c714b212 None None] MFA Rules not processed for user `0701f31766dd4eeab9a63f6411c26d6e`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:06.907491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1056c775-8af8-4ecf-8e7f-29a2c714b212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:06.958919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb47a02-38cc-4b9a-8a9d-fdfa39c11d23 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:06.959452 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb47a02-38cc-4b9a-8a9d-fdfa39c11d23 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:06.959915 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb47a02-38cc-4b9a-8a9d-fdfa39c11d23 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:06.961482 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 947/1912] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 20:54:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:54:06.966899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb47a02-38cc-4b9a-8a9d-fdfa39c11d23 None None] Authenticating service token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 20:54:07.034741 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 966/1913] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:07.039162 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056c775-8af8-4ecf-8e7f-29a2c714b212 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:07.091752 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb47a02-38cc-4b9a-8a9d-fdfa39c11d23 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:07.093800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-afb47a02-38cc-4b9a-8a9d-fdfa39c11d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:07.128885 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:07.193789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb47a02-38cc-4b9a-8a9d-fdfa39c11d23 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:07.206465 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056c775-8af8-4ecf-8e7f-29a2c714b212 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:07.207568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e74253-74d7-49f7-bfb8-f5b4082e3246 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d0382d1018f4878b5f64679164b3350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2edd3df091ee4fd391c170332ab3ade4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:07.208318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e74253-74d7-49f7-bfb8-f5b4082e3246 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:07.208677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e74253-74d7-49f7-bfb8-f5b4082e3246 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:07.209034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e74253-74d7-49f7-bfb8-f5b4082e3246 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] PATH_INFO: `/v3/projects/a9a98197762f43ebb2d16b69afd05a23` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:07.211375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e74253-74d7-49f7-bfb8-f5b4082e3246 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] RBAC: Authorizing `identity:get_project(project_id=a9a98197762f43ebb2d16b69afd05a23)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:07.213611 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e74253-74d7-49f7-bfb8-f5b4082e3246 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:07.216060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5f67e-160a-46a0-9c80-9eab70be389f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:07.217034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5f67e-160a-46a0-9c80-9eab70be389f admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:07.217319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5f67e-160a-46a0-9c80-9eab70be389f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:07.220126 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 948/1914] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 20:54:06 2022] GET /identity/v3/projects/a9a98197762f43ebb2d16b69afd05a23 => generated 391 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:54:07.220277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5f67e-160a-46a0-9c80-9eab70be389f admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:07.221255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a5f67e-160a-46a0-9c80-9eab70be389f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:07.224613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a5f67e-160a-46a0-9c80-9eab70be389f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:07.311576 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904d925-5bac-4a3b-a397-c1a86f222dfd None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:07.312174 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904d925-5bac-4a3b-a397-c1a86f222dfd None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:07.312174 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904d925-5bac-4a3b-a397-c1a86f222dfd None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:07.313456 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 967/1915] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:54:07 2022] POST /identity/v3/projects => generated 373 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:54:07.314108 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 949/1916] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 20:54:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:54:07.317216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5f67e-160a-46a0-9c80-9eab70be389f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:07.320574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904d925-5bac-4a3b-a397-c1a86f222dfd None None] Authenticating service token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 20:54:07.358249 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:07.459279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5f67e-160a-46a0-9c80-9eab70be389f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:07.464430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f5623-1911-46f5-8b55-99fa48b676d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:07.465103 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f5623-1911-46f5-8b55-99fa48b676d8 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:07.465338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f5623-1911-46f5-8b55-99fa48b676d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:07.465613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f5623-1911-46f5-8b55-99fa48b676d8 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:07.466252 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f5623-1911-46f5-8b55-99fa48b676d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:07.469028 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f5623-1911-46f5-8b55-99fa48b676d8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:07.482327 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904d925-5bac-4a3b-a397-c1a86f222dfd None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:07.502590 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 968/1917] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:54:07 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:07.505959 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f5623-1911-46f5-8b55-99fa48b676d8 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:07.525573 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f5623-1911-46f5-8b55-99fa48b676d8 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:07.531252 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b41c4-30a4-448a-be8a-5c7a6620127f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:07.531495 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b41c4-30a4-448a-be8a-5c7a6620127f admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:07.531799 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b41c4-30a4-448a-be8a-5c7a6620127f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:07.532172 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b41c4-30a4-448a-be8a-5c7a6620127f admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:07.532848 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b41c4-30a4-448a-be8a-5c7a6620127f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:07.535145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b41c4-30a4-448a-be8a-5c7a6620127f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:07.546913 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 969/1918] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:07.552350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b41c4-30a4-448a-be8a-5c7a6620127f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:07.566459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b41c4-30a4-448a-be8a-5c7a6620127f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:07.573135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31656882-1a45-4f8c-a26d-a2cbf43737f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:07.573935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31656882-1a45-4f8c-a26d-a2cbf43737f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:07.574303 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31656882-1a45-4f8c-a26d-a2cbf43737f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:07.574684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31656882-1a45-4f8c-a26d-a2cbf43737f9 admin admin] PATH_INFO: `/v3/projects/40902914b9a24c9e866171fbbcad74af/users/3028158d6d2f4b83815b724cd13dcb3b/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:07.590995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904d925-5bac-4a3b-a397-c1a86f222dfd None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:07.597434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555b6db-8a71-4676-b92c-08454ba222b2 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d0382d1018f4878b5f64679164b3350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2edd3df091ee4fd391c170332ab3ade4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:07.598080 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555b6db-8a71-4676-b92c-08454ba222b2 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:07.598367 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555b6db-8a71-4676-b92c-08454ba222b2 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:07.598696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555b6db-8a71-4676-b92c-08454ba222b2 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] PATH_INFO: `/v3/projects/a9a98197762f43ebb2d16b69afd05a23` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:07.599906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555b6db-8a71-4676-b92c-08454ba222b2 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] RBAC: Authorizing `identity:get_project(project_id=a9a98197762f43ebb2d16b69afd05a23)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:07.601901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31656882-1a45-4f8c-a26d-a2cbf43737f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40902914b9a24c9e866171fbbcad74af, user_id=3028158d6d2f4b83815b724cd13dcb3b, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:07.602016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555b6db-8a71-4676-b92c-08454ba222b2 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:07.604239 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 950/1919] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 20:54:07 2022] GET /identity/v3/projects/a9a98197762f43ebb2d16b69afd05a23 => generated 391 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:54:07.605378 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31656882-1a45-4f8c-a26d-a2cbf43737f9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:07.639905 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555b6db-8a71-4676-b92c-08454ba222b2 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:07.647622 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 970/1920] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:07 2022] PUT /identity/v3/projects/40902914b9a24c9e866171fbbcad74af/users/3028158d6d2f4b83815b724cd13dcb3b/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:07.655495 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555b6db-8a71-4676-b92c-08454ba222b2 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:07.768436 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d89eb-71d8-4e75-a9e8-39a88acb0abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:07.769053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d89eb-71d8-4e75-a9e8-39a88acb0abb admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:07.769330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d89eb-71d8-4e75-a9e8-39a88acb0abb admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:07.769600 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d89eb-71d8-4e75-a9e8-39a88acb0abb admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:07.770414 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d89eb-71d8-4e75-a9e8-39a88acb0abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:07.772417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d89eb-71d8-4e75-a9e8-39a88acb0abb admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:07.789830 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 951/1921] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:54:07.791177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31656882-1a45-4f8c-a26d-a2cbf43737f9 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:07.809176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31656882-1a45-4f8c-a26d-a2cbf43737f9 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:07.818444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07f69c-db4a-4159-86d8-bc1cf7028fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:07.819765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07f69c-db4a-4159-86d8-bc1cf7028fcb admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:07.820046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07f69c-db4a-4159-86d8-bc1cf7028fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:07.820321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07f69c-db4a-4159-86d8-bc1cf7028fcb admin admin] PATH_INFO: `/v3/projects/40902914b9a24c9e866171fbbcad74af/users/3028158d6d2f4b83815b724cd13dcb3b/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:07.823175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba07f69c-db4a-4159-86d8-bc1cf7028fcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=40902914b9a24c9e866171fbbcad74af, user_id=3028158d6d2f4b83815b724cd13dcb3b, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:07.831685 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba07f69c-db4a-4159-86d8-bc1cf7028fcb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:07.850596 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 971/1922] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:07 2022] PUT /identity/v3/projects/40902914b9a24c9e866171fbbcad74af/users/3028158d6d2f4b83815b724cd13dcb3b/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:07.858890 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae38950-a058-4781-b391-91caef1c7659 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:07.860120 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae38950-a058-4781-b391-91caef1c7659 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:07.860609 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae38950-a058-4781-b391-91caef1c7659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:07.873070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711651b7-7a98-414d-a6d8-efcd83d5110f None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:07.873427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711651b7-7a98-414d-a6d8-efcd83d5110f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:07.873770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711651b7-7a98-414d-a6d8-efcd83d5110f None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:07.876557 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 972/1923] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 20:54:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:54:07.882048 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711651b7-7a98-414d-a6d8-efcd83d5110f None None] Authenticating service token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 20:54:07.883826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-711651b7-7a98-414d-a6d8-efcd83d5110f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:07.900230 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-3ae38950-a058-4781-b391-91caef1c7659 None None] MFA Rules not processed for user `3028158d6d2f4b83815b724cd13dcb3b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:07.901436 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3ae38950-a058-4781-b391-91caef1c7659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:07.956392 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:08.006647 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 952/1924] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:08.007516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:08.019932 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711651b7-7a98-414d-a6d8-efcd83d5110f None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:08.026537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005ecc7-299d-483f-82fc-ccfefc4943e9 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:08.026824 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005ecc7-299d-483f-82fc-ccfefc4943e9 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:08.032079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005ecc7-299d-483f-82fc-ccfefc4943e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:08.086787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-2005ecc7-299d-483f-82fc-ccfefc4943e9 None None] MFA Rules not processed for user `0701f31766dd4eeab9a63f6411c26d6e`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:08.088050 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2005ecc7-299d-483f-82fc-ccfefc4943e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:08.122538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711651b7-7a98-414d-a6d8-efcd83d5110f None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:08.129381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ccff4c-effc-4a8a-9763-03d0da21c9b8 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d0382d1018f4878b5f64679164b3350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2edd3df091ee4fd391c170332ab3ade4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:08.130128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccff4c-effc-4a8a-9763-03d0da21c9b8 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:08.131020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccff4c-effc-4a8a-9763-03d0da21c9b8 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:08.131389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccff4c-effc-4a8a-9763-03d0da21c9b8 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] PATH_INFO: `/v3/projects/4d138283e1c34da39c090ddf384697eb` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:08.132750 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ccff4c-effc-4a8a-9763-03d0da21c9b8 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] RBAC: Authorizing `identity:get_project(project_id=4d138283e1c34da39c090ddf384697eb)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:08.134967 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ccff4c-effc-4a8a-9763-03d0da21c9b8 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:08.137290 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 973/1925] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 20:54:07 2022] GET /identity/v3/projects/4d138283e1c34da39c090ddf384697eb => generated 395 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:54:08.180569 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 953/1926] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:08.193125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ccff4c-effc-4a8a-9763-03d0da21c9b8 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:08.208445 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ccff4c-effc-4a8a-9763-03d0da21c9b8 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:08.216626 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b373476-f3a0-4ef5-af3e-90af99bb3473 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:08.216824 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b373476-f3a0-4ef5-af3e-90af99bb3473 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:08.217215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b373476-f3a0-4ef5-af3e-90af99bb3473 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:08.217498 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b373476-f3a0-4ef5-af3e-90af99bb3473 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:08.228059 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b373476-f3a0-4ef5-af3e-90af99bb3473 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:08.230180 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b373476-f3a0-4ef5-af3e-90af99bb3473 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:08.243449 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 974/1927] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:08.262528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005ecc7-299d-483f-82fc-ccfefc4943e9 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:08.264086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2005ecc7-299d-483f-82fc-ccfefc4943e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:08.350159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005ecc7-299d-483f-82fc-ccfefc4943e9 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:08.360731 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb5252-dee5-4a6c-be7d-ac5d5501a475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:08.361670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb5252-dee5-4a6c-be7d-ac5d5501a475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:08.362952 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb5252-dee5-4a6c-be7d-ac5d5501a475 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:08.363421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb5252-dee5-4a6c-be7d-ac5d5501a475 admin admin] PATH_INFO: `/v3/users/59c31f71a22b43b5ba8c98b831147fbd` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:08.365168 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb5252-dee5-4a6c-be7d-ac5d5501a475 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59c31f71a22b43b5ba8c98b831147fbd)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:08.367394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb5252-dee5-4a6c-be7d-ac5d5501a475 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:08.437723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8ebb5252-dee5-4a6c-be7d-ac5d5501a475 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59c31f71a22b43b5ba8c98b831147fbd'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:08.439593 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8ebb5252-dee5-4a6c-be7d-ac5d5501a475 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59c31f71a22b43b5ba8c98b831147fbd'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:08.440459 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8ebb5252-dee5-4a6c-be7d-ac5d5501a475 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59c31f71a22b43b5ba8c98b831147fbd'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:08.451333 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8ebb5252-dee5-4a6c-be7d-ac5d5501a475 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59c31f71a22b43b5ba8c98b831147fbd'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:08.472424 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8ebb5252-dee5-4a6c-be7d-ac5d5501a475 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59c31f71a22b43b5ba8c98b831147fbd'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:08.483107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:08.490392 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 954/1928] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:54:08 2022] DELETE /identity/v3/users/59c31f71a22b43b5ba8c98b831147fbd => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:08.494921 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956023b2-909a-4b75-b63c-3dd2ac5ed28f None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:08.495445 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956023b2-909a-4b75-b63c-3dd2ac5ed28f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:08.495555 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956023b2-909a-4b75-b63c-3dd2ac5ed28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:08.523216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-956023b2-909a-4b75-b63c-3dd2ac5ed28f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:08.524531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-956023b2-909a-4b75-b63c-3dd2ac5ed28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:08.619809 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 975/1929] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:08.631226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb5252-dee5-4a6c-be7d-ac5d5501a475 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:08.633431 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8ebb5252-dee5-4a6c-be7d-ac5d5501a475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:08.719886 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb5252-dee5-4a6c-be7d-ac5d5501a475 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:08.725761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eafe48-bac0-4898-8f29-d2d8e35b6254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:08.726444 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eafe48-bac0-4898-8f29-d2d8e35b6254 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:08.726821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eafe48-bac0-4898-8f29-d2d8e35b6254 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:08.727164 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eafe48-bac0-4898-8f29-d2d8e35b6254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:08.740787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eafe48-bac0-4898-8f29-d2d8e35b6254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:08.742463 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eafe48-bac0-4898-8f29-d2d8e35b6254 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:08.754924 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 955/1930] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:09.179287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956023b2-909a-4b75-b63c-3dd2ac5ed28f None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:09.181598 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-956023b2-909a-4b75-b63c-3dd2ac5ed28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:09.198137 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956023b2-909a-4b75-b63c-3dd2ac5ed28f None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:09.204758 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868f7b4-7064-4828-86d0-f0e16ee3596f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:09.205754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868f7b4-7064-4828-86d0-f0e16ee3596f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:09.206103 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868f7b4-7064-4828-86d0-f0e16ee3596f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:09.206438 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868f7b4-7064-4828-86d0-f0e16ee3596f admin admin] PATH_INFO: `/v3/projects/a9a98197762f43ebb2d16b69afd05a23` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:09.215075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868f7b4-7064-4828-86d0-f0e16ee3596f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9a98197762f43ebb2d16b69afd05a23)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:09.217619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868f7b4-7064-4828-86d0-f0e16ee3596f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:09.277466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9868f7b4-7064-4828-86d0-f0e16ee3596f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9a98197762f43ebb2d16b69afd05a23', 'request_id': 'req-9868f7b4-7064-4828-86d0-f0e16ee3596f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:09.284140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9868f7b4-7064-4828-86d0-f0e16ee3596f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9a98197762f43ebb2d16b69afd05a23', 'request_id': 'req-9868f7b4-7064-4828-86d0-f0e16ee3596f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:09.292678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9868f7b4-7064-4828-86d0-f0e16ee3596f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9a98197762f43ebb2d16b69afd05a23', 'request_id': 'req-9868f7b4-7064-4828-86d0-f0e16ee3596f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:09.306336 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9868f7b4-7064-4828-86d0-f0e16ee3596f admin admin] The token cache is being invalidate because project a9a98197762f43ebb2d16b69afd05a23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:54:09.306802 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9868f7b4-7064-4828-86d0-f0e16ee3596f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:09.307664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9868f7b4-7064-4828-86d0-f0e16ee3596f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:09.309295 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 976/1931] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:54:09 2022] DELETE /identity/v3/projects/a9a98197762f43ebb2d16b69afd05a23 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:09.315819 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eafe48-bac0-4898-8f29-d2d8e35b6254 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:09.327037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eafe48-bac0-4898-8f29-d2d8e35b6254 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:09.387962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec69ba4-62f7-4658-91dd-d96e23e2fc9c None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:09.387962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec69ba4-62f7-4658-91dd-d96e23e2fc9c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:09.388270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec69ba4-62f7-4658-91dd-d96e23e2fc9c None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:09.390047 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 977/1932] 10.222.0.33 () {54 vars in 921 bytes} [Sat Aug 6 20:54:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:54:09.404771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6813246-c030-4218-aac7-75ca7aef1c54 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:09.405629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6813246-c030-4218-aac7-75ca7aef1c54 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:09.405629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6813246-c030-4218-aac7-75ca7aef1c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:09.437447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b6813246-c030-4218-aac7-75ca7aef1c54 None None] MFA Rules not processed for user `5f9d53147a57402f8b9818590bc1fc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:09.439126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b6813246-c030-4218-aac7-75ca7aef1c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:09.445642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:09.548455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87a6a1-7955-4b6a-84b9-3529c320ed41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:09.549145 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87a6a1-7955-4b6a-84b9-3529c320ed41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:09.550241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87a6a1-7955-4b6a-84b9-3529c320ed41 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:09.550241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87a6a1-7955-4b6a-84b9-3529c320ed41 admin admin] PATH_INFO: `/v3/users/3d0382d1018f4878b5f64679164b3350` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:09.551478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e87a6a1-7955-4b6a-84b9-3529c320ed41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d0382d1018f4878b5f64679164b3350)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:09.553899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e87a6a1-7955-4b6a-84b9-3529c320ed41 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:09.583891 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 978/1933] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 20:54:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:54:09.600079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6813246-c030-4218-aac7-75ca7aef1c54 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:09.601479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b6813246-c030-4218-aac7-75ca7aef1c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:09.612775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6e87a6a1-7955-4b6a-84b9-3529c320ed41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d0382d1018f4878b5f64679164b3350'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:09.613582 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6e87a6a1-7955-4b6a-84b9-3529c320ed41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d0382d1018f4878b5f64679164b3350'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:09.614319 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6e87a6a1-7955-4b6a-84b9-3529c320ed41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d0382d1018f4878b5f64679164b3350'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:09.615320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6813246-c030-4218-aac7-75ca7aef1c54 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:09.621484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191f7c5-25f7-4821-a5d5-34533dcde7ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:09.622209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191f7c5-25f7-4821-a5d5-34533dcde7ff service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:09.622499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191f7c5-25f7-4821-a5d5-34533dcde7ff service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:09.622893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191f7c5-25f7-4821-a5d5-34533dcde7ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:09.622992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6e87a6a1-7955-4b6a-84b9-3529c320ed41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d0382d1018f4878b5f64679164b3350'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:09.626735 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6191f7c5-25f7-4821-a5d5-34533dcde7ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:09.639581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6e87a6a1-7955-4b6a-84b9-3529c320ed41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d0382d1018f4878b5f64679164b3350'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:09.643181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191f7c5-25f7-4821-a5d5-34533dcde7ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:09.644959 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191f7c5-25f7-4821-a5d5-34533dcde7ff service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:09.654878 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 956/1934] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:54:09 2022] DELETE /identity/v3/users/3d0382d1018f4878b5f64679164b3350 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:09.658135 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 979/1935] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:10.399705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87a6a1-7955-4b6a-84b9-3529c320ed41 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:10.401987 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6e87a6a1-7955-4b6a-84b9-3529c320ed41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:10.457082 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:10.522894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87a6a1-7955-4b6a-84b9-3529c320ed41 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:10.527468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df639c-69b0-4295-8bcd-d4f1657615ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:10.528093 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df639c-69b0-4295-8bcd-d4f1657615ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:10.528371 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df639c-69b0-4295-8bcd-d4f1657615ad admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:10.528731 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df639c-69b0-4295-8bcd-d4f1657615ad admin admin] PATH_INFO: `/v3/projects/2edd3df091ee4fd391c170332ab3ade4` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:10.530062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df639c-69b0-4295-8bcd-d4f1657615ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=2edd3df091ee4fd391c170332ab3ade4)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:10.533318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df639c-69b0-4295-8bcd-d4f1657615ad admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:10.583145 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e4df639c-69b0-4295-8bcd-d4f1657615ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2edd3df091ee4fd391c170332ab3ade4', 'request_id': 'req-e4df639c-69b0-4295-8bcd-d4f1657615ad'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:10.588517 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e4df639c-69b0-4295-8bcd-d4f1657615ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2edd3df091ee4fd391c170332ab3ade4', 'request_id': 'req-e4df639c-69b0-4295-8bcd-d4f1657615ad'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:10.595740 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e4df639c-69b0-4295-8bcd-d4f1657615ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2edd3df091ee4fd391c170332ab3ade4', 'request_id': 'req-e4df639c-69b0-4295-8bcd-d4f1657615ad'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:10.608044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e4df639c-69b0-4295-8bcd-d4f1657615ad admin admin] The token cache is being invalidate because project 2edd3df091ee4fd391c170332ab3ade4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:54:10.608318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e4df639c-69b0-4295-8bcd-d4f1657615ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:10.609112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e4df639c-69b0-4295-8bcd-d4f1657615ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:10.610647 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 957/1936] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:54:10 2022] DELETE /identity/v3/projects/2edd3df091ee4fd391c170332ab3ade4 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:10.614700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191f7c5-25f7-4821-a5d5-34533dcde7ff service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:10.625127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191f7c5-25f7-4821-a5d5-34533dcde7ff service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:10.693813 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa42e8c-df8e-4bc1-9b8e-fb697c21e58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:10.694477 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa42e8c-df8e-4bc1-9b8e-fb697c21e58f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:10.694804 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa42e8c-df8e-4bc1-9b8e-fb697c21e58f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:10.695103 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa42e8c-df8e-4bc1-9b8e-fb697c21e58f admin admin] PATH_INFO: `/v3/users/b8cd3396187b4f34998acced1587aba2` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:10.696247 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa42e8c-df8e-4bc1-9b8e-fb697c21e58f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8cd3396187b4f34998acced1587aba2)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:10.698318 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa42e8c-df8e-4bc1-9b8e-fb697c21e58f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:10.750830 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cfa42e8c-df8e-4bc1-9b8e-fb697c21e58f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8cd3396187b4f34998acced1587aba2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:10.758663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cfa42e8c-df8e-4bc1-9b8e-fb697c21e58f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8cd3396187b4f34998acced1587aba2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:10.759582 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cfa42e8c-df8e-4bc1-9b8e-fb697c21e58f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8cd3396187b4f34998acced1587aba2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:10.760174 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cfa42e8c-df8e-4bc1-9b8e-fb697c21e58f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8cd3396187b4f34998acced1587aba2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:10.767884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cfa42e8c-df8e-4bc1-9b8e-fb697c21e58f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8cd3396187b4f34998acced1587aba2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:10.789496 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 980/1937] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:54:10 2022] DELETE /identity/v3/users/b8cd3396187b4f34998acced1587aba2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:11.094891 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df639c-69b0-4295-8bcd-d4f1657615ad admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:11.096568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e4df639c-69b0-4295-8bcd-d4f1657615ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:11.113060 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df639c-69b0-4295-8bcd-d4f1657615ad admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:11.214727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4f10d-8cc5-4949-886c-af56a01157da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:11.215428 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4f10d-8cc5-4949-886c-af56a01157da admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:11.215704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4f10d-8cc5-4949-886c-af56a01157da admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:11.215969 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4f10d-8cc5-4949-886c-af56a01157da admin admin] PATH_INFO: `/v3/projects/4d138283e1c34da39c090ddf384697eb` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:11.217129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a4f10d-8cc5-4949-886c-af56a01157da admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d138283e1c34da39c090ddf384697eb)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:11.219718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a4f10d-8cc5-4949-886c-af56a01157da admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:11.269754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-98a4f10d-8cc5-4949-886c-af56a01157da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d138283e1c34da39c090ddf384697eb', 'request_id': 'req-98a4f10d-8cc5-4949-886c-af56a01157da'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:11.276696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-98a4f10d-8cc5-4949-886c-af56a01157da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d138283e1c34da39c090ddf384697eb', 'request_id': 'req-98a4f10d-8cc5-4949-886c-af56a01157da'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:11.280384 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:11.287761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-98a4f10d-8cc5-4949-886c-af56a01157da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d138283e1c34da39c090ddf384697eb', 'request_id': 'req-98a4f10d-8cc5-4949-886c-af56a01157da'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:11.310710 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-98a4f10d-8cc5-4949-886c-af56a01157da admin admin] The token cache is being invalidate because project 4d138283e1c34da39c090ddf384697eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:54:11.311014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-98a4f10d-8cc5-4949-886c-af56a01157da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:11.319085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-98a4f10d-8cc5-4949-886c-af56a01157da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:11.320747 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 958/1938] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:54:11 2022] DELETE /identity/v3/projects/4d138283e1c34da39c090ddf384697eb => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:11.329852 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50710cb-9888-413a-a2d0-2e537f8ca0fd None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:11.330592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50710cb-9888-413a-a2d0-2e537f8ca0fd None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:11.331026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50710cb-9888-413a-a2d0-2e537f8ca0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:11.356984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b50710cb-9888-413a-a2d0-2e537f8ca0fd None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:11.359117 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b50710cb-9888-413a-a2d0-2e537f8ca0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:11.365282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:11.426665 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 981/1939] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:11.432896 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5688c-513e-4c9f-98e3-fad287e015ee None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:11.433280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5688c-513e-4c9f-98e3-fad287e015ee None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:11.433561 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5688c-513e-4c9f-98e3-fad287e015ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:11.454102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-e8d5688c-513e-4c9f-98e3-fad287e015ee None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:11.455341 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e8d5688c-513e-4c9f-98e3-fad287e015ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:11.464150 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 959/1940] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:11.469665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50710cb-9888-413a-a2d0-2e537f8ca0fd None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:11.480047 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50710cb-9888-413a-a2d0-2e537f8ca0fd None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:11.485713 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75c9ff-9bd2-4d08-aaa4-329aa33e372d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:11.486521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75c9ff-9bd2-4d08-aaa4-329aa33e372d admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:11.486842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75c9ff-9bd2-4d08-aaa4-329aa33e372d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:11.487113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75c9ff-9bd2-4d08-aaa4-329aa33e372d admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:11.487769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75c9ff-9bd2-4d08-aaa4-329aa33e372d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:54:11.488068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75c9ff-9bd2-4d08-aaa4-329aa33e372d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:11.489668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75c9ff-9bd2-4d08-aaa4-329aa33e372d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:11.511115 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 982/1941] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:54:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:54:11.511658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5688c-513e-4c9f-98e3-fad287e015ee None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:11.522583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5688c-513e-4c9f-98e3-fad287e015ee None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:11.527223 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a5463-09c8-4871-9b4e-51088550abb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:11.529129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a5463-09c8-4871-9b4e-51088550abb6 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:11.529129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a5463-09c8-4871-9b4e-51088550abb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:11.529129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a5463-09c8-4871-9b4e-51088550abb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:11.529129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a5463-09c8-4871-9b4e-51088550abb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:11.531567 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a5463-09c8-4871-9b4e-51088550abb6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:11.567004 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 960/1942] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:54:11 2022] POST /identity/v3/projects => generated 407 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:54:11.571261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75c9ff-9bd2-4d08-aaa4-329aa33e372d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:11.586426 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75c9ff-9bd2-4d08-aaa4-329aa33e372d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:11.659461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb7e37-3e55-4619-8e95-bfe3da84691f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:11.660437 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb7e37-3e55-4619-8e95-bfe3da84691f admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:11.660623 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb7e37-3e55-4619-8e95-bfe3da84691f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:11.660987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb7e37-3e55-4619-8e95-bfe3da84691f admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:11.661707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb7e37-3e55-4619-8e95-bfe3da84691f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:11.671610 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb7e37-3e55-4619-8e95-bfe3da84691f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:11.714753 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 983/1943] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:54:11 2022] POST /identity/v3/users => generated 304 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:11.715451 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a5463-09c8-4871-9b4e-51088550abb6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:11.726764 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a5463-09c8-4871-9b4e-51088550abb6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:11.731699 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717359f7-8e62-43fe-b5c2-0c34edc8dec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:11.732311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717359f7-8e62-43fe-b5c2-0c34edc8dec6 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:11.732598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717359f7-8e62-43fe-b5c2-0c34edc8dec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:11.732860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717359f7-8e62-43fe-b5c2-0c34edc8dec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:11.733550 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717359f7-8e62-43fe-b5c2-0c34edc8dec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:11.736146 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717359f7-8e62-43fe-b5c2-0c34edc8dec6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:11.747847 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 961/1944] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:11.752065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb7e37-3e55-4619-8e95-bfe3da84691f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:11.763834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb7e37-3e55-4619-8e95-bfe3da84691f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:11.768674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60432fec-e8b5-49d1-9d44-361ca88d816a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:11.769401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60432fec-e8b5-49d1-9d44-361ca88d816a admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:11.769574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60432fec-e8b5-49d1-9d44-361ca88d816a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:11.769979 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60432fec-e8b5-49d1-9d44-361ca88d816a admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:11.770654 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60432fec-e8b5-49d1-9d44-361ca88d816a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:11.772242 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60432fec-e8b5-49d1-9d44-361ca88d816a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:11.785376 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 984/1945] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:54:11.791133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717359f7-8e62-43fe-b5c2-0c34edc8dec6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:11.804143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717359f7-8e62-43fe-b5c2-0c34edc8dec6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:11.811533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7ffa6-81d3-4df3-a4f3-2de650f086dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:11.812646 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7ffa6-81d3-4df3-a4f3-2de650f086dc admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:11.813312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7ffa6-81d3-4df3-a4f3-2de650f086dc admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:11.813691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7ffa6-81d3-4df3-a4f3-2de650f086dc admin admin] PATH_INFO: `/v3/projects/7e94ccc56a7a4c0cab325094f8185e42/users/d9fb424af10c4e52bca844b35f5a20f2/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:11.831279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b7ffa6-81d3-4df3-a4f3-2de650f086dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e94ccc56a7a4c0cab325094f8185e42, user_id=d9fb424af10c4e52bca844b35f5a20f2, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:11.834223 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b7ffa6-81d3-4df3-a4f3-2de650f086dc admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:11.853208 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 962/1946] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:11 2022] PUT /identity/v3/projects/7e94ccc56a7a4c0cab325094f8185e42/users/d9fb424af10c4e52bca844b35f5a20f2/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:11.866530 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc2fb4-afaf-4710-883e-3e491963cf20 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:11.868082 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc2fb4-afaf-4710-883e-3e491963cf20 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:11.868432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc2fb4-afaf-4710-883e-3e491963cf20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:11.901576 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-74cc2fb4-afaf-4710-883e-3e491963cf20 None None] MFA Rules not processed for user `d9fb424af10c4e52bca844b35f5a20f2`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:11.903266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-74cc2fb4-afaf-4710-883e-3e491963cf20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:11.997582 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 985/1947] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:11 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:11.998036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7ffa6-81d3-4df3-a4f3-2de650f086dc admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:12.082421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7ffa6-81d3-4df3-a4f3-2de650f086dc admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:12.089225 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9418e1-97d7-4a31-bc0f-d01baba2b1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:12.089896 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9418e1-97d7-4a31-bc0f-d01baba2b1e1 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:12.091078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9418e1-97d7-4a31-bc0f-d01baba2b1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:12.091704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9418e1-97d7-4a31-bc0f-d01baba2b1e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:12.094102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9418e1-97d7-4a31-bc0f-d01baba2b1e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:12.095479 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9418e1-97d7-4a31-bc0f-d01baba2b1e1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:12.126985 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 963/1948] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:54:11 2022] POST /identity/v3/projects => generated 407 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:54:12.131040 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc2fb4-afaf-4710-883e-3e491963cf20 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:12.138747 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:12.148570 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc2fb4-afaf-4710-883e-3e491963cf20 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:12.222236 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b87040f-894d-4f7f-a516-a20f13bfbd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:12.222236 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87040f-894d-4f7f-a516-a20f13bfbd4c admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:12.222516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87040f-894d-4f7f-a516-a20f13bfbd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:12.222858 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87040f-894d-4f7f-a516-a20f13bfbd4c admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:12.223462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b87040f-894d-4f7f-a516-a20f13bfbd4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:12.225512 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b87040f-894d-4f7f-a516-a20f13bfbd4c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:12.249800 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 986/1949] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:54:12 2022] POST /identity/v3/users => generated 310 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:54:12.253491 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9418e1-97d7-4a31-bc0f-d01baba2b1e1 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:12.265536 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9418e1-97d7-4a31-bc0f-d01baba2b1e1 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:12.270410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fa68b-feb8-4e7e-bbd0-cad26357b2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:12.271090 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fa68b-feb8-4e7e-bbd0-cad26357b2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:12.271371 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fa68b-feb8-4e7e-bbd0-cad26357b2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:12.271644 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fa68b-feb8-4e7e-bbd0-cad26357b2d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:12.272296 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921fa68b-feb8-4e7e-bbd0-cad26357b2d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:12.275807 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921fa68b-feb8-4e7e-bbd0-cad26357b2d1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:12.291936 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 964/1950] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:54:12.293282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b87040f-894d-4f7f-a516-a20f13bfbd4c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:12.314115 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b87040f-894d-4f7f-a516-a20f13bfbd4c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:12.324792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c200d3-28fa-41c3-bc8e-eb326e6815a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:12.325613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c200d3-28fa-41c3-bc8e-eb326e6815a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:12.325898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c200d3-28fa-41c3-bc8e-eb326e6815a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:12.326226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c200d3-28fa-41c3-bc8e-eb326e6815a0 admin admin] PATH_INFO: `/v3/projects/b079de30aab04018a437e3517970f1a4/users/cc7f8ad58b2a4c76b44b23ff539abcb3/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:12.355035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c200d3-28fa-41c3-bc8e-eb326e6815a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b079de30aab04018a437e3517970f1a4, user_id=cc7f8ad58b2a4c76b44b23ff539abcb3, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:12.357773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c200d3-28fa-41c3-bc8e-eb326e6815a0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:12.389291 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 987/1951] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:12 2022] PUT /identity/v3/projects/b079de30aab04018a437e3517970f1a4/users/cc7f8ad58b2a4c76b44b23ff539abcb3/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:12.393139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fa68b-feb8-4e7e-bbd0-cad26357b2d1 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:12.404476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fa68b-feb8-4e7e-bbd0-cad26357b2d1 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:12.456807 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:12.469295 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67e46c-e954-4a96-8fa9-f1b751342494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:12.469980 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67e46c-e954-4a96-8fa9-f1b751342494 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:12.470394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67e46c-e954-4a96-8fa9-f1b751342494 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:12.470580 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67e46c-e954-4a96-8fa9-f1b751342494 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:12.471298 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b67e46c-e954-4a96-8fa9-f1b751342494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:12.472930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b67e46c-e954-4a96-8fa9-f1b751342494 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:12.484680 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 965/1952] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:12.491783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c200d3-28fa-41c3-bc8e-eb326e6815a0 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:12.502701 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c200d3-28fa-41c3-bc8e-eb326e6815a0 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:12.507431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af60d53-465e-4675-89de-43fa85997ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:12.508123 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af60d53-465e-4675-89de-43fa85997ad2 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:12.508399 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af60d53-465e-4675-89de-43fa85997ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:12.508671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af60d53-465e-4675-89de-43fa85997ad2 admin admin] PATH_INFO: `/v3/projects/b079de30aab04018a437e3517970f1a4/users/cc7f8ad58b2a4c76b44b23ff539abcb3/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:12.510569 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af60d53-465e-4675-89de-43fa85997ad2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b079de30aab04018a437e3517970f1a4, user_id=cc7f8ad58b2a4c76b44b23ff539abcb3, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:12.513225 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af60d53-465e-4675-89de-43fa85997ad2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:12.524076 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 988/1953] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:12 2022] PUT /identity/v3/projects/b079de30aab04018a437e3517970f1a4/users/cc7f8ad58b2a4c76b44b23ff539abcb3/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:54:12.534671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e35fc0-767f-433b-9cc0-0abfad4ec46c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:12.535114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e35fc0-767f-433b-9cc0-0abfad4ec46c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:12.535374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e35fc0-767f-433b-9cc0-0abfad4ec46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:12.566487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-b8e35fc0-767f-433b-9cc0-0abfad4ec46c None None] MFA Rules not processed for user `cc7f8ad58b2a4c76b44b23ff539abcb3`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:12.567821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b8e35fc0-767f-433b-9cc0-0abfad4ec46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:12.662105 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 966/1954] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:12 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:54:12.681150 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af60d53-465e-4675-89de-43fa85997ad2 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:12.683636 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3af60d53-465e-4675-89de-43fa85997ad2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:12.767342 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af60d53-465e-4675-89de-43fa85997ad2 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:12.773462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d511d6-59ae-468b-850d-a96d2d79c57b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:12.774082 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d511d6-59ae-468b-850d-a96d2d79c57b service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:12.774382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d511d6-59ae-468b-850d-a96d2d79c57b service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:12.774669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d511d6-59ae-468b-850d-a96d2d79c57b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:12.784409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d511d6-59ae-468b-850d-a96d2d79c57b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:12.785998 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d511d6-59ae-468b-850d-a96d2d79c57b service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:12.795843 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 989/1955] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:12 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:12.879453 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e35fc0-767f-433b-9cc0-0abfad4ec46c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:12.880876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b8e35fc0-767f-433b-9cc0-0abfad4ec46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:12.903757 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e35fc0-767f-433b-9cc0-0abfad4ec46c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:12.910101 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b60c0-f9aa-4ef1-917c-08031988386b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:12.910742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b60c0-f9aa-4ef1-917c-08031988386b service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:12.911026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b60c0-f9aa-4ef1-917c-08031988386b service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:12.911299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b60c0-f9aa-4ef1-917c-08031988386b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:12.979080 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b60c0-f9aa-4ef1-917c-08031988386b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:12.981187 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b60c0-f9aa-4ef1-917c-08031988386b service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:12.991111 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 967/1956] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:12 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:13.126536 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d511d6-59ae-468b-850d-a96d2d79c57b service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:13.178202 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:13.199338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d511d6-59ae-468b-850d-a96d2d79c57b service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:13.204798 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b525755-2023-4f48-9936-182c2579859a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:13.205508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b525755-2023-4f48-9936-182c2579859a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:13.205753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b525755-2023-4f48-9936-182c2579859a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:13.206068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b525755-2023-4f48-9936-182c2579859a admin admin] PATH_INFO: `/v3/users/d9fb424af10c4e52bca844b35f5a20f2` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:13.207450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b525755-2023-4f48-9936-182c2579859a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9fb424af10c4e52bca844b35f5a20f2)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:13.209740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b525755-2023-4f48-9936-182c2579859a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:13.267088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6b525755-2023-4f48-9936-182c2579859a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9fb424af10c4e52bca844b35f5a20f2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:13.274294 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6b525755-2023-4f48-9936-182c2579859a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9fb424af10c4e52bca844b35f5a20f2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:13.275018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6b525755-2023-4f48-9936-182c2579859a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9fb424af10c4e52bca844b35f5a20f2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:13.275759 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6b525755-2023-4f48-9936-182c2579859a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9fb424af10c4e52bca844b35f5a20f2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:13.283385 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6b525755-2023-4f48-9936-182c2579859a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9fb424af10c4e52bca844b35f5a20f2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:13.301032 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 990/1957] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:54:13 2022] DELETE /identity/v3/users/d9fb424af10c4e52bca844b35f5a20f2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:13.305345 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05cac0-5f3f-4224-b27c-6575afd22e59 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:13.305633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05cac0-5f3f-4224-b27c-6575afd22e59 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:13.305931 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05cac0-5f3f-4224-b27c-6575afd22e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:13.326923 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-0a05cac0-5f3f-4224-b27c-6575afd22e59 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:13.326923 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0a05cac0-5f3f-4224-b27c-6575afd22e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:13.388697 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 968/1958] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:13.398945 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b525755-2023-4f48-9936-182c2579859a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:13.400380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6b525755-2023-4f48-9936-182c2579859a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:13.461041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b525755-2023-4f48-9936-182c2579859a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:13.464674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ac0dc-a62b-4985-a566-93a79b280162 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:13.465283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ac0dc-a62b-4985-a566-93a79b280162 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:13.465565 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ac0dc-a62b-4985-a566-93a79b280162 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:13.465841 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ac0dc-a62b-4985-a566-93a79b280162 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:13.476355 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ac0dc-a62b-4985-a566-93a79b280162 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:13.477789 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ac0dc-a62b-4985-a566-93a79b280162 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:13.488364 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 991/1959] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:54:13.974588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05cac0-5f3f-4224-b27c-6575afd22e59 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:13.975091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0a05cac0-5f3f-4224-b27c-6575afd22e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:13.997415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05cac0-5f3f-4224-b27c-6575afd22e59 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:14.003265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808e7a4-1722-481b-b626-290327558b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:14.003916 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808e7a4-1722-481b-b626-290327558b59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:14.004178 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808e7a4-1722-481b-b626-290327558b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:14.004454 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808e7a4-1722-481b-b626-290327558b59 admin admin] PATH_INFO: `/v3/projects/7e94ccc56a7a4c0cab325094f8185e42` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:14.005570 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808e7a4-1722-481b-b626-290327558b59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e94ccc56a7a4c0cab325094f8185e42)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:14.008997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808e7a4-1722-481b-b626-290327558b59 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:14.021406 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:14.072875 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9808e7a4-1722-481b-b626-290327558b59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e94ccc56a7a4c0cab325094f8185e42', 'request_id': 'req-9808e7a4-1722-481b-b626-290327558b59'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:14.079733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9808e7a4-1722-481b-b626-290327558b59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e94ccc56a7a4c0cab325094f8185e42', 'request_id': 'req-9808e7a4-1722-481b-b626-290327558b59'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:14.087525 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9808e7a4-1722-481b-b626-290327558b59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e94ccc56a7a4c0cab325094f8185e42', 'request_id': 'req-9808e7a4-1722-481b-b626-290327558b59'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:14.110359 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9808e7a4-1722-481b-b626-290327558b59 admin admin] The token cache is being invalidate because project 7e94ccc56a7a4c0cab325094f8185e42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:54:14.110744 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9808e7a4-1722-481b-b626-290327558b59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:14.112130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9808e7a4-1722-481b-b626-290327558b59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:14.118052 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 969/1960] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:54:13 2022] DELETE /identity/v3/projects/7e94ccc56a7a4c0cab325094f8185e42 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:14.118948 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ac0dc-a62b-4985-a566-93a79b280162 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:14.132498 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ac0dc-a62b-4985-a566-93a79b280162 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:14.194846 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d125b7-5bc0-4c3b-8768-e14acd4d5e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:14.195487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d125b7-5bc0-4c3b-8768-e14acd4d5e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:14.195769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d125b7-5bc0-4c3b-8768-e14acd4d5e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:14.196044 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d125b7-5bc0-4c3b-8768-e14acd4d5e92 admin admin] PATH_INFO: `/v3/users/cc7f8ad58b2a4c76b44b23ff539abcb3` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:14.197169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d125b7-5bc0-4c3b-8768-e14acd4d5e92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc7f8ad58b2a4c76b44b23ff539abcb3)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:14.199163 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d125b7-5bc0-4c3b-8768-e14acd4d5e92 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:14.204086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:14.253020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-09d125b7-5bc0-4c3b-8768-e14acd4d5e92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc7f8ad58b2a4c76b44b23ff539abcb3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:14.260916 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-09d125b7-5bc0-4c3b-8768-e14acd4d5e92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc7f8ad58b2a4c76b44b23ff539abcb3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:14.261738 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-09d125b7-5bc0-4c3b-8768-e14acd4d5e92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc7f8ad58b2a4c76b44b23ff539abcb3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:14.262365 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-09d125b7-5bc0-4c3b-8768-e14acd4d5e92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc7f8ad58b2a4c76b44b23ff539abcb3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:14.270940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-09d125b7-5bc0-4c3b-8768-e14acd4d5e92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc7f8ad58b2a4c76b44b23ff539abcb3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:14.290762 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 992/1961] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:54:14 2022] DELETE /identity/v3/users/cc7f8ad58b2a4c76b44b23ff539abcb3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:14.633281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808e7a4-1722-481b-b626-290327558b59 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:14.634795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9808e7a4-1722-481b-b626-290327558b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:14.648588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808e7a4-1722-481b-b626-290327558b59 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:14.711567 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035e372-5c59-40dc-8060-5946cbbf6918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:14.711567 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035e372-5c59-40dc-8060-5946cbbf6918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:14.711567 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035e372-5c59-40dc-8060-5946cbbf6918 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:14.711875 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035e372-5c59-40dc-8060-5946cbbf6918 admin admin] PATH_INFO: `/v3/projects/b079de30aab04018a437e3517970f1a4` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:14.712924 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1035e372-5c59-40dc-8060-5946cbbf6918 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b079de30aab04018a437e3517970f1a4)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:14.714982 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1035e372-5c59-40dc-8060-5946cbbf6918 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:14.763530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1035e372-5c59-40dc-8060-5946cbbf6918 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b079de30aab04018a437e3517970f1a4', 'request_id': 'req-1035e372-5c59-40dc-8060-5946cbbf6918'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:14.771316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1035e372-5c59-40dc-8060-5946cbbf6918 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b079de30aab04018a437e3517970f1a4', 'request_id': 'req-1035e372-5c59-40dc-8060-5946cbbf6918'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:14.778823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1035e372-5c59-40dc-8060-5946cbbf6918 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b079de30aab04018a437e3517970f1a4', 'request_id': 'req-1035e372-5c59-40dc-8060-5946cbbf6918'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:14.795118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1035e372-5c59-40dc-8060-5946cbbf6918 admin admin] The token cache is being invalidate because project b079de30aab04018a437e3517970f1a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:54:14.795401 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1035e372-5c59-40dc-8060-5946cbbf6918 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:14.796648 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1035e372-5c59-40dc-8060-5946cbbf6918 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:14.799128 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 970/1962] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:54:14 2022] DELETE /identity/v3/projects/b079de30aab04018a437e3517970f1a4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:14.804877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a76c2-b152-4b58-85fb-5d67da1ea062 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:14.805474 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a76c2-b152-4b58-85fb-5d67da1ea062 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:14.806000 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a76c2-b152-4b58-85fb-5d67da1ea062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:14.830721 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-3d0a76c2-b152-4b58-85fb-5d67da1ea062 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:14.832084 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3d0a76c2-b152-4b58-85fb-5d67da1ea062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:14.907150 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 993/1963] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:14.914716 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056ba80-c0c3-4f96-ba67-b2d5d3f55d88 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:14.915000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056ba80-c0c3-4f96-ba67-b2d5d3f55d88 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:14.915272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056ba80-c0c3-4f96-ba67-b2d5d3f55d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:14.937782 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d056ba80-c0c3-4f96-ba67-b2d5d3f55d88 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:14.939067 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d056ba80-c0c3-4f96-ba67-b2d5d3f55d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:14.947100 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 971/1964] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:14.951343 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a76c2-b152-4b58-85fb-5d67da1ea062 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:14.961933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a76c2-b152-4b58-85fb-5d67da1ea062 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:14.969085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed165bd-0df6-4ff4-818f-e1b36bb4f709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:14.969876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed165bd-0df6-4ff4-818f-e1b36bb4f709 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:14.970563 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed165bd-0df6-4ff4-818f-e1b36bb4f709 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:14.971195 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed165bd-0df6-4ff4-818f-e1b36bb4f709 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:14.972414 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed165bd-0df6-4ff4-818f-e1b36bb4f709 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:54:14.972690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed165bd-0df6-4ff4-818f-e1b36bb4f709 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:14.974573 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed165bd-0df6-4ff4-818f-e1b36bb4f709 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:14.991243 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 994/1965] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:54:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:54:14.993060 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056ba80-c0c3-4f96-ba67-b2d5d3f55d88 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:15.010532 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056ba80-c0c3-4f96-ba67-b2d5d3f55d88 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:15.018569 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed0f5d-7169-4dbd-9ab6-6597bf42eea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:15.019605 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed0f5d-7169-4dbd-9ab6-6597bf42eea1 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:15.020086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed0f5d-7169-4dbd-9ab6-6597bf42eea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:15.020566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed0f5d-7169-4dbd-9ab6-6597bf42eea1 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:15.021671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed0f5d-7169-4dbd-9ab6-6597bf42eea1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:15.025552 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed0f5d-7169-4dbd-9ab6-6597bf42eea1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:15.063539 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:15.083525 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 972/1966] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:54:14 2022] POST /identity/v3/projects => generated 397 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:54:15.085875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed165bd-0df6-4ff4-818f-e1b36bb4f709 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:15.098170 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed165bd-0df6-4ff4-818f-e1b36bb4f709 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:15.214288 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263991c-e62e-4ca0-87fe-51ea5f78d98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:15.214976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263991c-e62e-4ca0-87fe-51ea5f78d98e admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:15.215189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263991c-e62e-4ca0-87fe-51ea5f78d98e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:15.215462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263991c-e62e-4ca0-87fe-51ea5f78d98e admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:15.216091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263991c-e62e-4ca0-87fe-51ea5f78d98e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:15.218640 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263991c-e62e-4ca0-87fe-51ea5f78d98e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:15.238156 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:15.248043 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 995/1967] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:54:15 2022] POST /identity/v3/users => generated 299 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:54:15.249213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed0f5d-7169-4dbd-9ab6-6597bf42eea1 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:15.262297 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed0f5d-7169-4dbd-9ab6-6597bf42eea1 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:15.268923 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce8fa4-464a-4397-915d-f0b9f98cb2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:15.269565 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce8fa4-464a-4397-915d-f0b9f98cb2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:15.269872 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce8fa4-464a-4397-915d-f0b9f98cb2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:15.270817 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce8fa4-464a-4397-915d-f0b9f98cb2d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:15.271531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce8fa4-464a-4397-915d-f0b9f98cb2d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:15.273141 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce8fa4-464a-4397-915d-f0b9f98cb2d2 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:15.285180 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 973/1968] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:15.289073 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263991c-e62e-4ca0-87fe-51ea5f78d98e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:15.301517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263991c-e62e-4ca0-87fe-51ea5f78d98e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:15.306831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eac5c9-aa71-460b-afc3-6cd00bcdc4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:15.307589 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eac5c9-aa71-460b-afc3-6cd00bcdc4d7 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:15.307873 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eac5c9-aa71-460b-afc3-6cd00bcdc4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:15.308146 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eac5c9-aa71-460b-afc3-6cd00bcdc4d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:15.308792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eac5c9-aa71-460b-afc3-6cd00bcdc4d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:15.310385 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eac5c9-aa71-460b-afc3-6cd00bcdc4d7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:15.322876 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 996/1969] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:15.327717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce8fa4-464a-4397-915d-f0b9f98cb2d2 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:15.339213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce8fa4-464a-4397-915d-f0b9f98cb2d2 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:15.346389 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43581f8d-e991-4234-bc2a-788dd06e4899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:15.347219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43581f8d-e991-4234-bc2a-788dd06e4899 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:15.348291 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43581f8d-e991-4234-bc2a-788dd06e4899 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:15.348697 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43581f8d-e991-4234-bc2a-788dd06e4899 admin admin] PATH_INFO: `/v3/projects/5c99a4e2a24548ba906dd57b88cc0aba/users/343f309c07e343b4b15268472d19f10c/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:15.369535 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43581f8d-e991-4234-bc2a-788dd06e4899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c99a4e2a24548ba906dd57b88cc0aba, user_id=343f309c07e343b4b15268472d19f10c, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:15.372450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43581f8d-e991-4234-bc2a-788dd06e4899 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:15.388458 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 974/1970] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:15 2022] PUT /identity/v3/projects/5c99a4e2a24548ba906dd57b88cc0aba/users/343f309c07e343b4b15268472d19f10c/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:15.393599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff3ce3-bf37-47e7-999a-45e84dab4424 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:15.393880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff3ce3-bf37-47e7-999a-45e84dab4424 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:15.394152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff3ce3-bf37-47e7-999a-45e84dab4424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:15.416031 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-2bff3ce3-bf37-47e7-999a-45e84dab4424 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:15.417160 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2bff3ce3-bf37-47e7-999a-45e84dab4424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:15.493356 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 997/1971] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:15.503684 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43581f8d-e991-4234-bc2a-788dd06e4899 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:15.506904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-43581f8d-e991-4234-bc2a-788dd06e4899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:15.572622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43581f8d-e991-4234-bc2a-788dd06e4899 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:15.578125 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a65eb-943e-4c94-be58-d9c183f76bab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:15.579078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a65eb-943e-4c94-be58-d9c183f76bab service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:15.579501 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a65eb-943e-4c94-be58-d9c183f76bab service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:15.579936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a65eb-943e-4c94-be58-d9c183f76bab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:15.595460 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a65eb-943e-4c94-be58-d9c183f76bab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:15.597266 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a65eb-943e-4c94-be58-d9c183f76bab service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:15.609188 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff3ce3-bf37-47e7-999a-45e84dab4424 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:15.612153 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2bff3ce3-bf37-47e7-999a-45e84dab4424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:15.628861 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 975/1972] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:15.789459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff3ce3-bf37-47e7-999a-45e84dab4424 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:15.798928 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30778ad8-4cd8-40d7-95c8-4f4b08b222b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:15.799974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30778ad8-4cd8-40d7-95c8-4f4b08b222b0 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:15.800325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30778ad8-4cd8-40d7-95c8-4f4b08b222b0 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:15.800775 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30778ad8-4cd8-40d7-95c8-4f4b08b222b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:15.803401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-30778ad8-4cd8-40d7-95c8-4f4b08b222b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:15.935411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30778ad8-4cd8-40d7-95c8-4f4b08b222b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:15.937984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30778ad8-4cd8-40d7-95c8-4f4b08b222b0 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:15.949437 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 998/1973] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:15 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:54:17.722976 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2cdd08-2a45-4ff7-b47d-6212923d8a83 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:17.723484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2cdd08-2a45-4ff7-b47d-6212923d8a83 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:17.723484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2cdd08-2a45-4ff7-b47d-6212923d8a83 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:17.724901 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 976/1974] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 20:54:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:54:17.730974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408923ee-f853-466b-8acd-e6155aa1dc0b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:17.731457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408923ee-f853-466b-8acd-e6155aa1dc0b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:17.731662 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408923ee-f853-466b-8acd-e6155aa1dc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:17.756382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-408923ee-f853-466b-8acd-e6155aa1dc0b None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:17.757724 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-408923ee-f853-466b-8acd-e6155aa1dc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:17.781578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:17.862913 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 999/1975] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 20:54:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:17.888395 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2cdd08-2a45-4ff7-b47d-6212923d8a83 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:17.890581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6d2cdd08-2a45-4ff7-b47d-6212923d8a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:17.926330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2cdd08-2a45-4ff7-b47d-6212923d8a83 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:17.933543 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444f637-8f97-449f-8f80-619ffe22b364 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:17.934661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444f637-8f97-449f-8f80-619ffe22b364 service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:17.935808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444f637-8f97-449f-8f80-619ffe22b364 service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:17.936574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444f637-8f97-449f-8f80-619ffe22b364 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:17.949269 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444f637-8f97-449f-8f80-619ffe22b364 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:17.952554 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444f637-8f97-449f-8f80-619ffe22b364 service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:17.965166 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 977/1976] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:20.996674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408923ee-f853-466b-8acd-e6155aa1dc0b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:21.031125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408923ee-f853-466b-8acd-e6155aa1dc0b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:21.054415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2a6ec-c469-40c0-b460-735fb4c55bb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:21.056782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2a6ec-c469-40c0-b460-735fb4c55bb7 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:21.057068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2a6ec-c469-40c0-b460-735fb4c55bb7 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:21.058462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2a6ec-c469-40c0-b460-735fb4c55bb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:21.062139 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-77b2a6ec-c469-40c0-b460-735fb4c55bb7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:21.180250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2a6ec-c469-40c0-b460-735fb4c55bb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:21.182339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2a6ec-c469-40c0-b460-735fb4c55bb7 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:21.199180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444f637-8f97-449f-8f80-619ffe22b364 service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:21.200868 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a444f637-8f97-449f-8f80-619ffe22b364 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:21.211438 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1000/1977] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:21.252219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444f637-8f97-449f-8f80-619ffe22b364 service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:21.266020 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac9118-9d55-4210-a9b8-9bb3f96a186a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:21.268875 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac9118-9d55-4210-a9b8-9bb3f96a186a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:21.269280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac9118-9d55-4210-a9b8-9bb3f96a186a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:21.271631 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac9118-9d55-4210-a9b8-9bb3f96a186a admin admin] PATH_INFO: `/v3/users/2f338f404c5340d6903d71d16832bb1a` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:21.274329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac9118-9d55-4210-a9b8-9bb3f96a186a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f338f404c5340d6903d71d16832bb1a)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:21.281431 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac9118-9d55-4210-a9b8-9bb3f96a186a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:21.391350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58093d2-0f08-40c7-b097-9ebfc6b1fcb3 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:21.392825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58093d2-0f08-40c7-b097-9ebfc6b1fcb3 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:21.393119 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58093d2-0f08-40c7-b097-9ebfc6b1fcb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:21.400645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-91ac9118-9d55-4210-a9b8-9bb3f96a186a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f338f404c5340d6903d71d16832bb1a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:21.411660 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-91ac9118-9d55-4210-a9b8-9bb3f96a186a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f338f404c5340d6903d71d16832bb1a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:21.417148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-91ac9118-9d55-4210-a9b8-9bb3f96a186a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f338f404c5340d6903d71d16832bb1a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:21.446333 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-91ac9118-9d55-4210-a9b8-9bb3f96a186a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f338f404c5340d6903d71d16832bb1a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:21.459673 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-c58093d2-0f08-40c7-b097-9ebfc6b1fcb3 None None] MFA Rules not processed for user `f5f7743570b2465ea4d4397840485758`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:21.464450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c58093d2-0f08-40c7-b097-9ebfc6b1fcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:21.489597 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-91ac9118-9d55-4210-a9b8-9bb3f96a186a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f338f404c5340d6903d71d16832bb1a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:21.533263 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 978/1978] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:54:21 2022] DELETE /identity/v3/users/2f338f404c5340d6903d71d16832bb1a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:21.541133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488676b-9160-46c5-a97e-051e0f8f6877 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:21.542958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488676b-9160-46c5-a97e-051e0f8f6877 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:21.543375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488676b-9160-46c5-a97e-051e0f8f6877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:21.583472 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-5488676b-9160-46c5-a97e-051e0f8f6877 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:21.584843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5488676b-9160-46c5-a97e-051e0f8f6877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:21.611290 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:21.656935 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1001/1979] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:21.658740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58093d2-0f08-40c7-b097-9ebfc6b1fcb3 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:21.676195 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c58093d2-0f08-40c7-b097-9ebfc6b1fcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:21.710788 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 979/1980] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:21.731344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58093d2-0f08-40c7-b097-9ebfc6b1fcb3 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:21.741841 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488676b-9160-46c5-a97e-051e0f8f6877 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:21.743284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5488676b-9160-46c5-a97e-051e0f8f6877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:21.744539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f683ace-a478-427c-a68a-e37cab70b8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:21.745423 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f683ace-a478-427c-a68a-e37cab70b8f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:21.745621 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f683ace-a478-427c-a68a-e37cab70b8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:21.745893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f683ace-a478-427c-a68a-e37cab70b8f4 admin admin] PATH_INFO: `/v3/users/012f20ffe53640a3be67f9d3cff4e28a` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:21.751262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f683ace-a478-427c-a68a-e37cab70b8f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=012f20ffe53640a3be67f9d3cff4e28a)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:21.753871 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f683ace-a478-427c-a68a-e37cab70b8f4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:21.880728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3f683ace-a478-427c-a68a-e37cab70b8f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '012f20ffe53640a3be67f9d3cff4e28a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:21.899423 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:21.909896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3f683ace-a478-427c-a68a-e37cab70b8f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '012f20ffe53640a3be67f9d3cff4e28a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:21.911248 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3f683ace-a478-427c-a68a-e37cab70b8f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '012f20ffe53640a3be67f9d3cff4e28a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:21.911900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3f683ace-a478-427c-a68a-e37cab70b8f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '012f20ffe53640a3be67f9d3cff4e28a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:21.917885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488676b-9160-46c5-a97e-051e0f8f6877 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:21.923053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57a973-cdc6-4f17-b0f2-0738419e9043 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:21.923756 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57a973-cdc6-4f17-b0f2-0738419e9043 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:21.924362 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57a973-cdc6-4f17-b0f2-0738419e9043 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:21.924715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57a973-cdc6-4f17-b0f2-0738419e9043 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:21.925891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3f683ace-a478-427c-a68a-e37cab70b8f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '012f20ffe53640a3be67f9d3cff4e28a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:21.927088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3d57a973-cdc6-4f17-b0f2-0738419e9043 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:21.942337 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d57a973-cdc6-4f17-b0f2-0738419e9043 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:21.943894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d57a973-cdc6-4f17-b0f2-0738419e9043 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:21.972809 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1002/1981] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:54:21 2022] DELETE /identity/v3/users/012f20ffe53640a3be67f9d3cff4e28a => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:21.972809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427467d-409b-4536-acb6-cdd2f6544fff None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:21.972809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427467d-409b-4536-acb6-cdd2f6544fff None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:21.972809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427467d-409b-4536-acb6-cdd2f6544fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:21.974977 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 980/1982] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:54:21.983896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-e427467d-409b-4536-acb6-cdd2f6544fff None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:21.985308 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e427467d-409b-4536-acb6-cdd2f6544fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:22.156480 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1003/1983] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:22.198892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57a973-cdc6-4f17-b0f2-0738419e9043 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:22.200427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3d57a973-cdc6-4f17-b0f2-0738419e9043 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:22.223222 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57a973-cdc6-4f17-b0f2-0738419e9043 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:22.330025 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a26ae4-fed4-4a50-b2b3-7e35faae05e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:22.331142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a26ae4-fed4-4a50-b2b3-7e35faae05e6 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:22.331581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a26ae4-fed4-4a50-b2b3-7e35faae05e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:22.332037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a26ae4-fed4-4a50-b2b3-7e35faae05e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:22.345321 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a26ae4-fed4-4a50-b2b3-7e35faae05e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:22.347312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a26ae4-fed4-4a50-b2b3-7e35faae05e6 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:22.364036 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 981/1984] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:22.388249 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4209180-91f9-40ee-9f3e-6a212bb743fb None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:22.388541 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4209180-91f9-40ee-9f3e-6a212bb743fb None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:22.389501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4209180-91f9-40ee-9f3e-6a212bb743fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:22.418687 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b4209180-91f9-40ee-9f3e-6a212bb743fb None None] MFA Rules not processed for user `174e91100a184740b7c604730266dc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:22.420103 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b4209180-91f9-40ee-9f3e-6a212bb743fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:22.450200 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1004/1985] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 20:54:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:22.472818 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a26ae4-fed4-4a50-b2b3-7e35faae05e6 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:22.487505 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a26ae4-fed4-4a50-b2b3-7e35faae05e6 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:22.492216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e26eed-3c7a-4248-aac8-0f905123ff70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:22.492848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e26eed-3c7a-4248-aac8-0f905123ff70 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:22.493127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e26eed-3c7a-4248-aac8-0f905123ff70 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:22.493403 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e26eed-3c7a-4248-aac8-0f905123ff70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:22.507927 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e26eed-3c7a-4248-aac8-0f905123ff70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:22.509387 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e26eed-3c7a-4248-aac8-0f905123ff70 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:22.524500 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 982/1986] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:22.595538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06602f-eb68-46c1-b784-8306a80e27ec None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:22.595737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06602f-eb68-46c1-b784-8306a80e27ec None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:22.596013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06602f-eb68-46c1-b784-8306a80e27ec None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:22.607503 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1005/1987] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 20:54:22 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:54:22.617872 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58856281-0ecc-4183-a38a-1a608349afe5 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:22.618535 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58856281-0ecc-4183-a38a-1a608349afe5 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:22.619052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58856281-0ecc-4183-a38a-1a608349afe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:22.666686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-58856281-0ecc-4183-a38a-1a608349afe5 None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:22.668785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-58856281-0ecc-4183-a38a-1a608349afe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:22.719698 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06602f-eb68-46c1-b784-8306a80e27ec None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:22.721501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9e06602f-eb68-46c1-b784-8306a80e27ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:22.770867 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06602f-eb68-46c1-b784-8306a80e27ec None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:22.785272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e86ee-618d-495a-8078-5e639270a27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:22.786248 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e86ee-618d-495a-8078-5e639270a27a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:22.786526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e86ee-618d-495a-8078-5e639270a27a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:22.788597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e86ee-618d-495a-8078-5e639270a27a admin admin] PATH_INFO: `/v3/projects/19b72ba11e904abebb2bfd558261b5b1` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:22.789342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:22.790485 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e86ee-618d-495a-8078-5e639270a27a admin admin] RBAC: Authorizing `identity:delete_project(project_id=19b72ba11e904abebb2bfd558261b5b1)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:22.792704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e86ee-618d-495a-8078-5e639270a27a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:22.822517 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 983/1988] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 20:54:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:22.823832 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58856281-0ecc-4183-a38a-1a608349afe5 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:22.826322 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-58856281-0ecc-4183-a38a-1a608349afe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:22.859712 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58856281-0ecc-4183-a38a-1a608349afe5 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:22.866015 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c60a2e-1add-4720-8ef3-e673c7ea6ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:22.866865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c60a2e-1add-4720-8ef3-e673c7ea6ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:22.867237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c60a2e-1add-4720-8ef3-e673c7ea6ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:22.867584 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c60a2e-1add-4720-8ef3-e673c7ea6ce0 admin admin] PATH_INFO: `/v3/projects/35ffa77d7887486dbb30387455757c32` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:22.868985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c60a2e-1add-4720-8ef3-e673c7ea6ce0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35ffa77d7887486dbb30387455757c32)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:22.871431 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c60a2e-1add-4720-8ef3-e673c7ea6ce0 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:22.898031 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-db5e86ee-618d-495a-8078-5e639270a27a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19b72ba11e904abebb2bfd558261b5b1', 'request_id': 'req-db5e86ee-618d-495a-8078-5e639270a27a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:22.905011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-db5e86ee-618d-495a-8078-5e639270a27a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19b72ba11e904abebb2bfd558261b5b1', 'request_id': 'req-db5e86ee-618d-495a-8078-5e639270a27a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:22.915360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-db5e86ee-618d-495a-8078-5e639270a27a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19b72ba11e904abebb2bfd558261b5b1', 'request_id': 'req-db5e86ee-618d-495a-8078-5e639270a27a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:22.932856 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-db5e86ee-618d-495a-8078-5e639270a27a admin admin] The token cache is being invalidate because project 19b72ba11e904abebb2bfd558261b5b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:54:22.933111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-db5e86ee-618d-495a-8078-5e639270a27a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:22.934662 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-db5e86ee-618d-495a-8078-5e639270a27a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:22.938950 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1006/1989] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:54:22 2022] DELETE /identity/v3/projects/19b72ba11e904abebb2bfd558261b5b1 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:22.939944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e86ee-618d-495a-8078-5e639270a27a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:22.941817 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-db5e86ee-618d-495a-8078-5e639270a27a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:22.949021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f6c60a2e-1add-4720-8ef3-e673c7ea6ce0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35ffa77d7887486dbb30387455757c32', 'request_id': 'req-f6c60a2e-1add-4720-8ef3-e673c7ea6ce0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:22.958419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f6c60a2e-1add-4720-8ef3-e673c7ea6ce0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35ffa77d7887486dbb30387455757c32', 'request_id': 'req-f6c60a2e-1add-4720-8ef3-e673c7ea6ce0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:22.972046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f6c60a2e-1add-4720-8ef3-e673c7ea6ce0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35ffa77d7887486dbb30387455757c32', 'request_id': 'req-f6c60a2e-1add-4720-8ef3-e673c7ea6ce0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:22.989082 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f6c60a2e-1add-4720-8ef3-e673c7ea6ce0 admin admin] The token cache is being invalidate because project 35ffa77d7887486dbb30387455757c32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:54:22.989373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f6c60a2e-1add-4720-8ef3-e673c7ea6ce0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:22.990406 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f6c60a2e-1add-4720-8ef3-e673c7ea6ce0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:22.995004 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 984/1990] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:54:22 2022] DELETE /identity/v3/projects/35ffa77d7887486dbb30387455757c32 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:22.996207 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c60a2e-1add-4720-8ef3-e673c7ea6ce0 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:23.001996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f6c60a2e-1add-4720-8ef3-e673c7ea6ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:23.028438 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:23.058444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e86ee-618d-495a-8078-5e639270a27a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:23.133788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c60a2e-1add-4720-8ef3-e673c7ea6ce0 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:23.139969 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37f4d4-5a68-4203-8256-734ac86f7df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:23.140770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37f4d4-5a68-4203-8256-734ac86f7df8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:23.141181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37f4d4-5a68-4203-8256-734ac86f7df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:23.141480 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37f4d4-5a68-4203-8256-734ac86f7df8 admin admin] PATH_INFO: `/v3/users/89fc5615ddc64689b26e01c8e6e14dae` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:23.149420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37f4d4-5a68-4203-8256-734ac86f7df8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89fc5615ddc64689b26e01c8e6e14dae)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:23.151883 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab3661-7e94-4c90-aea9-9fe86ec6e074 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:23.152128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37f4d4-5a68-4203-8256-734ac86f7df8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:23.153099 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab3661-7e94-4c90-aea9-9fe86ec6e074 service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:23.153383 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab3661-7e94-4c90-aea9-9fe86ec6e074 service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:23.153650 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab3661-7e94-4c90-aea9-9fe86ec6e074 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:23.157338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-33ab3661-7e94-4c90-aea9-9fe86ec6e074 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:23.171501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab3661-7e94-4c90-aea9-9fe86ec6e074 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:23.174168 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab3661-7e94-4c90-aea9-9fe86ec6e074 service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:23.189196 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1007/1991] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:23.190895 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad072a88-1ada-48f1-8bfa-177687a3bbfb None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:23.191463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad072a88-1ada-48f1-8bfa-177687a3bbfb None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:23.191877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad072a88-1ada-48f1-8bfa-177687a3bbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:23.247634 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-ad072a88-1ada-48f1-8bfa-177687a3bbfb None None] MFA Rules not processed for user `343f309c07e343b4b15268472d19f10c`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:23.252174 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8f37f4d4-5a68-4203-8256-734ac86f7df8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89fc5615ddc64689b26e01c8e6e14dae'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:23.253055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8f37f4d4-5a68-4203-8256-734ac86f7df8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89fc5615ddc64689b26e01c8e6e14dae'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:23.253392 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ad072a88-1ada-48f1-8bfa-177687a3bbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:23.254053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8f37f4d4-5a68-4203-8256-734ac86f7df8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89fc5615ddc64689b26e01c8e6e14dae'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:23.280751 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8f37f4d4-5a68-4203-8256-734ac86f7df8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89fc5615ddc64689b26e01c8e6e14dae'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:23.311895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8f37f4d4-5a68-4203-8256-734ac86f7df8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89fc5615ddc64689b26e01c8e6e14dae'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:23.319859 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:23.334895 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 985/1992] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:54:22 2022] DELETE /identity/v3/users/89fc5615ddc64689b26e01c8e6e14dae => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:23.336390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37f4d4-5a68-4203-8256-734ac86f7df8 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:23.338016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8f37f4d4-5a68-4203-8256-734ac86f7df8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:23.401575 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1008/1993] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:23 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:23.402898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad072a88-1ada-48f1-8bfa-177687a3bbfb None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:23.404522 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ad072a88-1ada-48f1-8bfa-177687a3bbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:23.470838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37f4d4-5a68-4203-8256-734ac86f7df8 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:23.481868 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18dbc1c-3ec9-4651-8f01-3c46395355f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:23.485024 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18dbc1c-3ec9-4651-8f01-3c46395355f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:23.485527 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18dbc1c-3ec9-4651-8f01-3c46395355f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:23.487024 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18dbc1c-3ec9-4651-8f01-3c46395355f9 admin admin] PATH_INFO: `/v3/users/0679f6344f42438f8cb4852763260fb6` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:23.489490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18dbc1c-3ec9-4651-8f01-3c46395355f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0679f6344f42438f8cb4852763260fb6)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:23.492249 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18dbc1c-3ec9-4651-8f01-3c46395355f9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:23.633992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad072a88-1ada-48f1-8bfa-177687a3bbfb None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:23.644024 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:23.676689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e18dbc1c-3ec9-4651-8f01-3c46395355f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0679f6344f42438f8cb4852763260fb6'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:23.677986 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e18dbc1c-3ec9-4651-8f01-3c46395355f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0679f6344f42438f8cb4852763260fb6'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:23.679127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e18dbc1c-3ec9-4651-8f01-3c46395355f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0679f6344f42438f8cb4852763260fb6'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:23.694814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e18dbc1c-3ec9-4651-8f01-3c46395355f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0679f6344f42438f8cb4852763260fb6'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:23.713762 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e18dbc1c-3ec9-4651-8f01-3c46395355f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0679f6344f42438f8cb4852763260fb6'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:23.758298 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 986/1994] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:54:23 2022] DELETE /identity/v3/users/0679f6344f42438f8cb4852763260fb6 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:23.766480 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18dbc1c-3ec9-4651-8f01-3c46395355f9 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:23.772025 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e18dbc1c-3ec9-4651-8f01-3c46395355f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:23.849823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb9a84-45ac-4d67-8d25-15ee1eb55a2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:23.850453 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb9a84-45ac-4d67-8d25-15ee1eb55a2d service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:23.850772 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb9a84-45ac-4d67-8d25-15ee1eb55a2d service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:23.851055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb9a84-45ac-4d67-8d25-15ee1eb55a2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:23.853212 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ddbb9a84-45ac-4d67-8d25-15ee1eb55a2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:23.954467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18dbc1c-3ec9-4651-8f01-3c46395355f9 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:23.962377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30464fc7-06d7-45cf-847a-55163eb2d5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:23.963923 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30464fc7-06d7-45cf-847a-55163eb2d5be admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:23.964407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30464fc7-06d7-45cf-847a-55163eb2d5be admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:23.965029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30464fc7-06d7-45cf-847a-55163eb2d5be admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:23.966134 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30464fc7-06d7-45cf-847a-55163eb2d5be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:23.971518 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30464fc7-06d7-45cf-847a-55163eb2d5be admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:24.017383 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb9a84-45ac-4d67-8d25-15ee1eb55a2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:24.018017 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:24.020879 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb9a84-45ac-4d67-8d25-15ee1eb55a2d service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:24.034507 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 987/1995] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:54:23 2022] POST /identity/v3/projects => generated 395 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:24.035858 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbb2e4-7021-4e1f-b082-ba6997d59987 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:24.036148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbb2e4-7021-4e1f-b082-ba6997d59987 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:24.036422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbb2e4-7021-4e1f-b082-ba6997d59987 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:24.044551 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 988/1996] 10.222.0.33 () {54 vars in 921 bytes} [Sat Aug 6 20:54:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:54:24.046215 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfbb2e4-7021-4e1f-b082-ba6997d59987 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:24.052201 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1009/1997] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:23 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:24.053958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7115a7d-752c-4c67-8872-1d4f14295d3a None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:24.058355 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7115a7d-752c-4c67-8872-1d4f14295d3a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:24.064281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7115a7d-752c-4c67-8872-1d4f14295d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:24.132517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b7115a7d-752c-4c67-8872-1d4f14295d3a None None] MFA Rules not processed for user `174e91100a184740b7c604730266dc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:24.137393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b7115a7d-752c-4c67-8872-1d4f14295d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:24.259438 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfbb2e4-7021-4e1f-b082-ba6997d59987 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:24.275828 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1010/1998] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 20:54:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:24.277892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7115a7d-752c-4c67-8872-1d4f14295d3a None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:24.280604 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b7115a7d-752c-4c67-8872-1d4f14295d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:24.290353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a38eba-18c8-49ee-b52a-21e013767486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:24.292420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a38eba-18c8-49ee-b52a-21e013767486 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:24.294137 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a38eba-18c8-49ee-b52a-21e013767486 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:24.294424 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a38eba-18c8-49ee-b52a-21e013767486 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:24.295157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a38eba-18c8-49ee-b52a-21e013767486 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:24.301512 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a38eba-18c8-49ee-b52a-21e013767486 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:24.339555 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7115a7d-752c-4c67-8872-1d4f14295d3a None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:24.354367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349c32b-8b9c-4317-9a6e-a9e53aa5ba34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:24.355061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349c32b-8b9c-4317-9a6e-a9e53aa5ba34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:24.358288 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349c32b-8b9c-4317-9a6e-a9e53aa5ba34 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:24.360424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349c32b-8b9c-4317-9a6e-a9e53aa5ba34 admin admin] PATH_INFO: `/v3/projects/ce386f9bb1654c03b083f070d587bd30` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:24.362128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349c32b-8b9c-4317-9a6e-a9e53aa5ba34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce386f9bb1654c03b083f070d587bd30)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:24.364454 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349c32b-8b9c-4317-9a6e-a9e53aa5ba34 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:24.377629 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 989/1999] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:54:24 2022] POST /identity/v3/users => generated 304 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:24.379644 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a38eba-18c8-49ee-b52a-21e013767486 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:24.381896 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c7a38eba-18c8-49ee-b52a-21e013767486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:24.400287 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a38eba-18c8-49ee-b52a-21e013767486 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:24.406194 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f0d76-023a-43ef-b99b-8c92a760b306 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:24.406870 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f0d76-023a-43ef-b99b-8c92a760b306 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:24.407153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f0d76-023a-43ef-b99b-8c92a760b306 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:24.407480 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f0d76-023a-43ef-b99b-8c92a760b306 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:24.428917 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f0d76-023a-43ef-b99b-8c92a760b306 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:24.431429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f0d76-023a-43ef-b99b-8c92a760b306 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:24.454943 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 990/2000] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:24.455811 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f0d76-023a-43ef-b99b-8c92a760b306 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:24.475518 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:24.479325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8349c32b-8b9c-4317-9a6e-a9e53aa5ba34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce386f9bb1654c03b083f070d587bd30', 'request_id': 'req-8349c32b-8b9c-4317-9a6e-a9e53aa5ba34'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:24.483458 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f0d76-023a-43ef-b99b-8c92a760b306 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:24.493005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8349c32b-8b9c-4317-9a6e-a9e53aa5ba34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce386f9bb1654c03b083f070d587bd30', 'request_id': 'req-8349c32b-8b9c-4317-9a6e-a9e53aa5ba34'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:24.514162 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8349c32b-8b9c-4317-9a6e-a9e53aa5ba34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce386f9bb1654c03b083f070d587bd30', 'request_id': 'req-8349c32b-8b9c-4317-9a6e-a9e53aa5ba34'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:24.539990 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8349c32b-8b9c-4317-9a6e-a9e53aa5ba34 admin admin] The token cache is being invalidate because project ce386f9bb1654c03b083f070d587bd30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:54:24.540391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8349c32b-8b9c-4317-9a6e-a9e53aa5ba34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:24.542393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8349c32b-8b9c-4317-9a6e-a9e53aa5ba34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:24.544179 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1011/2001] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:54:24 2022] DELETE /identity/v3/projects/ce386f9bb1654c03b083f070d587bd30 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:24.558832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c9cc9-342f-40fb-90e0-86955c82a356 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:24.559195 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c9cc9-342f-40fb-90e0-86955c82a356 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:24.559395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c9cc9-342f-40fb-90e0-86955c82a356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:24.564140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8532fd-f5cf-4bc9-a06f-88fe36e11010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:24.564789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8532fd-f5cf-4bc9-a06f-88fe36e11010 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:24.565043 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8532fd-f5cf-4bc9-a06f-88fe36e11010 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:24.565415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8532fd-f5cf-4bc9-a06f-88fe36e11010 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:24.566091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8532fd-f5cf-4bc9-a06f-88fe36e11010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:24.567834 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8532fd-f5cf-4bc9-a06f-88fe36e11010 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:24.586141 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 991/2002] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:24.587246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8532fd-f5cf-4bc9-a06f-88fe36e11010 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:24.589260 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-dd8532fd-f5cf-4bc9-a06f-88fe36e11010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:24.604851 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8532fd-f5cf-4bc9-a06f-88fe36e11010 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:24.617123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05ab53-da89-4a97-a07c-587492b4a0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:24.618674 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05ab53-da89-4a97-a07c-587492b4a0eb admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:24.618961 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05ab53-da89-4a97-a07c-587492b4a0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:24.619239 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05ab53-da89-4a97-a07c-587492b4a0eb admin admin] PATH_INFO: `/v3/projects/f61462ba75654df88028a92e324cf071/users/d5df8df0714242c68a5a51614d23a144/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:24.644294 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-4f7c9cc9-342f-40fb-90e0-86955c82a356 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:24.645438 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4f7c9cc9-342f-40fb-90e0-86955c82a356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:24.648380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05ab53-da89-4a97-a07c-587492b4a0eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f61462ba75654df88028a92e324cf071, user_id=d5df8df0714242c68a5a51614d23a144, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:24.652774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05ab53-da89-4a97-a07c-587492b4a0eb admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:24.672477 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1012/2003] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:24.688103 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8646c-abe8-44bb-9ec5-41b19507a275 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:24.688664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8646c-abe8-44bb-9ec5-41b19507a275 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:24.689791 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8646c-abe8-44bb-9ec5-41b19507a275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:24.694976 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 992/2004] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:24 2022] PUT /identity/v3/projects/f61462ba75654df88028a92e324cf071/users/d5df8df0714242c68a5a51614d23a144/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:24.697293 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05ab53-da89-4a97-a07c-587492b4a0eb admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:24.757672 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-40c8646c-abe8-44bb-9ec5-41b19507a275 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:24.763111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-40c8646c-abe8-44bb-9ec5-41b19507a275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:24.823284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:24.880682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05ab53-da89-4a97-a07c-587492b4a0eb admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:24.900311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fd34a3-c3a5-4dfb-b93e-69b6b1997a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:24.904110 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd34a3-c3a5-4dfb-b93e-69b6b1997a2d admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:24.906154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd34a3-c3a5-4dfb-b93e-69b6b1997a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:24.907157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd34a3-c3a5-4dfb-b93e-69b6b1997a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:24.910169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fd34a3-c3a5-4dfb-b93e-69b6b1997a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:24.924232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fd34a3-c3a5-4dfb-b93e-69b6b1997a2d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:24.976749 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1013/2005] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:24.977838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48521c57-a929-457f-84ab-b0a47cafb414 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:24.978124 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48521c57-a929-457f-84ab-b0a47cafb414 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:24.978399 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48521c57-a929-457f-84ab-b0a47cafb414 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:24.986270 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1014/2006] 10.222.0.33 () {54 vars in 921 bytes} [Sat Aug 6 20:54:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:54:24.987332 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48521c57-a929-457f-84ab-b0a47cafb414 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:24.987442 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 993/2007] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:54:24.988879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66940c-745d-4ac1-9941-68ed30676de8 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:24.989170 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66940c-745d-4ac1-9941-68ed30676de8 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:24.989707 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66940c-745d-4ac1-9941-68ed30676de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:25.034338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48521c57-a929-457f-84ab-b0a47cafb414 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:25.040794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-ee66940c-745d-4ac1-9941-68ed30676de8 None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:25.043164 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ee66940c-745d-4ac1-9941-68ed30676de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:25.049290 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e84db7-0277-4ae0-be48-6136061dea4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:25.049913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e84db7-0277-4ae0-be48-6136061dea4c admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:25.050188 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e84db7-0277-4ae0-be48-6136061dea4c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:25.050660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e84db7-0277-4ae0-be48-6136061dea4c admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:25.051464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e84db7-0277-4ae0-be48-6136061dea4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:54:25.052292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e84db7-0277-4ae0-be48-6136061dea4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:25.055440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e84db7-0277-4ae0-be48-6136061dea4c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:25.085372 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1015/2008] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:54:25.088626 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e84db7-0277-4ae0-be48-6136061dea4c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:25.112645 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e84db7-0277-4ae0-be48-6136061dea4c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:25.130538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416959d6-d7fb-44fd-9327-456081823c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:25.131481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416959d6-d7fb-44fd-9327-456081823c11 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:25.131930 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416959d6-d7fb-44fd-9327-456081823c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:25.132347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416959d6-d7fb-44fd-9327-456081823c11 admin admin] PATH_INFO: `/v3/projects/f61462ba75654df88028a92e324cf071/users/d5df8df0714242c68a5a51614d23a144/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:25.135696 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416959d6-d7fb-44fd-9327-456081823c11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f61462ba75654df88028a92e324cf071, user_id=d5df8df0714242c68a5a51614d23a144, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:25.143884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416959d6-d7fb-44fd-9327-456081823c11 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:25.174353 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1016/2009] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:25 2022] PUT /identity/v3/projects/f61462ba75654df88028a92e324cf071/users/d5df8df0714242c68a5a51614d23a144/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:25.178293 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416959d6-d7fb-44fd-9327-456081823c11 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:25.282249 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 994/2010] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 20:54:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:25.294779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66940c-745d-4ac1-9941-68ed30676de8 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:25.305557 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ee66940c-745d-4ac1-9941-68ed30676de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:25.344374 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416959d6-d7fb-44fd-9327-456081823c11 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:25.351647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66940c-745d-4ac1-9941-68ed30676de8 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:25.359028 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37573993-35d3-41cf-baff-0a641ff3a822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:25.359893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37573993-35d3-41cf-baff-0a641ff3a822 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:25.360311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37573993-35d3-41cf-baff-0a641ff3a822 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:25.361347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37573993-35d3-41cf-baff-0a641ff3a822 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:25.362125 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e8fd5-ec1a-4645-8b49-b7744e2603ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:25.362441 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37573993-35d3-41cf-baff-0a641ff3a822 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:25.363034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e8fd5-ec1a-4645-8b49-b7744e2603ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:25.363407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e8fd5-ec1a-4645-8b49-b7744e2603ad admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:25.363782 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e8fd5-ec1a-4645-8b49-b7744e2603ad admin admin] PATH_INFO: `/v3/projects/820687a76e6640c7976c03f7b686471b` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:25.366461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e8fd5-ec1a-4645-8b49-b7744e2603ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=820687a76e6640c7976c03f7b686471b)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:25.367646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37573993-35d3-41cf-baff-0a641ff3a822 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:25.375441 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e8fd5-ec1a-4645-8b49-b7744e2603ad admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:25.466658 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1017/2011] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:54:25 2022] POST /identity/v3/projects => generated 405 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:25.466658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37573993-35d3-41cf-baff-0a641ff3a822 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:25.474005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-37573993-35d3-41cf-baff-0a641ff3a822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:25.553039 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:25.573107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-224e8fd5-ec1a-4645-8b49-b7744e2603ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '820687a76e6640c7976c03f7b686471b', 'request_id': 'req-224e8fd5-ec1a-4645-8b49-b7744e2603ad'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:25.597754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-224e8fd5-ec1a-4645-8b49-b7744e2603ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '820687a76e6640c7976c03f7b686471b', 'request_id': 'req-224e8fd5-ec1a-4645-8b49-b7744e2603ad'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:25.613310 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-224e8fd5-ec1a-4645-8b49-b7744e2603ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '820687a76e6640c7976c03f7b686471b', 'request_id': 'req-224e8fd5-ec1a-4645-8b49-b7744e2603ad'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:25.634340 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-224e8fd5-ec1a-4645-8b49-b7744e2603ad admin admin] The token cache is being invalidate because project 820687a76e6640c7976c03f7b686471b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:54:25.636100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-224e8fd5-ec1a-4645-8b49-b7744e2603ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:25.638703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-224e8fd5-ec1a-4645-8b49-b7744e2603ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:25.645786 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 995/2012] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:54:25 2022] DELETE /identity/v3/projects/820687a76e6640c7976c03f7b686471b => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:25.647671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e8fd5-ec1a-4645-8b49-b7744e2603ad admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:25.652116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-224e8fd5-ec1a-4645-8b49-b7744e2603ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:25.656059 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37573993-35d3-41cf-baff-0a641ff3a822 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:25.850457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e8fd5-ec1a-4645-8b49-b7744e2603ad admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:25.865753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cd279-c1c4-4583-92ad-8e9690dca870 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:25.875530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cd279-c1c4-4583-92ad-8e9690dca870 service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:25.878166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cd279-c1c4-4583-92ad-8e9690dca870 service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:25.878166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cd279-c1c4-4583-92ad-8e9690dca870 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:25.882921 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2c22b-c6a9-4bb8-9e3e-afb1968aa42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:25.883877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c78cd279-c1c4-4583-92ad-8e9690dca870 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:25.885430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2c22b-c6a9-4bb8-9e3e-afb1968aa42b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:25.886113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2c22b-c6a9-4bb8-9e3e-afb1968aa42b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:25.886475 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2c22b-c6a9-4bb8-9e3e-afb1968aa42b admin admin] PATH_INFO: `/v3/users/5ab74a18992d4a7a9f460e98efe9e0ea` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:25.894230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c2c22b-c6a9-4bb8-9e3e-afb1968aa42b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ab74a18992d4a7a9f460e98efe9e0ea)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:25.902916 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c2c22b-c6a9-4bb8-9e3e-afb1968aa42b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:25.908794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:25.917457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78cd279-c1c4-4583-92ad-8e9690dca870 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:25.927889 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78cd279-c1c4-4583-92ad-8e9690dca870 service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:25.949747 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 996/2013] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:25.953474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cd279-c1c4-4583-92ad-8e9690dca870 service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:25.958389 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c78cd279-c1c4-4583-92ad-8e9690dca870 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:26.001654 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cd279-c1c4-4583-92ad-8e9690dca870 service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:26.012990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43ae23-f65e-4b13-a83e-2565bca0378f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:26.015679 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43ae23-f65e-4b13-a83e-2565bca0378f admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:26.016629 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43ae23-f65e-4b13-a83e-2565bca0378f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:26.017599 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43ae23-f65e-4b13-a83e-2565bca0378f admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:26.019383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe43ae23-f65e-4b13-a83e-2565bca0378f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:26.027801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe43ae23-f65e-4b13-a83e-2565bca0378f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:26.089030 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 997/2014] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:54:25 2022] POST /identity/v3/users => generated 303 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:26.096288 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c95df9-275c-4ae7-b15e-6dfa69e13056 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:26.096481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c95df9-275c-4ae7-b15e-6dfa69e13056 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:26.096635 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c95df9-275c-4ae7-b15e-6dfa69e13056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:26.099210 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-24c2c22b-c6a9-4bb8-9e3e-afb1968aa42b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ab74a18992d4a7a9f460e98efe9e0ea'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:26.117601 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-24c2c22b-c6a9-4bb8-9e3e-afb1968aa42b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ab74a18992d4a7a9f460e98efe9e0ea'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:26.118909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-24c2c22b-c6a9-4bb8-9e3e-afb1968aa42b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ab74a18992d4a7a9f460e98efe9e0ea'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:26.120220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-24c2c22b-c6a9-4bb8-9e3e-afb1968aa42b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ab74a18992d4a7a9f460e98efe9e0ea'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:26.140699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-24c2c22b-c6a9-4bb8-9e3e-afb1968aa42b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ab74a18992d4a7a9f460e98efe9e0ea'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:26.183901 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1018/2015] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:54:25 2022] DELETE /identity/v3/users/5ab74a18992d4a7a9f460e98efe9e0ea => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:26.186166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-b4c95df9-275c-4ae7-b15e-6dfa69e13056 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:26.188657 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2c22b-c6a9-4bb8-9e3e-afb1968aa42b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:26.192968 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b4c95df9-275c-4ae7-b15e-6dfa69e13056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:26.194718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-24c2c22b-c6a9-4bb8-9e3e-afb1968aa42b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:26.320853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:26.334203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2c22b-c6a9-4bb8-9e3e-afb1968aa42b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:26.359543 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483702a-0c6d-4f1d-aff8-a8d94084d560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:26.363036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483702a-0c6d-4f1d-aff8-a8d94084d560 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:26.364950 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483702a-0c6d-4f1d-aff8-a8d94084d560 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:26.366136 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483702a-0c6d-4f1d-aff8-a8d94084d560 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:26.367284 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483702a-0c6d-4f1d-aff8-a8d94084d560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:26.371558 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483702a-0c6d-4f1d-aff8-a8d94084d560 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:26.386600 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 998/2016] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:26.387489 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318337e-7ef6-4950-94ff-da9c44d89ca2 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:26.387778 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318337e-7ef6-4950-94ff-da9c44d89ca2 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:26.388050 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318337e-7ef6-4950-94ff-da9c44d89ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:26.392971 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1019/2017] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:26.392971 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f04b2-a862-4165-abf6-1d5ff45764af None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:26.392971 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f04b2-a862-4165-abf6-1d5ff45764af None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:26.392971 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f04b2-a862-4165-abf6-1d5ff45764af None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:26.394906 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1020/2018] 10.222.0.33 () {54 vars in 921 bytes} [Sat Aug 6 20:54:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:54:26.396165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2e5ec-b58f-4645-a687-55713f232267 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:26.396751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2e5ec-b58f-4645-a687-55713f232267 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:26.397129 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2e5ec-b58f-4645-a687-55713f232267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:26.420258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b6c2e5ec-b58f-4645-a687-55713f232267 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:26.421866 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b6c2e5ec-b58f-4645-a687-55713f232267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:26.435942 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-b318337e-7ef6-4950-94ff-da9c44d89ca2 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:26.436951 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b318337e-7ef6-4950-94ff-da9c44d89ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:26.450238 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1021/2019] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:26.450238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2e5ec-b58f-4645-a687-55713f232267 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:26.464651 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 999/2020] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:26.472514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2e5ec-b58f-4645-a687-55713f232267 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:26.476947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c051267-ba76-48a3-b42b-212a6f921a29 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:26.477241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c051267-ba76-48a3-b42b-212a6f921a29 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:26.477515 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c051267-ba76-48a3-b42b-212a6f921a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:26.479336 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63eb9e-b1e4-4fe6-acf2-6883e2936d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:26.480118 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63eb9e-b1e4-4fe6-acf2-6883e2936d5e admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:26.480778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63eb9e-b1e4-4fe6-acf2-6883e2936d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:26.481761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63eb9e-b1e4-4fe6-acf2-6883e2936d5e admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:26.483989 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63eb9e-b1e4-4fe6-acf2-6883e2936d5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:26.487100 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63eb9e-b1e4-4fe6-acf2-6883e2936d5e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:26.516558 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1022/2021] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:26.517814 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63eb9e-b1e4-4fe6-acf2-6883e2936d5e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:26.533776 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63eb9e-b1e4-4fe6-acf2-6883e2936d5e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:26.539368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b0a1c-9fcd-4482-9606-6beb45b27221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:26.540173 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b0a1c-9fcd-4482-9606-6beb45b27221 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:26.540618 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b0a1c-9fcd-4482-9606-6beb45b27221 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:26.541197 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b0a1c-9fcd-4482-9606-6beb45b27221 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:26.542340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b0a1c-9fcd-4482-9606-6beb45b27221 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:54:26.542867 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b0a1c-9fcd-4482-9606-6beb45b27221 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:26.545497 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b0a1c-9fcd-4482-9606-6beb45b27221 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:26.557368 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-6c051267-ba76-48a3-b42b-212a6f921a29 None None] MFA Rules not processed for user `5f9d53147a57402f8b9818590bc1fc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:26.558625 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6c051267-ba76-48a3-b42b-212a6f921a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:26.582916 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1023/2022] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:54:26.584163 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b0a1c-9fcd-4482-9606-6beb45b27221 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:26.589080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e48b0a1c-9fcd-4482-9606-6beb45b27221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:26.617838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b0a1c-9fcd-4482-9606-6beb45b27221 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:26.634419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16ed78-9b40-4b33-8ade-17248e88120d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:26.635692 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16ed78-9b40-4b33-8ade-17248e88120d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:26.635692 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16ed78-9b40-4b33-8ade-17248e88120d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:26.635899 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16ed78-9b40-4b33-8ade-17248e88120d admin admin] PATH_INFO: `/v3/users/07d2a43d97f242e5a725eb5e12ba1cc2` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:26.638997 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e16ed78-9b40-4b33-8ade-17248e88120d admin admin] RBAC: Authorizing `identity:delete_user(user_id=07d2a43d97f242e5a725eb5e12ba1cc2)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:26.640963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e16ed78-9b40-4b33-8ade-17248e88120d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:26.704338 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1000/2023] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 20:54:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:26.705427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c051267-ba76-48a3-b42b-212a6f921a29 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:26.707503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6c051267-ba76-48a3-b42b-212a6f921a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:26.755843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6e16ed78-9b40-4b33-8ade-17248e88120d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07d2a43d97f242e5a725eb5e12ba1cc2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:26.772758 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6e16ed78-9b40-4b33-8ade-17248e88120d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07d2a43d97f242e5a725eb5e12ba1cc2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:26.773893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6e16ed78-9b40-4b33-8ade-17248e88120d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07d2a43d97f242e5a725eb5e12ba1cc2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:26.774878 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6e16ed78-9b40-4b33-8ade-17248e88120d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07d2a43d97f242e5a725eb5e12ba1cc2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:26.794810 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6e16ed78-9b40-4b33-8ade-17248e88120d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07d2a43d97f242e5a725eb5e12ba1cc2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:26.838923 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1024/2024] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:54:26 2022] DELETE /identity/v3/users/07d2a43d97f242e5a725eb5e12ba1cc2 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:26.843443 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16ed78-9b40-4b33-8ade-17248e88120d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:26.844896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6e16ed78-9b40-4b33-8ade-17248e88120d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:26.854976 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c051267-ba76-48a3-b42b-212a6f921a29 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:26.891422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:26.969026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa287d2-89cc-40bc-bc34-58d22f02d4e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:26.969759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa287d2-89cc-40bc-bc34-58d22f02d4e1 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:26.971165 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa287d2-89cc-40bc-bc34-58d22f02d4e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:26.971165 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa287d2-89cc-40bc-bc34-58d22f02d4e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:26.974851 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4aa287d2-89cc-40bc-bc34-58d22f02d4e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:27.010790 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16ed78-9b40-4b33-8ade-17248e88120d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:27.025336 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c7b82-c46d-433b-b200-36f5d4c0ba03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:27.026108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c7b82-c46d-433b-b200-36f5d4c0ba03 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:27.026453 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c7b82-c46d-433b-b200-36f5d4c0ba03 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:27.026821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c7b82-c46d-433b-b200-36f5d4c0ba03 admin admin] PATH_INFO: `/v3/projects/36b172e0463348d0a917c4b940fba552/users/392626ec112c47559420f9871c9712c3/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:27.055114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c7b82-c46d-433b-b200-36f5d4c0ba03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36b172e0463348d0a917c4b940fba552, user_id=392626ec112c47559420f9871c9712c3, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:27.058150 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c7b82-c46d-433b-b200-36f5d4c0ba03 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:27.101709 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1025/2025] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:26 2022] PUT /identity/v3/projects/36b172e0463348d0a917c4b940fba552/users/392626ec112c47559420f9871c9712c3/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:27.103306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c7b82-c46d-433b-b200-36f5d4c0ba03 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:27.113879 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-307c7b82-c46d-433b-b200-36f5d4c0ba03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:27.149117 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa287d2-89cc-40bc-bc34-58d22f02d4e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:27.151649 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa287d2-89cc-40bc-bc34-58d22f02d4e1 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:27.164036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:27.180376 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1001/2026] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:27.182446 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa287d2-89cc-40bc-bc34-58d22f02d4e1 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:27.191468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4aa287d2-89cc-40bc-bc34-58d22f02d4e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:27.228550 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa287d2-89cc-40bc-bc34-58d22f02d4e1 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:27.248952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c7b82-c46d-433b-b200-36f5d4c0ba03 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:27.255936 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37e8f4-f26d-4410-8e07-0deca27a203b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:27.257972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37e8f4-f26d-4410-8e07-0deca27a203b admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:27.258331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37e8f4-f26d-4410-8e07-0deca27a203b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:27.258688 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37e8f4-f26d-4410-8e07-0deca27a203b admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:27.267009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc37e8f4-f26d-4410-8e07-0deca27a203b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:27.267009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc37e8f4-f26d-4410-8e07-0deca27a203b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:27.307454 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1026/2027] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:54:27 2022] POST /identity/v3/projects => generated 381 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:27.309135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a77a5c-0f2b-421d-9924-8babaf67c141 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:27.309312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a77a5c-0f2b-421d-9924-8babaf67c141 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:27.309621 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a77a5c-0f2b-421d-9924-8babaf67c141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:27.338879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f954928c-5d31-4e05-8d0e-07616a60ed6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:27.339591 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954928c-5d31-4e05-8d0e-07616a60ed6b service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:27.340049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954928c-5d31-4e05-8d0e-07616a60ed6b service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:27.340394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954928c-5d31-4e05-8d0e-07616a60ed6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:27.346305 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f954928c-5d31-4e05-8d0e-07616a60ed6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:27.357655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-85a77a5c-0f2b-421d-9924-8babaf67c141 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:27.360454 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-85a77a5c-0f2b-421d-9924-8babaf67c141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:27.508247 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1027/2028] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:27.509678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa3fa4-27ca-48ed-82d0-8c99cca4e7f0 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:27.509952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa3fa4-27ca-48ed-82d0-8c99cca4e7f0 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:27.510228 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa3fa4-27ca-48ed-82d0-8c99cca4e7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:27.515363 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f954928c-5d31-4e05-8d0e-07616a60ed6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:27.516840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f954928c-5d31-4e05-8d0e-07616a60ed6b service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:27.543170 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1002/2029] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:27.544136 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f954928c-5d31-4e05-8d0e-07616a60ed6b service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:27.554381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-e8aa3fa4-27ca-48ed-82d0-8c99cca4e7f0 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:27.555650 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e8aa3fa4-27ca-48ed-82d0-8c99cca4e7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:27.565768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f954928c-5d31-4e05-8d0e-07616a60ed6b service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:27.574153 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1028/2030] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:27.579685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d63336-4679-42ed-9c24-278858fb8e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:27.580329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d63336-4679-42ed-9c24-278858fb8e0c admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:27.580650 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d63336-4679-42ed-9c24-278858fb8e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:27.580933 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d63336-4679-42ed-9c24-278858fb8e0c admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:27.581567 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d63336-4679-42ed-9c24-278858fb8e0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:27.586015 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d63336-4679-42ed-9c24-278858fb8e0c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:27.589684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa3fa4-27ca-48ed-82d0-8c99cca4e7f0 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:27.591099 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e8aa3fa4-27ca-48ed-82d0-8c99cca4e7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:27.617682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:27.651674 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1003/2031] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:54:27 2022] POST /identity/v3/users => generated 291 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:27.656289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d63336-4679-42ed-9c24-278858fb8e0c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:27.705325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa3fa4-27ca-48ed-82d0-8c99cca4e7f0 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:27.709544 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e475a9-830e-47ed-b737-1a439e7a63af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:27.710080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e475a9-830e-47ed-b737-1a439e7a63af service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:27.711024 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e475a9-830e-47ed-b737-1a439e7a63af service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:27.711312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e475a9-830e-47ed-b737-1a439e7a63af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:27.725167 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e475a9-830e-47ed-b737-1a439e7a63af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:27.726729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e475a9-830e-47ed-b737-1a439e7a63af service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:27.738587 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1029/2032] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:27.739747 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e475a9-830e-47ed-b737-1a439e7a63af service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:27.750577 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e475a9-830e-47ed-b737-1a439e7a63af service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:27.755560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015d69d-b75b-409f-8a33-1c604b1110db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:27.756052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015d69d-b75b-409f-8a33-1c604b1110db admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:27.756335 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015d69d-b75b-409f-8a33-1c604b1110db admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:27.756612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015d69d-b75b-409f-8a33-1c604b1110db admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:27.757336 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0015d69d-b75b-409f-8a33-1c604b1110db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:27.759223 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0015d69d-b75b-409f-8a33-1c604b1110db admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:27.770958 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1030/2033] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:27.774785 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015d69d-b75b-409f-8a33-1c604b1110db admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:27.796029 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015d69d-b75b-409f-8a33-1c604b1110db admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:27.801668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a61891-4527-4168-838f-cadfc0fa3fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:27.802427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a61891-4527-4168-838f-cadfc0fa3fbc admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:27.802742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a61891-4527-4168-838f-cadfc0fa3fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:27.803022 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a61891-4527-4168-838f-cadfc0fa3fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:27.803770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a61891-4527-4168-838f-cadfc0fa3fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:27.805683 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a61891-4527-4168-838f-cadfc0fa3fbc admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:27.818322 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1031/2034] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:54:27.822631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a61891-4527-4168-838f-cadfc0fa3fbc admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:27.826058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d63336-4679-42ed-9c24-278858fb8e0c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:27.831136 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf034d0-505b-499a-a632-6ef669405630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:27.831752 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf034d0-505b-499a-a632-6ef669405630 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:27.832031 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf034d0-505b-499a-a632-6ef669405630 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:27.832379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf034d0-505b-499a-a632-6ef669405630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:27.836425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a61891-4527-4168-838f-cadfc0fa3fbc admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:27.842469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab1288-75d2-40d2-8b9a-67b3f742903d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:27.843792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab1288-75d2-40d2-8b9a-67b3f742903d admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:27.844009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf034d0-505b-499a-a632-6ef669405630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:27.845208 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab1288-75d2-40d2-8b9a-67b3f742903d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:27.845473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf034d0-505b-499a-a632-6ef669405630 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:27.845643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab1288-75d2-40d2-8b9a-67b3f742903d admin admin] PATH_INFO: `/v3/projects/c0e3164f8b4943eeb85883a0fa08efaa/users/10aebae8bbbd4ea88b9cbf85d3438ed1/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:27.859488 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1004/2035] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:27.892526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:27.902035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaab1288-75d2-40d2-8b9a-67b3f742903d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0e3164f8b4943eeb85883a0fa08efaa, user_id=10aebae8bbbd4ea88b9cbf85d3438ed1, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:27.913350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaab1288-75d2-40d2-8b9a-67b3f742903d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:27.945316 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1032/2036] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:27 2022] PUT /identity/v3/projects/c0e3164f8b4943eeb85883a0fa08efaa/users/10aebae8bbbd4ea88b9cbf85d3438ed1/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:27.957429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb458f-afdd-47fc-a625-2de81c6cc749 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:27.957717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb458f-afdd-47fc-a625-2de81c6cc749 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:27.957991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb458f-afdd-47fc-a625-2de81c6cc749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:28.033196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-15cb458f-afdd-47fc-a625-2de81c6cc749 None None] MFA Rules not processed for user `10aebae8bbbd4ea88b9cbf85d3438ed1`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:28.034871 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-15cb458f-afdd-47fc-a625-2de81c6cc749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:28.124543 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab1288-75d2-40d2-8b9a-67b3f742903d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:28.127258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-eaab1288-75d2-40d2-8b9a-67b3f742903d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:28.202500 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1005/2037] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:28.209564 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb458f-afdd-47fc-a625-2de81c6cc749 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:28.289820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab1288-75d2-40d2-8b9a-67b3f742903d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:28.304435 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd65afe-fe14-4871-bb9a-42fb18e1d5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:28.305261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd65afe-fe14-4871-bb9a-42fb18e1d5be admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:28.305620 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd65afe-fe14-4871-bb9a-42fb18e1d5be admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:28.306004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd65afe-fe14-4871-bb9a-42fb18e1d5be admin admin] PATH_INFO: `/v3/users/c2fe3cd1577a42d3907c4d62ddb79833` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:28.308193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd65afe-fe14-4871-bb9a-42fb18e1d5be admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2fe3cd1577a42d3907c4d62ddb79833)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:28.314158 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd65afe-fe14-4871-bb9a-42fb18e1d5be admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:28.420406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fdd65afe-fe14-4871-bb9a-42fb18e1d5be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2fe3cd1577a42d3907c4d62ddb79833'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:28.429559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fdd65afe-fe14-4871-bb9a-42fb18e1d5be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2fe3cd1577a42d3907c4d62ddb79833'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:28.430297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fdd65afe-fe14-4871-bb9a-42fb18e1d5be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2fe3cd1577a42d3907c4d62ddb79833'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:28.430688 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb458f-afdd-47fc-a625-2de81c6cc749 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:28.431257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fdd65afe-fe14-4871-bb9a-42fb18e1d5be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2fe3cd1577a42d3907c4d62ddb79833'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:28.442946 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fdd65afe-fe14-4871-bb9a-42fb18e1d5be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2fe3cd1577a42d3907c4d62ddb79833'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:28.445950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749a5fe-3acd-4433-8aea-49674e8e2c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:28.448577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749a5fe-3acd-4433-8aea-49674e8e2c97 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:28.448784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749a5fe-3acd-4433-8aea-49674e8e2c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:28.449561 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749a5fe-3acd-4433-8aea-49674e8e2c97 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:28.450221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749a5fe-3acd-4433-8aea-49674e8e2c97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:28.454443 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749a5fe-3acd-4433-8aea-49674e8e2c97 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:28.468709 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1033/2038] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:54:28 2022] DELETE /identity/v3/users/c2fe3cd1577a42d3907c4d62ddb79833 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:28.474274 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a12b7-b24d-4d4a-a987-ddc1caf39422 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:28.477109 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a12b7-b24d-4d4a-a987-ddc1caf39422 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:28.477544 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a12b7-b24d-4d4a-a987-ddc1caf39422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:28.520890 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1006/2039] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:54:28 2022] POST /identity/v3/projects => generated 381 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:28.528720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749a5fe-3acd-4433-8aea-49674e8e2c97 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:28.531912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c749a5fe-3acd-4433-8aea-49674e8e2c97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:28.535019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-600a12b7-b24d-4d4a-a987-ddc1caf39422 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:28.536233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-600a12b7-b24d-4d4a-a987-ddc1caf39422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:28.557377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:28.642834 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1034/2040] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:28.643897 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a12b7-b24d-4d4a-a987-ddc1caf39422 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:28.645268 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-600a12b7-b24d-4d4a-a987-ddc1caf39422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:28.658997 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a12b7-b24d-4d4a-a987-ddc1caf39422 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:28.671725 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c237116-9f5b-4523-b407-9076c9f75c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:28.672826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c237116-9f5b-4523-b407-9076c9f75c82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:28.673416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c237116-9f5b-4523-b407-9076c9f75c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:28.676916 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c237116-9f5b-4523-b407-9076c9f75c82 admin admin] PATH_INFO: `/v3/projects/8df3c89fd9b64e7fabe13faf7fd63080` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:28.676916 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c237116-9f5b-4523-b407-9076c9f75c82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8df3c89fd9b64e7fabe13faf7fd63080)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:28.680023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c237116-9f5b-4523-b407-9076c9f75c82 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:28.691546 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:28.718762 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749a5fe-3acd-4433-8aea-49674e8e2c97 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:28.731226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6837e-9e8a-42ea-828f-5def59ce11cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:28.734588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6837e-9e8a-42ea-828f-5def59ce11cf admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:28.734728 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6837e-9e8a-42ea-828f-5def59ce11cf admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:28.735075 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6837e-9e8a-42ea-828f-5def59ce11cf admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:28.736212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6837e-9e8a-42ea-828f-5def59ce11cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:28.740356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6837e-9e8a-42ea-828f-5def59ce11cf admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:28.776086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0c237116-9f5b-4523-b407-9076c9f75c82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8df3c89fd9b64e7fabe13faf7fd63080', 'request_id': 'req-0c237116-9f5b-4523-b407-9076c9f75c82'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:28.796494 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1007/2041] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:54:28 2022] POST /identity/v3/users => generated 297 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:28.797240 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0c237116-9f5b-4523-b407-9076c9f75c82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8df3c89fd9b64e7fabe13faf7fd63080', 'request_id': 'req-0c237116-9f5b-4523-b407-9076c9f75c82'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:28.799171 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6837e-9e8a-42ea-828f-5def59ce11cf admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:28.803059 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-98a6837e-9e8a-42ea-828f-5def59ce11cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:28.815447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0c237116-9f5b-4523-b407-9076c9f75c82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8df3c89fd9b64e7fabe13faf7fd63080', 'request_id': 'req-0c237116-9f5b-4523-b407-9076c9f75c82'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:28.845420 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0c237116-9f5b-4523-b407-9076c9f75c82 admin admin] The token cache is being invalidate because project 8df3c89fd9b64e7fabe13faf7fd63080 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:54:28.845741 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0c237116-9f5b-4523-b407-9076c9f75c82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:28.846756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0c237116-9f5b-4523-b407-9076c9f75c82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:28.856027 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1035/2042] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:54:28 2022] DELETE /identity/v3/projects/8df3c89fd9b64e7fabe13faf7fd63080 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:28.856027 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c237116-9f5b-4523-b407-9076c9f75c82 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:28.856368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0c237116-9f5b-4523-b407-9076c9f75c82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:28.940590 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6837e-9e8a-42ea-828f-5def59ce11cf admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:29.005433 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c237116-9f5b-4523-b407-9076c9f75c82 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:29.028382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c938d2a-a0d7-467e-b7bf-f3d97bd3a68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:29.029222 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c938d2a-a0d7-467e-b7bf-f3d97bd3a68a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:29.029598 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c938d2a-a0d7-467e-b7bf-f3d97bd3a68a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:29.030241 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c938d2a-a0d7-467e-b7bf-f3d97bd3a68a admin admin] PATH_INFO: `/v3/projects/e95c49afa6f7467fb74adef67a9b4910` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:29.031888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c938d2a-a0d7-467e-b7bf-f3d97bd3a68a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e95c49afa6f7467fb74adef67a9b4910)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:29.036444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c938d2a-a0d7-467e-b7bf-f3d97bd3a68a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:29.092916 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a8b2e-5a6e-45d0-bf2a-daf294051597 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:29.093876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a8b2e-5a6e-45d0-bf2a-daf294051597 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:29.094154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a8b2e-5a6e-45d0-bf2a-daf294051597 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:29.094422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a8b2e-5a6e-45d0-bf2a-daf294051597 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:29.102356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-101a8b2e-5a6e-45d0-bf2a-daf294051597 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:29.122654 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7c938d2a-a0d7-467e-b7bf-f3d97bd3a68a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e95c49afa6f7467fb74adef67a9b4910', 'request_id': 'req-7c938d2a-a0d7-467e-b7bf-f3d97bd3a68a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:29.131587 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7c938d2a-a0d7-467e-b7bf-f3d97bd3a68a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e95c49afa6f7467fb74adef67a9b4910', 'request_id': 'req-7c938d2a-a0d7-467e-b7bf-f3d97bd3a68a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:29.133169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a8b2e-5a6e-45d0-bf2a-daf294051597 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:29.134973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a8b2e-5a6e-45d0-bf2a-daf294051597 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:29.156479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7c938d2a-a0d7-467e-b7bf-f3d97bd3a68a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e95c49afa6f7467fb74adef67a9b4910', 'request_id': 'req-7c938d2a-a0d7-467e-b7bf-f3d97bd3a68a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:29.162351 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1008/2043] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:29.164838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a8b2e-5a6e-45d0-bf2a-daf294051597 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:29.169708 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-101a8b2e-5a6e-45d0-bf2a-daf294051597 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:29.176684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7c938d2a-a0d7-467e-b7bf-f3d97bd3a68a admin admin] The token cache is being invalidate because project e95c49afa6f7467fb74adef67a9b4910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:54:29.176977 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7c938d2a-a0d7-467e-b7bf-f3d97bd3a68a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:29.192561 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7c938d2a-a0d7-467e-b7bf-f3d97bd3a68a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:29.199196 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1036/2044] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:54:28 2022] DELETE /identity/v3/projects/e95c49afa6f7467fb74adef67a9b4910 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:29.205211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c938d2a-a0d7-467e-b7bf-f3d97bd3a68a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:29.220093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7c938d2a-a0d7-467e-b7bf-f3d97bd3a68a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:29.224257 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a8b2e-5a6e-45d0-bf2a-daf294051597 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:29.294113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:29.353867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:29.374457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279094f-b12e-40f0-8cb1-ea01440c7599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:29.375398 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279094f-b12e-40f0-8cb1-ea01440c7599 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:29.375821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279094f-b12e-40f0-8cb1-ea01440c7599 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:29.376235 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279094f-b12e-40f0-8cb1-ea01440c7599 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:29.377029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f279094f-b12e-40f0-8cb1-ea01440c7599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:29.380228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f279094f-b12e-40f0-8cb1-ea01440c7599 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:29.387678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c938d2a-a0d7-467e-b7bf-f3d97bd3a68a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:29.405350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e91b6c-7171-4997-83a6-05cab24d2e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:29.406265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e91b6c-7171-4997-83a6-05cab24d2e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:29.408290 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e91b6c-7171-4997-83a6-05cab24d2e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:29.408760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e91b6c-7171-4997-83a6-05cab24d2e95 admin admin] PATH_INFO: `/v3/users/acdb663b8a424e42b95f086b8d418cb0` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:29.413658 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1009/2045] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:29.414859 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e91b6c-7171-4997-83a6-05cab24d2e95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acdb663b8a424e42b95f086b8d418cb0)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:29.416296 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279094f-b12e-40f0-8cb1-ea01440c7599 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:29.420978 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e91b6c-7171-4997-83a6-05cab24d2e95 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:29.430200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f279094f-b12e-40f0-8cb1-ea01440c7599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:29.466145 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279094f-b12e-40f0-8cb1-ea01440c7599 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:29.480402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc34341-f863-42b8-9421-7c6769fe3b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:29.482087 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc34341-f863-42b8-9421-7c6769fe3b21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:29.482474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc34341-f863-42b8-9421-7c6769fe3b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:29.482768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc34341-f863-42b8-9421-7c6769fe3b21 admin admin] PATH_INFO: `/v3/users/77ba04dfce9247ac9eba07003dd45faf` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:29.484157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc34341-f863-42b8-9421-7c6769fe3b21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77ba04dfce9247ac9eba07003dd45faf)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:29.486430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc34341-f863-42b8-9421-7c6769fe3b21 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:29.538716 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c0e91b6c-7171-4997-83a6-05cab24d2e95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acdb663b8a424e42b95f086b8d418cb0'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:29.552122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c0e91b6c-7171-4997-83a6-05cab24d2e95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acdb663b8a424e42b95f086b8d418cb0'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:29.553314 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c0e91b6c-7171-4997-83a6-05cab24d2e95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acdb663b8a424e42b95f086b8d418cb0'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:29.559862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c0e91b6c-7171-4997-83a6-05cab24d2e95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acdb663b8a424e42b95f086b8d418cb0'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:29.586783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c0e91b6c-7171-4997-83a6-05cab24d2e95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acdb663b8a424e42b95f086b8d418cb0'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:29.599334 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8fc34341-f863-42b8-9421-7c6769fe3b21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77ba04dfce9247ac9eba07003dd45faf'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:29.600473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8fc34341-f863-42b8-9421-7c6769fe3b21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77ba04dfce9247ac9eba07003dd45faf'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:29.602986 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8fc34341-f863-42b8-9421-7c6769fe3b21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77ba04dfce9247ac9eba07003dd45faf'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:29.612848 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1037/2046] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:54:29 2022] DELETE /identity/v3/users/acdb663b8a424e42b95f086b8d418cb0 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:29.614695 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e91b6c-7171-4997-83a6-05cab24d2e95 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:29.616963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c0e91b6c-7171-4997-83a6-05cab24d2e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:29.621146 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8fc34341-f863-42b8-9421-7c6769fe3b21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77ba04dfce9247ac9eba07003dd45faf'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:29.655607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8fc34341-f863-42b8-9421-7c6769fe3b21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77ba04dfce9247ac9eba07003dd45faf'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:29.680977 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1010/2047] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:54:29 2022] DELETE /identity/v3/users/77ba04dfce9247ac9eba07003dd45faf => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:29.718302 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e91b6c-7171-4997-83a6-05cab24d2e95 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:29.785472 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:29.806338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe18b1-3f97-49f0-bca2-538f14973111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:29.807313 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe18b1-3f97-49f0-bca2-538f14973111 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:29.807704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe18b1-3f97-49f0-bca2-538f14973111 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:29.808135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe18b1-3f97-49f0-bca2-538f14973111 admin admin] PATH_INFO: `/v3/projects/ae9f55d1dbe044afbf7dd82813210d27/users/e2d2602fe5d64b419df472540c3dd962/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:29.854708 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe18b1-3f97-49f0-bca2-538f14973111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae9f55d1dbe044afbf7dd82813210d27, user_id=e2d2602fe5d64b419df472540c3dd962, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:29.859187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe18b1-3f97-49f0-bca2-538f14973111 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:29.893327 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1038/2048] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:29 2022] PUT /identity/v3/projects/ae9f55d1dbe044afbf7dd82813210d27/users/e2d2602fe5d64b419df472540c3dd962/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:29.897831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc34341-f863-42b8-9421-7c6769fe3b21 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:29.902209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8fc34341-f863-42b8-9421-7c6769fe3b21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:29.930246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc34341-f863-42b8-9421-7c6769fe3b21 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:30.039598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4000eb-3f24-426f-b664-9557844560a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:30.040285 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4000eb-3f24-426f-b664-9557844560a0 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:30.040512 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4000eb-3f24-426f-b664-9557844560a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:30.040783 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4000eb-3f24-426f-b664-9557844560a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:30.041461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4000eb-3f24-426f-b664-9557844560a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:30.043078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4000eb-3f24-426f-b664-9557844560a0 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:30.067420 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1011/2049] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:30.071895 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe18b1-3f97-49f0-bca2-538f14973111 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:30.091220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe18b1-3f97-49f0-bca2-538f14973111 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:30.098401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded37512-7d0f-4c59-b448-1c77be1b680f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:30.099283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded37512-7d0f-4c59-b448-1c77be1b680f admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:30.099656 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded37512-7d0f-4c59-b448-1c77be1b680f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:30.100027 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded37512-7d0f-4c59-b448-1c77be1b680f admin admin] PATH_INFO: `/v3/projects/ae9f55d1dbe044afbf7dd82813210d27/users/e2d2602fe5d64b419df472540c3dd962/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:30.103787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded37512-7d0f-4c59-b448-1c77be1b680f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae9f55d1dbe044afbf7dd82813210d27, user_id=e2d2602fe5d64b419df472540c3dd962, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:30.107751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded37512-7d0f-4c59-b448-1c77be1b680f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:30.142140 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1039/2050] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:30 2022] PUT /identity/v3/projects/ae9f55d1dbe044afbf7dd82813210d27/users/e2d2602fe5d64b419df472540c3dd962/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:30.154429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b8d55-9ff6-4436-919f-c51e3af5c2c4 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:30.154935 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b8d55-9ff6-4436-919f-c51e3af5c2c4 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:30.155309 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b8d55-9ff6-4436-919f-c51e3af5c2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:30.236872 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-3d7b8d55-9ff6-4436-919f-c51e3af5c2c4 None None] MFA Rules not processed for user `e2d2602fe5d64b419df472540c3dd962`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:30.240898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3d7b8d55-9ff6-4436-919f-c51e3af5c2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:30.395824 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:30.486620 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1012/2051] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:30 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:30.503091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c54a16-9145-4a08-a6d0-daf82e7a0193 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:30.503724 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c54a16-9145-4a08-a6d0-daf82e7a0193 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:30.506501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c54a16-9145-4a08-a6d0-daf82e7a0193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:30.531620 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d3c54a16-9145-4a08-a6d0-daf82e7a0193 None None] MFA Rules not processed for user `10aebae8bbbd4ea88b9cbf85d3438ed1`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:30.534559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d3c54a16-9145-4a08-a6d0-daf82e7a0193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:30.621496 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1040/2052] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:30.632407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b8d55-9ff6-4436-919f-c51e3af5c2c4 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:30.633855 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3d7b8d55-9ff6-4436-919f-c51e3af5c2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:30.830165 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b8d55-9ff6-4436-919f-c51e3af5c2c4 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:30.859533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe890e-eca3-40bb-a8c3-f065a4500227 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:30.860255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe890e-eca3-40bb-a8c3-f065a4500227 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:30.861105 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe890e-eca3-40bb-a8c3-f065a4500227 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:30.861105 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe890e-eca3-40bb-a8c3-f065a4500227 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:30.865183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7ffe890e-eca3-40bb-a8c3-f065a4500227 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:30.905058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe890e-eca3-40bb-a8c3-f065a4500227 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:30.916150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe890e-eca3-40bb-a8c3-f065a4500227 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:30.940339 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1013/2053] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:30 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:31.164005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c54a16-9145-4a08-a6d0-daf82e7a0193 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:31.165538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d3c54a16-9145-4a08-a6d0-daf82e7a0193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:31.350907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c54a16-9145-4a08-a6d0-daf82e7a0193 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:31.358090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b1048-834f-409c-9643-b2e0cc256293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:31.359603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b1048-834f-409c-9643-b2e0cc256293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:31.359995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b1048-834f-409c-9643-b2e0cc256293 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:31.361115 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b1048-834f-409c-9643-b2e0cc256293 admin admin] PATH_INFO: `/v3/projects/9378dadc4e7a44d38180c953f18f80bd` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:31.363018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b1048-834f-409c-9643-b2e0cc256293 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9378dadc4e7a44d38180c953f18f80bd)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:31.368213 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b1048-834f-409c-9643-b2e0cc256293 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:31.443507 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c59b1048-834f-409c-9643-b2e0cc256293 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9378dadc4e7a44d38180c953f18f80bd', 'request_id': 'req-c59b1048-834f-409c-9643-b2e0cc256293'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:31.453594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c59b1048-834f-409c-9643-b2e0cc256293 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9378dadc4e7a44d38180c953f18f80bd', 'request_id': 'req-c59b1048-834f-409c-9643-b2e0cc256293'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:31.473059 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c59b1048-834f-409c-9643-b2e0cc256293 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9378dadc4e7a44d38180c953f18f80bd', 'request_id': 'req-c59b1048-834f-409c-9643-b2e0cc256293'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:31.476346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:31.496029 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c59b1048-834f-409c-9643-b2e0cc256293 admin admin] The token cache is being invalidate because project 9378dadc4e7a44d38180c953f18f80bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:54:31.496589 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c59b1048-834f-409c-9643-b2e0cc256293 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:31.498471 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c59b1048-834f-409c-9643-b2e0cc256293 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:31.506163 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe890e-eca3-40bb-a8c3-f065a4500227 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:31.515044 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1041/2054] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:54:31 2022] DELETE /identity/v3/projects/9378dadc4e7a44d38180c953f18f80bd => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:31.527639 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe890e-eca3-40bb-a8c3-f065a4500227 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:31.643389 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72744d7f-532c-4b7c-a6f8-2d42c0e9ea9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:31.644656 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72744d7f-532c-4b7c-a6f8-2d42c0e9ea9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:31.645081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72744d7f-532c-4b7c-a6f8-2d42c0e9ea9f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:31.645504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72744d7f-532c-4b7c-a6f8-2d42c0e9ea9f admin admin] PATH_INFO: `/v3/users/7cf7bbbf0c0e4bafb47caa177a0ff6fc` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:31.647276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72744d7f-532c-4b7c-a6f8-2d42c0e9ea9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cf7bbbf0c0e4bafb47caa177a0ff6fc)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:31.649551 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72744d7f-532c-4b7c-a6f8-2d42c0e9ea9f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:31.773746 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-72744d7f-532c-4b7c-a6f8-2d42c0e9ea9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cf7bbbf0c0e4bafb47caa177a0ff6fc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:31.777668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-72744d7f-532c-4b7c-a6f8-2d42c0e9ea9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cf7bbbf0c0e4bafb47caa177a0ff6fc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:31.780019 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-72744d7f-532c-4b7c-a6f8-2d42c0e9ea9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cf7bbbf0c0e4bafb47caa177a0ff6fc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:31.814899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-72744d7f-532c-4b7c-a6f8-2d42c0e9ea9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cf7bbbf0c0e4bafb47caa177a0ff6fc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:31.851170 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-72744d7f-532c-4b7c-a6f8-2d42c0e9ea9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cf7bbbf0c0e4bafb47caa177a0ff6fc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:31.854600 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:31.902624 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1014/2055] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:54:31 2022] DELETE /identity/v3/users/7cf7bbbf0c0e4bafb47caa177a0ff6fc => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:32.188971 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b1048-834f-409c-9643-b2e0cc256293 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:32.190756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c59b1048-834f-409c-9643-b2e0cc256293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:32.221487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b1048-834f-409c-9643-b2e0cc256293 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:32.324298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b138ce-9ddf-4368-99a2-6ab25b2f4eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:32.326176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b138ce-9ddf-4368-99a2-6ab25b2f4eb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:32.326695 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b138ce-9ddf-4368-99a2-6ab25b2f4eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:32.328247 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b138ce-9ddf-4368-99a2-6ab25b2f4eb5 admin admin] PATH_INFO: `/v3/projects/ae4c799b4d834fa19b81fedf13f0aa88` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:32.330295 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b138ce-9ddf-4368-99a2-6ab25b2f4eb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae4c799b4d834fa19b81fedf13f0aa88)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:32.333418 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b138ce-9ddf-4368-99a2-6ab25b2f4eb5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:32.368485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72744d7f-532c-4b7c-a6f8-2d42c0e9ea9f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:32.370287 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-72744d7f-532c-4b7c-a6f8-2d42c0e9ea9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:32.392066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72744d7f-532c-4b7c-a6f8-2d42c0e9ea9f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:32.409565 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291dd72-1014-4820-a306-d6b081f598b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:32.410352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291dd72-1014-4820-a306-d6b081f598b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:32.411140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291dd72-1014-4820-a306-d6b081f598b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:32.411140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291dd72-1014-4820-a306-d6b081f598b1 admin admin] PATH_INFO: `/v3/projects/b8caf528671c45c1ab579a7ca47c25e9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:32.414013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9291dd72-1014-4820-a306-d6b081f598b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8caf528671c45c1ab579a7ca47c25e9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:32.414563 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9291dd72-1014-4820-a306-d6b081f598b1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:32.463317 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-76b138ce-9ddf-4368-99a2-6ab25b2f4eb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae4c799b4d834fa19b81fedf13f0aa88', 'request_id': 'req-76b138ce-9ddf-4368-99a2-6ab25b2f4eb5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:32.472396 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-76b138ce-9ddf-4368-99a2-6ab25b2f4eb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae4c799b4d834fa19b81fedf13f0aa88', 'request_id': 'req-76b138ce-9ddf-4368-99a2-6ab25b2f4eb5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:32.488523 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-76b138ce-9ddf-4368-99a2-6ab25b2f4eb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae4c799b4d834fa19b81fedf13f0aa88', 'request_id': 'req-76b138ce-9ddf-4368-99a2-6ab25b2f4eb5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:32.509008 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-76b138ce-9ddf-4368-99a2-6ab25b2f4eb5 admin admin] The token cache is being invalidate because project ae4c799b4d834fa19b81fedf13f0aa88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:54:32.509453 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-76b138ce-9ddf-4368-99a2-6ab25b2f4eb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:32.510251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-76b138ce-9ddf-4368-99a2-6ab25b2f4eb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:32.516879 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1042/2056] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:54:32 2022] DELETE /identity/v3/projects/ae4c799b4d834fa19b81fedf13f0aa88 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:32.518441 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05753df-6cf1-4489-82d6-096c38318ef1 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:32.518899 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05753df-6cf1-4489-82d6-096c38318ef1 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:32.519429 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05753df-6cf1-4489-82d6-096c38318ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:32.525583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9291dd72-1014-4820-a306-d6b081f598b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8caf528671c45c1ab579a7ca47c25e9', 'request_id': 'req-9291dd72-1014-4820-a306-d6b081f598b1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:32.532597 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9291dd72-1014-4820-a306-d6b081f598b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8caf528671c45c1ab579a7ca47c25e9', 'request_id': 'req-9291dd72-1014-4820-a306-d6b081f598b1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:32.546009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9291dd72-1014-4820-a306-d6b081f598b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8caf528671c45c1ab579a7ca47c25e9', 'request_id': 'req-9291dd72-1014-4820-a306-d6b081f598b1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:32.628152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a05753df-6cf1-4489-82d6-096c38318ef1 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:32.631355 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a05753df-6cf1-4489-82d6-096c38318ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:32.646196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9291dd72-1014-4820-a306-d6b081f598b1 admin admin] The token cache is being invalidate because project b8caf528671c45c1ab579a7ca47c25e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:54:32.646777 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9291dd72-1014-4820-a306-d6b081f598b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:32.652245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9291dd72-1014-4820-a306-d6b081f598b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:32.654318 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1015/2057] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:54:32 2022] DELETE /identity/v3/projects/b8caf528671c45c1ab579a7ca47c25e9 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:32.659295 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2768873-7368-4241-afa8-db55af25a708 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:32.659582 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2768873-7368-4241-afa8-db55af25a708 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:32.659861 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2768873-7368-4241-afa8-db55af25a708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:32.729415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f2768873-7368-4241-afa8-db55af25a708 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:32.730671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f2768873-7368-4241-afa8-db55af25a708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:32.816367 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1043/2058] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:32.830171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc19cf-c989-463e-8c35-2d892b35fd2c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:32.831997 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc19cf-c989-463e-8c35-2d892b35fd2c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:32.832289 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc19cf-c989-463e-8c35-2d892b35fd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:32.894658 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1016/2059] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:32.902242 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2e781-f14e-4702-a2bf-2da5cc78954f None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:32.902733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2e781-f14e-4702-a2bf-2da5cc78954f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:32.904069 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2e781-f14e-4702-a2bf-2da5cc78954f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:32.906208 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-8acc19cf-c989-463e-8c35-2d892b35fd2c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:32.910397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8acc19cf-c989-463e-8c35-2d892b35fd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:32.931332 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-adc2e781-f14e-4702-a2bf-2da5cc78954f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:32.933293 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-adc2e781-f14e-4702-a2bf-2da5cc78954f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:32.935323 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1044/2060] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:32.940318 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc19cf-c989-463e-8c35-2d892b35fd2c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:32.964522 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc19cf-c989-463e-8c35-2d892b35fd2c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:32.965675 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1017/2061] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:32.968749 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2e781-f14e-4702-a2bf-2da5cc78954f None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:32.981280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f124f-8d3d-41d7-a558-fd799827258c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:32.981841 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f124f-8d3d-41d7-a558-fd799827258c admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:32.983138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f124f-8d3d-41d7-a558-fd799827258c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:32.983234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f124f-8d3d-41d7-a558-fd799827258c admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:32.983900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f124f-8d3d-41d7-a558-fd799827258c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:54:32.984202 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f124f-8d3d-41d7-a558-fd799827258c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:32.986247 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f124f-8d3d-41d7-a558-fd799827258c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:32.989164 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2e781-f14e-4702-a2bf-2da5cc78954f None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:33.015275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b484dc9-8fd0-4356-a6be-169c6efd0fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:33.016919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b484dc9-8fd0-4356-a6be-169c6efd0fce admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:33.017407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b484dc9-8fd0-4356-a6be-169c6efd0fce admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:33.018323 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b484dc9-8fd0-4356-a6be-169c6efd0fce admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:33.019738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b484dc9-8fd0-4356-a6be-169c6efd0fce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:54:33.022108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b484dc9-8fd0-4356-a6be-169c6efd0fce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:33.035832 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b484dc9-8fd0-4356-a6be-169c6efd0fce admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:33.043911 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1045/2062] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:54:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:54:33.045973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f124f-8d3d-41d7-a558-fd799827258c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:33.055987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1b8f124f-8d3d-41d7-a558-fd799827258c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:33.069770 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1018/2063] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:54:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:54:33.069770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b484dc9-8fd0-4356-a6be-169c6efd0fce admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:33.081476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f124f-8d3d-41d7-a558-fd799827258c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:33.088692 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5b25c-f0c3-4ade-8ef6-1ebdafab86f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:33.089787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5b25c-f0c3-4ade-8ef6-1ebdafab86f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:33.090330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5b25c-f0c3-4ade-8ef6-1ebdafab86f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:33.091004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5b25c-f0c3-4ade-8ef6-1ebdafab86f8 admin admin] PATH_INFO: `/v3/projects/cc8895257b064c5dafd5a756473fd31c` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:33.093535 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b5b25c-f0c3-4ade-8ef6-1ebdafab86f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc8895257b064c5dafd5a756473fd31c)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:33.096839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b5b25c-f0c3-4ade-8ef6-1ebdafab86f8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:33.098231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b484dc9-8fd0-4356-a6be-169c6efd0fce admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:33.109439 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:33.112197 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94a8e8-9eec-4a7f-b9fd-86b76f4ddbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:33.112197 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94a8e8-9eec-4a7f-b9fd-86b76f4ddbec admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:33.112524 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94a8e8-9eec-4a7f-b9fd-86b76f4ddbec admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:33.112745 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94a8e8-9eec-4a7f-b9fd-86b76f4ddbec admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:33.114815 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94a8e8-9eec-4a7f-b9fd-86b76f4ddbec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:33.116764 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94a8e8-9eec-4a7f-b9fd-86b76f4ddbec admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:33.202306 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1019/2064] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:54:33 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:33.204378 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94a8e8-9eec-4a7f-b9fd-86b76f4ddbec admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:33.283663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:33.298840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-08b5b25c-f0c3-4ade-8ef6-1ebdafab86f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc8895257b064c5dafd5a756473fd31c', 'request_id': 'req-08b5b25c-f0c3-4ade-8ef6-1ebdafab86f8'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:33.333275 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-08b5b25c-f0c3-4ade-8ef6-1ebdafab86f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc8895257b064c5dafd5a756473fd31c', 'request_id': 'req-08b5b25c-f0c3-4ade-8ef6-1ebdafab86f8'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:33.353573 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94a8e8-9eec-4a7f-b9fd-86b76f4ddbec admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:33.358859 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-08b5b25c-f0c3-4ade-8ef6-1ebdafab86f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc8895257b064c5dafd5a756473fd31c', 'request_id': 'req-08b5b25c-f0c3-4ade-8ef6-1ebdafab86f8'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:33.401010 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-08b5b25c-f0c3-4ade-8ef6-1ebdafab86f8 admin admin] The token cache is being invalidate because project cc8895257b064c5dafd5a756473fd31c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:54:33.401330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-08b5b25c-f0c3-4ade-8ef6-1ebdafab86f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:33.405053 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-08b5b25c-f0c3-4ade-8ef6-1ebdafab86f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:33.412199 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1046/2065] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:54:33 2022] DELETE /identity/v3/projects/cc8895257b064c5dafd5a756473fd31c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:33.413218 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5b25c-f0c3-4ade-8ef6-1ebdafab86f8 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:33.423498 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-08b5b25c-f0c3-4ade-8ef6-1ebdafab86f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:33.541370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d045dfd-fe6a-4bfc-8a65-63cff1cd1c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:33.543673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d045dfd-fe6a-4bfc-8a65-63cff1cd1c29 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:33.544265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d045dfd-fe6a-4bfc-8a65-63cff1cd1c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:33.549542 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d045dfd-fe6a-4bfc-8a65-63cff1cd1c29 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:33.551926 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d045dfd-fe6a-4bfc-8a65-63cff1cd1c29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:33.560258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d045dfd-fe6a-4bfc-8a65-63cff1cd1c29 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:33.628205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5b25c-f0c3-4ade-8ef6-1ebdafab86f8 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:33.666538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df9ef0-1889-44c5-9ac9-46e0fe696f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:33.667577 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df9ef0-1889-44c5-9ac9-46e0fe696f9c admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:33.668002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df9ef0-1889-44c5-9ac9-46e0fe696f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:33.668530 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df9ef0-1889-44c5-9ac9-46e0fe696f9c admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:33.672187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df9ef0-1889-44c5-9ac9-46e0fe696f9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:33.673399 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1020/2066] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:54:33 2022] POST /identity/v3/projects => generated 401 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:33.675260 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df9ef0-1889-44c5-9ac9-46e0fe696f9c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:33.678812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5961d-e5bc-4116-b724-82ebb4aa20fe None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:33.679820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5961d-e5bc-4116-b724-82ebb4aa20fe None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:33.680255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5961d-e5bc-4116-b724-82ebb4aa20fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:33.751040 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1047/2067] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:54:33 2022] POST /identity/v3/users => generated 288 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:33.762681 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df9ef0-1889-44c5-9ac9-46e0fe696f9c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:33.763473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-bac5961d-e5bc-4116-b724-82ebb4aa20fe None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:33.769314 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-70df9ef0-1889-44c5-9ac9-46e0fe696f9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:33.770272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-bac5961d-e5bc-4116-b724-82ebb4aa20fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:33.793042 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df9ef0-1889-44c5-9ac9-46e0fe696f9c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:33.941990 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4882f32-16f9-46bf-8522-a01a7b65570d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:33.943026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4882f32-16f9-46bf-8522-a01a7b65570d admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:33.943311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4882f32-16f9-46bf-8522-a01a7b65570d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:33.943591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4882f32-16f9-46bf-8522-a01a7b65570d admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:33.944228 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4882f32-16f9-46bf-8522-a01a7b65570d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:33.948723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4882f32-16f9-46bf-8522-a01a7b65570d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:33.974633 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1021/2068] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:33.974633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5961d-e5bc-4116-b724-82ebb4aa20fe None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:33.991729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5961d-e5bc-4116-b724-82ebb4aa20fe None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:34.010377 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1048/2069] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:54:33 2022] POST /identity/v3/users => generated 301 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:34.018608 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac3963-137d-4402-ac61-8aa890b4e26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:34.019217 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e730ff-3015-4f73-b3a3-4f0f6ae87181 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:34.019606 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e730ff-3015-4f73-b3a3-4f0f6ae87181 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:34.020047 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e730ff-3015-4f73-b3a3-4f0f6ae87181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:34.023822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac3963-137d-4402-ac61-8aa890b4e26a admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:34.024160 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac3963-137d-4402-ac61-8aa890b4e26a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:34.030097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac3963-137d-4402-ac61-8aa890b4e26a admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:34.030853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac3963-137d-4402-ac61-8aa890b4e26a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:34.032557 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac3963-137d-4402-ac61-8aa890b4e26a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:34.079050 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1022/2070] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:33 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:34.080250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac3963-137d-4402-ac61-8aa890b4e26a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:34.109965 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-60e730ff-3015-4f73-b3a3-4f0f6ae87181 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:34.111208 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-60e730ff-3015-4f73-b3a3-4f0f6ae87181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:34.114698 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac3963-137d-4402-ac61-8aa890b4e26a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:34.124621 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ceeac-e669-46fb-a50c-0e59cf473316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:34.125281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ceeac-e669-46fb-a50c-0e59cf473316 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:34.125506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ceeac-e669-46fb-a50c-0e59cf473316 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:34.125778 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ceeac-e669-46fb-a50c-0e59cf473316 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:34.126433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ceeac-e669-46fb-a50c-0e59cf473316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:34.128720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ceeac-e669-46fb-a50c-0e59cf473316 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:34.133577 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1049/2071] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:34.134508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e730ff-3015-4f73-b3a3-4f0f6ae87181 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:34.141368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=7 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:34.157861 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1023/2072] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:34.159048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ceeac-e669-46fb-a50c-0e59cf473316 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:34.173265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e730ff-3015-4f73-b3a3-4f0f6ae87181 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:34.175501 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ceeac-e669-46fb-a50c-0e59cf473316 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:34.187867 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df1cfc-e27f-4ea5-83c0-e29bf1300f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:34.189410 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df1cfc-e27f-4ea5-83c0-e29bf1300f5a admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:34.190563 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df1cfc-e27f-4ea5-83c0-e29bf1300f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:34.190924 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df1cfc-e27f-4ea5-83c0-e29bf1300f5a admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:34.191575 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df1cfc-e27f-4ea5-83c0-e29bf1300f5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:34.194290 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df1cfc-e27f-4ea5-83c0-e29bf1300f5a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:34.194419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e49ae-ab55-4142-8616-f827f65e08a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:34.194644 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e49ae-ab55-4142-8616-f827f65e08a7 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:34.194921 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e49ae-ab55-4142-8616-f827f65e08a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:34.195189 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e49ae-ab55-4142-8616-f827f65e08a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:34.196008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e49ae-ab55-4142-8616-f827f65e08a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:54:34.196413 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e49ae-ab55-4142-8616-f827f65e08a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:34.198355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e49ae-ab55-4142-8616-f827f65e08a7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:34.216254 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1050/2073] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:34.218496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df1cfc-e27f-4ea5-83c0-e29bf1300f5a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:34.220744 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1024/2074] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:54:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:54:34.220744 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e49ae-ab55-4142-8616-f827f65e08a7 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:34.236837 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e49ae-ab55-4142-8616-f827f65e08a7 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:34.239144 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df1cfc-e27f-4ea5-83c0-e29bf1300f5a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:34.245046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116456ae-1d20-4f29-9ff9-54d63a0eefa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:34.245705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116456ae-1d20-4f29-9ff9-54d63a0eefa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:34.245978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116456ae-1d20-4f29-9ff9-54d63a0eefa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:34.246247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116456ae-1d20-4f29-9ff9-54d63a0eefa2 admin admin] PATH_INFO: `/v3/projects/c0a3acd485194fe3b0a09906d9b70a8f/users/37fc74ce20894de3a3af50802f384ff0/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:34.250832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce1365-084d-4eef-b6e5-59efc1cd7964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:34.251733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce1365-084d-4eef-b6e5-59efc1cd7964 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:34.252726 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce1365-084d-4eef-b6e5-59efc1cd7964 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:34.254395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce1365-084d-4eef-b6e5-59efc1cd7964 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:34.255841 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce1365-084d-4eef-b6e5-59efc1cd7964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:34.258186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce1365-084d-4eef-b6e5-59efc1cd7964 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:34.262996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116456ae-1d20-4f29-9ff9-54d63a0eefa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0a3acd485194fe3b0a09906d9b70a8f, user_id=37fc74ce20894de3a3af50802f384ff0, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:34.267297 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116456ae-1d20-4f29-9ff9-54d63a0eefa2 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:34.289438 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1025/2075] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:34 2022] PUT /identity/v3/projects/c0a3acd485194fe3b0a09906d9b70a8f/users/37fc74ce20894de3a3af50802f384ff0/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:34.290271 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116456ae-1d20-4f29-9ff9-54d63a0eefa2 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:34.301230 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:34.312508 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1051/2076] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:34.319643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce1365-084d-4eef-b6e5-59efc1cd7964 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:34.359118 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce1365-084d-4eef-b6e5-59efc1cd7964 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:34.386887 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116456ae-1d20-4f29-9ff9-54d63a0eefa2 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:34.393809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7183ee5-fe67-460e-b389-dc16de4f5ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:34.394628 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7183ee5-fe67-460e-b389-dc16de4f5ff9 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:34.394971 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7183ee5-fe67-460e-b389-dc16de4f5ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:34.395289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7183ee5-fe67-460e-b389-dc16de4f5ff9 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:34.396806 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7183ee5-fe67-460e-b389-dc16de4f5ff9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:34.400284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7183ee5-fe67-460e-b389-dc16de4f5ff9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:34.447084 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1026/2077] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:54:34 2022] POST /identity/v3/projects => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:34.449736 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe319c-272f-4e48-b82d-18587e946cb6 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:34.450112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe319c-272f-4e48-b82d-18587e946cb6 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:34.450386 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe319c-272f-4e48-b82d-18587e946cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:34.497469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-3abe319c-272f-4e48-b82d-18587e946cb6 None None] MFA Rules not processed for user `37fc74ce20894de3a3af50802f384ff0`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:34.502848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3abe319c-272f-4e48-b82d-18587e946cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:34.537808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c664fb-cb47-4664-a3a0-d49921b1b6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:34.540963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c664fb-cb47-4664-a3a0-d49921b1b6a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:34.543151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c664fb-cb47-4664-a3a0-d49921b1b6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:34.544394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c664fb-cb47-4664-a3a0-d49921b1b6a7 admin admin] PATH_INFO: `/v3/projects/01e4e5b3804648cbbc3c48b5626a6208/users/5683a6991a8641bdb4323810e36a639a/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:34.598425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c664fb-cb47-4664-a3a0-d49921b1b6a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01e4e5b3804648cbbc3c48b5626a6208, user_id=5683a6991a8641bdb4323810e36a639a, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:34.602588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c664fb-cb47-4664-a3a0-d49921b1b6a7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:34.625184 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1052/2078] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:34 2022] PUT /identity/v3/projects/01e4e5b3804648cbbc3c48b5626a6208/users/5683a6991a8641bdb4323810e36a639a/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:34.626253 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c664fb-cb47-4664-a3a0-d49921b1b6a7 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:34.691196 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1027/2079] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:34.692685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cabae9-de50-4159-9707-78ffc0334b93 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:34.693052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cabae9-de50-4159-9707-78ffc0334b93 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:34.693511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cabae9-de50-4159-9707-78ffc0334b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:34.739792 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-98cabae9-de50-4159-9707-78ffc0334b93 None None] MFA Rules not processed for user `5683a6991a8641bdb4323810e36a639a`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:34.741631 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-98cabae9-de50-4159-9707-78ffc0334b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:34.781606 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c664fb-cb47-4664-a3a0-d49921b1b6a7 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:34.799600 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293c858-7718-4407-8d30-fab812ea1b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:34.800417 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293c858-7718-4407-8d30-fab812ea1b59 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:34.800979 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293c858-7718-4407-8d30-fab812ea1b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:34.801396 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293c858-7718-4407-8d30-fab812ea1b59 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:34.802759 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293c858-7718-4407-8d30-fab812ea1b59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:34.806987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293c858-7718-4407-8d30-fab812ea1b59 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:34.864923 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1053/2080] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:54:34 2022] POST /identity/v3/users => generated 291 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:34.867464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293c858-7718-4407-8d30-fab812ea1b59 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:34.897787 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1028/2081] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:34 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:34.899533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cabae9-de50-4159-9707-78ffc0334b93 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:34.901345 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293c858-7718-4407-8d30-fab812ea1b59 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:34.909470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e9662-0289-4d9b-a973-e10f77a18385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:34.910860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e9662-0289-4d9b-a973-e10f77a18385 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:34.911451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e9662-0289-4d9b-a973-e10f77a18385 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:34.911985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e9662-0289-4d9b-a973-e10f77a18385 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:34.914838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e9662-0289-4d9b-a973-e10f77a18385 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:34.918398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e9662-0289-4d9b-a973-e10f77a18385 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:34.921109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cabae9-de50-4159-9707-78ffc0334b93 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:34.926743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c033f-2605-44dd-b2ac-fd9d66c0c42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:34.927363 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c033f-2605-44dd-b2ac-fd9d66c0c42d admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:34.927645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c033f-2605-44dd-b2ac-fd9d66c0c42d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:34.927921 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c033f-2605-44dd-b2ac-fd9d66c0c42d admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:34.929214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c033f-2605-44dd-b2ac-fd9d66c0c42d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:34.931237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c033f-2605-44dd-b2ac-fd9d66c0c42d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:34.938650 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:34.951878 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1029/2082] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:34.953445 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c033f-2605-44dd-b2ac-fd9d66c0c42d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:34.971956 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c033f-2605-44dd-b2ac-fd9d66c0c42d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:34.978446 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff46e9-c2e5-4d21-865e-5a45524b933f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:34.979086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff46e9-c2e5-4d21-865e-5a45524b933f admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:34.979487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff46e9-c2e5-4d21-865e-5a45524b933f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:34.979694 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1054/2083] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:54:34 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:34.979794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff46e9-c2e5-4d21-865e-5a45524b933f admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:34.980443 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff46e9-c2e5-4d21-865e-5a45524b933f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:34.981252 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e9662-0289-4d9b-a973-e10f77a18385 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:34.983220 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff46e9-c2e5-4d21-865e-5a45524b933f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:35.071868 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:35.093388 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1030/2084] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:54:34 2022] POST /identity/v3/projects => generated 401 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:35.100945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff46e9-c2e5-4d21-865e-5a45524b933f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:35.128876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e9662-0289-4d9b-a973-e10f77a18385 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:35.252919 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0883a-8275-49bf-bbe8-b129b2b6c624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:35.252919 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0883a-8275-49bf-bbe8-b129b2b6c624 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:35.252919 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0883a-8275-49bf-bbe8-b129b2b6c624 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:35.253290 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0883a-8275-49bf-bbe8-b129b2b6c624 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:35.253696 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0883a-8275-49bf-bbe8-b129b2b6c624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:35.255337 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0883a-8275-49bf-bbe8-b129b2b6c624 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:35.292689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff46e9-c2e5-4d21-865e-5a45524b933f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:35.293777 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1055/2085] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:35.294992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0883a-8275-49bf-bbe8-b129b2b6c624 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:35.306025 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31025b14-2b61-4e5d-a681-16e469b4986e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:35.307800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31025b14-2b61-4e5d-a681-16e469b4986e admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:35.307800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31025b14-2b61-4e5d-a681-16e469b4986e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:35.308922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31025b14-2b61-4e5d-a681-16e469b4986e admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:35.310794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31025b14-2b61-4e5d-a681-16e469b4986e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:35.316552 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31025b14-2b61-4e5d-a681-16e469b4986e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:35.328049 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0883a-8275-49bf-bbe8-b129b2b6c624 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:35.342435 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8240f-0916-4dd2-9992-43b8da5b7f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:35.343135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8240f-0916-4dd2-9992-43b8da5b7f20 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:35.343411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8240f-0916-4dd2-9992-43b8da5b7f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:35.343678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8240f-0916-4dd2-9992-43b8da5b7f20 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:35.344305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8240f-0916-4dd2-9992-43b8da5b7f20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:35.348080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8240f-0916-4dd2-9992-43b8da5b7f20 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:35.371893 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1031/2086] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:54:35 2022] POST /identity/v3/users => generated 294 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:35.373617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31025b14-2b61-4e5d-a681-16e469b4986e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:35.415106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31025b14-2b61-4e5d-a681-16e469b4986e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:35.425577 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1056/2087] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:54:35 2022] POST /identity/v3/users => generated 307 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:35.427850 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8240f-0916-4dd2-9992-43b8da5b7f20 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:35.437668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a92f7-bdfd-48eb-8645-8d4ad3a8fc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:35.440106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a92f7-bdfd-48eb-8645-8d4ad3a8fc4e admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:35.440958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a92f7-bdfd-48eb-8645-8d4ad3a8fc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:35.442088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a92f7-bdfd-48eb-8645-8d4ad3a8fc4e admin admin] PATH_INFO: `/v3/projects/bce715ea78b24df486930bff86ded06e/users/b5bf47f4cae74970b2919507cf7ccaf0/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:35.465298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8240f-0916-4dd2-9992-43b8da5b7f20 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:35.483127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e2e7d-607e-4bbb-958c-6e3ae2592bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:35.484942 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e2e7d-607e-4bbb-958c-6e3ae2592bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:35.485809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e2e7d-607e-4bbb-958c-6e3ae2592bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:35.487267 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e2e7d-607e-4bbb-958c-6e3ae2592bd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:35.489368 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a92f7-bdfd-48eb-8645-8d4ad3a8fc4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bce715ea78b24df486930bff86ded06e, user_id=b5bf47f4cae74970b2919507cf7ccaf0, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:35.489712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e2e7d-607e-4bbb-958c-6e3ae2592bd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:35.494771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e2e7d-607e-4bbb-958c-6e3ae2592bd5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:35.495608 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a92f7-bdfd-48eb-8645-8d4ad3a8fc4e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:35.539344 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1032/2088] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:35 2022] PUT /identity/v3/projects/bce715ea78b24df486930bff86ded06e/users/b5bf47f4cae74970b2919507cf7ccaf0/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:35.550988 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1057/2089] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:35.550988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf7663-109e-4bd7-b2d4-ca4f25e194b9 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:35.550988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf7663-109e-4bd7-b2d4-ca4f25e194b9 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:35.550988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf7663-109e-4bd7-b2d4-ca4f25e194b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:35.561447 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a92f7-bdfd-48eb-8645-8d4ad3a8fc4e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:35.624749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-73cf7663-109e-4bd7-b2d4-ca4f25e194b9 None None] MFA Rules not processed for user `b5bf47f4cae74970b2919507cf7ccaf0`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:35.626147 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-73cf7663-109e-4bd7-b2d4-ca4f25e194b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:35.688922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a92f7-bdfd-48eb-8645-8d4ad3a8fc4e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:35.698510 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8aed1a-a206-4dc4-b9c6-a6c5c91cf00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:35.699161 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8aed1a-a206-4dc4-b9c6-a6c5c91cf00a admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:35.699402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8aed1a-a206-4dc4-b9c6-a6c5c91cf00a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:35.699671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8aed1a-a206-4dc4-b9c6-a6c5c91cf00a admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:35.702139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8aed1a-a206-4dc4-b9c6-a6c5c91cf00a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:35.703946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8aed1a-a206-4dc4-b9c6-a6c5c91cf00a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:35.732563 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1033/2090] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:35.732563 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8aed1a-a206-4dc4-b9c6-a6c5c91cf00a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:35.749189 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8aed1a-a206-4dc4-b9c6-a6c5c91cf00a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:35.755275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925cf28-eeea-48f6-9de7-b68226d7564a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:35.756159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925cf28-eeea-48f6-9de7-b68226d7564a admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:35.756523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925cf28-eeea-48f6-9de7-b68226d7564a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:35.756864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925cf28-eeea-48f6-9de7-b68226d7564a admin admin] PATH_INFO: `/v3/projects/2b74786c1e2a4635b3b3f31324ee3b50/users/dd90a1cabe614560ace218d791aec65c/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:35.784983 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925cf28-eeea-48f6-9de7-b68226d7564a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b74786c1e2a4635b3b3f31324ee3b50, user_id=dd90a1cabe614560ace218d791aec65c, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:35.788224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925cf28-eeea-48f6-9de7-b68226d7564a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:35.816067 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1058/2092] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:35.818912 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf7663-109e-4bd7-b2d4-ca4f25e194b9 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:35.819158 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1034/2092] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:35 2022] PUT /identity/v3/projects/2b74786c1e2a4635b3b3f31324ee3b50/users/dd90a1cabe614560ace218d791aec65c/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:35.820692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925cf28-eeea-48f6-9de7-b68226d7564a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:35.842486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf7663-109e-4bd7-b2d4-ca4f25e194b9 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:35.870702 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:35.930062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:35.967404 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925cf28-eeea-48f6-9de7-b68226d7564a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:35.972508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a03e8-7214-4c3d-ac72-489a26efb57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:35.973124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a03e8-7214-4c3d-ac72-489a26efb57f admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:35.973401 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a03e8-7214-4c3d-ac72-489a26efb57f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:35.973674 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a03e8-7214-4c3d-ac72-489a26efb57f admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:35.974323 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a03e8-7214-4c3d-ac72-489a26efb57f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:35.976002 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a03e8-7214-4c3d-ac72-489a26efb57f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:35.978376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d4d2d-f38c-47b4-b773-beef97919195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:35.979981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d4d2d-f38c-47b4-b773-beef97919195 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:35.979981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d4d2d-f38c-47b4-b773-beef97919195 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:35.979981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d4d2d-f38c-47b4-b773-beef97919195 admin admin] PATH_INFO: `/v3/projects/7c93a6f252254280940f10102ac1b6e3/users/a0c67ba464e44b22a289a7946ab3ca05/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:36.002950 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1035/2093] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:36.003438 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a03e8-7214-4c3d-ac72-489a26efb57f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:36.010998 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d4d2d-f38c-47b4-b773-beef97919195 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c93a6f252254280940f10102ac1b6e3, user_id=a0c67ba464e44b22a289a7946ab3ca05, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:36.016273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d4d2d-f38c-47b4-b773-beef97919195 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:36.031376 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a03e8-7214-4c3d-ac72-489a26efb57f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:36.040671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8e685-f476-48ef-8e7e-5e3a3d181931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:36.040892 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1059/2094] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:35 2022] PUT /identity/v3/projects/7c93a6f252254280940f10102ac1b6e3/users/a0c67ba464e44b22a289a7946ab3ca05/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:36.041296 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8e685-f476-48ef-8e7e-5e3a3d181931 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:36.041571 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8e685-f476-48ef-8e7e-5e3a3d181931 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:36.041685 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d4d2d-f38c-47b4-b773-beef97919195 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:36.041883 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8e685-f476-48ef-8e7e-5e3a3d181931 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:36.042461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8e685-f476-48ef-8e7e-5e3a3d181931 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:36.045393 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8e685-f476-48ef-8e7e-5e3a3d181931 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:36.105887 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1036/2095] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:54:36 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:36.107521 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8e685-f476-48ef-8e7e-5e3a3d181931 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:36.156980 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d4d2d-f38c-47b4-b773-beef97919195 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:36.242604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8e685-f476-48ef-8e7e-5e3a3d181931 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:36.249364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a43855-3845-40b0-93a8-99f607d7cf64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:36.250046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a43855-3845-40b0-93a8-99f607d7cf64 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:36.250331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a43855-3845-40b0-93a8-99f607d7cf64 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:36.250681 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a43855-3845-40b0-93a8-99f607d7cf64 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:36.251305 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a43855-3845-40b0-93a8-99f607d7cf64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:36.254762 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a43855-3845-40b0-93a8-99f607d7cf64 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:36.277582 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1037/2096] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:36.278512 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a43855-3845-40b0-93a8-99f607d7cf64 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:36.305958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a43855-3845-40b0-93a8-99f607d7cf64 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:36.321433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8008820-f658-4901-ad65-5827d225a408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:36.322070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8008820-f658-4901-ad65-5827d225a408 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:36.322352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8008820-f658-4901-ad65-5827d225a408 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:36.322655 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8008820-f658-4901-ad65-5827d225a408 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:36.323286 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8008820-f658-4901-ad65-5827d225a408 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:36.328123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8008820-f658-4901-ad65-5827d225a408 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:36.350964 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffba7d-8cbe-4966-888b-a1dcfa776661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:36.356654 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffba7d-8cbe-4966-888b-a1dcfa776661 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:36.357852 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1038/2097] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:54:36 2022] POST /identity/v3/users => generated 297 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:36.358992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8008820-f658-4901-ad65-5827d225a408 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:36.359352 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffba7d-8cbe-4966-888b-a1dcfa776661 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:36.360675 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffba7d-8cbe-4966-888b-a1dcfa776661 admin admin] PATH_INFO: `/v3/projects/2b74786c1e2a4635b3b3f31324ee3b50/users/dd90a1cabe614560ace218d791aec65c/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:36.369451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ffba7d-8cbe-4966-888b-a1dcfa776661 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b74786c1e2a4635b3b3f31324ee3b50, user_id=dd90a1cabe614560ace218d791aec65c, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:36.373338 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8008820-f658-4901-ad65-5827d225a408 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:36.377322 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ffba7d-8cbe-4966-888b-a1dcfa776661 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:36.383050 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb805d-f127-4558-8aa6-f0d3a5840854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:36.385631 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb805d-f127-4558-8aa6-f0d3a5840854 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:36.386032 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb805d-f127-4558-8aa6-f0d3a5840854 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:36.386417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb805d-f127-4558-8aa6-f0d3a5840854 admin admin] PATH_INFO: `/v3/projects/7c93a6f252254280940f10102ac1b6e3/users/a0c67ba464e44b22a289a7946ab3ca05/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:36.392989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb805d-f127-4558-8aa6-f0d3a5840854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c93a6f252254280940f10102ac1b6e3, user_id=a0c67ba464e44b22a289a7946ab3ca05, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:36.397145 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1060/2098] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:36 2022] PUT /identity/v3/projects/2b74786c1e2a4635b3b3f31324ee3b50/users/dd90a1cabe614560ace218d791aec65c/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:36.400378 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb805d-f127-4558-8aa6-f0d3a5840854 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:36.410065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffba7d-8cbe-4966-888b-a1dcfa776661 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:36.426441 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1039/2099] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:36 2022] PUT /identity/v3/projects/7c93a6f252254280940f10102ac1b6e3/users/a0c67ba464e44b22a289a7946ab3ca05/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:36.427763 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3017ddf-8719-4216-bdc7-5f597e69c9a9 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:36.432280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3017ddf-8719-4216-bdc7-5f597e69c9a9 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:36.432589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3017ddf-8719-4216-bdc7-5f597e69c9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:36.492470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-c3017ddf-8719-4216-bdc7-5f597e69c9a9 None None] MFA Rules not processed for user `dd90a1cabe614560ace218d791aec65c`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:36.493759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c3017ddf-8719-4216-bdc7-5f597e69c9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:36.553195 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffba7d-8cbe-4966-888b-a1dcfa776661 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:36.564367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:36.586373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:36.649362 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1040/2100] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:36.651396 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f344624-2300-438f-bcb6-126c61002cb0 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:36.651912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f344624-2300-438f-bcb6-126c61002cb0 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:36.652341 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f344624-2300-438f-bcb6-126c61002cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:36.708220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29ce01-7c70-4eb2-9e92-0bdf18e74260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:36.709151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29ce01-7c70-4eb2-9e92-0bdf18e74260 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:36.709580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29ce01-7c70-4eb2-9e92-0bdf18e74260 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:36.710309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29ce01-7c70-4eb2-9e92-0bdf18e74260 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:36.711295 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29ce01-7c70-4eb2-9e92-0bdf18e74260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:36.713259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29ce01-7c70-4eb2-9e92-0bdf18e74260 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:36.736954 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1061/2101] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:36.738757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29ce01-7c70-4eb2-9e92-0bdf18e74260 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:36.741569 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-cf29ce01-7c70-4eb2-9e92-0bdf18e74260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:36.742662 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-6f344624-2300-438f-bcb6-126c61002cb0 None None] MFA Rules not processed for user `a0c67ba464e44b22a289a7946ab3ca05`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:36.746379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6f344624-2300-438f-bcb6-126c61002cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:36.867518 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29ce01-7c70-4eb2-9e92-0bdf18e74260 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:36.883658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d68da-c0d9-4c96-915d-25a40323d525 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:36.884592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d68da-c0d9-4c96-915d-25a40323d525 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:36.885035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d68da-c0d9-4c96-915d-25a40323d525 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:36.885473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d68da-c0d9-4c96-915d-25a40323d525 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:36.896579 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d68da-c0d9-4c96-915d-25a40323d525 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:36.898504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d68da-c0d9-4c96-915d-25a40323d525 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:36.913876 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1062/2102] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:36 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:36.915320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d68da-c0d9-4c96-915d-25a40323d525 service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:36.917738 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1041/2103] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:36 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:36.932531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d68da-c0d9-4c96-915d-25a40323d525 service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:36.940209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d371e9-5e18-454a-839a-c3432322f08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:36.941287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d371e9-5e18-454a-839a-c3432322f08e admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:36.943024 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d371e9-5e18-454a-839a-c3432322f08e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:36.943671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d371e9-5e18-454a-839a-c3432322f08e admin admin] PATH_INFO: `/v3/projects/4d0b7a5aedc349458c1e2d192aadb549/users/c26ac98bae9e400184eb95f0899f5d79/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:36.967462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d371e9-5e18-454a-839a-c3432322f08e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d0b7a5aedc349458c1e2d192aadb549, user_id=c26ac98bae9e400184eb95f0899f5d79, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:36.970824 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d371e9-5e18-454a-839a-c3432322f08e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:37.000328 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1063/2104] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:36 2022] PUT /identity/v3/projects/4d0b7a5aedc349458c1e2d192aadb549/users/c26ac98bae9e400184eb95f0899f5d79/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:37.004259 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f344624-2300-438f-bcb6-126c61002cb0 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:37.016162 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f344624-2300-438f-bcb6-126c61002cb0 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:37.098011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2e36d-571d-4c4e-b6f4-df7e77f32c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:37.099139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2e36d-571d-4c4e-b6f4-df7e77f32c61 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:37.100257 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2e36d-571d-4c4e-b6f4-df7e77f32c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:37.100735 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2e36d-571d-4c4e-b6f4-df7e77f32c61 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:37.101700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2e36d-571d-4c4e-b6f4-df7e77f32c61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:37.104194 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2e36d-571d-4c4e-b6f4-df7e77f32c61 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:37.119985 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1042/2105] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:37.125352 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d371e9-5e18-454a-839a-c3432322f08e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:37.140409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d371e9-5e18-454a-839a-c3432322f08e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:37.147062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654c80b-9b85-45b1-8433-b5d4fe75c5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:37.148268 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654c80b-9b85-45b1-8433-b5d4fe75c5a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:37.148784 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654c80b-9b85-45b1-8433-b5d4fe75c5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:37.149277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654c80b-9b85-45b1-8433-b5d4fe75c5a9 admin admin] PATH_INFO: `/v3/projects/4d0b7a5aedc349458c1e2d192aadb549/users/c26ac98bae9e400184eb95f0899f5d79/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:37.152567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1654c80b-9b85-45b1-8433-b5d4fe75c5a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d0b7a5aedc349458c1e2d192aadb549, user_id=c26ac98bae9e400184eb95f0899f5d79, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:37.157115 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1654c80b-9b85-45b1-8433-b5d4fe75c5a9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:37.186318 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1064/2106] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:37 2022] PUT /identity/v3/projects/4d0b7a5aedc349458c1e2d192aadb549/users/c26ac98bae9e400184eb95f0899f5d79/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:37.196749 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7b95e-d748-4f07-8eed-309e84231269 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:37.197044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7b95e-d748-4f07-8eed-309e84231269 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:37.197323 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7b95e-d748-4f07-8eed-309e84231269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:37.239525 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-44a7b95e-d748-4f07-8eed-309e84231269 None None] MFA Rules not processed for user `c26ac98bae9e400184eb95f0899f5d79`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:37.242350 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-44a7b95e-d748-4f07-8eed-309e84231269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:37.299746 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:37.329614 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1043/2107] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:37 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:37.630672 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654c80b-9b85-45b1-8433-b5d4fe75c5a9 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:37.814966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7b95e-d748-4f07-8eed-309e84231269 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:37.816521 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-44a7b95e-d748-4f07-8eed-309e84231269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:37.838979 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:37.889148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654c80b-9b85-45b1-8433-b5d4fe75c5a9 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:37.898647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d7847-b5b9-45b9-aec3-1f04b762e9a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:37.899273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d7847-b5b9-45b9-aec3-1f04b762e9a8 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:37.899615 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d7847-b5b9-45b9-aec3-1f04b762e9a8 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:37.899952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d7847-b5b9-45b9-aec3-1f04b762e9a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:38.036025 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7b95e-d748-4f07-8eed-309e84231269 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:38.051719 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5c0dd-20d7-43a6-9a33-606d5bf84c60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:38.053232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5c0dd-20d7-43a6-9a33-606d5bf84c60 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:38.053670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5c0dd-20d7-43a6-9a33-606d5bf84c60 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:38.054087 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5c0dd-20d7-43a6-9a33-606d5bf84c60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:38.054718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d7847-b5b9-45b9-aec3-1f04b762e9a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:38.056591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d7847-b5b9-45b9-aec3-1f04b762e9a8 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:38.081218 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1065/2108] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:37 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:38.213603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d7847-b5b9-45b9-aec3-1f04b762e9a8 service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:38.223867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5c0dd-20d7-43a6-9a33-606d5bf84c60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:38.225506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5c0dd-20d7-43a6-9a33-606d5bf84c60 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:38.233656 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d7847-b5b9-45b9-aec3-1f04b762e9a8 service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:38.248386 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d383263-66d5-4702-b6fc-c1c7f91832be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:38.248839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d383263-66d5-4702-b6fc-c1c7f91832be service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:38.249119 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d383263-66d5-4702-b6fc-c1c7f91832be service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:38.249463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d383263-66d5-4702-b6fc-c1c7f91832be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:38.255083 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1044/2109] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:54:38.275474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5c0dd-20d7-43a6-9a33-606d5bf84c60 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:38.390157 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d383263-66d5-4702-b6fc-c1c7f91832be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:38.394923 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d383263-66d5-4702-b6fc-c1c7f91832be service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:38.423669 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1066/2110] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:38 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:38.438427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5c0dd-20d7-43a6-9a33-606d5bf84c60 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:38.445168 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ec14a-2228-428f-a2c4-3aeb918d7e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:38.446506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ec14a-2228-428f-a2c4-3aeb918d7e2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:38.446922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ec14a-2228-428f-a2c4-3aeb918d7e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:38.447324 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ec14a-2228-428f-a2c4-3aeb918d7e2a admin admin] PATH_INFO: `/v3/users/b5bf47f4cae74970b2919507cf7ccaf0` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:38.448724 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ec14a-2228-428f-a2c4-3aeb918d7e2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5bf47f4cae74970b2919507cf7ccaf0)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:38.452032 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ec14a-2228-428f-a2c4-3aeb918d7e2a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:38.520257 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:38.568147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a52ec14a-2228-428f-a2c4-3aeb918d7e2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5bf47f4cae74970b2919507cf7ccaf0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:38.569013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a52ec14a-2228-428f-a2c4-3aeb918d7e2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5bf47f4cae74970b2919507cf7ccaf0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:38.573305 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a52ec14a-2228-428f-a2c4-3aeb918d7e2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5bf47f4cae74970b2919507cf7ccaf0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:38.597147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a52ec14a-2228-428f-a2c4-3aeb918d7e2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5bf47f4cae74970b2919507cf7ccaf0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:38.666513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a52ec14a-2228-428f-a2c4-3aeb918d7e2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5bf47f4cae74970b2919507cf7ccaf0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:38.713174 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1045/2111] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:54:38 2022] DELETE /identity/v3/users/b5bf47f4cae74970b2919507cf7ccaf0 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:54:38.718279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5ad32-ca55-4f8f-90c2-f275810a6e03 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:38.718668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5ad32-ca55-4f8f-90c2-f275810a6e03 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:38.719016 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5ad32-ca55-4f8f-90c2-f275810a6e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:38.756295 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-17a5ad32-ca55-4f8f-90c2-f275810a6e03 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:38.757585 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-17a5ad32-ca55-4f8f-90c2-f275810a6e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:38.892589 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1067/2112] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:38.915734 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ec14a-2228-428f-a2c4-3aeb918d7e2a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:38.917257 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a52ec14a-2228-428f-a2c4-3aeb918d7e2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:38.990089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ec14a-2228-428f-a2c4-3aeb918d7e2a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:38.993901 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa21f35-79e3-4189-af87-4d7a3925f692 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:38.994667 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa21f35-79e3-4189-af87-4d7a3925f692 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:38.994943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa21f35-79e3-4189-af87-4d7a3925f692 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:38.995212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa21f35-79e3-4189-af87-4d7a3925f692 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:39.005708 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa21f35-79e3-4189-af87-4d7a3925f692 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:39.017310 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa21f35-79e3-4189-af87-4d7a3925f692 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:39.031053 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1046/2113] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:39.287876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2104b-09c1-4056-841a-0273c723c24b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:39.288272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2104b-09c1-4056-841a-0273c723c24b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:39.288552 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2104b-09c1-4056-841a-0273c723c24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:39.363648 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-3ae2104b-09c1-4056-841a-0273c723c24b None None] MFA Rules not processed for user `d5df8df0714242c68a5a51614d23a144`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:39.365487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3ae2104b-09c1-4056-841a-0273c723c24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:39.396939 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:39.565918 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1068/2114] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:39 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:39.568376 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664af776-4243-4fa6-b01a-5e46044ff1cb None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:39.568765 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664af776-4243-4fa6-b01a-5e46044ff1cb None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:39.569039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664af776-4243-4fa6-b01a-5e46044ff1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:39.608194 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-664af776-4243-4fa6-b01a-5e46044ff1cb None None] MFA Rules not processed for user `343f309c07e343b4b15268472d19f10c`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:39.610867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-664af776-4243-4fa6-b01a-5e46044ff1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:39.753272 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1047/2115] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:39 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:39.805432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2104b-09c1-4056-841a-0273c723c24b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:39.807198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3ae2104b-09c1-4056-841a-0273c723c24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:39.889750 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664af776-4243-4fa6-b01a-5e46044ff1cb None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:39.892232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-664af776-4243-4fa6-b01a-5e46044ff1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:39.932213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664af776-4243-4fa6-b01a-5e46044ff1cb None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:39.946359 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c167df-f5f1-4506-a818-10441ad3aa8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:39.947679 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c167df-f5f1-4506-a818-10441ad3aa8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:39.948732 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c167df-f5f1-4506-a818-10441ad3aa8a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:39.949016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c167df-f5f1-4506-a818-10441ad3aa8a admin admin] PATH_INFO: `/v3/users/5683a6991a8641bdb4323810e36a639a` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:39.952401 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c167df-f5f1-4506-a818-10441ad3aa8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5683a6991a8641bdb4323810e36a639a)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:39.956337 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c167df-f5f1-4506-a818-10441ad3aa8a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:40.016815 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2104b-09c1-4056-841a-0273c723c24b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:40.036629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be931ce-a11b-413a-bbbe-14764efdcf40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:40.038045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be931ce-a11b-413a-bbbe-14764efdcf40 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:40.038744 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be931ce-a11b-413a-bbbe-14764efdcf40 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:40.038909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be931ce-a11b-413a-bbbe-14764efdcf40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:40.041898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7be931ce-a11b-413a-bbbe-14764efdcf40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:40.078430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:40.081212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d3c167df-f5f1-4506-a818-10441ad3aa8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5683a6991a8641bdb4323810e36a639a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:40.082439 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d3c167df-f5f1-4506-a818-10441ad3aa8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5683a6991a8641bdb4323810e36a639a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:40.084168 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d3c167df-f5f1-4506-a818-10441ad3aa8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5683a6991a8641bdb4323810e36a639a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:40.090774 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be931ce-a11b-413a-bbbe-14764efdcf40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:40.093577 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be931ce-a11b-413a-bbbe-14764efdcf40 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:40.096312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d3c167df-f5f1-4506-a818-10441ad3aa8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5683a6991a8641bdb4323810e36a639a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:40.119428 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1069/2116] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:39 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:40.122880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be931ce-a11b-413a-bbbe-14764efdcf40 service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:40.127353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d3c167df-f5f1-4506-a818-10441ad3aa8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5683a6991a8641bdb4323810e36a639a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:40.127438 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7be931ce-a11b-413a-bbbe-14764efdcf40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:40.161116 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1048/2117] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:54:39 2022] DELETE /identity/v3/users/5683a6991a8641bdb4323810e36a639a => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:54:40.162197 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c167df-f5f1-4506-a818-10441ad3aa8a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:40.164672 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d3c167df-f5f1-4506-a818-10441ad3aa8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:40.164794 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be931ce-a11b-413a-bbbe-14764efdcf40 service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:40.299793 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326227a6-1d8b-482c-a86f-6cee9b8f1858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:40.300821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326227a6-1d8b-482c-a86f-6cee9b8f1858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:40.301424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326227a6-1d8b-482c-a86f-6cee9b8f1858 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:40.302096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326227a6-1d8b-482c-a86f-6cee9b8f1858 admin admin] PATH_INFO: `/v3/projects/bce715ea78b24df486930bff86ded06e` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:40.303765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326227a6-1d8b-482c-a86f-6cee9b8f1858 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bce715ea78b24df486930bff86ded06e)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:40.306488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326227a6-1d8b-482c-a86f-6cee9b8f1858 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:40.359068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c167df-f5f1-4506-a818-10441ad3aa8a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:40.367239 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:40.385456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-326227a6-1d8b-482c-a86f-6cee9b8f1858 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bce715ea78b24df486930bff86ded06e', 'request_id': 'req-326227a6-1d8b-482c-a86f-6cee9b8f1858'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:40.389209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ba722-68b6-41bd-afcf-25710be9d650 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:40.392038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ba722-68b6-41bd-afcf-25710be9d650 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:40.392502 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ba722-68b6-41bd-afcf-25710be9d650 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:40.392808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ba722-68b6-41bd-afcf-25710be9d650 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:40.393944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-326227a6-1d8b-482c-a86f-6cee9b8f1858 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bce715ea78b24df486930bff86ded06e', 'request_id': 'req-326227a6-1d8b-482c-a86f-6cee9b8f1858'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:40.399416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-771ba722-68b6-41bd-afcf-25710be9d650 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:40.412858 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-326227a6-1d8b-482c-a86f-6cee9b8f1858 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bce715ea78b24df486930bff86ded06e', 'request_id': 'req-326227a6-1d8b-482c-a86f-6cee9b8f1858'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:40.430145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-326227a6-1d8b-482c-a86f-6cee9b8f1858 admin admin] The token cache is being invalidate because project bce715ea78b24df486930bff86ded06e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:54:40.431630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-326227a6-1d8b-482c-a86f-6cee9b8f1858 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:40.432952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-326227a6-1d8b-482c-a86f-6cee9b8f1858 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:40.437334 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1070/2118] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:54:40 2022] DELETE /identity/v3/projects/bce715ea78b24df486930bff86ded06e => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:40.440616 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2399a7-0fbc-4ee8-b8b9-a49fe571408c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:40.441074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2399a7-0fbc-4ee8-b8b9-a49fe571408c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:40.441916 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2399a7-0fbc-4ee8-b8b9-a49fe571408c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:40.465551 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-3c2399a7-0fbc-4ee8-b8b9-a49fe571408c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:40.467134 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3c2399a7-0fbc-4ee8-b8b9-a49fe571408c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:40.565368 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1071/2119] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:40.568983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2399a7-0fbc-4ee8-b8b9-a49fe571408c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:40.570854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3c2399a7-0fbc-4ee8-b8b9-a49fe571408c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:40.585622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ba722-68b6-41bd-afcf-25710be9d650 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:40.587423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ba722-68b6-41bd-afcf-25710be9d650 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:40.587833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2399a7-0fbc-4ee8-b8b9-a49fe571408c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:40.596401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0321e-4471-4172-be0f-1fbb7f0b22ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:40.597057 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0321e-4471-4172-be0f-1fbb7f0b22ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:40.597345 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0321e-4471-4172-be0f-1fbb7f0b22ae admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:40.597620 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0321e-4471-4172-be0f-1fbb7f0b22ae admin admin] PATH_INFO: `/v3/users/c26ac98bae9e400184eb95f0899f5d79` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:40.598799 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0321e-4471-4172-be0f-1fbb7f0b22ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=c26ac98bae9e400184eb95f0899f5d79)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:40.599877 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1049/2120] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:40.612654 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0321e-4471-4172-be0f-1fbb7f0b22ae admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:40.662882 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ba722-68b6-41bd-afcf-25710be9d650 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:40.670203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-771ba722-68b6-41bd-afcf-25710be9d650 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:40.759527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-22a0321e-4471-4172-be0f-1fbb7f0b22ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c26ac98bae9e400184eb95f0899f5d79'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:40.775215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-22a0321e-4471-4172-be0f-1fbb7f0b22ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c26ac98bae9e400184eb95f0899f5d79'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:40.780456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-22a0321e-4471-4172-be0f-1fbb7f0b22ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c26ac98bae9e400184eb95f0899f5d79'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:40.781555 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-22a0321e-4471-4172-be0f-1fbb7f0b22ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c26ac98bae9e400184eb95f0899f5d79'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:40.798165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-22a0321e-4471-4172-be0f-1fbb7f0b22ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c26ac98bae9e400184eb95f0899f5d79'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:40.846778 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ba722-68b6-41bd-afcf-25710be9d650 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:40.860549 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1072/2121] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:54:40 2022] DELETE /identity/v3/users/c26ac98bae9e400184eb95f0899f5d79 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:40.881638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:41.019668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ac117-722a-4d5c-9aa9-ae542232614e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:41.021532 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ac117-722a-4d5c-9aa9-ae542232614e service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:41.022028 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ac117-722a-4d5c-9aa9-ae542232614e service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:41.022880 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ac117-722a-4d5c-9aa9-ae542232614e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:41.029609 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-215ac117-722a-4d5c-9aa9-ae542232614e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:41.062385 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ac117-722a-4d5c-9aa9-ae542232614e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:41.064044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ac117-722a-4d5c-9aa9-ae542232614e service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:41.099038 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1050/2122] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:54:41.788304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0321e-4471-4172-be0f-1fbb7f0b22ae admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:41.788304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-22a0321e-4471-4172-be0f-1fbb7f0b22ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:41.955300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:42.007649 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0321e-4471-4172-be0f-1fbb7f0b22ae admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:42.018074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038881eb-c082-45de-9d91-6122a1f3821a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:42.018865 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038881eb-c082-45de-9d91-6122a1f3821a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:42.019273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038881eb-c082-45de-9d91-6122a1f3821a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:42.019624 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038881eb-c082-45de-9d91-6122a1f3821a admin admin] PATH_INFO: `/v3/projects/4d0b7a5aedc349458c1e2d192aadb549` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:42.021404 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038881eb-c082-45de-9d91-6122a1f3821a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d0b7a5aedc349458c1e2d192aadb549)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:42.024076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038881eb-c082-45de-9d91-6122a1f3821a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:42.145502 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-038881eb-c082-45de-9d91-6122a1f3821a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d0b7a5aedc349458c1e2d192aadb549', 'request_id': 'req-038881eb-c082-45de-9d91-6122a1f3821a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:42.164764 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-038881eb-c082-45de-9d91-6122a1f3821a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d0b7a5aedc349458c1e2d192aadb549', 'request_id': 'req-038881eb-c082-45de-9d91-6122a1f3821a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:42.182352 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-038881eb-c082-45de-9d91-6122a1f3821a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d0b7a5aedc349458c1e2d192aadb549', 'request_id': 'req-038881eb-c082-45de-9d91-6122a1f3821a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:42.213813 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-038881eb-c082-45de-9d91-6122a1f3821a admin admin] The token cache is being invalidate because project 4d0b7a5aedc349458c1e2d192aadb549 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:54:42.214263 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-038881eb-c082-45de-9d91-6122a1f3821a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:42.218690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-038881eb-c082-45de-9d91-6122a1f3821a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:42.225402 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1073/2123] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:54:41 2022] DELETE /identity/v3/projects/4d0b7a5aedc349458c1e2d192aadb549 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:42.226596 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9938e00-fedf-4513-aa9b-2e71afa86433 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:42.227064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9938e00-fedf-4513-aa9b-2e71afa86433 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:42.227491 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9938e00-fedf-4513-aa9b-2e71afa86433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:42.271746 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d9938e00-fedf-4513-aa9b-2e71afa86433 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:42.283582 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d9938e00-fedf-4513-aa9b-2e71afa86433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:42.409274 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1051/2124] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:42.418398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdf6b7-4d93-4599-97eb-08ecfdf27ba2 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:42.419907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdf6b7-4d93-4599-97eb-08ecfdf27ba2 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:42.420436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdf6b7-4d93-4599-97eb-08ecfdf27ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:42.468168 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d0bdf6b7-4d93-4599-97eb-08ecfdf27ba2 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:42.473520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d0bdf6b7-4d93-4599-97eb-08ecfdf27ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:42.504920 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9938e00-fedf-4513-aa9b-2e71afa86433 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:42.505558 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1074/2125] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:42.517656 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9938e00-fedf-4513-aa9b-2e71afa86433 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:42.526867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb9bab-0920-4e59-b9e8-cc62541de0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:42.527754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb9bab-0920-4e59-b9e8-cc62541de0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:42.531297 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb9bab-0920-4e59-b9e8-cc62541de0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:42.532004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb9bab-0920-4e59-b9e8-cc62541de0a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:42.533087 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb9bab-0920-4e59-b9e8-cc62541de0a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:54:42.533546 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb9bab-0920-4e59-b9e8-cc62541de0a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:42.537822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb9bab-0920-4e59-b9e8-cc62541de0a7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:42.584911 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1052/2126] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:54:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:54:42.589766 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bdf6b7-4d93-4599-97eb-08ecfdf27ba2 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:42.609926 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bdf6b7-4d93-4599-97eb-08ecfdf27ba2 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:42.630710 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a788e-7c0f-4dde-ba69-06dd19a8c682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:42.631352 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a788e-7c0f-4dde-ba69-06dd19a8c682 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:42.631642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a788e-7c0f-4dde-ba69-06dd19a8c682 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:42.631918 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a788e-7c0f-4dde-ba69-06dd19a8c682 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:42.634344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a788e-7c0f-4dde-ba69-06dd19a8c682 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:42.638975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a788e-7c0f-4dde-ba69-06dd19a8c682 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:42.696476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb9bab-0920-4e59-b9e8-cc62541de0a7 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:42.697300 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1075/2127] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:54:42 2022] POST /identity/v3/projects => generated 403 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:42.710818 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb9bab-0920-4e59-b9e8-cc62541de0a7 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:42.833474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b617b-8819-4464-9769-f74840614780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:42.835691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b617b-8819-4464-9769-f74840614780 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:42.836041 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b617b-8819-4464-9769-f74840614780 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:42.837405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b617b-8819-4464-9769-f74840614780 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:42.838174 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b617b-8819-4464-9769-f74840614780 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:42.843454 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b617b-8819-4464-9769-f74840614780 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:42.914426 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1053/2128] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:54:42 2022] POST /identity/v3/users => generated 302 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:54:42.918304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a788e-7c0f-4dde-ba69-06dd19a8c682 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:42.941776 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a788e-7c0f-4dde-ba69-06dd19a8c682 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:42.955978 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf5b94-1187-4d5d-821b-adc0011ddc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:42.956614 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf5b94-1187-4d5d-821b-adc0011ddc8f admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:42.956892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf5b94-1187-4d5d-821b-adc0011ddc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:42.957164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf5b94-1187-4d5d-821b-adc0011ddc8f admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:42.959977 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf5b94-1187-4d5d-821b-adc0011ddc8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:42.968868 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf5b94-1187-4d5d-821b-adc0011ddc8f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:42.992905 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1076/2129] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:54:42.996328 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b617b-8819-4464-9769-f74840614780 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:43.014467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b617b-8819-4464-9769-f74840614780 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:43.035900 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5524071-4095-4523-9ae3-db55efe0c2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:43.036535 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5524071-4095-4523-9ae3-db55efe0c2fe admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:43.036821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5524071-4095-4523-9ae3-db55efe0c2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:43.037197 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5524071-4095-4523-9ae3-db55efe0c2fe admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:43.037859 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5524071-4095-4523-9ae3-db55efe0c2fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:43.040035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5524071-4095-4523-9ae3-db55efe0c2fe admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:43.057674 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1054/2130] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:43.062793 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf5b94-1187-4d5d-821b-adc0011ddc8f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:43.084427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf5b94-1187-4d5d-821b-adc0011ddc8f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:43.101509 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c09c8e-9c7e-488c-95c5-04ac069c97b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:43.105228 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c09c8e-9c7e-488c-95c5-04ac069c97b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:43.105549 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c09c8e-9c7e-488c-95c5-04ac069c97b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:43.106069 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c09c8e-9c7e-488c-95c5-04ac069c97b4 admin admin] PATH_INFO: `/v3/projects/2eff0aae88974b5a893b71e0d6b34257/users/4604780fce5b4ece8cb20354efb53569/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:43.159614 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c09c8e-9c7e-488c-95c5-04ac069c97b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eff0aae88974b5a893b71e0d6b34257, user_id=4604780fce5b4ece8cb20354efb53569, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:43.162584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c09c8e-9c7e-488c-95c5-04ac069c97b4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:43.194498 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1077/2131] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:43 2022] PUT /identity/v3/projects/2eff0aae88974b5a893b71e0d6b34257/users/4604780fce5b4ece8cb20354efb53569/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:43.199746 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c72953-d4e8-4007-8b2b-62cd18edfea7 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:43.201360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c72953-d4e8-4007-8b2b-62cd18edfea7 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:43.201883 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c72953-d4e8-4007-8b2b-62cd18edfea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:43.230314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d4c72953-d4e8-4007-8b2b-62cd18edfea7 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:43.234743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d4c72953-d4e8-4007-8b2b-62cd18edfea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:43.285572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:43.484283 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1055/2132] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:43.576808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c09c8e-9c7e-488c-95c5-04ac069c97b4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:43.583526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-58c09c8e-9c7e-488c-95c5-04ac069c97b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:43.819687 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c09c8e-9c7e-488c-95c5-04ac069c97b4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:43.827449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608614c5-a01a-4ef9-b9b9-add3050223c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:43.828089 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608614c5-a01a-4ef9-b9b9-add3050223c6 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:43.828371 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608614c5-a01a-4ef9-b9b9-add3050223c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:43.828645 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608614c5-a01a-4ef9-b9b9-add3050223c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:43.866855 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608614c5-a01a-4ef9-b9b9-add3050223c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:43.868760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608614c5-a01a-4ef9-b9b9-add3050223c6 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:43.902333 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1078/2133] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:44.370528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c72953-d4e8-4007-8b2b-62cd18edfea7 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:44.378167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d4c72953-d4e8-4007-8b2b-62cd18edfea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:44.410449 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c72953-d4e8-4007-8b2b-62cd18edfea7 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:44.426131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980707ec-1b96-4013-ac56-74957b6a78ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:44.427307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980707ec-1b96-4013-ac56-74957b6a78ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:44.430585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980707ec-1b96-4013-ac56-74957b6a78ff admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:44.431391 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980707ec-1b96-4013-ac56-74957b6a78ff admin admin] PATH_INFO: `/v3/projects/01e4e5b3804648cbbc3c48b5626a6208` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:44.435355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980707ec-1b96-4013-ac56-74957b6a78ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=01e4e5b3804648cbbc3c48b5626a6208)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:44.439364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980707ec-1b96-4013-ac56-74957b6a78ff admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:44.542767 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-980707ec-1b96-4013-ac56-74957b6a78ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01e4e5b3804648cbbc3c48b5626a6208', 'request_id': 'req-980707ec-1b96-4013-ac56-74957b6a78ff'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:44.560217 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610710d-2e95-40e5-9250-784f6e6be2c5 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:44.560924 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610710d-2e95-40e5-9250-784f6e6be2c5 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:44.560924 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610710d-2e95-40e5-9250-784f6e6be2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:44.567057 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-980707ec-1b96-4013-ac56-74957b6a78ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01e4e5b3804648cbbc3c48b5626a6208', 'request_id': 'req-980707ec-1b96-4013-ac56-74957b6a78ff'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:44.570477 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:44.579269 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-980707ec-1b96-4013-ac56-74957b6a78ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01e4e5b3804648cbbc3c48b5626a6208', 'request_id': 'req-980707ec-1b96-4013-ac56-74957b6a78ff'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:44.609865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-980707ec-1b96-4013-ac56-74957b6a78ff admin admin] The token cache is being invalidate because project 01e4e5b3804648cbbc3c48b5626a6208 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:54:44.610162 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-980707ec-1b96-4013-ac56-74957b6a78ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:44.611053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-980707ec-1b96-4013-ac56-74957b6a78ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:44.615538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-8610710d-2e95-40e5-9250-784f6e6be2c5 None None] MFA Rules not processed for user `392626ec112c47559420f9871c9712c3`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:44.616708 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8610710d-2e95-40e5-9250-784f6e6be2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:44.617392 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1056/2134] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:54:44 2022] DELETE /identity/v3/projects/01e4e5b3804648cbbc3c48b5626a6208 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:44.620608 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980707ec-1b96-4013-ac56-74957b6a78ff admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:44.623352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-980707ec-1b96-4013-ac56-74957b6a78ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:44.819543 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1079/2135] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:44 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:54:44.829837 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610710d-2e95-40e5-9250-784f6e6be2c5 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:44.831757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8610710d-2e95-40e5-9250-784f6e6be2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:44.856170 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980707ec-1b96-4013-ac56-74957b6a78ff admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:44.863010 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610710d-2e95-40e5-9250-784f6e6be2c5 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:44.867957 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4cfd07-7fb4-4fbd-bf64-7a1ba99d3b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:44.869023 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cfd07-7fb4-4fbd-bf64-7a1ba99d3b21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:44.869309 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cfd07-7fb4-4fbd-bf64-7a1ba99d3b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:44.869582 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cfd07-7fb4-4fbd-bf64-7a1ba99d3b21 admin admin] PATH_INFO: `/v3/users/a0c67ba464e44b22a289a7946ab3ca05` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:44.874351 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4cfd07-7fb4-4fbd-bf64-7a1ba99d3b21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0c67ba464e44b22a289a7946ab3ca05)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:44.876352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4cfd07-7fb4-4fbd-bf64-7a1ba99d3b21 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:44.879924 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d3173-1e16-4c3f-95ce-bd2f5a469ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:44.880721 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d3173-1e16-4c3f-95ce-bd2f5a469ea3 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:44.882190 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d3173-1e16-4c3f-95ce-bd2f5a469ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:44.883565 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d3173-1e16-4c3f-95ce-bd2f5a469ea3 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:44.884251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d3173-1e16-4c3f-95ce-bd2f5a469ea3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:44.888544 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d3173-1e16-4c3f-95ce-bd2f5a469ea3 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:44.980753 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1080/2136] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:54:44 2022] POST /identity/v3/projects => generated 405 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:54:44.990985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d3173-1e16-4c3f-95ce-bd2f5a469ea3 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:45.011920 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1a4cfd07-7fb4-4fbd-bf64-7a1ba99d3b21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0c67ba464e44b22a289a7946ab3ca05'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:45.013239 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1a4cfd07-7fb4-4fbd-bf64-7a1ba99d3b21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0c67ba464e44b22a289a7946ab3ca05'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:45.013874 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1a4cfd07-7fb4-4fbd-bf64-7a1ba99d3b21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0c67ba464e44b22a289a7946ab3ca05'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:45.017200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:45.033654 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1a4cfd07-7fb4-4fbd-bf64-7a1ba99d3b21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0c67ba464e44b22a289a7946ab3ca05'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:45.055734 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1a4cfd07-7fb4-4fbd-bf64-7a1ba99d3b21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0c67ba464e44b22a289a7946ab3ca05'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:45.076882 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1057/2137] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:54:44 2022] DELETE /identity/v3/users/a0c67ba464e44b22a289a7946ab3ca05 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:45.150215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d3173-1e16-4c3f-95ce-bd2f5a469ea3 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:45.265992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ee361-b7db-4222-a9ea-982586344a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:45.266848 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ee361-b7db-4222-a9ea-982586344a99 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:45.267199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ee361-b7db-4222-a9ea-982586344a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:45.267542 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ee361-b7db-4222-a9ea-982586344a99 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:45.268770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ee361-b7db-4222-a9ea-982586344a99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:45.272079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ee361-b7db-4222-a9ea-982586344a99 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:45.324567 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1081/2138] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:54:44 2022] POST /identity/v3/users => generated 309 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:45.329794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4cfd07-7fb4-4fbd-bf64-7a1ba99d3b21 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:45.331488 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1a4cfd07-7fb4-4fbd-bf64-7a1ba99d3b21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:45.361878 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4cfd07-7fb4-4fbd-bf64-7a1ba99d3b21 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:45.381162 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad627c-d03b-436d-ba00-d5b28c9e797b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:45.381911 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad627c-d03b-436d-ba00-d5b28c9e797b admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:45.382066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad627c-d03b-436d-ba00-d5b28c9e797b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:45.382522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad627c-d03b-436d-ba00-d5b28c9e797b admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:45.383359 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad627c-d03b-436d-ba00-d5b28c9e797b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:45.385175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad627c-d03b-436d-ba00-d5b28c9e797b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:45.432323 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1058/2139] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:45.433913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ee361-b7db-4222-a9ea-982586344a99 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:45.465233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ee361-b7db-4222-a9ea-982586344a99 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:45.486135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91467cd6-3616-4d6e-b6b6-1a2db0c53dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:45.486881 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91467cd6-3616-4d6e-b6b6-1a2db0c53dac admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:45.487253 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91467cd6-3616-4d6e-b6b6-1a2db0c53dac admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:45.487423 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91467cd6-3616-4d6e-b6b6-1a2db0c53dac admin admin] PATH_INFO: `/v3/projects/c34e7b977939473f89db79fccfed75ab/users/80b9eebc8d3341b7b1f00f3320d4f96e/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:45.500023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:45.536679 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91467cd6-3616-4d6e-b6b6-1a2db0c53dac admin admin] RBAC: Authorizing `identity:create_grant(project_id=c34e7b977939473f89db79fccfed75ab, user_id=80b9eebc8d3341b7b1f00f3320d4f96e, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:45.555513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91467cd6-3616-4d6e-b6b6-1a2db0c53dac admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:45.589649 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1082/2140] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:45 2022] PUT /identity/v3/projects/c34e7b977939473f89db79fccfed75ab/users/80b9eebc8d3341b7b1f00f3320d4f96e/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:45.594009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad627c-d03b-436d-ba00-d5b28c9e797b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:45.615157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad627c-d03b-436d-ba00-d5b28c9e797b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:45.753864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9eb2c-f1b2-4002-bd32-cb8e95998d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:45.754501 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9eb2c-f1b2-4002-bd32-cb8e95998d99 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:45.754838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9eb2c-f1b2-4002-bd32-cb8e95998d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:45.755119 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9eb2c-f1b2-4002-bd32-cb8e95998d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:45.755775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae9eb2c-f1b2-4002-bd32-cb8e95998d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:45.757406 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae9eb2c-f1b2-4002-bd32-cb8e95998d99 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:45.781488 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1059/2141] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:45.786369 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91467cd6-3616-4d6e-b6b6-1a2db0c53dac admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:45.798378 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91467cd6-3616-4d6e-b6b6-1a2db0c53dac admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:45.818187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0ee61-94ba-4f80-a8e6-aa4dea873197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:45.818898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0ee61-94ba-4f80-a8e6-aa4dea873197 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:45.819178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0ee61-94ba-4f80-a8e6-aa4dea873197 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:45.819455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0ee61-94ba-4f80-a8e6-aa4dea873197 admin admin] PATH_INFO: `/v3/projects/c34e7b977939473f89db79fccfed75ab/users/80b9eebc8d3341b7b1f00f3320d4f96e/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:45.821845 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b0ee61-94ba-4f80-a8e6-aa4dea873197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c34e7b977939473f89db79fccfed75ab, user_id=80b9eebc8d3341b7b1f00f3320d4f96e, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:45.824522 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b0ee61-94ba-4f80-a8e6-aa4dea873197 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:45.855967 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1083/2142] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:45 2022] PUT /identity/v3/projects/c34e7b977939473f89db79fccfed75ab/users/80b9eebc8d3341b7b1f00f3320d4f96e/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:47.258623 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9eb2c-f1b2-4002-bd32-cb8e95998d99 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:47.260477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8ae9eb2c-f1b2-4002-bd32-cb8e95998d99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:47.303189 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9eb2c-f1b2-4002-bd32-cb8e95998d99 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:47.393067 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f3c54-74c3-4440-aebb-2bcb1302f93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:47.394391 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f3c54-74c3-4440-aebb-2bcb1302f93b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:47.394961 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f3c54-74c3-4440-aebb-2bcb1302f93b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:47.395800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f3c54-74c3-4440-aebb-2bcb1302f93b admin admin] PATH_INFO: `/v3/projects/7c93a6f252254280940f10102ac1b6e3` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:47.397720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f3c54-74c3-4440-aebb-2bcb1302f93b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c93a6f252254280940f10102ac1b6e3)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:47.402900 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f3c54-74c3-4440-aebb-2bcb1302f93b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:47.554142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-017f3c54-74c3-4440-aebb-2bcb1302f93b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c93a6f252254280940f10102ac1b6e3', 'request_id': 'req-017f3c54-74c3-4440-aebb-2bcb1302f93b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:47.576046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=8,keystone:SELECT=92 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:47.582458 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-017f3c54-74c3-4440-aebb-2bcb1302f93b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c93a6f252254280940f10102ac1b6e3', 'request_id': 'req-017f3c54-74c3-4440-aebb-2bcb1302f93b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:47.606900 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-017f3c54-74c3-4440-aebb-2bcb1302f93b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c93a6f252254280940f10102ac1b6e3', 'request_id': 'req-017f3c54-74c3-4440-aebb-2bcb1302f93b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:47.639155 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-017f3c54-74c3-4440-aebb-2bcb1302f93b admin admin] The token cache is being invalidate because project 7c93a6f252254280940f10102ac1b6e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:54:47.641680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-017f3c54-74c3-4440-aebb-2bcb1302f93b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:47.643296 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-017f3c54-74c3-4440-aebb-2bcb1302f93b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:47.644835 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1060/2143] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:54:47 2022] DELETE /identity/v3/projects/7c93a6f252254280940f10102ac1b6e3 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:54:47.650067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cde66-d43f-40a3-831a-147ad1a6b0d3 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:47.650523 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cde66-d43f-40a3-831a-147ad1a6b0d3 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:47.650901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cde66-d43f-40a3-831a-147ad1a6b0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:47.700727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-8b6cde66-d43f-40a3-831a-147ad1a6b0d3 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:47.702318 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8b6cde66-d43f-40a3-831a-147ad1a6b0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:47.830069 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1084/2144] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:47.832700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3663d-59e7-429d-8509-5df128505f78 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:47.832700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3663d-59e7-429d-8509-5df128505f78 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:47.832922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3663d-59e7-429d-8509-5df128505f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:47.905676 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-bcf3663d-59e7-429d-8509-5df128505f78 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:47.907105 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-bcf3663d-59e7-429d-8509-5df128505f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:47.943613 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1061/2145] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:47.945108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6cde66-d43f-40a3-831a-147ad1a6b0d3 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:47.961347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6cde66-d43f-40a3-831a-147ad1a6b0d3 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:47.976730 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5493508-734f-45b6-ab54-c4d5d606d940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:47.977411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5493508-734f-45b6-ab54-c4d5d606d940 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:47.977689 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5493508-734f-45b6-ab54-c4d5d606d940 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:47.977954 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5493508-734f-45b6-ab54-c4d5d606d940 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:47.978805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5493508-734f-45b6-ab54-c4d5d606d940 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:54:47.979255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5493508-734f-45b6-ab54-c4d5d606d940 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:47.986613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5493508-734f-45b6-ab54-c4d5d606d940 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:48.020544 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1085/2146] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:54:48.024986 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3663d-59e7-429d-8509-5df128505f78 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:48.039320 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3663d-59e7-429d-8509-5df128505f78 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:48.053604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f4678-81b3-4875-a3dd-8e9be7c1157f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:48.054237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f4678-81b3-4875-a3dd-8e9be7c1157f admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:48.054517 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f4678-81b3-4875-a3dd-8e9be7c1157f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:48.054812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f4678-81b3-4875-a3dd-8e9be7c1157f admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:48.057613 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f4678-81b3-4875-a3dd-8e9be7c1157f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:48.063247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f4678-81b3-4875-a3dd-8e9be7c1157f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:48.133033 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1062/2147] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:54:48 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:48.136165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5493508-734f-45b6-ab54-c4d5d606d940 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:48.152543 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5493508-734f-45b6-ab54-c4d5d606d940 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:48.258648 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f2cc7-d300-4b5e-adc9-74e23fb1b965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:48.261433 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f2cc7-d300-4b5e-adc9-74e23fb1b965 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:48.261719 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f2cc7-d300-4b5e-adc9-74e23fb1b965 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:48.261996 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f2cc7-d300-4b5e-adc9-74e23fb1b965 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:48.264232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f2cc7-d300-4b5e-adc9-74e23fb1b965 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:48.266394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f2cc7-d300-4b5e-adc9-74e23fb1b965 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:48.309937 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1086/2148] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:54:48 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:48.311216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f4678-81b3-4875-a3dd-8e9be7c1157f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:48.328500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f4678-81b3-4875-a3dd-8e9be7c1157f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:48.345048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba1c6f-b601-4828-9285-8e1eecdb1992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:48.345762 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba1c6f-b601-4828-9285-8e1eecdb1992 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:48.348534 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba1c6f-b601-4828-9285-8e1eecdb1992 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:48.349093 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba1c6f-b601-4828-9285-8e1eecdb1992 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:48.350037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba1c6f-b601-4828-9285-8e1eecdb1992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:48.354358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba1c6f-b601-4828-9285-8e1eecdb1992 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:48.379831 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1063/2149] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:48.384912 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f2cc7-d300-4b5e-adc9-74e23fb1b965 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:48.397904 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f2cc7-d300-4b5e-adc9-74e23fb1b965 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:48.405906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6bfe1-8390-4097-a6ef-9085280e8914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:48.406533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6bfe1-8390-4097-a6ef-9085280e8914 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:48.406851 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6bfe1-8390-4097-a6ef-9085280e8914 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:48.407118 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6bfe1-8390-4097-a6ef-9085280e8914 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:48.407783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee6bfe1-8390-4097-a6ef-9085280e8914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:48.409606 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee6bfe1-8390-4097-a6ef-9085280e8914 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:48.429500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba1c6f-b601-4828-9285-8e1eecdb1992 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:48.430701 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1087/2150] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:48.447996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba1c6f-b601-4828-9285-8e1eecdb1992 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:48.454642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c3118-3804-4bba-bfea-2676013f7384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:48.455861 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c3118-3804-4bba-bfea-2676013f7384 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:48.456652 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c3118-3804-4bba-bfea-2676013f7384 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:48.457137 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c3118-3804-4bba-bfea-2676013f7384 admin admin] PATH_INFO: `/v3/projects/0e95eee80f3d48619360e3fc2bf48997/users/431f4cf2bdd743b09325793a057af7a7/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:48.491633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c3118-3804-4bba-bfea-2676013f7384 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e95eee80f3d48619360e3fc2bf48997, user_id=431f4cf2bdd743b09325793a057af7a7, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:48.498636 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c3118-3804-4bba-bfea-2676013f7384 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:48.526027 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1064/2151] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:48 2022] PUT /identity/v3/projects/0e95eee80f3d48619360e3fc2bf48997/users/431f4cf2bdd743b09325793a057af7a7/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:54:48.549240 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbe7ea-01f6-4ca1-b563-604f01157194 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:48.549617 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbe7ea-01f6-4ca1-b563-604f01157194 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:48.549909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbe7ea-01f6-4ca1-b563-604f01157194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:48.619249 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-9cdbe7ea-01f6-4ca1-b563-604f01157194 None None] MFA Rules not processed for user `431f4cf2bdd743b09325793a057af7a7`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:48.621263 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9cdbe7ea-01f6-4ca1-b563-604f01157194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:48.701715 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:48.836186 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1088/2152] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:48.840626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c3118-3804-4bba-bfea-2676013f7384 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:48.996692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c3118-3804-4bba-bfea-2676013f7384 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:49.017407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561790c-fd8b-42a3-b0af-9e9dd7fa7fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:49.018964 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561790c-fd8b-42a3-b0af-9e9dd7fa7fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:49.019452 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561790c-fd8b-42a3-b0af-9e9dd7fa7fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:49.020087 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561790c-fd8b-42a3-b0af-9e9dd7fa7fc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:49.021179 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561790c-fd8b-42a3-b0af-9e9dd7fa7fc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:49.032502 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561790c-fd8b-42a3-b0af-9e9dd7fa7fc6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:49.115865 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1065/2153] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:54:48 2022] POST /identity/v3/projects => generated 373 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:49.119888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbe7ea-01f6-4ca1-b563-604f01157194 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:49.141120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbe7ea-01f6-4ca1-b563-604f01157194 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:49.282795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f01683-ebf5-4f9b-84dc-5bda312fe6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:49.284064 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f01683-ebf5-4f9b-84dc-5bda312fe6d4 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:49.285090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f01683-ebf5-4f9b-84dc-5bda312fe6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:49.285665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f01683-ebf5-4f9b-84dc-5bda312fe6d4 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:49.287491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f01683-ebf5-4f9b-84dc-5bda312fe6d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:49.291835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f01683-ebf5-4f9b-84dc-5bda312fe6d4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:49.370763 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1089/2154] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:54:49 2022] POST /identity/v3/users => generated 293 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:49.373471 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561790c-fd8b-42a3-b0af-9e9dd7fa7fc6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:49.384004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f01683-ebf5-4f9b-84dc-5bda312fe6d4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:49.391916 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-92f01683-ebf5-4f9b-84dc-5bda312fe6d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:49.402956 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561790c-fd8b-42a3-b0af-9e9dd7fa7fc6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:49.421109 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f01683-ebf5-4f9b-84dc-5bda312fe6d4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:49.426430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169921f-4996-4eef-8738-7fbdc8cd5b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:49.427391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169921f-4996-4eef-8738-7fbdc8cd5b10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:49.427913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169921f-4996-4eef-8738-7fbdc8cd5b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:49.428183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7baf586-526f-4239-95f3-9e98bfdea1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:49.428320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169921f-4996-4eef-8738-7fbdc8cd5b10 admin admin] PATH_INFO: `/v3/users/37fc74ce20894de3a3af50802f384ff0` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:49.429145 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7baf586-526f-4239-95f3-9e98bfdea1fd admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:49.429902 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e169921f-4996-4eef-8738-7fbdc8cd5b10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37fc74ce20894de3a3af50802f384ff0)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:49.432153 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e169921f-4996-4eef-8738-7fbdc8cd5b10 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:49.432757 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7baf586-526f-4239-95f3-9e98bfdea1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:49.433310 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7baf586-526f-4239-95f3-9e98bfdea1fd admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:49.435572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7baf586-526f-4239-95f3-9e98bfdea1fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:49.442200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7baf586-526f-4239-95f3-9e98bfdea1fd admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:49.468247 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1066/2155] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:49.479385 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7baf586-526f-4239-95f3-9e98bfdea1fd admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:49.496774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7baf586-526f-4239-95f3-9e98bfdea1fd admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:49.502486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea4e81-d8b0-4458-8724-8290ae4b5a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:49.503388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea4e81-d8b0-4458-8724-8290ae4b5a53 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:49.504470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea4e81-d8b0-4458-8724-8290ae4b5a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:49.505549 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea4e81-d8b0-4458-8724-8290ae4b5a53 admin admin] PATH_INFO: `/v3/projects/12807db08b0f4500a04027e044475b9f/users/f6c65546944a49bab8d61e77195bf191/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:49.526032 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea4e81-d8b0-4458-8724-8290ae4b5a53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12807db08b0f4500a04027e044475b9f, user_id=f6c65546944a49bab8d61e77195bf191, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:49.530898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea4e81-d8b0-4458-8724-8290ae4b5a53 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:49.537893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e169921f-4996-4eef-8738-7fbdc8cd5b10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37fc74ce20894de3a3af50802f384ff0'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:49.557222 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1067/2156] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:49 2022] PUT /identity/v3/projects/12807db08b0f4500a04027e044475b9f/users/f6c65546944a49bab8d61e77195bf191/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:49.558391 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea4e81-d8b0-4458-8724-8290ae4b5a53 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:49.562048 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e169921f-4996-4eef-8738-7fbdc8cd5b10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37fc74ce20894de3a3af50802f384ff0'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:49.562717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e169921f-4996-4eef-8738-7fbdc8cd5b10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37fc74ce20894de3a3af50802f384ff0'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:49.563348 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e169921f-4996-4eef-8738-7fbdc8cd5b10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37fc74ce20894de3a3af50802f384ff0'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:49.582274 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e169921f-4996-4eef-8738-7fbdc8cd5b10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37fc74ce20894de3a3af50802f384ff0'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:49.663403 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1090/2157] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:54:49 2022] DELETE /identity/v3/users/37fc74ce20894de3a3af50802f384ff0 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:49.668202 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305feecc-290b-49c9-9282-61557e330910 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:49.670123 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305feecc-290b-49c9-9282-61557e330910 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:49.670612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305feecc-290b-49c9-9282-61557e330910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:49.692281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:49.763678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-305feecc-290b-49c9-9282-61557e330910 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:49.775887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-305feecc-290b-49c9-9282-61557e330910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:49.782206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea4e81-d8b0-4458-8724-8290ae4b5a53 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:49.885589 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:49.937759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678ef98-628d-4bb0-8fab-0fce002b4cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:49.939641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678ef98-628d-4bb0-8fab-0fce002b4cdc admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:49.939940 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678ef98-628d-4bb0-8fab-0fce002b4cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:49.940221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678ef98-628d-4bb0-8fab-0fce002b4cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:49.942843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678ef98-628d-4bb0-8fab-0fce002b4cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:49.945833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678ef98-628d-4bb0-8fab-0fce002b4cdc admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:49.948053 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1091/2158] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:54:49.961847 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1068/2159] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:49.966149 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305feecc-290b-49c9-9282-61557e330910 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:49.968469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-305feecc-290b-49c9-9282-61557e330910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:49.978707 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678ef98-628d-4bb0-8fab-0fce002b4cdc admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:49.983999 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1678ef98-628d-4bb0-8fab-0fce002b4cdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:49.991066 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305feecc-290b-49c9-9282-61557e330910 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:50.009351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5a2ac-3738-4764-b38c-330074ee9966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:50.010112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5a2ac-3738-4764-b38c-330074ee9966 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:50.010482 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5a2ac-3738-4764-b38c-330074ee9966 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:50.010790 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5a2ac-3738-4764-b38c-330074ee9966 admin admin] PATH_INFO: `/v3/projects/12807db08b0f4500a04027e044475b9f/users/f6c65546944a49bab8d61e77195bf191/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:50.018729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de5a2ac-3738-4764-b38c-330074ee9966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12807db08b0f4500a04027e044475b9f, user_id=f6c65546944a49bab8d61e77195bf191, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:50.025625 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de5a2ac-3738-4764-b38c-330074ee9966 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:50.056104 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1092/2160] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:49 2022] PUT /identity/v3/projects/12807db08b0f4500a04027e044475b9f/users/f6c65546944a49bab8d61e77195bf191/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:54:50.069117 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8770e-b166-48fa-97c3-1ef80e9cfe4b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:50.069459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8770e-b166-48fa-97c3-1ef80e9cfe4b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:50.069748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8770e-b166-48fa-97c3-1ef80e9cfe4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:50.145873 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-96e8770e-b166-48fa-97c3-1ef80e9cfe4b None None] MFA Rules not processed for user `f6c65546944a49bab8d61e77195bf191`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:50.147287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-96e8770e-b166-48fa-97c3-1ef80e9cfe4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:50.151791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678ef98-628d-4bb0-8fab-0fce002b4cdc admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:50.255866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef670c-adc8-4094-ae61-9442f25de37c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:50.256545 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef670c-adc8-4094-ae61-9442f25de37c service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:50.256830 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef670c-adc8-4094-ae61-9442f25de37c service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:50.257109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef670c-adc8-4094-ae61-9442f25de37c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:50.354982 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1093/2161] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:54:50.415136 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:50.471812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef670c-adc8-4094-ae61-9442f25de37c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:50.473312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef670c-adc8-4094-ae61-9442f25de37c service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:50.502126 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1069/2162] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:50.759847 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8770e-b166-48fa-97c3-1ef80e9cfe4b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:50.762226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-96e8770e-b166-48fa-97c3-1ef80e9cfe4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:50.863795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8770e-b166-48fa-97c3-1ef80e9cfe4b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:50.873645 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c375f62-c942-482d-a546-0df5849e796c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:50.874306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c375f62-c942-482d-a546-0df5849e796c service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:50.874723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c375f62-c942-482d-a546-0df5849e796c service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:50.875061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c375f62-c942-482d-a546-0df5849e796c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:50.889892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c375f62-c942-482d-a546-0df5849e796c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:50.892128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c375f62-c942-482d-a546-0df5849e796c service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:50.921130 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1094/2163] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:50.958528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef670c-adc8-4094-ae61-9442f25de37c service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:50.959977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2fef670c-adc8-4094-ae61-9442f25de37c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:50.991740 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef670c-adc8-4094-ae61-9442f25de37c service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:51.005622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278105e-14f0-4179-abfe-daa96e169af9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:51.006293 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278105e-14f0-4179-abfe-daa96e169af9 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:51.006497 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278105e-14f0-4179-abfe-daa96e169af9 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:51.006802 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278105e-14f0-4179-abfe-daa96e169af9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:51.008651 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6278105e-14f0-4179-abfe-daa96e169af9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:51.113619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c375f62-c942-482d-a546-0df5849e796c service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:51.116006 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9c375f62-c942-482d-a546-0df5849e796c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:51.135887 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278105e-14f0-4179-abfe-daa96e169af9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:51.138717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278105e-14f0-4179-abfe-daa96e169af9 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:51.144823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c375f62-c942-482d-a546-0df5849e796c service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:51.156612 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1070/2164] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:51.160536 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4df03-a04a-4f8a-b2f4-407e4ce76301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:51.161330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4df03-a04a-4f8a-b2f4-407e4ce76301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:51.161732 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4df03-a04a-4f8a-b2f4-407e4ce76301 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:51.162109 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4df03-a04a-4f8a-b2f4-407e4ce76301 admin admin] PATH_INFO: `/v3/users/f5f7743570b2465ea4d4397840485758` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:51.163631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4df03-a04a-4f8a-b2f4-407e4ce76301 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5f7743570b2465ea4d4397840485758)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:51.166672 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4df03-a04a-4f8a-b2f4-407e4ce76301 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:51.218883 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:51.245607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278105e-14f0-4179-abfe-daa96e169af9 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:51.248416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6278105e-14f0-4179-abfe-daa96e169af9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:51.270410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278105e-14f0-4179-abfe-daa96e169af9 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:51.280549 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5ed4df03-a04a-4f8a-b2f4-407e4ce76301 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5f7743570b2465ea4d4397840485758'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:51.296625 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5ed4df03-a04a-4f8a-b2f4-407e4ce76301 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5f7743570b2465ea4d4397840485758'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:51.297413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5ed4df03-a04a-4f8a-b2f4-407e4ce76301 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5f7743570b2465ea4d4397840485758'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:51.298286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5ed4df03-a04a-4f8a-b2f4-407e4ce76301 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5f7743570b2465ea4d4397840485758'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:51.314985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1637d57-0e4c-40a6-bd1e-fafa17438e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:51.315647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1637d57-0e4c-40a6-bd1e-fafa17438e11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:51.315924 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1637d57-0e4c-40a6-bd1e-fafa17438e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:51.316196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1637d57-0e4c-40a6-bd1e-fafa17438e11 admin admin] PATH_INFO: `/v3/projects/c0a3acd485194fe3b0a09906d9b70a8f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:51.317340 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1637d57-0e4c-40a6-bd1e-fafa17438e11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0a3acd485194fe3b0a09906d9b70a8f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:51.321135 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1637d57-0e4c-40a6-bd1e-fafa17438e11 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:51.332906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5ed4df03-a04a-4f8a-b2f4-407e4ce76301 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5f7743570b2465ea4d4397840485758'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:51.422835 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1095/2165] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:54:51 2022] DELETE /identity/v3/users/f5f7743570b2465ea4d4397840485758 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:54:51.424932 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d61837-cf19-4d18-8bb5-7b75e596ea27 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:51.427431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d61837-cf19-4d18-8bb5-7b75e596ea27 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:51.427980 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d61837-cf19-4d18-8bb5-7b75e596ea27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:51.449017 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c1637d57-0e4c-40a6-bd1e-fafa17438e11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0a3acd485194fe3b0a09906d9b70a8f', 'request_id': 'req-c1637d57-0e4c-40a6-bd1e-fafa17438e11'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:51.480780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c1637d57-0e4c-40a6-bd1e-fafa17438e11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0a3acd485194fe3b0a09906d9b70a8f', 'request_id': 'req-c1637d57-0e4c-40a6-bd1e-fafa17438e11'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:51.509047 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-70d61837-cf19-4d18-8bb5-7b75e596ea27 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:51.509483 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c1637d57-0e4c-40a6-bd1e-fafa17438e11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0a3acd485194fe3b0a09906d9b70a8f', 'request_id': 'req-c1637d57-0e4c-40a6-bd1e-fafa17438e11'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:51.515519 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-70d61837-cf19-4d18-8bb5-7b75e596ea27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:51.556342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c1637d57-0e4c-40a6-bd1e-fafa17438e11 admin admin] The token cache is being invalidate because project c0a3acd485194fe3b0a09906d9b70a8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:54:51.556646 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c1637d57-0e4c-40a6-bd1e-fafa17438e11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:51.560273 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c1637d57-0e4c-40a6-bd1e-fafa17438e11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:51.564117 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1071/2166] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:54:51 2022] DELETE /identity/v3/projects/c0a3acd485194fe3b0a09906d9b70a8f => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:51.568842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1637d57-0e4c-40a6-bd1e-fafa17438e11 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:51.576150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c1637d57-0e4c-40a6-bd1e-fafa17438e11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:51.748144 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1096/2167] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:51.749264 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d61837-cf19-4d18-8bb5-7b75e596ea27 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:51.752641 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-70d61837-cf19-4d18-8bb5-7b75e596ea27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:51.784893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d61837-cf19-4d18-8bb5-7b75e596ea27 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:51.799512 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b47568-2c71-4b91-bb13-695e1f91fd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:51.800323 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b47568-2c71-4b91-bb13-695e1f91fd8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:51.800559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b47568-2c71-4b91-bb13-695e1f91fd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:51.800837 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b47568-2c71-4b91-bb13-695e1f91fd8e admin admin] PATH_INFO: `/v3/users/431f4cf2bdd743b09325793a057af7a7` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:51.803226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b47568-2c71-4b91-bb13-695e1f91fd8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=431f4cf2bdd743b09325793a057af7a7)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:51.809076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b47568-2c71-4b91-bb13-695e1f91fd8e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:51.838952 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1637d57-0e4c-40a6-bd1e-fafa17438e11 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:51.864587 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe3511-5477-4b0a-81c9-1efa53ecdb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:51.865786 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe3511-5477-4b0a-81c9-1efa53ecdb2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:51.866285 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe3511-5477-4b0a-81c9-1efa53ecdb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:51.867243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe3511-5477-4b0a-81c9-1efa53ecdb2d admin admin] PATH_INFO: `/v3/users/dd90a1cabe614560ace218d791aec65c` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:51.910037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe3511-5477-4b0a-81c9-1efa53ecdb2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd90a1cabe614560ace218d791aec65c)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:51.915109 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b7b47568-2c71-4b91-bb13-695e1f91fd8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '431f4cf2bdd743b09325793a057af7a7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:51.926256 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe3511-5477-4b0a-81c9-1efa53ecdb2d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:51.929242 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:51.940474 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b7b47568-2c71-4b91-bb13-695e1f91fd8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '431f4cf2bdd743b09325793a057af7a7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:51.944966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b7b47568-2c71-4b91-bb13-695e1f91fd8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '431f4cf2bdd743b09325793a057af7a7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:51.945975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b7b47568-2c71-4b91-bb13-695e1f91fd8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '431f4cf2bdd743b09325793a057af7a7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:51.971592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b7b47568-2c71-4b91-bb13-695e1f91fd8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '431f4cf2bdd743b09325793a057af7a7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:52.021411 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1097/2168] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:54:51 2022] DELETE /identity/v3/users/431f4cf2bdd743b09325793a057af7a7 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:52.022411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b47568-2c71-4b91-bb13-695e1f91fd8e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:52.025241 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b7b47568-2c71-4b91-bb13-695e1f91fd8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:52.044364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-58fe3511-5477-4b0a-81c9-1efa53ecdb2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd90a1cabe614560ace218d791aec65c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:52.045236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-58fe3511-5477-4b0a-81c9-1efa53ecdb2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd90a1cabe614560ace218d791aec65c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:52.046235 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-58fe3511-5477-4b0a-81c9-1efa53ecdb2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd90a1cabe614560ace218d791aec65c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:52.062273 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-58fe3511-5477-4b0a-81c9-1efa53ecdb2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd90a1cabe614560ace218d791aec65c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:52.069892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:52.101847 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-58fe3511-5477-4b0a-81c9-1efa53ecdb2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd90a1cabe614560ace218d791aec65c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:52.140194 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1072/2169] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:54:51 2022] DELETE /identity/v3/users/dd90a1cabe614560ace218d791aec65c => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:52.146672 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd25282-68cc-447a-81b0-1fa0d571f1ca None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:52.147062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd25282-68cc-447a-81b0-1fa0d571f1ca None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:52.147344 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd25282-68cc-447a-81b0-1fa0d571f1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:52.207770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b47568-2c71-4b91-bb13-695e1f91fd8e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:52.211354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-4cd25282-68cc-447a-81b0-1fa0d571f1ca None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:52.220813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4cd25282-68cc-447a-81b0-1fa0d571f1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:52.326450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9aa28-2de5-4ac2-bd82-2151afc99223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:52.327757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9aa28-2de5-4ac2-bd82-2151afc99223 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:52.327757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9aa28-2de5-4ac2-bd82-2151afc99223 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:52.327757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9aa28-2de5-4ac2-bd82-2151afc99223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:52.339693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-68c9aa28-2de5-4ac2-bd82-2151afc99223 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:52.362189 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1073/2170] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:52.415280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd25282-68cc-447a-81b0-1fa0d571f1ca None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:52.417530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4cd25282-68cc-447a-81b0-1fa0d571f1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:52.450365 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd25282-68cc-447a-81b0-1fa0d571f1ca None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:52.460139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392933d7-d902-4cf4-a4b1-40ecdaef0cbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:52.464457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392933d7-d902-4cf4-a4b1-40ecdaef0cbd service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:52.465707 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392933d7-d902-4cf4-a4b1-40ecdaef0cbd service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:52.466176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392933d7-d902-4cf4-a4b1-40ecdaef0cbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:52.495491 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392933d7-d902-4cf4-a4b1-40ecdaef0cbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:52.498214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392933d7-d902-4cf4-a4b1-40ecdaef0cbd service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:52.518582 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9aa28-2de5-4ac2-bd82-2151afc99223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:52.520051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9aa28-2de5-4ac2-bd82-2151afc99223 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:52.529925 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1074/2171] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:52.558031 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1098/2172] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:53.750482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392933d7-d902-4cf4-a4b1-40ecdaef0cbd service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:53.752094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-392933d7-d902-4cf4-a4b1-40ecdaef0cbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:53.778021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392933d7-d902-4cf4-a4b1-40ecdaef0cbd service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:53.783928 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ccdf13-83e5-4782-bd61-bea9f917b26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:53.784990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccdf13-83e5-4782-bd61-bea9f917b26e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:53.785450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccdf13-83e5-4782-bd61-bea9f917b26e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:53.785932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccdf13-83e5-4782-bd61-bea9f917b26e admin admin] PATH_INFO: `/v3/projects/3f0afc603122424da744092d8ac29cee` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:53.787615 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ccdf13-83e5-4782-bd61-bea9f917b26e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f0afc603122424da744092d8ac29cee)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:53.791182 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ccdf13-83e5-4782-bd61-bea9f917b26e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:53.883557 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-71ccdf13-83e5-4782-bd61-bea9f917b26e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f0afc603122424da744092d8ac29cee', 'request_id': 'req-71ccdf13-83e5-4782-bd61-bea9f917b26e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:53.897691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-71ccdf13-83e5-4782-bd61-bea9f917b26e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f0afc603122424da744092d8ac29cee', 'request_id': 'req-71ccdf13-83e5-4782-bd61-bea9f917b26e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:53.899992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:53.910248 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-71ccdf13-83e5-4782-bd61-bea9f917b26e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f0afc603122424da744092d8ac29cee', 'request_id': 'req-71ccdf13-83e5-4782-bd61-bea9f917b26e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:53.931569 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-71ccdf13-83e5-4782-bd61-bea9f917b26e admin admin] The token cache is being invalidate because project 3f0afc603122424da744092d8ac29cee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:54:53.932344 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-71ccdf13-83e5-4782-bd61-bea9f917b26e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:53.933581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-71ccdf13-83e5-4782-bd61-bea9f917b26e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:53.936392 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1075/2173] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:54:53 2022] DELETE /identity/v3/projects/3f0afc603122424da744092d8ac29cee => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:53.940395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9aa28-2de5-4ac2-bd82-2151afc99223 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:53.951875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9aa28-2de5-4ac2-bd82-2151afc99223 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:54.029791 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78f232-192e-4cce-9c76-7819ac15794d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:54.030430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78f232-192e-4cce-9c76-7819ac15794d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:54.030882 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78f232-192e-4cce-9c76-7819ac15794d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:54.031152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78f232-192e-4cce-9c76-7819ac15794d admin admin] PATH_INFO: `/v3/users/a26c3c59c0644e4984543cb26f000425` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:54.032296 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78f232-192e-4cce-9c76-7819ac15794d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a26c3c59c0644e4984543cb26f000425)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:54.034239 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78f232-192e-4cce-9c76-7819ac15794d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:54.059180 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:54.097517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-aa78f232-192e-4cce-9c76-7819ac15794d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a26c3c59c0644e4984543cb26f000425'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:54.106811 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-aa78f232-192e-4cce-9c76-7819ac15794d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a26c3c59c0644e4984543cb26f000425'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:54.107604 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-aa78f232-192e-4cce-9c76-7819ac15794d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a26c3c59c0644e4984543cb26f000425'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:54.108470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-aa78f232-192e-4cce-9c76-7819ac15794d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a26c3c59c0644e4984543cb26f000425'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:54.118086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-aa78f232-192e-4cce-9c76-7819ac15794d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a26c3c59c0644e4984543cb26f000425'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:54.141568 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1099/2174] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:54:53 2022] DELETE /identity/v3/users/a26c3c59c0644e4984543cb26f000425 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:54.230516 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ccdf13-83e5-4782-bd61-bea9f917b26e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:54.235123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-71ccdf13-83e5-4782-bd61-bea9f917b26e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:54.258540 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ccdf13-83e5-4782-bd61-bea9f917b26e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:54.409191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c878b-bcf4-4ed0-9b76-9dc3eff1f32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:54.409834 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c878b-bcf4-4ed0-9b76-9dc3eff1f32f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:54.410117 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c878b-bcf4-4ed0-9b76-9dc3eff1f32f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:54.410380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c878b-bcf4-4ed0-9b76-9dc3eff1f32f admin admin] PATH_INFO: `/v3/projects/2b74786c1e2a4635b3b3f31324ee3b50` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:54.413861 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c878b-bcf4-4ed0-9b76-9dc3eff1f32f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b74786c1e2a4635b3b3f31324ee3b50)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:54.416088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c878b-bcf4-4ed0-9b76-9dc3eff1f32f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:54.535141 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-907c878b-bcf4-4ed0-9b76-9dc3eff1f32f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b74786c1e2a4635b3b3f31324ee3b50', 'request_id': 'req-907c878b-bcf4-4ed0-9b76-9dc3eff1f32f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:54.562015 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-907c878b-bcf4-4ed0-9b76-9dc3eff1f32f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b74786c1e2a4635b3b3f31324ee3b50', 'request_id': 'req-907c878b-bcf4-4ed0-9b76-9dc3eff1f32f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:54.577142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-907c878b-bcf4-4ed0-9b76-9dc3eff1f32f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b74786c1e2a4635b3b3f31324ee3b50', 'request_id': 'req-907c878b-bcf4-4ed0-9b76-9dc3eff1f32f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:54.619956 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-907c878b-bcf4-4ed0-9b76-9dc3eff1f32f admin admin] The token cache is being invalidate because project 2b74786c1e2a4635b3b3f31324ee3b50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:54:54.620157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-907c878b-bcf4-4ed0-9b76-9dc3eff1f32f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:54.621395 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-907c878b-bcf4-4ed0-9b76-9dc3eff1f32f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:54.623109 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1076/2175] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:54:54 2022] DELETE /identity/v3/projects/2b74786c1e2a4635b3b3f31324ee3b50 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:54.628104 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc45476-53dd-4ba2-a7be-5ebcda4909b1 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:54.628393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc45476-53dd-4ba2-a7be-5ebcda4909b1 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:54.628665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc45476-53dd-4ba2-a7be-5ebcda4909b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:54.649799 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-6bc45476-53dd-4ba2-a7be-5ebcda4909b1 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:54.651171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6bc45476-53dd-4ba2-a7be-5ebcda4909b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:54.758804 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1100/2176] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:54.767035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623a8b9-b652-44f0-a473-a667b289db63 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:54.767485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623a8b9-b652-44f0-a473-a667b289db63 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:54.767690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623a8b9-b652-44f0-a473-a667b289db63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:54.804260 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-9623a8b9-b652-44f0-a473-a667b289db63 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:54.805483 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9623a8b9-b652-44f0-a473-a667b289db63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:54.825628 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1077/2177] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:54.826239 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc45476-53dd-4ba2-a7be-5ebcda4909b1 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:54.879803 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc45476-53dd-4ba2-a7be-5ebcda4909b1 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:54.895468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c119dfd-6096-4b81-9ebb-99c50fd34dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:54.901276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c119dfd-6096-4b81-9ebb-99c50fd34dbd admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:54.906619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c119dfd-6096-4b81-9ebb-99c50fd34dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:54.909452 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c119dfd-6096-4b81-9ebb-99c50fd34dbd admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:54.914234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c119dfd-6096-4b81-9ebb-99c50fd34dbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:54:54.918824 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c119dfd-6096-4b81-9ebb-99c50fd34dbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:54.926747 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c119dfd-6096-4b81-9ebb-99c50fd34dbd admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:54.988061 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9623a8b9-b652-44f0-a473-a667b289db63 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:54.998065 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1101/2178] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:54:55.005507 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9623a8b9-b652-44f0-a473-a667b289db63 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:55.014090 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be27f6-f9ca-4628-b96e-ade3dd077c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:55.015053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be27f6-f9ca-4628-b96e-ade3dd077c7d admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:55.015482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be27f6-f9ca-4628-b96e-ade3dd077c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:55.016013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be27f6-f9ca-4628-b96e-ade3dd077c7d admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:55.016831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be27f6-f9ca-4628-b96e-ade3dd077c7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:55.019016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be27f6-f9ca-4628-b96e-ade3dd077c7d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:55.075815 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1078/2179] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:54:54 2022] POST /identity/v3/projects => generated 385 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:54:55.081163 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c119dfd-6096-4b81-9ebb-99c50fd34dbd admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:55.088197 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be27f6-f9ca-4628-b96e-ade3dd077c7d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:55.090479 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-81be27f6-f9ca-4628-b96e-ade3dd077c7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:55.108294 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c119dfd-6096-4b81-9ebb-99c50fd34dbd admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:55.215499 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:55.251987 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be27f6-f9ca-4628-b96e-ade3dd077c7d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:55.267321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8a1e5-b4bc-4d60-924a-df973cc7de42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:55.269823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8a1e5-b4bc-4d60-924a-df973cc7de42 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:55.270114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8a1e5-b4bc-4d60-924a-df973cc7de42 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:55.270393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8a1e5-b4bc-4d60-924a-df973cc7de42 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:55.271055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8a1e5-b4bc-4d60-924a-df973cc7de42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:55.273338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8a1e5-b4bc-4d60-924a-df973cc7de42 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:55.275945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767e2a4-bb21-4048-a811-13c75c7dcfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:55.276257 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767e2a4-bb21-4048-a811-13c75c7dcfaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:55.276539 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767e2a4-bb21-4048-a811-13c75c7dcfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:55.277075 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767e2a4-bb21-4048-a811-13c75c7dcfaa admin admin] PATH_INFO: `/v3/projects/0e95eee80f3d48619360e3fc2bf48997` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:55.278871 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767e2a4-bb21-4048-a811-13c75c7dcfaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e95eee80f3d48619360e3fc2bf48997)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:55.285015 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767e2a4-bb21-4048-a811-13c75c7dcfaa admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:55.359874 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1102/2180] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:54:55 2022] POST /identity/v3/users => generated 293 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:55.361101 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8a1e5-b4bc-4d60-924a-df973cc7de42 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:55.393787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8a1e5-b4bc-4d60-924a-df973cc7de42 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:55.414399 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db37d7-6847-4850-b3a8-6d8ff6c35ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:55.418395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db37d7-6847-4850-b3a8-6d8ff6c35ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:55.418395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db37d7-6847-4850-b3a8-6d8ff6c35ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:55.418395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db37d7-6847-4850-b3a8-6d8ff6c35ff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:55.421699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db37d7-6847-4850-b3a8-6d8ff6c35ff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:55.424590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db37d7-6847-4850-b3a8-6d8ff6c35ff4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:55.443843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c767e2a4-bb21-4048-a811-13c75c7dcfaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e95eee80f3d48619360e3fc2bf48997', 'request_id': 'req-c767e2a4-bb21-4048-a811-13c75c7dcfaa'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:55.458927 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1103/2181] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:55.460381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c767e2a4-bb21-4048-a811-13c75c7dcfaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e95eee80f3d48619360e3fc2bf48997', 'request_id': 'req-c767e2a4-bb21-4048-a811-13c75c7dcfaa'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:55.461865 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db37d7-6847-4850-b3a8-6d8ff6c35ff4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:55.474395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:55.475185 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c767e2a4-bb21-4048-a811-13c75c7dcfaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e95eee80f3d48619360e3fc2bf48997', 'request_id': 'req-c767e2a4-bb21-4048-a811-13c75c7dcfaa'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:55.502489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db37d7-6847-4850-b3a8-6d8ff6c35ff4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:55.518854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c767e2a4-bb21-4048-a811-13c75c7dcfaa admin admin] The token cache is being invalidate because project 0e95eee80f3d48619360e3fc2bf48997 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:54:55.522493 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c767e2a4-bb21-4048-a811-13c75c7dcfaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:55.524237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c767e2a4-bb21-4048-a811-13c75c7dcfaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:55.530692 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1079/2182] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:54:55 2022] DELETE /identity/v3/projects/0e95eee80f3d48619360e3fc2bf48997 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:55.531802 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767e2a4-bb21-4048-a811-13c75c7dcfaa admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:55.546792 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c767e2a4-bb21-4048-a811-13c75c7dcfaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:55.670039 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5072c-e4d0-49ee-b92a-f8f10dae691b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:55.670890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5072c-e4d0-49ee-b92a-f8f10dae691b admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:55.671180 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5072c-e4d0-49ee-b92a-f8f10dae691b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:55.671459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5072c-e4d0-49ee-b92a-f8f10dae691b admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:55.672121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5072c-e4d0-49ee-b92a-f8f10dae691b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:55.674020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5072c-e4d0-49ee-b92a-f8f10dae691b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:55.707611 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1104/2183] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:55.708690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5072c-e4d0-49ee-b92a-f8f10dae691b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:55.713012 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e9c5072c-e4d0-49ee-b92a-f8f10dae691b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:55.737311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5072c-e4d0-49ee-b92a-f8f10dae691b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:55.749074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767e2a4-bb21-4048-a811-13c75c7dcfaa admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:55.754189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad6c64-5768-4c79-9af6-4cb7177c2588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:55.754872 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad6c64-5768-4c79-9af6-4cb7177c2588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:55.755152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad6c64-5768-4c79-9af6-4cb7177c2588 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:55.755424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad6c64-5768-4c79-9af6-4cb7177c2588 admin admin] PATH_INFO: `/v3/users/f6c65546944a49bab8d61e77195bf191` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:55.756603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad6c64-5768-4c79-9af6-4cb7177c2588 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6c65546944a49bab8d61e77195bf191)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:55.758840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad6c64-5768-4c79-9af6-4cb7177c2588 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:55.763879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e0ac61-14c0-40ba-a87b-d6d14ee53e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:55.765823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0ac61-14c0-40ba-a87b-d6d14ee53e5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:55.766324 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0ac61-14c0-40ba-a87b-d6d14ee53e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:55.766768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0ac61-14c0-40ba-a87b-d6d14ee53e5c admin admin] PATH_INFO: `/v3/projects/a6ba6b85faa84d33abbd01a2b327fdbe` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:55.770882 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e0ac61-14c0-40ba-a87b-d6d14ee53e5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6ba6b85faa84d33abbd01a2b327fdbe)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:55.775187 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e0ac61-14c0-40ba-a87b-d6d14ee53e5c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:55.858277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b6e0ac61-14c0-40ba-a87b-d6d14ee53e5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6ba6b85faa84d33abbd01a2b327fdbe', 'request_id': 'req-b6e0ac61-14c0-40ba-a87b-d6d14ee53e5c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:55.865809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-96ad6c64-5768-4c79-9af6-4cb7177c2588 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6c65546944a49bab8d61e77195bf191'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:55.876643 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b6e0ac61-14c0-40ba-a87b-d6d14ee53e5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6ba6b85faa84d33abbd01a2b327fdbe', 'request_id': 'req-b6e0ac61-14c0-40ba-a87b-d6d14ee53e5c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:55.880473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-96ad6c64-5768-4c79-9af6-4cb7177c2588 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6c65546944a49bab8d61e77195bf191'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:55.881289 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-96ad6c64-5768-4c79-9af6-4cb7177c2588 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6c65546944a49bab8d61e77195bf191'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:55.881933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-96ad6c64-5768-4c79-9af6-4cb7177c2588 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6c65546944a49bab8d61e77195bf191'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:55.884550 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b6e0ac61-14c0-40ba-a87b-d6d14ee53e5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6ba6b85faa84d33abbd01a2b327fdbe', 'request_id': 'req-b6e0ac61-14c0-40ba-a87b-d6d14ee53e5c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:55.900573 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-96ad6c64-5768-4c79-9af6-4cb7177c2588 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6c65546944a49bab8d61e77195bf191'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:55.912534 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b6e0ac61-14c0-40ba-a87b-d6d14ee53e5c admin admin] The token cache is being invalidate because project a6ba6b85faa84d33abbd01a2b327fdbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:54:55.913047 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b6e0ac61-14c0-40ba-a87b-d6d14ee53e5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:55.913847 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b6e0ac61-14c0-40ba-a87b-d6d14ee53e5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:55.915895 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1080/2184] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:54:55 2022] DELETE /identity/v3/projects/a6ba6b85faa84d33abbd01a2b327fdbe => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:55.916948 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e0ac61-14c0-40ba-a87b-d6d14ee53e5c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:55.924203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b6e0ac61-14c0-40ba-a87b-d6d14ee53e5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:55.935877 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1105/2185] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:54:55 2022] DELETE /identity/v3/users/f6c65546944a49bab8d61e77195bf191 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:55.937177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae81bdd-19af-4250-a94f-63b1632c97b8 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:55.937463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae81bdd-19af-4250-a94f-63b1632c97b8 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:55.937742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae81bdd-19af-4250-a94f-63b1632c97b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:55.954533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:55.994224 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-dae81bdd-19af-4250-a94f-63b1632c97b8 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:55.995630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-dae81bdd-19af-4250-a94f-63b1632c97b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:56.122473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e0ac61-14c0-40ba-a87b-d6d14ee53e5c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:56.135619 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1106/2186] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:56.137491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae81bdd-19af-4250-a94f-63b1632c97b8 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:56.143319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-dae81bdd-19af-4250-a94f-63b1632c97b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:56.157408 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356ed0d-c060-478b-9dd7-e27de50b2c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:56.158101 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356ed0d-c060-478b-9dd7-e27de50b2c3c admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:56.158383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356ed0d-c060-478b-9dd7-e27de50b2c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:56.158691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356ed0d-c060-478b-9dd7-e27de50b2c3c admin admin] PATH_INFO: `/v3/projects/d219b0cd08c34c29a278ba6f0924d4be/users/7b5839d6ddf24d5fa2f431b5a460cde5/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:56.175787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:56.214494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356ed0d-c060-478b-9dd7-e27de50b2c3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d219b0cd08c34c29a278ba6f0924d4be, user_id=7b5839d6ddf24d5fa2f431b5a460cde5, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:56.226992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356ed0d-c060-478b-9dd7-e27de50b2c3c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:56.299484 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1081/2187] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:55 2022] PUT /identity/v3/projects/d219b0cd08c34c29a278ba6f0924d4be/users/7b5839d6ddf24d5fa2f431b5a460cde5/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:56.301080 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61216a84-277c-47da-9368-d8b921595d52 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:56.301364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61216a84-277c-47da-9368-d8b921595d52 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:56.301739 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61216a84-277c-47da-9368-d8b921595d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:56.331463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae81bdd-19af-4250-a94f-63b1632c97b8 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:56.364406 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-61216a84-277c-47da-9368-d8b921595d52 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:56.368637 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-61216a84-277c-47da-9368-d8b921595d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:56.507160 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b921095-a257-485d-88a3-1978a98d41ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:56.507789 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b921095-a257-485d-88a3-1978a98d41ad service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:56.508231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b921095-a257-485d-88a3-1978a98d41ad service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:56.508561 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b921095-a257-485d-88a3-1978a98d41ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:56.514282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6b921095-a257-485d-88a3-1978a98d41ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:56.549180 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1082/2188] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:56.551408 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092d2d5-63c8-4a57-9b45-dea224699711 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:56.558197 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092d2d5-63c8-4a57-9b45-dea224699711 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:56.559464 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092d2d5-63c8-4a57-9b45-dea224699711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:56.623271 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-5092d2d5-63c8-4a57-9b45-dea224699711 None None] MFA Rules not processed for user `7b5839d6ddf24d5fa2f431b5a460cde5`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:56.625404 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5092d2d5-63c8-4a57-9b45-dea224699711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:56.659832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b921095-a257-485d-88a3-1978a98d41ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:56.661558 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b921095-a257-485d-88a3-1978a98d41ad service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:56.682676 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1107/2189] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:56 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:56.686163 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b921095-a257-485d-88a3-1978a98d41ad service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:56.728143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b921095-a257-485d-88a3-1978a98d41ad service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:56.751378 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96558e-12bc-450f-a919-148755688994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:56.752287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96558e-12bc-450f-a919-148755688994 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:56.752721 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96558e-12bc-450f-a919-148755688994 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:56.753178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96558e-12bc-450f-a919-148755688994 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:56.753974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f96558e-12bc-450f-a919-148755688994 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:54:56.754431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f96558e-12bc-450f-a919-148755688994 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:56.761079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f96558e-12bc-450f-a919-148755688994 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:56.766578 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1083/2190] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:56.772095 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092d2d5-63c8-4a57-9b45-dea224699711 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:56.815619 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092d2d5-63c8-4a57-9b45-dea224699711 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:56.819164 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1108/2191] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:54:56.825636 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96558e-12bc-450f-a919-148755688994 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:56.839042 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63a076-ed66-44e6-9189-ad1a119f127f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:56.840252 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63a076-ed66-44e6-9189-ad1a119f127f admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:56.840503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63a076-ed66-44e6-9189-ad1a119f127f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:56.840766 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63a076-ed66-44e6-9189-ad1a119f127f admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:56.841402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63a076-ed66-44e6-9189-ad1a119f127f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:56.846055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63a076-ed66-44e6-9189-ad1a119f127f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:56.854038 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96558e-12bc-450f-a919-148755688994 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:56.860391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfbc78-a6c2-4e75-9aee-96d7be0084d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:56.861009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfbc78-a6c2-4e75-9aee-96d7be0084d4 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:56.861776 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfbc78-a6c2-4e75-9aee-96d7be0084d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:56.862125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfbc78-a6c2-4e75-9aee-96d7be0084d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:56.863149 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcfbc78-a6c2-4e75-9aee-96d7be0084d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:56.866991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcfbc78-a6c2-4e75-9aee-96d7be0084d4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:56.931513 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1109/2192] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:54:56 2022] POST /identity/v3/projects => generated 361 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:56.935936 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfbc78-a6c2-4e75-9aee-96d7be0084d4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:56.956193 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1084/2193] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:54:56 2022] POST /identity/v3/projects => generated 385 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:56.957073 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:56.957203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63a076-ed66-44e6-9189-ad1a119f127f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:56.973417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:57.097653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfbc78-a6c2-4e75-9aee-96d7be0084d4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:57.104493 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63a076-ed66-44e6-9189-ad1a119f127f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:57.115869 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5e4d7-3496-4331-b422-da74e262b353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:57.116509 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5e4d7-3496-4331-b422-da74e262b353 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:57.116789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5e4d7-3496-4331-b422-da74e262b353 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:57.117064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5e4d7-3496-4331-b422-da74e262b353 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:57.117362 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0b062-44cf-496a-8632-6689155eee94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:57.117702 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde5e4d7-3496-4331-b422-da74e262b353 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:57.118832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0b062-44cf-496a-8632-6689155eee94 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:57.119115 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0b062-44cf-496a-8632-6689155eee94 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:57.119524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0b062-44cf-496a-8632-6689155eee94 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:57.119719 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde5e4d7-3496-4331-b422-da74e262b353 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:57.120296 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0b062-44cf-496a-8632-6689155eee94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:57.128586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0b062-44cf-496a-8632-6689155eee94 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:57.165752 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1085/2194] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:54:56 2022] POST /identity/v3/users => generated 299 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:57.171055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5e4d7-3496-4331-b422-da74e262b353 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:57.179941 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1110/2195] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:54:56 2022] POST /identity/v3/users => generated 281 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:54:57.187068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0b062-44cf-496a-8632-6689155eee94 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:57.201305 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5e4d7-3496-4331-b422-da74e262b353 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:57.207833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0b062-44cf-496a-8632-6689155eee94 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:57.212796 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db77175-ec42-4e92-8e67-922cdb97a1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:57.213562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db77175-ec42-4e92-8e67-922cdb97a1af admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:57.213885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db77175-ec42-4e92-8e67-922cdb97a1af admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:57.214167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db77175-ec42-4e92-8e67-922cdb97a1af admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:57.216188 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf76c5-d3a6-4456-a819-91859ef08a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:57.216457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db77175-ec42-4e92-8e67-922cdb97a1af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:57.217631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf76c5-d3a6-4456-a819-91859ef08a02 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:57.218018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf76c5-d3a6-4456-a819-91859ef08a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:57.218132 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db77175-ec42-4e92-8e67-922cdb97a1af admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:57.218472 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf76c5-d3a6-4456-a819-91859ef08a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:57.220650 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf76c5-d3a6-4456-a819-91859ef08a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:57.223800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf76c5-d3a6-4456-a819-91859ef08a02 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:57.248142 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1086/2196] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:57.249235 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db77175-ec42-4e92-8e67-922cdb97a1af admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:57.250582 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1111/2197] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:57.253764 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf76c5-d3a6-4456-a819-91859ef08a02 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:57.264094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db77175-ec42-4e92-8e67-922cdb97a1af admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:57.269513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9528e-528c-4697-b4e9-43f35895beb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:57.270179 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9528e-528c-4697-b4e9-43f35895beb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:57.270451 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9528e-528c-4697-b4e9-43f35895beb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:57.270761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9528e-528c-4697-b4e9-43f35895beb9 admin admin] PATH_INFO: `/v3/projects/d7e8493d642b4a68b086f68d1a93f2ee/users/29f3c93c6b2c4254a094d2c4d316d104/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:57.275833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf76c5-d3a6-4456-a819-91859ef08a02 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:57.284741 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48dd82-7ac8-4a4e-8e68-3873bbe50218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:57.286036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48dd82-7ac8-4a4e-8e68-3873bbe50218 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:57.287122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48dd82-7ac8-4a4e-8e68-3873bbe50218 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:57.287663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48dd82-7ac8-4a4e-8e68-3873bbe50218 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:57.289242 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d48dd82-7ac8-4a4e-8e68-3873bbe50218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:57.289874 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b9528e-528c-4697-b4e9-43f35895beb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7e8493d642b4a68b086f68d1a93f2ee, user_id=29f3c93c6b2c4254a094d2c4d316d104, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:57.291524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d48dd82-7ac8-4a4e-8e68-3873bbe50218 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:57.294344 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b9528e-528c-4697-b4e9-43f35895beb9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:57.322778 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1087/2198] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:57 2022] PUT /identity/v3/projects/d7e8493d642b4a68b086f68d1a93f2ee/users/29f3c93c6b2c4254a094d2c4d316d104/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:57.326193 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9528e-528c-4697-b4e9-43f35895beb9 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:57.331208 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1112/2199] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:57.332163 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48dd82-7ac8-4a4e-8e68-3873bbe50218 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:57.368491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48dd82-7ac8-4a4e-8e68-3873bbe50218 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:57.512504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040ff99-5d7d-4ae2-9fe6-d873617dae04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:57.513356 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040ff99-5d7d-4ae2-9fe6-d873617dae04 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:57.513660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040ff99-5d7d-4ae2-9fe6-d873617dae04 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:57.513938 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040ff99-5d7d-4ae2-9fe6-d873617dae04 admin admin] PATH_INFO: `/v3/projects/1b84646871dd443ba7e666f4b3731881/users/18b3487bd7d34fa7a7973680a4b90070/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:57.519231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9528e-528c-4697-b4e9-43f35895beb9 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:57.531921 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263335e-d702-4abb-9a14-742723ce7fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:57.532552 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263335e-d702-4abb-9a14-742723ce7fac admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:57.532830 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263335e-d702-4abb-9a14-742723ce7fac admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:57.533097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263335e-d702-4abb-9a14-742723ce7fac admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:57.533742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a263335e-d702-4abb-9a14-742723ce7fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:57.537971 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a263335e-d702-4abb-9a14-742723ce7fac admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:57.548083 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d040ff99-5d7d-4ae2-9fe6-d873617dae04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b84646871dd443ba7e666f4b3731881, user_id=18b3487bd7d34fa7a7973680a4b90070, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:57.554299 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d040ff99-5d7d-4ae2-9fe6-d873617dae04 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:57.566344 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1088/2200] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:54:57.567654 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263335e-d702-4abb-9a14-742723ce7fac admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:57.606112 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1113/2201] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:57 2022] PUT /identity/v3/projects/1b84646871dd443ba7e666f4b3731881/users/18b3487bd7d34fa7a7973680a4b90070/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:57.608127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a08878-1244-4127-a465-e0b52c8f1020 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:57.610921 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a08878-1244-4127-a465-e0b52c8f1020 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:57.611791 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a08878-1244-4127-a465-e0b52c8f1020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:57.613792 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263335e-d702-4abb-9a14-742723ce7fac admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:57.742921 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-61a08878-1244-4127-a465-e0b52c8f1020 None None] MFA Rules not processed for user `18b3487bd7d34fa7a7973680a4b90070`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:57.755888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-61a08878-1244-4127-a465-e0b52c8f1020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:57.769398 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:57.788319 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da6115-a2d9-4fb0-b32a-a485489c07da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:57.790010 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da6115-a2d9-4fb0-b32a-a485489c07da admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:57.791644 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da6115-a2d9-4fb0-b32a-a485489c07da admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:57.792084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da6115-a2d9-4fb0-b32a-a485489c07da admin admin] PATH_INFO: `/v3/projects/d7e8493d642b4a68b086f68d1a93f2ee/users/29f3c93c6b2c4254a094d2c4d316d104/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:57.799599 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da6115-a2d9-4fb0-b32a-a485489c07da admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7e8493d642b4a68b086f68d1a93f2ee, user_id=29f3c93c6b2c4254a094d2c4d316d104, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:57.802575 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da6115-a2d9-4fb0-b32a-a485489c07da admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:57.878895 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1089/2202] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:57 2022] PUT /identity/v3/projects/d7e8493d642b4a68b086f68d1a93f2ee/users/29f3c93c6b2c4254a094d2c4d316d104/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:57.886161 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da6115-a2d9-4fb0-b32a-a485489c07da admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:57.903307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-78da6115-a2d9-4fb0-b32a-a485489c07da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:57.964122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:58.043741 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1114/2203] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:58.043741 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22824814-6516-42b2-bf53-a70e2d301817 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:58.045532 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22824814-6516-42b2-bf53-a70e2d301817 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:58.045842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22824814-6516-42b2-bf53-a70e2d301817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:58.083250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da6115-a2d9-4fb0-b32a-a485489c07da admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:58.099575 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf0373-5277-46bb-a617-76f70093be52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:58.100100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf0373-5277-46bb-a617-76f70093be52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:58.100381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf0373-5277-46bb-a617-76f70093be52 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:58.100656 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf0373-5277-46bb-a617-76f70093be52 admin admin] PATH_INFO: `/v3/projects/12807db08b0f4500a04027e044475b9f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:58.102066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf0373-5277-46bb-a617-76f70093be52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12807db08b0f4500a04027e044475b9f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:58.104893 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf0373-5277-46bb-a617-76f70093be52 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:58.112341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-22824814-6516-42b2-bf53-a70e2d301817 None None] MFA Rules not processed for user `29f3c93c6b2c4254a094d2c4d316d104`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:58.116234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-22824814-6516-42b2-bf53-a70e2d301817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:58.212282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9ccf0373-5277-46bb-a617-76f70093be52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12807db08b0f4500a04027e044475b9f', 'request_id': 'req-9ccf0373-5277-46bb-a617-76f70093be52'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:58.227632 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9ccf0373-5277-46bb-a617-76f70093be52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12807db08b0f4500a04027e044475b9f', 'request_id': 'req-9ccf0373-5277-46bb-a617-76f70093be52'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:58.244818 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9ccf0373-5277-46bb-a617-76f70093be52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12807db08b0f4500a04027e044475b9f', 'request_id': 'req-9ccf0373-5277-46bb-a617-76f70093be52'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:58.272227 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1115/2204] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:58 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:58.275363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22824814-6516-42b2-bf53-a70e2d301817 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:58.285033 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9ccf0373-5277-46bb-a617-76f70093be52 admin admin] The token cache is being invalidate because project 12807db08b0f4500a04027e044475b9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:54:58.285476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9ccf0373-5277-46bb-a617-76f70093be52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:58.287064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9ccf0373-5277-46bb-a617-76f70093be52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:54:58.289214 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1090/2205] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:54:57 2022] DELETE /identity/v3/projects/12807db08b0f4500a04027e044475b9f => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:58.294816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f093c-5928-46ec-882d-cf3709900ce5 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:58.295094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f093c-5928-46ec-882d-cf3709900ce5 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:58.295366 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f093c-5928-46ec-882d-cf3709900ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:58.304660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22824814-6516-42b2-bf53-a70e2d301817 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:58.361219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-523f093c-5928-46ec-882d-cf3709900ce5 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:58.362616 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-523f093c-5928-46ec-882d-cf3709900ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:58.467403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7735d90-7795-4a45-9427-2847e1c2781e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:58.468099 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7735d90-7795-4a45-9427-2847e1c2781e admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:58.468654 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7735d90-7795-4a45-9427-2847e1c2781e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:58.468796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7735d90-7795-4a45-9427-2847e1c2781e admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:58.469444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7735d90-7795-4a45-9427-2847e1c2781e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:58.472442 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7735d90-7795-4a45-9427-2847e1c2781e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:58.541663 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1116/2206] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:54:58 2022] POST /identity/v3/projects => generated 361 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:58.547276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7735d90-7795-4a45-9427-2847e1c2781e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:58.555887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e7735d90-7795-4a45-9427-2847e1c2781e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:58.595324 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1091/2207] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:58.596941 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757de0c3-b65b-4cdf-93ef-0f45d8e9d78f None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:58.597270 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757de0c3-b65b-4cdf-93ef-0f45d8e9d78f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:58.597516 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757de0c3-b65b-4cdf-93ef-0f45d8e9d78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:58.666937 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-757de0c3-b65b-4cdf-93ef-0f45d8e9d78f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:58.673903 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-757de0c3-b65b-4cdf-93ef-0f45d8e9d78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:58.693025 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:58.702355 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1092/2208] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:58.704343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757de0c3-b65b-4cdf-93ef-0f45d8e9d78f None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:58.716136 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7735d90-7795-4a45-9427-2847e1c2781e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:58.727993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757de0c3-b65b-4cdf-93ef-0f45d8e9d78f None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:58.732283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8fc03-1b48-47ff-96c8-8e00046d5f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:58.733298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8fc03-1b48-47ff-96c8-8e00046d5f0f admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:58.733694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8fc03-1b48-47ff-96c8-8e00046d5f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:58.734086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8fc03-1b48-47ff-96c8-8e00046d5f0f admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:58.736528 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a8fc03-1b48-47ff-96c8-8e00046d5f0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:58.740253 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a8fc03-1b48-47ff-96c8-8e00046d5f0f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:58.748004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44e168-491d-4a19-9891-3425314bc80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:58.749426 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44e168-491d-4a19-9891-3425314bc80c admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:58.749866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44e168-491d-4a19-9891-3425314bc80c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:58.750435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44e168-491d-4a19-9891-3425314bc80c admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:58.752866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf44e168-491d-4a19-9891-3425314bc80c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:54:58.754083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf44e168-491d-4a19-9891-3425314bc80c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:58.756421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf44e168-491d-4a19-9891-3425314bc80c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:58.770293 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:58.781064 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1093/2209] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:54:58.782836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca241bb-7852-420e-a66d-b55c2b31dc6d None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:58.783775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca241bb-7852-420e-a66d-b55c2b31dc6d None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:58.784272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca241bb-7852-420e-a66d-b55c2b31dc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:58.822725 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1117/2210] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:54:58 2022] POST /identity/v3/users => generated 287 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:58.823687 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8fc03-1b48-47ff-96c8-8e00046d5f0f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:58.824619 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-3ca241bb-7852-420e-a66d-b55c2b31dc6d None None] MFA Rules not processed for user `10aebae8bbbd4ea88b9cbf85d3438ed1`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:58.826308 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3ca241bb-7852-420e-a66d-b55c2b31dc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:58.835514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-10a8fc03-1b48-47ff-96c8-8e00046d5f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:58.933338 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1094/2211] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:58.934725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca241bb-7852-420e-a66d-b55c2b31dc6d None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:58.978385 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca241bb-7852-420e-a66d-b55c2b31dc6d None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:59.009833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe307ba-773d-4633-b490-84c162812c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:59.012120 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe307ba-773d-4633-b490-84c162812c32 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:59.013103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe307ba-773d-4633-b490-84c162812c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:59.015220 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe307ba-773d-4633-b490-84c162812c32 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:59.016128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe307ba-773d-4633-b490-84c162812c32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:59.038389 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe307ba-773d-4633-b490-84c162812c32 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:59.054754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8fc03-1b48-47ff-96c8-8e00046d5f0f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:59.069421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5476ae6-2f51-4dd1-8f65-260f8f289789 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:59.070581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5476ae6-2f51-4dd1-8f65-260f8f289789 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:59.071060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5476ae6-2f51-4dd1-8f65-260f8f289789 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:59.071702 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5476ae6-2f51-4dd1-8f65-260f8f289789 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:59.074898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e5476ae6-2f51-4dd1-8f65-260f8f289789 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:59.095667 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1095/2212] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:54:58 2022] POST /identity/v3/projects => generated 387 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:59.098461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe307ba-773d-4633-b490-84c162812c32 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:59.270945 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5476ae6-2f51-4dd1-8f65-260f8f289789 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:59.273262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5476ae6-2f51-4dd1-8f65-260f8f289789 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:59.276513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe307ba-773d-4633-b490-84c162812c32 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:59.287367 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59f5b1-ccb0-47d2-9a43-30b28797b3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:59.288301 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59f5b1-ccb0-47d2-9a43-30b28797b3bb admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:59.289724 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59f5b1-ccb0-47d2-9a43-30b28797b3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:59.290010 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59f5b1-ccb0-47d2-9a43-30b28797b3bb admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:59.294275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b59f5b1-ccb0-47d2-9a43-30b28797b3bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:59.296214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b59f5b1-ccb0-47d2-9a43-30b28797b3bb admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:59.316005 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1118/2213] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:54:58 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:59.319672 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ac760-1067-4bda-8b71-981f381fc9da None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:59.325817 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ac760-1067-4bda-8b71-981f381fc9da None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:59.326382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ac760-1067-4bda-8b71-981f381fc9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:59.334077 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1096/2214] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:59.335027 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59f5b1-ccb0-47d2-9a43-30b28797b3bb admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:59.368471 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-f30ac760-1067-4bda-8b71-981f381fc9da None None] MFA Rules not processed for user `0701f31766dd4eeab9a63f6411c26d6e`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:59.373516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f30ac760-1067-4bda-8b71-981f381fc9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:59.376353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59f5b1-ccb0-47d2-9a43-30b28797b3bb admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:59.388346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a073a22-5aa0-4019-bdb3-9a75481d482b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:59.389245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a073a22-5aa0-4019-bdb3-9a75481d482b admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:59.390957 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a073a22-5aa0-4019-bdb3-9a75481d482b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:59.393361 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a073a22-5aa0-4019-bdb3-9a75481d482b admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:59.394916 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a073a22-5aa0-4019-bdb3-9a75481d482b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:59.400408 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a073a22-5aa0-4019-bdb3-9a75481d482b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:59.473418 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1097/2215] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:54:59 2022] POST /identity/v3/users => generated 294 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:54:59.474536 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a073a22-5aa0-4019-bdb3-9a75481d482b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:59.507440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a073a22-5aa0-4019-bdb3-9a75481d482b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:59.521915 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342d48b-1039-40f8-8c6e-6f1012e9d9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:59.523833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342d48b-1039-40f8-8c6e-6f1012e9d9f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:59.525213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342d48b-1039-40f8-8c6e-6f1012e9d9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:59.525650 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342d48b-1039-40f8-8c6e-6f1012e9d9f1 admin admin] PATH_INFO: `/v3/projects/7eecc25d54984aeebebdf41fdfc1004d/users/8a75fa1c20ae4a23b7430f0be242eae5/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:59.543797 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1119/2216] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:54:59.544888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ac760-1067-4bda-8b71-981f381fc9da None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:59.573959 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ac760-1067-4bda-8b71-981f381fc9da None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:59.576339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342d48b-1039-40f8-8c6e-6f1012e9d9f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eecc25d54984aeebebdf41fdfc1004d, user_id=8a75fa1c20ae4a23b7430f0be242eae5, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:59.581187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f77eb6-0d05-4630-8745-744fa550388e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:59.582054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f77eb6-0d05-4630-8745-744fa550388e admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:59.582433 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f77eb6-0d05-4630-8745-744fa550388e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:59.582914 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342d48b-1039-40f8-8c6e-6f1012e9d9f1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:59.583500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f77eb6-0d05-4630-8745-744fa550388e admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:59.584226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f77eb6-0d05-4630-8745-744fa550388e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:59.586231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f77eb6-0d05-4630-8745-744fa550388e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:59.613193 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1098/2217] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:59 2022] PUT /identity/v3/projects/7eecc25d54984aeebebdf41fdfc1004d/users/8a75fa1c20ae4a23b7430f0be242eae5/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:54:59.614741 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1120/2218] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:59.617609 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342d48b-1039-40f8-8c6e-6f1012e9d9f1 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:59.618124 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f77eb6-0d05-4630-8745-744fa550388e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:59.660592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f77eb6-0d05-4630-8745-744fa550388e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:59.688505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:59.717053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:59.773448 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342d48b-1039-40f8-8c6e-6f1012e9d9f1 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:59.790088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38724a1-8bea-4dc5-bdbf-05fbe167989c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:59.790749 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38724a1-8bea-4dc5-bdbf-05fbe167989c admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:59.791026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38724a1-8bea-4dc5-bdbf-05fbe167989c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:59.791296 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38724a1-8bea-4dc5-bdbf-05fbe167989c admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:59.791945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38724a1-8bea-4dc5-bdbf-05fbe167989c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:59.793775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38724a1-8bea-4dc5-bdbf-05fbe167989c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:59.825199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371bf4a-08b7-4ee1-9655-5d0062f1d407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:59.826283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371bf4a-08b7-4ee1-9655-5d0062f1d407 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:59.826482 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1099/2219] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:54:59.827932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fedda2-f485-4cd8-928a-606b4786a90d None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:59.830968 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fedda2-f485-4cd8-928a-606b4786a90d None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:59.831253 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fedda2-f485-4cd8-928a-606b4786a90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:59.834798 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371bf4a-08b7-4ee1-9655-5d0062f1d407 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:59.835121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371bf4a-08b7-4ee1-9655-5d0062f1d407 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:59.837955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8371bf4a-08b7-4ee1-9655-5d0062f1d407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:59.840202 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8371bf4a-08b7-4ee1-9655-5d0062f1d407 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:59.867565 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1121/2220] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:54:59.868754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371bf4a-08b7-4ee1-9655-5d0062f1d407 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:54:59.891255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371bf4a-08b7-4ee1-9655-5d0062f1d407 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:54:59.891600 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-07fedda2-f485-4cd8-928a-606b4786a90d None None] MFA Rules not processed for user `4604780fce5b4ece8cb20354efb53569`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:54:59.893365 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-07fedda2-f485-4cd8-928a-606b4786a90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:54:59.908364 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8929cd-de89-4244-ad04-fc880141cf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:54:59.916769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8929cd-de89-4244-ad04-fc880141cf9c admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:54:59.919024 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8929cd-de89-4244-ad04-fc880141cf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:54:59.919431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8929cd-de89-4244-ad04-fc880141cf9c admin admin] PATH_INFO: `/v3/projects/7eecc25d54984aeebebdf41fdfc1004d/users/8a75fa1c20ae4a23b7430f0be242eae5/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:54:59.925377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8929cd-de89-4244-ad04-fc880141cf9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eecc25d54984aeebebdf41fdfc1004d, user_id=8a75fa1c20ae4a23b7430f0be242eae5, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:54:59.932701 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8929cd-de89-4244-ad04-fc880141cf9c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:54:59.983028 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1122/2221] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:59 2022] PUT /identity/v3/projects/7eecc25d54984aeebebdf41fdfc1004d/users/8a75fa1c20ae4a23b7430f0be242eae5/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:00.009306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8929cd-de89-4244-ad04-fc880141cf9c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:00.019867 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1100/2222] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:54:59 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:00.024289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b222b-4be5-4e0a-b27a-00e6cf1fbacc None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:00.025506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b222b-4be5-4e0a-b27a-00e6cf1fbacc None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:00.026845 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b222b-4be5-4e0a-b27a-00e6cf1fbacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:00.118249 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-958b222b-4be5-4e0a-b27a-00e6cf1fbacc None None] MFA Rules not processed for user `8a75fa1c20ae4a23b7430f0be242eae5`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:00.119581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-958b222b-4be5-4e0a-b27a-00e6cf1fbacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:00.175364 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8929cd-de89-4244-ad04-fc880141cf9c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:00.204156 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8231f-8ff8-42dc-b248-8ca3ec025b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:00.205037 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8231f-8ff8-42dc-b248-8ca3ec025b72 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:00.205324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8231f-8ff8-42dc-b248-8ca3ec025b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:00.210497 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8231f-8ff8-42dc-b248-8ca3ec025b72 admin admin] PATH_INFO: `/v3/projects/489f9cb65a0f40a383398c05d84b45f3/users/f413813531e94602959dbf30f21bdd45/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:00.260545 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8231f-8ff8-42dc-b248-8ca3ec025b72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=489f9cb65a0f40a383398c05d84b45f3, user_id=f413813531e94602959dbf30f21bdd45, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:00.271531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8231f-8ff8-42dc-b248-8ca3ec025b72 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:00.272340 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1101/2223] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:00 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:00.275281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b222b-4be5-4e0a-b27a-00e6cf1fbacc None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:00.278918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-958b222b-4be5-4e0a-b27a-00e6cf1fbacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:00.298400 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1123/2224] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:54:59 2022] PUT /identity/v3/projects/489f9cb65a0f40a383398c05d84b45f3/users/f413813531e94602959dbf30f21bdd45/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:00.303349 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b222b-4be5-4e0a-b27a-00e6cf1fbacc None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:00.307514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb514e-ab10-4be8-a52f-1d45f2b81dac None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:00.307808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb514e-ab10-4be8-a52f-1d45f2b81dac None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:00.308109 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb514e-ab10-4be8-a52f-1d45f2b81dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:00.391200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-ccbb514e-ab10-4be8-a52f-1d45f2b81dac None None] MFA Rules not processed for user `f413813531e94602959dbf30f21bdd45`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:00.396183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ccbb514e-ab10-4be8-a52f-1d45f2b81dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:00.418288 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:00.445330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944c44a-9ec2-46ae-a301-3adebef7d83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:00.449933 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944c44a-9ec2-46ae-a301-3adebef7d83f admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:00.450743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944c44a-9ec2-46ae-a301-3adebef7d83f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:00.451117 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944c44a-9ec2-46ae-a301-3adebef7d83f admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:00.452538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944c44a-9ec2-46ae-a301-3adebef7d83f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:00.455366 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944c44a-9ec2-46ae-a301-3adebef7d83f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:00.513839 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1102/2225] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:55:00 2022] POST /identity/v3/projects => generated 401 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:00.518742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944c44a-9ec2-46ae-a301-3adebef7d83f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:00.562242 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1124/2226] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:00.568660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb514e-ab10-4be8-a52f-1d45f2b81dac None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:00.595390 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb514e-ab10-4be8-a52f-1d45f2b81dac None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:00.603891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:00.632093 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944c44a-9ec2-46ae-a301-3adebef7d83f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:00.642206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0a52c-1719-482f-9550-1bb6f79148b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:00.647304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0a52c-1719-482f-9550-1bb6f79148b6 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:00.649779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0a52c-1719-482f-9550-1bb6f79148b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:00.650067 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0a52c-1719-482f-9550-1bb6f79148b6 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:00.650832 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0a52c-1719-482f-9550-1bb6f79148b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:00.658157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0a52c-1719-482f-9550-1bb6f79148b6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:00.733621 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1103/2227] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:55:00 2022] POST /identity/v3/users => generated 307 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:00.736203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0a52c-1719-482f-9550-1bb6f79148b6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:00.761626 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3086f-c12e-4fc5-975a-355170089c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:00.761993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0a52c-1719-482f-9550-1bb6f79148b6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:00.762616 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3086f-c12e-4fc5-975a-355170089c5d admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:00.762908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3086f-c12e-4fc5-975a-355170089c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:00.764197 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3086f-c12e-4fc5-975a-355170089c5d admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:00.766741 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3086f-c12e-4fc5-975a-355170089c5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:00.776072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3086f-c12e-4fc5-975a-355170089c5d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:00.782740 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffdf04-8ebf-4cf1-918e-6f8c5b129fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:00.783689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffdf04-8ebf-4cf1-918e-6f8c5b129fca admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:00.783689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffdf04-8ebf-4cf1-918e-6f8c5b129fca admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:00.784241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffdf04-8ebf-4cf1-918e-6f8c5b129fca admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:00.785067 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ffdf04-8ebf-4cf1-918e-6f8c5b129fca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:00.789527 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ffdf04-8ebf-4cf1-918e-6f8c5b129fca admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:00.831263 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1125/2228] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:55:00 2022] POST /identity/v3/projects => generated 389 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:00.832258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3086f-c12e-4fc5-975a-355170089c5d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:00.895937 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1104/2229] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:00.897031 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffdf04-8ebf-4cf1-918e-6f8c5b129fca admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:00.927586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffdf04-8ebf-4cf1-918e-6f8c5b129fca admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:01.122407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396fa99-0c38-4302-ac8b-9f55c4b28bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:01.124212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396fa99-0c38-4302-ac8b-9f55c4b28bfa admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:01.124613 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396fa99-0c38-4302-ac8b-9f55c4b28bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:01.124799 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396fa99-0c38-4302-ac8b-9f55c4b28bfa admin admin] PATH_INFO: `/v3/projects/fa2ee8d438d541d2817c8557bfcb6e4f/users/b71dd466b4d140448e8bb188f9e72901/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:01.187685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396fa99-0c38-4302-ac8b-9f55c4b28bfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa2ee8d438d541d2817c8557bfcb6e4f, user_id=b71dd466b4d140448e8bb188f9e72901, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:01.197599 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396fa99-0c38-4302-ac8b-9f55c4b28bfa admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:01.230171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3086f-c12e-4fc5-975a-355170089c5d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:01.243690 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1105/2230] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:55:00 2022] PUT /identity/v3/projects/fa2ee8d438d541d2817c8557bfcb6e4f/users/b71dd466b4d140448e8bb188f9e72901/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:01.248956 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396fa99-0c38-4302-ac8b-9f55c4b28bfa admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:01.388809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:01.453679 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396fa99-0c38-4302-ac8b-9f55c4b28bfa admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:01.470337 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df62fc1-19a5-490b-a5d8-7b37e69825fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:01.470998 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df62fc1-19a5-490b-a5d8-7b37e69825fc admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:01.471278 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df62fc1-19a5-490b-a5d8-7b37e69825fc admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:01.471548 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df62fc1-19a5-490b-a5d8-7b37e69825fc admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:01.472197 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df62fc1-19a5-490b-a5d8-7b37e69825fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:01.473835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df62fc1-19a5-490b-a5d8-7b37e69825fc admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:01.505461 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1106/2231] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:01.506408 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df62fc1-19a5-490b-a5d8-7b37e69825fc admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:01.537512 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df62fc1-19a5-490b-a5d8-7b37e69825fc admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:01.553974 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee96f673-7ea0-4164-aaf1-0ac4fce2ea48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:01.554701 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96f673-7ea0-4164-aaf1-0ac4fce2ea48 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:01.554985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96f673-7ea0-4164-aaf1-0ac4fce2ea48 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:01.555260 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96f673-7ea0-4164-aaf1-0ac4fce2ea48 admin admin] PATH_INFO: `/v3/projects/fa2ee8d438d541d2817c8557bfcb6e4f/users/b71dd466b4d140448e8bb188f9e72901/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:01.565703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee96f673-7ea0-4164-aaf1-0ac4fce2ea48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa2ee8d438d541d2817c8557bfcb6e4f, user_id=b71dd466b4d140448e8bb188f9e72901, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:01.568510 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee96f673-7ea0-4164-aaf1-0ac4fce2ea48 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:01.596447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cda1df-e67d-4549-99ee-b35d9572ed94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:01.597156 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cda1df-e67d-4549-99ee-b35d9572ed94 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:01.597436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cda1df-e67d-4549-99ee-b35d9572ed94 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:01.597707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cda1df-e67d-4549-99ee-b35d9572ed94 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:01.598336 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cda1df-e67d-4549-99ee-b35d9572ed94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:01.600310 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cda1df-e67d-4549-99ee-b35d9572ed94 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:01.626031 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1107/2232] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:55:01 2022] PUT /identity/v3/projects/fa2ee8d438d541d2817c8557bfcb6e4f/users/b71dd466b4d140448e8bb188f9e72901/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:01.627019 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee96f673-7ea0-4164-aaf1-0ac4fce2ea48 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:01.633445 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ee96f673-7ea0-4164-aaf1-0ac4fce2ea48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:01.680882 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1126/2233] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:55:00 2022] POST /identity/v3/users => generated 301 bytes in 849 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:01.682803 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf2ac5-20fd-4227-9521-9ff676cc8e04 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:01.682935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf2ac5-20fd-4227-9521-9ff676cc8e04 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:01.684147 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf2ac5-20fd-4227-9521-9ff676cc8e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:01.783982 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-c6cf2ac5-20fd-4227-9521-9ff676cc8e04 None None] MFA Rules not processed for user `80b9eebc8d3341b7b1f00f3320d4f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:01.786430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c6cf2ac5-20fd-4227-9521-9ff676cc8e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:01.847858 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:01.967664 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1127/2234] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:01 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:01.974375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee96f673-7ea0-4164-aaf1-0ac4fce2ea48 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:01.994257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf2ac5-20fd-4227-9521-9ff676cc8e04 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:01.999426 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e915d8b-642c-4917-abbe-9ec680fbde7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:02.008531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e915d8b-642c-4917-abbe-9ec680fbde7e service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:02.008919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e915d8b-642c-4917-abbe-9ec680fbde7e service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:02.013017 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e915d8b-642c-4917-abbe-9ec680fbde7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:02.159207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf2ac5-20fd-4227-9521-9ff676cc8e04 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:02.169918 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f818fbe-104a-4262-a4b2-3d9cb575e43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:02.171120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f818fbe-104a-4262-a4b2-3d9cb575e43f admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:02.171550 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f818fbe-104a-4262-a4b2-3d9cb575e43f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:02.173658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f818fbe-104a-4262-a4b2-3d9cb575e43f admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:02.174534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f818fbe-104a-4262-a4b2-3d9cb575e43f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:02.181614 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f818fbe-104a-4262-a4b2-3d9cb575e43f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:02.201592 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e915d8b-642c-4917-abbe-9ec680fbde7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:02.206632 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e915d8b-642c-4917-abbe-9ec680fbde7e service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:02.219408 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1128/2235] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:02.231968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f818fbe-104a-4262-a4b2-3d9cb575e43f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:02.243211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f818fbe-104a-4262-a4b2-3d9cb575e43f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:02.254162 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0590159-ed6c-4173-b133-6af94cc430d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:02.255655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0590159-ed6c-4173-b133-6af94cc430d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:02.256108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0590159-ed6c-4173-b133-6af94cc430d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:02.256532 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0590159-ed6c-4173-b133-6af94cc430d2 admin admin] PATH_INFO: `/v3/projects/56223cc3fb6f4dda99ae403aa8f1b2d7/users/58ecd3be3f3b429da58912f0a742608e/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:02.279938 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1108/2236] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:01 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:02.307571 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0590159-ed6c-4173-b133-6af94cc430d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56223cc3fb6f4dda99ae403aa8f1b2d7, user_id=58ecd3be3f3b429da58912f0a742608e, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:02.311950 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0590159-ed6c-4173-b133-6af94cc430d2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:02.344932 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1129/2237] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:55:02 2022] PUT /identity/v3/projects/56223cc3fb6f4dda99ae403aa8f1b2d7/users/58ecd3be3f3b429da58912f0a742608e/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:02.348710 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e915d8b-642c-4917-abbe-9ec680fbde7e service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:02.365532 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e915d8b-642c-4917-abbe-9ec680fbde7e service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:02.487439 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:02.508747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92dcc5-1036-4743-9424-904aefaa1bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:02.509412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92dcc5-1036-4743-9424-904aefaa1bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:02.509692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92dcc5-1036-4743-9424-904aefaa1bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:02.509961 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92dcc5-1036-4743-9424-904aefaa1bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:02.511068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92dcc5-1036-4743-9424-904aefaa1bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:02.513085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92dcc5-1036-4743-9424-904aefaa1bb4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:02.560001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0590159-ed6c-4173-b133-6af94cc430d2 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:02.571025 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1109/2238] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:02.575918 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0590159-ed6c-4173-b133-6af94cc430d2 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:02.587248 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb9e7f-e099-4948-bac4-1fa718f63c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:02.588198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb9e7f-e099-4948-bac4-1fa718f63c45 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:02.588649 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb9e7f-e099-4948-bac4-1fa718f63c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:02.590165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb9e7f-e099-4948-bac4-1fa718f63c45 admin admin] PATH_INFO: `/v3/projects/56223cc3fb6f4dda99ae403aa8f1b2d7/users/58ecd3be3f3b429da58912f0a742608e/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:02.593851 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb9e7f-e099-4948-bac4-1fa718f63c45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56223cc3fb6f4dda99ae403aa8f1b2d7, user_id=58ecd3be3f3b429da58912f0a742608e, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:02.602262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb9e7f-e099-4948-bac4-1fa718f63c45 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:02.648954 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1130/2239] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:55:02 2022] PUT /identity/v3/projects/56223cc3fb6f4dda99ae403aa8f1b2d7/users/58ecd3be3f3b429da58912f0a742608e/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:02.653734 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a41c7-aeba-4228-9773-a2d4935fd1f2 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:02.654032 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a41c7-aeba-4228-9773-a2d4935fd1f2 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:02.654315 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a41c7-aeba-4228-9773-a2d4935fd1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:02.741458 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-7c8a41c7-aeba-4228-9773-a2d4935fd1f2 None None] MFA Rules not processed for user `58ecd3be3f3b429da58912f0a742608e`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:02.745996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7c8a41c7-aeba-4228-9773-a2d4935fd1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:02.911494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb9e7f-e099-4948-bac4-1fa718f63c45 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:02.957947 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1110/2240] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:02 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:02.964083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a41c7-aeba-4228-9773-a2d4935fd1f2 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:02.967327 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7c8a41c7-aeba-4228-9773-a2d4935fd1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:03.049290 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a41c7-aeba-4228-9773-a2d4935fd1f2 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:03.055421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814564a-9f19-4059-bd3e-30d3976a62d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:03.056439 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814564a-9f19-4059-bd3e-30d3976a62d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:03.057077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814564a-9f19-4059-bd3e-30d3976a62d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:03.057566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814564a-9f19-4059-bd3e-30d3976a62d8 admin admin] PATH_INFO: `/v3/users/7b5839d6ddf24d5fa2f431b5a460cde5` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:03.059067 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814564a-9f19-4059-bd3e-30d3976a62d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b5839d6ddf24d5fa2f431b5a460cde5)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:03.061457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814564a-9f19-4059-bd3e-30d3976a62d8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:03.105843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb9e7f-e099-4948-bac4-1fa718f63c45 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:03.135076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8814564a-9f19-4059-bd3e-30d3976a62d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b5839d6ddf24d5fa2f431b5a460cde5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:03.136344 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8814564a-9f19-4059-bd3e-30d3976a62d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b5839d6ddf24d5fa2f431b5a460cde5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:03.136923 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b7574-8424-4013-a1ac-3718be4e75cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:03.137563 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b7574-8424-4013-a1ac-3718be4e75cc service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:03.137782 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8814564a-9f19-4059-bd3e-30d3976a62d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b5839d6ddf24d5fa2f431b5a460cde5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:03.137911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b7574-8424-4013-a1ac-3718be4e75cc service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:03.138114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b7574-8424-4013-a1ac-3718be4e75cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:03.149107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8814564a-9f19-4059-bd3e-30d3976a62d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b5839d6ddf24d5fa2f431b5a460cde5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:03.150861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-fc6b7574-8424-4013-a1ac-3718be4e75cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:03.169087 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8814564a-9f19-4059-bd3e-30d3976a62d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b5839d6ddf24d5fa2f431b5a460cde5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:03.170871 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:03.194610 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1111/2241] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:55:02 2022] DELETE /identity/v3/users/7b5839d6ddf24d5fa2f431b5a460cde5 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:03.199748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b9fb5-9e02-45fa-9a9e-08bb4c2fd4b1 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:03.200438 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b9fb5-9e02-45fa-9a9e-08bb4c2fd4b1 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:03.201090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:03.202014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b9fb5-9e02-45fa-9a9e-08bb4c2fd4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:03.251058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-614b9fb5-9e02-45fa-9a9e-08bb4c2fd4b1 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:03.252732 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-614b9fb5-9e02-45fa-9a9e-08bb4c2fd4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:03.360231 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1112/2242] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:03.384814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b9fb5-9e02-45fa-9a9e-08bb4c2fd4b1 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:03.389431 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-614b9fb5-9e02-45fa-9a9e-08bb4c2fd4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:03.425731 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b7574-8424-4013-a1ac-3718be4e75cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:03.430267 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b7574-8424-4013-a1ac-3718be4e75cc service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:03.457318 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1131/2243] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:02 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:03.533758 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b9fb5-9e02-45fa-9a9e-08bb4c2fd4b1 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:03.546373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad074b9-5607-4460-944b-ce7069e03b5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:03.547034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad074b9-5607-4460-944b-ce7069e03b5a service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:03.547318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad074b9-5607-4460-944b-ce7069e03b5a service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:03.547863 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad074b9-5607-4460-944b-ce7069e03b5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:03.568425 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad074b9-5607-4460-944b-ce7069e03b5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:03.569947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad074b9-5607-4460-944b-ce7069e03b5a service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:03.581753 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1113/2244] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:55:03.680482 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b7574-8424-4013-a1ac-3718be4e75cc service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:03.681939 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-fc6b7574-8424-4013-a1ac-3718be4e75cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:03.726974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b7574-8424-4013-a1ac-3718be4e75cc service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:03.888663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d462b2-a61b-4e1f-a2ee-8ebc330cf5b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:03.889474 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d462b2-a61b-4e1f-a2ee-8ebc330cf5b9 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:03.889860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d462b2-a61b-4e1f-a2ee-8ebc330cf5b9 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:03.890849 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d462b2-a61b-4e1f-a2ee-8ebc330cf5b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:03.892527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-86d462b2-a61b-4e1f-a2ee-8ebc330cf5b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:04.048280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d462b2-a61b-4e1f-a2ee-8ebc330cf5b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:04.053685 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d462b2-a61b-4e1f-a2ee-8ebc330cf5b9 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:04.079099 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1132/2245] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:03 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:55:04.756280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad074b9-5607-4460-944b-ce7069e03b5a service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:04.775218 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad074b9-5607-4460-944b-ce7069e03b5a service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:04.793770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae361a5-fdda-4d4f-98b0-eb6a45e417b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:04.794518 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae361a5-fdda-4d4f-98b0-eb6a45e417b3 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:04.796162 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae361a5-fdda-4d4f-98b0-eb6a45e417b3 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:04.796526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae361a5-fdda-4d4f-98b0-eb6a45e417b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:04.813272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-bae361a5-fdda-4d4f-98b0-eb6a45e417b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:04.925036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d462b2-a61b-4e1f-a2ee-8ebc330cf5b9 service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:04.928412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-86d462b2-a61b-4e1f-a2ee-8ebc330cf5b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:04.958519 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d462b2-a61b-4e1f-a2ee-8ebc330cf5b9 service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:04.979376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843f9f1-f085-40f0-baf9-aea4e3220e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:04.980716 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843f9f1-f085-40f0-baf9-aea4e3220e9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:04.981007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843f9f1-f085-40f0-baf9-aea4e3220e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:04.981271 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843f9f1-f085-40f0-baf9-aea4e3220e9e admin admin] PATH_INFO: `/v3/users/18b3487bd7d34fa7a7973680a4b90070` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:04.997933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e843f9f1-f085-40f0-baf9-aea4e3220e9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=18b3487bd7d34fa7a7973680a4b90070)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:04.999378 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae361a5-fdda-4d4f-98b0-eb6a45e417b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:05.014043 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e843f9f1-f085-40f0-baf9-aea4e3220e9e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:05.018278 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae361a5-fdda-4d4f-98b0-eb6a45e417b3 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:05.055379 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1114/2246] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:04 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:05.131539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:05.161594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e843f9f1-f085-40f0-baf9-aea4e3220e9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18b3487bd7d34fa7a7973680a4b90070'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:05.180458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e843f9f1-f085-40f0-baf9-aea4e3220e9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18b3487bd7d34fa7a7973680a4b90070'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:05.181237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e843f9f1-f085-40f0-baf9-aea4e3220e9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18b3487bd7d34fa7a7973680a4b90070'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:05.182038 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e843f9f1-f085-40f0-baf9-aea4e3220e9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18b3487bd7d34fa7a7973680a4b90070'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:05.205734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e843f9f1-f085-40f0-baf9-aea4e3220e9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18b3487bd7d34fa7a7973680a4b90070'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:05.248650 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1133/2247] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:55:04 2022] DELETE /identity/v3/users/18b3487bd7d34fa7a7973680a4b90070 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:55:05.251149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9581162-9509-4628-a51c-16dba2a5262c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:05.251504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9581162-9509-4628-a51c-16dba2a5262c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:05.251853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9581162-9509-4628-a51c-16dba2a5262c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:05.313792 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d9581162-9509-4628-a51c-16dba2a5262c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:05.317679 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d9581162-9509-4628-a51c-16dba2a5262c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:05.387349 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:05.478957 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1115/2248] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:05.562098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843f9f1-f085-40f0-baf9-aea4e3220e9e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:05.568243 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e843f9f1-f085-40f0-baf9-aea4e3220e9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:05.711437 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843f9f1-f085-40f0-baf9-aea4e3220e9e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:05.717065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbfb06-bdf8-458d-87d3-d2a8558e1040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:05.717904 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbfb06-bdf8-458d-87d3-d2a8558e1040 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:05.718193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbfb06-bdf8-458d-87d3-d2a8558e1040 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:05.718469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbfb06-bdf8-458d-87d3-d2a8558e1040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:05.730721 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fbfb06-bdf8-458d-87d3-d2a8558e1040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:05.734185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fbfb06-bdf8-458d-87d3-d2a8558e1040 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:05.737983 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9581162-9509-4628-a51c-16dba2a5262c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:05.741509 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d9581162-9509-4628-a51c-16dba2a5262c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:05.750854 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1134/2249] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:05.760610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9581162-9509-4628-a51c-16dba2a5262c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:05.768087 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0390625-c2b9-4286-8f51-9b53f6501ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:05.769099 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0390625-c2b9-4286-8f51-9b53f6501ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:05.769480 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0390625-c2b9-4286-8f51-9b53f6501ead admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:05.769855 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0390625-c2b9-4286-8f51-9b53f6501ead admin admin] PATH_INFO: `/v3/projects/d219b0cd08c34c29a278ba6f0924d4be` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:05.771665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0390625-c2b9-4286-8f51-9b53f6501ead admin admin] RBAC: Authorizing `identity:delete_project(project_id=d219b0cd08c34c29a278ba6f0924d4be)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:05.776091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0390625-c2b9-4286-8f51-9b53f6501ead admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:05.876233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c0390625-c2b9-4286-8f51-9b53f6501ead admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd219b0cd08c34c29a278ba6f0924d4be', 'request_id': 'req-c0390625-c2b9-4286-8f51-9b53f6501ead'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:05.884460 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c0390625-c2b9-4286-8f51-9b53f6501ead admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd219b0cd08c34c29a278ba6f0924d4be', 'request_id': 'req-c0390625-c2b9-4286-8f51-9b53f6501ead'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:05.893577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c0390625-c2b9-4286-8f51-9b53f6501ead admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd219b0cd08c34c29a278ba6f0924d4be', 'request_id': 'req-c0390625-c2b9-4286-8f51-9b53f6501ead'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:05.922384 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c0390625-c2b9-4286-8f51-9b53f6501ead admin admin] The token cache is being invalidate because project d219b0cd08c34c29a278ba6f0924d4be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:55:05.923047 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c0390625-c2b9-4286-8f51-9b53f6501ead admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:05.924011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c0390625-c2b9-4286-8f51-9b53f6501ead admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:05.926110 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1116/2250] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:55:05 2022] DELETE /identity/v3/projects/d219b0cd08c34c29a278ba6f0924d4be => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:05.930444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbfb06-bdf8-458d-87d3-d2a8558e1040 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:05.951088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbfb06-bdf8-458d-87d3-d2a8558e1040 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:06.099133 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4a02f-77b3-4d16-9df2-3254a8f19207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:06.100169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4a02f-77b3-4d16-9df2-3254a8f19207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:06.100702 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4a02f-77b3-4d16-9df2-3254a8f19207 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:06.101231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4a02f-77b3-4d16-9df2-3254a8f19207 admin admin] PATH_INFO: `/v3/users/29f3c93c6b2c4254a094d2c4d316d104` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:06.103115 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4a02f-77b3-4d16-9df2-3254a8f19207 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29f3c93c6b2c4254a094d2c4d316d104)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:06.106111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4a02f-77b3-4d16-9df2-3254a8f19207 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:06.207554 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e3e4a02f-77b3-4d16-9df2-3254a8f19207 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29f3c93c6b2c4254a094d2c4d316d104'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:06.217049 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e3e4a02f-77b3-4d16-9df2-3254a8f19207 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29f3c93c6b2c4254a094d2c4d316d104'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:06.218099 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e3e4a02f-77b3-4d16-9df2-3254a8f19207 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29f3c93c6b2c4254a094d2c4d316d104'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:06.218762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e3e4a02f-77b3-4d16-9df2-3254a8f19207 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29f3c93c6b2c4254a094d2c4d316d104'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:06.221078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:06.233339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e3e4a02f-77b3-4d16-9df2-3254a8f19207 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29f3c93c6b2c4254a094d2c4d316d104'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:06.269239 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1135/2251] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:55:05 2022] DELETE /identity/v3/users/29f3c93c6b2c4254a094d2c4d316d104 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:06.614922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b4396-b38f-4279-983d-9460a0e5c8e0 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:06.615426 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b4396-b38f-4279-983d-9460a0e5c8e0 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:06.615936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b4396-b38f-4279-983d-9460a0e5c8e0 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:06.619123 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1117/2252] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 20:55:06 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:55:06.630050 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e828865-ecef-4172-b719-6d9acc887c03 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:06.630607 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e828865-ecef-4172-b719-6d9acc887c03 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:06.631055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e828865-ecef-4172-b719-6d9acc887c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:06.700795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-0e828865-ecef-4172-b719-6d9acc887c03 None None] MFA Rules not processed for user `174e91100a184740b7c604730266dc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:06.705706 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0e828865-ecef-4172-b719-6d9acc887c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:06.741760 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b4396-b38f-4279-983d-9460a0e5c8e0 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:06.745018 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d48b4396-b38f-4279-983d-9460a0e5c8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:06.831726 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1136/2253] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 20:55:06 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:55:06.832846 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e828865-ecef-4172-b719-6d9acc887c03 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:06.834491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0e828865-ecef-4172-b719-6d9acc887c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:06.850931 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e828865-ecef-4172-b719-6d9acc887c03 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:06.853190 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b4396-b38f-4279-983d-9460a0e5c8e0 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:06.857399 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84472c5-b2de-4b2a-9004-ad49acbcb29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:06.858254 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84472c5-b2de-4b2a-9004-ad49acbcb29e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:06.858692 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84472c5-b2de-4b2a-9004-ad49acbcb29e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:06.859072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84472c5-b2de-4b2a-9004-ad49acbcb29e admin admin] PATH_INFO: `/v3/users/f413813531e94602959dbf30f21bdd45` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:06.860320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84472c5-b2de-4b2a-9004-ad49acbcb29e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f413813531e94602959dbf30f21bdd45)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:06.861096 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74cc62b-4bfb-44d1-b732-12feb5d89938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:06.862030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cc62b-4bfb-44d1-b732-12feb5d89938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:06.862472 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cc62b-4bfb-44d1-b732-12feb5d89938 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:06.862912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cc62b-4bfb-44d1-b732-12feb5d89938 admin admin] PATH_INFO: `/v3/projects/1b84646871dd443ba7e666f4b3731881` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:06.863228 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84472c5-b2de-4b2a-9004-ad49acbcb29e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:06.864412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74cc62b-4bfb-44d1-b732-12feb5d89938 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b84646871dd443ba7e666f4b3731881)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:06.867838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74cc62b-4bfb-44d1-b732-12feb5d89938 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:06.961928 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e74cc62b-4bfb-44d1-b732-12feb5d89938 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b84646871dd443ba7e666f4b3731881', 'request_id': 'req-e74cc62b-4bfb-44d1-b732-12feb5d89938'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:06.968140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:06.970457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e74cc62b-4bfb-44d1-b732-12feb5d89938 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b84646871dd443ba7e666f4b3731881', 'request_id': 'req-e74cc62b-4bfb-44d1-b732-12feb5d89938'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:06.980729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d84472c5-b2de-4b2a-9004-ad49acbcb29e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f413813531e94602959dbf30f21bdd45'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:06.985117 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e74cc62b-4bfb-44d1-b732-12feb5d89938 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b84646871dd443ba7e666f4b3731881', 'request_id': 'req-e74cc62b-4bfb-44d1-b732-12feb5d89938'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:06.991774 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d84472c5-b2de-4b2a-9004-ad49acbcb29e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f413813531e94602959dbf30f21bdd45'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:06.993166 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d84472c5-b2de-4b2a-9004-ad49acbcb29e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f413813531e94602959dbf30f21bdd45'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:06.994115 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d84472c5-b2de-4b2a-9004-ad49acbcb29e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f413813531e94602959dbf30f21bdd45'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:07.004490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e74cc62b-4bfb-44d1-b732-12feb5d89938 admin admin] The token cache is being invalidate because project 1b84646871dd443ba7e666f4b3731881 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:55:07.005775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e74cc62b-4bfb-44d1-b732-12feb5d89938 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:07.005775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e74cc62b-4bfb-44d1-b732-12feb5d89938 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:07.008154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d84472c5-b2de-4b2a-9004-ad49acbcb29e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f413813531e94602959dbf30f21bdd45'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:07.009304 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1118/2254] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:55:06 2022] DELETE /identity/v3/projects/1b84646871dd443ba7e666f4b3731881 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:07.012470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74cc62b-4bfb-44d1-b732-12feb5d89938 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:07.013943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e74cc62b-4bfb-44d1-b732-12feb5d89938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:07.039947 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1137/2255] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:55:06 2022] DELETE /identity/v3/users/f413813531e94602959dbf30f21bdd45 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:07.041044 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84472c5-b2de-4b2a-9004-ad49acbcb29e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:07.043368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d84472c5-b2de-4b2a-9004-ad49acbcb29e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:07.093225 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74cc62b-4bfb-44d1-b732-12feb5d89938 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:07.121596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:07.128801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84472c5-b2de-4b2a-9004-ad49acbcb29e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:07.136885 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad4ddb-e8a1-4c80-b1d2-a5745d189951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:07.137665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad4ddb-e8a1-4c80-b1d2-a5745d189951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:07.139071 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad4ddb-e8a1-4c80-b1d2-a5745d189951 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:07.139071 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad4ddb-e8a1-4c80-b1d2-a5745d189951 admin admin] PATH_INFO: `/v3/users/8a75fa1c20ae4a23b7430f0be242eae5` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:07.140652 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad4ddb-e8a1-4c80-b1d2-a5745d189951 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a75fa1c20ae4a23b7430f0be242eae5)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:07.142864 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad4ddb-e8a1-4c80-b1d2-a5745d189951 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:07.169862 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304a826-fd25-4144-86c4-b78bbcc93097 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:07.170694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304a826-fd25-4144-86c4-b78bbcc93097 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:07.170983 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304a826-fd25-4144-86c4-b78bbcc93097 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:07.171255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304a826-fd25-4144-86c4-b78bbcc93097 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:07.173429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e304a826-fd25-4144-86c4-b78bbcc93097 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:07.185491 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304a826-fd25-4144-86c4-b78bbcc93097 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:07.187234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304a826-fd25-4144-86c4-b78bbcc93097 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:07.209475 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1119/2256] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:07.210811 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a151643-4775-4654-bcc8-32e3dec8d5c2 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:07.211099 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a151643-4775-4654-bcc8-32e3dec8d5c2 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:07.211375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a151643-4775-4654-bcc8-32e3dec8d5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:07.239504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-9a151643-4775-4654-bcc8-32e3dec8d5c2 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:07.241621 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9a151643-4775-4654-bcc8-32e3dec8d5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:07.250839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f9ad4ddb-e8a1-4c80-b1d2-a5745d189951 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a75fa1c20ae4a23b7430f0be242eae5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:07.258523 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1120/2257] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:07.261096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f9ad4ddb-e8a1-4c80-b1d2-a5745d189951 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a75fa1c20ae4a23b7430f0be242eae5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:07.262100 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f9ad4ddb-e8a1-4c80-b1d2-a5745d189951 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a75fa1c20ae4a23b7430f0be242eae5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:07.262975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f9ad4ddb-e8a1-4c80-b1d2-a5745d189951 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a75fa1c20ae4a23b7430f0be242eae5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:07.274061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f9ad4ddb-e8a1-4c80-b1d2-a5745d189951 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a75fa1c20ae4a23b7430f0be242eae5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:07.317296 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1138/2258] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:55:07 2022] DELETE /identity/v3/users/8a75fa1c20ae4a23b7430f0be242eae5 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:07.346281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a151643-4775-4654-bcc8-32e3dec8d5c2 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:07.347958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9a151643-4775-4654-bcc8-32e3dec8d5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:07.372455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a151643-4775-4654-bcc8-32e3dec8d5c2 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:07.522713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8749cf6-55ca-43ec-84f9-92fc3c5a5095 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:07.523539 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8749cf6-55ca-43ec-84f9-92fc3c5a5095 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:07.523805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad4ddb-e8a1-4c80-b1d2-a5745d189951 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:07.524155 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8749cf6-55ca-43ec-84f9-92fc3c5a5095 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:07.524571 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8749cf6-55ca-43ec-84f9-92fc3c5a5095 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:07.525648 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f9ad4ddb-e8a1-4c80-b1d2-a5745d189951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:07.536127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a8749cf6-55ca-43ec-84f9-92fc3c5a5095 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:07.690587 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:07.701621 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad4ddb-e8a1-4c80-b1d2-a5745d189951 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:07.715972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c9062-67f3-4d31-b70a-c73063b06467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:07.716600 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c9062-67f3-4d31-b70a-c73063b06467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:07.717004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c9062-67f3-4d31-b70a-c73063b06467 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:07.717283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c9062-67f3-4d31-b70a-c73063b06467 admin admin] PATH_INFO: `/v3/projects/d7e8493d642b4a68b086f68d1a93f2ee` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:07.717734 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8749cf6-55ca-43ec-84f9-92fc3c5a5095 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:07.719043 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0c9062-67f3-4d31-b70a-c73063b06467 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7e8493d642b4a68b086f68d1a93f2ee)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:07.721538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0c9062-67f3-4d31-b70a-c73063b06467 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:07.722846 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8749cf6-55ca-43ec-84f9-92fc3c5a5095 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:07.764448 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1121/2259] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:07.829741 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-db0c9062-67f3-4d31-b70a-c73063b06467 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7e8493d642b4a68b086f68d1a93f2ee', 'request_id': 'req-db0c9062-67f3-4d31-b70a-c73063b06467'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:07.836110 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-db0c9062-67f3-4d31-b70a-c73063b06467 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7e8493d642b4a68b086f68d1a93f2ee', 'request_id': 'req-db0c9062-67f3-4d31-b70a-c73063b06467'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:07.854110 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-db0c9062-67f3-4d31-b70a-c73063b06467 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7e8493d642b4a68b086f68d1a93f2ee', 'request_id': 'req-db0c9062-67f3-4d31-b70a-c73063b06467'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:07.895031 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-db0c9062-67f3-4d31-b70a-c73063b06467 admin admin] The token cache is being invalidate because project d7e8493d642b4a68b086f68d1a93f2ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:55:07.897360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-db0c9062-67f3-4d31-b70a-c73063b06467 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:07.902634 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-db0c9062-67f3-4d31-b70a-c73063b06467 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:07.905733 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1139/2260] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:55:07 2022] DELETE /identity/v3/projects/d7e8493d642b4a68b086f68d1a93f2ee => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:55:07.910468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee974a-3ff9-4eb8-a59e-5ddaf6e5a593 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:07.910969 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee974a-3ff9-4eb8-a59e-5ddaf6e5a593 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:07.911059 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee974a-3ff9-4eb8-a59e-5ddaf6e5a593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:07.950275 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ccd52-8c07-4c98-b387-a1b122d374e7 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:07.951230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ccd52-8c07-4c98-b387-a1b122d374e7 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:07.951230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ccd52-8c07-4c98-b387-a1b122d374e7 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:07.952947 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1140/2261] 10.222.0.33 () {54 vars in 921 bytes} [Sat Aug 6 20:55:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:55:07.957979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-36ee974a-3ff9-4eb8-a59e-5ddaf6e5a593 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:07.959464 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-36ee974a-3ff9-4eb8-a59e-5ddaf6e5a593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:07.968413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d7a3c-d64f-47f9-8a38-9493f2d096fe None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:07.968788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d7a3c-d64f-47f9-8a38-9493f2d096fe None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:07.969169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d7a3c-d64f-47f9-8a38-9493f2d096fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:07.981463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:08.006380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-0e3d7a3c-d64f-47f9-8a38-9493f2d096fe None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:08.013598 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0e3d7a3c-d64f-47f9-8a38-9493f2d096fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:08.128606 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1141/2262] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 20:55:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:08.129807 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1122/2263] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:08.141305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3db0e-fae7-4a3d-a1ce-bcca5d3145cc None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:08.142339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3db0e-fae7-4a3d-a1ce-bcca5d3145cc None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:08.142772 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3db0e-fae7-4a3d-a1ce-bcca5d3145cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:08.163387 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee974a-3ff9-4eb8-a59e-5ddaf6e5a593 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:08.164922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-36ee974a-3ff9-4eb8-a59e-5ddaf6e5a593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:08.165047 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-daf3db0e-fae7-4a3d-a1ce-bcca5d3145cc None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:08.166307 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-daf3db0e-fae7-4a3d-a1ce-bcca5d3145cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:08.180525 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1142/2264] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:08.181613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3db0e-fae7-4a3d-a1ce-bcca5d3145cc None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:08.191381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee974a-3ff9-4eb8-a59e-5ddaf6e5a593 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:08.192070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3db0e-fae7-4a3d-a1ce-bcca5d3145cc None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:08.206884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b40ca-c775-4810-a295-e571a7251705 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:08.207615 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b40ca-c775-4810-a295-e571a7251705 service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:08.207904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b40ca-c775-4810-a295-e571a7251705 service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:08.208258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b40ca-c775-4810-a295-e571a7251705 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:08.212204 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3db0b-061d-45e7-9a6a-1e94b39b3837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:08.212990 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3db0b-061d-45e7-9a6a-1e94b39b3837 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:08.213936 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3db0b-061d-45e7-9a6a-1e94b39b3837 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:08.214408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3db0b-061d-45e7-9a6a-1e94b39b3837 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:08.215453 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad3db0b-061d-45e7-9a6a-1e94b39b3837 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:55:08.215870 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad3db0b-061d-45e7-9a6a-1e94b39b3837 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:08.218493 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad3db0b-061d-45e7-9a6a-1e94b39b3837 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:08.225388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b40ca-c775-4810-a295-e571a7251705 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:08.227052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b40ca-c775-4810-a295-e571a7251705 service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:08.236423 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1143/2265] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:55:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:55:08.237470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3db0b-061d-45e7-9a6a-1e94b39b3837 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:08.249661 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3db0b-061d-45e7-9a6a-1e94b39b3837 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:08.253834 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1123/2266] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:08.258205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c68fd2-267f-4086-a23f-92d403dedc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:08.260506 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c68fd2-267f-4086-a23f-92d403dedc39 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:08.261611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c68fd2-267f-4086-a23f-92d403dedc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:08.262197 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c68fd2-267f-4086-a23f-92d403dedc39 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:08.262646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c68fd2-267f-4086-a23f-92d403dedc39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:08.265373 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c68fd2-267f-4086-a23f-92d403dedc39 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:08.317518 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1144/2267] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:55:08 2022] POST /identity/v3/projects => generated 383 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:08.321544 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b40ca-c775-4810-a295-e571a7251705 service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:08.341723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b40ca-c775-4810-a295-e571a7251705 service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:08.510028 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765c478-7eba-4597-b07b-4ba5689bc751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:08.510571 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765c478-7eba-4597-b07b-4ba5689bc751 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:08.511454 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765c478-7eba-4597-b07b-4ba5689bc751 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:08.512061 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765c478-7eba-4597-b07b-4ba5689bc751 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:08.512701 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1765c478-7eba-4597-b07b-4ba5689bc751 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:08.515056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1765c478-7eba-4597-b07b-4ba5689bc751 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:08.586864 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1124/2268] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:55:08 2022] POST /identity/v3/users => generated 292 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:08.591781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c68fd2-267f-4086-a23f-92d403dedc39 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:08.617908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c68fd2-267f-4086-a23f-92d403dedc39 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:08.618812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765c478-7eba-4597-b07b-4ba5689bc751 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:08.636076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54cc06-353b-40e0-acc0-dae422959992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:08.637426 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54cc06-353b-40e0-acc0-dae422959992 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:08.639603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54cc06-353b-40e0-acc0-dae422959992 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:08.640211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54cc06-353b-40e0-acc0-dae422959992 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:08.644094 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54cc06-353b-40e0-acc0-dae422959992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:08.648757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54cc06-353b-40e0-acc0-dae422959992 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:08.704482 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1145/2269] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:08.709401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54cc06-353b-40e0-acc0-dae422959992 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:08.746467 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54cc06-353b-40e0-acc0-dae422959992 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:08.750339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765c478-7eba-4597-b07b-4ba5689bc751 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:08.762425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264271f6-abda-4956-8802-b3cce16ac881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:08.763078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264271f6-abda-4956-8802-b3cce16ac881 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:08.763361 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264271f6-abda-4956-8802-b3cce16ac881 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:08.763632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264271f6-abda-4956-8802-b3cce16ac881 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:08.764285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264271f6-abda-4956-8802-b3cce16ac881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:08.767173 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264271f6-abda-4956-8802-b3cce16ac881 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:08.774261 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614d068-cf08-4870-be7d-d34d4e872482 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:08.786343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614d068-cf08-4870-be7d-d34d4e872482 service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:08.786659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614d068-cf08-4870-be7d-d34d4e872482 service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:08.786939 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614d068-cf08-4870-be7d-d34d4e872482 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:08.790682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8614d068-cf08-4870-be7d-d34d4e872482 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:08.808237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:08.815888 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1146/2270] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:08.816982 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264271f6-abda-4956-8802-b3cce16ac881 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:08.821205 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8614d068-cf08-4870-be7d-d34d4e872482 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:08.827132 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8614d068-cf08-4870-be7d-d34d4e872482 service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:08.839464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264271f6-abda-4956-8802-b3cce16ac881 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:08.849427 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1125/2271] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:08.851043 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5672e-46c8-4bc6-b56b-caae4712e961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:08.851728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5672e-46c8-4bc6-b56b-caae4712e961 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:08.852007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5672e-46c8-4bc6-b56b-caae4712e961 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:08.852282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5672e-46c8-4bc6-b56b-caae4712e961 admin admin] PATH_INFO: `/v3/projects/80de26a83f844824b1a7412ba537095b/users/5e045fe9d063419b870efc8f06311372/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:08.901537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5672e-46c8-4bc6-b56b-caae4712e961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80de26a83f844824b1a7412ba537095b, user_id=5e045fe9d063419b870efc8f06311372, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:08.910194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5672e-46c8-4bc6-b56b-caae4712e961 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:08.956595 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1147/2272] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:55:08 2022] PUT /identity/v3/projects/80de26a83f844824b1a7412ba537095b/users/5e045fe9d063419b870efc8f06311372/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:08.957322 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cffee-8f3d-43a7-bb19-13d89a522094 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:08.957783 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cffee-8f3d-43a7-bb19-13d89a522094 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:08.958335 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cffee-8f3d-43a7-bb19-13d89a522094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:09.052759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-013cffee-8f3d-43a7-bb19-13d89a522094 None None] MFA Rules not processed for user `5e045fe9d063419b870efc8f06311372`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:09.056086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-013cffee-8f3d-43a7-bb19-13d89a522094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:09.256830 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1126/2273] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:09.261990 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5672e-46c8-4bc6-b56b-caae4712e961 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:09.405727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cffee-8f3d-43a7-bb19-13d89a522094 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:09.407223 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-013cffee-8f3d-43a7-bb19-13d89a522094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:09.475663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5672e-46c8-4bc6-b56b-caae4712e961 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:09.503332 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ba205-ff12-414e-9e50-a2827feb27ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:09.505584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ba205-ff12-414e-9e50-a2827feb27ed admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:09.507518 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ba205-ff12-414e-9e50-a2827feb27ed admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:09.507826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ba205-ff12-414e-9e50-a2827feb27ed admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:09.508494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ba205-ff12-414e-9e50-a2827feb27ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:09.521613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ba205-ff12-414e-9e50-a2827feb27ed admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:09.597784 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:09.661177 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1148/2274] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:55:09 2022] POST /identity/v3/projects => generated 381 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:09.662032 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ba205-ff12-414e-9e50-a2827feb27ed admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:09.700604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cffee-8f3d-43a7-bb19-13d89a522094 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:09.894671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88709c2a-79c2-4243-89bc-185d37f91386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:09.905231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88709c2a-79c2-4243-89bc-185d37f91386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:09.905517 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88709c2a-79c2-4243-89bc-185d37f91386 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:09.906805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88709c2a-79c2-4243-89bc-185d37f91386 admin admin] PATH_INFO: `/v3/projects/7eecc25d54984aeebebdf41fdfc1004d` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:09.910402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ba205-ff12-414e-9e50-a2827feb27ed admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:09.911675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88709c2a-79c2-4243-89bc-185d37f91386 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eecc25d54984aeebebdf41fdfc1004d)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:09.923643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a26c7-e9d0-40ea-9d47-612325c91910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:09.924382 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88709c2a-79c2-4243-89bc-185d37f91386 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:09.927373 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a26c7-e9d0-40ea-9d47-612325c91910 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:09.927823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a26c7-e9d0-40ea-9d47-612325c91910 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:09.928108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a26c7-e9d0-40ea-9d47-612325c91910 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:09.928823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a26c7-e9d0-40ea-9d47-612325c91910 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:09.932501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a26c7-e9d0-40ea-9d47-612325c91910 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:09.967899 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1149/2275] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:55:09 2022] POST /identity/v3/users => generated 297 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:09.969750 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14fa21-7348-4372-a5ed-5d793eb3b529 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:09.970143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14fa21-7348-4372-a5ed-5d793eb3b529 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:09.970951 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14fa21-7348-4372-a5ed-5d793eb3b529 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:09.988059 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1150/2276] 10.222.0.33 () {54 vars in 921 bytes} [Sat Aug 6 20:55:09 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:55:09.988932 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14fa21-7348-4372-a5ed-5d793eb3b529 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:10.025588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:10.031700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14fa21-7348-4372-a5ed-5d793eb3b529 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:10.058229 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-88709c2a-79c2-4243-89bc-185d37f91386 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eecc25d54984aeebebdf41fdfc1004d', 'request_id': 'req-88709c2a-79c2-4243-89bc-185d37f91386'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:10.078336 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-88709c2a-79c2-4243-89bc-185d37f91386 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eecc25d54984aeebebdf41fdfc1004d', 'request_id': 'req-88709c2a-79c2-4243-89bc-185d37f91386'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:10.096163 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-88709c2a-79c2-4243-89bc-185d37f91386 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eecc25d54984aeebebdf41fdfc1004d', 'request_id': 'req-88709c2a-79c2-4243-89bc-185d37f91386'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:10.130200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-88709c2a-79c2-4243-89bc-185d37f91386 admin admin] The token cache is being invalidate because project 7eecc25d54984aeebebdf41fdfc1004d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:55:10.130596 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-88709c2a-79c2-4243-89bc-185d37f91386 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:10.132238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-88709c2a-79c2-4243-89bc-185d37f91386 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:10.141278 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1127/2277] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:55:09 2022] DELETE /identity/v3/projects/7eecc25d54984aeebebdf41fdfc1004d => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:55:10.141278 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca68e7-5147-4a5e-ba49-c610b257b58b None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:10.141278 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca68e7-5147-4a5e-ba49-c610b257b58b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:10.142950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca68e7-5147-4a5e-ba49-c610b257b58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:10.185983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac94d8-6f9d-4407-bd9f-172d73e7af5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:10.186380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac94d8-6f9d-4407-bd9f-172d73e7af5e admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:10.186710 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac94d8-6f9d-4407-bd9f-172d73e7af5e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:10.186989 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac94d8-6f9d-4407-bd9f-172d73e7af5e admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:10.187650 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac94d8-6f9d-4407-bd9f-172d73e7af5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:10.189272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac94d8-6f9d-4407-bd9f-172d73e7af5e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:10.196586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-04ca68e7-5147-4a5e-ba49-c610b257b58b None None] MFA Rules not processed for user `5f9d53147a57402f8b9818590bc1fc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:10.200800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-04ca68e7-5147-4a5e-ba49-c610b257b58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:10.238134 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1151/2278] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:10.240351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b54e51-7b4d-4917-8e42-3e3c72523270 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:10.240635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b54e51-7b4d-4917-8e42-3e3c72523270 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:10.241163 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b54e51-7b4d-4917-8e42-3e3c72523270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:10.279001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-47b54e51-7b4d-4917-8e42-3e3c72523270 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:10.281024 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-47b54e51-7b4d-4917-8e42-3e3c72523270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:10.305573 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1152/2279] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:10.307980 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b54e51-7b4d-4917-8e42-3e3c72523270 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:10.315530 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-47b54e51-7b4d-4917-8e42-3e3c72523270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:10.346450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b54e51-7b4d-4917-8e42-3e3c72523270 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:10.363171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10ce4e-891e-4419-bca7-b5dae050926d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:10.363860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10ce4e-891e-4419-bca7-b5dae050926d admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:10.364143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10ce4e-891e-4419-bca7-b5dae050926d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:10.364421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10ce4e-891e-4419-bca7-b5dae050926d admin admin] PATH_INFO: `/v3/projects/b98e097cb9454952a141adeca3001917/users/8169225269a54db3a7b9eb0f80e3b89c/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:10.369450 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1128/2280] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 20:55:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:10.370920 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f38a3-e102-4747-b0c4-8e396f88d451 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:10.371210 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f38a3-e102-4747-b0c4-8e396f88d451 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:10.371483 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f38a3-e102-4747-b0c4-8e396f88d451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:10.403266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10ce4e-891e-4419-bca7-b5dae050926d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b98e097cb9454952a141adeca3001917, user_id=8169225269a54db3a7b9eb0f80e3b89c, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:10.410353 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10ce4e-891e-4419-bca7-b5dae050926d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:10.423487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-5a3f38a3-e102-4747-b0c4-8e396f88d451 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:10.431317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5a3f38a3-e102-4747-b0c4-8e396f88d451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:10.439305 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1153/2281] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:55:10 2022] PUT /identity/v3/projects/b98e097cb9454952a141adeca3001917/users/8169225269a54db3a7b9eb0f80e3b89c/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:10.441046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10ce4e-891e-4419-bca7-b5dae050926d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:10.567055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:10.585358 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1129/2282] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:10.589857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f38a3-e102-4747-b0c4-8e396f88d451 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:10.590246 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10ce4e-891e-4419-bca7-b5dae050926d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:10.607681 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03f433-32bf-4d0c-ad50-2340884250e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:10.608392 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03f433-32bf-4d0c-ad50-2340884250e7 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:10.608664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03f433-32bf-4d0c-ad50-2340884250e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:10.608942 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03f433-32bf-4d0c-ad50-2340884250e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:10.609603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03f433-32bf-4d0c-ad50-2340884250e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:10.610148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f38a3-e102-4747-b0c4-8e396f88d451 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:10.611281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03f433-32bf-4d0c-ad50-2340884250e7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:10.624828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95957cb1-c0ee-44a7-89c6-e257440d544d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:10.626613 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95957cb1-c0ee-44a7-89c6-e257440d544d admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:10.626828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95957cb1-c0ee-44a7-89c6-e257440d544d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:10.628624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95957cb1-c0ee-44a7-89c6-e257440d544d admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:10.629741 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95957cb1-c0ee-44a7-89c6-e257440d544d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:55:10.630066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95957cb1-c0ee-44a7-89c6-e257440d544d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:10.634338 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95957cb1-c0ee-44a7-89c6-e257440d544d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:10.641433 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1154/2283] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:10.645553 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03f433-32bf-4d0c-ad50-2340884250e7 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:10.661046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03f433-32bf-4d0c-ad50-2340884250e7 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:10.662358 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1130/2284] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:55:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:55:10.666439 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95957cb1-c0ee-44a7-89c6-e257440d544d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:10.680950 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d6419-badd-48f6-b600-e7c13c735c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:10.681662 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d6419-badd-48f6-b600-e7c13c735c44 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:10.681915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d6419-badd-48f6-b600-e7c13c735c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:10.683301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d6419-badd-48f6-b600-e7c13c735c44 admin admin] PATH_INFO: `/v3/projects/b98e097cb9454952a141adeca3001917/users/8169225269a54db3a7b9eb0f80e3b89c/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:10.685708 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d6419-badd-48f6-b600-e7c13c735c44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b98e097cb9454952a141adeca3001917, user_id=8169225269a54db3a7b9eb0f80e3b89c, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:10.688330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95957cb1-c0ee-44a7-89c6-e257440d544d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:10.688466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d6419-badd-48f6-b600-e7c13c735c44 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:10.704192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b0110-585b-442e-b24e-23910d33ec9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:10.704903 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b0110-585b-442e-b24e-23910d33ec9a admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:10.705189 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b0110-585b-442e-b24e-23910d33ec9a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:10.705468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b0110-585b-442e-b24e-23910d33ec9a admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:10.708270 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85b0110-585b-442e-b24e-23910d33ec9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:10.711511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85b0110-585b-442e-b24e-23910d33ec9a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:10.730882 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1155/2285] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:55:10 2022] PUT /identity/v3/projects/b98e097cb9454952a141adeca3001917/users/8169225269a54db3a7b9eb0f80e3b89c/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:55:10.733141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d0afb-c13b-4899-934a-8a09ac352d62 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:10.733433 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d0afb-c13b-4899-934a-8a09ac352d62 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:10.733714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d0afb-c13b-4899-934a-8a09ac352d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:10.797736 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1131/2286] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:55:10 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:55:10.798728 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b0110-585b-442e-b24e-23910d33ec9a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:10.803479 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d85b0110-585b-442e-b24e-23910d33ec9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:10.810783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-dc4d0afb-c13b-4899-934a-8a09ac352d62 None None] MFA Rules not processed for user `8169225269a54db3a7b9eb0f80e3b89c`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:10.815023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-dc4d0afb-c13b-4899-934a-8a09ac352d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:10.855230 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:11.045755 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1156/2287] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:10 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:55:11.047751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d0afb-c13b-4899-934a-8a09ac352d62 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:11.088860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b0110-585b-442e-b24e-23910d33ec9a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:11.118172 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643af87b-726f-41ca-83d2-3d8eb723b0c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:11.119195 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643af87b-726f-41ca-83d2-3d8eb723b0c4 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:11.119195 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643af87b-726f-41ca-83d2-3d8eb723b0c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:11.131993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643af87b-726f-41ca-83d2-3d8eb723b0c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:11.355335 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d0afb-c13b-4899-934a-8a09ac352d62 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:11.366899 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06bc610-60b1-4072-810b-76a7db79540d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:11.367527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bc610-60b1-4072-810b-76a7db79540d admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:11.370152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bc610-60b1-4072-810b-76a7db79540d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:11.370460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bc610-60b1-4072-810b-76a7db79540d admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:11.373211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06bc610-60b1-4072-810b-76a7db79540d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:11.375088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06bc610-60b1-4072-810b-76a7db79540d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:11.413170 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643af87b-726f-41ca-83d2-3d8eb723b0c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:11.423595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643af87b-726f-41ca-83d2-3d8eb723b0c4 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:11.431283 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1157/2288] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:55:11 2022] POST /identity/v3/users => generated 287 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:11.436843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06bc610-60b1-4072-810b-76a7db79540d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:11.457568 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1132/2289] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:11.460693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06bc610-60b1-4072-810b-76a7db79540d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:11.479794 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970f090-9047-4c8b-8376-767a102d2159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:11.480607 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970f090-9047-4c8b-8376-767a102d2159 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:11.480991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970f090-9047-4c8b-8376-767a102d2159 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:11.481370 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970f090-9047-4c8b-8376-767a102d2159 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:11.482135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970f090-9047-4c8b-8376-767a102d2159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:11.483891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970f090-9047-4c8b-8376-767a102d2159 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:11.502503 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1158/2290] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:11.506535 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643af87b-726f-41ca-83d2-3d8eb723b0c4 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:11.520078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643af87b-726f-41ca-83d2-3d8eb723b0c4 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:11.532336 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb6109-16f1-41e4-8dbe-be50ce994b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:11.534687 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb6109-16f1-41e4-8dbe-be50ce994b2c admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:11.534977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb6109-16f1-41e4-8dbe-be50ce994b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:11.535246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb6109-16f1-41e4-8dbe-be50ce994b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:11.538751 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb6109-16f1-41e4-8dbe-be50ce994b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:11.541400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb6109-16f1-41e4-8dbe-be50ce994b2c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:11.569147 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6bc23-ec01-4072-ad84-55569cb6d2e4 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:11.569563 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6bc23-ec01-4072-ad84-55569cb6d2e4 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:11.569948 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6bc23-ec01-4072-ad84-55569cb6d2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:11.588155 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1133/2291] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:11.592361 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb6109-16f1-41e4-8dbe-be50ce994b2c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:11.607677 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-2ae6bc23-ec01-4072-ad84-55569cb6d2e4 None None] MFA Rules not processed for user `174e91100a184740b7c604730266dc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:11.609041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2ae6bc23-ec01-4072-ad84-55569cb6d2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:11.614413 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb6109-16f1-41e4-8dbe-be50ce994b2c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:11.626497 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934979c-2935-449d-aba3-49f210873f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:11.626941 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934979c-2935-449d-aba3-49f210873f9d admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:11.627224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934979c-2935-449d-aba3-49f210873f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:11.627490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934979c-2935-449d-aba3-49f210873f9d admin admin] PATH_INFO: `/v3/projects/f60674e881dc407296dd58e190b26164/users/e9067baeaf4a422b85297540fa940079/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:11.628022 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1159/2292] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 20:55:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:55:11.655331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7934979c-2935-449d-aba3-49f210873f9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f60674e881dc407296dd58e190b26164, user_id=e9067baeaf4a422b85297540fa940079, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:11.674361 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6bc23-ec01-4072-ad84-55569cb6d2e4 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:11.681861 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7934979c-2935-449d-aba3-49f210873f9d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:11.686833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6bc23-ec01-4072-ad84-55569cb6d2e4 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:11.700465 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc13122-0050-4433-8563-9e22e967023e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:11.702540 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc13122-0050-4433-8563-9e22e967023e service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:11.704671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc13122-0050-4433-8563-9e22e967023e service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:11.705230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc13122-0050-4433-8563-9e22e967023e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:11.731603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc13122-0050-4433-8563-9e22e967023e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:11.732446 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1134/2293] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:55:11 2022] PUT /identity/v3/projects/f60674e881dc407296dd58e190b26164/users/e9067baeaf4a422b85297540fa940079/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:55:11.734537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de92f8c-95b6-4262-8a28-95e18c895fc6 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:11.735104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de92f8c-95b6-4262-8a28-95e18c895fc6 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:11.735532 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc13122-0050-4433-8563-9e22e967023e service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:11.735954 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de92f8c-95b6-4262-8a28-95e18c895fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:11.759985 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1160/2294] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:55:11.782180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-4de92f8c-95b6-4262-8a28-95e18c895fc6 None None] MFA Rules not processed for user `e9067baeaf4a422b85297540fa940079`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:11.783737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4de92f8c-95b6-4262-8a28-95e18c895fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:11.956440 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1135/2295] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:11.957257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc13122-0050-4433-8563-9e22e967023e service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:11.971990 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc13122-0050-4433-8563-9e22e967023e service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:12.009367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:12.068757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea60eb-1324-4025-b507-1c167955b8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:12.069773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea60eb-1324-4025-b507-1c167955b8c6 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:12.070151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea60eb-1324-4025-b507-1c167955b8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:12.070569 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea60eb-1324-4025-b507-1c167955b8c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:12.071301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea60eb-1324-4025-b507-1c167955b8c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:12.074220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea60eb-1324-4025-b507-1c167955b8c6 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:12.111629 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1161/2296] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:55:11 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:55:12.115529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de92f8c-95b6-4262-8a28-95e18c895fc6 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:12.139379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de92f8c-95b6-4262-8a28-95e18c895fc6 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:12.154572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:12.208354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea60eb-1324-4025-b507-1c167955b8c6 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:12.210742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-44ea60eb-1324-4025-b507-1c167955b8c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:12.289413 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1088eb-6593-47fb-8bac-80e4e294ae81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:12.290084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1088eb-6593-47fb-8bac-80e4e294ae81 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:12.290370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1088eb-6593-47fb-8bac-80e4e294ae81 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:12.290701 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1088eb-6593-47fb-8bac-80e4e294ae81 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:12.291333 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1088eb-6593-47fb-8bac-80e4e294ae81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:12.295435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1088eb-6593-47fb-8bac-80e4e294ae81 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:12.338235 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1136/2297] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:55:12 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:12.339737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1088eb-6593-47fb-8bac-80e4e294ae81 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:12.341927 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5c1088eb-6593-47fb-8bac-80e4e294ae81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:12.366090 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1088eb-6593-47fb-8bac-80e4e294ae81 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:12.374481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d47ee-6262-416d-b5e7-f0c867f8fd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:12.376059 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d47ee-6262-416d-b5e7-f0c867f8fd6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:12.376519 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d47ee-6262-416d-b5e7-f0c867f8fd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:12.376630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d47ee-6262-416d-b5e7-f0c867f8fd6f admin admin] PATH_INFO: `/v3/projects/489f9cb65a0f40a383398c05d84b45f3` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:12.377985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d47ee-6262-416d-b5e7-f0c867f8fd6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=489f9cb65a0f40a383398c05d84b45f3)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:12.381312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d47ee-6262-416d-b5e7-f0c867f8fd6f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:12.407891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea60eb-1324-4025-b507-1c167955b8c6 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:12.425363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6c36c-6e9f-4825-b2d3-c6f560ae4234 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:12.426691 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6c36c-6e9f-4825-b2d3-c6f560ae4234 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:12.427156 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6c36c-6e9f-4825-b2d3-c6f560ae4234 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:12.427440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6c36c-6e9f-4825-b2d3-c6f560ae4234 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:12.531594 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-db2d47ee-6262-416d-b5e7-f0c867f8fd6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '489f9cb65a0f40a383398c05d84b45f3', 'request_id': 'req-db2d47ee-6262-416d-b5e7-f0c867f8fd6f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:12.537128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6c36c-6e9f-4825-b2d3-c6f560ae4234 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:12.539075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6c36c-6e9f-4825-b2d3-c6f560ae4234 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:12.548921 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-db2d47ee-6262-416d-b5e7-f0c867f8fd6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '489f9cb65a0f40a383398c05d84b45f3', 'request_id': 'req-db2d47ee-6262-416d-b5e7-f0c867f8fd6f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:12.567289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-db2d47ee-6262-416d-b5e7-f0c867f8fd6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '489f9cb65a0f40a383398c05d84b45f3', 'request_id': 'req-db2d47ee-6262-416d-b5e7-f0c867f8fd6f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:12.582960 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1162/2298] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:12 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:12.585982 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6c36c-6e9f-4825-b2d3-c6f560ae4234 service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:12.596109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-db2d47ee-6262-416d-b5e7-f0c867f8fd6f admin admin] The token cache is being invalidate because project 489f9cb65a0f40a383398c05d84b45f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:55:12.596504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-db2d47ee-6262-416d-b5e7-f0c867f8fd6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:12.597314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-db2d47ee-6262-416d-b5e7-f0c867f8fd6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:12.604215 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1137/2299] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:55:12 2022] DELETE /identity/v3/projects/489f9cb65a0f40a383398c05d84b45f3 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:12.613576 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d47ee-6262-416d-b5e7-f0c867f8fd6f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:12.616692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-db2d47ee-6262-416d-b5e7-f0c867f8fd6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:12.628761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6c36c-6e9f-4825-b2d3-c6f560ae4234 service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:12.725556 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:12.787949 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5ce0e-418f-4a10-b30c-9e70de8f8813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:12.793067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5ce0e-418f-4a10-b30c-9e70de8f8813 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:12.793378 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5ce0e-418f-4a10-b30c-9e70de8f8813 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:12.793607 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5ce0e-418f-4a10-b30c-9e70de8f8813 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:12.795248 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a5ce0e-418f-4a10-b30c-9e70de8f8813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:12.800386 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a5ce0e-418f-4a10-b30c-9e70de8f8813 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:12.807195 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d47ee-6262-416d-b5e7-f0c867f8fd6f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:12.823538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b7320-e8d1-4ef5-9ccb-079da8dbcf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:12.824538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b7320-e8d1-4ef5-9ccb-079da8dbcf56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:12.827784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b7320-e8d1-4ef5-9ccb-079da8dbcf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:12.827784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b7320-e8d1-4ef5-9ccb-079da8dbcf56 admin admin] PATH_INFO: `/v3/users/58ecd3be3f3b429da58912f0a742608e` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:12.827784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b7320-e8d1-4ef5-9ccb-079da8dbcf56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58ecd3be3f3b429da58912f0a742608e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:12.828097 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1163/2300] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:12.829309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5ce0e-418f-4a10-b30c-9e70de8f8813 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:12.829522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b7320-e8d1-4ef5-9ccb-079da8dbcf56 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:12.834225 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c8a5ce0e-418f-4a10-b30c-9e70de8f8813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:12.865921 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5ce0e-418f-4a10-b30c-9e70de8f8813 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:12.879864 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2f22b-2cf8-4064-aef7-c1f776467140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:12.881112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2f22b-2cf8-4064-aef7-c1f776467140 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:12.881393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2f22b-2cf8-4064-aef7-c1f776467140 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:12.881663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2f22b-2cf8-4064-aef7-c1f776467140 admin admin] PATH_INFO: `/v3/projects/8a412509105c4736b912d323ac3f659a/users/da19d3c4fc114a119e37c77464934eec/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:12.912959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:12.929608 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2f22b-2cf8-4064-aef7-c1f776467140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a412509105c4736b912d323ac3f659a, user_id=da19d3c4fc114a119e37c77464934eec, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:12.939933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2f22b-2cf8-4064-aef7-c1f776467140 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:12.962108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b02b7320-e8d1-4ef5-9ccb-079da8dbcf56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58ecd3be3f3b429da58912f0a742608e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:12.964191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b02b7320-e8d1-4ef5-9ccb-079da8dbcf56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58ecd3be3f3b429da58912f0a742608e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:12.967090 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b02b7320-e8d1-4ef5-9ccb-079da8dbcf56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58ecd3be3f3b429da58912f0a742608e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:12.976299 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1164/2301] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:55:12 2022] PUT /identity/v3/projects/8a412509105c4736b912d323ac3f659a/users/da19d3c4fc114a119e37c77464934eec/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:12.980954 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2f22b-2cf8-4064-aef7-c1f776467140 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:12.983175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9fe2f22b-2cf8-4064-aef7-c1f776467140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:12.991157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b02b7320-e8d1-4ef5-9ccb-079da8dbcf56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58ecd3be3f3b429da58912f0a742608e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:13.036361 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b02b7320-e8d1-4ef5-9ccb-079da8dbcf56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58ecd3be3f3b429da58912f0a742608e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:13.084852 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1138/2302] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:55:12 2022] DELETE /identity/v3/users/58ecd3be3f3b429da58912f0a742608e => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:13.134836 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2f22b-2cf8-4064-aef7-c1f776467140 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:13.277299 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a22d8-9603-4ed1-9552-ddccd0286d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:13.277931 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a22d8-9603-4ed1-9552-ddccd0286d58 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:13.278206 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a22d8-9603-4ed1-9552-ddccd0286d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:13.278532 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a22d8-9603-4ed1-9552-ddccd0286d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:13.279891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a22d8-9603-4ed1-9552-ddccd0286d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:13.281542 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a22d8-9603-4ed1-9552-ddccd0286d58 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:13.301815 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1165/2303] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:13.305679 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b7320-e8d1-4ef5-9ccb-079da8dbcf56 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:13.336828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b7320-e8d1-4ef5-9ccb-079da8dbcf56 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:13.342658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ddce87-abe1-4b4c-a592-f324e5b65d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:13.344792 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddce87-abe1-4b4c-a592-f324e5b65d3f admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:13.345209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddce87-abe1-4b4c-a592-f324e5b65d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:13.345680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddce87-abe1-4b4c-a592-f324e5b65d3f admin admin] PATH_INFO: `/v3/projects/8a412509105c4736b912d323ac3f659a/users/da19d3c4fc114a119e37c77464934eec/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:13.348451 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ddce87-abe1-4b4c-a592-f324e5b65d3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a412509105c4736b912d323ac3f659a, user_id=da19d3c4fc114a119e37c77464934eec, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:13.351643 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ddce87-abe1-4b4c-a592-f324e5b65d3f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:13.384398 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1139/2304] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:55:13 2022] PUT /identity/v3/projects/8a412509105c4736b912d323ac3f659a/users/da19d3c4fc114a119e37c77464934eec/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:13.397447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2783ff-6192-49b6-945f-340765e7aa38 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:13.397711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2783ff-6192-49b6-945f-340765e7aa38 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:13.398136 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2783ff-6192-49b6-945f-340765e7aa38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:13.473091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-ae2783ff-6192-49b6-945f-340765e7aa38 None None] MFA Rules not processed for user `da19d3c4fc114a119e37c77464934eec`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:13.474608 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ae2783ff-6192-49b6-945f-340765e7aa38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:13.556573 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:13.599863 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1166/2305] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:13.611489 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd3619-bad9-4f17-9640-4b37b1173e56 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:13.611863 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd3619-bad9-4f17-9640-4b37b1173e56 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:13.612098 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd3619-bad9-4f17-9640-4b37b1173e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:13.640937 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-13bd3619-bad9-4f17-9640-4b37b1173e56 None None] MFA Rules not processed for user `e9067baeaf4a422b85297540fa940079`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:13.642615 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-13bd3619-bad9-4f17-9640-4b37b1173e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:13.784087 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1140/2306] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:13.864930 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2783ff-6192-49b6-945f-340765e7aa38 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:13.866909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ae2783ff-6192-49b6-945f-340765e7aa38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:14.040522 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2783ff-6192-49b6-945f-340765e7aa38 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:14.049455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d994d-7598-4149-9954-8f20b0db8e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:14.050110 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d994d-7598-4149-9954-8f20b0db8e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:14.050385 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d994d-7598-4149-9954-8f20b0db8e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:14.050692 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d994d-7598-4149-9954-8f20b0db8e8c admin admin] PATH_INFO: `/v3/users/5e045fe9d063419b870efc8f06311372` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:14.051879 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d994d-7598-4149-9954-8f20b0db8e8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e045fe9d063419b870efc8f06311372)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:14.054577 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d994d-7598-4149-9954-8f20b0db8e8c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:14.152595 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a50d994d-7598-4149-9954-8f20b0db8e8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e045fe9d063419b870efc8f06311372'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:14.161797 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a50d994d-7598-4149-9954-8f20b0db8e8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e045fe9d063419b870efc8f06311372'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:14.162971 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a50d994d-7598-4149-9954-8f20b0db8e8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e045fe9d063419b870efc8f06311372'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:14.164044 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a50d994d-7598-4149-9954-8f20b0db8e8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e045fe9d063419b870efc8f06311372'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:14.181124 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a50d994d-7598-4149-9954-8f20b0db8e8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e045fe9d063419b870efc8f06311372'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:14.234380 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1167/2307] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:55:13 2022] DELETE /identity/v3/users/5e045fe9d063419b870efc8f06311372 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:14.236368 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328aeff4-d6ed-4887-bae9-519abbbffc6c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:14.237914 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328aeff4-d6ed-4887-bae9-519abbbffc6c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:14.237914 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328aeff4-d6ed-4887-bae9-519abbbffc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:14.279298 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-328aeff4-d6ed-4887-bae9-519abbbffc6c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:14.283125 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-328aeff4-d6ed-4887-bae9-519abbbffc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:14.435234 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1141/2308] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:14.459993 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d994d-7598-4149-9954-8f20b0db8e8c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:14.461807 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a50d994d-7598-4149-9954-8f20b0db8e8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:14.591622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328aeff4-d6ed-4887-bae9-519abbbffc6c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:14.593094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-328aeff4-d6ed-4887-bae9-519abbbffc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:14.688566 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d994d-7598-4149-9954-8f20b0db8e8c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:14.694120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa7991-cdf5-465e-aba6-2168ea88373c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:14.694829 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa7991-cdf5-465e-aba6-2168ea88373c service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:14.695090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa7991-cdf5-465e-aba6-2168ea88373c service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:14.695370 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa7991-cdf5-465e-aba6-2168ea88373c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:14.722765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa7991-cdf5-465e-aba6-2168ea88373c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:14.725018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa7991-cdf5-465e-aba6-2168ea88373c service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:14.737711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:14.751783 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1168/2309] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:55:14.812246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:14.915058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328aeff4-d6ed-4887-bae9-519abbbffc6c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:14.924706 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a19c1-00cd-4cd6-90f8-a56c5f9f3e1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:14.925496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a19c1-00cd-4cd6-90f8-a56c5f9f3e1d service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:14.925910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a19c1-00cd-4cd6-90f8-a56c5f9f3e1d service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:14.926279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a19c1-00cd-4cd6-90f8-a56c5f9f3e1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:14.928780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-888a19c1-00cd-4cd6-90f8-a56c5f9f3e1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:15.030442 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a19c1-00cd-4cd6-90f8-a56c5f9f3e1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:15.032335 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a19c1-00cd-4cd6-90f8-a56c5f9f3e1d service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:15.050515 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1142/2310] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:15.686723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa7991-cdf5-465e-aba6-2168ea88373c service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:15.688176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-bcfa7991-cdf5-465e-aba6-2168ea88373c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:15.709842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa7991-cdf5-465e-aba6-2168ea88373c service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:15.723309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b5012-4f9f-4d58-91e4-793faa5ff2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:15.724330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b5012-4f9f-4d58-91e4-793faa5ff2e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:15.725032 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b5012-4f9f-4d58-91e4-793faa5ff2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:15.725478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b5012-4f9f-4d58-91e4-793faa5ff2e0 admin admin] PATH_INFO: `/v3/projects/56223cc3fb6f4dda99ae403aa8f1b2d7` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:15.727448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b5012-4f9f-4d58-91e4-793faa5ff2e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56223cc3fb6f4dda99ae403aa8f1b2d7)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:15.729626 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b5012-4f9f-4d58-91e4-793faa5ff2e0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:15.806725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260f6eb-225b-4194-a2bc-201ef14a3fa9 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:15.807306 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260f6eb-225b-4194-a2bc-201ef14a3fa9 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:15.807440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260f6eb-225b-4194-a2bc-201ef14a3fa9 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:15.810668 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1143/2311] 10.222.0.33 () {54 vars in 921 bytes} [Sat Aug 6 20:55:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:55:15.883456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc8be3-76bb-498f-a8eb-61ab40cfbe1e None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:15.886209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc8be3-76bb-498f-a8eb-61ab40cfbe1e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:15.889004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc8be3-76bb-498f-a8eb-61ab40cfbe1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:15.892800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b66b5012-4f9f-4d58-91e4-793faa5ff2e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56223cc3fb6f4dda99ae403aa8f1b2d7', 'request_id': 'req-b66b5012-4f9f-4d58-91e4-793faa5ff2e0'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:15.913832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b66b5012-4f9f-4d58-91e4-793faa5ff2e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56223cc3fb6f4dda99ae403aa8f1b2d7', 'request_id': 'req-b66b5012-4f9f-4d58-91e4-793faa5ff2e0'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:15.929325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b66b5012-4f9f-4d58-91e4-793faa5ff2e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56223cc3fb6f4dda99ae403aa8f1b2d7', 'request_id': 'req-b66b5012-4f9f-4d58-91e4-793faa5ff2e0'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:15.946908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b66b5012-4f9f-4d58-91e4-793faa5ff2e0 admin admin] The token cache is being invalidate because project 56223cc3fb6f4dda99ae403aa8f1b2d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:55:15.947203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b66b5012-4f9f-4d58-91e4-793faa5ff2e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:15.947977 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b66b5012-4f9f-4d58-91e4-793faa5ff2e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:15.951566 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1169/2312] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:55:15 2022] DELETE /identity/v3/projects/56223cc3fb6f4dda99ae403aa8f1b2d7 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:15.956999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6674f5-9417-4d1e-9afb-da5b62e10367 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:15.958503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6674f5-9417-4d1e-9afb-da5b62e10367 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:15.959524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6674f5-9417-4d1e-9afb-da5b62e10367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:15.988054 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-b4cc8be3-76bb-498f-a8eb-61ab40cfbe1e None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:15.989309 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b4cc8be3-76bb-498f-a8eb-61ab40cfbe1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:16.017009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-bc6674f5-9417-4d1e-9afb-da5b62e10367 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:16.020237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-bc6674f5-9417-4d1e-9afb-da5b62e10367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:16.173983 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1170/2313] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:16.175753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4c565-8424-4dfc-9656-80c4f37ff9cf None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:16.176098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4c565-8424-4dfc-9656-80c4f37ff9cf None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:16.176537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4c565-8424-4dfc-9656-80c4f37ff9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:16.191867 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1144/2314] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 20:55:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:55:16.193248 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b776474-e78f-4bbd-842b-7a8c4d5a162c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:16.193884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b776474-e78f-4bbd-842b-7a8c4d5a162c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:16.194163 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b776474-e78f-4bbd-842b-7a8c4d5a162c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:16.219571 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-9b776474-e78f-4bbd-842b-7a8c4d5a162c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:16.221324 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9b776474-e78f-4bbd-842b-7a8c4d5a162c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:16.227164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-7ed4c565-8424-4dfc-9656-80c4f37ff9cf None None] MFA Rules not processed for user `b71dd466b4d140448e8bb188f9e72901`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:16.228583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7ed4c565-8424-4dfc-9656-80c4f37ff9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:16.234958 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1145/2315] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:16.240410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b776474-e78f-4bbd-842b-7a8c4d5a162c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:16.305804 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b776474-e78f-4bbd-842b-7a8c4d5a162c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:16.319633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a869326-1349-4a15-8aed-92392a133ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:16.320987 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a869326-1349-4a15-8aed-92392a133ffd admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:16.321417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a869326-1349-4a15-8aed-92392a133ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:16.328190 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a869326-1349-4a15-8aed-92392a133ffd admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:16.330989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a869326-1349-4a15-8aed-92392a133ffd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:55:16.331326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a869326-1349-4a15-8aed-92392a133ffd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:16.336838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a869326-1349-4a15-8aed-92392a133ffd admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:16.381671 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1171/2316] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:16 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:16.381671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4c565-8424-4dfc-9656-80c4f37ff9cf None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:16.381671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7ed4c565-8424-4dfc-9656-80c4f37ff9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:16.382961 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1146/2317] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:55:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:55:16.384154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a869326-1349-4a15-8aed-92392a133ffd admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:16.387359 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7a869326-1349-4a15-8aed-92392a133ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:16.407412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a869326-1349-4a15-8aed-92392a133ffd admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:16.425770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4c565-8424-4dfc-9656-80c4f37ff9cf None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:16.430446 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b4558-ec41-4720-b2cc-5fd06006a639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:16.431222 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b4558-ec41-4720-b2cc-5fd06006a639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:16.432053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b4558-ec41-4720-b2cc-5fd06006a639 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:16.432929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b4558-ec41-4720-b2cc-5fd06006a639 admin admin] PATH_INFO: `/v3/projects/80de26a83f844824b1a7412ba537095b` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:16.434136 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b4558-ec41-4720-b2cc-5fd06006a639 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80de26a83f844824b1a7412ba537095b)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:16.436213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b4558-ec41-4720-b2cc-5fd06006a639 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:16.447036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c4464-7a09-4a8e-9c6c-f23081402209 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:16.449661 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c4464-7a09-4a8e-9c6c-f23081402209 service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:16.449956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c4464-7a09-4a8e-9c6c-f23081402209 service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:16.450298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c4464-7a09-4a8e-9c6c-f23081402209 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:16.461021 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:16.464198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c4464-7a09-4a8e-9c6c-f23081402209 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:16.466171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c4464-7a09-4a8e-9c6c-f23081402209 service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:16.501790 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1172/2318] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:16.505550 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c4464-7a09-4a8e-9c6c-f23081402209 service placement] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:16.548089 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c4464-7a09-4a8e-9c6c-f23081402209 service placement] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:16.561967 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a20c08-885a-4a02-bb4e-75569e4bf26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:16.562623 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a20c08-885a-4a02-bb4e-75569e4bf26d admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:16.565063 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a20c08-885a-4a02-bb4e-75569e4bf26d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:16.565063 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a20c08-885a-4a02-bb4e-75569e4bf26d admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:16.565063 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a20c08-885a-4a02-bb4e-75569e4bf26d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:16.567959 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a20c08-885a-4a02-bb4e-75569e4bf26d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:16.635641 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1173/2319] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:55:16 2022] POST /identity/v3/projects => generated 391 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:16.639909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a20c08-885a-4a02-bb4e-75569e4bf26d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:16.685833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:16.697189 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f09b4558-ec41-4720-b2cc-5fd06006a639 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80de26a83f844824b1a7412ba537095b', 'request_id': 'req-f09b4558-ec41-4720-b2cc-5fd06006a639'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:16.719522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f09b4558-ec41-4720-b2cc-5fd06006a639 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80de26a83f844824b1a7412ba537095b', 'request_id': 'req-f09b4558-ec41-4720-b2cc-5fd06006a639'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:16.733198 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f09b4558-ec41-4720-b2cc-5fd06006a639 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80de26a83f844824b1a7412ba537095b', 'request_id': 'req-f09b4558-ec41-4720-b2cc-5fd06006a639'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:16.764673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f09b4558-ec41-4720-b2cc-5fd06006a639 admin admin] The token cache is being invalidate because project 80de26a83f844824b1a7412ba537095b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:55:16.764939 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f09b4558-ec41-4720-b2cc-5fd06006a639 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:16.766451 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f09b4558-ec41-4720-b2cc-5fd06006a639 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:16.774618 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1147/2320] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:55:16 2022] DELETE /identity/v3/projects/80de26a83f844824b1a7412ba537095b => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:16.784430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b4558-ec41-4720-b2cc-5fd06006a639 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:16.789384 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f09b4558-ec41-4720-b2cc-5fd06006a639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:16.797638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a20c08-885a-4a02-bb4e-75569e4bf26d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:16.811464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235ccdd-7667-4694-bc9a-3ad07186edd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:16.812091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235ccdd-7667-4694-bc9a-3ad07186edd1 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:16.812374 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235ccdd-7667-4694-bc9a-3ad07186edd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:16.812648 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235ccdd-7667-4694-bc9a-3ad07186edd1 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:16.813278 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f235ccdd-7667-4694-bc9a-3ad07186edd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:16.815252 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f235ccdd-7667-4694-bc9a-3ad07186edd1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:16.868751 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1174/2321] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:55:16 2022] POST /identity/v3/users => generated 296 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:55:16.875395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235ccdd-7667-4694-bc9a-3ad07186edd1 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:16.879943 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f235ccdd-7667-4694-bc9a-3ad07186edd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:16.904570 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235ccdd-7667-4694-bc9a-3ad07186edd1 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:16.912189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff656f-a805-4e78-8e2b-a428a5f1226e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:16.912961 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff656f-a805-4e78-8e2b-a428a5f1226e admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:16.914833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff656f-a805-4e78-8e2b-a428a5f1226e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:16.915823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff656f-a805-4e78-8e2b-a428a5f1226e admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:16.917561 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff656f-a805-4e78-8e2b-a428a5f1226e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:16.919619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff656f-a805-4e78-8e2b-a428a5f1226e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:16.935621 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1175/2322] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:16.937897 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff656f-a805-4e78-8e2b-a428a5f1226e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:16.956709 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff656f-a805-4e78-8e2b-a428a5f1226e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:16.959809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b4558-ec41-4720-b2cc-5fd06006a639 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:16.965377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebd37a-c7ea-4ec1-aae4-216c137aa5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:16.965989 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebd37a-c7ea-4ec1-aae4-216c137aa5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:16.966266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebd37a-c7ea-4ec1-aae4-216c137aa5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:16.966363 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47d582-ca5c-4d23-8f99-cdb21e9a3c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:16.966719 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebd37a-c7ea-4ec1-aae4-216c137aa5e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:16.967284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47d582-ca5c-4d23-8f99-cdb21e9a3c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:16.967406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebd37a-c7ea-4ec1-aae4-216c137aa5e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:16.969027 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47d582-ca5c-4d23-8f99-cdb21e9a3c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:16.969424 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47d582-ca5c-4d23-8f99-cdb21e9a3c99 admin admin] PATH_INFO: `/v3/users/8169225269a54db3a7b9eb0f80e3b89c` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:16.969554 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebd37a-c7ea-4ec1-aae4-216c137aa5e1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:16.971389 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47d582-ca5c-4d23-8f99-cdb21e9a3c99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8169225269a54db3a7b9eb0f80e3b89c)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:16.973588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47d582-ca5c-4d23-8f99-cdb21e9a3c99 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:16.984824 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1176/2323] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:16.985712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebd37a-c7ea-4ec1-aae4-216c137aa5e1 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:16.991429 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-37ebd37a-c7ea-4ec1-aae4-216c137aa5e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:17.064550 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bf47d582-ca5c-4d23-8f99-cdb21e9a3c99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8169225269a54db3a7b9eb0f80e3b89c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:17.067507 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bf47d582-ca5c-4d23-8f99-cdb21e9a3c99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8169225269a54db3a7b9eb0f80e3b89c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:17.068569 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bf47d582-ca5c-4d23-8f99-cdb21e9a3c99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8169225269a54db3a7b9eb0f80e3b89c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:17.085834 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bf47d582-ca5c-4d23-8f99-cdb21e9a3c99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8169225269a54db3a7b9eb0f80e3b89c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:17.111918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bf47d582-ca5c-4d23-8f99-cdb21e9a3c99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8169225269a54db3a7b9eb0f80e3b89c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:17.134626 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1148/2324] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:55:16 2022] DELETE /identity/v3/users/8169225269a54db3a7b9eb0f80e3b89c => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:17.134626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47d582-ca5c-4d23-8f99-cdb21e9a3c99 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:17.147101 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebd37a-c7ea-4ec1-aae4-216c137aa5e1 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:17.148839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-bf47d582-ca5c-4d23-8f99-cdb21e9a3c99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:17.218329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:17.267001 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:17.272001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982e811-fe52-4d4c-ab30-b31e355b263e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:17.272943 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982e811-fe52-4d4c-ab30-b31e355b263e service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:17.273437 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982e811-fe52-4d4c-ab30-b31e355b263e service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:17.273906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982e811-fe52-4d4c-ab30-b31e355b263e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:17.276981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e982e811-fe52-4d4c-ab30-b31e355b263e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:17.293902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47d582-ca5c-4d23-8f99-cdb21e9a3c99 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:17.302355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0588784-114b-45c1-a404-ad454a55dd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:17.303258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0588784-114b-45c1-a404-ad454a55dd2b admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:17.303634 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0588784-114b-45c1-a404-ad454a55dd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:17.304088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0588784-114b-45c1-a404-ad454a55dd2b admin admin] PATH_INFO: `/v3/projects/336956808662481388c99ed178fb5014/users/f689c9ee5919409d929c60172e711e3e/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:17.339935 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0588784-114b-45c1-a404-ad454a55dd2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=336956808662481388c99ed178fb5014, user_id=f689c9ee5919409d929c60172e711e3e, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:17.346650 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0588784-114b-45c1-a404-ad454a55dd2b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:17.380962 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1149/2325] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:55:17 2022] PUT /identity/v3/projects/336956808662481388c99ed178fb5014/users/f689c9ee5919409d929c60172e711e3e/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:17.393829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e485e-4cc2-4249-8f24-f19e58bde3b1 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:17.394125 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e485e-4cc2-4249-8f24-f19e58bde3b1 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:17.395612 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e485e-4cc2-4249-8f24-f19e58bde3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:17.454204 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982e811-fe52-4d4c-ab30-b31e355b263e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:17.458667 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982e811-fe52-4d4c-ab30-b31e355b263e service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:17.470397 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-b25e485e-4cc2-4249-8f24-f19e58bde3b1 None None] MFA Rules not processed for user `f689c9ee5919409d929c60172e711e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:17.473649 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b25e485e-4cc2-4249-8f24-f19e58bde3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:17.509205 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1177/2326] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:16 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:17.632277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982e811-fe52-4d4c-ab30-b31e355b263e service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:17.640236 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1150/2327] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:17 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:17.650966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982e811-fe52-4d4c-ab30-b31e355b263e service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:17.745049 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000b95f-b9c7-459f-8262-5b47ceefd967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:17.745786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000b95f-b9c7-459f-8262-5b47ceefd967 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:17.746119 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000b95f-b9c7-459f-8262-5b47ceefd967 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:17.746465 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000b95f-b9c7-459f-8262-5b47ceefd967 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:17.747193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b000b95f-b9c7-459f-8262-5b47ceefd967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:17.749262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b000b95f-b9c7-459f-8262-5b47ceefd967 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:17.808309 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1178/2328] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:55:17 2022] POST /identity/v3/projects => generated 391 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:55:17.812086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e485e-4cc2-4249-8f24-f19e58bde3b1 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:17.825184 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e485e-4cc2-4249-8f24-f19e58bde3b1 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:17.910383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5f9f2-ab8b-463f-b8ef-99bf77129864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:17.910937 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5f9f2-ab8b-463f-b8ef-99bf77129864 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:17.911795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5f9f2-ab8b-463f-b8ef-99bf77129864 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:17.912253 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5f9f2-ab8b-463f-b8ef-99bf77129864 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:17.913193 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5f9f2-ab8b-463f-b8ef-99bf77129864 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:17.915556 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5f9f2-ab8b-463f-b8ef-99bf77129864 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:17.950357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000b95f-b9c7-459f-8262-5b47ceefd967 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:17.952366 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b000b95f-b9c7-459f-8262-5b47ceefd967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:17.955664 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1151/2329] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:55:17 2022] POST /identity/v3/users => generated 302 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:17.957200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5f9f2-ab8b-463f-b8ef-99bf77129864 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:17.976262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5f9f2-ab8b-463f-b8ef-99bf77129864 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:17.989071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600be39a-1642-49ba-95a6-35ed2b97e3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:17.991102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600be39a-1642-49ba-95a6-35ed2b97e3da admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:17.991495 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600be39a-1642-49ba-95a6-35ed2b97e3da admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:17.992470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600be39a-1642-49ba-95a6-35ed2b97e3da admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:17.993255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600be39a-1642-49ba-95a6-35ed2b97e3da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:18.002815 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600be39a-1642-49ba-95a6-35ed2b97e3da admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:18.037057 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:18.046622 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1152/2330] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:18.048226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600be39a-1642-49ba-95a6-35ed2b97e3da admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:18.071032 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600be39a-1642-49ba-95a6-35ed2b97e3da admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:18.083861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000b95f-b9c7-459f-8262-5b47ceefd967 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:18.090210 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b718e9-40b5-4fb4-9f35-f887680d749a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:18.091525 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b718e9-40b5-4fb4-9f35-f887680d749a admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:18.092507 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b718e9-40b5-4fb4-9f35-f887680d749a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:18.093635 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b718e9-40b5-4fb4-9f35-f887680d749a admin admin] PATH_INFO: `/v3/projects/7dabd90de9a14d5f80e2d039b180397a/users/632eb9c904e54b868a4dc96fd1a24496/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:18.098901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fea7c5-1da2-407d-891c-936b31bc509a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:18.100415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fea7c5-1da2-407d-891c-936b31bc509a service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:18.101750 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fea7c5-1da2-407d-891c-936b31bc509a service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:18.102232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fea7c5-1da2-407d-891c-936b31bc509a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:18.111615 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f7fea7c5-1da2-407d-891c-936b31bc509a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:18.129785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b718e9-40b5-4fb4-9f35-f887680d749a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dabd90de9a14d5f80e2d039b180397a, user_id=632eb9c904e54b868a4dc96fd1a24496, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:18.133536 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b718e9-40b5-4fb4-9f35-f887680d749a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:18.174891 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1153/2331] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:55:18 2022] PUT /identity/v3/projects/7dabd90de9a14d5f80e2d039b180397a/users/632eb9c904e54b868a4dc96fd1a24496/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:18.178055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b718e9-40b5-4fb4-9f35-f887680d749a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:18.214077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:18.250180 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fea7c5-1da2-407d-891c-936b31bc509a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:18.251724 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fea7c5-1da2-407d-891c-936b31bc509a service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:18.265592 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1179/2332] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:17 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:55:18.298426 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b718e9-40b5-4fb4-9f35-f887680d749a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:18.305463 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fe78a-de3d-4b4f-9440-fea48d9542e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:18.305673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fe78a-de3d-4b4f-9440-fea48d9542e6 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:18.305934 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fe78a-de3d-4b4f-9440-fea48d9542e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:18.306265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fe78a-de3d-4b4f-9440-fea48d9542e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:18.308233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15fe78a-de3d-4b4f-9440-fea48d9542e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:18.310029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15fe78a-de3d-4b4f-9440-fea48d9542e6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:18.326632 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1154/2333] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:18.328952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fea7c5-1da2-407d-891c-936b31bc509a service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:18.342656 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fea7c5-1da2-407d-891c-936b31bc509a service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:18.366270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea83d2b-82af-4301-8ce2-c6a3fc614563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:18.366981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea83d2b-82af-4301-8ce2-c6a3fc614563 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:18.367260 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea83d2b-82af-4301-8ce2-c6a3fc614563 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:18.367538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea83d2b-82af-4301-8ce2-c6a3fc614563 admin admin] PATH_INFO: `/v3/projects/7dabd90de9a14d5f80e2d039b180397a/users/632eb9c904e54b868a4dc96fd1a24496/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:18.375432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea83d2b-82af-4301-8ce2-c6a3fc614563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dabd90de9a14d5f80e2d039b180397a, user_id=632eb9c904e54b868a4dc96fd1a24496, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:18.378111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea83d2b-82af-4301-8ce2-c6a3fc614563 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:18.435302 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1180/2334] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:55:18 2022] PUT /identity/v3/projects/7dabd90de9a14d5f80e2d039b180397a/users/632eb9c904e54b868a4dc96fd1a24496/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:18.435654 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73abf9-3cdf-46c7-9b11-daef33083a4a None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:18.436245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73abf9-3cdf-46c7-9b11-daef33083a4a None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:18.436544 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73abf9-3cdf-46c7-9b11-daef33083a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:18.488807 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea83d2b-82af-4301-8ce2-c6a3fc614563 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:18.490605 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1ea83d2b-82af-4301-8ce2-c6a3fc614563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:18.536320 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-cb73abf9-3cdf-46c7-9b11-daef33083a4a None None] MFA Rules not processed for user `632eb9c904e54b868a4dc96fd1a24496`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:18.549384 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-cb73abf9-3cdf-46c7-9b11-daef33083a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:18.634828 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea83d2b-82af-4301-8ce2-c6a3fc614563 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:18.647937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c330b-823b-440c-87e8-6cf8f81c687c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:18.649788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c330b-823b-440c-87e8-6cf8f81c687c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:18.650074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c330b-823b-440c-87e8-6cf8f81c687c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:18.651475 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c330b-823b-440c-87e8-6cf8f81c687c admin admin] PATH_INFO: `/v3/projects/b98e097cb9454952a141adeca3001917` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:18.655364 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c330b-823b-440c-87e8-6cf8f81c687c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b98e097cb9454952a141adeca3001917)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:18.661745 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c330b-823b-440c-87e8-6cf8f81c687c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:18.712877 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1155/2335] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:18 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:18.728685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73abf9-3cdf-46c7-9b11-daef33083a4a None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:18.730445 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-cb73abf9-3cdf-46c7-9b11-daef33083a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:18.779057 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fd9c330b-823b-440c-87e8-6cf8f81c687c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b98e097cb9454952a141adeca3001917', 'request_id': 'req-fd9c330b-823b-440c-87e8-6cf8f81c687c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:18.804360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fd9c330b-823b-440c-87e8-6cf8f81c687c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b98e097cb9454952a141adeca3001917', 'request_id': 'req-fd9c330b-823b-440c-87e8-6cf8f81c687c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:18.829207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fd9c330b-823b-440c-87e8-6cf8f81c687c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b98e097cb9454952a141adeca3001917', 'request_id': 'req-fd9c330b-823b-440c-87e8-6cf8f81c687c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:18.858798 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fd9c330b-823b-440c-87e8-6cf8f81c687c admin admin] The token cache is being invalidate because project b98e097cb9454952a141adeca3001917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:55:18.860444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fd9c330b-823b-440c-87e8-6cf8f81c687c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:18.863952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fd9c330b-823b-440c-87e8-6cf8f81c687c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:18.866097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73abf9-3cdf-46c7-9b11-daef33083a4a None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:18.867270 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1181/2336] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:55:18 2022] DELETE /identity/v3/projects/b98e097cb9454952a141adeca3001917 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:18.882137 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8252b3-792a-47ac-bd03-43b5b20a1d0f None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:18.882437 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8252b3-792a-47ac-bd03-43b5b20a1d0f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:18.884177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8252b3-792a-47ac-bd03-43b5b20a1d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:18.939698 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:18.961222 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-df8252b3-792a-47ac-bd03-43b5b20a1d0f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:18.962508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-df8252b3-792a-47ac-bd03-43b5b20a1d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:18.977634 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:19.013527 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca26af1-8e72-42cb-8f35-4ca4def80448 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:19.014027 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca26af1-8e72-42cb-8f35-4ca4def80448 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:19.014307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca26af1-8e72-42cb-8f35-4ca4def80448 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:19.016198 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca26af1-8e72-42cb-8f35-4ca4def80448 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:19.020882 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8ca26af1-8e72-42cb-8f35-4ca4def80448 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:19.120913 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1182/2337] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:19.130704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee3715-e87b-48a8-8265-be6995b20e0f None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:19.131338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee3715-e87b-48a8-8265-be6995b20e0f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:19.132390 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee3715-e87b-48a8-8265-be6995b20e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:19.180208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca26af1-8e72-42cb-8f35-4ca4def80448 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:19.181416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-17ee3715-e87b-48a8-8265-be6995b20e0f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:19.181909 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca26af1-8e72-42cb-8f35-4ca4def80448 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:19.183455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-17ee3715-e87b-48a8-8265-be6995b20e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:19.197348 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1183/2338] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:19.201704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee3715-e87b-48a8-8265-be6995b20e0f None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:19.202936 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1156/2339] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:18 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:55:19.212460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee3715-e87b-48a8-8265-be6995b20e0f None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:19.218206 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb4427-3bf0-46c4-a23d-2b73cb9ec6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:19.218955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb4427-3bf0-46c4-a23d-2b73cb9ec6cd admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:19.219251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb4427-3bf0-46c4-a23d-2b73cb9ec6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:19.219570 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb4427-3bf0-46c4-a23d-2b73cb9ec6cd admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:19.220420 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb4427-3bf0-46c4-a23d-2b73cb9ec6cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:55:19.220838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb4427-3bf0-46c4-a23d-2b73cb9ec6cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:19.222963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb4427-3bf0-46c4-a23d-2b73cb9ec6cd admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:19.238731 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1184/2340] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:55:19.242799 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca26af1-8e72-42cb-8f35-4ca4def80448 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:19.266277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca26af1-8e72-42cb-8f35-4ca4def80448 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:19.278579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14514c-0c71-4110-9ba8-cf68d5919bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:19.279313 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14514c-0c71-4110-9ba8-cf68d5919bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:19.279691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14514c-0c71-4110-9ba8-cf68d5919bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:19.280078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14514c-0c71-4110-9ba8-cf68d5919bc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:19.280822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14514c-0c71-4110-9ba8-cf68d5919bc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:19.283796 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14514c-0c71-4110-9ba8-cf68d5919bc9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:19.386957 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1157/2341] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:55:19 2022] POST /identity/v3/projects => generated 391 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:19.388451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb4427-3bf0-46c4-a23d-2b73cb9ec6cd admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:19.402239 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb4427-3bf0-46c4-a23d-2b73cb9ec6cd admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:19.610452 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4eca61-819f-4069-8a7f-5d33661544ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:19.612361 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4eca61-819f-4069-8a7f-5d33661544ae admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:19.613125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4eca61-819f-4069-8a7f-5d33661544ae admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:19.613418 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4eca61-819f-4069-8a7f-5d33661544ae admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:19.614257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4eca61-819f-4069-8a7f-5d33661544ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:19.618302 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4eca61-819f-4069-8a7f-5d33661544ae admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:19.698110 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1185/2342] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:55:19 2022] POST /identity/v3/users => generated 296 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:19.699811 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14514c-0c71-4110-9ba8-cf68d5919bc9 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:19.714271 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14514c-0c71-4110-9ba8-cf68d5919bc9 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:19.721331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26016f0-f4a0-4e1a-90e3-9e16c0281b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:19.722109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26016f0-f4a0-4e1a-90e3-9e16c0281b6e admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:19.722389 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26016f0-f4a0-4e1a-90e3-9e16c0281b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:19.722770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26016f0-f4a0-4e1a-90e3-9e16c0281b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:19.723483 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26016f0-f4a0-4e1a-90e3-9e16c0281b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:19.725267 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26016f0-f4a0-4e1a-90e3-9e16c0281b6e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:19.746636 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1158/2343] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:19.752908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4eca61-819f-4069-8a7f-5d33661544ae admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:19.769451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4eca61-819f-4069-8a7f-5d33661544ae admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:19.775752 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f1f5e-ca3f-43a6-ad36-54c211f396fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:19.777384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f1f5e-ca3f-43a6-ad36-54c211f396fe admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:19.777676 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f1f5e-ca3f-43a6-ad36-54c211f396fe admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:19.778002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f1f5e-ca3f-43a6-ad36-54c211f396fe admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:19.778970 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f1f5e-ca3f-43a6-ad36-54c211f396fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:19.782216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f1f5e-ca3f-43a6-ad36-54c211f396fe admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:19.796507 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1186/2344] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:19.800471 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26016f0-f4a0-4e1a-90e3-9e16c0281b6e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:19.818265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26016f0-f4a0-4e1a-90e3-9e16c0281b6e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:19.824953 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7ac85-e201-47bf-8569-0f26591df2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:19.826293 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7ac85-e201-47bf-8569-0f26591df2c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:19.826718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7ac85-e201-47bf-8569-0f26591df2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:19.827227 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7ac85-e201-47bf-8569-0f26591df2c6 admin admin] PATH_INFO: `/v3/projects/2529b39d48e2403289342cf1990d137a/users/b6acce050bac4026814c02509fac5aa7/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:19.859118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd7ac85-e201-47bf-8569-0f26591df2c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2529b39d48e2403289342cf1990d137a, user_id=b6acce050bac4026814c02509fac5aa7, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:19.868664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd7ac85-e201-47bf-8569-0f26591df2c6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:19.900169 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1159/2345] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:55:19 2022] PUT /identity/v3/projects/2529b39d48e2403289342cf1990d137a/users/b6acce050bac4026814c02509fac5aa7/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:19.912405 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30008b9-2f29-486a-ad37-4d15852a3b03 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:19.913527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30008b9-2f29-486a-ad37-4d15852a3b03 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:19.914027 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30008b9-2f29-486a-ad37-4d15852a3b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:19.968864 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b30008b9-2f29-486a-ad37-4d15852a3b03 None None] MFA Rules not processed for user `b6acce050bac4026814c02509fac5aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:19.970556 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b30008b9-2f29-486a-ad37-4d15852a3b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:20.114483 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:20.122187 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1187/2346] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:20.126033 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7ac85-e201-47bf-8569-0f26591df2c6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:20.313899 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30008b9-2f29-486a-ad37-4d15852a3b03 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:20.316681 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b30008b9-2f29-486a-ad37-4d15852a3b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:20.320108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7ac85-e201-47bf-8569-0f26591df2c6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:20.332965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc9197-1415-436f-9c1d-e74cb3084bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:20.333312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc9197-1415-436f-9c1d-e74cb3084bbe admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:20.333593 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc9197-1415-436f-9c1d-e74cb3084bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:20.333866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc9197-1415-436f-9c1d-e74cb3084bbe admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:20.334496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc9197-1415-436f-9c1d-e74cb3084bbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:20.336460 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc9197-1415-436f-9c1d-e74cb3084bbe admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:20.348459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30008b9-2f29-486a-ad37-4d15852a3b03 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:20.359285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651fcd6-8c62-4771-aaec-f3d98cd66967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:20.359901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651fcd6-8c62-4771-aaec-f3d98cd66967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:20.360182 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651fcd6-8c62-4771-aaec-f3d98cd66967 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:20.360894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651fcd6-8c62-4771-aaec-f3d98cd66967 admin admin] PATH_INFO: `/v3/users/f689c9ee5919409d929c60172e711e3e` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:20.361740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651fcd6-8c62-4771-aaec-f3d98cd66967 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f689c9ee5919409d929c60172e711e3e)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:20.363660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651fcd6-8c62-4771-aaec-f3d98cd66967 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:20.390265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:20.406619 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1160/2347] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:55:20 2022] POST /identity/v3/projects => generated 389 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:20.409660 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc9197-1415-436f-9c1d-e74cb3084bbe admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:20.513604 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e651fcd6-8c62-4771-aaec-f3d98cd66967 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f689c9ee5919409d929c60172e711e3e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:20.537729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e651fcd6-8c62-4771-aaec-f3d98cd66967 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f689c9ee5919409d929c60172e711e3e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:20.539344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e651fcd6-8c62-4771-aaec-f3d98cd66967 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f689c9ee5919409d929c60172e711e3e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:20.540216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e651fcd6-8c62-4771-aaec-f3d98cd66967 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f689c9ee5919409d929c60172e711e3e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:20.564405 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e651fcd6-8c62-4771-aaec-f3d98cd66967 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f689c9ee5919409d929c60172e711e3e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:20.598130 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1188/2348] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:55:20 2022] DELETE /identity/v3/users/f689c9ee5919409d929c60172e711e3e => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:55:20.603843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25309b3-5669-486a-acdd-86d8646320db None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:20.604488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25309b3-5669-486a-acdd-86d8646320db None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:20.606146 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25309b3-5669-486a-acdd-86d8646320db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:20.674352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc9197-1415-436f-9c1d-e74cb3084bbe admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:20.684984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d25309b3-5669-486a-acdd-86d8646320db None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:20.686223 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d25309b3-5669-486a-acdd-86d8646320db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:20.839435 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1189/2349] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:20.849882 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25309b3-5669-486a-acdd-86d8646320db None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:20.852968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d25309b3-5669-486a-acdd-86d8646320db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:20.946587 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25309b3-5669-486a-acdd-86d8646320db None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:20.952213 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a4ccd-d1e7-42ad-8a29-3f21f374b658 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:20.953347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a4ccd-d1e7-42ad-8a29-3f21f374b658 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:20.953749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a4ccd-d1e7-42ad-8a29-3f21f374b658 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:20.954133 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a4ccd-d1e7-42ad-8a29-3f21f374b658 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:20.966892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e976cd2-82cd-4733-8cda-af4e65acffef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:20.967784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e976cd2-82cd-4733-8cda-af4e65acffef admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:20.970031 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e976cd2-82cd-4733-8cda-af4e65acffef admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:20.970780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e976cd2-82cd-4733-8cda-af4e65acffef admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:20.971602 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e976cd2-82cd-4733-8cda-af4e65acffef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:20.972490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a4ccd-d1e7-42ad-8a29-3f21f374b658 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:20.974747 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a4ccd-d1e7-42ad-8a29-3f21f374b658 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:20.979599 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e976cd2-82cd-4733-8cda-af4e65acffef admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:20.992025 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1190/2350] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:21.039259 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1161/2351] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:55:20 2022] POST /identity/v3/users => generated 301 bytes in 629 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:21.043559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a4ccd-d1e7-42ad-8a29-3f21f374b658 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:21.045749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b96a4ccd-d1e7-42ad-8a29-3f21f374b658 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:21.084164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a4ccd-d1e7-42ad-8a29-3f21f374b658 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:21.112792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687b5e7-a77b-410e-98cb-fbdeaec9f8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:21.115356 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687b5e7-a77b-410e-98cb-fbdeaec9f8cd admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:21.119588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687b5e7-a77b-410e-98cb-fbdeaec9f8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:21.120005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687b5e7-a77b-410e-98cb-fbdeaec9f8cd admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:21.120801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0687b5e7-a77b-410e-98cb-fbdeaec9f8cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:21.123160 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0687b5e7-a77b-410e-98cb-fbdeaec9f8cd admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:21.154835 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1191/2352] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:21.156988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e976cd2-82cd-4733-8cda-af4e65acffef admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:21.175381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e976cd2-82cd-4733-8cda-af4e65acffef admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:21.188748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da270657-6540-4307-9571-5b4834fbc7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:21.190346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da270657-6540-4307-9571-5b4834fbc7cf admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:21.190676 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da270657-6540-4307-9571-5b4834fbc7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:21.192121 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da270657-6540-4307-9571-5b4834fbc7cf admin admin] PATH_INFO: `/v3/projects/7c33b1dbd593424db1a78dae7822146f/users/421ec919b39c4c05aa13592d52cbcf65/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:21.241591 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da270657-6540-4307-9571-5b4834fbc7cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c33b1dbd593424db1a78dae7822146f, user_id=421ec919b39c4c05aa13592d52cbcf65, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:21.241591 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da270657-6540-4307-9571-5b4834fbc7cf admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:21.272597 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1162/2353] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:55:21 2022] PUT /identity/v3/projects/7c33b1dbd593424db1a78dae7822146f/users/421ec919b39c4c05aa13592d52cbcf65/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:21.274211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687b5e7-a77b-410e-98cb-fbdeaec9f8cd admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:21.281799 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:21.294150 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687b5e7-a77b-410e-98cb-fbdeaec9f8cd admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:21.415417 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263a12b-a981-4d47-b7a4-67bfa60cf576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:21.416733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263a12b-a981-4d47-b7a4-67bfa60cf576 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:21.417112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263a12b-a981-4d47-b7a4-67bfa60cf576 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:21.417699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263a12b-a981-4d47-b7a4-67bfa60cf576 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:21.419239 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263a12b-a981-4d47-b7a4-67bfa60cf576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:21.421721 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263a12b-a981-4d47-b7a4-67bfa60cf576 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:21.439091 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1192/2354] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:55:21.444518 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da270657-6540-4307-9571-5b4834fbc7cf admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:21.461038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da270657-6540-4307-9571-5b4834fbc7cf admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:21.468488 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4a63a-817a-47e1-a7cd-5d2b6079edb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:21.470858 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4a63a-817a-47e1-a7cd-5d2b6079edb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:21.471264 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4a63a-817a-47e1-a7cd-5d2b6079edb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:21.471711 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4a63a-817a-47e1-a7cd-5d2b6079edb0 admin admin] PATH_INFO: `/v3/projects/7c33b1dbd593424db1a78dae7822146f/users/421ec919b39c4c05aa13592d52cbcf65/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:21.474191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a4a63a-817a-47e1-a7cd-5d2b6079edb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c33b1dbd593424db1a78dae7822146f, user_id=421ec919b39c4c05aa13592d52cbcf65, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:21.477530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a4a63a-817a-47e1-a7cd-5d2b6079edb0 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:21.489942 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1163/2355] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:55:21 2022] PUT /identity/v3/projects/7c33b1dbd593424db1a78dae7822146f/users/421ec919b39c4c05aa13592d52cbcf65/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:55:21.500620 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ca194-227a-4d53-8764-25d36a7098da None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:21.500976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ca194-227a-4d53-8764-25d36a7098da None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:21.501196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ca194-227a-4d53-8764-25d36a7098da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:21.549089 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-0f2ca194-227a-4d53-8764-25d36a7098da None None] MFA Rules not processed for user `421ec919b39c4c05aa13592d52cbcf65`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:21.552350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0f2ca194-227a-4d53-8764-25d36a7098da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:21.722290 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1193/2356] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:21 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:55:21.816285 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4a63a-817a-47e1-a7cd-5d2b6079edb0 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:21.824690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b4a4a63a-817a-47e1-a7cd-5d2b6079edb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:21.902563 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ca194-227a-4d53-8764-25d36a7098da None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:21.904190 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0f2ca194-227a-4d53-8764-25d36a7098da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:21.935036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4a63a-817a-47e1-a7cd-5d2b6079edb0 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:21.941465 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1840fe-2b1a-4c87-8cd3-7e4a666dbdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:21.942291 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1840fe-2b1a-4c87-8cd3-7e4a666dbdec admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:21.942751 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1840fe-2b1a-4c87-8cd3-7e4a666dbdec admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:21.943167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1840fe-2b1a-4c87-8cd3-7e4a666dbdec admin admin] PATH_INFO: `/v3/projects/336956808662481388c99ed178fb5014` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:21.944471 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1840fe-2b1a-4c87-8cd3-7e4a666dbdec admin admin] RBAC: Authorizing `identity:delete_project(project_id=336956808662481388c99ed178fb5014)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:21.946528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1840fe-2b1a-4c87-8cd3-7e4a666dbdec admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:21.949333 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:22.006690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ca194-227a-4d53-8764-25d36a7098da None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:22.013662 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dc1840fe-2b1a-4c87-8cd3-7e4a666dbdec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '336956808662481388c99ed178fb5014', 'request_id': 'req-dc1840fe-2b1a-4c87-8cd3-7e4a666dbdec'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:22.021485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dc1840fe-2b1a-4c87-8cd3-7e4a666dbdec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '336956808662481388c99ed178fb5014', 'request_id': 'req-dc1840fe-2b1a-4c87-8cd3-7e4a666dbdec'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:22.032508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dc1840fe-2b1a-4c87-8cd3-7e4a666dbdec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '336956808662481388c99ed178fb5014', 'request_id': 'req-dc1840fe-2b1a-4c87-8cd3-7e4a666dbdec'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:22.049092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:22.053171 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dc1840fe-2b1a-4c87-8cd3-7e4a666dbdec admin admin] The token cache is being invalidate because project 336956808662481388c99ed178fb5014 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:55:22.054150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dc1840fe-2b1a-4c87-8cd3-7e4a666dbdec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:22.055105 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dc1840fe-2b1a-4c87-8cd3-7e4a666dbdec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:22.062204 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1164/2357] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:55:21 2022] DELETE /identity/v3/projects/336956808662481388c99ed178fb5014 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:22.063649 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1840fe-2b1a-4c87-8cd3-7e4a666dbdec admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:22.067223 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-dc1840fe-2b1a-4c87-8cd3-7e4a666dbdec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:22.141453 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7bb9c-1f80-4e66-a6f8-ab7de6485c8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:22.142334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7bb9c-1f80-4e66-a6f8-ab7de6485c8a service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:22.142334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7bb9c-1f80-4e66-a6f8-ab7de6485c8a service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:22.142752 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7bb9c-1f80-4e66-a6f8-ab7de6485c8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:22.146354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-72a7bb9c-1f80-4e66-a6f8-ab7de6485c8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:22.176341 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1840fe-2b1a-4c87-8cd3-7e4a666dbdec admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:22.182614 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855cc1c-5bc3-412c-9aca-e768f48110d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:22.183359 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855cc1c-5bc3-412c-9aca-e768f48110d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:22.183705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855cc1c-5bc3-412c-9aca-e768f48110d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:22.184045 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855cc1c-5bc3-412c-9aca-e768f48110d9 admin admin] PATH_INFO: `/v3/users/632eb9c904e54b868a4dc96fd1a24496` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:22.185376 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855cc1c-5bc3-412c-9aca-e768f48110d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=632eb9c904e54b868a4dc96fd1a24496)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:22.189262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855cc1c-5bc3-412c-9aca-e768f48110d9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:22.235320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7bb9c-1f80-4e66-a6f8-ab7de6485c8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:22.237065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7bb9c-1f80-4e66-a6f8-ab7de6485c8a service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:22.259651 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d855cc1c-5bc3-412c-9aca-e768f48110d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '632eb9c904e54b868a4dc96fd1a24496'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:22.261310 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d855cc1c-5bc3-412c-9aca-e768f48110d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '632eb9c904e54b868a4dc96fd1a24496'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:22.262196 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1194/2358] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:21 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:22.263658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d855cc1c-5bc3-412c-9aca-e768f48110d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '632eb9c904e54b868a4dc96fd1a24496'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:22.273756 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d855cc1c-5bc3-412c-9aca-e768f48110d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '632eb9c904e54b868a4dc96fd1a24496'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:22.293575 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d855cc1c-5bc3-412c-9aca-e768f48110d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '632eb9c904e54b868a4dc96fd1a24496'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:22.315879 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1165/2359] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:55:22 2022] DELETE /identity/v3/users/632eb9c904e54b868a4dc96fd1a24496 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:22.857163 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7bb9c-1f80-4e66-a6f8-ab7de6485c8a service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:22.877368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7bb9c-1f80-4e66-a6f8-ab7de6485c8a service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:23.009775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855cc1c-5bc3-412c-9aca-e768f48110d9 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:23.011858 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d855cc1c-5bc3-412c-9aca-e768f48110d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:23.044848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:23.072397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d5a8fa-804a-47bd-a3e1-0e1f2f1ce113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:23.073438 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5a8fa-804a-47bd-a3e1-0e1f2f1ce113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:23.074424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5a8fa-804a-47bd-a3e1-0e1f2f1ce113 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:23.074424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5a8fa-804a-47bd-a3e1-0e1f2f1ce113 admin admin] PATH_INFO: `/v3/projects/7dabd90de9a14d5f80e2d039b180397a` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:23.075705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d5a8fa-804a-47bd-a3e1-0e1f2f1ce113 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dabd90de9a14d5f80e2d039b180397a)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:23.078905 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d5a8fa-804a-47bd-a3e1-0e1f2f1ce113 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:23.153843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855cc1c-5bc3-412c-9aca-e768f48110d9 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:23.170815 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870f9b2-94f5-470a-8ad2-c1835d75216d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:23.171558 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870f9b2-94f5-470a-8ad2-c1835d75216d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:23.172187 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870f9b2-94f5-470a-8ad2-c1835d75216d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:23.172463 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870f9b2-94f5-470a-8ad2-c1835d75216d admin admin] PATH_INFO: `/v3/users/b6acce050bac4026814c02509fac5aa7` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:23.173988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870f9b2-94f5-470a-8ad2-c1835d75216d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6acce050bac4026814c02509fac5aa7)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:23.176263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870f9b2-94f5-470a-8ad2-c1835d75216d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:23.194012 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-18d5a8fa-804a-47bd-a3e1-0e1f2f1ce113 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dabd90de9a14d5f80e2d039b180397a', 'request_id': 'req-18d5a8fa-804a-47bd-a3e1-0e1f2f1ce113'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:23.201681 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-18d5a8fa-804a-47bd-a3e1-0e1f2f1ce113 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dabd90de9a14d5f80e2d039b180397a', 'request_id': 'req-18d5a8fa-804a-47bd-a3e1-0e1f2f1ce113'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:23.203791 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:23.218011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-18d5a8fa-804a-47bd-a3e1-0e1f2f1ce113 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dabd90de9a14d5f80e2d039b180397a', 'request_id': 'req-18d5a8fa-804a-47bd-a3e1-0e1f2f1ce113'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:23.258165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-18d5a8fa-804a-47bd-a3e1-0e1f2f1ce113 admin admin] The token cache is being invalidate because project 7dabd90de9a14d5f80e2d039b180397a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:55:23.258744 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-18d5a8fa-804a-47bd-a3e1-0e1f2f1ce113 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:23.260284 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-18d5a8fa-804a-47bd-a3e1-0e1f2f1ce113 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:23.263144 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1195/2360] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:55:22 2022] DELETE /identity/v3/projects/7dabd90de9a14d5f80e2d039b180397a => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:23.275075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b6784-6006-4e68-9606-6fde504d64ca None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:23.279459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b6784-6006-4e68-9606-6fde504d64ca None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:23.280430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b6784-6006-4e68-9606-6fde504d64ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:23.290854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9870f9b2-94f5-470a-8ad2-c1835d75216d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6acce050bac4026814c02509fac5aa7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:23.292834 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9870f9b2-94f5-470a-8ad2-c1835d75216d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6acce050bac4026814c02509fac5aa7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:23.294989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9870f9b2-94f5-470a-8ad2-c1835d75216d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6acce050bac4026814c02509fac5aa7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:23.311273 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9870f9b2-94f5-470a-8ad2-c1835d75216d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6acce050bac4026814c02509fac5aa7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:23.321125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-437b6784-6006-4e68-9606-6fde504d64ca None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:23.324378 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-437b6784-6006-4e68-9606-6fde504d64ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:23.332051 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9870f9b2-94f5-470a-8ad2-c1835d75216d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6acce050bac4026814c02509fac5aa7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:23.355107 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1166/2361] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:55:23 2022] DELETE /identity/v3/users/b6acce050bac4026814c02509fac5aa7 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:23.357167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4092d-ec1d-4d3e-8daa-f5f1ea4b4721 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:23.357460 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4092d-ec1d-4d3e-8daa-f5f1ea4b4721 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:23.357738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4092d-ec1d-4d3e-8daa-f5f1ea4b4721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:23.383318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-6fa4092d-ec1d-4d3e-8daa-f5f1ea4b4721 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:23.387498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6fa4092d-ec1d-4d3e-8daa-f5f1ea4b4721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:23.467005 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1196/2362] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:23.474778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ea765-e792-4b69-bf84-a54ba47be2fe None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:23.475073 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ea765-e792-4b69-bf84-a54ba47be2fe None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:23.475348 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ea765-e792-4b69-bf84-a54ba47be2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:23.487521 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1167/2363] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:23.504599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-243ea765-e792-4b69-bf84-a54ba47be2fe None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:23.506791 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-243ea765-e792-4b69-bf84-a54ba47be2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:23.512214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4092d-ec1d-4d3e-8daa-f5f1ea4b4721 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:23.516308 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6fa4092d-ec1d-4d3e-8daa-f5f1ea4b4721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:23.521355 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1197/2364] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:55:23.522451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ea765-e792-4b69-bf84-a54ba47be2fe None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:23.536875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ea765-e792-4b69-bf84-a54ba47be2fe None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:23.544327 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3dbf0-31f3-4f0f-8b05-dadc7bacfe24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:23.545237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3dbf0-31f3-4f0f-8b05-dadc7bacfe24 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:23.545584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3dbf0-31f3-4f0f-8b05-dadc7bacfe24 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:23.545927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3dbf0-31f3-4f0f-8b05-dadc7bacfe24 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:23.547235 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3dbf0-31f3-4f0f-8b05-dadc7bacfe24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:55:23.547612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3dbf0-31f3-4f0f-8b05-dadc7bacfe24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:23.549464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3dbf0-31f3-4f0f-8b05-dadc7bacfe24 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:23.583501 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1198/2365] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:55:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:55:23.593670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3dbf0-31f3-4f0f-8b05-dadc7bacfe24 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:23.608397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3dbf0-31f3-4f0f-8b05-dadc7bacfe24 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:23.616218 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:23.628691 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5460e9-897c-4feb-b61d-9d153c1c4f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:23.631632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5460e9-897c-4feb-b61d-9d153c1c4f69 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:23.632019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5460e9-897c-4feb-b61d-9d153c1c4f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:23.632569 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5460e9-897c-4feb-b61d-9d153c1c4f69 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:23.661207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5460e9-897c-4feb-b61d-9d153c1c4f69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:23.667811 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5460e9-897c-4feb-b61d-9d153c1c4f69 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:23.772289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4092d-ec1d-4d3e-8daa-f5f1ea4b4721 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:23.802910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37519b-6e83-47f4-b267-a3cad271d638 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:23.803562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37519b-6e83-47f4-b267-a3cad271d638 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:23.803840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37519b-6e83-47f4-b267-a3cad271d638 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:23.804114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37519b-6e83-47f4-b267-a3cad271d638 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:23.829068 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1199/2366] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:55:23 2022] POST /identity/v3/projects => generated 409 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:23.835816 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5460e9-897c-4feb-b61d-9d153c1c4f69 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:23.859098 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37519b-6e83-47f4-b267-a3cad271d638 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:23.861017 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37519b-6e83-47f4-b267-a3cad271d638 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:23.890855 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1168/2367] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:24.039551 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5460e9-897c-4feb-b61d-9d153c1c4f69 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:24.053100 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9fac78-f477-498b-be49-390b83e4dca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:24.053736 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fac78-f477-498b-be49-390b83e4dca5 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:24.054159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fac78-f477-498b-be49-390b83e4dca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:24.054436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fac78-f477-498b-be49-390b83e4dca5 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:24.055091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9fac78-f477-498b-be49-390b83e4dca5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:24.057810 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9fac78-f477-498b-be49-390b83e4dca5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:24.101505 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1200/2368] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:55:23 2022] POST /identity/v3/users => generated 305 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:24.105778 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37519b-6e83-47f4-b267-a3cad271d638 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:24.122676 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37519b-6e83-47f4-b267-a3cad271d638 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:24.129265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9284f-ddb4-48e9-b139-d0f777e723ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:24.130085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9284f-ddb4-48e9-b139-d0f777e723ac admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:24.130604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9284f-ddb4-48e9-b139-d0f777e723ac admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:24.130925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9284f-ddb4-48e9-b139-d0f777e723ac admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:24.131580 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a9284f-ddb4-48e9-b139-d0f777e723ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:24.133261 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a9284f-ddb4-48e9-b139-d0f777e723ac admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:24.146852 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1169/2369] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:55:24.152433 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9fac78-f477-498b-be49-390b83e4dca5 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:24.167562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9fac78-f477-498b-be49-390b83e4dca5 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:24.178200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575bb7c-0c68-4956-a24c-84d54abf029f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:24.179094 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575bb7c-0c68-4956-a24c-84d54abf029f admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:24.179609 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575bb7c-0c68-4956-a24c-84d54abf029f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:24.180720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575bb7c-0c68-4956-a24c-84d54abf029f admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:24.181596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575bb7c-0c68-4956-a24c-84d54abf029f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:24.189060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575bb7c-0c68-4956-a24c-84d54abf029f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:24.238644 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1201/2370] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:24.240085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9284f-ddb4-48e9-b139-d0f777e723ac admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:24.254386 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9284f-ddb4-48e9-b139-d0f777e723ac admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:24.262017 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ad736-aa6d-40dc-880d-bf360674a148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:24.265161 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ad736-aa6d-40dc-880d-bf360674a148 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:24.266169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ad736-aa6d-40dc-880d-bf360674a148 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:24.266665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ad736-aa6d-40dc-880d-bf360674a148 admin admin] PATH_INFO: `/v3/projects/85daaeab115b4b38a6a28e2730bb36da/users/6eb56171c33045c0ae3de05f854a1e6d/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:24.301738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ad736-aa6d-40dc-880d-bf360674a148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85daaeab115b4b38a6a28e2730bb36da, user_id=6eb56171c33045c0ae3de05f854a1e6d, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:24.305468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ad736-aa6d-40dc-880d-bf360674a148 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:24.335280 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1170/2371] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:55:24 2022] PUT /identity/v3/projects/85daaeab115b4b38a6a28e2730bb36da/users/6eb56171c33045c0ae3de05f854a1e6d/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:55:24.347806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69dd526-b91d-4384-a655-1706770bc5e5 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:24.348158 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69dd526-b91d-4384-a655-1706770bc5e5 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:24.348438 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69dd526-b91d-4384-a655-1706770bc5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:24.405341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b69dd526-b91d-4384-a655-1706770bc5e5 None None] MFA Rules not processed for user `6eb56171c33045c0ae3de05f854a1e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:24.407243 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b69dd526-b91d-4384-a655-1706770bc5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:24.425781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:24.519197 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1202/2372] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:24 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:24.521958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ad736-aa6d-40dc-880d-bf360674a148 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:24.613726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ad736-aa6d-40dc-880d-bf360674a148 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:24.620534 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55ef0b-eeaf-48af-887e-0a493187e245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:24.621417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55ef0b-eeaf-48af-887e-0a493187e245 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:24.621853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55ef0b-eeaf-48af-887e-0a493187e245 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:24.622582 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55ef0b-eeaf-48af-887e-0a493187e245 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:24.623390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac55ef0b-eeaf-48af-887e-0a493187e245 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:24.625747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac55ef0b-eeaf-48af-887e-0a493187e245 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:24.686798 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1171/2373] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:55:24 2022] POST /identity/v3/projects => generated 409 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:24.688260 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69dd526-b91d-4384-a655-1706770bc5e5 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:24.703514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69dd526-b91d-4384-a655-1706770bc5e5 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:24.807646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda5b38-ed3d-4433-834a-820886b71b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:24.809087 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda5b38-ed3d-4433-834a-820886b71b76 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:24.809750 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda5b38-ed3d-4433-834a-820886b71b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:24.810233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda5b38-ed3d-4433-834a-820886b71b76 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:24.811246 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda5b38-ed3d-4433-834a-820886b71b76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:24.813829 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda5b38-ed3d-4433-834a-820886b71b76 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:24.849209 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1203/2374] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:55:24 2022] POST /identity/v3/users => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:24.855436 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55ef0b-eeaf-48af-887e-0a493187e245 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:24.875380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55ef0b-eeaf-48af-887e-0a493187e245 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:24.882041 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacda0b-698c-4644-b95c-7edb2b85b683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:24.883226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacda0b-698c-4644-b95c-7edb2b85b683 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:24.883532 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacda0b-698c-4644-b95c-7edb2b85b683 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:24.883787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacda0b-698c-4644-b95c-7edb2b85b683 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:24.884467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bacda0b-698c-4644-b95c-7edb2b85b683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:24.887530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bacda0b-698c-4644-b95c-7edb2b85b683 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:24.908835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda5b38-ed3d-4433-834a-820886b71b76 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:24.916915 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1172/2375] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:24.925222 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda5b38-ed3d-4433-834a-820886b71b76 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:24.932406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d01ff7-4e08-49a2-935d-012458bc54cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:24.933433 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d01ff7-4e08-49a2-935d-012458bc54cb admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:24.933818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d01ff7-4e08-49a2-935d-012458bc54cb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:24.934561 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d01ff7-4e08-49a2-935d-012458bc54cb admin admin] PATH_INFO: `/v3/projects/d61c47fe5b094398b28069eb001777b6/users/94bf980445424649afb7274e8cc8f953/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:24.965743 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d01ff7-4e08-49a2-935d-012458bc54cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d61c47fe5b094398b28069eb001777b6, user_id=94bf980445424649afb7274e8cc8f953, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:24.969260 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d01ff7-4e08-49a2-935d-012458bc54cb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:24.994792 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacda0b-698c-4644-b95c-7edb2b85b683 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:24.997485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3bacda0b-698c-4644-b95c-7edb2b85b683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:25.004372 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1204/2376] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:55:24 2022] PUT /identity/v3/projects/d61c47fe5b094398b28069eb001777b6/users/94bf980445424649afb7274e8cc8f953/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:25.013687 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d01ff7-4e08-49a2-935d-012458bc54cb admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:25.031167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacda0b-698c-4644-b95c-7edb2b85b683 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:25.119355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070d02c-f8df-4a0e-83e9-7fa4bb726679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:25.122030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070d02c-f8df-4a0e-83e9-7fa4bb726679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:25.122321 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070d02c-f8df-4a0e-83e9-7fa4bb726679 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:25.122765 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070d02c-f8df-4a0e-83e9-7fa4bb726679 admin admin] PATH_INFO: `/v3/projects/2529b39d48e2403289342cf1990d137a` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:25.124705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070d02c-f8df-4a0e-83e9-7fa4bb726679 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2529b39d48e2403289342cf1990d137a)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:25.127435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070d02c-f8df-4a0e-83e9-7fa4bb726679 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:25.130411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d01ff7-4e08-49a2-935d-012458bc54cb admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:25.136069 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75dae80-3766-4af5-a632-08dc7f02432b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:25.137721 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75dae80-3766-4af5-a632-08dc7f02432b admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:25.138064 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75dae80-3766-4af5-a632-08dc7f02432b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:25.138419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75dae80-3766-4af5-a632-08dc7f02432b admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:25.139464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75dae80-3766-4af5-a632-08dc7f02432b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:25.142259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75dae80-3766-4af5-a632-08dc7f02432b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:25.152723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:25.162806 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1205/2377] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:25.167366 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75dae80-3766-4af5-a632-08dc7f02432b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:25.184520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75dae80-3766-4af5-a632-08dc7f02432b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:25.192304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ae524-824c-4c2b-bd95-4372dd77468a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:25.194739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ae524-824c-4c2b-bd95-4372dd77468a admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:25.195904 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ae524-824c-4c2b-bd95-4372dd77468a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:25.196275 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ae524-824c-4c2b-bd95-4372dd77468a admin admin] PATH_INFO: `/v3/projects/d61c47fe5b094398b28069eb001777b6/users/94bf980445424649afb7274e8cc8f953/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:25.199069 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ae524-824c-4c2b-bd95-4372dd77468a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d61c47fe5b094398b28069eb001777b6, user_id=94bf980445424649afb7274e8cc8f953, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:25.205973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ae524-824c-4c2b-bd95-4372dd77468a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:25.223452 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1206/2378] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:55:25 2022] PUT /identity/v3/projects/d61c47fe5b094398b28069eb001777b6/users/94bf980445424649afb7274e8cc8f953/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:55:25.257092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1070d02c-f8df-4a0e-83e9-7fa4bb726679 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2529b39d48e2403289342cf1990d137a', 'request_id': 'req-1070d02c-f8df-4a0e-83e9-7fa4bb726679'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:25.261016 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d2a1b-65ec-41ac-979e-3b1dbfb549bb None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:25.261908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d2a1b-65ec-41ac-979e-3b1dbfb549bb None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:25.262603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d2a1b-65ec-41ac-979e-3b1dbfb549bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:25.282159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1070d02c-f8df-4a0e-83e9-7fa4bb726679 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2529b39d48e2403289342cf1990d137a', 'request_id': 'req-1070d02c-f8df-4a0e-83e9-7fa4bb726679'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:25.295514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:25.298727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1070d02c-f8df-4a0e-83e9-7fa4bb726679 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2529b39d48e2403289342cf1990d137a', 'request_id': 'req-1070d02c-f8df-4a0e-83e9-7fa4bb726679'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:25.327608 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1070d02c-f8df-4a0e-83e9-7fa4bb726679 admin admin] The token cache is being invalidate because project 2529b39d48e2403289342cf1990d137a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:55:25.328282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1070d02c-f8df-4a0e-83e9-7fa4bb726679 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:25.339410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1070d02c-f8df-4a0e-83e9-7fa4bb726679 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:25.342032 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1173/2379] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:55:24 2022] DELETE /identity/v3/projects/2529b39d48e2403289342cf1990d137a => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:55:25.346250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070d02c-f8df-4a0e-83e9-7fa4bb726679 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:25.348223 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1070d02c-f8df-4a0e-83e9-7fa4bb726679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:25.380981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-e76d2a1b-65ec-41ac-979e-3b1dbfb549bb None None] MFA Rules not processed for user `94bf980445424649afb7274e8cc8f953`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:25.382948 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e76d2a1b-65ec-41ac-979e-3b1dbfb549bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:25.545867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070d02c-f8df-4a0e-83e9-7fa4bb726679 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:25.604182 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1207/2380] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:25 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:25.729757 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c4f49-0299-4c63-911a-56fe6518eb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:25.730571 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c4f49-0299-4c63-911a-56fe6518eb9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:25.734605 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c4f49-0299-4c63-911a-56fe6518eb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:25.738759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c4f49-0299-4c63-911a-56fe6518eb9f admin admin] PATH_INFO: `/v3/users/421ec919b39c4c05aa13592d52cbcf65` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:25.749192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c4f49-0299-4c63-911a-56fe6518eb9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=421ec919b39c4c05aa13592d52cbcf65)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:25.756227 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c4f49-0299-4c63-911a-56fe6518eb9f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:25.922580 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3b4c4f49-0299-4c63-911a-56fe6518eb9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '421ec919b39c4c05aa13592d52cbcf65'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:25.923842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3b4c4f49-0299-4c63-911a-56fe6518eb9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '421ec919b39c4c05aa13592d52cbcf65'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:25.924212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3b4c4f49-0299-4c63-911a-56fe6518eb9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '421ec919b39c4c05aa13592d52cbcf65'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:25.929695 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:25.938869 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3b4c4f49-0299-4c63-911a-56fe6518eb9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '421ec919b39c4c05aa13592d52cbcf65'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:25.940179 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d2a1b-65ec-41ac-979e-3b1dbfb549bb None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:25.942025 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e76d2a1b-65ec-41ac-979e-3b1dbfb549bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:25.964628 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3b4c4f49-0299-4c63-911a-56fe6518eb9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '421ec919b39c4c05aa13592d52cbcf65'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:25.991668 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1174/2381] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:55:25 2022] DELETE /identity/v3/users/421ec919b39c4c05aa13592d52cbcf65 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:55:26.063896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d2a1b-65ec-41ac-979e-3b1dbfb549bb None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:26.064347 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170dc35-089d-4aeb-b895-50a3585e1b01 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:26.064795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170dc35-089d-4aeb-b895-50a3585e1b01 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:26.065322 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170dc35-089d-4aeb-b895-50a3585e1b01 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:26.067410 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1175/2382] 10.222.0.33 () {54 vars in 921 bytes} [Sat Aug 6 20:55:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:55:26.077360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a968b-2b2f-456d-8af9-f2cf4309909e None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:26.077360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a968b-2b2f-456d-8af9-f2cf4309909e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:26.077360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a968b-2b2f-456d-8af9-f2cf4309909e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:26.100512 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-e20a968b-2b2f-456d-8af9-f2cf4309909e None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:26.102208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e20a968b-2b2f-456d-8af9-f2cf4309909e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:26.169458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c4233-8857-452f-bc3f-3ad87ddbe4b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:26.170149 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c4233-8857-452f-bc3f-3ad87ddbe4b9 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:26.170447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c4233-8857-452f-bc3f-3ad87ddbe4b9 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:26.170801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c4233-8857-452f-bc3f-3ad87ddbe4b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:26.174355 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e16c4233-8857-452f-bc3f-3ad87ddbe4b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:26.190405 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1176/2383] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 20:55:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:55:26.230892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a968b-2b2f-456d-8af9-f2cf4309909e None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:26.233083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e20a968b-2b2f-456d-8af9-f2cf4309909e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:26.237776 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:26.266018 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a968b-2b2f-456d-8af9-f2cf4309909e None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:26.280473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc9763-aacd-4911-9e49-d3f779f91481 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:26.281667 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc9763-aacd-4911-9e49-d3f779f91481 service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:26.285181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc9763-aacd-4911-9e49-d3f779f91481 service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:26.285507 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc9763-aacd-4911-9e49-d3f779f91481 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:26.310519 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc9763-aacd-4911-9e49-d3f779f91481 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:26.313517 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc9763-aacd-4911-9e49-d3f779f91481 service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:26.339672 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1177/2384] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:55:26.357439 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c4233-8857-452f-bc3f-3ad87ddbe4b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:26.359288 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c4233-8857-452f-bc3f-3ad87ddbe4b9 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:26.372320 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1208/2385] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:25 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:26.504194 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc9763-aacd-4911-9e49-d3f779f91481 service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:26.506109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d6cc9763-aacd-4911-9e49-d3f779f91481 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:26.541982 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc9763-aacd-4911-9e49-d3f779f91481 service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:26.556851 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9de5bb-1fe8-4fbe-8951-eb1646fe33ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:26.557973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9de5bb-1fe8-4fbe-8951-eb1646fe33ed service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:26.558408 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9de5bb-1fe8-4fbe-8951-eb1646fe33ed service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:26.558900 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9de5bb-1fe8-4fbe-8951-eb1646fe33ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:26.567286 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8e9de5bb-1fe8-4fbe-8951-eb1646fe33ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:26.749321 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9de5bb-1fe8-4fbe-8951-eb1646fe33ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:26.758059 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9de5bb-1fe8-4fbe-8951-eb1646fe33ed service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:26.778238 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1178/2386] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:26 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:26.863473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c4233-8857-452f-bc3f-3ad87ddbe4b9 service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:26.864183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e16c4233-8857-452f-bc3f-3ad87ddbe4b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:27.034216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c4233-8857-452f-bc3f-3ad87ddbe4b9 service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:27.040447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7055c-9b42-4519-bda9-4c8d2317b04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:27.043808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7055c-9b42-4519-bda9-4c8d2317b04d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:27.044263 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7055c-9b42-4519-bda9-4c8d2317b04d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:27.044834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7055c-9b42-4519-bda9-4c8d2317b04d admin admin] PATH_INFO: `/v3/users/6eb56171c33045c0ae3de05f854a1e6d` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:27.047074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7055c-9b42-4519-bda9-4c8d2317b04d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eb56171c33045c0ae3de05f854a1e6d)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:27.049285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7055c-9b42-4519-bda9-4c8d2317b04d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:27.177959 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-05e7055c-9b42-4519-bda9-4c8d2317b04d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eb56171c33045c0ae3de05f854a1e6d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:27.191016 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-05e7055c-9b42-4519-bda9-4c8d2317b04d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eb56171c33045c0ae3de05f854a1e6d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:27.197732 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-05e7055c-9b42-4519-bda9-4c8d2317b04d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eb56171c33045c0ae3de05f854a1e6d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:27.198530 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-05e7055c-9b42-4519-bda9-4c8d2317b04d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eb56171c33045c0ae3de05f854a1e6d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:27.213888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-05e7055c-9b42-4519-bda9-4c8d2317b04d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eb56171c33045c0ae3de05f854a1e6d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:27.258293 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce9767-3bd9-4468-8841-6ff47eb7206b None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:27.262175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce9767-3bd9-4468-8841-6ff47eb7206b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:27.264215 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce9767-3bd9-4468-8841-6ff47eb7206b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:27.287098 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1209/2387] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:55:26 2022] DELETE /identity/v3/users/6eb56171c33045c0ae3de05f854a1e6d => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:27.291265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b498d-e5a6-4461-a40e-119e172deb5a None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:27.291612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b498d-e5a6-4461-a40e-119e172deb5a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:27.291956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b498d-e5a6-4461-a40e-119e172deb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:27.336160 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-400b498d-e5a6-4461-a40e-119e172deb5a None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:27.337710 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-400b498d-e5a6-4461-a40e-119e172deb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:27.343046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-98ce9767-3bd9-4468-8841-6ff47eb7206b None None] MFA Rules not processed for user `4604780fce5b4ece8cb20354efb53569`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:27.346004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-98ce9767-3bd9-4468-8841-6ff47eb7206b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:27.499169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:27.557489 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:27.611511 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1210/2388] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:27.619579 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1179/2389] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:27 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:27.766977 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b498d-e5a6-4461-a40e-119e172deb5a None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:27.768796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-400b498d-e5a6-4461-a40e-119e172deb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:27.944357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b498d-e5a6-4461-a40e-119e172deb5a None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:27.951228 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667c18f-98ea-4579-a530-7d49db34f00f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:27.952146 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667c18f-98ea-4579-a530-7d49db34f00f service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:27.952598 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667c18f-98ea-4579-a530-7d49db34f00f service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:27.953396 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667c18f-98ea-4579-a530-7d49db34f00f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:27.966489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667c18f-98ea-4579-a530-7d49db34f00f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:27.968212 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667c18f-98ea-4579-a530-7d49db34f00f service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:27.983773 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1211/2390] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:28.050364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce9767-3bd9-4468-8841-6ff47eb7206b None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:28.053634 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-98ce9767-3bd9-4468-8841-6ff47eb7206b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:28.081372 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce9767-3bd9-4468-8841-6ff47eb7206b None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:28.088741 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd315f0f-7ae2-42b7-952d-947410fa7b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:28.089871 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd315f0f-7ae2-42b7-952d-947410fa7b5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:28.090360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd315f0f-7ae2-42b7-952d-947410fa7b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:28.090893 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd315f0f-7ae2-42b7-952d-947410fa7b5b admin admin] PATH_INFO: `/v3/projects/7c33b1dbd593424db1a78dae7822146f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:28.092572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd315f0f-7ae2-42b7-952d-947410fa7b5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c33b1dbd593424db1a78dae7822146f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:28.113055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd315f0f-7ae2-42b7-952d-947410fa7b5b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:28.240528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dd315f0f-7ae2-42b7-952d-947410fa7b5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c33b1dbd593424db1a78dae7822146f', 'request_id': 'req-dd315f0f-7ae2-42b7-952d-947410fa7b5b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:28.253968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667c18f-98ea-4579-a530-7d49db34f00f service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:28.255476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0667c18f-98ea-4579-a530-7d49db34f00f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:28.261812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dd315f0f-7ae2-42b7-952d-947410fa7b5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c33b1dbd593424db1a78dae7822146f', 'request_id': 'req-dd315f0f-7ae2-42b7-952d-947410fa7b5b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:28.270676 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dd315f0f-7ae2-42b7-952d-947410fa7b5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c33b1dbd593424db1a78dae7822146f', 'request_id': 'req-dd315f0f-7ae2-42b7-952d-947410fa7b5b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:28.295902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dd315f0f-7ae2-42b7-952d-947410fa7b5b admin admin] The token cache is being invalidate because project 7c33b1dbd593424db1a78dae7822146f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:55:28.296245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dd315f0f-7ae2-42b7-952d-947410fa7b5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:28.296375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667c18f-98ea-4579-a530-7d49db34f00f service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:28.297306 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dd315f0f-7ae2-42b7-952d-947410fa7b5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:28.302661 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1180/2391] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:55:28 2022] DELETE /identity/v3/projects/7c33b1dbd593424db1a78dae7822146f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:28.304009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac254eb6-c813-4662-97ef-780c6dd9ee61 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:28.304299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac254eb6-c813-4662-97ef-780c6dd9ee61 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:28.304576 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac254eb6-c813-4662-97ef-780c6dd9ee61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:28.327034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-ac254eb6-c813-4662-97ef-780c6dd9ee61 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:28.328291 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ac254eb6-c813-4662-97ef-780c6dd9ee61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:28.402201 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e81d34-dbb8-4c34-8cb6-3657ac19a442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:28.403101 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e81d34-dbb8-4c34-8cb6-3657ac19a442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:28.403384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e81d34-dbb8-4c34-8cb6-3657ac19a442 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:28.403704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e81d34-dbb8-4c34-8cb6-3657ac19a442 admin admin] PATH_INFO: `/v3/users/392626ec112c47559420f9871c9712c3` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:28.405514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e81d34-dbb8-4c34-8cb6-3657ac19a442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=392626ec112c47559420f9871c9712c3)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:28.407818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e81d34-dbb8-4c34-8cb6-3657ac19a442 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:28.432313 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1181/2392] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:28.441633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d4dc5-1442-4eac-a40a-8e22fa29d78c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:28.441985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d4dc5-1442-4eac-a40a-8e22fa29d78c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:28.442306 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d4dc5-1442-4eac-a40a-8e22fa29d78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:28.513675 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b4e81d34-dbb8-4c34-8cb6-3657ac19a442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '392626ec112c47559420f9871c9712c3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:28.522999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b4e81d34-dbb8-4c34-8cb6-3657ac19a442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '392626ec112c47559420f9871c9712c3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:28.524224 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b4e81d34-dbb8-4c34-8cb6-3657ac19a442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '392626ec112c47559420f9871c9712c3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:28.524665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b4e81d34-dbb8-4c34-8cb6-3657ac19a442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '392626ec112c47559420f9871c9712c3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:28.535833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-996d4dc5-1442-4eac-a40a-8e22fa29d78c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:28.537344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b4e81d34-dbb8-4c34-8cb6-3657ac19a442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '392626ec112c47559420f9871c9712c3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:28.547364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-996d4dc5-1442-4eac-a40a-8e22fa29d78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:28.554851 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:28.565586 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1212/2393] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:55:28 2022] DELETE /identity/v3/users/392626ec112c47559420f9871c9712c3 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:28.577544 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1182/2394] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:55:28.582685 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e81d34-dbb8-4c34-8cb6-3657ac19a442 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:28.699832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e81d34-dbb8-4c34-8cb6-3657ac19a442 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:28.711590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d422e-173d-4d86-b2e3-f964bed411d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:28.712268 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d422e-173d-4d86-b2e3-f964bed411d8 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:28.712586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d422e-173d-4d86-b2e3-f964bed411d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:28.713119 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d422e-173d-4d86-b2e3-f964bed411d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:28.713802 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d422e-173d-4d86-b2e3-f964bed411d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:55:28.714114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d422e-173d-4d86-b2e3-f964bed411d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:28.716164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d422e-173d-4d86-b2e3-f964bed411d8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:28.758804 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d4dc5-1442-4eac-a40a-8e22fa29d78c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:28.770408 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1213/2395] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:55:28.771390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d4dc5-1442-4eac-a40a-8e22fa29d78c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:28.779807 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36aade-f269-4ad0-a9e0-753e04f18f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:28.780479 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36aade-f269-4ad0-a9e0-753e04f18f3c admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:28.780766 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36aade-f269-4ad0-a9e0-753e04f18f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:28.781121 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36aade-f269-4ad0-a9e0-753e04f18f3c admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:28.781754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b36aade-f269-4ad0-a9e0-753e04f18f3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:28.784615 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b36aade-f269-4ad0-a9e0-753e04f18f3c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:28.823172 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1183/2396] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:55:28 2022] POST /identity/v3/projects => generated 409 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:28.827878 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d422e-173d-4d86-b2e3-f964bed411d8 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:28.838931 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d422e-173d-4d86-b2e3-f964bed411d8 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:28.925477 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0712fd-ba36-4038-88ba-21ff9e7a25a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:28.926037 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0712fd-ba36-4038-88ba-21ff9e7a25a4 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:28.926422 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0712fd-ba36-4038-88ba-21ff9e7a25a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:28.927016 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0712fd-ba36-4038-88ba-21ff9e7a25a4 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:28.927885 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0712fd-ba36-4038-88ba-21ff9e7a25a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:28.932824 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0712fd-ba36-4038-88ba-21ff9e7a25a4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:28.987316 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1214/2397] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:55:28 2022] POST /identity/v3/users => generated 305 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:28.991088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36aade-f269-4ad0-a9e0-753e04f18f3c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:29.005438 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36aade-f269-4ad0-a9e0-753e04f18f3c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:29.012155 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19a6fe-8e98-40e9-ae30-1dc982616241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:29.012895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19a6fe-8e98-40e9-ae30-1dc982616241 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:29.013280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19a6fe-8e98-40e9-ae30-1dc982616241 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:29.013677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19a6fe-8e98-40e9-ae30-1dc982616241 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:29.014606 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db19a6fe-8e98-40e9-ae30-1dc982616241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:29.017239 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db19a6fe-8e98-40e9-ae30-1dc982616241 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:29.035191 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1184/2398] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:29.036527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0712fd-ba36-4038-88ba-21ff9e7a25a4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:29.052112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0712fd-ba36-4038-88ba-21ff9e7a25a4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:29.058827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a716ac7-3f9e-4600-b18b-ebdd8db2b1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:29.059588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a716ac7-3f9e-4600-b18b-ebdd8db2b1f1 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:29.060055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a716ac7-3f9e-4600-b18b-ebdd8db2b1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:29.060457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a716ac7-3f9e-4600-b18b-ebdd8db2b1f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:29.061354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a716ac7-3f9e-4600-b18b-ebdd8db2b1f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:29.063827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a716ac7-3f9e-4600-b18b-ebdd8db2b1f1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:29.083649 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1215/2399] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:29.085748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19a6fe-8e98-40e9-ae30-1dc982616241 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:29.101573 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19a6fe-8e98-40e9-ae30-1dc982616241 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:29.121743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4c2d9-9e62-4608-b4de-1e2557b6e5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:29.122473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4c2d9-9e62-4608-b4de-1e2557b6e5ab admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:29.122803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4c2d9-9e62-4608-b4de-1e2557b6e5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:29.123083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4c2d9-9e62-4608-b4de-1e2557b6e5ab admin admin] PATH_INFO: `/v3/projects/2277fd43910a4a6caa1ea9d5d38750d2/users/81acbbb199684022a0a81a5299d7dee8/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:29.141048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e4c2d9-9e62-4608-b4de-1e2557b6e5ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=2277fd43910a4a6caa1ea9d5d38750d2, user_id=81acbbb199684022a0a81a5299d7dee8, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:29.143954 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e4c2d9-9e62-4608-b4de-1e2557b6e5ab admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:29.159305 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1185/2400] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:55:29 2022] PUT /identity/v3/projects/2277fd43910a4a6caa1ea9d5d38750d2/users/81acbbb199684022a0a81a5299d7dee8/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:29.172551 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfab22-1f93-46c7-9fd3-b76764941de5 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:29.172551 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfab22-1f93-46c7-9fd3-b76764941de5 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:29.172551 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfab22-1f93-46c7-9fd3-b76764941de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:29.192875 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4c2d9-9e62-4608-b4de-1e2557b6e5ab admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:29.194833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-29e4c2d9-9e62-4608-b4de-1e2557b6e5ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:29.239545 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:29.248277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-bebfab22-1f93-46c7-9fd3-b76764941de5 None None] MFA Rules not processed for user `81acbbb199684022a0a81a5299d7dee8`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:29.249535 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-bebfab22-1f93-46c7-9fd3-b76764941de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:29.386010 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4c2d9-9e62-4608-b4de-1e2557b6e5ab admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:29.413299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383f3b4-d01c-42fc-9ac2-9d64bee52922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:29.418087 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383f3b4-d01c-42fc-9ac2-9d64bee52922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:29.418991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383f3b4-d01c-42fc-9ac2-9d64bee52922 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:29.419280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383f3b4-d01c-42fc-9ac2-9d64bee52922 admin admin] PATH_INFO: `/v3/projects/85daaeab115b4b38a6a28e2730bb36da` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:29.421304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383f3b4-d01c-42fc-9ac2-9d64bee52922 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85daaeab115b4b38a6a28e2730bb36da)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:29.426508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383f3b4-d01c-42fc-9ac2-9d64bee52922 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:29.454936 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1216/2401] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:29 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:29.455844 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfab22-1f93-46c7-9fd3-b76764941de5 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:29.459506 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-bebfab22-1f93-46c7-9fd3-b76764941de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:29.483293 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:29.497520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfab22-1f93-46c7-9fd3-b76764941de5 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:29.514067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b5a34-1e97-44f5-8dc0-3ded75a8066e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:29.515886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b5a34-1e97-44f5-8dc0-3ded75a8066e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:29.515886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b5a34-1e97-44f5-8dc0-3ded75a8066e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:29.515886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b5a34-1e97-44f5-8dc0-3ded75a8066e admin admin] PATH_INFO: `/v3/projects/36b172e0463348d0a917c4b940fba552` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:29.518039 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b5a34-1e97-44f5-8dc0-3ded75a8066e admin admin] RBAC: Authorizing `identity:delete_project(project_id=36b172e0463348d0a917c4b940fba552)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:29.520063 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b5a34-1e97-44f5-8dc0-3ded75a8066e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:29.571373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2383f3b4-d01c-42fc-9ac2-9d64bee52922 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85daaeab115b4b38a6a28e2730bb36da', 'request_id': 'req-2383f3b4-d01c-42fc-9ac2-9d64bee52922'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:29.584587 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2383f3b4-d01c-42fc-9ac2-9d64bee52922 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85daaeab115b4b38a6a28e2730bb36da', 'request_id': 'req-2383f3b4-d01c-42fc-9ac2-9d64bee52922'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:29.594304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2383f3b4-d01c-42fc-9ac2-9d64bee52922 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85daaeab115b4b38a6a28e2730bb36da', 'request_id': 'req-2383f3b4-d01c-42fc-9ac2-9d64bee52922'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:29.616545 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9c9b5a34-1e97-44f5-8dc0-3ded75a8066e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36b172e0463348d0a917c4b940fba552', 'request_id': 'req-9c9b5a34-1e97-44f5-8dc0-3ded75a8066e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:29.619499 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2383f3b4-d01c-42fc-9ac2-9d64bee52922 admin admin] The token cache is being invalidate because project 85daaeab115b4b38a6a28e2730bb36da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:55:29.619999 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2383f3b4-d01c-42fc-9ac2-9d64bee52922 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:29.621388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2383f3b4-d01c-42fc-9ac2-9d64bee52922 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:29.623903 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1186/2402] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:55:29 2022] DELETE /identity/v3/projects/85daaeab115b4b38a6a28e2730bb36da => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:29.624904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383f3b4-d01c-42fc-9ac2-9d64bee52922 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:29.627024 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2383f3b4-d01c-42fc-9ac2-9d64bee52922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:29.646742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9c9b5a34-1e97-44f5-8dc0-3ded75a8066e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36b172e0463348d0a917c4b940fba552', 'request_id': 'req-9c9b5a34-1e97-44f5-8dc0-3ded75a8066e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:29.673141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9c9b5a34-1e97-44f5-8dc0-3ded75a8066e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36b172e0463348d0a917c4b940fba552', 'request_id': 'req-9c9b5a34-1e97-44f5-8dc0-3ded75a8066e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:29.711526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9c9b5a34-1e97-44f5-8dc0-3ded75a8066e admin admin] The token cache is being invalidate because project 36b172e0463348d0a917c4b940fba552 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:55:29.712037 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9c9b5a34-1e97-44f5-8dc0-3ded75a8066e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:29.713822 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9c9b5a34-1e97-44f5-8dc0-3ded75a8066e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:29.724018 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1217/2403] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:55:29 2022] DELETE /identity/v3/projects/36b172e0463348d0a917c4b940fba552 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:29.724886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b5a34-1e97-44f5-8dc0-3ded75a8066e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:29.727188 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383f3b4-d01c-42fc-9ac2-9d64bee52922 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:29.731862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9c9b5a34-1e97-44f5-8dc0-3ded75a8066e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:29.874862 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:29.919455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b5a34-1e97-44f5-8dc0-3ded75a8066e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:29.920428 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd8326-f1ea-40ec-9757-29cf0f892ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:29.922780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd8326-f1ea-40ec-9757-29cf0f892ad8 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:29.923311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd8326-f1ea-40ec-9757-29cf0f892ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:29.923821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd8326-f1ea-40ec-9757-29cf0f892ad8 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:29.924679 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd8326-f1ea-40ec-9757-29cf0f892ad8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:29.929770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd8326-f1ea-40ec-9757-29cf0f892ad8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:29.933103 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f5b94-4e10-4c04-a8f6-cb54792df733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:29.935303 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f5b94-4e10-4c04-a8f6-cb54792df733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:29.935585 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f5b94-4e10-4c04-a8f6-cb54792df733 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:29.937066 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f5b94-4e10-4c04-a8f6-cb54792df733 admin admin] PATH_INFO: `/v3/users/94bf980445424649afb7274e8cc8f953` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:29.941988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f5b94-4e10-4c04-a8f6-cb54792df733 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94bf980445424649afb7274e8cc8f953)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:29.948430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f5b94-4e10-4c04-a8f6-cb54792df733 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:30.008776 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1187/2404] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:55:29 2022] POST /identity/v3/projects => generated 405 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:30.011726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd8326-f1ea-40ec-9757-29cf0f892ad8 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:30.014980 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-41bd8326-f1ea-40ec-9757-29cf0f892ad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:30.081174 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8f1f5b94-4e10-4c04-a8f6-cb54792df733 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94bf980445424649afb7274e8cc8f953'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:30.104727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8f1f5b94-4e10-4c04-a8f6-cb54792df733 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94bf980445424649afb7274e8cc8f953'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:30.106270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8f1f5b94-4e10-4c04-a8f6-cb54792df733 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94bf980445424649afb7274e8cc8f953'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:30.107114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8f1f5b94-4e10-4c04-a8f6-cb54792df733 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94bf980445424649afb7274e8cc8f953'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:30.122540 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8f1f5b94-4e10-4c04-a8f6-cb54792df733 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94bf980445424649afb7274e8cc8f953'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:30.144820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd8326-f1ea-40ec-9757-29cf0f892ad8 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:30.151190 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c0b2a-ac97-47b5-8a81-6ccba66e81fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:30.152086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c0b2a-ac97-47b5-8a81-6ccba66e81fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:30.153304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c0b2a-ac97-47b5-8a81-6ccba66e81fd admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:30.153304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c0b2a-ac97-47b5-8a81-6ccba66e81fd admin admin] PATH_INFO: `/v3/users/80b9eebc8d3341b7b1f00f3320d4f96e` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:30.155270 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c0b2a-ac97-47b5-8a81-6ccba66e81fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=80b9eebc8d3341b7b1f00f3320d4f96e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:30.157661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c0b2a-ac97-47b5-8a81-6ccba66e81fd admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:30.168413 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1218/2405] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:55:29 2022] DELETE /identity/v3/users/94bf980445424649afb7274e8cc8f953 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:30.168413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f5b94-4e10-4c04-a8f6-cb54792df733 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:30.174023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8f1f5b94-4e10-4c04-a8f6-cb54792df733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:30.186203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:30.263175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bd3c0b2a-ac97-47b5-8a81-6ccba66e81fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80b9eebc8d3341b7b1f00f3320d4f96e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:30.264569 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bd3c0b2a-ac97-47b5-8a81-6ccba66e81fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80b9eebc8d3341b7b1f00f3320d4f96e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:30.266007 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bd3c0b2a-ac97-47b5-8a81-6ccba66e81fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80b9eebc8d3341b7b1f00f3320d4f96e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:30.283616 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bd3c0b2a-ac97-47b5-8a81-6ccba66e81fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80b9eebc8d3341b7b1f00f3320d4f96e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:30.309318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bd3c0b2a-ac97-47b5-8a81-6ccba66e81fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80b9eebc8d3341b7b1f00f3320d4f96e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:30.312466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f5b94-4e10-4c04-a8f6-cb54792df733 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:30.321446 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8af24-13de-4410-879b-56cbdb7fdb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:30.324631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8af24-13de-4410-879b-56cbdb7fdb90 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:30.325051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8af24-13de-4410-879b-56cbdb7fdb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:30.325415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8af24-13de-4410-879b-56cbdb7fdb90 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:30.326330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8af24-13de-4410-879b-56cbdb7fdb90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:30.329757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8af24-13de-4410-879b-56cbdb7fdb90 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:30.344382 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1188/2406] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:55:30 2022] DELETE /identity/v3/users/80b9eebc8d3341b7b1f00f3320d4f96e => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:30.367106 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1219/2407] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:55:30 2022] POST /identity/v3/users => generated 309 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:30.371335 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c0b2a-ac97-47b5-8a81-6ccba66e81fd admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:30.373551 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-bd3c0b2a-ac97-47b5-8a81-6ccba66e81fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:30.514586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:30.528938 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c0b2a-ac97-47b5-8a81-6ccba66e81fd admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:30.550038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee8f33-f5cd-43cd-ae69-1fdc830ab2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:30.551726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee8f33-f5cd-43cd-ae69-1fdc830ab2da admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:30.552321 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee8f33-f5cd-43cd-ae69-1fdc830ab2da admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:30.554698 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee8f33-f5cd-43cd-ae69-1fdc830ab2da admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:30.555651 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee8f33-f5cd-43cd-ae69-1fdc830ab2da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:30.561575 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee8f33-f5cd-43cd-ae69-1fdc830ab2da admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:30.580880 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1189/2408] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:30.584873 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8af24-13de-4410-879b-56cbdb7fdb90 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:30.602077 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8af24-13de-4410-879b-56cbdb7fdb90 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:30.611447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72afc79-8931-465e-a777-907fd13b1b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:30.613985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72afc79-8931-465e-a777-907fd13b1b00 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:30.614331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72afc79-8931-465e-a777-907fd13b1b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:30.627493 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72afc79-8931-465e-a777-907fd13b1b00 admin admin] PATH_INFO: `/v3/projects/6489fd88d2544993aa4d1046d0fb9b81/users/094b24e49d3a48a3bf2b649be7229947/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:30.644880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72afc79-8931-465e-a777-907fd13b1b00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6489fd88d2544993aa4d1046d0fb9b81, user_id=094b24e49d3a48a3bf2b649be7229947, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:30.648250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72afc79-8931-465e-a777-907fd13b1b00 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:30.674861 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1220/2409] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:55:30 2022] PUT /identity/v3/projects/6489fd88d2544993aa4d1046d0fb9b81/users/094b24e49d3a48a3bf2b649be7229947/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:30.679627 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee8f33-f5cd-43cd-ae69-1fdc830ab2da admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:30.691470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee8f33-f5cd-43cd-ae69-1fdc830ab2da admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:30.781684 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0c30b-068a-4c43-8e8f-d923c04b58a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:30.782408 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0c30b-068a-4c43-8e8f-d923c04b58a6 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:30.782941 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0c30b-068a-4c43-8e8f-d923c04b58a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:30.783194 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0c30b-068a-4c43-8e8f-d923c04b58a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:30.784028 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0c30b-068a-4c43-8e8f-d923c04b58a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:30.785701 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0c30b-068a-4c43-8e8f-d923c04b58a6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:30.802621 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1190/2410] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:30.804464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72afc79-8931-465e-a777-907fd13b1b00 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:30.816551 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72afc79-8931-465e-a777-907fd13b1b00 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:30.825724 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bdb5ec-dc8c-4b1b-9fa6-764c512cef6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:30.827553 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdb5ec-dc8c-4b1b-9fa6-764c512cef6c admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:30.828035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdb5ec-dc8c-4b1b-9fa6-764c512cef6c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:30.829319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdb5ec-dc8c-4b1b-9fa6-764c512cef6c admin admin] PATH_INFO: `/v3/projects/6489fd88d2544993aa4d1046d0fb9b81/users/094b24e49d3a48a3bf2b649be7229947/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:30.831655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bdb5ec-dc8c-4b1b-9fa6-764c512cef6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6489fd88d2544993aa4d1046d0fb9b81, user_id=094b24e49d3a48a3bf2b649be7229947, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:30.835137 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bdb5ec-dc8c-4b1b-9fa6-764c512cef6c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:30.848899 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1221/2411] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:55:30 2022] PUT /identity/v3/projects/6489fd88d2544993aa4d1046d0fb9b81/users/094b24e49d3a48a3bf2b649be7229947/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:55:30.860229 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c90a0d-8200-4ee8-be73-e3d5295bbb2f None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:30.860762 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c90a0d-8200-4ee8-be73-e3d5295bbb2f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:30.861204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c90a0d-8200-4ee8-be73-e3d5295bbb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:30.898860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-c7c90a0d-8200-4ee8-be73-e3d5295bbb2f None None] MFA Rules not processed for user `094b24e49d3a48a3bf2b649be7229947`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:30.901637 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c7c90a0d-8200-4ee8-be73-e3d5295bbb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:31.039828 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1191/2412] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:30 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:31.047970 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bdb5ec-dc8c-4b1b-9fa6-764c512cef6c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:31.174224 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bdb5ec-dc8c-4b1b-9fa6-764c512cef6c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:31.181358 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cb7fb-e801-4fd4-84ae-674075062423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:31.182224 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cb7fb-e801-4fd4-84ae-674075062423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:31.182640 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cb7fb-e801-4fd4-84ae-674075062423 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:31.182907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cb7fb-e801-4fd4-84ae-674075062423 admin admin] PATH_INFO: `/v3/users/81acbbb199684022a0a81a5299d7dee8` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:31.185210 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97cb7fb-e801-4fd4-84ae-674075062423 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81acbbb199684022a0a81a5299d7dee8)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:31.187827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97cb7fb-e801-4fd4-84ae-674075062423 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:31.202024 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c90a0d-8200-4ee8-be73-e3d5295bbb2f None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:31.205268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c7c90a0d-8200-4ee8-be73-e3d5295bbb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:31.247208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c90a0d-8200-4ee8-be73-e3d5295bbb2f None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:31.268046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd150b-906c-4e39-9361-a769afe6bdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:31.269895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd150b-906c-4e39-9361-a769afe6bdca admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:31.270978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd150b-906c-4e39-9361-a769afe6bdca admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:31.271267 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd150b-906c-4e39-9361-a769afe6bdca admin admin] PATH_INFO: `/v3/projects/c34e7b977939473f89db79fccfed75ab` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:31.275837 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd150b-906c-4e39-9361-a769afe6bdca admin admin] RBAC: Authorizing `identity:delete_project(project_id=c34e7b977939473f89db79fccfed75ab)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:31.281665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd150b-906c-4e39-9361-a769afe6bdca admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:31.293090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d97cb7fb-e801-4fd4-84ae-674075062423 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81acbbb199684022a0a81a5299d7dee8'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:31.305677 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d97cb7fb-e801-4fd4-84ae-674075062423 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81acbbb199684022a0a81a5299d7dee8'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:31.307491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d97cb7fb-e801-4fd4-84ae-674075062423 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81acbbb199684022a0a81a5299d7dee8'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:31.308789 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d97cb7fb-e801-4fd4-84ae-674075062423 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81acbbb199684022a0a81a5299d7dee8'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:31.314093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:31.325640 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d97cb7fb-e801-4fd4-84ae-674075062423 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81acbbb199684022a0a81a5299d7dee8'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:31.347392 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1222/2413] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:55:31 2022] DELETE /identity/v3/users/81acbbb199684022a0a81a5299d7dee8 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:31.351629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cb7fb-e801-4fd4-84ae-674075062423 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:31.353350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d97cb7fb-e801-4fd4-84ae-674075062423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:31.417076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-60bd150b-906c-4e39-9361-a769afe6bdca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c34e7b977939473f89db79fccfed75ab', 'request_id': 'req-60bd150b-906c-4e39-9361-a769afe6bdca'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:31.424730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-60bd150b-906c-4e39-9361-a769afe6bdca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c34e7b977939473f89db79fccfed75ab', 'request_id': 'req-60bd150b-906c-4e39-9361-a769afe6bdca'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:31.438947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-60bd150b-906c-4e39-9361-a769afe6bdca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c34e7b977939473f89db79fccfed75ab', 'request_id': 'req-60bd150b-906c-4e39-9361-a769afe6bdca'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:31.446400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:31.455933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cb7fb-e801-4fd4-84ae-674075062423 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:31.472385 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-60bd150b-906c-4e39-9361-a769afe6bdca admin admin] The token cache is being invalidate because project c34e7b977939473f89db79fccfed75ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:55:31.472846 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-60bd150b-906c-4e39-9361-a769afe6bdca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:31.477871 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-60bd150b-906c-4e39-9361-a769afe6bdca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:31.485761 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1192/2414] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:55:31 2022] DELETE /identity/v3/projects/c34e7b977939473f89db79fccfed75ab => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:55:31.485761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf862c-c123-4150-8fb2-414b7e9c458e None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:31.485761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf862c-c123-4150-8fb2-414b7e9c458e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:31.485761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf862c-c123-4150-8fb2-414b7e9c458e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:31.548329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-37bf862c-c123-4150-8fb2-414b7e9c458e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:31.550192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-37bf862c-c123-4150-8fb2-414b7e9c458e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:31.621212 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074bc9e-f26e-4e6b-840b-74212da4e35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:31.621862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074bc9e-f26e-4e6b-840b-74212da4e35b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:31.622143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074bc9e-f26e-4e6b-840b-74212da4e35b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:31.622419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074bc9e-f26e-4e6b-840b-74212da4e35b admin admin] PATH_INFO: `/v3/projects/d61c47fe5b094398b28069eb001777b6` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:31.624075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0074bc9e-f26e-4e6b-840b-74212da4e35b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d61c47fe5b094398b28069eb001777b6)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:31.626707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0074bc9e-f26e-4e6b-840b-74212da4e35b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:31.687424 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1193/2415] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:31.689042 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f9d96-634e-455e-9544-c32c129c6bd5 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:31.689357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f9d96-634e-455e-9544-c32c129c6bd5 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:31.689619 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f9d96-634e-455e-9544-c32c129c6bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:31.705463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0074bc9e-f26e-4e6b-840b-74212da4e35b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd61c47fe5b094398b28069eb001777b6', 'request_id': 'req-0074bc9e-f26e-4e6b-840b-74212da4e35b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:31.713732 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0074bc9e-f26e-4e6b-840b-74212da4e35b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd61c47fe5b094398b28069eb001777b6', 'request_id': 'req-0074bc9e-f26e-4e6b-840b-74212da4e35b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:31.715016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-152f9d96-634e-455e-9544-c32c129c6bd5 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:31.716575 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-152f9d96-634e-455e-9544-c32c129c6bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:31.727503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0074bc9e-f26e-4e6b-840b-74212da4e35b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd61c47fe5b094398b28069eb001777b6', 'request_id': 'req-0074bc9e-f26e-4e6b-840b-74212da4e35b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:31.751368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0074bc9e-f26e-4e6b-840b-74212da4e35b admin admin] The token cache is being invalidate because project d61c47fe5b094398b28069eb001777b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:55:31.751677 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0074bc9e-f26e-4e6b-840b-74212da4e35b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:31.752504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0074bc9e-f26e-4e6b-840b-74212da4e35b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:31.758508 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1223/2416] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:55:31 2022] DELETE /identity/v3/projects/d61c47fe5b094398b28069eb001777b6 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:31.759845 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074bc9e-f26e-4e6b-840b-74212da4e35b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:31.761365 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0074bc9e-f26e-4e6b-840b-74212da4e35b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:31.791419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:31.815035 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1194/2417] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:31.816414 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d28bfa-d24a-4035-bb46-68262cd23ab7 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:31.816928 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d28bfa-d24a-4035-bb46-68262cd23ab7 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:31.817331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d28bfa-d24a-4035-bb46-68262cd23ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:31.850663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-72d28bfa-d24a-4035-bb46-68262cd23ab7 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:31.852138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-72d28bfa-d24a-4035-bb46-68262cd23ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:31.866680 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1195/2418] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:31.866680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668dbd3-5a09-4c1e-b166-bf7cf63ae83f None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:31.866680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668dbd3-5a09-4c1e-b166-bf7cf63ae83f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:31.866680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668dbd3-5a09-4c1e-b166-bf7cf63ae83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:31.881062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074bc9e-f26e-4e6b-840b-74212da4e35b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:31.887516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec0781-f83e-4b1e-8bd4-b8427faca22e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:31.888574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec0781-f83e-4b1e-8bd4-b8427faca22e service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:31.889110 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec0781-f83e-4b1e-8bd4-b8427faca22e service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:31.889575 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec0781-f83e-4b1e-8bd4-b8427faca22e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:31.893373 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b6ec0781-f83e-4b1e-8bd4-b8427faca22e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:31.907193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec0781-f83e-4b1e-8bd4-b8427faca22e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:31.908628 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec0781-f83e-4b1e-8bd4-b8427faca22e service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:31.923739 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f668dbd3-5a09-4c1e-b166-bf7cf63ae83f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:31.924139 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1224/2419] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:31.925240 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42457a3c-0c94-49da-bc92-64126bd8d49f None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:31.925631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42457a3c-0c94-49da-bc92-64126bd8d49f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:31.925957 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42457a3c-0c94-49da-bc92-64126bd8d49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:31.926724 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f668dbd3-5a09-4c1e-b166-bf7cf63ae83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:31.941579 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1196/2420] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:31.942958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668dbd3-5a09-4c1e-b166-bf7cf63ae83f None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:31.956913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668dbd3-5a09-4c1e-b166-bf7cf63ae83f None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:31.965798 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda742ff-9642-4261-b160-4e393ad7ed89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:31.966676 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda742ff-9642-4261-b160-4e393ad7ed89 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:31.968209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda742ff-9642-4261-b160-4e393ad7ed89 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:31.968209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda742ff-9642-4261-b160-4e393ad7ed89 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:31.969251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda742ff-9642-4261-b160-4e393ad7ed89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:55:31.969723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda742ff-9642-4261-b160-4e393ad7ed89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:31.974983 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda742ff-9642-4261-b160-4e393ad7ed89 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:31.987180 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1197/2421] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:55:31.994718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda742ff-9642-4261-b160-4e393ad7ed89 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:32.003365 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-42457a3c-0c94-49da-bc92-64126bd8d49f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:32.007463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-42457a3c-0c94-49da-bc92-64126bd8d49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:32.022838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda742ff-9642-4261-b160-4e393ad7ed89 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:32.033742 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1225/2422] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:32.036531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42457a3c-0c94-49da-bc92-64126bd8d49f None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:32.039690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd04a1-47de-448c-8dac-1ae986f27d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:32.040433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd04a1-47de-448c-8dac-1ae986f27d5c admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:32.040896 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd04a1-47de-448c-8dac-1ae986f27d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:32.041380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd04a1-47de-448c-8dac-1ae986f27d5c admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:32.042021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd04a1-47de-448c-8dac-1ae986f27d5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:32.043982 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd04a1-47de-448c-8dac-1ae986f27d5c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:32.059800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42457a3c-0c94-49da-bc92-64126bd8d49f None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:32.075660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d3556-0616-472b-b398-0ade3c831a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:32.076717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d3556-0616-472b-b398-0ade3c831a3e admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:32.077004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d3556-0616-472b-b398-0ade3c831a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:32.077400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d3556-0616-472b-b398-0ade3c831a3e admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:32.078066 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d3556-0616-472b-b398-0ade3c831a3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:55:32.078375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d3556-0616-472b-b398-0ade3c831a3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:32.082619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d3556-0616-472b-b398-0ade3c831a3e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:32.114914 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1198/2423] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:55:31 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:32.118966 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1226/2424] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:55:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:55:32.119199 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd04a1-47de-448c-8dac-1ae986f27d5c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:32.124084 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d3556-0616-472b-b398-0ade3c831a3e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:32.157535 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d3556-0616-472b-b398-0ade3c831a3e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:32.232317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:32.236201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd04a1-47de-448c-8dac-1ae986f27d5c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:32.251380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ac8ce-0e7a-4b03-aa34-6f2960beac14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:32.252406 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ac8ce-0e7a-4b03-aa34-6f2960beac14 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:32.252791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ac8ce-0e7a-4b03-aa34-6f2960beac14 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:32.253070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ac8ce-0e7a-4b03-aa34-6f2960beac14 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:32.253702 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ac8ce-0e7a-4b03-aa34-6f2960beac14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:32.255688 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ac8ce-0e7a-4b03-aa34-6f2960beac14 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:32.295491 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1199/2425] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:55:32 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:32.296979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ac8ce-0e7a-4b03-aa34-6f2960beac14 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:32.301921 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad21de-0408-4636-a4a9-e04e475a20af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:32.302564 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad21de-0408-4636-a4a9-e04e475a20af admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:32.302877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad21de-0408-4636-a4a9-e04e475a20af admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:32.303191 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad21de-0408-4636-a4a9-e04e475a20af admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:32.304189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad21de-0408-4636-a4a9-e04e475a20af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:32.309628 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad21de-0408-4636-a4a9-e04e475a20af admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:32.327396 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ac8ce-0e7a-4b03-aa34-6f2960beac14 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:32.335861 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd16935-aa88-4afb-badb-c408da890c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:32.336543 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd16935-aa88-4afb-badb-c408da890c04 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:32.336827 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd16935-aa88-4afb-badb-c408da890c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:32.338262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd16935-aa88-4afb-badb-c408da890c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:32.339394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd16935-aa88-4afb-badb-c408da890c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:32.343089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd16935-aa88-4afb-badb-c408da890c04 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:32.357129 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1200/2426] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:32.357596 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1227/2427] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:55:32 2022] POST /identity/v3/projects => generated 375 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:32.361300 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd16935-aa88-4afb-badb-c408da890c04 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:32.361570 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad21de-0408-4636-a4a9-e04e475a20af admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:32.372423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd16935-aa88-4afb-badb-c408da890c04 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:32.436707 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a7d0a-ca0a-4f08-91af-93d9e8809c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:32.437328 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a7d0a-ca0a-4f08-91af-93d9e8809c7d admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:32.437606 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a7d0a-ca0a-4f08-91af-93d9e8809c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:32.437892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a7d0a-ca0a-4f08-91af-93d9e8809c7d admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:32.438501 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a7d0a-ca0a-4f08-91af-93d9e8809c7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:32.439873 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad21de-0408-4636-a4a9-e04e475a20af admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:32.440475 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a7d0a-ca0a-4f08-91af-93d9e8809c7d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:32.448016 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa4ff3-34e8-417a-8d91-9e7de379e89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:32.450023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa4ff3-34e8-417a-8d91-9e7de379e89a admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:32.450532 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa4ff3-34e8-417a-8d91-9e7de379e89a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:32.451062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa4ff3-34e8-417a-8d91-9e7de379e89a admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:32.451946 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa4ff3-34e8-417a-8d91-9e7de379e89a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:32.453918 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa4ff3-34e8-417a-8d91-9e7de379e89a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:32.475915 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1228/2428] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:32.475915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa4ff3-34e8-417a-8d91-9e7de379e89a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:32.479527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f6fa4ff3-34e8-417a-8d91-9e7de379e89a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:32.482372 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1201/2429] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:55:32 2022] POST /identity/v3/users => generated 288 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:32.484967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a7d0a-ca0a-4f08-91af-93d9e8809c7d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:32.493807 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa4ff3-34e8-417a-8d91-9e7de379e89a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:32.499011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a43c6a-c400-4c11-b791-238fc8eddcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:32.499400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a7d0a-ca0a-4f08-91af-93d9e8809c7d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:32.499937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a43c6a-c400-4c11-b791-238fc8eddcd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:32.500218 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a43c6a-c400-4c11-b791-238fc8eddcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:32.500494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a43c6a-c400-4c11-b791-238fc8eddcd4 admin admin] PATH_INFO: `/v3/projects/2277fd43910a4a6caa1ea9d5d38750d2` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:32.501654 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a43c6a-c400-4c11-b791-238fc8eddcd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2277fd43910a4a6caa1ea9d5d38750d2)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:32.504083 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a43c6a-c400-4c11-b791-238fc8eddcd4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:32.506167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcd613-28b6-4f5a-a830-03e9edd35f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:32.507684 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcd613-28b6-4f5a-a830-03e9edd35f1f admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:32.508177 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcd613-28b6-4f5a-a830-03e9edd35f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:32.508655 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcd613-28b6-4f5a-a830-03e9edd35f1f admin admin] PATH_INFO: `/v3/projects/d5ef27173302447a82d257b1f838e75d/users/79ffbe6477ea45f481620fa6293e1958/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:32.519968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:32.531466 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dcd613-28b6-4f5a-a830-03e9edd35f1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5ef27173302447a82d257b1f838e75d, user_id=79ffbe6477ea45f481620fa6293e1958, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:32.534532 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dcd613-28b6-4f5a-a830-03e9edd35f1f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:32.550593 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1202/2430] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:55:32 2022] PUT /identity/v3/projects/d5ef27173302447a82d257b1f838e75d/users/79ffbe6477ea45f481620fa6293e1958/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:32.551478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcd613-28b6-4f5a-a830-03e9edd35f1f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:32.586587 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a1a43c6a-c400-4c11-b791-238fc8eddcd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2277fd43910a4a6caa1ea9d5d38750d2', 'request_id': 'req-a1a43c6a-c400-4c11-b791-238fc8eddcd4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:32.592875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a1a43c6a-c400-4c11-b791-238fc8eddcd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2277fd43910a4a6caa1ea9d5d38750d2', 'request_id': 'req-a1a43c6a-c400-4c11-b791-238fc8eddcd4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:32.604095 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a1a43c6a-c400-4c11-b791-238fc8eddcd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2277fd43910a4a6caa1ea9d5d38750d2', 'request_id': 'req-a1a43c6a-c400-4c11-b791-238fc8eddcd4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:32.622531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a1a43c6a-c400-4c11-b791-238fc8eddcd4 admin admin] The token cache is being invalidate because project 2277fd43910a4a6caa1ea9d5d38750d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:55:32.623441 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a1a43c6a-c400-4c11-b791-238fc8eddcd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:32.624505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a1a43c6a-c400-4c11-b791-238fc8eddcd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:32.626583 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1229/2431] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:55:32 2022] DELETE /identity/v3/projects/2277fd43910a4a6caa1ea9d5d38750d2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:32.627843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef24a7b-cbc2-479c-9798-3e3a3e3ce0b3 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:32.628127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef24a7b-cbc2-479c-9798-3e3a3e3ce0b3 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:32.628409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef24a7b-cbc2-479c-9798-3e3a3e3ce0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:32.653183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcd613-28b6-4f5a-a830-03e9edd35f1f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:32.658809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-eef24a7b-cbc2-479c-9798-3e3a3e3ce0b3 None None] MFA Rules not processed for user `79ffbe6477ea45f481620fa6293e1958`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:32.659414 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-eef24a7b-cbc2-479c-9798-3e3a3e3ce0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:32.710356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:32.745230 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df311efd-8bd3-41f0-9ea8-c11b42777e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:32.745851 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df311efd-8bd3-41f0-9ea8-c11b42777e54 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:32.746134 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df311efd-8bd3-41f0-9ea8-c11b42777e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:32.746411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df311efd-8bd3-41f0-9ea8-c11b42777e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:32.747541 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df311efd-8bd3-41f0-9ea8-c11b42777e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:32.749510 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df311efd-8bd3-41f0-9ea8-c11b42777e54 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:32.756733 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1230/2432] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:32.756733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4039e95-4541-40c8-ba4b-d96c236cca2d None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:32.756733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4039e95-4541-40c8-ba4b-d96c236cca2d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:32.756733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4039e95-4541-40c8-ba4b-d96c236cca2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:32.765796 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1203/2433] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:32.767243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df311efd-8bd3-41f0-9ea8-c11b42777e54 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:32.769515 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-df311efd-8bd3-41f0-9ea8-c11b42777e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:32.787518 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-e4039e95-4541-40c8-ba4b-d96c236cca2d None None] MFA Rules not processed for user `343f309c07e343b4b15268472d19f10c`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:32.787995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df311efd-8bd3-41f0-9ea8-c11b42777e54 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:32.788897 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e4039e95-4541-40c8-ba4b-d96c236cca2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:32.795117 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81f7be-bff7-4f81-bd0b-7d7b595fa4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:32.796758 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81f7be-bff7-4f81-bd0b-7d7b595fa4fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:32.797160 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81f7be-bff7-4f81-bd0b-7d7b595fa4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:32.797551 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81f7be-bff7-4f81-bd0b-7d7b595fa4fc admin admin] PATH_INFO: `/v3/users/094b24e49d3a48a3bf2b649be7229947` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:32.798776 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec81f7be-bff7-4f81-bd0b-7d7b595fa4fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=094b24e49d3a48a3bf2b649be7229947)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:32.802013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec81f7be-bff7-4f81-bd0b-7d7b595fa4fc admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:32.879135 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1231/2434] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:32 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:32.880391 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ec81f7be-bff7-4f81-bd0b-7d7b595fa4fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '094b24e49d3a48a3bf2b649be7229947'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:32.880729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4039e95-4541-40c8-ba4b-d96c236cca2d None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:32.882471 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e4039e95-4541-40c8-ba4b-d96c236cca2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:32.882614 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ec81f7be-bff7-4f81-bd0b-7d7b595fa4fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '094b24e49d3a48a3bf2b649be7229947'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:32.883248 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ec81f7be-bff7-4f81-bd0b-7d7b595fa4fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '094b24e49d3a48a3bf2b649be7229947'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:32.905604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ec81f7be-bff7-4f81-bd0b-7d7b595fa4fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '094b24e49d3a48a3bf2b649be7229947'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:32.929169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4039e95-4541-40c8-ba4b-d96c236cca2d None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:32.935429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ec81f7be-bff7-4f81-bd0b-7d7b595fa4fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '094b24e49d3a48a3bf2b649be7229947'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:32.936994 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da715b74-ebe5-4fb3-a93c-2d77ce1e4f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:32.937884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da715b74-ebe5-4fb3-a93c-2d77ce1e4f12 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:32.938147 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da715b74-ebe5-4fb3-a93c-2d77ce1e4f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:32.938626 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da715b74-ebe5-4fb3-a93c-2d77ce1e4f12 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:32.939263 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da715b74-ebe5-4fb3-a93c-2d77ce1e4f12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:32.942128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da715b74-ebe5-4fb3-a93c-2d77ce1e4f12 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:32.955478 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1204/2435] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:55:32 2022] DELETE /identity/v3/users/094b24e49d3a48a3bf2b649be7229947 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:32.956677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81f7be-bff7-4f81-bd0b-7d7b595fa4fc admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:32.967180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ec81f7be-bff7-4f81-bd0b-7d7b595fa4fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:33.013027 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1232/2436] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:55:32 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:33.017061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da715b74-ebe5-4fb3-a93c-2d77ce1e4f12 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:33.023805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-da715b74-ebe5-4fb3-a93c-2d77ce1e4f12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:33.065514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:33.111377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81f7be-bff7-4f81-bd0b-7d7b595fa4fc admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:33.131599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da715b74-ebe5-4fb3-a93c-2d77ce1e4f12 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:33.137301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef44954-14f1-480d-8c48-55f4c93c91de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:33.138524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef44954-14f1-480d-8c48-55f4c93c91de admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:33.139013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef44954-14f1-480d-8c48-55f4c93c91de admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:33.139438 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef44954-14f1-480d-8c48-55f4c93c91de admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:33.140216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef44954-14f1-480d-8c48-55f4c93c91de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:33.142317 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef44954-14f1-480d-8c48-55f4c93c91de admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:33.178888 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1233/2437] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:55:33 2022] POST /identity/v3/users => generated 300 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:55:33.180256 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8e408-f3a0-419d-92bd-4aa4ead8c84c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:33.180543 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8e408-f3a0-419d-92bd-4aa4ead8c84c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:33.181380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8e408-f3a0-419d-92bd-4aa4ead8c84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:33.229464 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:33.237051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-ada8e408-f3a0-419d-92bd-4aa4ead8c84c None None] MFA Rules not processed for user `10aebae8bbbd4ea88b9cbf85d3438ed1`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:33.238283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ada8e408-f3a0-419d-92bd-4aa4ead8c84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:33.249307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63524b61-3b6b-4f24-8472-dc6a121d2fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:33.252273 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63524b61-3b6b-4f24-8472-dc6a121d2fdc admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:33.252678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63524b61-3b6b-4f24-8472-dc6a121d2fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:33.253772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63524b61-3b6b-4f24-8472-dc6a121d2fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:33.254982 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63524b61-3b6b-4f24-8472-dc6a121d2fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:33.257252 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63524b61-3b6b-4f24-8472-dc6a121d2fdc admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:33.278717 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1205/2438] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:33.278717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63524b61-3b6b-4f24-8472-dc6a121d2fdc admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:33.292788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63524b61-3b6b-4f24-8472-dc6a121d2fdc admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:33.306794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061389ee-1874-4c64-bfe6-2451928b6234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:33.307374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061389ee-1874-4c64-bfe6-2451928b6234 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:33.307872 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061389ee-1874-4c64-bfe6-2451928b6234 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:33.308195 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061389ee-1874-4c64-bfe6-2451928b6234 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:33.308993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061389ee-1874-4c64-bfe6-2451928b6234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:33.310862 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061389ee-1874-4c64-bfe6-2451928b6234 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:33.328184 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1206/2439] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:33.328184 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061389ee-1874-4c64-bfe6-2451928b6234 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:33.344174 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061389ee-1874-4c64-bfe6-2451928b6234 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:33.349843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4664b-1cf4-46ea-ad59-2cef24ce3cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:33.350729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4664b-1cf4-46ea-ad59-2cef24ce3cf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:33.351105 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4664b-1cf4-46ea-ad59-2cef24ce3cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:33.351433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4664b-1cf4-46ea-ad59-2cef24ce3cf8 admin admin] PATH_INFO: `/v3/projects/be298dcc2e9c45459497fc6168afd7a8/users/1af69965aeae44449fe70f2cd63c0fed/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:33.359942 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1234/2440] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:33.360836 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8e408-f3a0-419d-92bd-4aa4ead8c84c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:33.377872 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8e408-f3a0-419d-92bd-4aa4ead8c84c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:33.386955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615191f5-4fd9-4831-8936-2a127a66a4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:33.387609 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615191f5-4fd9-4831-8936-2a127a66a4cf admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:33.387993 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615191f5-4fd9-4831-8936-2a127a66a4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:33.388369 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615191f5-4fd9-4831-8936-2a127a66a4cf admin admin] PATH_INFO: `/v3/projects/6df791ea0dc14b459fd00aeeae02d584/users/edbe49bf4b1a46fcbe274cb75a16c5e2/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:33.393272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4664b-1cf4-46ea-ad59-2cef24ce3cf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be298dcc2e9c45459497fc6168afd7a8, user_id=1af69965aeae44449fe70f2cd63c0fed, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:33.405331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4664b-1cf4-46ea-ad59-2cef24ce3cf8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:33.415007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615191f5-4fd9-4831-8936-2a127a66a4cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6df791ea0dc14b459fd00aeeae02d584, user_id=edbe49bf4b1a46fcbe274cb75a16c5e2, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:33.419107 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615191f5-4fd9-4831-8936-2a127a66a4cf admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:33.434191 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1207/2441] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:55:33 2022] PUT /identity/v3/projects/be298dcc2e9c45459497fc6168afd7a8/users/1af69965aeae44449fe70f2cd63c0fed/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:33.445933 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f84f3d-0d16-4a5c-943b-b1f21b76b0ff None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:33.446258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f84f3d-0d16-4a5c-943b-b1f21b76b0ff None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:33.447175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f84f3d-0d16-4a5c-943b-b1f21b76b0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:33.449482 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1235/2442] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:55:33 2022] PUT /identity/v3/projects/6df791ea0dc14b459fd00aeeae02d584/users/edbe49bf4b1a46fcbe274cb75a16c5e2/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:33.454036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615191f5-4fd9-4831-8936-2a127a66a4cf admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:33.499076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-61f84f3d-0d16-4a5c-943b-b1f21b76b0ff None None] MFA Rules not processed for user `1af69965aeae44449fe70f2cd63c0fed`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:33.502848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-61f84f3d-0d16-4a5c-943b-b1f21b76b0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:33.585989 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615191f5-4fd9-4831-8936-2a127a66a4cf admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:33.593088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc3aa5-7ee3-40fc-9f91-da95a6500721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:33.593787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc3aa5-7ee3-40fc-9f91-da95a6500721 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:33.594216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc3aa5-7ee3-40fc-9f91-da95a6500721 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:33.594642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc3aa5-7ee3-40fc-9f91-da95a6500721 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:33.595635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc3aa5-7ee3-40fc-9f91-da95a6500721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:33.597449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc3aa5-7ee3-40fc-9f91-da95a6500721 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:33.612805 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1236/2443] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:33.614122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc3aa5-7ee3-40fc-9f91-da95a6500721 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:33.625116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc3aa5-7ee3-40fc-9f91-da95a6500721 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:33.630081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a31efc-ab2f-4755-aed9-227ad25e24e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:33.630922 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a31efc-ab2f-4755-aed9-227ad25e24e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:33.631272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a31efc-ab2f-4755-aed9-227ad25e24e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:33.631619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a31efc-ab2f-4755-aed9-227ad25e24e8 admin admin] PATH_INFO: `/v3/projects/6df791ea0dc14b459fd00aeeae02d584/users/edbe49bf4b1a46fcbe274cb75a16c5e2/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:33.633709 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1208/2444] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:33.635074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a31efc-ab2f-4755-aed9-227ad25e24e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6df791ea0dc14b459fd00aeeae02d584, user_id=edbe49bf4b1a46fcbe274cb75a16c5e2, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:33.635566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f84f3d-0d16-4a5c-943b-b1f21b76b0ff None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:33.638034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a31efc-ab2f-4755-aed9-227ad25e24e8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:33.650401 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1237/2445] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:55:33 2022] PUT /identity/v3/projects/6df791ea0dc14b459fd00aeeae02d584/users/edbe49bf4b1a46fcbe274cb75a16c5e2/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:33.650913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f84f3d-0d16-4a5c-943b-b1f21b76b0ff None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:33.681819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46357836-1c47-4227-9125-3b9730b53371 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:33.682487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46357836-1c47-4227-9125-3b9730b53371 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:33.682974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46357836-1c47-4227-9125-3b9730b53371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:33.716594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:33.761519 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-46357836-1c47-4227-9125-3b9730b53371 None None] MFA Rules not processed for user `edbe49bf4b1a46fcbe274cb75a16c5e2`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:33.763267 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-46357836-1c47-4227-9125-3b9730b53371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:33.775789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98794ef3-340e-4c71-b75d-74d77708e3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:33.776420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98794ef3-340e-4c71-b75d-74d77708e3b3 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:33.777404 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98794ef3-340e-4c71-b75d-74d77708e3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:33.777764 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98794ef3-340e-4c71-b75d-74d77708e3b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:33.779011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98794ef3-340e-4c71-b75d-74d77708e3b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:33.781881 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98794ef3-340e-4c71-b75d-74d77708e3b3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:33.841213 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1209/2446] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:55:33 2022] POST /identity/v3/projects => generated 377 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:33.842362 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98794ef3-340e-4c71-b75d-74d77708e3b3 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:33.898792 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:33.927316 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1238/2447] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:33 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:55:33.935555 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46357836-1c47-4227-9125-3b9730b53371 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:33.937826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-46357836-1c47-4227-9125-3b9730b53371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:33.946898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98794ef3-340e-4c71-b75d-74d77708e3b3 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:33.952715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dafcd4-68d1-4575-b9d4-b6aba2ec085c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:33.953491 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dafcd4-68d1-4575-b9d4-b6aba2ec085c admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:33.953782 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dafcd4-68d1-4575-b9d4-b6aba2ec085c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:33.954056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dafcd4-68d1-4575-b9d4-b6aba2ec085c admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:33.954772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dafcd4-68d1-4575-b9d4-b6aba2ec085c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:33.956787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dafcd4-68d1-4575-b9d4-b6aba2ec085c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:33.962676 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46357836-1c47-4227-9125-3b9730b53371 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:33.971497 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc181a-eaf0-4e3f-b5d8-386f2a70a57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:33.973232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc181a-eaf0-4e3f-b5d8-386f2a70a57b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:33.973872 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc181a-eaf0-4e3f-b5d8-386f2a70a57b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:33.974452 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc181a-eaf0-4e3f-b5d8-386f2a70a57b admin admin] PATH_INFO: `/v3/projects/6489fd88d2544993aa4d1046d0fb9b81` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:33.976997 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc181a-eaf0-4e3f-b5d8-386f2a70a57b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6489fd88d2544993aa4d1046d0fb9b81)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:33.981243 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc181a-eaf0-4e3f-b5d8-386f2a70a57b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:34.004668 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1210/2448] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:55:33 2022] POST /identity/v3/users => generated 295 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:34.015370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93a9b4-f715-41af-90ca-2382c773661b None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:34.015667 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93a9b4-f715-41af-90ca-2382c773661b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:34.016228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93a9b4-f715-41af-90ca-2382c773661b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:34.052436 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-1c93a9b4-f715-41af-90ca-2382c773661b None None] MFA Rules not processed for user `79ffbe6477ea45f481620fa6293e1958`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:34.054591 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1c93a9b4-f715-41af-90ca-2382c773661b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:34.093983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d9cc181a-eaf0-4e3f-b5d8-386f2a70a57b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6489fd88d2544993aa4d1046d0fb9b81', 'request_id': 'req-d9cc181a-eaf0-4e3f-b5d8-386f2a70a57b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:34.100795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d9cc181a-eaf0-4e3f-b5d8-386f2a70a57b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6489fd88d2544993aa4d1046d0fb9b81', 'request_id': 'req-d9cc181a-eaf0-4e3f-b5d8-386f2a70a57b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:34.113896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d9cc181a-eaf0-4e3f-b5d8-386f2a70a57b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6489fd88d2544993aa4d1046d0fb9b81', 'request_id': 'req-d9cc181a-eaf0-4e3f-b5d8-386f2a70a57b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:34.149186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d9cc181a-eaf0-4e3f-b5d8-386f2a70a57b admin admin] The token cache is being invalidate because project 6489fd88d2544993aa4d1046d0fb9b81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:55:34.150515 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d9cc181a-eaf0-4e3f-b5d8-386f2a70a57b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:34.154802 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d9cc181a-eaf0-4e3f-b5d8-386f2a70a57b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:34.163208 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1239/2449] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:55:33 2022] DELETE /identity/v3/projects/6489fd88d2544993aa4d1046d0fb9b81 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:34.163208 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc181a-eaf0-4e3f-b5d8-386f2a70a57b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:34.164722 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d9cc181a-eaf0-4e3f-b5d8-386f2a70a57b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:34.189812 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1211/2450] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:34.189812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8de65-5cb4-43ce-b4ba-167c00f384d9 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:34.189812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8de65-5cb4-43ce-b4ba-167c00f384d9 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:34.189812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8de65-5cb4-43ce-b4ba-167c00f384d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:34.232891 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-c7f8de65-5cb4-43ce-b4ba-167c00f384d9 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:34.234130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c7f8de65-5cb4-43ce-b4ba-167c00f384d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:34.335157 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc181a-eaf0-4e3f-b5d8-386f2a70a57b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:34.346702 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1212/2451] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:34.347742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8de65-5cb4-43ce-b4ba-167c00f384d9 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:34.352172 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c7f8de65-5cb4-43ce-b4ba-167c00f384d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:34.353329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b25b6c-dee2-4a57-b64f-ccfaf84654b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:34.354693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b25b6c-dee2-4a57-b64f-ccfaf84654b7 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:34.355271 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b25b6c-dee2-4a57-b64f-ccfaf84654b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:34.355840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b25b6c-dee2-4a57-b64f-ccfaf84654b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:34.356689 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b25b6c-dee2-4a57-b64f-ccfaf84654b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:34.358645 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b25b6c-dee2-4a57-b64f-ccfaf84654b7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:34.379744 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1240/2452] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:34.381194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8446a7f-1f4c-4635-86e8-714b46df3b1a None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:34.382083 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8446a7f-1f4c-4635-86e8-714b46df3b1a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:34.382386 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8446a7f-1f4c-4635-86e8-714b46df3b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:34.435213 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a8446a7f-1f4c-4635-86e8-714b46df3b1a None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:34.436460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a8446a7f-1f4c-4635-86e8-714b46df3b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:34.457846 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1241/2453] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:34.458774 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8446a7f-1f4c-4635-86e8-714b46df3b1a None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:34.470808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:34.473833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:34.476154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8de65-5cb4-43ce-b4ba-167c00f384d9 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:34.482281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8446a7f-1f4c-4635-86e8-714b46df3b1a None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:34.484023 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a24bca-6d74-402d-a98e-dc332351e6b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:34.485012 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a24bca-6d74-402d-a98e-dc332351e6b4 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:34.485486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a24bca-6d74-402d-a98e-dc332351e6b4 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:34.485909 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a24bca-6d74-402d-a98e-dc332351e6b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:34.489203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-26a24bca-6d74-402d-a98e-dc332351e6b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:34.493229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b5aed-67f6-4e8a-a485-d5b26fa37fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:34.497832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b5aed-67f6-4e8a-a485-d5b26fa37fd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:34.498122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b5aed-67f6-4e8a-a485-d5b26fa37fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:34.498400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b5aed-67f6-4e8a-a485-d5b26fa37fd2 admin admin] PATH_INFO: `/v3/projects/b74c8a0e42c14775aee608cad242c989/users/2b8a9623b0174c6e95097546c83667c3/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:34.533559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b5aed-67f6-4e8a-a485-d5b26fa37fd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b74c8a0e42c14775aee608cad242c989, user_id=2b8a9623b0174c6e95097546c83667c3, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:34.540362 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b5aed-67f6-4e8a-a485-d5b26fa37fd2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:34.565569 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a24bca-6d74-402d-a98e-dc332351e6b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:34.567280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a24bca-6d74-402d-a98e-dc332351e6b4 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:34.574634 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1242/2454] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:55:34 2022] PUT /identity/v3/projects/b74c8a0e42c14775aee608cad242c989/users/2b8a9623b0174c6e95097546c83667c3/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:34.575862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b5aed-67f6-4e8a-a485-d5b26fa37fd2 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:34.578458 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1213/2455] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:34.579697 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a24bca-6d74-402d-a98e-dc332351e6b4 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:34.591361 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a24bca-6d74-402d-a98e-dc332351e6b4 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:34.652813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cf418-b7fb-4918-9aad-661388284df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:34.653441 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cf418-b7fb-4918-9aad-661388284df9 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:34.653721 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cf418-b7fb-4918-9aad-661388284df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:34.653991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cf418-b7fb-4918-9aad-661388284df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:34.654663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cf418-b7fb-4918-9aad-661388284df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:34.656349 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cf418-b7fb-4918-9aad-661388284df9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:34.668928 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1214/2456] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:34.677014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cf418-b7fb-4918-9aad-661388284df9 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:34.679671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b5aed-67f6-4e8a-a485-d5b26fa37fd2 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:34.687663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d62a8-cd4a-481f-ad3f-33565d03bfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:34.689198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d62a8-cd4a-481f-ad3f-33565d03bfa5 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:34.689791 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d62a8-cd4a-481f-ad3f-33565d03bfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:34.690215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d62a8-cd4a-481f-ad3f-33565d03bfa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:34.691278 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d62a8-cd4a-481f-ad3f-33565d03bfa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:55:34.691963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d62a8-cd4a-481f-ad3f-33565d03bfa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:34.694028 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d62a8-cd4a-481f-ad3f-33565d03bfa5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:34.698823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cf418-b7fb-4918-9aad-661388284df9 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:34.706781 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2b5b0-ee63-424a-99a0-e46b99c08d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:34.707358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2b5b0-ee63-424a-99a0-e46b99c08d76 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:34.707653 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2b5b0-ee63-424a-99a0-e46b99c08d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:34.708415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2b5b0-ee63-424a-99a0-e46b99c08d76 admin admin] PATH_INFO: `/v3/projects/b74c8a0e42c14775aee608cad242c989/users/2b8a9623b0174c6e95097546c83667c3/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:34.711034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c2b5b0-ee63-424a-99a0-e46b99c08d76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b74c8a0e42c14775aee608cad242c989, user_id=2b8a9623b0174c6e95097546c83667c3, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:34.714075 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c2b5b0-ee63-424a-99a0-e46b99c08d76 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:34.721403 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1243/2457] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:55:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:55:34.722392 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d62a8-cd4a-481f-ad3f-33565d03bfa5 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:34.726856 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1215/2458] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:55:34 2022] PUT /identity/v3/projects/b74c8a0e42c14775aee608cad242c989/users/2b8a9623b0174c6e95097546c83667c3/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:34.738008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a4e98-7277-43ac-a416-00b668ff979c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:34.738982 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a4e98-7277-43ac-a416-00b668ff979c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:34.739262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a4e98-7277-43ac-a416-00b668ff979c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:34.756966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d62a8-cd4a-481f-ad3f-33565d03bfa5 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:34.805936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-8c4a4e98-7277-43ac-a416-00b668ff979c None None] MFA Rules not processed for user `2b8a9623b0174c6e95097546c83667c3`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:34.807195 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8c4a4e98-7277-43ac-a416-00b668ff979c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:34.884166 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5e990-3092-4d98-94cb-ef5025ac4a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:34.885184 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5e990-3092-4d98-94cb-ef5025ac4a94 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:34.885184 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5e990-3092-4d98-94cb-ef5025ac4a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:34.885412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5e990-3092-4d98-94cb-ef5025ac4a94 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:34.886196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5e990-3092-4d98-94cb-ef5025ac4a94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:34.887853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5e990-3092-4d98-94cb-ef5025ac4a94 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:34.949289 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1244/2459] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:55:34 2022] POST /identity/v3/projects => generated 395 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:34.953765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5e990-3092-4d98-94cb-ef5025ac4a94 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:35.013620 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1216/2460] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:34 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:55:35.093720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5e990-3092-4d98-94cb-ef5025ac4a94 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:35.101477 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e36043-de78-4db8-890c-c780bff3d270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:35.104269 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e36043-de78-4db8-890c-c780bff3d270 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:35.104670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e36043-de78-4db8-890c-c780bff3d270 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:35.105047 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e36043-de78-4db8-890c-c780bff3d270 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:35.107825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e36043-de78-4db8-890c-c780bff3d270 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:35.110959 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e36043-de78-4db8-890c-c780bff3d270 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:35.120426 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:35.146626 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1245/2461] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:55:34 2022] POST /identity/v3/users => generated 298 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:55:35.151441 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a4e98-7277-43ac-a416-00b668ff979c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:35.166686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a4e98-7277-43ac-a416-00b668ff979c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:35.171904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b064f-0cc7-4560-a1cd-337b33f79ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:35.172717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b064f-0cc7-4560-a1cd-337b33f79ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:35.172987 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b064f-0cc7-4560-a1cd-337b33f79ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:35.173214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b064f-0cc7-4560-a1cd-337b33f79ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:35.174320 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b064f-0cc7-4560-a1cd-337b33f79ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:35.175510 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b064f-0cc7-4560-a1cd-337b33f79ca9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:35.182165 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:35.194383 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e36043-de78-4db8-890c-c780bff3d270 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:35.208729 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1217/2462] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:35.214300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e36043-de78-4db8-890c-c780bff3d270 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:35.222171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44790bd3-efa0-4a07-9f28-376567219fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:35.223045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44790bd3-efa0-4a07-9f28-376567219fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:35.223721 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44790bd3-efa0-4a07-9f28-376567219fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:35.224002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44790bd3-efa0-4a07-9f28-376567219fa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:35.224930 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44790bd3-efa0-4a07-9f28-376567219fa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:35.226893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44790bd3-efa0-4a07-9f28-376567219fa3 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:35.242607 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1246/2463] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:35.247272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b064f-0cc7-4560-a1cd-337b33f79ca9 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:35.282186 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b064f-0cc7-4560-a1cd-337b33f79ca9 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:35.295106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff3a6e-6445-4576-a54f-54acdeaaf301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:35.296139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff3a6e-6445-4576-a54f-54acdeaaf301 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:35.296827 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff3a6e-6445-4576-a54f-54acdeaaf301 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:35.297292 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff3a6e-6445-4576-a54f-54acdeaaf301 admin admin] PATH_INFO: `/v3/projects/7d3df491595442f0b3db2c41d8f92e90/users/86365ec401234204a907a9f7d955b41c/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:35.336379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff3a6e-6445-4576-a54f-54acdeaaf301 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d3df491595442f0b3db2c41d8f92e90, user_id=86365ec401234204a907a9f7d955b41c, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:35.339880 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff3a6e-6445-4576-a54f-54acdeaaf301 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:35.375927 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1218/2464] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:55:35 2022] PUT /identity/v3/projects/7d3df491595442f0b3db2c41d8f92e90/users/86365ec401234204a907a9f7d955b41c/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:35.377791 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5c67a-92a0-4d9c-8983-43cc5ffd6aaa None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:35.378141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5c67a-92a0-4d9c-8983-43cc5ffd6aaa None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:35.378513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5c67a-92a0-4d9c-8983-43cc5ffd6aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:35.449464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-86b5c67a-92a0-4d9c-8983-43cc5ffd6aaa None None] MFA Rules not processed for user `86365ec401234204a907a9f7d955b41c`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:35.452013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-86b5c67a-92a0-4d9c-8983-43cc5ffd6aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:35.473756 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff3a6e-6445-4576-a54f-54acdeaaf301 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:35.475853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-44ff3a6e-6445-4576-a54f-54acdeaaf301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:35.576968 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1247/2465] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:35 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:35.607416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff3a6e-6445-4576-a54f-54acdeaaf301 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:35.627313 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43655e2e-b2d8-482f-a827-d4be30f63089 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:35.627951 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43655e2e-b2d8-482f-a827-d4be30f63089 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:35.628435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43655e2e-b2d8-482f-a827-d4be30f63089 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:35.628710 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43655e2e-b2d8-482f-a827-d4be30f63089 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:35.740428 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43655e2e-b2d8-482f-a827-d4be30f63089 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:35.747454 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43655e2e-b2d8-482f-a827-d4be30f63089 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:35.766407 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1219/2466] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:55:36.108010 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5c67a-92a0-4d9c-8983-43cc5ffd6aaa None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:36.130129 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5c67a-92a0-4d9c-8983-43cc5ffd6aaa None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:36.137357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fd706-7e90-4494-a136-0eb44116c083 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:36.138306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fd706-7e90-4494-a136-0eb44116c083 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:36.138844 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fd706-7e90-4494-a136-0eb44116c083 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:36.139187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fd706-7e90-4494-a136-0eb44116c083 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:36.151241 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373fd706-7e90-4494-a136-0eb44116c083 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:36.153560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373fd706-7e90-4494-a136-0eb44116c083 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:36.167430 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1248/2467] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:36 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:36.643992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43655e2e-b2d8-482f-a827-d4be30f63089 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:36.688405 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fd706-7e90-4494-a136-0eb44116c083 service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:36.733356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43655e2e-b2d8-482f-a827-d4be30f63089 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:36.738928 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67662856-a33f-45e4-b6bf-847a1cc96dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:36.740135 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67662856-a33f-45e4-b6bf-847a1cc96dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:36.740560 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67662856-a33f-45e4-b6bf-847a1cc96dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:36.740847 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67662856-a33f-45e4-b6bf-847a1cc96dc6 admin admin] PATH_INFO: `/v3/users/86365ec401234204a907a9f7d955b41c` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:36.742158 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67662856-a33f-45e4-b6bf-847a1cc96dc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86365ec401234204a907a9f7d955b41c)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:36.745864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67662856-a33f-45e4-b6bf-847a1cc96dc6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:36.760716 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:36.784638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fd706-7e90-4494-a136-0eb44116c083 service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:36.795089 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf04ad2-b2e8-4707-a958-c66679896d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:36.796087 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf04ad2-b2e8-4707-a958-c66679896d75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:36.796720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf04ad2-b2e8-4707-a958-c66679896d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:36.797056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf04ad2-b2e8-4707-a958-c66679896d75 admin admin] PATH_INFO: `/v3/users/1af69965aeae44449fe70f2cd63c0fed` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:36.798779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf04ad2-b2e8-4707-a958-c66679896d75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1af69965aeae44449fe70f2cd63c0fed)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:36.802566 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf04ad2-b2e8-4707-a958-c66679896d75 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:36.821115 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-67662856-a33f-45e4-b6bf-847a1cc96dc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86365ec401234204a907a9f7d955b41c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:36.823540 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-67662856-a33f-45e4-b6bf-847a1cc96dc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86365ec401234204a907a9f7d955b41c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:36.825794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-67662856-a33f-45e4-b6bf-847a1cc96dc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86365ec401234204a907a9f7d955b41c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:36.838436 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-67662856-a33f-45e4-b6bf-847a1cc96dc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86365ec401234204a907a9f7d955b41c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:36.877629 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-67662856-a33f-45e4-b6bf-847a1cc96dc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86365ec401234204a907a9f7d955b41c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:36.903479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ecf04ad2-b2e8-4707-a958-c66679896d75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1af69965aeae44449fe70f2cd63c0fed'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:36.904960 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1220/2468] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:55:36 2022] DELETE /identity/v3/users/86365ec401234204a907a9f7d955b41c => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:36.909916 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36595e3d-5b31-49eb-b9f4-d4a3c63bf3df None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:36.910224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36595e3d-5b31-49eb-b9f4-d4a3c63bf3df None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:36.910532 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36595e3d-5b31-49eb-b9f4-d4a3c63bf3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:36.934154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ecf04ad2-b2e8-4707-a958-c66679896d75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1af69965aeae44449fe70f2cd63c0fed'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:36.934695 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-36595e3d-5b31-49eb-b9f4-d4a3c63bf3df None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:36.935929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-36595e3d-5b31-49eb-b9f4-d4a3c63bf3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:36.937487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ecf04ad2-b2e8-4707-a958-c66679896d75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1af69965aeae44449fe70f2cd63c0fed'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:36.938578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ecf04ad2-b2e8-4707-a958-c66679896d75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1af69965aeae44449fe70f2cd63c0fed'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:36.942207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:36.960721 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ecf04ad2-b2e8-4707-a958-c66679896d75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1af69965aeae44449fe70f2cd63c0fed'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:36.998768 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1249/2469] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:55:36 2022] DELETE /identity/v3/users/1af69965aeae44449fe70f2cd63c0fed => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:55:37.002416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd72261-1eee-4c10-b5ca-f35c09285019 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:37.003638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd72261-1eee-4c10-b5ca-f35c09285019 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:37.004261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd72261-1eee-4c10-b5ca-f35c09285019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:37.078510 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-0fd72261-1eee-4c10-b5ca-f35c09285019 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:37.083403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0fd72261-1eee-4c10-b5ca-f35c09285019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:37.109209 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1221/2470] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:37.211376 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1250/2471] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:37.269009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36595e3d-5b31-49eb-b9f4-d4a3c63bf3df None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:37.271414 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-36595e3d-5b31-49eb-b9f4-d4a3c63bf3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:37.317999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd72261-1eee-4c10-b5ca-f35c09285019 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:37.319973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0fd72261-1eee-4c10-b5ca-f35c09285019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:37.450124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36595e3d-5b31-49eb-b9f4-d4a3c63bf3df None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:37.522111 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:37.532637 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd72261-1eee-4c10-b5ca-f35c09285019 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:37.537740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c40cd-fcb5-412f-8260-7a29dccf1063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:37.538790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c08d1-273d-4b1f-ab0e-c122a29934cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:37.539104 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c40cd-fcb5-412f-8260-7a29dccf1063 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:37.539503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c40cd-fcb5-412f-8260-7a29dccf1063 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:37.540518 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c08d1-273d-4b1f-ab0e-c122a29934cc service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:37.540707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c40cd-fcb5-412f-8260-7a29dccf1063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:37.542502 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c08d1-273d-4b1f-ab0e-c122a29934cc service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:37.543006 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c08d1-273d-4b1f-ab0e-c122a29934cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:37.556728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c40cd-fcb5-412f-8260-7a29dccf1063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:37.557791 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c40cd-fcb5-412f-8260-7a29dccf1063 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:37.565974 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c08d1-273d-4b1f-ab0e-c122a29934cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:37.569020 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c08d1-273d-4b1f-ab0e-c122a29934cc service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:37.570740 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1251/2472] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:37.591970 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1222/2473] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:38.600839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c40cd-fcb5-412f-8260-7a29dccf1063 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:38.602776 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-374c40cd-fcb5-412f-8260-7a29dccf1063 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:38.622398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c40cd-fcb5-412f-8260-7a29dccf1063 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:38.635845 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd94f8-0735-4113-9738-63bd30aef787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:38.636701 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd94f8-0735-4113-9738-63bd30aef787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:38.636983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd94f8-0735-4113-9738-63bd30aef787 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:38.637257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd94f8-0735-4113-9738-63bd30aef787 admin admin] PATH_INFO: `/v3/projects/7d3df491595442f0b3db2c41d8f92e90` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:38.639547 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd94f8-0735-4113-9738-63bd30aef787 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d3df491595442f0b3db2c41d8f92e90)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:38.643139 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd94f8-0735-4113-9738-63bd30aef787 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:38.732097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e8dd94f8-0735-4113-9738-63bd30aef787 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d3df491595442f0b3db2c41d8f92e90', 'request_id': 'req-e8dd94f8-0735-4113-9738-63bd30aef787'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:38.740852 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e8dd94f8-0735-4113-9738-63bd30aef787 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d3df491595442f0b3db2c41d8f92e90', 'request_id': 'req-e8dd94f8-0735-4113-9738-63bd30aef787'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:38.752112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e8dd94f8-0735-4113-9738-63bd30aef787 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d3df491595442f0b3db2c41d8f92e90', 'request_id': 'req-e8dd94f8-0735-4113-9738-63bd30aef787'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:38.763556 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:38.769988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e8dd94f8-0735-4113-9738-63bd30aef787 admin admin] The token cache is being invalidate because project 7d3df491595442f0b3db2c41d8f92e90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:55:38.770295 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e8dd94f8-0735-4113-9738-63bd30aef787 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:38.771263 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e8dd94f8-0735-4113-9738-63bd30aef787 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:38.773620 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1252/2474] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:55:38 2022] DELETE /identity/v3/projects/7d3df491595442f0b3db2c41d8f92e90 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:38.779162 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e1c7c-0947-4846-905a-9ba185c0a765 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:38.779683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e1c7c-0947-4846-905a-9ba185c0a765 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:38.779683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e1c7c-0947-4846-905a-9ba185c0a765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:38.800245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-e90e1c7c-0947-4846-905a-9ba185c0a765 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:38.801474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e90e1c7c-0947-4846-905a-9ba185c0a765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:38.895476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd94f8-0735-4113-9738-63bd30aef787 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:38.898365 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e8dd94f8-0735-4113-9738-63bd30aef787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:38.974697 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1223/2475] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:38.976235 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88186cbb-765f-44d2-bd62-c89c4dcc7930 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:38.976524 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88186cbb-765f-44d2-bd62-c89c4dcc7930 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:38.976826 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88186cbb-765f-44d2-bd62-c89c4dcc7930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:39.009107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-88186cbb-765f-44d2-bd62-c89c4dcc7930 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:39.010862 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-88186cbb-765f-44d2-bd62-c89c4dcc7930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:39.023299 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1224/2476] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:39.028876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88186cbb-765f-44d2-bd62-c89c4dcc7930 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:39.070420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88186cbb-765f-44d2-bd62-c89c4dcc7930 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:39.082696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23d6e3-2865-458c-95c5-fce3149b303a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:39.084554 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23d6e3-2865-458c-95c5-fce3149b303a admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:39.085460 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23d6e3-2865-458c-95c5-fce3149b303a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:39.085833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23d6e3-2865-458c-95c5-fce3149b303a admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:39.087371 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd23d6e3-2865-458c-95c5-fce3149b303a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:55:39.089101 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd23d6e3-2865-458c-95c5-fce3149b303a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:39.092251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd23d6e3-2865-458c-95c5-fce3149b303a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:39.121486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd94f8-0735-4113-9738-63bd30aef787 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:39.132782 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1225/2477] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:55:39.133831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23d6e3-2865-458c-95c5-fce3149b303a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:39.148227 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc203fc-fab3-4448-bb65-5088f6a7f65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:39.148988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc203fc-fab3-4448-bb65-5088f6a7f65f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:39.149398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc203fc-fab3-4448-bb65-5088f6a7f65f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:39.149768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc203fc-fab3-4448-bb65-5088f6a7f65f admin admin] PATH_INFO: `/v3/projects/be298dcc2e9c45459497fc6168afd7a8` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:39.152217 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc203fc-fab3-4448-bb65-5088f6a7f65f admin admin] RBAC: Authorizing `identity:delete_project(project_id=be298dcc2e9c45459497fc6168afd7a8)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:39.154269 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc203fc-fab3-4448-bb65-5088f6a7f65f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:39.160566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23d6e3-2865-458c-95c5-fce3149b303a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:39.174838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd993d-b0db-466e-99e1-0ce3dac982a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:39.176642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd993d-b0db-466e-99e1-0ce3dac982a4 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:39.177628 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd993d-b0db-466e-99e1-0ce3dac982a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:39.181226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd993d-b0db-466e-99e1-0ce3dac982a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:39.182067 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd993d-b0db-466e-99e1-0ce3dac982a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:39.185124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd993d-b0db-466e-99e1-0ce3dac982a4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:39.276978 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1226/2478] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:55:39 2022] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:39.277939 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd993d-b0db-466e-99e1-0ce3dac982a4 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:39.285287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9dc203fc-fab3-4448-bb65-5088f6a7f65f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be298dcc2e9c45459497fc6168afd7a8', 'request_id': 'req-9dc203fc-fab3-4448-bb65-5088f6a7f65f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:39.302083 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9dc203fc-fab3-4448-bb65-5088f6a7f65f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be298dcc2e9c45459497fc6168afd7a8', 'request_id': 'req-9dc203fc-fab3-4448-bb65-5088f6a7f65f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:39.320035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9dc203fc-fab3-4448-bb65-5088f6a7f65f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be298dcc2e9c45459497fc6168afd7a8', 'request_id': 'req-9dc203fc-fab3-4448-bb65-5088f6a7f65f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:39.344559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9dc203fc-fab3-4448-bb65-5088f6a7f65f admin admin] The token cache is being invalidate because project be298dcc2e9c45459497fc6168afd7a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:55:39.344858 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9dc203fc-fab3-4448-bb65-5088f6a7f65f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:39.346870 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9dc203fc-fab3-4448-bb65-5088f6a7f65f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:39.349300 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1253/2479] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:55:38 2022] DELETE /identity/v3/projects/be298dcc2e9c45459497fc6168afd7a8 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:39.355899 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc203fc-fab3-4448-bb65-5088f6a7f65f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:39.359102 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9dc203fc-fab3-4448-bb65-5088f6a7f65f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:39.454823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd993d-b0db-466e-99e1-0ce3dac982a4 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:39.469954 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18d0bb-4ec9-4cd5-ac04-ed0314d24014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:39.471226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18d0bb-4ec9-4cd5-ac04-ed0314d24014 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:39.474255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18d0bb-4ec9-4cd5-ac04-ed0314d24014 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:39.474817 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18d0bb-4ec9-4cd5-ac04-ed0314d24014 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:39.477047 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18d0bb-4ec9-4cd5-ac04-ed0314d24014 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:39.481765 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18d0bb-4ec9-4cd5-ac04-ed0314d24014 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:39.545027 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1227/2480] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:55:39 2022] POST /identity/v3/users => generated 292 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:39.548288 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18d0bb-4ec9-4cd5-ac04-ed0314d24014 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:39.550463 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0a18d0bb-4ec9-4cd5-ac04-ed0314d24014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:39.558462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc203fc-fab3-4448-bb65-5088f6a7f65f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:39.575212 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15e891-d67d-4bbe-91ce-b28bc58cb9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:39.577727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15e891-d67d-4bbe-91ce-b28bc58cb9e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:39.578951 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15e891-d67d-4bbe-91ce-b28bc58cb9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:39.579417 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15e891-d67d-4bbe-91ce-b28bc58cb9e7 admin admin] PATH_INFO: `/v3/users/2b8a9623b0174c6e95097546c83667c3` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:39.583308 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15e891-d67d-4bbe-91ce-b28bc58cb9e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b8a9623b0174c6e95097546c83667c3)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:39.587447 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18d0bb-4ec9-4cd5-ac04-ed0314d24014 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:39.590734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15e891-d67d-4bbe-91ce-b28bc58cb9e7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:39.603116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4bf3a3-17c8-4e00-aa8f-dce6dab635e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:39.605110 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bf3a3-17c8-4e00-aa8f-dce6dab635e9 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:39.607344 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bf3a3-17c8-4e00-aa8f-dce6dab635e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:39.607796 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bf3a3-17c8-4e00-aa8f-dce6dab635e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:39.610590 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4bf3a3-17c8-4e00-aa8f-dce6dab635e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:39.615258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4bf3a3-17c8-4e00-aa8f-dce6dab635e9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:39.644568 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1228/2481] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:39.652715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4bf3a3-17c8-4e00-aa8f-dce6dab635e9 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:39.692365 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4bf3a3-17c8-4e00-aa8f-dce6dab635e9 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:39.701795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:39.708335 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127c3a2-a6ed-4c07-a54c-b8ab4eb3178b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:39.709410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127c3a2-a6ed-4c07-a54c-b8ab4eb3178b admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:39.709694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127c3a2-a6ed-4c07-a54c-b8ab4eb3178b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:39.709963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127c3a2-a6ed-4c07-a54c-b8ab4eb3178b admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:39.714072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127c3a2-a6ed-4c07-a54c-b8ab4eb3178b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:39.716611 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127c3a2-a6ed-4c07-a54c-b8ab4eb3178b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:39.724757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-db15e891-d67d-4bbe-91ce-b28bc58cb9e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b8a9623b0174c6e95097546c83667c3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:39.737477 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-db15e891-d67d-4bbe-91ce-b28bc58cb9e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b8a9623b0174c6e95097546c83667c3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:39.738243 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-db15e891-d67d-4bbe-91ce-b28bc58cb9e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b8a9623b0174c6e95097546c83667c3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:39.739224 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-db15e891-d67d-4bbe-91ce-b28bc58cb9e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b8a9623b0174c6e95097546c83667c3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:39.760868 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1229/2482] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:39.761957 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127c3a2-a6ed-4c07-a54c-b8ab4eb3178b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:39.764992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b127c3a2-a6ed-4c07-a54c-b8ab4eb3178b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:39.773666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-db15e891-d67d-4bbe-91ce-b28bc58cb9e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b8a9623b0174c6e95097546c83667c3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:39.797797 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127c3a2-a6ed-4c07-a54c-b8ab4eb3178b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:39.809565 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65360c5-b7f2-47ea-81b9-77e7cce888f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:39.810232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65360c5-b7f2-47ea-81b9-77e7cce888f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:39.810517 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65360c5-b7f2-47ea-81b9-77e7cce888f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:39.812084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65360c5-b7f2-47ea-81b9-77e7cce888f8 admin admin] PATH_INFO: `/v3/projects/7397d6b602604e2caa60f16aee28c950/users/096b2f40a81a4627af9ae5c7b83fc619/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:39.817300 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1254/2483] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:55:39 2022] DELETE /identity/v3/users/2b8a9623b0174c6e95097546c83667c3 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:39.843376 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:39.851379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65360c5-b7f2-47ea-81b9-77e7cce888f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7397d6b602604e2caa60f16aee28c950, user_id=096b2f40a81a4627af9ae5c7b83fc619, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:39.855915 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65360c5-b7f2-47ea-81b9-77e7cce888f8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:39.888108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d7895-dbf2-4962-a842-9d29a1323862 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:39.888405 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d7895-dbf2-4962-a842-9d29a1323862 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:39.888677 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d7895-dbf2-4962-a842-9d29a1323862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:39.892626 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1230/2484] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:55:39 2022] PUT /identity/v3/projects/7397d6b602604e2caa60f16aee28c950/users/096b2f40a81a4627af9ae5c7b83fc619/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:39.937011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-5a0d7895-dbf2-4962-a842-9d29a1323862 None None] MFA Rules not processed for user `096b2f40a81a4627af9ae5c7b83fc619`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:39.939312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5a0d7895-dbf2-4962-a842-9d29a1323862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:40.067758 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09650dee-58bb-4b17-88f3-be1cd53898cf None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:40.068051 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09650dee-58bb-4b17-88f3-be1cd53898cf None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:40.068394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09650dee-58bb-4b17-88f3-be1cd53898cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:40.077476 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1255/2485] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:40.093533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-09650dee-58bb-4b17-88f3-be1cd53898cf None None] MFA Rules not processed for user `096b2f40a81a4627af9ae5c7b83fc619`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:40.094845 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-09650dee-58bb-4b17-88f3-be1cd53898cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:40.112105 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1231/2486] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:40.276450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d7895-dbf2-4962-a842-9d29a1323862 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:40.278503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5a0d7895-dbf2-4962-a842-9d29a1323862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:40.409606 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d7895-dbf2-4962-a842-9d29a1323862 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:40.416353 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfde33f-174d-45ba-9779-94c9996af9d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:40.416981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfde33f-174d-45ba-9779-94c9996af9d3 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:40.417267 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfde33f-174d-45ba-9779-94c9996af9d3 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:40.417543 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfde33f-174d-45ba-9779-94c9996af9d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:40.428444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfde33f-174d-45ba-9779-94c9996af9d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:40.431303 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfde33f-174d-45ba-9779-94c9996af9d3 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:40.444886 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1256/2487] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:40.803001 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09650dee-58bb-4b17-88f3-be1cd53898cf None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:40.804946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-09650dee-58bb-4b17-88f3-be1cd53898cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:40.932722 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09650dee-58bb-4b17-88f3-be1cd53898cf None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:40.941460 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680cedd-7ae4-4348-b3ea-a67b54b84726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:40.942253 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680cedd-7ae4-4348-b3ea-a67b54b84726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:40.942664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680cedd-7ae4-4348-b3ea-a67b54b84726 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:40.942947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680cedd-7ae4-4348-b3ea-a67b54b84726 admin admin] PATH_INFO: `/v3/projects/b74c8a0e42c14775aee608cad242c989` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:40.945178 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9680cedd-7ae4-4348-b3ea-a67b54b84726 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b74c8a0e42c14775aee608cad242c989)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:40.948952 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9680cedd-7ae4-4348-b3ea-a67b54b84726 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:41.052502 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9680cedd-7ae4-4348-b3ea-a67b54b84726 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b74c8a0e42c14775aee608cad242c989', 'request_id': 'req-9680cedd-7ae4-4348-b3ea-a67b54b84726'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:41.060375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9680cedd-7ae4-4348-b3ea-a67b54b84726 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b74c8a0e42c14775aee608cad242c989', 'request_id': 'req-9680cedd-7ae4-4348-b3ea-a67b54b84726'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:41.067491 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9680cedd-7ae4-4348-b3ea-a67b54b84726 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b74c8a0e42c14775aee608cad242c989', 'request_id': 'req-9680cedd-7ae4-4348-b3ea-a67b54b84726'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:41.100112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9680cedd-7ae4-4348-b3ea-a67b54b84726 admin admin] The token cache is being invalidate because project b74c8a0e42c14775aee608cad242c989 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:55:41.100471 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9680cedd-7ae4-4348-b3ea-a67b54b84726 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:41.101225 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9680cedd-7ae4-4348-b3ea-a67b54b84726 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:41.106703 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1232/2488] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:55:40 2022] DELETE /identity/v3/projects/b74c8a0e42c14775aee608cad242c989 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:41.109037 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ef5a8-aa7f-40d9-bba8-1b10134357c6 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:41.109554 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ef5a8-aa7f-40d9-bba8-1b10134357c6 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:41.109637 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ef5a8-aa7f-40d9-bba8-1b10134357c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:41.147613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-cc0ef5a8-aa7f-40d9-bba8-1b10134357c6 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:41.149799 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-cc0ef5a8-aa7f-40d9-bba8-1b10134357c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:41.201197 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:41.284755 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1257/2489] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:41.293976 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7e209-dcb6-4241-9232-1e4c40a1e4fe None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:41.294272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7e209-dcb6-4241-9232-1e4c40a1e4fe None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:41.294574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7e209-dcb6-4241-9232-1e4c40a1e4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:41.322576 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f0d7e209-dcb6-4241-9232-1e4c40a1e4fe None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:41.324263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f0d7e209-dcb6-4241-9232-1e4c40a1e4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:41.340477 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1233/2490] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:41.345070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ef5a8-aa7f-40d9-bba8-1b10134357c6 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:41.355465 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ef5a8-aa7f-40d9-bba8-1b10134357c6 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:41.360926 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c345250-b6ad-44ef-9d3f-327dc02d95d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:41.361541 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c345250-b6ad-44ef-9d3f-327dc02d95d5 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:41.361814 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c345250-b6ad-44ef-9d3f-327dc02d95d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:41.362213 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c345250-b6ad-44ef-9d3f-327dc02d95d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:41.363054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c345250-b6ad-44ef-9d3f-327dc02d95d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:55:41.363357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c345250-b6ad-44ef-9d3f-327dc02d95d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:41.365065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c345250-b6ad-44ef-9d3f-327dc02d95d5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:41.382759 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1258/2491] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:55:41.386697 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d7e209-dcb6-4241-9232-1e4c40a1e4fe None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:41.396498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d7e209-dcb6-4241-9232-1e4c40a1e4fe None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:41.402283 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce55312-a6fc-49e3-bc87-c9ce9d3ab5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:41.402996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce55312-a6fc-49e3-bc87-c9ce9d3ab5ac admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:41.403356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce55312-a6fc-49e3-bc87-c9ce9d3ab5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:41.403718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce55312-a6fc-49e3-bc87-c9ce9d3ab5ac admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:41.404574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce55312-a6fc-49e3-bc87-c9ce9d3ab5ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:41.406817 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce55312-a6fc-49e3-bc87-c9ce9d3ab5ac admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:41.459876 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1234/2492] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:55:41 2022] POST /identity/v3/projects => generated 399 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:41.470719 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c345250-b6ad-44ef-9d3f-327dc02d95d5 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:41.487765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c345250-b6ad-44ef-9d3f-327dc02d95d5 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:41.614323 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ca796-fcfa-4f29-a897-3f4b2c2bb999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:41.615664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ca796-fcfa-4f29-a897-3f4b2c2bb999 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:41.616238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ca796-fcfa-4f29-a897-3f4b2c2bb999 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:41.616720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ca796-fcfa-4f29-a897-3f4b2c2bb999 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:41.618194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ca796-fcfa-4f29-a897-3f4b2c2bb999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:41.621571 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ca796-fcfa-4f29-a897-3f4b2c2bb999 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:41.661823 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1259/2493] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:55:41 2022] POST /identity/v3/users => generated 300 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:41.668068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce55312-a6fc-49e3-bc87-c9ce9d3ab5ac admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:41.698861 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce55312-a6fc-49e3-bc87-c9ce9d3ab5ac admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:41.717223 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca844d49-7817-4cb4-a9b3-4da85fc86635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:41.718376 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca844d49-7817-4cb4-a9b3-4da85fc86635 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:41.718774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca844d49-7817-4cb4-a9b3-4da85fc86635 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:41.719052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca844d49-7817-4cb4-a9b3-4da85fc86635 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:41.719717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca844d49-7817-4cb4-a9b3-4da85fc86635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:41.722343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca844d49-7817-4cb4-a9b3-4da85fc86635 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:41.748708 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1235/2494] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:41.753237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ca796-fcfa-4f29-a897-3f4b2c2bb999 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:41.831924 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ca796-fcfa-4f29-a897-3f4b2c2bb999 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:41.861045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b81e2-0543-4073-befe-7b04ffaad505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:41.862961 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b81e2-0543-4073-befe-7b04ffaad505 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:41.863247 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b81e2-0543-4073-befe-7b04ffaad505 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:41.863521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b81e2-0543-4073-befe-7b04ffaad505 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:41.864185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b81e2-0543-4073-befe-7b04ffaad505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:41.871403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b81e2-0543-4073-befe-7b04ffaad505 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:41.928617 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1260/2495] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:41.935209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca844d49-7817-4cb4-a9b3-4da85fc86635 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:41.949875 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca844d49-7817-4cb4-a9b3-4da85fc86635 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:41.967934 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da1203-c398-47a0-80ba-6af8548bcb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:41.968895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da1203-c398-47a0-80ba-6af8548bcb00 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:41.969444 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da1203-c398-47a0-80ba-6af8548bcb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:41.976646 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da1203-c398-47a0-80ba-6af8548bcb00 admin admin] PATH_INFO: `/v3/projects/223cac9f81b340e1bb38e07ac0cf33df/users/58458184a2c0439091c78decf58b0177/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:42.004053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1da1203-c398-47a0-80ba-6af8548bcb00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=223cac9f81b340e1bb38e07ac0cf33df, user_id=58458184a2c0439091c78decf58b0177, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:42.010111 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1da1203-c398-47a0-80ba-6af8548bcb00 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:42.069664 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1236/2496] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:55:41 2022] PUT /identity/v3/projects/223cac9f81b340e1bb38e07ac0cf33df/users/58458184a2c0439091c78decf58b0177/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:42.070712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be57dc-2ef2-441f-8a9f-276a082a2699 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:42.071159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be57dc-2ef2-441f-8a9f-276a082a2699 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:42.071964 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be57dc-2ef2-441f-8a9f-276a082a2699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:42.158730 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-65be57dc-2ef2-441f-8a9f-276a082a2699 None None] MFA Rules not processed for user `58458184a2c0439091c78decf58b0177`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:42.160682 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-65be57dc-2ef2-441f-8a9f-276a082a2699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:42.389769 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1261/2497] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:42 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:42.394966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da1203-c398-47a0-80ba-6af8548bcb00 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:42.413649 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:42.502865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da1203-c398-47a0-80ba-6af8548bcb00 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:42.509185 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84418399-7ad1-4df3-8b82-8fa64ead653c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:42.509941 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84418399-7ad1-4df3-8b82-8fa64ead653c admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:42.510326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84418399-7ad1-4df3-8b82-8fa64ead653c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:42.511094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84418399-7ad1-4df3-8b82-8fa64ead653c admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:42.511968 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84418399-7ad1-4df3-8b82-8fa64ead653c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:42.514224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84418399-7ad1-4df3-8b82-8fa64ead653c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:42.576826 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1237/2498] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:55:42 2022] POST /identity/v3/projects => generated 401 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:42.580935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be57dc-2ef2-441f-8a9f-276a082a2699 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:42.599826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be57dc-2ef2-441f-8a9f-276a082a2699 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:42.636575 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:42.763225 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec665a-46b6-4718-af20-418d83219117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:42.764022 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec665a-46b6-4718-af20-418d83219117 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:42.764403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec665a-46b6-4718-af20-418d83219117 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:42.764775 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec665a-46b6-4718-af20-418d83219117 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:42.766135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec665a-46b6-4718-af20-418d83219117 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:42.767587 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec665a-46b6-4718-af20-418d83219117 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:42.799763 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84418399-7ad1-4df3-8b82-8fa64ead653c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:42.800194 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1262/2499] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:55:42 2022] POST /identity/v3/users => generated 307 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:42.815364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84418399-7ad1-4df3-8b82-8fa64ead653c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:42.820498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3332d-7355-4236-bdc2-dd0a9bc062c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:42.821871 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3332d-7355-4236-bdc2-dd0a9bc062c4 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:42.822156 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3332d-7355-4236-bdc2-dd0a9bc062c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:42.822663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3332d-7355-4236-bdc2-dd0a9bc062c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:42.824151 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed3332d-7355-4236-bdc2-dd0a9bc062c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:42.827226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed3332d-7355-4236-bdc2-dd0a9bc062c4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:42.849987 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1238/2500] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:55:42.854517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec665a-46b6-4718-af20-418d83219117 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:42.881611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec665a-46b6-4718-af20-418d83219117 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:42.906741 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a5d30-99d7-40df-adf8-a0b50d2f20df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:42.907733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a5d30-99d7-40df-adf8-a0b50d2f20df admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:42.908192 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a5d30-99d7-40df-adf8-a0b50d2f20df admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:42.908688 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a5d30-99d7-40df-adf8-a0b50d2f20df admin admin] PATH_INFO: `/v3/projects/06c34e95151a4212986b05ed7a84656e/users/535b817c316343de84b6e7c4876c24e2/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:42.942054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a5d30-99d7-40df-adf8-a0b50d2f20df admin admin] RBAC: Authorizing `identity:create_grant(project_id=06c34e95151a4212986b05ed7a84656e, user_id=535b817c316343de84b6e7c4876c24e2, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:42.949415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a5d30-99d7-40df-adf8-a0b50d2f20df admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:42.970000 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1263/2501] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:55:42 2022] PUT /identity/v3/projects/06c34e95151a4212986b05ed7a84656e/users/535b817c316343de84b6e7c4876c24e2/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:42.973786 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3332d-7355-4236-bdc2-dd0a9bc062c4 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:42.990387 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3332d-7355-4236-bdc2-dd0a9bc062c4 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:43.073832 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c530fe2-3c0c-4e1d-89d5-7355ffb6ae04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:43.074618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c530fe2-3c0c-4e1d-89d5-7355ffb6ae04 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:43.074899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c530fe2-3c0c-4e1d-89d5-7355ffb6ae04 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:43.075169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c530fe2-3c0c-4e1d-89d5-7355ffb6ae04 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:43.075807 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c530fe2-3c0c-4e1d-89d5-7355ffb6ae04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:43.077643 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c530fe2-3c0c-4e1d-89d5-7355ffb6ae04 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:43.090703 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1239/2502] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:43.095314 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a5d30-99d7-40df-adf8-a0b50d2f20df admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:43.112340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a5d30-99d7-40df-adf8-a0b50d2f20df admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:43.125875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521c47a-fcf9-4b45-8418-5afd24545fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:43.126840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521c47a-fcf9-4b45-8418-5afd24545fb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:43.127321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521c47a-fcf9-4b45-8418-5afd24545fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:43.127803 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521c47a-fcf9-4b45-8418-5afd24545fb8 admin admin] PATH_INFO: `/v3/projects/06c34e95151a4212986b05ed7a84656e/users/535b817c316343de84b6e7c4876c24e2/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:43.130131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521c47a-fcf9-4b45-8418-5afd24545fb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06c34e95151a4212986b05ed7a84656e, user_id=535b817c316343de84b6e7c4876c24e2, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:43.134539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521c47a-fcf9-4b45-8418-5afd24545fb8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:43.158092 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1264/2503] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:55:43 2022] PUT /identity/v3/projects/06c34e95151a4212986b05ed7a84656e/users/535b817c316343de84b6e7c4876c24e2/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:43.168894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642948c6-5ffe-44b5-a7dd-1c12a53320d5 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:43.169174 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642948c6-5ffe-44b5-a7dd-1c12a53320d5 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:43.169450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642948c6-5ffe-44b5-a7dd-1c12a53320d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:43.203090 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-642948c6-5ffe-44b5-a7dd-1c12a53320d5 None None] MFA Rules not processed for user `535b817c316343de84b6e7c4876c24e2`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:43.204352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-642948c6-5ffe-44b5-a7dd-1c12a53320d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:43.309502 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1240/2504] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:43 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:55:43.631546 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521c47a-fcf9-4b45-8418-5afd24545fb8 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:43.635272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a521c47a-fcf9-4b45-8418-5afd24545fb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:43.734098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521c47a-fcf9-4b45-8418-5afd24545fb8 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:43.740588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5fabd-522b-4947-81da-7ff4c044838b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:43.741274 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5fabd-522b-4947-81da-7ff4c044838b service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:43.742341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5fabd-522b-4947-81da-7ff4c044838b service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:43.742341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5fabd-522b-4947-81da-7ff4c044838b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:43.751537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5fabd-522b-4947-81da-7ff4c044838b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:43.753197 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5fabd-522b-4947-81da-7ff4c044838b service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:43.765905 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1265/2505] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:43 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:45.542405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642948c6-5ffe-44b5-a7dd-1c12a53320d5 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:45.544075 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-642948c6-5ffe-44b5-a7dd-1c12a53320d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:45.555991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:45.561974 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642948c6-5ffe-44b5-a7dd-1c12a53320d5 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:45.576277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d21d2b-603a-41be-abd5-d389a7924643 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:45.576898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d21d2b-603a-41be-abd5-d389a7924643 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:45.577181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d21d2b-603a-41be-abd5-d389a7924643 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:45.577455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d21d2b-603a-41be-abd5-d389a7924643 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:45.640633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d21d2b-603a-41be-abd5-d389a7924643 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:45.642225 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d21d2b-603a-41be-abd5-d389a7924643 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:45.652342 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1241/2506] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:45 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:45.684371 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5fabd-522b-4947-81da-7ff4c044838b service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:45.747960 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:45.754432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5fabd-522b-4947-81da-7ff4c044838b service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:45.761176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ee45c1-f110-467b-900c-a8e0ca79f370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:45.762031 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee45c1-f110-467b-900c-a8e0ca79f370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:45.762458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee45c1-f110-467b-900c-a8e0ca79f370 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:45.762937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee45c1-f110-467b-900c-a8e0ca79f370 admin admin] PATH_INFO: `/v3/users/58458184a2c0439091c78decf58b0177` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:45.764226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ee45c1-f110-467b-900c-a8e0ca79f370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58458184a2c0439091c78decf58b0177)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:45.766295 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ee45c1-f110-467b-900c-a8e0ca79f370 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:45.834787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-74ee45c1-f110-467b-900c-a8e0ca79f370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58458184a2c0439091c78decf58b0177'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:45.844853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-74ee45c1-f110-467b-900c-a8e0ca79f370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58458184a2c0439091c78decf58b0177'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:45.845601 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-74ee45c1-f110-467b-900c-a8e0ca79f370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58458184a2c0439091c78decf58b0177'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:45.848800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-74ee45c1-f110-467b-900c-a8e0ca79f370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58458184a2c0439091c78decf58b0177'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:45.856094 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-74ee45c1-f110-467b-900c-a8e0ca79f370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58458184a2c0439091c78decf58b0177'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:45.878848 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1266/2507] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:55:45 2022] DELETE /identity/v3/users/58458184a2c0439091c78decf58b0177 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:45.884590 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40b581-e3fa-4497-ab4f-4796e7076137 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:45.884868 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40b581-e3fa-4497-ab4f-4796e7076137 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:45.885322 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40b581-e3fa-4497-ab4f-4796e7076137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:45.911564 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-8c40b581-e3fa-4497-ab4f-4796e7076137 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:45.913169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8c40b581-e3fa-4497-ab4f-4796e7076137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:45.996858 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1242/2508] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:46.058427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ee45c1-f110-467b-900c-a8e0ca79f370 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:46.060051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-74ee45c1-f110-467b-900c-a8e0ca79f370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:46.142634 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ee45c1-f110-467b-900c-a8e0ca79f370 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:46.146772 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a7097-ba14-4771-9873-5ab4b4d86998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:46.147516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a7097-ba14-4771-9873-5ab4b4d86998 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:46.148942 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a7097-ba14-4771-9873-5ab4b4d86998 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:46.149339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a7097-ba14-4771-9873-5ab4b4d86998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:46.162023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7a7097-ba14-4771-9873-5ab4b4d86998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:46.164305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7a7097-ba14-4771-9873-5ab4b4d86998 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:46.177676 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1267/2509] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:47.268904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40b581-e3fa-4497-ab4f-4796e7076137 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:47.270923 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8c40b581-e3fa-4497-ab4f-4796e7076137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:47.297149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40b581-e3fa-4497-ab4f-4796e7076137 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:47.322140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2491d-bcab-4b76-9ba3-95e43ac9e7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:47.322828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2491d-bcab-4b76-9ba3-95e43ac9e7dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:47.323300 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2491d-bcab-4b76-9ba3-95e43ac9e7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:47.323730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2491d-bcab-4b76-9ba3-95e43ac9e7dd admin admin] PATH_INFO: `/v3/projects/223cac9f81b340e1bb38e07ac0cf33df` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:47.325041 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2491d-bcab-4b76-9ba3-95e43ac9e7dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=223cac9f81b340e1bb38e07ac0cf33df)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:47.327169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2491d-bcab-4b76-9ba3-95e43ac9e7dd admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:47.402729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-98f2491d-bcab-4b76-9ba3-95e43ac9e7dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '223cac9f81b340e1bb38e07ac0cf33df', 'request_id': 'req-98f2491d-bcab-4b76-9ba3-95e43ac9e7dd'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:47.411923 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-98f2491d-bcab-4b76-9ba3-95e43ac9e7dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '223cac9f81b340e1bb38e07ac0cf33df', 'request_id': 'req-98f2491d-bcab-4b76-9ba3-95e43ac9e7dd'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:47.431229 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-98f2491d-bcab-4b76-9ba3-95e43ac9e7dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '223cac9f81b340e1bb38e07ac0cf33df', 'request_id': 'req-98f2491d-bcab-4b76-9ba3-95e43ac9e7dd'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:47.471866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-98f2491d-bcab-4b76-9ba3-95e43ac9e7dd admin admin] The token cache is being invalidate because project 223cac9f81b340e1bb38e07ac0cf33df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:55:47.472164 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-98f2491d-bcab-4b76-9ba3-95e43ac9e7dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:47.472963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-98f2491d-bcab-4b76-9ba3-95e43ac9e7dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:47.479375 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1243/2510] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:55:47 2022] DELETE /identity/v3/projects/223cac9f81b340e1bb38e07ac0cf33df => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:47.480638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a7097-ba14-4771-9873-5ab4b4d86998 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:47.493576 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a7097-ba14-4771-9873-5ab4b4d86998 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:47.624451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10207d44-6025-4d02-a96b-b785869a2c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:47.625860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10207d44-6025-4d02-a96b-b785869a2c7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:47.626342 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10207d44-6025-4d02-a96b-b785869a2c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:47.626819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10207d44-6025-4d02-a96b-b785869a2c7b admin admin] PATH_INFO: `/v3/users/535b817c316343de84b6e7c4876c24e2` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:47.630019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10207d44-6025-4d02-a96b-b785869a2c7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=535b817c316343de84b6e7c4876c24e2)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:47.632157 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10207d44-6025-4d02-a96b-b785869a2c7b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:47.670652 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:47.733270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-10207d44-6025-4d02-a96b-b785869a2c7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '535b817c316343de84b6e7c4876c24e2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:47.754633 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-10207d44-6025-4d02-a96b-b785869a2c7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '535b817c316343de84b6e7c4876c24e2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:47.755659 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-10207d44-6025-4d02-a96b-b785869a2c7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '535b817c316343de84b6e7c4876c24e2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:47.756416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-10207d44-6025-4d02-a96b-b785869a2c7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '535b817c316343de84b6e7c4876c24e2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:47.769496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-10207d44-6025-4d02-a96b-b785869a2c7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '535b817c316343de84b6e7c4876c24e2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:47.809349 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1268/2511] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:55:47 2022] DELETE /identity/v3/users/535b817c316343de84b6e7c4876c24e2 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:49.386675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2491d-bcab-4b76-9ba3-95e43ac9e7dd admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:49.388437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-98f2491d-bcab-4b76-9ba3-95e43ac9e7dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:49.404990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2491d-bcab-4b76-9ba3-95e43ac9e7dd admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:49.476180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:49.546076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32039aec-10f9-41a2-8c51-3009881f198b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:49.546888 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32039aec-10f9-41a2-8c51-3009881f198b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:49.547250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32039aec-10f9-41a2-8c51-3009881f198b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:49.547595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32039aec-10f9-41a2-8c51-3009881f198b admin admin] PATH_INFO: `/v3/projects/06c34e95151a4212986b05ed7a84656e` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:49.553882 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32039aec-10f9-41a2-8c51-3009881f198b admin admin] RBAC: Authorizing `identity:delete_project(project_id=06c34e95151a4212986b05ed7a84656e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:49.557779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32039aec-10f9-41a2-8c51-3009881f198b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:49.638857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-32039aec-10f9-41a2-8c51-3009881f198b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06c34e95151a4212986b05ed7a84656e', 'request_id': 'req-32039aec-10f9-41a2-8c51-3009881f198b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:49.648354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-32039aec-10f9-41a2-8c51-3009881f198b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06c34e95151a4212986b05ed7a84656e', 'request_id': 'req-32039aec-10f9-41a2-8c51-3009881f198b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:49.657476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-32039aec-10f9-41a2-8c51-3009881f198b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06c34e95151a4212986b05ed7a84656e', 'request_id': 'req-32039aec-10f9-41a2-8c51-3009881f198b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:49.704073 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-32039aec-10f9-41a2-8c51-3009881f198b admin admin] The token cache is being invalidate because project 06c34e95151a4212986b05ed7a84656e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:55:49.704371 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-32039aec-10f9-41a2-8c51-3009881f198b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:49.706057 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-32039aec-10f9-41a2-8c51-3009881f198b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:49.711609 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1244/2512] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:55:49 2022] DELETE /identity/v3/projects/06c34e95151a4212986b05ed7a84656e => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:49.715069 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f10d1-a747-4bed-b6df-9c1fc4350b51 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:49.715770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f10d1-a747-4bed-b6df-9c1fc4350b51 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:49.715770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f10d1-a747-4bed-b6df-9c1fc4350b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:49.768738 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-f97f10d1-a747-4bed-b6df-9c1fc4350b51 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:49.772216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f97f10d1-a747-4bed-b6df-9c1fc4350b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:49.898039 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1269/2513] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:49.900815 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903c79d-3706-457a-bc17-5d4619c17a9f None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:49.901104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903c79d-3706-457a-bc17-5d4619c17a9f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:49.901844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903c79d-3706-457a-bc17-5d4619c17a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:49.945116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-2903c79d-3706-457a-bc17-5d4619c17a9f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:49.954006 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2903c79d-3706-457a-bc17-5d4619c17a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:49.981051 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1245/2514] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:49.985663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f10d1-a747-4bed-b6df-9c1fc4350b51 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:49.998879 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f10d1-a747-4bed-b6df-9c1fc4350b51 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:50.004651 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2033b01-7085-497c-891d-fc5eecd7359a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:50.005561 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2033b01-7085-497c-891d-fc5eecd7359a admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:50.006265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2033b01-7085-497c-891d-fc5eecd7359a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:50.006265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2033b01-7085-497c-891d-fc5eecd7359a admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:50.006787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2033b01-7085-497c-891d-fc5eecd7359a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:55:50.007083 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2033b01-7085-497c-891d-fc5eecd7359a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:50.009396 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2033b01-7085-497c-891d-fc5eecd7359a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:50.026599 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1270/2515] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:55:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:55:50.030265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903c79d-3706-457a-bc17-5d4619c17a9f None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:50.043126 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903c79d-3706-457a-bc17-5d4619c17a9f None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:50.058141 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df77a2a2-44f8-4fca-bab8-77b9de535301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:50.058806 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77a2a2-44f8-4fca-bab8-77b9de535301 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:50.059088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77a2a2-44f8-4fca-bab8-77b9de535301 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:50.059365 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77a2a2-44f8-4fca-bab8-77b9de535301 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:50.060000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df77a2a2-44f8-4fca-bab8-77b9de535301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:50.065780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df77a2a2-44f8-4fca-bab8-77b9de535301 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:50.127345 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1246/2516] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:55:50 2022] POST /identity/v3/projects => generated 371 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:50.128852 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2033b01-7085-497c-891d-fc5eecd7359a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:50.142782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2033b01-7085-497c-891d-fc5eecd7359a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:50.345026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086058b0-8032-41cc-97fb-1c4d0ff8f705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:50.345772 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086058b0-8032-41cc-97fb-1c4d0ff8f705 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:50.346344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086058b0-8032-41cc-97fb-1c4d0ff8f705 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:50.346762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086058b0-8032-41cc-97fb-1c4d0ff8f705 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:50.347904 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086058b0-8032-41cc-97fb-1c4d0ff8f705 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:50.352299 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086058b0-8032-41cc-97fb-1c4d0ff8f705 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:50.399873 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1271/2517] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:55:50 2022] POST /identity/v3/users => generated 286 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:50.404002 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df77a2a2-44f8-4fca-bab8-77b9de535301 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:50.423185 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df77a2a2-44f8-4fca-bab8-77b9de535301 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:50.432166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4459d-85ae-426e-8a6d-5ed1f8cb1e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:50.433119 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4459d-85ae-426e-8a6d-5ed1f8cb1e3e admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:50.434912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4459d-85ae-426e-8a6d-5ed1f8cb1e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:50.435061 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4459d-85ae-426e-8a6d-5ed1f8cb1e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:50.438078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4459d-85ae-426e-8a6d-5ed1f8cb1e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:50.439894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4459d-85ae-426e-8a6d-5ed1f8cb1e3e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:50.459755 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1247/2518] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:50.463985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086058b0-8032-41cc-97fb-1c4d0ff8f705 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:50.478421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086058b0-8032-41cc-97fb-1c4d0ff8f705 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:50.484769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c665e6b-b839-4384-8cd8-da77e7654e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:50.485384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c665e6b-b839-4384-8cd8-da77e7654e27 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:50.485664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c665e6b-b839-4384-8cd8-da77e7654e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:50.485938 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c665e6b-b839-4384-8cd8-da77e7654e27 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:50.486678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c665e6b-b839-4384-8cd8-da77e7654e27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:50.488277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c665e6b-b839-4384-8cd8-da77e7654e27 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:50.501585 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1272/2519] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:50.505826 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4459d-85ae-426e-8a6d-5ed1f8cb1e3e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:50.540657 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4459d-85ae-426e-8a6d-5ed1f8cb1e3e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:50.546420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464132e-50f0-431d-a8db-799b67384d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:50.547475 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464132e-50f0-431d-a8db-799b67384d8c admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:50.547965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464132e-50f0-431d-a8db-799b67384d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:50.548302 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464132e-50f0-431d-a8db-799b67384d8c admin admin] PATH_INFO: `/v3/projects/9c56e75f91534676ab7166c04292c9fe/users/03712c55fe354985a4639603d4307415/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:50.596763 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8464132e-50f0-431d-a8db-799b67384d8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c56e75f91534676ab7166c04292c9fe, user_id=03712c55fe354985a4639603d4307415, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:50.599922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8464132e-50f0-431d-a8db-799b67384d8c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:50.619779 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1248/2520] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:55:50 2022] PUT /identity/v3/projects/9c56e75f91534676ab7166c04292c9fe/users/03712c55fe354985a4639603d4307415/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:50.696402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf9ffd-49dc-42c3-8756-c3ee85bc9202 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:50.697233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf9ffd-49dc-42c3-8756-c3ee85bc9202 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:50.697520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf9ffd-49dc-42c3-8756-c3ee85bc9202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:50.707972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:50.739937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-5ecf9ffd-49dc-42c3-8756-c3ee85bc9202 None None] MFA Rules not processed for user `03712c55fe354985a4639603d4307415`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:50.742403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5ecf9ffd-49dc-42c3-8756-c3ee85bc9202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:50.877929 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1273/2521] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:51.028763 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464132e-50f0-431d-a8db-799b67384d8c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:51.030730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8464132e-50f0-431d-a8db-799b67384d8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:51.096962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:51.121025 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464132e-50f0-431d-a8db-799b67384d8c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:51.126689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7b8d5-99fb-4d6c-9a26-dc36506b614d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:51.127303 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7b8d5-99fb-4d6c-9a26-dc36506b614d service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:51.127583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7b8d5-99fb-4d6c-9a26-dc36506b614d service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:51.127857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7b8d5-99fb-4d6c-9a26-dc36506b614d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:51.137895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a7b8d5-99fb-4d6c-9a26-dc36506b614d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:51.139552 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a7b8d5-99fb-4d6c-9a26-dc36506b614d service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:51.150003 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1249/2522] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:52.282850 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf9ffd-49dc-42c3-8756-c3ee85bc9202 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:52.353290 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf9ffd-49dc-42c3-8756-c3ee85bc9202 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:52.358933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec686b52-7787-4505-b10e-710f57a2d210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:52.359662 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec686b52-7787-4505-b10e-710f57a2d210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:52.359938 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec686b52-7787-4505-b10e-710f57a2d210 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:52.360265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec686b52-7787-4505-b10e-710f57a2d210 admin admin] PATH_INFO: `/v3/users/03712c55fe354985a4639603d4307415` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:52.361440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec686b52-7787-4505-b10e-710f57a2d210 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03712c55fe354985a4639603d4307415)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:52.363445 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec686b52-7787-4505-b10e-710f57a2d210 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:52.417379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ec686b52-7787-4505-b10e-710f57a2d210 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03712c55fe354985a4639603d4307415'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:52.425007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ec686b52-7787-4505-b10e-710f57a2d210 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03712c55fe354985a4639603d4307415'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:52.425760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ec686b52-7787-4505-b10e-710f57a2d210 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03712c55fe354985a4639603d4307415'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:52.426365 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ec686b52-7787-4505-b10e-710f57a2d210 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03712c55fe354985a4639603d4307415'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:52.434820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ec686b52-7787-4505-b10e-710f57a2d210 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03712c55fe354985a4639603d4307415'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:52.455492 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1274/2523] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:55:52 2022] DELETE /identity/v3/users/03712c55fe354985a4639603d4307415 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:52.459958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c4123-1b50-452f-a2a4-e8f3a67af557 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:52.460444 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c4123-1b50-452f-a2a4-e8f3a67af557 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:52.460541 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c4123-1b50-452f-a2a4-e8f3a67af557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:52.480377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-5f4c4123-1b50-452f-a2a4-e8f3a67af557 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:52.481695 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5f4c4123-1b50-452f-a2a4-e8f3a67af557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:52.544508 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1250/2524] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:52.555832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec686b52-7787-4505-b10e-710f57a2d210 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:52.557302 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ec686b52-7787-4505-b10e-710f57a2d210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:52.573494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:52.654096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec686b52-7787-4505-b10e-710f57a2d210 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:52.659619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2edb47-3f78-49c6-a821-1db2270c349c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:52.661060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2edb47-3f78-49c6-a821-1db2270c349c service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:52.661349 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2edb47-3f78-49c6-a821-1db2270c349c service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:52.661627 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2edb47-3f78-49c6-a821-1db2270c349c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:52.678780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2edb47-3f78-49c6-a821-1db2270c349c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:52.682169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2edb47-3f78-49c6-a821-1db2270c349c service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:52.701440 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1275/2525] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:53.118588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a06bd-03c6-4a16-b3ae-08ed84a70ce2 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:53.118588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a06bd-03c6-4a16-b3ae-08ed84a70ce2 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:53.118588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a06bd-03c6-4a16-b3ae-08ed84a70ce2 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:53.119525 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1251/2526] 10.222.0.33 () {54 vars in 921 bytes} [Sat Aug 6 20:55:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:55:53.126272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00c615-f203-48c0-8788-a3cefcd3c27a None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:53.126675 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00c615-f203-48c0-8788-a3cefcd3c27a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:53.127012 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00c615-f203-48c0-8788-a3cefcd3c27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:53.151102 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-ce00c615-f203-48c0-8788-a3cefcd3c27a None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:53.152464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ce00c615-f203-48c0-8788-a3cefcd3c27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:53.227575 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1276/2527] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 20:55:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:53.228560 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a06bd-03c6-4a16-b3ae-08ed84a70ce2 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:53.230410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c30a06bd-03c6-4a16-b3ae-08ed84a70ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:53.247728 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a06bd-03c6-4a16-b3ae-08ed84a70ce2 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:53.250004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00c615-f203-48c0-8788-a3cefcd3c27a None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:53.251672 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ce00c615-f203-48c0-8788-a3cefcd3c27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:53.253726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd2717-5a28-42dd-adbd-3e7dd1139991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:53.255549 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd2717-5a28-42dd-adbd-3e7dd1139991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:53.255829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd2717-5a28-42dd-adbd-3e7dd1139991 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:53.256103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd2717-5a28-42dd-adbd-3e7dd1139991 admin admin] PATH_INFO: `/v3/projects/9c56e75f91534676ab7166c04292c9fe` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:53.258048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd2717-5a28-42dd-adbd-3e7dd1139991 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c56e75f91534676ab7166c04292c9fe)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:53.260314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd2717-5a28-42dd-adbd-3e7dd1139991 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:53.269617 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00c615-f203-48c0-8788-a3cefcd3c27a None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:53.276255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c96ef-300b-4e9b-bec3-6cae3912656e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:53.276868 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c96ef-300b-4e9b-bec3-6cae3912656e service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:53.277153 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c96ef-300b-4e9b-bec3-6cae3912656e service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:53.277430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c96ef-300b-4e9b-bec3-6cae3912656e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:53.287908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c96ef-300b-4e9b-bec3-6cae3912656e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:53.290103 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c96ef-300b-4e9b-bec3-6cae3912656e service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:53.300967 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1277/2528] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:53.319237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e9fd2717-5a28-42dd-adbd-3e7dd1139991 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c56e75f91534676ab7166c04292c9fe', 'request_id': 'req-e9fd2717-5a28-42dd-adbd-3e7dd1139991'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:53.326651 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e9fd2717-5a28-42dd-adbd-3e7dd1139991 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c56e75f91534676ab7166c04292c9fe', 'request_id': 'req-e9fd2717-5a28-42dd-adbd-3e7dd1139991'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:53.336539 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e9fd2717-5a28-42dd-adbd-3e7dd1139991 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c56e75f91534676ab7166c04292c9fe', 'request_id': 'req-e9fd2717-5a28-42dd-adbd-3e7dd1139991'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:53.352193 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e9fd2717-5a28-42dd-adbd-3e7dd1139991 admin admin] The token cache is being invalidate because project 9c56e75f91534676ab7166c04292c9fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:55:53.352485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e9fd2717-5a28-42dd-adbd-3e7dd1139991 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:53.353291 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e9fd2717-5a28-42dd-adbd-3e7dd1139991 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:55:53.358437 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1252/2529] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:55:53 2022] DELETE /identity/v3/projects/9c56e75f91534676ab7166c04292c9fe => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:55:53.360177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e7b29-9ea1-43c8-a8d2-fc0320ba5773 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:53.360393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e7b29-9ea1-43c8-a8d2-fc0320ba5773 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:53.360673 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e7b29-9ea1-43c8-a8d2-fc0320ba5773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:53.385977 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-007e7b29-9ea1-43c8-a8d2-fc0320ba5773 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:53.387983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-007e7b29-9ea1-43c8-a8d2-fc0320ba5773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:53.463810 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1278/2530] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:55:53.471910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf474d-fa98-4dd6-87af-adb321d088d0 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:53.472414 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf474d-fa98-4dd6-87af-adb321d088d0 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:53.472414 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf474d-fa98-4dd6-87af-adb321d088d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:53.500790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-07cf474d-fa98-4dd6-87af-adb321d088d0 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:53.501996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-07cf474d-fa98-4dd6-87af-adb321d088d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:53.511765 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1253/2531] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:53.515972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e7b29-9ea1-43c8-a8d2-fc0320ba5773 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:53.528326 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e7b29-9ea1-43c8-a8d2-fc0320ba5773 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:53.533632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ef8ca-4df4-49e9-bf44-2d5dcb3425c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:53.534280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ef8ca-4df4-49e9-bf44-2d5dcb3425c4 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:53.534611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ef8ca-4df4-49e9-bf44-2d5dcb3425c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:53.534871 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ef8ca-4df4-49e9-bf44-2d5dcb3425c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:53.535568 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ef8ca-4df4-49e9-bf44-2d5dcb3425c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:55:53.535877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ef8ca-4df4-49e9-bf44-2d5dcb3425c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:53.539518 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ef8ca-4df4-49e9-bf44-2d5dcb3425c4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:53.555374 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1279/2532] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:55:53.561599 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf474d-fa98-4dd6-87af-adb321d088d0 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:53.573185 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf474d-fa98-4dd6-87af-adb321d088d0 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:53.578659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f50e38-abd5-42e0-8d31-7d62722a4b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:53.579737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f50e38-abd5-42e0-8d31-7d62722a4b8c admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:53.579922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f50e38-abd5-42e0-8d31-7d62722a4b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:53.580195 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f50e38-abd5-42e0-8d31-7d62722a4b8c admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:53.580909 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f50e38-abd5-42e0-8d31-7d62722a4b8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:53.583041 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f50e38-abd5-42e0-8d31-7d62722a4b8c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:53.614713 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1254/2533] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:55:53 2022] POST /identity/v3/projects => generated 397 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:53.619085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ef8ca-4df4-49e9-bf44-2d5dcb3425c4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:53.630641 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ef8ca-4df4-49e9-bf44-2d5dcb3425c4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:53.671983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:53.709844 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3d09a-390e-4369-9f99-73443ebcb488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:53.711116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3d09a-390e-4369-9f99-73443ebcb488 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:53.712132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3d09a-390e-4369-9f99-73443ebcb488 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:53.712415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3d09a-390e-4369-9f99-73443ebcb488 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:53.713041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3d09a-390e-4369-9f99-73443ebcb488 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:53.714977 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3d09a-390e-4369-9f99-73443ebcb488 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:53.738723 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1280/2534] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:55:53 2022] POST /identity/v3/users => generated 299 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:55:53.741320 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f50e38-abd5-42e0-8d31-7d62722a4b8c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:53.752397 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f50e38-abd5-42e0-8d31-7d62722a4b8c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:53.758095 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ac9d3-e4ab-4bec-81dd-1eb55c25eac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:53.758742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ac9d3-e4ab-4bec-81dd-1eb55c25eac0 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:53.759021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ac9d3-e4ab-4bec-81dd-1eb55c25eac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:53.759293 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ac9d3-e4ab-4bec-81dd-1eb55c25eac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:53.759952 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ac9d3-e4ab-4bec-81dd-1eb55c25eac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:53.774581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ac9d3-e4ab-4bec-81dd-1eb55c25eac0 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:53.785350 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1255/2535] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:53.790264 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3d09a-390e-4369-9f99-73443ebcb488 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:53.800564 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3d09a-390e-4369-9f99-73443ebcb488 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:53.806446 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87233a3c-1072-4cb4-bee8-c5a4580707a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:53.807188 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87233a3c-1072-4cb4-bee8-c5a4580707a5 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:53.807534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87233a3c-1072-4cb4-bee8-c5a4580707a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:53.807873 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87233a3c-1072-4cb4-bee8-c5a4580707a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:53.808586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87233a3c-1072-4cb4-bee8-c5a4580707a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:53.810241 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87233a3c-1072-4cb4-bee8-c5a4580707a5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:53.822610 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1281/2536] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:55:53.826990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ac9d3-e4ab-4bec-81dd-1eb55c25eac0 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:53.839550 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ac9d3-e4ab-4bec-81dd-1eb55c25eac0 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:53.845314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33877940-d96a-4503-b598-2718c487c28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:53.847793 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33877940-d96a-4503-b598-2718c487c28b admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:53.847793 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33877940-d96a-4503-b598-2718c487c28b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:53.847793 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33877940-d96a-4503-b598-2718c487c28b admin admin] PATH_INFO: `/v3/projects/8fd242c56a3f436c9cf158e68253218c/users/dff69a9a061a454685cfc57c1675f4b9/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:53.875254 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33877940-d96a-4503-b598-2718c487c28b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fd242c56a3f436c9cf158e68253218c, user_id=dff69a9a061a454685cfc57c1675f4b9, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:53.877959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33877940-d96a-4503-b598-2718c487c28b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:53.894016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:53.905126 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1256/2537] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:55:53 2022] PUT /identity/v3/projects/8fd242c56a3f436c9cf158e68253218c/users/dff69a9a061a454685cfc57c1675f4b9/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:55:53.906996 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfae45-db4a-4453-875c-69b69fb7414e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:53.907392 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfae45-db4a-4453-875c-69b69fb7414e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:53.907674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfae45-db4a-4453-875c-69b69fb7414e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:53.928797 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-84bfae45-db4a-4453-875c-69b69fb7414e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:53.931437 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-84bfae45-db4a-4453-875c-69b69fb7414e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:54.001823 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1282/2538] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:54.028515 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33877940-d96a-4503-b598-2718c487c28b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:54.030264 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-33877940-d96a-4503-b598-2718c487c28b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:54.104326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33877940-d96a-4503-b598-2718c487c28b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:54.108822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93270b96-b1b2-494e-af1b-04274ac78ea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:54.109919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93270b96-b1b2-494e-af1b-04274ac78ea5 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:54.110511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93270b96-b1b2-494e-af1b-04274ac78ea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:54.110511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93270b96-b1b2-494e-af1b-04274ac78ea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:54.123744 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93270b96-b1b2-494e-af1b-04274ac78ea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:54.125765 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93270b96-b1b2-494e-af1b-04274ac78ea5 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:54.144104 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1257/2539] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:54.657329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31552baa-20b6-49eb-8ab3-bc944a3ec562 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:54.658018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31552baa-20b6-49eb-8ab3-bc944a3ec562 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:54.658018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31552baa-20b6-49eb-8ab3-bc944a3ec562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:54.693627 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-31552baa-20b6-49eb-8ab3-bc944a3ec562 None None] MFA Rules not processed for user `5f9d53147a57402f8b9818590bc1fc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:54.703913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-31552baa-20b6-49eb-8ab3-bc944a3ec562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:54.843510 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1283/2540] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 20:55:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:54.856199 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93270b96-b1b2-494e-af1b-04274ac78ea5 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:54.858396 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-93270b96-b1b2-494e-af1b-04274ac78ea5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:54.895383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93270b96-b1b2-494e-af1b-04274ac78ea5 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:54.903356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b06a7e-3b87-4fe9-8816-e9ceadf14d18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:54.904386 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b06a7e-3b87-4fe9-8816-e9ceadf14d18 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:54.904668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b06a7e-3b87-4fe9-8816-e9ceadf14d18 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:54.904949 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b06a7e-3b87-4fe9-8816-e9ceadf14d18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:54.919892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b06a7e-3b87-4fe9-8816-e9ceadf14d18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:54.921743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b06a7e-3b87-4fe9-8816-e9ceadf14d18 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:54.943370 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1258/2541] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:56.237433 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31552baa-20b6-49eb-8ab3-bc944a3ec562 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:56.240381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-31552baa-20b6-49eb-8ab3-bc944a3ec562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:56.256700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31552baa-20b6-49eb-8ab3-bc944a3ec562 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:56.264106 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8613c0-c040-4e57-8cfe-a635f8c385c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:56.264848 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8613c0-c040-4e57-8cfe-a635f8c385c8 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:56.265193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8613c0-c040-4e57-8cfe-a635f8c385c8 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:56.265571 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8613c0-c040-4e57-8cfe-a635f8c385c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:56.267511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6e8613c0-c040-4e57-8cfe-a635f8c385c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:56.315095 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:56.361786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8613c0-c040-4e57-8cfe-a635f8c385c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:56.363498 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8613c0-c040-4e57-8cfe-a635f8c385c8 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:56.374766 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1284/2542] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:56 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:56.690300 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f666087-5a4c-4b15-b073-52d738c58518 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:56.691840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f666087-5a4c-4b15-b073-52d738c58518 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:56.692283 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f666087-5a4c-4b15-b073-52d738c58518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:56.735947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-1f666087-5a4c-4b15-b073-52d738c58518 None None] MFA Rules not processed for user `79ffbe6477ea45f481620fa6293e1958`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:56.740767 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1f666087-5a4c-4b15-b073-52d738c58518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:56.846604 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1259/2543] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:56.960287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35effd80-353b-4049-8522-c8a23570f0cc None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:56.962041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35effd80-353b-4049-8522-c8a23570f0cc None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:56.962645 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35effd80-353b-4049-8522-c8a23570f0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:57.019838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-35effd80-353b-4049-8522-c8a23570f0cc None None] MFA Rules not processed for user `10aebae8bbbd4ea88b9cbf85d3438ed1`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:57.021353 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-35effd80-353b-4049-8522-c8a23570f0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:57.094561 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1285/2544] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:55:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:58.451296 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f666087-5a4c-4b15-b073-52d738c58518 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:58.467204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f666087-5a4c-4b15-b073-52d738c58518 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:58.473624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ac9c2-c085-471a-a033-a685b0b8810d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:58.474879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ac9c2-c085-471a-a033-a685b0b8810d service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:58.475343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ac9c2-c085-471a-a033-a685b0b8810d service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:58.475831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ac9c2-c085-471a-a033-a685b0b8810d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:58.478228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-fb9ac9c2-c085-471a-a033-a685b0b8810d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:58.563019 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ac9c2-c085-471a-a033-a685b0b8810d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:58.564639 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ac9c2-c085-471a-a033-a685b0b8810d service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:58.599603 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1260/2545] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:56:05.057647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83dca86-68ee-489c-84fd-0051666e74c2 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:05.058143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83dca86-68ee-489c-84fd-0051666e74c2 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:05.058335 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83dca86-68ee-489c-84fd-0051666e74c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:05.116834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a83dca86-68ee-489c-84fd-0051666e74c2 None None] MFA Rules not processed for user `dff69a9a061a454685cfc57c1675f4b9`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:56:05.129799 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a83dca86-68ee-489c-84fd-0051666e74c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:05.254929 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1286/2546] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:56:05 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:56:05.256400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c8c9e-0afb-47f6-becf-59bd55e62cfa None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:05.257479 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c8c9e-0afb-47f6-becf-59bd55e62cfa None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:05.263496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c8c9e-0afb-47f6-becf-59bd55e62cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:05.288788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-646c8c9e-0afb-47f6-becf-59bd55e62cfa None None] MFA Rules not processed for user `dff69a9a061a454685cfc57c1675f4b9`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:56:05.291685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-646c8c9e-0afb-47f6-becf-59bd55e62cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:05.302374 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1261/2547] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:56:05 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:56:05.313825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83dca86-68ee-489c-84fd-0051666e74c2 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:05.315697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a83dca86-68ee-489c-84fd-0051666e74c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:05.343182 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83dca86-68ee-489c-84fd-0051666e74c2 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:05.350801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2615d4-8a2c-4d23-b2e1-4a41283174e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:05.351983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2615d4-8a2c-4d23-b2e1-4a41283174e3 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:05.352325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2615d4-8a2c-4d23-b2e1-4a41283174e3 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:05.352658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2615d4-8a2c-4d23-b2e1-4a41283174e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:05.373926 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2615d4-8a2c-4d23-b2e1-4a41283174e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:05.376216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2615d4-8a2c-4d23-b2e1-4a41283174e3 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:05.390406 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1287/2548] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:56:05 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:56:06.015584 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca988a-49cf-482e-9950-a357b1ceb423 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:06.015861 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca988a-49cf-482e-9950-a357b1ceb423 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:06.016307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca988a-49cf-482e-9950-a357b1ceb423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:06.052977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-b3ca988a-49cf-482e-9950-a357b1ceb423 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:56:06.054662 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b3ca988a-49cf-482e-9950-a357b1ceb423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:06.077267 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:06.208122 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1262/2549] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 20:56:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:56:06.271281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2615d4-8a2c-4d23-b2e1-4a41283174e3 service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:06.276541 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4f2615d4-8a2c-4d23-b2e1-4a41283174e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:06.341971 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:06.371388 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2615d4-8a2c-4d23-b2e1-4a41283174e3 service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:06.379320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98486743-b6d5-46dd-afe6-a5276eb0a305 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:06.380108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98486743-b6d5-46dd-afe6-a5276eb0a305 service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:06.380457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98486743-b6d5-46dd-afe6-a5276eb0a305 service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:06.380969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98486743-b6d5-46dd-afe6-a5276eb0a305 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:06.403015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98486743-b6d5-46dd-afe6-a5276eb0a305 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:06.405704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98486743-b6d5-46dd-afe6-a5276eb0a305 service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:06.419412 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1288/2550] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 20:56:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 20:56:07.814074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e47bd2-29b2-4b71-af9d-08865101dc19 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:07.815147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e47bd2-29b2-4b71-af9d-08865101dc19 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:07.815574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e47bd2-29b2-4b71-af9d-08865101dc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:07.875351 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-b0e47bd2-29b2-4b71-af9d-08865101dc19 None None] MFA Rules not processed for user `0701f31766dd4eeab9a63f6411c26d6e`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:56:07.876736 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b0e47bd2-29b2-4b71-af9d-08865101dc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:08.063862 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1263/2551] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:56:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:56:16.151195 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c9d78-aa24-4922-856a-c81002a244ed None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:16.151752 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c9d78-aa24-4922-856a-c81002a244ed None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:16.151857 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c9d78-aa24-4922-856a-c81002a244ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:16.195163 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-578c9d78-aa24-4922-856a-c81002a244ed None None] MFA Rules not processed for user `10aebae8bbbd4ea88b9cbf85d3438ed1`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:56:16.198150 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-578c9d78-aa24-4922-856a-c81002a244ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:16.220636 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1289/2552] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:56:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:56:16.894989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6abad-4602-46e7-9d3b-39cd5c876e8e None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:16.895513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6abad-4602-46e7-9d3b-39cd5c876e8e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:16.895732 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6abad-4602-46e7-9d3b-39cd5c876e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:16.927995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a8e6abad-4602-46e7-9d3b-39cd5c876e8e None None] MFA Rules not processed for user `343f309c07e343b4b15268472d19f10c`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:56:16.930469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a8e6abad-4602-46e7-9d3b-39cd5c876e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:17.113829 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1264/2553] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:56:16 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:56:26.182844 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=11 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:27.102509 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=66 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:27.457887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9a68b-ddf2-4d2a-9b13-7f0af027a7d1 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:27.458447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9a68b-ddf2-4d2a-9b13-7f0af027a7d1 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:27.458701 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9a68b-ddf2-4d2a-9b13-7f0af027a7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:27.478198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d5c9a68b-ddf2-4d2a-9b13-7f0af027a7d1 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:56:27.479428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d5c9a68b-ddf2-4d2a-9b13-7f0af027a7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:27.494823 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1290/2554] 10.222.0.33 () {58 vars in 967 bytes} [Sat Aug 6 20:56:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:56:27.501152 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6abad-4602-46e7-9d3b-39cd5c876e8e None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:27.515192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6abad-4602-46e7-9d3b-39cd5c876e8e None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:27.522019 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33804ed-2374-44eb-8233-6857b36b5ede service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:27.523022 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33804ed-2374-44eb-8233-6857b36b5ede service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:27.523319 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33804ed-2374-44eb-8233-6857b36b5ede service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:27.523698 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33804ed-2374-44eb-8233-6857b36b5ede service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:27.542358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33804ed-2374-44eb-8233-6857b36b5ede service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:27.544687 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33804ed-2374-44eb-8233-6857b36b5ede service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:27.560464 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1265/2555] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 20:56:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 20:56:27.839551 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9a68b-ddf2-4d2a-9b13-7f0af027a7d1 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:27.840826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d5c9a68b-ddf2-4d2a-9b13-7f0af027a7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:28.006577 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9a68b-ddf2-4d2a-9b13-7f0af027a7d1 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:28.017274 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a5d68-3ff9-4a2f-95a0-ef039f6f72bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:28.017922 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a5d68-3ff9-4a2f-95a0-ef039f6f72bb service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:28.018198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a5d68-3ff9-4a2f-95a0-ef039f6f72bb service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:28.019204 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a5d68-3ff9-4a2f-95a0-ef039f6f72bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:28.021891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-599a5d68-3ff9-4a2f-95a0-ef039f6f72bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:28.044064 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a5d68-3ff9-4a2f-95a0-ef039f6f72bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:28.046173 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a5d68-3ff9-4a2f-95a0-ef039f6f72bb service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:28.059209 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1291/2556] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:56:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:56:29.110348 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879adc05-68a6-4886-b88b-ce53da8a06b9 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:29.111357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879adc05-68a6-4886-b88b-ce53da8a06b9 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:29.111764 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879adc05-68a6-4886-b88b-ce53da8a06b9 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:29.113215 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1266/2557] 10.222.0.33 () {54 vars in 921 bytes} [Sat Aug 6 20:56:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:56:29.119511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bfc5c-b530-4440-a55c-3ae0767e95e5 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:29.122962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bfc5c-b530-4440-a55c-3ae0767e95e5 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:29.123367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bfc5c-b530-4440-a55c-3ae0767e95e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:29.149030 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-5c2bfc5c-b530-4440-a55c-3ae0767e95e5 None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:56:29.150330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5c2bfc5c-b530-4440-a55c-3ae0767e95e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:29.160061 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1292/2558] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 20:56:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:56:29.181840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879adc05-68a6-4886-b88b-ce53da8a06b9 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:29.184026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-879adc05-68a6-4886-b88b-ce53da8a06b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:29.202083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879adc05-68a6-4886-b88b-ce53da8a06b9 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:29.207274 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e9965-a5e0-4021-bce8-3c47d016ae44 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:29.208635 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e9965-a5e0-4021-bce8-3c47d016ae44 service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:29.209238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e9965-a5e0-4021-bce8-3c47d016ae44 service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:29.209238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e9965-a5e0-4021-bce8-3c47d016ae44 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:29.217729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e9965-a5e0-4021-bce8-3c47d016ae44 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:29.219319 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e9965-a5e0-4021-bce8-3c47d016ae44 service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:29.228821 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1267/2559] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:56:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:56:29.327882 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2bfc5c-b530-4440-a55c-3ae0767e95e5 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:29.340905 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2bfc5c-b530-4440-a55c-3ae0767e95e5 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:29.348176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9312ef-f2f2-4572-bc2c-cd015c82c9ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:29.349541 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9312ef-f2f2-4572-bc2c-cd015c82c9ed service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:29.349907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9312ef-f2f2-4572-bc2c-cd015c82c9ed service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:29.350403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9312ef-f2f2-4572-bc2c-cd015c82c9ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:29.352899 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4b9312ef-f2f2-4572-bc2c-cd015c82c9ed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:29.366997 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9312ef-f2f2-4572-bc2c-cd015c82c9ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:29.368874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9312ef-f2f2-4572-bc2c-cd015c82c9ed service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:29.379487 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1293/2560] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:56:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:56:29.934783 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e9965-a5e0-4021-bce8-3c47d016ae44 service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:29.936382 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4b5e9965-a5e0-4021-bce8-3c47d016ae44 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:29.960077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e9965-a5e0-4021-bce8-3c47d016ae44 service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:29.967441 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e081f6c-886a-4382-9ea6-ba980a24d4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:29.968211 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e081f6c-886a-4382-9ea6-ba980a24d4d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:29.968653 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e081f6c-886a-4382-9ea6-ba980a24d4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:29.969006 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e081f6c-886a-4382-9ea6-ba980a24d4d0 admin admin] PATH_INFO: `/v3/users/79ffbe6477ea45f481620fa6293e1958` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:29.983171 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e081f6c-886a-4382-9ea6-ba980a24d4d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79ffbe6477ea45f481620fa6293e1958)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:29.983171 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e081f6c-886a-4382-9ea6-ba980a24d4d0 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:30.055979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9e081f6c-886a-4382-9ea6-ba980a24d4d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79ffbe6477ea45f481620fa6293e1958'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:30.056957 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9e081f6c-886a-4382-9ea6-ba980a24d4d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79ffbe6477ea45f481620fa6293e1958'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:30.057669 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9e081f6c-886a-4382-9ea6-ba980a24d4d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79ffbe6477ea45f481620fa6293e1958'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:30.072388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9e081f6c-886a-4382-9ea6-ba980a24d4d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79ffbe6477ea45f481620fa6293e1958'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:30.101124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9e081f6c-886a-4382-9ea6-ba980a24d4d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79ffbe6477ea45f481620fa6293e1958'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:30.121256 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1268/2561] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:56:29 2022] DELETE /identity/v3/users/79ffbe6477ea45f481620fa6293e1958 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:56:30.121887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d34e9f-63d6-4bc0-815b-8cd530000c91 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:30.122243 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d34e9f-63d6-4bc0-815b-8cd530000c91 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:30.122338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d34e9f-63d6-4bc0-815b-8cd530000c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:30.170298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-73d34e9f-63d6-4bc0-815b-8cd530000c91 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:56:30.171567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-73d34e9f-63d6-4bc0-815b-8cd530000c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:30.280577 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1294/2562] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:56:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:56:30.291533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e081f6c-886a-4382-9ea6-ba980a24d4d0 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:30.293054 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9e081f6c-886a-4382-9ea6-ba980a24d4d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:30.376624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e081f6c-886a-4382-9ea6-ba980a24d4d0 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:30.381472 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bfcc4c-1c46-462d-a920-dfcce47a5669 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:30.382342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfcc4c-1c46-462d-a920-dfcce47a5669 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:30.382854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfcc4c-1c46-462d-a920-dfcce47a5669 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:30.383543 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfcc4c-1c46-462d-a920-dfcce47a5669 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:30.395204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bfcc4c-1c46-462d-a920-dfcce47a5669 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:30.397869 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bfcc4c-1c46-462d-a920-dfcce47a5669 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:30.413802 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1269/2563] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:56:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:56:30.593111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d34e9f-63d6-4bc0-815b-8cd530000c91 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:30.594609 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-73d34e9f-63d6-4bc0-815b-8cd530000c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:30.609469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d34e9f-63d6-4bc0-815b-8cd530000c91 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:30.615121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97f5d8-81f3-49ab-a4ce-c440abff41e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:30.615759 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97f5d8-81f3-49ab-a4ce-c440abff41e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:30.616033 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97f5d8-81f3-49ab-a4ce-c440abff41e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:30.616298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97f5d8-81f3-49ab-a4ce-c440abff41e4 admin admin] PATH_INFO: `/v3/projects/d5ef27173302447a82d257b1f838e75d` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:30.618187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d97f5d8-81f3-49ab-a4ce-c440abff41e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5ef27173302447a82d257b1f838e75d)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:30.620447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d97f5d8-81f3-49ab-a4ce-c440abff41e4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:30.673335 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0d97f5d8-81f3-49ab-a4ce-c440abff41e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5ef27173302447a82d257b1f838e75d', 'request_id': 'req-0d97f5d8-81f3-49ab-a4ce-c440abff41e4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:30.680476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0d97f5d8-81f3-49ab-a4ce-c440abff41e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5ef27173302447a82d257b1f838e75d', 'request_id': 'req-0d97f5d8-81f3-49ab-a4ce-c440abff41e4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:30.682447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:30.690232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0d97f5d8-81f3-49ab-a4ce-c440abff41e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5ef27173302447a82d257b1f838e75d', 'request_id': 'req-0d97f5d8-81f3-49ab-a4ce-c440abff41e4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:30.702042 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0d97f5d8-81f3-49ab-a4ce-c440abff41e4 admin admin] The token cache is being invalidate because project d5ef27173302447a82d257b1f838e75d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:56:30.702329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0d97f5d8-81f3-49ab-a4ce-c440abff41e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:30.703014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0d97f5d8-81f3-49ab-a4ce-c440abff41e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:30.704695 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1295/2564] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:30 2022] DELETE /identity/v3/projects/d5ef27173302447a82d257b1f838e75d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:56:30.708732 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bfcc4c-1c46-462d-a920-dfcce47a5669 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:30.718407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bfcc4c-1c46-462d-a920-dfcce47a5669 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:30.763796 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:30.777141 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae9eabc-08f3-4573-94c4-e3ec190edb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:30.777788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae9eabc-08f3-4573-94c4-e3ec190edb05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:30.778069 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae9eabc-08f3-4573-94c4-e3ec190edb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:30.778367 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae9eabc-08f3-4573-94c4-e3ec190edb05 admin admin] PATH_INFO: `/v3/users/edbe49bf4b1a46fcbe274cb75a16c5e2` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:30.779517 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae9eabc-08f3-4573-94c4-e3ec190edb05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edbe49bf4b1a46fcbe274cb75a16c5e2)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:30.781442 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae9eabc-08f3-4573-94c4-e3ec190edb05 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:30.827402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1ae9eabc-08f3-4573-94c4-e3ec190edb05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edbe49bf4b1a46fcbe274cb75a16c5e2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:30.827976 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1ae9eabc-08f3-4573-94c4-e3ec190edb05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edbe49bf4b1a46fcbe274cb75a16c5e2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:30.828671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1ae9eabc-08f3-4573-94c4-e3ec190edb05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edbe49bf4b1a46fcbe274cb75a16c5e2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:30.835797 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1ae9eabc-08f3-4573-94c4-e3ec190edb05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edbe49bf4b1a46fcbe274cb75a16c5e2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:30.847582 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1ae9eabc-08f3-4573-94c4-e3ec190edb05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edbe49bf4b1a46fcbe274cb75a16c5e2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:30.860400 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1270/2565] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:56:30 2022] DELETE /identity/v3/users/edbe49bf4b1a46fcbe274cb75a16c5e2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:56:31.184907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97f5d8-81f3-49ab-a4ce-c440abff41e4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:31.189222 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0d97f5d8-81f3-49ab-a4ce-c440abff41e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:31.272854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97f5d8-81f3-49ab-a4ce-c440abff41e4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:31.378503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff254db-ed97-49af-8fa4-7f84b4b2d136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:31.379183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff254db-ed97-49af-8fa4-7f84b4b2d136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:31.379559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff254db-ed97-49af-8fa4-7f84b4b2d136 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:31.380546 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff254db-ed97-49af-8fa4-7f84b4b2d136 admin admin] PATH_INFO: `/v3/projects/6df791ea0dc14b459fd00aeeae02d584` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:31.381639 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff254db-ed97-49af-8fa4-7f84b4b2d136 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6df791ea0dc14b459fd00aeeae02d584)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:31.384290 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff254db-ed97-49af-8fa4-7f84b4b2d136 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:31.437196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cff254db-ed97-49af-8fa4-7f84b4b2d136 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6df791ea0dc14b459fd00aeeae02d584', 'request_id': 'req-cff254db-ed97-49af-8fa4-7f84b4b2d136'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:31.443655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cff254db-ed97-49af-8fa4-7f84b4b2d136 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6df791ea0dc14b459fd00aeeae02d584', 'request_id': 'req-cff254db-ed97-49af-8fa4-7f84b4b2d136'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:31.451854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cff254db-ed97-49af-8fa4-7f84b4b2d136 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6df791ea0dc14b459fd00aeeae02d584', 'request_id': 'req-cff254db-ed97-49af-8fa4-7f84b4b2d136'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:31.463740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cff254db-ed97-49af-8fa4-7f84b4b2d136 admin admin] The token cache is being invalidate because project 6df791ea0dc14b459fd00aeeae02d584 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:56:31.464151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cff254db-ed97-49af-8fa4-7f84b4b2d136 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:31.464898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cff254db-ed97-49af-8fa4-7f84b4b2d136 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:31.466638 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1296/2566] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:31 2022] DELETE /identity/v3/projects/6df791ea0dc14b459fd00aeeae02d584 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:56:31.472263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88ab20-9a90-4e88-bd3b-b693effbc708 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:31.473859 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88ab20-9a90-4e88-bd3b-b693effbc708 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:31.474206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88ab20-9a90-4e88-bd3b-b693effbc708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:31.495196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-df88ab20-9a90-4e88-bd3b-b693effbc708 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:56:31.496403 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-df88ab20-9a90-4e88-bd3b-b693effbc708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:31.560519 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1271/2567] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:56:31.568979 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248e9de-f57b-4e61-a362-b2d839b8194c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:31.569266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248e9de-f57b-4e61-a362-b2d839b8194c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:31.569542 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248e9de-f57b-4e61-a362-b2d839b8194c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:31.588882 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-1248e9de-f57b-4e61-a362-b2d839b8194c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:56:31.590130 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1248e9de-f57b-4e61-a362-b2d839b8194c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:31.601978 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1297/2568] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:56:31.603219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88ab20-9a90-4e88-bd3b-b693effbc708 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:31.612867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88ab20-9a90-4e88-bd3b-b693effbc708 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:31.618172 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c5e76-4c45-4ba9-9669-03ed2ddff6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:31.618812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c5e76-4c45-4ba9-9669-03ed2ddff6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:31.619084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c5e76-4c45-4ba9-9669-03ed2ddff6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:31.619350 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c5e76-4c45-4ba9-9669-03ed2ddff6e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:31.619989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c5e76-4c45-4ba9-9669-03ed2ddff6e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:56:31.620289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c5e76-4c45-4ba9-9669-03ed2ddff6e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:31.621877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c5e76-4c45-4ba9-9669-03ed2ddff6e6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:31.634315 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1272/2569] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:56:31.638838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248e9de-f57b-4e61-a362-b2d839b8194c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:31.648457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248e9de-f57b-4e61-a362-b2d839b8194c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:31.653166 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f414a49-d8a0-4a24-8fcd-434ea51f0769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:31.653788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f414a49-d8a0-4a24-8fcd-434ea51f0769 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:31.654071 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f414a49-d8a0-4a24-8fcd-434ea51f0769 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:31.654345 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f414a49-d8a0-4a24-8fcd-434ea51f0769 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:31.654998 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f414a49-d8a0-4a24-8fcd-434ea51f0769 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:31.656887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f414a49-d8a0-4a24-8fcd-434ea51f0769 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:31.687190 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1298/2570] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:56:31 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:56:31.691310 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c5e76-4c45-4ba9-9669-03ed2ddff6e6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:31.702009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c5e76-4c45-4ba9-9669-03ed2ddff6e6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:31.756945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:31.770884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6aa05-8e20-4210-a674-7649bd1cb00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:31.771508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6aa05-8e20-4210-a674-7649bd1cb00b admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:31.772033 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6aa05-8e20-4210-a674-7649bd1cb00b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:31.772374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6aa05-8e20-4210-a674-7649bd1cb00b admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:31.772952 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6aa05-8e20-4210-a674-7649bd1cb00b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:31.774969 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6aa05-8e20-4210-a674-7649bd1cb00b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:31.802660 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1273/2571] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:56:31 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:56:31.804781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f414a49-d8a0-4a24-8fcd-434ea51f0769 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:31.816632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f414a49-d8a0-4a24-8fcd-434ea51f0769 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:31.822436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc005c-46f0-4e8f-8a85-98e137f054f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:31.822814 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc005c-46f0-4e8f-8a85-98e137f054f5 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:31.823109 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc005c-46f0-4e8f-8a85-98e137f054f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:31.823531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc005c-46f0-4e8f-8a85-98e137f054f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:31.824155 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc005c-46f0-4e8f-8a85-98e137f054f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:31.826700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc005c-46f0-4e8f-8a85-98e137f054f5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:31.837826 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1299/2572] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:56:31.841711 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6aa05-8e20-4210-a674-7649bd1cb00b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:31.853046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6aa05-8e20-4210-a674-7649bd1cb00b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:31.857837 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e3aa4-7501-453e-bf7d-accc6704a539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:31.858423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e3aa4-7501-453e-bf7d-accc6704a539 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:31.858733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e3aa4-7501-453e-bf7d-accc6704a539 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:31.859007 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e3aa4-7501-453e-bf7d-accc6704a539 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:31.859642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e3aa4-7501-453e-bf7d-accc6704a539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:31.861240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e3aa4-7501-453e-bf7d-accc6704a539 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:31.873453 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1274/2573] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:56:31.877650 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc005c-46f0-4e8f-8a85-98e137f054f5 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:31.888712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc005c-46f0-4e8f-8a85-98e137f054f5 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:31.893949 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3bbfa-a482-47d3-b329-6baf7cdae307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:31.894742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3bbfa-a482-47d3-b329-6baf7cdae307 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:31.895116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3bbfa-a482-47d3-b329-6baf7cdae307 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:31.895669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3bbfa-a482-47d3-b329-6baf7cdae307 admin admin] PATH_INFO: `/v3/projects/9a5966e798bb40ac92eec4c6d2f10dc0/users/084322277a7a4abead28cb8407763a32/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:31.912409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3bbfa-a482-47d3-b329-6baf7cdae307 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a5966e798bb40ac92eec4c6d2f10dc0, user_id=084322277a7a4abead28cb8407763a32, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:31.915139 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3bbfa-a482-47d3-b329-6baf7cdae307 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:31.932774 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1300/2574] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:56:31 2022] PUT /identity/v3/projects/9a5966e798bb40ac92eec4c6d2f10dc0/users/084322277a7a4abead28cb8407763a32/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:56:31.949156 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e561c8-f94d-45a5-b2ae-9c4703395860 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:31.949825 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e561c8-f94d-45a5-b2ae-9c4703395860 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:31.950485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e561c8-f94d-45a5-b2ae-9c4703395860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:31.981794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-e1e561c8-f94d-45a5-b2ae-9c4703395860 None None] MFA Rules not processed for user `084322277a7a4abead28cb8407763a32`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:56:31.983096 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e1e561c8-f94d-45a5-b2ae-9c4703395860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:32.076298 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1275/2575] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:56:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:56:32.077474 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3bbfa-a482-47d3-b329-6baf7cdae307 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:32.099831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02569b23-70d3-4e9c-8bf2-dc511c8517d9 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:32.100640 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02569b23-70d3-4e9c-8bf2-dc511c8517d9 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:32.100640 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02569b23-70d3-4e9c-8bf2-dc511c8517d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:32.104720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:32.127030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-02569b23-70d3-4e9c-8bf2-dc511c8517d9 None None] MFA Rules not processed for user `4604780fce5b4ece8cb20354efb53569`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:56:32.128605 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-02569b23-70d3-4e9c-8bf2-dc511c8517d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:32.200297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3bbfa-a482-47d3-b329-6baf7cdae307 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:32.216884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea1c4a-1a91-4596-913d-900bc6d75141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:32.217515 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea1c4a-1a91-4596-913d-900bc6d75141 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:32.217800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea1c4a-1a91-4596-913d-900bc6d75141 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:32.218072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea1c4a-1a91-4596-913d-900bc6d75141 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:32.218753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea1c4a-1a91-4596-913d-900bc6d75141 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:32.220670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea1c4a-1a91-4596-913d-900bc6d75141 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:32.234990 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1276/2576] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:56:32 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:56:32.275137 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1301/2577] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:56:32 2022] POST /identity/v3/projects => generated 373 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:56:32.279877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02569b23-70d3-4e9c-8bf2-dc511c8517d9 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:32.292875 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02569b23-70d3-4e9c-8bf2-dc511c8517d9 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:32.371800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c7196-87aa-4a13-bc1d-cde451a1bd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:32.372752 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c7196-87aa-4a13-bc1d-cde451a1bd90 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:32.373073 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c7196-87aa-4a13-bc1d-cde451a1bd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:32.373467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c7196-87aa-4a13-bc1d-cde451a1bd90 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:32.374108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c7196-87aa-4a13-bc1d-cde451a1bd90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:32.376124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c7196-87aa-4a13-bc1d-cde451a1bd90 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:32.400274 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:32.412675 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea1c4a-1a91-4596-913d-900bc6d75141 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:32.422629 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1277/2578] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:56:32 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:56:32.424004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea1c4a-1a91-4596-913d-900bc6d75141 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:32.429095 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc465cf2-4dab-4b8e-8b80-32b20ff8fe07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:32.429777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc465cf2-4dab-4b8e-8b80-32b20ff8fe07 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:32.430123 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc465cf2-4dab-4b8e-8b80-32b20ff8fe07 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:32.430464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc465cf2-4dab-4b8e-8b80-32b20ff8fe07 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:32.431204 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc465cf2-4dab-4b8e-8b80-32b20ff8fe07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:32.432888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc465cf2-4dab-4b8e-8b80-32b20ff8fe07 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:32.446597 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1302/2579] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:56:32.449429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c7196-87aa-4a13-bc1d-cde451a1bd90 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:32.462835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c7196-87aa-4a13-bc1d-cde451a1bd90 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:32.467728 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8067bf1-358d-4556-8341-db2793150cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:32.468474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8067bf1-358d-4556-8341-db2793150cab admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:32.468845 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8067bf1-358d-4556-8341-db2793150cab admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:32.469186 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8067bf1-358d-4556-8341-db2793150cab admin admin] PATH_INFO: `/v3/projects/a932f2ac861040ed8428d0bea61ef61b/users/21d5f876040148d7a3d427d59a65f7e7/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:32.485263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8067bf1-358d-4556-8341-db2793150cab admin admin] RBAC: Authorizing `identity:create_grant(project_id=a932f2ac861040ed8428d0bea61ef61b, user_id=21d5f876040148d7a3d427d59a65f7e7, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:32.488080 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8067bf1-358d-4556-8341-db2793150cab admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:32.511236 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1278/2580] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:56:32 2022] PUT /identity/v3/projects/a932f2ac861040ed8428d0bea61ef61b/users/21d5f876040148d7a3d427d59a65f7e7/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:56:32.515363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc465cf2-4dab-4b8e-8b80-32b20ff8fe07 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:32.539771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc465cf2-4dab-4b8e-8b80-32b20ff8fe07 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:32.609381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc1d61-098d-4b69-beaa-92282d701075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:32.610001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc1d61-098d-4b69-beaa-92282d701075 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:32.610285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc1d61-098d-4b69-beaa-92282d701075 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:32.610634 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc1d61-098d-4b69-beaa-92282d701075 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:32.611445 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc1d61-098d-4b69-beaa-92282d701075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:32.613088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc1d61-098d-4b69-beaa-92282d701075 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:32.625116 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1303/2581] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:56:32.629432 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8067bf1-358d-4556-8341-db2793150cab admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:32.641489 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8067bf1-358d-4556-8341-db2793150cab admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:32.647093 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf86dd6a-b4dd-4724-bb30-7e7104ce4716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:32.647857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86dd6a-b4dd-4724-bb30-7e7104ce4716 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:32.648156 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86dd6a-b4dd-4724-bb30-7e7104ce4716 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:32.648465 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86dd6a-b4dd-4724-bb30-7e7104ce4716 admin admin] PATH_INFO: `/v3/projects/a932f2ac861040ed8428d0bea61ef61b/users/21d5f876040148d7a3d427d59a65f7e7/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:32.650784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf86dd6a-b4dd-4724-bb30-7e7104ce4716 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a932f2ac861040ed8428d0bea61ef61b, user_id=21d5f876040148d7a3d427d59a65f7e7, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:32.653662 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf86dd6a-b4dd-4724-bb30-7e7104ce4716 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:32.673100 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1279/2582] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:56:32 2022] PUT /identity/v3/projects/a932f2ac861040ed8428d0bea61ef61b/users/21d5f876040148d7a3d427d59a65f7e7/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:56:32.685345 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be06ce-702a-46a2-84da-fceb8486a7fe None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:32.685632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be06ce-702a-46a2-84da-fceb8486a7fe None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:32.685911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be06ce-702a-46a2-84da-fceb8486a7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:32.723268 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-e3be06ce-702a-46a2-84da-fceb8486a7fe None None] MFA Rules not processed for user `21d5f876040148d7a3d427d59a65f7e7`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:56:32.724591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e3be06ce-702a-46a2-84da-fceb8486a7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:32.736012 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0adb4ed-c68d-41d3-8dc6-2b5d37cc164d None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:32.736372 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0adb4ed-c68d-41d3-8dc6-2b5d37cc164d None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:32.736708 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0adb4ed-c68d-41d3-8dc6-2b5d37cc164d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:32.767618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-b0adb4ed-c68d-41d3-8dc6-2b5d37cc164d None None] MFA Rules not processed for user `10aebae8bbbd4ea88b9cbf85d3438ed1`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:56:32.769523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b0adb4ed-c68d-41d3-8dc6-2b5d37cc164d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:32.838742 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1304/2583] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:56:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:56:32.842214 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1280/2584] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:56:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:56:32.846305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be06ce-702a-46a2-84da-fceb8486a7fe None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:32.856615 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be06ce-702a-46a2-84da-fceb8486a7fe None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:32.861373 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2a473-3a5d-4549-be80-285f6d5f027c tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d5f876040148d7a3d427d59a65f7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a932f2ac861040ed8428d0bea61ef61b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:32.861981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2a473-3a5d-4549-be80-285f6d5f027c tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:32.862422 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2a473-3a5d-4549-be80-285f6d5f027c tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:32.862754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2a473-3a5d-4549-be80-285f6d5f027c tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:32.863402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2a473-3a5d-4549-be80-285f6d5f027c tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:56:32.863704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2a473-3a5d-4549-be80-285f6d5f027c tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:32.866200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2a473-3a5d-4549-be80-285f6d5f027c tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:32.874465 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:32.885171 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1305/2585] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:56:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:56:32.886298 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0adb4ed-c68d-41d3-8dc6-2b5d37cc164d None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:32.898652 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0adb4ed-c68d-41d3-8dc6-2b5d37cc164d None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:32.903368 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71ecb7-dee3-4fa6-ad83-51d37aeed15b tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d5f876040148d7a3d427d59a65f7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a932f2ac861040ed8428d0bea61ef61b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:32.903986 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71ecb7-dee3-4fa6-ad83-51d37aeed15b tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:32.904277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71ecb7-dee3-4fa6-ad83-51d37aeed15b tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:32.904555 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71ecb7-dee3-4fa6-ad83-51d37aeed15b tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:32.905180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71ecb7-dee3-4fa6-ad83-51d37aeed15b tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:32.907162 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71ecb7-dee3-4fa6-ad83-51d37aeed15b tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:32.938104 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1281/2586] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:56:32 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:56:32.943267 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2a473-3a5d-4549-be80-285f6d5f027c tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:32.954138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2a473-3a5d-4549-be80-285f6d5f027c tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:33.040488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420be85-e28a-4396-bf6a-0a9a788318e3 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d5f876040148d7a3d427d59a65f7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a932f2ac861040ed8428d0bea61ef61b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:33.041185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420be85-e28a-4396-bf6a-0a9a788318e3 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:33.041677 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420be85-e28a-4396-bf6a-0a9a788318e3 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:33.042150 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420be85-e28a-4396-bf6a-0a9a788318e3 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:33.042615 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420be85-e28a-4396-bf6a-0a9a788318e3 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:56:33.042997 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420be85-e28a-4396-bf6a-0a9a788318e3 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:33.045515 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420be85-e28a-4396-bf6a-0a9a788318e3 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:33.068364 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1306/2587] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:56:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:56:33.350016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71ecb7-dee3-4fa6-ad83-51d37aeed15b tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:33.352617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1c71ecb7-dee3-4fa6-ad83-51d37aeed15b tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:33.472852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71ecb7-dee3-4fa6-ad83-51d37aeed15b tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:33.479813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d1259-0746-4113-bcbc-d520538dd4fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:33.480512 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d1259-0746-4113-bcbc-d520538dd4fb service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:33.480928 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d1259-0746-4113-bcbc-d520538dd4fb service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:33.481380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d1259-0746-4113-bcbc-d520538dd4fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:33.496064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d1259-0746-4113-bcbc-d520538dd4fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:33.497733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d1259-0746-4113-bcbc-d520538dd4fb service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:33.508766 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1282/2588] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:56:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:56:33.548799 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bd425-e37f-4816-8e87-562288ec6c00 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:33.549357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bd425-e37f-4816-8e87-562288ec6c00 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:33.549357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bd425-e37f-4816-8e87-562288ec6c00 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:33.552133 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1307/2589] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 20:56:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:56:33.557510 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d1259-0746-4113-bcbc-d520538dd4fb service nova] Authenticating service token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 20:56:33.571691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d1259-0746-4113-bcbc-d520538dd4fb service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:33.582778 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d1259-0746-4113-bcbc-d520538dd4fb service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:33.588682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d189ef2c-8320-40d7-9b79-f70be49684ed tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d5f876040148d7a3d427d59a65f7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a932f2ac861040ed8428d0bea61ef61b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:33.589315 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189ef2c-8320-40d7-9b79-f70be49684ed tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:33.589786 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189ef2c-8320-40d7-9b79-f70be49684ed tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:33.590214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189ef2c-8320-40d7-9b79-f70be49684ed tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] PATH_INFO: `/v3/projects/845885d4ede946babd400ee92b7c4490` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:33.591555 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d189ef2c-8320-40d7-9b79-f70be49684ed tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: Authorizing `identity:get_project(project_id=845885d4ede946babd400ee92b7c4490)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:33.594156 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d189ef2c-8320-40d7-9b79-f70be49684ed tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:33.596659 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1283/2590] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 20:56:33 2022] GET /identity/v3/projects/845885d4ede946babd400ee92b7c4490 => generated 369 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:56:33.899665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2f934-1cef-431c-bb41-211a02a29c7d None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:33.900072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2f934-1cef-431c-bb41-211a02a29c7d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:33.900457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2f934-1cef-431c-bb41-211a02a29c7d None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:33.903714 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1308/2591] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 20:56:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:56:33.908771 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d189ef2c-8320-40d7-9b79-f70be49684ed tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Authenticating service token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 20:56:33.923880 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d189ef2c-8320-40d7-9b79-f70be49684ed tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:33.933917 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d189ef2c-8320-40d7-9b79-f70be49684ed tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:33.943989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225221a-0179-4a9c-b7b1-e29c82690d6c tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d5f876040148d7a3d427d59a65f7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a932f2ac861040ed8428d0bea61ef61b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:33.944631 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225221a-0179-4a9c-b7b1-e29c82690d6c tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:33.944899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225221a-0179-4a9c-b7b1-e29c82690d6c tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:33.945170 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225221a-0179-4a9c-b7b1-e29c82690d6c tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] PATH_INFO: `/v3/projects/845885d4ede946babd400ee92b7c4490` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:33.946493 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225221a-0179-4a9c-b7b1-e29c82690d6c tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: Authorizing `identity:get_project(project_id=845885d4ede946babd400ee92b7c4490)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:33.948835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225221a-0179-4a9c-b7b1-e29c82690d6c tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:33.958634 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1284/2592] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 20:56:33 2022] GET /identity/v3/projects/845885d4ede946babd400ee92b7c4490 => generated 369 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:56:33.998284 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2f934-1cef-431c-bb41-211a02a29c7d None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:34.012209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2f934-1cef-431c-bb41-211a02a29c7d None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:34.016822 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136517a-172a-4b8a-9b5e-2b82e484f9ac tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d5f876040148d7a3d427d59a65f7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a932f2ac861040ed8428d0bea61ef61b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:34.017430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136517a-172a-4b8a-9b5e-2b82e484f9ac tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:34.017715 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136517a-172a-4b8a-9b5e-2b82e484f9ac tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:34.018116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136517a-172a-4b8a-9b5e-2b82e484f9ac tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:34.018804 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136517a-172a-4b8a-9b5e-2b82e484f9ac tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:56:34.019116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136517a-172a-4b8a-9b5e-2b82e484f9ac tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:34.021299 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136517a-172a-4b8a-9b5e-2b82e484f9ac tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:34.036098 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1309/2593] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:56:34.040554 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225221a-0179-4a9c-b7b1-e29c82690d6c tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:34.054963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225221a-0179-4a9c-b7b1-e29c82690d6c tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:34.060011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d387a-d676-4015-8ded-ab2bbcfcaa05 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d5f876040148d7a3d427d59a65f7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a932f2ac861040ed8428d0bea61ef61b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:34.060714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d387a-d676-4015-8ded-ab2bbcfcaa05 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:34.061109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d387a-d676-4015-8ded-ab2bbcfcaa05 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:34.061400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d387a-d676-4015-8ded-ab2bbcfcaa05 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:34.062918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d387a-d676-4015-8ded-ab2bbcfcaa05 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:34.065562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d387a-d676-4015-8ded-ab2bbcfcaa05 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:34.078652 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:34.096645 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1285/2594] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:56:34 2022] POST /identity/v3/users => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:56:34.100755 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136517a-172a-4b8a-9b5e-2b82e484f9ac tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:34.110901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136517a-172a-4b8a-9b5e-2b82e484f9ac tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:34.118787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4a217-f000-41e6-9c08-2a170f4d3388 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d5f876040148d7a3d427d59a65f7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a932f2ac861040ed8428d0bea61ef61b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:34.119402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4a217-f000-41e6-9c08-2a170f4d3388 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:34.119924 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4a217-f000-41e6-9c08-2a170f4d3388 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:34.120206 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4a217-f000-41e6-9c08-2a170f4d3388 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:34.120863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da4a217-f000-41e6-9c08-2a170f4d3388 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:56:34.121171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da4a217-f000-41e6-9c08-2a170f4d3388 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:34.122820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da4a217-f000-41e6-9c08-2a170f4d3388 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:34.140815 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1310/2595] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:56:34.157793 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abc0c1-e2b9-4f54-ba23-f7947e8ad1fa None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:34.158339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abc0c1-e2b9-4f54-ba23-f7947e8ad1fa None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:34.158825 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abc0c1-e2b9-4f54-ba23-f7947e8ad1fa None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:34.160360 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1286/2596] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 20:56:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:56:34.166176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4a217-f000-41e6-9c08-2a170f4d3388 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Authenticating service token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 20:56:34.182208 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4a217-f000-41e6-9c08-2a170f4d3388 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:34.193565 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4a217-f000-41e6-9c08-2a170f4d3388 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:34.198874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761b9af-d613-4cf7-a38e-1d475be0c03b tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d5f876040148d7a3d427d59a65f7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a932f2ac861040ed8428d0bea61ef61b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:34.199508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761b9af-d613-4cf7-a38e-1d475be0c03b tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:34.199796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761b9af-d613-4cf7-a38e-1d475be0c03b tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:34.200072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761b9af-d613-4cf7-a38e-1d475be0c03b tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] PATH_INFO: `/v3/projects/845885d4ede946babd400ee92b7c4490` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:34.201200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c761b9af-d613-4cf7-a38e-1d475be0c03b tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: Authorizing `identity:get_project(project_id=845885d4ede946babd400ee92b7c4490)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:34.203630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c761b9af-d613-4cf7-a38e-1d475be0c03b tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:34.205577 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1311/2597] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 20:56:34 2022] GET /identity/v3/projects/845885d4ede946babd400ee92b7c4490 => generated 369 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:56:34.352720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62de5a9-e571-40a8-9d67-8600e4591623 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:34.352985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62de5a9-e571-40a8-9d67-8600e4591623 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:34.353271 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62de5a9-e571-40a8-9d67-8600e4591623 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:34.355303 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1287/2598] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 20:56:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:56:34.370414 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761b9af-d613-4cf7-a38e-1d475be0c03b tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Authenticating service token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 20:56:34.372467 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c761b9af-d613-4cf7-a38e-1d475be0c03b tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:34.403886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761b9af-d613-4cf7-a38e-1d475be0c03b tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:34.424869 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761b9af-d613-4cf7-a38e-1d475be0c03b tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:34.440892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81ef3a-c191-484a-bf6c-b65147a861d6 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d5f876040148d7a3d427d59a65f7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a932f2ac861040ed8428d0bea61ef61b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:34.441541 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81ef3a-c191-484a-bf6c-b65147a861d6 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:34.442656 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81ef3a-c191-484a-bf6c-b65147a861d6 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:34.442950 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81ef3a-c191-484a-bf6c-b65147a861d6 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] PATH_INFO: `/v3/projects/845885d4ede946babd400ee92b7c4490` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:34.444113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81ef3a-c191-484a-bf6c-b65147a861d6 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: Authorizing `identity:get_project(project_id=845885d4ede946babd400ee92b7c4490)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:34.446218 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81ef3a-c191-484a-bf6c-b65147a861d6 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:34.448389 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1312/2599] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 20:56:34 2022] GET /identity/v3/projects/845885d4ede946babd400ee92b7c4490 => generated 369 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:56:34.493717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62de5a9-e571-40a8-9d67-8600e4591623 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:34.514354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62de5a9-e571-40a8-9d67-8600e4591623 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:34.521607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f9197-95ad-4b58-9cf2-3f370718418d tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d5f876040148d7a3d427d59a65f7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a932f2ac861040ed8428d0bea61ef61b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:34.522250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f9197-95ad-4b58-9cf2-3f370718418d tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:34.522517 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f9197-95ad-4b58-9cf2-3f370718418d tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:34.522814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f9197-95ad-4b58-9cf2-3f370718418d tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] PATH_INFO: `/v3/users/2b104f8851c54d48a0489d45884eddb3` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:34.541746 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f9197-95ad-4b58-9cf2-3f370718418d tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2b104f8851c54d48a0489d45884eddb3)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:34.544927 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f9197-95ad-4b58-9cf2-3f370718418d tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:34.617375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-419f9197-95ad-4b58-9cf2-3f370718418d tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b104f8851c54d48a0489d45884eddb3'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:34.618142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-419f9197-95ad-4b58-9cf2-3f370718418d tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b104f8851c54d48a0489d45884eddb3'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:34.619609 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-419f9197-95ad-4b58-9cf2-3f370718418d tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b104f8851c54d48a0489d45884eddb3'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:34.629956 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-419f9197-95ad-4b58-9cf2-3f370718418d tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b104f8851c54d48a0489d45884eddb3'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:34.672783 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-419f9197-95ad-4b58-9cf2-3f370718418d tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b104f8851c54d48a0489d45884eddb3'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:34.729092 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1288/2600] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:56:34 2022] DELETE /identity/v3/users/2b104f8851c54d48a0489d45884eddb3 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:56:34.730299 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81ef3a-c191-484a-bf6c-b65147a861d6 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:34.732299 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4f81ef3a-c191-484a-bf6c-b65147a861d6 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:34.750835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81ef3a-c191-484a-bf6c-b65147a861d6 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:34.911710 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debd60d-59c2-4539-adaa-abe91116216f tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d5f876040148d7a3d427d59a65f7e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a932f2ac861040ed8428d0bea61ef61b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:34.912746 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debd60d-59c2-4539-adaa-abe91116216f tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:34.913236 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debd60d-59c2-4539-adaa-abe91116216f tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:34.913795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debd60d-59c2-4539-adaa-abe91116216f tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] PATH_INFO: `/v3/projects/845885d4ede946babd400ee92b7c4490` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:34.915583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debd60d-59c2-4539-adaa-abe91116216f tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: Authorizing `identity:delete_project(project_id=845885d4ede946babd400ee92b7c4490)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:34.917500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debd60d-59c2-4539-adaa-abe91116216f tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:35.003138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:35.009494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6debd60d-59c2-4539-adaa-abe91116216f tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '845885d4ede946babd400ee92b7c4490', 'request_id': 'req-6debd60d-59c2-4539-adaa-abe91116216f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:35.024772 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6debd60d-59c2-4539-adaa-abe91116216f tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '845885d4ede946babd400ee92b7c4490', 'request_id': 'req-6debd60d-59c2-4539-adaa-abe91116216f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:35.036525 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6debd60d-59c2-4539-adaa-abe91116216f tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '845885d4ede946babd400ee92b7c4490', 'request_id': 'req-6debd60d-59c2-4539-adaa-abe91116216f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:35.055770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6debd60d-59c2-4539-adaa-abe91116216f tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] The token cache is being invalidate because project 845885d4ede946babd400ee92b7c4490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:56:35.056305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6debd60d-59c2-4539-adaa-abe91116216f tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:35.057707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6debd60d-59c2-4539-adaa-abe91116216f tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:35.060059 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1313/2601] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:34 2022] DELETE /identity/v3/projects/845885d4ede946babd400ee92b7c4490 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:56:35.065270 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f9197-95ad-4b58-9cf2-3f370718418d tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:35.067835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-419f9197-95ad-4b58-9cf2-3f370718418d tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:35.202948 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f9197-95ad-4b58-9cf2-3f370718418d tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:35.271343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f5176-e834-4dce-8a18-f5835471a905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:35.272580 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f5176-e834-4dce-8a18-f5835471a905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:35.272861 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f5176-e834-4dce-8a18-f5835471a905 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:35.273746 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f5176-e834-4dce-8a18-f5835471a905 admin admin] PATH_INFO: `/v3/users/084322277a7a4abead28cb8407763a32` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:35.274388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f5176-e834-4dce-8a18-f5835471a905 admin admin] RBAC: Authorizing `identity:delete_user(user_id=084322277a7a4abead28cb8407763a32)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:35.276739 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f5176-e834-4dce-8a18-f5835471a905 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:35.279962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:35.340502 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2f2f5176-e834-4dce-8a18-f5835471a905 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '084322277a7a4abead28cb8407763a32'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:35.341176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2f2f5176-e834-4dce-8a18-f5835471a905 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '084322277a7a4abead28cb8407763a32'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:35.341788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2f2f5176-e834-4dce-8a18-f5835471a905 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '084322277a7a4abead28cb8407763a32'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:35.354135 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2f2f5176-e834-4dce-8a18-f5835471a905 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '084322277a7a4abead28cb8407763a32'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:35.376584 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2f2f5176-e834-4dce-8a18-f5835471a905 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '084322277a7a4abead28cb8407763a32'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:35.405457 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1289/2602] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:56:35 2022] DELETE /identity/v3/users/084322277a7a4abead28cb8407763a32 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:56:35.410007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7082f-a012-4c09-a268-44cc1b0c8dbe None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:35.410294 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7082f-a012-4c09-a268-44cc1b0c8dbe None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:35.411178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7082f-a012-4c09-a268-44cc1b0c8dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:35.431635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-e2e7082f-a012-4c09-a268-44cc1b0c8dbe None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:56:35.432890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e2e7082f-a012-4c09-a268-44cc1b0c8dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:35.516177 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1314/2603] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:56:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:56:35.530121 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f5176-e834-4dce-8a18-f5835471a905 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:35.531648 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2f2f5176-e834-4dce-8a18-f5835471a905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:35.594453 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f5176-e834-4dce-8a18-f5835471a905 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:35.598307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51e551-3d4f-4c76-9d42-0db636c3530e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:35.599082 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51e551-3d4f-4c76-9d42-0db636c3530e service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:35.599423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51e551-3d4f-4c76-9d42-0db636c3530e service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:35.599876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51e551-3d4f-4c76-9d42-0db636c3530e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:35.609159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51e551-3d4f-4c76-9d42-0db636c3530e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:35.610649 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51e551-3d4f-4c76-9d42-0db636c3530e service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:35.620490 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1290/2604] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:56:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:56:36.150451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7082f-a012-4c09-a268-44cc1b0c8dbe None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:36.152217 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e2e7082f-a012-4c09-a268-44cc1b0c8dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:36.165132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7082f-a012-4c09-a268-44cc1b0c8dbe None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:36.171288 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28287575-511b-4e18-9896-aa670f1db840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:36.171928 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28287575-511b-4e18-9896-aa670f1db840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:36.172209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28287575-511b-4e18-9896-aa670f1db840 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:36.172479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28287575-511b-4e18-9896-aa670f1db840 admin admin] PATH_INFO: `/v3/projects/9a5966e798bb40ac92eec4c6d2f10dc0` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:36.173595 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28287575-511b-4e18-9896-aa670f1db840 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a5966e798bb40ac92eec4c6d2f10dc0)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:36.175580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28287575-511b-4e18-9896-aa670f1db840 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:36.276350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-28287575-511b-4e18-9896-aa670f1db840 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a5966e798bb40ac92eec4c6d2f10dc0', 'request_id': 'req-28287575-511b-4e18-9896-aa670f1db840'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:36.291350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-28287575-511b-4e18-9896-aa670f1db840 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a5966e798bb40ac92eec4c6d2f10dc0', 'request_id': 'req-28287575-511b-4e18-9896-aa670f1db840'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:36.305204 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-28287575-511b-4e18-9896-aa670f1db840 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a5966e798bb40ac92eec4c6d2f10dc0', 'request_id': 'req-28287575-511b-4e18-9896-aa670f1db840'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:36.327529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-28287575-511b-4e18-9896-aa670f1db840 admin admin] The token cache is being invalidate because project 9a5966e798bb40ac92eec4c6d2f10dc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:56:36.327819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-28287575-511b-4e18-9896-aa670f1db840 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:36.328609 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-28287575-511b-4e18-9896-aa670f1db840 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:36.332009 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1315/2605] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:36 2022] DELETE /identity/v3/projects/9a5966e798bb40ac92eec4c6d2f10dc0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:56:36.336473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51e551-3d4f-4c76-9d42-0db636c3530e service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:36.352006 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51e551-3d4f-4c76-9d42-0db636c3530e service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:36.488091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67ec62-66ae-46ec-9744-a57066acbc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:36.489321 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67ec62-66ae-46ec-9744-a57066acbc5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:36.489606 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67ec62-66ae-46ec-9744-a57066acbc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:36.489881 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67ec62-66ae-46ec-9744-a57066acbc5d admin admin] PATH_INFO: `/v3/users/21d5f876040148d7a3d427d59a65f7e7` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:36.496527 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab67ec62-66ae-46ec-9744-a57066acbc5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=21d5f876040148d7a3d427d59a65f7e7)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:36.503019 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab67ec62-66ae-46ec-9744-a57066acbc5d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:36.571962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:36.615043 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ab67ec62-66ae-46ec-9744-a57066acbc5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21d5f876040148d7a3d427d59a65f7e7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:36.617047 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ab67ec62-66ae-46ec-9744-a57066acbc5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21d5f876040148d7a3d427d59a65f7e7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:36.618904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ab67ec62-66ae-46ec-9744-a57066acbc5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21d5f876040148d7a3d427d59a65f7e7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:36.640430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ab67ec62-66ae-46ec-9744-a57066acbc5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21d5f876040148d7a3d427d59a65f7e7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:36.680572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ab67ec62-66ae-46ec-9744-a57066acbc5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21d5f876040148d7a3d427d59a65f7e7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:36.725037 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1291/2606] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:56:36 2022] DELETE /identity/v3/users/21d5f876040148d7a3d427d59a65f7e7 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:56:36.950297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1926ed-2037-429a-85ce-acb789e62dff None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:36.950749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1926ed-2037-429a-85ce-acb789e62dff None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:36.951035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1926ed-2037-429a-85ce-acb789e62dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:37.002741 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-ef1926ed-2037-429a-85ce-acb789e62dff None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:56:37.007295 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ef1926ed-2037-429a-85ce-acb789e62dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:37.191074 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1316/2607] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 20:56:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:56:37.203243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67ec62-66ae-46ec-9744-a57066acbc5d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:37.204672 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ab67ec62-66ae-46ec-9744-a57066acbc5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:37.359856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67ec62-66ae-46ec-9744-a57066acbc5d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:37.376937 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861dd63-7100-4901-8f14-567fa27382b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:37.377575 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861dd63-7100-4901-8f14-567fa27382b8 service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:37.377854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861dd63-7100-4901-8f14-567fa27382b8 service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:37.378127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861dd63-7100-4901-8f14-567fa27382b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:37.397505 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861dd63-7100-4901-8f14-567fa27382b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:37.399180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861dd63-7100-4901-8f14-567fa27382b8 service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:37.411506 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1292/2608] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 20:56:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 20:56:39.503257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1926ed-2037-429a-85ce-acb789e62dff None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:39.510429 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ef1926ed-2037-429a-85ce-acb789e62dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:39.527743 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:39.682580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1926ed-2037-429a-85ce-acb789e62dff None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:39.694182 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8677840-6474-45a5-af0c-45be64a5c3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:39.694872 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8677840-6474-45a5-af0c-45be64a5c3f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:39.695203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8677840-6474-45a5-af0c-45be64a5c3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:39.695484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8677840-6474-45a5-af0c-45be64a5c3f1 admin admin] PATH_INFO: `/v3/projects/a932f2ac861040ed8428d0bea61ef61b` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:39.703173 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8677840-6474-45a5-af0c-45be64a5c3f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a932f2ac861040ed8428d0bea61ef61b)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:39.705162 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8677840-6474-45a5-af0c-45be64a5c3f1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:39.818005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b8677840-6474-45a5-af0c-45be64a5c3f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a932f2ac861040ed8428d0bea61ef61b', 'request_id': 'req-b8677840-6474-45a5-af0c-45be64a5c3f1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:39.825367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b8677840-6474-45a5-af0c-45be64a5c3f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a932f2ac861040ed8428d0bea61ef61b', 'request_id': 'req-b8677840-6474-45a5-af0c-45be64a5c3f1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:39.850487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b8677840-6474-45a5-af0c-45be64a5c3f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a932f2ac861040ed8428d0bea61ef61b', 'request_id': 'req-b8677840-6474-45a5-af0c-45be64a5c3f1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:39.873607 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b8677840-6474-45a5-af0c-45be64a5c3f1 admin admin] The token cache is being invalidate because project a932f2ac861040ed8428d0bea61ef61b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:56:39.874762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b8677840-6474-45a5-af0c-45be64a5c3f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:39.876652 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b8677840-6474-45a5-af0c-45be64a5c3f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:39.881358 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1317/2609] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:39 2022] DELETE /identity/v3/projects/a932f2ac861040ed8428d0bea61ef61b => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:56:39.887134 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4032a7-9bc3-4804-a6e5-a97e24698844 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:39.887625 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4032a7-9bc3-4804-a6e5-a97e24698844 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:39.887743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4032a7-9bc3-4804-a6e5-a97e24698844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:39.923306 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-fb4032a7-9bc3-4804-a6e5-a97e24698844 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:56:39.925742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-fb4032a7-9bc3-4804-a6e5-a97e24698844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:40.132884 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1293/2610] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:56:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:56:40.140957 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e083e76-50ad-4118-8e22-950e2601b375 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:40.141238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e083e76-50ad-4118-8e22-950e2601b375 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:40.141526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e083e76-50ad-4118-8e22-950e2601b375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:40.187827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-1e083e76-50ad-4118-8e22-950e2601b375 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:56:40.194274 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1e083e76-50ad-4118-8e22-950e2601b375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:40.219833 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1318/2611] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:56:40.221614 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4032a7-9bc3-4804-a6e5-a97e24698844 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:40.237107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4032a7-9bc3-4804-a6e5-a97e24698844 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:40.270012 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96cdca-4d10-4b3f-8883-b5495237eb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:40.275533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96cdca-4d10-4b3f-8883-b5495237eb7e admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:40.275795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96cdca-4d10-4b3f-8883-b5495237eb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:40.276071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96cdca-4d10-4b3f-8883-b5495237eb7e admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:40.276751 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b96cdca-4d10-4b3f-8883-b5495237eb7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:56:40.277055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b96cdca-4d10-4b3f-8883-b5495237eb7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:40.292436 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b96cdca-4d10-4b3f-8883-b5495237eb7e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:40.359540 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1294/2612] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:56:40.364663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e083e76-50ad-4118-8e22-950e2601b375 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:40.392351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e083e76-50ad-4118-8e22-950e2601b375 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:40.413216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c148b-53b6-487e-9558-d2adfa965c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:40.415456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c148b-53b6-487e-9558-d2adfa965c26 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:40.419342 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c148b-53b6-487e-9558-d2adfa965c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:40.420698 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c148b-53b6-487e-9558-d2adfa965c26 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:40.428456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c148b-53b6-487e-9558-d2adfa965c26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:40.433624 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c148b-53b6-487e-9558-d2adfa965c26 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:40.527360 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1319/2613] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:56:40 2022] POST /identity/v3/projects => generated 391 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:56:40.531584 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96cdca-4d10-4b3f-8883-b5495237eb7e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:40.548422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96cdca-4d10-4b3f-8883-b5495237eb7e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:40.624360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:40.871034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c202f3a-390a-423d-bf79-ffa564f25e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:40.872653 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c202f3a-390a-423d-bf79-ffa564f25e68 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:40.874441 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c202f3a-390a-423d-bf79-ffa564f25e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:40.876376 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c202f3a-390a-423d-bf79-ffa564f25e68 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:40.877416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c202f3a-390a-423d-bf79-ffa564f25e68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:40.885755 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c202f3a-390a-423d-bf79-ffa564f25e68 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:40.949343 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1295/2614] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:56:40 2022] POST /identity/v3/users => generated 296 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:56:40.950537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c148b-53b6-487e-9558-d2adfa965c26 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:40.969086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c148b-53b6-487e-9558-d2adfa965c26 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:40.994536 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df99441-a839-472b-a44f-b460cfb6d26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:40.999168 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df99441-a839-472b-a44f-b460cfb6d26c admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:40.999678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df99441-a839-472b-a44f-b460cfb6d26c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:41.000674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df99441-a839-472b-a44f-b460cfb6d26c admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:41.002716 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df99441-a839-472b-a44f-b460cfb6d26c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:41.007168 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df99441-a839-472b-a44f-b460cfb6d26c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:41.065874 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c202f3a-390a-423d-bf79-ffa564f25e68 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:41.077934 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1320/2615] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:56:41.085810 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c202f3a-390a-423d-bf79-ffa564f25e68 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:41.106145 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84726e27-3cb6-4316-aecd-3feef6b5751c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:41.107744 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84726e27-3cb6-4316-aecd-3feef6b5751c admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:41.108734 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84726e27-3cb6-4316-aecd-3feef6b5751c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:41.109470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84726e27-3cb6-4316-aecd-3feef6b5751c admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:41.124812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84726e27-3cb6-4316-aecd-3feef6b5751c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:41.126503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84726e27-3cb6-4316-aecd-3feef6b5751c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:41.177794 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1296/2616] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:56:41.182268 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df99441-a839-472b-a44f-b460cfb6d26c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:41.197008 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df99441-a839-472b-a44f-b460cfb6d26c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:41.212632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ba713-08df-4ed1-9daa-ebe656563679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:41.213534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ba713-08df-4ed1-9daa-ebe656563679 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:41.213819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ba713-08df-4ed1-9daa-ebe656563679 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:41.214077 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ba713-08df-4ed1-9daa-ebe656563679 admin admin] PATH_INFO: `/v3/projects/ae18d1a9386b473098b3f37f92f6da8f/users/728d7aea2ff1421fa55a511ef098536f/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:41.278092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ba713-08df-4ed1-9daa-ebe656563679 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae18d1a9386b473098b3f37f92f6da8f, user_id=728d7aea2ff1421fa55a511ef098536f, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:41.281112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ba713-08df-4ed1-9daa-ebe656563679 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:41.318604 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1321/2617] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:56:41 2022] PUT /identity/v3/projects/ae18d1a9386b473098b3f37f92f6da8f/users/728d7aea2ff1421fa55a511ef098536f/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:56:41.334589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89741992-4c7e-4a88-ab1a-02a1813cd9c7 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:41.334853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89741992-4c7e-4a88-ab1a-02a1813cd9c7 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:41.335272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89741992-4c7e-4a88-ab1a-02a1813cd9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:41.405576 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-89741992-4c7e-4a88-ab1a-02a1813cd9c7 None None] MFA Rules not processed for user `728d7aea2ff1421fa55a511ef098536f`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:56:41.407127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-89741992-4c7e-4a88-ab1a-02a1813cd9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:41.618184 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1297/2618] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:56:41 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:56:41.622669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ba713-08df-4ed1-9daa-ebe656563679 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:41.779774 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:41.883459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ba713-08df-4ed1-9daa-ebe656563679 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:41.904331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e11460-73ea-4941-a243-2c4639fae7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:41.905098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e11460-73ea-4941-a243-2c4639fae7c8 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:41.905831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e11460-73ea-4941-a243-2c4639fae7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:41.905831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e11460-73ea-4941-a243-2c4639fae7c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:41.906514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e11460-73ea-4941-a243-2c4639fae7c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:41.909757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e11460-73ea-4941-a243-2c4639fae7c8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:41.975341 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1322/2619] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:56:41 2022] POST /identity/v3/projects => generated 389 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:56:41.980946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89741992-4c7e-4a88-ab1a-02a1813cd9c7 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:41.998910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89741992-4c7e-4a88-ab1a-02a1813cd9c7 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:42.158356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afb997-e857-408b-8869-74ad11d88df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:42.161630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afb997-e857-408b-8869-74ad11d88df6 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:42.161911 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afb997-e857-408b-8869-74ad11d88df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:42.162357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afb997-e857-408b-8869-74ad11d88df6 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:42.163040 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0afb997-e857-408b-8869-74ad11d88df6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:42.165318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0afb997-e857-408b-8869-74ad11d88df6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:42.249249 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1298/2620] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:56:41 2022] POST /identity/v3/users => generated 301 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:56:42.253256 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e11460-73ea-4941-a243-2c4639fae7c8 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:42.269164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e11460-73ea-4941-a243-2c4639fae7c8 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:42.290822 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232bca8-a401-48d7-8eef-40b5f4150a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:42.291351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232bca8-a401-48d7-8eef-40b5f4150a33 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:42.291633 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232bca8-a401-48d7-8eef-40b5f4150a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:42.291909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232bca8-a401-48d7-8eef-40b5f4150a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:42.292565 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b232bca8-a401-48d7-8eef-40b5f4150a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:42.295558 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b232bca8-a401-48d7-8eef-40b5f4150a33 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:42.345216 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1323/2621] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:56:42.346680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afb997-e857-408b-8869-74ad11d88df6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:42.365148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afb997-e857-408b-8869-74ad11d88df6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:42.381362 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec37800-a5c2-4ecb-8572-8a864b88fc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:42.382531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec37800-a5c2-4ecb-8572-8a864b88fc65 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:42.382892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec37800-a5c2-4ecb-8572-8a864b88fc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:42.383217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec37800-a5c2-4ecb-8572-8a864b88fc65 admin admin] PATH_INFO: `/v3/projects/78d3bd3100674e1b99638cc8fccbf97b/users/650d7786cf8a47f3854fabd98285f5ca/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:42.416374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec37800-a5c2-4ecb-8572-8a864b88fc65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78d3bd3100674e1b99638cc8fccbf97b, user_id=650d7786cf8a47f3854fabd98285f5ca, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:42.419381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec37800-a5c2-4ecb-8572-8a864b88fc65 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:42.422345 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:42.445684 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1299/2622] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:56:42 2022] PUT /identity/v3/projects/78d3bd3100674e1b99638cc8fccbf97b/users/650d7786cf8a47f3854fabd98285f5ca/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:56:42.449688 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232bca8-a401-48d7-8eef-40b5f4150a33 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:42.475666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232bca8-a401-48d7-8eef-40b5f4150a33 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:42.621041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a628e-3f3e-400c-a7dd-9784a0204802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:42.621694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a628e-3f3e-400c-a7dd-9784a0204802 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:42.622172 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a628e-3f3e-400c-a7dd-9784a0204802 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:42.622459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a628e-3f3e-400c-a7dd-9784a0204802 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:42.623848 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882a628e-3f3e-400c-a7dd-9784a0204802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:42.641860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882a628e-3f3e-400c-a7dd-9784a0204802 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:42.698874 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1324/2623] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:56:42.700558 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec37800-a5c2-4ecb-8572-8a864b88fc65 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:42.719386 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec37800-a5c2-4ecb-8572-8a864b88fc65 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:42.729858 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8886d7-19dd-4283-b45e-a64f22cfb541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:42.730894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8886d7-19dd-4283-b45e-a64f22cfb541 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:42.731301 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8886d7-19dd-4283-b45e-a64f22cfb541 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:42.731692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8886d7-19dd-4283-b45e-a64f22cfb541 admin admin] PATH_INFO: `/v3/projects/78d3bd3100674e1b99638cc8fccbf97b/users/650d7786cf8a47f3854fabd98285f5ca/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:42.735354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8886d7-19dd-4283-b45e-a64f22cfb541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78d3bd3100674e1b99638cc8fccbf97b, user_id=650d7786cf8a47f3854fabd98285f5ca, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:42.741324 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8886d7-19dd-4283-b45e-a64f22cfb541 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:42.773057 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1300/2624] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:56:42 2022] PUT /identity/v3/projects/78d3bd3100674e1b99638cc8fccbf97b/users/650d7786cf8a47f3854fabd98285f5ca/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:56:42.786826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8473a5-70c6-4518-9cef-8a5f6ff82b92 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:42.787144 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8473a5-70c6-4518-9cef-8a5f6ff82b92 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:42.787379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8473a5-70c6-4518-9cef-8a5f6ff82b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:42.865663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-5c8473a5-70c6-4518-9cef-8a5f6ff82b92 None None] MFA Rules not processed for user `650d7786cf8a47f3854fabd98285f5ca`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:56:42.866892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5c8473a5-70c6-4518-9cef-8a5f6ff82b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:43.103426 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1325/2625] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:56:42 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:56:43.293456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8886d7-19dd-4283-b45e-a64f22cfb541 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:43.295703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-fd8886d7-19dd-4283-b45e-a64f22cfb541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:43.540184 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8886d7-19dd-4283-b45e-a64f22cfb541 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:43.551915 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07a48c-44c3-4a6c-adab-9a0558c9a3e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:43.552910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07a48c-44c3-4a6c-adab-9a0558c9a3e3 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:43.553393 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07a48c-44c3-4a6c-adab-9a0558c9a3e3 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:43.553853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07a48c-44c3-4a6c-adab-9a0558c9a3e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:43.720181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07a48c-44c3-4a6c-adab-9a0558c9a3e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:43.735232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07a48c-44c3-4a6c-adab-9a0558c9a3e3 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:43.767151 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1301/2626] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:56:43 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:56:44.460984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8473a5-70c6-4518-9cef-8a5f6ff82b92 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:44.462793 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5c8473a5-70c6-4518-9cef-8a5f6ff82b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:44.557037 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:44.648599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8473a5-70c6-4518-9cef-8a5f6ff82b92 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:44.672330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9195c5-d542-49f5-9567-7ed3c12c596d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:44.673364 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9195c5-d542-49f5-9567-7ed3c12c596d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:44.673850 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9195c5-d542-49f5-9567-7ed3c12c596d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:44.674430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9195c5-d542-49f5-9567-7ed3c12c596d admin admin] PATH_INFO: `/v3/users/e9067baeaf4a422b85297540fa940079` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:44.678164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9195c5-d542-49f5-9567-7ed3c12c596d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9067baeaf4a422b85297540fa940079)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:44.680880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9195c5-d542-49f5-9567-7ed3c12c596d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:44.791957 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1c9195c5-d542-49f5-9567-7ed3c12c596d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9067baeaf4a422b85297540fa940079'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:44.815856 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1c9195c5-d542-49f5-9567-7ed3c12c596d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9067baeaf4a422b85297540fa940079'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:44.817794 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1c9195c5-d542-49f5-9567-7ed3c12c596d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9067baeaf4a422b85297540fa940079'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:44.818468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1c9195c5-d542-49f5-9567-7ed3c12c596d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9067baeaf4a422b85297540fa940079'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:44.836381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1c9195c5-d542-49f5-9567-7ed3c12c596d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9067baeaf4a422b85297540fa940079'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:44.870509 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1326/2627] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:56:44 2022] DELETE /identity/v3/users/e9067baeaf4a422b85297540fa940079 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:56:44.876297 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61847150-1a05-49c2-93e6-4213190d5c57 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:44.876816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61847150-1a05-49c2-93e6-4213190d5c57 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:44.876957 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61847150-1a05-49c2-93e6-4213190d5c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:44.949064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-61847150-1a05-49c2-93e6-4213190d5c57 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:56:44.950310 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-61847150-1a05-49c2-93e6-4213190d5c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:45.085178 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1302/2628] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:56:45.169418 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9195c5-d542-49f5-9567-7ed3c12c596d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:45.170849 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1c9195c5-d542-49f5-9567-7ed3c12c596d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:45.304444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9195c5-d542-49f5-9567-7ed3c12c596d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:45.309415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca83ff5e-99cd-46d7-9f21-8af110d43464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:45.310063 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83ff5e-99cd-46d7-9f21-8af110d43464 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:45.310329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83ff5e-99cd-46d7-9f21-8af110d43464 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:45.310672 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83ff5e-99cd-46d7-9f21-8af110d43464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:45.342737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca83ff5e-99cd-46d7-9f21-8af110d43464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:45.344560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca83ff5e-99cd-46d7-9f21-8af110d43464 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:45.363805 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1327/2629] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:56:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:56:46.308830 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61847150-1a05-49c2-93e6-4213190d5c57 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:46.311635 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-61847150-1a05-49c2-93e6-4213190d5c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:46.342795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:46.500803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61847150-1a05-49c2-93e6-4213190d5c57 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:46.512277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c9f31-34db-45ab-ae9d-5de2cc5cc7af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:46.513733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c9f31-34db-45ab-ae9d-5de2cc5cc7af service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:46.514209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c9f31-34db-45ab-ae9d-5de2cc5cc7af service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:46.515138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c9f31-34db-45ab-ae9d-5de2cc5cc7af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:46.518250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b83c9f31-34db-45ab-ae9d-5de2cc5cc7af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:46.622534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca83ff5e-99cd-46d7-9f21-8af110d43464 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:46.625419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ca83ff5e-99cd-46d7-9f21-8af110d43464 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:46.648972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c9f31-34db-45ab-ae9d-5de2cc5cc7af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:46.650900 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c9f31-34db-45ab-ae9d-5de2cc5cc7af service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:46.682087 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca83ff5e-99cd-46d7-9f21-8af110d43464 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:46.696668 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1303/2630] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:56:46 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:56:46.703722 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d4b98-77d2-48de-8790-db01e53622b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:46.704608 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44339ea-5602-4610-a8ed-6606325c907b None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:46.705359 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d4b98-77d2-48de-8790-db01e53622b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:46.706273 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44339ea-5602-4610-a8ed-6606325c907b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:46.708062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d4b98-77d2-48de-8790-db01e53622b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:46.708469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44339ea-5602-4610-a8ed-6606325c907b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:46.708796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d4b98-77d2-48de-8790-db01e53622b2 admin admin] PATH_INFO: `/v3/projects/f60674e881dc407296dd58e190b26164` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:46.712333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d4b98-77d2-48de-8790-db01e53622b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f60674e881dc407296dd58e190b26164)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:46.718356 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d4b98-77d2-48de-8790-db01e53622b2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:46.749540 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-b44339ea-5602-4610-a8ed-6606325c907b None None] MFA Rules not processed for user `dff69a9a061a454685cfc57c1675f4b9`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:56:46.758020 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b44339ea-5602-4610-a8ed-6606325c907b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:46.817074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:46.822701 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-047d4b98-77d2-48de-8790-db01e53622b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f60674e881dc407296dd58e190b26164', 'request_id': 'req-047d4b98-77d2-48de-8790-db01e53622b2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:46.831232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-047d4b98-77d2-48de-8790-db01e53622b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f60674e881dc407296dd58e190b26164', 'request_id': 'req-047d4b98-77d2-48de-8790-db01e53622b2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:46.844368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-047d4b98-77d2-48de-8790-db01e53622b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f60674e881dc407296dd58e190b26164', 'request_id': 'req-047d4b98-77d2-48de-8790-db01e53622b2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:46.886891 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1304/2631] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:56:46 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:56:46.906463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-047d4b98-77d2-48de-8790-db01e53622b2 admin admin] The token cache is being invalidate because project f60674e881dc407296dd58e190b26164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:56:46.906812 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-047d4b98-77d2-48de-8790-db01e53622b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:46.908300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-047d4b98-77d2-48de-8790-db01e53622b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:46.910441 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1328/2632] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:46 2022] DELETE /identity/v3/projects/f60674e881dc407296dd58e190b26164 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:56:46.916157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44339ea-5602-4610-a8ed-6606325c907b None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:46.942888 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44339ea-5602-4610-a8ed-6606325c907b None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:47.035907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:47.054243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eff68b-dacd-4404-ba08-758dec9e0eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:47.056955 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eff68b-dacd-4404-ba08-758dec9e0eb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:47.057331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eff68b-dacd-4404-ba08-758dec9e0eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:47.057711 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eff68b-dacd-4404-ba08-758dec9e0eb6 admin admin] PATH_INFO: `/v3/users/da19d3c4fc114a119e37c77464934eec` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:47.061559 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eff68b-dacd-4404-ba08-758dec9e0eb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da19d3c4fc114a119e37c77464934eec)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:47.064083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eff68b-dacd-4404-ba08-758dec9e0eb6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:47.148773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d9eff68b-dacd-4404-ba08-758dec9e0eb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da19d3c4fc114a119e37c77464934eec'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:47.150591 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d9eff68b-dacd-4404-ba08-758dec9e0eb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da19d3c4fc114a119e37c77464934eec'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:47.151375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d9eff68b-dacd-4404-ba08-758dec9e0eb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da19d3c4fc114a119e37c77464934eec'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:47.163734 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d9eff68b-dacd-4404-ba08-758dec9e0eb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da19d3c4fc114a119e37c77464934eec'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:47.188480 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d9eff68b-dacd-4404-ba08-758dec9e0eb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da19d3c4fc114a119e37c77464934eec'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:47.218908 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1305/2633] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:56:46 2022] DELETE /identity/v3/users/da19d3c4fc114a119e37c77464934eec => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:56:47.770387 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d4b98-77d2-48de-8790-db01e53622b2 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:47.772225 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-047d4b98-77d2-48de-8790-db01e53622b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:47.808416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d4b98-77d2-48de-8790-db01e53622b2 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:47.931164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124c9d5-1777-45a1-aaa8-fea8f056e483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:47.931817 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124c9d5-1777-45a1-aaa8-fea8f056e483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:47.932100 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124c9d5-1777-45a1-aaa8-fea8f056e483 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:47.932380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124c9d5-1777-45a1-aaa8-fea8f056e483 admin admin] PATH_INFO: `/v3/projects/8a412509105c4736b912d323ac3f659a` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:47.934146 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124c9d5-1777-45a1-aaa8-fea8f056e483 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a412509105c4736b912d323ac3f659a)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:47.936331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124c9d5-1777-45a1-aaa8-fea8f056e483 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:48.037270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8124c9d5-1777-45a1-aaa8-fea8f056e483 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a412509105c4736b912d323ac3f659a', 'request_id': 'req-8124c9d5-1777-45a1-aaa8-fea8f056e483'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:48.052141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8124c9d5-1777-45a1-aaa8-fea8f056e483 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a412509105c4736b912d323ac3f659a', 'request_id': 'req-8124c9d5-1777-45a1-aaa8-fea8f056e483'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:48.063933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8124c9d5-1777-45a1-aaa8-fea8f056e483 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a412509105c4736b912d323ac3f659a', 'request_id': 'req-8124c9d5-1777-45a1-aaa8-fea8f056e483'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:48.091994 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8124c9d5-1777-45a1-aaa8-fea8f056e483 admin admin] The token cache is being invalidate because project 8a412509105c4736b912d323ac3f659a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:56:48.092334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8124c9d5-1777-45a1-aaa8-fea8f056e483 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:48.098124 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8124c9d5-1777-45a1-aaa8-fea8f056e483 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:48.103347 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1329/2634] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:47 2022] DELETE /identity/v3/projects/8a412509105c4736b912d323ac3f659a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:56:48.108110 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a097e-fc51-4ab7-ae4c-1ebe22afe8c2 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:48.108614 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a097e-fc51-4ab7-ae4c-1ebe22afe8c2 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:48.108720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a097e-fc51-4ab7-ae4c-1ebe22afe8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:48.149435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-069a097e-fc51-4ab7-ae4c-1ebe22afe8c2 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:56:48.150718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-069a097e-fc51-4ab7-ae4c-1ebe22afe8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:48.266975 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1306/2635] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:56:48.268777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89230bf-b4ea-45a6-b114-54f8f0e5b7a0 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:48.269691 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89230bf-b4ea-45a6-b114-54f8f0e5b7a0 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:48.270105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89230bf-b4ea-45a6-b114-54f8f0e5b7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:48.316461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-f89230bf-b4ea-45a6-b114-54f8f0e5b7a0 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:56:48.318348 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f89230bf-b4ea-45a6-b114-54f8f0e5b7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:48.335011 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1330/2636] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:56:48.339263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a097e-fc51-4ab7-ae4c-1ebe22afe8c2 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:48.357457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a097e-fc51-4ab7-ae4c-1ebe22afe8c2 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:48.366794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497c306-62e2-405c-a951-cb21ddaf2b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:48.367417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497c306-62e2-405c-a951-cb21ddaf2b29 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:48.367703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497c306-62e2-405c-a951-cb21ddaf2b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:48.368034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497c306-62e2-405c-a951-cb21ddaf2b29 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:48.368626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497c306-62e2-405c-a951-cb21ddaf2b29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:56:48.368931 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497c306-62e2-405c-a951-cb21ddaf2b29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:48.370797 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497c306-62e2-405c-a951-cb21ddaf2b29 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:48.400237 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1307/2637] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:56:48.403703 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89230bf-b4ea-45a6-b114-54f8f0e5b7a0 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:48.419466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89230bf-b4ea-45a6-b114-54f8f0e5b7a0 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:48.432516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd8552-484e-4f31-a9e4-ab736f0d6cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:48.435283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd8552-484e-4f31-a9e4-ab736f0d6cc6 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:48.435961 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd8552-484e-4f31-a9e4-ab736f0d6cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:48.435961 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd8552-484e-4f31-a9e4-ab736f0d6cc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:48.438438 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd8552-484e-4f31-a9e4-ab736f0d6cc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:48.442708 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd8552-484e-4f31-a9e4-ab736f0d6cc6 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:48.497908 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1331/2638] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:56:48 2022] POST /identity/v3/projects => generated 377 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:56:48.499233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497c306-62e2-405c-a951-cb21ddaf2b29 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:48.513353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497c306-62e2-405c-a951-cb21ddaf2b29 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:48.697860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fb3a0-8b40-4ffe-a879-ea7bafa4269e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:48.697860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fb3a0-8b40-4ffe-a879-ea7bafa4269e admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:48.697860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fb3a0-8b40-4ffe-a879-ea7bafa4269e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:48.697860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fb3a0-8b40-4ffe-a879-ea7bafa4269e admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:48.699056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64fb3a0-8b40-4ffe-a879-ea7bafa4269e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:48.699056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64fb3a0-8b40-4ffe-a879-ea7bafa4269e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:48.708893 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:48.737198 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1308/2639] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:56:48 2022] POST /identity/v3/users => generated 289 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:56:48.737975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd8552-484e-4f31-a9e4-ab736f0d6cc6 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:48.757124 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd8552-484e-4f31-a9e4-ab736f0d6cc6 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:48.774306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6904c-4839-4ce2-b867-50a860f7309e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:48.778096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6904c-4839-4ce2-b867-50a860f7309e admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:48.779194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6904c-4839-4ce2-b867-50a860f7309e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:48.780912 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6904c-4839-4ce2-b867-50a860f7309e admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:48.783373 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6904c-4839-4ce2-b867-50a860f7309e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:48.788275 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6904c-4839-4ce2-b867-50a860f7309e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:48.827899 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1332/2640] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:56:48.834162 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fb3a0-8b40-4ffe-a879-ea7bafa4269e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:48.857005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fb3a0-8b40-4ffe-a879-ea7bafa4269e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:48.861999 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b3fec-cf1a-4fc4-bc67-744c2750dc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:48.862766 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b3fec-cf1a-4fc4-bc67-744c2750dc02 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:48.863054 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b3fec-cf1a-4fc4-bc67-744c2750dc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:48.863333 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b3fec-cf1a-4fc4-bc67-744c2750dc02 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:48.864001 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b3fec-cf1a-4fc4-bc67-744c2750dc02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:48.865813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b3fec-cf1a-4fc4-bc67-744c2750dc02 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:48.882063 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1309/2641] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:56:48.883418 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6904c-4839-4ce2-b867-50a860f7309e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:48.902180 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6904c-4839-4ce2-b867-50a860f7309e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:48.911048 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c8635-f835-4e7a-a64f-da7c354dcd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:48.911783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c8635-f835-4e7a-a64f-da7c354dcd31 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:48.912070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c8635-f835-4e7a-a64f-da7c354dcd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:48.912346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c8635-f835-4e7a-a64f-da7c354dcd31 admin admin] PATH_INFO: `/v3/projects/1558d5dbaa704f40a3b6436b4b6c0e51/users/ea7293bc4816483dbcd0f96536814d2c/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:48.942213 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c8635-f835-4e7a-a64f-da7c354dcd31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1558d5dbaa704f40a3b6436b4b6c0e51, user_id=ea7293bc4816483dbcd0f96536814d2c, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:48.945780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c8635-f835-4e7a-a64f-da7c354dcd31 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:48.959956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:48.972464 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1333/2642] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:56:48 2022] PUT /identity/v3/projects/1558d5dbaa704f40a3b6436b4b6c0e51/users/ea7293bc4816483dbcd0f96536814d2c/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:56:48.983925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95107b7a-804c-44b2-8820-5af0d155aee6 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:48.984260 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95107b7a-804c-44b2-8820-5af0d155aee6 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:48.984540 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95107b7a-804c-44b2-8820-5af0d155aee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:49.055946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-95107b7a-804c-44b2-8820-5af0d155aee6 None None] MFA Rules not processed for user `ea7293bc4816483dbcd0f96536814d2c`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:56:49.059609 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-95107b7a-804c-44b2-8820-5af0d155aee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:49.254901 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1310/2643] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:56:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:56:49.259070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c8635-f835-4e7a-a64f-da7c354dcd31 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:49.361278 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c8635-f835-4e7a-a64f-da7c354dcd31 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:49.370817 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b0461-69cb-4426-b04d-9f12d87e99e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:49.371060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b0461-69cb-4426-b04d-9f12d87e99e1 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:49.371338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b0461-69cb-4426-b04d-9f12d87e99e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:49.371608 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b0461-69cb-4426-b04d-9f12d87e99e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:49.372498 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b0461-69cb-4426-b04d-9f12d87e99e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:49.376468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b0461-69cb-4426-b04d-9f12d87e99e1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:49.431110 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1334/2644] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:56:49 2022] POST /identity/v3/projects => generated 375 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:56:49.433909 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95107b7a-804c-44b2-8820-5af0d155aee6 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:49.463695 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95107b7a-804c-44b2-8820-5af0d155aee6 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:49.603995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c85e4-3339-432c-ba45-4f52f92a7fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:49.605081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c85e4-3339-432c-ba45-4f52f92a7fbe admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:49.605366 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c85e4-3339-432c-ba45-4f52f92a7fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:49.605638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c85e4-3339-432c-ba45-4f52f92a7fbe admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:49.606255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c85e4-3339-432c-ba45-4f52f92a7fbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:49.608408 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c85e4-3339-432c-ba45-4f52f92a7fbe admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:49.655908 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1311/2645] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:56:49 2022] POST /identity/v3/users => generated 294 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:56:49.659571 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b0461-69cb-4426-b04d-9f12d87e99e1 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:49.677893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b0461-69cb-4426-b04d-9f12d87e99e1 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:49.689082 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff92d46-b635-4cb8-919a-1fd38d3efb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:49.689706 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff92d46-b635-4cb8-919a-1fd38d3efb20 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:49.689983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff92d46-b635-4cb8-919a-1fd38d3efb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:49.690403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff92d46-b635-4cb8-919a-1fd38d3efb20 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:49.691715 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff92d46-b635-4cb8-919a-1fd38d3efb20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:49.694382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff92d46-b635-4cb8-919a-1fd38d3efb20 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:49.714664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c85e4-3339-432c-ba45-4f52f92a7fbe admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:49.726681 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1335/2646] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:56:49.727344 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c85e4-3339-432c-ba45-4f52f92a7fbe admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:49.732441 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cefc46-0197-4723-aad3-099c8e6cbd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:49.733310 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cefc46-0197-4723-aad3-099c8e6cbd6e admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:49.733836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cefc46-0197-4723-aad3-099c8e6cbd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:49.734113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cefc46-0197-4723-aad3-099c8e6cbd6e admin admin] PATH_INFO: `/v3/projects/29517a1e62d0497e8aaa61d568060cdc/users/5957e1ab3953455daa504c8a3836735d/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:49.759006 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cefc46-0197-4723-aad3-099c8e6cbd6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=29517a1e62d0497e8aaa61d568060cdc, user_id=5957e1ab3953455daa504c8a3836735d, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:49.761950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cefc46-0197-4723-aad3-099c8e6cbd6e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:49.793402 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1312/2647] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:56:49 2022] PUT /identity/v3/projects/29517a1e62d0497e8aaa61d568060cdc/users/5957e1ab3953455daa504c8a3836735d/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:56:49.795053 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff92d46-b635-4cb8-919a-1fd38d3efb20 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:49.826920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff92d46-b635-4cb8-919a-1fd38d3efb20 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:49.938044 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558d872-b43d-42b1-b2c1-7e1bf2012a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:49.940007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558d872-b43d-42b1-b2c1-7e1bf2012a53 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:49.940413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558d872-b43d-42b1-b2c1-7e1bf2012a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:49.942222 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558d872-b43d-42b1-b2c1-7e1bf2012a53 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:49.943401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558d872-b43d-42b1-b2c1-7e1bf2012a53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:49.945500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558d872-b43d-42b1-b2c1-7e1bf2012a53 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:49.961177 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1336/2648] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:56:49.962079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cefc46-0197-4723-aad3-099c8e6cbd6e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:49.986917 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cefc46-0197-4723-aad3-099c8e6cbd6e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:50.002018 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd0659-1dc5-4ae3-beb8-47073246b78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:50.002879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd0659-1dc5-4ae3-beb8-47073246b78a admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:50.003907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd0659-1dc5-4ae3-beb8-47073246b78a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:50.004284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd0659-1dc5-4ae3-beb8-47073246b78a admin admin] PATH_INFO: `/v3/projects/29517a1e62d0497e8aaa61d568060cdc/users/5957e1ab3953455daa504c8a3836735d/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:50.006559 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd0659-1dc5-4ae3-beb8-47073246b78a admin admin] RBAC: Authorizing `identity:create_grant(project_id=29517a1e62d0497e8aaa61d568060cdc, user_id=5957e1ab3953455daa504c8a3836735d, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:50.010142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd0659-1dc5-4ae3-beb8-47073246b78a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:50.055021 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5f837-2cfe-4a77-862d-c4cbb065c440 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:50.055429 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5f837-2cfe-4a77-862d-c4cbb065c440 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:50.055806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5f837-2cfe-4a77-862d-c4cbb065c440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:50.064384 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1313/2649] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:56:49 2022] PUT /identity/v3/projects/29517a1e62d0497e8aaa61d568060cdc/users/5957e1ab3953455daa504c8a3836735d/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:56:50.096177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-4ac5f837-2cfe-4a77-862d-c4cbb065c440 None None] MFA Rules not processed for user `5957e1ab3953455daa504c8a3836735d`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:56:50.098263 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4ac5f837-2cfe-4a77-862d-c4cbb065c440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:50.196091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:50.215555 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1337/2650] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:56:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:56:50.226846 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f53f45-af03-4663-b87b-3c02e53004b8 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:50.227258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f53f45-af03-4663-b87b-3c02e53004b8 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:50.227978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f53f45-af03-4663-b87b-3c02e53004b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:50.275497 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f1f53f45-af03-4663-b87b-3c02e53004b8 None None] MFA Rules not processed for user `ea7293bc4816483dbcd0f96536814d2c`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:56:50.282169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f1f53f45-af03-4663-b87b-3c02e53004b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:50.317522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:50.387533 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1314/2651] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:56:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:56:50.856828 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5f837-2cfe-4a77-862d-c4cbb065c440 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:50.859396 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4ac5f837-2cfe-4a77-862d-c4cbb065c440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:51.052338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5f837-2cfe-4a77-862d-c4cbb065c440 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:51.096219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774db35-ce22-45f2-bcef-f9b290db3ec3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:51.097801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774db35-ce22-45f2-bcef-f9b290db3ec3 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:51.098216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774db35-ce22-45f2-bcef-f9b290db3ec3 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:51.098506 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774db35-ce22-45f2-bcef-f9b290db3ec3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:51.147060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774db35-ce22-45f2-bcef-f9b290db3ec3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:51.161128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774db35-ce22-45f2-bcef-f9b290db3ec3 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:51.187160 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1338/2652] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:56:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:56:51.921065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a9674-92bf-443c-854b-acb4eb6f880d None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:51.922398 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a9674-92bf-443c-854b-acb4eb6f880d None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:51.923202 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a9674-92bf-443c-854b-acb4eb6f880d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:51.951567 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-967a9674-92bf-443c-854b-acb4eb6f880d None None] MFA Rules not processed for user `ea7293bc4816483dbcd0f96536814d2c`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:56:51.954233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-967a9674-92bf-443c-854b-acb4eb6f880d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:51.967682 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1315/2653] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:56:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:56:56.320486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774db35-ce22-45f2-bcef-f9b290db3ec3 service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:56.321302 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7774db35-ce22-45f2-bcef-f9b290db3ec3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:56.467781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774db35-ce22-45f2-bcef-f9b290db3ec3 service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:56.488739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e7bd6-c9aa-4f1f-a47b-3e6e6d815c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:56.489488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e7bd6-c9aa-4f1f-a47b-3e6e6d815c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:56.489993 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e7bd6-c9aa-4f1f-a47b-3e6e6d815c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:56.490353 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e7bd6-c9aa-4f1f-a47b-3e6e6d815c13 admin admin] PATH_INFO: `/v3/users/728d7aea2ff1421fa55a511ef098536f` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:56.494580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e7bd6-c9aa-4f1f-a47b-3e6e6d815c13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=728d7aea2ff1421fa55a511ef098536f)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:56.496795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e7bd6-c9aa-4f1f-a47b-3e6e6d815c13 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:56.626393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d40e7bd6-c9aa-4f1f-a47b-3e6e6d815c13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '728d7aea2ff1421fa55a511ef098536f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:56.644729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d40e7bd6-c9aa-4f1f-a47b-3e6e6d815c13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '728d7aea2ff1421fa55a511ef098536f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:56.645764 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d40e7bd6-c9aa-4f1f-a47b-3e6e6d815c13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '728d7aea2ff1421fa55a511ef098536f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:56.646341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d40e7bd6-c9aa-4f1f-a47b-3e6e6d815c13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '728d7aea2ff1421fa55a511ef098536f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:56.662147 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d40e7bd6-c9aa-4f1f-a47b-3e6e6d815c13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '728d7aea2ff1421fa55a511ef098536f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:56.684052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:56.693174 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1339/2654] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:56:56 2022] DELETE /identity/v3/users/728d7aea2ff1421fa55a511ef098536f => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:56:56.697791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829776e6-cbba-4ca5-9cc4-1a6fdfeba5a4 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:56.698888 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829776e6-cbba-4ca5-9cc4-1a6fdfeba5a4 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:56.699400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829776e6-cbba-4ca5-9cc4-1a6fdfeba5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:56.743317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-829776e6-cbba-4ca5-9cc4-1a6fdfeba5a4 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:56:56.745225 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-829776e6-cbba-4ca5-9cc4-1a6fdfeba5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:56.924594 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1316/2655] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:56:56.960865 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e7bd6-c9aa-4f1f-a47b-3e6e6d815c13 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:56.962726 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d40e7bd6-c9aa-4f1f-a47b-3e6e6d815c13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:57.118052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e7bd6-c9aa-4f1f-a47b-3e6e6d815c13 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:57.124147 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bac7ad-71c8-4d0f-a133-6e0e01136b20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:57.125008 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bac7ad-71c8-4d0f-a133-6e0e01136b20 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:57.125487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bac7ad-71c8-4d0f-a133-6e0e01136b20 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:57.125885 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bac7ad-71c8-4d0f-a133-6e0e01136b20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:57.139012 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bac7ad-71c8-4d0f-a133-6e0e01136b20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:57.142576 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bac7ad-71c8-4d0f-a133-6e0e01136b20 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:57.172425 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1340/2656] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:56:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:56:57.502008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829776e6-cbba-4ca5-9cc4-1a6fdfeba5a4 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:57.503651 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-829776e6-cbba-4ca5-9cc4-1a6fdfeba5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:57.525015 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829776e6-cbba-4ca5-9cc4-1a6fdfeba5a4 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:57.545206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b7235-fcca-4fc0-9bd2-7cd06bc9de85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:57.546055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b7235-fcca-4fc0-9bd2-7cd06bc9de85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:57.546238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b7235-fcca-4fc0-9bd2-7cd06bc9de85 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:57.546633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b7235-fcca-4fc0-9bd2-7cd06bc9de85 admin admin] PATH_INFO: `/v3/projects/ae18d1a9386b473098b3f37f92f6da8f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:57.548996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b7235-fcca-4fc0-9bd2-7cd06bc9de85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae18d1a9386b473098b3f37f92f6da8f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:57.559454 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b7235-fcca-4fc0-9bd2-7cd06bc9de85 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:57.625361 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e81b7235-fcca-4fc0-9bd2-7cd06bc9de85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae18d1a9386b473098b3f37f92f6da8f', 'request_id': 'req-e81b7235-fcca-4fc0-9bd2-7cd06bc9de85'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:57.632944 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e81b7235-fcca-4fc0-9bd2-7cd06bc9de85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae18d1a9386b473098b3f37f92f6da8f', 'request_id': 'req-e81b7235-fcca-4fc0-9bd2-7cd06bc9de85'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:57.640449 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e81b7235-fcca-4fc0-9bd2-7cd06bc9de85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae18d1a9386b473098b3f37f92f6da8f', 'request_id': 'req-e81b7235-fcca-4fc0-9bd2-7cd06bc9de85'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:57.656137 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e81b7235-fcca-4fc0-9bd2-7cd06bc9de85 admin admin] The token cache is being invalidate because project ae18d1a9386b473098b3f37f92f6da8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:56:57.656431 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e81b7235-fcca-4fc0-9bd2-7cd06bc9de85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:57.657063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e81b7235-fcca-4fc0-9bd2-7cd06bc9de85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:57.658815 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1317/2657] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:57 2022] DELETE /identity/v3/projects/ae18d1a9386b473098b3f37f92f6da8f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:56:57.677736 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bac7ad-71c8-4d0f-a133-6e0e01136b20 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:57.688089 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bac7ad-71c8-4d0f-a133-6e0e01136b20 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:57.754694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debe33c-77db-438e-b0f4-93768abd69b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:57.755334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debe33c-77db-438e-b0f4-93768abd69b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:57.755627 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debe33c-77db-438e-b0f4-93768abd69b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:57.755890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debe33c-77db-438e-b0f4-93768abd69b5 admin admin] PATH_INFO: `/v3/users/650d7786cf8a47f3854fabd98285f5ca` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:57.757011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8debe33c-77db-438e-b0f4-93768abd69b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=650d7786cf8a47f3854fabd98285f5ca)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:57.758972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8debe33c-77db-438e-b0f4-93768abd69b5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:57.806234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8debe33c-77db-438e-b0f4-93768abd69b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '650d7786cf8a47f3854fabd98285f5ca'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:57.813302 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8debe33c-77db-438e-b0f4-93768abd69b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '650d7786cf8a47f3854fabd98285f5ca'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:57.814007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8debe33c-77db-438e-b0f4-93768abd69b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '650d7786cf8a47f3854fabd98285f5ca'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:57.814764 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8debe33c-77db-438e-b0f4-93768abd69b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '650d7786cf8a47f3854fabd98285f5ca'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:57.823496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8debe33c-77db-438e-b0f4-93768abd69b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '650d7786cf8a47f3854fabd98285f5ca'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:57.842894 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1341/2658] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:56:57 2022] DELETE /identity/v3/users/650d7786cf8a47f3854fabd98285f5ca => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:56:58.147295 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b7235-fcca-4fc0-9bd2-7cd06bc9de85 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:58.149677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e81b7235-fcca-4fc0-9bd2-7cd06bc9de85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:58.165809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b7235-fcca-4fc0-9bd2-7cd06bc9de85 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:58.278654 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:58.310309 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173aede2-a5fa-4e2a-b495-206004e89e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:58.311291 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173aede2-a5fa-4e2a-b495-206004e89e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:58.311753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173aede2-a5fa-4e2a-b495-206004e89e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:58.313385 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173aede2-a5fa-4e2a-b495-206004e89e81 admin admin] PATH_INFO: `/v3/projects/78d3bd3100674e1b99638cc8fccbf97b` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:58.314828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173aede2-a5fa-4e2a-b495-206004e89e81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78d3bd3100674e1b99638cc8fccbf97b)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:58.318082 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173aede2-a5fa-4e2a-b495-206004e89e81 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:58.441751 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-173aede2-a5fa-4e2a-b495-206004e89e81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78d3bd3100674e1b99638cc8fccbf97b', 'request_id': 'req-173aede2-a5fa-4e2a-b495-206004e89e81'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:58.451142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-173aede2-a5fa-4e2a-b495-206004e89e81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78d3bd3100674e1b99638cc8fccbf97b', 'request_id': 'req-173aede2-a5fa-4e2a-b495-206004e89e81'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:58.461626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-173aede2-a5fa-4e2a-b495-206004e89e81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78d3bd3100674e1b99638cc8fccbf97b', 'request_id': 'req-173aede2-a5fa-4e2a-b495-206004e89e81'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:58.488929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-173aede2-a5fa-4e2a-b495-206004e89e81 admin admin] The token cache is being invalidate because project 78d3bd3100674e1b99638cc8fccbf97b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:56:58.489219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-173aede2-a5fa-4e2a-b495-206004e89e81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:58.489888 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-173aede2-a5fa-4e2a-b495-206004e89e81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:56:58.494603 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1318/2659] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:58 2022] DELETE /identity/v3/projects/78d3bd3100674e1b99638cc8fccbf97b => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:56:58.505809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a565e-a7ee-4c93-8642-f7f6416e5f70 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:58.506127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a565e-a7ee-4c93-8642-f7f6416e5f70 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:58.506676 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a565e-a7ee-4c93-8642-f7f6416e5f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:58.541250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-448a565e-a7ee-4c93-8642-f7f6416e5f70 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:56:58.544009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-448a565e-a7ee-4c93-8642-f7f6416e5f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:58.564663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:58.637411 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1342/2660] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:56:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:56:58.645972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735ffd7-65df-4f2d-9bb0-f2ec4411e0f7 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:58.645972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735ffd7-65df-4f2d-9bb0-f2ec4411e0f7 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:58.645972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735ffd7-65df-4f2d-9bb0-f2ec4411e0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:58.683140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-e735ffd7-65df-4f2d-9bb0-f2ec4411e0f7 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:56:58.684381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e735ffd7-65df-4f2d-9bb0-f2ec4411e0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:58.700613 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1319/2661] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:56:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:56:58.702584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a565e-a7ee-4c93-8642-f7f6416e5f70 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:58.714152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a565e-a7ee-4c93-8642-f7f6416e5f70 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:58.719403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e17b28-63ba-49ad-98d7-5412a4a0768e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:58.720029 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e17b28-63ba-49ad-98d7-5412a4a0768e admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:58.721038 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e17b28-63ba-49ad-98d7-5412a4a0768e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:58.722116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e17b28-63ba-49ad-98d7-5412a4a0768e admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:58.723165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e17b28-63ba-49ad-98d7-5412a4a0768e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:56:58.723509 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e17b28-63ba-49ad-98d7-5412a4a0768e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:58.725366 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e17b28-63ba-49ad-98d7-5412a4a0768e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:58.743499 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1343/2662] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:56:58.747399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735ffd7-65df-4f2d-9bb0-f2ec4411e0f7 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:58.761231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735ffd7-65df-4f2d-9bb0-f2ec4411e0f7 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:58.767807 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189a0ec-0e7c-4d47-9429-1e9d5d1c1de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:58.769213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189a0ec-0e7c-4d47-9429-1e9d5d1c1de8 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:58.769896 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189a0ec-0e7c-4d47-9429-1e9d5d1c1de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:58.770354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189a0ec-0e7c-4d47-9429-1e9d5d1c1de8 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:58.771229 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c189a0ec-0e7c-4d47-9429-1e9d5d1c1de8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:58.773381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c189a0ec-0e7c-4d47-9429-1e9d5d1c1de8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:58.837830 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e17b28-63ba-49ad-98d7-5412a4a0768e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:58.838391 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1320/2663] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:56:58 2022] POST /identity/v3/projects => generated 393 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:56:58.855897 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e17b28-63ba-49ad-98d7-5412a4a0768e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:58.946188 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ad688-b074-4f73-bc83-1d08ad8ba387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:58.947249 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ad688-b074-4f73-bc83-1d08ad8ba387 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:58.947604 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ad688-b074-4f73-bc83-1d08ad8ba387 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:58.947952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ad688-b074-4f73-bc83-1d08ad8ba387 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:58.948649 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ad688-b074-4f73-bc83-1d08ad8ba387 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:58.950841 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ad688-b074-4f73-bc83-1d08ad8ba387 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:58.977848 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1344/2664] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:56:58 2022] POST /identity/v3/users => generated 297 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:56:58.979203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189a0ec-0e7c-4d47-9429-1e9d5d1c1de8 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:58.990922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189a0ec-0e7c-4d47-9429-1e9d5d1c1de8 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:58.996119 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09839c39-2061-496b-8462-0a1633e724a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:58.996966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09839c39-2061-496b-8462-0a1633e724a5 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:58.997623 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09839c39-2061-496b-8462-0a1633e724a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:58.997623 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09839c39-2061-496b-8462-0a1633e724a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:58.998300 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09839c39-2061-496b-8462-0a1633e724a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:59.000133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09839c39-2061-496b-8462-0a1633e724a5 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:59.012661 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1321/2665] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:56:59.016570 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ad688-b074-4f73-bc83-1d08ad8ba387 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:59.031011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ad688-b074-4f73-bc83-1d08ad8ba387 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:59.037559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bfa6a7-d119-4396-a79e-6fdf1e644a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:59.038617 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfa6a7-d119-4396-a79e-6fdf1e644a70 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:59.038859 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfa6a7-d119-4396-a79e-6fdf1e644a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:59.039689 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfa6a7-d119-4396-a79e-6fdf1e644a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:59.040586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bfa6a7-d119-4396-a79e-6fdf1e644a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:59.042467 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bfa6a7-d119-4396-a79e-6fdf1e644a70 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:59.057221 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1345/2666] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:56:59.061278 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09839c39-2061-496b-8462-0a1633e724a5 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:59.077929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09839c39-2061-496b-8462-0a1633e724a5 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:59.085267 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646893a-1116-4260-9429-ffc87042060f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:59.086492 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646893a-1116-4260-9429-ffc87042060f admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:59.087026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646893a-1116-4260-9429-ffc87042060f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:59.087516 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646893a-1116-4260-9429-ffc87042060f admin admin] PATH_INFO: `/v3/projects/61b980ff8dca4c84bb452d09d55c37ef/users/46557175a8504db78843b5d56b1413cf/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:59.108513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2646893a-1116-4260-9429-ffc87042060f admin admin] RBAC: Authorizing `identity:create_grant(project_id=61b980ff8dca4c84bb452d09d55c37ef, user_id=46557175a8504db78843b5d56b1413cf, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:59.113722 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2646893a-1116-4260-9429-ffc87042060f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:59.159246 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1322/2667] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:56:59 2022] PUT /identity/v3/projects/61b980ff8dca4c84bb452d09d55c37ef/users/46557175a8504db78843b5d56b1413cf/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:56:59.223891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a3c4d-9379-4ef0-a5a0-005f0a61fae0 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:59.224134 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a3c4d-9379-4ef0-a5a0-005f0a61fae0 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:59.224601 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a3c4d-9379-4ef0-a5a0-005f0a61fae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:59.289944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-248a3c4d-9379-4ef0-a5a0-005f0a61fae0 None None] MFA Rules not processed for user `46557175a8504db78843b5d56b1413cf`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:56:59.294639 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-248a3c4d-9379-4ef0-a5a0-005f0a61fae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:59.319364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b159a1-bdd9-4fd0-9beb-a1586eb154a5 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:59.319364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b159a1-bdd9-4fd0-9beb-a1586eb154a5 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:59.319643 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b159a1-bdd9-4fd0-9beb-a1586eb154a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:59.373095 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-22b159a1-bdd9-4fd0-9beb-a1586eb154a5 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:56:59.376119 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-22b159a1-bdd9-4fd0-9beb-a1586eb154a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:59.467991 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1346/2668] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:56:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:56:59.475379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a3c4d-9379-4ef0-a5a0-005f0a61fae0 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:59.530717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:59.553925 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1323/2669] 10.222.0.33 () {58 vars in 967 bytes} [Sat Aug 6 20:56:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:56:59.569867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b159a1-bdd9-4fd0-9beb-a1586eb154a5 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:59.571670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-22b159a1-bdd9-4fd0-9beb-a1586eb154a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:59.615955 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:59.690590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a3c4d-9379-4ef0-a5a0-005f0a61fae0 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:59.703243 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66669e-6460-4000-b898-d8cce99c6634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:59.703915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66669e-6460-4000-b898-d8cce99c6634 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:59.704275 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66669e-6460-4000-b898-d8cce99c6634 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:59.704612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66669e-6460-4000-b898-d8cce99c6634 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:59.706479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66669e-6460-4000-b898-d8cce99c6634 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:59.706648 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b159a1-bdd9-4fd0-9beb-a1586eb154a5 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:59.712141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66669e-6460-4000-b898-d8cce99c6634 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:59.713486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6616929-808c-4fc3-94f9-59f1b88c207d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:59.714477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6616929-808c-4fc3-94f9-59f1b88c207d service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:59.714794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6616929-808c-4fc3-94f9-59f1b88c207d service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:59.715071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6616929-808c-4fc3-94f9-59f1b88c207d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:59.726618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6616929-808c-4fc3-94f9-59f1b88c207d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:59.728450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6616929-808c-4fc3-94f9-59f1b88c207d service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:59.755445 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1324/2670] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 20:56:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 20:56:59.806780 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1347/2671] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:56:59 2022] POST /identity/v3/projects => generated 393 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:56:59.808188 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6616929-808c-4fc3-94f9-59f1b88c207d service swift] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:59.828086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6616929-808c-4fc3-94f9-59f1b88c207d service swift] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:59.980840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351de0da-d3f2-4cd1-a4bb-9370c751c04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:59.981474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351de0da-d3f2-4cd1-a4bb-9370c751c04c admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:59.982308 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351de0da-d3f2-4cd1-a4bb-9370c751c04c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:59.982945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351de0da-d3f2-4cd1-a4bb-9370c751c04c admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:59.983914 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351de0da-d3f2-4cd1-a4bb-9370c751c04c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:59.988299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351de0da-d3f2-4cd1-a4bb-9370c751c04c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:00.068570 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1325/2672] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:56:59 2022] POST /identity/v3/users => generated 303 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:57:00.070963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66669e-6460-4000-b898-d8cce99c6634 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:00.089842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66669e-6460-4000-b898-d8cce99c6634 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:00.118112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02276e-a0ca-4191-92d1-d529e70d462f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:00.119564 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02276e-a0ca-4191-92d1-d529e70d462f admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:00.119564 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02276e-a0ca-4191-92d1-d529e70d462f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:00.119564 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02276e-a0ca-4191-92d1-d529e70d462f admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:00.119975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02276e-a0ca-4191-92d1-d529e70d462f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:00.123617 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02276e-a0ca-4191-92d1-d529e70d462f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:00.160684 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1348/2673] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:57:00.162279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351de0da-d3f2-4cd1-a4bb-9370c751c04c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:00.178197 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351de0da-d3f2-4cd1-a4bb-9370c751c04c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:00.201056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8bea7-f7e1-42f7-b5af-533fe4f828e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:00.205009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8bea7-f7e1-42f7-b5af-533fe4f828e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:00.206729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8bea7-f7e1-42f7-b5af-533fe4f828e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:00.208358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8bea7-f7e1-42f7-b5af-533fe4f828e8 admin admin] PATH_INFO: `/v3/projects/eb76102372d64079b3571e92331e77ae/users/7004eb9df0824403a47f7b26d5eaf89c/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:00.252243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8bea7-f7e1-42f7-b5af-533fe4f828e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb76102372d64079b3571e92331e77ae, user_id=7004eb9df0824403a47f7b26d5eaf89c, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:00.259560 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8bea7-f7e1-42f7-b5af-533fe4f828e8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:00.291905 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1326/2674] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:57:00 2022] PUT /identity/v3/projects/eb76102372d64079b3571e92331e77ae/users/7004eb9df0824403a47f7b26d5eaf89c/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:57:00.295848 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02276e-a0ca-4191-92d1-d529e70d462f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:00.312819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02276e-a0ca-4191-92d1-d529e70d462f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:00.403963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e0c49-386b-4be7-9c71-08c0ad54474c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:00.404619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e0c49-386b-4be7-9c71-08c0ad54474c admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:00.404907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e0c49-386b-4be7-9c71-08c0ad54474c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:00.405180 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e0c49-386b-4be7-9c71-08c0ad54474c admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:00.405821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e0c49-386b-4be7-9c71-08c0ad54474c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:00.408483 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e0c49-386b-4be7-9c71-08c0ad54474c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:00.421163 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1349/2675] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:57:00.429395 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8bea7-f7e1-42f7-b5af-533fe4f828e8 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:00.442127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8bea7-f7e1-42f7-b5af-533fe4f828e8 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:00.447695 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e2ef8-f4da-4931-ad62-41af64df4079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:00.448371 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e2ef8-f4da-4931-ad62-41af64df4079 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:00.448797 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e2ef8-f4da-4931-ad62-41af64df4079 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:00.449122 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e2ef8-f4da-4931-ad62-41af64df4079 admin admin] PATH_INFO: `/v3/projects/eb76102372d64079b3571e92331e77ae/users/7004eb9df0824403a47f7b26d5eaf89c/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:00.451348 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248e2ef8-f4da-4931-ad62-41af64df4079 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb76102372d64079b3571e92331e77ae, user_id=7004eb9df0824403a47f7b26d5eaf89c, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:00.455064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248e2ef8-f4da-4931-ad62-41af64df4079 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:00.490841 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1327/2676] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:57:00 2022] PUT /identity/v3/projects/eb76102372d64079b3571e92331e77ae/users/7004eb9df0824403a47f7b26d5eaf89c/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:57:00.501803 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb22cec-1cd5-4c00-9007-c71122d8b222 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:00.502088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb22cec-1cd5-4c00-9007-c71122d8b222 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:00.502493 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb22cec-1cd5-4c00-9007-c71122d8b222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:00.542839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-9fb22cec-1cd5-4c00-9007-c71122d8b222 None None] MFA Rules not processed for user `7004eb9df0824403a47f7b26d5eaf89c`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:57:00.544903 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9fb22cec-1cd5-4c00-9007-c71122d8b222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:00.641802 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1350/2677] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:57:00 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:57:00.653973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616e03f-50f0-46fa-9040-ba3d0a6d9bed None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:00.654455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616e03f-50f0-46fa-9040-ba3d0a6d9bed None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:00.654893 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616e03f-50f0-46fa-9040-ba3d0a6d9bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:00.692248 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-1616e03f-50f0-46fa-9040-ba3d0a6d9bed None None] MFA Rules not processed for user `46557175a8504db78843b5d56b1413cf`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:57:00.693780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1616e03f-50f0-46fa-9040-ba3d0a6d9bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:00.761114 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1328/2678] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:57:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:57:01.046419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb22cec-1cd5-4c00-9007-c71122d8b222 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:01.048276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9fb22cec-1cd5-4c00-9007-c71122d8b222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:01.064126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:01.128468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb22cec-1cd5-4c00-9007-c71122d8b222 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:01.133981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f89b8-e62e-4497-9e66-4e7c293dba5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:01.134605 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f89b8-e62e-4497-9e66-4e7c293dba5c service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:01.134888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f89b8-e62e-4497-9e66-4e7c293dba5c service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:01.135157 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f89b8-e62e-4497-9e66-4e7c293dba5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:01.143406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f89b8-e62e-4497-9e66-4e7c293dba5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:01.145036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f89b8-e62e-4497-9e66-4e7c293dba5c service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:01.154515 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1351/2679] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:57:01 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:57:07.035460 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616e03f-50f0-46fa-9040-ba3d0a6d9bed None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:07.037871 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1616e03f-50f0-46fa-9040-ba3d0a6d9bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:07.045993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:07.181405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616e03f-50f0-46fa-9040-ba3d0a6d9bed None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:07.187821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675e718-c81b-4d6e-b7b5-1912c8707f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:07.188177 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675e718-c81b-4d6e-b7b5-1912c8707f07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:07.188354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675e718-c81b-4d6e-b7b5-1912c8707f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:07.188668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675e718-c81b-4d6e-b7b5-1912c8707f07 admin admin] PATH_INFO: `/v3/users/096b2f40a81a4627af9ae5c7b83fc619` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:07.190049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4675e718-c81b-4d6e-b7b5-1912c8707f07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=096b2f40a81a4627af9ae5c7b83fc619)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:07.193079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4675e718-c81b-4d6e-b7b5-1912c8707f07 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:07.326589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4675e718-c81b-4d6e-b7b5-1912c8707f07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '096b2f40a81a4627af9ae5c7b83fc619'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:07.327485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4675e718-c81b-4d6e-b7b5-1912c8707f07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '096b2f40a81a4627af9ae5c7b83fc619'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:07.330844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4675e718-c81b-4d6e-b7b5-1912c8707f07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '096b2f40a81a4627af9ae5c7b83fc619'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:07.346719 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4675e718-c81b-4d6e-b7b5-1912c8707f07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '096b2f40a81a4627af9ae5c7b83fc619'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:07.371520 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4675e718-c81b-4d6e-b7b5-1912c8707f07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '096b2f40a81a4627af9ae5c7b83fc619'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:07.407117 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1329/2680] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:57:07 2022] DELETE /identity/v3/users/096b2f40a81a4627af9ae5c7b83fc619 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:57:07.409367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3fdc6-5b4f-4b04-987d-c614de2ad1ae None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:07.410019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3fdc6-5b4f-4b04-987d-c614de2ad1ae None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:07.410019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3fdc6-5b4f-4b04-987d-c614de2ad1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:07.437007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-39b3fdc6-5b4f-4b04-987d-c614de2ad1ae None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:57:07.439079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-39b3fdc6-5b4f-4b04-987d-c614de2ad1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:07.531187 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1352/2681] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:57:07.559471 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675e718-c81b-4d6e-b7b5-1912c8707f07 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:07.563378 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4675e718-c81b-4d6e-b7b5-1912c8707f07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:07.684316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675e718-c81b-4d6e-b7b5-1912c8707f07 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:07.688487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6a301-62f7-4088-89d7-e6066cd4191e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:07.689183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6a301-62f7-4088-89d7-e6066cd4191e service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:07.689519 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6a301-62f7-4088-89d7-e6066cd4191e service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:07.689969 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6a301-62f7-4088-89d7-e6066cd4191e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:07.715887 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f6a301-62f7-4088-89d7-e6066cd4191e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:07.717668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f6a301-62f7-4088-89d7-e6066cd4191e service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:07.730329 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1330/2682] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:57:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:57:08.372772 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3fdc6-5b4f-4b04-987d-c614de2ad1ae None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:08.375836 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-39b3fdc6-5b4f-4b04-987d-c614de2ad1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:08.392509 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3fdc6-5b4f-4b04-987d-c614de2ad1ae None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:08.401312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62988bf-e31b-489f-a866-8a9b8bc69af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:08.402598 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62988bf-e31b-489f-a866-8a9b8bc69af2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:08.402985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62988bf-e31b-489f-a866-8a9b8bc69af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:08.403345 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62988bf-e31b-489f-a866-8a9b8bc69af2 admin admin] PATH_INFO: `/v3/projects/7397d6b602604e2caa60f16aee28c950` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:08.405411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62988bf-e31b-489f-a866-8a9b8bc69af2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7397d6b602604e2caa60f16aee28c950)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:08.410236 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62988bf-e31b-489f-a866-8a9b8bc69af2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:08.531929 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f62988bf-e31b-489f-a866-8a9b8bc69af2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7397d6b602604e2caa60f16aee28c950', 'request_id': 'req-f62988bf-e31b-489f-a866-8a9b8bc69af2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:08.537931 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f62988bf-e31b-489f-a866-8a9b8bc69af2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7397d6b602604e2caa60f16aee28c950', 'request_id': 'req-f62988bf-e31b-489f-a866-8a9b8bc69af2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:08.547782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f62988bf-e31b-489f-a866-8a9b8bc69af2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7397d6b602604e2caa60f16aee28c950', 'request_id': 'req-f62988bf-e31b-489f-a866-8a9b8bc69af2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:08.559844 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f62988bf-e31b-489f-a866-8a9b8bc69af2 admin admin] The token cache is being invalidate because project 7397d6b602604e2caa60f16aee28c950 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:57:08.560133 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f62988bf-e31b-489f-a866-8a9b8bc69af2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:08.560802 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f62988bf-e31b-489f-a866-8a9b8bc69af2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:08.562339 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1353/2683] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:57:08 2022] DELETE /identity/v3/projects/7397d6b602604e2caa60f16aee28c950 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:57:08.568253 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8954cf9-6fd8-457c-b9e5-955a83862533 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:08.568739 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8954cf9-6fd8-457c-b9e5-955a83862533 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:08.568822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8954cf9-6fd8-457c-b9e5-955a83862533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:08.588160 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-e8954cf9-6fd8-457c-b9e5-955a83862533 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:57:08.589283 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e8954cf9-6fd8-457c-b9e5-955a83862533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:08.609864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:08.655002 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1331/2684] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:57:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:57:08.675933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aae122-21cc-40b6-91a3-9c88f98afe9a None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:08.676241 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aae122-21cc-40b6-91a3-9c88f98afe9a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:08.676486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aae122-21cc-40b6-91a3-9c88f98afe9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:08.704886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a0aae122-21cc-40b6-91a3-9c88f98afe9a None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:57:08.706596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a0aae122-21cc-40b6-91a3-9c88f98afe9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:08.718591 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1354/2685] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:57:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:57:08.731259 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8954cf9-6fd8-457c-b9e5-955a83862533 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:08.745759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8954cf9-6fd8-457c-b9e5-955a83862533 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:08.751632 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a77e9a-7a87-48b1-abd0-cdb08980722a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:08.754086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a77e9a-7a87-48b1-abd0-cdb08980722a admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:08.754472 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a77e9a-7a87-48b1-abd0-cdb08980722a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:08.755257 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a77e9a-7a87-48b1-abd0-cdb08980722a admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:08.756614 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a77e9a-7a87-48b1-abd0-cdb08980722a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:57:08.757330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a77e9a-7a87-48b1-abd0-cdb08980722a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:08.759251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a77e9a-7a87-48b1-abd0-cdb08980722a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:08.779861 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1332/2686] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:57:08.781268 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aae122-21cc-40b6-91a3-9c88f98afe9a None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:08.792069 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aae122-21cc-40b6-91a3-9c88f98afe9a None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:08.798063 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1501a-a5b0-4984-b69e-b0e4b3cf973a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:08.799234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1501a-a5b0-4984-b69e-b0e4b3cf973a admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:08.799520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1501a-a5b0-4984-b69e-b0e4b3cf973a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:08.799785 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1501a-a5b0-4984-b69e-b0e4b3cf973a admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:08.800673 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf1501a-a5b0-4984-b69e-b0e4b3cf973a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:08.802383 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf1501a-a5b0-4984-b69e-b0e4b3cf973a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:08.817464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:08.838794 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1355/2687] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:57:08 2022] POST /identity/v3/projects => generated 381 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:57:08.843115 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a77e9a-7a87-48b1-abd0-cdb08980722a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:08.856147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a77e9a-7a87-48b1-abd0-cdb08980722a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:08.944963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9e7a1-5c0b-4d8b-b403-a79336bf58a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:08.948301 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9e7a1-5c0b-4d8b-b403-a79336bf58a9 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:08.948301 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9e7a1-5c0b-4d8b-b403-a79336bf58a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:08.948301 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9e7a1-5c0b-4d8b-b403-a79336bf58a9 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:08.948301 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a9e7a1-5c0b-4d8b-b403-a79336bf58a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:08.949559 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a9e7a1-5c0b-4d8b-b403-a79336bf58a9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:08.982127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1501a-a5b0-4984-b69e-b0e4b3cf973a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:08.982516 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1333/2688] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:57:08 2022] POST /identity/v3/users => generated 291 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:57:08.993721 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1501a-a5b0-4984-b69e-b0e4b3cf973a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:08.999257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc616bf-f0a5-4ca2-9009-ca268832735a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:08.999365 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc616bf-f0a5-4ca2-9009-ca268832735a admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:08.999730 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc616bf-f0a5-4ca2-9009-ca268832735a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:09.006574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc616bf-f0a5-4ca2-9009-ca268832735a admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:09.007204 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc616bf-f0a5-4ca2-9009-ca268832735a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:09.008828 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc616bf-f0a5-4ca2-9009-ca268832735a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:09.022132 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1356/2689] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:57:09.026529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9e7a1-5c0b-4d8b-b403-a79336bf58a9 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:09.037729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9e7a1-5c0b-4d8b-b403-a79336bf58a9 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:09.044881 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eab0d8-a4ee-4e88-93c4-1790f6a53f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:09.046107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eab0d8-a4ee-4e88-93c4-1790f6a53f58 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:09.046395 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eab0d8-a4ee-4e88-93c4-1790f6a53f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:09.046695 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eab0d8-a4ee-4e88-93c4-1790f6a53f58 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:09.047540 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eab0d8-a4ee-4e88-93c4-1790f6a53f58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:09.049284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eab0d8-a4ee-4e88-93c4-1790f6a53f58 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:09.063348 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1334/2690] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:57:09.068720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc616bf-f0a5-4ca2-9009-ca268832735a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:09.089973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc616bf-f0a5-4ca2-9009-ca268832735a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:09.089973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb00c8b-d19d-4f62-acb4-58dc4b3272ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:09.089973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb00c8b-d19d-4f62-acb4-58dc4b3272ee admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:09.089973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb00c8b-d19d-4f62-acb4-58dc4b3272ee admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:09.090458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb00c8b-d19d-4f62-acb4-58dc4b3272ee admin admin] PATH_INFO: `/v3/projects/690e571b106a4305977f2d9166a4433e/users/3df9834cd3164d72a4bbd4d71d35df96/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:09.107920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb00c8b-d19d-4f62-acb4-58dc4b3272ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=690e571b106a4305977f2d9166a4433e, user_id=3df9834cd3164d72a4bbd4d71d35df96, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:09.110654 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb00c8b-d19d-4f62-acb4-58dc4b3272ee admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:09.126161 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1357/2691] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:57:09 2022] PUT /identity/v3/projects/690e571b106a4305977f2d9166a4433e/users/3df9834cd3164d72a4bbd4d71d35df96/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:57:09.131704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35f90c-c873-4b55-bc71-731d70581e64 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:09.132086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35f90c-c873-4b55-bc71-731d70581e64 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:09.132505 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35f90c-c873-4b55-bc71-731d70581e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:09.153105 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-5e35f90c-c873-4b55-bc71-731d70581e64 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:57:09.154311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5e35f90c-c873-4b55-bc71-731d70581e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:09.224057 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1335/2692] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:57:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:57:09.233607 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb00c8b-d19d-4f62-acb4-58dc4b3272ee admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:09.235427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-adb00c8b-d19d-4f62-acb4-58dc4b3272ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:09.298807 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb00c8b-d19d-4f62-acb4-58dc4b3272ee admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:09.303087 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee577cf-b38b-43af-88d2-c5425687397a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:09.303818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee577cf-b38b-43af-88d2-c5425687397a service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:09.304160 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee577cf-b38b-43af-88d2-c5425687397a service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:09.304604 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee577cf-b38b-43af-88d2-c5425687397a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:09.325410 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee577cf-b38b-43af-88d2-c5425687397a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:09.327547 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee577cf-b38b-43af-88d2-c5425687397a service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:09.342537 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1358/2693] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:57:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:57:13.270693 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9fe79-350e-4fa6-9fc6-a79e7ef1964d None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:13.271569 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9fe79-350e-4fa6-9fc6-a79e7ef1964d None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:13.272002 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9fe79-350e-4fa6-9fc6-a79e7ef1964d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:13.331721 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d0d9fe79-350e-4fa6-9fc6-a79e7ef1964d None None] MFA Rules not processed for user `ea7293bc4816483dbcd0f96536814d2c`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:57:13.332963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d0d9fe79-350e-4fa6-9fc6-a79e7ef1964d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:13.405725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:13.487817 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1336/2694] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:57:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:57:15.169002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815f35e-db56-4d41-bfb5-7a9484ecb350 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:15.170217 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815f35e-db56-4d41-bfb5-7a9484ecb350 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:15.170751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815f35e-db56-4d41-bfb5-7a9484ecb350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:15.211014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-5815f35e-db56-4d41-bfb5-7a9484ecb350 None None] MFA Rules not processed for user `dff69a9a061a454685cfc57c1675f4b9`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:57:15.214189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5815f35e-db56-4d41-bfb5-7a9484ecb350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:15.311322 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1359/2695] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:57:15 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:57:17.259573 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9789941-985c-4c82-a419-68f0e565dacc None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:17.260581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9789941-985c-4c82-a419-68f0e565dacc None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:17.261008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9789941-985c-4c82-a419-68f0e565dacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:17.320572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a9789941-985c-4c82-a419-68f0e565dacc None None] MFA Rules not processed for user `3df9834cd3164d72a4bbd4d71d35df96`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:57:17.321881 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a9789941-985c-4c82-a419-68f0e565dacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:17.413939 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1337/2696] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:57:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:57:17.504970 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815f35e-db56-4d41-bfb5-7a9484ecb350 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:17.507056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5815f35e-db56-4d41-bfb5-7a9484ecb350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:17.608488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:17.616932 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815f35e-db56-4d41-bfb5-7a9484ecb350 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:17.625950 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe38b9-322f-4cd5-bbe1-04159ca47adc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:17.627807 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe38b9-322f-4cd5-bbe1-04159ca47adc service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:17.628091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe38b9-322f-4cd5-bbe1-04159ca47adc service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:17.628366 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe38b9-322f-4cd5-bbe1-04159ca47adc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:17.647584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe38b9-322f-4cd5-bbe1-04159ca47adc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:17.649205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe38b9-322f-4cd5-bbe1-04159ca47adc service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:17.677528 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1360/2697] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:57:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:57:18.935191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e6c57-f813-4f5d-a1e7-4611873e3708 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:18.935727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e6c57-f813-4f5d-a1e7-4611873e3708 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:18.935937 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e6c57-f813-4f5d-a1e7-4611873e3708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:18.988554 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-107e6c57-f813-4f5d-a1e7-4611873e3708 None None] MFA Rules not processed for user `3df9834cd3164d72a4bbd4d71d35df96`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:57:18.988554 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-107e6c57-f813-4f5d-a1e7-4611873e3708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:19.021963 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1338/2698] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:57:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:57:20.365790 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe38b9-322f-4cd5-bbe1-04159ca47adc service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:20.367969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-72fe38b9-322f-4cd5-bbe1-04159ca47adc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:20.395052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe38b9-322f-4cd5-bbe1-04159ca47adc service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:20.404441 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086e516-cf67-4e7e-801e-d1f85f0d9ec8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:20.405305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086e516-cf67-4e7e-801e-d1f85f0d9ec8 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:20.405737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086e516-cf67-4e7e-801e-d1f85f0d9ec8 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:20.406245 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086e516-cf67-4e7e-801e-d1f85f0d9ec8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:20.409487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b086e516-cf67-4e7e-801e-d1f85f0d9ec8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:20.512457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086e516-cf67-4e7e-801e-d1f85f0d9ec8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:20.514681 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086e516-cf67-4e7e-801e-d1f85f0d9ec8 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:20.541244 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1361/2699] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:57:20 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:57:20.615473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a833b2b-a994-47cd-9b54-8b2e1e811699 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:20.616251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a833b2b-a994-47cd-9b54-8b2e1e811699 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:20.616251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a833b2b-a994-47cd-9b54-8b2e1e811699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:20.654200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-8a833b2b-a994-47cd-9b54-8b2e1e811699 None None] MFA Rules not processed for user `46557175a8504db78843b5d56b1413cf`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:57:20.656265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8a833b2b-a994-47cd-9b54-8b2e1e811699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:20.814767 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1339/2700] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:57:20 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:57:23.670831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e9079-1e2c-465a-a271-e479e5101598 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:23.673805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e9079-1e2c-465a-a271-e479e5101598 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:23.674332 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e9079-1e2c-465a-a271-e479e5101598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:23.706213 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-441e9079-1e2c-465a-a271-e479e5101598 None None] MFA Rules not processed for user `0701f31766dd4eeab9a63f6411c26d6e`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:57:23.707908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-441e9079-1e2c-465a-a271-e479e5101598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:23.817964 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1362/2701] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:57:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:57:30.791019 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=71 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:33.589879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a833b2b-a994-47cd-9b54-8b2e1e811699 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:33.614416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a833b2b-a994-47cd-9b54-8b2e1e811699 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:33.621175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2bca98-bf18-49a4-a2b3-7cc64b32a6c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:33.621945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2bca98-bf18-49a4-a2b3-7cc64b32a6c4 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:33.622406 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2bca98-bf18-49a4-a2b3-7cc64b32a6c4 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:33.622723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2bca98-bf18-49a4-a2b3-7cc64b32a6c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:33.624521 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7d2bca98-bf18-49a4-a2b3-7cc64b32a6c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:33.696985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2bca98-bf18-49a4-a2b3-7cc64b32a6c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:33.698687 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2bca98-bf18-49a4-a2b3-7cc64b32a6c4 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:33.709936 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1340/2702] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:57:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:57:33.805652 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=60 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:34.574188 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e9079-1e2c-465a-a271-e479e5101598 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:34.574188 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-441e9079-1e2c-465a-a271-e479e5101598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:34.593400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e9079-1e2c-465a-a271-e479e5101598 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:34.621203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4169b-c46f-4a18-a712-8c51f7cdc8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:34.623461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4169b-c46f-4a18-a712-8c51f7cdc8fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:34.623661 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4169b-c46f-4a18-a712-8c51f7cdc8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:34.624306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4169b-c46f-4a18-a712-8c51f7cdc8fe admin admin] PATH_INFO: `/v3/users/10aebae8bbbd4ea88b9cbf85d3438ed1` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:34.627080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac4169b-c46f-4a18-a712-8c51f7cdc8fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=10aebae8bbbd4ea88b9cbf85d3438ed1)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:34.629402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac4169b-c46f-4a18-a712-8c51f7cdc8fe admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:34.711420 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7ac4169b-c46f-4a18-a712-8c51f7cdc8fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10aebae8bbbd4ea88b9cbf85d3438ed1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:34.722504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7ac4169b-c46f-4a18-a712-8c51f7cdc8fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10aebae8bbbd4ea88b9cbf85d3438ed1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:34.723545 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7ac4169b-c46f-4a18-a712-8c51f7cdc8fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10aebae8bbbd4ea88b9cbf85d3438ed1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:34.724224 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7ac4169b-c46f-4a18-a712-8c51f7cdc8fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10aebae8bbbd4ea88b9cbf85d3438ed1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:34.734818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7ac4169b-c46f-4a18-a712-8c51f7cdc8fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10aebae8bbbd4ea88b9cbf85d3438ed1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:34.760236 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1363/2703] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:57:34 2022] DELETE /identity/v3/users/10aebae8bbbd4ea88b9cbf85d3438ed1 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:57:34.764909 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cceeba-53c1-4d51-ba98-936c671748f5 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:34.765784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cceeba-53c1-4d51-ba98-936c671748f5 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:34.766789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cceeba-53c1-4d51-ba98-936c671748f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:34.795468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f4cceeba-53c1-4d51-ba98-936c671748f5 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:57:34.797070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f4cceeba-53c1-4d51-ba98-936c671748f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:34.878960 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1341/2704] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:57:34.892775 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4169b-c46f-4a18-a712-8c51f7cdc8fe admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:34.894233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7ac4169b-c46f-4a18-a712-8c51f7cdc8fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:34.994320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4169b-c46f-4a18-a712-8c51f7cdc8fe admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:34.998508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6071ff6-23fd-4d6e-a941-86cd827fcedd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:34.999379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6071ff6-23fd-4d6e-a941-86cd827fcedd service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:34.999841 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6071ff6-23fd-4d6e-a941-86cd827fcedd service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:35.000114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6071ff6-23fd-4d6e-a941-86cd827fcedd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:35.033680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6071ff6-23fd-4d6e-a941-86cd827fcedd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:35.035511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6071ff6-23fd-4d6e-a941-86cd827fcedd service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:35.048306 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1364/2705] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:57:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:57:35.331221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cceeba-53c1-4d51-ba98-936c671748f5 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:35.333386 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f4cceeba-53c1-4d51-ba98-936c671748f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:35.365978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cceeba-53c1-4d51-ba98-936c671748f5 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:35.382108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb1a05-0653-4b3b-bc4f-380f6ffddd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:35.382835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb1a05-0653-4b3b-bc4f-380f6ffddd46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:35.383119 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb1a05-0653-4b3b-bc4f-380f6ffddd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:35.383380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb1a05-0653-4b3b-bc4f-380f6ffddd46 admin admin] PATH_INFO: `/v3/projects/c0e3164f8b4943eeb85883a0fa08efaa` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:35.384720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb1a05-0653-4b3b-bc4f-380f6ffddd46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0e3164f8b4943eeb85883a0fa08efaa)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:35.386965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb1a05-0653-4b3b-bc4f-380f6ffddd46 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:35.455651 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-84eb1a05-0653-4b3b-bc4f-380f6ffddd46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0e3164f8b4943eeb85883a0fa08efaa', 'request_id': 'req-84eb1a05-0653-4b3b-bc4f-380f6ffddd46'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:35.467516 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-84eb1a05-0653-4b3b-bc4f-380f6ffddd46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0e3164f8b4943eeb85883a0fa08efaa', 'request_id': 'req-84eb1a05-0653-4b3b-bc4f-380f6ffddd46'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:35.478004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-84eb1a05-0653-4b3b-bc4f-380f6ffddd46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0e3164f8b4943eeb85883a0fa08efaa', 'request_id': 'req-84eb1a05-0653-4b3b-bc4f-380f6ffddd46'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:35.501431 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-84eb1a05-0653-4b3b-bc4f-380f6ffddd46 admin admin] The token cache is being invalidate because project c0e3164f8b4943eeb85883a0fa08efaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:57:35.502701 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-84eb1a05-0653-4b3b-bc4f-380f6ffddd46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:35.504042 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-84eb1a05-0653-4b3b-bc4f-380f6ffddd46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:35.506731 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1342/2706] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:57:35 2022] DELETE /identity/v3/projects/c0e3164f8b4943eeb85883a0fa08efaa => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:57:35.513379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6071ff6-23fd-4d6e-a941-86cd827fcedd service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:35.526375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6071ff6-23fd-4d6e-a941-86cd827fcedd service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:35.642381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e252e-192e-4beb-b13e-2f8c13b63be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:35.643542 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e252e-192e-4beb-b13e-2f8c13b63be9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:35.643929 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e252e-192e-4beb-b13e-2f8c13b63be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:35.644307 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e252e-192e-4beb-b13e-2f8c13b63be9 admin admin] PATH_INFO: `/v3/users/e2d2602fe5d64b419df472540c3dd962` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:35.645847 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e252e-192e-4beb-b13e-2f8c13b63be9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2d2602fe5d64b419df472540c3dd962)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:35.648179 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e252e-192e-4beb-b13e-2f8c13b63be9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:35.669439 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:35.718789 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a90e252e-192e-4beb-b13e-2f8c13b63be9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2d2602fe5d64b419df472540c3dd962'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:35.730043 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a90e252e-192e-4beb-b13e-2f8c13b63be9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2d2602fe5d64b419df472540c3dd962'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:35.730815 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a90e252e-192e-4beb-b13e-2f8c13b63be9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2d2602fe5d64b419df472540c3dd962'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:35.731427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a90e252e-192e-4beb-b13e-2f8c13b63be9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2d2602fe5d64b419df472540c3dd962'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:35.741452 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a90e252e-192e-4beb-b13e-2f8c13b63be9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2d2602fe5d64b419df472540c3dd962'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:35.764317 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1365/2707] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:57:35 2022] DELETE /identity/v3/users/e2d2602fe5d64b419df472540c3dd962 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:57:35.975688 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb1a05-0653-4b3b-bc4f-380f6ffddd46 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:35.977319 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-84eb1a05-0653-4b3b-bc4f-380f6ffddd46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:36.007431 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb1a05-0653-4b3b-bc4f-380f6ffddd46 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:36.056777 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:36.119128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e90cc-8040-4b79-ae37-68c442fb360d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:36.120846 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e90cc-8040-4b79-ae37-68c442fb360d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:36.121194 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e90cc-8040-4b79-ae37-68c442fb360d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:36.121531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e90cc-8040-4b79-ae37-68c442fb360d admin admin] PATH_INFO: `/v3/projects/ae9f55d1dbe044afbf7dd82813210d27` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:36.122809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e90cc-8040-4b79-ae37-68c442fb360d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae9f55d1dbe044afbf7dd82813210d27)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:36.124774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e90cc-8040-4b79-ae37-68c442fb360d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:36.202267 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8b0e90cc-8040-4b79-ae37-68c442fb360d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae9f55d1dbe044afbf7dd82813210d27', 'request_id': 'req-8b0e90cc-8040-4b79-ae37-68c442fb360d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:36.209572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8b0e90cc-8040-4b79-ae37-68c442fb360d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae9f55d1dbe044afbf7dd82813210d27', 'request_id': 'req-8b0e90cc-8040-4b79-ae37-68c442fb360d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:36.216545 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8b0e90cc-8040-4b79-ae37-68c442fb360d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae9f55d1dbe044afbf7dd82813210d27', 'request_id': 'req-8b0e90cc-8040-4b79-ae37-68c442fb360d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:36.234437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8b0e90cc-8040-4b79-ae37-68c442fb360d admin admin] The token cache is being invalidate because project ae9f55d1dbe044afbf7dd82813210d27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:57:36.234802 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8b0e90cc-8040-4b79-ae37-68c442fb360d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:36.235470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8b0e90cc-8040-4b79-ae37-68c442fb360d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:36.244006 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1343/2708] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:57:35 2022] DELETE /identity/v3/projects/ae9f55d1dbe044afbf7dd82813210d27 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:57:36.245528 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f83de-1902-4686-9cc7-4cbfc0f22995 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:36.245985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f83de-1902-4686-9cc7-4cbfc0f22995 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:36.246090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f83de-1902-4686-9cc7-4cbfc0f22995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:36.268215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b62f83de-1902-4686-9cc7-4cbfc0f22995 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:57:36.269542 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b62f83de-1902-4686-9cc7-4cbfc0f22995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:36.350347 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1366/2709] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:57:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:57:36.352797 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016cbdb-df87-4fbd-88bf-ebb20c165647 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:36.353179 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016cbdb-df87-4fbd-88bf-ebb20c165647 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:36.353648 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016cbdb-df87-4fbd-88bf-ebb20c165647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:36.377705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a016cbdb-df87-4fbd-88bf-ebb20c165647 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:57:36.378951 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a016cbdb-df87-4fbd-88bf-ebb20c165647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:36.387035 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1344/2710] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:57:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:57:36.391562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f83de-1902-4686-9cc7-4cbfc0f22995 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:36.402258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f83de-1902-4686-9cc7-4cbfc0f22995 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:36.407267 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2319e-d9ea-4ec2-82d5-5ce3762b56cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:36.407875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2319e-d9ea-4ec2-82d5-5ce3762b56cb admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:36.408154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2319e-d9ea-4ec2-82d5-5ce3762b56cb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:36.408430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2319e-d9ea-4ec2-82d5-5ce3762b56cb admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:36.409080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b2319e-d9ea-4ec2-82d5-5ce3762b56cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:57:36.409383 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b2319e-d9ea-4ec2-82d5-5ce3762b56cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:36.411034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b2319e-d9ea-4ec2-82d5-5ce3762b56cb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:36.428597 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1367/2711] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:57:36.433121 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016cbdb-df87-4fbd-88bf-ebb20c165647 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:36.445507 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016cbdb-df87-4fbd-88bf-ebb20c165647 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:36.451999 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d77fb-e6bb-4260-81ab-54b2272e4350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:36.452626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d77fb-e6bb-4260-81ab-54b2272e4350 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:36.453015 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d77fb-e6bb-4260-81ab-54b2272e4350 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:36.453291 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d77fb-e6bb-4260-81ab-54b2272e4350 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:36.454222 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d77fb-e6bb-4260-81ab-54b2272e4350 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:36.456193 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d77fb-e6bb-4260-81ab-54b2272e4350 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:36.503890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2319e-d9ea-4ec2-82d5-5ce3762b56cb admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:36.504144 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1345/2712] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:57:36 2022] POST /identity/v3/projects => generated 379 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:57:36.520702 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2319e-d9ea-4ec2-82d5-5ce3762b56cb admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:36.596989 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db8a50-8ec8-4e2a-a5b8-dfc4bffbbec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:36.597721 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db8a50-8ec8-4e2a-a5b8-dfc4bffbbec0 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:36.598978 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db8a50-8ec8-4e2a-a5b8-dfc4bffbbec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:36.599258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db8a50-8ec8-4e2a-a5b8-dfc4bffbbec0 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:36.599926 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db8a50-8ec8-4e2a-a5b8-dfc4bffbbec0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:36.603534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db8a50-8ec8-4e2a-a5b8-dfc4bffbbec0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:36.631733 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1368/2713] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:57:36 2022] POST /identity/v3/users => generated 290 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:57:36.633095 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d77fb-e6bb-4260-81ab-54b2272e4350 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:36.644856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d77fb-e6bb-4260-81ab-54b2272e4350 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:36.649943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd9ace-5084-41bd-abce-bc23c3602827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:36.650665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd9ace-5084-41bd-abce-bc23c3602827 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:36.651016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd9ace-5084-41bd-abce-bc23c3602827 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:36.651354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd9ace-5084-41bd-abce-bc23c3602827 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:36.652069 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd9ace-5084-41bd-abce-bc23c3602827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:36.653777 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd9ace-5084-41bd-abce-bc23c3602827 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:36.676222 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1346/2714] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:57:36.677711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db8a50-8ec8-4e2a-a5b8-dfc4bffbbec0 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:36.688486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db8a50-8ec8-4e2a-a5b8-dfc4bffbbec0 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:36.694389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622db2e-38bc-4432-b102-59239568cf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:36.695447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622db2e-38bc-4432-b102-59239568cf4f admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:36.695730 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622db2e-38bc-4432-b102-59239568cf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:36.696004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622db2e-38bc-4432-b102-59239568cf4f admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:36.696650 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5622db2e-38bc-4432-b102-59239568cf4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:36.698364 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5622db2e-38bc-4432-b102-59239568cf4f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:36.705460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:36.712386 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1369/2715] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:57:36.716667 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd9ace-5084-41bd-abce-bc23c3602827 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:36.732854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd9ace-5084-41bd-abce-bc23c3602827 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:36.740906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9f2f8-197a-4d78-a511-63cb9ce7965a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:36.743079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9f2f8-197a-4d78-a511-63cb9ce7965a admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:36.743598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9f2f8-197a-4d78-a511-63cb9ce7965a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:36.744582 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9f2f8-197a-4d78-a511-63cb9ce7965a admin admin] PATH_INFO: `/v3/projects/ebc37ffeaeb945f08545e6cf756fad64/users/8c4455ce2f604175bc7bbcb68a9fae93/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:36.762803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9f2f8-197a-4d78-a511-63cb9ce7965a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebc37ffeaeb945f08545e6cf756fad64, user_id=8c4455ce2f604175bc7bbcb68a9fae93, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:36.765340 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9f2f8-197a-4d78-a511-63cb9ce7965a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:36.781219 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1347/2716] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:57:36 2022] PUT /identity/v3/projects/ebc37ffeaeb945f08545e6cf756fad64/users/8c4455ce2f604175bc7bbcb68a9fae93/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:57:36.792774 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28536849-2f13-4278-b77d-2767c6e38327 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:36.793067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28536849-2f13-4278-b77d-2767c6e38327 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:36.793346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28536849-2f13-4278-b77d-2767c6e38327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:36.834099 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-28536849-2f13-4278-b77d-2767c6e38327 None None] MFA Rules not processed for user `8c4455ce2f604175bc7bbcb68a9fae93`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:57:36.835749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-28536849-2f13-4278-b77d-2767c6e38327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:36.941067 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1370/2717] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:57:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:57:36.950850 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9f2f8-197a-4d78-a511-63cb9ce7965a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:36.952602 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c7e9f2f8-197a-4d78-a511-63cb9ce7965a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:37.011234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:37.027775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9f2f8-197a-4d78-a511-63cb9ce7965a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:37.032837 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b06350-288a-42ac-a8eb-3cf53b284648 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10759b2abd4cafacf338551327775e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:37.033618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b06350-288a-42ac-a8eb-3cf53b284648 service glance] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:37.033998 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b06350-288a-42ac-a8eb-3cf53b284648 service glance] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:37.034381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b06350-288a-42ac-a8eb-3cf53b284648 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:37.045516 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b06350-288a-42ac-a8eb-3cf53b284648 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:37.047149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b06350-288a-42ac-a8eb-3cf53b284648 service glance] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:37.084865 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1348/2718] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:57:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:57:37.216605 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c2753-938a-43c8-8b07-9e3a84e787cf None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:37.216895 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c2753-938a-43c8-8b07-9e3a84e787cf None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:37.217172 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c2753-938a-43c8-8b07-9e3a84e787cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:37.238048 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-811c2753-938a-43c8-8b07-9e3a84e787cf None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:57:37.239948 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-811c2753-938a-43c8-8b07-9e3a84e787cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:37.306818 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1371/2719] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 20:57:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:57:37.330714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b06350-288a-42ac-a8eb-3cf53b284648 service glance] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:37.332377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c2b06350-288a-42ac-a8eb-3cf53b284648 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:37.450750 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b06350-288a-42ac-a8eb-3cf53b284648 service glance] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:37.456841 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09389f1c-18fb-43dc-b5be-be6411a7f5b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:37.457449 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09389f1c-18fb-43dc-b5be-be6411a7f5b0 service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:37.457732 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09389f1c-18fb-43dc-b5be-be6411a7f5b0 service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:37.458009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09389f1c-18fb-43dc-b5be-be6411a7f5b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:37.473587 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09389f1c-18fb-43dc-b5be-be6411a7f5b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:37.475357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09389f1c-18fb-43dc-b5be-be6411a7f5b0 service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:37.498091 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1349/2720] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 20:57:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 06 20:57:38.639522 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98bc63-6526-45a4-a229-0df1be7405fc None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:38.640152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98bc63-6526-45a4-a229-0df1be7405fc None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:38.640441 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98bc63-6526-45a4-a229-0df1be7405fc None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:38.642944 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1372/2721] 10.222.0.33 () {54 vars in 921 bytes} [Sat Aug 6 20:57:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:57:38.648568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb67114-6672-4580-8317-307bfd8d2e86 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:38.649056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb67114-6672-4580-8317-307bfd8d2e86 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:38.649163 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb67114-6672-4580-8317-307bfd8d2e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:38.675263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-fcb67114-6672-4580-8317-307bfd8d2e86 None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:57:38.676481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-fcb67114-6672-4580-8317-307bfd8d2e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:38.751307 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1350/2722] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 20:57:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:57:38.770679 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98bc63-6526-45a4-a229-0df1be7405fc None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:38.772939 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ee98bc63-6526-45a4-a229-0df1be7405fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:38.792625 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98bc63-6526-45a4-a229-0df1be7405fc None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:38.801368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8600e3-9d61-4bf9-9059-3aefd716cc41 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:38.801981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8600e3-9d61-4bf9-9059-3aefd716cc41 service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:38.802260 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8600e3-9d61-4bf9-9059-3aefd716cc41 service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:38.802537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8600e3-9d61-4bf9-9059-3aefd716cc41 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:38.811649 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8600e3-9d61-4bf9-9059-3aefd716cc41 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:38.813786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8600e3-9d61-4bf9-9059-3aefd716cc41 service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:38.825395 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1373/2723] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:57:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:57:42.955619 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6014d-c7c1-495e-ae00-244bd542c7fb None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:42.956142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6014d-c7c1-495e-ae00-244bd542c7fb None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:42.956433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6014d-c7c1-495e-ae00-244bd542c7fb None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:42.958198 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1351/2724] 10.222.0.33 () {54 vars in 921 bytes} [Sat Aug 6 20:57:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:57:42.967499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef3982-d76d-4175-bed4-b5a4e75f8adc None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:42.968537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef3982-d76d-4175-bed4-b5a4e75f8adc None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:42.969602 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef3982-d76d-4175-bed4-b5a4e75f8adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:43.004063 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-05ef3982-d76d-4175-bed4-b5a4e75f8adc None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:57:43.005857 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-05ef3982-d76d-4175-bed4-b5a4e75f8adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:43.029473 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1374/2725] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 20:57:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:57:43.049549 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6014d-c7c1-495e-ae00-244bd542c7fb None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:43.065928 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6014d-c7c1-495e-ae00-244bd542c7fb None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:43.074860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfa25d-0633-4f2c-be8b-28c598ae42a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:43.075597 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfa25d-0633-4f2c-be8b-28c598ae42a2 service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:43.075980 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfa25d-0633-4f2c-be8b-28c598ae42a2 service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:43.076353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfa25d-0633-4f2c-be8b-28c598ae42a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:43.088114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfa25d-0633-4f2c-be8b-28c598ae42a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:43.090366 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfa25d-0633-4f2c-be8b-28c598ae42a2 service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:43.104245 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1352/2726] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:57:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:57:45.071581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741a7a3-a5da-4f46-8570-8c9d429f81e7 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:45.072418 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741a7a3-a5da-4f46-8570-8c9d429f81e7 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:45.072695 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741a7a3-a5da-4f46-8570-8c9d429f81e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:45.107588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-f741a7a3-a5da-4f46-8570-8c9d429f81e7 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:57:45.109309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f741a7a3-a5da-4f46-8570-8c9d429f81e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:45.117308 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1375/2727] 10.222.0.33 () {58 vars in 967 bytes} [Sat Aug 6 20:57:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:57:45.131878 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfa25d-0633-4f2c-be8b-28c598ae42a2 service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:45.145262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfa25d-0633-4f2c-be8b-28c598ae42a2 service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:45.152202 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d2104-edf6-436c-a745-cafec75e3fb0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:45.152830 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d2104-edf6-436c-a745-cafec75e3fb0 service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:45.153110 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d2104-edf6-436c-a745-cafec75e3fb0 service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:45.153384 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d2104-edf6-436c-a745-cafec75e3fb0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:45.164896 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d2104-edf6-436c-a745-cafec75e3fb0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:45.166888 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d2104-edf6-436c-a745-cafec75e3fb0 service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:45.177223 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1353/2728] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 20:57:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 20:57:45.331981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741a7a3-a5da-4f46-8570-8c9d429f81e7 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:45.411580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741a7a3-a5da-4f46-8570-8c9d429f81e7 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:45.416845 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796e1ec-4a00-4783-b753-c2aaaacd78e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:45.417478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796e1ec-4a00-4783-b753-c2aaaacd78e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:45.417940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796e1ec-4a00-4783-b753-c2aaaacd78e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:45.418380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796e1ec-4a00-4783-b753-c2aaaacd78e8 admin admin] PATH_INFO: `/v3/users/8c4455ce2f604175bc7bbcb68a9fae93` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:45.419873 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796e1ec-4a00-4783-b753-c2aaaacd78e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c4455ce2f604175bc7bbcb68a9fae93)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:45.422665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796e1ec-4a00-4783-b753-c2aaaacd78e8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:45.441590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:45.507611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b796e1ec-4a00-4783-b753-c2aaaacd78e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c4455ce2f604175bc7bbcb68a9fae93'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:45.515908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b796e1ec-4a00-4783-b753-c2aaaacd78e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c4455ce2f604175bc7bbcb68a9fae93'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:45.516858 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b796e1ec-4a00-4783-b753-c2aaaacd78e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c4455ce2f604175bc7bbcb68a9fae93'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:45.518136 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b796e1ec-4a00-4783-b753-c2aaaacd78e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c4455ce2f604175bc7bbcb68a9fae93'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:45.529649 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b796e1ec-4a00-4783-b753-c2aaaacd78e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c4455ce2f604175bc7bbcb68a9fae93'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:45.555348 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1376/2729] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:57:45 2022] DELETE /identity/v3/users/8c4455ce2f604175bc7bbcb68a9fae93 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:57:45.559656 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47db32-1b34-433e-ab3a-237e25f5791f None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:45.559934 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47db32-1b34-433e-ab3a-237e25f5791f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:45.560529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47db32-1b34-433e-ab3a-237e25f5791f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:45.582422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-9a47db32-1b34-433e-ab3a-237e25f5791f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:57:45.583586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9a47db32-1b34-433e-ab3a-237e25f5791f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:45.661144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:45.688153 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1354/2730] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:57:45.703649 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796e1ec-4a00-4783-b753-c2aaaacd78e8 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:45.711455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b796e1ec-4a00-4783-b753-c2aaaacd78e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:45.799767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796e1ec-4a00-4783-b753-c2aaaacd78e8 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:45.803899 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b932e-0f19-4748-9627-b733ecda364d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:45.804281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b932e-0f19-4748-9627-b733ecda364d service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:45.804653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b932e-0f19-4748-9627-b733ecda364d service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:45.805116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b932e-0f19-4748-9627-b733ecda364d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:45.816122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b932e-0f19-4748-9627-b733ecda364d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:45.817733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b932e-0f19-4748-9627-b733ecda364d service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:45.829319 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1377/2731] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:57:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:57:46.705074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a47db32-1b34-433e-ab3a-237e25f5791f None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:46.706751 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9a47db32-1b34-433e-ab3a-237e25f5791f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:46.719606 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a47db32-1b34-433e-ab3a-237e25f5791f None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:46.724635 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3e186-d5b8-46db-b306-15968f7b76c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:46.725404 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3e186-d5b8-46db-b306-15968f7b76c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:46.725780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3e186-d5b8-46db-b306-15968f7b76c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:46.726402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3e186-d5b8-46db-b306-15968f7b76c0 admin admin] PATH_INFO: `/v3/projects/ebc37ffeaeb945f08545e6cf756fad64` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:46.727650 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3e186-d5b8-46db-b306-15968f7b76c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebc37ffeaeb945f08545e6cf756fad64)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:46.729675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3e186-d5b8-46db-b306-15968f7b76c0 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:46.815234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fcc3e186-d5b8-46db-b306-15968f7b76c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebc37ffeaeb945f08545e6cf756fad64', 'request_id': 'req-fcc3e186-d5b8-46db-b306-15968f7b76c0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:46.823246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fcc3e186-d5b8-46db-b306-15968f7b76c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebc37ffeaeb945f08545e6cf756fad64', 'request_id': 'req-fcc3e186-d5b8-46db-b306-15968f7b76c0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:46.835400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fcc3e186-d5b8-46db-b306-15968f7b76c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebc37ffeaeb945f08545e6cf756fad64', 'request_id': 'req-fcc3e186-d5b8-46db-b306-15968f7b76c0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:46.853603 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fcc3e186-d5b8-46db-b306-15968f7b76c0 admin admin] The token cache is being invalidate because project ebc37ffeaeb945f08545e6cf756fad64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:57:46.854087 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fcc3e186-d5b8-46db-b306-15968f7b76c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:46.855644 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fcc3e186-d5b8-46db-b306-15968f7b76c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:46.858176 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1355/2732] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:57:46 2022] DELETE /identity/v3/projects/ebc37ffeaeb945f08545e6cf756fad64 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:57:46.868418 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85533ccb-29d7-4e7d-b2b3-3a18a99aafef None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:46.868893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85533ccb-29d7-4e7d-b2b3-3a18a99aafef None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:46.869200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85533ccb-29d7-4e7d-b2b3-3a18a99aafef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:46.892466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-85533ccb-29d7-4e7d-b2b3-3a18a99aafef None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:57:46.894596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-85533ccb-29d7-4e7d-b2b3-3a18a99aafef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:46.967985 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1378/2733] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:57:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:57:46.969405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b9020-ca33-4c82-ba33-b6dbced95026 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:46.969753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b9020-ca33-4c82-ba33-b6dbced95026 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:46.969974 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b9020-ca33-4c82-ba33-b6dbced95026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:47.007989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-820b9020-ca33-4c82-ba33-b6dbced95026 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:57:47.009326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-820b9020-ca33-4c82-ba33-b6dbced95026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:47.025420 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1356/2734] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:57:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:57:47.029891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85533ccb-29d7-4e7d-b2b3-3a18a99aafef None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:47.041848 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85533ccb-29d7-4e7d-b2b3-3a18a99aafef None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:47.054385 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ce1f0-f12b-4207-947f-992a5a68d347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:47.055042 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ce1f0-f12b-4207-947f-992a5a68d347 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:47.055321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ce1f0-f12b-4207-947f-992a5a68d347 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:47.055595 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ce1f0-f12b-4207-947f-992a5a68d347 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:47.056278 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ce1f0-f12b-4207-947f-992a5a68d347 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:57:47.056549 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ce1f0-f12b-4207-947f-992a5a68d347 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:47.058292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ce1f0-f12b-4207-947f-992a5a68d347 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:47.071327 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1379/2735] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:57:47.081648 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b9020-ca33-4c82-ba33-b6dbced95026 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:47.091891 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b9020-ca33-4c82-ba33-b6dbced95026 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:47.098251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4cbef-f4c1-4960-9829-edbfd6e8f226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:47.100461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4cbef-f4c1-4960-9829-edbfd6e8f226 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:47.100993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4cbef-f4c1-4960-9829-edbfd6e8f226 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:47.101150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4cbef-f4c1-4960-9829-edbfd6e8f226 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:47.101950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4cbef-f4c1-4960-9829-edbfd6e8f226 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:47.103962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4cbef-f4c1-4960-9829-edbfd6e8f226 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:47.139119 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1357/2736] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:57:47 2022] POST /identity/v3/projects => generated 363 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:57:47.143126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ce1f0-f12b-4207-947f-992a5a68d347 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:47.153191 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ce1f0-f12b-4207-947f-992a5a68d347 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:47.168284 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:47.227680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead3bdd-b067-4089-bb78-32e6dd7c3793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:47.227941 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead3bdd-b067-4089-bb78-32e6dd7c3793 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:47.228434 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead3bdd-b067-4089-bb78-32e6dd7c3793 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:47.228717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead3bdd-b067-4089-bb78-32e6dd7c3793 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:47.229355 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead3bdd-b067-4089-bb78-32e6dd7c3793 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:47.231358 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead3bdd-b067-4089-bb78-32e6dd7c3793 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:47.260009 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1380/2737] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:57:47 2022] POST /identity/v3/users => generated 282 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:57:47.264309 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4cbef-f4c1-4960-9829-edbfd6e8f226 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:47.276983 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4cbef-f4c1-4960-9829-edbfd6e8f226 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:47.284847 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d4716-dfff-4f01-8e60-9b5b0a86c453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:47.285726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d4716-dfff-4f01-8e60-9b5b0a86c453 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:47.286164 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d4716-dfff-4f01-8e60-9b5b0a86c453 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:47.286623 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d4716-dfff-4f01-8e60-9b5b0a86c453 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:47.287416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d4716-dfff-4f01-8e60-9b5b0a86c453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:47.289186 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d4716-dfff-4f01-8e60-9b5b0a86c453 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:47.302338 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1358/2738] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:57:47.305304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead3bdd-b067-4089-bb78-32e6dd7c3793 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:47.316871 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead3bdd-b067-4089-bb78-32e6dd7c3793 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:47.325613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756940b-59a9-45ad-9004-1c18da14fb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:47.326442 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756940b-59a9-45ad-9004-1c18da14fb59 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:47.326824 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756940b-59a9-45ad-9004-1c18da14fb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:47.327101 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756940b-59a9-45ad-9004-1c18da14fb59 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:47.327825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f756940b-59a9-45ad-9004-1c18da14fb59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:47.329615 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f756940b-59a9-45ad-9004-1c18da14fb59 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:47.340578 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1381/2739] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:57:47.345227 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d4716-dfff-4f01-8e60-9b5b0a86c453 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:47.355881 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d4716-dfff-4f01-8e60-9b5b0a86c453 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:47.361536 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d0711-4bf3-40c7-b8f2-39fa05933a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:47.362204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d0711-4bf3-40c7-b8f2-39fa05933a3d admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:47.362480 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d0711-4bf3-40c7-b8f2-39fa05933a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:47.362831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d0711-4bf3-40c7-b8f2-39fa05933a3d admin admin] PATH_INFO: `/v3/projects/764e8bbcc05b47e5a647cf2a0fe82a20/users/d43d0d15118242b7a60cc34c512fbe5e/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:47.379813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d0711-4bf3-40c7-b8f2-39fa05933a3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=764e8bbcc05b47e5a647cf2a0fe82a20, user_id=d43d0d15118242b7a60cc34c512fbe5e, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:47.382811 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d0711-4bf3-40c7-b8f2-39fa05933a3d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:47.398163 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1359/2740] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:57:47 2022] PUT /identity/v3/projects/764e8bbcc05b47e5a647cf2a0fe82a20/users/d43d0d15118242b7a60cc34c512fbe5e/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:57:47.403471 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4937b29-6368-409d-ace6-365a33ec2575 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:47.403905 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4937b29-6368-409d-ace6-365a33ec2575 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:47.404191 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4937b29-6368-409d-ace6-365a33ec2575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:47.426572 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d4937b29-6368-409d-ace6-365a33ec2575 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:57:47.427831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d4937b29-6368-409d-ace6-365a33ec2575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:47.500275 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1382/2741] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:57:47.510827 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d0711-4bf3-40c7-b8f2-39fa05933a3d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:47.512883 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-578d0711-4bf3-40c7-b8f2-39fa05933a3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:47.581505 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d0711-4bf3-40c7-b8f2-39fa05933a3d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:47.586175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba8385-0a77-4312-a511-acd66c0b0146 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:47.587118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba8385-0a77-4312-a511-acd66c0b0146 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:47.587505 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba8385-0a77-4312-a511-acd66c0b0146 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:47.587883 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba8385-0a77-4312-a511-acd66c0b0146 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:47.600847 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba8385-0a77-4312-a511-acd66c0b0146 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:47.602479 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba8385-0a77-4312-a511-acd66c0b0146 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:47.616337 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1360/2742] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:57:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:57:53.845580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447a8ab-b394-4ec4-8d02-152e2149c920 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:53.846259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447a8ab-b394-4ec4-8d02-152e2149c920 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:53.846259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447a8ab-b394-4ec4-8d02-152e2149c920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:53.931766 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-0447a8ab-b394-4ec4-8d02-152e2149c920 None None] MFA Rules not processed for user `3df9834cd3164d72a4bbd4d71d35df96`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:57:53.934285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0447a8ab-b394-4ec4-8d02-152e2149c920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:54.068238 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1383/2743] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:57:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:57:56.326252 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba8385-0a77-4312-a511-acd66c0b0146 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:56.328856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-68ba8385-0a77-4312-a511-acd66c0b0146 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:56.362112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447a8ab-b394-4ec4-8d02-152e2149c920 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:56.363813 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0447a8ab-b394-4ec4-8d02-152e2149c920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:56.369454 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba8385-0a77-4312-a511-acd66c0b0146 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:56.391459 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb81d2-861c-4a86-b415-dd2ced506d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:56.392255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb81d2-861c-4a86-b415-dd2ced506d55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:56.392391 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb81d2-861c-4a86-b415-dd2ced506d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:56.392768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb81d2-861c-4a86-b415-dd2ced506d55 admin admin] PATH_INFO: `/v3/users/46557175a8504db78843b5d56b1413cf` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:56.401813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb81d2-861c-4a86-b415-dd2ced506d55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46557175a8504db78843b5d56b1413cf)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:56.404604 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447a8ab-b394-4ec4-8d02-152e2149c920 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:56.406892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb81d2-861c-4a86-b415-dd2ced506d55 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:56.420510 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:56.428669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe3c60-c3b3-47e4-b232-512be51e35b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:56.440411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe3c60-c3b3-47e4-b232-512be51e35b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:56.440803 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe3c60-c3b3-47e4-b232-512be51e35b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:56.441176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe3c60-c3b3-47e4-b232-512be51e35b7 admin admin] PATH_INFO: `/v3/users/dff69a9a061a454685cfc57c1675f4b9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:56.442615 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe3c60-c3b3-47e4-b232-512be51e35b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dff69a9a061a454685cfc57c1675f4b9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:56.445142 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe3c60-c3b3-47e4-b232-512be51e35b7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:56.526217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7adb81d2-861c-4a86-b415-dd2ced506d55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46557175a8504db78843b5d56b1413cf'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:56.529228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7adb81d2-861c-4a86-b415-dd2ced506d55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46557175a8504db78843b5d56b1413cf'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:56.534439 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7adb81d2-861c-4a86-b415-dd2ced506d55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46557175a8504db78843b5d56b1413cf'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:56.544766 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:56.556882 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7adb81d2-861c-4a86-b415-dd2ced506d55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46557175a8504db78843b5d56b1413cf'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:56.575412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0efe3c60-c3b3-47e4-b232-512be51e35b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dff69a9a061a454685cfc57c1675f4b9'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:56.590344 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7adb81d2-861c-4a86-b415-dd2ced506d55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46557175a8504db78843b5d56b1413cf'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:56.601773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0efe3c60-c3b3-47e4-b232-512be51e35b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dff69a9a061a454685cfc57c1675f4b9'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:56.602975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0efe3c60-c3b3-47e4-b232-512be51e35b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dff69a9a061a454685cfc57c1675f4b9'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:56.603776 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0efe3c60-c3b3-47e4-b232-512be51e35b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dff69a9a061a454685cfc57c1675f4b9'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:56.615937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0efe3c60-c3b3-47e4-b232-512be51e35b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dff69a9a061a454685cfc57c1675f4b9'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:56.653161 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1384/2744] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:57:56 2022] DELETE /identity/v3/users/dff69a9a061a454685cfc57c1675f4b9 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:57:56.653972 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1361/2745] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:57:56 2022] DELETE /identity/v3/users/46557175a8504db78843b5d56b1413cf => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:57:56.659312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf25372-6323-47cd-bcbd-c528c7bca931 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:56.659487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf25372-6323-47cd-bcbd-c528c7bca931 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:56.659942 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf25372-6323-47cd-bcbd-c528c7bca931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:56.705936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-4bf25372-6323-47cd-bcbd-c528c7bca931 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:57:56.707208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4bf25372-6323-47cd-bcbd-c528c7bca931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:56.842505 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1362/2746] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:57:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:57:56.865444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe3c60-c3b3-47e4-b232-512be51e35b7 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:56.867800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0efe3c60-c3b3-47e4-b232-512be51e35b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:57.032220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe3c60-c3b3-47e4-b232-512be51e35b7 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:57.137519 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22220b-46ab-4688-b094-e6200bb69831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:57.138172 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22220b-46ab-4688-b094-e6200bb69831 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:57.138448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22220b-46ab-4688-b094-e6200bb69831 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:57.139080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22220b-46ab-4688-b094-e6200bb69831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:57.176822 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad22220b-46ab-4688-b094-e6200bb69831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:57.178510 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad22220b-46ab-4688-b094-e6200bb69831 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:57.209388 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1385/2747] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:57:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:57:57.951626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf25372-6323-47cd-bcbd-c528c7bca931 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:57.955114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4bf25372-6323-47cd-bcbd-c528c7bca931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:57.984422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf25372-6323-47cd-bcbd-c528c7bca931 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:57.992012 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b42c85-ecf9-436f-be1f-a8f5d07c67f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:57.993023 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b42c85-ecf9-436f-be1f-a8f5d07c67f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:57.993350 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b42c85-ecf9-436f-be1f-a8f5d07c67f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:57.994654 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b42c85-ecf9-436f-be1f-a8f5d07c67f6 admin admin] PATH_INFO: `/v3/projects/8fd242c56a3f436c9cf158e68253218c` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:57.996167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b42c85-ecf9-436f-be1f-a8f5d07c67f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fd242c56a3f436c9cf158e68253218c)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:58.005432 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b42c85-ecf9-436f-be1f-a8f5d07c67f6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:58.103249 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-89b42c85-ecf9-436f-be1f-a8f5d07c67f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fd242c56a3f436c9cf158e68253218c', 'request_id': 'req-89b42c85-ecf9-436f-be1f-a8f5d07c67f6'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:58.132471 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-89b42c85-ecf9-436f-be1f-a8f5d07c67f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fd242c56a3f436c9cf158e68253218c', 'request_id': 'req-89b42c85-ecf9-436f-be1f-a8f5d07c67f6'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:58.151134 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-89b42c85-ecf9-436f-be1f-a8f5d07c67f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fd242c56a3f436c9cf158e68253218c', 'request_id': 'req-89b42c85-ecf9-436f-be1f-a8f5d07c67f6'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:58.181671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-89b42c85-ecf9-436f-be1f-a8f5d07c67f6 admin admin] The token cache is being invalidate because project 8fd242c56a3f436c9cf158e68253218c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:57:58.182045 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-89b42c85-ecf9-436f-be1f-a8f5d07c67f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:58.184545 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-89b42c85-ecf9-436f-be1f-a8f5d07c67f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:58.189034 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1363/2748] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:57:57 2022] DELETE /identity/v3/projects/8fd242c56a3f436c9cf158e68253218c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:57:58.193773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa68f6-a750-4f8a-a1c0-3e2bfbffcc82 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:58.194284 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa68f6-a750-4f8a-a1c0-3e2bfbffcc82 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:58.194284 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa68f6-a750-4f8a-a1c0-3e2bfbffcc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:58.229278 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-13fa68f6-a750-4f8a-a1c0-3e2bfbffcc82 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:57:58.230961 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-13fa68f6-a750-4f8a-a1c0-3e2bfbffcc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:58.340380 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1386/2749] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:57:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:57:58.350207 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec8571-6ab0-44bc-a0f8-ef68f2f93c1e None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:58.350797 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec8571-6ab0-44bc-a0f8-ef68f2f93c1e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:58.351320 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec8571-6ab0-44bc-a0f8-ef68f2f93c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:58.363177 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:58.384325 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-80ec8571-6ab0-44bc-a0f8-ef68f2f93c1e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:57:58.385348 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-80ec8571-6ab0-44bc-a0f8-ef68f2f93c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:58.413089 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1364/2750] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:57:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:57:58.413568 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa68f6-a750-4f8a-a1c0-3e2bfbffcc82 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:58.435943 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa68f6-a750-4f8a-a1c0-3e2bfbffcc82 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:58.444414 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987614a-8fc9-4cbf-94ab-25a6796cf004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:58.445323 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987614a-8fc9-4cbf-94ab-25a6796cf004 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:58.445825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987614a-8fc9-4cbf-94ab-25a6796cf004 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:58.446454 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987614a-8fc9-4cbf-94ab-25a6796cf004 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:58.447363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4987614a-8fc9-4cbf-94ab-25a6796cf004 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:57:58.448189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4987614a-8fc9-4cbf-94ab-25a6796cf004 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:58.450048 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4987614a-8fc9-4cbf-94ab-25a6796cf004 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:58.463527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:58.474189 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec8571-6ab0-44bc-a0f8-ef68f2f93c1e None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:58.482153 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1387/2751] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:57:58.487008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec8571-6ab0-44bc-a0f8-ef68f2f93c1e None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:58.493727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242c0b3-6c2b-4c49-bf0b-17100e0b1e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:58.494450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242c0b3-6c2b-4c49-bf0b-17100e0b1e5e admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:58.494893 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242c0b3-6c2b-4c49-bf0b-17100e0b1e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:58.495257 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242c0b3-6c2b-4c49-bf0b-17100e0b1e5e admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:58.496751 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242c0b3-6c2b-4c49-bf0b-17100e0b1e5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:58.499587 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242c0b3-6c2b-4c49-bf0b-17100e0b1e5e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:58.546617 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1365/2752] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:57:58 2022] POST /identity/v3/projects => generated 375 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:57:58.551940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987614a-8fc9-4cbf-94ab-25a6796cf004 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:58.590722 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987614a-8fc9-4cbf-94ab-25a6796cf004 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:58.640419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242c0b3-6c2b-4c49-bf0b-17100e0b1e5e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:58.645019 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b242c0b3-6c2b-4c49-bf0b-17100e0b1e5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:58.709445 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9b4d3-003f-493e-a55d-17b5c7e8f413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:58.711488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9b4d3-003f-493e-a55d-17b5c7e8f413 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:58.713218 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9b4d3-003f-493e-a55d-17b5c7e8f413 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:58.713705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9b4d3-003f-493e-a55d-17b5c7e8f413 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:58.714733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c9b4d3-003f-493e-a55d-17b5c7e8f413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:58.719140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c9b4d3-003f-493e-a55d-17b5c7e8f413 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:58.756061 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1388/2753] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:57:58 2022] POST /identity/v3/users => generated 288 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:57:58.760819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9b4d3-003f-493e-a55d-17b5c7e8f413 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:58.787697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9b4d3-003f-493e-a55d-17b5c7e8f413 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:58.801397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443b94b-0feb-449a-aa06-01115a54549a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:58.802028 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443b94b-0feb-449a-aa06-01115a54549a admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:58.802311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443b94b-0feb-449a-aa06-01115a54549a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:58.802640 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443b94b-0feb-449a-aa06-01115a54549a admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:58.803635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443b94b-0feb-449a-aa06-01115a54549a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:58.805789 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443b94b-0feb-449a-aa06-01115a54549a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:58.820344 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242c0b3-6c2b-4c49-bf0b-17100e0b1e5e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:58.833665 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1389/2754] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:57:58.835519 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443b94b-0feb-449a-aa06-01115a54549a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:58.838399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf03de1-c4bf-459c-a7ae-47ead59f6808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:58.839334 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf03de1-c4bf-459c-a7ae-47ead59f6808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:58.839774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf03de1-c4bf-459c-a7ae-47ead59f6808 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:58.840354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf03de1-c4bf-459c-a7ae-47ead59f6808 admin admin] PATH_INFO: `/v3/projects/61b980ff8dca4c84bb452d09d55c37ef` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:58.842054 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf03de1-c4bf-459c-a7ae-47ead59f6808 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61b980ff8dca4c84bb452d09d55c37ef)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:58.846047 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf03de1-c4bf-459c-a7ae-47ead59f6808 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:58.860787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443b94b-0feb-449a-aa06-01115a54549a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:58.878678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a072bc2-2354-4302-9e68-2021f30bbee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:58.879313 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a072bc2-2354-4302-9e68-2021f30bbee4 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:58.879595 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a072bc2-2354-4302-9e68-2021f30bbee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:58.879872 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a072bc2-2354-4302-9e68-2021f30bbee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:58.880522 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a072bc2-2354-4302-9e68-2021f30bbee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:58.882505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a072bc2-2354-4302-9e68-2021f30bbee4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:58.910873 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1390/2755] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:57:58.914831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a072bc2-2354-4302-9e68-2021f30bbee4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:58.935533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a072bc2-2354-4302-9e68-2021f30bbee4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:58.945376 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bdf03de1-c4bf-459c-a7ae-47ead59f6808 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61b980ff8dca4c84bb452d09d55c37ef', 'request_id': 'req-bdf03de1-c4bf-459c-a7ae-47ead59f6808'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:58.959559 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bdf03de1-c4bf-459c-a7ae-47ead59f6808 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61b980ff8dca4c84bb452d09d55c37ef', 'request_id': 'req-bdf03de1-c4bf-459c-a7ae-47ead59f6808'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:58.968578 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bdf03de1-c4bf-459c-a7ae-47ead59f6808 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61b980ff8dca4c84bb452d09d55c37ef', 'request_id': 'req-bdf03de1-c4bf-459c-a7ae-47ead59f6808'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:58.989585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bdf03de1-c4bf-459c-a7ae-47ead59f6808 admin admin] The token cache is being invalidate because project 61b980ff8dca4c84bb452d09d55c37ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:57:58.989585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bdf03de1-c4bf-459c-a7ae-47ead59f6808 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:58.990041 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bdf03de1-c4bf-459c-a7ae-47ead59f6808 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:58.992725 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1366/2756] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:57:58 2022] DELETE /identity/v3/projects/61b980ff8dca4c84bb452d09d55c37ef => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:57:58.996862 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf03de1-c4bf-459c-a7ae-47ead59f6808 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:58.999363 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-bdf03de1-c4bf-459c-a7ae-47ead59f6808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:59.065222 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34098f-1a55-47f5-af61-043d9eb10dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:59.066013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34098f-1a55-47f5-af61-043d9eb10dad admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:59.066575 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34098f-1a55-47f5-af61-043d9eb10dad admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:59.067169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34098f-1a55-47f5-af61-043d9eb10dad admin admin] PATH_INFO: `/v3/projects/6a59301a44bb4936a40bc62a7059501c/users/663839a7e8d042a39ec1a29494a99d91/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:59.104091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa34098f-1a55-47f5-af61-043d9eb10dad admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a59301a44bb4936a40bc62a7059501c, user_id=663839a7e8d042a39ec1a29494a99d91, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:59.109865 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa34098f-1a55-47f5-af61-043d9eb10dad admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:59.135155 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1391/2757] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:57:58 2022] PUT /identity/v3/projects/6a59301a44bb4936a40bc62a7059501c/users/663839a7e8d042a39ec1a29494a99d91/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:57:59.145606 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246040c7-8df2-4d86-9e66-2de27b7a0b3c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:59.148397 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf03de1-c4bf-459c-a7ae-47ead59f6808 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:59.152420 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246040c7-8df2-4d86-9e66-2de27b7a0b3c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:59.153367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246040c7-8df2-4d86-9e66-2de27b7a0b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:59.162324 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:59.220788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-246040c7-8df2-4d86-9e66-2de27b7a0b3c None None] MFA Rules not processed for user `663839a7e8d042a39ec1a29494a99d91`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:57:59.222326 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-246040c7-8df2-4d86-9e66-2de27b7a0b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:59.299045 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ee80f-74d6-4fcc-81f0-8eae6da81c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:59.299998 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ee80f-74d6-4fcc-81f0-8eae6da81c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:59.300527 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ee80f-74d6-4fcc-81f0-8eae6da81c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:59.301325 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ee80f-74d6-4fcc-81f0-8eae6da81c47 admin admin] PATH_INFO: `/v3/users/7004eb9df0824403a47f7b26d5eaf89c` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:59.305703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ee80f-74d6-4fcc-81f0-8eae6da81c47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7004eb9df0824403a47f7b26d5eaf89c)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:59.310045 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ee80f-74d6-4fcc-81f0-8eae6da81c47 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:59.339952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:59.427787 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1392/2758] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:57:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:57:59.435131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad15978-0b23-4b9b-882f-1730023e6f1d None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:59.440522 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad15978-0b23-4b9b-882f-1730023e6f1d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:59.440984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad15978-0b23-4b9b-882f-1730023e6f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:59.469003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-238ee80f-74d6-4fcc-81f0-8eae6da81c47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7004eb9df0824403a47f7b26d5eaf89c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:59.469947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-238ee80f-74d6-4fcc-81f0-8eae6da81c47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7004eb9df0824403a47f7b26d5eaf89c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:59.471175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-238ee80f-74d6-4fcc-81f0-8eae6da81c47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7004eb9df0824403a47f7b26d5eaf89c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:59.492477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-238ee80f-74d6-4fcc-81f0-8eae6da81c47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7004eb9df0824403a47f7b26d5eaf89c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:59.545200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-238ee80f-74d6-4fcc-81f0-8eae6da81c47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7004eb9df0824403a47f7b26d5eaf89c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:57:59.577591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-bad15978-0b23-4b9b-882f-1730023e6f1d None None] MFA Rules not processed for user `d43d0d15118242b7a60cc34c512fbe5e`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:57:59.580272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-bad15978-0b23-4b9b-882f-1730023e6f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:59.588496 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1367/2759] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:57:58 2022] DELETE /identity/v3/users/7004eb9df0824403a47f7b26d5eaf89c => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:57:59.590325 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ee80f-74d6-4fcc-81f0-8eae6da81c47 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:59.605696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-238ee80f-74d6-4fcc-81f0-8eae6da81c47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:59.808635 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1393/2760] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:57:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:57:59.816920 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ee80f-74d6-4fcc-81f0-8eae6da81c47 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:59.821572 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57890b-22b8-4105-9da6-d9fbf65fd410 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:59.822061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57890b-22b8-4105-9da6-d9fbf65fd410 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:59.822442 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57890b-22b8-4105-9da6-d9fbf65fd410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:59.832596 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f99a2-21fe-449b-ac62-556268fb2e70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:59.833390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f99a2-21fe-449b-ac62-556268fb2e70 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:59.833676 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f99a2-21fe-449b-ac62-556268fb2e70 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:59.834476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f99a2-21fe-449b-ac62-556268fb2e70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:59.841789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-587f99a2-21fe-449b-ac62-556268fb2e70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:59.849558 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-ba57890b-22b8-4105-9da6-d9fbf65fd410 None None] MFA Rules not processed for user `d43d0d15118242b7a60cc34c512fbe5e`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:57:59.851873 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ba57890b-22b8-4105-9da6-d9fbf65fd410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:59.862023 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1394/2761] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:57:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:57:59.920150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:59.977726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f99a2-21fe-449b-ac62-556268fb2e70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:59.979690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f99a2-21fe-449b-ac62-556268fb2e70 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:59.993905 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1368/2762] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:57:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:58:00.519597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57890b-22b8-4105-9da6-d9fbf65fd410 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:00.550242 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57890b-22b8-4105-9da6-d9fbf65fd410 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:00.568081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b22d7a-9127-4be0-b5e6-6d86837b2c51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:00.570199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b22d7a-9127-4be0-b5e6-6d86837b2c51 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:00.572410 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b22d7a-9127-4be0-b5e6-6d86837b2c51 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:00.573185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b22d7a-9127-4be0-b5e6-6d86837b2c51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:00.606586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b22d7a-9127-4be0-b5e6-6d86837b2c51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:00.620463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b22d7a-9127-4be0-b5e6-6d86837b2c51 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:00.674217 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1395/2763] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:58:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:58:01.080258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f99a2-21fe-449b-ac62-556268fb2e70 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:01.088962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-587f99a2-21fe-449b-ac62-556268fb2e70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:01.280476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f99a2-21fe-449b-ac62-556268fb2e70 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:01.286002 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d0da0-d70f-43ca-9443-08130873b5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:01.286791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d0da0-d70f-43ca-9443-08130873b5e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:01.287079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d0da0-d70f-43ca-9443-08130873b5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:01.287409 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d0da0-d70f-43ca-9443-08130873b5e4 admin admin] PATH_INFO: `/v3/projects/eb76102372d64079b3571e92331e77ae` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:01.288578 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d0da0-d70f-43ca-9443-08130873b5e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb76102372d64079b3571e92331e77ae)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:01.292031 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d0da0-d70f-43ca-9443-08130873b5e4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:01.375118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-df2d0da0-d70f-43ca-9443-08130873b5e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb76102372d64079b3571e92331e77ae', 'request_id': 'req-df2d0da0-d70f-43ca-9443-08130873b5e4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:01.388979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-df2d0da0-d70f-43ca-9443-08130873b5e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb76102372d64079b3571e92331e77ae', 'request_id': 'req-df2d0da0-d70f-43ca-9443-08130873b5e4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:01.401566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-df2d0da0-d70f-43ca-9443-08130873b5e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb76102372d64079b3571e92331e77ae', 'request_id': 'req-df2d0da0-d70f-43ca-9443-08130873b5e4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:01.423310 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-df2d0da0-d70f-43ca-9443-08130873b5e4 admin admin] The token cache is being invalidate because project eb76102372d64079b3571e92331e77ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:58:01.423833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-df2d0da0-d70f-43ca-9443-08130873b5e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:01.425269 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-df2d0da0-d70f-43ca-9443-08130873b5e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:01.427312 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1369/2764] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:58:01 2022] DELETE /identity/v3/projects/eb76102372d64079b3571e92331e77ae => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:58:01.433373 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9af445-effb-464d-ac18-ed3be815e858 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:01.433679 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9af445-effb-464d-ac18-ed3be815e858 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:01.433976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9af445-effb-464d-ac18-ed3be815e858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:01.469213 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-1e9af445-effb-464d-ac18-ed3be815e858 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:58:01.471301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1e9af445-effb-464d-ac18-ed3be815e858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:01.599750 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1396/2765] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:58:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:58:01.607585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9217616-a619-475c-98bb-524c75f02053 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:01.607948 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9217616-a619-475c-98bb-524c75f02053 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:01.608738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9217616-a619-475c-98bb-524c75f02053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:01.697508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-e9217616-a619-475c-98bb-524c75f02053 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:58:01.698514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e9217616-a619-475c-98bb-524c75f02053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:01.732732 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1370/2766] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:58:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:58:01.738008 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9af445-effb-464d-ac18-ed3be815e858 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:01.760490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9af445-effb-464d-ac18-ed3be815e858 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:01.775299 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a98bd-d5ea-4ef1-ab37-a07aa38ed0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:01.777536 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a98bd-d5ea-4ef1-ab37-a07aa38ed0cb admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:01.778467 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a98bd-d5ea-4ef1-ab37-a07aa38ed0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:01.780680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a98bd-d5ea-4ef1-ab37-a07aa38ed0cb admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:01.782709 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a98bd-d5ea-4ef1-ab37-a07aa38ed0cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:58:01.783502 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a98bd-d5ea-4ef1-ab37-a07aa38ed0cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:01.787383 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a98bd-d5ea-4ef1-ab37-a07aa38ed0cb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:01.819556 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1397/2767] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:58:01.820639 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9217616-a619-475c-98bb-524c75f02053 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:01.847263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9217616-a619-475c-98bb-524c75f02053 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:01.882628 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22516c59-084b-4e43-a087-5a5f63af7129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:01.886097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22516c59-084b-4e43-a087-5a5f63af7129 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:01.886421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22516c59-084b-4e43-a087-5a5f63af7129 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:01.886691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22516c59-084b-4e43-a087-5a5f63af7129 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:01.887348 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22516c59-084b-4e43-a087-5a5f63af7129 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:01.893886 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22516c59-084b-4e43-a087-5a5f63af7129 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:01.963051 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1371/2768] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:58:01 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:58:01.964577 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a98bd-d5ea-4ef1-ab37-a07aa38ed0cb admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:01.999828 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a98bd-d5ea-4ef1-ab37-a07aa38ed0cb admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:02.097906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:02.225993 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0aa05-ffe8-4e01-a8eb-f16b6a934f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:02.227004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0aa05-ffe8-4e01-a8eb-f16b6a934f9b admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:02.227666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0aa05-ffe8-4e01-a8eb-f16b6a934f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:02.227946 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0aa05-ffe8-4e01-a8eb-f16b6a934f9b admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:02.231033 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0aa05-ffe8-4e01-a8eb-f16b6a934f9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:02.234437 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0aa05-ffe8-4e01-a8eb-f16b6a934f9b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:02.328693 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1398/2769] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:58:01 2022] POST /identity/v3/users => generated 287 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:58:02.331072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22516c59-084b-4e43-a087-5a5f63af7129 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:02.349387 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22516c59-084b-4e43-a087-5a5f63af7129 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:02.374853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1bf1d9-16cf-4eab-b1dc-54aed4374945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:02.381739 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1bf1d9-16cf-4eab-b1dc-54aed4374945 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:02.382370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1bf1d9-16cf-4eab-b1dc-54aed4374945 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:02.383360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1bf1d9-16cf-4eab-b1dc-54aed4374945 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:02.390338 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1bf1d9-16cf-4eab-b1dc-54aed4374945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:02.396879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1bf1d9-16cf-4eab-b1dc-54aed4374945 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:02.421408 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1372/2770] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:58:02.426355 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0aa05-ffe8-4e01-a8eb-f16b6a934f9b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:02.451887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0aa05-ffe8-4e01-a8eb-f16b6a934f9b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:02.475269 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96f619-3b13-4857-b6a8-f4d4dbd274a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:02.475918 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96f619-3b13-4857-b6a8-f4d4dbd274a7 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:02.476203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96f619-3b13-4857-b6a8-f4d4dbd274a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:02.476523 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96f619-3b13-4857-b6a8-f4d4dbd274a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:02.477180 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e96f619-3b13-4857-b6a8-f4d4dbd274a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:02.485906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e96f619-3b13-4857-b6a8-f4d4dbd274a7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:02.510372 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1399/2771] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:58:02.515122 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1bf1d9-16cf-4eab-b1dc-54aed4374945 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:02.529188 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1bf1d9-16cf-4eab-b1dc-54aed4374945 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:02.542423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a6364-5817-47d6-8feb-80c446d06035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:02.543549 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a6364-5817-47d6-8feb-80c446d06035 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:02.544233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a6364-5817-47d6-8feb-80c446d06035 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:02.545453 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a6364-5817-47d6-8feb-80c446d06035 admin admin] PATH_INFO: `/v3/projects/9129b06bfc47457c954b8c5af61bdb7e/users/ad26fc0c618f4a548c64863f640dcf95/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:02.614361 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a6364-5817-47d6-8feb-80c446d06035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9129b06bfc47457c954b8c5af61bdb7e, user_id=ad26fc0c618f4a548c64863f640dcf95, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:02.618011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a6364-5817-47d6-8feb-80c446d06035 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:02.645801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:02.689373 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1373/2772] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:58:02 2022] PUT /identity/v3/projects/9129b06bfc47457c954b8c5af61bdb7e/users/ad26fc0c618f4a548c64863f640dcf95/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:58:02.700624 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe3708-0e00-4365-9943-b3877a917b58 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:02.701183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe3708-0e00-4365-9943-b3877a917b58 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:02.702084 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe3708-0e00-4365-9943-b3877a917b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:02.773453 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d7fe3708-0e00-4365-9943-b3877a917b58 None None] MFA Rules not processed for user `ad26fc0c618f4a548c64863f640dcf95`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:58:02.775018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d7fe3708-0e00-4365-9943-b3877a917b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:02.976291 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1400/2773] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:58:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:58:02.980291 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a6364-5817-47d6-8feb-80c446d06035 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:03.130990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a6364-5817-47d6-8feb-80c446d06035 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:03.140001 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e952c2-8766-4da9-8bea-fd3d817c20f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:03.141123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e952c2-8766-4da9-8bea-fd3d817c20f8 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:03.141587 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e952c2-8766-4da9-8bea-fd3d817c20f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:03.142186 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e952c2-8766-4da9-8bea-fd3d817c20f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:03.143561 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e952c2-8766-4da9-8bea-fd3d817c20f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:03.151467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e952c2-8766-4da9-8bea-fd3d817c20f8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:03.200105 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1374/2774] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:58:02 2022] POST /identity/v3/projects => generated 377 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:58:03.204760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe3708-0e00-4365-9943-b3877a917b58 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:03.220628 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe3708-0e00-4365-9943-b3877a917b58 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:03.379357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93636b-05a3-4389-a8a3-1c1f996e3dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:03.381834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93636b-05a3-4389-a8a3-1c1f996e3dae admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:03.382937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93636b-05a3-4389-a8a3-1c1f996e3dae admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:03.383374 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93636b-05a3-4389-a8a3-1c1f996e3dae admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:03.385141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93636b-05a3-4389-a8a3-1c1f996e3dae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:03.387478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93636b-05a3-4389-a8a3-1c1f996e3dae admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:03.419479 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1401/2775] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:58:03 2022] POST /identity/v3/users => generated 295 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:58:03.424236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e952c2-8766-4da9-8bea-fd3d817c20f8 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:03.440601 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e952c2-8766-4da9-8bea-fd3d817c20f8 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:03.449808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c363fed-2440-4365-b4a9-ea4a2bd64d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:03.450741 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c363fed-2440-4365-b4a9-ea4a2bd64d9f admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:03.451254 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c363fed-2440-4365-b4a9-ea4a2bd64d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:03.451972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c363fed-2440-4365-b4a9-ea4a2bd64d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:03.452858 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c363fed-2440-4365-b4a9-ea4a2bd64d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:03.455078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c363fed-2440-4365-b4a9-ea4a2bd64d9f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:03.472521 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1375/2776] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:58:03.476857 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93636b-05a3-4389-a8a3-1c1f996e3dae admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:03.492284 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93636b-05a3-4389-a8a3-1c1f996e3dae admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:03.503435 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072f5be-e52d-4098-83fd-0ef939637ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:03.504399 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072f5be-e52d-4098-83fd-0ef939637ad8 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:03.504688 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072f5be-e52d-4098-83fd-0ef939637ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:03.504962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072f5be-e52d-4098-83fd-0ef939637ad8 admin admin] PATH_INFO: `/v3/projects/55640d69a22642dcbb738feb426e874c/users/07214bd7590946e2afe5104b0a6c029f/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:03.543580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072f5be-e52d-4098-83fd-0ef939637ad8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55640d69a22642dcbb738feb426e874c, user_id=07214bd7590946e2afe5104b0a6c029f, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:03.543782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072f5be-e52d-4098-83fd-0ef939637ad8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:03.581352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c363fed-2440-4365-b4a9-ea4a2bd64d9f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:03.582195 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1402/2777] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:58:03 2022] PUT /identity/v3/projects/55640d69a22642dcbb738feb426e874c/users/07214bd7590946e2afe5104b0a6c029f/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:58:03.596004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c363fed-2440-4365-b4a9-ea4a2bd64d9f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:03.679945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f66993-ca7b-4810-a2ef-b01758ba2cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:03.680780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f66993-ca7b-4810-a2ef-b01758ba2cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:03.683150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f66993-ca7b-4810-a2ef-b01758ba2cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:03.683607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f66993-ca7b-4810-a2ef-b01758ba2cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:03.685118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f66993-ca7b-4810-a2ef-b01758ba2cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:03.688082 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f66993-ca7b-4810-a2ef-b01758ba2cb1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:03.712998 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072f5be-e52d-4098-83fd-0ef939637ad8 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:03.719906 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1376/2778] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:58:03.728872 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072f5be-e52d-4098-83fd-0ef939637ad8 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:03.743374 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97459b9d-0ffa-4d2d-8c21-881f1b86a32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:03.744494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97459b9d-0ffa-4d2d-8c21-881f1b86a32c admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:03.744935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97459b9d-0ffa-4d2d-8c21-881f1b86a32c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:03.745367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97459b9d-0ffa-4d2d-8c21-881f1b86a32c admin admin] PATH_INFO: `/v3/projects/55640d69a22642dcbb738feb426e874c/users/07214bd7590946e2afe5104b0a6c029f/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:03.747891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97459b9d-0ffa-4d2d-8c21-881f1b86a32c admin admin] RBAC: Authorizing `identity:create_grant(project_id=55640d69a22642dcbb738feb426e874c, user_id=07214bd7590946e2afe5104b0a6c029f, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:03.751191 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97459b9d-0ffa-4d2d-8c21-881f1b86a32c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:03.770522 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:03.802196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f045a-78d1-4767-a945-2bed1dc0764e None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:03.802754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f045a-78d1-4767-a945-2bed1dc0764e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:03.802860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f045a-78d1-4767-a945-2bed1dc0764e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:03.805566 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1403/2779] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:58:03 2022] PUT /identity/v3/projects/55640d69a22642dcbb738feb426e874c/users/07214bd7590946e2afe5104b0a6c029f/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:58:03.857054 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-712f045a-78d1-4767-a945-2bed1dc0764e None None] MFA Rules not processed for user `07214bd7590946e2afe5104b0a6c029f`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:58:03.859196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-712f045a-78d1-4767-a945-2bed1dc0764e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:04.018419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:04.066954 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1377/2780] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:58:03 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:58:04.087044 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f75bc1-3a5d-4d28-8302-0b34ae3a12d3 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:04.087333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f75bc1-3a5d-4d28-8302-0b34ae3a12d3 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:04.087666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f75bc1-3a5d-4d28-8302-0b34ae3a12d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:04.120692 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-83f75bc1-3a5d-4d28-8302-0b34ae3a12d3 None None] MFA Rules not processed for user `ad26fc0c618f4a548c64863f640dcf95`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:58:04.123319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-83f75bc1-3a5d-4d28-8302-0b34ae3a12d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:04.312635 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1404/2781] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:58:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:58:04.621101 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f045a-78d1-4767-a945-2bed1dc0764e None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:04.623811 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-712f045a-78d1-4767-a945-2bed1dc0764e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:04.749352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f045a-78d1-4767-a945-2bed1dc0764e None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:04.759567 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501af86b-181a-4fd7-8033-ef11764b8780 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:04.761351 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501af86b-181a-4fd7-8033-ef11764b8780 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:04.765097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501af86b-181a-4fd7-8033-ef11764b8780 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:04.765097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501af86b-181a-4fd7-8033-ef11764b8780 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:04.776542 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501af86b-181a-4fd7-8033-ef11764b8780 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:04.778516 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501af86b-181a-4fd7-8033-ef11764b8780 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:04.791403 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1378/2782] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:58:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:58:07.100752 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9480a9b-b700-4ee2-8eb4-37d727a1a75c None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:07.101336 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9480a9b-b700-4ee2-8eb4-37d727a1a75c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:07.101336 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9480a9b-b700-4ee2-8eb4-37d727a1a75c None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:07.103032 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1405/2783] 10.222.0.33 () {54 vars in 921 bytes} [Sat Aug 6 20:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:58:07.120034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156048f-d89f-4ca7-9bc3-3b0773f5b7a2 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:07.120999 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156048f-d89f-4ca7-9bc3-3b0773f5b7a2 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:07.121489 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156048f-d89f-4ca7-9bc3-3b0773f5b7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:07.176120 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-2156048f-d89f-4ca7-9bc3-3b0773f5b7a2 None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:58:07.177538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2156048f-d89f-4ca7-9bc3-3b0773f5b7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:07.348953 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1379/2784] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 20:58:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:58:07.378332 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9480a9b-b700-4ee2-8eb4-37d727a1a75c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:07.380233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e9480a9b-b700-4ee2-8eb4-37d727a1a75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:07.416436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9480a9b-b700-4ee2-8eb4-37d727a1a75c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:07.429262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c40ab7-a93e-4fe7-8429-a659559cffad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:07.429933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c40ab7-a93e-4fe7-8429-a659559cffad service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:07.430237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c40ab7-a93e-4fe7-8429-a659559cffad service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:07.430485 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c40ab7-a93e-4fe7-8429-a659559cffad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:07.456910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c40ab7-a93e-4fe7-8429-a659559cffad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:07.459287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c40ab7-a93e-4fe7-8429-a659559cffad service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:07.480587 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1406/2785] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:58:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:58:09.211779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156048f-d89f-4ca7-9bc3-3b0773f5b7a2 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:09.213629 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2156048f-d89f-4ca7-9bc3-3b0773f5b7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:09.302826 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156048f-d89f-4ca7-9bc3-3b0773f5b7a2 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:09.307940 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38d0b9-1aff-4cb9-9249-8dc2f7b9ce13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:09.309226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38d0b9-1aff-4cb9-9249-8dc2f7b9ce13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:09.309512 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38d0b9-1aff-4cb9-9249-8dc2f7b9ce13 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:09.309791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38d0b9-1aff-4cb9-9249-8dc2f7b9ce13 admin admin] PATH_INFO: `/v3/users/663839a7e8d042a39ec1a29494a99d91` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:09.311859 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38d0b9-1aff-4cb9-9249-8dc2f7b9ce13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=663839a7e8d042a39ec1a29494a99d91)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:09.313984 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38d0b9-1aff-4cb9-9249-8dc2f7b9ce13 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:09.331619 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:09.396224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4f38d0b9-1aff-4cb9-9249-8dc2f7b9ce13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '663839a7e8d042a39ec1a29494a99d91'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:09.396875 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4f38d0b9-1aff-4cb9-9249-8dc2f7b9ce13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '663839a7e8d042a39ec1a29494a99d91'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:09.397484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4f38d0b9-1aff-4cb9-9249-8dc2f7b9ce13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '663839a7e8d042a39ec1a29494a99d91'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:09.406824 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4f38d0b9-1aff-4cb9-9249-8dc2f7b9ce13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '663839a7e8d042a39ec1a29494a99d91'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:09.424940 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4f38d0b9-1aff-4cb9-9249-8dc2f7b9ce13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '663839a7e8d042a39ec1a29494a99d91'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:09.447118 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1380/2786] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:58:09 2022] DELETE /identity/v3/users/663839a7e8d042a39ec1a29494a99d91 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:58:09.452640 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701e8e9-1bcb-4aa2-904d-a8e2e342c9fb None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:09.453157 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701e8e9-1bcb-4aa2-904d-a8e2e342c9fb None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:09.453242 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701e8e9-1bcb-4aa2-904d-a8e2e342c9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:09.497367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-7701e8e9-1bcb-4aa2-904d-a8e2e342c9fb None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:58:09.503594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7701e8e9-1bcb-4aa2-904d-a8e2e342c9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:09.644620 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1407/2787] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:58:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:58:09.700660 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3d7ac-3e84-4091-b365-0a0c71bf4ceb None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:09.701074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3d7ac-3e84-4091-b365-0a0c71bf4ceb None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:09.701414 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3d7ac-3e84-4091-b365-0a0c71bf4ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:09.722025 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701e8e9-1bcb-4aa2-904d-a8e2e342c9fb None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:09.724316 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7701e8e9-1bcb-4aa2-904d-a8e2e342c9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:09.725830 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-2fc3d7ac-3e84-4091-b365-0a0c71bf4ceb None None] MFA Rules not processed for user `343f309c07e343b4b15268472d19f10c`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:58:09.727118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2fc3d7ac-3e84-4091-b365-0a0c71bf4ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:09.811994 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1381/2788] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:58:09 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:58:09.824349 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701e8e9-1bcb-4aa2-904d-a8e2e342c9fb None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:09.828826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945743c-e9e9-452f-ab8e-9a1888e39997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:09.829439 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945743c-e9e9-452f-ab8e-9a1888e39997 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:09.830024 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945743c-e9e9-452f-ab8e-9a1888e39997 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:09.830281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945743c-e9e9-452f-ab8e-9a1888e39997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:09.847400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945743c-e9e9-452f-ab8e-9a1888e39997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:09.849308 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945743c-e9e9-452f-ab8e-9a1888e39997 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:09.863810 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1408/2789] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:58:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:58:10.827555 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3d7ac-3e84-4091-b365-0a0c71bf4ceb None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:10.829041 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2fc3d7ac-3e84-4091-b365-0a0c71bf4ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:10.869397 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3d7ac-3e84-4091-b365-0a0c71bf4ceb None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:10.887462 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b588880-9eda-462c-a45f-ef8fbf55795c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:10.888359 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b588880-9eda-462c-a45f-ef8fbf55795c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:10.888862 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b588880-9eda-462c-a45f-ef8fbf55795c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:10.889311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b588880-9eda-462c-a45f-ef8fbf55795c admin admin] PATH_INFO: `/v3/projects/6a59301a44bb4936a40bc62a7059501c` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:10.890963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b588880-9eda-462c-a45f-ef8fbf55795c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a59301a44bb4936a40bc62a7059501c)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:10.893215 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b588880-9eda-462c-a45f-ef8fbf55795c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:11.009899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4b588880-9eda-462c-a45f-ef8fbf55795c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a59301a44bb4936a40bc62a7059501c', 'request_id': 'req-4b588880-9eda-462c-a45f-ef8fbf55795c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:11.027334 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4b588880-9eda-462c-a45f-ef8fbf55795c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a59301a44bb4936a40bc62a7059501c', 'request_id': 'req-4b588880-9eda-462c-a45f-ef8fbf55795c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:11.059537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4b588880-9eda-462c-a45f-ef8fbf55795c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a59301a44bb4936a40bc62a7059501c', 'request_id': 'req-4b588880-9eda-462c-a45f-ef8fbf55795c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:11.084029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4b588880-9eda-462c-a45f-ef8fbf55795c admin admin] The token cache is being invalidate because project 6a59301a44bb4936a40bc62a7059501c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:58:11.084526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4b588880-9eda-462c-a45f-ef8fbf55795c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:11.087321 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4b588880-9eda-462c-a45f-ef8fbf55795c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:11.091103 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1382/2790] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:58:10 2022] DELETE /identity/v3/projects/6a59301a44bb4936a40bc62a7059501c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:58:11.099571 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd950348-cec7-4953-807f-74cd1b59d6ff None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:11.100517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd950348-cec7-4953-807f-74cd1b59d6ff None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:11.100971 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd950348-cec7-4953-807f-74cd1b59d6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:11.157026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-bd950348-cec7-4953-807f-74cd1b59d6ff None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:58:11.158279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-bd950348-cec7-4953-807f-74cd1b59d6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:11.221027 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:11.282061 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1409/2791] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:58:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:58:11.289628 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5d6ad-3b2d-4020-85a4-bad2886a672b None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:11.289936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5d6ad-3b2d-4020-85a4-bad2886a672b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:11.290215 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5d6ad-3b2d-4020-85a4-bad2886a672b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:11.337732 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f7e5d6ad-3b2d-4020-85a4-bad2886a672b None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:58:11.342581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f7e5d6ad-3b2d-4020-85a4-bad2886a672b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:11.361931 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1383/2792] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:58:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:58:11.366251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd950348-cec7-4953-807f-74cd1b59d6ff None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:11.380466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd950348-cec7-4953-807f-74cd1b59d6ff None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:11.396898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b28c50-8f34-4b2a-94aa-08abc98f1371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:11.397852 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b28c50-8f34-4b2a-94aa-08abc98f1371 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:11.398234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b28c50-8f34-4b2a-94aa-08abc98f1371 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:11.398713 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b28c50-8f34-4b2a-94aa-08abc98f1371 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:11.400310 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b28c50-8f34-4b2a-94aa-08abc98f1371 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:58:11.402411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b28c50-8f34-4b2a-94aa-08abc98f1371 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:11.406135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b28c50-8f34-4b2a-94aa-08abc98f1371 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:11.433259 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1410/2793] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:58:11.438342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5d6ad-3b2d-4020-85a4-bad2886a672b None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:11.455389 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5d6ad-3b2d-4020-85a4-bad2886a672b None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:11.481081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae61ee-68ae-4c7d-95c4-1f000342b6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:11.481081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae61ee-68ae-4c7d-95c4-1f000342b6e4 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:11.481745 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae61ee-68ae-4c7d-95c4-1f000342b6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:11.481745 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae61ee-68ae-4c7d-95c4-1f000342b6e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:11.482855 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae61ee-68ae-4c7d-95c4-1f000342b6e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:11.491707 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae61ee-68ae-4c7d-95c4-1f000342b6e4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:11.514476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:11.551012 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1384/2794] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:58:11 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:58:11.552348 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b28c50-8f34-4b2a-94aa-08abc98f1371 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:11.565324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b28c50-8f34-4b2a-94aa-08abc98f1371 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:11.697473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b6c8d-3f2b-4e1d-83fb-20f7036c677b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:11.698257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b6c8d-3f2b-4e1d-83fb-20f7036c677b admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:11.698566 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b6c8d-3f2b-4e1d-83fb-20f7036c677b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:11.698843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b6c8d-3f2b-4e1d-83fb-20f7036c677b admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:11.699648 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b6c8d-3f2b-4e1d-83fb-20f7036c677b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:11.702149 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b6c8d-3f2b-4e1d-83fb-20f7036c677b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:11.735769 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1411/2795] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:58:11 2022] POST /identity/v3/users => generated 288 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:58:11.740168 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae61ee-68ae-4c7d-95c4-1f000342b6e4 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:11.769814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae61ee-68ae-4c7d-95c4-1f000342b6e4 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:11.785662 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e092a7-ea69-4718-bc31-9bab531b4457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:11.788043 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e092a7-ea69-4718-bc31-9bab531b4457 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:11.788043 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e092a7-ea69-4718-bc31-9bab531b4457 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:11.788043 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e092a7-ea69-4718-bc31-9bab531b4457 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:11.792162 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e092a7-ea69-4718-bc31-9bab531b4457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:11.793924 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e092a7-ea69-4718-bc31-9bab531b4457 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:11.818731 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b6c8d-3f2b-4e1d-83fb-20f7036c677b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:11.833402 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1385/2796] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:58:11.838117 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b6c8d-3f2b-4e1d-83fb-20f7036c677b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:11.851458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b0318-530f-4593-999e-fec09f7f808c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:11.851609 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b0318-530f-4593-999e-fec09f7f808c admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:11.851936 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b0318-530f-4593-999e-fec09f7f808c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:11.852222 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b0318-530f-4593-999e-fec09f7f808c admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:11.852856 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b0318-530f-4593-999e-fec09f7f808c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:11.855290 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b0318-530f-4593-999e-fec09f7f808c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:11.874299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e092a7-ea69-4718-bc31-9bab531b4457 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:11.875182 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1412/2797] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:58:11.887582 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e092a7-ea69-4718-bc31-9bab531b4457 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:11.894607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c491fa6-35de-433b-8c0c-9e2d60fcb19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:11.895583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c491fa6-35de-433b-8c0c-9e2d60fcb19b admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:11.896017 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c491fa6-35de-433b-8c0c-9e2d60fcb19b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:11.896695 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c491fa6-35de-433b-8c0c-9e2d60fcb19b admin admin] PATH_INFO: `/v3/projects/710cf2b1bc504e8090132ca97890a791/users/91d180c9584c49b296a1db51fbe50694/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:11.914827 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c491fa6-35de-433b-8c0c-9e2d60fcb19b admin admin] RBAC: Authorizing `identity:create_grant(project_id=710cf2b1bc504e8090132ca97890a791, user_id=91d180c9584c49b296a1db51fbe50694, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:11.918751 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c491fa6-35de-433b-8c0c-9e2d60fcb19b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:11.949410 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00094d-0d30-4190-94f6-4e46be8641b4 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:11.949888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00094d-0d30-4190-94f6-4e46be8641b4 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:11.950283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00094d-0d30-4190-94f6-4e46be8641b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:11.959630 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1386/2798] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:58:11 2022] PUT /identity/v3/projects/710cf2b1bc504e8090132ca97890a791/users/91d180c9584c49b296a1db51fbe50694/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:58:11.980724 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-2f00094d-0d30-4190-94f6-4e46be8641b4 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:58:11.983567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2f00094d-0d30-4190-94f6-4e46be8641b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:12.092978 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1413/2799] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:58:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:58:12.153817 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c491fa6-35de-433b-8c0c-9e2d60fcb19b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:12.155951 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9c491fa6-35de-433b-8c0c-9e2d60fcb19b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:12.287234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c491fa6-35de-433b-8c0c-9e2d60fcb19b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:12.292749 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82708f-e740-4469-8e6f-5be989abdc38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:12.293514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82708f-e740-4469-8e6f-5be989abdc38 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:12.293815 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82708f-e740-4469-8e6f-5be989abdc38 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:12.294065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82708f-e740-4469-8e6f-5be989abdc38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:12.306319 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82708f-e740-4469-8e6f-5be989abdc38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:12.307863 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82708f-e740-4469-8e6f-5be989abdc38 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:12.322399 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1387/2800] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:58:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:58:20.668184 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00094d-0d30-4190-94f6-4e46be8641b4 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:20.669811 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2f00094d-0d30-4190-94f6-4e46be8641b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:20.694303 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00094d-0d30-4190-94f6-4e46be8641b4 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:20.707892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314bbb64-e0cb-4710-8acd-c897e276afe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:20.708553 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314bbb64-e0cb-4710-8acd-c897e276afe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:20.708834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314bbb64-e0cb-4710-8acd-c897e276afe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:20.709110 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314bbb64-e0cb-4710-8acd-c897e276afe8 admin admin] PATH_INFO: `/v3/users/4604780fce5b4ece8cb20354efb53569` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:20.713346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314bbb64-e0cb-4710-8acd-c897e276afe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4604780fce5b4ece8cb20354efb53569)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:20.718270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314bbb64-e0cb-4710-8acd-c897e276afe8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:20.799334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:20.829382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-314bbb64-e0cb-4710-8acd-c897e276afe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4604780fce5b4ece8cb20354efb53569'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:20.853170 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-314bbb64-e0cb-4710-8acd-c897e276afe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4604780fce5b4ece8cb20354efb53569'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:20.853961 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-314bbb64-e0cb-4710-8acd-c897e276afe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4604780fce5b4ece8cb20354efb53569'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:20.855169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-314bbb64-e0cb-4710-8acd-c897e276afe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4604780fce5b4ece8cb20354efb53569'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:20.871429 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-314bbb64-e0cb-4710-8acd-c897e276afe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4604780fce5b4ece8cb20354efb53569'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:20.912856 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1414/2801] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:58:20 2022] DELETE /identity/v3/users/4604780fce5b4ece8cb20354efb53569 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:58:21.194221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82708f-e740-4469-8e6f-5be989abdc38 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:21.226260 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82708f-e740-4469-8e6f-5be989abdc38 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:21.302131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebcf354-d333-4559-958c-565266e05f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:21.303513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebcf354-d333-4559-958c-565266e05f4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:21.303978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebcf354-d333-4559-958c-565266e05f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:21.304351 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebcf354-d333-4559-958c-565266e05f4d admin admin] PATH_INFO: `/v3/projects/2eff0aae88974b5a893b71e0d6b34257` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:21.307383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebcf354-d333-4559-958c-565266e05f4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2eff0aae88974b5a893b71e0d6b34257)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:21.309177 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebcf354-d333-4559-958c-565266e05f4d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:21.531243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1ebcf354-d333-4559-958c-565266e05f4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2eff0aae88974b5a893b71e0d6b34257', 'request_id': 'req-1ebcf354-d333-4559-958c-565266e05f4d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:21.543202 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1ebcf354-d333-4559-958c-565266e05f4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2eff0aae88974b5a893b71e0d6b34257', 'request_id': 'req-1ebcf354-d333-4559-958c-565266e05f4d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:21.548659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:21.557997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1ebcf354-d333-4559-958c-565266e05f4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2eff0aae88974b5a893b71e0d6b34257', 'request_id': 'req-1ebcf354-d333-4559-958c-565266e05f4d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:21.587012 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1ebcf354-d333-4559-958c-565266e05f4d admin admin] The token cache is being invalidate because project 2eff0aae88974b5a893b71e0d6b34257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:58:21.587300 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1ebcf354-d333-4559-958c-565266e05f4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:21.588043 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1ebcf354-d333-4559-958c-565266e05f4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:21.593660 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1388/2802] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:58:21 2022] DELETE /identity/v3/projects/2eff0aae88974b5a893b71e0d6b34257 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:58:21.594910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314bbb64-e0cb-4710-8acd-c897e276afe8 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:21.596666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-314bbb64-e0cb-4710-8acd-c897e276afe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:21.629813 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314bbb64-e0cb-4710-8acd-c897e276afe8 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:21.827009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a733503-71b5-45ba-b8ba-68dbd6ac34c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:21.830150 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a733503-71b5-45ba-b8ba-68dbd6ac34c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:21.831734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a733503-71b5-45ba-b8ba-68dbd6ac34c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:21.833504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a733503-71b5-45ba-b8ba-68dbd6ac34c7 admin admin] PATH_INFO: `/v3/users/b71dd466b4d140448e8bb188f9e72901` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:21.838113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a733503-71b5-45ba-b8ba-68dbd6ac34c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b71dd466b4d140448e8bb188f9e72901)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:21.845389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a733503-71b5-45ba-b8ba-68dbd6ac34c7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:22.047559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3a733503-71b5-45ba-b8ba-68dbd6ac34c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b71dd466b4d140448e8bb188f9e72901'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:22.062142 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3a733503-71b5-45ba-b8ba-68dbd6ac34c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b71dd466b4d140448e8bb188f9e72901'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:22.063684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3a733503-71b5-45ba-b8ba-68dbd6ac34c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b71dd466b4d140448e8bb188f9e72901'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:22.064721 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3a733503-71b5-45ba-b8ba-68dbd6ac34c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b71dd466b4d140448e8bb188f9e72901'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:22.082863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3a733503-71b5-45ba-b8ba-68dbd6ac34c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b71dd466b4d140448e8bb188f9e72901'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:22.158812 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1415/2803] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:58:21 2022] DELETE /identity/v3/users/b71dd466b4d140448e8bb188f9e72901 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:58:22.176481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18cfcf-d380-47c6-bd2e-698691a384e0 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:22.176772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18cfcf-d380-47c6-bd2e-698691a384e0 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:22.177054 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18cfcf-d380-47c6-bd2e-698691a384e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:22.234935 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-fb18cfcf-d380-47c6-bd2e-698691a384e0 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:58:22.244320 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-fb18cfcf-d380-47c6-bd2e-698691a384e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:22.335892 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1389/2804] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 20:58:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:58:22.351043 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a733503-71b5-45ba-b8ba-68dbd6ac34c7 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:22.352490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3a733503-71b5-45ba-b8ba-68dbd6ac34c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:22.415812 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:22.493399 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a733503-71b5-45ba-b8ba-68dbd6ac34c7 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:22.505115 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf6d54-09fc-46f6-8443-4a04fc49fcd6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:22.506779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf6d54-09fc-46f6-8443-4a04fc49fcd6 service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:22.506779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf6d54-09fc-46f6-8443-4a04fc49fcd6 service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:22.506779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf6d54-09fc-46f6-8443-4a04fc49fcd6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:22.518780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf6d54-09fc-46f6-8443-4a04fc49fcd6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:22.521160 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf6d54-09fc-46f6-8443-4a04fc49fcd6 service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:22.532894 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1416/2805] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 20:58:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 20:58:22.695315 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18cfcf-d380-47c6-bd2e-698691a384e0 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:22.696771 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-fb18cfcf-d380-47c6-bd2e-698691a384e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:22.878143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18cfcf-d380-47c6-bd2e-698691a384e0 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:22.892565 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567daed-7ffc-4be1-9f44-6637c658310a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:22.893422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567daed-7ffc-4be1-9f44-6637c658310a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:22.893632 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567daed-7ffc-4be1-9f44-6637c658310a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:22.894433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567daed-7ffc-4be1-9f44-6637c658310a admin admin] PATH_INFO: `/v3/projects/fa2ee8d438d541d2817c8557bfcb6e4f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:22.895647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d567daed-7ffc-4be1-9f44-6637c658310a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa2ee8d438d541d2817c8557bfcb6e4f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:22.898090 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d567daed-7ffc-4be1-9f44-6637c658310a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:23.003379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d567daed-7ffc-4be1-9f44-6637c658310a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa2ee8d438d541d2817c8557bfcb6e4f', 'request_id': 'req-d567daed-7ffc-4be1-9f44-6637c658310a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:23.029977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d567daed-7ffc-4be1-9f44-6637c658310a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa2ee8d438d541d2817c8557bfcb6e4f', 'request_id': 'req-d567daed-7ffc-4be1-9f44-6637c658310a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:23.042397 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d567daed-7ffc-4be1-9f44-6637c658310a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa2ee8d438d541d2817c8557bfcb6e4f', 'request_id': 'req-d567daed-7ffc-4be1-9f44-6637c658310a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:23.077117 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d567daed-7ffc-4be1-9f44-6637c658310a admin admin] The token cache is being invalidate because project fa2ee8d438d541d2817c8557bfcb6e4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:58:23.077484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d567daed-7ffc-4be1-9f44-6637c658310a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:23.078895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d567daed-7ffc-4be1-9f44-6637c658310a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:23.085838 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1390/2806] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:58:22 2022] DELETE /identity/v3/projects/fa2ee8d438d541d2817c8557bfcb6e4f => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:58:23.087514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f34f1-67f2-42bd-9aa2-e8311882e67b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:23.088033 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f34f1-67f2-42bd-9aa2-e8311882e67b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:23.088122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f34f1-67f2-42bd-9aa2-e8311882e67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:23.132013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-e06f34f1-67f2-42bd-9aa2-e8311882e67b None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:58:23.133264 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e06f34f1-67f2-42bd-9aa2-e8311882e67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:23.232968 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1417/2807] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:58:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:58:23.242400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9b38e-669d-4db7-a7dd-dc4cb50a5930 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:23.242400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9b38e-669d-4db7-a7dd-dc4cb50a5930 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:23.242400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9b38e-669d-4db7-a7dd-dc4cb50a5930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:23.271736 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-49f9b38e-669d-4db7-a7dd-dc4cb50a5930 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:58:23.277230 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-49f9b38e-669d-4db7-a7dd-dc4cb50a5930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:23.292621 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f34f1-67f2-42bd-9aa2-e8311882e67b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:23.293556 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1391/2808] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:58:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:58:23.306497 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f34f1-67f2-42bd-9aa2-e8311882e67b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:23.321993 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c8073-0363-4c57-9831-69e2af97cf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:23.323872 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c8073-0363-4c57-9831-69e2af97cf28 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:23.324264 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c8073-0363-4c57-9831-69e2af97cf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:23.326227 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c8073-0363-4c57-9831-69e2af97cf28 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:23.327282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c8073-0363-4c57-9831-69e2af97cf28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:58:23.328209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c8073-0363-4c57-9831-69e2af97cf28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:23.329955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c8073-0363-4c57-9831-69e2af97cf28 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:23.367387 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1418/2809] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:58:23.372270 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9b38e-669d-4db7-a7dd-dc4cb50a5930 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:23.397447 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9b38e-669d-4db7-a7dd-dc4cb50a5930 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:23.406688 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe211d-c62c-4a41-8379-83713d2510c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:23.407580 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe211d-c62c-4a41-8379-83713d2510c2 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:23.407927 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe211d-c62c-4a41-8379-83713d2510c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:23.408208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe211d-c62c-4a41-8379-83713d2510c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:23.408847 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe211d-c62c-4a41-8379-83713d2510c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:23.411546 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe211d-c62c-4a41-8379-83713d2510c2 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:23.519080 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:23.584175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c8073-0363-4c57-9831-69e2af97cf28 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:23.592344 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1392/2810] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:58:23 2022] POST /identity/v3/projects => generated 399 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:58:23.597929 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c8073-0363-4c57-9831-69e2af97cf28 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:23.757771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2018b-8181-4d1b-9fd4-bccee5218941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:23.758975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2018b-8181-4d1b-9fd4-bccee5218941 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:23.759802 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2018b-8181-4d1b-9fd4-bccee5218941 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:23.760869 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2018b-8181-4d1b-9fd4-bccee5218941 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:23.762942 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b2018b-8181-4d1b-9fd4-bccee5218941 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:23.768341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b2018b-8181-4d1b-9fd4-bccee5218941 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:23.821819 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe211d-c62c-4a41-8379-83713d2510c2 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:23.832136 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1419/2811] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:58:23 2022] POST /identity/v3/users => generated 300 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:58:23.836435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe211d-c62c-4a41-8379-83713d2510c2 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:23.882460 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f85f77-7fa0-49a4-835b-80362378cf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:23.886832 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f85f77-7fa0-49a4-835b-80362378cf6c admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:23.892303 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f85f77-7fa0-49a4-835b-80362378cf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:23.892727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f85f77-7fa0-49a4-835b-80362378cf6c admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:23.894866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f85f77-7fa0-49a4-835b-80362378cf6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:23.898272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f85f77-7fa0-49a4-835b-80362378cf6c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:23.951483 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2018b-8181-4d1b-9fd4-bccee5218941 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:23.963305 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1393/2812] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:58:23.975161 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2018b-8181-4d1b-9fd4-bccee5218941 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:23.992459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0251d6e-f21f-44c1-8668-ee688e7135b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:23.996010 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0251d6e-f21f-44c1-8668-ee688e7135b7 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:23.998574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0251d6e-f21f-44c1-8668-ee688e7135b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:23.999792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0251d6e-f21f-44c1-8668-ee688e7135b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:24.002178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0251d6e-f21f-44c1-8668-ee688e7135b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:24.005975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0251d6e-f21f-44c1-8668-ee688e7135b7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:24.041493 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f85f77-7fa0-49a4-835b-80362378cf6c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:24.055169 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1420/2813] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:58:24.062683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f85f77-7fa0-49a4-835b-80362378cf6c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:24.073653 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05356e4d-a03c-4538-b81c-70aa095d4ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:24.077571 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05356e4d-a03c-4538-b81c-70aa095d4ec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:24.078140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05356e4d-a03c-4538-b81c-70aa095d4ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:24.078604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05356e4d-a03c-4538-b81c-70aa095d4ec3 admin admin] PATH_INFO: `/v3/projects/63eb5c85d76f425aaf4126ca694ae8b7/users/e1bb7e1a44f44711b773bfbe44125567/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:24.112581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05356e4d-a03c-4538-b81c-70aa095d4ec3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63eb5c85d76f425aaf4126ca694ae8b7, user_id=e1bb7e1a44f44711b773bfbe44125567, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:24.120593 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05356e4d-a03c-4538-b81c-70aa095d4ec3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:24.167933 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1394/2814] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:58:24 2022] PUT /identity/v3/projects/63eb5c85d76f425aaf4126ca694ae8b7/users/e1bb7e1a44f44711b773bfbe44125567/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:58:24.180161 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21f648-4d3c-45d8-997e-9fda143d5f73 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:24.182407 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21f648-4d3c-45d8-997e-9fda143d5f73 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:24.182907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21f648-4d3c-45d8-997e-9fda143d5f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:24.250871 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-1e21f648-4d3c-45d8-997e-9fda143d5f73 None None] MFA Rules not processed for user `e1bb7e1a44f44711b773bfbe44125567`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:58:24.257068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1e21f648-4d3c-45d8-997e-9fda143d5f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:24.296198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:24.444714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05356e4d-a03c-4538-b81c-70aa095d4ec3 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:24.455354 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1421/2815] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:58:24 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:58:24.599035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05356e4d-a03c-4538-b81c-70aa095d4ec3 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:24.605731 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52911b-526f-44d0-9902-4f3508f8c184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:24.607472 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52911b-526f-44d0-9902-4f3508f8c184 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:24.609075 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52911b-526f-44d0-9902-4f3508f8c184 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:24.609587 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52911b-526f-44d0-9902-4f3508f8c184 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:24.610319 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52911b-526f-44d0-9902-4f3508f8c184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:24.643112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52911b-526f-44d0-9902-4f3508f8c184 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:24.719076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e21f648-4d3c-45d8-997e-9fda143d5f73 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:24.719689 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1395/2816] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:58:24 2022] POST /identity/v3/projects => generated 397 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:58:24.734387 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e21f648-4d3c-45d8-997e-9fda143d5f73 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:24.849623 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0272f-ccb2-4a52-b4c4-998229b6ae56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:24.850516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0272f-ccb2-4a52-b4c4-998229b6ae56 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:24.850898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0272f-ccb2-4a52-b4c4-998229b6ae56 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:24.851237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0272f-ccb2-4a52-b4c4-998229b6ae56 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:24.851949 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0272f-ccb2-4a52-b4c4-998229b6ae56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:24.855124 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0272f-ccb2-4a52-b4c4-998229b6ae56 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:24.905757 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1422/2817] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:58:24 2022] POST /identity/v3/users => generated 305 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:58:24.909468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52911b-526f-44d0-9902-4f3508f8c184 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:24.927723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52911b-526f-44d0-9902-4f3508f8c184 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:24.942586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd7416-f0c5-4eae-a6c2-12f39aa7c109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:24.942586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd7416-f0c5-4eae-a6c2-12f39aa7c109 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:24.942586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd7416-f0c5-4eae-a6c2-12f39aa7c109 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:24.942586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd7416-f0c5-4eae-a6c2-12f39aa7c109 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:24.943154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd7416-f0c5-4eae-a6c2-12f39aa7c109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:24.944611 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd7416-f0c5-4eae-a6c2-12f39aa7c109 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:25.009797 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1396/2818] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:58:25.015712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0272f-ccb2-4a52-b4c4-998229b6ae56 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:25.040433 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0272f-ccb2-4a52-b4c4-998229b6ae56 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:25.056972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec0c26-79f6-43f8-a2d3-b3207cf8df6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:25.061024 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec0c26-79f6-43f8-a2d3-b3207cf8df6c admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:25.061311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec0c26-79f6-43f8-a2d3-b3207cf8df6c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:25.061590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec0c26-79f6-43f8-a2d3-b3207cf8df6c admin admin] PATH_INFO: `/v3/projects/4d7fb4d2b40d46379171fc2c3a2e2907/users/fddb3590455f4d75967b3eece154e619/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:25.093005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec0c26-79f6-43f8-a2d3-b3207cf8df6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d7fb4d2b40d46379171fc2c3a2e2907, user_id=fddb3590455f4d75967b3eece154e619, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:25.109908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec0c26-79f6-43f8-a2d3-b3207cf8df6c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:25.155419 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1423/2819] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:58:25 2022] PUT /identity/v3/projects/4d7fb4d2b40d46379171fc2c3a2e2907/users/fddb3590455f4d75967b3eece154e619/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:58:25.159882 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd7416-f0c5-4eae-a6c2-12f39aa7c109 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:25.187076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd7416-f0c5-4eae-a6c2-12f39aa7c109 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:25.330810 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77d624-a02e-40c5-bf18-53c627653a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:25.331533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77d624-a02e-40c5-bf18-53c627653a7a admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:25.333185 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77d624-a02e-40c5-bf18-53c627653a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:25.333482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77d624-a02e-40c5-bf18-53c627653a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:25.334198 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77d624-a02e-40c5-bf18-53c627653a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:25.335845 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77d624-a02e-40c5-bf18-53c627653a7a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:25.369732 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec0c26-79f6-43f8-a2d3-b3207cf8df6c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:25.370629 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1397/2820] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:58:25.389000 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec0c26-79f6-43f8-a2d3-b3207cf8df6c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:25.409976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267164d-0b4c-4d62-8f74-7d3bb710e44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:25.410791 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267164d-0b4c-4d62-8f74-7d3bb710e44d admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:25.411140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267164d-0b4c-4d62-8f74-7d3bb710e44d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:25.411479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267164d-0b4c-4d62-8f74-7d3bb710e44d admin admin] PATH_INFO: `/v3/projects/4d7fb4d2b40d46379171fc2c3a2e2907/users/fddb3590455f4d75967b3eece154e619/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:25.418176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267164d-0b4c-4d62-8f74-7d3bb710e44d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d7fb4d2b40d46379171fc2c3a2e2907, user_id=fddb3590455f4d75967b3eece154e619, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:25.421719 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267164d-0b4c-4d62-8f74-7d3bb710e44d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:25.460947 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1424/2821] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:58:25 2022] PUT /identity/v3/projects/4d7fb4d2b40d46379171fc2c3a2e2907/users/fddb3590455f4d75967b3eece154e619/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:58:25.475571 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4397c0-a80a-4a3b-93f9-95b441391bed None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:25.476529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4397c0-a80a-4a3b-93f9-95b441391bed None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:25.476529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4397c0-a80a-4a3b-93f9-95b441391bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:25.564751 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-fc4397c0-a80a-4a3b-93f9-95b441391bed None None] MFA Rules not processed for user `fddb3590455f4d75967b3eece154e619`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:58:25.565997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-fc4397c0-a80a-4a3b-93f9-95b441391bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:25.647043 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:25.842626 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1398/2822] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:58:25 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:58:27.594019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267164d-0b4c-4d62-8f74-7d3bb710e44d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:27.599001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1267164d-0b4c-4d62-8f74-7d3bb710e44d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:27.813775 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267164d-0b4c-4d62-8f74-7d3bb710e44d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:27.824401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832730d-4bbc-4484-ac29-f8136434917d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:27.825906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832730d-4bbc-4484-ac29-f8136434917d service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:27.825906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832730d-4bbc-4484-ac29-f8136434917d service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:27.825906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832730d-4bbc-4484-ac29-f8136434917d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:27.835196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:28.059600 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4832730d-4bbc-4484-ac29-f8136434917d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:28.061843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4832730d-4bbc-4484-ac29-f8136434917d service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:28.078486 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1425/2823] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:58:27 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:58:28.296725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbfd48-02da-4d1d-b22a-c65d511d170b None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:28.298460 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbfd48-02da-4d1d-b22a-c65d511d170b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:28.299687 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbfd48-02da-4d1d-b22a-c65d511d170b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:28.365743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d6cbfd48-02da-4d1d-b22a-c65d511d170b None None] MFA Rules not processed for user `91d180c9584c49b296a1db51fbe50694`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:58:28.368512 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d6cbfd48-02da-4d1d-b22a-c65d511d170b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:28.558164 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1399/2824] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:58:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:58:28.568256 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832730d-4bbc-4484-ac29-f8136434917d service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:28.569687 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4832730d-4bbc-4484-ac29-f8136434917d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:28.778002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832730d-4bbc-4484-ac29-f8136434917d service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:28.798930 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f416a7-1a62-4b72-a4a0-a18877171bbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:28.799565 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f416a7-1a62-4b72-a4a0-a18877171bbf service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:28.799848 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f416a7-1a62-4b72-a4a0-a18877171bbf service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:28.802378 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f416a7-1a62-4b72-a4a0-a18877171bbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:28.807341 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbfd48-02da-4d1d-b22a-c65d511d170b None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:28.826539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f416a7-1a62-4b72-a4a0-a18877171bbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:28.828742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f416a7-1a62-4b72-a4a0-a18877171bbf service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:28.842704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbfd48-02da-4d1d-b22a-c65d511d170b None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:28.856792 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1426/2825] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:58:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:58:28.863891 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d534a38e-7ba5-4c4e-aae6-e4f0dd160af3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:28.864524 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534a38e-7ba5-4c4e-aae6-e4f0dd160af3 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:28.864805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534a38e-7ba5-4c4e-aae6-e4f0dd160af3 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:28.865080 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534a38e-7ba5-4c4e-aae6-e4f0dd160af3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:28.872564 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d534a38e-7ba5-4c4e-aae6-e4f0dd160af3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:29.035441 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d534a38e-7ba5-4c4e-aae6-e4f0dd160af3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:29.037089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d534a38e-7ba5-4c4e-aae6-e4f0dd160af3 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:29.063558 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1400/2826] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:58:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:58:30.758062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f416a7-1a62-4b72-a4a0-a18877171bbf service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:30.762228 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b1f416a7-1a62-4b72-a4a0-a18877171bbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:30.847442 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f416a7-1a62-4b72-a4a0-a18877171bbf service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:30.873178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82887b8-0382-4aee-bd9f-aeffea296b37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:30.876646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82887b8-0382-4aee-bd9f-aeffea296b37 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:30.878494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82887b8-0382-4aee-bd9f-aeffea296b37 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:30.879007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82887b8-0382-4aee-bd9f-aeffea296b37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:30.912208 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82887b8-0382-4aee-bd9f-aeffea296b37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:30.920907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82887b8-0382-4aee-bd9f-aeffea296b37 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:30.970417 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1427/2827] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:58:30 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:58:33.556834 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a478b-da71-4053-879f-8abf19ed1f8a None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:33.557720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a478b-da71-4053-879f-8abf19ed1f8a None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:33.558627 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a478b-da71-4053-879f-8abf19ed1f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:33.608661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-114a478b-da71-4053-879f-8abf19ed1f8a None None] MFA Rules not processed for user `91d180c9584c49b296a1db51fbe50694`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:58:33.611934 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-114a478b-da71-4053-879f-8abf19ed1f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:33.655652 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1401/2828] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:58:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:58:35.275792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82887b8-0382-4aee-bd9f-aeffea296b37 service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:35.444536 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82887b8-0382-4aee-bd9f-aeffea296b37 service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:35.457437 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ef05b-42a3-4062-ac06-bc7eb2424511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:35.458881 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ef05b-42a3-4062-ac06-bc7eb2424511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:35.459276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ef05b-42a3-4062-ac06-bc7eb2424511 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:35.459677 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ef05b-42a3-4062-ac06-bc7eb2424511 admin admin] PATH_INFO: `/v3/users/e1bb7e1a44f44711b773bfbe44125567` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:35.460965 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ef05b-42a3-4062-ac06-bc7eb2424511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1bb7e1a44f44711b773bfbe44125567)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:35.467160 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ef05b-42a3-4062-ac06-bc7eb2424511 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:35.559471 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:35.581610 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bb9ef05b-42a3-4062-ac06-bc7eb2424511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1bb7e1a44f44711b773bfbe44125567'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:35.601935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bb9ef05b-42a3-4062-ac06-bc7eb2424511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1bb7e1a44f44711b773bfbe44125567'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:35.609174 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bb9ef05b-42a3-4062-ac06-bc7eb2424511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1bb7e1a44f44711b773bfbe44125567'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:35.610402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bb9ef05b-42a3-4062-ac06-bc7eb2424511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1bb7e1a44f44711b773bfbe44125567'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:35.623731 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bb9ef05b-42a3-4062-ac06-bc7eb2424511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1bb7e1a44f44711b773bfbe44125567'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:35.661825 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1428/2829] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:58:35 2022] DELETE /identity/v3/users/e1bb7e1a44f44711b773bfbe44125567 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:58:35.666530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb98dfb-2411-487e-9740-dd6ff0b16d14 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:35.667879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb98dfb-2411-487e-9740-dd6ff0b16d14 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:35.668595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb98dfb-2411-487e-9740-dd6ff0b16d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:35.708929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-5fb98dfb-2411-487e-9740-dd6ff0b16d14 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:58:35.713937 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5fb98dfb-2411-487e-9740-dd6ff0b16d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:35.799052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:35.891158 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1402/2830] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:58:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:58:35.912434 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ef05b-42a3-4062-ac06-bc7eb2424511 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:35.914769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-bb9ef05b-42a3-4062-ac06-bc7eb2424511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:36.074873 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ef05b-42a3-4062-ac06-bc7eb2424511 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:36.093805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea4fb9-d0e8-469a-a46d-4131775540bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:36.094952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea4fb9-d0e8-469a-a46d-4131775540bb service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:36.095503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea4fb9-d0e8-469a-a46d-4131775540bb service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:36.096006 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea4fb9-d0e8-469a-a46d-4131775540bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:36.123828 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea4fb9-d0e8-469a-a46d-4131775540bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:36.125749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea4fb9-d0e8-469a-a46d-4131775540bb service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:36.151675 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1429/2831] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:58:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:58:38.025492 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb98dfb-2411-487e-9740-dd6ff0b16d14 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:38.027768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5fb98dfb-2411-487e-9740-dd6ff0b16d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:38.055451 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb98dfb-2411-487e-9740-dd6ff0b16d14 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:38.093344 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206b0a3-c0c4-43df-81d0-fd12048f480e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:38.096527 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206b0a3-c0c4-43df-81d0-fd12048f480e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:38.099287 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206b0a3-c0c4-43df-81d0-fd12048f480e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:38.100232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206b0a3-c0c4-43df-81d0-fd12048f480e admin admin] PATH_INFO: `/v3/projects/63eb5c85d76f425aaf4126ca694ae8b7` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:38.104469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c206b0a3-c0c4-43df-81d0-fd12048f480e admin admin] RBAC: Authorizing `identity:delete_project(project_id=63eb5c85d76f425aaf4126ca694ae8b7)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:38.115817 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c206b0a3-c0c4-43df-81d0-fd12048f480e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:38.362969 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c206b0a3-c0c4-43df-81d0-fd12048f480e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63eb5c85d76f425aaf4126ca694ae8b7', 'request_id': 'req-c206b0a3-c0c4-43df-81d0-fd12048f480e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:38.375419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c206b0a3-c0c4-43df-81d0-fd12048f480e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63eb5c85d76f425aaf4126ca694ae8b7', 'request_id': 'req-c206b0a3-c0c4-43df-81d0-fd12048f480e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:38.405423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c206b0a3-c0c4-43df-81d0-fd12048f480e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63eb5c85d76f425aaf4126ca694ae8b7', 'request_id': 'req-c206b0a3-c0c4-43df-81d0-fd12048f480e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:38.453365 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c206b0a3-c0c4-43df-81d0-fd12048f480e admin admin] The token cache is being invalidate because project 63eb5c85d76f425aaf4126ca694ae8b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:58:38.456906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c206b0a3-c0c4-43df-81d0-fd12048f480e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:38.460241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c206b0a3-c0c4-43df-81d0-fd12048f480e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:38.476046 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1403/2832] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:58:38 2022] DELETE /identity/v3/projects/63eb5c85d76f425aaf4126ca694ae8b7 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:58:38.477458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea4fb9-d0e8-469a-a46d-4131775540bb service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:38.492021 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea4fb9-d0e8-469a-a46d-4131775540bb service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:38.737265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6495122-4767-409a-b89f-30ec4026f675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:38.740402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6495122-4767-409a-b89f-30ec4026f675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:38.740725 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6495122-4767-409a-b89f-30ec4026f675 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:38.741011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6495122-4767-409a-b89f-30ec4026f675 admin admin] PATH_INFO: `/v3/users/fddb3590455f4d75967b3eece154e619` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:38.747199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6495122-4767-409a-b89f-30ec4026f675 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fddb3590455f4d75967b3eece154e619)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:38.749143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6495122-4767-409a-b89f-30ec4026f675 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:38.925541 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c6495122-4767-409a-b89f-30ec4026f675 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fddb3590455f4d75967b3eece154e619'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:38.959822 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c6495122-4767-409a-b89f-30ec4026f675 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fddb3590455f4d75967b3eece154e619'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:38.967131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c6495122-4767-409a-b89f-30ec4026f675 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fddb3590455f4d75967b3eece154e619'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:38.969624 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c6495122-4767-409a-b89f-30ec4026f675 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fddb3590455f4d75967b3eece154e619'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:38.975673 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:38.990065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c6495122-4767-409a-b89f-30ec4026f675 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fddb3590455f4d75967b3eece154e619'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:39.031079 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1430/2833] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:58:38 2022] DELETE /identity/v3/users/fddb3590455f4d75967b3eece154e619 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:58:39.988202 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206b0a3-c0c4-43df-81d0-fd12048f480e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:39.989955 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c206b0a3-c0c4-43df-81d0-fd12048f480e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:40.024122 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206b0a3-c0c4-43df-81d0-fd12048f480e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:40.098307 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6495122-4767-409a-b89f-30ec4026f675 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:40.099660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c6495122-4767-409a-b89f-30ec4026f675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:40.323642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6495122-4767-409a-b89f-30ec4026f675 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:40.341098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f820dad-2ba2-4246-9129-da36c9ee3185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:40.343311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f820dad-2ba2-4246-9129-da36c9ee3185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:40.346661 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f820dad-2ba2-4246-9129-da36c9ee3185 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:40.347683 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f820dad-2ba2-4246-9129-da36c9ee3185 admin admin] PATH_INFO: `/v3/users/ad26fc0c618f4a548c64863f640dcf95` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:40.351930 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f820dad-2ba2-4246-9129-da36c9ee3185 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad26fc0c618f4a548c64863f640dcf95)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:40.356711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f820dad-2ba2-4246-9129-da36c9ee3185 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:40.372427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989d499-ce5c-4a5a-b23e-41283834c581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:40.373281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989d499-ce5c-4a5a-b23e-41283834c581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:40.375642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989d499-ce5c-4a5a-b23e-41283834c581 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:40.376019 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989d499-ce5c-4a5a-b23e-41283834c581 admin admin] PATH_INFO: `/v3/projects/4d7fb4d2b40d46379171fc2c3a2e2907` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:40.379373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989d499-ce5c-4a5a-b23e-41283834c581 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d7fb4d2b40d46379171fc2c3a2e2907)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:40.383844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989d499-ce5c-4a5a-b23e-41283834c581 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:40.522450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9f820dad-2ba2-4246-9129-da36c9ee3185 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad26fc0c618f4a548c64863f640dcf95'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:40.545781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9f820dad-2ba2-4246-9129-da36c9ee3185 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad26fc0c618f4a548c64863f640dcf95'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:40.549299 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9f820dad-2ba2-4246-9129-da36c9ee3185 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad26fc0c618f4a548c64863f640dcf95'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:40.550512 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9f820dad-2ba2-4246-9129-da36c9ee3185 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad26fc0c618f4a548c64863f640dcf95'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:40.568109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c989d499-ce5c-4a5a-b23e-41283834c581 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d7fb4d2b40d46379171fc2c3a2e2907', 'request_id': 'req-c989d499-ce5c-4a5a-b23e-41283834c581'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:40.571074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9f820dad-2ba2-4246-9129-da36c9ee3185 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad26fc0c618f4a548c64863f640dcf95'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:40.592923 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c989d499-ce5c-4a5a-b23e-41283834c581 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d7fb4d2b40d46379171fc2c3a2e2907', 'request_id': 'req-c989d499-ce5c-4a5a-b23e-41283834c581'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:40.595180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:40.617946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c989d499-ce5c-4a5a-b23e-41283834c581 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d7fb4d2b40d46379171fc2c3a2e2907', 'request_id': 'req-c989d499-ce5c-4a5a-b23e-41283834c581'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:40.619325 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1431/2834] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:58:40 2022] DELETE /identity/v3/users/ad26fc0c618f4a548c64863f640dcf95 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:58:40.626508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0c536-e557-4a1b-b295-c87768a69ed8 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:40.627017 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0c536-e557-4a1b-b295-c87768a69ed8 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:40.627686 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0c536-e557-4a1b-b295-c87768a69ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:40.644060 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c989d499-ce5c-4a5a-b23e-41283834c581 admin admin] The token cache is being invalidate because project 4d7fb4d2b40d46379171fc2c3a2e2907 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:58:40.644350 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c989d499-ce5c-4a5a-b23e-41283834c581 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:40.645234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c989d499-ce5c-4a5a-b23e-41283834c581 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:40.648367 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1404/2835] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:58:39 2022] DELETE /identity/v3/projects/4d7fb4d2b40d46379171fc2c3a2e2907 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:58:40.653949 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e885b-217c-4d61-9cae-d1e7ed9210fa None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:40.654440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e885b-217c-4d61-9cae-d1e7ed9210fa None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:40.654918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e885b-217c-4d61-9cae-d1e7ed9210fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:40.659697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-baf0c536-e557-4a1b-b295-c87768a69ed8 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:58:40.661075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-baf0c536-e557-4a1b-b295-c87768a69ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:40.697039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a39e885b-217c-4d61-9cae-d1e7ed9210fa None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:58:40.698497 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a39e885b-217c-4d61-9cae-d1e7ed9210fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:40.755780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:40.774185 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1432/2836] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:58:40.824391 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1405/2837] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:58:40.825386 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb160b-faf6-44e8-a700-bf2889a7cf83 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:40.825752 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb160b-faf6-44e8-a700-bf2889a7cf83 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:40.826199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb160b-faf6-44e8-a700-bf2889a7cf83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:40.892400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-55cb160b-faf6-44e8-a700-bf2889a7cf83 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:58:40.896804 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-55cb160b-faf6-44e8-a700-bf2889a7cf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:40.919169 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1433/2838] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:58:40.923087 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e885b-217c-4d61-9cae-d1e7ed9210fa None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:40.963408 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e885b-217c-4d61-9cae-d1e7ed9210fa None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:40.989136 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aac2ab-571d-471d-be7b-9ac19aab274e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:40.990199 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aac2ab-571d-471d-be7b-9ac19aab274e admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:40.990199 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aac2ab-571d-471d-be7b-9ac19aab274e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:40.990362 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aac2ab-571d-471d-be7b-9ac19aab274e admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:40.996987 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aac2ab-571d-471d-be7b-9ac19aab274e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:58:40.997311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aac2ab-571d-471d-be7b-9ac19aab274e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:40.999893 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aac2ab-571d-471d-be7b-9ac19aab274e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:41.047797 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb160b-faf6-44e8-a700-bf2889a7cf83 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:41.052406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-55cb160b-faf6-44e8-a700-bf2889a7cf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:41.054616 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1406/2839] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:58:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:58:41.056411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aac2ab-571d-471d-be7b-9ac19aab274e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:41.101106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aac2ab-571d-471d-be7b-9ac19aab274e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:41.126357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd86ef2-ce1c-42ce-8da5-876f329e2d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:41.127138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd86ef2-ce1c-42ce-8da5-876f329e2d89 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:41.127383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd86ef2-ce1c-42ce-8da5-876f329e2d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:41.133774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd86ef2-ce1c-42ce-8da5-876f329e2d89 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:41.134332 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd86ef2-ce1c-42ce-8da5-876f329e2d89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:41.142130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd86ef2-ce1c-42ce-8da5-876f329e2d89 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:41.238388 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb160b-faf6-44e8-a700-bf2889a7cf83 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:41.247737 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1407/2840] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:58:41 2022] POST /identity/v3/projects => generated 369 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:58:41.248737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd86ef2-ce1c-42ce-8da5-876f329e2d89 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:41.445827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5ba08-f652-4b2d-8df8-10ff9fd07df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:41.446459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5ba08-f652-4b2d-8df8-10ff9fd07df4 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:41.446882 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5ba08-f652-4b2d-8df8-10ff9fd07df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:41.455516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5ba08-f652-4b2d-8df8-10ff9fd07df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:41.468292 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd86ef2-ce1c-42ce-8da5-876f329e2d89 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:41.479488 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e3bcb-676e-4a7d-9483-6a5ac91fd65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:41.482790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e3bcb-676e-4a7d-9483-6a5ac91fd65c admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:41.484433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e3bcb-676e-4a7d-9483-6a5ac91fd65c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:41.485180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e3bcb-676e-4a7d-9483-6a5ac91fd65c admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:41.485995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e3bcb-676e-4a7d-9483-6a5ac91fd65c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:41.490539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5ba08-f652-4b2d-8df8-10ff9fd07df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:41.492147 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5ba08-f652-4b2d-8df8-10ff9fd07df4 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:41.497326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e3bcb-676e-4a7d-9483-6a5ac91fd65c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:41.539148 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1434/2841] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:58:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:58:41.560763 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1408/2842] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:58:41 2022] POST /identity/v3/users => generated 285 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:58:41.564493 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5ba08-f652-4b2d-8df8-10ff9fd07df4 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:41.580660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5ba08-f652-4b2d-8df8-10ff9fd07df4 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:41.604064 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36e9b1-8380-4104-a819-b13547991f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:41.606663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36e9b1-8380-4104-a819-b13547991f46 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:41.607797 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36e9b1-8380-4104-a819-b13547991f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:41.609822 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36e9b1-8380-4104-a819-b13547991f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:41.613506 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36e9b1-8380-4104-a819-b13547991f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:41.623833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36e9b1-8380-4104-a819-b13547991f46 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:41.659374 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1435/2843] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:58:41.662669 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e3bcb-676e-4a7d-9483-6a5ac91fd65c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:41.687706 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e3bcb-676e-4a7d-9483-6a5ac91fd65c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:41.708536 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf2705-22bf-4619-bf3a-91c492738c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:41.712482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf2705-22bf-4619-bf3a-91c492738c53 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:41.712788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf2705-22bf-4619-bf3a-91c492738c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:41.714035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf2705-22bf-4619-bf3a-91c492738c53 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:41.717474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf2705-22bf-4619-bf3a-91c492738c53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:41.725223 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf2705-22bf-4619-bf3a-91c492738c53 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:41.767748 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1409/2844] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:58:41.772255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36e9b1-8380-4104-a819-b13547991f46 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:41.803515 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36e9b1-8380-4104-a819-b13547991f46 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:41.826750 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954fdd0-b802-4676-8080-4e287e438e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:41.827688 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954fdd0-b802-4676-8080-4e287e438e43 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:41.829670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954fdd0-b802-4676-8080-4e287e438e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:41.831487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954fdd0-b802-4676-8080-4e287e438e43 admin admin] PATH_INFO: `/v3/projects/e47f439135a6445fa29c8be6d69c1759/users/ad1a96004778407584d1805b07ad1c5f/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:41.892556 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954fdd0-b802-4676-8080-4e287e438e43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e47f439135a6445fa29c8be6d69c1759, user_id=ad1a96004778407584d1805b07ad1c5f, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:41.895298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954fdd0-b802-4676-8080-4e287e438e43 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:41.959638 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1436/2845] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:58:41 2022] PUT /identity/v3/projects/e47f439135a6445fa29c8be6d69c1759/users/ad1a96004778407584d1805b07ad1c5f/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:58:41.961356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887e3de-4baf-4322-9967-175610539c2d None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:41.963008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887e3de-4baf-4322-9967-175610539c2d None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:41.963294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887e3de-4baf-4322-9967-175610539c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:42.030427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-2887e3de-4baf-4322-9967-175610539c2d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:58:42.038839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2887e3de-4baf-4322-9967-175610539c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:42.131909 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:42.246622 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1410/2846] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:58:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:58:42.399653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954fdd0-b802-4676-8080-4e287e438e43 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:42.531919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887e3de-4baf-4322-9967-175610539c2d None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:42.533406 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2887e3de-4baf-4322-9967-175610539c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:42.561261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954fdd0-b802-4676-8080-4e287e438e43 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:42.563721 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887e3de-4baf-4322-9967-175610539c2d None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:42.570586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e8d07-9064-4990-9083-cb6ea2c2e079 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:42.571260 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e8d07-9064-4990-9083-cb6ea2c2e079 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:42.571893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e8d07-9064-4990-9083-cb6ea2c2e079 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:42.572652 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e8d07-9064-4990-9083-cb6ea2c2e079 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:42.574776 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1037c7d-218c-4250-bc3a-430e274109dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:42.575943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1037c7d-218c-4250-bc3a-430e274109dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:42.576221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1037c7d-218c-4250-bc3a-430e274109dc admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:42.576500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1037c7d-218c-4250-bc3a-430e274109dc admin admin] PATH_INFO: `/v3/projects/9129b06bfc47457c954b8c5af61bdb7e` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:42.585405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1037c7d-218c-4250-bc3a-430e274109dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9129b06bfc47457c954b8c5af61bdb7e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:42.588035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1037c7d-218c-4250-bc3a-430e274109dc admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:42.611522 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e8d07-9064-4990-9083-cb6ea2c2e079 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:42.613189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e8d07-9064-4990-9083-cb6ea2c2e079 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:42.644742 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1437/2847] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:58:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:58:42.761821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c1037c7d-218c-4250-bc3a-430e274109dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9129b06bfc47457c954b8c5af61bdb7e', 'request_id': 'req-c1037c7d-218c-4250-bc3a-430e274109dc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:42.771986 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c1037c7d-218c-4250-bc3a-430e274109dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9129b06bfc47457c954b8c5af61bdb7e', 'request_id': 'req-c1037c7d-218c-4250-bc3a-430e274109dc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:42.784242 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c1037c7d-218c-4250-bc3a-430e274109dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9129b06bfc47457c954b8c5af61bdb7e', 'request_id': 'req-c1037c7d-218c-4250-bc3a-430e274109dc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:42.816007 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c1037c7d-218c-4250-bc3a-430e274109dc admin admin] The token cache is being invalidate because project 9129b06bfc47457c954b8c5af61bdb7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:58:42.816579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c1037c7d-218c-4250-bc3a-430e274109dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:42.835010 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c1037c7d-218c-4250-bc3a-430e274109dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:42.838322 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1411/2848] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:58:42 2022] DELETE /identity/v3/projects/9129b06bfc47457c954b8c5af61bdb7e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:58:42.842479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e8d07-9064-4990-9083-cb6ea2c2e079 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:42.859437 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e8d07-9064-4990-9083-cb6ea2c2e079 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:42.906584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:43.080402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20170d-d04b-4897-8d70-7cb7667bdcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:43.081671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20170d-d04b-4897-8d70-7cb7667bdcfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:43.082110 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20170d-d04b-4897-8d70-7cb7667bdcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:43.082498 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20170d-d04b-4897-8d70-7cb7667bdcfb admin admin] PATH_INFO: `/v3/users/07214bd7590946e2afe5104b0a6c029f` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:43.084745 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20170d-d04b-4897-8d70-7cb7667bdcfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=07214bd7590946e2afe5104b0a6c029f)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:43.090977 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20170d-d04b-4897-8d70-7cb7667bdcfb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:43.254183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0f20170d-d04b-4897-8d70-7cb7667bdcfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07214bd7590946e2afe5104b0a6c029f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:43.272594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0f20170d-d04b-4897-8d70-7cb7667bdcfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07214bd7590946e2afe5104b0a6c029f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:43.273345 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0f20170d-d04b-4897-8d70-7cb7667bdcfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07214bd7590946e2afe5104b0a6c029f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:43.273970 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0f20170d-d04b-4897-8d70-7cb7667bdcfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07214bd7590946e2afe5104b0a6c029f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:43.296054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0f20170d-d04b-4897-8d70-7cb7667bdcfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07214bd7590946e2afe5104b0a6c029f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:43.340094 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1438/2849] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:58:42 2022] DELETE /identity/v3/users/07214bd7590946e2afe5104b0a6c029f => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:58:44.549466 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1037c7d-218c-4250-bc3a-430e274109dc admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:44.551716 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c1037c7d-218c-4250-bc3a-430e274109dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:44.586270 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1037c7d-218c-4250-bc3a-430e274109dc admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:44.785421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0278e8-3aa2-4a44-86fb-085e0682d914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:44.785918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0278e8-3aa2-4a44-86fb-085e0682d914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:44.786198 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0278e8-3aa2-4a44-86fb-085e0682d914 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:44.786473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0278e8-3aa2-4a44-86fb-085e0682d914 admin admin] PATH_INFO: `/v3/projects/55640d69a22642dcbb738feb426e874c` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:44.799056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0278e8-3aa2-4a44-86fb-085e0682d914 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55640d69a22642dcbb738feb426e874c)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:44.803065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0278e8-3aa2-4a44-86fb-085e0682d914 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:44.939358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4d0278e8-3aa2-4a44-86fb-085e0682d914 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55640d69a22642dcbb738feb426e874c', 'request_id': 'req-4d0278e8-3aa2-4a44-86fb-085e0682d914'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:44.946458 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:44.949496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4d0278e8-3aa2-4a44-86fb-085e0682d914 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55640d69a22642dcbb738feb426e874c', 'request_id': 'req-4d0278e8-3aa2-4a44-86fb-085e0682d914'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:44.969120 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4d0278e8-3aa2-4a44-86fb-085e0682d914 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55640d69a22642dcbb738feb426e874c', 'request_id': 'req-4d0278e8-3aa2-4a44-86fb-085e0682d914'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:45.011580 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4d0278e8-3aa2-4a44-86fb-085e0682d914 admin admin] The token cache is being invalidate because project 55640d69a22642dcbb738feb426e874c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:58:45.012110 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4d0278e8-3aa2-4a44-86fb-085e0682d914 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:45.012972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4d0278e8-3aa2-4a44-86fb-085e0682d914 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:58:45.015328 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1412/2850] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:58:44 2022] DELETE /identity/v3/projects/55640d69a22642dcbb738feb426e874c => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:58:45.020762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f051b8f-5c05-4770-9f50-59b4b3b14ca7 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:45.021682 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f051b8f-5c05-4770-9f50-59b4b3b14ca7 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:45.022127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f051b8f-5c05-4770-9f50-59b4b3b14ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:45.062754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-9f051b8f-5c05-4770-9f50-59b4b3b14ca7 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:58:45.064400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9f051b8f-5c05-4770-9f50-59b4b3b14ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:45.199955 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1439/2851] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:58:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:58:45.208860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc79a9-1f2d-4aec-af1a-48443b9e28fb None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:45.209310 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc79a9-1f2d-4aec-af1a-48443b9e28fb None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:45.209690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc79a9-1f2d-4aec-af1a-48443b9e28fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:45.248987 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-68cc79a9-1f2d-4aec-af1a-48443b9e28fb None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:58:45.250417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-68cc79a9-1f2d-4aec-af1a-48443b9e28fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:45.275199 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1413/2852] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:58:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:58:45.279302 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f051b8f-5c05-4770-9f50-59b4b3b14ca7 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:45.292801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f051b8f-5c05-4770-9f50-59b4b3b14ca7 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:45.313011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a61173-1dd3-4e14-87ca-a6f414c19fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:45.313654 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a61173-1dd3-4e14-87ca-a6f414c19fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:45.313939 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a61173-1dd3-4e14-87ca-a6f414c19fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:45.314207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a61173-1dd3-4e14-87ca-a6f414c19fd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:45.314933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a61173-1dd3-4e14-87ca-a6f414c19fd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:58:45.315237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a61173-1dd3-4e14-87ca-a6f414c19fd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:45.316860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a61173-1dd3-4e14-87ca-a6f414c19fd5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:45.343959 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1440/2853] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:58:45.346930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc79a9-1f2d-4aec-af1a-48443b9e28fb None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:45.367729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc79a9-1f2d-4aec-af1a-48443b9e28fb None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:45.382636 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9f426-e39f-44cd-8a12-207c1ac545ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:45.383668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9f426-e39f-44cd-8a12-207c1ac545ad admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:45.384194 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9f426-e39f-44cd-8a12-207c1ac545ad admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:45.384709 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9f426-e39f-44cd-8a12-207c1ac545ad admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:45.386699 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe9f426-e39f-44cd-8a12-207c1ac545ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:45.389630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe9f426-e39f-44cd-8a12-207c1ac545ad admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:45.552684 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1414/2854] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:58:45 2022] POST /identity/v3/projects => generated 381 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:58:45.563086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a61173-1dd3-4e14-87ca-a6f414c19fd5 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:45.598088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a61173-1dd3-4e14-87ca-a6f414c19fd5 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:45.684819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:45.826709 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019befbc-7626-4fff-8a9e-33b50862d7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:45.827339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019befbc-7626-4fff-8a9e-33b50862d7a3 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:45.827611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019befbc-7626-4fff-8a9e-33b50862d7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:45.827885 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019befbc-7626-4fff-8a9e-33b50862d7a3 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:45.828806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019befbc-7626-4fff-8a9e-33b50862d7a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:45.831565 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019befbc-7626-4fff-8a9e-33b50862d7a3 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:45.916692 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1441/2855] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:58:45 2022] POST /identity/v3/users => generated 291 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:58:45.922072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9f426-e39f-44cd-8a12-207c1ac545ad admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:45.935897 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9f426-e39f-44cd-8a12-207c1ac545ad admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:45.973751 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29cd20-2745-40bf-b2e7-9ac44b938463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:45.974650 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29cd20-2745-40bf-b2e7-9ac44b938463 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:45.975103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29cd20-2745-40bf-b2e7-9ac44b938463 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:45.975544 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29cd20-2745-40bf-b2e7-9ac44b938463 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:45.976355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca29cd20-2745-40bf-b2e7-9ac44b938463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:45.979327 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca29cd20-2745-40bf-b2e7-9ac44b938463 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:46.021498 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1415/2856] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:58:46.024004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019befbc-7626-4fff-8a9e-33b50862d7a3 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:46.056029 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019befbc-7626-4fff-8a9e-33b50862d7a3 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:46.079158 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1285abe-ac8d-4c62-af48-2d0a32f4ff55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:46.080067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1285abe-ac8d-4c62-af48-2d0a32f4ff55 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:46.080534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1285abe-ac8d-4c62-af48-2d0a32f4ff55 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:46.082179 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1285abe-ac8d-4c62-af48-2d0a32f4ff55 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:46.083108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1285abe-ac8d-4c62-af48-2d0a32f4ff55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:46.091136 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1285abe-ac8d-4c62-af48-2d0a32f4ff55 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:46.156109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29cd20-2745-40bf-b2e7-9ac44b938463 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:46.158856 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1442/2857] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:58:46.184087 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29cd20-2745-40bf-b2e7-9ac44b938463 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:46.204574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d5f4d-c924-4b7a-ad10-7599657e03d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:46.205264 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d5f4d-c924-4b7a-ad10-7599657e03d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:46.205659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d5f4d-c924-4b7a-ad10-7599657e03d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:46.205886 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d5f4d-c924-4b7a-ad10-7599657e03d2 admin admin] PATH_INFO: `/v3/projects/ce68966451244078835766f1dfd16258/users/e3a18bfb46b54712a4b6e1f6bec790a4/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:46.283327 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d5f4d-c924-4b7a-ad10-7599657e03d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce68966451244078835766f1dfd16258, user_id=e3a18bfb46b54712a4b6e1f6bec790a4, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:46.300486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d5f4d-c924-4b7a-ad10-7599657e03d2 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:46.398248 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1416/2858] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:58:46 2022] PUT /identity/v3/projects/ce68966451244078835766f1dfd16258/users/e3a18bfb46b54712a4b6e1f6bec790a4/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:58:46.404371 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7510719-e244-46ef-8b2d-422d69eb956d None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:46.404768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7510719-e244-46ef-8b2d-422d69eb956d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:46.405149 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7510719-e244-46ef-8b2d-422d69eb956d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:46.498232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a7510719-e244-46ef-8b2d-422d69eb956d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:58:46.504550 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a7510719-e244-46ef-8b2d-422d69eb956d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:46.605829 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1443/2859] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:58:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:58:46.684060 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d5f4d-c924-4b7a-ad10-7599657e03d2 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:46.701570 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a88d5f4d-c924-4b7a-ad10-7599657e03d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:46.878723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d5f4d-c924-4b7a-ad10-7599657e03d2 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:46.888164 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b6f9d-18d1-4d36-bbb5-bb77db4e7d35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:46.888894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b6f9d-18d1-4d36-bbb5-bb77db4e7d35 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:46.889300 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b6f9d-18d1-4d36-bbb5-bb77db4e7d35 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:46.889802 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b6f9d-18d1-4d36-bbb5-bb77db4e7d35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:46.912559 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b6f9d-18d1-4d36-bbb5-bb77db4e7d35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:46.914315 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b6f9d-18d1-4d36-bbb5-bb77db4e7d35 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:46.945052 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1417/2860] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:58:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:58:47.072484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7510719-e244-46ef-8b2d-422d69eb956d None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:47.085304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7510719-e244-46ef-8b2d-422d69eb956d None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:47.093307 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1f708-ecc4-43d4-bc79-bd8ff32f74e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:47.094176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1f708-ecc4-43d4-bc79-bd8ff32f74e2 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:47.094722 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1f708-ecc4-43d4-bc79-bd8ff32f74e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:47.095195 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1f708-ecc4-43d4-bc79-bd8ff32f74e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:47.099899 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2cf1f708-ecc4-43d4-bc79-bd8ff32f74e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:47.264568 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1f708-ecc4-43d4-bc79-bd8ff32f74e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:47.266889 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1f708-ecc4-43d4-bc79-bd8ff32f74e2 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:47.289928 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1444/2861] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:58:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:58:48.492508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b6f9d-18d1-4d36-bbb5-bb77db4e7d35 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:48.498119 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e70b6f9d-18d1-4d36-bbb5-bb77db4e7d35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:48.518407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b6f9d-18d1-4d36-bbb5-bb77db4e7d35 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:48.523119 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14598d-bebf-43cf-97c7-3ff5d5778fd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:48.524064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14598d-bebf-43cf-97c7-3ff5d5778fd6 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:48.524518 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14598d-bebf-43cf-97c7-3ff5d5778fd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:48.525141 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14598d-bebf-43cf-97c7-3ff5d5778fd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:48.528207 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0e14598d-bebf-43cf-97c7-3ff5d5778fd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:48.581027 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14598d-bebf-43cf-97c7-3ff5d5778fd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:48.583179 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14598d-bebf-43cf-97c7-3ff5d5778fd6 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:48.608553 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1418/2862] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:58:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:58:52.900450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402a98c-5af6-44ea-8f11-65a3af764d3c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:52.901578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402a98c-5af6-44ea-8f11-65a3af764d3c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:52.902213 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402a98c-5af6-44ea-8f11-65a3af764d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:52.935666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-3402a98c-5af6-44ea-8f11-65a3af764d3c None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:58:52.938259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3402a98c-5af6-44ea-8f11-65a3af764d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:53.034637 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:53.165821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14598d-bebf-43cf-97c7-3ff5d5778fd6 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:53.167830 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1445/2863] 10.222.0.33 () {58 vars in 967 bytes} [Sat Aug 6 20:58:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:58:53.177956 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0e14598d-bebf-43cf-97c7-3ff5d5778fd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:53.439151 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14598d-bebf-43cf-97c7-3ff5d5778fd6 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:53.453217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be243e2-7eb0-4b6a-a2c5-94c10e447a69 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:53.454227 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be243e2-7eb0-4b6a-a2c5-94c10e447a69 service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:53.455760 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be243e2-7eb0-4b6a-a2c5-94c10e447a69 service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:53.456515 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be243e2-7eb0-4b6a-a2c5-94c10e447a69 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:53.485826 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be243e2-7eb0-4b6a-a2c5-94c10e447a69 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:53.488426 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be243e2-7eb0-4b6a-a2c5-94c10e447a69 service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:53.523367 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:53.533021 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1419/2864] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 20:58:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 06 20:58:54.213298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402a98c-5af6-44ea-8f11-65a3af764d3c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:54.263786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402a98c-5af6-44ea-8f11-65a3af764d3c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:54.277085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7e259-f159-4d20-ad14-ee136b834a0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:54.278275 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7e259-f159-4d20-ad14-ee136b834a0b service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:54.278859 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7e259-f159-4d20-ad14-ee136b834a0b service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:54.279337 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7e259-f159-4d20-ad14-ee136b834a0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:54.281860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5ba7e259-f159-4d20-ad14-ee136b834a0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:54.305587 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7e259-f159-4d20-ad14-ee136b834a0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:54.307015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7e259-f159-4d20-ad14-ee136b834a0b service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:54.370719 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1446/2865] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:58:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:58:54.897846 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26113911-6b46-40fc-b019-b70c756c2a8f None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:54.898973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26113911-6b46-40fc-b019-b70c756c2a8f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:54.899477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26113911-6b46-40fc-b019-b70c756c2a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:54.935131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-26113911-6b46-40fc-b019-b70c756c2a8f None None] MFA Rules not processed for user `d43d0d15118242b7a60cc34c512fbe5e`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:58:54.940900 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-26113911-6b46-40fc-b019-b70c756c2a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:55.095374 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1420/2866] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:58:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:58:58.473891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7e259-f159-4d20-ad14-ee136b834a0b service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:58.475511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5ba7e259-f159-4d20-ad14-ee136b834a0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:58.531002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7e259-f159-4d20-ad14-ee136b834a0b service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:58.537469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26113911-6b46-40fc-b019-b70c756c2a8f None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:58.539109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-26113911-6b46-40fc-b019-b70c756c2a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:58.551682 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00fa55-6bc1-41c9-9cb8-67f8c5863f8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:58.553193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00fa55-6bc1-41c9-9cb8-67f8c5863f8c service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:58.554257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00fa55-6bc1-41c9-9cb8-67f8c5863f8c service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:58.554787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00fa55-6bc1-41c9-9cb8-67f8c5863f8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:58.556830 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-bd00fa55-6bc1-41c9-9cb8-67f8c5863f8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:58.572526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd00fa55-6bc1-41c9-9cb8-67f8c5863f8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:58.575320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd00fa55-6bc1-41c9-9cb8-67f8c5863f8c service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:58.592077 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1447/2867] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:58:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:58:58.753581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26113911-6b46-40fc-b019-b70c756c2a8f None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:58.761054 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4a2b1-f6a7-4bbe-b653-2e2c3810e5b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:58.761918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4a2b1-f6a7-4bbe-b653-2e2c3810e5b0 service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:58.762375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4a2b1-f6a7-4bbe-b653-2e2c3810e5b0 service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:58.762870 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4a2b1-f6a7-4bbe-b653-2e2c3810e5b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:58.764851 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e1d4a2b1-f6a7-4bbe-b653-2e2c3810e5b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:58.780725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d4a2b1-f6a7-4bbe-b653-2e2c3810e5b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:58.782815 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d4a2b1-f6a7-4bbe-b653-2e2c3810e5b0 service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:58.797142 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1421/2868] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:58:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:58:59.919368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00fa55-6bc1-41c9-9cb8-67f8c5863f8c service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:59.922489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-bd00fa55-6bc1-41c9-9cb8-67f8c5863f8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:59.952919 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00fa55-6bc1-41c9-9cb8-67f8c5863f8c service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:59.994169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcd79c-2958-4bf8-aed3-e0192d7117ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:59.995035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcd79c-2958-4bf8-aed3-e0192d7117ba service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:59.995428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcd79c-2958-4bf8-aed3-e0192d7117ba service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:59.995988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcd79c-2958-4bf8-aed3-e0192d7117ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:00.001053 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-52fcd79c-2958-4bf8-aed3-e0192d7117ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:00.031268 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fcd79c-2958-4bf8-aed3-e0192d7117ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:00.034172 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fcd79c-2958-4bf8-aed3-e0192d7117ba service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:00.067952 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1448/2869] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:58:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:59:03.647749 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4855f7-4231-4ae8-84ba-16550aad1c3b None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:03.648305 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4855f7-4231-4ae8-84ba-16550aad1c3b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:03.648305 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4855f7-4231-4ae8-84ba-16550aad1c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:03.685673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-ea4855f7-4231-4ae8-84ba-16550aad1c3b None None] MFA Rules not processed for user `ad1a96004778407584d1805b07ad1c5f`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:59:03.687021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ea4855f7-4231-4ae8-84ba-16550aad1c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:03.768193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcd79c-2958-4bf8-aed3-e0192d7117ba service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:03.768782 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1422/2870] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:59:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:59:03.770359 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-52fcd79c-2958-4bf8-aed3-e0192d7117ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:03.789308 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcd79c-2958-4bf8-aed3-e0192d7117ba service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:03.795673 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec24929-a480-42b4-afe5-eba9a64297bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:03.797935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec24929-a480-42b4-afe5-eba9a64297bc admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:03.798407 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec24929-a480-42b4-afe5-eba9a64297bc admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:03.799162 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec24929-a480-42b4-afe5-eba9a64297bc admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:03.799806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec24929-a480-42b4-afe5-eba9a64297bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:03.801711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec24929-a480-42b4-afe5-eba9a64297bc admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:03.885474 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1449/2871] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:59:03 2022] POST /identity/v3/projects => generated 369 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:59:03.888021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4855f7-4231-4ae8-84ba-16550aad1c3b None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:03.921870 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4855f7-4231-4ae8-84ba-16550aad1c3b None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:03.985191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:04.063383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba070e2-5f2b-4dc7-abce-a152c62a974d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:04.064500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba070e2-5f2b-4dc7-abce-a152c62a974d admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:04.064939 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba070e2-5f2b-4dc7-abce-a152c62a974d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:04.065853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba070e2-5f2b-4dc7-abce-a152c62a974d admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:04.066755 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba070e2-5f2b-4dc7-abce-a152c62a974d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:04.069320 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba070e2-5f2b-4dc7-abce-a152c62a974d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:04.110295 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1423/2872] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:59:03 2022] POST /identity/v3/users => generated 291 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:59:04.111651 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec24929-a480-42b4-afe5-eba9a64297bc admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:04.127651 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec24929-a480-42b4-afe5-eba9a64297bc admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:04.140398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f009a-62cd-4143-88c1-531f93d5ca68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:04.144335 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f009a-62cd-4143-88c1-531f93d5ca68 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:04.144903 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f009a-62cd-4143-88c1-531f93d5ca68 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:04.145355 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f009a-62cd-4143-88c1-531f93d5ca68 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:04.147471 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f009a-62cd-4143-88c1-531f93d5ca68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:04.163149 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f009a-62cd-4143-88c1-531f93d5ca68 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:04.211771 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1450/2873] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:59:04.215668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba070e2-5f2b-4dc7-abce-a152c62a974d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:04.249456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba070e2-5f2b-4dc7-abce-a152c62a974d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:04.266433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35719bb-a0d6-4aba-a888-d351c3f43c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:04.267160 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35719bb-a0d6-4aba-a888-d351c3f43c61 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:04.267495 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35719bb-a0d6-4aba-a888-d351c3f43c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:04.267699 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35719bb-a0d6-4aba-a888-d351c3f43c61 admin admin] PATH_INFO: `/v3/projects/b8aab578cc634111b7de333bdd7ef198/users/d22f6d46c5124b1ba8e025934d9aaf5d/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:04.297867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35719bb-a0d6-4aba-a888-d351c3f43c61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8aab578cc634111b7de333bdd7ef198, user_id=d22f6d46c5124b1ba8e025934d9aaf5d, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:04.305384 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35719bb-a0d6-4aba-a888-d351c3f43c61 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:04.327384 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1424/2874] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:59:04 2022] PUT /identity/v3/projects/b8aab578cc634111b7de333bdd7ef198/users/d22f6d46c5124b1ba8e025934d9aaf5d/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:04.327693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f009a-62cd-4143-88c1-531f93d5ca68 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:04.342519 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f009a-62cd-4143-88c1-531f93d5ca68 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:04.475070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d1eba-d98d-493e-a497-b3dfd22036c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:04.475752 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d1eba-d98d-493e-a497-b3dfd22036c2 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:04.477751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d1eba-d98d-493e-a497-b3dfd22036c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:04.478055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d1eba-d98d-493e-a497-b3dfd22036c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:04.480455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d1eba-d98d-493e-a497-b3dfd22036c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:04.484647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d1eba-d98d-493e-a497-b3dfd22036c2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:04.536877 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1451/2875] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:59:04.538106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35719bb-a0d6-4aba-a888-d351c3f43c61 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:04.554088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35719bb-a0d6-4aba-a888-d351c3f43c61 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:04.573827 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34817fa-95fd-4a36-9fa7-220ecc685e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:04.574848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34817fa-95fd-4a36-9fa7-220ecc685e48 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:04.576058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34817fa-95fd-4a36-9fa7-220ecc685e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:04.577266 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34817fa-95fd-4a36-9fa7-220ecc685e48 admin admin] PATH_INFO: `/v3/projects/b8aab578cc634111b7de333bdd7ef198/users/d22f6d46c5124b1ba8e025934d9aaf5d/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:04.580105 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34817fa-95fd-4a36-9fa7-220ecc685e48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8aab578cc634111b7de333bdd7ef198, user_id=d22f6d46c5124b1ba8e025934d9aaf5d, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:04.585464 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34817fa-95fd-4a36-9fa7-220ecc685e48 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:04.610799 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1425/2876] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:59:04 2022] PUT /identity/v3/projects/b8aab578cc634111b7de333bdd7ef198/users/d22f6d46c5124b1ba8e025934d9aaf5d/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:08.336542 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d1eba-d98d-493e-a497-b3dfd22036c2 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:08.445549 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:08.472448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d1eba-d98d-493e-a497-b3dfd22036c2 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:08.630756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c10cb-b618-454c-83c2-3e982cd6e4b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:08.631505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c10cb-b618-454c-83c2-3e982cd6e4b5 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:08.632399 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c10cb-b618-454c-83c2-3e982cd6e4b5 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:08.632683 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c10cb-b618-454c-83c2-3e982cd6e4b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:08.634854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c44c10cb-b618-454c-83c2-3e982cd6e4b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:08.747163 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c10cb-b618-454c-83c2-3e982cd6e4b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:08.748739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c10cb-b618-454c-83c2-3e982cd6e4b5 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:08.758988 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1452/2877] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:59:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:59:10.506263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77edc4b8-9682-4caf-9708-e46d1a1c88e8 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:10.506780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77edc4b8-9682-4caf-9708-e46d1a1c88e8 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:10.506953 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77edc4b8-9682-4caf-9708-e46d1a1c88e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:10.583198 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-77edc4b8-9682-4caf-9708-e46d1a1c88e8 None None] MFA Rules not processed for user `e3a18bfb46b54712a4b6e1f6bec790a4`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:59:10.584981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-77edc4b8-9682-4caf-9708-e46d1a1c88e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:10.769375 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1426/2878] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:59:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:59:10.770807 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae863346-2256-4114-9882-ff9c5bf4dc3e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:10.771375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae863346-2256-4114-9882-ff9c5bf4dc3e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:10.771817 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae863346-2256-4114-9882-ff9c5bf4dc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:10.814690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-ae863346-2256-4114-9882-ff9c5bf4dc3e None None] MFA Rules not processed for user `e3a18bfb46b54712a4b6e1f6bec790a4`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:59:10.815965 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ae863346-2256-4114-9882-ff9c5bf4dc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:10.834714 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1453/2879] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:59:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:59:11.593167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77edc4b8-9682-4caf-9708-e46d1a1c88e8 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:11.618174 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77edc4b8-9682-4caf-9708-e46d1a1c88e8 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:11.625924 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0088e-b98b-4a32-99bc-2e80f5c1f361 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:11.627062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0088e-b98b-4a32-99bc-2e80f5c1f361 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:11.628494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0088e-b98b-4a32-99bc-2e80f5c1f361 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:11.629248 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0088e-b98b-4a32-99bc-2e80f5c1f361 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:11.642240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f0088e-b98b-4a32-99bc-2e80f5c1f361 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:11.645290 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f0088e-b98b-4a32-99bc-2e80f5c1f361 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:11.701928 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1427/2880] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:59:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:59:11.888088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae863346-2256-4114-9882-ff9c5bf4dc3e None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:12.011894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0088e-b98b-4a32-99bc-2e80f5c1f361 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:12.013468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e3f0088e-b98b-4a32-99bc-2e80f5c1f361 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:12.014451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae863346-2256-4114-9882-ff9c5bf4dc3e None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:12.020631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbca9c-5e11-4c07-95f1-7e798bd41e0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:12.022094 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbca9c-5e11-4c07-95f1-7e798bd41e0c service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:12.022665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbca9c-5e11-4c07-95f1-7e798bd41e0c service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:12.023159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbca9c-5e11-4c07-95f1-7e798bd41e0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:12.027351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-98dbca9c-5e11-4c07-95f1-7e798bd41e0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:12.047419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dbca9c-5e11-4c07-95f1-7e798bd41e0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:12.051348 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dbca9c-5e11-4c07-95f1-7e798bd41e0c service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:12.076814 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1454/2881] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:59:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:59:12.130982 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:12.157838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0088e-b98b-4a32-99bc-2e80f5c1f361 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:12.166613 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8881e-c1ba-4868-ba23-e6beeee77295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:12.167639 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8881e-c1ba-4868-ba23-e6beeee77295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:12.168280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8881e-c1ba-4868-ba23-e6beeee77295 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:12.168766 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8881e-c1ba-4868-ba23-e6beeee77295 admin admin] PATH_INFO: `/v3/users/3df9834cd3164d72a4bbd4d71d35df96` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:12.170206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8881e-c1ba-4868-ba23-e6beeee77295 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3df9834cd3164d72a4bbd4d71d35df96)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:12.172502 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8881e-c1ba-4868-ba23-e6beeee77295 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:12.280666 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6fd8881e-c1ba-4868-ba23-e6beeee77295 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3df9834cd3164d72a4bbd4d71d35df96'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:12.281562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6fd8881e-c1ba-4868-ba23-e6beeee77295 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3df9834cd3164d72a4bbd4d71d35df96'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:12.282265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6fd8881e-c1ba-4868-ba23-e6beeee77295 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3df9834cd3164d72a4bbd4d71d35df96'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:12.297047 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6fd8881e-c1ba-4868-ba23-e6beeee77295 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3df9834cd3164d72a4bbd4d71d35df96'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:12.331258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6fd8881e-c1ba-4868-ba23-e6beeee77295 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3df9834cd3164d72a4bbd4d71d35df96'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:12.363217 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1428/2882] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:59:12 2022] DELETE /identity/v3/users/3df9834cd3164d72a4bbd4d71d35df96 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:12.739829 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbca9c-5e11-4c07-95f1-7e798bd41e0c service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:12.753008 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbca9c-5e11-4c07-95f1-7e798bd41e0c service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:12.783574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:12.824492 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57adc93-6e6f-4189-b902-91c7f94c209b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:12.825359 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57adc93-6e6f-4189-b902-91c7f94c209b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:12.825792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57adc93-6e6f-4189-b902-91c7f94c209b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:12.826322 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57adc93-6e6f-4189-b902-91c7f94c209b admin admin] PATH_INFO: `/v3/projects/690e571b106a4305977f2d9166a4433e` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:12.827686 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57adc93-6e6f-4189-b902-91c7f94c209b admin admin] RBAC: Authorizing `identity:delete_project(project_id=690e571b106a4305977f2d9166a4433e)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:12.830369 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57adc93-6e6f-4189-b902-91c7f94c209b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:12.910246 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f57adc93-6e6f-4189-b902-91c7f94c209b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '690e571b106a4305977f2d9166a4433e', 'request_id': 'req-f57adc93-6e6f-4189-b902-91c7f94c209b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:12.918929 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f57adc93-6e6f-4189-b902-91c7f94c209b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '690e571b106a4305977f2d9166a4433e', 'request_id': 'req-f57adc93-6e6f-4189-b902-91c7f94c209b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:12.927198 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8881e-c1ba-4868-ba23-e6beeee77295 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:12.929950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6fd8881e-c1ba-4868-ba23-e6beeee77295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:12.947882 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f57adc93-6e6f-4189-b902-91c7f94c209b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '690e571b106a4305977f2d9166a4433e', 'request_id': 'req-f57adc93-6e6f-4189-b902-91c7f94c209b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:12.980557 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f57adc93-6e6f-4189-b902-91c7f94c209b admin admin] The token cache is being invalidate because project 690e571b106a4305977f2d9166a4433e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:59:12.980855 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f57adc93-6e6f-4189-b902-91c7f94c209b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:12.983271 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f57adc93-6e6f-4189-b902-91c7f94c209b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:12.985958 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1455/2883] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:59:12 2022] DELETE /identity/v3/projects/690e571b106a4305977f2d9166a4433e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:12.993526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b283c97-cceb-4fb7-891a-070facb4244c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:12.995311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b283c97-cceb-4fb7-891a-070facb4244c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:13.001079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b283c97-cceb-4fb7-891a-070facb4244c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:13.044442 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-5b283c97-cceb-4fb7-891a-070facb4244c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:59:13.046814 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5b283c97-cceb-4fb7-891a-070facb4244c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:13.074298 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8881e-c1ba-4868-ba23-e6beeee77295 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:13.186411 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1456/2884] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:59:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:59:13.194111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a4a1c-0338-480e-aa65-b92cd06700c5 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:13.194515 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a4a1c-0338-480e-aa65-b92cd06700c5 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:13.194975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a4a1c-0338-480e-aa65-b92cd06700c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:13.210128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415c7b7-980a-45c6-be30-97067b3b43d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:13.210886 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415c7b7-980a-45c6-be30-97067b3b43d9 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:13.211177 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415c7b7-980a-45c6-be30-97067b3b43d9 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:13.211455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415c7b7-980a-45c6-be30-97067b3b43d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:13.214011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d415c7b7-980a-45c6-be30-97067b3b43d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:13.226909 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:13.230870 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d415c7b7-980a-45c6-be30-97067b3b43d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:13.233075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-910a4a1c-0338-480e-aa65-b92cd06700c5 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:59:13.233645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d415c7b7-980a-45c6-be30-97067b3b43d9 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:13.235144 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-910a4a1c-0338-480e-aa65-b92cd06700c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:13.251962 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1457/2885] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:59:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:59:13.254104 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a4a1c-0338-480e-aa65-b92cd06700c5 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:13.265741 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1429/2886] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:59:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:59:13.269267 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a4a1c-0338-480e-aa65-b92cd06700c5 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:13.274773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ca29b-e217-417c-a4e1-a275b69097e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:13.275432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ca29b-e217-417c-a4e1-a275b69097e9 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:13.275720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ca29b-e217-417c-a4e1-a275b69097e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:13.275996 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ca29b-e217-417c-a4e1-a275b69097e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:13.277358 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ca29b-e217-417c-a4e1-a275b69097e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:59:13.277724 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ca29b-e217-417c-a4e1-a275b69097e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:13.279397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ca29b-e217-417c-a4e1-a275b69097e9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:13.295365 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1458/2887] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:59:13.299823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415c7b7-980a-45c6-be30-97067b3b43d9 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:13.314202 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415c7b7-980a-45c6-be30-97067b3b43d9 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:13.322679 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f76fb-b927-4215-b075-468f10ab7202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:13.325156 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f76fb-b927-4215-b075-468f10ab7202 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:13.325664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f76fb-b927-4215-b075-468f10ab7202 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:13.326210 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f76fb-b927-4215-b075-468f10ab7202 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:13.326979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f76fb-b927-4215-b075-468f10ab7202 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:13.329435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f76fb-b927-4215-b075-468f10ab7202 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:13.375870 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ca29b-e217-417c-a4e1-a275b69097e9 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:13.377917 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-cc9ca29b-e217-417c-a4e1-a275b69097e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:13.394538 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1430/2888] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:59:13 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:59:13.395556 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f76fb-b927-4215-b075-468f10ab7202 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:13.398734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ca29b-e217-417c-a4e1-a275b69097e9 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:13.456136 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:13.518969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31beab87-1d49-4817-bae7-b72a2433b064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:13.520368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31beab87-1d49-4817-bae7-b72a2433b064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:13.520368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31beab87-1d49-4817-bae7-b72a2433b064 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:13.520600 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31beab87-1d49-4817-bae7-b72a2433b064 admin admin] PATH_INFO: `/v3/users/0701f31766dd4eeab9a63f6411c26d6e` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:13.524423 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31beab87-1d49-4817-bae7-b72a2433b064 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0701f31766dd4eeab9a63f6411c26d6e)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:13.525097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31beab87-1d49-4817-bae7-b72a2433b064 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:13.542357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f76fb-b927-4215-b075-468f10ab7202 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:13.551378 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e58c73-e0ec-487c-93e2-d304872df530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:13.552732 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e58c73-e0ec-487c-93e2-d304872df530 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:13.553322 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e58c73-e0ec-487c-93e2-d304872df530 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:13.553805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e58c73-e0ec-487c-93e2-d304872df530 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:13.554730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e58c73-e0ec-487c-93e2-d304872df530 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:13.556889 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e58c73-e0ec-487c-93e2-d304872df530 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:13.620736 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1431/2889] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:59:13 2022] POST /identity/v3/users => generated 294 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:59:13.624646 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e58c73-e0ec-487c-93e2-d304872df530 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:13.647065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e58c73-e0ec-487c-93e2-d304872df530 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:13.647832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-31beab87-1d49-4817-bae7-b72a2433b064 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0701f31766dd4eeab9a63f6411c26d6e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:13.649726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bd938-2c67-4202-abb1-259e6a067de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:13.650870 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bd938-2c67-4202-abb1-259e6a067de3 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:13.650870 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bd938-2c67-4202-abb1-259e6a067de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:13.651070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bd938-2c67-4202-abb1-259e6a067de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:13.651647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bd938-2c67-4202-abb1-259e6a067de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:13.654442 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bd938-2c67-4202-abb1-259e6a067de3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:13.658870 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-31beab87-1d49-4817-bae7-b72a2433b064 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0701f31766dd4eeab9a63f6411c26d6e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:13.659885 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-31beab87-1d49-4817-bae7-b72a2433b064 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0701f31766dd4eeab9a63f6411c26d6e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:13.660747 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-31beab87-1d49-4817-bae7-b72a2433b064 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0701f31766dd4eeab9a63f6411c26d6e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:13.674402 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1432/2890] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:59:13.678144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bd938-2c67-4202-abb1-259e6a067de3 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:13.684349 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-31beab87-1d49-4817-bae7-b72a2433b064 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0701f31766dd4eeab9a63f6411c26d6e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:13.688856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4b5bd938-2c67-4202-abb1-259e6a067de3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:13.728540 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bd938-2c67-4202-abb1-259e6a067de3 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:13.734408 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1459/2891] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:59:13 2022] DELETE /identity/v3/users/0701f31766dd4eeab9a63f6411c26d6e => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:13.737913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83289c-0c67-4cf8-bf46-e3647ffe8463 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:13.738199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83289c-0c67-4cf8-bf46-e3647ffe8463 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:13.738481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83289c-0c67-4cf8-bf46-e3647ffe8463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:13.743379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c03499-2e2a-4814-8d53-ba5eb28bf850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:13.744059 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c03499-2e2a-4814-8d53-ba5eb28bf850 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:13.744347 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c03499-2e2a-4814-8d53-ba5eb28bf850 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:13.744622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c03499-2e2a-4814-8d53-ba5eb28bf850 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:13.745933 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c03499-2e2a-4814-8d53-ba5eb28bf850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:13.747719 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c03499-2e2a-4814-8d53-ba5eb28bf850 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:13.776537 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1433/2892] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:59:13.776537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c03499-2e2a-4814-8d53-ba5eb28bf850 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:13.785616 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-ad83289c-0c67-4cf8-bf46-e3647ffe8463 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:59:13.786958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ad83289c-0c67-4cf8-bf46-e3647ffe8463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:13.800128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c03499-2e2a-4814-8d53-ba5eb28bf850 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:13.928068 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1460/2893] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:59:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:59:13.936616 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1756a6f-6afd-42da-a336-446aaa940058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:13.937299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1756a6f-6afd-42da-a336-446aaa940058 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:13.937574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1756a6f-6afd-42da-a336-446aaa940058 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:13.937855 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1756a6f-6afd-42da-a336-446aaa940058 admin admin] PATH_INFO: `/v3/projects/26d35f36722e4fc8ac7d222cf93883e9/users/dd9a63d793aa4a55822bfe108df664a3/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:13.955674 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1756a6f-6afd-42da-a336-446aaa940058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26d35f36722e4fc8ac7d222cf93883e9, user_id=dd9a63d793aa4a55822bfe108df664a3, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:13.958504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1756a6f-6afd-42da-a336-446aaa940058 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:13.976999 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1434/2894] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:59:13 2022] PUT /identity/v3/projects/26d35f36722e4fc8ac7d222cf93883e9/users/dd9a63d793aa4a55822bfe108df664a3/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:13.983014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29b35c-8c14-48bf-860a-b1cd9acf885b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:13.983445 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29b35c-8c14-48bf-860a-b1cd9acf885b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:13.983795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29b35c-8c14-48bf-860a-b1cd9acf885b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:14.010534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-8e29b35c-8c14-48bf-860a-b1cd9acf885b None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:59:14.012218 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8e29b35c-8c14-48bf-860a-b1cd9acf885b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:14.016413 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1756a6f-6afd-42da-a336-446aaa940058 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:14.019435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c1756a6f-6afd-42da-a336-446aaa940058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:14.090586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:14.145732 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1756a6f-6afd-42da-a336-446aaa940058 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:14.149968 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd6eb8-53fc-47e1-a9e1-cde4077dd086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:14.150734 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd6eb8-53fc-47e1-a9e1-cde4077dd086 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:14.151003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd6eb8-53fc-47e1-a9e1-cde4077dd086 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:14.151273 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd6eb8-53fc-47e1-a9e1-cde4077dd086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:14.221477 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:14.255531 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1461/2895] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:59:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:59:14.278054 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd6eb8-53fc-47e1-a9e1-cde4077dd086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:14.279684 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd6eb8-53fc-47e1-a9e1-cde4077dd086 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:14.285798 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29b35c-8c14-48bf-860a-b1cd9acf885b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:14.287787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8e29b35c-8c14-48bf-860a-b1cd9acf885b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:14.291765 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1435/2896] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:59:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:59:14.313678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29b35c-8c14-48bf-860a-b1cd9acf885b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:14.319863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bcb3c2-6f5e-4db5-a217-d9faf8c97a20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:14.322099 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcb3c2-6f5e-4db5-a217-d9faf8c97a20 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:14.322352 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcb3c2-6f5e-4db5-a217-d9faf8c97a20 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:14.322660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcb3c2-6f5e-4db5-a217-d9faf8c97a20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:14.348379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bcb3c2-6f5e-4db5-a217-d9faf8c97a20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:14.353231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bcb3c2-6f5e-4db5-a217-d9faf8c97a20 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:14.393570 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1462/2897] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:59:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:59:15.048644 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd6eb8-53fc-47e1-a9e1-cde4077dd086 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:15.050803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1edd6eb8-53fc-47e1-a9e1-cde4077dd086 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:15.082466 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd6eb8-53fc-47e1-a9e1-cde4077dd086 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:15.097034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba08cd-2333-425c-a452-1a9fe61ee28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:15.100166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba08cd-2333-425c-a452-1a9fe61ee28b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:15.109561 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba08cd-2333-425c-a452-1a9fe61ee28b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:15.109561 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba08cd-2333-425c-a452-1a9fe61ee28b admin admin] PATH_INFO: `/v3/projects/aa51632a6bbf4d26b3db87902d6a17d2` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:15.111786 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba08cd-2333-425c-a452-1a9fe61ee28b admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa51632a6bbf4d26b3db87902d6a17d2)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:15.114912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba08cd-2333-425c-a452-1a9fe61ee28b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:15.364474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d7ba08cd-2333-425c-a452-1a9fe61ee28b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa51632a6bbf4d26b3db87902d6a17d2', 'request_id': 'req-d7ba08cd-2333-425c-a452-1a9fe61ee28b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:15.403003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d7ba08cd-2333-425c-a452-1a9fe61ee28b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa51632a6bbf4d26b3db87902d6a17d2', 'request_id': 'req-d7ba08cd-2333-425c-a452-1a9fe61ee28b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:15.424842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d7ba08cd-2333-425c-a452-1a9fe61ee28b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa51632a6bbf4d26b3db87902d6a17d2', 'request_id': 'req-d7ba08cd-2333-425c-a452-1a9fe61ee28b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:15.452819 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d7ba08cd-2333-425c-a452-1a9fe61ee28b admin admin] The token cache is being invalidate because project aa51632a6bbf4d26b3db87902d6a17d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:59:15.453027 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d7ba08cd-2333-425c-a452-1a9fe61ee28b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:15.455626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d7ba08cd-2333-425c-a452-1a9fe61ee28b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:15.458006 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1436/2898] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:59:15 2022] DELETE /identity/v3/projects/aa51632a6bbf4d26b3db87902d6a17d2 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:15.462781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bcb3c2-6f5e-4db5-a217-d9faf8c97a20 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:15.481539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bcb3c2-6f5e-4db5-a217-d9faf8c97a20 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:15.649062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043369f4-0684-45cd-85e4-0493d5a21caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:15.649730 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043369f4-0684-45cd-85e4-0493d5a21caa admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:15.650014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043369f4-0684-45cd-85e4-0493d5a21caa admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:15.650288 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043369f4-0684-45cd-85e4-0493d5a21caa admin admin] PATH_INFO: `/v3/users/3028158d6d2f4b83815b724cd13dcb3b` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:15.652093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043369f4-0684-45cd-85e4-0493d5a21caa admin admin] RBAC: Authorizing `identity:delete_user(user_id=3028158d6d2f4b83815b724cd13dcb3b)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:15.654905 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043369f4-0684-45cd-85e4-0493d5a21caa admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:15.819208 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-043369f4-0684-45cd-85e4-0493d5a21caa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3028158d6d2f4b83815b724cd13dcb3b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:15.864609 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-043369f4-0684-45cd-85e4-0493d5a21caa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3028158d6d2f4b83815b724cd13dcb3b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:15.868216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-043369f4-0684-45cd-85e4-0493d5a21caa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3028158d6d2f4b83815b724cd13dcb3b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:15.872877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-043369f4-0684-45cd-85e4-0493d5a21caa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3028158d6d2f4b83815b724cd13dcb3b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:15.891116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-043369f4-0684-45cd-85e4-0493d5a21caa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3028158d6d2f4b83815b724cd13dcb3b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:15.973457 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1463/2899] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:59:15 2022] DELETE /identity/v3/users/3028158d6d2f4b83815b724cd13dcb3b => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:16.521797 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba08cd-2333-425c-a452-1a9fe61ee28b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:16.523324 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d7ba08cd-2333-425c-a452-1a9fe61ee28b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:16.556012 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba08cd-2333-425c-a452-1a9fe61ee28b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:16.728273 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:16.744341 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f2612-e668-46c7-9855-d02bc844bcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:16.745173 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f2612-e668-46c7-9855-d02bc844bcd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:16.745578 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f2612-e668-46c7-9855-d02bc844bcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:16.745942 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f2612-e668-46c7-9855-d02bc844bcd0 admin admin] PATH_INFO: `/v3/users/ea7293bc4816483dbcd0f96536814d2c` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:16.747398 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f2612-e668-46c7-9855-d02bc844bcd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea7293bc4816483dbcd0f96536814d2c)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:16.762910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f2612-e668-46c7-9855-d02bc844bcd0 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:16.905915 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-375f2612-e668-46c7-9855-d02bc844bcd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea7293bc4816483dbcd0f96536814d2c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:16.906422 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043369f4-0684-45cd-85e4-0493d5a21caa admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:16.906974 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-375f2612-e668-46c7-9855-d02bc844bcd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea7293bc4816483dbcd0f96536814d2c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:16.907627 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-375f2612-e668-46c7-9855-d02bc844bcd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea7293bc4816483dbcd0f96536814d2c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:16.908247 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-043369f4-0684-45cd-85e4-0493d5a21caa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:16.920515 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-375f2612-e668-46c7-9855-d02bc844bcd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea7293bc4816483dbcd0f96536814d2c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:16.933665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043369f4-0684-45cd-85e4-0493d5a21caa admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:16.947405 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249e61b-d848-4999-a57f-fa40444f01ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:16.948642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-375f2612-e668-46c7-9855-d02bc844bcd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea7293bc4816483dbcd0f96536814d2c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:16.949090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249e61b-d848-4999-a57f-fa40444f01ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:16.949575 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249e61b-d848-4999-a57f-fa40444f01ee admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:16.950014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249e61b-d848-4999-a57f-fa40444f01ee admin admin] PATH_INFO: `/v3/projects/40902914b9a24c9e866171fbbcad74af` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:16.954973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249e61b-d848-4999-a57f-fa40444f01ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=40902914b9a24c9e866171fbbcad74af)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:16.957287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249e61b-d848-4999-a57f-fa40444f01ee admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:16.977275 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1437/2900] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:59:16 2022] DELETE /identity/v3/users/ea7293bc4816483dbcd0f96536814d2c => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:16.979181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb98727-1ff7-496e-9251-e0c4f720825d None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:16.980149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb98727-1ff7-496e-9251-e0c4f720825d None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:16.980534 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb98727-1ff7-496e-9251-e0c4f720825d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:17.012693 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-7fb98727-1ff7-496e-9251-e0c4f720825d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:59:17.015472 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7fb98727-1ff7-496e-9251-e0c4f720825d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:17.091323 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2249e61b-d848-4999-a57f-fa40444f01ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40902914b9a24c9e866171fbbcad74af', 'request_id': 'req-2249e61b-d848-4999-a57f-fa40444f01ee'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:17.110739 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1438/2901] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:59:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:59:17.111470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2249e61b-d848-4999-a57f-fa40444f01ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40902914b9a24c9e866171fbbcad74af', 'request_id': 'req-2249e61b-d848-4999-a57f-fa40444f01ee'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:17.113858 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:17.128421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2249e61b-d848-4999-a57f-fa40444f01ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40902914b9a24c9e866171fbbcad74af', 'request_id': 'req-2249e61b-d848-4999-a57f-fa40444f01ee'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:17.143625 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2249e61b-d848-4999-a57f-fa40444f01ee admin admin] The token cache is being invalidate because project 40902914b9a24c9e866171fbbcad74af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:59:17.144155 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2249e61b-d848-4999-a57f-fa40444f01ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:17.149320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2249e61b-d848-4999-a57f-fa40444f01ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:17.151584 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1464/2902] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:59:16 2022] DELETE /identity/v3/projects/40902914b9a24c9e866171fbbcad74af => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:17.156815 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e73e79-70f7-48ff-825a-b8601de721a7 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:17.157610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e73e79-70f7-48ff-825a-b8601de721a7 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:17.157922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e73e79-70f7-48ff-825a-b8601de721a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:17.176710 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249e61b-d848-4999-a57f-fa40444f01ee admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:17.178447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2249e61b-d848-4999-a57f-fa40444f01ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:17.190066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-50e73e79-70f7-48ff-825a-b8601de721a7 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:59:17.192977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-50e73e79-70f7-48ff-825a-b8601de721a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:17.309058 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249e61b-d848-4999-a57f-fa40444f01ee admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:17.316359 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18571d8b-180a-469b-84fb-8aa40169ea6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:17.317921 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18571d8b-180a-469b-84fb-8aa40169ea6d service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:17.318219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18571d8b-180a-469b-84fb-8aa40169ea6d service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:17.318498 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18571d8b-180a-469b-84fb-8aa40169ea6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:17.333083 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-18571d8b-180a-469b-84fb-8aa40169ea6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:17.373416 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1439/2903] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:59:17.381977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d6db3-639f-4f2e-a730-c78c62c79d49 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:17.382283 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d6db3-639f-4f2e-a730-c78c62c79d49 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:17.382527 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d6db3-639f-4f2e-a730-c78c62c79d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:17.423041 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f67d6db3-639f-4f2e-a730-c78c62c79d49 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:59:17.424042 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f67d6db3-639f-4f2e-a730-c78c62c79d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:17.437475 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1440/2904] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:59:17.441475 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d6db3-639f-4f2e-a730-c78c62c79d49 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:17.455919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d6db3-639f-4f2e-a730-c78c62c79d49 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:17.465092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18571d8b-180a-469b-84fb-8aa40169ea6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:17.466864 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18571d8b-180a-469b-84fb-8aa40169ea6d service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:17.469130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a2c32-9600-47bc-9f45-0ac53218cd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:17.469755 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a2c32-9600-47bc-9f45-0ac53218cd00 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:17.470030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a2c32-9600-47bc-9f45-0ac53218cd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:17.470314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a2c32-9600-47bc-9f45-0ac53218cd00 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:17.470982 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a2c32-9600-47bc-9f45-0ac53218cd00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:59:17.471280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a2c32-9600-47bc-9f45-0ac53218cd00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:17.472891 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a2c32-9600-47bc-9f45-0ac53218cd00 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:17.484481 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1465/2905] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:59:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:59:17.495997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:17.512555 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18571d8b-180a-469b-84fb-8aa40169ea6d service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:17.516384 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1441/2906] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:59:17.531076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18571d8b-180a-469b-84fb-8aa40169ea6d service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:17.537328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8078a-4ebe-4f77-a157-11771ed4ac32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:17.538161 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8078a-4ebe-4f77-a157-11771ed4ac32 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:17.538511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8078a-4ebe-4f77-a157-11771ed4ac32 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:17.538885 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8078a-4ebe-4f77-a157-11771ed4ac32 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:17.539586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8078a-4ebe-4f77-a157-11771ed4ac32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:17.545388 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8078a-4ebe-4f77-a157-11771ed4ac32 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:17.594864 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1466/2907] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:59:17 2022] POST /identity/v3/projects => generated 373 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:59:17.599494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a2c32-9600-47bc-9f45-0ac53218cd00 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:17.619362 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a2c32-9600-47bc-9f45-0ac53218cd00 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:17.751402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb6bff-a8f5-40a8-a09d-b57ac2aab219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:17.752019 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb6bff-a8f5-40a8-a09d-b57ac2aab219 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:17.752346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb6bff-a8f5-40a8-a09d-b57ac2aab219 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:17.752608 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb6bff-a8f5-40a8-a09d-b57ac2aab219 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:17.753183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb6bff-a8f5-40a8-a09d-b57ac2aab219 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:17.755203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb6bff-a8f5-40a8-a09d-b57ac2aab219 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:17.798045 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1442/2908] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:59:17 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:59:17.799609 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8078a-4ebe-4f77-a157-11771ed4ac32 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:17.821806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8078a-4ebe-4f77-a157-11771ed4ac32 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:17.837658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65065a7e-765d-49d1-af1b-891af83a9dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:17.838283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65065a7e-765d-49d1-af1b-891af83a9dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:17.838570 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65065a7e-765d-49d1-af1b-891af83a9dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:17.838944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65065a7e-765d-49d1-af1b-891af83a9dc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:17.840233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65065a7e-765d-49d1-af1b-891af83a9dc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:17.842068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65065a7e-765d-49d1-af1b-891af83a9dc2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:17.866304 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1467/2909] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:59:17.868349 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb6bff-a8f5-40a8-a09d-b57ac2aab219 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:17.884302 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb6bff-a8f5-40a8-a09d-b57ac2aab219 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:17.898745 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a09c17-671e-4765-84fe-88e08abcffc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:17.901474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a09c17-671e-4765-84fe-88e08abcffc5 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:17.901474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a09c17-671e-4765-84fe-88e08abcffc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:17.901474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a09c17-671e-4765-84fe-88e08abcffc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:17.904997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a09c17-671e-4765-84fe-88e08abcffc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:17.907432 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a09c17-671e-4765-84fe-88e08abcffc5 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:17.922782 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1443/2910] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:59:17.924752 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65065a7e-765d-49d1-af1b-891af83a9dc2 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:17.939915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65065a7e-765d-49d1-af1b-891af83a9dc2 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:17.946240 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762cb27-1665-4733-a34a-e01cbf8860e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:17.947212 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762cb27-1665-4733-a34a-e01cbf8860e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:17.947585 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762cb27-1665-4733-a34a-e01cbf8860e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:17.947953 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762cb27-1665-4733-a34a-e01cbf8860e5 admin admin] PATH_INFO: `/v3/projects/5a9a056b01e74eee84124c184505bcb2/users/f68574f7389a4fddb0676083d6730077/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:17.970416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762cb27-1665-4733-a34a-e01cbf8860e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a9a056b01e74eee84124c184505bcb2, user_id=f68574f7389a4fddb0676083d6730077, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:17.974275 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762cb27-1665-4733-a34a-e01cbf8860e5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:18.031508 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1468/2911] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:59:17 2022] PUT /identity/v3/projects/5a9a056b01e74eee84124c184505bcb2/users/f68574f7389a4fddb0676083d6730077/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:18.039284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7a303-fe63-4a03-bf79-c63f351b36c3 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:18.039682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7a303-fe63-4a03-bf79-c63f351b36c3 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:18.040111 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7a303-fe63-4a03-bf79-c63f351b36c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:18.124607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-bad7a303-fe63-4a03-bf79-c63f351b36c3 None None] MFA Rules not processed for user `f68574f7389a4fddb0676083d6730077`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:59:18.128933 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-bad7a303-fe63-4a03-bf79-c63f351b36c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:18.309037 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1444/2912] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:59:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:59:18.312939 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762cb27-1665-4733-a34a-e01cbf8860e5 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:18.369331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:18.473985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762cb27-1665-4733-a34a-e01cbf8860e5 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:18.482107 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e00fa-4257-4a1c-89b4-d7fe2c2ebfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:18.482953 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e00fa-4257-4a1c-89b4-d7fe2c2ebfd1 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:18.483290 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e00fa-4257-4a1c-89b4-d7fe2c2ebfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:18.483605 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e00fa-4257-4a1c-89b4-d7fe2c2ebfd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:18.484673 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e00fa-4257-4a1c-89b4-d7fe2c2ebfd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:18.486940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e00fa-4257-4a1c-89b4-d7fe2c2ebfd1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:18.528245 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1469/2913] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:59:18 2022] POST /identity/v3/projects => generated 375 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:59:18.532365 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7a303-fe63-4a03-bf79-c63f351b36c3 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:18.551602 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7a303-fe63-4a03-bf79-c63f351b36c3 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:18.648098 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08dc10-67b9-454f-8f3d-2dfa6ca95320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:18.649271 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08dc10-67b9-454f-8f3d-2dfa6ca95320 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:18.649565 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08dc10-67b9-454f-8f3d-2dfa6ca95320 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:18.649902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08dc10-67b9-454f-8f3d-2dfa6ca95320 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:18.650686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f08dc10-67b9-454f-8f3d-2dfa6ca95320 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:18.654174 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f08dc10-67b9-454f-8f3d-2dfa6ca95320 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:18.670985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:18.703872 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1445/2914] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:59:18 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:59:18.717817 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e00fa-4257-4a1c-89b4-d7fe2c2ebfd1 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:18.741001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e00fa-4257-4a1c-89b4-d7fe2c2ebfd1 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:18.747846 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89614297-b074-435c-a442-373ed92d6e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:18.748408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89614297-b074-435c-a442-373ed92d6e37 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:18.748688 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89614297-b074-435c-a442-373ed92d6e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:18.748957 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89614297-b074-435c-a442-373ed92d6e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:18.749598 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89614297-b074-435c-a442-373ed92d6e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:18.752148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89614297-b074-435c-a442-373ed92d6e37 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:18.800217 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1470/2915] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:59:18.803857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08dc10-67b9-454f-8f3d-2dfa6ca95320 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:18.813885 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89614297-b074-435c-a442-373ed92d6e37 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:18.817857 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-89614297-b074-435c-a442-373ed92d6e37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:18.824931 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08dc10-67b9-454f-8f3d-2dfa6ca95320 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:18.831909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89614297-b074-435c-a442-373ed92d6e37 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:18.837564 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438bb90-8e0e-427c-bed4-9043c3907513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:18.838723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2fcfe5-09d5-44f2-bd1c-a6ea090f403b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:18.839716 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438bb90-8e0e-427c-bed4-9043c3907513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:18.840697 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fcfe5-09d5-44f2-bd1c-a6ea090f403b admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:18.840697 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fcfe5-09d5-44f2-bd1c-a6ea090f403b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:18.840697 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fcfe5-09d5-44f2-bd1c-a6ea090f403b admin admin] PATH_INFO: `/v3/projects/526664f28f1d4dd4bcd1e69b97ec3439/users/117f0f15e1be4e4898473ec8e678a1f9/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:18.841152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438bb90-8e0e-427c-bed4-9043c3907513 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:18.841794 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438bb90-8e0e-427c-bed4-9043c3907513 admin admin] PATH_INFO: `/v3/projects/1558d5dbaa704f40a3b6436b4b6c0e51` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:18.843899 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438bb90-8e0e-427c-bed4-9043c3907513 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1558d5dbaa704f40a3b6436b4b6c0e51)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:18.847226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438bb90-8e0e-427c-bed4-9043c3907513 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:18.872045 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2fcfe5-09d5-44f2-bd1c-a6ea090f403b admin admin] RBAC: Authorizing `identity:create_grant(project_id=526664f28f1d4dd4bcd1e69b97ec3439, user_id=117f0f15e1be4e4898473ec8e678a1f9, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:18.876057 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2fcfe5-09d5-44f2-bd1c-a6ea090f403b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:18.905008 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1446/2916] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:59:18 2022] PUT /identity/v3/projects/526664f28f1d4dd4bcd1e69b97ec3439/users/117f0f15e1be4e4898473ec8e678a1f9/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:18.908881 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2fcfe5-09d5-44f2-bd1c-a6ea090f403b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:18.942289 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f438bb90-8e0e-427c-bed4-9043c3907513 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1558d5dbaa704f40a3b6436b4b6c0e51', 'request_id': 'req-f438bb90-8e0e-427c-bed4-9043c3907513'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:18.950259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f438bb90-8e0e-427c-bed4-9043c3907513 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1558d5dbaa704f40a3b6436b4b6c0e51', 'request_id': 'req-f438bb90-8e0e-427c-bed4-9043c3907513'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:18.960452 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f438bb90-8e0e-427c-bed4-9043c3907513 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1558d5dbaa704f40a3b6436b4b6c0e51', 'request_id': 'req-f438bb90-8e0e-427c-bed4-9043c3907513'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:18.974282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f438bb90-8e0e-427c-bed4-9043c3907513 admin admin] The token cache is being invalidate because project 1558d5dbaa704f40a3b6436b4b6c0e51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:59:18.975234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f438bb90-8e0e-427c-bed4-9043c3907513 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:18.977465 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f438bb90-8e0e-427c-bed4-9043c3907513 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:18.980222 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1471/2917] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:59:18 2022] DELETE /identity/v3/projects/1558d5dbaa704f40a3b6436b4b6c0e51 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:18.985004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438bb90-8e0e-427c-bed4-9043c3907513 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:18.987368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f438bb90-8e0e-427c-bed4-9043c3907513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:19.026518 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2fcfe5-09d5-44f2-bd1c-a6ea090f403b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:19.094290 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438bb90-8e0e-427c-bed4-9043c3907513 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:19.110913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3c4c0-3988-4105-a960-e444dfed0a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:19.112005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3c4c0-3988-4105-a960-e444dfed0a75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:19.112970 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3c4c0-3988-4105-a960-e444dfed0a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:19.113412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3c4c0-3988-4105-a960-e444dfed0a75 admin admin] PATH_INFO: `/v3/users/5957e1ab3953455daa504c8a3836735d` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:19.117997 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3c4c0-3988-4105-a960-e444dfed0a75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5957e1ab3953455daa504c8a3836735d)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:19.123090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3c4c0-3988-4105-a960-e444dfed0a75 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:19.193277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1665f7-be9b-46e9-adce-c859af4adb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:19.194182 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1665f7-be9b-46e9-adce-c859af4adb8a admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:19.205584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:19.209078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1665f7-be9b-46e9-adce-c859af4adb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:19.211486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1665f7-be9b-46e9-adce-c859af4adb8a admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:19.216107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1665f7-be9b-46e9-adce-c859af4adb8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:19.221673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1665f7-be9b-46e9-adce-c859af4adb8a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:19.223162 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-04f3c4c0-3988-4105-a960-e444dfed0a75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5957e1ab3953455daa504c8a3836735d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:19.237868 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-04f3c4c0-3988-4105-a960-e444dfed0a75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5957e1ab3953455daa504c8a3836735d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:19.238745 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-04f3c4c0-3988-4105-a960-e444dfed0a75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5957e1ab3953455daa504c8a3836735d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:19.239473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-04f3c4c0-3988-4105-a960-e444dfed0a75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5957e1ab3953455daa504c8a3836735d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:19.251049 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1447/2918] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:59:19.252167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1665f7-be9b-46e9-adce-c859af4adb8a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:19.255331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-04f3c4c0-3988-4105-a960-e444dfed0a75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5957e1ab3953455daa504c8a3836735d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:19.259329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-fc1665f7-be9b-46e9-adce-c859af4adb8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:19.276159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1665f7-be9b-46e9-adce-c859af4adb8a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:19.282737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5795c8-6145-4860-977c-98afc50b6d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:19.283956 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5795c8-6145-4860-977c-98afc50b6d5f admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:19.284460 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5795c8-6145-4860-977c-98afc50b6d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:19.284952 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5795c8-6145-4860-977c-98afc50b6d5f admin admin] PATH_INFO: `/v3/projects/526664f28f1d4dd4bcd1e69b97ec3439/users/117f0f15e1be4e4898473ec8e678a1f9/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:19.287423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5795c8-6145-4860-977c-98afc50b6d5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=526664f28f1d4dd4bcd1e69b97ec3439, user_id=117f0f15e1be4e4898473ec8e678a1f9, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:19.289985 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1472/2919] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:59:18 2022] DELETE /identity/v3/users/5957e1ab3953455daa504c8a3836735d => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:19.292743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5795c8-6145-4860-977c-98afc50b6d5f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:19.314269 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1448/2920] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:59:19 2022] PUT /identity/v3/projects/526664f28f1d4dd4bcd1e69b97ec3439/users/117f0f15e1be4e4898473ec8e678a1f9/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:19.325748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105a0bd-3eb3-4456-a9f3-02ab48dcaab0 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:19.326959 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105a0bd-3eb3-4456-a9f3-02ab48dcaab0 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:19.327965 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105a0bd-3eb3-4456-a9f3-02ab48dcaab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:19.374747 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-0105a0bd-3eb3-4456-a9f3-02ab48dcaab0 None None] MFA Rules not processed for user `117f0f15e1be4e4898473ec8e678a1f9`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:59:19.377276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0105a0bd-3eb3-4456-a9f3-02ab48dcaab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:19.483017 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1473/2921] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:59:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:59:19.484922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5795c8-6145-4860-977c-98afc50b6d5f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:19.521449 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5795c8-6145-4860-977c-98afc50b6d5f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:19.557159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930be33-f766-433f-9a05-a4e19e7dd6bc tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117f0f15e1be4e4898473ec8e678a1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '526664f28f1d4dd4bcd1e69b97ec3439', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:19.561099 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930be33-f766-433f-9a05-a4e19e7dd6bc tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:19.562203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930be33-f766-433f-9a05-a4e19e7dd6bc tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:19.563170 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930be33-f766-433f-9a05-a4e19e7dd6bc tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:19.564408 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930be33-f766-433f-9a05-a4e19e7dd6bc tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:59:19.565081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930be33-f766-433f-9a05-a4e19e7dd6bc tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:19.566978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930be33-f766-433f-9a05-a4e19e7dd6bc tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:19.590416 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1449/2922] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:59:19.594150 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105a0bd-3eb3-4456-a9f3-02ab48dcaab0 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:19.606063 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105a0bd-3eb3-4456-a9f3-02ab48dcaab0 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:19.613966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def28be8-8797-467b-9524-1b7383a07852 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117f0f15e1be4e4898473ec8e678a1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '526664f28f1d4dd4bcd1e69b97ec3439', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:19.614986 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def28be8-8797-467b-9524-1b7383a07852 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:19.615489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def28be8-8797-467b-9524-1b7383a07852 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:19.615951 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def28be8-8797-467b-9524-1b7383a07852 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:19.616831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def28be8-8797-467b-9524-1b7383a07852 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:19.619027 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def28be8-8797-467b-9524-1b7383a07852 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:19.684833 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1474/2923] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:59:19 2022] POST /identity/v3/projects => generated 371 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:59:19.685847 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930be33-f766-433f-9a05-a4e19e7dd6bc tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:19.728161 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930be33-f766-433f-9a05-a4e19e7dd6bc tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:19.836569 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:19.854642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b80a3-e153-4c22-a95b-8004cb58ad68 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117f0f15e1be4e4898473ec8e678a1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '526664f28f1d4dd4bcd1e69b97ec3439', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:19.855303 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b80a3-e153-4c22-a95b-8004cb58ad68 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:19.867946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b80a3-e153-4c22-a95b-8004cb58ad68 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:19.868312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b80a3-e153-4c22-a95b-8004cb58ad68 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:19.869036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b80a3-e153-4c22-a95b-8004cb58ad68 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:59:19.869355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b80a3-e153-4c22-a95b-8004cb58ad68 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:19.871311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b80a3-e153-4c22-a95b-8004cb58ad68 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:19.899824 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1450/2924] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:59:19.930166 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def28be8-8797-467b-9524-1b7383a07852 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:19.932552 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-def28be8-8797-467b-9524-1b7383a07852 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:20.060819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def28be8-8797-467b-9524-1b7383a07852 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:20.068891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088959d-1b20-47a2-a77b-4f863492ef3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:20.069406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088959d-1b20-47a2-a77b-4f863492ef3c service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:20.070205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088959d-1b20-47a2-a77b-4f863492ef3c service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:20.070496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088959d-1b20-47a2-a77b-4f863492ef3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:20.082282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088959d-1b20-47a2-a77b-4f863492ef3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:20.084040 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088959d-1b20-47a2-a77b-4f863492ef3c service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:20.109238 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1475/2925] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:59:19 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:59:20.117368 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f25dd-9aad-4d6d-bd1d-ac7b9b8088c8 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:20.117656 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f25dd-9aad-4d6d-bd1d-ac7b9b8088c8 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:20.117927 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f25dd-9aad-4d6d-bd1d-ac7b9b8088c8 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:20.119617 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1451/2926] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 20:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:59:20.129282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088959d-1b20-47a2-a77b-4f863492ef3c service nova] Authenticating service token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 20:59:20.138840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:20.144728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088959d-1b20-47a2-a77b-4f863492ef3c service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:20.156602 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088959d-1b20-47a2-a77b-4f863492ef3c service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:20.162458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bff71-330e-4440-9320-8fb4eae3d35a tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117f0f15e1be4e4898473ec8e678a1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '526664f28f1d4dd4bcd1e69b97ec3439', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:20.163449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bff71-330e-4440-9320-8fb4eae3d35a tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:20.163926 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bff71-330e-4440-9320-8fb4eae3d35a tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:20.164347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bff71-330e-4440-9320-8fb4eae3d35a tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] PATH_INFO: `/v3/projects/69951ce724f64b5e995611e8bde7477a` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:20.165998 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8bff71-330e-4440-9320-8fb4eae3d35a tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorizing `identity:get_project(project_id=69951ce724f64b5e995611e8bde7477a)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:20.169028 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8bff71-330e-4440-9320-8fb4eae3d35a tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:20.179960 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1476/2927] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 20:59:20 2022] GET /identity/v3/projects/69951ce724f64b5e995611e8bde7477a => generated 371 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:59:20.227939 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d536d-279a-4c3d-a787-89227a2f4c9b None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:20.228250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d536d-279a-4c3d-a787-89227a2f4c9b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:20.228513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d536d-279a-4c3d-a787-89227a2f4c9b None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:20.231364 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1452/2928] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 20:59:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:59:20.240394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bff71-330e-4440-9320-8fb4eae3d35a tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Authenticating service token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 20:59:20.260985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bff71-330e-4440-9320-8fb4eae3d35a tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:20.271066 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bff71-330e-4440-9320-8fb4eae3d35a tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:20.277096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a210e-2d98-42c6-bc7f-538ee39493d0 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117f0f15e1be4e4898473ec8e678a1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '526664f28f1d4dd4bcd1e69b97ec3439', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:20.277915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a210e-2d98-42c6-bc7f-538ee39493d0 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:20.278161 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a210e-2d98-42c6-bc7f-538ee39493d0 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:20.278506 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a210e-2d98-42c6-bc7f-538ee39493d0 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] PATH_INFO: `/v3/projects/69951ce724f64b5e995611e8bde7477a` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:20.280818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a210e-2d98-42c6-bc7f-538ee39493d0 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorizing `identity:get_project(project_id=69951ce724f64b5e995611e8bde7477a)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:20.283228 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a210e-2d98-42c6-bc7f-538ee39493d0 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:20.285525 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1477/2929] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 20:59:20 2022] GET /identity/v3/projects/69951ce724f64b5e995611e8bde7477a => generated 371 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:59:20.363116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d536d-279a-4c3d-a787-89227a2f4c9b None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:20.365630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-096d536d-279a-4c3d-a787-89227a2f4c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:20.536372 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d536d-279a-4c3d-a787-89227a2f4c9b None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:20.549991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0dd9b8-6637-4e78-bfef-2fe98719a120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:20.550584 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0dd9b8-6637-4e78-bfef-2fe98719a120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:20.550871 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0dd9b8-6637-4e78-bfef-2fe98719a120 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:20.551306 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0dd9b8-6637-4e78-bfef-2fe98719a120 admin admin] PATH_INFO: `/v3/projects/29517a1e62d0497e8aaa61d568060cdc` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:20.558190 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0dd9b8-6637-4e78-bfef-2fe98719a120 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29517a1e62d0497e8aaa61d568060cdc)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:20.559986 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0dd9b8-6637-4e78-bfef-2fe98719a120 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:20.737961 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ca0dd9b8-6637-4e78-bfef-2fe98719a120 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29517a1e62d0497e8aaa61d568060cdc', 'request_id': 'req-ca0dd9b8-6637-4e78-bfef-2fe98719a120'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:20.769671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ca0dd9b8-6637-4e78-bfef-2fe98719a120 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29517a1e62d0497e8aaa61d568060cdc', 'request_id': 'req-ca0dd9b8-6637-4e78-bfef-2fe98719a120'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:20.795373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ca0dd9b8-6637-4e78-bfef-2fe98719a120 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29517a1e62d0497e8aaa61d568060cdc', 'request_id': 'req-ca0dd9b8-6637-4e78-bfef-2fe98719a120'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:20.819099 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ca0dd9b8-6637-4e78-bfef-2fe98719a120 admin admin] The token cache is being invalidate because project 29517a1e62d0497e8aaa61d568060cdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:59:20.819834 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ca0dd9b8-6637-4e78-bfef-2fe98719a120 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:20.820943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ca0dd9b8-6637-4e78-bfef-2fe98719a120 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:20.827116 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1453/2930] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:59:20 2022] DELETE /identity/v3/projects/29517a1e62d0497e8aaa61d568060cdc => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:59:20.833121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090b3df-a9a0-4011-b340-bd6b1c0cf0b1 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:20.833415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090b3df-a9a0-4011-b340-bd6b1c0cf0b1 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:20.833738 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090b3df-a9a0-4011-b340-bd6b1c0cf0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:20.858291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-1090b3df-a9a0-4011-b340-bd6b1c0cf0b1 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:59:20.860775 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1090b3df-a9a0-4011-b340-bd6b1c0cf0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:20.955384 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1478/2931] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:59:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:59:20.956595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cf95f-e268-4514-a0fd-615a88956afb None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:20.956890 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cf95f-e268-4514-a0fd-615a88956afb None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:20.957231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cf95f-e268-4514-a0fd-615a88956afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:21.028006 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a21cf95f-e268-4514-a0fd-615a88956afb None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:59:21.031617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a21cf95f-e268-4514-a0fd-615a88956afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:21.067913 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1454/2932] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:59:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:59:21.072329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090b3df-a9a0-4011-b340-bd6b1c0cf0b1 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:21.089695 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090b3df-a9a0-4011-b340-bd6b1c0cf0b1 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:21.104300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842fa87-19fc-468c-a3a3-3daa692bb261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:21.105502 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842fa87-19fc-468c-a3a3-3daa692bb261 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:21.105782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842fa87-19fc-468c-a3a3-3daa692bb261 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:21.106123 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842fa87-19fc-468c-a3a3-3daa692bb261 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:21.106813 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842fa87-19fc-468c-a3a3-3daa692bb261 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:59:21.107493 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842fa87-19fc-468c-a3a3-3daa692bb261 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:21.112003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842fa87-19fc-468c-a3a3-3daa692bb261 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:21.150677 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1479/2933] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:59:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:59:21.155820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21cf95f-e268-4514-a0fd-615a88956afb None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:21.167855 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21cf95f-e268-4514-a0fd-615a88956afb None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:21.186663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7fd23e-30fa-47b1-8b05-75ece6a4b0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:21.187483 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fd23e-30fa-47b1-8b05-75ece6a4b0ea admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:21.187766 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fd23e-30fa-47b1-8b05-75ece6a4b0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:21.188154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fd23e-30fa-47b1-8b05-75ece6a4b0ea admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:21.188953 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7fd23e-30fa-47b1-8b05-75ece6a4b0ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:21.194558 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7fd23e-30fa-47b1-8b05-75ece6a4b0ea admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:21.298151 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1455/2934] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:59:21 2022] POST /identity/v3/projects => generated 395 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:59:21.299460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842fa87-19fc-468c-a3a3-3daa692bb261 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:21.312811 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842fa87-19fc-468c-a3a3-3daa692bb261 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:21.451331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9035acc-9584-43f7-b7e9-b3250c387878 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:21.451885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9035acc-9584-43f7-b7e9-b3250c387878 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:21.452336 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9035acc-9584-43f7-b7e9-b3250c387878 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:21.454190 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1456/2935] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 20:59:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:59:21.461556 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092efc7-9631-4cd9-8326-7ee34c217354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:21.462198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092efc7-9631-4cd9-8326-7ee34c217354 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:21.462481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092efc7-9631-4cd9-8326-7ee34c217354 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:21.462785 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092efc7-9631-4cd9-8326-7ee34c217354 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:21.463423 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092efc7-9631-4cd9-8326-7ee34c217354 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:21.468431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092efc7-9631-4cd9-8326-7ee34c217354 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:21.470295 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9035acc-9584-43f7-b7e9-b3250c387878 None None] Authenticating service token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 20:59:21.473112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a9035acc-9584-43f7-b7e9-b3250c387878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:21.525296 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1480/2936] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:59:21 2022] POST /identity/v3/users => generated 298 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:59:21.529135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092efc7-9631-4cd9-8326-7ee34c217354 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:21.548989 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092efc7-9631-4cd9-8326-7ee34c217354 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:21.554653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4b4d0-a14c-465d-87a9-c0aa408a790c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:21.555347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4b4d0-a14c-465d-87a9-c0aa408a790c admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:21.555856 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4b4d0-a14c-465d-87a9-c0aa408a790c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:21.556062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4b4d0-a14c-465d-87a9-c0aa408a790c admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:21.556663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae4b4d0-a14c-465d-87a9-c0aa408a790c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:21.558922 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae4b4d0-a14c-465d-87a9-c0aa408a790c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:21.578094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:21.592794 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1481/2937] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:59:21.593918 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4b4d0-a14c-465d-87a9-c0aa408a790c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:21.617633 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4b4d0-a14c-465d-87a9-c0aa408a790c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:21.623796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cff3b4-a114-49a8-81a2-c839e9cdca38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:21.624505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cff3b4-a114-49a8-81a2-c839e9cdca38 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:21.624812 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cff3b4-a114-49a8-81a2-c839e9cdca38 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:21.625085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cff3b4-a114-49a8-81a2-c839e9cdca38 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:21.625768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cff3b4-a114-49a8-81a2-c839e9cdca38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:21.627564 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cff3b4-a114-49a8-81a2-c839e9cdca38 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:21.646525 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1482/2938] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:59:21.648881 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9035acc-9584-43f7-b7e9-b3250c387878 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:21.649426 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cff3b4-a114-49a8-81a2-c839e9cdca38 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:21.650346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a9035acc-9584-43f7-b7e9-b3250c387878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:21.681104 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cff3b4-a114-49a8-81a2-c839e9cdca38 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:21.688322 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6440c-71ec-4932-915f-27b071301caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:21.689131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6440c-71ec-4932-915f-27b071301caa admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:21.689508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6440c-71ec-4932-915f-27b071301caa admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:21.690045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6440c-71ec-4932-915f-27b071301caa admin admin] PATH_INFO: `/v3/projects/5d03c5ff6ed945d49d82c794fc3e43c2/users/675a845a87f648cc88ef25b584d99908/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:21.716664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd6440c-71ec-4932-915f-27b071301caa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d03c5ff6ed945d49d82c794fc3e43c2, user_id=675a845a87f648cc88ef25b584d99908, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:21.719412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd6440c-71ec-4932-915f-27b071301caa admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:21.750853 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1483/2939] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:59:21 2022] PUT /identity/v3/projects/5d03c5ff6ed945d49d82c794fc3e43c2/users/675a845a87f648cc88ef25b584d99908/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:21.765742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bfecc-ca84-4b29-a06f-9bea8069c293 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:21.765936 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bfecc-ca84-4b29-a06f-9bea8069c293 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:21.766219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bfecc-ca84-4b29-a06f-9bea8069c293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:21.809130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9035acc-9584-43f7-b7e9-b3250c387878 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:21.831787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-489bfecc-ca84-4b29-a06f-9bea8069c293 None None] MFA Rules not processed for user `675a845a87f648cc88ef25b584d99908`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:59:21.833472 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-489bfecc-ca84-4b29-a06f-9bea8069c293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:21.847170 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:21.939213 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1484/2940] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:59:21 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:59:21.944655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489bfecc-ca84-4b29-a06f-9bea8069c293 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:21.953268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b0679-1557-4287-bc98-a760d56b0f87 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117f0f15e1be4e4898473ec8e678a1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '526664f28f1d4dd4bcd1e69b97ec3439', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:21.954207 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b0679-1557-4287-bc98-a760d56b0f87 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:21.954686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b0679-1557-4287-bc98-a760d56b0f87 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:21.955274 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b0679-1557-4287-bc98-a760d56b0f87 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] PATH_INFO: `/v3/projects/69951ce724f64b5e995611e8bde7477a` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:21.956630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b0679-1557-4287-bc98-a760d56b0f87 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorizing `identity:get_project(project_id=69951ce724f64b5e995611e8bde7477a)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:21.959046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b0679-1557-4287-bc98-a760d56b0f87 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:21.962676 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1457/2941] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 20:59:21 2022] GET /identity/v3/projects/69951ce724f64b5e995611e8bde7477a => generated 371 bytes in 492 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:59:22.015074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b0679-1557-4287-bc98-a760d56b0f87 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:22.027908 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b0679-1557-4287-bc98-a760d56b0f87 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:22.044302 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a50aa-a662-443c-88f6-8e87d13a40bd tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117f0f15e1be4e4898473ec8e678a1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '526664f28f1d4dd4bcd1e69b97ec3439', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:22.045186 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a50aa-a662-443c-88f6-8e87d13a40bd tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:22.045633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a50aa-a662-443c-88f6-8e87d13a40bd tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:22.046062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a50aa-a662-443c-88f6-8e87d13a40bd tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] PATH_INFO: `/v3/projects/69951ce724f64b5e995611e8bde7477a` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:22.050941 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a50aa-a662-443c-88f6-8e87d13a40bd tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorizing `identity:delete_project(project_id=69951ce724f64b5e995611e8bde7477a)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:22.053177 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a50aa-a662-443c-88f6-8e87d13a40bd tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:22.192698 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489bfecc-ca84-4b29-a06f-9bea8069c293 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:22.211562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f20a50aa-a662-443c-88f6-8e87d13a40bd tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69951ce724f64b5e995611e8bde7477a', 'request_id': 'req-f20a50aa-a662-443c-88f6-8e87d13a40bd'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:22.222645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f20a50aa-a662-443c-88f6-8e87d13a40bd tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69951ce724f64b5e995611e8bde7477a', 'request_id': 'req-f20a50aa-a662-443c-88f6-8e87d13a40bd'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:22.242225 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f20a50aa-a662-443c-88f6-8e87d13a40bd tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69951ce724f64b5e995611e8bde7477a', 'request_id': 'req-f20a50aa-a662-443c-88f6-8e87d13a40bd'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:22.282890 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f20a50aa-a662-443c-88f6-8e87d13a40bd tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] The token cache is being invalidate because project 69951ce724f64b5e995611e8bde7477a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:59:22.283191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f20a50aa-a662-443c-88f6-8e87d13a40bd tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:22.283926 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f20a50aa-a662-443c-88f6-8e87d13a40bd tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:22.286955 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1458/2942] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:59:22 2022] DELETE /identity/v3/projects/69951ce724f64b5e995611e8bde7477a => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:22.324757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61562a-caef-4722-a309-0062ba586f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:22.325725 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61562a-caef-4722-a309-0062ba586f4f admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:22.326637 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61562a-caef-4722-a309-0062ba586f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:22.327003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61562a-caef-4722-a309-0062ba586f4f admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:22.327772 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61562a-caef-4722-a309-0062ba586f4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:22.330074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61562a-caef-4722-a309-0062ba586f4f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:22.391393 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1485/2943] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:59:21 2022] POST /identity/v3/projects => generated 395 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:59:22.391894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a50aa-a662-443c-88f6-8e87d13a40bd tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:22.393737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f20a50aa-a662-443c-88f6-8e87d13a40bd tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:22.442918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a50aa-a662-443c-88f6-8e87d13a40bd tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:22.456143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:22.574995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d2bb2-e1ac-49c3-b11b-d968cda72c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:22.575722 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d2bb2-e1ac-49c3-b11b-d968cda72c64 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:22.576071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d2bb2-e1ac-49c3-b11b-d968cda72c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:22.576415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d2bb2-e1ac-49c3-b11b-d968cda72c64 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:22.578452 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d2bb2-e1ac-49c3-b11b-d968cda72c64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:22.593786 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d2bb2-e1ac-49c3-b11b-d968cda72c64 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:22.650685 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71eccd1-fb6b-471b-be13-9384f9464f66 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:22.651336 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71eccd1-fb6b-471b-be13-9384f9464f66 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:22.652349 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71eccd1-fb6b-471b-be13-9384f9464f66 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:22.654902 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1486/2944] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 20:59:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:59:22.661362 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71eccd1-fb6b-471b-be13-9384f9464f66 None None] Authenticating service token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 20:59:22.680370 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a71eccd1-fb6b-471b-be13-9384f9464f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:22.692098 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1459/2945] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:59:22 2022] POST /identity/v3/users => generated 304 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:59:22.697805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d2bb2-e1ac-49c3-b11b-d968cda72c64 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:22.747165 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d2bb2-e1ac-49c3-b11b-d968cda72c64 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:22.762157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243fd38-4006-4ffc-8938-613816008445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:22.762833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243fd38-4006-4ffc-8938-613816008445 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:22.763139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243fd38-4006-4ffc-8938-613816008445 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:22.763363 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243fd38-4006-4ffc-8938-613816008445 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:22.764013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243fd38-4006-4ffc-8938-613816008445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:22.770024 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243fd38-4006-4ffc-8938-613816008445 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:22.800039 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1460/2946] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:59:22.801351 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243fd38-4006-4ffc-8938-613816008445 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:22.817111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:22.824831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243fd38-4006-4ffc-8938-613816008445 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:22.840361 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5efc1dd-de0f-4139-8642-2994574c4d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:22.841718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efc1dd-de0f-4139-8642-2994574c4d34 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:22.842000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efc1dd-de0f-4139-8642-2994574c4d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:22.842764 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efc1dd-de0f-4139-8642-2994574c4d34 admin admin] PATH_INFO: `/v3/projects/639acc17555041ce8dc532741f72075d/users/ab309fc5861a4c69818cff1f5b7ae621/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:22.879906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5efc1dd-de0f-4139-8642-2994574c4d34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=639acc17555041ce8dc532741f72075d, user_id=ab309fc5861a4c69818cff1f5b7ae621, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:22.888978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5efc1dd-de0f-4139-8642-2994574c4d34 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:22.893082 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71eccd1-fb6b-471b-be13-9384f9464f66 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:22.896155 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a71eccd1-fb6b-471b-be13-9384f9464f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:22.910894 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1461/2947] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:59:22 2022] PUT /identity/v3/projects/639acc17555041ce8dc532741f72075d/users/ab309fc5861a4c69818cff1f5b7ae621/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:22.921095 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5efc1dd-de0f-4139-8642-2994574c4d34 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:23.090686 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71eccd1-fb6b-471b-be13-9384f9464f66 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:23.150895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5efc1dd-de0f-4139-8642-2994574c4d34 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:23.165152 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bbcbfe-2ac1-4e10-b33b-fefcf036b2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:23.166069 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbcbfe-2ac1-4e10-b33b-fefcf036b2fe admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:23.166347 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbcbfe-2ac1-4e10-b33b-fefcf036b2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:23.166645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbcbfe-2ac1-4e10-b33b-fefcf036b2fe admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:23.168787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bbcbfe-2ac1-4e10-b33b-fefcf036b2fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:23.172280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bbcbfe-2ac1-4e10-b33b-fefcf036b2fe admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:23.197591 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1462/2948] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:59:23.201360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bbcbfe-2ac1-4e10-b33b-fefcf036b2fe admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:23.206433 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b35b80-ab73-40ff-a702-6f46763fd05b tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117f0f15e1be4e4898473ec8e678a1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '526664f28f1d4dd4bcd1e69b97ec3439', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:23.208583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b35b80-ab73-40ff-a702-6f46763fd05b tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:23.209383 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b35b80-ab73-40ff-a702-6f46763fd05b tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:23.209975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b35b80-ab73-40ff-a702-6f46763fd05b tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] PATH_INFO: `/v3/projects/5a9a056b01e74eee84124c184505bcb2` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:23.213127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b35b80-ab73-40ff-a702-6f46763fd05b tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorizing `identity:get_project(project_id=5a9a056b01e74eee84124c184505bcb2)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:23.217461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b35b80-ab73-40ff-a702-6f46763fd05b tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:23.229544 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1487/2949] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 20:59:22 2022] GET /identity/v3/projects/5a9a056b01e74eee84124c184505bcb2 => generated 373 bytes in 569 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:59:23.230673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bbcbfe-2ac1-4e10-b33b-fefcf036b2fe admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:23.247896 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd94c8-21d5-4546-a2c7-681fcb8e7ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:23.248428 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd94c8-21d5-4546-a2c7-681fcb8e7ac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:23.248706 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd94c8-21d5-4546-a2c7-681fcb8e7ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:23.249036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd94c8-21d5-4546-a2c7-681fcb8e7ac5 admin admin] PATH_INFO: `/v3/projects/639acc17555041ce8dc532741f72075d/users/ab309fc5861a4c69818cff1f5b7ae621/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:23.251279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd94c8-21d5-4546-a2c7-681fcb8e7ac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=639acc17555041ce8dc532741f72075d, user_id=ab309fc5861a4c69818cff1f5b7ae621, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:23.256437 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b35b80-ab73-40ff-a702-6f46763fd05b tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:23.269772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd94c8-21d5-4546-a2c7-681fcb8e7ac5 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:23.284538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b35b80-ab73-40ff-a702-6f46763fd05b tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:23.306316 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1463/2950] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:59:23 2022] PUT /identity/v3/projects/639acc17555041ce8dc532741f72075d/users/ab309fc5861a4c69818cff1f5b7ae621/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:23.383112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fc66c-cbb3-4531-8d28-e7909c5173fc None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:23.383297 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fc66c-cbb3-4531-8d28-e7909c5173fc None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:23.383551 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fc66c-cbb3-4531-8d28-e7909c5173fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:23.444004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53944abd-16b1-482f-9b0c-e5666abc23f8 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117f0f15e1be4e4898473ec8e678a1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '526664f28f1d4dd4bcd1e69b97ec3439', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:23.444284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-cb1fc66c-cbb3-4531-8d28-e7909c5173fc None None] MFA Rules not processed for user `ab309fc5861a4c69818cff1f5b7ae621`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:59:23.444632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53944abd-16b1-482f-9b0c-e5666abc23f8 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:23.444908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53944abd-16b1-482f-9b0c-e5666abc23f8 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:23.445176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53944abd-16b1-482f-9b0c-e5666abc23f8 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:23.446419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-cb1fc66c-cbb3-4531-8d28-e7909c5173fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:23.446807 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53944abd-16b1-482f-9b0c-e5666abc23f8 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:59:23.447119 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53944abd-16b1-482f-9b0c-e5666abc23f8 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:23.449106 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53944abd-16b1-482f-9b0c-e5666abc23f8 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:23.471894 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1488/2951] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:59:23.477110 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53944abd-16b1-482f-9b0c-e5666abc23f8 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:23.508767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53944abd-16b1-482f-9b0c-e5666abc23f8 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:23.515862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34a926-bcb6-4c86-abdc-cb44947caa9f tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117f0f15e1be4e4898473ec8e678a1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '526664f28f1d4dd4bcd1e69b97ec3439', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:23.516831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34a926-bcb6-4c86-abdc-cb44947caa9f tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:23.517487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34a926-bcb6-4c86-abdc-cb44947caa9f tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:23.517975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34a926-bcb6-4c86-abdc-cb44947caa9f tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:23.518948 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f34a926-bcb6-4c86-abdc-cb44947caa9f tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:23.533423 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f34a926-bcb6-4c86-abdc-cb44947caa9f tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:23.556123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:23.571938 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:23.600511 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1489/2952] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:59:23 2022] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:59:23.611927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34a926-bcb6-4c86-abdc-cb44947caa9f tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:23.629463 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1464/2953] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:59:23 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:59:23.720044 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34a926-bcb6-4c86-abdc-cb44947caa9f tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:23.726509 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf6ca5-8875-49b3-96e4-db8300069310 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117f0f15e1be4e4898473ec8e678a1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '526664f28f1d4dd4bcd1e69b97ec3439', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:23.727335 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf6ca5-8875-49b3-96e4-db8300069310 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:23.727734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf6ca5-8875-49b3-96e4-db8300069310 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:23.727972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf6ca5-8875-49b3-96e4-db8300069310 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:23.728865 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf6ca5-8875-49b3-96e4-db8300069310 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:59:23.729178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf6ca5-8875-49b3-96e4-db8300069310 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:23.731232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf6ca5-8875-49b3-96e4-db8300069310 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:23.746936 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1490/2954] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:59:24.163710 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fc66c-cbb3-4531-8d28-e7909c5173fc None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:24.347681 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fc66c-cbb3-4531-8d28-e7909c5173fc None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:24.447329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1676edc-1fac-41f1-9d7b-e0d0f4fce6bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:24.448506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1676edc-1fac-41f1-9d7b-e0d0f4fce6bf service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:24.449035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1676edc-1fac-41f1-9d7b-e0d0f4fce6bf service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:24.449544 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1676edc-1fac-41f1-9d7b-e0d0f4fce6bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:24.541290 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1676edc-1fac-41f1-9d7b-e0d0f4fce6bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:24.544208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1676edc-1fac-41f1-9d7b-e0d0f4fce6bf service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:24.567148 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1465/2955] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:59:24 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:59:24.620548 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedbb22-053b-4479-9cf2-bf567e12404e None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:24.621570 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedbb22-053b-4479-9cf2-bf567e12404e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:24.621570 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedbb22-053b-4479-9cf2-bf567e12404e None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:24.622932 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1491/2956] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 20:59:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:59:24.629195 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1676edc-1fac-41f1-9d7b-e0d0f4fce6bf service nova] Authenticating service token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 20:59:24.636797 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:24.644705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1676edc-1fac-41f1-9d7b-e0d0f4fce6bf service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:24.685847 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1676edc-1fac-41f1-9d7b-e0d0f4fce6bf service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:24.691128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c386f72-8d83-432a-bc3f-6241e05031e5 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117f0f15e1be4e4898473ec8e678a1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '526664f28f1d4dd4bcd1e69b97ec3439', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:24.691764 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c386f72-8d83-432a-bc3f-6241e05031e5 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:24.692045 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c386f72-8d83-432a-bc3f-6241e05031e5 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:24.692320 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c386f72-8d83-432a-bc3f-6241e05031e5 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] PATH_INFO: `/v3/projects/0f38a9f6a69d4aa9b3d3997e572a01ef` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:24.694246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c386f72-8d83-432a-bc3f-6241e05031e5 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorizing `identity:get_project(project_id=0f38a9f6a69d4aa9b3d3997e572a01ef)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:24.703380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c386f72-8d83-432a-bc3f-6241e05031e5 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:24.719052 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1466/2957] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 20:59:24 2022] GET /identity/v3/projects/0f38a9f6a69d4aa9b3d3997e572a01ef => generated 371 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:59:25.037017 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759a145-ee79-4703-9afa-1caad56f9e2c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:25.037461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759a145-ee79-4703-9afa-1caad56f9e2c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:25.037895 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759a145-ee79-4703-9afa-1caad56f9e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:25.107563 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-8759a145-ee79-4703-9afa-1caad56f9e2c None None] MFA Rules not processed for user `dd9a63d793aa4a55822bfe108df664a3`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:59:25.110739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8759a145-ee79-4703-9afa-1caad56f9e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:25.292019 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c386f72-8d83-432a-bc3f-6241e05031e5 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:25.294148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2c386f72-8d83-432a-bc3f-6241e05031e5 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:25.294942 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1492/2958] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:59:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:59:25.309961 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff9eb2-147b-4d8e-a777-16f79f7dab1d None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:25.310649 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff9eb2-147b-4d8e-a777-16f79f7dab1d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:25.311984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff9eb2-147b-4d8e-a777-16f79f7dab1d None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:25.319760 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1493/2959] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 20:59:25 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:59:25.326642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff9eb2-147b-4d8e-a777-16f79f7dab1d None None] Authenticating service token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 20:59:25.329763 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8cff9eb2-147b-4d8e-a777-16f79f7dab1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:25.395287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff9eb2-147b-4d8e-a777-16f79f7dab1d None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:25.451618 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff9eb2-147b-4d8e-a777-16f79f7dab1d None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:25.461593 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb364de5-edd4-42e9-bb38-5cc5fc0accfe tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117f0f15e1be4e4898473ec8e678a1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '526664f28f1d4dd4bcd1e69b97ec3439', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:25.463693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb364de5-edd4-42e9-bb38-5cc5fc0accfe tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:25.463930 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb364de5-edd4-42e9-bb38-5cc5fc0accfe tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:25.464748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb364de5-edd4-42e9-bb38-5cc5fc0accfe tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] PATH_INFO: `/v3/projects/0f38a9f6a69d4aa9b3d3997e572a01ef` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:25.469931 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb364de5-edd4-42e9-bb38-5cc5fc0accfe tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorizing `identity:get_project(project_id=0f38a9f6a69d4aa9b3d3997e572a01ef)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:25.472101 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb364de5-edd4-42e9-bb38-5cc5fc0accfe tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:25.489107 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1494/2960] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 20:59:25 2022] GET /identity/v3/projects/0f38a9f6a69d4aa9b3d3997e572a01ef => generated 371 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:59:25.491902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c386f72-8d83-432a-bc3f-6241e05031e5 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:25.499260 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe7225-c899-4cb8-9e53-9e3645372a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:25.500166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe7225-c899-4cb8-9e53-9e3645372a78 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:25.500166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe7225-c899-4cb8-9e53-9e3645372a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:25.500400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe7225-c899-4cb8-9e53-9e3645372a78 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:25.501025 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe7225-c899-4cb8-9e53-9e3645372a78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:25.502974 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe7225-c899-4cb8-9e53-9e3645372a78 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:25.539789 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb364de5-edd4-42e9-bb38-5cc5fc0accfe tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:25.556190 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb364de5-edd4-42e9-bb38-5cc5fc0accfe tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:25.569190 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878db68-031b-4c8e-95ae-ab971c76f36b tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117f0f15e1be4e4898473ec8e678a1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '526664f28f1d4dd4bcd1e69b97ec3439', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:25.570121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878db68-031b-4c8e-95ae-ab971c76f36b tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:25.570620 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878db68-031b-4c8e-95ae-ab971c76f36b tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:25.571071 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878db68-031b-4c8e-95ae-ab971c76f36b tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:25.571888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878db68-031b-4c8e-95ae-ab971c76f36b tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:59:25.572362 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878db68-031b-4c8e-95ae-ab971c76f36b tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:25.582064 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878db68-031b-4c8e-95ae-ab971c76f36b tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:25.591678 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1467/2961] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:59:25 2022] POST /identity/v3/projects => generated 389 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:59:25.599655 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe7225-c899-4cb8-9e53-9e3645372a78 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:25.615428 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1495/2962] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:59:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:59:25.619312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878db68-031b-4c8e-95ae-ab971c76f36b tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:25.636801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878db68-031b-4c8e-95ae-ab971c76f36b tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:25.754353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe7225-c899-4cb8-9e53-9e3645372a78 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:25.767720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:25.769474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7ac2a-1fd0-4946-ac41-f7e21f7bfb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:25.770107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7ac2a-1fd0-4946-ac41-f7e21f7bfb6e admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:25.770390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7ac2a-1fd0-4946-ac41-f7e21f7bfb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:25.770721 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7ac2a-1fd0-4946-ac41-f7e21f7bfb6e admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:25.771633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c7ac2a-1fd0-4946-ac41-f7e21f7bfb6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:25.774477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c7ac2a-1fd0-4946-ac41-f7e21f7bfb6e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:25.782777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335bfc18-8c29-40b6-a5c8-8299762033cd tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117f0f15e1be4e4898473ec8e678a1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '526664f28f1d4dd4bcd1e69b97ec3439', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:25.783406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bfc18-8c29-40b6-a5c8-8299762033cd tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:25.783871 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bfc18-8c29-40b6-a5c8-8299762033cd tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:25.784151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bfc18-8c29-40b6-a5c8-8299762033cd tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:25.784795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335bfc18-8c29-40b6-a5c8-8299762033cd tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:25.799519 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335bfc18-8c29-40b6-a5c8-8299762033cd tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:25.823469 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1468/2963] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:59:25 2022] POST /identity/v3/users => generated 301 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:59:25.827824 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7ac2a-1fd0-4946-ac41-f7e21f7bfb6e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:25.838309 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1496/2964] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:59:25 2022] POST /identity/v3/users => generated 383 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:59:25.843717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335bfc18-8c29-40b6-a5c8-8299762033cd tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:25.853104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7ac2a-1fd0-4946-ac41-f7e21f7bfb6e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:25.860351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335bfc18-8c29-40b6-a5c8-8299762033cd tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:25.865235 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3cc2b-bee8-4387-8c44-16a9f60afcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:25.865937 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3cc2b-bee8-4387-8c44-16a9f60afcb9 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:25.866202 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3cc2b-bee8-4387-8c44-16a9f60afcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:25.866470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3cc2b-bee8-4387-8c44-16a9f60afcb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:25.867138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3cc2b-bee8-4387-8c44-16a9f60afcb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:25.869991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3cc2b-bee8-4387-8c44-16a9f60afcb9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:25.879097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b504a40-eb52-4183-9a77-cdfcf228e64c tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117f0f15e1be4e4898473ec8e678a1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '526664f28f1d4dd4bcd1e69b97ec3439', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:25.879726 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b504a40-eb52-4183-9a77-cdfcf228e64c tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:25.879982 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b504a40-eb52-4183-9a77-cdfcf228e64c tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:25.880251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b504a40-eb52-4183-9a77-cdfcf228e64c tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:25.880902 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b504a40-eb52-4183-9a77-cdfcf228e64c tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:59:25.881197 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b504a40-eb52-4183-9a77-cdfcf228e64c tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:25.889109 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b504a40-eb52-4183-9a77-cdfcf228e64c tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:25.900230 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1469/2965] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:59:25 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:59:25.902467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3cc2b-bee8-4387-8c44-16a9f60afcb9 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:25.918271 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1497/2966] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:59:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:59:25.924095 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3cc2b-bee8-4387-8c44-16a9f60afcb9 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:25.929918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7a078-5f59-4c70-8820-e927b72c6e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:25.930780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7a078-5f59-4c70-8820-e927b72c6e6b admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:25.931129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7a078-5f59-4c70-8820-e927b72c6e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:25.931463 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7a078-5f59-4c70-8820-e927b72c6e6b admin admin] PATH_INFO: `/v3/projects/1a8b1bb5c0ab47328f44a4284fc3d3d2/users/09abf99d2b254ebb983fa6ec55bc5969/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:25.950330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7a078-5f59-4c70-8820-e927b72c6e6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a8b1bb5c0ab47328f44a4284fc3d3d2, user_id=09abf99d2b254ebb983fa6ec55bc5969, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:25.954065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7a078-5f59-4c70-8820-e927b72c6e6b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:25.979351 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1470/2967] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:59:25 2022] PUT /identity/v3/projects/1a8b1bb5c0ab47328f44a4284fc3d3d2/users/09abf99d2b254ebb983fa6ec55bc5969/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:25.983987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b504a40-eb52-4183-9a77-cdfcf228e64c tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:25.996627 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b504a40-eb52-4183-9a77-cdfcf228e64c tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:26.014643 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d91924-2b13-47b9-8deb-b9450a7b0154 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:26.015034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d91924-2b13-47b9-8deb-b9450a7b0154 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:26.015423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d91924-2b13-47b9-8deb-b9450a7b0154 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:26.017245 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1471/2968] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 20:59:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:59:26.024320 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d91924-2b13-47b9-8deb-b9450a7b0154 None None] Authenticating service token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 20:59:26.091352 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2562e54-fba7-457c-a080-cacb973410da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:26.092013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2562e54-fba7-457c-a080-cacb973410da admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:26.092297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2562e54-fba7-457c-a080-cacb973410da admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:26.092573 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2562e54-fba7-457c-a080-cacb973410da admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:26.094419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:26.096255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2562e54-fba7-457c-a080-cacb973410da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:26.099681 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2562e54-fba7-457c-a080-cacb973410da admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:26.118817 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1498/2969] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:59:25 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:59:26.123660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2562e54-fba7-457c-a080-cacb973410da admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:26.135940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2562e54-fba7-457c-a080-cacb973410da admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:26.142915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258e97c-88a0-459d-bdee-6f0a93ffeff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:26.143578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258e97c-88a0-459d-bdee-6f0a93ffeff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:26.143858 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258e97c-88a0-459d-bdee-6f0a93ffeff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:26.144133 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258e97c-88a0-459d-bdee-6f0a93ffeff6 admin admin] PATH_INFO: `/v3/projects/1a8b1bb5c0ab47328f44a4284fc3d3d2/users/09abf99d2b254ebb983fa6ec55bc5969/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:26.145345 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d91924-2b13-47b9-8deb-b9450a7b0154 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:26.146209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258e97c-88a0-459d-bdee-6f0a93ffeff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a8b1bb5c0ab47328f44a4284fc3d3d2, user_id=09abf99d2b254ebb983fa6ec55bc5969, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:26.149231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258e97c-88a0-459d-bdee-6f0a93ffeff6 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:26.168625 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1499/2970] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:59:26 2022] PUT /identity/v3/projects/1a8b1bb5c0ab47328f44a4284fc3d3d2/users/09abf99d2b254ebb983fa6ec55bc5969/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:26.235979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d91924-2b13-47b9-8deb-b9450a7b0154 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:26.340079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc92385-8db9-44ed-a4fa-76a460877885 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117f0f15e1be4e4898473ec8e678a1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '526664f28f1d4dd4bcd1e69b97ec3439', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:26.342004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc92385-8db9-44ed-a4fa-76a460877885 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:26.342004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc92385-8db9-44ed-a4fa-76a460877885 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:26.342976 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc92385-8db9-44ed-a4fa-76a460877885 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] PATH_INFO: `/v3/projects/0f38a9f6a69d4aa9b3d3997e572a01ef` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:26.344519 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc92385-8db9-44ed-a4fa-76a460877885 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorizing `identity:get_project(project_id=0f38a9f6a69d4aa9b3d3997e572a01ef)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:26.347210 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc92385-8db9-44ed-a4fa-76a460877885 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:26.357504 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1472/2971] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 20:59:26 2022] GET /identity/v3/projects/0f38a9f6a69d4aa9b3d3997e572a01ef => generated 371 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:59:27.227346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a1878-c1db-41de-968f-33dccc56ede5 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:27.227875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a1878-c1db-41de-968f-33dccc56ede5 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:27.227875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a1878-c1db-41de-968f-33dccc56ede5 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:27.231697 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1500/2972] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 20:59:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:59:27.236757 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc92385-8db9-44ed-a4fa-76a460877885 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Authenticating service token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 20:59:27.374539 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc92385-8db9-44ed-a4fa-76a460877885 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:27.396541 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc92385-8db9-44ed-a4fa-76a460877885 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:27.405513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d48a43-07df-451b-959d-9b80e680c1c9 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117f0f15e1be4e4898473ec8e678a1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '526664f28f1d4dd4bcd1e69b97ec3439', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:27.406707 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d48a43-07df-451b-959d-9b80e680c1c9 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:27.407154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d48a43-07df-451b-959d-9b80e680c1c9 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:27.407618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d48a43-07df-451b-959d-9b80e680c1c9 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] PATH_INFO: `/v3/projects/0f38a9f6a69d4aa9b3d3997e572a01ef` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:27.409138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d48a43-07df-451b-959d-9b80e680c1c9 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorizing `identity:get_project(project_id=0f38a9f6a69d4aa9b3d3997e572a01ef)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:27.411810 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d48a43-07df-451b-959d-9b80e680c1c9 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:27.415124 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1473/2973] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 20:59:27 2022] GET /identity/v3/projects/0f38a9f6a69d4aa9b3d3997e572a01ef => generated 371 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:59:27.478343 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a1878-c1db-41de-968f-33dccc56ede5 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:27.505662 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d48a43-07df-451b-959d-9b80e680c1c9 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:27.519112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a1878-c1db-41de-968f-33dccc56ede5 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:27.535217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d48a43-07df-451b-959d-9b80e680c1c9 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:27.539751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ac5e2-7bfc-4263-a9c3-559605bd2462 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117f0f15e1be4e4898473ec8e678a1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '526664f28f1d4dd4bcd1e69b97ec3439', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:27.540544 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ac5e2-7bfc-4263-a9c3-559605bd2462 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:27.540928 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ac5e2-7bfc-4263-a9c3-559605bd2462 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:27.541569 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ac5e2-7bfc-4263-a9c3-559605bd2462 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] PATH_INFO: `/v3/users/78bba8e1bcca4892ac76807ced3d6d8a` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:27.543466 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94552ce-5a7b-4d94-b24c-97bae4b541da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:27.544069 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94552ce-5a7b-4d94-b24c-97bae4b541da service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:27.544349 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94552ce-5a7b-4d94-b24c-97bae4b541da service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:27.544618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94552ce-5a7b-4d94-b24c-97bae4b541da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:27.550123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a94552ce-5a7b-4d94-b24c-97bae4b541da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:27.568848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:27.573466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ac5e2-7bfc-4263-a9c3-559605bd2462 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorizing `identity:delete_user(user_id=78bba8e1bcca4892ac76807ced3d6d8a)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:27.576780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ac5e2-7bfc-4263-a9c3-559605bd2462 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:27.686039 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-107ac5e2-7bfc-4263-a9c3-559605bd2462 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78bba8e1bcca4892ac76807ced3d6d8a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:27.698710 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94552ce-5a7b-4d94-b24c-97bae4b541da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:27.701050 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94552ce-5a7b-4d94-b24c-97bae4b541da service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:27.707775 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-107ac5e2-7bfc-4263-a9c3-559605bd2462 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78bba8e1bcca4892ac76807ced3d6d8a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:27.710479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-107ac5e2-7bfc-4263-a9c3-559605bd2462 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78bba8e1bcca4892ac76807ced3d6d8a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:27.711894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-107ac5e2-7bfc-4263-a9c3-559605bd2462 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78bba8e1bcca4892ac76807ced3d6d8a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:27.733516 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1474/2974] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:59:27 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:59:27.747221 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-107ac5e2-7bfc-4263-a9c3-559605bd2462 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78bba8e1bcca4892ac76807ced3d6d8a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:27.771469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94552ce-5a7b-4d94-b24c-97bae4b541da service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:27.781400 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1501/2975] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:59:27 2022] DELETE /identity/v3/users/78bba8e1bcca4892ac76807ced3d6d8a => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:27.785647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ac5e2-7bfc-4263-a9c3-559605bd2462 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:27.788840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-107ac5e2-7bfc-4263-a9c3-559605bd2462 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:27.840698 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:27.900353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94552ce-5a7b-4d94-b24c-97bae4b541da service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:27.946838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ac5e2-7bfc-4263-a9c3-559605bd2462 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:27.958593 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1eb543-0b05-49c7-b542-4930ffd6d8fe tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117f0f15e1be4e4898473ec8e678a1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '526664f28f1d4dd4bcd1e69b97ec3439', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:27.963841 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1eb543-0b05-49c7-b542-4930ffd6d8fe tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:27.964105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1eb543-0b05-49c7-b542-4930ffd6d8fe tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:27.964913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1eb543-0b05-49c7-b542-4930ffd6d8fe tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] PATH_INFO: `/v3/projects/0f38a9f6a69d4aa9b3d3997e572a01ef` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:27.968559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1eb543-0b05-49c7-b542-4930ffd6d8fe tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0f38a9f6a69d4aa9b3d3997e572a01ef)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:27.974676 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1eb543-0b05-49c7-b542-4930ffd6d8fe tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:28.064181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b42ff6-2e6c-4ecd-a75e-b1e3315456df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:28.064845 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b42ff6-2e6c-4ecd-a75e-b1e3315456df admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:28.065272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b42ff6-2e6c-4ecd-a75e-b1e3315456df admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:28.065552 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b42ff6-2e6c-4ecd-a75e-b1e3315456df admin admin] PATH_INFO: `/v3/users/675a845a87f648cc88ef25b584d99908` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:28.067662 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b42ff6-2e6c-4ecd-a75e-b1e3315456df admin admin] RBAC: Authorizing `identity:delete_user(user_id=675a845a87f648cc88ef25b584d99908)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:28.069674 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b42ff6-2e6c-4ecd-a75e-b1e3315456df admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:28.113729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ea1eb543-0b05-49c7-b542-4930ffd6d8fe tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f38a9f6a69d4aa9b3d3997e572a01ef', 'request_id': 'req-ea1eb543-0b05-49c7-b542-4930ffd6d8fe'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:28.129583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ea1eb543-0b05-49c7-b542-4930ffd6d8fe tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f38a9f6a69d4aa9b3d3997e572a01ef', 'request_id': 'req-ea1eb543-0b05-49c7-b542-4930ffd6d8fe'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:28.175222 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ea1eb543-0b05-49c7-b542-4930ffd6d8fe tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f38a9f6a69d4aa9b3d3997e572a01ef', 'request_id': 'req-ea1eb543-0b05-49c7-b542-4930ffd6d8fe'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:28.189414 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c3b42ff6-2e6c-4ecd-a75e-b1e3315456df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '675a845a87f648cc88ef25b584d99908'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:28.191122 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c3b42ff6-2e6c-4ecd-a75e-b1e3315456df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '675a845a87f648cc88ef25b584d99908'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:28.192393 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c3b42ff6-2e6c-4ecd-a75e-b1e3315456df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '675a845a87f648cc88ef25b584d99908'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:28.208748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ea1eb543-0b05-49c7-b542-4930ffd6d8fe tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] The token cache is being invalidate because project 0f38a9f6a69d4aa9b3d3997e572a01ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:59:28.208973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ea1eb543-0b05-49c7-b542-4930ffd6d8fe tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:28.215697 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c3b42ff6-2e6c-4ecd-a75e-b1e3315456df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '675a845a87f648cc88ef25b584d99908'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:28.217517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ea1eb543-0b05-49c7-b542-4930ffd6d8fe tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:28.219470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:28.225632 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1502/2976] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:59:27 2022] DELETE /identity/v3/projects/0f38a9f6a69d4aa9b3d3997e572a01ef => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:28.250158 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c3b42ff6-2e6c-4ecd-a75e-b1e3315456df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '675a845a87f648cc88ef25b584d99908'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:28.284023 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1475/2977] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:59:27 2022] DELETE /identity/v3/users/675a845a87f648cc88ef25b584d99908 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:28.288791 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cd692-25e8-450d-ad0a-ae85c486dc7e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:28.289334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cd692-25e8-450d-ad0a-ae85c486dc7e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:28.289495 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cd692-25e8-450d-ad0a-ae85c486dc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:28.347678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-793cd692-25e8-450d-ad0a-ae85c486dc7e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:59:28.349043 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-793cd692-25e8-450d-ad0a-ae85c486dc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:28.511361 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1503/2978] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:59:28.535344 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b42ff6-2e6c-4ecd-a75e-b1e3315456df admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:28.538183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c3b42ff6-2e6c-4ecd-a75e-b1e3315456df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:28.658754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b42ff6-2e6c-4ecd-a75e-b1e3315456df admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:28.667789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f235f-9438-4ede-aa1b-a0f14da7683a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:28.667789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f235f-9438-4ede-aa1b-a0f14da7683a service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:28.667789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f235f-9438-4ede-aa1b-a0f14da7683a service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:28.667789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f235f-9438-4ede-aa1b-a0f14da7683a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:28.684695 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f235f-9438-4ede-aa1b-a0f14da7683a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:28.686769 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f235f-9438-4ede-aa1b-a0f14da7683a service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:28.702660 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1476/2979] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:59:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:59:28.890385 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3ec5b-8522-4c7d-9163-4d31c1134bee None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:28.891083 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3ec5b-8522-4c7d-9163-4d31c1134bee None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:28.891365 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3ec5b-8522-4c7d-9163-4d31c1134bee None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:28.892713 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1504/2980] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 20:59:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:59:28.899745 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f235f-9438-4ede-aa1b-a0f14da7683a service neutron] Authenticating service token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 20:59:28.901066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ea3f235f-9438-4ede-aa1b-a0f14da7683a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:29.062389 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f235f-9438-4ede-aa1b-a0f14da7683a service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:29.063791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ea3f235f-9438-4ede-aa1b-a0f14da7683a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:29.203245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f235f-9438-4ede-aa1b-a0f14da7683a service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:29.226180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9d997-12c9-4b6c-b3d8-e537e367430d tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117f0f15e1be4e4898473ec8e678a1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '526664f28f1d4dd4bcd1e69b97ec3439', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:29.227067 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9d997-12c9-4b6c-b3d8-e537e367430d tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:29.227573 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9d997-12c9-4b6c-b3d8-e537e367430d tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:29.228135 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9d997-12c9-4b6c-b3d8-e537e367430d tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] PATH_INFO: `/v3/projects/5a9a056b01e74eee84124c184505bcb2` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:29.236456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9d997-12c9-4b6c-b3d8-e537e367430d tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorizing `identity:get_project(project_id=5a9a056b01e74eee84124c184505bcb2)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:29.240650 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9d997-12c9-4b6c-b3d8-e537e367430d tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:29.243326 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1477/2981] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 20:59:28 2022] GET /identity/v3/projects/5a9a056b01e74eee84124c184505bcb2 => generated 373 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:59:29.784032 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2656e-962b-4b99-b35a-58d28a9667c9 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:29.784948 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2656e-962b-4b99-b35a-58d28a9667c9 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:29.785385 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2656e-962b-4b99-b35a-58d28a9667c9 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:29.787687 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1505/2982] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 20:59:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:59:29.798395 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9d997-12c9-4b6c-b3d8-e537e367430d tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Authenticating service token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 20:59:29.800184 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0ac9d997-12c9-4b6c-b3d8-e537e367430d tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:29.830476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9d997-12c9-4b6c-b3d8-e537e367430d tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:29.850672 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9d997-12c9-4b6c-b3d8-e537e367430d tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:29.868990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685ae52-ced9-4c1d-88d9-87845712ade8 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117f0f15e1be4e4898473ec8e678a1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '526664f28f1d4dd4bcd1e69b97ec3439', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:29.869768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685ae52-ced9-4c1d-88d9-87845712ade8 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:29.870244 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685ae52-ced9-4c1d-88d9-87845712ade8 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:29.870636 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685ae52-ced9-4c1d-88d9-87845712ade8 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] PATH_INFO: `/v3/projects/5a9a056b01e74eee84124c184505bcb2` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:29.873142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685ae52-ced9-4c1d-88d9-87845712ade8 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorizing `identity:get_project(project_id=5a9a056b01e74eee84124c184505bcb2)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:29.875792 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685ae52-ced9-4c1d-88d9-87845712ade8 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:29.879606 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1478/2983] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 20:59:29 2022] GET /identity/v3/projects/5a9a056b01e74eee84124c184505bcb2 => generated 373 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:59:31.230002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2d40f-6b10-416e-b604-266892224793 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:31.231017 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2d40f-6b10-416e-b604-266892224793 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:31.231523 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2d40f-6b10-416e-b604-266892224793 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:31.237761 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1506/2984] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 20:59:31 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:59:31.240577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685ae52-ced9-4c1d-88d9-87845712ade8 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Authenticating service token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 20:59:31.250031 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:31.276172 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685ae52-ced9-4c1d-88d9-87845712ade8 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:31.301641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685ae52-ced9-4c1d-88d9-87845712ade8 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:31.380344 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c98152-5d0d-4531-88b9-4f33b0a00577 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117f0f15e1be4e4898473ec8e678a1f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '526664f28f1d4dd4bcd1e69b97ec3439', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:31.384217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c98152-5d0d-4531-88b9-4f33b0a00577 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:31.385695 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c98152-5d0d-4531-88b9-4f33b0a00577 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:31.387734 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c98152-5d0d-4531-88b9-4f33b0a00577 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] PATH_INFO: `/v3/projects/5a9a056b01e74eee84124c184505bcb2` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:31.395199 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c98152-5d0d-4531-88b9-4f33b0a00577 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorizing `identity:get_project(project_id=5a9a056b01e74eee84124c184505bcb2)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:31.400045 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c98152-5d0d-4531-88b9-4f33b0a00577 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:31.422135 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1479/2985] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 20:59:31 2022] GET /identity/v3/projects/5a9a056b01e74eee84124c184505bcb2 => generated 373 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:59:31.608945 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2d40f-6b10-416e-b604-266892224793 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:31.611635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e5c2d40f-6b10-416e-b604-266892224793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:31.657721 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2d40f-6b10-416e-b604-266892224793 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:31.689736 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2b16f-6c0f-4015-87d8-4a5a0232bf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:31.690880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2b16f-6c0f-4015-87d8-4a5a0232bf83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:31.692297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2b16f-6c0f-4015-87d8-4a5a0232bf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:31.692836 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2b16f-6c0f-4015-87d8-4a5a0232bf83 admin admin] PATH_INFO: `/v3/projects/5d03c5ff6ed945d49d82c794fc3e43c2` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:31.695606 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d2b16f-6c0f-4015-87d8-4a5a0232bf83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d03c5ff6ed945d49d82c794fc3e43c2)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:31.698264 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d2b16f-6c0f-4015-87d8-4a5a0232bf83 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:31.911489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:31.934857 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-34d2b16f-6c0f-4015-87d8-4a5a0232bf83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d03c5ff6ed945d49d82c794fc3e43c2', 'request_id': 'req-34d2b16f-6c0f-4015-87d8-4a5a0232bf83'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:31.971733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-34d2b16f-6c0f-4015-87d8-4a5a0232bf83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d03c5ff6ed945d49d82c794fc3e43c2', 'request_id': 'req-34d2b16f-6c0f-4015-87d8-4a5a0232bf83'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:31.998436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-34d2b16f-6c0f-4015-87d8-4a5a0232bf83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d03c5ff6ed945d49d82c794fc3e43c2', 'request_id': 'req-34d2b16f-6c0f-4015-87d8-4a5a0232bf83'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:32.019993 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-34d2b16f-6c0f-4015-87d8-4a5a0232bf83 admin admin] The token cache is being invalidate because project 5d03c5ff6ed945d49d82c794fc3e43c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:59:32.020571 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-34d2b16f-6c0f-4015-87d8-4a5a0232bf83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:32.026532 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-34d2b16f-6c0f-4015-87d8-4a5a0232bf83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:32.039570 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1507/2986] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:59:31 2022] DELETE /identity/v3/projects/5d03c5ff6ed945d49d82c794fc3e43c2 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:32.040487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c98152-5d0d-4531-88b9-4f33b0a00577 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:32.043945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-77c98152-5d0d-4531-88b9-4f33b0a00577 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:32.071190 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c98152-5d0d-4531-88b9-4f33b0a00577 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:32.241623 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2b16f-6c0f-4015-87d8-4a5a0232bf83 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:32.243932 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-34d2b16f-6c0f-4015-87d8-4a5a0232bf83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:32.314007 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2628029-a396-417f-93d0-85958495d06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:32.315742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2628029-a396-417f-93d0-85958495d06f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:32.317058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2628029-a396-417f-93d0-85958495d06f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:32.319226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2628029-a396-417f-93d0-85958495d06f admin admin] PATH_INFO: `/v3/users/ab309fc5861a4c69818cff1f5b7ae621` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:32.331685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2628029-a396-417f-93d0-85958495d06f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab309fc5861a4c69818cff1f5b7ae621)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:32.338223 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2628029-a396-417f-93d0-85958495d06f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:32.451572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a2628029-a396-417f-93d0-85958495d06f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab309fc5861a4c69818cff1f5b7ae621'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:32.453537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a2628029-a396-417f-93d0-85958495d06f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab309fc5861a4c69818cff1f5b7ae621'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:32.454733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a2628029-a396-417f-93d0-85958495d06f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab309fc5861a4c69818cff1f5b7ae621'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:32.457463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2b16f-6c0f-4015-87d8-4a5a0232bf83 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:32.469504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a2628029-a396-417f-93d0-85958495d06f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab309fc5861a4c69818cff1f5b7ae621'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:32.474315 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de80bf-3ec9-4ffe-951e-5b941759f218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:32.476603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de80bf-3ec9-4ffe-951e-5b941759f218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:32.477364 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de80bf-3ec9-4ffe-951e-5b941759f218 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:32.479242 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de80bf-3ec9-4ffe-951e-5b941759f218 admin admin] PATH_INFO: `/v3/users/f68574f7389a4fddb0676083d6730077` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:32.483826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de80bf-3ec9-4ffe-951e-5b941759f218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f68574f7389a4fddb0676083d6730077)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:32.490806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de80bf-3ec9-4ffe-951e-5b941759f218 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:32.508806 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a2628029-a396-417f-93d0-85958495d06f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab309fc5861a4c69818cff1f5b7ae621'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:32.551649 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1480/2987] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:59:32 2022] DELETE /identity/v3/users/ab309fc5861a4c69818cff1f5b7ae621 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:59:32.612603 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40284949-6e20-4a3d-afa5-a0bad7820960 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:32.613284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40284949-6e20-4a3d-afa5-a0bad7820960 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:32.613789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40284949-6e20-4a3d-afa5-a0bad7820960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:32.633958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a1de80bf-3ec9-4ffe-951e-5b941759f218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f68574f7389a4fddb0676083d6730077'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:32.655169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a1de80bf-3ec9-4ffe-951e-5b941759f218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f68574f7389a4fddb0676083d6730077'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:32.656401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a1de80bf-3ec9-4ffe-951e-5b941759f218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f68574f7389a4fddb0676083d6730077'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:32.659046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a1de80bf-3ec9-4ffe-951e-5b941759f218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f68574f7389a4fddb0676083d6730077'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:32.682745 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a1de80bf-3ec9-4ffe-951e-5b941759f218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f68574f7389a4fddb0676083d6730077'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:32.697592 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-40284949-6e20-4a3d-afa5-a0bad7820960 None None] MFA Rules not processed for user `d22f6d46c5124b1ba8e025934d9aaf5d`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:59:32.703293 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-40284949-6e20-4a3d-afa5-a0bad7820960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:32.760220 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1508/2988] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:59:32 2022] DELETE /identity/v3/users/f68574f7389a4fddb0676083d6730077 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:32.765257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ac9ad-35ba-4b26-8347-617348493b27 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:32.766911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ac9ad-35ba-4b26-8347-617348493b27 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:32.768098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ac9ad-35ba-4b26-8347-617348493b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:32.840451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-e10ac9ad-35ba-4b26-8347-617348493b27 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:59:32.843578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e10ac9ad-35ba-4b26-8347-617348493b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:32.935522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:32.964027 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1481/2989] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:59:32 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:59:32.964296 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fadeca-ca7f-45fa-8549-d2a46f9a6b51 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:32.964695 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fadeca-ca7f-45fa-8549-d2a46f9a6b51 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:32.964985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fadeca-ca7f-45fa-8549-d2a46f9a6b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:32.980346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:33.008190 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1509/2990] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:59:33.010734 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a1fadeca-ca7f-45fa-8549-d2a46f9a6b51 None None] MFA Rules not processed for user `ad1a96004778407584d1805b07ad1c5f`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:59:33.012846 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a1fadeca-ca7f-45fa-8549-d2a46f9a6b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:33.077812 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ac9ad-35ba-4b26-8347-617348493b27 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:33.079284 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e10ac9ad-35ba-4b26-8347-617348493b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:33.130527 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1482/2991] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:59:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:59:33.199438 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ac9ad-35ba-4b26-8347-617348493b27 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:33.209386 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa1d75-9ab4-46f1-b5df-f9e651e07536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:33.210019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa1d75-9ab4-46f1-b5df-f9e651e07536 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:33.210298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa1d75-9ab4-46f1-b5df-f9e651e07536 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:33.210614 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa1d75-9ab4-46f1-b5df-f9e651e07536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:33.232753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa1d75-9ab4-46f1-b5df-f9e651e07536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:33.234331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa1d75-9ab4-46f1-b5df-f9e651e07536 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:33.254887 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1510/2992] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:59:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:59:33.488180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fadeca-ca7f-45fa-8549-d2a46f9a6b51 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:33.490831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a1fadeca-ca7f-45fa-8549-d2a46f9a6b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:33.680084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fadeca-ca7f-45fa-8549-d2a46f9a6b51 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:33.695401 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170852f-4e6c-403b-8bd0-dce898aad419 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:33.696034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170852f-4e6c-403b-8bd0-dce898aad419 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:33.696314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170852f-4e6c-403b-8bd0-dce898aad419 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:33.696588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170852f-4e6c-403b-8bd0-dce898aad419 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:33.722797 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3170852f-4e6c-403b-8bd0-dce898aad419 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:33.727964 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170852f-4e6c-403b-8bd0-dce898aad419 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:33.734757 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170852f-4e6c-403b-8bd0-dce898aad419 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:33.774914 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1483/2993] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:59:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:59:34.401163 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa1d75-9ab4-46f1-b5df-f9e651e07536 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:34.404295 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0dfa1d75-9ab4-46f1-b5df-f9e651e07536 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:34.434950 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa1d75-9ab4-46f1-b5df-f9e651e07536 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:34.454324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d59988-0a39-40a4-a44b-4d9d82cf92ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:34.459116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d59988-0a39-40a4-a44b-4d9d82cf92ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:34.459576 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d59988-0a39-40a4-a44b-4d9d82cf92ca admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:34.460392 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d59988-0a39-40a4-a44b-4d9d82cf92ca admin admin] PATH_INFO: `/v3/projects/639acc17555041ce8dc532741f72075d` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:34.469555 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170852f-4e6c-403b-8bd0-dce898aad419 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:34.474946 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d59988-0a39-40a4-a44b-4d9d82cf92ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=639acc17555041ce8dc532741f72075d)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:34.484354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d59988-0a39-40a4-a44b-4d9d82cf92ca admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:34.488068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170852f-4e6c-403b-8bd0-dce898aad419 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:34.493857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d409e-3f1c-4609-9428-30d48f0db986 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:34.494491 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d409e-3f1c-4609-9428-30d48f0db986 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:34.494803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d409e-3f1c-4609-9428-30d48f0db986 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:34.495063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d409e-3f1c-4609-9428-30d48f0db986 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:34.500529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-890d409e-3f1c-4609-9428-30d48f0db986 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:34.522474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d409e-3f1c-4609-9428-30d48f0db986 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:34.530082 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d409e-3f1c-4609-9428-30d48f0db986 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:34.552680 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1484/2994] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:59:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:59:34.618895 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-69d59988-0a39-40a4-a44b-4d9d82cf92ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '639acc17555041ce8dc532741f72075d', 'request_id': 'req-69d59988-0a39-40a4-a44b-4d9d82cf92ca'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:34.628403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-69d59988-0a39-40a4-a44b-4d9d82cf92ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '639acc17555041ce8dc532741f72075d', 'request_id': 'req-69d59988-0a39-40a4-a44b-4d9d82cf92ca'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:34.640221 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-69d59988-0a39-40a4-a44b-4d9d82cf92ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '639acc17555041ce8dc532741f72075d', 'request_id': 'req-69d59988-0a39-40a4-a44b-4d9d82cf92ca'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:34.702746 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-69d59988-0a39-40a4-a44b-4d9d82cf92ca admin admin] The token cache is being invalidate because project 639acc17555041ce8dc532741f72075d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:59:34.703638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-69d59988-0a39-40a4-a44b-4d9d82cf92ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:34.709011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-69d59988-0a39-40a4-a44b-4d9d82cf92ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:34.724920 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b9099-2b57-4a7a-8683-245f988576cb None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:34.725671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b9099-2b57-4a7a-8683-245f988576cb None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:34.726209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b9099-2b57-4a7a-8683-245f988576cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:34.727089 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1511/2995] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:59:34 2022] DELETE /identity/v3/projects/639acc17555041ce8dc532741f72075d => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:34.766148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-b57b9099-2b57-4a7a-8683-245f988576cb None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:59:34.769993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b57b9099-2b57-4a7a-8683-245f988576cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:34.867382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d59988-0a39-40a4-a44b-4d9d82cf92ca admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:34.873286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-69d59988-0a39-40a4-a44b-4d9d82cf92ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:34.975833 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1485/2996] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:59:34.984296 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb944f-4e44-420f-9d4e-2dd213f0251d None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:34.984767 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb944f-4e44-420f-9d4e-2dd213f0251d None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:34.985956 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb944f-4e44-420f-9d4e-2dd213f0251d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:35.027645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-91eb944f-4e44-420f-9d4e-2dd213f0251d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:59:35.034820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-91eb944f-4e44-420f-9d4e-2dd213f0251d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:35.071203 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1486/2997] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:59:35.076478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb944f-4e44-420f-9d4e-2dd213f0251d None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:35.102990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb944f-4e44-420f-9d4e-2dd213f0251d None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:35.109162 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d59988-0a39-40a4-a44b-4d9d82cf92ca admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:35.110530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306937b-e6eb-44a8-a90c-b6a7d4043b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:35.111916 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306937b-e6eb-44a8-a90c-b6a7d4043b5d admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:35.112364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306937b-e6eb-44a8-a90c-b6a7d4043b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:35.112801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306937b-e6eb-44a8-a90c-b6a7d4043b5d admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:35.113464 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306937b-e6eb-44a8-a90c-b6a7d4043b5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:59:35.114062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306937b-e6eb-44a8-a90c-b6a7d4043b5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:35.115934 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bdc018-5931-4897-bb05-21aa150c2c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:35.116221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306937b-e6eb-44a8-a90c-b6a7d4043b5d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:35.116967 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bdc018-5931-4897-bb05-21aa150c2c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:35.117455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bdc018-5931-4897-bb05-21aa150c2c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:35.117884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bdc018-5931-4897-bb05-21aa150c2c5b admin admin] PATH_INFO: `/v3/projects/5a9a056b01e74eee84124c184505bcb2` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:35.128045 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:35.137131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bdc018-5931-4897-bb05-21aa150c2c5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a9a056b01e74eee84124c184505bcb2)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:35.143849 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bdc018-5931-4897-bb05-21aa150c2c5b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:35.144270 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1487/2998] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:59:35.146434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306937b-e6eb-44a8-a90c-b6a7d4043b5d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:35.186489 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306937b-e6eb-44a8-a90c-b6a7d4043b5d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:35.215914 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ef596-8379-4820-b40b-7714455cf632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:35.216506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ef596-8379-4820-b40b-7714455cf632 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:35.217182 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ef596-8379-4820-b40b-7714455cf632 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:35.217455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ef596-8379-4820-b40b-7714455cf632 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:35.218090 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ef596-8379-4820-b40b-7714455cf632 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:35.220071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ef596-8379-4820-b40b-7714455cf632 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:35.230879 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:35.281881 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1488/2999] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:59:35 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:59:35.286701 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ef596-8379-4820-b40b-7714455cf632 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:35.300769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-64bdc018-5931-4897-bb05-21aa150c2c5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a9a056b01e74eee84124c184505bcb2', 'request_id': 'req-64bdc018-5931-4897-bb05-21aa150c2c5b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:35.311578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-64bdc018-5931-4897-bb05-21aa150c2c5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a9a056b01e74eee84124c184505bcb2', 'request_id': 'req-64bdc018-5931-4897-bb05-21aa150c2c5b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:35.327103 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-64bdc018-5931-4897-bb05-21aa150c2c5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a9a056b01e74eee84124c184505bcb2', 'request_id': 'req-64bdc018-5931-4897-bb05-21aa150c2c5b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:35.355680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-64bdc018-5931-4897-bb05-21aa150c2c5b admin admin] The token cache is being invalidate because project 5a9a056b01e74eee84124c184505bcb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:59:35.356021 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-64bdc018-5931-4897-bb05-21aa150c2c5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:35.357323 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-64bdc018-5931-4897-bb05-21aa150c2c5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:35.359344 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1512/3000] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:59:34 2022] DELETE /identity/v3/projects/5a9a056b01e74eee84124c184505bcb2 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:35.363198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bdc018-5931-4897-bb05-21aa150c2c5b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:35.364657 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-64bdc018-5931-4897-bb05-21aa150c2c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:35.477680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ef596-8379-4820-b40b-7714455cf632 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:35.510835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff1190-a6b9-48d3-8c12-ee0af2b69993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:35.513638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff1190-a6b9-48d3-8c12-ee0af2b69993 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:35.514318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff1190-a6b9-48d3-8c12-ee0af2b69993 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:35.515177 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff1190-a6b9-48d3-8c12-ee0af2b69993 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:35.516279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff1190-a6b9-48d3-8c12-ee0af2b69993 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:35.519547 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff1190-a6b9-48d3-8c12-ee0af2b69993 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:35.535765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bdc018-5931-4897-bb05-21aa150c2c5b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:35.553730 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1489/3001] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:59:35 2022] POST /identity/v3/users => generated 293 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:59:35.563198 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff1190-a6b9-48d3-8c12-ee0af2b69993 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:35.566050 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f8ff1190-a6b9-48d3-8c12-ee0af2b69993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:35.578794 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67a20c-a042-4653-999d-955b3c991764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:35.579461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67a20c-a042-4653-999d-955b3c991764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:35.579681 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67a20c-a042-4653-999d-955b3c991764 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:35.579957 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67a20c-a042-4653-999d-955b3c991764 admin admin] PATH_INFO: `/v3/users/117f0f15e1be4e4898473ec8e678a1f9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:35.583263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff1190-a6b9-48d3-8c12-ee0af2b69993 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:35.591581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed016e6-a0d4-4130-b669-aee66835b7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:35.592336 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67a20c-a042-4653-999d-955b3c991764 admin admin] RBAC: Authorizing `identity:delete_user(user_id=117f0f15e1be4e4898473ec8e678a1f9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:35.593217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed016e6-a0d4-4130-b669-aee66835b7ac admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:35.594294 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67a20c-a042-4653-999d-955b3c991764 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:35.594586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed016e6-a0d4-4130-b669-aee66835b7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:35.595140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed016e6-a0d4-4130-b669-aee66835b7ac admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:35.596356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed016e6-a0d4-4130-b669-aee66835b7ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:35.598245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed016e6-a0d4-4130-b669-aee66835b7ac admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:35.629582 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1490/3002] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:59:35.635331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed016e6-a0d4-4130-b669-aee66835b7ac admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:35.660993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed016e6-a0d4-4130-b669-aee66835b7ac admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:35.681966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909cb2d5-3ad3-4ba6-9407-28abff23a4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:35.682826 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cb2d5-3ad3-4ba6-9407-28abff23a4d8 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:35.683311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cb2d5-3ad3-4ba6-9407-28abff23a4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:35.684521 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cb2d5-3ad3-4ba6-9407-28abff23a4d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:35.684521 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909cb2d5-3ad3-4ba6-9407-28abff23a4d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:35.690530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909cb2d5-3ad3-4ba6-9407-28abff23a4d8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:35.709128 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1491/3003] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:59:35.716394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909cb2d5-3ad3-4ba6-9407-28abff23a4d8 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:35.735453 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909cb2d5-3ad3-4ba6-9407-28abff23a4d8 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:35.744060 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11272d30-eaba-444a-a5db-df855f35c14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:35.744892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11272d30-eaba-444a-a5db-df855f35c14e admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:35.745309 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11272d30-eaba-444a-a5db-df855f35c14e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:35.745821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11272d30-eaba-444a-a5db-df855f35c14e admin admin] PATH_INFO: `/v3/projects/155b2c35804a4799a75a327703a5e26e/users/d5754e7eed1b48f8805b6dffefb37b59/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:35.773455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ce67a20c-a042-4653-999d-955b3c991764 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '117f0f15e1be4e4898473ec8e678a1f9'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:35.799822 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ce67a20c-a042-4653-999d-955b3c991764 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '117f0f15e1be4e4898473ec8e678a1f9'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:35.802753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ce67a20c-a042-4653-999d-955b3c991764 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '117f0f15e1be4e4898473ec8e678a1f9'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:35.805680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ce67a20c-a042-4653-999d-955b3c991764 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '117f0f15e1be4e4898473ec8e678a1f9'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:35.816090 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11272d30-eaba-444a-a5db-df855f35c14e admin admin] RBAC: Authorizing `identity:create_grant(project_id=155b2c35804a4799a75a327703a5e26e, user_id=d5754e7eed1b48f8805b6dffefb37b59, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:35.818874 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11272d30-eaba-444a-a5db-df855f35c14e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:35.826199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ce67a20c-a042-4653-999d-955b3c991764 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '117f0f15e1be4e4898473ec8e678a1f9'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:35.871501 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1492/3004] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:59:35 2022] PUT /identity/v3/projects/155b2c35804a4799a75a327703a5e26e/users/d5754e7eed1b48f8805b6dffefb37b59/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:35.877001 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980768a-e938-428a-a9a2-4c539058b016 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:35.877644 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980768a-e938-428a-a9a2-4c539058b016 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:35.878154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980768a-e938-428a-a9a2-4c539058b016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:35.902589 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1513/3005] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:59:35 2022] DELETE /identity/v3/users/117f0f15e1be4e4898473ec8e678a1f9 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:59:35.925948 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-2980768a-e938-428a-a9a2-4c539058b016 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:59:35.928636 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2980768a-e938-428a-a9a2-4c539058b016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:35.956037 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bab14b-b206-4baf-9d83-b8ccd6354808 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:35.956567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bab14b-b206-4baf-9d83-b8ccd6354808 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:35.957002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bab14b-b206-4baf-9d83-b8ccd6354808 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:35.958538 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1514/3006] 10.222.0.33 () {54 vars in 921 bytes} [Sat Aug 6 20:59:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:59:35.970377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d4016-4595-439a-a056-a5f7280600a2 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:35.970929 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d4016-4595-439a-a056-a5f7280600a2 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:35.971390 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d4016-4595-439a-a056-a5f7280600a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:36.016759 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-f03d4016-4595-439a-a056-a5f7280600a2 None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:59:36.017995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f03d4016-4595-439a-a056-a5f7280600a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:36.026699 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1493/3007] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:59:36.075282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:36.119770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980768a-e938-428a-a9a2-4c539058b016 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:36.132875 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2980768a-e938-428a-a9a2-4c539058b016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:36.204514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:36.252288 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1515/3008] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 20:59:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:59:36.278753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d4016-4595-439a-a056-a5f7280600a2 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:36.280391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f03d4016-4595-439a-a056-a5f7280600a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:36.298858 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d4016-4595-439a-a056-a5f7280600a2 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:36.305520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c5ac7-b31f-4732-9a0f-f8ae188bfe4f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:36.306383 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c5ac7-b31f-4732-9a0f-f8ae188bfe4f service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:36.306820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c5ac7-b31f-4732-9a0f-f8ae188bfe4f service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:36.307336 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c5ac7-b31f-4732-9a0f-f8ae188bfe4f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:36.323731 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c5ac7-b31f-4732-9a0f-f8ae188bfe4f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:36.325844 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c5ac7-b31f-4732-9a0f-f8ae188bfe4f service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:36.340842 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1516/3009] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:59:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:59:36.351192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980768a-e938-428a-a9a2-4c539058b016 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:36.367749 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f839ebe-f7a9-4a6f-975b-b2630cb2f1e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:36.370042 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f839ebe-f7a9-4a6f-975b-b2630cb2f1e3 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:36.370042 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f839ebe-f7a9-4a6f-975b-b2630cb2f1e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:36.370713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f839ebe-f7a9-4a6f-975b-b2630cb2f1e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:36.402043 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f839ebe-f7a9-4a6f-975b-b2630cb2f1e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:36.407694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f839ebe-f7a9-4a6f-975b-b2630cb2f1e3 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:36.443675 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1494/3010] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:59:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:59:37.570560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c5ac7-b31f-4732-9a0f-f8ae188bfe4f service placement] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:37.572352 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a36c5ac7-b31f-4732-9a0f-f8ae188bfe4f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:37.592309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c5ac7-b31f-4732-9a0f-f8ae188bfe4f service placement] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:37.603320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb57566-47d1-484d-8bcb-67bff70086c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:37.604313 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb57566-47d1-484d-8bcb-67bff70086c1 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:37.606734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb57566-47d1-484d-8bcb-67bff70086c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:37.607254 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb57566-47d1-484d-8bcb-67bff70086c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:37.615449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-bfb57566-47d1-484d-8bcb-67bff70086c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:37.639432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb57566-47d1-484d-8bcb-67bff70086c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:37.641297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb57566-47d1-484d-8bcb-67bff70086c1 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:37.652625 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1517/3011] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:59:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:59:37.705028 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f839ebe-f7a9-4a6f-975b-b2630cb2f1e3 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:37.706624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7f839ebe-f7a9-4a6f-975b-b2630cb2f1e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:37.727561 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f839ebe-f7a9-4a6f-975b-b2630cb2f1e3 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:37.760203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ce5f9-af8b-4d26-a2c2-2ffee25790b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:37.761117 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ce5f9-af8b-4d26-a2c2-2ffee25790b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:37.761242 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ce5f9-af8b-4d26-a2c2-2ffee25790b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:37.761999 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ce5f9-af8b-4d26-a2c2-2ffee25790b9 admin admin] PATH_INFO: `/v3/projects/526664f28f1d4dd4bcd1e69b97ec3439` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:37.769131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ce5f9-af8b-4d26-a2c2-2ffee25790b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=526664f28f1d4dd4bcd1e69b97ec3439)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:37.774884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ce5f9-af8b-4d26-a2c2-2ffee25790b9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:37.887833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ff8ce5f9-af8b-4d26-a2c2-2ffee25790b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '526664f28f1d4dd4bcd1e69b97ec3439', 'request_id': 'req-ff8ce5f9-af8b-4d26-a2c2-2ffee25790b9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:37.915468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ff8ce5f9-af8b-4d26-a2c2-2ffee25790b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '526664f28f1d4dd4bcd1e69b97ec3439', 'request_id': 'req-ff8ce5f9-af8b-4d26-a2c2-2ffee25790b9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:37.931338 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ff8ce5f9-af8b-4d26-a2c2-2ffee25790b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '526664f28f1d4dd4bcd1e69b97ec3439', 'request_id': 'req-ff8ce5f9-af8b-4d26-a2c2-2ffee25790b9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:37.954658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ff8ce5f9-af8b-4d26-a2c2-2ffee25790b9 admin admin] The token cache is being invalidate because project 526664f28f1d4dd4bcd1e69b97ec3439 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:59:37.955624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ff8ce5f9-af8b-4d26-a2c2-2ffee25790b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:37.956617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ff8ce5f9-af8b-4d26-a2c2-2ffee25790b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:37.958885 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1495/3012] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:59:37 2022] DELETE /identity/v3/projects/526664f28f1d4dd4bcd1e69b97ec3439 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:37.965640 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe4b4b-54ed-4ef1-aacb-1484e0000d1e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:37.966128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe4b4b-54ed-4ef1-aacb-1484e0000d1e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:37.966490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe4b4b-54ed-4ef1-aacb-1484e0000d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:38.011991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-c5fe4b4b-54ed-4ef1-aacb-1484e0000d1e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:59:38.013242 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c5fe4b4b-54ed-4ef1-aacb-1484e0000d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:38.161828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4982aec-1517-450a-96b5-80acd9267ea3 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:38.162116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4982aec-1517-450a-96b5-80acd9267ea3 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:38.162416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4982aec-1517-450a-96b5-80acd9267ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:38.247979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a4982aec-1517-450a-96b5-80acd9267ea3 None None] MFA Rules not processed for user `09abf99d2b254ebb983fa6ec55bc5969`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:59:38.249456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a4982aec-1517-450a-96b5-80acd9267ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:38.477038 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1496/3013] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:59:38 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:59:38.492852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4982aec-1517-450a-96b5-80acd9267ea3 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:38.494995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a4982aec-1517-450a-96b5-80acd9267ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:38.542704 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1518/3014] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:59:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 578 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:59:38.552056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1900ff8-ceb3-4a37-ba53-8b7968e4c2b1 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:38.552386 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1900ff8-ceb3-4a37-ba53-8b7968e4c2b1 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:38.552636 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1900ff8-ceb3-4a37-ba53-8b7968e4c2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:38.593317 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-e1900ff8-ceb3-4a37-ba53-8b7968e4c2b1 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:59:38.595325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e1900ff8-ceb3-4a37-ba53-8b7968e4c2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:38.617693 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1519/3015] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:59:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:59:38.622005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1900ff8-ceb3-4a37-ba53-8b7968e4c2b1 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:38.645698 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1900ff8-ceb3-4a37-ba53-8b7968e4c2b1 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:38.656523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:38.661066 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae7f2a-e6d8-4a47-82b9-444b17fb02bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:38.661698 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae7f2a-e6d8-4a47-82b9-444b17fb02bf admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:38.661978 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae7f2a-e6d8-4a47-82b9-444b17fb02bf admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:38.662251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae7f2a-e6d8-4a47-82b9-444b17fb02bf admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:38.663381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae7f2a-e6d8-4a47-82b9-444b17fb02bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:59:38.663907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae7f2a-e6d8-4a47-82b9-444b17fb02bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:38.665709 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae7f2a-e6d8-4a47-82b9-444b17fb02bf admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:38.707816 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1520/3016] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:59:38.710164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae7f2a-e6d8-4a47-82b9-444b17fb02bf admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:38.733714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae7f2a-e6d8-4a47-82b9-444b17fb02bf admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:38.765441 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235dea8e-72bb-4ded-9b15-21f7fc9dd406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:38.766348 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235dea8e-72bb-4ded-9b15-21f7fc9dd406 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:38.766861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235dea8e-72bb-4ded-9b15-21f7fc9dd406 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:38.767298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235dea8e-72bb-4ded-9b15-21f7fc9dd406 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:38.768292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235dea8e-72bb-4ded-9b15-21f7fc9dd406 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:38.772330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235dea8e-72bb-4ded-9b15-21f7fc9dd406 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:38.836989 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1521/3017] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:59:38 2022] POST /identity/v3/projects => generated 393 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:59:38.841999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235dea8e-72bb-4ded-9b15-21f7fc9dd406 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:38.842927 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4982aec-1517-450a-96b5-80acd9267ea3 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:38.969811 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:38.973956 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae41d0-7643-42fb-af84-d24b943ff2e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:38.974828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae41d0-7643-42fb-af84-d24b943ff2e1 service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:38.975347 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae41d0-7643-42fb-af84-d24b943ff2e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:38.975866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae41d0-7643-42fb-af84-d24b943ff2e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:38.978767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235dea8e-72bb-4ded-9b15-21f7fc9dd406 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:38.983006 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-acae41d0-7643-42fb-af84-d24b943ff2e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:38.987357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0bcee-dc44-4b49-b754-49d2e3fee2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:38.988554 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0bcee-dc44-4b49-b754-49d2e3fee2f2 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:38.988971 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0bcee-dc44-4b49-b754-49d2e3fee2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:38.989256 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0bcee-dc44-4b49-b754-49d2e3fee2f2 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:38.989936 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf0bcee-dc44-4b49-b754-49d2e3fee2f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:38.992400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf0bcee-dc44-4b49-b754-49d2e3fee2f2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:39.057355 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1522/3018] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:59:38 2022] POST /identity/v3/users => generated 297 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:59:39.062015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0bcee-dc44-4b49-b754-49d2e3fee2f2 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:39.079437 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0bcee-dc44-4b49-b754-49d2e3fee2f2 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:39.091436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b2e18-07f2-46b7-8f75-481940c61fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:39.092070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b2e18-07f2-46b7-8f75-481940c61fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:39.092361 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b2e18-07f2-46b7-8f75-481940c61fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:39.093074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b2e18-07f2-46b7-8f75-481940c61fb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:39.093795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b2e18-07f2-46b7-8f75-481940c61fb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:39.096962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b2e18-07f2-46b7-8f75-481940c61fb7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:39.132893 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1523/3019] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:59:39.134593 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b2e18-07f2-46b7-8f75-481940c61fb7 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:39.145736 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acae41d0-7643-42fb-af84-d24b943ff2e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:39.147664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acae41d0-7643-42fb-af84-d24b943ff2e1 service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:39.149328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b2e18-07f2-46b7-8f75-481940c61fb7 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:39.156077 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263123e-2d6f-452c-afc1-d0d362cfe5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:39.156671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263123e-2d6f-452c-afc1-d0d362cfe5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:39.156951 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263123e-2d6f-452c-afc1-d0d362cfe5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:39.157225 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263123e-2d6f-452c-afc1-d0d362cfe5f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:39.157976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a263123e-2d6f-452c-afc1-d0d362cfe5f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:39.160022 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a263123e-2d6f-452c-afc1-d0d362cfe5f7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:39.161380 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1497/3020] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:59:38 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:59:39.179326 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1524/3021] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:59:39.184454 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae41d0-7643-42fb-af84-d24b943ff2e1 service cinder] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:39.197861 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae41d0-7643-42fb-af84-d24b943ff2e1 service cinder] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:39.204394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a835a-a2c7-4d3b-adad-90b0b0d20dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:39.205433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a835a-a2c7-4d3b-adad-90b0b0d20dc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:39.205951 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a835a-a2c7-4d3b-adad-90b0b0d20dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:39.206300 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a835a-a2c7-4d3b-adad-90b0b0d20dc2 admin admin] PATH_INFO: `/v3/projects/bed4a73b5c7341089301eac35984057a/users/031a0c2bf880491a9ad1c1ed53783722/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:39.224803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a835a-a2c7-4d3b-adad-90b0b0d20dc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bed4a73b5c7341089301eac35984057a, user_id=031a0c2bf880491a9ad1c1ed53783722, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:39.233481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a835a-a2c7-4d3b-adad-90b0b0d20dc2 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:39.256070 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1498/3022] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:59:39 2022] PUT /identity/v3/projects/bed4a73b5c7341089301eac35984057a/users/031a0c2bf880491a9ad1c1ed53783722/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:39.274105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca28af3-cb64-4828-892b-105af1a6d5c6 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:39.275043 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca28af3-cb64-4828-892b-105af1a6d5c6 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:39.275627 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca28af3-cb64-4828-892b-105af1a6d5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:39.327251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-1ca28af3-cb64-4828-892b-105af1a6d5c6 None None] MFA Rules not processed for user `031a0c2bf880491a9ad1c1ed53783722`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:59:39.328650 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1ca28af3-cb64-4828-892b-105af1a6d5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:39.566470 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1525/3023] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:59:39 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:59:39.570985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a835a-a2c7-4d3b-adad-90b0b0d20dc2 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:39.686845 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:39.691362 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a835a-a2c7-4d3b-adad-90b0b0d20dc2 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:39.701950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4546dd-9392-4401-a6c9-84a2c5ba8acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:39.703584 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4546dd-9392-4401-a6c9-84a2c5ba8acb admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:39.703869 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4546dd-9392-4401-a6c9-84a2c5ba8acb admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:39.704147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4546dd-9392-4401-a6c9-84a2c5ba8acb admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:39.704780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4546dd-9392-4401-a6c9-84a2c5ba8acb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:39.707050 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4546dd-9392-4401-a6c9-84a2c5ba8acb admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:39.779730 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1499/3024] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:59:39 2022] POST /identity/v3/projects => generated 391 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:59:39.783957 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca28af3-cb64-4828-892b-105af1a6d5c6 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:39.804700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca28af3-cb64-4828-892b-105af1a6d5c6 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:39.955578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8b0a0-29e0-4f39-bfc5-e27273a00950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:39.956517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8b0a0-29e0-4f39-bfc5-e27273a00950 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:39.957229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8b0a0-29e0-4f39-bfc5-e27273a00950 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:39.957733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8b0a0-29e0-4f39-bfc5-e27273a00950 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:39.958678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c8b0a0-29e0-4f39-bfc5-e27273a00950 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:39.960709 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c8b0a0-29e0-4f39-bfc5-e27273a00950 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:40.013901 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4546dd-9392-4401-a6c9-84a2c5ba8acb admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:40.023145 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1526/3025] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:59:39 2022] POST /identity/v3/users => generated 302 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:59:40.030711 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4546dd-9392-4401-a6c9-84a2c5ba8acb admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:40.046023 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab3f92-9b0c-4c69-8098-57faa77bc1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:40.046843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab3f92-9b0c-4c69-8098-57faa77bc1ec admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:40.047194 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab3f92-9b0c-4c69-8098-57faa77bc1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:40.047539 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab3f92-9b0c-4c69-8098-57faa77bc1ec admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:40.048410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab3f92-9b0c-4c69-8098-57faa77bc1ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:40.050115 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab3f92-9b0c-4c69-8098-57faa77bc1ec admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:40.086689 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1500/3026] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:59:40.091120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8b0a0-29e0-4f39-bfc5-e27273a00950 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:40.118450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8b0a0-29e0-4f39-bfc5-e27273a00950 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:40.133053 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce80db1e-4920-4a8b-9363-654c91fc992b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:40.133787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80db1e-4920-4a8b-9363-654c91fc992b admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:40.134073 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80db1e-4920-4a8b-9363-654c91fc992b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:40.134349 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80db1e-4920-4a8b-9363-654c91fc992b admin admin] PATH_INFO: `/v3/projects/282f57f59dbd43978417807e8a6e1f5b/users/eabc5f5d5d3a432785021324bb9c190d/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:40.160111 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab3f92-9b0c-4c69-8098-57faa77bc1ec admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:40.165698 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1fab3f92-9b0c-4c69-8098-57faa77bc1ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:40.184645 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce80db1e-4920-4a8b-9363-654c91fc992b admin admin] RBAC: Authorizing `identity:create_grant(project_id=282f57f59dbd43978417807e8a6e1f5b, user_id=eabc5f5d5d3a432785021324bb9c190d, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:40.187113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce80db1e-4920-4a8b-9363-654c91fc992b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:40.211734 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1527/3027] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:59:40 2022] PUT /identity/v3/projects/282f57f59dbd43978417807e8a6e1f5b/users/eabc5f5d5d3a432785021324bb9c190d/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:40.217040 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce80db1e-4920-4a8b-9363-654c91fc992b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:40.311466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:40.463735 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce80db1e-4920-4a8b-9363-654c91fc992b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:40.474408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0dcb5-5dc0-4543-af41-636651f7c08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:40.474408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0dcb5-5dc0-4543-af41-636651f7c08f admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:40.474408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0dcb5-5dc0-4543-af41-636651f7c08f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:40.474854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0dcb5-5dc0-4543-af41-636651f7c08f admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:40.475382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa0dcb5-5dc0-4543-af41-636651f7c08f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:40.477596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa0dcb5-5dc0-4543-af41-636651f7c08f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:40.502584 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab3f92-9b0c-4c69-8098-57faa77bc1ec admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:40.522757 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1528/3028] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:59:40.523940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0dcb5-5dc0-4543-af41-636651f7c08f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:40.561306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0dcb5-5dc0-4543-af41-636651f7c08f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:40.577382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a837f-94dc-44f8-a511-83d68e8f3ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:40.578077 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a837f-94dc-44f8-a511-83d68e8f3ec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:40.578354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a837f-94dc-44f8-a511-83d68e8f3ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:40.580129 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a837f-94dc-44f8-a511-83d68e8f3ec8 admin admin] PATH_INFO: `/v3/projects/282f57f59dbd43978417807e8a6e1f5b/users/eabc5f5d5d3a432785021324bb9c190d/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:40.587525 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a837f-94dc-44f8-a511-83d68e8f3ec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=282f57f59dbd43978417807e8a6e1f5b, user_id=eabc5f5d5d3a432785021324bb9c190d, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:40.593732 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a837f-94dc-44f8-a511-83d68e8f3ec8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:40.614068 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1529/3029] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:59:40 2022] PUT /identity/v3/projects/282f57f59dbd43978417807e8a6e1f5b/users/eabc5f5d5d3a432785021324bb9c190d/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:40.666360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8745ee-5e5f-44e5-b972-34cb4a3b7c7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:40.667539 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8745ee-5e5f-44e5-b972-34cb4a3b7c7e service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:40.668565 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8745ee-5e5f-44e5-b972-34cb4a3b7c7e service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:40.668935 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8745ee-5e5f-44e5-b972-34cb4a3b7c7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:40.678480 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6e8745ee-5e5f-44e5-b972-34cb4a3b7c7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:40.713912 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecaa0d2-8864-4414-8a3a-569eff38d95c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:40.714242 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecaa0d2-8864-4414-8a3a-569eff38d95c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:40.715078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecaa0d2-8864-4414-8a3a-569eff38d95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:40.781563 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-3ecaa0d2-8864-4414-8a3a-569eff38d95c None None] MFA Rules not processed for user `eabc5f5d5d3a432785021324bb9c190d`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:59:40.786706 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3ecaa0d2-8864-4414-8a3a-569eff38d95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:40.878791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8745ee-5e5f-44e5-b972-34cb4a3b7c7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:40.882813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8745ee-5e5f-44e5-b972-34cb4a3b7c7e service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:40.905387 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1501/3030] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:59:40 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 746 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:59:41.008379 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1530/3031] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:59:40 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:59:41.024203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8745ee-5e5f-44e5-b972-34cb4a3b7c7e service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:41.025758 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6e8745ee-5e5f-44e5-b972-34cb4a3b7c7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:41.058154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8745ee-5e5f-44e5-b972-34cb4a3b7c7e service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:41.065162 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:41.171240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3df1b-543d-48c6-af53-ff8dab205fdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:41.171814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3df1b-543d-48c6-af53-ff8dab205fdd service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:41.172097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3df1b-543d-48c6-af53-ff8dab205fdd service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:41.173175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3df1b-543d-48c6-af53-ff8dab205fdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:41.185772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff3df1b-543d-48c6-af53-ff8dab205fdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:41.188002 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff3df1b-543d-48c6-af53-ff8dab205fdd service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:41.210897 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1502/3032] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:59:41 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:59:41.692418 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecaa0d2-8864-4414-8a3a-569eff38d95c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:41.727963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecaa0d2-8864-4414-8a3a-569eff38d95c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:41.737717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4183ada9-7928-432f-8276-5aa4740a445e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:41.738538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183ada9-7928-432f-8276-5aa4740a445e service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:41.738845 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183ada9-7928-432f-8276-5aa4740a445e service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:41.739119 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183ada9-7928-432f-8276-5aa4740a445e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:41.865635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4183ada9-7928-432f-8276-5aa4740a445e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:41.868328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4183ada9-7928-432f-8276-5aa4740a445e service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:41.896242 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1531/3033] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:59:41 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:59:41.971129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3df1b-543d-48c6-af53-ff8dab205fdd service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:42.209006 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3df1b-543d-48c6-af53-ff8dab205fdd service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:42.220888 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4f4e7-a6b9-4e64-b5e7-b56ff0b505d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:42.223031 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4f4e7-a6b9-4e64-b5e7-b56ff0b505d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:42.229635 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4f4e7-a6b9-4e64-b5e7-b56ff0b505d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:42.229953 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4f4e7-a6b9-4e64-b5e7-b56ff0b505d1 admin admin] PATH_INFO: `/v3/users/031a0c2bf880491a9ad1c1ed53783722` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:42.233959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4f4e7-a6b9-4e64-b5e7-b56ff0b505d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=031a0c2bf880491a9ad1c1ed53783722)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:42.242606 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4f4e7-a6b9-4e64-b5e7-b56ff0b505d1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:42.333222 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-32d4f4e7-a6b9-4e64-b5e7-b56ff0b505d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '031a0c2bf880491a9ad1c1ed53783722'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:42.334415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-32d4f4e7-a6b9-4e64-b5e7-b56ff0b505d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '031a0c2bf880491a9ad1c1ed53783722'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:42.337020 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-32d4f4e7-a6b9-4e64-b5e7-b56ff0b505d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '031a0c2bf880491a9ad1c1ed53783722'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:42.356875 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-32d4f4e7-a6b9-4e64-b5e7-b56ff0b505d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '031a0c2bf880491a9ad1c1ed53783722'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:42.391951 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-32d4f4e7-a6b9-4e64-b5e7-b56ff0b505d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '031a0c2bf880491a9ad1c1ed53783722'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:42.419256 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1503/3034] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:59:41 2022] DELETE /identity/v3/users/031a0c2bf880491a9ad1c1ed53783722 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:42.424395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413d334-6fa2-432f-9ea2-ea71c7ccc65c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:42.424838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413d334-6fa2-432f-9ea2-ea71c7ccc65c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:42.425219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413d334-6fa2-432f-9ea2-ea71c7ccc65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:42.467065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-8413d334-6fa2-432f-9ea2-ea71c7ccc65c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:59:42.468405 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8413d334-6fa2-432f-9ea2-ea71c7ccc65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:42.505555 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:42.605315 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1532/3035] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:59:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:59:42.661404 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4f4e7-a6b9-4e64-b5e7-b56ff0b505d1 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:42.663411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-32d4f4e7-a6b9-4e64-b5e7-b56ff0b505d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:42.706404 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:42.821152 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4f4e7-a6b9-4e64-b5e7-b56ff0b505d1 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:42.826269 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dcf64b-76bd-4e3f-b9df-438cfad6e4b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:42.826921 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dcf64b-76bd-4e3f-b9df-438cfad6e4b2 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:42.827202 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dcf64b-76bd-4e3f-b9df-438cfad6e4b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:42.827492 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dcf64b-76bd-4e3f-b9df-438cfad6e4b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:42.837912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dcf64b-76bd-4e3f-b9df-438cfad6e4b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:42.839381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dcf64b-76bd-4e3f-b9df-438cfad6e4b2 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:42.851413 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1504/3036] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:59:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:59:45.745573 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413d334-6fa2-432f-9ea2-ea71c7ccc65c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:45.747424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8413d334-6fa2-432f-9ea2-ea71c7ccc65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:45.767203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413d334-6fa2-432f-9ea2-ea71c7ccc65c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:45.781858 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928d400-77b9-4027-a394-7716bc90d16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:45.782600 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928d400-77b9-4027-a394-7716bc90d16a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:45.783134 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928d400-77b9-4027-a394-7716bc90d16a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:45.783607 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928d400-77b9-4027-a394-7716bc90d16a admin admin] PATH_INFO: `/v3/projects/bed4a73b5c7341089301eac35984057a` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:45.784961 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3928d400-77b9-4027-a394-7716bc90d16a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bed4a73b5c7341089301eac35984057a)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:45.787854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3928d400-77b9-4027-a394-7716bc90d16a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:45.931285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3928d400-77b9-4027-a394-7716bc90d16a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bed4a73b5c7341089301eac35984057a', 'request_id': 'req-3928d400-77b9-4027-a394-7716bc90d16a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:45.944689 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3928d400-77b9-4027-a394-7716bc90d16a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bed4a73b5c7341089301eac35984057a', 'request_id': 'req-3928d400-77b9-4027-a394-7716bc90d16a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:45.961425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3928d400-77b9-4027-a394-7716bc90d16a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bed4a73b5c7341089301eac35984057a', 'request_id': 'req-3928d400-77b9-4027-a394-7716bc90d16a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:45.978634 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3928d400-77b9-4027-a394-7716bc90d16a admin admin] The token cache is being invalidate because project bed4a73b5c7341089301eac35984057a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:59:45.979534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3928d400-77b9-4027-a394-7716bc90d16a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:45.981129 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3928d400-77b9-4027-a394-7716bc90d16a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:45.983335 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1533/3037] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:59:45 2022] DELETE /identity/v3/projects/bed4a73b5c7341089301eac35984057a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:45.988111 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dcf64b-76bd-4e3f-b9df-438cfad6e4b2 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:46.010697 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dcf64b-76bd-4e3f-b9df-438cfad6e4b2 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:46.147991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e64f1d-02de-4f30-b626-f27cdfb4970e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:46.148976 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e64f1d-02de-4f30-b626-f27cdfb4970e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:46.149264 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e64f1d-02de-4f30-b626-f27cdfb4970e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:46.149774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e64f1d-02de-4f30-b626-f27cdfb4970e admin admin] PATH_INFO: `/v3/users/eabc5f5d5d3a432785021324bb9c190d` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:46.151158 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e64f1d-02de-4f30-b626-f27cdfb4970e admin admin] RBAC: Authorizing `identity:delete_user(user_id=eabc5f5d5d3a432785021324bb9c190d)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:46.156858 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e64f1d-02de-4f30-b626-f27cdfb4970e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:46.303850 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d1e64f1d-02de-4f30-b626-f27cdfb4970e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eabc5f5d5d3a432785021324bb9c190d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:46.304429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d1e64f1d-02de-4f30-b626-f27cdfb4970e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eabc5f5d5d3a432785021324bb9c190d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:46.306950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d1e64f1d-02de-4f30-b626-f27cdfb4970e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eabc5f5d5d3a432785021324bb9c190d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:46.331673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d1e64f1d-02de-4f30-b626-f27cdfb4970e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eabc5f5d5d3a432785021324bb9c190d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:46.357434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d1e64f1d-02de-4f30-b626-f27cdfb4970e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eabc5f5d5d3a432785021324bb9c190d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:46.415447 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1505/3038] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:59:45 2022] DELETE /identity/v3/users/eabc5f5d5d3a432785021324bb9c190d => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:47.972668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928d400-77b9-4027-a394-7716bc90d16a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:47.976314 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3928d400-77b9-4027-a394-7716bc90d16a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:48.011625 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928d400-77b9-4027-a394-7716bc90d16a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:48.201758 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46488386-956a-442b-bba3-8addbd2376f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:48.202611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46488386-956a-442b-bba3-8addbd2376f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:48.203003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46488386-956a-442b-bba3-8addbd2376f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:48.203380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46488386-956a-442b-bba3-8addbd2376f1 admin admin] PATH_INFO: `/v3/projects/282f57f59dbd43978417807e8a6e1f5b` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:48.211083 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46488386-956a-442b-bba3-8addbd2376f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=282f57f59dbd43978417807e8a6e1f5b)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:48.213286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46488386-956a-442b-bba3-8addbd2376f1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:48.353968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-46488386-956a-442b-bba3-8addbd2376f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '282f57f59dbd43978417807e8a6e1f5b', 'request_id': 'req-46488386-956a-442b-bba3-8addbd2376f1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:48.356128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:48.371430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-46488386-956a-442b-bba3-8addbd2376f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '282f57f59dbd43978417807e8a6e1f5b', 'request_id': 'req-46488386-956a-442b-bba3-8addbd2376f1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:48.391013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-46488386-956a-442b-bba3-8addbd2376f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '282f57f59dbd43978417807e8a6e1f5b', 'request_id': 'req-46488386-956a-442b-bba3-8addbd2376f1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:48.421500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-46488386-956a-442b-bba3-8addbd2376f1 admin admin] The token cache is being invalidate because project 282f57f59dbd43978417807e8a6e1f5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:59:48.426888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-46488386-956a-442b-bba3-8addbd2376f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:48.437436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-46488386-956a-442b-bba3-8addbd2376f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:59:48.458454 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1534/3039] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:59:47 2022] DELETE /identity/v3/projects/282f57f59dbd43978417807e8a6e1f5b => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:48.465969 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f733e33-25f5-437c-8bdd-755e02a1a335 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:48.465969 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f733e33-25f5-437c-8bdd-755e02a1a335 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:48.466737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f733e33-25f5-437c-8bdd-755e02a1a335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:48.516572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-5f733e33-25f5-437c-8bdd-755e02a1a335 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:59:48.520500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5f733e33-25f5-437c-8bdd-755e02a1a335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:48.625725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:48.734627 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1506/3040] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:59:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:59:48.748162 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df964dd-682c-40d2-92a1-a457d0ddbb16 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:48.748818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df964dd-682c-40d2-92a1-a457d0ddbb16 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:48.749384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df964dd-682c-40d2-92a1-a457d0ddbb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:48.827560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-3df964dd-682c-40d2-92a1-a457d0ddbb16 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:59:48.831617 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3df964dd-682c-40d2-92a1-a457d0ddbb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:48.855094 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1535/3041] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:59:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:59:48.855508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f733e33-25f5-437c-8bdd-755e02a1a335 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:48.875576 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f733e33-25f5-437c-8bdd-755e02a1a335 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:48.886063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4ec57-5a4c-4c93-aa2d-88879c3d8bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:48.888966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4ec57-5a4c-4c93-aa2d-88879c3d8bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:48.893901 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4ec57-5a4c-4c93-aa2d-88879c3d8bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:48.894386 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4ec57-5a4c-4c93-aa2d-88879c3d8bb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:48.900200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4ec57-5a4c-4c93-aa2d-88879c3d8bb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:59:48.900858 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4ec57-5a4c-4c93-aa2d-88879c3d8bb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:48.911563 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4ec57-5a4c-4c93-aa2d-88879c3d8bb7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:48.965160 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1507/3042] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 20:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:59:48.966971 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df964dd-682c-40d2-92a1-a457d0ddbb16 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:48.979473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df964dd-682c-40d2-92a1-a457d0ddbb16 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:48.995410 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca4640-0f54-4999-9d47-d54b17e12aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:48.999205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca4640-0f54-4999-9d47-d54b17e12aac admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:49.001049 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca4640-0f54-4999-9d47-d54b17e12aac admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:49.001630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca4640-0f54-4999-9d47-d54b17e12aac admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:49.002837 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca4640-0f54-4999-9d47-d54b17e12aac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:49.007726 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca4640-0f54-4999-9d47-d54b17e12aac admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:49.091796 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1536/3043] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:59:48 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:59:49.095209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4ec57-5a4c-4c93-aa2d-88879c3d8bb7 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:49.112002 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4ec57-5a4c-4c93-aa2d-88879c3d8bb7 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:49.247759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e3122-038c-41e7-8aec-d4db71b92b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:49.249557 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e3122-038c-41e7-8aec-d4db71b92b77 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:49.251123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e3122-038c-41e7-8aec-d4db71b92b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:49.251545 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e3122-038c-41e7-8aec-d4db71b92b77 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:49.253349 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e3122-038c-41e7-8aec-d4db71b92b77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:49.259733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e3122-038c-41e7-8aec-d4db71b92b77 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:49.310492 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1508/3044] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:59:49 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:59:49.315482 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca4640-0f54-4999-9d47-d54b17e12aac admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:49.336700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca4640-0f54-4999-9d47-d54b17e12aac admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:49.348580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464683f9-3797-4e0f-a588-82d5798ac0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:49.349773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464683f9-3797-4e0f-a588-82d5798ac0be admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:49.353557 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464683f9-3797-4e0f-a588-82d5798ac0be admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:49.353968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464683f9-3797-4e0f-a588-82d5798ac0be admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:49.354789 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464683f9-3797-4e0f-a588-82d5798ac0be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:49.357142 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464683f9-3797-4e0f-a588-82d5798ac0be admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:49.383476 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1537/3045] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:59:49 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:59:49.388134 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e3122-038c-41e7-8aec-d4db71b92b77 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:49.404340 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e3122-038c-41e7-8aec-d4db71b92b77 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:49.411346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d959b-adad-4708-bb1f-72d77c785da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:49.412112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d959b-adad-4708-bb1f-72d77c785da2 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:49.412501 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d959b-adad-4708-bb1f-72d77c785da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:49.412901 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d959b-adad-4708-bb1f-72d77c785da2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:49.413714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d959b-adad-4708-bb1f-72d77c785da2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:49.415414 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d959b-adad-4708-bb1f-72d77c785da2 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:49.427958 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1509/3046] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:59:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:59:49.432151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464683f9-3797-4e0f-a588-82d5798ac0be admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:49.450300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464683f9-3797-4e0f-a588-82d5798ac0be admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:49.460408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2077004-9e7a-4b24-9d00-986104d64b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:49.462315 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2077004-9e7a-4b24-9d00-986104d64b82 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:49.463952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2077004-9e7a-4b24-9d00-986104d64b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:49.464299 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2077004-9e7a-4b24-9d00-986104d64b82 admin admin] PATH_INFO: `/v3/projects/afc36f344d274f89b5139ba88bef375b/users/145439e0e0d549f89b17e81cbd46c580/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:49.511059 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2077004-9e7a-4b24-9d00-986104d64b82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afc36f344d274f89b5139ba88bef375b, user_id=145439e0e0d549f89b17e81cbd46c580, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:49.519088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2077004-9e7a-4b24-9d00-986104d64b82 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:49.561837 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1538/3047] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:59:49 2022] PUT /identity/v3/projects/afc36f344d274f89b5139ba88bef375b/users/145439e0e0d549f89b17e81cbd46c580/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:49.567239 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346deb3d-a57f-4b26-aad7-cea2d9eae760 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:49.567947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346deb3d-a57f-4b26-aad7-cea2d9eae760 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:49.567947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346deb3d-a57f-4b26-aad7-cea2d9eae760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:49.620353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-346deb3d-a57f-4b26-aad7-cea2d9eae760 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:59:49.627693 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-346deb3d-a57f-4b26-aad7-cea2d9eae760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:49.745559 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1510/3048] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:59:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:59:49.810586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2077004-9e7a-4b24-9d00-986104d64b82 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:49.816428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a2077004-9e7a-4b24-9d00-986104d64b82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:49.952688 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a56806-f68c-438e-9fdf-4068862265a4 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:49.952976 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a56806-f68c-438e-9fdf-4068862265a4 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:49.953277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a56806-f68c-438e-9fdf-4068862265a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:49.998124 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2077004-9e7a-4b24-9d00-986104d64b82 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:50.008583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0fc149-dc57-4176-a5cf-38d9aad3b7b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:50.012842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fc149-dc57-4176-a5cf-38d9aad3b7b1 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:50.013430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fc149-dc57-4176-a5cf-38d9aad3b7b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:50.014707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fc149-dc57-4176-a5cf-38d9aad3b7b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:50.018789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-97a56806-f68c-438e-9fdf-4068862265a4 None None] MFA Rules not processed for user `91d180c9584c49b296a1db51fbe50694`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:59:50.021072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-97a56806-f68c-438e-9fdf-4068862265a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:50.043481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0fc149-dc57-4176-a5cf-38d9aad3b7b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:50.046711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0fc149-dc57-4176-a5cf-38d9aad3b7b1 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:50.075388 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1539/3049] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:59:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:59:50.117343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:50.181746 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1511/3050] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:59:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:59:56.835765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11664d-7b10-4f36-aba5-be4716a447f7 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:56.836473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11664d-7b10-4f36-aba5-be4716a447f7 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:56.836473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11664d-7b10-4f36-aba5-be4716a447f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:56.905818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-ea11664d-7b10-4f36-aba5-be4716a447f7 None None] MFA Rules not processed for user `d5754e7eed1b48f8805b6dffefb37b59`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:59:56.912409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ea11664d-7b10-4f36-aba5-be4716a447f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:57.100337 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1540/3051] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 20:59:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:59:57.107580 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a56806-f68c-438e-9fdf-4068862265a4 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:57.111089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-97a56806-f68c-438e-9fdf-4068862265a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:57.150921 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a56806-f68c-438e-9fdf-4068862265a4 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:57.167632 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec88aa-59e4-4993-90b2-c129e91b060a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:57.170061 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec88aa-59e4-4993-90b2-c129e91b060a admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:57.170514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec88aa-59e4-4993-90b2-c129e91b060a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:57.172123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec88aa-59e4-4993-90b2-c129e91b060a admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:57.172123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ec88aa-59e4-4993-90b2-c129e91b060a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:57.177784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ec88aa-59e4-4993-90b2-c129e91b060a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:57.275862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11664d-7b10-4f36-aba5-be4716a447f7 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:57.276413 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1512/3052] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 20:59:57 2022] POST /identity/v3/projects => generated 385 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:59:57.298717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11664d-7b10-4f36-aba5-be4716a447f7 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:57.312064 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:57.514578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4fa49-64f5-445e-b77b-db1b90ffaa65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:57.520221 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4fa49-64f5-445e-b77b-db1b90ffaa65 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:57.520682 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4fa49-64f5-445e-b77b-db1b90ffaa65 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:57.521203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4fa49-64f5-445e-b77b-db1b90ffaa65 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:57.521839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4fa49-64f5-445e-b77b-db1b90ffaa65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:57.524277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4fa49-64f5-445e-b77b-db1b90ffaa65 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:57.617199 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1541/3053] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 20:59:57 2022] POST /identity/v3/users => generated 299 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:59:57.622657 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec88aa-59e4-4993-90b2-c129e91b060a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:57.651492 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec88aa-59e4-4993-90b2-c129e91b060a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:57.700145 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2b6d3-43ed-46a4-8166-8083dfb4f382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:57.703261 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2b6d3-43ed-46a4-8166-8083dfb4f382 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:57.703560 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2b6d3-43ed-46a4-8166-8083dfb4f382 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:57.703880 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2b6d3-43ed-46a4-8166-8083dfb4f382 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:57.704548 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2b6d3-43ed-46a4-8166-8083dfb4f382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:57.712124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2b6d3-43ed-46a4-8166-8083dfb4f382 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:57.783935 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1513/3054] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:59:57.788520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4fa49-64f5-445e-b77b-db1b90ffaa65 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:57.820546 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4fa49-64f5-445e-b77b-db1b90ffaa65 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:57.846152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8172928-4b7f-42bb-a47c-b20d2328393b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:57.857722 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8172928-4b7f-42bb-a47c-b20d2328393b admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:57.859244 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8172928-4b7f-42bb-a47c-b20d2328393b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:57.859750 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8172928-4b7f-42bb-a47c-b20d2328393b admin admin] PATH_INFO: `/v3/projects/8c7bca96003b47e9b30a21b51042d0fd/users/fabbdd5183e74097994fdfb2767de55e/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:57.912715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c2d5e-d44f-4221-9e95-0a4517e8c50c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:57.913047 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c2d5e-d44f-4221-9e95-0a4517e8c50c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:57.913282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c2d5e-d44f-4221-9e95-0a4517e8c50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:57.916820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8172928-4b7f-42bb-a47c-b20d2328393b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c7bca96003b47e9b30a21b51042d0fd, user_id=fabbdd5183e74097994fdfb2767de55e, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:57.933863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8172928-4b7f-42bb-a47c-b20d2328393b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:57.955861 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-df8c2d5e-d44f-4221-9e95-0a4517e8c50c None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:59:57.957161 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-df8c2d5e-d44f-4221-9e95-0a4517e8c50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:57.972028 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1542/3055] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:59:57 2022] PUT /identity/v3/projects/8c7bca96003b47e9b30a21b51042d0fd/users/fabbdd5183e74097994fdfb2767de55e/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:57.977011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8172928-4b7f-42bb-a47c-b20d2328393b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:58.153105 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1514/3056] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 20:59:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:59:58.176965 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8172928-4b7f-42bb-a47c-b20d2328393b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:58.191455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab58221-d7d7-45a7-ad42-78c812a91ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:58.192422 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab58221-d7d7-45a7-ad42-78c812a91ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:58.192944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab58221-d7d7-45a7-ad42-78c812a91ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:58.193435 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab58221-d7d7-45a7-ad42-78c812a91ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:58.195882 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab58221-d7d7-45a7-ad42-78c812a91ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:58.201099 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab58221-d7d7-45a7-ad42-78c812a91ff6 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:58.220459 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c2d5e-d44f-4221-9e95-0a4517e8c50c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:58.224608 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-df8c2d5e-d44f-4221-9e95-0a4517e8c50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:58.233267 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1543/3057] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 20:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:59:58.234446 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab58221-d7d7-45a7-ad42-78c812a91ff6 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:58.256492 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab58221-d7d7-45a7-ad42-78c812a91ff6 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:58.284958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5aeff-ef2c-47e6-980d-76fefcf09bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:58.285932 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5aeff-ef2c-47e6-980d-76fefcf09bfd admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:58.291151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5aeff-ef2c-47e6-980d-76fefcf09bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:58.291715 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5aeff-ef2c-47e6-980d-76fefcf09bfd admin admin] PATH_INFO: `/v3/projects/8c7bca96003b47e9b30a21b51042d0fd/users/fabbdd5183e74097994fdfb2767de55e/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:58.305569 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b5aeff-ef2c-47e6-980d-76fefcf09bfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c7bca96003b47e9b30a21b51042d0fd, user_id=fabbdd5183e74097994fdfb2767de55e, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:58.308812 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b5aeff-ef2c-47e6-980d-76fefcf09bfd admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:58.342242 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1544/3058] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 20:59:58 2022] PUT /identity/v3/projects/8c7bca96003b47e9b30a21b51042d0fd/users/fabbdd5183e74097994fdfb2767de55e/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:59:58.405090 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c2d5e-d44f-4221-9e95-0a4517e8c50c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:58.413429 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5aeff-ef2c-47e6-980d-76fefcf09bfd admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:59:58.416088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-11b5aeff-ef2c-47e6-980d-76fefcf09bfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:58.552044 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:58.610562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:58.611543 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5aeff-ef2c-47e6-980d-76fefcf09bfd admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:59:58.631707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f3de1-e62c-4f7a-bdf1-2201cc8e4b74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:58.635476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f3de1-e62c-4f7a-bdf1-2201cc8e4b74 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:58.635775 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f3de1-e62c-4f7a-bdf1-2201cc8e4b74 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:58.635892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734a48e-b687-4766-ae2e-f4f204564c5b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:59:58.636115 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f3de1-e62c-4f7a-bdf1-2201cc8e4b74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:58.638488 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734a48e-b687-4766-ae2e-f4f204564c5b service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:59:58.640125 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734a48e-b687-4766-ae2e-f4f204564c5b service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:59:58.640662 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734a48e-b687-4766-ae2e-f4f204564c5b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:59:58.643361 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d51f3de1-e62c-4f7a-bdf1-2201cc8e4b74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:59:58.858154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f3de1-e62c-4f7a-bdf1-2201cc8e4b74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:58.864913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f3de1-e62c-4f7a-bdf1-2201cc8e4b74 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:58.875012 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c734a48e-b687-4766-ae2e-f4f204564c5b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:59:58.880967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c734a48e-b687-4766-ae2e-f4f204564c5b service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:59:58.908250 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1545/3059] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 20:59:58 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:59:58.908564 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1515/3060] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 20:59:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 689 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 06 21:00:02.328494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f3de1-e62c-4f7a-bdf1-2201cc8e4b74 service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:02.330828 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d51f3de1-e62c-4f7a-bdf1-2201cc8e4b74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:02.474646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f3de1-e62c-4f7a-bdf1-2201cc8e4b74 service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:02.483030 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c7d3a-c5fc-4739-a4db-2c79446d2d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:02.485019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c7d3a-c5fc-4739-a4db-2c79446d2d8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:02.486243 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c7d3a-c5fc-4739-a4db-2c79446d2d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:02.488341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c7d3a-c5fc-4739-a4db-2c79446d2d8c admin admin] PATH_INFO: `/v3/users/e3a18bfb46b54712a4b6e1f6bec790a4` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:02.490779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206c7d3a-c5fc-4739-a4db-2c79446d2d8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3a18bfb46b54712a4b6e1f6bec790a4)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:02.496057 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206c7d3a-c5fc-4739-a4db-2c79446d2d8c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:02.591142 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-206c7d3a-c5fc-4739-a4db-2c79446d2d8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3a18bfb46b54712a4b6e1f6bec790a4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:02.611055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-206c7d3a-c5fc-4739-a4db-2c79446d2d8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3a18bfb46b54712a4b6e1f6bec790a4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:02.614239 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-206c7d3a-c5fc-4739-a4db-2c79446d2d8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3a18bfb46b54712a4b6e1f6bec790a4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:02.617712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-206c7d3a-c5fc-4739-a4db-2c79446d2d8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3a18bfb46b54712a4b6e1f6bec790a4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:02.632140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-206c7d3a-c5fc-4739-a4db-2c79446d2d8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3a18bfb46b54712a4b6e1f6bec790a4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:02.718005 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1546/3061] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:00:02 2022] DELETE /identity/v3/users/e3a18bfb46b54712a4b6e1f6bec790a4 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:00:02.988023 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85f1e9-16fe-4cd6-812d-ce905411710c None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:02.988856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85f1e9-16fe-4cd6-812d-ce905411710c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:02.989179 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85f1e9-16fe-4cd6-812d-ce905411710c None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:02.990886 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1516/3062] 10.222.0.33 () {54 vars in 921 bytes} [Sat Aug 6 21:00:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 21:00:03.001955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199e6bb-595e-400c-8843-7f6c1344cb29 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:03.002248 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199e6bb-595e-400c-8843-7f6c1344cb29 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:03.002517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199e6bb-595e-400c-8843-7f6c1344cb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:03.041592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:00:03.083055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-8199e6bb-595e-400c-8843-7f6c1344cb29 None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:00:03.085484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8199e6bb-595e-400c-8843-7f6c1344cb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:03.365776 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1547/3063] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 21:00:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:00:03.393928 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85f1e9-16fe-4cd6-812d-ce905411710c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:03.396599 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7a85f1e9-16fe-4cd6-812d-ce905411710c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:03.445151 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85f1e9-16fe-4cd6-812d-ce905411710c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:03.456692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef9e93-4dd4-4e79-b552-8f5720fed3da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:03.459295 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef9e93-4dd4-4e79-b552-8f5720fed3da service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:03.459920 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef9e93-4dd4-4e79-b552-8f5720fed3da service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:03.463842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef9e93-4dd4-4e79-b552-8f5720fed3da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:03.495342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef9e93-4dd4-4e79-b552-8f5720fed3da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:03.511956 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef9e93-4dd4-4e79-b552-8f5720fed3da service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:03.542146 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1517/3064] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:00:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:00:04.885897 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199e6bb-595e-400c-8843-7f6c1344cb29 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:04.888022 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8199e6bb-595e-400c-8843-7f6c1344cb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:05.002603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199e6bb-595e-400c-8843-7f6c1344cb29 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:05.010869 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653148b2-6ef0-4c5e-8a63-94734b033ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:05.012550 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653148b2-6ef0-4c5e-8a63-94734b033ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:05.013128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653148b2-6ef0-4c5e-8a63-94734b033ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:05.014274 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653148b2-6ef0-4c5e-8a63-94734b033ce6 admin admin] PATH_INFO: `/v3/projects/ce68966451244078835766f1dfd16258` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:05.016043 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653148b2-6ef0-4c5e-8a63-94734b033ce6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce68966451244078835766f1dfd16258)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:05.018317 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653148b2-6ef0-4c5e-8a63-94734b033ce6 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:05.092295 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-653148b2-6ef0-4c5e-8a63-94734b033ce6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce68966451244078835766f1dfd16258', 'request_id': 'req-653148b2-6ef0-4c5e-8a63-94734b033ce6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:05.101597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-653148b2-6ef0-4c5e-8a63-94734b033ce6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce68966451244078835766f1dfd16258', 'request_id': 'req-653148b2-6ef0-4c5e-8a63-94734b033ce6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:05.118660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-653148b2-6ef0-4c5e-8a63-94734b033ce6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce68966451244078835766f1dfd16258', 'request_id': 'req-653148b2-6ef0-4c5e-8a63-94734b033ce6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:05.144612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-653148b2-6ef0-4c5e-8a63-94734b033ce6 admin admin] The token cache is being invalidate because project ce68966451244078835766f1dfd16258 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:00:05.145374 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-653148b2-6ef0-4c5e-8a63-94734b033ce6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:05.148492 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-653148b2-6ef0-4c5e-8a63-94734b033ce6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:05.156348 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1548/3065] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:00:04 2022] DELETE /identity/v3/projects/ce68966451244078835766f1dfd16258 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:00:05.158237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ee20e-4f6f-4554-a614-8f83285104bb None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:05.158774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ee20e-4f6f-4554-a614-8f83285104bb None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:05.158896 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ee20e-4f6f-4554-a614-8f83285104bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:05.214048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-797ee20e-4f6f-4554-a614-8f83285104bb None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:00:05.216599 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-797ee20e-4f6f-4554-a614-8f83285104bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:05.377026 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1518/3066] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:00:05.384988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98259feb-d7f3-49ea-a41b-651f6eae6c68 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:05.385402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98259feb-d7f3-49ea-a41b-651f6eae6c68 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:05.385853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98259feb-d7f3-49ea-a41b-651f6eae6c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:05.415850 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-98259feb-d7f3-49ea-a41b-651f6eae6c68 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:00:05.418063 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-98259feb-d7f3-49ea-a41b-651f6eae6c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:05.428598 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1549/3067] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:00:05.432765 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ee20e-4f6f-4554-a614-8f83285104bb None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:05.445540 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ee20e-4f6f-4554-a614-8f83285104bb None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:05.478332 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4e470-8cb4-4d9c-be4a-e6fa1cfaa4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:05.479295 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4e470-8cb4-4d9c-be4a-e6fa1cfaa4d3 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:05.479701 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4e470-8cb4-4d9c-be4a-e6fa1cfaa4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:05.481495 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4e470-8cb4-4d9c-be4a-e6fa1cfaa4d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:05.484364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a4e470-8cb4-4d9c-be4a-e6fa1cfaa4d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:00:05.484795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a4e470-8cb4-4d9c-be4a-e6fa1cfaa4d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:05.489679 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a4e470-8cb4-4d9c-be4a-e6fa1cfaa4d3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:05.522487 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1519/3068] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:00:05.525095 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98259feb-d7f3-49ea-a41b-651f6eae6c68 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:05.545740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98259feb-d7f3-49ea-a41b-651f6eae6c68 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:05.568458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbad626-141c-4849-a1b0-123b3c021990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:05.572165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbad626-141c-4849-a1b0-123b3c021990 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:05.572482 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbad626-141c-4849-a1b0-123b3c021990 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:05.572761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbad626-141c-4849-a1b0-123b3c021990 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:05.573434 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbad626-141c-4849-a1b0-123b3c021990 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:05.576526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbad626-141c-4849-a1b0-123b3c021990 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:05.717821 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1550/3069] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:00:05 2022] POST /identity/v3/projects => generated 379 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:00:05.719429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4e470-8cb4-4d9c-be4a-e6fa1cfaa4d3 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:05.733181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4e470-8cb4-4d9c-be4a-e6fa1cfaa4d3 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:05.931998 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf446b8-ca02-478a-9447-25b63972299a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:05.932686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf446b8-ca02-478a-9447-25b63972299a admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:05.932976 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf446b8-ca02-478a-9447-25b63972299a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:05.933297 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf446b8-ca02-478a-9447-25b63972299a admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:05.936747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf446b8-ca02-478a-9447-25b63972299a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:05.940003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf446b8-ca02-478a-9447-25b63972299a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:05.994679 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1520/3070] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:00:05 2022] POST /identity/v3/users => generated 290 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:00:05.996060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbad626-141c-4849-a1b0-123b3c021990 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:06.007452 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:00:06.017618 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbad626-141c-4849-a1b0-123b3c021990 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:06.034101 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41473d1e-e904-4152-a51c-96397de981c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:06.034762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41473d1e-e904-4152-a51c-96397de981c2 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:06.035046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41473d1e-e904-4152-a51c-96397de981c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:06.035368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41473d1e-e904-4152-a51c-96397de981c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:06.036025 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41473d1e-e904-4152-a51c-96397de981c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:06.037809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41473d1e-e904-4152-a51c-96397de981c2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:06.078004 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1551/3071] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:00:06.079598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf446b8-ca02-478a-9447-25b63972299a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:06.088499 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:00:06.097618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf446b8-ca02-478a-9447-25b63972299a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:06.108908 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195b549-2a44-4b9f-bda1-c4b8e8914ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:06.109541 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195b549-2a44-4b9f-bda1-c4b8e8914ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:06.109820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195b549-2a44-4b9f-bda1-c4b8e8914ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:06.110096 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195b549-2a44-4b9f-bda1-c4b8e8914ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:06.115684 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195b549-2a44-4b9f-bda1-c4b8e8914ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:06.117482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195b549-2a44-4b9f-bda1-c4b8e8914ba8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:06.155638 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1521/3072] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:00:06.160096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41473d1e-e904-4152-a51c-96397de981c2 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:06.177369 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41473d1e-e904-4152-a51c-96397de981c2 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:06.194134 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18558695-b654-41db-a0f2-b40b2828a51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:06.196196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18558695-b654-41db-a0f2-b40b2828a51e admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:06.196566 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18558695-b654-41db-a0f2-b40b2828a51e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:06.198175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18558695-b654-41db-a0f2-b40b2828a51e admin admin] PATH_INFO: `/v3/projects/732046dc9fc84a5595e7d62ef4134589/users/260593e822bc4229a16b904d843add11/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:06.237166 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18558695-b654-41db-a0f2-b40b2828a51e admin admin] RBAC: Authorizing `identity:create_grant(project_id=732046dc9fc84a5595e7d62ef4134589, user_id=260593e822bc4229a16b904d843add11, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:06.251663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18558695-b654-41db-a0f2-b40b2828a51e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:06.296558 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1552/3073] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:00:06 2022] PUT /identity/v3/projects/732046dc9fc84a5595e7d62ef4134589/users/260593e822bc4229a16b904d843add11/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:00:06.298750 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd12a10-e9b1-4e9f-a2b2-40d9c2465299 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:06.299255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd12a10-e9b1-4e9f-a2b2-40d9c2465299 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:06.299365 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd12a10-e9b1-4e9f-a2b2-40d9c2465299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:06.381187 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-5bd12a10-e9b1-4e9f-a2b2-40d9c2465299 None None] MFA Rules not processed for user `260593e822bc4229a16b904d843add11`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:00:06.392725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5bd12a10-e9b1-4e9f-a2b2-40d9c2465299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:06.620054 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1522/3074] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:00:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:00:07.018225 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18558695-b654-41db-a0f2-b40b2828a51e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:07.021875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-18558695-b654-41db-a0f2-b40b2828a51e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:07.426340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18558695-b654-41db-a0f2-b40b2828a51e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:07.436217 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910aa001-63f8-48d0-813a-780349d12a0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:07.437503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910aa001-63f8-48d0-813a-780349d12a0c service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:07.438252 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910aa001-63f8-48d0-813a-780349d12a0c service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:07.438843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910aa001-63f8-48d0-813a-780349d12a0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:07.457811 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910aa001-63f8-48d0-813a-780349d12a0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:07.460721 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910aa001-63f8-48d0-813a-780349d12a0c service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:07.485699 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1553/3075] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:00:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:00:07.595595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd12a10-e9b1-4e9f-a2b2-40d9c2465299 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:07.792269 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd12a10-e9b1-4e9f-a2b2-40d9c2465299 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:07.805621 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59b487-5e9c-4c4e-acf9-695c1c6c2a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:07.806738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59b487-5e9c-4c4e-acf9-695c1c6c2a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:07.811429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59b487-5e9c-4c4e-acf9-695c1c6c2a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:07.811728 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59b487-5e9c-4c4e-acf9-695c1c6c2a86 admin admin] PATH_INFO: `/v3/users/260593e822bc4229a16b904d843add11` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:07.814104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be59b487-5e9c-4c4e-acf9-695c1c6c2a86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=260593e822bc4229a16b904d843add11)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:07.818876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be59b487-5e9c-4c4e-acf9-695c1c6c2a86 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:07.931980 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-be59b487-5e9c-4c4e-acf9-695c1c6c2a86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '260593e822bc4229a16b904d843add11'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:07.936072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-be59b487-5e9c-4c4e-acf9-695c1c6c2a86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '260593e822bc4229a16b904d843add11'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:07.940916 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-be59b487-5e9c-4c4e-acf9-695c1c6c2a86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '260593e822bc4229a16b904d843add11'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:07.959958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-be59b487-5e9c-4c4e-acf9-695c1c6c2a86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '260593e822bc4229a16b904d843add11'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:07.990302 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-be59b487-5e9c-4c4e-acf9-695c1c6c2a86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '260593e822bc4229a16b904d843add11'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:08.017316 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1523/3076] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:00:07 2022] DELETE /identity/v3/users/260593e822bc4229a16b904d843add11 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:00:08.021754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a5750-8887-4dcf-87da-4c222a046bba None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:08.022619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a5750-8887-4dcf-87da-4c222a046bba None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:08.023199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a5750-8887-4dcf-87da-4c222a046bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:08.072553 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-1a8a5750-8887-4dcf-87da-4c222a046bba None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:00:08.075097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1a8a5750-8887-4dcf-87da-4c222a046bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:08.223188 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1554/3077] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:00:08.247567 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59b487-5e9c-4c4e-acf9-695c1c6c2a86 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:08.249033 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-be59b487-5e9c-4c4e-acf9-695c1c6c2a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:08.256984 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:00:08.273656 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a5750-8887-4dcf-87da-4c222a046bba None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:08.275665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1a8a5750-8887-4dcf-87da-4c222a046bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:08.585268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59b487-5e9c-4c4e-acf9-695c1c6c2a86 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:08.611699 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41035d23-87bd-4439-8750-3ee0d8fb18bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:08.615033 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41035d23-87bd-4439-8750-3ee0d8fb18bc service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:08.616176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41035d23-87bd-4439-8750-3ee0d8fb18bc service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:08.617866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41035d23-87bd-4439-8750-3ee0d8fb18bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:08.620463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a5750-8887-4dcf-87da-4c222a046bba None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:08.625803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-41035d23-87bd-4439-8750-3ee0d8fb18bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:08.645710 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e6e3d-87a1-481b-b3b7-e5aca2dc638e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:08.646426 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e6e3d-87a1-481b-b3b7-e5aca2dc638e service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:08.646748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e6e3d-87a1-481b-b3b7-e5aca2dc638e service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:08.647072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e6e3d-87a1-481b-b3b7-e5aca2dc638e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:08.677995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e6e3d-87a1-481b-b3b7-e5aca2dc638e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:08.686677 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e6e3d-87a1-481b-b3b7-e5aca2dc638e service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:08.709615 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:00:08.735878 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1555/3078] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:00:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:00:08.940586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41035d23-87bd-4439-8750-3ee0d8fb18bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:08.942272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41035d23-87bd-4439-8750-3ee0d8fb18bc service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:08.982372 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1524/3079] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:00:08 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 736 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:00:13.288116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e6e3d-87a1-481b-b3b7-e5aca2dc638e service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:13.289621 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8e8e6e3d-87a1-481b-b3b7-e5aca2dc638e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:13.338210 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e6e3d-87a1-481b-b3b7-e5aca2dc638e service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:13.348711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9acd6e-33d5-4630-828f-5ca6dbbae428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:13.349443 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9acd6e-33d5-4630-828f-5ca6dbbae428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:13.349728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9acd6e-33d5-4630-828f-5ca6dbbae428 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:13.350013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9acd6e-33d5-4630-828f-5ca6dbbae428 admin admin] PATH_INFO: `/v3/projects/732046dc9fc84a5595e7d62ef4134589` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:13.351290 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9acd6e-33d5-4630-828f-5ca6dbbae428 admin admin] RBAC: Authorizing `identity:delete_project(project_id=732046dc9fc84a5595e7d62ef4134589)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:13.353693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9acd6e-33d5-4630-828f-5ca6dbbae428 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:13.525732 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6f9acd6e-33d5-4630-828f-5ca6dbbae428 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '732046dc9fc84a5595e7d62ef4134589', 'request_id': 'req-6f9acd6e-33d5-4630-828f-5ca6dbbae428'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:13.541036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6f9acd6e-33d5-4630-828f-5ca6dbbae428 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '732046dc9fc84a5595e7d62ef4134589', 'request_id': 'req-6f9acd6e-33d5-4630-828f-5ca6dbbae428'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:13.562326 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6f9acd6e-33d5-4630-828f-5ca6dbbae428 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '732046dc9fc84a5595e7d62ef4134589', 'request_id': 'req-6f9acd6e-33d5-4630-828f-5ca6dbbae428'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:13.593662 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6f9acd6e-33d5-4630-828f-5ca6dbbae428 admin admin] The token cache is being invalidate because project 732046dc9fc84a5595e7d62ef4134589 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:00:13.595295 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6f9acd6e-33d5-4630-828f-5ca6dbbae428 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:13.600009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6f9acd6e-33d5-4630-828f-5ca6dbbae428 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:13.607096 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1556/3080] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:00:13 2022] DELETE /identity/v3/projects/732046dc9fc84a5595e7d62ef4134589 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:00:13.612174 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a7a8e-d5c0-493d-af63-51a8b5d76051 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:13.612658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a7a8e-d5c0-493d-af63-51a8b5d76051 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:13.612781 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a7a8e-d5c0-493d-af63-51a8b5d76051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:13.690947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-ac5a7a8e-d5c0-493d-af63-51a8b5d76051 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:00:13.695219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ac5a7a8e-d5c0-493d-af63-51a8b5d76051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:13.869907 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1525/3081] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:00:13.878010 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141be64-d9ca-4165-9702-d08cdf0938ab None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:13.878216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141be64-d9ca-4165-9702-d08cdf0938ab None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:13.878466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141be64-d9ca-4165-9702-d08cdf0938ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:13.919732 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d141be64-d9ca-4165-9702-d08cdf0938ab None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:00:13.921671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d141be64-d9ca-4165-9702-d08cdf0938ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:13.936288 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1557/3082] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:00:13.940493 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a7a8e-d5c0-493d-af63-51a8b5d76051 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:13.978392 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a7a8e-d5c0-493d-af63-51a8b5d76051 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:13.995981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c3cce-df00-4cfe-b9d3-b615c58efab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:13.996274 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c3cce-df00-4cfe-b9d3-b615c58efab3 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:13.996805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c3cce-df00-4cfe-b9d3-b615c58efab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:13.998080 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c3cce-df00-4cfe-b9d3-b615c58efab3 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:14.000152 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c3cce-df00-4cfe-b9d3-b615c58efab3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:00:14.002671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c3cce-df00-4cfe-b9d3-b615c58efab3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:14.006394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c3cce-df00-4cfe-b9d3-b615c58efab3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:14.056376 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1526/3083] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:00:14.058790 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141be64-d9ca-4165-9702-d08cdf0938ab None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:14.086983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141be64-d9ca-4165-9702-d08cdf0938ab None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:14.106493 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da3514-94c2-4d9e-a95d-97280025f077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:14.108184 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da3514-94c2-4d9e-a95d-97280025f077 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:14.109848 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da3514-94c2-4d9e-a95d-97280025f077 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:14.110771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da3514-94c2-4d9e-a95d-97280025f077 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:14.114222 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1da3514-94c2-4d9e-a95d-97280025f077 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:14.122431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1da3514-94c2-4d9e-a95d-97280025f077 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:14.213984 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1558/3084] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:00:14 2022] POST /identity/v3/projects => generated 377 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:00:14.221125 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c3cce-df00-4cfe-b9d3-b615c58efab3 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:14.236389 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c3cce-df00-4cfe-b9d3-b615c58efab3 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:14.348535 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:00:14.393143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9bd9d0-3935-47eb-88a9-0bf436018ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:14.394091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bd9d0-3935-47eb-88a9-0bf436018ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:14.394091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bd9d0-3935-47eb-88a9-0bf436018ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:14.394342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bd9d0-3935-47eb-88a9-0bf436018ed5 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:14.395111 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9bd9d0-3935-47eb-88a9-0bf436018ed5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:14.397240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9bd9d0-3935-47eb-88a9-0bf436018ed5 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:14.453763 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1527/3085] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:00:14 2022] POST /identity/v3/users => generated 289 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:00:14.455117 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da3514-94c2-4d9e-a95d-97280025f077 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:14.472757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da3514-94c2-4d9e-a95d-97280025f077 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:14.488499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233416b-43cf-4c20-a23d-c6681d33b9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:14.489566 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233416b-43cf-4c20-a23d-c6681d33b9ac admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:14.493154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233416b-43cf-4c20-a23d-c6681d33b9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:14.493690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233416b-43cf-4c20-a23d-c6681d33b9ac admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:14.494718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233416b-43cf-4c20-a23d-c6681d33b9ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:14.497610 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233416b-43cf-4c20-a23d-c6681d33b9ac admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:14.525615 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1559/3086] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:00:14.530274 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9bd9d0-3935-47eb-88a9-0bf436018ed5 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:14.551900 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9bd9d0-3935-47eb-88a9-0bf436018ed5 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:14.571040 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901fd87-9cf3-4f7e-8129-421ec45841df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:14.572106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901fd87-9cf3-4f7e-8129-421ec45841df admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:14.572563 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901fd87-9cf3-4f7e-8129-421ec45841df admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:14.572996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901fd87-9cf3-4f7e-8129-421ec45841df admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:14.573865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0901fd87-9cf3-4f7e-8129-421ec45841df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:14.576172 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0901fd87-9cf3-4f7e-8129-421ec45841df admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:14.603760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233416b-43cf-4c20-a23d-c6681d33b9ac admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:14.614093 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1528/3087] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:00:14.624591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233416b-43cf-4c20-a23d-c6681d33b9ac admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:14.637035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f75d93-1c15-451b-a649-e639263f5a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:14.642280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f75d93-1c15-451b-a649-e639263f5a99 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:14.643327 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f75d93-1c15-451b-a649-e639263f5a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:14.644320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f75d93-1c15-451b-a649-e639263f5a99 admin admin] PATH_INFO: `/v3/projects/e9acff8060d543c3b8422b25fdc1119b/users/62e7c88630854feb8e5f74c105f70825/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:14.710723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f75d93-1c15-451b-a649-e639263f5a99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9acff8060d543c3b8422b25fdc1119b, user_id=62e7c88630854feb8e5f74c105f70825, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:14.715327 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f75d93-1c15-451b-a649-e639263f5a99 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:14.753331 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1560/3088] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:00:14 2022] PUT /identity/v3/projects/e9acff8060d543c3b8422b25fdc1119b/users/62e7c88630854feb8e5f74c105f70825/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:00:14.770132 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7e5ae-16d1-4c53-a552-39cdb56848a6 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:14.770422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7e5ae-16d1-4c53-a552-39cdb56848a6 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:14.770716 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7e5ae-16d1-4c53-a552-39cdb56848a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:14.828106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-09a7e5ae-16d1-4c53-a552-39cdb56848a6 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:00:14.830384 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-09a7e5ae-16d1-4c53-a552-39cdb56848a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:15.037670 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1529/3089] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:00:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:00:15.133056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f75d93-1c15-451b-a649-e639263f5a99 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:15.135428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-42f75d93-1c15-451b-a649-e639263f5a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:15.321041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f75d93-1c15-451b-a649-e639263f5a99 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:15.337893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc02bff8-0566-4f4f-90cb-1025e1472270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:15.338739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02bff8-0566-4f4f-90cb-1025e1472270 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:15.341744 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02bff8-0566-4f4f-90cb-1025e1472270 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:15.342081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02bff8-0566-4f4f-90cb-1025e1472270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:15.367665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc02bff8-0566-4f4f-90cb-1025e1472270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:15.369165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc02bff8-0566-4f4f-90cb-1025e1472270 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:15.403244 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1561/3090] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:00:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:00:18.424646 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd1825-11ff-467a-81fc-0835d360277e None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:18.425184 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd1825-11ff-467a-81fc-0835d360277e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:18.425184 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd1825-11ff-467a-81fc-0835d360277e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:18.491983 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-ecfd1825-11ff-467a-81fc-0835d360277e None None] MFA Rules not processed for user `dd9a63d793aa4a55822bfe108df664a3`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:00:18.493179 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ecfd1825-11ff-467a-81fc-0835d360277e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:18.627256 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb48926-9745-40a5-a0a8-fc9d58db16a2 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:18.627765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb48926-9745-40a5-a0a8-fc9d58db16a2 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:18.627964 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb48926-9745-40a5-a0a8-fc9d58db16a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:18.691208 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1530/3091] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:00:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:00:18.694154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149d61b-a154-4a8d-b0ab-22582b740a89 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:18.694445 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149d61b-a154-4a8d-b0ab-22582b740a89 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:18.696331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149d61b-a154-4a8d-b0ab-22582b740a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:18.731635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-dcb48926-9745-40a5-a0a8-fc9d58db16a2 None None] MFA Rules not processed for user `145439e0e0d549f89b17e81cbd46c580`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:00:18.735365 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-dcb48926-9745-40a5-a0a8-fc9d58db16a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:18.769864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a149d61b-a154-4a8d-b0ab-22582b740a89 None None] MFA Rules not processed for user `dd9a63d793aa4a55822bfe108df664a3`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:00:18.771723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a149d61b-a154-4a8d-b0ab-22582b740a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:18.775273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:00:18.799271 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1531/3092] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:00:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:00:18.994932 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1562/3093] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:00:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:00:18.997686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149d61b-a154-4a8d-b0ab-22582b740a89 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:18.999460 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a149d61b-a154-4a8d-b0ab-22582b740a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:19.053544 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149d61b-a154-4a8d-b0ab-22582b740a89 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:19.081286 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b02cb1-5992-40f5-bdcc-ac8b1fd5f051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:19.092333 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b02cb1-5992-40f5-bdcc-ac8b1fd5f051 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:19.094811 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b02cb1-5992-40f5-bdcc-ac8b1fd5f051 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:19.116283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668de137-4f37-4fec-9197-3d322e74b9ef None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:19.117581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668de137-4f37-4fec-9197-3d322e74b9ef None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:19.117965 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668de137-4f37-4fec-9197-3d322e74b9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:19.128567 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b02cb1-5992-40f5-bdcc-ac8b1fd5f051 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:19.131645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b02cb1-5992-40f5-bdcc-ac8b1fd5f051 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:19.140419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b02cb1-5992-40f5-bdcc-ac8b1fd5f051 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:19.220102 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-668de137-4f37-4fec-9197-3d322e74b9ef None None] MFA Rules not processed for user `fabbdd5183e74097994fdfb2767de55e`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:00:19.221351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-668de137-4f37-4fec-9197-3d322e74b9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:19.281046 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1532/3094] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:00:18 2022] POST /identity/v3/projects => generated 385 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:00:19.285241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b02cb1-5992-40f5-bdcc-ac8b1fd5f051 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:19.385524 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:00:19.456358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b02cb1-5992-40f5-bdcc-ac8b1fd5f051 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:19.486843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d866b-b774-4fef-9b50-d5e6db6cab07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:19.488168 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d866b-b774-4fef-9b50-d5e6db6cab07 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:19.488727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d866b-b774-4fef-9b50-d5e6db6cab07 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:19.489337 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d866b-b774-4fef-9b50-d5e6db6cab07 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:19.490157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d866b-b774-4fef-9b50-d5e6db6cab07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:19.492836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d866b-b774-4fef-9b50-d5e6db6cab07 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:19.532307 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1563/3095] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:00:19 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:00:19.585855 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668de137-4f37-4fec-9197-3d322e74b9ef None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:19.586404 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1533/3096] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:00:19 2022] POST /identity/v3/users => generated 299 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:00:19.601520 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d866b-b774-4fef-9b50-d5e6db6cab07 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:19.603217 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668de137-4f37-4fec-9197-3d322e74b9ef None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:19.603976 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4d7d866b-b774-4fef-9b50-d5e6db6cab07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:19.635913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557ee1c-ff1c-497d-bc38-0e4cc768a212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:19.636662 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557ee1c-ff1c-497d-bc38-0e4cc768a212 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:19.636852 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557ee1c-ff1c-497d-bc38-0e4cc768a212 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:19.637753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557ee1c-ff1c-497d-bc38-0e4cc768a212 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:19.643878 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557ee1c-ff1c-497d-bc38-0e4cc768a212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:19.648803 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557ee1c-ff1c-497d-bc38-0e4cc768a212 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:19.686852 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1564/3097] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:00:19.699620 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557ee1c-ff1c-497d-bc38-0e4cc768a212 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:19.754745 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557ee1c-ff1c-497d-bc38-0e4cc768a212 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:19.770416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ca781-ba48-4a50-b9dc-1ae9598d19dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:19.771126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ca781-ba48-4a50-b9dc-1ae9598d19dc admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:19.771410 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ca781-ba48-4a50-b9dc-1ae9598d19dc admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:19.771693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ca781-ba48-4a50-b9dc-1ae9598d19dc admin admin] PATH_INFO: `/v3/projects/a144007359694aa0b700198d0c384e3d/users/b5b60c17df8e4ec3a8236bfedde32eab/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:19.783247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d866b-b774-4fef-9b50-d5e6db6cab07 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:19.803077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3942c2f-09f2-430a-81f8-3dc7b29701bf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10759b2abd4cafacf338551327775e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:19.804053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3942c2f-09f2-430a-81f8-3dc7b29701bf service glance] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:19.804525 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3942c2f-09f2-430a-81f8-3dc7b29701bf service glance] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:19.805159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3942c2f-09f2-430a-81f8-3dc7b29701bf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:19.811530 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ca781-ba48-4a50-b9dc-1ae9598d19dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a144007359694aa0b700198d0c384e3d, user_id=b5b60c17df8e4ec3a8236bfedde32eab, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:19.816201 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ca781-ba48-4a50-b9dc-1ae9598d19dc admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:19.851369 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1565/3098] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:00:19 2022] PUT /identity/v3/projects/a144007359694aa0b700198d0c384e3d/users/b5b60c17df8e4ec3a8236bfedde32eab/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:00:19.857088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ca781-ba48-4a50-b9dc-1ae9598d19dc admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:19.971000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3942c2f-09f2-430a-81f8-3dc7b29701bf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:19.974716 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3942c2f-09f2-430a-81f8-3dc7b29701bf service glance] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:20.005937 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1534/3099] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:00:19 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:00:20.058521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ca781-ba48-4a50-b9dc-1ae9598d19dc admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:20.078324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba18511-1a81-4fb2-8250-7e87e9c858ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:20.081304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba18511-1a81-4fb2-8250-7e87e9c858ae admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:20.081594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba18511-1a81-4fb2-8250-7e87e9c858ae admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:20.081872 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba18511-1a81-4fb2-8250-7e87e9c858ae admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:20.082527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba18511-1a81-4fb2-8250-7e87e9c858ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:20.084160 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba18511-1a81-4fb2-8250-7e87e9c858ae admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:20.094947 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:00:20.136852 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1566/3100] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:00:20.138501 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3942c2f-09f2-430a-81f8-3dc7b29701bf service glance] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:20.156461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3942c2f-09f2-430a-81f8-3dc7b29701bf service glance] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:20.173781 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06292f-dc82-48b5-ae7e-436ad69cecc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:20.177345 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06292f-dc82-48b5-ae7e-436ad69cecc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:20.177749 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06292f-dc82-48b5-ae7e-436ad69cecc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:20.178946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06292f-dc82-48b5-ae7e-436ad69cecc3 admin admin] PATH_INFO: `/v3/projects/a144007359694aa0b700198d0c384e3d/users/b5b60c17df8e4ec3a8236bfedde32eab/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:20.186613 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f06292f-dc82-48b5-ae7e-436ad69cecc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a144007359694aa0b700198d0c384e3d, user_id=b5b60c17df8e4ec3a8236bfedde32eab, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:20.199771 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f06292f-dc82-48b5-ae7e-436ad69cecc3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:20.245926 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1535/3101] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:00:20 2022] PUT /identity/v3/projects/a144007359694aa0b700198d0c384e3d/users/b5b60c17df8e4ec3a8236bfedde32eab/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:00:23.785566 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba18511-1a81-4fb2-8250-7e87e9c858ae admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:24.092487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba18511-1a81-4fb2-8250-7e87e9c858ae admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:24.443881 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cac2f4-256f-4918-8da9-4244d7ac310a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:24.444592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cac2f4-256f-4918-8da9-4244d7ac310a service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:24.444880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cac2f4-256f-4918-8da9-4244d7ac310a service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:24.445161 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cac2f4-256f-4918-8da9-4244d7ac310a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:24.447175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-18cac2f4-256f-4918-8da9-4244d7ac310a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:24.468153 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cac2f4-256f-4918-8da9-4244d7ac310a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:24.469719 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cac2f4-256f-4918-8da9-4244d7ac310a service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:24.500590 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1567/3102] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:00:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 715 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:00:30.229717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=68,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:00:34.112004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1a135-893a-4711-9bf7-2a2986e2699f None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:34.112683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1a135-893a-4711-9bf7-2a2986e2699f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:34.118793 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1a135-893a-4711-9bf7-2a2986e2699f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:34.154113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-b4c1a135-893a-4711-9bf7-2a2986e2699f None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:00:34.163652 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b4c1a135-893a-4711-9bf7-2a2986e2699f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:34.303214 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1536/3103] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:00:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:00:34.322956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cac2f4-256f-4918-8da9-4244d7ac310a service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:34.324605 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-18cac2f4-256f-4918-8da9-4244d7ac310a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:34.522789 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cac2f4-256f-4918-8da9-4244d7ac310a service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:34.529405 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776aaae3-a92e-4dfa-b7f5-67574aaa46ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:34.530332 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776aaae3-a92e-4dfa-b7f5-67574aaa46ea service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:34.530850 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776aaae3-a92e-4dfa-b7f5-67574aaa46ea service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:34.531301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776aaae3-a92e-4dfa-b7f5-67574aaa46ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:34.541655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776aaae3-a92e-4dfa-b7f5-67574aaa46ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:34.544648 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776aaae3-a92e-4dfa-b7f5-67574aaa46ea service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:34.565172 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1568/3104] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:00:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:00:35.887338 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e3f03-c0a5-4d0f-923d-befcb02db8d6 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:35.888106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e3f03-c0a5-4d0f-923d-befcb02db8d6 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:35.888581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e3f03-c0a5-4d0f-923d-befcb02db8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:35.943440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-712e3f03-c0a5-4d0f-923d-befcb02db8d6 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:00:35.952074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-712e3f03-c0a5-4d0f-923d-befcb02db8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:35.976712 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1537/3105] 10.222.0.33 () {58 vars in 967 bytes} [Sat Aug 6 21:00:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:00:35.998862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776aaae3-a92e-4dfa-b7f5-67574aaa46ea service swift] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:36.019285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776aaae3-a92e-4dfa-b7f5-67574aaa46ea service swift] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:36.043419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56573fe-3ca1-45de-8505-a10c501f00f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:36.045414 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56573fe-3ca1-45de-8505-a10c501f00f0 service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:36.046034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56573fe-3ca1-45de-8505-a10c501f00f0 service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:36.046568 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56573fe-3ca1-45de-8505-a10c501f00f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:36.082065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56573fe-3ca1-45de-8505-a10c501f00f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:36.084112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56573fe-3ca1-45de-8505-a10c501f00f0 service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:36.130048 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1569/3106] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:00:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:00:39.160835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e3f03-c0a5-4d0f-923d-befcb02db8d6 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:39.178284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e3f03-c0a5-4d0f-923d-befcb02db8d6 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:39.199674 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ccf2d-1bfb-48bc-a77f-954fa8827295 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:39.203388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ccf2d-1bfb-48bc-a77f-954fa8827295 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:39.204386 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ccf2d-1bfb-48bc-a77f-954fa8827295 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:39.204850 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ccf2d-1bfb-48bc-a77f-954fa8827295 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:39.213175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-561ccf2d-1bfb-48bc-a77f-954fa8827295 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:39.375313 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2566a12-20c4-45a2-aceb-8685a4a2f431 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:39.376242 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2566a12-20c4-45a2-aceb-8685a4a2f431 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:39.376678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2566a12-20c4-45a2-aceb-8685a4a2f431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:39.397737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-e2566a12-20c4-45a2-aceb-8685a4a2f431 None None] MFA Rules not processed for user `d43d0d15118242b7a60cc34c512fbe5e`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:00:39.399279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e2566a12-20c4-45a2-aceb-8685a4a2f431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:39.429752 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:00:39.524698 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1570/3107] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:00:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:00:39.613017 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561ccf2d-1bfb-48bc-a77f-954fa8827295 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:39.618812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561ccf2d-1bfb-48bc-a77f-954fa8827295 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:39.644597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a78e9d-416f-4ec7-aaf5-9c7d62bbe67e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:39.644882 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a78e9d-416f-4ec7-aaf5-9c7d62bbe67e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:39.645154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a78e9d-416f-4ec7-aaf5-9c7d62bbe67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:39.657746 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1538/3108] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:00:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:00:39.750948 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a6a78e9d-416f-4ec7-aaf5-9c7d62bbe67e None None] MFA Rules not processed for user `b5b60c17df8e4ec3a8236bfedde32eab`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:00:39.752196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a6a78e9d-416f-4ec7-aaf5-9c7d62bbe67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:40.065630 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1571/3109] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:00:39 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:00:40.796241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ccf2d-1bfb-48bc-a77f-954fa8827295 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:40.799507 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-561ccf2d-1bfb-48bc-a77f-954fa8827295 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:40.809325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b081b0-962c-4065-beed-a807286ef52c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:40.810469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b081b0-962c-4065-beed-a807286ef52c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:40.811120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b081b0-962c-4065-beed-a807286ef52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:40.835141 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ccf2d-1bfb-48bc-a77f-954fa8827295 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:40.862170 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-58b081b0-962c-4065-beed-a807286ef52c None None] MFA Rules not processed for user `ad1a96004778407584d1805b07ad1c5f`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:00:40.864419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-58b081b0-962c-4065-beed-a807286ef52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:40.920444 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089fc85b-8ed7-45aa-ba6e-dc7062c25377 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:40.930337 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fc85b-8ed7-45aa-ba6e-dc7062c25377 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:40.930686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fc85b-8ed7-45aa-ba6e-dc7062c25377 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:40.935351 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fc85b-8ed7-45aa-ba6e-dc7062c25377 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:41.061005 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1572/3110] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:00:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:00:41.143107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089fc85b-8ed7-45aa-ba6e-dc7062c25377 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:41.148128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089fc85b-8ed7-45aa-ba6e-dc7062c25377 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:41.184059 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1539/3111] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:00:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:00:45.017215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605d971-71ae-4a05-835f-d75762698e88 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:45.018244 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605d971-71ae-4a05-835f-d75762698e88 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:45.018740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605d971-71ae-4a05-835f-d75762698e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:45.127705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d605d971-71ae-4a05-835f-d75762698e88 None None] MFA Rules not processed for user `62e7c88630854feb8e5f74c105f70825`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:00:45.136629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d605d971-71ae-4a05-835f-d75762698e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:45.390771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:00:45.421422 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1573/3112] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:00:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:00:46.477746 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089fc85b-8ed7-45aa-ba6e-dc7062c25377 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:46.480681 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-089fc85b-8ed7-45aa-ba6e-dc7062c25377 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:46.516816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089fc85b-8ed7-45aa-ba6e-dc7062c25377 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:46.531546 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf2542-7e1c-4a80-a0d0-87bc88d7d973 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:46.534251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf2542-7e1c-4a80-a0d0-87bc88d7d973 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:46.534996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf2542-7e1c-4a80-a0d0-87bc88d7d973 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:46.536075 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf2542-7e1c-4a80-a0d0-87bc88d7d973 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:46.561168 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf2542-7e1c-4a80-a0d0-87bc88d7d973 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:46.564664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf2542-7e1c-4a80-a0d0-87bc88d7d973 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:46.607708 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1540/3113] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:00:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:00:50.330594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a032c7-bb5b-4cca-bbbe-c7f07b2949c5 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:50.331404 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a032c7-bb5b-4cca-bbbe-c7f07b2949c5 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:50.331839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a032c7-bb5b-4cca-bbbe-c7f07b2949c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:50.401335 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-e5a032c7-bb5b-4cca-bbbe-c7f07b2949c5 None None] MFA Rules not processed for user `145439e0e0d549f89b17e81cbd46c580`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:00:50.419390 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e5a032c7-bb5b-4cca-bbbe-c7f07b2949c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:50.425851 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1574/3114] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:00:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:00:54.501642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7289999-35db-481f-afc9-71a7e14f01af None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:54.502112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7289999-35db-481f-afc9-71a7e14f01af None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:54.502204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7289999-35db-481f-afc9-71a7e14f01af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:54.539688 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d7289999-35db-481f-afc9-71a7e14f01af None None] MFA Rules not processed for user `62e7c88630854feb8e5f74c105f70825`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:00:54.543615 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d7289999-35db-481f-afc9-71a7e14f01af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:54.563762 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1541/3115] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:00:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:00:59.597116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a032c7-bb5b-4cca-bbbe-c7f07b2949c5 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:59.598577 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e5a032c7-bb5b-4cca-bbbe-c7f07b2949c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:59.620674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a032c7-bb5b-4cca-bbbe-c7f07b2949c5 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:59.630159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ecf23-b3f1-4b91-b289-a7eb1507f650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:59.631353 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ecf23-b3f1-4b91-b289-a7eb1507f650 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:59.631818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ecf23-b3f1-4b91-b289-a7eb1507f650 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:59.633330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ecf23-b3f1-4b91-b289-a7eb1507f650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:59.637064 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0c4ecf23-b3f1-4b91-b289-a7eb1507f650 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:59.821306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ecf23-b3f1-4b91-b289-a7eb1507f650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:59.823377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ecf23-b3f1-4b91-b289-a7eb1507f650 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:59.859851 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1575/3116] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:00:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:01:01.585760 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7289999-35db-481f-afc9-71a7e14f01af None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:01.608358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:01.624102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7289999-35db-481f-afc9-71a7e14f01af None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:01.632537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c29a5-2e2f-42f7-968d-c53e5d8934b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:01.632537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c29a5-2e2f-42f7-968d-c53e5d8934b0 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:01.632761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c29a5-2e2f-42f7-968d-c53e5d8934b0 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:01.633023 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c29a5-2e2f-42f7-968d-c53e5d8934b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:01.635983 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2c1c29a5-2e2f-42f7-968d-c53e5d8934b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:01.727489 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c29a5-2e2f-42f7-968d-c53e5d8934b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:01.729690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c29a5-2e2f-42f7-968d-c53e5d8934b0 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:01.743034 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1542/3117] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:01:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:01:05.833246 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ecf23-b3f1-4b91-b289-a7eb1507f650 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:05.834707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0c4ecf23-b3f1-4b91-b289-a7eb1507f650 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:05.939663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ecf23-b3f1-4b91-b289-a7eb1507f650 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:05.946296 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13839bd0-00e7-4dde-be8b-be5a70beb4ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:05.947105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13839bd0-00e7-4dde-be8b-be5a70beb4ab service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:05.947396 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13839bd0-00e7-4dde-be8b-be5a70beb4ab service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:05.947667 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13839bd0-00e7-4dde-be8b-be5a70beb4ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:05.952235 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-13839bd0-00e7-4dde-be8b-be5a70beb4ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:05.972457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13839bd0-00e7-4dde-be8b-be5a70beb4ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:05.975315 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13839bd0-00e7-4dde-be8b-be5a70beb4ab service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:05.989201 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1576/3118] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:01:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:01:07.071371 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aff4c6-6f4e-47e9-af16-9c31a00b6f7b None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:07.072280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aff4c6-6f4e-47e9-af16-9c31a00b6f7b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:07.072723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aff4c6-6f4e-47e9-af16-9c31a00b6f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:07.110796 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-19aff4c6-6f4e-47e9-af16-9c31a00b6f7b None None] MFA Rules not processed for user `d5754e7eed1b48f8805b6dffefb37b59`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:01:07.113117 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-19aff4c6-6f4e-47e9-af16-9c31a00b6f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:07.127585 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1543/3119] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:01:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:01:09.969394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c4f06-033c-4646-9564-56d9d078db9c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:09.969980 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c4f06-033c-4646-9564-56d9d078db9c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:09.970197 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c4f06-033c-4646-9564-56d9d078db9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:09.991588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-498c4f06-033c-4646-9564-56d9d078db9c None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:01:09.993658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-498c4f06-033c-4646-9564-56d9d078db9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:10.014499 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1577/3120] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:01:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:01:10.020485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aff4c6-6f4e-47e9-af16-9c31a00b6f7b None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:10.037351 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aff4c6-6f4e-47e9-af16-9c31a00b6f7b None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:10.043010 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ac8c7-ebf3-4329-9e97-04e51a2ee357 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:10.043636 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ac8c7-ebf3-4329-9e97-04e51a2ee357 service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:10.044486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ac8c7-ebf3-4329-9e97-04e51a2ee357 service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:10.044965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ac8c7-ebf3-4329-9e97-04e51a2ee357 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:10.055457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ac8c7-ebf3-4329-9e97-04e51a2ee357 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:10.057521 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ac8c7-ebf3-4329-9e97-04e51a2ee357 service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:10.069642 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1544/3121] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:01:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:01:13.167236 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b92c7d-2b07-41c3-be1e-2f0441b2a634 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:13.167753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b92c7d-2b07-41c3-be1e-2f0441b2a634 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:13.167753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b92c7d-2b07-41c3-be1e-2f0441b2a634 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:13.170018 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1578/3122] 10.222.0.33 () {54 vars in 921 bytes} [Sat Aug 6 21:01:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 21:01:13.181527 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc722f-c8b9-40d7-a45e-b206ba9271d4 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:13.182111 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc722f-c8b9-40d7-a45e-b206ba9271d4 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:13.182384 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc722f-c8b9-40d7-a45e-b206ba9271d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:13.228733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-2dfc722f-c8b9-40d7-a45e-b206ba9271d4 None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:01:13.230332 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2dfc722f-c8b9-40d7-a45e-b206ba9271d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:13.255465 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1545/3123] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 21:01:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:01:13.280489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b92c7d-2b07-41c3-be1e-2f0441b2a634 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:13.282316 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c9b92c7d-2b07-41c3-be1e-2f0441b2a634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:13.323512 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b92c7d-2b07-41c3-be1e-2f0441b2a634 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:13.330973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b2a24-1f47-4a30-b04f-a0cd1196ce35 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:13.332114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b2a24-1f47-4a30-b04f-a0cd1196ce35 service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:13.332608 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b2a24-1f47-4a30-b04f-a0cd1196ce35 service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:13.333284 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b2a24-1f47-4a30-b04f-a0cd1196ce35 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:13.346711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b2a24-1f47-4a30-b04f-a0cd1196ce35 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:13.349597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b2a24-1f47-4a30-b04f-a0cd1196ce35 service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:13.366178 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1579/3124] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:01:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:01:13.757890 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc722f-c8b9-40d7-a45e-b206ba9271d4 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:13.777216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc722f-c8b9-40d7-a45e-b206ba9271d4 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:13.786420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6ac4c-05fa-4ed2-b514-c15e36e35d03 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:13.787140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6ac4c-05fa-4ed2-b514-c15e36e35d03 service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:13.787653 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6ac4c-05fa-4ed2-b514-c15e36e35d03 service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:13.788065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6ac4c-05fa-4ed2-b514-c15e36e35d03 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:13.791745 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-84c6ac4c-05fa-4ed2-b514-c15e36e35d03 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:13.808278 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6ac4c-05fa-4ed2-b514-c15e36e35d03 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:13.810911 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6ac4c-05fa-4ed2-b514-c15e36e35d03 service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:13.831780 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1546/3125] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:01:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:01:14.757489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b2a24-1f47-4a30-b04f-a0cd1196ce35 service placement] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:14.771254 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b2a24-1f47-4a30-b04f-a0cd1196ce35 service placement] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:14.798929 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b234e6-c366-4a76-b1ef-fcb4a3ec12c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:14.799966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b234e6-c366-4a76-b1ef-fcb4a3ec12c2 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:14.800486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b234e6-c366-4a76-b1ef-fcb4a3ec12c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:14.801116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b234e6-c366-4a76-b1ef-fcb4a3ec12c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:14.808123 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-14b234e6-c366-4a76-b1ef-fcb4a3ec12c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:14.868908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b234e6-c366-4a76-b1ef-fcb4a3ec12c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:14.873763 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b234e6-c366-4a76-b1ef-fcb4a3ec12c2 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:14.912888 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1580/3126] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:01:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:01:14.996019 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6ac4c-05fa-4ed2-b514-c15e36e35d03 service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:15.019978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6ac4c-05fa-4ed2-b514-c15e36e35d03 service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:15.040328 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32bde26-4170-452a-b955-086ff623f4f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:15.041133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bde26-4170-452a-b955-086ff623f4f4 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:15.041912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bde26-4170-452a-b955-086ff623f4f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:15.042372 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bde26-4170-452a-b955-086ff623f4f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:15.047634 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d32bde26-4170-452a-b955-086ff623f4f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:15.097158 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32bde26-4170-452a-b955-086ff623f4f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:15.102377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32bde26-4170-452a-b955-086ff623f4f4 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:15.143465 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1547/3127] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:01:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:01:15.162163 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a0879-83e0-4bed-8a40-fe3fa103c27b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:15.162689 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a0879-83e0-4bed-8a40-fe3fa103c27b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:15.163065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a0879-83e0-4bed-8a40-fe3fa103c27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:15.226736 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-608a0879-83e0-4bed-8a40-fe3fa103c27b None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:01:15.228596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-608a0879-83e0-4bed-8a40-fe3fa103c27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:15.253171 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1581/3128] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:01:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:01:15.280263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32bde26-4170-452a-b955-086ff623f4f4 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:15.301975 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32bde26-4170-452a-b955-086ff623f4f4 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:15.333685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8495a6d3-1872-4c9c-8d85-3699190294f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:15.334793 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8495a6d3-1872-4c9c-8d85-3699190294f3 service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:15.335335 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8495a6d3-1872-4c9c-8d85-3699190294f3 service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:15.335846 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8495a6d3-1872-4c9c-8d85-3699190294f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:15.354665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8495a6d3-1872-4c9c-8d85-3699190294f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:15.358179 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8495a6d3-1872-4c9c-8d85-3699190294f3 service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:15.390229 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1548/3129] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:01:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 06 21:01:22.942510 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a0879-83e0-4bed-8a40-fe3fa103c27b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:22.944084 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-608a0879-83e0-4bed-8a40-fe3fa103c27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:22.964113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=86 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:22.984889 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a0879-83e0-4bed-8a40-fe3fa103c27b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:22.998736 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf7c36-aea7-4c9c-a119-9735cc226b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:22.999939 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf7c36-aea7-4c9c-a119-9735cc226b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:23.001654 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf7c36-aea7-4c9c-a119-9735cc226b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:23.014379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf7c36-aea7-4c9c-a119-9735cc226b3f admin admin] PATH_INFO: `/v3/users/91d180c9584c49b296a1db51fbe50694` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:23.017670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf7c36-aea7-4c9c-a119-9735cc226b3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=91d180c9584c49b296a1db51fbe50694)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:23.020531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf7c36-aea7-4c9c-a119-9735cc226b3f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:23.189776 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e9cf7c36-aea7-4c9c-a119-9735cc226b3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91d180c9584c49b296a1db51fbe50694'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:23.221805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e9cf7c36-aea7-4c9c-a119-9735cc226b3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91d180c9584c49b296a1db51fbe50694'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:23.230226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e9cf7c36-aea7-4c9c-a119-9735cc226b3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91d180c9584c49b296a1db51fbe50694'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:23.233056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e9cf7c36-aea7-4c9c-a119-9735cc226b3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91d180c9584c49b296a1db51fbe50694'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:23.259591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e9cf7c36-aea7-4c9c-a119-9735cc226b3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91d180c9584c49b296a1db51fbe50694'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:23.328175 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1582/3130] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:01:22 2022] DELETE /identity/v3/users/91d180c9584c49b296a1db51fbe50694 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:01:25.373415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=57 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:25.733271 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8495a6d3-1872-4c9c-8d85-3699190294f3 service swift] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:25.816342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8495a6d3-1872-4c9c-8d85-3699190294f3 service swift] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:25.941856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698577f7-8333-467f-aaca-558d4c122feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:25.942877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698577f7-8333-467f-aaca-558d4c122feb admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:25.942877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698577f7-8333-467f-aaca-558d4c122feb admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:25.943111 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698577f7-8333-467f-aaca-558d4c122feb admin admin] PATH_INFO: `/v3/projects/710cf2b1bc504e8090132ca97890a791` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:25.944223 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698577f7-8333-467f-aaca-558d4c122feb admin admin] RBAC: Authorizing `identity:delete_project(project_id=710cf2b1bc504e8090132ca97890a791)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:25.947215 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698577f7-8333-467f-aaca-558d4c122feb admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:26.055274 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-698577f7-8333-467f-aaca-558d4c122feb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '710cf2b1bc504e8090132ca97890a791', 'request_id': 'req-698577f7-8333-467f-aaca-558d4c122feb'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:26.077699 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-698577f7-8333-467f-aaca-558d4c122feb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '710cf2b1bc504e8090132ca97890a791', 'request_id': 'req-698577f7-8333-467f-aaca-558d4c122feb'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:26.092292 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-698577f7-8333-467f-aaca-558d4c122feb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '710cf2b1bc504e8090132ca97890a791', 'request_id': 'req-698577f7-8333-467f-aaca-558d4c122feb'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:26.116450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-698577f7-8333-467f-aaca-558d4c122feb admin admin] The token cache is being invalidate because project 710cf2b1bc504e8090132ca97890a791 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:01:26.116735 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-698577f7-8333-467f-aaca-558d4c122feb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:26.117494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-698577f7-8333-467f-aaca-558d4c122feb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:26.119028 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1549/3131] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:01:25 2022] DELETE /identity/v3/projects/710cf2b1bc504e8090132ca97890a791 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:01:26.124507 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8e21b-dd0b-4f7a-8e6c-7d2019e5342e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:26.125001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8e21b-dd0b-4f7a-8e6c-7d2019e5342e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:26.125132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8e21b-dd0b-4f7a-8e6c-7d2019e5342e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:26.220240 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-87d8e21b-dd0b-4f7a-8e6c-7d2019e5342e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:01:26.221474 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-87d8e21b-dd0b-4f7a-8e6c-7d2019e5342e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:26.319148 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1583/3132] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:01:26.327761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42877c-8291-4dde-b502-c408a7f1b1bb None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:26.328189 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42877c-8291-4dde-b502-c408a7f1b1bb None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:26.328308 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42877c-8291-4dde-b502-c408a7f1b1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:26.365712 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-aa42877c-8291-4dde-b502-c408a7f1b1bb None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:01:26.368074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-aa42877c-8291-4dde-b502-c408a7f1b1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:26.419437 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1550/3133] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:01:26.424131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8e21b-dd0b-4f7a-8e6c-7d2019e5342e None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:26.436201 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8e21b-dd0b-4f7a-8e6c-7d2019e5342e None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:26.455385 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1b1c4-bd2e-4a6f-9a95-07987b7bf4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:26.456302 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1b1c4-bd2e-4a6f-9a95-07987b7bf4ee admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:26.456737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1b1c4-bd2e-4a6f-9a95-07987b7bf4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:26.457355 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1b1c4-bd2e-4a6f-9a95-07987b7bf4ee admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:26.458192 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1b1c4-bd2e-4a6f-9a95-07987b7bf4ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:01:26.458710 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1b1c4-bd2e-4a6f-9a95-07987b7bf4ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:26.460711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1b1c4-bd2e-4a6f-9a95-07987b7bf4ee admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:26.506682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42877c-8291-4dde-b502-c408a7f1b1bb None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:26.508572 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1584/3134] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:01:26.609754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42877c-8291-4dde-b502-c408a7f1b1bb None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:26.652590 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958d458-ed81-48d0-9721-7df34c6ee60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:26.653223 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958d458-ed81-48d0-9721-7df34c6ee60a admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:26.653546 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958d458-ed81-48d0-9721-7df34c6ee60a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:26.653823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958d458-ed81-48d0-9721-7df34c6ee60a admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:26.654452 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958d458-ed81-48d0-9721-7df34c6ee60a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:26.699654 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958d458-ed81-48d0-9721-7df34c6ee60a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:26.894144 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1551/3135] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:01:26 2022] POST /identity/v3/projects => generated 381 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:01:26.895422 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1b1c4-bd2e-4a6f-9a95-07987b7bf4ee admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:26.907434 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1b1c4-bd2e-4a6f-9a95-07987b7bf4ee admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:27.016786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:27.041294 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04947c-fa11-4c95-bd60-4ba513a0a4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:27.041999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04947c-fa11-4c95-bd60-4ba513a0a4ec admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:27.042369 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04947c-fa11-4c95-bd60-4ba513a0a4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:27.042941 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04947c-fa11-4c95-bd60-4ba513a0a4ec admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:27.043630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d04947c-fa11-4c95-bd60-4ba513a0a4ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:27.047646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d04947c-fa11-4c95-bd60-4ba513a0a4ec admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:27.086114 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1585/3136] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:01:26 2022] POST /identity/v3/users => generated 291 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:01:27.089726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958d458-ed81-48d0-9721-7df34c6ee60a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:27.101056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958d458-ed81-48d0-9721-7df34c6ee60a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:27.115654 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7b517-5dc9-468a-80cd-bd5ce52633cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:27.116298 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7b517-5dc9-468a-80cd-bd5ce52633cb admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:27.116578 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7b517-5dc9-468a-80cd-bd5ce52633cb admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:27.116854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7b517-5dc9-468a-80cd-bd5ce52633cb admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:27.117510 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7b517-5dc9-468a-80cd-bd5ce52633cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:27.119290 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7b517-5dc9-468a-80cd-bd5ce52633cb admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:27.154244 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1552/3137] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:01:27.156862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04947c-fa11-4c95-bd60-4ba513a0a4ec admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:27.179219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04947c-fa11-4c95-bd60-4ba513a0a4ec admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:27.192287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70d2ef-9f5b-482e-b594-74fe4ab99217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:27.194215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70d2ef-9f5b-482e-b594-74fe4ab99217 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:27.195920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70d2ef-9f5b-482e-b594-74fe4ab99217 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:27.196376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70d2ef-9f5b-482e-b594-74fe4ab99217 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:27.199051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70d2ef-9f5b-482e-b594-74fe4ab99217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:27.205380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70d2ef-9f5b-482e-b594-74fe4ab99217 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:27.246537 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1586/3138] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:01:27.250756 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7b517-5dc9-468a-80cd-bd5ce52633cb admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:27.270649 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7b517-5dc9-468a-80cd-bd5ce52633cb admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:27.294960 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb0a36-cfd7-45fd-8352-bb32f5bcc4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:27.295820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb0a36-cfd7-45fd-8352-bb32f5bcc4d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:27.304799 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb0a36-cfd7-45fd-8352-bb32f5bcc4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:27.305139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb0a36-cfd7-45fd-8352-bb32f5bcc4d9 admin admin] PATH_INFO: `/v3/projects/5a30ae4cede34e428cc6468b7a073497/users/398134b8b4234816ae43a9230eae3c16/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:27.380074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb0a36-cfd7-45fd-8352-bb32f5bcc4d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a30ae4cede34e428cc6468b7a073497, user_id=398134b8b4234816ae43a9230eae3c16, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:27.383606 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb0a36-cfd7-45fd-8352-bb32f5bcc4d9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:27.408091 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1553/3139] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:01:27 2022] PUT /identity/v3/projects/5a30ae4cede34e428cc6468b7a073497/users/398134b8b4234816ae43a9230eae3c16/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:01:27.413277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9447e8-d238-44b2-8dcf-a267942b217a None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:27.413570 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9447e8-d238-44b2-8dcf-a267942b217a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:27.414059 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9447e8-d238-44b2-8dcf-a267942b217a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:27.459665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-8b9447e8-d238-44b2-8dcf-a267942b217a None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:01:27.463547 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8b9447e8-d238-44b2-8dcf-a267942b217a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:27.644477 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1587/3140] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:01:27.771544 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb0a36-cfd7-45fd-8352-bb32f5bcc4d9 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:27.773936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-24eb0a36-cfd7-45fd-8352-bb32f5bcc4d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:27.782112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:27.938271 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb0a36-cfd7-45fd-8352-bb32f5bcc4d9 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:27.950077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb2ce7-730d-465b-b058-151721984bd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:27.952403 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb2ce7-730d-465b-b058-151721984bd6 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:27.953443 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb2ce7-730d-465b-b058-151721984bd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:27.953973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb2ce7-730d-465b-b058-151721984bd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:27.975119 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb2ce7-730d-465b-b058-151721984bd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:27.977104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb2ce7-730d-465b-b058-151721984bd6 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:27.989789 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1554/3141] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:01:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:01:31.135218 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9447e8-d238-44b2-8dcf-a267942b217a None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:31.136665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8b9447e8-d238-44b2-8dcf-a267942b217a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:31.166123 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9447e8-d238-44b2-8dcf-a267942b217a None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:31.185112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e1f18-51f9-44e2-8e01-232b3f9aaaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:31.185779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e1f18-51f9-44e2-8e01-232b3f9aaaf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:31.186061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e1f18-51f9-44e2-8e01-232b3f9aaaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:31.186338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e1f18-51f9-44e2-8e01-232b3f9aaaf7 admin admin] PATH_INFO: `/v3/users/343f309c07e343b4b15268472d19f10c` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:31.194913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e1f18-51f9-44e2-8e01-232b3f9aaaf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=343f309c07e343b4b15268472d19f10c)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:31.196885 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e1f18-51f9-44e2-8e01-232b3f9aaaf7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:31.348331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-897e1f18-51f9-44e2-8e01-232b3f9aaaf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '343f309c07e343b4b15268472d19f10c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:31.367118 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-897e1f18-51f9-44e2-8e01-232b3f9aaaf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '343f309c07e343b4b15268472d19f10c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:31.370150 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-897e1f18-51f9-44e2-8e01-232b3f9aaaf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '343f309c07e343b4b15268472d19f10c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:31.373618 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-897e1f18-51f9-44e2-8e01-232b3f9aaaf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '343f309c07e343b4b15268472d19f10c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:31.405489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-897e1f18-51f9-44e2-8e01-232b3f9aaaf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '343f309c07e343b4b15268472d19f10c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:31.467689 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1588/3142] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:01:31 2022] DELETE /identity/v3/users/343f309c07e343b4b15268472d19f10c => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:01:32.795469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb2ce7-730d-465b-b058-151721984bd6 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:32.845633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb2ce7-730d-465b-b058-151721984bd6 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:33.122580 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b86e9-7c29-49a5-9d46-9dbf7f092442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:33.123182 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b86e9-7c29-49a5-9d46-9dbf7f092442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:33.123466 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b86e9-7c29-49a5-9d46-9dbf7f092442 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:33.123742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b86e9-7c29-49a5-9d46-9dbf7f092442 admin admin] PATH_INFO: `/v3/projects/5c99a4e2a24548ba906dd57b88cc0aba` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:33.125138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b86e9-7c29-49a5-9d46-9dbf7f092442 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c99a4e2a24548ba906dd57b88cc0aba)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:33.151929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b86e9-7c29-49a5-9d46-9dbf7f092442 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:33.333526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e71b86e9-7c29-49a5-9d46-9dbf7f092442 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c99a4e2a24548ba906dd57b88cc0aba', 'request_id': 'req-e71b86e9-7c29-49a5-9d46-9dbf7f092442'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:33.358257 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e71b86e9-7c29-49a5-9d46-9dbf7f092442 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c99a4e2a24548ba906dd57b88cc0aba', 'request_id': 'req-e71b86e9-7c29-49a5-9d46-9dbf7f092442'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:33.383923 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e71b86e9-7c29-49a5-9d46-9dbf7f092442 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c99a4e2a24548ba906dd57b88cc0aba', 'request_id': 'req-e71b86e9-7c29-49a5-9d46-9dbf7f092442'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:33.413448 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e71b86e9-7c29-49a5-9d46-9dbf7f092442 admin admin] The token cache is being invalidate because project 5c99a4e2a24548ba906dd57b88cc0aba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:01:33.413753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e71b86e9-7c29-49a5-9d46-9dbf7f092442 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:33.415115 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e71b86e9-7c29-49a5-9d46-9dbf7f092442 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:33.424378 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1555/3143] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:01:32 2022] DELETE /identity/v3/projects/5c99a4e2a24548ba906dd57b88cc0aba => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:01:33.425932 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e1f18-51f9-44e2-8e01-232b3f9aaaf7 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:33.427374 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-897e1f18-51f9-44e2-8e01-232b3f9aaaf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:33.442743 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e1f18-51f9-44e2-8e01-232b3f9aaaf7 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:33.488761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:33.543360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f80519-ea28-40fe-ae92-f1dcc1b026bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:33.544841 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f80519-ea28-40fe-ae92-f1dcc1b026bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:33.545850 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f80519-ea28-40fe-ae92-f1dcc1b026bd admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:33.546339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f80519-ea28-40fe-ae92-f1dcc1b026bd admin admin] PATH_INFO: `/v3/users/d5df8df0714242c68a5a51614d23a144` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:33.548230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f80519-ea28-40fe-ae92-f1dcc1b026bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5df8df0714242c68a5a51614d23a144)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:33.551067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f80519-ea28-40fe-ae92-f1dcc1b026bd admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:33.634361 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d1f80519-ea28-40fe-ae92-f1dcc1b026bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5df8df0714242c68a5a51614d23a144'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:33.643870 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d1f80519-ea28-40fe-ae92-f1dcc1b026bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5df8df0714242c68a5a51614d23a144'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:33.645589 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d1f80519-ea28-40fe-ae92-f1dcc1b026bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5df8df0714242c68a5a51614d23a144'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:33.646467 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d1f80519-ea28-40fe-ae92-f1dcc1b026bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5df8df0714242c68a5a51614d23a144'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:33.660309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d1f80519-ea28-40fe-ae92-f1dcc1b026bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5df8df0714242c68a5a51614d23a144'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:33.696514 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1589/3144] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:01:33 2022] DELETE /identity/v3/users/d5df8df0714242c68a5a51614d23a144 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:01:34.246896 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b86e9-7c29-49a5-9d46-9dbf7f092442 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:34.248422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e71b86e9-7c29-49a5-9d46-9dbf7f092442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:34.292500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:34.470236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b86e9-7c29-49a5-9d46-9dbf7f092442 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:34.608603 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d22625-a885-49fe-a873-e79af1e44869 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:34.609236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d22625-a885-49fe-a873-e79af1e44869 service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:34.609518 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d22625-a885-49fe-a873-e79af1e44869 service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:34.609799 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d22625-a885-49fe-a873-e79af1e44869 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:34.618821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b3d22625-a885-49fe-a873-e79af1e44869 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:34.638933 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d22625-a885-49fe-a873-e79af1e44869 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:34.640622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d22625-a885-49fe-a873-e79af1e44869 service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:34.662331 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1556/3145] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:01:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:01:34.726122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f7b79-f696-4e30-9fb0-75a49c758ee2 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:34.726658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f7b79-f696-4e30-9fb0-75a49c758ee2 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:34.726934 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f7b79-f696-4e30-9fb0-75a49c758ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:34.769214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-741f7b79-f696-4e30-9fb0-75a49c758ee2 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:01:34.770901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-741f7b79-f696-4e30-9fb0-75a49c758ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:34.844206 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1590/3146] 10.222.0.33 () {58 vars in 967 bytes} [Sat Aug 6 21:01:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:01:34.862666 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d22625-a885-49fe-a873-e79af1e44869 service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:34.864282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b3d22625-a885-49fe-a873-e79af1e44869 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:34.986025 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d22625-a885-49fe-a873-e79af1e44869 service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:34.991666 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72f0bd-8155-4da7-999e-3e82e42e8cc0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:34.992570 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72f0bd-8155-4da7-999e-3e82e42e8cc0 service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:34.993096 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72f0bd-8155-4da7-999e-3e82e42e8cc0 service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:34.993604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72f0bd-8155-4da7-999e-3e82e42e8cc0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:35.005833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72f0bd-8155-4da7-999e-3e82e42e8cc0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:35.007852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72f0bd-8155-4da7-999e-3e82e42e8cc0 service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:35.019014 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1557/3147] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:01:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:01:35.135142 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f7b79-f696-4e30-9fb0-75a49c758ee2 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:35.137436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-741f7b79-f696-4e30-9fb0-75a49c758ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:35.329563 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:35.353726 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f7b79-f696-4e30-9fb0-75a49c758ee2 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:35.361796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a983c-04e6-4021-a64a-556856efb388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:35.363348 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a983c-04e6-4021-a64a-556856efb388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:35.363983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a983c-04e6-4021-a64a-556856efb388 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:35.364485 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a983c-04e6-4021-a64a-556856efb388 admin admin] PATH_INFO: `/v3/projects/f61462ba75654df88028a92e324cf071` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:35.365903 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a983c-04e6-4021-a64a-556856efb388 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f61462ba75654df88028a92e324cf071)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:35.368128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a983c-04e6-4021-a64a-556856efb388 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:35.485768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b38a983c-04e6-4021-a64a-556856efb388 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f61462ba75654df88028a92e324cf071', 'request_id': 'req-b38a983c-04e6-4021-a64a-556856efb388'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:35.500045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b38a983c-04e6-4021-a64a-556856efb388 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f61462ba75654df88028a92e324cf071', 'request_id': 'req-b38a983c-04e6-4021-a64a-556856efb388'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:35.518201 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b38a983c-04e6-4021-a64a-556856efb388 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f61462ba75654df88028a92e324cf071', 'request_id': 'req-b38a983c-04e6-4021-a64a-556856efb388'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:35.551357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b38a983c-04e6-4021-a64a-556856efb388 admin admin] The token cache is being invalidate because project f61462ba75654df88028a92e324cf071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:01:35.554860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b38a983c-04e6-4021-a64a-556856efb388 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:35.556638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b38a983c-04e6-4021-a64a-556856efb388 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:35.561781 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1591/3148] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:01:35 2022] DELETE /identity/v3/projects/f61462ba75654df88028a92e324cf071 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:01:35.566984 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0475ee-1d71-4f6f-a4cd-c358308b0305 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:35.568677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0475ee-1d71-4f6f-a4cd-c358308b0305 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:35.569789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0475ee-1d71-4f6f-a4cd-c358308b0305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:35.649795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-af0475ee-1d71-4f6f-a4cd-c358308b0305 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:01:35.653620 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-af0475ee-1d71-4f6f-a4cd-c358308b0305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:35.703823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:35.744035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a983c-04e6-4021-a64a-556856efb388 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:35.745545 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b38a983c-04e6-4021-a64a-556856efb388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:35.777584 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1558/3149] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:01:35.787102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46758cc3-0b3c-4dc1-aea8-7082d386c3c7 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:35.787653 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46758cc3-0b3c-4dc1-aea8-7082d386c3c7 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:35.788291 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46758cc3-0b3c-4dc1-aea8-7082d386c3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:35.822098 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-46758cc3-0b3c-4dc1-aea8-7082d386c3c7 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:01:35.825174 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-46758cc3-0b3c-4dc1-aea8-7082d386c3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:35.844301 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1559/3150] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:01:35.849748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46758cc3-0b3c-4dc1-aea8-7082d386c3c7 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:35.870144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46758cc3-0b3c-4dc1-aea8-7082d386c3c7 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:35.885147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54a716-096c-4b8a-8137-0f9a0b10b6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:35.886361 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54a716-096c-4b8a-8137-0f9a0b10b6ab admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:35.886851 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54a716-096c-4b8a-8137-0f9a0b10b6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:35.887349 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54a716-096c-4b8a-8137-0f9a0b10b6ab admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:35.889003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df54a716-096c-4b8a-8137-0f9a0b10b6ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:01:35.891199 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df54a716-096c-4b8a-8137-0f9a0b10b6ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:35.899959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df54a716-096c-4b8a-8137-0f9a0b10b6ab admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:35.907014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a983c-04e6-4021-a64a-556856efb388 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:35.935774 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1560/3151] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:01:35.937266 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54a716-096c-4b8a-8137-0f9a0b10b6ab admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:35.944455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21ec12-db7c-4665-8dda-aeab7aa32f91 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:35.945074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21ec12-db7c-4665-8dda-aeab7aa32f91 service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:35.946130 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21ec12-db7c-4665-8dda-aeab7aa32f91 service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:35.946416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21ec12-db7c-4665-8dda-aeab7aa32f91 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:35.950723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54a716-096c-4b8a-8137-0f9a0b10b6ab admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:35.960188 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7b21ec12-db7c-4665-8dda-aeab7aa32f91 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:35.967495 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab7365-9722-4ce1-89b1-b98095c62536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:35.968389 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab7365-9722-4ce1-89b1-b98095c62536 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:35.968834 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab7365-9722-4ce1-89b1-b98095c62536 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:35.969338 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab7365-9722-4ce1-89b1-b98095c62536 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:35.970636 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab7365-9722-4ce1-89b1-b98095c62536 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:35.974023 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab7365-9722-4ce1-89b1-b98095c62536 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:35.983299 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21ec12-db7c-4665-8dda-aeab7aa32f91 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:35.985480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21ec12-db7c-4665-8dda-aeab7aa32f91 service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:36.005725 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1592/3152] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:01:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:01:36.012244 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0a147-8ecb-4742-b6f3-838d4a2fb401 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:36.012903 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0a147-8ecb-4742-b6f3-838d4a2fb401 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:36.013399 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0a147-8ecb-4742-b6f3-838d4a2fb401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:36.019105 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1561/3153] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:01:35 2022] POST /identity/v3/projects => generated 375 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:01:36.023774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab7365-9722-4ce1-89b1-b98095c62536 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:36.056672 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-19f0a147-8ecb-4742-b6f3-838d4a2fb401 None None] MFA Rules not processed for user `d43d0d15118242b7a60cc34c512fbe5e`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:01:36.058140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-19f0a147-8ecb-4742-b6f3-838d4a2fb401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:36.126768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab7365-9722-4ce1-89b1-b98095c62536 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:36.136465 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830a8a5-ef92-4da9-88ae-b2063bba6c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:36.137347 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830a8a5-ef92-4da9-88ae-b2063bba6c20 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:36.137629 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830a8a5-ef92-4da9-88ae-b2063bba6c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:36.138186 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830a8a5-ef92-4da9-88ae-b2063bba6c20 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:36.139352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830a8a5-ef92-4da9-88ae-b2063bba6c20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:36.142805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830a8a5-ef92-4da9-88ae-b2063bba6c20 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:36.195178 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1593/3154] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:01:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:01:36.217403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0a147-8ecb-4742-b6f3-838d4a2fb401 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:36.217661 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1562/3155] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:01:36 2022] POST /identity/v3/users => generated 288 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:01:36.235878 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0a147-8ecb-4742-b6f3-838d4a2fb401 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:36.241892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f70608-61df-48a7-a350-ea8bab5c55c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:36.242570 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f70608-61df-48a7-a350-ea8bab5c55c9 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:36.242972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f70608-61df-48a7-a350-ea8bab5c55c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:36.243324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f70608-61df-48a7-a350-ea8bab5c55c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:36.243975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f70608-61df-48a7-a350-ea8bab5c55c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:36.245633 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f70608-61df-48a7-a350-ea8bab5c55c9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:36.258590 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1594/3156] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:01:36.264404 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830a8a5-ef92-4da9-88ae-b2063bba6c20 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:36.292527 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830a8a5-ef92-4da9-88ae-b2063bba6c20 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:36.306065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af54ab3-e7ae-431b-ba09-f6d739deb9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:36.307658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af54ab3-e7ae-431b-ba09-f6d739deb9a3 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:36.307658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af54ab3-e7ae-431b-ba09-f6d739deb9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:36.307658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af54ab3-e7ae-431b-ba09-f6d739deb9a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:36.308220 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af54ab3-e7ae-431b-ba09-f6d739deb9a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:36.310215 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af54ab3-e7ae-431b-ba09-f6d739deb9a3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:36.321763 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1563/3157] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:01:36.326114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f70608-61df-48a7-a350-ea8bab5c55c9 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:36.333136 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:36.337268 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f70608-61df-48a7-a350-ea8bab5c55c9 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:36.344635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9918cf6-446b-49b6-9891-24af5bfda84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:36.345600 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9918cf6-446b-49b6-9891-24af5bfda84c admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:36.346051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9918cf6-446b-49b6-9891-24af5bfda84c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:36.346950 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9918cf6-446b-49b6-9891-24af5bfda84c admin admin] PATH_INFO: `/v3/projects/016941d261d94a44b95b4c85b31bf1c9/users/4e0d873fee86474e89174bc07152736e/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:36.367104 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9918cf6-446b-49b6-9891-24af5bfda84c admin admin] RBAC: Authorizing `identity:create_grant(project_id=016941d261d94a44b95b4c85b31bf1c9, user_id=4e0d873fee86474e89174bc07152736e, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:36.370795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9918cf6-446b-49b6-9891-24af5bfda84c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:36.404486 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1595/3158] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:01:36 2022] PUT /identity/v3/projects/016941d261d94a44b95b4c85b31bf1c9/users/4e0d873fee86474e89174bc07152736e/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:01:36.462821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1dc24-fb53-4efc-af1d-d9b0bf694540 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:36.463561 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1dc24-fb53-4efc-af1d-d9b0bf694540 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:36.465039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1dc24-fb53-4efc-af1d-d9b0bf694540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:36.503074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-8df1dc24-fb53-4efc-af1d-d9b0bf694540 None None] MFA Rules not processed for user `4e0d873fee86474e89174bc07152736e`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:01:36.505171 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8df1dc24-fb53-4efc-af1d-d9b0bf694540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:36.578439 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:36.608884 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1564/3159] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:01:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:01:36.614825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9918cf6-446b-49b6-9891-24af5bfda84c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:36.733780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9918cf6-446b-49b6-9891-24af5bfda84c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:36.738847 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae8372-fa14-4ae5-8b83-5dd993f576f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:36.739501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae8372-fa14-4ae5-8b83-5dd993f576f9 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:36.739777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae8372-fa14-4ae5-8b83-5dd993f576f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:36.740048 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae8372-fa14-4ae5-8b83-5dd993f576f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:36.740672 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae8372-fa14-4ae5-8b83-5dd993f576f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:36.742720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae8372-fa14-4ae5-8b83-5dd993f576f9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:36.779774 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1596/3160] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:01:36 2022] POST /identity/v3/projects => generated 375 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:01:36.784013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1dc24-fb53-4efc-af1d-d9b0bf694540 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:36.796931 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1dc24-fb53-4efc-af1d-d9b0bf694540 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:36.871309 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966e5d2-23a8-4290-b543-31c47b0d4370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:36.871845 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966e5d2-23a8-4290-b543-31c47b0d4370 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:36.872152 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966e5d2-23a8-4290-b543-31c47b0d4370 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:36.872506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966e5d2-23a8-4290-b543-31c47b0d4370 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:36.873033 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966e5d2-23a8-4290-b543-31c47b0d4370 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:36.875048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966e5d2-23a8-4290-b543-31c47b0d4370 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:36.903914 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1565/3161] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:01:36 2022] POST /identity/v3/users => generated 294 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:01:36.905438 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae8372-fa14-4ae5-8b83-5dd993f576f9 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:36.917113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae8372-fa14-4ae5-8b83-5dd993f576f9 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:36.923088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8fbee-fcc1-41f5-aa4e-a55f93cbd7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:36.925294 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8fbee-fcc1-41f5-aa4e-a55f93cbd7d1 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:36.925654 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8fbee-fcc1-41f5-aa4e-a55f93cbd7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:36.925991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8fbee-fcc1-41f5-aa4e-a55f93cbd7d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:36.926929 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae8fbee-fcc1-41f5-aa4e-a55f93cbd7d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:36.929357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae8fbee-fcc1-41f5-aa4e-a55f93cbd7d1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:36.943019 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1597/3162] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:01:36.946906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966e5d2-23a8-4290-b543-31c47b0d4370 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:36.961863 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966e5d2-23a8-4290-b543-31c47b0d4370 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:36.970373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497328fa-17da-4780-905c-0b6f3072d02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:36.971214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497328fa-17da-4780-905c-0b6f3072d02b admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:36.971586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497328fa-17da-4780-905c-0b6f3072d02b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:36.972176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497328fa-17da-4780-905c-0b6f3072d02b admin admin] PATH_INFO: `/v3/projects/e06e4053f3b64c7bada9654c1627f4ec/users/f6775e8099c044c4a37184bcf3943e73/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:36.996457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497328fa-17da-4780-905c-0b6f3072d02b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e06e4053f3b64c7bada9654c1627f4ec, user_id=f6775e8099c044c4a37184bcf3943e73, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:37.000256 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497328fa-17da-4780-905c-0b6f3072d02b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:37.019382 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1566/3163] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:01:36 2022] PUT /identity/v3/projects/e06e4053f3b64c7bada9654c1627f4ec/users/f6775e8099c044c4a37184bcf3943e73/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:01:37.023288 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8fbee-fcc1-41f5-aa4e-a55f93cbd7d1 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:37.040283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8fbee-fcc1-41f5-aa4e-a55f93cbd7d1 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:37.124255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ea153-1efc-4f32-a445-63e18ed86f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:37.124424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ea153-1efc-4f32-a445-63e18ed86f59 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:37.124642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ea153-1efc-4f32-a445-63e18ed86f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:37.124926 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ea153-1efc-4f32-a445-63e18ed86f59 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:37.125692 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ea153-1efc-4f32-a445-63e18ed86f59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:37.127233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ea153-1efc-4f32-a445-63e18ed86f59 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:37.139570 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1598/3164] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:01:37.143677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497328fa-17da-4780-905c-0b6f3072d02b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:37.155735 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497328fa-17da-4780-905c-0b6f3072d02b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:37.162801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c62b3-6223-47cb-8e1e-dc0a6226ac70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:37.163474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c62b3-6223-47cb-8e1e-dc0a6226ac70 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:37.163745 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c62b3-6223-47cb-8e1e-dc0a6226ac70 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:37.164018 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c62b3-6223-47cb-8e1e-dc0a6226ac70 admin admin] PATH_INFO: `/v3/projects/e06e4053f3b64c7bada9654c1627f4ec/users/f6775e8099c044c4a37184bcf3943e73/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:37.165972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c62b3-6223-47cb-8e1e-dc0a6226ac70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e06e4053f3b64c7bada9654c1627f4ec, user_id=f6775e8099c044c4a37184bcf3943e73, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:37.169072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c62b3-6223-47cb-8e1e-dc0a6226ac70 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:37.196441 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1567/3165] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:01:37 2022] PUT /identity/v3/projects/e06e4053f3b64c7bada9654c1627f4ec/users/f6775e8099c044c4a37184bcf3943e73/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:01:37.201339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4794929-6a28-4c6f-b953-66c886478f01 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:37.201905 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4794929-6a28-4c6f-b953-66c886478f01 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:37.202350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4794929-6a28-4c6f-b953-66c886478f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:37.248553 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-e4794929-6a28-4c6f-b953-66c886478f01 None None] MFA Rules not processed for user `f6775e8099c044c4a37184bcf3943e73`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:01:37.250116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e4794929-6a28-4c6f-b953-66c886478f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:37.302690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:37.366817 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1599/3166] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:01:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:01:37.368042 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c62b3-6223-47cb-8e1e-dc0a6226ac70 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:37.384937 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c62b3-6223-47cb-8e1e-dc0a6226ac70 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:37.392320 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bd363-fc94-46e8-b162-3583615f0591 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6775e8099c044c4a37184bcf3943e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e06e4053f3b64c7bada9654c1627f4ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:37.393924 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bd363-fc94-46e8-b162-3583615f0591 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:37.394210 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bd363-fc94-46e8-b162-3583615f0591 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:37.394923 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bd363-fc94-46e8-b162-3583615f0591 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:37.395576 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bd363-fc94-46e8-b162-3583615f0591 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:01:37.395703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bd363-fc94-46e8-b162-3583615f0591 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:37.397501 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bd363-fc94-46e8-b162-3583615f0591 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:37.424001 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1568/3167] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:01:37.425617 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4794929-6a28-4c6f-b953-66c886478f01 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:37.441451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4794929-6a28-4c6f-b953-66c886478f01 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:37.449592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0504ef-0918-48af-bd59-8ab840e7f6a4 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6775e8099c044c4a37184bcf3943e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e06e4053f3b64c7bada9654c1627f4ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:37.452477 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0504ef-0918-48af-bd59-8ab840e7f6a4 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:37.453041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0504ef-0918-48af-bd59-8ab840e7f6a4 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:37.453415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0504ef-0918-48af-bd59-8ab840e7f6a4 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:37.454665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0504ef-0918-48af-bd59-8ab840e7f6a4 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:37.457556 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0504ef-0918-48af-bd59-8ab840e7f6a4 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:37.568763 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bd363-fc94-46e8-b162-3583615f0591 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:37.568964 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1600/3168] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:01:37 2022] POST /identity/v3/projects => generated 369 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:01:37.585827 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bd363-fc94-46e8-b162-3583615f0591 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:37.709561 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a24aa0-88d6-4566-8ada-6d0ea853a6b6 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6775e8099c044c4a37184bcf3943e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e06e4053f3b64c7bada9654c1627f4ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:37.713685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a24aa0-88d6-4566-8ada-6d0ea853a6b6 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:37.714494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a24aa0-88d6-4566-8ada-6d0ea853a6b6 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:37.715021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a24aa0-88d6-4566-8ada-6d0ea853a6b6 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:37.716062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a24aa0-88d6-4566-8ada-6d0ea853a6b6 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:01:37.716641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a24aa0-88d6-4566-8ada-6d0ea853a6b6 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:37.720419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a24aa0-88d6-4566-8ada-6d0ea853a6b6 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:37.741031 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1569/3169] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:01:37.812709 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0504ef-0918-48af-bd59-8ab840e7f6a4 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:37.815444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3f0504ef-0918-48af-bd59-8ab840e7f6a4 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:38.047373 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0504ef-0918-48af-bd59-8ab840e7f6a4 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:38.069377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdda3a-eb63-438e-9501-ba8995bb3c42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:38.072242 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdda3a-eb63-438e-9501-ba8995bb3c42 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:38.074061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdda3a-eb63-438e-9501-ba8995bb3c42 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:38.079048 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdda3a-eb63-438e-9501-ba8995bb3c42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:38.115451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debdda3a-eb63-438e-9501-ba8995bb3c42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:38.121009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debdda3a-eb63-438e-9501-ba8995bb3c42 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:38.152689 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1601/3170] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:01:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:01:38.181663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d09b7-a7fa-4900-b386-465dad6c32c7 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:38.182319 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d09b7-a7fa-4900-b386-465dad6c32c7 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:38.182819 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d09b7-a7fa-4900-b386-465dad6c32c7 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:38.184466 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1570/3171] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 21:01:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 21:01:38.194807 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdda3a-eb63-438e-9501-ba8995bb3c42 service nova] Authenticating service token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 21:01:38.229144 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdda3a-eb63-438e-9501-ba8995bb3c42 service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:38.257430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdda3a-eb63-438e-9501-ba8995bb3c42 service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:38.273064 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f189941-9cc7-4d1d-be76-27ce5537fc27 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6775e8099c044c4a37184bcf3943e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e06e4053f3b64c7bada9654c1627f4ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:38.275627 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f189941-9cc7-4d1d-be76-27ce5537fc27 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:38.276632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f189941-9cc7-4d1d-be76-27ce5537fc27 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:38.277630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f189941-9cc7-4d1d-be76-27ce5537fc27 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] PATH_INFO: `/v3/projects/914267b631964bb69eb459d6e58ed982` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:38.282379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f189941-9cc7-4d1d-be76-27ce5537fc27 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: Authorizing `identity:get_project(project_id=914267b631964bb69eb459d6e58ed982)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:38.286847 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f189941-9cc7-4d1d-be76-27ce5537fc27 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:38.293295 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1602/3172] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 21:01:38 2022] GET /identity/v3/projects/914267b631964bb69eb459d6e58ed982 => generated 369 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:01:38.715729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbe72d-1a0c-4c5f-a8ee-31697b6b6a11 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:38.716360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbe72d-1a0c-4c5f-a8ee-31697b6b6a11 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:38.716560 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbe72d-1a0c-4c5f-a8ee-31697b6b6a11 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:38.718098 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1571/3173] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 21:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 21:01:38.746146 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f189941-9cc7-4d1d-be76-27ce5537fc27 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Authenticating service token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 21:01:38.771301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f189941-9cc7-4d1d-be76-27ce5537fc27 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:38.802352 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f189941-9cc7-4d1d-be76-27ce5537fc27 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:38.813217 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67292a-59c7-4f6e-b7c7-50dcdf088342 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6775e8099c044c4a37184bcf3943e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e06e4053f3b64c7bada9654c1627f4ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:38.814808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67292a-59c7-4f6e-b7c7-50dcdf088342 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:38.814808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67292a-59c7-4f6e-b7c7-50dcdf088342 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:38.814808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67292a-59c7-4f6e-b7c7-50dcdf088342 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] PATH_INFO: `/v3/projects/914267b631964bb69eb459d6e58ed982` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:38.817242 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67292a-59c7-4f6e-b7c7-50dcdf088342 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: Authorizing `identity:get_project(project_id=914267b631964bb69eb459d6e58ed982)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:38.819352 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67292a-59c7-4f6e-b7c7-50dcdf088342 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:38.839612 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1603/3174] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 21:01:38 2022] GET /identity/v3/projects/914267b631964bb69eb459d6e58ed982 => generated 369 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:01:38.913256 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dbe72d-1a0c-4c5f-a8ee-31697b6b6a11 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:38.947554 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dbe72d-1a0c-4c5f-a8ee-31697b6b6a11 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:38.963381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0bde6-8807-46a0-a136-c1712d17eee9 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6775e8099c044c4a37184bcf3943e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e06e4053f3b64c7bada9654c1627f4ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:38.964496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0bde6-8807-46a0-a136-c1712d17eee9 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:38.964789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0bde6-8807-46a0-a136-c1712d17eee9 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:38.965073 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0bde6-8807-46a0-a136-c1712d17eee9 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:38.965741 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c0bde6-8807-46a0-a136-c1712d17eee9 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:01:38.971315 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c0bde6-8807-46a0-a136-c1712d17eee9 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:38.973118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c0bde6-8807-46a0-a136-c1712d17eee9 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:39.036003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67292a-59c7-4f6e-b7c7-50dcdf088342 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:39.036689 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1572/3175] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:01:39.049256 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67292a-59c7-4f6e-b7c7-50dcdf088342 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:39.061345 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c18b8-4db9-4639-bbf7-ced86d415529 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6775e8099c044c4a37184bcf3943e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e06e4053f3b64c7bada9654c1627f4ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:39.061810 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c18b8-4db9-4639-bbf7-ced86d415529 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:39.062417 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c18b8-4db9-4639-bbf7-ced86d415529 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:39.062979 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c18b8-4db9-4639-bbf7-ced86d415529 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:39.063788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c18b8-4db9-4639-bbf7-ced86d415529 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:39.067755 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c18b8-4db9-4639-bbf7-ced86d415529 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:39.121128 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1604/3176] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:01:39 2022] POST /identity/v3/users => generated 383 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:01:39.125797 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0bde6-8807-46a0-a136-c1712d17eee9 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:39.139870 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0bde6-8807-46a0-a136-c1712d17eee9 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:39.151558 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e3ee0-d958-425e-90eb-963d8c00b292 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6775e8099c044c4a37184bcf3943e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e06e4053f3b64c7bada9654c1627f4ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:39.152643 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e3ee0-d958-425e-90eb-963d8c00b292 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:39.153264 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e3ee0-d958-425e-90eb-963d8c00b292 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:39.154324 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e3ee0-d958-425e-90eb-963d8c00b292 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:39.155233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e3ee0-d958-425e-90eb-963d8c00b292 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:01:39.159497 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e3ee0-d958-425e-90eb-963d8c00b292 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:39.161566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e3ee0-d958-425e-90eb-963d8c00b292 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:39.167568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:39.186898 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1573/3177] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:01:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:01:39.260509 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a11a6d-cc0b-4197-b2e7-0d761b019ce9 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:39.261064 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a11a6d-cc0b-4197-b2e7-0d761b019ce9 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:39.261541 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a11a6d-cc0b-4197-b2e7-0d761b019ce9 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:39.264389 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1605/3178] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 21:01:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 21:01:39.274884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e3ee0-d958-425e-90eb-963d8c00b292 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Authenticating service token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 21:01:39.276868 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-eb9e3ee0-d958-425e-90eb-963d8c00b292 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:39.298451 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e3ee0-d958-425e-90eb-963d8c00b292 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:39.322787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e3ee0-d958-425e-90eb-963d8c00b292 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:39.329355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd014d6-b8be-4112-ac16-767091f6205e tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6775e8099c044c4a37184bcf3943e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e06e4053f3b64c7bada9654c1627f4ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:39.331004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd014d6-b8be-4112-ac16-767091f6205e tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:39.331568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd014d6-b8be-4112-ac16-767091f6205e tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:39.332075 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd014d6-b8be-4112-ac16-767091f6205e tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] PATH_INFO: `/v3/projects/914267b631964bb69eb459d6e58ed982` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:39.335658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd014d6-b8be-4112-ac16-767091f6205e tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: Authorizing `identity:get_project(project_id=914267b631964bb69eb459d6e58ed982)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:39.342209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd014d6-b8be-4112-ac16-767091f6205e tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:39.346662 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1574/3179] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 21:01:39 2022] GET /identity/v3/projects/914267b631964bb69eb459d6e58ed982 => generated 369 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:01:39.595438 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e650f-1109-4b79-80ba-540a22655bea None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:39.595698 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e650f-1109-4b79-80ba-540a22655bea None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:39.596081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e650f-1109-4b79-80ba-540a22655bea None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:39.597857 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1606/3180] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 21:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 21:01:39.604462 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd014d6-b8be-4112-ac16-767091f6205e tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Authenticating service token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 21:01:39.626015 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd014d6-b8be-4112-ac16-767091f6205e tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:39.640459 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd014d6-b8be-4112-ac16-767091f6205e tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:39.646996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95340c8-076f-42fc-aeec-e31b31de2664 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6775e8099c044c4a37184bcf3943e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e06e4053f3b64c7bada9654c1627f4ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:39.648394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95340c8-076f-42fc-aeec-e31b31de2664 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:39.652477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95340c8-076f-42fc-aeec-e31b31de2664 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:39.660976 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95340c8-076f-42fc-aeec-e31b31de2664 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] PATH_INFO: `/v3/projects/914267b631964bb69eb459d6e58ed982` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:39.698306 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95340c8-076f-42fc-aeec-e31b31de2664 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: Authorizing `identity:get_project(project_id=914267b631964bb69eb459d6e58ed982)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:39.707415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95340c8-076f-42fc-aeec-e31b31de2664 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:39.713407 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1575/3181] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 21:01:39 2022] GET /identity/v3/projects/914267b631964bb69eb459d6e58ed982 => generated 369 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:01:39.762214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e650f-1109-4b79-80ba-540a22655bea None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:39.777745 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e650f-1109-4b79-80ba-540a22655bea None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:39.789415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3a22f-069b-4b27-9802-d4e8505a84e9 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6775e8099c044c4a37184bcf3943e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e06e4053f3b64c7bada9654c1627f4ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:39.790062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3a22f-069b-4b27-9802-d4e8505a84e9 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:39.790345 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3a22f-069b-4b27-9802-d4e8505a84e9 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:39.790667 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3a22f-069b-4b27-9802-d4e8505a84e9 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] PATH_INFO: `/v3/users/1b4ad0ba40394a55b3f0ae198bace645` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:39.826502 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3a22f-069b-4b27-9802-d4e8505a84e9 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1b4ad0ba40394a55b3f0ae198bace645)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:39.829892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3a22f-069b-4b27-9802-d4e8505a84e9 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:39.939887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-efb3a22f-069b-4b27-9802-d4e8505a84e9 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b4ad0ba40394a55b3f0ae198bace645'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:39.945092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:39.975897 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-efb3a22f-069b-4b27-9802-d4e8505a84e9 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b4ad0ba40394a55b3f0ae198bace645'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:39.977262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-efb3a22f-069b-4b27-9802-d4e8505a84e9 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b4ad0ba40394a55b3f0ae198bace645'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:39.978710 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-efb3a22f-069b-4b27-9802-d4e8505a84e9 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b4ad0ba40394a55b3f0ae198bace645'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:40.003521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-efb3a22f-069b-4b27-9802-d4e8505a84e9 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b4ad0ba40394a55b3f0ae198bace645'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:40.057610 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1607/3182] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:01:39 2022] DELETE /identity/v3/users/1b4ad0ba40394a55b3f0ae198bace645 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:01:40.063016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95340c8-076f-42fc-aeec-e31b31de2664 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:40.070232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c95340c8-076f-42fc-aeec-e31b31de2664 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:40.105050 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95340c8-076f-42fc-aeec-e31b31de2664 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:40.253592 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae7ff6-349e-4112-91c1-c5d98ac197d4 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6775e8099c044c4a37184bcf3943e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e06e4053f3b64c7bada9654c1627f4ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:40.256482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae7ff6-349e-4112-91c1-c5d98ac197d4 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:40.257007 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae7ff6-349e-4112-91c1-c5d98ac197d4 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:40.263204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae7ff6-349e-4112-91c1-c5d98ac197d4 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] PATH_INFO: `/v3/projects/914267b631964bb69eb459d6e58ed982` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:40.265118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae7ff6-349e-4112-91c1-c5d98ac197d4 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: Authorizing `identity:delete_project(project_id=914267b631964bb69eb459d6e58ed982)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:40.277674 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae7ff6-349e-4112-91c1-c5d98ac197d4 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:40.373871 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-32ae7ff6-349e-4112-91c1-c5d98ac197d4 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '914267b631964bb69eb459d6e58ed982', 'request_id': 'req-32ae7ff6-349e-4112-91c1-c5d98ac197d4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:40.384032 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-32ae7ff6-349e-4112-91c1-c5d98ac197d4 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '914267b631964bb69eb459d6e58ed982', 'request_id': 'req-32ae7ff6-349e-4112-91c1-c5d98ac197d4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:40.401493 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-32ae7ff6-349e-4112-91c1-c5d98ac197d4 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '914267b631964bb69eb459d6e58ed982', 'request_id': 'req-32ae7ff6-349e-4112-91c1-c5d98ac197d4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:40.428137 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-32ae7ff6-349e-4112-91c1-c5d98ac197d4 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] The token cache is being invalidate because project 914267b631964bb69eb459d6e58ed982 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:01:40.428574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-32ae7ff6-349e-4112-91c1-c5d98ac197d4 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:40.430087 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-32ae7ff6-349e-4112-91c1-c5d98ac197d4 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:40.432062 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1576/3183] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:01:40 2022] DELETE /identity/v3/projects/914267b631964bb69eb459d6e58ed982 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:01:40.439935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3a22f-069b-4b27-9802-d4e8505a84e9 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:40.441626 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-efb3a22f-069b-4b27-9802-d4e8505a84e9 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:40.615388 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3a22f-069b-4b27-9802-d4e8505a84e9 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:40.727492 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3e498-0736-4321-a2b6-ab8ad9b6b7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:40.728148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3e498-0736-4321-a2b6-ab8ad9b6b7f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:40.728432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3e498-0736-4321-a2b6-ab8ad9b6b7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:40.728705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3e498-0736-4321-a2b6-ab8ad9b6b7f1 admin admin] PATH_INFO: `/v3/users/4e0d873fee86474e89174bc07152736e` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:40.732844 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3e498-0736-4321-a2b6-ab8ad9b6b7f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e0d873fee86474e89174bc07152736e)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:40.743010 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3e498-0736-4321-a2b6-ab8ad9b6b7f1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:40.840099 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b4c3e498-0736-4321-a2b6-ab8ad9b6b7f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e0d873fee86474e89174bc07152736e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:40.853072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b4c3e498-0736-4321-a2b6-ab8ad9b6b7f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e0d873fee86474e89174bc07152736e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:40.853906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b4c3e498-0736-4321-a2b6-ab8ad9b6b7f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e0d873fee86474e89174bc07152736e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:40.855279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b4c3e498-0736-4321-a2b6-ab8ad9b6b7f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e0d873fee86474e89174bc07152736e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:40.865191 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b4c3e498-0736-4321-a2b6-ab8ad9b6b7f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e0d873fee86474e89174bc07152736e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:40.874256 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:40.891675 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1608/3184] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:01:40 2022] DELETE /identity/v3/users/4e0d873fee86474e89174bc07152736e => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:01:40.896481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73095915-4c98-4aee-bc20-23fe1fa501e1 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:40.896765 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73095915-4c98-4aee-bc20-23fe1fa501e1 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:40.897030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73095915-4c98-4aee-bc20-23fe1fa501e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:40.919585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-73095915-4c98-4aee-bc20-23fe1fa501e1 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:01:40.920704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-73095915-4c98-4aee-bc20-23fe1fa501e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:41.029396 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1577/3185] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:01:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:01:41.064548 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3e498-0736-4321-a2b6-ab8ad9b6b7f1 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:41.067718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b4c3e498-0736-4321-a2b6-ab8ad9b6b7f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:41.189627 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3e498-0736-4321-a2b6-ab8ad9b6b7f1 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:41.194508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f64d41-4ca0-442a-a5da-822df7fb1573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:41.195172 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f64d41-4ca0-442a-a5da-822df7fb1573 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:41.195452 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f64d41-4ca0-442a-a5da-822df7fb1573 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:41.195725 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f64d41-4ca0-442a-a5da-822df7fb1573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:41.207229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f64d41-4ca0-442a-a5da-822df7fb1573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:41.208670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f64d41-4ca0-442a-a5da-822df7fb1573 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:41.222099 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1609/3186] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:01:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:01:42.306461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73095915-4c98-4aee-bc20-23fe1fa501e1 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:42.307928 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-73095915-4c98-4aee-bc20-23fe1fa501e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:42.329201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73095915-4c98-4aee-bc20-23fe1fa501e1 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:42.334971 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6b653-d347-47f0-aa38-2b428ce764e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:42.335229 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6b653-d347-47f0-aa38-2b428ce764e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:42.335568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6b653-d347-47f0-aa38-2b428ce764e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:42.335929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6b653-d347-47f0-aa38-2b428ce764e1 admin admin] PATH_INFO: `/v3/projects/016941d261d94a44b95b4c85b31bf1c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:42.337427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d6b653-d347-47f0-aa38-2b428ce764e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=016941d261d94a44b95b4c85b31bf1c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:42.339907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d6b653-d347-47f0-aa38-2b428ce764e1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:42.343943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:42.398282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c0d6b653-d347-47f0-aa38-2b428ce764e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '016941d261d94a44b95b4c85b31bf1c9', 'request_id': 'req-c0d6b653-d347-47f0-aa38-2b428ce764e1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:42.405293 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c0d6b653-d347-47f0-aa38-2b428ce764e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '016941d261d94a44b95b4c85b31bf1c9', 'request_id': 'req-c0d6b653-d347-47f0-aa38-2b428ce764e1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:42.412274 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c0d6b653-d347-47f0-aa38-2b428ce764e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '016941d261d94a44b95b4c85b31bf1c9', 'request_id': 'req-c0d6b653-d347-47f0-aa38-2b428ce764e1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:42.431155 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c0d6b653-d347-47f0-aa38-2b428ce764e1 admin admin] The token cache is being invalidate because project 016941d261d94a44b95b4c85b31bf1c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:01:42.431768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c0d6b653-d347-47f0-aa38-2b428ce764e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:42.432714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c0d6b653-d347-47f0-aa38-2b428ce764e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:42.435694 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1578/3187] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:01:42 2022] DELETE /identity/v3/projects/016941d261d94a44b95b4c85b31bf1c9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:01:42.439572 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f64d41-4ca0-442a-a5da-822df7fb1573 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:42.451972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f64d41-4ca0-442a-a5da-822df7fb1573 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:42.527558 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd961911-38cf-461b-b593-183cdbc00a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:42.528228 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd961911-38cf-461b-b593-183cdbc00a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:42.529137 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd961911-38cf-461b-b593-183cdbc00a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:42.529401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd961911-38cf-461b-b593-183cdbc00a03 admin admin] PATH_INFO: `/v3/users/f6775e8099c044c4a37184bcf3943e73` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:42.530844 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd961911-38cf-461b-b593-183cdbc00a03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6775e8099c044c4a37184bcf3943e73)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:42.532769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd961911-38cf-461b-b593-183cdbc00a03 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:42.607087 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dd961911-38cf-461b-b593-183cdbc00a03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6775e8099c044c4a37184bcf3943e73'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:42.618900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dd961911-38cf-461b-b593-183cdbc00a03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6775e8099c044c4a37184bcf3943e73'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:42.619258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dd961911-38cf-461b-b593-183cdbc00a03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6775e8099c044c4a37184bcf3943e73'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:42.620389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dd961911-38cf-461b-b593-183cdbc00a03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6775e8099c044c4a37184bcf3943e73'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:42.636786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dd961911-38cf-461b-b593-183cdbc00a03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6775e8099c044c4a37184bcf3943e73'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:42.680816 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1610/3188] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:01:42 2022] DELETE /identity/v3/users/f6775e8099c044c4a37184bcf3943e73 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:01:43.159992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6b653-d347-47f0-aa38-2b428ce764e1 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:43.161597 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c0d6b653-d347-47f0-aa38-2b428ce764e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:43.177546 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6b653-d347-47f0-aa38-2b428ce764e1 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:43.250526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a75bb6-0813-4d39-9f8d-ef027b138a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:43.251309 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a75bb6-0813-4d39-9f8d-ef027b138a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:43.251595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a75bb6-0813-4d39-9f8d-ef027b138a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:43.251872 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a75bb6-0813-4d39-9f8d-ef027b138a23 admin admin] PATH_INFO: `/v3/projects/e06e4053f3b64c7bada9654c1627f4ec` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:43.253026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a75bb6-0813-4d39-9f8d-ef027b138a23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e06e4053f3b64c7bada9654c1627f4ec)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:43.254993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a75bb6-0813-4d39-9f8d-ef027b138a23 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:43.311000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-76a75bb6-0813-4d39-9f8d-ef027b138a23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e06e4053f3b64c7bada9654c1627f4ec', 'request_id': 'req-76a75bb6-0813-4d39-9f8d-ef027b138a23'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:43.316766 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-76a75bb6-0813-4d39-9f8d-ef027b138a23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e06e4053f3b64c7bada9654c1627f4ec', 'request_id': 'req-76a75bb6-0813-4d39-9f8d-ef027b138a23'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:43.323235 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-76a75bb6-0813-4d39-9f8d-ef027b138a23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e06e4053f3b64c7bada9654c1627f4ec', 'request_id': 'req-76a75bb6-0813-4d39-9f8d-ef027b138a23'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:43.338505 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-76a75bb6-0813-4d39-9f8d-ef027b138a23 admin admin] The token cache is being invalidate because project e06e4053f3b64c7bada9654c1627f4ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:01:43.338840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-76a75bb6-0813-4d39-9f8d-ef027b138a23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:43.339596 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-76a75bb6-0813-4d39-9f8d-ef027b138a23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:01:43.341765 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1579/3189] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:01:43 2022] DELETE /identity/v3/projects/e06e4053f3b64c7bada9654c1627f4ec => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:01:43.348380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12329bac-80a1-47a9-bb29-5d6c34a36dd2 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:43.348835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12329bac-80a1-47a9-bb29-5d6c34a36dd2 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:43.349236 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12329bac-80a1-47a9-bb29-5d6c34a36dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:43.369969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-12329bac-80a1-47a9-bb29-5d6c34a36dd2 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:01:43.371291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-12329bac-80a1-47a9-bb29-5d6c34a36dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:43.384606 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:43.456845 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1611/3190] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:01:43.465167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdc6e7-6977-4396-91a0-eb8870a4fd38 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:43.465456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdc6e7-6977-4396-91a0-eb8870a4fd38 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:43.465734 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdc6e7-6977-4396-91a0-eb8870a4fd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:43.486918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-24cdc6e7-6977-4396-91a0-eb8870a4fd38 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:01:43.488118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-24cdc6e7-6977-4396-91a0-eb8870a4fd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:43.495999 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1580/3191] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:01:43.501013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12329bac-80a1-47a9-bb29-5d6c34a36dd2 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:43.510862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12329bac-80a1-47a9-bb29-5d6c34a36dd2 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:43.517832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dbd94a-f793-4ea9-8753-d2df1b1fd5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:43.518456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbd94a-f793-4ea9-8753-d2df1b1fd5c7 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:43.518781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbd94a-f793-4ea9-8753-d2df1b1fd5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:43.519054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbd94a-f793-4ea9-8753-d2df1b1fd5c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:43.519707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dbd94a-f793-4ea9-8753-d2df1b1fd5c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:01:43.520013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dbd94a-f793-4ea9-8753-d2df1b1fd5c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:43.521932 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dbd94a-f793-4ea9-8753-d2df1b1fd5c7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:43.534823 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1612/3192] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:01:43.539487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdc6e7-6977-4396-91a0-eb8870a4fd38 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:43.549992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdc6e7-6977-4396-91a0-eb8870a4fd38 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:43.555226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513126b5-654f-41b6-a85d-e62ff6f92a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:43.555843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513126b5-654f-41b6-a85d-e62ff6f92a19 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:43.556129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513126b5-654f-41b6-a85d-e62ff6f92a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:43.556423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513126b5-654f-41b6-a85d-e62ff6f92a19 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:43.557236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513126b5-654f-41b6-a85d-e62ff6f92a19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:43.559458 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513126b5-654f-41b6-a85d-e62ff6f92a19 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:43.579215 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:43.595867 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1581/3193] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:01:43 2022] POST /identity/v3/projects => generated 389 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:01:43.599762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dbd94a-f793-4ea9-8753-d2df1b1fd5c7 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:43.611008 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dbd94a-f793-4ea9-8753-d2df1b1fd5c7 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:43.679873 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e0804-ed92-4c76-9f93-1595dd7db31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:43.680699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e0804-ed92-4c76-9f93-1595dd7db31f admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:43.680984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e0804-ed92-4c76-9f93-1595dd7db31f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:43.681260 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e0804-ed92-4c76-9f93-1595dd7db31f admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:43.681954 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e0804-ed92-4c76-9f93-1595dd7db31f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:43.683997 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e0804-ed92-4c76-9f93-1595dd7db31f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:43.711840 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1613/3194] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:01:43 2022] POST /identity/v3/users => generated 295 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:01:43.715167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513126b5-654f-41b6-a85d-e62ff6f92a19 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:43.728563 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513126b5-654f-41b6-a85d-e62ff6f92a19 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:43.737715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd8ab1-9d56-4df4-856f-9c985b680bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:43.738726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd8ab1-9d56-4df4-856f-9c985b680bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:43.739139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd8ab1-9d56-4df4-856f-9c985b680bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:43.739423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd8ab1-9d56-4df4-856f-9c985b680bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:43.740072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd8ab1-9d56-4df4-856f-9c985b680bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:43.741881 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd8ab1-9d56-4df4-856f-9c985b680bd6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:43.758048 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1582/3195] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:01:43.759341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e0804-ed92-4c76-9f93-1595dd7db31f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:43.773976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e0804-ed92-4c76-9f93-1595dd7db31f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:43.782995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee2ca6-e2d7-4a02-a8d1-d94712ba5178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:43.784482 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee2ca6-e2d7-4a02-a8d1-d94712ba5178 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:43.784482 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee2ca6-e2d7-4a02-a8d1-d94712ba5178 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:43.784482 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee2ca6-e2d7-4a02-a8d1-d94712ba5178 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:43.785353 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee2ca6-e2d7-4a02-a8d1-d94712ba5178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:43.787727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee2ca6-e2d7-4a02-a8d1-d94712ba5178 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:43.804223 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1614/3196] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:01:43.810051 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd8ab1-9d56-4df4-856f-9c985b680bd6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:43.820770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd8ab1-9d56-4df4-856f-9c985b680bd6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:43.827938 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850cfcbb-d85e-4cf2-a064-4a3f65ea102a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:43.828877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cfcbb-d85e-4cf2-a064-4a3f65ea102a admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:43.829329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cfcbb-d85e-4cf2-a064-4a3f65ea102a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:43.829846 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cfcbb-d85e-4cf2-a064-4a3f65ea102a admin admin] PATH_INFO: `/v3/projects/064df62cbc9b447d85833fff49cac599/users/d2ece0a12baa4e0eb534865a7437bd9a/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:43.852771 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850cfcbb-d85e-4cf2-a064-4a3f65ea102a admin admin] RBAC: Authorizing `identity:create_grant(project_id=064df62cbc9b447d85833fff49cac599, user_id=d2ece0a12baa4e0eb534865a7437bd9a, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:43.855949 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850cfcbb-d85e-4cf2-a064-4a3f65ea102a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:43.870513 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1583/3197] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:01:43 2022] PUT /identity/v3/projects/064df62cbc9b447d85833fff49cac599/users/d2ece0a12baa4e0eb534865a7437bd9a/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:01:43.875773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25407fd6-2e1e-41ca-9a8b-1f64f5c087e8 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:43.876115 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25407fd6-2e1e-41ca-9a8b-1f64f5c087e8 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:43.877023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25407fd6-2e1e-41ca-9a8b-1f64f5c087e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:43.901375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-25407fd6-2e1e-41ca-9a8b-1f64f5c087e8 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:01:43.902514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-25407fd6-2e1e-41ca-9a8b-1f64f5c087e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:43.977366 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1615/3198] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:01:43.987147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850cfcbb-d85e-4cf2-a064-4a3f65ea102a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:43.989051 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-850cfcbb-d85e-4cf2-a064-4a3f65ea102a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:44.059113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850cfcbb-d85e-4cf2-a064-4a3f65ea102a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:44.064197 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a764757-1eb7-41b7-b3c9-816ce7b44206 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:44.064838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a764757-1eb7-41b7-b3c9-816ce7b44206 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:44.065119 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a764757-1eb7-41b7-b3c9-816ce7b44206 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:44.065640 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a764757-1eb7-41b7-b3c9-816ce7b44206 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:44.079239 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a764757-1eb7-41b7-b3c9-816ce7b44206 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:44.080691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a764757-1eb7-41b7-b3c9-816ce7b44206 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:44.102306 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1584/3199] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:01:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:01:44.335607 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe49c5-94da-42df-bed9-e6114172aa3d None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:44.335607 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe49c5-94da-42df-bed9-e6114172aa3d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:44.336018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe49c5-94da-42df-bed9-e6114172aa3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:44.373074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-0efe49c5-94da-42df-bed9-e6114172aa3d None None] MFA Rules not processed for user `398134b8b4234816ae43a9230eae3c16`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:01:44.374413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0efe49c5-94da-42df-bed9-e6114172aa3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:44.385135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:44.520466 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1bb02-1441-41dd-b6ba-5a63d55b32f8 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:44.521065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1bb02-1441-41dd-b6ba-5a63d55b32f8 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:44.521251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1bb02-1441-41dd-b6ba-5a63d55b32f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:44.521446 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1616/3200] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:01:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:01:44.550078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d9f1bb02-1441-41dd-b6ba-5a63d55b32f8 None None] MFA Rules not processed for user `398134b8b4234816ae43a9230eae3c16`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:01:44.551668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d9f1bb02-1441-41dd-b6ba-5a63d55b32f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:44.561268 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1585/3201] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:01:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:01:44.572704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe49c5-94da-42df-bed9-e6114172aa3d None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:44.574746 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0efe49c5-94da-42df-bed9-e6114172aa3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:44.698876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe49c5-94da-42df-bed9-e6114172aa3d None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:44.707498 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a8906-0925-4a69-a1d6-85399cd7e86b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:44.708126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a8906-0925-4a69-a1d6-85399cd7e86b service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:44.708458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a8906-0925-4a69-a1d6-85399cd7e86b service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:44.708726 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a8906-0925-4a69-a1d6-85399cd7e86b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:44.718725 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a8906-0925-4a69-a1d6-85399cd7e86b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:44.720428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a8906-0925-4a69-a1d6-85399cd7e86b service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:44.735973 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1617/3202] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:01:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:01:45.082961 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c900b-7ced-414d-a566-a2de520932e2 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:45.084064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c900b-7ced-414d-a566-a2de520932e2 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:45.084467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c900b-7ced-414d-a566-a2de520932e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:45.123119 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-841c900b-7ced-414d-a566-a2de520932e2 None None] MFA Rules not processed for user `ad1a96004778407584d1805b07ad1c5f`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:01:45.128061 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-841c900b-7ced-414d-a566-a2de520932e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:45.224776 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1586/3203] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:01:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:01:53.329281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a8906-0925-4a69-a1d6-85399cd7e86b service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:53.345631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a8906-0925-4a69-a1d6-85399cd7e86b service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:53.358353 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6360ab62-5c15-4d29-89b2-6d2c2956c457 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:53.359328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360ab62-5c15-4d29-89b2-6d2c2956c457 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:53.359789 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360ab62-5c15-4d29-89b2-6d2c2956c457 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:53.360228 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360ab62-5c15-4d29-89b2-6d2c2956c457 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:53.363943 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6360ab62-5c15-4d29-89b2-6d2c2956c457 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:53.489918 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6360ab62-5c15-4d29-89b2-6d2c2956c457 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:53.493159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6360ab62-5c15-4d29-89b2-6d2c2956c457 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:53.508461 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1618/3204] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:01:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:01:55.214508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:INSERT=2,keystone:SELECT=71 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:55.695525 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374ce87-9ad5-4220-b756-129cab3a921b None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:55.695874 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374ce87-9ad5-4220-b756-129cab3a921b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:55.696213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374ce87-9ad5-4220-b756-129cab3a921b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:55.740230 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-7374ce87-9ad5-4220-b756-129cab3a921b None None] MFA Rules not processed for user `d2ece0a12baa4e0eb534865a7437bd9a`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:01:55.743674 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7374ce87-9ad5-4220-b756-129cab3a921b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:55.748645 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45447e-1cbe-4c6f-a2c5-208b14eda7cf None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:55.749479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45447e-1cbe-4c6f-a2c5-208b14eda7cf None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:55.749991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45447e-1cbe-4c6f-a2c5-208b14eda7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:55.773313 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-9a45447e-1cbe-4c6f-a2c5-208b14eda7cf None None] MFA Rules not processed for user `145439e0e0d549f89b17e81cbd46c580`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:01:55.774893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9a45447e-1cbe-4c6f-a2c5-208b14eda7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:55.813796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:55.852089 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1587/3205] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:01:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:01:55.862101 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1619/3206] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:01:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:01:55.863896 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374ce87-9ad5-4220-b756-129cab3a921b None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:55.865384 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7374ce87-9ad5-4220-b756-129cab3a921b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:55.882887 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374ce87-9ad5-4220-b756-129cab3a921b None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:55.890385 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c2a452-5aa0-40e6-acbf-a6e1ccfc13f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:55.891042 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2a452-5aa0-40e6-acbf-a6e1ccfc13f0 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:55.891324 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2a452-5aa0-40e6-acbf-a6e1ccfc13f0 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:55.891603 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2a452-5aa0-40e6-acbf-a6e1ccfc13f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:55.901034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c2a452-5aa0-40e6-acbf-a6e1ccfc13f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:55.902648 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c2a452-5aa0-40e6-acbf-a6e1ccfc13f0 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:55.913411 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1588/3207] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:01:55 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:02:03.951773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45447e-1cbe-4c6f-a2c5-208b14eda7cf None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:03.975088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45447e-1cbe-4c6f-a2c5-208b14eda7cf None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:03.988935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80b59f-3589-441c-b004-2d6018437d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:03.991938 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80b59f-3589-441c-b004-2d6018437d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:03.993893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80b59f-3589-441c-b004-2d6018437d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:03.994176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80b59f-3589-441c-b004-2d6018437d7b admin admin] PATH_INFO: `/v3/users/d2ece0a12baa4e0eb534865a7437bd9a` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:04.002220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da80b59f-3589-441c-b004-2d6018437d7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2ece0a12baa4e0eb534865a7437bd9a)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:04.007148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da80b59f-3589-441c-b004-2d6018437d7b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:04.119562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-da80b59f-3589-441c-b004-2d6018437d7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2ece0a12baa4e0eb534865a7437bd9a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:04.130455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-da80b59f-3589-441c-b004-2d6018437d7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2ece0a12baa4e0eb534865a7437bd9a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:04.133990 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-da80b59f-3589-441c-b004-2d6018437d7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2ece0a12baa4e0eb534865a7437bd9a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:04.134730 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-da80b59f-3589-441c-b004-2d6018437d7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2ece0a12baa4e0eb534865a7437bd9a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:04.160522 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-da80b59f-3589-441c-b004-2d6018437d7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2ece0a12baa4e0eb534865a7437bd9a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:04.206249 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1620/3208] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:02:03 2022] DELETE /identity/v3/users/d2ece0a12baa4e0eb534865a7437bd9a => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:02:04.565892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c2a452-5aa0-40e6-acbf-a6e1ccfc13f0 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:04.607912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c2a452-5aa0-40e6-acbf-a6e1ccfc13f0 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:04.715136 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462fd23-db63-455d-9ce9-3cdd84a4f358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:04.715760 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462fd23-db63-455d-9ce9-3cdd84a4f358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:04.716178 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462fd23-db63-455d-9ce9-3cdd84a4f358 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:04.716600 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462fd23-db63-455d-9ce9-3cdd84a4f358 admin admin] PATH_INFO: `/v3/projects/064df62cbc9b447d85833fff49cac599` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:04.719032 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462fd23-db63-455d-9ce9-3cdd84a4f358 admin admin] RBAC: Authorizing `identity:delete_project(project_id=064df62cbc9b447d85833fff49cac599)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:04.721114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462fd23-db63-455d-9ce9-3cdd84a4f358 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:04.859715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d462fd23-db63-455d-9ce9-3cdd84a4f358 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '064df62cbc9b447d85833fff49cac599', 'request_id': 'req-d462fd23-db63-455d-9ce9-3cdd84a4f358'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:04.872465 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d462fd23-db63-455d-9ce9-3cdd84a4f358 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '064df62cbc9b447d85833fff49cac599', 'request_id': 'req-d462fd23-db63-455d-9ce9-3cdd84a4f358'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:04.885189 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d462fd23-db63-455d-9ce9-3cdd84a4f358 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '064df62cbc9b447d85833fff49cac599', 'request_id': 'req-d462fd23-db63-455d-9ce9-3cdd84a4f358'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:04.887321 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:04.940255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d462fd23-db63-455d-9ce9-3cdd84a4f358 admin admin] The token cache is being invalidate because project 064df62cbc9b447d85833fff49cac599 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:02:04.940802 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d462fd23-db63-455d-9ce9-3cdd84a4f358 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:04.960283 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d462fd23-db63-455d-9ce9-3cdd84a4f358 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:04.962409 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1589/3209] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:02:04 2022] DELETE /identity/v3/projects/064df62cbc9b447d85833fff49cac599 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:02:04.968659 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d435e-0c2e-4078-b360-8eb620d6a076 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:04.969754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d435e-0c2e-4078-b360-8eb620d6a076 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:04.970257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d435e-0c2e-4078-b360-8eb620d6a076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:05.050884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-842d435e-0c2e-4078-b360-8eb620d6a076 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:02:05.053316 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-842d435e-0c2e-4078-b360-8eb620d6a076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:05.155316 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1621/3210] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:02:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:02:05.162681 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edf25c-95da-4ef1-b902-7dfa5063e468 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:05.162960 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edf25c-95da-4ef1-b902-7dfa5063e468 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:05.163563 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edf25c-95da-4ef1-b902-7dfa5063e468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:05.204883 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f0edf25c-95da-4ef1-b902-7dfa5063e468 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:02:05.209994 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f0edf25c-95da-4ef1-b902-7dfa5063e468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:05.285550 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1590/3211] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:02:05.285894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d435e-0c2e-4078-b360-8eb620d6a076 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:05.285894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d435e-0c2e-4078-b360-8eb620d6a076 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:05.307802 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ced603-e173-4516-aee9-15267e6bce23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:05.308770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ced603-e173-4516-aee9-15267e6bce23 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:05.309249 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ced603-e173-4516-aee9-15267e6bce23 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:05.310408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ced603-e173-4516-aee9-15267e6bce23 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:05.311490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ced603-e173-4516-aee9-15267e6bce23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:02:05.312113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ced603-e173-4516-aee9-15267e6bce23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:05.315840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ced603-e173-4516-aee9-15267e6bce23 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:05.339669 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1622/3212] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:02:05.340374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0edf25c-95da-4ef1-b902-7dfa5063e468 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:05.354200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0edf25c-95da-4ef1-b902-7dfa5063e468 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:05.360065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44ca70-a08c-4b7a-a43f-6b932de199bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:05.360885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44ca70-a08c-4b7a-a43f-6b932de199bd admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:05.361301 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44ca70-a08c-4b7a-a43f-6b932de199bd admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:05.361884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44ca70-a08c-4b7a-a43f-6b932de199bd admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:05.362670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44ca70-a08c-4b7a-a43f-6b932de199bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:05.367687 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44ca70-a08c-4b7a-a43f-6b932de199bd admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:05.414937 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1591/3213] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:02:05 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:02:05.416317 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ced603-e173-4516-aee9-15267e6bce23 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:05.432678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ced603-e173-4516-aee9-15267e6bce23 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:05.454364 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:05.632163 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e58594-fa75-49d0-b22c-2d8228edb973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:05.632808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e58594-fa75-49d0-b22c-2d8228edb973 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:05.633090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e58594-fa75-49d0-b22c-2d8228edb973 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:05.636658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e58594-fa75-49d0-b22c-2d8228edb973 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:05.637319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e58594-fa75-49d0-b22c-2d8228edb973 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:05.641284 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e58594-fa75-49d0-b22c-2d8228edb973 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:05.707576 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1623/3214] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:02:05 2022] POST /identity/v3/users => generated 293 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:02:05.709158 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44ca70-a08c-4b7a-a43f-6b932de199bd admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:05.730119 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44ca70-a08c-4b7a-a43f-6b932de199bd admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:05.738697 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b2562-f417-4996-9ce4-cfd15a6b4b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:05.739489 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b2562-f417-4996-9ce4-cfd15a6b4b8e admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:05.739980 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b2562-f417-4996-9ce4-cfd15a6b4b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:05.740391 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b2562-f417-4996-9ce4-cfd15a6b4b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:05.741253 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b2562-f417-4996-9ce4-cfd15a6b4b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:05.743062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b2562-f417-4996-9ce4-cfd15a6b4b8e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:05.763851 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1592/3215] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:02:05.768188 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e58594-fa75-49d0-b22c-2d8228edb973 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:05.782499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e58594-fa75-49d0-b22c-2d8228edb973 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:05.796363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e0a30-7015-4d6b-8236-58dbced1ef6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:05.797359 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e0a30-7015-4d6b-8236-58dbced1ef6a admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:05.797779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e0a30-7015-4d6b-8236-58dbced1ef6a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:05.798231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e0a30-7015-4d6b-8236-58dbced1ef6a admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:05.799556 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e0a30-7015-4d6b-8236-58dbced1ef6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:05.801496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e0a30-7015-4d6b-8236-58dbced1ef6a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:05.824457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b2562-f417-4996-9ce4-cfd15a6b4b8e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:05.832663 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1624/3216] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:02:05.838513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b2562-f417-4996-9ce4-cfd15a6b4b8e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:05.856181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5088d-6177-495e-9934-882ba402692a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:05.858178 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5088d-6177-495e-9934-882ba402692a admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:05.858680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5088d-6177-495e-9934-882ba402692a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:05.859099 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5088d-6177-495e-9934-882ba402692a admin admin] PATH_INFO: `/v3/projects/ebf6d5c4c6624b849238429d19be6dc6/users/393ed805f99d4b4c93500bcff599eb56/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:05.896481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff5088d-6177-495e-9934-882ba402692a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebf6d5c4c6624b849238429d19be6dc6, user_id=393ed805f99d4b4c93500bcff599eb56, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:05.899588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff5088d-6177-495e-9934-882ba402692a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:05.921193 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1593/3217] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:02:05 2022] PUT /identity/v3/projects/ebf6d5c4c6624b849238429d19be6dc6/users/393ed805f99d4b4c93500bcff599eb56/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:02:05.926571 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286c577-038c-4dbc-a91d-d2093f4117f8 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:05.926966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286c577-038c-4dbc-a91d-d2093f4117f8 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:05.927346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286c577-038c-4dbc-a91d-d2093f4117f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:05.951577 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-3286c577-038c-4dbc-a91d-d2093f4117f8 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:02:05.952984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3286c577-038c-4dbc-a91d-d2093f4117f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:06.083709 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1625/3218] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:02:06.131189 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5088d-6177-495e-9934-882ba402692a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:06.135364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-fff5088d-6177-495e-9934-882ba402692a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:06.228664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5088d-6177-495e-9934-882ba402692a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:06.234229 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19c4c1-c2ac-4ca1-a5b3-3f0074493d34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:06.235016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19c4c1-c2ac-4ca1-a5b3-3f0074493d34 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:06.235304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19c4c1-c2ac-4ca1-a5b3-3f0074493d34 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:06.235577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19c4c1-c2ac-4ca1-a5b3-3f0074493d34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:06.246401 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19c4c1-c2ac-4ca1-a5b3-3f0074493d34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:06.248072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19c4c1-c2ac-4ca1-a5b3-3f0074493d34 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:06.275892 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1594/3219] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:02:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:02:13.059232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286c577-038c-4dbc-a91d-d2093f4117f8 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:13.061960 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3286c577-038c-4dbc-a91d-d2093f4117f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:13.074986 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286c577-038c-4dbc-a91d-d2093f4117f8 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:13.081754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f7c15-b925-46d8-a88f-30f245f4239f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:13.082405 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f7c15-b925-46d8-a88f-30f245f4239f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:13.082902 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f7c15-b925-46d8-a88f-30f245f4239f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:13.083179 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f7c15-b925-46d8-a88f-30f245f4239f admin admin] PATH_INFO: `/v3/users/62e7c88630854feb8e5f74c105f70825` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:13.084310 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f7c15-b925-46d8-a88f-30f245f4239f admin admin] RBAC: Authorizing `identity:delete_user(user_id=62e7c88630854feb8e5f74c105f70825)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:13.086450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f7c15-b925-46d8-a88f-30f245f4239f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:13.197155 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-077f7c15-b925-46d8-a88f-30f245f4239f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62e7c88630854feb8e5f74c105f70825'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:13.209823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-077f7c15-b925-46d8-a88f-30f245f4239f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62e7c88630854feb8e5f74c105f70825'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:13.210836 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-077f7c15-b925-46d8-a88f-30f245f4239f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62e7c88630854feb8e5f74c105f70825'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:13.211599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-077f7c15-b925-46d8-a88f-30f245f4239f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62e7c88630854feb8e5f74c105f70825'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:13.222699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-077f7c15-b925-46d8-a88f-30f245f4239f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62e7c88630854feb8e5f74c105f70825'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:13.252467 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1626/3220] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:02:13 2022] DELETE /identity/v3/users/62e7c88630854feb8e5f74c105f70825 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:02:14.141033 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19c4c1-c2ac-4ca1-a5b3-3f0074493d34 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:14.151838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19c4c1-c2ac-4ca1-a5b3-3f0074493d34 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:14.297082 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb518d-1641-4867-a6ba-9aca5f439e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:14.299328 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb518d-1641-4867-a6ba-9aca5f439e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:14.299781 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb518d-1641-4867-a6ba-9aca5f439e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:14.301247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb518d-1641-4867-a6ba-9aca5f439e03 admin admin] PATH_INFO: `/v3/projects/e9acff8060d543c3b8422b25fdc1119b` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:14.306184 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb518d-1641-4867-a6ba-9aca5f439e03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9acff8060d543c3b8422b25fdc1119b)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:14.308853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb518d-1641-4867-a6ba-9aca5f439e03 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:14.347956 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:14.411729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-66eb518d-1641-4867-a6ba-9aca5f439e03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9acff8060d543c3b8422b25fdc1119b', 'request_id': 'req-66eb518d-1641-4867-a6ba-9aca5f439e03'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:14.422196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-66eb518d-1641-4867-a6ba-9aca5f439e03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9acff8060d543c3b8422b25fdc1119b', 'request_id': 'req-66eb518d-1641-4867-a6ba-9aca5f439e03'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:14.435275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-66eb518d-1641-4867-a6ba-9aca5f439e03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9acff8060d543c3b8422b25fdc1119b', 'request_id': 'req-66eb518d-1641-4867-a6ba-9aca5f439e03'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:14.466867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-66eb518d-1641-4867-a6ba-9aca5f439e03 admin admin] The token cache is being invalidate because project e9acff8060d543c3b8422b25fdc1119b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:02:14.467163 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-66eb518d-1641-4867-a6ba-9aca5f439e03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:14.471021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-66eb518d-1641-4867-a6ba-9aca5f439e03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:14.476863 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1595/3221] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:02:14 2022] DELETE /identity/v3/projects/e9acff8060d543c3b8422b25fdc1119b => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:02:14.478406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f06b1-7de9-4a08-b8e1-6c1c23d32e28 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:14.479230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f06b1-7de9-4a08-b8e1-6c1c23d32e28 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:14.479640 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f06b1-7de9-4a08-b8e1-6c1c23d32e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:14.490993 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:14.507330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-c99f06b1-7de9-4a08-b8e1-6c1c23d32e28 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:02:14.509000 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c99f06b1-7de9-4a08-b8e1-6c1c23d32e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:14.585206 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1627/3222] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:02:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:02:14.592522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff7657-e489-4eb6-82c2-e04316e268a9 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:14.592813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff7657-e489-4eb6-82c2-e04316e268a9 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:14.593090 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff7657-e489-4eb6-82c2-e04316e268a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:14.618386 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-62ff7657-e489-4eb6-82c2-e04316e268a9 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:02:14.620250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-62ff7657-e489-4eb6-82c2-e04316e268a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:14.641168 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f06b1-7de9-4a08-b8e1-6c1c23d32e28 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:14.649402 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1596/3223] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:02:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:02:14.653406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f06b1-7de9-4a08-b8e1-6c1c23d32e28 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:14.659799 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1f446-2c2b-47cc-8c9c-98746d701462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:14.660431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1f446-2c2b-47cc-8c9c-98746d701462 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:14.660712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1f446-2c2b-47cc-8c9c-98746d701462 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:14.660985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1f446-2c2b-47cc-8c9c-98746d701462 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:14.661640 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1f446-2c2b-47cc-8c9c-98746d701462 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:02:14.661955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1f446-2c2b-47cc-8c9c-98746d701462 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:14.666581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1f446-2c2b-47cc-8c9c-98746d701462 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:14.694502 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1628/3224] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:02:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:02:14.701051 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff7657-e489-4eb6-82c2-e04316e268a9 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:14.717138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff7657-e489-4eb6-82c2-e04316e268a9 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:14.739591 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a5fb8-dd43-4934-b2e3-b7248201c426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:14.740376 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a5fb8-dd43-4934-b2e3-b7248201c426 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:14.742699 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a5fb8-dd43-4934-b2e3-b7248201c426 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:14.743014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a5fb8-dd43-4934-b2e3-b7248201c426 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:14.743709 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a5fb8-dd43-4934-b2e3-b7248201c426 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:14.745769 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a5fb8-dd43-4934-b2e3-b7248201c426 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:14.818833 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1597/3225] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:02:14 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:02:14.819856 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1f446-2c2b-47cc-8c9c-98746d701462 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:14.841464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1f446-2c2b-47cc-8c9c-98746d701462 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:15.021826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d1c3a-7321-4971-8f5b-75f8ed3cd31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:15.022451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d1c3a-7321-4971-8f5b-75f8ed3cd31d admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:15.022758 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d1c3a-7321-4971-8f5b-75f8ed3cd31d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:15.023031 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d1c3a-7321-4971-8f5b-75f8ed3cd31d admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:15.023654 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d1c3a-7321-4971-8f5b-75f8ed3cd31d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:15.026721 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d1c3a-7321-4971-8f5b-75f8ed3cd31d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:15.073878 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1629/3226] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:02:14 2022] POST /identity/v3/users => generated 289 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:02:15.076077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a5fb8-dd43-4934-b2e3-b7248201c426 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:15.128067 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a5fb8-dd43-4934-b2e3-b7248201c426 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:15.157815 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0bcab-860f-4ff7-a48e-1b8658eb11e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:15.158440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0bcab-860f-4ff7-a48e-1b8658eb11e6 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:15.158758 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0bcab-860f-4ff7-a48e-1b8658eb11e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:15.159033 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0bcab-860f-4ff7-a48e-1b8658eb11e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:15.159679 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b0bcab-860f-4ff7-a48e-1b8658eb11e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:15.162907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b0bcab-860f-4ff7-a48e-1b8658eb11e6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:15.197099 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1598/3227] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:02:15.199034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d1c3a-7321-4971-8f5b-75f8ed3cd31d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:15.218056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d1c3a-7321-4971-8f5b-75f8ed3cd31d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:15.271918 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7244c-9b9e-4c76-abec-63bb93eb2d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:15.272577 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7244c-9b9e-4c76-abec-63bb93eb2d00 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:15.273376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7244c-9b9e-4c76-abec-63bb93eb2d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:15.273376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7244c-9b9e-4c76-abec-63bb93eb2d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:15.273767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af7244c-9b9e-4c76-abec-63bb93eb2d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:15.275420 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af7244c-9b9e-4c76-abec-63bb93eb2d00 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:15.305731 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1630/3228] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:02:15.307104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0bcab-860f-4ff7-a48e-1b8658eb11e6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:15.324252 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0bcab-860f-4ff7-a48e-1b8658eb11e6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:15.339392 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349cb53-966c-42e9-9e42-a90c2705d740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:15.340700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349cb53-966c-42e9-9e42-a90c2705d740 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:15.341198 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349cb53-966c-42e9-9e42-a90c2705d740 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:15.341782 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349cb53-966c-42e9-9e42-a90c2705d740 admin admin] PATH_INFO: `/v3/projects/e1ed29bedd5e4f4788958bad354166f3/users/78f7a58ae0b24b6a9aca96713dfe99b4/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:15.375607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349cb53-966c-42e9-9e42-a90c2705d740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1ed29bedd5e4f4788958bad354166f3, user_id=78f7a58ae0b24b6a9aca96713dfe99b4, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:15.380805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349cb53-966c-42e9-9e42-a90c2705d740 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:15.412448 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1599/3229] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:02:15 2022] PUT /identity/v3/projects/e1ed29bedd5e4f4788958bad354166f3/users/78f7a58ae0b24b6a9aca96713dfe99b4/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:02:15.418373 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc309e-c63b-42c1-8883-dd58cac423e9 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:15.419499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc309e-c63b-42c1-8883-dd58cac423e9 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:15.419863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc309e-c63b-42c1-8883-dd58cac423e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:15.448911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-5bdc309e-c63b-42c1-8883-dd58cac423e9 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:02:15.451666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5bdc309e-c63b-42c1-8883-dd58cac423e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:15.541443 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1631/3230] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:02:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:02:15.581315 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349cb53-966c-42e9-9e42-a90c2705d740 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:15.583876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7349cb53-966c-42e9-9e42-a90c2705d740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:15.734602 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349cb53-966c-42e9-9e42-a90c2705d740 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:15.739258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c391b8e7-0f73-4a39-9dd6-efbbcace7d75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:15.740167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391b8e7-0f73-4a39-9dd6-efbbcace7d75 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:15.740586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391b8e7-0f73-4a39-9dd6-efbbcace7d75 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:15.740864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391b8e7-0f73-4a39-9dd6-efbbcace7d75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:15.751943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c391b8e7-0f73-4a39-9dd6-efbbcace7d75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:15.753411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c391b8e7-0f73-4a39-9dd6-efbbcace7d75 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:15.775696 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1600/3231] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:02:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:02:21.939668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5657fe0-87b1-4f94-8384-05132ae46aee None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:21.940928 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5657fe0-87b1-4f94-8384-05132ae46aee None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:21.941951 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5657fe0-87b1-4f94-8384-05132ae46aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:21.985068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:22.020317 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a5657fe0-87b1-4f94-8384-05132ae46aee None None] MFA Rules not processed for user `393ed805f99d4b4c93500bcff599eb56`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:02:22.021616 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a5657fe0-87b1-4f94-8384-05132ae46aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:22.237012 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1632/3232] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:02:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:02:22.251783 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c391b8e7-0f73-4a39-9dd6-efbbcace7d75 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:22.253911 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c391b8e7-0f73-4a39-9dd6-efbbcace7d75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:22.329451 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:22.487270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5657fe0-87b1-4f94-8384-05132ae46aee None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:22.489090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a5657fe0-87b1-4f94-8384-05132ae46aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:22.505806 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c391b8e7-0f73-4a39-9dd6-efbbcace7d75 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:22.516934 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5657fe0-87b1-4f94-8384-05132ae46aee None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:22.523240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a45568-5d29-4ca7-8d40-e3bd4f20dbf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:22.523865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a45568-5d29-4ca7-8d40-e3bd4f20dbf4 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:22.524136 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a45568-5d29-4ca7-8d40-e3bd4f20dbf4 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:22.525122 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a45568-5d29-4ca7-8d40-e3bd4f20dbf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:22.530792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7467e3c-e939-41c8-8156-5ae1559ac11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:22.531484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7467e3c-e939-41c8-8156-5ae1559ac11a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:22.531921 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7467e3c-e939-41c8-8156-5ae1559ac11a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:22.539418 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7467e3c-e939-41c8-8156-5ae1559ac11a admin admin] PATH_INFO: `/v3/users/d43d0d15118242b7a60cc34c512fbe5e` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:22.539621 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a45568-5d29-4ca7-8d40-e3bd4f20dbf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:22.542380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7467e3c-e939-41c8-8156-5ae1559ac11a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d43d0d15118242b7a60cc34c512fbe5e)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:22.544175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a45568-5d29-4ca7-8d40-e3bd4f20dbf4 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:22.545003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7467e3c-e939-41c8-8156-5ae1559ac11a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:22.570988 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1601/3233] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:02:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:02:22.668271 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b7467e3c-e939-41c8-8156-5ae1559ac11a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd43d0d15118242b7a60cc34c512fbe5e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:22.688735 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b7467e3c-e939-41c8-8156-5ae1559ac11a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd43d0d15118242b7a60cc34c512fbe5e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:22.689544 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b7467e3c-e939-41c8-8156-5ae1559ac11a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd43d0d15118242b7a60cc34c512fbe5e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:22.691342 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b7467e3c-e939-41c8-8156-5ae1559ac11a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd43d0d15118242b7a60cc34c512fbe5e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:22.741114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b7467e3c-e939-41c8-8156-5ae1559ac11a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd43d0d15118242b7a60cc34c512fbe5e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:22.791694 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1633/3234] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:02:22 2022] DELETE /identity/v3/users/d43d0d15118242b7a60cc34c512fbe5e => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:02:24.180583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a45568-5d29-4ca7-8d40-e3bd4f20dbf4 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:24.204821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a45568-5d29-4ca7-8d40-e3bd4f20dbf4 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:24.281942 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08801855-7b04-41d1-a06d-766acc79c784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:24.282968 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08801855-7b04-41d1-a06d-766acc79c784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:24.283416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08801855-7b04-41d1-a06d-766acc79c784 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:24.283830 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08801855-7b04-41d1-a06d-766acc79c784 admin admin] PATH_INFO: `/v3/projects/764e8bbcc05b47e5a647cf2a0fe82a20` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:24.295410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08801855-7b04-41d1-a06d-766acc79c784 admin admin] RBAC: Authorizing `identity:delete_project(project_id=764e8bbcc05b47e5a647cf2a0fe82a20)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:24.301251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08801855-7b04-41d1-a06d-766acc79c784 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:24.458637 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-08801855-7b04-41d1-a06d-766acc79c784 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '764e8bbcc05b47e5a647cf2a0fe82a20', 'request_id': 'req-08801855-7b04-41d1-a06d-766acc79c784'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:24.474417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-08801855-7b04-41d1-a06d-766acc79c784 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '764e8bbcc05b47e5a647cf2a0fe82a20', 'request_id': 'req-08801855-7b04-41d1-a06d-766acc79c784'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:24.494323 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-08801855-7b04-41d1-a06d-766acc79c784 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '764e8bbcc05b47e5a647cf2a0fe82a20', 'request_id': 'req-08801855-7b04-41d1-a06d-766acc79c784'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:24.514523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-08801855-7b04-41d1-a06d-766acc79c784 admin admin] The token cache is being invalidate because project 764e8bbcc05b47e5a647cf2a0fe82a20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:02:24.514900 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-08801855-7b04-41d1-a06d-766acc79c784 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:24.516011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-08801855-7b04-41d1-a06d-766acc79c784 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:24.524958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd111b45-c3ff-4b52-b852-18a2b9f72a1c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:24.525482 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd111b45-c3ff-4b52-b852-18a2b9f72a1c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:24.525555 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd111b45-c3ff-4b52-b852-18a2b9f72a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:24.530020 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1602/3235] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:02:24 2022] DELETE /identity/v3/projects/764e8bbcc05b47e5a647cf2a0fe82a20 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:02:24.568015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-fd111b45-c3ff-4b52-b852-18a2b9f72a1c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:02:24.569308 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-fd111b45-c3ff-4b52-b852-18a2b9f72a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:24.653916 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1634/3236] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:02:24.662882 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdf0ca-b997-41ea-b2c1-14e79148438e None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:24.663168 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdf0ca-b997-41ea-b2c1-14e79148438e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:24.663449 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdf0ca-b997-41ea-b2c1-14e79148438e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:24.712256 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-befdf0ca-b997-41ea-b2c1-14e79148438e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:02:24.714185 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-befdf0ca-b997-41ea-b2c1-14e79148438e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:24.736516 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1603/3237] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:02:24.740111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd111b45-c3ff-4b52-b852-18a2b9f72a1c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:24.753249 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd111b45-c3ff-4b52-b852-18a2b9f72a1c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:24.780321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b92711-5095-4af4-a9fd-b95a163fdd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:24.780959 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b92711-5095-4af4-a9fd-b95a163fdd5e admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:24.781243 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b92711-5095-4af4-a9fd-b95a163fdd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:24.781517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b92711-5095-4af4-a9fd-b95a163fdd5e admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:24.782176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b92711-5095-4af4-a9fd-b95a163fdd5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:02:24.782478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b92711-5095-4af4-a9fd-b95a163fdd5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:24.784106 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b92711-5095-4af4-a9fd-b95a163fdd5e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:24.808925 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:24.830222 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1635/3238] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:02:24.831365 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befdf0ca-b997-41ea-b2c1-14e79148438e None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:24.848501 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befdf0ca-b997-41ea-b2c1-14e79148438e None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:24.865685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ea9e6-fa7a-42ef-90b4-961f2bd24bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:24.867714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ea9e6-fa7a-42ef-90b4-961f2bd24bdd admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:24.868169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ea9e6-fa7a-42ef-90b4-961f2bd24bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:24.869235 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ea9e6-fa7a-42ef-90b4-961f2bd24bdd admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:24.873101 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ea9e6-fa7a-42ef-90b4-961f2bd24bdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:24.876119 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ea9e6-fa7a-42ef-90b4-961f2bd24bdd admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:24.892726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:24.938329 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1604/3239] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:02:24 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:02:24.941514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b92711-5095-4af4-a9fd-b95a163fdd5e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:24.954794 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b92711-5095-4af4-a9fd-b95a163fdd5e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:24.985764 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73ae48-1b4d-476e-b710-e16279cecc4b None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:24.986183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73ae48-1b4d-476e-b710-e16279cecc4b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:24.986535 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73ae48-1b4d-476e-b710-e16279cecc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:25.017865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-df73ae48-1b4d-476e-b710-e16279cecc4b None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:02:25.018635 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-df73ae48-1b4d-476e-b710-e16279cecc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:25.069111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae54757-403d-4d85-8d5b-af911aee4829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:25.069700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae54757-403d-4d85-8d5b-af911aee4829 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:25.070035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae54757-403d-4d85-8d5b-af911aee4829 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:25.070444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae54757-403d-4d85-8d5b-af911aee4829 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:25.071176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae54757-403d-4d85-8d5b-af911aee4829 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:25.073136 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae54757-403d-4d85-8d5b-af911aee4829 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:25.100465 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1636/3240] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:02:24 2022] POST /identity/v3/users => generated 287 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:02:25.111510 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae54757-403d-4d85-8d5b-af911aee4829 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:25.148183 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1605/3241] 10.222.0.33 () {58 vars in 967 bytes} [Sat Aug 6 21:02:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:02:25.150105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae54757-403d-4d85-8d5b-af911aee4829 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:25.155721 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722aeed1-5fde-4b4f-854d-4612cdb8c870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:25.156337 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722aeed1-5fde-4b4f-854d-4612cdb8c870 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:25.156640 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722aeed1-5fde-4b4f-854d-4612cdb8c870 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:25.156882 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722aeed1-5fde-4b4f-854d-4612cdb8c870 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:25.157527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722aeed1-5fde-4b4f-854d-4612cdb8c870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:25.159154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722aeed1-5fde-4b4f-854d-4612cdb8c870 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:25.182324 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1637/3242] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:02:25.183267 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73ae48-1b4d-476e-b710-e16279cecc4b None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:25.198005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73ae48-1b4d-476e-b710-e16279cecc4b None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:25.203407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f419b-a6b7-431f-9fd5-6f8e51766365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:25.204457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f419b-a6b7-431f-9fd5-6f8e51766365 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:25.204990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f419b-a6b7-431f-9fd5-6f8e51766365 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:25.205581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f419b-a6b7-431f-9fd5-6f8e51766365 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:25.206097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64f419b-a6b7-431f-9fd5-6f8e51766365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:25.208279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64f419b-a6b7-431f-9fd5-6f8e51766365 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:25.229177 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1606/3243] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:02:25.231974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722aeed1-5fde-4b4f-854d-4612cdb8c870 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:25.235427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-722aeed1-5fde-4b4f-854d-4612cdb8c870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:25.240104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f419b-a6b7-431f-9fd5-6f8e51766365 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:25.267587 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f419b-a6b7-431f-9fd5-6f8e51766365 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:25.288515 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12534294-9dee-455f-b522-9bd28614f9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:25.293832 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12534294-9dee-455f-b522-9bd28614f9b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:25.294761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12534294-9dee-455f-b522-9bd28614f9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:25.295446 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12534294-9dee-455f-b522-9bd28614f9b4 admin admin] PATH_INFO: `/v3/projects/ffc886269aa74ee69b2bfac2b2c76c8c/users/9b3c963664a94c5fba2aa0a0d6f50587/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:25.331754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12534294-9dee-455f-b522-9bd28614f9b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffc886269aa74ee69b2bfac2b2c76c8c, user_id=9b3c963664a94c5fba2aa0a0d6f50587, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:25.337753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12534294-9dee-455f-b522-9bd28614f9b4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:25.382029 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1607/3244] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:02:25 2022] PUT /identity/v3/projects/ffc886269aa74ee69b2bfac2b2c76c8c/users/9b3c963664a94c5fba2aa0a0d6f50587/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:02:25.384125 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88c275-1364-4a1f-a662-ebf4ed080271 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:25.384545 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88c275-1364-4a1f-a662-ebf4ed080271 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:25.384837 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88c275-1364-4a1f-a662-ebf4ed080271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:25.421155 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722aeed1-5fde-4b4f-854d-4612cdb8c870 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:25.446152 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-6a88c275-1364-4a1f-a662-ebf4ed080271 None None] MFA Rules not processed for user `9b3c963664a94c5fba2aa0a0d6f50587`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:02:25.458577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6a88c275-1364-4a1f-a662-ebf4ed080271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:25.545710 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d6e9c-4511-4e16-8be8-378dab66cd8e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:25.547077 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d6e9c-4511-4e16-8be8-378dab66cd8e service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:25.547647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d6e9c-4511-4e16-8be8-378dab66cd8e service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:25.548061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d6e9c-4511-4e16-8be8-378dab66cd8e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:25.579187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:25.650820 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1608/3245] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:02:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:02:25.668741 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d6e9c-4511-4e16-8be8-378dab66cd8e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:25.669685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88c275-1364-4a1f-a662-ebf4ed080271 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:25.669685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6a88c275-1364-4a1f-a662-ebf4ed080271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:25.671125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d6e9c-4511-4e16-8be8-378dab66cd8e service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:25.699593 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1638/3246] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:02:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:02:25.834209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:25.907965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88c275-1364-4a1f-a662-ebf4ed080271 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:25.922640 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423143d-e6ca-4d48-bff8-3e51191cc097 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:25.923287 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423143d-e6ca-4d48-bff8-3e51191cc097 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:25.923554 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423143d-e6ca-4d48-bff8-3e51191cc097 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:25.923908 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423143d-e6ca-4d48-bff8-3e51191cc097 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:25.943730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423143d-e6ca-4d48-bff8-3e51191cc097 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:25.952329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423143d-e6ca-4d48-bff8-3e51191cc097 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:25.973147 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1609/3247] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:02:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:02:27.163413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d6e9c-4511-4e16-8be8-378dab66cd8e service swift] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:27.220993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423143d-e6ca-4d48-bff8-3e51191cc097 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:27.222429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0423143d-e6ca-4d48-bff8-3e51191cc097 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:27.323207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d6e9c-4511-4e16-8be8-378dab66cd8e service swift] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:27.330448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a281ac4-3391-41ba-ad50-c35869b52fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:27.331887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a281ac4-3391-41ba-ad50-c35869b52fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:27.332863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a281ac4-3391-41ba-ad50-c35869b52fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:27.333354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a281ac4-3391-41ba-ad50-c35869b52fd5 admin admin] PATH_INFO: `/v3/users/9b3c963664a94c5fba2aa0a0d6f50587` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:27.335054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a281ac4-3391-41ba-ad50-c35869b52fd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b3c963664a94c5fba2aa0a0d6f50587)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:27.338526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a281ac4-3391-41ba-ad50-c35869b52fd5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:27.397716 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423143d-e6ca-4d48-bff8-3e51191cc097 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:27.405603 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c4f93-e997-4234-9f20-fccbb7f08beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:27.406679 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c4f93-e997-4234-9f20-fccbb7f08beb admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:27.407200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c4f93-e997-4234-9f20-fccbb7f08beb admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:27.407704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c4f93-e997-4234-9f20-fccbb7f08beb admin admin] PATH_INFO: `/v3/users/398134b8b4234816ae43a9230eae3c16` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:27.409106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c4f93-e997-4234-9f20-fccbb7f08beb admin admin] RBAC: Authorizing `identity:delete_user(user_id=398134b8b4234816ae43a9230eae3c16)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:27.411660 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c4f93-e997-4234-9f20-fccbb7f08beb admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:27.458298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4a281ac4-3391-41ba-ad50-c35869b52fd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b3c963664a94c5fba2aa0a0d6f50587'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:27.474464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4a281ac4-3391-41ba-ad50-c35869b52fd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b3c963664a94c5fba2aa0a0d6f50587'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:27.477679 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4a281ac4-3391-41ba-ad50-c35869b52fd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b3c963664a94c5fba2aa0a0d6f50587'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:27.478742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4a281ac4-3391-41ba-ad50-c35869b52fd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b3c963664a94c5fba2aa0a0d6f50587'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:27.494539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4a281ac4-3391-41ba-ad50-c35869b52fd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b3c963664a94c5fba2aa0a0d6f50587'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:27.508180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-473c4f93-e997-4234-9f20-fccbb7f08beb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '398134b8b4234816ae43a9230eae3c16'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:27.510303 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-473c4f93-e997-4234-9f20-fccbb7f08beb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '398134b8b4234816ae43a9230eae3c16'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:27.513646 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-473c4f93-e997-4234-9f20-fccbb7f08beb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '398134b8b4234816ae43a9230eae3c16'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:27.535448 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1639/3248] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:02:27 2022] DELETE /identity/v3/users/9b3c963664a94c5fba2aa0a0d6f50587 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:02:27.543503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ad8a4-2d9a-4e0d-9c92-53a058be4094 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:27.543788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ad8a4-2d9a-4e0d-9c92-53a058be4094 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:27.544094 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ad8a4-2d9a-4e0d-9c92-53a058be4094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:27.545387 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-473c4f93-e997-4234-9f20-fccbb7f08beb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '398134b8b4234816ae43a9230eae3c16'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:27.578083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-473c4f93-e997-4234-9f20-fccbb7f08beb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '398134b8b4234816ae43a9230eae3c16'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:27.585616 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-c42ad8a4-2d9a-4e0d-9c92-53a058be4094 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:02:27.586884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c42ad8a4-2d9a-4e0d-9c92-53a058be4094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:27.613148 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1610/3249] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:02:27 2022] DELETE /identity/v3/users/398134b8b4234816ae43a9230eae3c16 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:02:27.702164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:27.769213 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1640/3250] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:02:27.802770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c4f93-e997-4234-9f20-fccbb7f08beb admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:27.804670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-473c4f93-e997-4234-9f20-fccbb7f08beb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:27.918411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c4f93-e997-4234-9f20-fccbb7f08beb admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:27.925627 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f62d3-cea6-4795-9b28-385f2b633098 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:27.926657 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f62d3-cea6-4795-9b28-385f2b633098 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:27.927827 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f62d3-cea6-4795-9b28-385f2b633098 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:27.928213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f62d3-cea6-4795-9b28-385f2b633098 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:27.947153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:28.018055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ad8a4-2d9a-4e0d-9c92-53a058be4094 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:28.022826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c42ad8a4-2d9a-4e0d-9c92-53a058be4094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:28.050464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ad8a4-2d9a-4e0d-9c92-53a058be4094 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:28.121444 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f62d3-cea6-4795-9b28-385f2b633098 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:28.124249 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f62d3-cea6-4795-9b28-385f2b633098 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:28.148241 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1611/3251] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:02:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:02:28.225198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0986db6-b816-4fe3-be5c-24b46169e838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:28.225770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0986db6-b816-4fe3-be5c-24b46169e838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:28.226238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0986db6-b816-4fe3-be5c-24b46169e838 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:28.226723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0986db6-b816-4fe3-be5c-24b46169e838 admin admin] PATH_INFO: `/v3/projects/5a30ae4cede34e428cc6468b7a073497` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:28.230595 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0986db6-b816-4fe3-be5c-24b46169e838 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a30ae4cede34e428cc6468b7a073497)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:28.234382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0986db6-b816-4fe3-be5c-24b46169e838 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:28.333931 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f0986db6-b816-4fe3-be5c-24b46169e838 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a30ae4cede34e428cc6468b7a073497', 'request_id': 'req-f0986db6-b816-4fe3-be5c-24b46169e838'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:28.343134 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f0986db6-b816-4fe3-be5c-24b46169e838 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a30ae4cede34e428cc6468b7a073497', 'request_id': 'req-f0986db6-b816-4fe3-be5c-24b46169e838'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:28.355807 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f0986db6-b816-4fe3-be5c-24b46169e838 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a30ae4cede34e428cc6468b7a073497', 'request_id': 'req-f0986db6-b816-4fe3-be5c-24b46169e838'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:28.375348 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f0986db6-b816-4fe3-be5c-24b46169e838 admin admin] The token cache is being invalidate because project 5a30ae4cede34e428cc6468b7a073497 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:02:28.375651 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f0986db6-b816-4fe3-be5c-24b46169e838 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:28.377551 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f0986db6-b816-4fe3-be5c-24b46169e838 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:28.379501 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1641/3252] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:02:28 2022] DELETE /identity/v3/projects/5a30ae4cede34e428cc6468b7a073497 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:02:28.384554 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e02bc-12c5-4d18-920b-4febd41fd38a None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:28.385006 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e02bc-12c5-4d18-920b-4febd41fd38a None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:28.385112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e02bc-12c5-4d18-920b-4febd41fd38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:28.428900 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-777e02bc-12c5-4d18-920b-4febd41fd38a None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:02:28.433340 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-777e02bc-12c5-4d18-920b-4febd41fd38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:28.537249 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1612/3253] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:02:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:02:28.545970 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b50a31-6250-46cb-8c7b-9fc8fb4ea077 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:28.546261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b50a31-6250-46cb-8c7b-9fc8fb4ea077 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:28.546579 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b50a31-6250-46cb-8c7b-9fc8fb4ea077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:28.583728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-31b50a31-6250-46cb-8c7b-9fc8fb4ea077 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:02:28.585213 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-31b50a31-6250-46cb-8c7b-9fc8fb4ea077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:28.607531 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1642/3254] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:02:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:02:28.611052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e02bc-12c5-4d18-920b-4febd41fd38a None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:28.629337 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e02bc-12c5-4d18-920b-4febd41fd38a None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:28.637088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517fb1d-b524-47a2-8ba9-70e3359d94e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:28.638767 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517fb1d-b524-47a2-8ba9-70e3359d94e6 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:28.639254 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517fb1d-b524-47a2-8ba9-70e3359d94e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:28.639675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517fb1d-b524-47a2-8ba9-70e3359d94e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:28.640816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f517fb1d-b524-47a2-8ba9-70e3359d94e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:02:28.641186 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f517fb1d-b524-47a2-8ba9-70e3359d94e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:28.644203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f517fb1d-b524-47a2-8ba9-70e3359d94e6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:28.669153 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1613/3255] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:02:28.676332 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b50a31-6250-46cb-8c7b-9fc8fb4ea077 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:28.699129 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b50a31-6250-46cb-8c7b-9fc8fb4ea077 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:28.706287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed97da9-e2c6-4313-b6af-a028277b093f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:28.707359 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed97da9-e2c6-4313-b6af-a028277b093f admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:28.708321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed97da9-e2c6-4313-b6af-a028277b093f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:28.708696 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed97da9-e2c6-4313-b6af-a028277b093f admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:28.709496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed97da9-e2c6-4313-b6af-a028277b093f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:28.711804 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed97da9-e2c6-4313-b6af-a028277b093f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:28.776229 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1643/3256] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:02:28 2022] POST /identity/v3/projects => generated 395 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:02:28.777568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517fb1d-b524-47a2-8ba9-70e3359d94e6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:28.793759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517fb1d-b524-47a2-8ba9-70e3359d94e6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:28.940972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f29cf-919e-4a10-98bc-bef094fad5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:28.941672 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f29cf-919e-4a10-98bc-bef094fad5ea admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:28.941953 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f29cf-919e-4a10-98bc-bef094fad5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:28.942221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f29cf-919e-4a10-98bc-bef094fad5ea admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:28.943067 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f29cf-919e-4a10-98bc-bef094fad5ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:28.944828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f29cf-919e-4a10-98bc-bef094fad5ea admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:28.988142 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1614/3257] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:02:28 2022] POST /identity/v3/users => generated 298 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:02:28.991178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed97da9-e2c6-4313-b6af-a028277b093f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:29.019078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed97da9-e2c6-4313-b6af-a028277b093f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:29.039325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8551dd-4369-4869-9b77-f4456205121e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:29.041420 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8551dd-4369-4869-9b77-f4456205121e admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:29.042086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8551dd-4369-4869-9b77-f4456205121e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:29.042194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8551dd-4369-4869-9b77-f4456205121e admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:29.043227 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8551dd-4369-4869-9b77-f4456205121e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:29.044803 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8551dd-4369-4869-9b77-f4456205121e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:29.059798 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1644/3258] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:02:29.064316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f29cf-919e-4a10-98bc-bef094fad5ea admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:29.079629 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f29cf-919e-4a10-98bc-bef094fad5ea admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:29.087805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb47a1-3323-46ef-9e70-489f941ab5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:29.088821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb47a1-3323-46ef-9e70-489f941ab5cf admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:29.089286 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb47a1-3323-46ef-9e70-489f941ab5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:29.089779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb47a1-3323-46ef-9e70-489f941ab5cf admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:29.090864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb47a1-3323-46ef-9e70-489f941ab5cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:29.094975 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb47a1-3323-46ef-9e70-489f941ab5cf admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:29.111314 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1615/3259] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:02:29.113034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8551dd-4369-4869-9b77-f4456205121e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:29.141316 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8551dd-4369-4869-9b77-f4456205121e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:29.149269 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08225f13-367c-40c4-92e1-94f89384f402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:29.149949 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08225f13-367c-40c4-92e1-94f89384f402 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:29.150252 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08225f13-367c-40c4-92e1-94f89384f402 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:29.150494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08225f13-367c-40c4-92e1-94f89384f402 admin admin] PATH_INFO: `/v3/projects/ce57444bd40e42f4bf88177067f756b0/users/0902f98ad0254cc48ff7e0e5469e8f2d/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:29.179729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08225f13-367c-40c4-92e1-94f89384f402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce57444bd40e42f4bf88177067f756b0, user_id=0902f98ad0254cc48ff7e0e5469e8f2d, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:29.183197 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08225f13-367c-40c4-92e1-94f89384f402 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:29.211495 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1645/3260] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:02:29 2022] PUT /identity/v3/projects/ce57444bd40e42f4bf88177067f756b0/users/0902f98ad0254cc48ff7e0e5469e8f2d/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:02:29.216816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64281a5-ac39-42d8-ae37-66051bd97088 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:29.217052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64281a5-ac39-42d8-ae37-66051bd97088 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:29.217329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64281a5-ac39-42d8-ae37-66051bd97088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:29.267828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f64281a5-ac39-42d8-ae37-66051bd97088 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:02:29.272383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f64281a5-ac39-42d8-ae37-66051bd97088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:29.279449 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:29.381234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08225f13-367c-40c4-92e1-94f89384f402 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:29.383308 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-08225f13-367c-40c4-92e1-94f89384f402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:29.400098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:29.437379 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1616/3261] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:02:29.466387 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64281a5-ac39-42d8-ae37-66051bd97088 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:29.468686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f64281a5-ac39-42d8-ae37-66051bd97088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:29.590227 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08225f13-367c-40c4-92e1-94f89384f402 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:29.603573 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de153397-4894-42ec-bb9f-b6a372313147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:29.604542 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de153397-4894-42ec-bb9f-b6a372313147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:29.604822 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de153397-4894-42ec-bb9f-b6a372313147 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:29.606230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de153397-4894-42ec-bb9f-b6a372313147 admin admin] PATH_INFO: `/v3/projects/ffc886269aa74ee69b2bfac2b2c76c8c` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:29.609328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de153397-4894-42ec-bb9f-b6a372313147 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffc886269aa74ee69b2bfac2b2c76c8c)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:29.611511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de153397-4894-42ec-bb9f-b6a372313147 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:29.654140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64281a5-ac39-42d8-ae37-66051bd97088 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:29.678717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ade6cb-6b09-4465-9a3a-34cf23c609f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:29.679387 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ade6cb-6b09-4465-9a3a-34cf23c609f9 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:29.679662 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ade6cb-6b09-4465-9a3a-34cf23c609f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:29.680386 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ade6cb-6b09-4465-9a3a-34cf23c609f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:29.730935 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ade6cb-6b09-4465-9a3a-34cf23c609f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:29.738348 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ade6cb-6b09-4465-9a3a-34cf23c609f9 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:29.761901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-de153397-4894-42ec-bb9f-b6a372313147 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffc886269aa74ee69b2bfac2b2c76c8c', 'request_id': 'req-de153397-4894-42ec-bb9f-b6a372313147'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:29.773419 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1617/3262] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:02:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:02:29.782488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-de153397-4894-42ec-bb9f-b6a372313147 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffc886269aa74ee69b2bfac2b2c76c8c', 'request_id': 'req-de153397-4894-42ec-bb9f-b6a372313147'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:29.825822 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-de153397-4894-42ec-bb9f-b6a372313147 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffc886269aa74ee69b2bfac2b2c76c8c', 'request_id': 'req-de153397-4894-42ec-bb9f-b6a372313147'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:29.855444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-de153397-4894-42ec-bb9f-b6a372313147 admin admin] The token cache is being invalidate because project ffc886269aa74ee69b2bfac2b2c76c8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:02:29.855677 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-de153397-4894-42ec-bb9f-b6a372313147 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:29.857178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-de153397-4894-42ec-bb9f-b6a372313147 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:29.859362 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1646/3263] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:02:29 2022] DELETE /identity/v3/projects/ffc886269aa74ee69b2bfac2b2c76c8c => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:02:29.866753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d326f-88cb-4f47-b394-514dc74e8a4c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:29.867378 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d326f-88cb-4f47-b394-514dc74e8a4c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:29.867820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d326f-88cb-4f47-b394-514dc74e8a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:29.913669 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-746d326f-88cb-4f47-b394-514dc74e8a4c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:02:29.919310 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-746d326f-88cb-4f47-b394-514dc74e8a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:30.237319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63760e5-f89d-4a48-8fe0-d74335ded9be None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:30.237991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63760e5-f89d-4a48-8fe0-d74335ded9be None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:30.238629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63760e5-f89d-4a48-8fe0-d74335ded9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:30.244493 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1618/3264] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:02:30.283928 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-c63760e5-f89d-4a48-8fe0-d74335ded9be None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:02:30.285418 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c63760e5-f89d-4a48-8fe0-d74335ded9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:30.312221 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1647/3265] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:02:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:02:30.316622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d326f-88cb-4f47-b394-514dc74e8a4c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:30.330415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d326f-88cb-4f47-b394-514dc74e8a4c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:30.351594 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd8294-5e14-4da4-94e3-06f2d4bd82b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:30.351594 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd8294-5e14-4da4-94e3-06f2d4bd82b3 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:30.351594 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd8294-5e14-4da4-94e3-06f2d4bd82b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:30.351594 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd8294-5e14-4da4-94e3-06f2d4bd82b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:30.352026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd8294-5e14-4da4-94e3-06f2d4bd82b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:02:30.352026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd8294-5e14-4da4-94e3-06f2d4bd82b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:30.353342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd8294-5e14-4da4-94e3-06f2d4bd82b3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:30.377830 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1619/3266] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:02:30.382918 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63760e5-f89d-4a48-8fe0-d74335ded9be None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:30.396967 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63760e5-f89d-4a48-8fe0-d74335ded9be None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:30.410305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f89d4-df1b-4ebe-b3f1-6f1c291da8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:30.411093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f89d4-df1b-4ebe-b3f1-6f1c291da8dd admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:30.411469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f89d4-df1b-4ebe-b3f1-6f1c291da8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:30.411859 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f89d4-df1b-4ebe-b3f1-6f1c291da8dd admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:30.412580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f89d4-df1b-4ebe-b3f1-6f1c291da8dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:30.417211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f89d4-df1b-4ebe-b3f1-6f1c291da8dd admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:30.490256 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1648/3267] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:02:30 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:02:30.490627 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd8294-5e14-4da4-94e3-06f2d4bd82b3 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:30.516288 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd8294-5e14-4da4-94e3-06f2d4bd82b3 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:30.628012 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:30.673279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a73df9-b318-4c6b-a24e-c2648f3a56b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:30.673485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a73df9-b318-4c6b-a24e-c2648f3a56b6 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:30.673593 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a73df9-b318-4c6b-a24e-c2648f3a56b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:30.673868 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a73df9-b318-4c6b-a24e-c2648f3a56b6 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:30.675102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a73df9-b318-4c6b-a24e-c2648f3a56b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:30.680629 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a73df9-b318-4c6b-a24e-c2648f3a56b6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:30.753429 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1620/3268] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:02:30 2022] POST /identity/v3/users => generated 287 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:02:30.755093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f89d4-df1b-4ebe-b3f1-6f1c291da8dd admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:30.768793 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f89d4-df1b-4ebe-b3f1-6f1c291da8dd admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:30.784691 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c752aa-0741-4b92-bcf7-7b4f750dfe72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:30.785324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c752aa-0741-4b92-bcf7-7b4f750dfe72 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:30.785602 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c752aa-0741-4b92-bcf7-7b4f750dfe72 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:30.785874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c752aa-0741-4b92-bcf7-7b4f750dfe72 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:30.786520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c752aa-0741-4b92-bcf7-7b4f750dfe72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:30.788781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c752aa-0741-4b92-bcf7-7b4f750dfe72 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:30.804976 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1649/3269] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:02:30.811939 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a73df9-b318-4c6b-a24e-c2648f3a56b6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:30.833113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a73df9-b318-4c6b-a24e-c2648f3a56b6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:30.844210 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b88b6-4e1f-4905-9c8e-4cb40bf38da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:30.847278 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b88b6-4e1f-4905-9c8e-4cb40bf38da3 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:30.848077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b88b6-4e1f-4905-9c8e-4cb40bf38da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:30.848566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b88b6-4e1f-4905-9c8e-4cb40bf38da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:30.853027 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b88b6-4e1f-4905-9c8e-4cb40bf38da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:30.855361 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b88b6-4e1f-4905-9c8e-4cb40bf38da3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:30.876986 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1621/3270] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:02:30.881433 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c752aa-0741-4b92-bcf7-7b4f750dfe72 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:30.898620 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c752aa-0741-4b92-bcf7-7b4f750dfe72 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:30.906257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a37d9-1c73-4c7c-822d-5903cf7fc9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:30.907819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a37d9-1c73-4c7c-822d-5903cf7fc9d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:30.907819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a37d9-1c73-4c7c-822d-5903cf7fc9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:30.907819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a37d9-1c73-4c7c-822d-5903cf7fc9d8 admin admin] PATH_INFO: `/v3/projects/58e12fc91a56482d96deeb5001c85322/users/66488ec9cca7421cb91ba817f2cb218c/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:30.957741 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a37d9-1c73-4c7c-822d-5903cf7fc9d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58e12fc91a56482d96deeb5001c85322, user_id=66488ec9cca7421cb91ba817f2cb218c, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:30.960776 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a37d9-1c73-4c7c-822d-5903cf7fc9d8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:31.014573 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1650/3271] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:02:30 2022] PUT /identity/v3/projects/58e12fc91a56482d96deeb5001c85322/users/66488ec9cca7421cb91ba817f2cb218c/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:02:31.031185 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479f78d-11c0-41c6-a581-31a2a64d6e19 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:31.031476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479f78d-11c0-41c6-a581-31a2a64d6e19 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:31.031822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479f78d-11c0-41c6-a581-31a2a64d6e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:31.075823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-1479f78d-11c0-41c6-a581-31a2a64d6e19 None None] MFA Rules not processed for user `66488ec9cca7421cb91ba817f2cb218c`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:02:31.077341 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1479f78d-11c0-41c6-a581-31a2a64d6e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:31.232333 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1622/3272] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:02:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:02:31.247307 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a37d9-1c73-4c7c-822d-5903cf7fc9d8 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:31.250211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-df4a37d9-1c73-4c7c-822d-5903cf7fc9d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:31.320378 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:31.423871 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a37d9-1c73-4c7c-822d-5903cf7fc9d8 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:31.438379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b850f6b-816a-4639-95c5-cb30f78e3a70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:31.439076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b850f6b-816a-4639-95c5-cb30f78e3a70 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:31.439352 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b850f6b-816a-4639-95c5-cb30f78e3a70 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:31.441151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b850f6b-816a-4639-95c5-cb30f78e3a70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:31.460827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b850f6b-816a-4639-95c5-cb30f78e3a70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:31.463396 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b850f6b-816a-4639-95c5-cb30f78e3a70 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:31.478994 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1651/3273] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:02:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:02:32.086847 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553cce19-877c-4e22-8d3a-f8ba9b0917fc None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:32.087320 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553cce19-877c-4e22-8d3a-f8ba9b0917fc None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:32.087644 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553cce19-877c-4e22-8d3a-f8ba9b0917fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:32.157099 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-553cce19-877c-4e22-8d3a-f8ba9b0917fc None None] MFA Rules not processed for user `78f7a58ae0b24b6a9aca96713dfe99b4`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:02:32.158406 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-553cce19-877c-4e22-8d3a-f8ba9b0917fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:32.274132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b850f6b-816a-4639-95c5-cb30f78e3a70 service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:32.274334 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1623/3274] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:02:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:02:32.276112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9b850f6b-816a-4639-95c5-cb30f78e3a70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:32.587765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b850f6b-816a-4639-95c5-cb30f78e3a70 service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:32.606167 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1418f5-a397-45f6-9b76-2589ec7dc368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:32.608695 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1418f5-a397-45f6-9b76-2589ec7dc368 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:32.609299 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1418f5-a397-45f6-9b76-2589ec7dc368 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:32.611646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1418f5-a397-45f6-9b76-2589ec7dc368 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:32.612248 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1418f5-a397-45f6-9b76-2589ec7dc368 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:32.616045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1418f5-a397-45f6-9b76-2589ec7dc368 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:32.693438 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1652/3275] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:02:32 2022] POST /identity/v3/projects => generated 377 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:02:32.695346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553cce19-877c-4e22-8d3a-f8ba9b0917fc None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:32.725277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553cce19-877c-4e22-8d3a-f8ba9b0917fc None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:32.846112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:32.953759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de14342-964f-4f6f-9d9c-a1429a1101ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:32.953759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de14342-964f-4f6f-9d9c-a1429a1101ea admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:32.953759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de14342-964f-4f6f-9d9c-a1429a1101ea admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:32.955055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de14342-964f-4f6f-9d9c-a1429a1101ea admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:32.955257 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de14342-964f-4f6f-9d9c-a1429a1101ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:32.963626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de14342-964f-4f6f-9d9c-a1429a1101ea admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:33.011138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1418f5-a397-45f6-9b76-2589ec7dc368 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:33.017256 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1624/3276] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:02:32 2022] POST /identity/v3/users => generated 295 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:02:33.021817 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de14342-964f-4f6f-9d9c-a1429a1101ea admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:33.027533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1418f5-a397-45f6-9b76-2589ec7dc368 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:33.043250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de14342-964f-4f6f-9d9c-a1429a1101ea admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:33.045773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e651f95-d2d6-4255-9f63-0bb5abf0f352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:33.046591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e651f95-d2d6-4255-9f63-0bb5abf0f352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:33.047009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e651f95-d2d6-4255-9f63-0bb5abf0f352 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:33.047286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e651f95-d2d6-4255-9f63-0bb5abf0f352 admin admin] PATH_INFO: `/v3/users/66488ec9cca7421cb91ba817f2cb218c` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:33.051924 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e651f95-d2d6-4255-9f63-0bb5abf0f352 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66488ec9cca7421cb91ba817f2cb218c)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:33.054583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e651f95-d2d6-4255-9f63-0bb5abf0f352 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:33.072287 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec367faa-450f-47b7-825c-dd2873251a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:33.072924 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec367faa-450f-47b7-825c-dd2873251a97 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:33.073204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec367faa-450f-47b7-825c-dd2873251a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:33.073476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec367faa-450f-47b7-825c-dd2873251a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:33.074143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec367faa-450f-47b7-825c-dd2873251a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:33.076690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec367faa-450f-47b7-825c-dd2873251a97 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:33.109305 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1625/3277] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:02:33.110299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec367faa-450f-47b7-825c-dd2873251a97 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:33.135029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec367faa-450f-47b7-825c-dd2873251a97 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:33.152493 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7dd8e-be28-4ed2-9968-c55af3dd9cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:33.152755 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7dd8e-be28-4ed2-9968-c55af3dd9cb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:33.152973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7dd8e-be28-4ed2-9968-c55af3dd9cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:33.153255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7dd8e-be28-4ed2-9968-c55af3dd9cb6 admin admin] PATH_INFO: `/v3/projects/8bd254c943c1499e88f92af865635df0/users/f06e774b04164833ab25fb139011fb0b/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:33.161705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2e651f95-d2d6-4255-9f63-0bb5abf0f352 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66488ec9cca7421cb91ba817f2cb218c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:33.173427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2e651f95-d2d6-4255-9f63-0bb5abf0f352 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66488ec9cca7421cb91ba817f2cb218c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:33.174255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2e651f95-d2d6-4255-9f63-0bb5abf0f352 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66488ec9cca7421cb91ba817f2cb218c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:33.175995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2e651f95-d2d6-4255-9f63-0bb5abf0f352 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66488ec9cca7421cb91ba817f2cb218c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:33.191319 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7dd8e-be28-4ed2-9968-c55af3dd9cb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bd254c943c1499e88f92af865635df0, user_id=f06e774b04164833ab25fb139011fb0b, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:33.194101 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7dd8e-be28-4ed2-9968-c55af3dd9cb6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:33.198147 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2e651f95-d2d6-4255-9f63-0bb5abf0f352 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66488ec9cca7421cb91ba817f2cb218c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:33.228737 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1626/3278] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:02:33 2022] PUT /identity/v3/projects/8bd254c943c1499e88f92af865635df0/users/f06e774b04164833ab25fb139011fb0b/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:02:33.229840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7dd8e-be28-4ed2-9968-c55af3dd9cb6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:33.237528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-94d7dd8e-be28-4ed2-9968-c55af3dd9cb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:33.320696 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1653/3279] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:02:33 2022] DELETE /identity/v3/users/66488ec9cca7421cb91ba817f2cb218c => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:02:33.333006 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942e0b0-3970-4f41-aff4-d4448de81674 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:33.333618 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942e0b0-3970-4f41-aff4-d4448de81674 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:33.334091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942e0b0-3970-4f41-aff4-d4448de81674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:33.395950 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a942e0b0-3970-4f41-aff4-d4448de81674 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:02:33.398528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7dd8e-be28-4ed2-9968-c55af3dd9cb6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:33.402075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a942e0b0-3970-4f41-aff4-d4448de81674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:33.436981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:33.579520 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7caea-78ba-4eaa-8503-9e605828c82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:33.581287 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7caea-78ba-4eaa-8503-9e605828c82c admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:33.582066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7caea-78ba-4eaa-8503-9e605828c82c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:33.582917 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7caea-78ba-4eaa-8503-9e605828c82c admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:33.583685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d7caea-78ba-4eaa-8503-9e605828c82c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:33.585926 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1654/3280] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:02:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:02:33.587076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d7caea-78ba-4eaa-8503-9e605828c82c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:33.608078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942e0b0-3970-4f41-aff4-d4448de81674 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:33.630885 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1627/3281] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:02:33.634045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942e0b0-3970-4f41-aff4-d4448de81674 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:33.657895 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cda61d-50ff-41b5-a3fb-899c228f28d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:33.661022 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cda61d-50ff-41b5-a3fb-899c228f28d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:33.662720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cda61d-50ff-41b5-a3fb-899c228f28d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:33.663926 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cda61d-50ff-41b5-a3fb-899c228f28d0 admin admin] PATH_INFO: `/v3/projects/8bd254c943c1499e88f92af865635df0/users/f06e774b04164833ab25fb139011fb0b/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:33.675953 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7caea-78ba-4eaa-8503-9e605828c82c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:33.685531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-48d7caea-78ba-4eaa-8503-9e605828c82c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:33.692178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cda61d-50ff-41b5-a3fb-899c228f28d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bd254c943c1499e88f92af865635df0, user_id=f06e774b04164833ab25fb139011fb0b, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:33.700794 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cda61d-50ff-41b5-a3fb-899c228f28d0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:33.760057 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1655/3282] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:02:33 2022] PUT /identity/v3/projects/8bd254c943c1499e88f92af865635df0/users/f06e774b04164833ab25fb139011fb0b/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:02:33.803631 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:33.851334 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7caea-78ba-4eaa-8503-9e605828c82c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:33.961349 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860513e6-41de-4c56-9b75-9ac755f44ac7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:33.961349 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860513e6-41de-4c56-9b75-9ac755f44ac7 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:33.961794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860513e6-41de-4c56-9b75-9ac755f44ac7 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:33.962112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860513e6-41de-4c56-9b75-9ac755f44ac7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:34.124171 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860513e6-41de-4c56-9b75-9ac755f44ac7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:34.126492 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860513e6-41de-4c56-9b75-9ac755f44ac7 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:34.145166 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1628/3283] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:02:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:02:36.389865 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cda61d-50ff-41b5-a3fb-899c228f28d0 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:36.392736 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-26cda61d-50ff-41b5-a3fb-899c228f28d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:36.465079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cda61d-50ff-41b5-a3fb-899c228f28d0 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:36.476120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758aeae3-dd47-4ffb-b3ec-c5db44ba6508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:36.477201 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758aeae3-dd47-4ffb-b3ec-c5db44ba6508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:36.478017 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758aeae3-dd47-4ffb-b3ec-c5db44ba6508 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:36.478475 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758aeae3-dd47-4ffb-b3ec-c5db44ba6508 admin admin] PATH_INFO: `/v3/projects/58e12fc91a56482d96deeb5001c85322` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:36.480148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758aeae3-dd47-4ffb-b3ec-c5db44ba6508 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58e12fc91a56482d96deeb5001c85322)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:36.484596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758aeae3-dd47-4ffb-b3ec-c5db44ba6508 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:36.571423 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-758aeae3-dd47-4ffb-b3ec-c5db44ba6508 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58e12fc91a56482d96deeb5001c85322', 'request_id': 'req-758aeae3-dd47-4ffb-b3ec-c5db44ba6508'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:36.579811 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-758aeae3-dd47-4ffb-b3ec-c5db44ba6508 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58e12fc91a56482d96deeb5001c85322', 'request_id': 'req-758aeae3-dd47-4ffb-b3ec-c5db44ba6508'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:36.598291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-758aeae3-dd47-4ffb-b3ec-c5db44ba6508 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58e12fc91a56482d96deeb5001c85322', 'request_id': 'req-758aeae3-dd47-4ffb-b3ec-c5db44ba6508'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:36.619703 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-758aeae3-dd47-4ffb-b3ec-c5db44ba6508 admin admin] The token cache is being invalidate because project 58e12fc91a56482d96deeb5001c85322 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:02:36.620162 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-758aeae3-dd47-4ffb-b3ec-c5db44ba6508 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:36.620870 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-758aeae3-dd47-4ffb-b3ec-c5db44ba6508 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:36.627559 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1656/3284] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:02:36 2022] DELETE /identity/v3/projects/58e12fc91a56482d96deeb5001c85322 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:02:36.629609 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979d2da-ac55-4869-9083-2d323b9fdcad None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:36.630079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979d2da-ac55-4869-9083-2d323b9fdcad None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:36.630176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979d2da-ac55-4869-9083-2d323b9fdcad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:36.692594 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-0979d2da-ac55-4869-9083-2d323b9fdcad None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:02:36.694015 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0979d2da-ac55-4869-9083-2d323b9fdcad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:36.858108 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1629/3285] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:02:36.865061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c0edd-9681-400b-8e3f-9cf28e3a62e8 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:36.865400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c0edd-9681-400b-8e3f-9cf28e3a62e8 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:36.866255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c0edd-9681-400b-8e3f-9cf28e3a62e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:36.941704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-1f4c0edd-9681-400b-8e3f-9cf28e3a62e8 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:02:36.946709 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1f4c0edd-9681-400b-8e3f-9cf28e3a62e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:36.962596 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1657/3286] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:02:36.964583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979d2da-ac55-4869-9083-2d323b9fdcad None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:36.988115 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979d2da-ac55-4869-9083-2d323b9fdcad None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:36.998937 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8415c-f251-461f-81d8-2534de3f4715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:36.999999 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8415c-f251-461f-81d8-2534de3f4715 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:37.000338 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8415c-f251-461f-81d8-2534de3f4715 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:37.000613 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8415c-f251-461f-81d8-2534de3f4715 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:37.001598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8415c-f251-461f-81d8-2534de3f4715 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:02:37.001598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8415c-f251-461f-81d8-2534de3f4715 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:37.006111 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8415c-f251-461f-81d8-2534de3f4715 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:37.033436 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1630/3287] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:02:37.037769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c0edd-9681-400b-8e3f-9cf28e3a62e8 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:37.050807 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c0edd-9681-400b-8e3f-9cf28e3a62e8 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:37.057349 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97003a4-28b9-4a53-b999-f0636c1648e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:37.057966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97003a4-28b9-4a53-b999-f0636c1648e9 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:37.058324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97003a4-28b9-4a53-b999-f0636c1648e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:37.059106 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97003a4-28b9-4a53-b999-f0636c1648e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:37.059860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97003a4-28b9-4a53-b999-f0636c1648e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:37.062210 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97003a4-28b9-4a53-b999-f0636c1648e9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:37.135254 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1658/3288] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:02:37 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:02:37.139885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8415c-f251-461f-81d8-2534de3f4715 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:37.161755 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8415c-f251-461f-81d8-2534de3f4715 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:37.228251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:37.298856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d537a-379d-4cea-b3a7-efaee5428cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:37.299480 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d537a-379d-4cea-b3a7-efaee5428cb3 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:37.300023 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d537a-379d-4cea-b3a7-efaee5428cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:37.300357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d537a-379d-4cea-b3a7-efaee5428cb3 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:37.300984 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d537a-379d-4cea-b3a7-efaee5428cb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:37.304773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d537a-379d-4cea-b3a7-efaee5428cb3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:37.338432 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1631/3289] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:02:37 2022] POST /identity/v3/users => generated 283 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:02:37.340418 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97003a4-28b9-4a53-b999-f0636c1648e9 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:37.367076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97003a4-28b9-4a53-b999-f0636c1648e9 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:37.380667 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29f9de-d72e-452d-8f77-6dff91ff9f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:37.381772 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29f9de-d72e-452d-8f77-6dff91ff9f82 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:37.382197 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29f9de-d72e-452d-8f77-6dff91ff9f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:37.382668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29f9de-d72e-452d-8f77-6dff91ff9f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:37.383908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29f9de-d72e-452d-8f77-6dff91ff9f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:37.385834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29f9de-d72e-452d-8f77-6dff91ff9f82 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:37.426165 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d537a-379d-4cea-b3a7-efaee5428cb3 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:37.426523 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1659/3290] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:02:37.452264 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d537a-379d-4cea-b3a7-efaee5428cb3 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:37.460574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98b0b0-a6bc-43d3-91f6-f28f791d0bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:37.461380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98b0b0-a6bc-43d3-91f6-f28f791d0bae admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:37.462614 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98b0b0-a6bc-43d3-91f6-f28f791d0bae admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:37.465281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98b0b0-a6bc-43d3-91f6-f28f791d0bae admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:37.466178 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98b0b0-a6bc-43d3-91f6-f28f791d0bae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:37.468413 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98b0b0-a6bc-43d3-91f6-f28f791d0bae admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:37.495396 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29f9de-d72e-452d-8f77-6dff91ff9f82 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:37.502439 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1632/3291] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:02:37.508204 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29f9de-d72e-452d-8f77-6dff91ff9f82 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:37.515469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eade991-38b7-4ca9-8bfc-b2850e3074ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:37.516907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eade991-38b7-4ca9-8bfc-b2850e3074ce admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:37.517384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eade991-38b7-4ca9-8bfc-b2850e3074ce admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:37.517805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eade991-38b7-4ca9-8bfc-b2850e3074ce admin admin] PATH_INFO: `/v3/projects/24244713faa54507b5973eea5083a635/users/5fbf3973b1d3431f9682be0eb6d8948a/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:37.544520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eade991-38b7-4ca9-8bfc-b2850e3074ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=24244713faa54507b5973eea5083a635, user_id=5fbf3973b1d3431f9682be0eb6d8948a, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:37.548318 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eade991-38b7-4ca9-8bfc-b2850e3074ce admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:37.572062 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1660/3292] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:02:37 2022] PUT /identity/v3/projects/24244713faa54507b5973eea5083a635/users/5fbf3973b1d3431f9682be0eb6d8948a/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:02:37.578341 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb77d0c-04c5-4e41-a0f7-7177d323e7f0 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:37.578840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb77d0c-04c5-4e41-a0f7-7177d323e7f0 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:37.579016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb77d0c-04c5-4e41-a0f7-7177d323e7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:37.609848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-7eb77d0c-04c5-4e41-a0f7-7177d323e7f0 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:02:37.611298 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7eb77d0c-04c5-4e41-a0f7-7177d323e7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:37.714851 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1633/3293] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:02:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:02:37.735396 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eade991-38b7-4ca9-8bfc-b2850e3074ce admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:37.737695 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5eade991-38b7-4ca9-8bfc-b2850e3074ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:37.804441 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:37.894999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eade991-38b7-4ca9-8bfc-b2850e3074ce admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:37.902277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5025d-525d-4c07-897a-c068b79f2a38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:37.904590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5025d-525d-4c07-897a-c068b79f2a38 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:37.905148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5025d-525d-4c07-897a-c068b79f2a38 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:37.905696 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5025d-525d-4c07-897a-c068b79f2a38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:37.928647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5025d-525d-4c07-897a-c068b79f2a38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:37.931279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5025d-525d-4c07-897a-c068b79f2a38 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:37.956609 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1661/3294] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:02:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:02:43.227085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d87bb-806f-4bc2-a239-2b6e1a6680c4 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:43.229473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d87bb-806f-4bc2-a239-2b6e1a6680c4 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:43.230894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d87bb-806f-4bc2-a239-2b6e1a6680c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:43.293245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-9a9d87bb-806f-4bc2-a239-2b6e1a6680c4 None None] MFA Rules not processed for user `0902f98ad0254cc48ff7e0e5469e8f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:02:43.296274 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9a9d87bb-806f-4bc2-a239-2b6e1a6680c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:43.426702 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1634/3295] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:02:43 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:02:43.435075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98357af-26b1-41cf-a581-423b7b724f27 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:43.436746 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98357af-26b1-41cf-a581-423b7b724f27 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:43.436746 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98357af-26b1-41cf-a581-423b7b724f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:43.466597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-f98357af-26b1-41cf-a581-423b7b724f27 None None] MFA Rules not processed for user `0902f98ad0254cc48ff7e0e5469e8f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:02:43.469072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f98357af-26b1-41cf-a581-423b7b724f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:43.480100 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1662/3296] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:02:43 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:02:43.495450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d87bb-806f-4bc2-a239-2b6e1a6680c4 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:43.498388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9a9d87bb-806f-4bc2-a239-2b6e1a6680c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:43.613897 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:43.713909 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d87bb-806f-4bc2-a239-2b6e1a6680c4 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:43.723746 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceccf36a-6546-42a5-ad42-dc107e3f7b63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:43.724655 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceccf36a-6546-42a5-ad42-dc107e3f7b63 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:43.725093 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceccf36a-6546-42a5-ad42-dc107e3f7b63 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:43.725703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceccf36a-6546-42a5-ad42-dc107e3f7b63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:43.740557 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceccf36a-6546-42a5-ad42-dc107e3f7b63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:43.741858 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceccf36a-6546-42a5-ad42-dc107e3f7b63 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:43.774441 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1635/3297] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:02:43 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:02:50.741014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d0f75-47ca-4e78-9bb9-f7476d68e248 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:50.741553 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d0f75-47ca-4e78-9bb9-f7476d68e248 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:50.742184 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d0f75-47ca-4e78-9bb9-f7476d68e248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:50.811112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d83d0f75-47ca-4e78-9bb9-f7476d68e248 None None] MFA Rules not processed for user `f06e774b04164833ab25fb139011fb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:02:50.812495 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d83d0f75-47ca-4e78-9bb9-f7476d68e248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:51.046106 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1663/3298] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:02:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:02:51.060972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceccf36a-6546-42a5-ad42-dc107e3f7b63 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:51.062853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ceccf36a-6546-42a5-ad42-dc107e3f7b63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:51.205193 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceccf36a-6546-42a5-ad42-dc107e3f7b63 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:51.216738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17156471-d8d0-4df1-80c1-ed1bb61049a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:51.217463 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17156471-d8d0-4df1-80c1-ed1bb61049a1 service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:51.219746 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17156471-d8d0-4df1-80c1-ed1bb61049a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:51.220822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17156471-d8d0-4df1-80c1-ed1bb61049a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:51.227219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-17156471-d8d0-4df1-80c1-ed1bb61049a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:51.376119 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17156471-d8d0-4df1-80c1-ed1bb61049a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:51.379884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17156471-d8d0-4df1-80c1-ed1bb61049a1 service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:51.414056 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1636/3299] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:02:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:02:55.173737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a017afa-2f25-4124-b686-e7933429f237 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:55.174931 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a017afa-2f25-4124-b686-e7933429f237 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:55.175790 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a017afa-2f25-4124-b686-e7933429f237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:55.251078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-8a017afa-2f25-4124-b686-e7933429f237 None None] MFA Rules not processed for user `5fbf3973b1d3431f9682be0eb6d8948a`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:02:55.252597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8a017afa-2f25-4124-b686-e7933429f237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:55.410753 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1664/3300] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:02:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:02:55.426429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17156471-d8d0-4df1-80c1-ed1bb61049a1 service cinder] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:55.428445 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-17156471-d8d0-4df1-80c1-ed1bb61049a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:55.462068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17156471-d8d0-4df1-80c1-ed1bb61049a1 service cinder] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:55.474192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce718b-2eb9-4587-9518-24806382fb78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:55.475282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce718b-2eb9-4587-9518-24806382fb78 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:55.475788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce718b-2eb9-4587-9518-24806382fb78 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:55.476396 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce718b-2eb9-4587-9518-24806382fb78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:55.488651 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce718b-2eb9-4587-9518-24806382fb78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:55.491136 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce718b-2eb9-4587-9518-24806382fb78 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:55.523135 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1637/3301] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:02:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:02:55.962765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a017afa-2f25-4124-b686-e7933429f237 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:55.970438 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8a017afa-2f25-4124-b686-e7933429f237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:56.006314 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a017afa-2f25-4124-b686-e7933429f237 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:56.022684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700358a-5ba6-4f81-aca4-b3f3753c292a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:56.025003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700358a-5ba6-4f81-aca4-b3f3753c292a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:56.025940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700358a-5ba6-4f81-aca4-b3f3753c292a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:56.027047 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700358a-5ba6-4f81-aca4-b3f3753c292a admin admin] PATH_INFO: `/v3/users/d5754e7eed1b48f8805b6dffefb37b59` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:56.030291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700358a-5ba6-4f81-aca4-b3f3753c292a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5754e7eed1b48f8805b6dffefb37b59)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:56.036896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700358a-5ba6-4f81-aca4-b3f3753c292a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:56.120479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:56.190823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3700358a-5ba6-4f81-aca4-b3f3753c292a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5754e7eed1b48f8805b6dffefb37b59'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:56.209437 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3700358a-5ba6-4f81-aca4-b3f3753c292a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5754e7eed1b48f8805b6dffefb37b59'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:56.211994 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3700358a-5ba6-4f81-aca4-b3f3753c292a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5754e7eed1b48f8805b6dffefb37b59'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:56.213758 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3700358a-5ba6-4f81-aca4-b3f3753c292a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5754e7eed1b48f8805b6dffefb37b59'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:56.233857 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3700358a-5ba6-4f81-aca4-b3f3753c292a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5754e7eed1b48f8805b6dffefb37b59'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:56.268056 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1665/3302] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:02:55 2022] DELETE /identity/v3/users/d5754e7eed1b48f8805b6dffefb37b59 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:02:58.188647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce718b-2eb9-4587-9518-24806382fb78 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:58.248834 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce718b-2eb9-4587-9518-24806382fb78 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:58.316637 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b3111-5e4a-4242-bde7-bf9b8d6114af None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:58.317479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b3111-5e4a-4242-bde7-bf9b8d6114af None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:58.317913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b3111-5e4a-4242-bde7-bf9b8d6114af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:58.391822 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d20b3111-5e4a-4242-bde7-bf9b8d6114af None None] MFA Rules not processed for user `5fbf3973b1d3431f9682be0eb6d8948a`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:02:58.393209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d20b3111-5e4a-4242-bde7-bf9b8d6114af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:58.495270 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d92893-fb2f-49c1-b25b-6da74a2245f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:58.496186 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d92893-fb2f-49c1-b25b-6da74a2245f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:58.496621 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d92893-fb2f-49c1-b25b-6da74a2245f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:58.498792 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d92893-fb2f-49c1-b25b-6da74a2245f9 admin admin] PATH_INFO: `/v3/projects/155b2c35804a4799a75a327703a5e26e` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:58.503412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d92893-fb2f-49c1-b25b-6da74a2245f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=155b2c35804a4799a75a327703a5e26e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:58.506953 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d92893-fb2f-49c1-b25b-6da74a2245f9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:58.525605 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:58.569834 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1666/3303] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:02:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:02:58.683950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-70d92893-fb2f-49c1-b25b-6da74a2245f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '155b2c35804a4799a75a327703a5e26e', 'request_id': 'req-70d92893-fb2f-49c1-b25b-6da74a2245f9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:58.704899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-70d92893-fb2f-49c1-b25b-6da74a2245f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '155b2c35804a4799a75a327703a5e26e', 'request_id': 'req-70d92893-fb2f-49c1-b25b-6da74a2245f9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:58.732400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-70d92893-fb2f-49c1-b25b-6da74a2245f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '155b2c35804a4799a75a327703a5e26e', 'request_id': 'req-70d92893-fb2f-49c1-b25b-6da74a2245f9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:58.770369 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-70d92893-fb2f-49c1-b25b-6da74a2245f9 admin admin] The token cache is being invalidate because project 155b2c35804a4799a75a327703a5e26e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:02:58.770707 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-70d92893-fb2f-49c1-b25b-6da74a2245f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:58.772679 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-70d92893-fb2f-49c1-b25b-6da74a2245f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:58.780597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b3111-5e4a-4242-bde7-bf9b8d6114af None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:02:58.781119 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1638/3304] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:02:58 2022] DELETE /identity/v3/projects/155b2c35804a4799a75a327703a5e26e => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:02:58.784305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d20b3111-5e4a-4242-bde7-bf9b8d6114af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:02:58.835250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b3111-5e4a-4242-bde7-bf9b8d6114af None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:02:59.013546 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc23a9-b2a8-442d-ab2a-a3c89cda9588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:02:59.014296 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc23a9-b2a8-442d-ab2a-a3c89cda9588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:02:59.023716 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc23a9-b2a8-442d-ab2a-a3c89cda9588 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:02:59.024132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc23a9-b2a8-442d-ab2a-a3c89cda9588 admin admin] PATH_INFO: `/v3/users/fabbdd5183e74097994fdfb2767de55e` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:02:59.033618 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc23a9-b2a8-442d-ab2a-a3c89cda9588 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fabbdd5183e74097994fdfb2767de55e)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:02:59.041971 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc23a9-b2a8-442d-ab2a-a3c89cda9588 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:02:59.147983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-20bc23a9-b2a8-442d-ab2a-a3c89cda9588 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fabbdd5183e74097994fdfb2767de55e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:59.158957 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:59.187440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-20bc23a9-b2a8-442d-ab2a-a3c89cda9588 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fabbdd5183e74097994fdfb2767de55e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:59.192315 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-20bc23a9-b2a8-442d-ab2a-a3c89cda9588 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fabbdd5183e74097994fdfb2767de55e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:59.195799 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-20bc23a9-b2a8-442d-ab2a-a3c89cda9588 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fabbdd5183e74097994fdfb2767de55e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:59.218394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-20bc23a9-b2a8-442d-ab2a-a3c89cda9588 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fabbdd5183e74097994fdfb2767de55e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:02:59.266597 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1667/3305] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:02:58 2022] DELETE /identity/v3/users/fabbdd5183e74097994fdfb2767de55e => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:03:00.650044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d92893-fb2f-49c1-b25b-6da74a2245f9 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:00.651911 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-70d92893-fb2f-49c1-b25b-6da74a2245f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:00.699614 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d92893-fb2f-49c1-b25b-6da74a2245f9 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:00.830101 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303215ab-0794-4c0a-abe2-3c4cdd6ce817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:00.831174 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303215ab-0794-4c0a-abe2-3c4cdd6ce817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:00.831738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303215ab-0794-4c0a-abe2-3c4cdd6ce817 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:00.832215 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303215ab-0794-4c0a-abe2-3c4cdd6ce817 admin admin] PATH_INFO: `/v3/projects/8c7bca96003b47e9b30a21b51042d0fd` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:00.834536 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303215ab-0794-4c0a-abe2-3c4cdd6ce817 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c7bca96003b47e9b30a21b51042d0fd)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:00.838476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303215ab-0794-4c0a-abe2-3c4cdd6ce817 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:00.910531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-303215ab-0794-4c0a-abe2-3c4cdd6ce817 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c7bca96003b47e9b30a21b51042d0fd', 'request_id': 'req-303215ab-0794-4c0a-abe2-3c4cdd6ce817'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:00.917622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-303215ab-0794-4c0a-abe2-3c4cdd6ce817 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c7bca96003b47e9b30a21b51042d0fd', 'request_id': 'req-303215ab-0794-4c0a-abe2-3c4cdd6ce817'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:00.926819 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-303215ab-0794-4c0a-abe2-3c4cdd6ce817 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c7bca96003b47e9b30a21b51042d0fd', 'request_id': 'req-303215ab-0794-4c0a-abe2-3c4cdd6ce817'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:00.957507 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-303215ab-0794-4c0a-abe2-3c4cdd6ce817 admin admin] The token cache is being invalidate because project 8c7bca96003b47e9b30a21b51042d0fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:03:00.958013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-303215ab-0794-4c0a-abe2-3c4cdd6ce817 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:00.958838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-303215ab-0794-4c0a-abe2-3c4cdd6ce817 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:00.964603 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1639/3306] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:03:00 2022] DELETE /identity/v3/projects/8c7bca96003b47e9b30a21b51042d0fd => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:03:00.970766 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40606aea-754e-4353-b3cb-bcc313ce7288 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:00.971674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40606aea-754e-4353-b3cb-bcc313ce7288 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:00.972187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40606aea-754e-4353-b3cb-bcc313ce7288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:01.012243 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-40606aea-754e-4353-b3cb-bcc313ce7288 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:03:01.015158 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-40606aea-754e-4353-b3cb-bcc313ce7288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:01.165783 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1668/3307] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:03:01.173849 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990b1df-9131-42d8-90ab-493995c352a3 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:01.176275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990b1df-9131-42d8-90ab-493995c352a3 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:01.177011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990b1df-9131-42d8-90ab-493995c352a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:01.222314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-0990b1df-9131-42d8-90ab-493995c352a3 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:03:01.234557 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0990b1df-9131-42d8-90ab-493995c352a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:01.248501 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1640/3308] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:03:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:03:01.250628 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40606aea-754e-4353-b3cb-bcc313ce7288 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:01.265286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40606aea-754e-4353-b3cb-bcc313ce7288 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:01.281477 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a83a0-a2b1-4fc7-9067-ac91dc2fba71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:01.282998 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a83a0-a2b1-4fc7-9067-ac91dc2fba71 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:01.283332 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a83a0-a2b1-4fc7-9067-ac91dc2fba71 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:01.283762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a83a0-a2b1-4fc7-9067-ac91dc2fba71 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:01.285181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a83a0-a2b1-4fc7-9067-ac91dc2fba71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:03:01.285639 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a83a0-a2b1-4fc7-9067-ac91dc2fba71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:01.297096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a83a0-a2b1-4fc7-9067-ac91dc2fba71 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:01.332866 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1669/3309] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:03:01.337438 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990b1df-9131-42d8-90ab-493995c352a3 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:01.355344 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990b1df-9131-42d8-90ab-493995c352a3 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:01.377357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7a034-d682-440c-ad24-396b02988792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:01.378860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7a034-d682-440c-ad24-396b02988792 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:01.379121 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7a034-d682-440c-ad24-396b02988792 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:01.379495 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7a034-d682-440c-ad24-396b02988792 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:01.380560 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a7a034-d682-440c-ad24-396b02988792 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:01.391070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a7a034-d682-440c-ad24-396b02988792 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:01.459013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:01.489232 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1641/3310] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:03:01 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:03:01.489843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a83a0-a2b1-4fc7-9067-ac91dc2fba71 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:01.526381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a83a0-a2b1-4fc7-9067-ac91dc2fba71 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:01.788669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738774cd-fc50-4a83-959f-589c4149d84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:01.789886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738774cd-fc50-4a83-959f-589c4149d84d admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:01.790309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738774cd-fc50-4a83-959f-589c4149d84d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:01.790785 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738774cd-fc50-4a83-959f-589c4149d84d admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:01.791661 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738774cd-fc50-4a83-959f-589c4149d84d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:01.795446 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738774cd-fc50-4a83-959f-589c4149d84d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:01.848518 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7a034-d682-440c-ad24-396b02988792 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:01.864804 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7a034-d682-440c-ad24-396b02988792 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:01.864989 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1670/3311] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:03:01 2022] POST /identity/v3/users => generated 293 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:03:01.869390 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca30da6-1584-41b7-b4b5-c6ca8918c9da None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:01.871223 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca30da6-1584-41b7-b4b5-c6ca8918c9da None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:01.872127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca30da6-1584-41b7-b4b5-c6ca8918c9da None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:01.878461 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1671/3312] 10.222.0.33 () {54 vars in 921 bytes} [Sat Aug 6 21:03:01 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 21:03:01.884617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532491e-6d55-44b1-911f-c012a570d437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:01.885403 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532491e-6d55-44b1-911f-c012a570d437 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:01.885781 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532491e-6d55-44b1-911f-c012a570d437 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:01.886150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532491e-6d55-44b1-911f-c012a570d437 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:01.887130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532491e-6d55-44b1-911f-c012a570d437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:01.889771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b6f79-ceb6-4992-b29a-518cb349cabc None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:01.890338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b6f79-ceb6-4992-b29a-518cb349cabc None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:01.891568 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b6f79-ceb6-4992-b29a-518cb349cabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:01.896305 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532491e-6d55-44b1-911f-c012a570d437 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:01.931749 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1642/3313] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:03:01.935549 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532491e-6d55-44b1-911f-c012a570d437 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:01.958484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532491e-6d55-44b1-911f-c012a570d437 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:01.985395 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7583f-73f3-40f3-8812-8333ad488a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:01.986065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7583f-73f3-40f3-8812-8333ad488a54 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:01.986349 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7583f-73f3-40f3-8812-8333ad488a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:01.986728 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7583f-73f3-40f3-8812-8333ad488a54 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:01.987833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed7583f-73f3-40f3-8812-8333ad488a54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:01.989641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed7583f-73f3-40f3-8812-8333ad488a54 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:01.997537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-8a0b6f79-ceb6-4992-b29a-518cb349cabc None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:03:02.004167 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8a0b6f79-ceb6-4992-b29a-518cb349cabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:02.024270 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1643/3314] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:03:02.025245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7583f-73f3-40f3-8812-8333ad488a54 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:02.052597 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7583f-73f3-40f3-8812-8333ad488a54 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:02.091609 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeda574-05b8-4368-a1a0-4d0ebe2161fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:02.099258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeda574-05b8-4368-a1a0-4d0ebe2161fe admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:02.101406 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeda574-05b8-4368-a1a0-4d0ebe2161fe admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:02.103088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeda574-05b8-4368-a1a0-4d0ebe2161fe admin admin] PATH_INFO: `/v3/projects/1d11bd5e6d68490185f009db8dbf1d3b/users/9fc68526628248b18670cffb99246c9d/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:02.124958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:02.171211 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeda574-05b8-4368-a1a0-4d0ebe2161fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d11bd5e6d68490185f009db8dbf1d3b, user_id=9fc68526628248b18670cffb99246c9d, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:02.174008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeda574-05b8-4368-a1a0-4d0ebe2161fe admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:02.208260 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1644/3315] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:03:02 2022] PUT /identity/v3/projects/1d11bd5e6d68490185f009db8dbf1d3b/users/9fc68526628248b18670cffb99246c9d/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:03:02.210727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c101c-a99c-4fab-9a1c-90d50503196f None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:02.211085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c101c-a99c-4fab-9a1c-90d50503196f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:02.211423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c101c-a99c-4fab-9a1c-90d50503196f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:02.255192 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1672/3316] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 21:03:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:03:02.255819 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-e70c101c-a99c-4fab-9a1c-90d50503196f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:03:02.258130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e70c101c-a99c-4fab-9a1c-90d50503196f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:02.288643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b6f79-ceb6-4992-b29a-518cb349cabc None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:02.291410 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8a0b6f79-ceb6-4992-b29a-518cb349cabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:02.394252 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b6f79-ceb6-4992-b29a-518cb349cabc None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:02.493916 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1645/3317] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:03:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:03:02.560422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c101c-a99c-4fab-9a1c-90d50503196f None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:02.562601 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e70c101c-a99c-4fab-9a1c-90d50503196f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:02.630473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e3055-099c-4ec0-a60a-05a39e2674d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:02.632046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e3055-099c-4ec0-a60a-05a39e2674d6 service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:02.632604 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e3055-099c-4ec0-a60a-05a39e2674d6 service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:02.634125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e3055-099c-4ec0-a60a-05a39e2674d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:02.658153 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e3055-099c-4ec0-a60a-05a39e2674d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:02.661462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e3055-099c-4ec0-a60a-05a39e2674d6 service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:02.691591 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1673/3318] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:03:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:03:02.719145 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c101c-a99c-4fab-9a1c-90d50503196f None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:02.730636 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05685eba-be1b-4280-a8e7-b98e3f6c221a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:02.732221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05685eba-be1b-4280-a8e7-b98e3f6c221a service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:02.732606 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05685eba-be1b-4280-a8e7-b98e3f6c221a service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:02.733823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05685eba-be1b-4280-a8e7-b98e3f6c221a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:02.766384 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05685eba-be1b-4280-a8e7-b98e3f6c221a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:02.769638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05685eba-be1b-4280-a8e7-b98e3f6c221a service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:02.786492 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1646/3319] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:03:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:03:03.831596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e3055-099c-4ec0-a60a-05a39e2674d6 service placement] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:03.834328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f05e3055-099c-4ec0-a60a-05a39e2674d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:03.864297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e3055-099c-4ec0-a60a-05a39e2674d6 service placement] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:03.877426 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34bc625-be4a-4c0f-971c-e77cd34cc2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:03.878641 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bc625-be4a-4c0f-971c-e77cd34cc2ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:03.879225 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bc625-be4a-4c0f-971c-e77cd34cc2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:03.879873 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bc625-be4a-4c0f-971c-e77cd34cc2ec admin admin] PATH_INFO: `/v3/users/145439e0e0d549f89b17e81cbd46c580` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:03.883100 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34bc625-be4a-4c0f-971c-e77cd34cc2ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=145439e0e0d549f89b17e81cbd46c580)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:03.885930 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34bc625-be4a-4c0f-971c-e77cd34cc2ec admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:03.987898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d34bc625-be4a-4c0f-971c-e77cd34cc2ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '145439e0e0d549f89b17e81cbd46c580'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:04.077259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d34bc625-be4a-4c0f-971c-e77cd34cc2ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '145439e0e0d549f89b17e81cbd46c580'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:04.080562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d34bc625-be4a-4c0f-971c-e77cd34cc2ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '145439e0e0d549f89b17e81cbd46c580'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:04.084006 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d34bc625-be4a-4c0f-971c-e77cd34cc2ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '145439e0e0d549f89b17e81cbd46c580'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:04.108022 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d34bc625-be4a-4c0f-971c-e77cd34cc2ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '145439e0e0d549f89b17e81cbd46c580'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:04.141065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05685eba-be1b-4280-a8e7-b98e3f6c221a service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:04.155140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05685eba-be1b-4280-a8e7-b98e3f6c221a service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:04.163513 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1674/3320] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:03:03 2022] DELETE /identity/v3/users/145439e0e0d549f89b17e81cbd46c580 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:03:04.168131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c60cd-5829-4877-b242-980756fa9c11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:04.169210 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c60cd-5829-4877-b242-980756fa9c11 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:04.169774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c60cd-5829-4877-b242-980756fa9c11 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:04.169774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c60cd-5829-4877-b242-980756fa9c11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:04.174717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b49c60cd-5829-4877-b242-980756fa9c11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:04.297351 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:04.349101 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c60cd-5829-4877-b242-980756fa9c11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:04.351201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c60cd-5829-4877-b242-980756fa9c11 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:04.367962 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1647/3321] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:03:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:03:04.677436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34bc625-be4a-4c0f-971c-e77cd34cc2ec admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:04.686264 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d34bc625-be4a-4c0f-971c-e77cd34cc2ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:04.784298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:04.848686 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34bc625-be4a-4c0f-971c-e77cd34cc2ec admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:04.857288 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6f6af-cb2c-4e90-bfa0-321a925549a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:04.858668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6f6af-cb2c-4e90-bfa0-321a925549a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:04.859188 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6f6af-cb2c-4e90-bfa0-321a925549a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:04.859652 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6f6af-cb2c-4e90-bfa0-321a925549a6 admin admin] PATH_INFO: `/v3/users/393ed805f99d4b4c93500bcff599eb56` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:04.861271 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a6f6af-cb2c-4e90-bfa0-321a925549a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=393ed805f99d4b4c93500bcff599eb56)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:04.864471 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a6f6af-cb2c-4e90-bfa0-321a925549a6 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:04.987455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f7a6f6af-cb2c-4e90-bfa0-321a925549a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '393ed805f99d4b4c93500bcff599eb56'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:05.006353 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f7a6f6af-cb2c-4e90-bfa0-321a925549a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '393ed805f99d4b4c93500bcff599eb56'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:05.007805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f7a6f6af-cb2c-4e90-bfa0-321a925549a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '393ed805f99d4b4c93500bcff599eb56'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:05.009848 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f7a6f6af-cb2c-4e90-bfa0-321a925549a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '393ed805f99d4b4c93500bcff599eb56'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:05.023720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f7a6f6af-cb2c-4e90-bfa0-321a925549a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '393ed805f99d4b4c93500bcff599eb56'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:05.092846 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1675/3322] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:03:04 2022] DELETE /identity/v3/users/393ed805f99d4b4c93500bcff599eb56 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:03:05.136201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c60cd-5829-4877-b242-980756fa9c11 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:05.138304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b49c60cd-5829-4877-b242-980756fa9c11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:05.162795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c60cd-5829-4877-b242-980756fa9c11 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:05.270193 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326db59-a354-4e2f-9c25-cf6195d9af9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:05.271085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326db59-a354-4e2f-9c25-cf6195d9af9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:05.271729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326db59-a354-4e2f-9c25-cf6195d9af9b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:05.272163 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326db59-a354-4e2f-9c25-cf6195d9af9b admin admin] PATH_INFO: `/v3/projects/afc36f344d274f89b5139ba88bef375b` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:05.273675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1326db59-a354-4e2f-9c25-cf6195d9af9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=afc36f344d274f89b5139ba88bef375b)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:05.276133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1326db59-a354-4e2f-9c25-cf6195d9af9b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:05.373456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1326db59-a354-4e2f-9c25-cf6195d9af9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afc36f344d274f89b5139ba88bef375b', 'request_id': 'req-1326db59-a354-4e2f-9c25-cf6195d9af9b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:05.382345 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1326db59-a354-4e2f-9c25-cf6195d9af9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afc36f344d274f89b5139ba88bef375b', 'request_id': 'req-1326db59-a354-4e2f-9c25-cf6195d9af9b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:05.394669 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1326db59-a354-4e2f-9c25-cf6195d9af9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afc36f344d274f89b5139ba88bef375b', 'request_id': 'req-1326db59-a354-4e2f-9c25-cf6195d9af9b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:05.417724 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1326db59-a354-4e2f-9c25-cf6195d9af9b admin admin] The token cache is being invalidate because project afc36f344d274f89b5139ba88bef375b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:03:05.418278 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1326db59-a354-4e2f-9c25-cf6195d9af9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:05.420503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1326db59-a354-4e2f-9c25-cf6195d9af9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:05.423467 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1648/3323] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:03:05 2022] DELETE /identity/v3/projects/afc36f344d274f89b5139ba88bef375b => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:03:05.427520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6f6af-cb2c-4e90-bfa0-321a925549a6 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:05.429600 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f7a6f6af-cb2c-4e90-bfa0-321a925549a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:05.461088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6f6af-cb2c-4e90-bfa0-321a925549a6 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:05.631068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb37d3a-317a-45cd-a92e-ec3b9171eca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:05.632158 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb37d3a-317a-45cd-a92e-ec3b9171eca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:05.632623 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb37d3a-317a-45cd-a92e-ec3b9171eca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:05.633001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb37d3a-317a-45cd-a92e-ec3b9171eca4 admin admin] PATH_INFO: `/v3/users/b5b60c17df8e4ec3a8236bfedde32eab` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:05.635808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb37d3a-317a-45cd-a92e-ec3b9171eca4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5b60c17df8e4ec3a8236bfedde32eab)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:05.653422 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb37d3a-317a-45cd-a92e-ec3b9171eca4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:05.882401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8eb37d3a-317a-45cd-a92e-ec3b9171eca4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5b60c17df8e4ec3a8236bfedde32eab'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:05.896700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:05.938787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8eb37d3a-317a-45cd-a92e-ec3b9171eca4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5b60c17df8e4ec3a8236bfedde32eab'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:05.940105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8eb37d3a-317a-45cd-a92e-ec3b9171eca4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5b60c17df8e4ec3a8236bfedde32eab'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:05.942386 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8eb37d3a-317a-45cd-a92e-ec3b9171eca4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5b60c17df8e4ec3a8236bfedde32eab'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:05.960379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8eb37d3a-317a-45cd-a92e-ec3b9171eca4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5b60c17df8e4ec3a8236bfedde32eab'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:06.045520 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1676/3324] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:03:05 2022] DELETE /identity/v3/users/b5b60c17df8e4ec3a8236bfedde32eab => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:03:06.378853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326db59-a354-4e2f-9c25-cf6195d9af9b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:06.380608 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1326db59-a354-4e2f-9c25-cf6195d9af9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:06.423144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326db59-a354-4e2f-9c25-cf6195d9af9b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:06.568234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408df41a-4757-4cd2-af0d-2d89a4e41611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:06.569030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408df41a-4757-4cd2-af0d-2d89a4e41611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:06.569692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408df41a-4757-4cd2-af0d-2d89a4e41611 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:06.570118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408df41a-4757-4cd2-af0d-2d89a4e41611 admin admin] PATH_INFO: `/v3/projects/ebf6d5c4c6624b849238429d19be6dc6` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:06.572426 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408df41a-4757-4cd2-af0d-2d89a4e41611 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebf6d5c4c6624b849238429d19be6dc6)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:06.575071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408df41a-4757-4cd2-af0d-2d89a4e41611 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:06.594370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:06.689002 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-408df41a-4757-4cd2-af0d-2d89a4e41611 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebf6d5c4c6624b849238429d19be6dc6', 'request_id': 'req-408df41a-4757-4cd2-af0d-2d89a4e41611'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:06.706843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-408df41a-4757-4cd2-af0d-2d89a4e41611 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebf6d5c4c6624b849238429d19be6dc6', 'request_id': 'req-408df41a-4757-4cd2-af0d-2d89a4e41611'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:06.723197 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-408df41a-4757-4cd2-af0d-2d89a4e41611 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebf6d5c4c6624b849238429d19be6dc6', 'request_id': 'req-408df41a-4757-4cd2-af0d-2d89a4e41611'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:06.760626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-408df41a-4757-4cd2-af0d-2d89a4e41611 admin admin] The token cache is being invalidate because project ebf6d5c4c6624b849238429d19be6dc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:03:06.760917 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-408df41a-4757-4cd2-af0d-2d89a4e41611 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:06.761743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-408df41a-4757-4cd2-af0d-2d89a4e41611 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:06.764262 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1649/3325] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:03:06 2022] DELETE /identity/v3/projects/ebf6d5c4c6624b849238429d19be6dc6 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:03:06.770941 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb51c37-0be4-4c79-8b4b-432f7b00fd3a None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:06.771501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb51c37-0be4-4c79-8b4b-432f7b00fd3a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:06.772067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb51c37-0be4-4c79-8b4b-432f7b00fd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:06.819118 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-fbb51c37-0be4-4c79-8b4b-432f7b00fd3a None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:03:06.820631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-fbb51c37-0be4-4c79-8b4b-432f7b00fd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:06.985957 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8e265-bb8c-483b-9f4e-fe8f85f46e92 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:06.986656 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1677/3326] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:03:06.987118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8e265-bb8c-483b-9f4e-fe8f85f46e92 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:06.987118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8e265-bb8c-483b-9f4e-fe8f85f46e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:07.033515 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-7aa8e265-bb8c-483b-9f4e-fe8f85f46e92 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:03:07.052643 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7aa8e265-bb8c-483b-9f4e-fe8f85f46e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:07.071745 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1650/3327] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:03:07.079544 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb51c37-0be4-4c79-8b4b-432f7b00fd3a None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:07.104209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb51c37-0be4-4c79-8b4b-432f7b00fd3a None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:07.118719 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17939c4a-6051-40fb-86f0-c56d49aa17dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:07.126490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17939c4a-6051-40fb-86f0-c56d49aa17dd admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:07.126864 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17939c4a-6051-40fb-86f0-c56d49aa17dd admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:07.127520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17939c4a-6051-40fb-86f0-c56d49aa17dd admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:07.128406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17939c4a-6051-40fb-86f0-c56d49aa17dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:03:07.129946 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17939c4a-6051-40fb-86f0-c56d49aa17dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:07.140917 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17939c4a-6051-40fb-86f0-c56d49aa17dd admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:07.173360 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1678/3328] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:03:07.174858 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8e265-bb8c-483b-9f4e-fe8f85f46e92 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:07.198761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8e265-bb8c-483b-9f4e-fe8f85f46e92 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:07.215818 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276dc129-cf12-42d8-9954-c67347a12072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:07.216919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276dc129-cf12-42d8-9954-c67347a12072 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:07.217338 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276dc129-cf12-42d8-9954-c67347a12072 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:07.217755 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276dc129-cf12-42d8-9954-c67347a12072 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:07.218606 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276dc129-cf12-42d8-9954-c67347a12072 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:07.220741 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276dc129-cf12-42d8-9954-c67347a12072 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:07.289692 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1651/3329] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:03:07 2022] POST /identity/v3/projects => generated 393 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:03:07.296565 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17939c4a-6051-40fb-86f0-c56d49aa17dd admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:07.314593 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17939c4a-6051-40fb-86f0-c56d49aa17dd admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:07.420292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec90e2-3db9-4315-ab20-24313bf9a412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:07.420936 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec90e2-3db9-4315-ab20-24313bf9a412 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:07.421416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec90e2-3db9-4315-ab20-24313bf9a412 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:07.422960 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec90e2-3db9-4315-ab20-24313bf9a412 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:07.425341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ec90e2-3db9-4315-ab20-24313bf9a412 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:07.428216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ec90e2-3db9-4315-ab20-24313bf9a412 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:07.487960 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276dc129-cf12-42d8-9954-c67347a12072 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:07.497090 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1679/3330] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:03:07 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:03:07.503640 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276dc129-cf12-42d8-9954-c67347a12072 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:07.513671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac992448-c404-488d-bd52-f9f787b8a31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:07.515413 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac992448-c404-488d-bd52-f9f787b8a31a admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:07.516410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac992448-c404-488d-bd52-f9f787b8a31a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:07.517217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac992448-c404-488d-bd52-f9f787b8a31a admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:07.518359 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac992448-c404-488d-bd52-f9f787b8a31a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:07.523598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac992448-c404-488d-bd52-f9f787b8a31a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:07.552113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec90e2-3db9-4315-ab20-24313bf9a412 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:07.560332 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1652/3331] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:03:07 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:03:07.569031 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec90e2-3db9-4315-ab20-24313bf9a412 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:07.575488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b6edd-0f15-4014-aae0-ab9e31535bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:07.576682 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b6edd-0f15-4014-aae0-ab9e31535bbd admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:07.577039 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b6edd-0f15-4014-aae0-ab9e31535bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:07.577351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b6edd-0f15-4014-aae0-ab9e31535bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:07.578766 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b6edd-0f15-4014-aae0-ab9e31535bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:07.580624 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b6edd-0f15-4014-aae0-ab9e31535bbd admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:07.599884 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1680/3332] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:03:07 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:03:07.601709 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac992448-c404-488d-bd52-f9f787b8a31a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:07.618320 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac992448-c404-488d-bd52-f9f787b8a31a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:07.625590 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a41ee-def8-4693-a4e8-b25b572502dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:07.626915 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a41ee-def8-4693-a4e8-b25b572502dd admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:07.627357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a41ee-def8-4693-a4e8-b25b572502dd admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:07.627852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a41ee-def8-4693-a4e8-b25b572502dd admin admin] PATH_INFO: `/v3/projects/593535c3378c451baef5a3030a42d012/users/6df409ba874342c29a452db74a60819a/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:07.656533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a41ee-def8-4693-a4e8-b25b572502dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=593535c3378c451baef5a3030a42d012, user_id=6df409ba874342c29a452db74a60819a, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:07.660548 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a41ee-def8-4693-a4e8-b25b572502dd admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:07.693792 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1653/3333] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:03:07 2022] PUT /identity/v3/projects/593535c3378c451baef5a3030a42d012/users/6df409ba874342c29a452db74a60819a/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:03:07.699742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc1e28-fc75-4c7b-bc76-ee6d2026670a None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:07.700304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc1e28-fc75-4c7b-bc76-ee6d2026670a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:07.700614 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc1e28-fc75-4c7b-bc76-ee6d2026670a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:07.720798 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a41ee-def8-4693-a4e8-b25b572502dd admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:07.723218 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-153a41ee-def8-4693-a4e8-b25b572502dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:07.736786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-e3dc1e28-fc75-4c7b-bc76-ee6d2026670a None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:03:07.740125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e3dc1e28-fc75-4c7b-bc76-ee6d2026670a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:07.802387 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:07.904607 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1681/3334] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:03:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:03:07.917078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a41ee-def8-4693-a4e8-b25b572502dd admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:07.926228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6758e5f-93b6-4247-9096-473b1f701d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:07.928910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6758e5f-93b6-4247-9096-473b1f701d6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:07.929719 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6758e5f-93b6-4247-9096-473b1f701d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:07.930391 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6758e5f-93b6-4247-9096-473b1f701d6e admin admin] PATH_INFO: `/v3/projects/a144007359694aa0b700198d0c384e3d` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:07.932066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6758e5f-93b6-4247-9096-473b1f701d6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a144007359694aa0b700198d0c384e3d)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:07.938836 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc1e28-fc75-4c7b-bc76-ee6d2026670a None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:07.941527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e3dc1e28-fc75-4c7b-bc76-ee6d2026670a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:07.947808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6758e5f-93b6-4247-9096-473b1f701d6e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:08.086770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc1e28-fc75-4c7b-bc76-ee6d2026670a None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:08.100339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba042dda-2f6a-46c9-925d-f8f6861156fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:08.100977 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba042dda-2f6a-46c9-925d-f8f6861156fb service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:08.101260 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba042dda-2f6a-46c9-925d-f8f6861156fb service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:08.101534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba042dda-2f6a-46c9-925d-f8f6861156fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:08.120581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:08.129823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba042dda-2f6a-46c9-925d-f8f6861156fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:08.134203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba042dda-2f6a-46c9-925d-f8f6861156fb service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:08.157824 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e6758e5f-93b6-4247-9096-473b1f701d6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a144007359694aa0b700198d0c384e3d', 'request_id': 'req-e6758e5f-93b6-4247-9096-473b1f701d6e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:08.160583 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1682/3335] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:03:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:03:08.188704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e6758e5f-93b6-4247-9096-473b1f701d6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a144007359694aa0b700198d0c384e3d', 'request_id': 'req-e6758e5f-93b6-4247-9096-473b1f701d6e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:08.215098 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e6758e5f-93b6-4247-9096-473b1f701d6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a144007359694aa0b700198d0c384e3d', 'request_id': 'req-e6758e5f-93b6-4247-9096-473b1f701d6e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:08.248258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e6758e5f-93b6-4247-9096-473b1f701d6e admin admin] The token cache is being invalidate because project a144007359694aa0b700198d0c384e3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:03:08.248848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e6758e5f-93b6-4247-9096-473b1f701d6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:08.249753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e6758e5f-93b6-4247-9096-473b1f701d6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:08.252899 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1654/3336] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:03:07 2022] DELETE /identity/v3/projects/a144007359694aa0b700198d0c384e3d => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:03:08.259726 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c29e51-9550-4277-b5cf-d2918e778343 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:08.260020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c29e51-9550-4277-b5cf-d2918e778343 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:08.260630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c29e51-9550-4277-b5cf-d2918e778343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:08.302481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-20c29e51-9550-4277-b5cf-d2918e778343 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:03:08.307428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-20c29e51-9550-4277-b5cf-d2918e778343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:08.468220 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1683/3337] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:03:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:03:08.468910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ccfbd3-52e7-43b5-807a-8829c30fced0 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:08.469202 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ccfbd3-52e7-43b5-807a-8829c30fced0 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:08.469484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ccfbd3-52e7-43b5-807a-8829c30fced0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:08.526064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-56ccfbd3-52e7-43b5-807a-8829c30fced0 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:03:08.531958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-56ccfbd3-52e7-43b5-807a-8829c30fced0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:08.557276 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1655/3338] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:03:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:03:08.561081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c29e51-9550-4277-b5cf-d2918e778343 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:08.577959 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c29e51-9550-4277-b5cf-d2918e778343 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:08.595399 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd0922-fd53-48eb-8089-33bd3d2e5fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:08.596701 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd0922-fd53-48eb-8089-33bd3d2e5fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:08.597003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd0922-fd53-48eb-8089-33bd3d2e5fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:08.597281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd0922-fd53-48eb-8089-33bd3d2e5fb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:08.597990 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd0922-fd53-48eb-8089-33bd3d2e5fb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:03:08.598299 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd0922-fd53-48eb-8089-33bd3d2e5fb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:08.600140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd0922-fd53-48eb-8089-33bd3d2e5fb1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:08.626439 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1684/3339] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:03:08.631706 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ccfbd3-52e7-43b5-807a-8829c30fced0 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:08.647721 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ccfbd3-52e7-43b5-807a-8829c30fced0 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:08.671525 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f454e8-91a5-4be3-b4c2-283107d932b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:08.672159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f454e8-91a5-4be3-b4c2-283107d932b7 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:08.672431 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f454e8-91a5-4be3-b4c2-283107d932b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:08.672690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f454e8-91a5-4be3-b4c2-283107d932b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:08.676317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f454e8-91a5-4be3-b4c2-283107d932b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:08.678422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f454e8-91a5-4be3-b4c2-283107d932b7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:08.792888 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1656/3340] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:03:08 2022] POST /identity/v3/projects => generated 397 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:03:08.798020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd0922-fd53-48eb-8089-33bd3d2e5fb1 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:08.813810 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd0922-fd53-48eb-8089-33bd3d2e5fb1 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:09.047403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1af1c-ceda-4ca7-bfdf-0b4ac17658b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:09.048065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1af1c-ceda-4ca7-bfdf-0b4ac17658b9 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:09.048342 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1af1c-ceda-4ca7-bfdf-0b4ac17658b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:09.048619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1af1c-ceda-4ca7-bfdf-0b4ac17658b9 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:09.049645 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af1af1c-ceda-4ca7-bfdf-0b4ac17658b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:09.053304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af1af1c-ceda-4ca7-bfdf-0b4ac17658b9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:09.128107 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:09.161179 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1685/3341] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:03:08 2022] POST /identity/v3/users => generated 299 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:03:09.164118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f454e8-91a5-4be3-b4c2-283107d932b7 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:09.180977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f454e8-91a5-4be3-b4c2-283107d932b7 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:09.207372 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784f0f3-13ff-4598-abfb-61fe074d6cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:09.208144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784f0f3-13ff-4598-abfb-61fe074d6cae admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:09.208492 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784f0f3-13ff-4598-abfb-61fe074d6cae admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:09.208825 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784f0f3-13ff-4598-abfb-61fe074d6cae admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:09.212012 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784f0f3-13ff-4598-abfb-61fe074d6cae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:09.222616 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784f0f3-13ff-4598-abfb-61fe074d6cae admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:09.260704 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1657/3342] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:03:09.264582 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1af1c-ceda-4ca7-bfdf-0b4ac17658b9 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:09.280291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1af1c-ceda-4ca7-bfdf-0b4ac17658b9 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:09.298181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ebb5e-038a-4e97-a448-1f4294a66cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:09.299540 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ebb5e-038a-4e97-a448-1f4294a66cdd admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:09.299958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ebb5e-038a-4e97-a448-1f4294a66cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:09.300333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ebb5e-038a-4e97-a448-1f4294a66cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:09.301469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ebb5e-038a-4e97-a448-1f4294a66cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:09.308274 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ebb5e-038a-4e97-a448-1f4294a66cdd admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:09.352967 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1686/3343] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:03:09.359557 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784f0f3-13ff-4598-abfb-61fe074d6cae admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:09.377931 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784f0f3-13ff-4598-abfb-61fe074d6cae admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:09.390259 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63909033-1f6a-43cc-85e8-7d7e14ba19ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:09.392908 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63909033-1f6a-43cc-85e8-7d7e14ba19ea admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:09.394216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63909033-1f6a-43cc-85e8-7d7e14ba19ea admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:09.394621 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63909033-1f6a-43cc-85e8-7d7e14ba19ea admin admin] PATH_INFO: `/v3/projects/2c6626cd5e8e4669a5ccb84df569d140/users/721aed6cddeb46cf9d8f33deaf6e5b8b/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:09.435725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63909033-1f6a-43cc-85e8-7d7e14ba19ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c6626cd5e8e4669a5ccb84df569d140, user_id=721aed6cddeb46cf9d8f33deaf6e5b8b, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:09.438831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63909033-1f6a-43cc-85e8-7d7e14ba19ea admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:09.459477 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1658/3344] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:03:09 2022] PUT /identity/v3/projects/2c6626cd5e8e4669a5ccb84df569d140/users/721aed6cddeb46cf9d8f33deaf6e5b8b/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:03:09.465239 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88227949-5fc1-4b7b-aac7-613dfe31ee3e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:09.466430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88227949-5fc1-4b7b-aac7-613dfe31ee3e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:09.466430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88227949-5fc1-4b7b-aac7-613dfe31ee3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:09.489655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-88227949-5fc1-4b7b-aac7-613dfe31ee3e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:03:09.491146 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-88227949-5fc1-4b7b-aac7-613dfe31ee3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:09.605760 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1687/3345] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:03:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:03:09.650153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63909033-1f6a-43cc-85e8-7d7e14ba19ea admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:09.667939 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-63909033-1f6a-43cc-85e8-7d7e14ba19ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:09.801065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63909033-1f6a-43cc-85e8-7d7e14ba19ea admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:09.807064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a644154-265a-462e-adde-6617d869310f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:09.808308 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a644154-265a-462e-adde-6617d869310f service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:09.808899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a644154-265a-462e-adde-6617d869310f service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:09.809415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a644154-265a-462e-adde-6617d869310f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:09.822928 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a644154-265a-462e-adde-6617d869310f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:09.825089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a644154-265a-462e-adde-6617d869310f service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:09.856847 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1659/3346] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:03:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:03:15.753689 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9054a-0a5c-4c39-bcbb-954cf28eb6bc None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:15.754189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9054a-0a5c-4c39-bcbb-954cf28eb6bc None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:15.754444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9054a-0a5c-4c39-bcbb-954cf28eb6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:15.836382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a0d9054a-0a5c-4c39-bcbb-954cf28eb6bc None None] MFA Rules not processed for user `9fc68526628248b18670cffb99246c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:03:15.838131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a0d9054a-0a5c-4c39-bcbb-954cf28eb6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:15.949040 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1688/3347] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:03:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:03:15.964146 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a644154-265a-462e-adde-6617d869310f service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:15.967546 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2a644154-265a-462e-adde-6617d869310f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:16.194091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:16.248555 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a644154-265a-462e-adde-6617d869310f service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:16.277730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbfe03e-8deb-4621-8f5c-2770a1b3f403 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:16.278476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfe03e-8deb-4621-8f5c-2770a1b3f403 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:16.278874 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfe03e-8deb-4621-8f5c-2770a1b3f403 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:16.279164 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfe03e-8deb-4621-8f5c-2770a1b3f403 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:16.302247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbfe03e-8deb-4621-8f5c-2770a1b3f403 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:16.308088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbfe03e-8deb-4621-8f5c-2770a1b3f403 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:16.330790 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1660/3348] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:03:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:03:22.000138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d56cc-0d88-4e62-927b-7385d439ee0f None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:22.000994 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d56cc-0d88-4e62-927b-7385d439ee0f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:22.001447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d56cc-0d88-4e62-927b-7385d439ee0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:22.037313 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-6b3d56cc-0d88-4e62-927b-7385d439ee0f None None] MFA Rules not processed for user `78f7a58ae0b24b6a9aca96713dfe99b4`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:03:22.038880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6b3d56cc-0d88-4e62-927b-7385d439ee0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:22.213896 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e36fd9-78e5-40e9-9bae-e41af2200d55 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:22.214960 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e36fd9-78e5-40e9-9bae-e41af2200d55 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:22.215524 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e36fd9-78e5-40e9-9bae-e41af2200d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:22.218884 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1689/3349] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:03:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:03:22.264046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-59e36fd9-78e5-40e9-9bae-e41af2200d55 None None] MFA Rules not processed for user `78f7a58ae0b24b6a9aca96713dfe99b4`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:03:22.265664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-59e36fd9-78e5-40e9-9bae-e41af2200d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:22.296894 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1661/3350] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:03:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:03:25.677293 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbf0fd-249e-4157-9940-e5e51541a3b7 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:25.677742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbf0fd-249e-4157-9940-e5e51541a3b7 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:25.678028 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbf0fd-249e-4157-9940-e5e51541a3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:25.748934 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a2fbf0fd-249e-4157-9940-e5e51541a3b7 None None] MFA Rules not processed for user `721aed6cddeb46cf9d8f33deaf6e5b8b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:03:25.750180 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a2fbf0fd-249e-4157-9940-e5e51541a3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:25.784126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:25.985614 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1690/3351] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:03:25 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:03:25.987609 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c5153-575e-4c8e-9633-270bd57b8bd2 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:25.988059 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c5153-575e-4c8e-9633-270bd57b8bd2 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:25.988148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c5153-575e-4c8e-9633-270bd57b8bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:26.020986 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-793c5153-575e-4c8e-9633-270bd57b8bd2 None None] MFA Rules not processed for user `721aed6cddeb46cf9d8f33deaf6e5b8b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:03:26.024183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-793c5153-575e-4c8e-9633-270bd57b8bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:26.037680 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1662/3352] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:03:25 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:03:26.609506 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752a97b-6cb2-4093-99bf-ee86e856a283 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:26.609796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752a97b-6cb2-4093-99bf-ee86e856a283 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:26.610071 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752a97b-6cb2-4093-99bf-ee86e856a283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:26.665914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a752a97b-6cb2-4093-99bf-ee86e856a283 None None] MFA Rules not processed for user `6df409ba874342c29a452db74a60819a`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:03:26.667200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a752a97b-6cb2-4093-99bf-ee86e856a283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:26.819518 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1691/3353] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:03:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:03:27.781596 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c5153-575e-4c8e-9633-270bd57b8bd2 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:27.805986 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c5153-575e-4c8e-9633-270bd57b8bd2 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:27.815071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b740b-ba2a-4099-892a-ac2058a30af5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:27.816085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b740b-ba2a-4099-892a-ac2058a30af5 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:27.816918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b740b-ba2a-4099-892a-ac2058a30af5 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:27.817201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b740b-ba2a-4099-892a-ac2058a30af5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:27.829363 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b740b-ba2a-4099-892a-ac2058a30af5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:27.831490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b740b-ba2a-4099-892a-ac2058a30af5 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:27.862632 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1663/3354] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:03:27 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:03:28.982954 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752a97b-6cb2-4093-99bf-ee86e856a283 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:28.999831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752a97b-6cb2-4093-99bf-ee86e856a283 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:29.008164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb1d49-5da6-4c10-b2bb-e07038ca3df5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:29.010221 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb1d49-5da6-4c10-b2bb-e07038ca3df5 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:29.010825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb1d49-5da6-4c10-b2bb-e07038ca3df5 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:29.011305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb1d49-5da6-4c10-b2bb-e07038ca3df5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:29.022579 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb1d49-5da6-4c10-b2bb-e07038ca3df5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:29.024554 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb1d49-5da6-4c10-b2bb-e07038ca3df5 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:29.037076 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1692/3355] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:03:28 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:03:30.747806 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f6c4f-ee06-41a5-9301-2364fd0ec357 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:30.748382 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f6c4f-ee06-41a5-9301-2364fd0ec357 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:30.748382 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f6c4f-ee06-41a5-9301-2364fd0ec357 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:30.750511 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1664/3356] 10.222.0.33 () {54 vars in 921 bytes} [Sat Aug 6 21:03:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 21:03:30.771074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20827b-9d9a-4e35-b796-9c4e01b36476 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:30.771976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20827b-9d9a-4e35-b796-9c4e01b36476 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:30.772546 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20827b-9d9a-4e35-b796-9c4e01b36476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:30.821875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-6b20827b-9d9a-4e35-b796-9c4e01b36476 None None] MFA Rules not processed for user `5f9d53147a57402f8b9818590bc1fc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:03:30.823480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6b20827b-9d9a-4e35-b796-9c4e01b36476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:30.846147 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1693/3357] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 21:03:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:03:30.922411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f6c4f-ee06-41a5-9301-2364fd0ec357 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:30.946607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f6c4f-ee06-41a5-9301-2364fd0ec357 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:30.964349 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83913cfb-4334-403f-9f9f-02441c26b954 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:30.970003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83913cfb-4334-403f-9f9f-02441c26b954 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:30.970788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83913cfb-4334-403f-9f9f-02441c26b954 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:30.971929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83913cfb-4334-403f-9f9f-02441c26b954 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:31.011838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83913cfb-4334-403f-9f9f-02441c26b954 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:31.014773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83913cfb-4334-403f-9f9f-02441c26b954 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:31.046509 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1665/3358] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:03:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:03:38.260165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99a42b-16f5-4145-ba56-61a01a85f413 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:38.260755 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99a42b-16f5-4145-ba56-61a01a85f413 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:38.260997 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99a42b-16f5-4145-ba56-61a01a85f413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:38.330746 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-cb99a42b-16f5-4145-ba56-61a01a85f413 None None] MFA Rules not processed for user `ad1a96004778407584d1805b07ad1c5f`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:03:38.332330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-cb99a42b-16f5-4145-ba56-61a01a85f413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:38.487424 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1694/3359] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:03:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:03:41.024652 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=23 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:42.249690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802fdfa-4016-4394-bfaf-2caffc2890a8 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:42.250687 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802fdfa-4016-4394-bfaf-2caffc2890a8 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:42.251114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802fdfa-4016-4394-bfaf-2caffc2890a8 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:42.253497 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1666/3360] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 21:03:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 21:03:42.259722 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa3cc1-a47b-4ee2-a7c6-d6e37eb8ac28 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:42.260266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa3cc1-a47b-4ee2-a7c6-d6e37eb8ac28 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:42.260266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa3cc1-a47b-4ee2-a7c6-d6e37eb8ac28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:42.281478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-00aa3cc1-a47b-4ee2-a7c6-d6e37eb8ac28 None None] MFA Rules not processed for user `174e91100a184740b7c604730266dc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:03:42.282746 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-00aa3cc1-a47b-4ee2-a7c6-d6e37eb8ac28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:42.291177 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1695/3361] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:03:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:03:42.339169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802fdfa-4016-4394-bfaf-2caffc2890a8 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:42.357103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802fdfa-4016-4394-bfaf-2caffc2890a8 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:42.364631 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be7d71-4cf5-4343-bc0f-c4304c399b24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:42.365644 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be7d71-4cf5-4343-bc0f-c4304c399b24 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:42.366148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be7d71-4cf5-4343-bc0f-c4304c399b24 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:42.366636 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be7d71-4cf5-4343-bc0f-c4304c399b24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:42.377559 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77be7d71-4cf5-4343-bc0f-c4304c399b24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:42.380575 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77be7d71-4cf5-4343-bc0f-c4304c399b24 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:42.394943 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1667/3362] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:03:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:03:43.834851 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa3cc1-a47b-4ee2-a7c6-d6e37eb8ac28 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:43.836515 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-00aa3cc1-a47b-4ee2-a7c6-d6e37eb8ac28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:43.862475 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:43.940560 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be7d71-4cf5-4343-bc0f-c4304c399b24 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:43.943710 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-77be7d71-4cf5-4343-bc0f-c4304c399b24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:43.949034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa3cc1-a47b-4ee2-a7c6-d6e37eb8ac28 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:43.959116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d32c57-9607-4186-b331-9ca3101afec7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:43.960379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d32c57-9607-4186-b331-9ca3101afec7 service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:43.960772 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d32c57-9607-4186-b331-9ca3101afec7 service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:43.961662 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d32c57-9607-4186-b331-9ca3101afec7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:43.964852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be7d71-4cf5-4343-bc0f-c4304c399b24 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:43.966941 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-84d32c57-9607-4186-b331-9ca3101afec7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:43.979768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acecb640-001c-4902-b01a-6ad84b688a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:43.980625 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acecb640-001c-4902-b01a-6ad84b688a3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:43.982065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acecb640-001c-4902-b01a-6ad84b688a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:43.982065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acecb640-001c-4902-b01a-6ad84b688a3e admin admin] PATH_INFO: `/v3/users/6df409ba874342c29a452db74a60819a` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:43.985415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acecb640-001c-4902-b01a-6ad84b688a3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6df409ba874342c29a452db74a60819a)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:43.986253 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d32c57-9607-4186-b331-9ca3101afec7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:43.987618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acecb640-001c-4902-b01a-6ad84b688a3e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:43.988559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d32c57-9607-4186-b331-9ca3101afec7 service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:44.017764 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1696/3363] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:03:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:03:44.086190 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-acecb640-001c-4902-b01a-6ad84b688a3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6df409ba874342c29a452db74a60819a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:44.087448 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-acecb640-001c-4902-b01a-6ad84b688a3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6df409ba874342c29a452db74a60819a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:44.088416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-acecb640-001c-4902-b01a-6ad84b688a3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6df409ba874342c29a452db74a60819a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:44.099380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-acecb640-001c-4902-b01a-6ad84b688a3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6df409ba874342c29a452db74a60819a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:44.118333 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-acecb640-001c-4902-b01a-6ad84b688a3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6df409ba874342c29a452db74a60819a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:44.144400 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1668/3364] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:03:43 2022] DELETE /identity/v3/users/6df409ba874342c29a452db74a60819a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:03:44.579380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d32c57-9607-4186-b331-9ca3101afec7 service placement] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:44.621806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d32c57-9607-4186-b331-9ca3101afec7 service placement] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:44.741565 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9af6f3-b958-433c-bf50-b539281083c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:44.742356 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9af6f3-b958-433c-bf50-b539281083c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:44.742962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9af6f3-b958-433c-bf50-b539281083c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:44.743478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9af6f3-b958-433c-bf50-b539281083c4 admin admin] PATH_INFO: `/v3/projects/593535c3378c451baef5a3030a42d012` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:44.744848 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9af6f3-b958-433c-bf50-b539281083c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=593535c3378c451baef5a3030a42d012)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:44.747889 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9af6f3-b958-433c-bf50-b539281083c4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:44.812241 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7f9af6f3-b958-433c-bf50-b539281083c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '593535c3378c451baef5a3030a42d012', 'request_id': 'req-7f9af6f3-b958-433c-bf50-b539281083c4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:44.821713 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7f9af6f3-b958-433c-bf50-b539281083c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '593535c3378c451baef5a3030a42d012', 'request_id': 'req-7f9af6f3-b958-433c-bf50-b539281083c4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:44.837275 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7f9af6f3-b958-433c-bf50-b539281083c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '593535c3378c451baef5a3030a42d012', 'request_id': 'req-7f9af6f3-b958-433c-bf50-b539281083c4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:44.864873 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7f9af6f3-b958-433c-bf50-b539281083c4 admin admin] The token cache is being invalidate because project 593535c3378c451baef5a3030a42d012 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:03:44.865798 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7f9af6f3-b958-433c-bf50-b539281083c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:44.866897 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7f9af6f3-b958-433c-bf50-b539281083c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:44.870520 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1697/3365] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:03:44 2022] DELETE /identity/v3/projects/593535c3378c451baef5a3030a42d012 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:03:44.878514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771fb17-f0a8-4e66-a5b2-d4d38fcb4196 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:44.878833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771fb17-f0a8-4e66-a5b2-d4d38fcb4196 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:44.879109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771fb17-f0a8-4e66-a5b2-d4d38fcb4196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:44.926286 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-9771fb17-f0a8-4e66-a5b2-d4d38fcb4196 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:03:44.929903 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9771fb17-f0a8-4e66-a5b2-d4d38fcb4196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:45.030516 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1669/3366] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:03:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:03:45.037605 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527af11-d1ea-4e2c-a45f-6e1a8528795b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:45.037887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527af11-d1ea-4e2c-a45f-6e1a8528795b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:45.038168 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527af11-d1ea-4e2c-a45f-6e1a8528795b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:45.068631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-e527af11-d1ea-4e2c-a45f-6e1a8528795b None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:03:45.070863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e527af11-d1ea-4e2c-a45f-6e1a8528795b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:45.090948 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1698/3367] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:03:45.094763 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771fb17-f0a8-4e66-a5b2-d4d38fcb4196 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:45.110223 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771fb17-f0a8-4e66-a5b2-d4d38fcb4196 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:45.116737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d17432-8a94-4417-bf1e-613c67b667e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:45.119377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d17432-8a94-4417-bf1e-613c67b667e8 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:45.120092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d17432-8a94-4417-bf1e-613c67b667e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:45.121275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d17432-8a94-4417-bf1e-613c67b667e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:45.122692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d17432-8a94-4417-bf1e-613c67b667e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:03:45.123210 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d17432-8a94-4417-bf1e-613c67b667e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:45.125783 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d17432-8a94-4417-bf1e-613c67b667e8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:45.155061 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1670/3368] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:03:45.158038 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527af11-d1ea-4e2c-a45f-6e1a8528795b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:45.173249 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527af11-d1ea-4e2c-a45f-6e1a8528795b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:45.180750 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe808f-ffff-417f-888c-832b41280d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:45.182569 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe808f-ffff-417f-888c-832b41280d9c admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:45.182948 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe808f-ffff-417f-888c-832b41280d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:45.183316 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe808f-ffff-417f-888c-832b41280d9c admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:45.184955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fe808f-ffff-417f-888c-832b41280d9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:45.187287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fe808f-ffff-417f-888c-832b41280d9c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:45.241590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:45.267613 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1699/3369] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:03:45 2022] POST /identity/v3/projects => generated 359 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:03:45.271511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d17432-8a94-4417-bf1e-613c67b667e8 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:45.284560 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d17432-8a94-4417-bf1e-613c67b667e8 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:45.355018 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:45.380157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d981f4c-d54b-469f-8d7a-841068da694b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:45.381092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d981f4c-d54b-469f-8d7a-841068da694b admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:45.381471 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d981f4c-d54b-469f-8d7a-841068da694b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:45.381836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d981f4c-d54b-469f-8d7a-841068da694b admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:45.382573 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d981f4c-d54b-469f-8d7a-841068da694b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:45.385039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d981f4c-d54b-469f-8d7a-841068da694b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:45.414781 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1671/3370] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:03:45 2022] POST /identity/v3/users => generated 280 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:03:45.419344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe808f-ffff-417f-888c-832b41280d9c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:45.438332 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe808f-ffff-417f-888c-832b41280d9c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:45.444129 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db549098-a1fc-44ab-b853-e0192a708a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:45.445032 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db549098-a1fc-44ab-b853-e0192a708a14 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:45.445875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db549098-a1fc-44ab-b853-e0192a708a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:45.446266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db549098-a1fc-44ab-b853-e0192a708a14 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:45.447085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db549098-a1fc-44ab-b853-e0192a708a14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:45.448758 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db549098-a1fc-44ab-b853-e0192a708a14 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:45.464236 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1700/3371] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:03:45.468519 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d981f4c-d54b-469f-8d7a-841068da694b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:45.485237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d981f4c-d54b-469f-8d7a-841068da694b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:45.492144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82580f-806a-484a-bd03-131a516d8cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:45.493714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82580f-806a-484a-bd03-131a516d8cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:45.494457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82580f-806a-484a-bd03-131a516d8cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:45.495096 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82580f-806a-484a-bd03-131a516d8cc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:45.497294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef82580f-806a-484a-bd03-131a516d8cc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:45.499775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef82580f-806a-484a-bd03-131a516d8cc1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:45.518575 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1672/3372] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:03:45.522942 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db549098-a1fc-44ab-b853-e0192a708a14 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:45.539694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db549098-a1fc-44ab-b853-e0192a708a14 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:45.551159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707a420-6763-4eca-b544-4a98cb288053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:45.552415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707a420-6763-4eca-b544-4a98cb288053 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:45.552960 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707a420-6763-4eca-b544-4a98cb288053 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:45.553357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707a420-6763-4eca-b544-4a98cb288053 admin admin] PATH_INFO: `/v3/projects/8901890be0b346c18bce6a0b8c2cecfb/users/43ac2a2240554ba793d5aa561e7b1399/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:45.581730 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9707a420-6763-4eca-b544-4a98cb288053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8901890be0b346c18bce6a0b8c2cecfb, user_id=43ac2a2240554ba793d5aa561e7b1399, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:45.585606 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9707a420-6763-4eca-b544-4a98cb288053 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:45.604942 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1701/3373] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:03:45 2022] PUT /identity/v3/projects/8901890be0b346c18bce6a0b8c2cecfb/users/43ac2a2240554ba793d5aa561e7b1399/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:03:45.616904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33bcb6-a81b-4a13-a2a1-33d55a8334bb None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:45.617533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33bcb6-a81b-4a13-a2a1-33d55a8334bb None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:45.617904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33bcb6-a81b-4a13-a2a1-33d55a8334bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:45.673845 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-ef33bcb6-a81b-4a13-a2a1-33d55a8334bb None None] MFA Rules not processed for user `43ac2a2240554ba793d5aa561e7b1399`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:03:45.680648 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ef33bcb6-a81b-4a13-a2a1-33d55a8334bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:45.799850 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1673/3374] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:03:45 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:03:46.497188 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707a420-6763-4eca-b544-4a98cb288053 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:46.503875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9707a420-6763-4eca-b544-4a98cb288053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:46.585861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707a420-6763-4eca-b544-4a98cb288053 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:46.591758 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b4f4e-fa84-40ef-aec9-6625bfa0dbdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:46.592455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b4f4e-fa84-40ef-aec9-6625bfa0dbdf service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:46.592800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b4f4e-fa84-40ef-aec9-6625bfa0dbdf service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:46.593141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b4f4e-fa84-40ef-aec9-6625bfa0dbdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:46.595534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7a4b4f4e-fa84-40ef-aec9-6625bfa0dbdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:46.641681 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001552fa-de34-46c2-8c11-c549215276fe None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:46.642193 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001552fa-de34-46c2-8c11-c549215276fe None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:46.642283 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001552fa-de34-46c2-8c11-c549215276fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:46.687231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-001552fa-de34-46c2-8c11-c549215276fe None None] MFA Rules not processed for user `721aed6cddeb46cf9d8f33deaf6e5b8b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:03:46.688742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-001552fa-de34-46c2-8c11-c549215276fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:46.720087 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b4f4e-fa84-40ef-aec9-6625bfa0dbdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:46.722830 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b4f4e-fa84-40ef-aec9-6625bfa0dbdf service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:46.742352 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1702/3375] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:03:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:03:46.774609 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1674/3376] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:03:46 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:03:46.979766 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b4f4e-fa84-40ef-aec9-6625bfa0dbdf service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:46.981898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7a4b4f4e-fa84-40ef-aec9-6625bfa0dbdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:46.996955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b4f4e-fa84-40ef-aec9-6625bfa0dbdf service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:47.005838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3c2f4-6028-434f-a013-8c651f5d096c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:47.006462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3c2f4-6028-434f-a013-8c651f5d096c service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:47.006803 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3c2f4-6028-434f-a013-8c651f5d096c service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:47.007208 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3c2f4-6028-434f-a013-8c651f5d096c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:47.017449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd3c2f4-6028-434f-a013-8c651f5d096c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:47.019594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd3c2f4-6028-434f-a013-8c651f5d096c service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:47.039641 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1703/3377] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:03:46 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:03:47.113454 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001552fa-de34-46c2-8c11-c549215276fe None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:47.222073 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001552fa-de34-46c2-8c11-c549215276fe None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:47.229020 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5c3f1-cd6c-4fee-a760-1dda516638ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:47.231774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5c3f1-cd6c-4fee-a760-1dda516638ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:47.232276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5c3f1-cd6c-4fee-a760-1dda516638ed admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:47.232746 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5c3f1-cd6c-4fee-a760-1dda516638ed admin admin] PATH_INFO: `/v3/users/43ac2a2240554ba793d5aa561e7b1399` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:47.234787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5c3f1-cd6c-4fee-a760-1dda516638ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=43ac2a2240554ba793d5aa561e7b1399)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:47.237451 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5c3f1-cd6c-4fee-a760-1dda516638ed admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:47.241988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:47.319197 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4bd5c3f1-cd6c-4fee-a760-1dda516638ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43ac2a2240554ba793d5aa561e7b1399'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:47.321035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4bd5c3f1-cd6c-4fee-a760-1dda516638ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43ac2a2240554ba793d5aa561e7b1399'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:47.321035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4bd5c3f1-cd6c-4fee-a760-1dda516638ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43ac2a2240554ba793d5aa561e7b1399'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:47.339563 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4bd5c3f1-cd6c-4fee-a760-1dda516638ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43ac2a2240554ba793d5aa561e7b1399'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:47.375762 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4bd5c3f1-cd6c-4fee-a760-1dda516638ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43ac2a2240554ba793d5aa561e7b1399'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:47.399256 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1675/3378] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:03:47 2022] DELETE /identity/v3/users/43ac2a2240554ba793d5aa561e7b1399 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:03:47.404745 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8dad7-7a59-45fd-be1b-58f6da0ec02b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:47.405076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8dad7-7a59-45fd-be1b-58f6da0ec02b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:47.405365 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8dad7-7a59-45fd-be1b-58f6da0ec02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:47.435708 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-52c8dad7-7a59-45fd-be1b-58f6da0ec02b None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:03:47.437969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-52c8dad7-7a59-45fd-be1b-58f6da0ec02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:47.530394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:47.559012 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1704/3379] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:03:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:03:47.575810 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5c3f1-cd6c-4fee-a760-1dda516638ed admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:47.578591 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4bd5c3f1-cd6c-4fee-a760-1dda516638ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:47.692588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5c3f1-cd6c-4fee-a760-1dda516638ed admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:47.698187 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f7307-880d-4e4b-a6ca-01dff997ca4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:47.699047 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f7307-880d-4e4b-a6ca-01dff997ca4e service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:47.700012 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f7307-880d-4e4b-a6ca-01dff997ca4e service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:47.700549 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f7307-880d-4e4b-a6ca-01dff997ca4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:47.711751 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f7307-880d-4e4b-a6ca-01dff997ca4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:47.713744 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f7307-880d-4e4b-a6ca-01dff997ca4e service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:47.730412 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1676/3380] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:03:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:03:48.272500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8dad7-7a59-45fd-be1b-58f6da0ec02b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:48.294788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8dad7-7a59-45fd-be1b-58f6da0ec02b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:48.302321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed25691-3afd-4121-b4ae-9d0c6abbc0a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:48.303012 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed25691-3afd-4121-b4ae-9d0c6abbc0a2 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:48.303343 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed25691-3afd-4121-b4ae-9d0c6abbc0a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:48.304360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed25691-3afd-4121-b4ae-9d0c6abbc0a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:48.306699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2ed25691-3afd-4121-b4ae-9d0c6abbc0a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:48.459460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed25691-3afd-4121-b4ae-9d0c6abbc0a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:48.461016 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed25691-3afd-4121-b4ae-9d0c6abbc0a2 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:48.474289 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1705/3381] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:03:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:03:49.450955 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f7307-880d-4e4b-a6ca-01dff997ca4e service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:49.453157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-328f7307-880d-4e4b-a6ca-01dff997ca4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:49.469237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f7307-880d-4e4b-a6ca-01dff997ca4e service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:49.474589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a431d-754c-46e0-8e2a-ee6e5ede7707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:49.475296 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a431d-754c-46e0-8e2a-ee6e5ede7707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:49.475654 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a431d-754c-46e0-8e2a-ee6e5ede7707 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:49.476396 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a431d-754c-46e0-8e2a-ee6e5ede7707 admin admin] PATH_INFO: `/v3/projects/8901890be0b346c18bce6a0b8c2cecfb` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:49.477719 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a431d-754c-46e0-8e2a-ee6e5ede7707 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8901890be0b346c18bce6a0b8c2cecfb)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:49.479875 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a431d-754c-46e0-8e2a-ee6e5ede7707 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:49.578581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-540a431d-754c-46e0-8e2a-ee6e5ede7707 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8901890be0b346c18bce6a0b8c2cecfb', 'request_id': 'req-540a431d-754c-46e0-8e2a-ee6e5ede7707'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:49.587155 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-540a431d-754c-46e0-8e2a-ee6e5ede7707 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8901890be0b346c18bce6a0b8c2cecfb', 'request_id': 'req-540a431d-754c-46e0-8e2a-ee6e5ede7707'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:49.596760 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-540a431d-754c-46e0-8e2a-ee6e5ede7707 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8901890be0b346c18bce6a0b8c2cecfb', 'request_id': 'req-540a431d-754c-46e0-8e2a-ee6e5ede7707'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:49.617122 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-540a431d-754c-46e0-8e2a-ee6e5ede7707 admin admin] The token cache is being invalidate because project 8901890be0b346c18bce6a0b8c2cecfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:03:49.617960 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-540a431d-754c-46e0-8e2a-ee6e5ede7707 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:49.618343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-540a431d-754c-46e0-8e2a-ee6e5ede7707 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:49.623998 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1677/3382] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:03:49 2022] DELETE /identity/v3/projects/8901890be0b346c18bce6a0b8c2cecfb => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:03:49.626194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183648e7-9a9b-4b75-a987-1851097e94f9 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:49.626740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183648e7-9a9b-4b75-a987-1851097e94f9 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:49.626841 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183648e7-9a9b-4b75-a987-1851097e94f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:49.655096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-183648e7-9a9b-4b75-a987-1851097e94f9 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:03:49.656497 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-183648e7-9a9b-4b75-a987-1851097e94f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:49.761132 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1706/3383] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:03:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:03:49.763560 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58374e-b373-424d-9441-da48a449b304 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:49.763847 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58374e-b373-424d-9441-da48a449b304 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:49.764142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58374e-b373-424d-9441-da48a449b304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:49.775680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:49.796041 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-bd58374e-b373-424d-9441-da48a449b304 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:03:49.800660 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-bd58374e-b373-424d-9441-da48a449b304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:49.823912 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1678/3384] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:03:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:03:49.828481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183648e7-9a9b-4b75-a987-1851097e94f9 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:49.842041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183648e7-9a9b-4b75-a987-1851097e94f9 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:49.848489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f8966-4e77-4e4f-bfb3-975dcadcd431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:49.849899 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f8966-4e77-4e4f-bfb3-975dcadcd431 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:49.850374 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f8966-4e77-4e4f-bfb3-975dcadcd431 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:49.851508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f8966-4e77-4e4f-bfb3-975dcadcd431 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:49.852498 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f8966-4e77-4e4f-bfb3-975dcadcd431 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:03:49.852961 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f8966-4e77-4e4f-bfb3-975dcadcd431 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:49.855547 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f8966-4e77-4e4f-bfb3-975dcadcd431 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:49.878320 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1707/3385] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:03:49.880018 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58374e-b373-424d-9441-da48a449b304 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:49.893195 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58374e-b373-424d-9441-da48a449b304 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:49.900269 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ab2eca-4d6a-431b-bd1d-8ba6db35e412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:49.901081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab2eca-4d6a-431b-bd1d-8ba6db35e412 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:49.901463 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab2eca-4d6a-431b-bd1d-8ba6db35e412 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:49.901828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab2eca-4d6a-431b-bd1d-8ba6db35e412 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:49.902639 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ab2eca-4d6a-431b-bd1d-8ba6db35e412 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:49.906047 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ab2eca-4d6a-431b-bd1d-8ba6db35e412 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:49.955132 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1679/3386] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:03:49 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:03:49.956674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f8966-4e77-4e4f-bfb3-975dcadcd431 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:49.980409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f8966-4e77-4e4f-bfb3-975dcadcd431 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:50.095302 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0bed7-f99a-4fef-a667-690298b8f5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:50.096591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0bed7-f99a-4fef-a667-690298b8f5aa admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:50.097039 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0bed7-f99a-4fef-a667-690298b8f5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:50.097471 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0bed7-f99a-4fef-a667-690298b8f5aa admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:50.098236 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0bed7-f99a-4fef-a667-690298b8f5aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:50.101056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0bed7-f99a-4fef-a667-690298b8f5aa admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:50.116179 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:50.136562 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1708/3387] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:03:49 2022] POST /identity/v3/users => generated 292 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:03:50.138155 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ab2eca-4d6a-431b-bd1d-8ba6db35e412 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:50.165240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ab2eca-4d6a-431b-bd1d-8ba6db35e412 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:50.175803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff52e9c-b36b-48e0-9458-29738b19b525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:50.179585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff52e9c-b36b-48e0-9458-29738b19b525 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:50.179943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff52e9c-b36b-48e0-9458-29738b19b525 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:50.180234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff52e9c-b36b-48e0-9458-29738b19b525 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:50.182257 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff52e9c-b36b-48e0-9458-29738b19b525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:50.185398 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff52e9c-b36b-48e0-9458-29738b19b525 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:50.208312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0bed7-f99a-4fef-a667-690298b8f5aa admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:50.218598 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1680/3388] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:03:50.224176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0bed7-f99a-4fef-a667-690298b8f5aa admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:50.249068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158698b-76ac-46f1-bee5-79899a8ccfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:50.254151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158698b-76ac-46f1-bee5-79899a8ccfd9 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:50.265185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158698b-76ac-46f1-bee5-79899a8ccfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:50.265503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158698b-76ac-46f1-bee5-79899a8ccfd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:50.267468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6158698b-76ac-46f1-bee5-79899a8ccfd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:50.270277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6158698b-76ac-46f1-bee5-79899a8ccfd9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:50.287739 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1709/3389] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:03:50.289847 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff52e9c-b36b-48e0-9458-29738b19b525 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:50.306990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff52e9c-b36b-48e0-9458-29738b19b525 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:50.319624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12948636-7ffa-4ffa-8dfa-4367c473d7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:50.320294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12948636-7ffa-4ffa-8dfa-4367c473d7dd admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:50.320568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12948636-7ffa-4ffa-8dfa-4367c473d7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:50.320837 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12948636-7ffa-4ffa-8dfa-4367c473d7dd admin admin] PATH_INFO: `/v3/projects/609ccfef33a94ae0ab5e082095e7ab1e/users/a7e47a63c2e64d3584e044fae0fe2270/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:50.356555 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12948636-7ffa-4ffa-8dfa-4367c473d7dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=609ccfef33a94ae0ab5e082095e7ab1e, user_id=a7e47a63c2e64d3584e044fae0fe2270, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:50.363429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12948636-7ffa-4ffa-8dfa-4367c473d7dd admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:50.390194 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1681/3390] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:03:50 2022] PUT /identity/v3/projects/609ccfef33a94ae0ab5e082095e7ab1e/users/a7e47a63c2e64d3584e044fae0fe2270/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:03:50.395211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3e67c-0a12-4d29-bf7f-688ac2045f67 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:50.395609 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3e67c-0a12-4d29-bf7f-688ac2045f67 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:50.396043 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3e67c-0a12-4d29-bf7f-688ac2045f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:50.443375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-e7e3e67c-0a12-4d29-bf7f-688ac2045f67 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:03:50.445941 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e7e3e67c-0a12-4d29-bf7f-688ac2045f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:50.565133 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1710/3391] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:03:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:03:50.588723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12948636-7ffa-4ffa-8dfa-4367c473d7dd admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:50.591497 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-12948636-7ffa-4ffa-8dfa-4367c473d7dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:50.718907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12948636-7ffa-4ffa-8dfa-4367c473d7dd admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:50.723048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40801d7-4c16-4d2b-8c7c-50393fdd3df3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:50.723993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40801d7-4c16-4d2b-8c7c-50393fdd3df3 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:50.723993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40801d7-4c16-4d2b-8c7c-50393fdd3df3 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:50.724325 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40801d7-4c16-4d2b-8c7c-50393fdd3df3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:50.739128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40801d7-4c16-4d2b-8c7c-50393fdd3df3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:50.741011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40801d7-4c16-4d2b-8c7c-50393fdd3df3 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:50.761154 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1682/3392] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:03:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:03:54.389473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3e67c-0a12-4d29-bf7f-688ac2045f67 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:54.427969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3e67c-0a12-4d29-bf7f-688ac2045f67 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:54.444314 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba9562-b0fa-4f52-9e5c-bf0ac6dcf2fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:54.445439 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba9562-b0fa-4f52-9e5c-bf0ac6dcf2fc service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:54.445919 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba9562-b0fa-4f52-9e5c-bf0ac6dcf2fc service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:54.447482 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba9562-b0fa-4f52-9e5c-bf0ac6dcf2fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:54.454980 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6cba9562-b0fa-4f52-9e5c-bf0ac6dcf2fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:54.499127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba9562-b0fa-4f52-9e5c-bf0ac6dcf2fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:54.504164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba9562-b0fa-4f52-9e5c-bf0ac6dcf2fc service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:54.522738 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1711/3393] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:03:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:03:58.870711 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40801d7-4c16-4d2b-8c7c-50393fdd3df3 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:58.873486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a40801d7-4c16-4d2b-8c7c-50393fdd3df3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:03:58.888771 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40801d7-4c16-4d2b-8c7c-50393fdd3df3 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:03:58.906065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e5972-5f35-45a6-90ef-e1431ef799a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:03:58.907438 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e5972-5f35-45a6-90ef-e1431ef799a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:03:58.908235 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e5972-5f35-45a6-90ef-e1431ef799a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:03:58.908755 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e5972-5f35-45a6-90ef-e1431ef799a5 admin admin] PATH_INFO: `/v3/users/9fc68526628248b18670cffb99246c9d` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:03:58.910071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e5972-5f35-45a6-90ef-e1431ef799a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fc68526628248b18670cffb99246c9d)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:03:58.913169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e5972-5f35-45a6-90ef-e1431ef799a5 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:03:59.011686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e45e5972-5f35-45a6-90ef-e1431ef799a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fc68526628248b18670cffb99246c9d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:59.013067 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e45e5972-5f35-45a6-90ef-e1431ef799a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fc68526628248b18670cffb99246c9d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:59.023214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e45e5972-5f35-45a6-90ef-e1431ef799a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fc68526628248b18670cffb99246c9d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:59.036132 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e45e5972-5f35-45a6-90ef-e1431ef799a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fc68526628248b18670cffb99246c9d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:59.058532 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e45e5972-5f35-45a6-90ef-e1431ef799a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fc68526628248b18670cffb99246c9d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:03:59.088235 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1683/3394] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:03:58 2022] DELETE /identity/v3/users/9fc68526628248b18670cffb99246c9d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:03:59.882232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba9562-b0fa-4f52-9e5c-bf0ac6dcf2fc service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:03:59.884273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6cba9562-b0fa-4f52-9e5c-bf0ac6dcf2fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:00.018376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba9562-b0fa-4f52-9e5c-bf0ac6dcf2fc service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:00.112218 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371e806-1d46-4e73-878a-5e7f9575d11a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:00.114397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371e806-1d46-4e73-878a-5e7f9575d11a service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:00.114730 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371e806-1d46-4e73-878a-5e7f9575d11a service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:00.115007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371e806-1d46-4e73-878a-5e7f9575d11a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:00.116903 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3371e806-1d46-4e73-878a-5e7f9575d11a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:00.128282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:00.132760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371e806-1d46-4e73-878a-5e7f9575d11a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:00.134568 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371e806-1d46-4e73-878a-5e7f9575d11a service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:00.148027 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1712/3395] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:03:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:04:00.289847 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e5972-5f35-45a6-90ef-e1431ef799a5 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:00.291416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e45e5972-5f35-45a6-90ef-e1431ef799a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:00.325823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:00.399471 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e5972-5f35-45a6-90ef-e1431ef799a5 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:00.426638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32380c-69ac-4cb4-924f-f64c8b9b555a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:00.430420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32380c-69ac-4cb4-924f-f64c8b9b555a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:00.433317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32380c-69ac-4cb4-924f-f64c8b9b555a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:00.434733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32380c-69ac-4cb4-924f-f64c8b9b555a admin admin] PATH_INFO: `/v3/projects/1d11bd5e6d68490185f009db8dbf1d3b` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:00.439944 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32380c-69ac-4cb4-924f-f64c8b9b555a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d11bd5e6d68490185f009db8dbf1d3b)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:00.445379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32380c-69ac-4cb4-924f-f64c8b9b555a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:00.553609 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8f32380c-69ac-4cb4-924f-f64c8b9b555a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d11bd5e6d68490185f009db8dbf1d3b', 'request_id': 'req-8f32380c-69ac-4cb4-924f-f64c8b9b555a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:00.571340 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8f32380c-69ac-4cb4-924f-f64c8b9b555a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d11bd5e6d68490185f009db8dbf1d3b', 'request_id': 'req-8f32380c-69ac-4cb4-924f-f64c8b9b555a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:00.588712 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8f32380c-69ac-4cb4-924f-f64c8b9b555a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d11bd5e6d68490185f009db8dbf1d3b', 'request_id': 'req-8f32380c-69ac-4cb4-924f-f64c8b9b555a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:00.624170 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8f32380c-69ac-4cb4-924f-f64c8b9b555a admin admin] The token cache is being invalidate because project 1d11bd5e6d68490185f009db8dbf1d3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:04:00.626918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8f32380c-69ac-4cb4-924f-f64c8b9b555a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:00.627750 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8f32380c-69ac-4cb4-924f-f64c8b9b555a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:00.632002 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1684/3396] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:04:00 2022] DELETE /identity/v3/projects/1d11bd5e6d68490185f009db8dbf1d3b => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:04:00.638218 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68d840-2aad-4943-bb96-25c17f4591eb None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:00.638528 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68d840-2aad-4943-bb96-25c17f4591eb None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:00.638847 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68d840-2aad-4943-bb96-25c17f4591eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:00.700842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-4f68d840-2aad-4943-bb96-25c17f4591eb None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:04:00.702268 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4f68d840-2aad-4943-bb96-25c17f4591eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:00.851497 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1713/3397] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:04:00.861566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b648c1-e77b-4adb-a6ba-63e0850d691d None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:00.861854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b648c1-e77b-4adb-a6ba-63e0850d691d None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:00.862130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b648c1-e77b-4adb-a6ba-63e0850d691d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:00.906728 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-64b648c1-e77b-4adb-a6ba-63e0850d691d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:04:00.908102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-64b648c1-e77b-4adb-a6ba-63e0850d691d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:00.935487 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1685/3398] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:04:00.940381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68d840-2aad-4943-bb96-25c17f4591eb None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:00.954026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68d840-2aad-4943-bb96-25c17f4591eb None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:00.990294 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a42c9-1791-44c6-a6f9-3d696408cf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:00.991226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a42c9-1791-44c6-a6f9-3d696408cf46 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:00.991657 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a42c9-1791-44c6-a6f9-3d696408cf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:00.992081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a42c9-1791-44c6-a6f9-3d696408cf46 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:00.992905 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a42c9-1791-44c6-a6f9-3d696408cf46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:04:00.993860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a42c9-1791-44c6-a6f9-3d696408cf46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:00.995682 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a42c9-1791-44c6-a6f9-3d696408cf46 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:01.013324 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1714/3399] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:04:01.017352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b648c1-e77b-4adb-a6ba-63e0850d691d None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:01.036327 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b648c1-e77b-4adb-a6ba-63e0850d691d None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:01.051131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53624b-dded-46f9-abcf-bcd94581b144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:01.052558 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53624b-dded-46f9-abcf-bcd94581b144 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:01.052852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53624b-dded-46f9-abcf-bcd94581b144 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:01.053129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53624b-dded-46f9-abcf-bcd94581b144 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:01.053830 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53624b-dded-46f9-abcf-bcd94581b144 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:01.060959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53624b-dded-46f9-abcf-bcd94581b144 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:01.128947 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1686/3400] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:04:01 2022] POST /identity/v3/projects => generated 401 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:04:01.131981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a42c9-1791-44c6-a6f9-3d696408cf46 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:01.151855 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a42c9-1791-44c6-a6f9-3d696408cf46 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:01.289584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9a62b-9f64-499c-8b9a-d177e0d40518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:01.290238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9a62b-9f64-499c-8b9a-d177e0d40518 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:01.290535 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9a62b-9f64-499c-8b9a-d177e0d40518 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:01.290977 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9a62b-9f64-499c-8b9a-d177e0d40518 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:01.291793 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b9a62b-9f64-499c-8b9a-d177e0d40518 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:01.294807 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b9a62b-9f64-499c-8b9a-d177e0d40518 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:01.352514 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1715/3401] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:04:01 2022] POST /identity/v3/users => generated 301 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:04:01.354077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53624b-dded-46f9-abcf-bcd94581b144 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:01.372281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53624b-dded-46f9-abcf-bcd94581b144 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:01.379356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7247a49-ac9d-4e8a-9917-bcf82932b812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:01.380148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7247a49-ac9d-4e8a-9917-bcf82932b812 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:01.380581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7247a49-ac9d-4e8a-9917-bcf82932b812 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:01.381000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7247a49-ac9d-4e8a-9917-bcf82932b812 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:01.382537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7247a49-ac9d-4e8a-9917-bcf82932b812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:01.385059 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7247a49-ac9d-4e8a-9917-bcf82932b812 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:01.399871 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1687/3402] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:04:01.405339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9a62b-9f64-499c-8b9a-d177e0d40518 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:01.422262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9a62b-9f64-499c-8b9a-d177e0d40518 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:01.435793 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf398993-c7a6-43c4-b86c-3e823978cfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:01.436678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf398993-c7a6-43c4-b86c-3e823978cfc1 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:01.437170 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf398993-c7a6-43c4-b86c-3e823978cfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:01.438633 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf398993-c7a6-43c4-b86c-3e823978cfc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:01.439470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf398993-c7a6-43c4-b86c-3e823978cfc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:01.442255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf398993-c7a6-43c4-b86c-3e823978cfc1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:01.480121 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1716/3403] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:04:01.483103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7247a49-ac9d-4e8a-9917-bcf82932b812 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:01.500957 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7247a49-ac9d-4e8a-9917-bcf82932b812 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:01.508531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3d1c4-1642-49d2-9312-6912aebf4053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:01.510459 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3d1c4-1642-49d2-9312-6912aebf4053 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:01.510937 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3d1c4-1642-49d2-9312-6912aebf4053 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:01.511369 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3d1c4-1642-49d2-9312-6912aebf4053 admin admin] PATH_INFO: `/v3/projects/89c9fc448338409b81bfb23efbd52ed2/users/797faa6fd1d44cbf8d2ef9176c50b45e/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:01.539829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf3d1c4-1642-49d2-9312-6912aebf4053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89c9fc448338409b81bfb23efbd52ed2, user_id=797faa6fd1d44cbf8d2ef9176c50b45e, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:01.546864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf3d1c4-1642-49d2-9312-6912aebf4053 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:01.568020 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1688/3404] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:04:01 2022] PUT /identity/v3/projects/89c9fc448338409b81bfb23efbd52ed2/users/797faa6fd1d44cbf8d2ef9176c50b45e/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:04:01.579181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c29ee9-7dfb-421d-a97e-7501eb2bdcaf None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:01.579479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c29ee9-7dfb-421d-a97e-7501eb2bdcaf None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:01.579739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c29ee9-7dfb-421d-a97e-7501eb2bdcaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:01.631564 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-73c29ee9-7dfb-421d-a97e-7501eb2bdcaf None None] MFA Rules not processed for user `797faa6fd1d44cbf8d2ef9176c50b45e`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:04:01.632805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-73c29ee9-7dfb-421d-a97e-7501eb2bdcaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:01.782087 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:01.834280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3d1c4-1642-49d2-9312-6912aebf4053 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:01.836705 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1717/3405] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:04:01 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:04:01.837873 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8cf3d1c4-1642-49d2-9312-6912aebf4053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:01.916053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:01.953074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3d1c4-1642-49d2-9312-6912aebf4053 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:01.961037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92812d-458e-47eb-bd5f-dfbd3180ccad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:01.961882 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92812d-458e-47eb-bd5f-dfbd3180ccad service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:01.962366 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92812d-458e-47eb-bd5f-dfbd3180ccad service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:01.962808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92812d-458e-47eb-bd5f-dfbd3180ccad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:01.965318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7f92812d-458e-47eb-bd5f-dfbd3180ccad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:01.982777 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f92812d-458e-47eb-bd5f-dfbd3180ccad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:01.985231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f92812d-458e-47eb-bd5f-dfbd3180ccad service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:02.021253 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1689/3406] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:04:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:04:02.326970 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c29ee9-7dfb-421d-a97e-7501eb2bdcaf None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:02.347870 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c29ee9-7dfb-421d-a97e-7501eb2bdcaf None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:02.364946 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b79ca-c620-4bec-8569-aa4024c1fb95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:02.365588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b79ca-c620-4bec-8569-aa4024c1fb95 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:02.365879 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b79ca-c620-4bec-8569-aa4024c1fb95 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:02.366156 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b79ca-c620-4bec-8569-aa4024c1fb95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:02.376244 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b79ca-c620-4bec-8569-aa4024c1fb95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:02.378353 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b79ca-c620-4bec-8569-aa4024c1fb95 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:02.392848 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1718/3407] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:04:02 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:04:02.461488 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92812d-458e-47eb-bd5f-dfbd3180ccad service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:02.661315 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92812d-458e-47eb-bd5f-dfbd3180ccad service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:02.668185 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a5489-caf7-4d0a-bb59-ec8c8358afb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:02.669709 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a5489-caf7-4d0a-bb59-ec8c8358afb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:02.670323 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a5489-caf7-4d0a-bb59-ec8c8358afb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:02.671263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a5489-caf7-4d0a-bb59-ec8c8358afb9 admin admin] PATH_INFO: `/v3/users/797faa6fd1d44cbf8d2ef9176c50b45e` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:02.672849 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a5489-caf7-4d0a-bb59-ec8c8358afb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=797faa6fd1d44cbf8d2ef9176c50b45e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:02.676203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a5489-caf7-4d0a-bb59-ec8c8358afb9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:02.797997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d57a5489-caf7-4d0a-bb59-ec8c8358afb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '797faa6fd1d44cbf8d2ef9176c50b45e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:02.799359 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d57a5489-caf7-4d0a-bb59-ec8c8358afb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '797faa6fd1d44cbf8d2ef9176c50b45e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:02.800341 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d57a5489-caf7-4d0a-bb59-ec8c8358afb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '797faa6fd1d44cbf8d2ef9176c50b45e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:02.814527 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d57a5489-caf7-4d0a-bb59-ec8c8358afb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '797faa6fd1d44cbf8d2ef9176c50b45e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:02.838176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d57a5489-caf7-4d0a-bb59-ec8c8358afb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '797faa6fd1d44cbf8d2ef9176c50b45e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:02.891036 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1690/3408] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:04:02 2022] DELETE /identity/v3/users/797faa6fd1d44cbf8d2ef9176c50b45e => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:04:02.892888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb2565-2781-4db9-a4af-8c25a60bd7be None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:02.893191 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb2565-2781-4db9-a4af-8c25a60bd7be None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:02.893466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb2565-2781-4db9-a4af-8c25a60bd7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:02.916915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-10eb2565-2781-4db9-a4af-8c25a60bd7be None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:04:02.918214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-10eb2565-2781-4db9-a4af-8c25a60bd7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:03.054922 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1719/3409] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:04:03.055861 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a5489-caf7-4d0a-bb59-ec8c8358afb9 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:03.057610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d57a5489-caf7-4d0a-bb59-ec8c8358afb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:03.143747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:03.152341 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a5489-caf7-4d0a-bb59-ec8c8358afb9 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:03.157889 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2cbe78-2a90-4349-83e5-20df717f9e49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:03.158827 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cbe78-2a90-4349-83e5-20df717f9e49 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:03.159376 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cbe78-2a90-4349-83e5-20df717f9e49 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:03.160279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cbe78-2a90-4349-83e5-20df717f9e49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:03.173648 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2cbe78-2a90-4349-83e5-20df717f9e49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:03.175244 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2cbe78-2a90-4349-83e5-20df717f9e49 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:03.198533 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1691/3410] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:04:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:04:04.149088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb2565-2781-4db9-a4af-8c25a60bd7be None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:04.156430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-10eb2565-2781-4db9-a4af-8c25a60bd7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:04.172197 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb2565-2781-4db9-a4af-8c25a60bd7be None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:04.217684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482abdb-31c3-4841-a33e-a0ff00f00f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:04.218866 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482abdb-31c3-4841-a33e-a0ff00f00f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:04.221538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482abdb-31c3-4841-a33e-a0ff00f00f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:04.222900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482abdb-31c3-4841-a33e-a0ff00f00f36 admin admin] PATH_INFO: `/v3/projects/89c9fc448338409b81bfb23efbd52ed2` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:04.235086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9482abdb-31c3-4841-a33e-a0ff00f00f36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89c9fc448338409b81bfb23efbd52ed2)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:04.238414 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9482abdb-31c3-4841-a33e-a0ff00f00f36 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:04.347244 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9482abdb-31c3-4841-a33e-a0ff00f00f36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89c9fc448338409b81bfb23efbd52ed2', 'request_id': 'req-9482abdb-31c3-4841-a33e-a0ff00f00f36'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:04.354883 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9482abdb-31c3-4841-a33e-a0ff00f00f36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89c9fc448338409b81bfb23efbd52ed2', 'request_id': 'req-9482abdb-31c3-4841-a33e-a0ff00f00f36'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:04.368526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9482abdb-31c3-4841-a33e-a0ff00f00f36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89c9fc448338409b81bfb23efbd52ed2', 'request_id': 'req-9482abdb-31c3-4841-a33e-a0ff00f00f36'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:04.389257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9482abdb-31c3-4841-a33e-a0ff00f00f36 admin admin] The token cache is being invalidate because project 89c9fc448338409b81bfb23efbd52ed2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:04:04.389828 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9482abdb-31c3-4841-a33e-a0ff00f00f36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:04.392722 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9482abdb-31c3-4841-a33e-a0ff00f00f36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:04.398908 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1720/3411] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:04:04 2022] DELETE /identity/v3/projects/89c9fc448338409b81bfb23efbd52ed2 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:04:04.399644 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d4d1a-8d56-4a20-b52c-685525e1066e None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:04.400107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d4d1a-8d56-4a20-b52c-685525e1066e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:04.400186 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d4d1a-8d56-4a20-b52c-685525e1066e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:04.430658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-789d4d1a-8d56-4a20-b52c-685525e1066e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:04:04.432187 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-789d4d1a-8d56-4a20-b52c-685525e1066e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:04.519444 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1692/3412] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:04:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:04:04.529359 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e0d34-88e0-424f-b528-b6ad48d58640 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:04.539351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e0d34-88e0-424f-b528-b6ad48d58640 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:04.540626 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e0d34-88e0-424f-b528-b6ad48d58640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:04.572682 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-286e0d34-88e0-424f-b528-b6ad48d58640 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:04:04.574433 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-286e0d34-88e0-424f-b528-b6ad48d58640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:04.599514 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1721/3413] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:04:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:04:04.600714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d4d1a-8d56-4a20-b52c-685525e1066e None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:04.615121 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d4d1a-8d56-4a20-b52c-685525e1066e None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:04.625420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad652e90-f668-415c-b22b-b2431cdda505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:04.626318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad652e90-f668-415c-b22b-b2431cdda505 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:04.628237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad652e90-f668-415c-b22b-b2431cdda505 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:04.628583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad652e90-f668-415c-b22b-b2431cdda505 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:04.629393 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad652e90-f668-415c-b22b-b2431cdda505 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:04:04.630048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad652e90-f668-415c-b22b-b2431cdda505 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:04.632282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad652e90-f668-415c-b22b-b2431cdda505 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:04.661916 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e0d34-88e0-424f-b528-b6ad48d58640 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:04.668921 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1693/3414] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:04:04.674516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e0d34-88e0-424f-b528-b6ad48d58640 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:04.681993 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62671bed-aae8-40d4-90eb-fb930c1c3d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:04.682926 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62671bed-aae8-40d4-90eb-fb930c1c3d78 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:04.683408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62671bed-aae8-40d4-90eb-fb930c1c3d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:04.683958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62671bed-aae8-40d4-90eb-fb930c1c3d78 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:04.684786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62671bed-aae8-40d4-90eb-fb930c1c3d78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:04.687069 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62671bed-aae8-40d4-90eb-fb930c1c3d78 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:04.709805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3086bd-d4a6-4205-9bde-64cad5002a4f None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:04.710500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3086bd-d4a6-4205-9bde-64cad5002a4f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:04.711017 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3086bd-d4a6-4205-9bde-64cad5002a4f None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:04.712884 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1694/3415] 10.222.0.33 () {54 vars in 921 bytes} [Sat Aug 6 21:04:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 21:04:04.725473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879ebea-c2bc-43b2-bf23-880b2516d3c3 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:04.726010 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879ebea-c2bc-43b2-bf23-880b2516d3c3 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:04.726331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879ebea-c2bc-43b2-bf23-880b2516d3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:04.754138 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1722/3416] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:04:04 2022] POST /identity/v3/projects => generated 405 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:04:04.758975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62671bed-aae8-40d4-90eb-fb930c1c3d78 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:04.760247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-6879ebea-c2bc-43b2-bf23-880b2516d3c3 None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:04:04.762729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6879ebea-c2bc-43b2-bf23-880b2516d3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:04.832372 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:04.905479 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1695/3417] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 21:04:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:04:04.937896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62671bed-aae8-40d4-90eb-fb930c1c3d78 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:04.940658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879ebea-c2bc-43b2-bf23-880b2516d3c3 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:04.943317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6879ebea-c2bc-43b2-bf23-880b2516d3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:04.947705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b83f2-059f-4a7c-b725-465effbc175f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:04.950891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b83f2-059f-4a7c-b725-465effbc175f admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:04.951300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b83f2-059f-4a7c-b725-465effbc175f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:04.951642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b83f2-059f-4a7c-b725-465effbc175f admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:04.952655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b83f2-059f-4a7c-b725-465effbc175f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:04.959675 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b83f2-059f-4a7c-b725-465effbc175f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:04.964189 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879ebea-c2bc-43b2-bf23-880b2516d3c3 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:04.971191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb1cf6-01d2-41b7-9c11-08dc08ba659c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:04.971868 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb1cf6-01d2-41b7-9c11-08dc08ba659c service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:04.972149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb1cf6-01d2-41b7-9c11-08dc08ba659c service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:04.972421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb1cf6-01d2-41b7-9c11-08dc08ba659c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:04.984611 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb1cf6-01d2-41b7-9c11-08dc08ba659c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:04.986359 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb1cf6-01d2-41b7-9c11-08dc08ba659c service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:05.012781 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1696/3418] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:04:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:04:05.017167 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1723/3419] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:04:04 2022] POST /identity/v3/users => generated 303 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:04:05.017338 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb1cf6-01d2-41b7-9c11-08dc08ba659c service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:05.035829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb1cf6-01d2-41b7-9c11-08dc08ba659c service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:05.048402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdedc846-6c23-408f-b3bb-ecdd73acf4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:05.048854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedc846-6c23-408f-b3bb-ecdd73acf4ea admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:05.049078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedc846-6c23-408f-b3bb-ecdd73acf4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:05.049350 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedc846-6c23-408f-b3bb-ecdd73acf4ea admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:05.049997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdedc846-6c23-408f-b3bb-ecdd73acf4ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:05.054027 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdedc846-6c23-408f-b3bb-ecdd73acf4ea admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:05.074530 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1697/3420] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:04:05.076056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b83f2-059f-4a7c-b725-465effbc175f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:05.087562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b83f2-059f-4a7c-b725-465effbc175f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:05.092867 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040762d-6d93-48b7-9707-d1618a38b7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:05.093549 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040762d-6d93-48b7-9707-d1618a38b7f1 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:05.093856 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040762d-6d93-48b7-9707-d1618a38b7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:05.094197 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040762d-6d93-48b7-9707-d1618a38b7f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:05.094982 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4040762d-6d93-48b7-9707-d1618a38b7f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:05.097120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4040762d-6d93-48b7-9707-d1618a38b7f1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:05.137241 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1724/3421] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:04:05.138421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdedc846-6c23-408f-b3bb-ecdd73acf4ea admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:05.152799 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdedc846-6c23-408f-b3bb-ecdd73acf4ea admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:05.159370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f0149-d8fd-40ea-92ed-0e7812fc0c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:05.165520 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f0149-d8fd-40ea-92ed-0e7812fc0c1f admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:05.165812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f0149-d8fd-40ea-92ed-0e7812fc0c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:05.166079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f0149-d8fd-40ea-92ed-0e7812fc0c1f admin admin] PATH_INFO: `/v3/projects/4566277f215048cb9aaa09c4b3e577e8/users/cc790d675b2e4bae8a38e0666f5c9e27/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:05.208967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f0149-d8fd-40ea-92ed-0e7812fc0c1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4566277f215048cb9aaa09c4b3e577e8, user_id=cc790d675b2e4bae8a38e0666f5c9e27, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:05.212323 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f0149-d8fd-40ea-92ed-0e7812fc0c1f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:05.272643 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1698/3422] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:04:05 2022] PUT /identity/v3/projects/4566277f215048cb9aaa09c4b3e577e8/users/cc790d675b2e4bae8a38e0666f5c9e27/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:04:05.275317 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab9adb-24aa-4b0f-a6ee-cf08c589f02e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:05.275796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab9adb-24aa-4b0f-a6ee-cf08c589f02e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:05.276043 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab9adb-24aa-4b0f-a6ee-cf08c589f02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:05.300159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-f0ab9adb-24aa-4b0f-a6ee-cf08c589f02e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:04:05.301757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f0ab9adb-24aa-4b0f-a6ee-cf08c589f02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:05.431383 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1725/3423] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:04:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:04:05.445812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f0149-d8fd-40ea-92ed-0e7812fc0c1f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:05.450303 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-af7f0149-d8fd-40ea-92ed-0e7812fc0c1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:05.503170 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:05.552542 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f0149-d8fd-40ea-92ed-0e7812fc0c1f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:05.557605 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa3057-9b1a-4adb-a6ad-0e434754c8b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:05.560091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa3057-9b1a-4adb-a6ad-0e434754c8b7 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:05.560615 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa3057-9b1a-4adb-a6ad-0e434754c8b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:05.560972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa3057-9b1a-4adb-a6ad-0e434754c8b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:05.572658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa3057-9b1a-4adb-a6ad-0e434754c8b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:05.574278 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa3057-9b1a-4adb-a6ad-0e434754c8b7 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:05.587400 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1699/3424] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:04:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:04:05.750409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3088dc-df18-4d75-9ba5-fa370b13e71f None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:05.751068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3088dc-df18-4d75-9ba5-fa370b13e71f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:05.751533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3088dc-df18-4d75-9ba5-fa370b13e71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:05.816953 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-5b3088dc-df18-4d75-9ba5-fa370b13e71f None None] MFA Rules not processed for user `a7e47a63c2e64d3584e044fae0fe2270`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:04:05.820220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5b3088dc-df18-4d75-9ba5-fa370b13e71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:05.934479 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1726/3425] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:04:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:04:06.367111 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa3057-9b1a-4adb-a6ad-0e434754c8b7 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:06.368568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-dafa3057-9b1a-4adb-a6ad-0e434754c8b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:06.452414 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa3057-9b1a-4adb-a6ad-0e434754c8b7 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:06.458468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050f41b-42bc-45d7-9717-3a09ee76f5d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:06.459655 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050f41b-42bc-45d7-9717-3a09ee76f5d6 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:06.460190 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050f41b-42bc-45d7-9717-3a09ee76f5d6 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:06.460652 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050f41b-42bc-45d7-9717-3a09ee76f5d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:06.470063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050f41b-42bc-45d7-9717-3a09ee76f5d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:06.474354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050f41b-42bc-45d7-9717-3a09ee76f5d6 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:06.485200 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1700/3426] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:04:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:04:12.521324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3088dc-df18-4d75-9ba5-fa370b13e71f None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:12.524379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5b3088dc-df18-4d75-9ba5-fa370b13e71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:12.550868 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3088dc-df18-4d75-9ba5-fa370b13e71f None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:12.564371 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672f2fc-bfcf-45ba-b65e-f9f0093a55bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:12.567157 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672f2fc-bfcf-45ba-b65e-f9f0093a55bd service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:12.570290 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672f2fc-bfcf-45ba-b65e-f9f0093a55bd service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:12.570890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672f2fc-bfcf-45ba-b65e-f9f0093a55bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:12.575817 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f672f2fc-bfcf-45ba-b65e-f9f0093a55bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:12.594960 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672f2fc-bfcf-45ba-b65e-f9f0093a55bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:12.596861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672f2fc-bfcf-45ba-b65e-f9f0093a55bd service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:12.610814 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1727/3427] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:04:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:04:12.892300 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b832e14-9c5f-48cb-8665-dbc33c5e176f None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:12.892738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b832e14-9c5f-48cb-8665-dbc33c5e176f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:12.892738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b832e14-9c5f-48cb-8665-dbc33c5e176f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:12.922045 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-3b832e14-9c5f-48cb-8665-dbc33c5e176f None None] MFA Rules not processed for user `a7e47a63c2e64d3584e044fae0fe2270`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:04:12.923463 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3b832e14-9c5f-48cb-8665-dbc33c5e176f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:12.937449 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1701/3428] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:04:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:04:14.906104 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672f2fc-bfcf-45ba-b65e-f9f0093a55bd service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:14.907588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f672f2fc-bfcf-45ba-b65e-f9f0093a55bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:14.991042 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:15.079093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672f2fc-bfcf-45ba-b65e-f9f0093a55bd service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:15.085833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdaf2e3-7dc9-4f95-92bd-3c838efc0309 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:15.086454 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdaf2e3-7dc9-4f95-92bd-3c838efc0309 service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:15.086770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdaf2e3-7dc9-4f95-92bd-3c838efc0309 service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:15.087048 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdaf2e3-7dc9-4f95-92bd-3c838efc0309 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:15.089052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6fdaf2e3-7dc9-4f95-92bd-3c838efc0309 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:15.106194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdaf2e3-7dc9-4f95-92bd-3c838efc0309 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:15.108266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdaf2e3-7dc9-4f95-92bd-3c838efc0309 service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:15.121919 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1728/3429] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:04:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:04:19.894625 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b832e14-9c5f-48cb-8665-dbc33c5e176f None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:19.896217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3b832e14-9c5f-48cb-8665-dbc33c5e176f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:19.925449 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b832e14-9c5f-48cb-8665-dbc33c5e176f None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:19.944704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ad0f6-ad14-436d-b0b2-eef8ed6c7017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:19.945394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ad0f6-ad14-436d-b0b2-eef8ed6c7017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:19.945679 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ad0f6-ad14-436d-b0b2-eef8ed6c7017 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:19.945960 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ad0f6-ad14-436d-b0b2-eef8ed6c7017 admin admin] PATH_INFO: `/v3/users/0902f98ad0254cc48ff7e0e5469e8f2d` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:19.947231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ad0f6-ad14-436d-b0b2-eef8ed6c7017 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0902f98ad0254cc48ff7e0e5469e8f2d)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:19.951749 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ad0f6-ad14-436d-b0b2-eef8ed6c7017 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:20.095703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-882ad0f6-ad14-436d-b0b2-eef8ed6c7017 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0902f98ad0254cc48ff7e0e5469e8f2d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:20.097070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-882ad0f6-ad14-436d-b0b2-eef8ed6c7017 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0902f98ad0254cc48ff7e0e5469e8f2d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:20.099003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-882ad0f6-ad14-436d-b0b2-eef8ed6c7017 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0902f98ad0254cc48ff7e0e5469e8f2d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:20.114887 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-882ad0f6-ad14-436d-b0b2-eef8ed6c7017 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0902f98ad0254cc48ff7e0e5469e8f2d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:20.147175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-882ad0f6-ad14-436d-b0b2-eef8ed6c7017 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0902f98ad0254cc48ff7e0e5469e8f2d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:20.178488 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1702/3430] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:04:19 2022] DELETE /identity/v3/users/0902f98ad0254cc48ff7e0e5469e8f2d => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:04:21.551640 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdaf2e3-7dc9-4f95-92bd-3c838efc0309 service placement] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:21.568950 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdaf2e3-7dc9-4f95-92bd-3c838efc0309 service placement] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:21.763045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ee756-cb90-456c-b593-3bf75286788c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:21.763734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ee756-cb90-456c-b593-3bf75286788c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:21.765968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ee756-cb90-456c-b593-3bf75286788c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:21.766255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ee756-cb90-456c-b593-3bf75286788c admin admin] PATH_INFO: `/v3/projects/ce57444bd40e42f4bf88177067f756b0` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:21.773190 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ee756-cb90-456c-b593-3bf75286788c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce57444bd40e42f4bf88177067f756b0)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:21.779295 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ee756-cb90-456c-b593-3bf75286788c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:21.920177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e22ee756-cb90-456c-b593-3bf75286788c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce57444bd40e42f4bf88177067f756b0', 'request_id': 'req-e22ee756-cb90-456c-b593-3bf75286788c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:21.941133 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e22ee756-cb90-456c-b593-3bf75286788c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce57444bd40e42f4bf88177067f756b0', 'request_id': 'req-e22ee756-cb90-456c-b593-3bf75286788c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:21.965278 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e22ee756-cb90-456c-b593-3bf75286788c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce57444bd40e42f4bf88177067f756b0', 'request_id': 'req-e22ee756-cb90-456c-b593-3bf75286788c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:21.996733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e22ee756-cb90-456c-b593-3bf75286788c admin admin] The token cache is being invalidate because project ce57444bd40e42f4bf88177067f756b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:04:21.997023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e22ee756-cb90-456c-b593-3bf75286788c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:21.998684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e22ee756-cb90-456c-b593-3bf75286788c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:22.001483 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1729/3431] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:04:21 2022] DELETE /identity/v3/projects/ce57444bd40e42f4bf88177067f756b0 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:04:22.006645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a716d-7c94-4506-bc68-d78f87f45197 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:22.007467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a716d-7c94-4506-bc68-d78f87f45197 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:22.007906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a716d-7c94-4506-bc68-d78f87f45197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:22.048239 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-3d7a716d-7c94-4506-bc68-d78f87f45197 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:04:22.052918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3d7a716d-7c94-4506-bc68-d78f87f45197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:22.117077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:22.256360 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1703/3432] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:04:22.282457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b32fc-0202-4a2d-aa70-3fdd6134bacc None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:22.282825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b32fc-0202-4a2d-aa70-3fdd6134bacc None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:22.283045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b32fc-0202-4a2d-aa70-3fdd6134bacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:22.332029 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-268b32fc-0202-4a2d-aa70-3fdd6134bacc None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:04:22.333257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-268b32fc-0202-4a2d-aa70-3fdd6134bacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:22.357982 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1730/3433] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:04:22.360821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a716d-7c94-4506-bc68-d78f87f45197 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:22.375000 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c497fb-0673-4eb1-9dca-6a599ed3167c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:22.375173 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c497fb-0673-4eb1-9dca-6a599ed3167c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:22.375456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c497fb-0673-4eb1-9dca-6a599ed3167c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:22.375646 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a716d-7c94-4506-bc68-d78f87f45197 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:22.395996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0944fe0-3d7d-4f2d-860b-a77a19ef8803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:22.396365 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0944fe0-3d7d-4f2d-860b-a77a19ef8803 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:22.396648 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0944fe0-3d7d-4f2d-860b-a77a19ef8803 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:22.400043 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0944fe0-3d7d-4f2d-860b-a77a19ef8803 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:22.400773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0944fe0-3d7d-4f2d-860b-a77a19ef8803 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:04:22.404123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0944fe0-3d7d-4f2d-860b-a77a19ef8803 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:22.406195 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0944fe0-3d7d-4f2d-860b-a77a19ef8803 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:22.437848 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d4c497fb-0673-4eb1-9dca-6a599ed3167c None None] MFA Rules not processed for user `cc790d675b2e4bae8a38e0666f5c9e27`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:04:22.439125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d4c497fb-0673-4eb1-9dca-6a599ed3167c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:22.485920 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1704/3434] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:04:22.489699 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0944fe0-3d7d-4f2d-860b-a77a19ef8803 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:22.516909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:22.528790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0944fe0-3d7d-4f2d-860b-a77a19ef8803 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:22.550578 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7584e-bea0-4082-a193-708df07a1a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:22.551234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7584e-bea0-4082-a193-708df07a1a96 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:22.552889 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7584e-bea0-4082-a193-708df07a1a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:22.553553 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7584e-bea0-4082-a193-708df07a1a96 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:22.555574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7584e-bea0-4082-a193-708df07a1a96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:22.569421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7584e-bea0-4082-a193-708df07a1a96 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:22.607579 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1731/3435] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:04:22 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:04:22.666788 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1705/3436] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:04:22 2022] POST /identity/v3/projects => generated 373 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:04:22.679955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c497fb-0673-4eb1-9dca-6a599ed3167c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:22.701072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c497fb-0673-4eb1-9dca-6a599ed3167c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:22.813883 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3ee36-f565-4119-b822-0000ac9ef004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:22.814666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3ee36-f565-4119-b822-0000ac9ef004 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:22.815045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3ee36-f565-4119-b822-0000ac9ef004 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:22.815414 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3ee36-f565-4119-b822-0000ac9ef004 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:22.816140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3ee36-f565-4119-b822-0000ac9ef004 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:22.818661 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3ee36-f565-4119-b822-0000ac9ef004 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:22.848931 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1732/3437] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:04:22 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:04:22.852926 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7584e-bea0-4082-a193-708df07a1a96 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:22.865073 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7584e-bea0-4082-a193-708df07a1a96 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:22.872815 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde684c2-446d-4ec7-8b70-ba150ad14c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:22.874037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde684c2-446d-4ec7-8b70-ba150ad14c9d admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:22.874691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde684c2-446d-4ec7-8b70-ba150ad14c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:22.874984 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde684c2-446d-4ec7-8b70-ba150ad14c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:22.875693 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde684c2-446d-4ec7-8b70-ba150ad14c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:22.877786 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde684c2-446d-4ec7-8b70-ba150ad14c9d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:22.895089 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1706/3438] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:04:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:04:22.898830 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3ee36-f565-4119-b822-0000ac9ef004 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:22.910915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3ee36-f565-4119-b822-0000ac9ef004 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:22.916587 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a35c2e-1cf4-4548-b403-cd2e9d79a0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:22.917215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a35c2e-1cf4-4548-b403-cd2e9d79a0db admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:22.917494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a35c2e-1cf4-4548-b403-cd2e9d79a0db admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:22.918441 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a35c2e-1cf4-4548-b403-cd2e9d79a0db admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:22.919375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a35c2e-1cf4-4548-b403-cd2e9d79a0db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:22.921115 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a35c2e-1cf4-4548-b403-cd2e9d79a0db admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:22.943072 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1733/3439] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:04:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:04:22.947078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde684c2-446d-4ec7-8b70-ba150ad14c9d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:22.969731 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde684c2-446d-4ec7-8b70-ba150ad14c9d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:22.983842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488f786-8409-451c-98ca-b75c89a0d31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:22.984799 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488f786-8409-451c-98ca-b75c89a0d31b admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:22.985082 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488f786-8409-451c-98ca-b75c89a0d31b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:22.985353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488f786-8409-451c-98ca-b75c89a0d31b admin admin] PATH_INFO: `/v3/projects/4e1d1731bd4d4143a97447b303dd5e6a/users/d836c65ccbdb4c52bfbf17291d00c83b/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:23.019337 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488f786-8409-451c-98ca-b75c89a0d31b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e1d1731bd4d4143a97447b303dd5e6a, user_id=d836c65ccbdb4c52bfbf17291d00c83b, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:23.022163 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488f786-8409-451c-98ca-b75c89a0d31b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:23.058932 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1707/3440] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:04:22 2022] PUT /identity/v3/projects/4e1d1731bd4d4143a97447b303dd5e6a/users/d836c65ccbdb4c52bfbf17291d00c83b/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:04:23.061850 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ed636-9115-4c72-a028-f58eecaabe9d None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:23.063032 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ed636-9115-4c72-a028-f58eecaabe9d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:23.064237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ed636-9115-4c72-a028-f58eecaabe9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:23.157072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-2e3ed636-9115-4c72-a028-f58eecaabe9d None None] MFA Rules not processed for user `d836c65ccbdb4c52bfbf17291d00c83b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:04:23.158388 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2e3ed636-9115-4c72-a028-f58eecaabe9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:23.244340 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488f786-8409-451c-98ca-b75c89a0d31b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:23.246368 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4488f786-8409-451c-98ca-b75c89a0d31b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:23.353615 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1734/3441] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:04:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:04:23.369444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259104c4-ebf2-49ae-8345-5445e8a1c1a5 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:23.369964 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259104c4-ebf2-49ae-8345-5445e8a1c1a5 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:23.370473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259104c4-ebf2-49ae-8345-5445e8a1c1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:23.436422 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-259104c4-ebf2-49ae-8345-5445e8a1c1a5 None None] MFA Rules not processed for user `d836c65ccbdb4c52bfbf17291d00c83b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:04:23.438151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-259104c4-ebf2-49ae-8345-5445e8a1c1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:23.454617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488f786-8409-451c-98ca-b75c89a0d31b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:23.456057 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1735/3442] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:04:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:04:23.466775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b2c19-a317-48f1-9044-a4d2321ba5c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:23.467420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b2c19-a317-48f1-9044-a4d2321ba5c5 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:23.467859 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b2c19-a317-48f1-9044-a4d2321ba5c5 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:23.468141 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b2c19-a317-48f1-9044-a4d2321ba5c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:23.548596 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:23.575297 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b2c19-a317-48f1-9044-a4d2321ba5c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:23.580112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b2c19-a317-48f1-9044-a4d2321ba5c5 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:23.609755 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1708/3443] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:04:23 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:04:25.086147 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259104c4-ebf2-49ae-8345-5445e8a1c1a5 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:25.088087 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-259104c4-ebf2-49ae-8345-5445e8a1c1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:25.117063 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259104c4-ebf2-49ae-8345-5445e8a1c1a5 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:25.127093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4040a-43a6-470f-8da6-82081905dd9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:25.128018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4040a-43a6-470f-8da6-82081905dd9f service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:25.128835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4040a-43a6-470f-8da6-82081905dd9f service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:25.129114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4040a-43a6-470f-8da6-82081905dd9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:25.144390 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4040a-43a6-470f-8da6-82081905dd9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:25.146104 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4040a-43a6-470f-8da6-82081905dd9f service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:25.163048 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1736/3444] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:04:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:04:26.961010 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b2c19-a317-48f1-9044-a4d2321ba5c5 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:26.963975 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-157b2c19-a317-48f1-9044-a4d2321ba5c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:27.015606 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5bc07-3737-4130-8af6-017074baf57f None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:27.016401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5bc07-3737-4130-8af6-017074baf57f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:27.016842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5bc07-3737-4130-8af6-017074baf57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:27.067160 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-59a5bc07-3737-4130-8af6-017074baf57f None None] MFA Rules not processed for user `d836c65ccbdb4c52bfbf17291d00c83b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:04:27.068528 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-59a5bc07-3737-4130-8af6-017074baf57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:27.080361 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1737/3445] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:04:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:04:27.119398 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b2c19-a317-48f1-9044-a4d2321ba5c5 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:27.125793 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc92588-f5f7-441c-b697-1b6a13bc882e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:27.126589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc92588-f5f7-441c-b697-1b6a13bc882e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:27.126893 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc92588-f5f7-441c-b697-1b6a13bc882e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:27.127139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc92588-f5f7-441c-b697-1b6a13bc882e admin admin] PATH_INFO: `/v3/users/5fbf3973b1d3431f9682be0eb6d8948a` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:27.128978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc92588-f5f7-441c-b697-1b6a13bc882e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fbf3973b1d3431f9682be0eb6d8948a)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:27.131047 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc92588-f5f7-441c-b697-1b6a13bc882e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:27.234531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6fc92588-f5f7-441c-b697-1b6a13bc882e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fbf3973b1d3431f9682be0eb6d8948a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:27.235625 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6fc92588-f5f7-441c-b697-1b6a13bc882e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fbf3973b1d3431f9682be0eb6d8948a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:27.237655 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6fc92588-f5f7-441c-b697-1b6a13bc882e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fbf3973b1d3431f9682be0eb6d8948a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:27.254401 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6fc92588-f5f7-441c-b697-1b6a13bc882e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fbf3973b1d3431f9682be0eb6d8948a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:27.280758 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6fc92588-f5f7-441c-b697-1b6a13bc882e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fbf3973b1d3431f9682be0eb6d8948a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:27.321495 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1709/3446] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:04:26 2022] DELETE /identity/v3/users/5fbf3973b1d3431f9682be0eb6d8948a => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:04:27.973209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5bc07-3737-4130-8af6-017074baf57f None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:27.997277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5bc07-3737-4130-8af6-017074baf57f None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:28.037035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:28.160664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207227b-964b-4433-8429-b91dd35d9b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:28.161309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207227b-964b-4433-8429-b91dd35d9b0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:28.161887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207227b-964b-4433-8429-b91dd35d9b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:28.162754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207227b-964b-4433-8429-b91dd35d9b0f admin admin] PATH_INFO: `/v3/projects/24244713faa54507b5973eea5083a635` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:28.164288 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5207227b-964b-4433-8429-b91dd35d9b0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=24244713faa54507b5973eea5083a635)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:28.169596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5207227b-964b-4433-8429-b91dd35d9b0f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:28.316099 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5207227b-964b-4433-8429-b91dd35d9b0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24244713faa54507b5973eea5083a635', 'request_id': 'req-5207227b-964b-4433-8429-b91dd35d9b0f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:28.331135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5207227b-964b-4433-8429-b91dd35d9b0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24244713faa54507b5973eea5083a635', 'request_id': 'req-5207227b-964b-4433-8429-b91dd35d9b0f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:28.350005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5207227b-964b-4433-8429-b91dd35d9b0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24244713faa54507b5973eea5083a635', 'request_id': 'req-5207227b-964b-4433-8429-b91dd35d9b0f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:28.371668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5207227b-964b-4433-8429-b91dd35d9b0f admin admin] The token cache is being invalidate because project 24244713faa54507b5973eea5083a635 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:04:28.372222 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5207227b-964b-4433-8429-b91dd35d9b0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:28.373152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5207227b-964b-4433-8429-b91dd35d9b0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:28.380943 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1738/3447] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:04:27 2022] DELETE /identity/v3/projects/24244713faa54507b5973eea5083a635 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:04:28.381265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f6f9a-ca26-4409-8811-23a76c32e8a0 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:28.381754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f6f9a-ca26-4409-8811-23a76c32e8a0 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:28.381754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f6f9a-ca26-4409-8811-23a76c32e8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:28.414503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-496f6f9a-ca26-4409-8811-23a76c32e8a0 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:04:28.415800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-496f6f9a-ca26-4409-8811-23a76c32e8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:28.596707 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1710/3448] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:04:28.615802 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93757f0a-3316-443b-b8b8-1c0d975e05db None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:28.616179 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93757f0a-3316-443b-b8b8-1c0d975e05db None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:28.616493 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93757f0a-3316-443b-b8b8-1c0d975e05db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:28.650473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-93757f0a-3316-443b-b8b8-1c0d975e05db None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:04:28.651628 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-93757f0a-3316-443b-b8b8-1c0d975e05db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:28.693570 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1739/3449] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:04:28.698030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f6f9a-ca26-4409-8811-23a76c32e8a0 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:28.707314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:28.714662 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f6f9a-ca26-4409-8811-23a76c32e8a0 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:28.725856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15dd40d-5e49-4998-af14-0387f54aa70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:28.728691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15dd40d-5e49-4998-af14-0387f54aa70e admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:28.728990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15dd40d-5e49-4998-af14-0387f54aa70e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:28.729326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15dd40d-5e49-4998-af14-0387f54aa70e admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:28.741090 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15dd40d-5e49-4998-af14-0387f54aa70e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:04:28.742100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15dd40d-5e49-4998-af14-0387f54aa70e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:28.744221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15dd40d-5e49-4998-af14-0387f54aa70e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:28.771494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93757f0a-3316-443b-b8b8-1c0d975e05db None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:28.772550 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1711/3450] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:04:28.788159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93757f0a-3316-443b-b8b8-1c0d975e05db None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:28.794946 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0dd50a-7a2b-45a9-98bf-58dbb04a8709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:28.796746 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0dd50a-7a2b-45a9-98bf-58dbb04a8709 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:28.797221 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0dd50a-7a2b-45a9-98bf-58dbb04a8709 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:28.797664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0dd50a-7a2b-45a9-98bf-58dbb04a8709 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:28.798857 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0dd50a-7a2b-45a9-98bf-58dbb04a8709 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:28.801318 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0dd50a-7a2b-45a9-98bf-58dbb04a8709 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:28.849375 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1740/3451] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:04:28 2022] POST /identity/v3/projects => generated 381 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:04:28.853244 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15dd40d-5e49-4998-af14-0387f54aa70e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:28.869254 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15dd40d-5e49-4998-af14-0387f54aa70e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:29.023283 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80d35e-529f-46fe-8709-e8a95fdfcb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:29.025660 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80d35e-529f-46fe-8709-e8a95fdfcb8a admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:29.026570 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80d35e-529f-46fe-8709-e8a95fdfcb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:29.027458 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80d35e-529f-46fe-8709-e8a95fdfcb8a admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:29.028620 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a80d35e-529f-46fe-8709-e8a95fdfcb8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:29.032371 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a80d35e-529f-46fe-8709-e8a95fdfcb8a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:29.102937 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1712/3452] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:04:28 2022] POST /identity/v3/users => generated 291 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:04:29.108516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0dd50a-7a2b-45a9-98bf-58dbb04a8709 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:29.128121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0dd50a-7a2b-45a9-98bf-58dbb04a8709 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:29.141343 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09c339-0e55-41b1-8b23-3302d938d3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:29.142415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09c339-0e55-41b1-8b23-3302d938d3db admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:29.143165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09c339-0e55-41b1-8b23-3302d938d3db admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:29.143650 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09c339-0e55-41b1-8b23-3302d938d3db admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:29.145681 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b09c339-0e55-41b1-8b23-3302d938d3db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:29.153713 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b09c339-0e55-41b1-8b23-3302d938d3db admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:29.187369 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1741/3453] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:04:29.191631 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80d35e-529f-46fe-8709-e8a95fdfcb8a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:29.208571 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80d35e-529f-46fe-8709-e8a95fdfcb8a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:29.226689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf649e15-1f59-4030-a4ef-484eb635cf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:29.229152 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf649e15-1f59-4030-a4ef-484eb635cf2b admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:29.229703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf649e15-1f59-4030-a4ef-484eb635cf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:29.232622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf649e15-1f59-4030-a4ef-484eb635cf2b admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:29.234008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf649e15-1f59-4030-a4ef-484eb635cf2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:29.236227 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf649e15-1f59-4030-a4ef-484eb635cf2b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:29.280865 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1713/3454] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:04:29.285400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09c339-0e55-41b1-8b23-3302d938d3db admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:29.307313 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09c339-0e55-41b1-8b23-3302d938d3db admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:29.326001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bdb5a-9f88-4b05-8175-64ef418efa1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:29.327052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bdb5a-9f88-4b05-8175-64ef418efa1e admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:29.328893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bdb5a-9f88-4b05-8175-64ef418efa1e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:29.329284 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bdb5a-9f88-4b05-8175-64ef418efa1e admin admin] PATH_INFO: `/v3/projects/1b871c1ed18840838016162c77dcaf88/users/bf5c9921f2554f058eca4fcf4ef0fde7/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:29.380348 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64bdb5a-9f88-4b05-8175-64ef418efa1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b871c1ed18840838016162c77dcaf88, user_id=bf5c9921f2554f058eca4fcf4ef0fde7, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:29.383564 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64bdb5a-9f88-4b05-8175-64ef418efa1e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:29.414646 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1742/3455] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:04:29 2022] PUT /identity/v3/projects/1b871c1ed18840838016162c77dcaf88/users/bf5c9921f2554f058eca4fcf4ef0fde7/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:04:29.416446 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0e614-978c-4c23-a39a-f6019520a574 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:29.416978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0e614-978c-4c23-a39a-f6019520a574 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:29.417263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0e614-978c-4c23-a39a-f6019520a574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:29.471725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-20b0e614-978c-4c23-a39a-f6019520a574 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:04:29.474716 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-20b0e614-978c-4c23-a39a-f6019520a574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:29.670258 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1714/3456] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:04:29.709582 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bdb5a-9f88-4b05-8175-64ef418efa1e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:29.711706 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e64bdb5a-9f88-4b05-8175-64ef418efa1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:29.857154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:29.882397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bdb5a-9f88-4b05-8175-64ef418efa1e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:29.890836 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97216ef2-00c6-408a-857a-ec628f7924fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:29.891790 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97216ef2-00c6-408a-857a-ec628f7924fa service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:29.892468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97216ef2-00c6-408a-857a-ec628f7924fa service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:29.893181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97216ef2-00c6-408a-857a-ec628f7924fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:29.908505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97216ef2-00c6-408a-857a-ec628f7924fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:29.910674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97216ef2-00c6-408a-857a-ec628f7924fa service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:29.927118 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1743/3457] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:04:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:04:31.445623 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0e614-978c-4c23-a39a-f6019520a574 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:31.448076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-20b0e614-978c-4c23-a39a-f6019520a574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:31.561632 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0e614-978c-4c23-a39a-f6019520a574 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:31.571786 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd0abf-5daf-45f7-838f-b824c8a5e181 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:31.572856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd0abf-5daf-45f7-838f-b824c8a5e181 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:31.573954 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd0abf-5daf-45f7-838f-b824c8a5e181 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:31.574492 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd0abf-5daf-45f7-838f-b824c8a5e181 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:31.577584 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-58bd0abf-5daf-45f7-838f-b824c8a5e181 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:31.597202 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:31.605064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd0abf-5daf-45f7-838f-b824c8a5e181 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:31.608680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd0abf-5daf-45f7-838f-b824c8a5e181 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:31.649557 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1715/3458] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:04:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:04:32.730620 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97216ef2-00c6-408a-857a-ec628f7924fa service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:32.741863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97216ef2-00c6-408a-857a-ec628f7924fa service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:32.748164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb382bce-c9a3-4744-bf27-5b9c95c7968a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:32.748805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb382bce-c9a3-4744-bf27-5b9c95c7968a service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:32.749395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb382bce-c9a3-4744-bf27-5b9c95c7968a service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:32.749954 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb382bce-c9a3-4744-bf27-5b9c95c7968a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:32.752889 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-cb382bce-c9a3-4744-bf27-5b9c95c7968a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:32.835348 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb382bce-c9a3-4744-bf27-5b9c95c7968a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:32.837164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb382bce-c9a3-4744-bf27-5b9c95c7968a service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:32.852643 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1744/3459] 10.222.0.33 () {60 vars in 1396 bytes} [Sat Aug 6 21:04:32 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3246 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:04:40.624820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd0abf-5daf-45f7-838f-b824c8a5e181 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:40.639715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd0abf-5daf-45f7-838f-b824c8a5e181 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:40.647602 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fab89b-6f7b-481f-b35c-dca1eda70b20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:40.648514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fab89b-6f7b-481f-b35c-dca1eda70b20 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:40.648623 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fab89b-6f7b-481f-b35c-dca1eda70b20 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:40.648934 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fab89b-6f7b-481f-b35c-dca1eda70b20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:40.658678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-87fab89b-6f7b-481f-b35c-dca1eda70b20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:40.690924 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fab89b-6f7b-481f-b35c-dca1eda70b20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:40.693178 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fab89b-6f7b-481f-b35c-dca1eda70b20 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:40.716675 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1716/3460] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:04:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:04:42.846833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=36 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:45.961784 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145f594-46e2-4876-add8-28cd64cd9a5e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:45.962466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145f594-46e2-4876-add8-28cd64cd9a5e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:45.962466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145f594-46e2-4876-add8-28cd64cd9a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:46.014084 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-2145f594-46e2-4876-add8-28cd64cd9a5e None None] MFA Rules not processed for user `bf5c9921f2554f058eca4fcf4ef0fde7`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:04:46.016067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2145f594-46e2-4876-add8-28cd64cd9a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:46.146272 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1745/3461] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:04:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:04:46.146887 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcc8b9-ec78-4a0a-bc6c-69f867c5d0a4 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:46.147357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcc8b9-ec78-4a0a-bc6c-69f867c5d0a4 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:46.147456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcc8b9-ec78-4a0a-bc6c-69f867c5d0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:46.182246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-edfcc8b9-ec78-4a0a-bc6c-69f867c5d0a4 None None] MFA Rules not processed for user `bf5c9921f2554f058eca4fcf4ef0fde7`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:04:46.184796 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-edfcc8b9-ec78-4a0a-bc6c-69f867c5d0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:46.198199 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1717/3462] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:04:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:04:46.310951 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145f594-46e2-4876-add8-28cd64cd9a5e None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:46.332376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145f594-46e2-4876-add8-28cd64cd9a5e None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:46.342367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0373d-19b3-4bfa-ace0-6d1de1f29119 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:46.342637 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0373d-19b3-4bfa-ace0-6d1de1f29119 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:46.342978 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0373d-19b3-4bfa-ace0-6d1de1f29119 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:46.343194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0373d-19b3-4bfa-ace0-6d1de1f29119 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:46.355826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0373d-19b3-4bfa-ace0-6d1de1f29119 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:46.357472 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0373d-19b3-4bfa-ace0-6d1de1f29119 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:46.380261 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1746/3463] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:04:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:04:54.781331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfcc8b9-ec78-4a0a-bc6c-69f867c5d0a4 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:54.783053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-edfcc8b9-ec78-4a0a-bc6c-69f867c5d0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:54.813576 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfcc8b9-ec78-4a0a-bc6c-69f867c5d0a4 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:54.822432 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c77e0-7665-4155-95a3-3d9e41c070bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:54.824226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c77e0-7665-4155-95a3-3d9e41c070bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:54.824682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c77e0-7665-4155-95a3-3d9e41c070bc admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:54.825132 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c77e0-7665-4155-95a3-3d9e41c070bc admin admin] PATH_INFO: `/v3/users/cc790d675b2e4bae8a38e0666f5c9e27` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:54.827043 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c77e0-7665-4155-95a3-3d9e41c070bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc790d675b2e4bae8a38e0666f5c9e27)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:54.830435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c77e0-7665-4155-95a3-3d9e41c070bc admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:54.919707 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d17c77e0-7665-4155-95a3-3d9e41c070bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc790d675b2e4bae8a38e0666f5c9e27'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:54.920474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d17c77e0-7665-4155-95a3-3d9e41c070bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc790d675b2e4bae8a38e0666f5c9e27'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:54.921084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d17c77e0-7665-4155-95a3-3d9e41c070bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc790d675b2e4bae8a38e0666f5c9e27'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:54.936708 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d17c77e0-7665-4155-95a3-3d9e41c070bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc790d675b2e4bae8a38e0666f5c9e27'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:54.956627 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d17c77e0-7665-4155-95a3-3d9e41c070bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc790d675b2e4bae8a38e0666f5c9e27'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:55.014405 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1718/3464] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:04:54 2022] DELETE /identity/v3/users/cc790d675b2e4bae8a38e0666f5c9e27 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:04:55.266043 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0373d-19b3-4bfa-ace0-6d1de1f29119 service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:55.284921 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0373d-19b3-4bfa-ace0-6d1de1f29119 service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:55.416185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e89ea2-7444-4bb7-8f1b-803217ce2439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:55.416937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e89ea2-7444-4bb7-8f1b-803217ce2439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:55.418148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e89ea2-7444-4bb7-8f1b-803217ce2439 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:55.418444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e89ea2-7444-4bb7-8f1b-803217ce2439 admin admin] PATH_INFO: `/v3/projects/4566277f215048cb9aaa09c4b3e577e8` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:55.420575 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e89ea2-7444-4bb7-8f1b-803217ce2439 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4566277f215048cb9aaa09c4b3e577e8)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:55.422932 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e89ea2-7444-4bb7-8f1b-803217ce2439 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:55.503975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b5e89ea2-7444-4bb7-8f1b-803217ce2439 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4566277f215048cb9aaa09c4b3e577e8', 'request_id': 'req-b5e89ea2-7444-4bb7-8f1b-803217ce2439'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:55.511841 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b5e89ea2-7444-4bb7-8f1b-803217ce2439 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4566277f215048cb9aaa09c4b3e577e8', 'request_id': 'req-b5e89ea2-7444-4bb7-8f1b-803217ce2439'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:55.521007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b5e89ea2-7444-4bb7-8f1b-803217ce2439 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4566277f215048cb9aaa09c4b3e577e8', 'request_id': 'req-b5e89ea2-7444-4bb7-8f1b-803217ce2439'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:55.554221 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b5e89ea2-7444-4bb7-8f1b-803217ce2439 admin admin] The token cache is being invalidate because project 4566277f215048cb9aaa09c4b3e577e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:04:55.554516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b5e89ea2-7444-4bb7-8f1b-803217ce2439 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:55.555582 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b5e89ea2-7444-4bb7-8f1b-803217ce2439 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:55.561725 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1747/3465] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:04:55 2022] DELETE /identity/v3/projects/4566277f215048cb9aaa09c4b3e577e8 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:04:55.564168 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b512f28-3575-4f4e-a342-d5239ab91265 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:55.564508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b512f28-3575-4f4e-a342-d5239ab91265 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:55.564795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b512f28-3575-4f4e-a342-d5239ab91265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:55.591692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-0b512f28-3575-4f4e-a342-d5239ab91265 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:04:55.593728 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0b512f28-3575-4f4e-a342-d5239ab91265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:55.662668 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1719/3466] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:04:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:04:55.672535 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb50837-c0af-4d67-81f8-e11bd8ed52c3 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:55.672821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb50837-c0af-4d67-81f8-e11bd8ed52c3 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:55.673095 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb50837-c0af-4d67-81f8-e11bd8ed52c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:55.694278 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:55.700665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-3fb50837-c0af-4d67-81f8-e11bd8ed52c3 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:04:55.702078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3fb50837-c0af-4d67-81f8-e11bd8ed52c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:55.712385 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1748/3467] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:04:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:04:55.717493 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b512f28-3575-4f4e-a342-d5239ab91265 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:55.727465 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b512f28-3575-4f4e-a342-d5239ab91265 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:55.736810 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe4150-b8c7-4ff0-a98c-8d7cf585330f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:55.737516 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe4150-b8c7-4ff0-a98c-8d7cf585330f admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:55.737953 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe4150-b8c7-4ff0-a98c-8d7cf585330f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:55.738262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe4150-b8c7-4ff0-a98c-8d7cf585330f admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:55.739009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe4150-b8c7-4ff0-a98c-8d7cf585330f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:04:55.739317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe4150-b8c7-4ff0-a98c-8d7cf585330f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:55.741200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe4150-b8c7-4ff0-a98c-8d7cf585330f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:55.759355 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1720/3468] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:04:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:04:55.760412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb50837-c0af-4d67-81f8-e11bd8ed52c3 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:55.771643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb50837-c0af-4d67-81f8-e11bd8ed52c3 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:55.776404 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a530245-66c1-452b-8beb-8db8e31df3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:55.777684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a530245-66c1-452b-8beb-8db8e31df3d5 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:55.777864 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a530245-66c1-452b-8beb-8db8e31df3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:55.778105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a530245-66c1-452b-8beb-8db8e31df3d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:55.778880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a530245-66c1-452b-8beb-8db8e31df3d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:55.780836 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a530245-66c1-452b-8beb-8db8e31df3d5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:55.816208 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1749/3469] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:04:55 2022] POST /identity/v3/projects => generated 395 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:04:55.817876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe4150-b8c7-4ff0-a98c-8d7cf585330f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:55.830584 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe4150-b8c7-4ff0-a98c-8d7cf585330f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:55.884104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:55.927233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d229ab-5855-43e4-9f42-dc23810d8c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:55.927852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d229ab-5855-43e4-9f42-dc23810d8c70 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:55.928392 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d229ab-5855-43e4-9f42-dc23810d8c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:55.928760 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d229ab-5855-43e4-9f42-dc23810d8c70 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:55.929410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d229ab-5855-43e4-9f42-dc23810d8c70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:55.931393 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d229ab-5855-43e4-9f42-dc23810d8c70 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:55.959701 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1721/3470] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:04:55 2022] POST /identity/v3/users => generated 298 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:04:55.965357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a530245-66c1-452b-8beb-8db8e31df3d5 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:55.983134 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a530245-66c1-452b-8beb-8db8e31df3d5 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:55.990048 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e1d46-9dc7-4ef9-b1c1-f1fe5e09616a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:55.990922 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e1d46-9dc7-4ef9-b1c1-f1fe5e09616a admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:55.991644 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e1d46-9dc7-4ef9-b1c1-f1fe5e09616a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:55.991644 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e1d46-9dc7-4ef9-b1c1-f1fe5e09616a admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:55.992576 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e1d46-9dc7-4ef9-b1c1-f1fe5e09616a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:55.994278 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e1d46-9dc7-4ef9-b1c1-f1fe5e09616a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:56.009140 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1750/3471] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:04:56.010481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d229ab-5855-43e4-9f42-dc23810d8c70 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:56.023749 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d229ab-5855-43e4-9f42-dc23810d8c70 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:56.031087 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab517e-ecfb-48b4-9406-cab39f4881a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:56.031717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab517e-ecfb-48b4-9406-cab39f4881a5 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:56.032155 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab517e-ecfb-48b4-9406-cab39f4881a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:56.032442 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab517e-ecfb-48b4-9406-cab39f4881a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:56.033077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab517e-ecfb-48b4-9406-cab39f4881a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:56.035127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab517e-ecfb-48b4-9406-cab39f4881a5 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:56.050441 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1722/3472] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:04:56.054592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e1d46-9dc7-4ef9-b1c1-f1fe5e09616a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:56.067731 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e1d46-9dc7-4ef9-b1c1-f1fe5e09616a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:56.072515 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334a0e9-257d-4c2d-afc3-60c2db96262f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:56.074154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334a0e9-257d-4c2d-afc3-60c2db96262f admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:56.075279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334a0e9-257d-4c2d-afc3-60c2db96262f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:56.075279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334a0e9-257d-4c2d-afc3-60c2db96262f admin admin] PATH_INFO: `/v3/projects/31fda4f324b24803a973fc29926b74bc/users/afdab69360e54d38bd9e3fbb3f56b9b6/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:56.094700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334a0e9-257d-4c2d-afc3-60c2db96262f admin admin] RBAC: Authorizing `identity:create_grant(project_id=31fda4f324b24803a973fc29926b74bc, user_id=afdab69360e54d38bd9e3fbb3f56b9b6, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:56.098796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334a0e9-257d-4c2d-afc3-60c2db96262f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:56.146448 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1751/3473] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:04:56 2022] PUT /identity/v3/projects/31fda4f324b24803a973fc29926b74bc/users/afdab69360e54d38bd9e3fbb3f56b9b6/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:04:56.159552 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89ce93-72ab-4ce4-ae80-54c41183ed7d None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:56.159838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89ce93-72ab-4ce4-ae80-54c41183ed7d None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:56.160118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89ce93-72ab-4ce4-ae80-54c41183ed7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:56.196200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-0c89ce93-72ab-4ce4-ae80-54c41183ed7d None None] MFA Rules not processed for user `afdab69360e54d38bd9e3fbb3f56b9b6`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:04:56.197741 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0c89ce93-72ab-4ce4-ae80-54c41183ed7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:56.318411 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1723/3474] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:04:56 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:04:56.320518 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f332a4a-d0a7-4234-bbb6-4b66ecfa0648 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:56.320964 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f332a4a-d0a7-4234-bbb6-4b66ecfa0648 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:56.321131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f332a4a-d0a7-4234-bbb6-4b66ecfa0648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:56.361848 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-7f332a4a-d0a7-4234-bbb6-4b66ecfa0648 None None] MFA Rules not processed for user `afdab69360e54d38bd9e3fbb3f56b9b6`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:04:56.363181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7f332a4a-d0a7-4234-bbb6-4b66ecfa0648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:56.382477 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1752/3475] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:04:56 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:04:56.393760 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89ce93-72ab-4ce4-ae80-54c41183ed7d None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:56.395201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0c89ce93-72ab-4ce4-ae80-54c41183ed7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:56.525277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89ce93-72ab-4ce4-ae80-54c41183ed7d None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:56.535237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d1c46-53f8-4022-9dae-200b28dd0f81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:56.535864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d1c46-53f8-4022-9dae-200b28dd0f81 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:56.536148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d1c46-53f8-4022-9dae-200b28dd0f81 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:56.536422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d1c46-53f8-4022-9dae-200b28dd0f81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:56.546434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d1c46-53f8-4022-9dae-200b28dd0f81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:56.548096 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d1c46-53f8-4022-9dae-200b28dd0f81 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:56.559796 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1724/3476] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:04:56 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:04:56.586473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7f58a-0b73-4d03-a48f-4940e089b9aa None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:56.586976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7f58a-0b73-4d03-a48f-4940e089b9aa None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:56.587333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7f58a-0b73-4d03-a48f-4940e089b9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:56.610291 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d1c46-53f8-4022-9dae-200b28dd0f81 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:56.617013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-263d1c46-53f8-4022-9dae-200b28dd0f81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:56.642532 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-4ab7f58a-0b73-4d03-a48f-4940e089b9aa None None] MFA Rules not processed for user `afdab69360e54d38bd9e3fbb3f56b9b6`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:04:56.644375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4ab7f58a-0b73-4d03-a48f-4940e089b9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:56.662845 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1753/3477] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:04:56 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:04:56.676514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:56.761360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d1c46-53f8-4022-9dae-200b28dd0f81 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:56.764086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6cb0f-2dda-439e-9abd-e69c02d2f0ba None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:56.764446 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6cb0f-2dda-439e-9abd-e69c02d2f0ba None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:56.764787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6cb0f-2dda-439e-9abd-e69c02d2f0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:56.767117 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503a441-05ec-4364-a3a1-c84cd92bb640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:56.767939 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503a441-05ec-4364-a3a1-c84cd92bb640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:56.768294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503a441-05ec-4364-a3a1-c84cd92bb640 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:56.768632 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503a441-05ec-4364-a3a1-c84cd92bb640 admin admin] PATH_INFO: `/v3/users/721aed6cddeb46cf9d8f33deaf6e5b8b` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:56.769864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503a441-05ec-4364-a3a1-c84cd92bb640 admin admin] RBAC: Authorizing `identity:delete_user(user_id=721aed6cddeb46cf9d8f33deaf6e5b8b)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:56.772468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503a441-05ec-4364-a3a1-c84cd92bb640 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:56.799641 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a5a6cb0f-2dda-439e-9abd-e69c02d2f0ba None None] MFA Rules not processed for user `afdab69360e54d38bd9e3fbb3f56b9b6`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:04:56.801004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a5a6cb0f-2dda-439e-9abd-e69c02d2f0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:56.812532 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1754/3478] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:04:56 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:04:56.841105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129569be-e42a-42ff-9482-bea842cf023f None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:56.842179 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129569be-e42a-42ff-9482-bea842cf023f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:56.842633 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129569be-e42a-42ff-9482-bea842cf023f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:56.867966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e503a441-05ec-4364-a3a1-c84cd92bb640 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '721aed6cddeb46cf9d8f33deaf6e5b8b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:56.869818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-129569be-e42a-42ff-9482-bea842cf023f None None] MFA Rules not processed for user `afdab69360e54d38bd9e3fbb3f56b9b6`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:04:56.870935 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e503a441-05ec-4364-a3a1-c84cd92bb640 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '721aed6cddeb46cf9d8f33deaf6e5b8b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:56.871690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-129569be-e42a-42ff-9482-bea842cf023f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:56.872928 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e503a441-05ec-4364-a3a1-c84cd92bb640 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '721aed6cddeb46cf9d8f33deaf6e5b8b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:56.883158 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1755/3479] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:04:56 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:04:56.888181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e503a441-05ec-4364-a3a1-c84cd92bb640 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '721aed6cddeb46cf9d8f33deaf6e5b8b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:56.910837 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474565d-9bd9-46d4-a12c-108ef6e9deb9 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:56.911120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474565d-9bd9-46d4-a12c-108ef6e9deb9 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:56.911395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474565d-9bd9-46d4-a12c-108ef6e9deb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:56.940364 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d474565d-9bd9-46d4-a12c-108ef6e9deb9 None None] MFA Rules not processed for user `afdab69360e54d38bd9e3fbb3f56b9b6`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:04:56.941925 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d474565d-9bd9-46d4-a12c-108ef6e9deb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:56.949747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e503a441-05ec-4364-a3a1-c84cd92bb640 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '721aed6cddeb46cf9d8f33deaf6e5b8b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:56.956405 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1756/3480] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:04:56 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:04:56.971605 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474565d-9bd9-46d4-a12c-108ef6e9deb9 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:56.973025 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d474565d-9bd9-46d4-a12c-108ef6e9deb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:56.974187 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1725/3481] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:04:56 2022] DELETE /identity/v3/users/721aed6cddeb46cf9d8f33deaf6e5b8b => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:04:56.988883 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474565d-9bd9-46d4-a12c-108ef6e9deb9 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:57.085583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8d363-c97b-4d27-8e35-7c0332ebd2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:57.088891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8d363-c97b-4d27-8e35-7c0332ebd2ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:57.089173 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8d363-c97b-4d27-8e35-7c0332ebd2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:57.089571 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8d363-c97b-4d27-8e35-7c0332ebd2ee admin admin] PATH_INFO: `/v3/users/afdab69360e54d38bd9e3fbb3f56b9b6` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:57.091523 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8d363-c97b-4d27-8e35-7c0332ebd2ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=afdab69360e54d38bd9e3fbb3f56b9b6)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:57.094018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8d363-c97b-4d27-8e35-7c0332ebd2ee admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:57.184218 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4cf8d363-c97b-4d27-8e35-7c0332ebd2ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afdab69360e54d38bd9e3fbb3f56b9b6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:57.198177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4cf8d363-c97b-4d27-8e35-7c0332ebd2ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afdab69360e54d38bd9e3fbb3f56b9b6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:57.200063 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4cf8d363-c97b-4d27-8e35-7c0332ebd2ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afdab69360e54d38bd9e3fbb3f56b9b6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:57.202686 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4cf8d363-c97b-4d27-8e35-7c0332ebd2ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afdab69360e54d38bd9e3fbb3f56b9b6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:57.217480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4cf8d363-c97b-4d27-8e35-7c0332ebd2ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afdab69360e54d38bd9e3fbb3f56b9b6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:57.233504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:57.253591 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1757/3482] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:04:56 2022] DELETE /identity/v3/users/afdab69360e54d38bd9e3fbb3f56b9b6 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:04:57.257899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66f7ca-8245-471b-8b04-45e4e7e8617f None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:57.258182 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66f7ca-8245-471b-8b04-45e4e7e8617f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:57.258450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66f7ca-8245-471b-8b04-45e4e7e8617f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:57.311424 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-bc66f7ca-8245-471b-8b04-45e4e7e8617f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:04:57.312842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-bc66f7ca-8245-471b-8b04-45e4e7e8617f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:57.394102 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8d363-c97b-4d27-8e35-7c0332ebd2ee admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:57.395668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4cf8d363-c97b-4d27-8e35-7c0332ebd2ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:57.403462 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1726/3483] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:04:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:04:57.412332 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8d363-c97b-4d27-8e35-7c0332ebd2ee admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:57.413241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66f7ca-8245-471b-8b04-45e4e7e8617f None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:57.414641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-bc66f7ca-8245-471b-8b04-45e4e7e8617f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:57.419296 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10ef82-6cba-446f-abbe-7a8b1d879c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:57.425717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10ef82-6cba-446f-abbe-7a8b1d879c42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:57.426008 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10ef82-6cba-446f-abbe-7a8b1d879c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:57.426289 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10ef82-6cba-446f-abbe-7a8b1d879c42 admin admin] PATH_INFO: `/v3/projects/2c6626cd5e8e4669a5ccb84df569d140` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:57.428281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c10ef82-6cba-446f-abbe-7a8b1d879c42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c6626cd5e8e4669a5ccb84df569d140)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:57.430795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c10ef82-6cba-446f-abbe-7a8b1d879c42 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:57.508108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:57.512939 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66f7ca-8245-471b-8b04-45e4e7e8617f None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:57.518929 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7c10ef82-6cba-446f-abbe-7a8b1d879c42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c6626cd5e8e4669a5ccb84df569d140', 'request_id': 'req-7c10ef82-6cba-446f-abbe-7a8b1d879c42'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:57.547715 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7c10ef82-6cba-446f-abbe-7a8b1d879c42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c6626cd5e8e4669a5ccb84df569d140', 'request_id': 'req-7c10ef82-6cba-446f-abbe-7a8b1d879c42'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:57.564101 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7c10ef82-6cba-446f-abbe-7a8b1d879c42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c6626cd5e8e4669a5ccb84df569d140', 'request_id': 'req-7c10ef82-6cba-446f-abbe-7a8b1d879c42'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:57.589181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7c10ef82-6cba-446f-abbe-7a8b1d879c42 admin admin] The token cache is being invalidate because project 2c6626cd5e8e4669a5ccb84df569d140 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:04:57.589376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7c10ef82-6cba-446f-abbe-7a8b1d879c42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:57.593411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7c10ef82-6cba-446f-abbe-7a8b1d879c42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:57.598299 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1758/3484] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:04:57 2022] DELETE /identity/v3/projects/2c6626cd5e8e4669a5ccb84df569d140 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:04:57.603470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df5149-5e11-46a0-b62e-3a755df3e623 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:57.603754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df5149-5e11-46a0-b62e-3a755df3e623 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:57.604330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df5149-5e11-46a0-b62e-3a755df3e623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:57.633309 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930c499-3166-46bb-a9f5-e7125a1aa2a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:57.634028 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930c499-3166-46bb-a9f5-e7125a1aa2a9 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:57.637231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930c499-3166-46bb-a9f5-e7125a1aa2a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:57.637751 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930c499-3166-46bb-a9f5-e7125a1aa2a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:57.643052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f930c499-3166-46bb-a9f5-e7125a1aa2a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:57.672178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-c9df5149-5e11-46a0-b62e-3a755df3e623 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:04:57.673808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c9df5149-5e11-46a0-b62e-3a755df3e623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:57.811645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f930c499-3166-46bb-a9f5-e7125a1aa2a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:57.813157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f930c499-3166-46bb-a9f5-e7125a1aa2a9 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:57.822250 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1759/3485] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:04:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:04:57.832245 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add895a-3ac7-4ab5-94b4-662c9e5c8eac None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:57.832673 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add895a-3ac7-4ab5-94b4-662c9e5c8eac None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:57.833052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add895a-3ac7-4ab5-94b4-662c9e5c8eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:57.836845 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1727/3486] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:04:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:04:57.887811 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-0add895a-3ac7-4ab5-94b4-662c9e5c8eac None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:04:57.889130 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0add895a-3ac7-4ab5-94b4-662c9e5c8eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:57.897710 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1760/3487] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:04:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:04:57.902689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930c499-3166-46bb-a9f5-e7125a1aa2a9 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:57.912818 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930c499-3166-46bb-a9f5-e7125a1aa2a9 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:57.918740 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c6a6e-d004-4318-8fbe-4c0bb8bcbc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:57.919369 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c6a6e-d004-4318-8fbe-4c0bb8bcbc9c admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:57.919649 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c6a6e-d004-4318-8fbe-4c0bb8bcbc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:57.919918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c6a6e-d004-4318-8fbe-4c0bb8bcbc9c admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:57.920560 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c6a6e-d004-4318-8fbe-4c0bb8bcbc9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:04:57.920886 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c6a6e-d004-4318-8fbe-4c0bb8bcbc9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:57.922686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c6a6e-d004-4318-8fbe-4c0bb8bcbc9c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:57.939673 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1728/3488] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:04:57.940901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add895a-3ac7-4ab5-94b4-662c9e5c8eac None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:57.951501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add895a-3ac7-4ab5-94b4-662c9e5c8eac None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:57.956775 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e86476-5cc5-41db-a301-b6f2f2bb0428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:57.957384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e86476-5cc5-41db-a301-b6f2f2bb0428 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:57.957686 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e86476-5cc5-41db-a301-b6f2f2bb0428 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:57.957979 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e86476-5cc5-41db-a301-b6f2f2bb0428 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:57.958641 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e86476-5cc5-41db-a301-b6f2f2bb0428 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:57.960667 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e86476-5cc5-41db-a301-b6f2f2bb0428 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:57.991478 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1761/3489] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:04:57 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:04:57.995860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c6a6e-d004-4318-8fbe-4c0bb8bcbc9c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:58.008695 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c6a6e-d004-4318-8fbe-4c0bb8bcbc9c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:58.076003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4725f-db41-4f86-bf69-add03949df62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:58.076646 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4725f-db41-4f86-bf69-add03949df62 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:58.076921 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4725f-db41-4f86-bf69-add03949df62 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:58.077191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4725f-db41-4f86-bf69-add03949df62 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:58.077811 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4725f-db41-4f86-bf69-add03949df62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:58.079788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4725f-db41-4f86-bf69-add03949df62 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:58.102863 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1729/3490] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:04:57 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:04:58.107219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e86476-5cc5-41db-a301-b6f2f2bb0428 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:58.118757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e86476-5cc5-41db-a301-b6f2f2bb0428 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:58.125990 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553ec91-5eb6-45f4-a9e4-8f3cf2c957ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:58.126727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553ec91-5eb6-45f4-a9e4-8f3cf2c957ae admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:58.127093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553ec91-5eb6-45f4-a9e4-8f3cf2c957ae admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:58.127439 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553ec91-5eb6-45f4-a9e4-8f3cf2c957ae admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:58.128148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553ec91-5eb6-45f4-a9e4-8f3cf2c957ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:58.130019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553ec91-5eb6-45f4-a9e4-8f3cf2c957ae admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:58.143408 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1762/3491] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:04:58.150324 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4725f-db41-4f86-bf69-add03949df62 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:58.152199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553ec91-5eb6-45f4-a9e4-8f3cf2c957ae admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:58.155458 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c2b4725f-db41-4f86-bf69-add03949df62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:58.163520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553ec91-5eb6-45f4-a9e4-8f3cf2c957ae admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:58.169458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b90599-deac-4e9a-a170-43fb4ace4e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:58.170078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b90599-deac-4e9a-a170-43fb4ace4e69 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:58.170360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b90599-deac-4e9a-a170-43fb4ace4e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:58.170672 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b90599-deac-4e9a-a170-43fb4ace4e69 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:58.171323 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b90599-deac-4e9a-a170-43fb4ace4e69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:58.172995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b90599-deac-4e9a-a170-43fb4ace4e69 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:58.180554 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4725f-db41-4f86-bf69-add03949df62 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:58.185523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4c45b-b6f4-42b4-b0a9-393477d88a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:58.186157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4c45b-b6f4-42b4-b0a9-393477d88a92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:58.186452 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4c45b-b6f4-42b4-b0a9-393477d88a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:58.186754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4c45b-b6f4-42b4-b0a9-393477d88a92 admin admin] PATH_INFO: `/v3/projects/31fda4f324b24803a973fc29926b74bc` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:58.190286 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1763/3492] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:04:58.190421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4c45b-b6f4-42b4-b0a9-393477d88a92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31fda4f324b24803a973fc29926b74bc)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:58.190421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4c45b-b6f4-42b4-b0a9-393477d88a92 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:58.191386 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b90599-deac-4e9a-a170-43fb4ace4e69 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:58.202806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b90599-deac-4e9a-a170-43fb4ace4e69 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:58.207552 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896dbbf-391e-4f9b-816f-562ed47d9fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:58.208191 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896dbbf-391e-4f9b-816f-562ed47d9fb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:58.208469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896dbbf-391e-4f9b-816f-562ed47d9fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:58.209016 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896dbbf-391e-4f9b-816f-562ed47d9fb8 admin admin] PATH_INFO: `/v3/projects/92692c7d7d124e3599b2e764da8415ef/users/1f9190aa4d52460f8636df2d87f11792/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:58.223262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:58.225898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896dbbf-391e-4f9b-816f-562ed47d9fb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92692c7d7d124e3599b2e764da8415ef, user_id=1f9190aa4d52460f8636df2d87f11792, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:58.228581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896dbbf-391e-4f9b-816f-562ed47d9fb8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:58.237205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:58.242679 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-96c4c45b-b6f4-42b4-b0a9-393477d88a92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31fda4f324b24803a973fc29926b74bc', 'request_id': 'req-96c4c45b-b6f4-42b4-b0a9-393477d88a92'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:58.247129 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1764/3493] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:04:58 2022] PUT /identity/v3/projects/92692c7d7d124e3599b2e764da8415ef/users/1f9190aa4d52460f8636df2d87f11792/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:04:58.248553 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f78a3-fa85-49d3-915c-3d3dc1d79c2e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:58.249139 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f78a3-fa85-49d3-915c-3d3dc1d79c2e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:58.249740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f78a3-fa85-49d3-915c-3d3dc1d79c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:58.254185 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-96c4c45b-b6f4-42b4-b0a9-393477d88a92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31fda4f324b24803a973fc29926b74bc', 'request_id': 'req-96c4c45b-b6f4-42b4-b0a9-393477d88a92'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:58.262176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-96c4c45b-b6f4-42b4-b0a9-393477d88a92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31fda4f324b24803a973fc29926b74bc', 'request_id': 'req-96c4c45b-b6f4-42b4-b0a9-393477d88a92'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:58.269511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-c63f78a3-fa85-49d3-915c-3d3dc1d79c2e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:04:58.270737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c63f78a3-fa85-49d3-915c-3d3dc1d79c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:58.275286 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-96c4c45b-b6f4-42b4-b0a9-393477d88a92 admin admin] The token cache is being invalidate because project 31fda4f324b24803a973fc29926b74bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:04:58.276003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-96c4c45b-b6f4-42b4-b0a9-393477d88a92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:58.276196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-96c4c45b-b6f4-42b4-b0a9-393477d88a92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:04:58.283163 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1730/3494] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:04:58 2022] DELETE /identity/v3/projects/31fda4f324b24803a973fc29926b74bc => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:04:58.284920 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c95aea-a8b6-4bd5-8cad-2d95029e9303 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:58.284920 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c95aea-a8b6-4bd5-8cad-2d95029e9303 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:58.285154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c95aea-a8b6-4bd5-8cad-2d95029e9303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:58.308208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-76c95aea-a8b6-4bd5-8cad-2d95029e9303 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:04:58.310188 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-76c95aea-a8b6-4bd5-8cad-2d95029e9303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:58.341590 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1765/3495] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:04:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:04:58.360470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f78a3-fa85-49d3-915c-3d3dc1d79c2e None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:58.361783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c63f78a3-fa85-49d3-915c-3d3dc1d79c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:58.397778 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1731/3496] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:04:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:04:58.405747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da519ff6-c0a8-41da-a769-5a4a27c0c57f None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:58.406034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da519ff6-c0a8-41da-a769-5a4a27c0c57f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:58.406327 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da519ff6-c0a8-41da-a769-5a4a27c0c57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:58.427594 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-da519ff6-c0a8-41da-a769-5a4a27c0c57f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:04:58.428479 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-da519ff6-c0a8-41da-a769-5a4a27c0c57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:58.432620 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f78a3-fa85-49d3-915c-3d3dc1d79c2e None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:58.437705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2468d6d-25e0-4caa-8986-1ff540764c76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:58.437855 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1732/3497] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:04:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:04:58.438324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2468d6d-25e0-4caa-8986-1ff540764c76 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:58.439075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2468d6d-25e0-4caa-8986-1ff540764c76 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:58.439075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2468d6d-25e0-4caa-8986-1ff540764c76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:58.442152 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da519ff6-c0a8-41da-a769-5a4a27c0c57f None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:58.449303 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2468d6d-25e0-4caa-8986-1ff540764c76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:58.450768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2468d6d-25e0-4caa-8986-1ff540764c76 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:58.451842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da519ff6-c0a8-41da-a769-5a4a27c0c57f None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:58.461372 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1766/3498] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:04:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:04:58.466335 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92de01a-1cdb-47a7-9ae6-e988db7f8093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:58.467218 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92de01a-1cdb-47a7-9ae6-e988db7f8093 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:58.467399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92de01a-1cdb-47a7-9ae6-e988db7f8093 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:58.467615 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92de01a-1cdb-47a7-9ae6-e988db7f8093 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:58.468265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92de01a-1cdb-47a7-9ae6-e988db7f8093 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:04:58.468562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92de01a-1cdb-47a7-9ae6-e988db7f8093 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:58.470595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92de01a-1cdb-47a7-9ae6-e988db7f8093 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:58.486888 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1733/3499] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:04:58.488112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2468d6d-25e0-4caa-8986-1ff540764c76 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:58.498285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2468d6d-25e0-4caa-8986-1ff540764c76 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:58.503048 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e08024-c891-49a3-a279-319c68f6ce58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:58.503644 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e08024-c891-49a3-a279-319c68f6ce58 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:58.503918 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e08024-c891-49a3-a279-319c68f6ce58 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:58.504192 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e08024-c891-49a3-a279-319c68f6ce58 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:58.504808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e08024-c891-49a3-a279-319c68f6ce58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:58.506720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e08024-c891-49a3-a279-319c68f6ce58 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:58.538730 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1767/3500] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:04:58 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:04:58.540790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92de01a-1cdb-47a7-9ae6-e988db7f8093 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:58.552726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92de01a-1cdb-47a7-9ae6-e988db7f8093 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:58.613193 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5fc9a8-e84f-4b6f-8577-93868e0cd4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:58.614326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fc9a8-e84f-4b6f-8577-93868e0cd4b4 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:58.614858 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fc9a8-e84f-4b6f-8577-93868e0cd4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:58.615239 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fc9a8-e84f-4b6f-8577-93868e0cd4b4 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:58.616749 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5fc9a8-e84f-4b6f-8577-93868e0cd4b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:58.619200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5fc9a8-e84f-4b6f-8577-93868e0cd4b4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:58.648848 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1734/3501] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:04:58 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:04:58.653981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e08024-c891-49a3-a279-319c68f6ce58 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:58.668347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e08024-c891-49a3-a279-319c68f6ce58 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:58.674613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1188c-a55f-476c-b282-1a8286a79453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:58.674613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1188c-a55f-476c-b282-1a8286a79453 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:58.674613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1188c-a55f-476c-b282-1a8286a79453 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:58.674613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1188c-a55f-476c-b282-1a8286a79453 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:58.675330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1188c-a55f-476c-b282-1a8286a79453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:58.676804 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1188c-a55f-476c-b282-1a8286a79453 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:58.689522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5fc9a8-e84f-4b6f-8577-93868e0cd4b4 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:58.691308 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1768/3502] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:04:58.691426 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0a5fc9a8-e84f-4b6f-8577-93868e0cd4b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:58.692198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1188c-a55f-476c-b282-1a8286a79453 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:58.707499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1188c-a55f-476c-b282-1a8286a79453 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:58.713749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788e0fd-2efc-4272-8f91-cca3be2af16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:58.715373 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788e0fd-2efc-4272-8f91-cca3be2af16d admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:58.715643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788e0fd-2efc-4272-8f91-cca3be2af16d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:58.715911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788e0fd-2efc-4272-8f91-cca3be2af16d admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:58.716548 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9788e0fd-2efc-4272-8f91-cca3be2af16d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:58.718147 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9788e0fd-2efc-4272-8f91-cca3be2af16d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:58.732673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:58.733380 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1769/3503] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:04:58.736894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788e0fd-2efc-4272-8f91-cca3be2af16d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:58.752965 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788e0fd-2efc-4272-8f91-cca3be2af16d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:58.758990 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49607671-0ab4-41ef-b7e4-4fbdba971346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:58.759661 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49607671-0ab4-41ef-b7e4-4fbdba971346 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:58.759942 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49607671-0ab4-41ef-b7e4-4fbdba971346 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:58.760218 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49607671-0ab4-41ef-b7e4-4fbdba971346 admin admin] PATH_INFO: `/v3/projects/7dffa3e9ecbe4f118302bee4d90591ba/users/a2df7f5bd4ae4f6d918bb18721a6ac5b/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:58.780400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5fc9a8-e84f-4b6f-8577-93868e0cd4b4 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:58.780725 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49607671-0ab4-41ef-b7e4-4fbdba971346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dffa3e9ecbe4f118302bee4d90591ba, user_id=a2df7f5bd4ae4f6d918bb18721a6ac5b, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:58.783455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49607671-0ab4-41ef-b7e4-4fbdba971346 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:58.785115 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde2294-f03f-4f07-bb2e-83f56ae9180f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:58.786105 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde2294-f03f-4f07-bb2e-83f56ae9180f service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:58.786983 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde2294-f03f-4f07-bb2e-83f56ae9180f service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:58.787673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde2294-f03f-4f07-bb2e-83f56ae9180f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:58.789549 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2dde2294-f03f-4f07-bb2e-83f56ae9180f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:58.802292 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1770/3504] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:04:58 2022] PUT /identity/v3/projects/7dffa3e9ecbe4f118302bee4d90591ba/users/a2df7f5bd4ae4f6d918bb18721a6ac5b/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:04:58.805436 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde2294-f03f-4f07-bb2e-83f56ae9180f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:58.807494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde2294-f03f-4f07-bb2e-83f56ae9180f service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:58.811915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775d7d6-3645-4ca5-bc32-8d0efc9a9990 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:58.812404 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775d7d6-3645-4ca5-bc32-8d0efc9a9990 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:58.812723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775d7d6-3645-4ca5-bc32-8d0efc9a9990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:58.825506 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1735/3505] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:04:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:04:58.846703 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-5775d7d6-3645-4ca5-bc32-8d0efc9a9990 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:04:58.848207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5775d7d6-3645-4ca5-bc32-8d0efc9a9990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:04:58.882640 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:58.944016 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1771/3506] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:04:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:04:58.951665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde2294-f03f-4f07-bb2e-83f56ae9180f service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:04:58.962123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde2294-f03f-4f07-bb2e-83f56ae9180f service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:04:59.052945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b66bb6-becd-46c0-a7eb-0896f79916e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:04:59.054047 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b66bb6-becd-46c0-a7eb-0896f79916e2 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:04:59.054533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b66bb6-becd-46c0-a7eb-0896f79916e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:04:59.055016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b66bb6-becd-46c0-a7eb-0896f79916e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:04:59.070603 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b66bb6-becd-46c0-a7eb-0896f79916e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:04:59.072323 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b66bb6-becd-46c0-a7eb-0896f79916e2 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:04:59.107281 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1736/3507] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:04:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:05:08.119821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69c3fc-d2f3-4f05-a006-9fd2f56f88c3 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:08.121336 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69c3fc-d2f3-4f05-a006-9fd2f56f88c3 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:08.121336 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69c3fc-d2f3-4f05-a006-9fd2f56f88c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:08.208175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-7b69c3fc-d2f3-4f05-a006-9fd2f56f88c3 None None] MFA Rules not processed for user `1f9190aa4d52460f8636df2d87f11792`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:08.215894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7b69c3fc-d2f3-4f05-a006-9fd2f56f88c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:08.398755 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1772/3508] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:08.406317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b66bb6-becd-46c0-a7eb-0896f79916e2 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:08.407929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e7b66bb6-becd-46c0-a7eb-0896f79916e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:08.590114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b66bb6-becd-46c0-a7eb-0896f79916e2 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:08.598430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d17f8a-8a4e-4c38-904a-c7ebf1bec998 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:08.599421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d17f8a-8a4e-4c38-904a-c7ebf1bec998 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:08.599868 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d17f8a-8a4e-4c38-904a-c7ebf1bec998 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:08.600342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d17f8a-8a4e-4c38-904a-c7ebf1bec998 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:08.611113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d17f8a-8a4e-4c38-904a-c7ebf1bec998 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:08.615877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d17f8a-8a4e-4c38-904a-c7ebf1bec998 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:08.656897 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1737/3509] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:05:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:05:11.797171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7b0b2-b383-4a52-9e00-e9d424f4fe77 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:11.798419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7b0b2-b383-4a52-9e00-e9d424f4fe77 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:11.798893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7b0b2-b383-4a52-9e00-e9d424f4fe77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:11.893927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-54d7b0b2-b383-4a52-9e00-e9d424f4fe77 None None] MFA Rules not processed for user `a2df7f5bd4ae4f6d918bb18721a6ac5b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:11.895555 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-54d7b0b2-b383-4a52-9e00-e9d424f4fe77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:12.058860 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1773/3510] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:12.069759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d17f8a-8a4e-4c38-904a-c7ebf1bec998 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:12.071400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e9d17f8a-8a4e-4c38-904a-c7ebf1bec998 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:12.115177 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d17f8a-8a4e-4c38-904a-c7ebf1bec998 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:12.142400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee9fb6-edab-4309-99d6-8f4031f788c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:12.143281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee9fb6-edab-4309-99d6-8f4031f788c2 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:12.143761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee9fb6-edab-4309-99d6-8f4031f788c2 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:12.144664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee9fb6-edab-4309-99d6-8f4031f788c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:12.162095 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee9fb6-edab-4309-99d6-8f4031f788c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:12.164177 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee9fb6-edab-4309-99d6-8f4031f788c2 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:12.193998 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1738/3511] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:05:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:05:14.498683 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7f92e-624f-4670-b6f6-a635118c048f None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:14.500031 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7f92e-624f-4670-b6f6-a635118c048f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:14.501033 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7f92e-624f-4670-b6f6-a635118c048f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:14.556032 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a2e7f92e-624f-4670-b6f6-a635118c048f None None] MFA Rules not processed for user `a2df7f5bd4ae4f6d918bb18721a6ac5b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:14.560545 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a2e7f92e-624f-4670-b6f6-a635118c048f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:14.597682 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1774/3512] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:16.496426 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee9fb6-edab-4309-99d6-8f4031f788c2 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:16.498026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-43ee9fb6-edab-4309-99d6-8f4031f788c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:16.567437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee9fb6-edab-4309-99d6-8f4031f788c2 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:16.578569 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7db2b-35a1-4e5b-bb38-d622b09f0632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:16.580700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7db2b-35a1-4e5b-bb38-d622b09f0632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:16.581080 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7db2b-35a1-4e5b-bb38-d622b09f0632 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:16.581610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7db2b-35a1-4e5b-bb38-d622b09f0632 admin admin] PATH_INFO: `/v3/users/d836c65ccbdb4c52bfbf17291d00c83b` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:16.583670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7db2b-35a1-4e5b-bb38-d622b09f0632 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d836c65ccbdb4c52bfbf17291d00c83b)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:16.590676 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7db2b-35a1-4e5b-bb38-d622b09f0632 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:16.749407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:16.800392 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7cd7db2b-35a1-4e5b-bb38-d622b09f0632 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd836c65ccbdb4c52bfbf17291d00c83b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:16.801119 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7cd7db2b-35a1-4e5b-bb38-d622b09f0632 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd836c65ccbdb4c52bfbf17291d00c83b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:16.803897 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7cd7db2b-35a1-4e5b-bb38-d622b09f0632 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd836c65ccbdb4c52bfbf17291d00c83b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:16.833221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7cd7db2b-35a1-4e5b-bb38-d622b09f0632 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd836c65ccbdb4c52bfbf17291d00c83b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:16.855750 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7cd7db2b-35a1-4e5b-bb38-d622b09f0632 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd836c65ccbdb4c52bfbf17291d00c83b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:16.897843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cc801-6d40-417a-a06b-c2f2f2fe3580 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:16.898867 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cc801-6d40-417a-a06b-c2f2f2fe3580 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:16.899187 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1739/3513] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:05:16 2022] DELETE /identity/v3/users/d836c65ccbdb4c52bfbf17291d00c83b => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:05:16.899305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cc801-6d40-417a-a06b-c2f2f2fe3580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:16.929271 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-448cc801-6d40-417a-a06b-c2f2f2fe3580 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:16.938459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-448cc801-6d40-417a-a06b-c2f2f2fe3580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:17.090050 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:17.162864 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1775/3514] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:05:17.527630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7db2b-35a1-4e5b-bb38-d622b09f0632 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:17.533820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7cd7db2b-35a1-4e5b-bb38-d622b09f0632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:17.715546 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7db2b-35a1-4e5b-bb38-d622b09f0632 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:17.726834 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315839c-5dd8-4d7c-b794-b344517ef823 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:17.727699 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315839c-5dd8-4d7c-b794-b344517ef823 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:17.727699 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315839c-5dd8-4d7c-b794-b344517ef823 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:17.727950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315839c-5dd8-4d7c-b794-b344517ef823 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:17.772163 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315839c-5dd8-4d7c-b794-b344517ef823 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:17.778794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315839c-5dd8-4d7c-b794-b344517ef823 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:17.841032 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1740/3515] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:05:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:05:18.207206 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cc801-6d40-417a-a06b-c2f2f2fe3580 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:18.209260 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-448cc801-6d40-417a-a06b-c2f2f2fe3580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:18.246065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cc801-6d40-417a-a06b-c2f2f2fe3580 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:18.270266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc913c79-7e58-4368-b528-0d2f370dd51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:18.271151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc913c79-7e58-4368-b528-0d2f370dd51f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:18.271725 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc913c79-7e58-4368-b528-0d2f370dd51f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:18.272527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc913c79-7e58-4368-b528-0d2f370dd51f admin admin] PATH_INFO: `/v3/users/ad1a96004778407584d1805b07ad1c5f` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:18.274319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc913c79-7e58-4368-b528-0d2f370dd51f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad1a96004778407584d1805b07ad1c5f)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:18.278601 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc913c79-7e58-4368-b528-0d2f370dd51f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:18.377108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fc913c79-7e58-4368-b528-0d2f370dd51f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad1a96004778407584d1805b07ad1c5f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:18.399312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fc913c79-7e58-4368-b528-0d2f370dd51f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad1a96004778407584d1805b07ad1c5f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:18.401410 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fc913c79-7e58-4368-b528-0d2f370dd51f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad1a96004778407584d1805b07ad1c5f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:18.402978 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fc913c79-7e58-4368-b528-0d2f370dd51f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad1a96004778407584d1805b07ad1c5f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:18.414966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fc913c79-7e58-4368-b528-0d2f370dd51f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad1a96004778407584d1805b07ad1c5f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:18.453101 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1776/3516] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:05:18 2022] DELETE /identity/v3/users/ad1a96004778407584d1805b07ad1c5f => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:05:18.878143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315839c-5dd8-4d7c-b794-b344517ef823 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:18.895417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315839c-5dd8-4d7c-b794-b344517ef823 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:19.082539 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15b450-befc-46e2-8f39-22610aa64674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:19.083073 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15b450-befc-46e2-8f39-22610aa64674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:19.083460 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15b450-befc-46e2-8f39-22610aa64674 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:19.083839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15b450-befc-46e2-8f39-22610aa64674 admin admin] PATH_INFO: `/v3/projects/e47f439135a6445fa29c8be6d69c1759` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:19.085493 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15b450-befc-46e2-8f39-22610aa64674 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e47f439135a6445fa29c8be6d69c1759)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:19.106149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15b450-befc-46e2-8f39-22610aa64674 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:19.190224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5e15b450-befc-46e2-8f39-22610aa64674 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e47f439135a6445fa29c8be6d69c1759', 'request_id': 'req-5e15b450-befc-46e2-8f39-22610aa64674'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:19.216099 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5e15b450-befc-46e2-8f39-22610aa64674 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e47f439135a6445fa29c8be6d69c1759', 'request_id': 'req-5e15b450-befc-46e2-8f39-22610aa64674'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:19.218612 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:19.241455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5e15b450-befc-46e2-8f39-22610aa64674 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e47f439135a6445fa29c8be6d69c1759', 'request_id': 'req-5e15b450-befc-46e2-8f39-22610aa64674'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:19.277679 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5e15b450-befc-46e2-8f39-22610aa64674 admin admin] The token cache is being invalidate because project e47f439135a6445fa29c8be6d69c1759 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:05:19.278306 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5e15b450-befc-46e2-8f39-22610aa64674 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:19.283639 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5e15b450-befc-46e2-8f39-22610aa64674 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:19.285681 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1741/3517] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:05:18 2022] DELETE /identity/v3/projects/e47f439135a6445fa29c8be6d69c1759 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:05:19.290091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc913c79-7e58-4368-b528-0d2f370dd51f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:19.292847 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-fc913c79-7e58-4368-b528-0d2f370dd51f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:19.318350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc913c79-7e58-4368-b528-0d2f370dd51f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:19.423838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e4b9b-a2a6-4c35-9f7f-f15e8388a7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:19.424673 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e4b9b-a2a6-4c35-9f7f-f15e8388a7a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:19.425117 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e4b9b-a2a6-4c35-9f7f-f15e8388a7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:19.425508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e4b9b-a2a6-4c35-9f7f-f15e8388a7a1 admin admin] PATH_INFO: `/v3/users/d22f6d46c5124b1ba8e025934d9aaf5d` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:19.426798 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e4b9b-a2a6-4c35-9f7f-f15e8388a7a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d22f6d46c5124b1ba8e025934d9aaf5d)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:19.429416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e4b9b-a2a6-4c35-9f7f-f15e8388a7a1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:19.499765 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15b450-befc-46e2-8f39-22610aa64674 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:19.501547 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5e15b450-befc-46e2-8f39-22610aa64674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:19.533933 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15b450-befc-46e2-8f39-22610aa64674 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:19.548739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4d2e4b9b-a2a6-4c35-9f7f-f15e8388a7a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd22f6d46c5124b1ba8e025934d9aaf5d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:19.552865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc71955-2784-4df5-b53f-f5830dfb4634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:19.555202 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc71955-2784-4df5-b53f-f5830dfb4634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:19.558199 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc71955-2784-4df5-b53f-f5830dfb4634 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:19.558968 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc71955-2784-4df5-b53f-f5830dfb4634 admin admin] PATH_INFO: `/v3/projects/4e1d1731bd4d4143a97447b303dd5e6a` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:19.562276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc71955-2784-4df5-b53f-f5830dfb4634 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e1d1731bd4d4143a97447b303dd5e6a)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:19.566472 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc71955-2784-4df5-b53f-f5830dfb4634 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:19.574538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4d2e4b9b-a2a6-4c35-9f7f-f15e8388a7a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd22f6d46c5124b1ba8e025934d9aaf5d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:19.576427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4d2e4b9b-a2a6-4c35-9f7f-f15e8388a7a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd22f6d46c5124b1ba8e025934d9aaf5d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:19.577392 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4d2e4b9b-a2a6-4c35-9f7f-f15e8388a7a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd22f6d46c5124b1ba8e025934d9aaf5d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:19.586587 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:19.598162 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4d2e4b9b-a2a6-4c35-9f7f-f15e8388a7a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd22f6d46c5124b1ba8e025934d9aaf5d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:19.637311 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1777/3518] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:05:19 2022] DELETE /identity/v3/users/d22f6d46c5124b1ba8e025934d9aaf5d => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:05:19.689800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6dc71955-2784-4df5-b53f-f5830dfb4634 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e1d1731bd4d4143a97447b303dd5e6a', 'request_id': 'req-6dc71955-2784-4df5-b53f-f5830dfb4634'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:19.706973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6dc71955-2784-4df5-b53f-f5830dfb4634 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e1d1731bd4d4143a97447b303dd5e6a', 'request_id': 'req-6dc71955-2784-4df5-b53f-f5830dfb4634'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:19.716187 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6dc71955-2784-4df5-b53f-f5830dfb4634 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e1d1731bd4d4143a97447b303dd5e6a', 'request_id': 'req-6dc71955-2784-4df5-b53f-f5830dfb4634'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:19.741713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6dc71955-2784-4df5-b53f-f5830dfb4634 admin admin] The token cache is being invalidate because project 4e1d1731bd4d4143a97447b303dd5e6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:05:19.742379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6dc71955-2784-4df5-b53f-f5830dfb4634 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:19.743410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6dc71955-2784-4df5-b53f-f5830dfb4634 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:19.745852 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1742/3519] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:05:19 2022] DELETE /identity/v3/projects/4e1d1731bd4d4143a97447b303dd5e6a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:05:19.750863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9d980-a50b-4564-b6aa-95cc7d120ac9 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:19.751471 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9d980-a50b-4564-b6aa-95cc7d120ac9 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:19.751978 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9d980-a50b-4564-b6aa-95cc7d120ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:19.795167 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-37e9d980-a50b-4564-b6aa-95cc7d120ac9 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:19.796399 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-37e9d980-a50b-4564-b6aa-95cc7d120ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:19.887640 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1778/3520] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:19.895640 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2868ce8-1bc0-4993-a6ed-0f4a4c2808b3 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:19.896171 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2868ce8-1bc0-4993-a6ed-0f4a4c2808b3 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:19.896798 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2868ce8-1bc0-4993-a6ed-0f4a4c2808b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:19.926298 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-e2868ce8-1bc0-4993-a6ed-0f4a4c2808b3 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:19.927916 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e2868ce8-1bc0-4993-a6ed-0f4a4c2808b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:19.938857 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1743/3521] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:19.943298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9d980-a50b-4564-b6aa-95cc7d120ac9 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:19.954877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9d980-a50b-4564-b6aa-95cc7d120ac9 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:19.961748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a94870-a51b-42ff-a336-fde320f6efc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:19.964347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a94870-a51b-42ff-a336-fde320f6efc3 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:19.964347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a94870-a51b-42ff-a336-fde320f6efc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:19.964347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a94870-a51b-42ff-a336-fde320f6efc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:19.964995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a94870-a51b-42ff-a336-fde320f6efc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:05:19.965318 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a94870-a51b-42ff-a336-fde320f6efc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:19.967559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a94870-a51b-42ff-a336-fde320f6efc3 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:19.982890 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1779/3522] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:05:19.987476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2868ce8-1bc0-4993-a6ed-0f4a4c2808b3 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:20.005447 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2868ce8-1bc0-4993-a6ed-0f4a4c2808b3 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:20.012486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86686681-9e0f-460e-8ddc-ee6d6d769fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:20.013397 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86686681-9e0f-460e-8ddc-ee6d6d769fd7 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:20.013567 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86686681-9e0f-460e-8ddc-ee6d6d769fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:20.014293 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86686681-9e0f-460e-8ddc-ee6d6d769fd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:20.014506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86686681-9e0f-460e-8ddc-ee6d6d769fd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:20.017286 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86686681-9e0f-460e-8ddc-ee6d6d769fd7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:20.066324 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1744/3523] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:05:19 2022] POST /identity/v3/projects => generated 365 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:05:20.070674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a94870-a51b-42ff-a336-fde320f6efc3 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:20.082878 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a94870-a51b-42ff-a336-fde320f6efc3 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:20.172567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2671e-f1db-4153-9ffc-f7e9843ba370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:20.173210 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2671e-f1db-4153-9ffc-f7e9843ba370 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:20.173492 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2671e-f1db-4153-9ffc-f7e9843ba370 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:20.174505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2671e-f1db-4153-9ffc-f7e9843ba370 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:20.175032 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a2671e-f1db-4153-9ffc-f7e9843ba370 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:20.177600 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a2671e-f1db-4153-9ffc-f7e9843ba370 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:20.209394 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1780/3524] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:05:20 2022] POST /identity/v3/users => generated 283 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:05:20.214491 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86686681-9e0f-460e-8ddc-ee6d6d769fd7 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:20.232270 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86686681-9e0f-460e-8ddc-ee6d6d769fd7 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:20.239465 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392917c-4452-4553-b120-792de9ad6f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:20.241354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392917c-4452-4553-b120-792de9ad6f0f admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:20.242533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392917c-4452-4553-b120-792de9ad6f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:20.242928 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392917c-4452-4553-b120-792de9ad6f0f admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:20.243740 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392917c-4452-4553-b120-792de9ad6f0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:20.246738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392917c-4452-4553-b120-792de9ad6f0f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:20.268157 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1745/3525] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:05:20.272222 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2671e-f1db-4153-9ffc-f7e9843ba370 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:20.281398 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392917c-4452-4553-b120-792de9ad6f0f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:20.293822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8392917c-4452-4553-b120-792de9ad6f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:20.294440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2671e-f1db-4153-9ffc-f7e9843ba370 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:20.304830 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0874b-f94b-4615-9ae6-a1fe351472da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:20.305990 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0874b-f94b-4615-9ae6-a1fe351472da admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:20.306648 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0874b-f94b-4615-9ae6-a1fe351472da admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:20.307781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0874b-f94b-4615-9ae6-a1fe351472da admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:20.309366 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0874b-f94b-4615-9ae6-a1fe351472da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:20.312516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0874b-f94b-4615-9ae6-a1fe351472da admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:20.332506 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1781/3526] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:05:20.339460 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392917c-4452-4553-b120-792de9ad6f0f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:20.341653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0874b-f94b-4615-9ae6-a1fe351472da admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:20.353115 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0874b-f94b-4615-9ae6-a1fe351472da admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:20.353347 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f100f1-34f4-4d37-a2ec-126c955a7243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:20.353877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f100f1-34f4-4d37-a2ec-126c955a7243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:20.354364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f100f1-34f4-4d37-a2ec-126c955a7243 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:20.354696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f100f1-34f4-4d37-a2ec-126c955a7243 admin admin] PATH_INFO: `/v3/users/bf5c9921f2554f058eca4fcf4ef0fde7` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:20.360308 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f100f1-34f4-4d37-a2ec-126c955a7243 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf5c9921f2554f058eca4fcf4ef0fde7)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:20.361376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f97d1-3e95-49b5-a554-f1b1ce3f97dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:20.362143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f100f1-34f4-4d37-a2ec-126c955a7243 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:20.362948 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f97d1-3e95-49b5-a554-f1b1ce3f97dd admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:20.363458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f97d1-3e95-49b5-a554-f1b1ce3f97dd admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:20.364252 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f97d1-3e95-49b5-a554-f1b1ce3f97dd admin admin] PATH_INFO: `/v3/projects/dbbbe30122a7461ea225294728dc8af7/users/7dcd210e197347f8ad1622ee882bee92/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:20.384659 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f97d1-3e95-49b5-a554-f1b1ce3f97dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbbbe30122a7461ea225294728dc8af7, user_id=7dcd210e197347f8ad1622ee882bee92, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:20.388950 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f97d1-3e95-49b5-a554-f1b1ce3f97dd admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:20.412032 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1782/3527] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:05:20 2022] PUT /identity/v3/projects/dbbbe30122a7461ea225294728dc8af7/users/7dcd210e197347f8ad1622ee882bee92/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:05:20.413599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f97d1-3e95-49b5-a554-f1b1ce3f97dd admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:20.419103 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-555f97d1-3e95-49b5-a554-f1b1ce3f97dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:20.493046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:20.598608 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f97d1-3e95-49b5-a554-f1b1ce3f97dd admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:20.610029 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f771924-addb-4d4a-8deb-9c76e54cedd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:20.611463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f771924-addb-4d4a-8deb-9c76e54cedd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:20.612439 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f771924-addb-4d4a-8deb-9c76e54cedd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:20.612787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f771924-addb-4d4a-8deb-9c76e54cedd5 admin admin] PATH_INFO: `/v3/projects/b8aab578cc634111b7de333bdd7ef198` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:20.614910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f771924-addb-4d4a-8deb-9c76e54cedd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8aab578cc634111b7de333bdd7ef198)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:20.617009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f771924-addb-4d4a-8deb-9c76e54cedd5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:20.651987 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-48f100f1-34f4-4d37-a2ec-126c955a7243 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf5c9921f2554f058eca4fcf4ef0fde7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:20.652744 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-48f100f1-34f4-4d37-a2ec-126c955a7243 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf5c9921f2554f058eca4fcf4ef0fde7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:20.653423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-48f100f1-34f4-4d37-a2ec-126c955a7243 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf5c9921f2554f058eca4fcf4ef0fde7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:20.673794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-48f100f1-34f4-4d37-a2ec-126c955a7243 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf5c9921f2554f058eca4fcf4ef0fde7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:20.706993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-48f100f1-34f4-4d37-a2ec-126c955a7243 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf5c9921f2554f058eca4fcf4ef0fde7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:20.720438 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1746/3528] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:05:20 2022] DELETE /identity/v3/users/bf5c9921f2554f058eca4fcf4ef0fde7 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:05:20.722075 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb617c2-e75f-4914-8bf3-b5cf40c2fa32 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:20.722528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb617c2-e75f-4914-8bf3-b5cf40c2fa32 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:20.723000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb617c2-e75f-4914-8bf3-b5cf40c2fa32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:20.732211 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=78,keystone:INSERT=4,keystone:DELETE=18 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:20.750123 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6f771924-addb-4d4a-8deb-9c76e54cedd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8aab578cc634111b7de333bdd7ef198', 'request_id': 'req-6f771924-addb-4d4a-8deb-9c76e54cedd5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:20.755603 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-acb617c2-e75f-4914-8bf3-b5cf40c2fa32 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:20.757130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-acb617c2-e75f-4914-8bf3-b5cf40c2fa32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:20.765071 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6f771924-addb-4d4a-8deb-9c76e54cedd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8aab578cc634111b7de333bdd7ef198', 'request_id': 'req-6f771924-addb-4d4a-8deb-9c76e54cedd5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:20.781545 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6f771924-addb-4d4a-8deb-9c76e54cedd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8aab578cc634111b7de333bdd7ef198', 'request_id': 'req-6f771924-addb-4d4a-8deb-9c76e54cedd5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:20.808876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6f771924-addb-4d4a-8deb-9c76e54cedd5 admin admin] The token cache is being invalidate because project b8aab578cc634111b7de333bdd7ef198 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:05:20.809799 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6f771924-addb-4d4a-8deb-9c76e54cedd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:20.810868 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6f771924-addb-4d4a-8deb-9c76e54cedd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:20.827237 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1783/3529] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:05:20 2022] DELETE /identity/v3/projects/b8aab578cc634111b7de333bdd7ef198 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:05:20.832949 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6279e-b501-4b82-a51b-649d55e2f753 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:20.833455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6279e-b501-4b82-a51b-649d55e2f753 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:20.834141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6279e-b501-4b82-a51b-649d55e2f753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:20.888269 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-79c6279e-b501-4b82-a51b-649d55e2f753 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:20.891858 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-79c6279e-b501-4b82-a51b-649d55e2f753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:20.942664 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1747/3530] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:20.952521 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb617c2-e75f-4914-8bf3-b5cf40c2fa32 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:20.954193 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-acb617c2-e75f-4914-8bf3-b5cf40c2fa32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:21.040480 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1784/3531] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:21.068252 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6279e-b501-4b82-a51b-649d55e2f753 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:21.068252 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-79c6279e-b501-4b82-a51b-649d55e2f753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:21.103402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6279e-b501-4b82-a51b-649d55e2f753 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:21.112967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb617c2-e75f-4914-8bf3-b5cf40c2fa32 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:21.116204 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7c130-6cbb-4c4b-afb5-c6454ac02e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:21.118484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7c130-6cbb-4c4b-afb5-c6454ac02e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:21.119494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7c130-6cbb-4c4b-afb5-c6454ac02e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:21.121226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7c130-6cbb-4c4b-afb5-c6454ac02e30 admin admin] PATH_INFO: `/v3/projects/1b871c1ed18840838016162c77dcaf88` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:21.124153 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7c130-6cbb-4c4b-afb5-c6454ac02e30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b871c1ed18840838016162c77dcaf88)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:21.124507 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745a43d-be6e-4792-8470-e36d65e81ea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:21.125340 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745a43d-be6e-4792-8470-e36d65e81ea1 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:21.125684 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745a43d-be6e-4792-8470-e36d65e81ea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:21.126165 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745a43d-be6e-4792-8470-e36d65e81ea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:21.133864 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7c130-6cbb-4c4b-afb5-c6454ac02e30 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:21.140243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745a43d-be6e-4792-8470-e36d65e81ea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:21.141979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745a43d-be6e-4792-8470-e36d65e81ea1 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:21.155477 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1748/3532] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:05:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:05:21.168478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffa961-0a92-483c-9c9c-45106722735b None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:21.168789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffa961-0a92-483c-9c9c-45106722735b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:21.169258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffa961-0a92-483c-9c9c-45106722735b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:21.191219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-30ffa961-0a92-483c-9c9c-45106722735b None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:21.192729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-30ffa961-0a92-483c-9c9c-45106722735b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:21.204746 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1749/3533] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:21.209438 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffa961-0a92-483c-9c9c-45106722735b None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:21.223864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffa961-0a92-483c-9c9c-45106722735b None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:21.257855 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:21.268590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-08f7c130-6cbb-4c4b-afb5-c6454ac02e30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b871c1ed18840838016162c77dcaf88', 'request_id': 'req-08f7c130-6cbb-4c4b-afb5-c6454ac02e30'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:21.285885 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-08f7c130-6cbb-4c4b-afb5-c6454ac02e30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b871c1ed18840838016162c77dcaf88', 'request_id': 'req-08f7c130-6cbb-4c4b-afb5-c6454ac02e30'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:21.299081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-08f7c130-6cbb-4c4b-afb5-c6454ac02e30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b871c1ed18840838016162c77dcaf88', 'request_id': 'req-08f7c130-6cbb-4c4b-afb5-c6454ac02e30'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:21.319454 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-08f7c130-6cbb-4c4b-afb5-c6454ac02e30 admin admin] The token cache is being invalidate because project 1b871c1ed18840838016162c77dcaf88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:05:21.321296 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-08f7c130-6cbb-4c4b-afb5-c6454ac02e30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:21.322187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-08f7c130-6cbb-4c4b-afb5-c6454ac02e30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:21.327526 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1785/3534] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:05:21 2022] DELETE /identity/v3/projects/1b871c1ed18840838016162c77dcaf88 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:05:21.332546 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db489675-deb0-4234-9d43-cb5e8fc31fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:21.334402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a86b3-90d0-4071-984a-830565e3eaa8 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:21.334767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a86b3-90d0-4071-984a-830565e3eaa8 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:21.335048 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a86b3-90d0-4071-984a-830565e3eaa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:21.335531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db489675-deb0-4234-9d43-cb5e8fc31fbc admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:21.336063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db489675-deb0-4234-9d43-cb5e8fc31fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:21.336645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db489675-deb0-4234-9d43-cb5e8fc31fbc admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:21.337519 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db489675-deb0-4234-9d43-cb5e8fc31fbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:05:21.338030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db489675-deb0-4234-9d43-cb5e8fc31fbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:21.356942 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db489675-deb0-4234-9d43-cb5e8fc31fbc admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:21.363979 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-bf9a86b3-90d0-4071-984a-830565e3eaa8 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:21.365860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-bf9a86b3-90d0-4071-984a-830565e3eaa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:21.389222 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1786/3535] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:21.391242 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53675034-aeea-4cdc-ad96-9d5804915226 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:21.391876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53675034-aeea-4cdc-ad96-9d5804915226 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:21.392664 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1750/3536] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:05:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:05:21.393211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53675034-aeea-4cdc-ad96-9d5804915226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:21.398017 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db489675-deb0-4234-9d43-cb5e8fc31fbc admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:21.400347 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-db489675-deb0-4234-9d43-cb5e8fc31fbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:21.431140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-53675034-aeea-4cdc-ad96-9d5804915226 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:21.433414 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-53675034-aeea-4cdc-ad96-9d5804915226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:21.433793 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db489675-deb0-4234-9d43-cb5e8fc31fbc admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:21.446960 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f08f1-3363-44a1-a564-01774e1ebbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:21.448992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f08f1-3363-44a1-a564-01774e1ebbb8 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:21.449580 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f08f1-3363-44a1-a564-01774e1ebbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:21.451251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f08f1-3363-44a1-a564-01774e1ebbb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:21.453586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f08f1-3363-44a1-a564-01774e1ebbb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:21.454574 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1787/3537] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:21.457075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53675034-aeea-4cdc-ad96-9d5804915226 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:21.459622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f08f1-3363-44a1-a564-01774e1ebbb8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:21.470291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53675034-aeea-4cdc-ad96-9d5804915226 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:21.476226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08392d-7798-49a0-9154-cfde6321bfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:21.476907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08392d-7798-49a0-9154-cfde6321bfae admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:21.477828 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08392d-7798-49a0-9154-cfde6321bfae admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:21.478086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08392d-7798-49a0-9154-cfde6321bfae admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:21.478801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08392d-7798-49a0-9154-cfde6321bfae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:05:21.479148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08392d-7798-49a0-9154-cfde6321bfae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:21.481469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08392d-7798-49a0-9154-cfde6321bfae admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:21.504479 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1788/3538] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:05:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:05:21.508761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08392d-7798-49a0-9154-cfde6321bfae admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:21.525537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08392d-7798-49a0-9154-cfde6321bfae admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:21.534001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3b374-91bd-46a1-b17a-ec01e5833912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:21.534739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3b374-91bd-46a1-b17a-ec01e5833912 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:21.535522 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3b374-91bd-46a1-b17a-ec01e5833912 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:21.535826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3b374-91bd-46a1-b17a-ec01e5833912 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:21.537116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b3b374-91bd-46a1-b17a-ec01e5833912 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:21.539863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b3b374-91bd-46a1-b17a-ec01e5833912 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:21.547160 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1751/3539] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:05:21 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:05:21.551083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f08f1-3363-44a1-a564-01774e1ebbb8 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:21.592649 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1789/3540] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:05:21 2022] POST /identity/v3/projects => generated 389 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:05:21.599592 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:21.600234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3b374-91bd-46a1-b17a-ec01e5833912 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:21.738854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f08f1-3363-44a1-a564-01774e1ebbb8 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:21.789830 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3b374-91bd-46a1-b17a-ec01e5833912 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:21.816817 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ec793-455f-4530-8c6c-717fbb17b24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:21.818081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ec793-455f-4530-8c6c-717fbb17b24c admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:21.818566 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ec793-455f-4530-8c6c-717fbb17b24c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:21.819018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ec793-455f-4530-8c6c-717fbb17b24c admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:21.819824 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ec793-455f-4530-8c6c-717fbb17b24c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:21.829593 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ec793-455f-4530-8c6c-717fbb17b24c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:21.859984 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9655fb-b4ba-4497-bd67-9a4c80bb1ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:21.860709 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9655fb-b4ba-4497-bd67-9a4c80bb1ae5 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:21.861167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9655fb-b4ba-4497-bd67-9a4c80bb1ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:21.862323 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9655fb-b4ba-4497-bd67-9a4c80bb1ae5 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:21.863140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9655fb-b4ba-4497-bd67-9a4c80bb1ae5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:21.865812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9655fb-b4ba-4497-bd67-9a4c80bb1ae5 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:21.889940 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1790/3541] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:05:21 2022] POST /identity/v3/users => generated 295 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:05:21.894034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ec793-455f-4530-8c6c-717fbb17b24c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:21.909766 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1752/3542] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:05:21 2022] POST /identity/v3/users => generated 293 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:05:21.911052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9655fb-b4ba-4497-bd67-9a4c80bb1ae5 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:21.918144 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ec793-455f-4530-8c6c-717fbb17b24c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:21.923653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5564bab-46f3-41be-bb3a-d6b6309da3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:21.924544 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5564bab-46f3-41be-bb3a-d6b6309da3c2 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:21.925013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5564bab-46f3-41be-bb3a-d6b6309da3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:21.925133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9655fb-b4ba-4497-bd67-9a4c80bb1ae5 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:21.925576 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5564bab-46f3-41be-bb3a-d6b6309da3c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:21.926478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5564bab-46f3-41be-bb3a-d6b6309da3c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:21.928655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5564bab-46f3-41be-bb3a-d6b6309da3c2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:21.933159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c8d75-251d-4c81-afd7-3ac8e60d172a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:21.934150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c8d75-251d-4c81-afd7-3ac8e60d172a admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:21.935136 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c8d75-251d-4c81-afd7-3ac8e60d172a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:21.935136 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c8d75-251d-4c81-afd7-3ac8e60d172a admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:21.936221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c8d75-251d-4c81-afd7-3ac8e60d172a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:21.939161 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c8d75-251d-4c81-afd7-3ac8e60d172a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:21.943998 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1791/3543] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:05:21.949111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5564bab-46f3-41be-bb3a-d6b6309da3c2 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:21.960443 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1753/3544] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:05:21.964092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c8d75-251d-4c81-afd7-3ac8e60d172a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:21.964493 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5564bab-46f3-41be-bb3a-d6b6309da3c2 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:21.971260 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe1ad6-2e07-4251-b081-2d59a0d6a30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:21.972452 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe1ad6-2e07-4251-b081-2d59a0d6a30c admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:21.973409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe1ad6-2e07-4251-b081-2d59a0d6a30c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:21.974077 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe1ad6-2e07-4251-b081-2d59a0d6a30c admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:21.975728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe1ad6-2e07-4251-b081-2d59a0d6a30c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:21.976480 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c8d75-251d-4c81-afd7-3ac8e60d172a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:21.978532 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe1ad6-2e07-4251-b081-2d59a0d6a30c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:21.996744 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8ad5a-837d-4bfe-949c-8842512b5ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:21.997392 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8ad5a-837d-4bfe-949c-8842512b5ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:21.998221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8ad5a-837d-4bfe-949c-8842512b5ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:21.998221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8ad5a-837d-4bfe-949c-8842512b5ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:21.998609 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8ad5a-837d-4bfe-949c-8842512b5ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:22.000235 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8ad5a-837d-4bfe-949c-8842512b5ab2 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:22.025750 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1754/3545] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:05:22.029775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8ad5a-837d-4bfe-949c-8842512b5ab2 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:22.044498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8ad5a-837d-4bfe-949c-8842512b5ab2 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:22.049915 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1792/3546] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:05:22.054619 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d20a86-66a1-45f5-a834-5c2cf2b8a025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:22.055378 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe1ad6-2e07-4251-b081-2d59a0d6a30c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:22.056396 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d20a86-66a1-45f5-a834-5c2cf2b8a025 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:22.058842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d20a86-66a1-45f5-a834-5c2cf2b8a025 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:22.059442 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d20a86-66a1-45f5-a834-5c2cf2b8a025 admin admin] PATH_INFO: `/v3/projects/b686c8ef8667480393ad48b1d8bf6237/users/c6b36a5f1720420f92caacce28cf6fc5/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:22.086703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d20a86-66a1-45f5-a834-5c2cf2b8a025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b686c8ef8667480393ad48b1d8bf6237, user_id=c6b36a5f1720420f92caacce28cf6fc5, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:22.093905 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe1ad6-2e07-4251-b081-2d59a0d6a30c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:22.096607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d20a86-66a1-45f5-a834-5c2cf2b8a025 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:22.101832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704d1c7-2870-4e35-b77e-00971459efd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:22.103768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704d1c7-2870-4e35-b77e-00971459efd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:22.106170 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704d1c7-2870-4e35-b77e-00971459efd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:22.106651 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704d1c7-2870-4e35-b77e-00971459efd3 admin admin] PATH_INFO: `/v3/projects/90a59ffcb8834a50b1e8fa57aa9e89d2/users/e0943fdb586241b796e349e08c778f28/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:22.133507 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1704d1c7-2870-4e35-b77e-00971459efd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90a59ffcb8834a50b1e8fa57aa9e89d2, user_id=e0943fdb586241b796e349e08c778f28, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:22.146971 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1755/3547] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:05:22 2022] PUT /identity/v3/projects/b686c8ef8667480393ad48b1d8bf6237/users/c6b36a5f1720420f92caacce28cf6fc5/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:05:22.157494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1481c-eb9e-4910-b531-fc088fd47438 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:22.157828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1481c-eb9e-4910-b531-fc088fd47438 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:22.158067 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1481c-eb9e-4910-b531-fc088fd47438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:22.159065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1704d1c7-2870-4e35-b77e-00971459efd3 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:22.184481 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1793/3548] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:05:22 2022] PUT /identity/v3/projects/90a59ffcb8834a50b1e8fa57aa9e89d2/users/e0943fdb586241b796e349e08c778f28/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:05:22.190344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd383c8-aa01-49db-ba32-e2442e964509 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:22.190797 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd383c8-aa01-49db-ba32-e2442e964509 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:22.191089 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd383c8-aa01-49db-ba32-e2442e964509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:22.208795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-02a1481c-eb9e-4910-b531-fc088fd47438 None None] MFA Rules not processed for user `c6b36a5f1720420f92caacce28cf6fc5`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:22.210305 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-02a1481c-eb9e-4910-b531-fc088fd47438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:22.227295 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-2bd383c8-aa01-49db-ba32-e2442e964509 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:22.232196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2bd383c8-aa01-49db-ba32-e2442e964509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:22.273138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=4,keystone:SELECT=90,keystone:INSERT=6 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:22.342330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:22.379179 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1756/3549] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:22.385115 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1481c-eb9e-4910-b531-fc088fd47438 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:22.394107 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1794/3550] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:22.400305 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1481c-eb9e-4910-b531-fc088fd47438 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:22.405007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd383c8-aa01-49db-ba32-e2442e964509 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:22.406757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2bd383c8-aa01-49db-ba32-e2442e964509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:22.406885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5285d-213a-4ec0-b793-9902e47c6b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:22.407652 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5285d-213a-4ec0-b793-9902e47c6b55 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:22.408028 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5285d-213a-4ec0-b793-9902e47c6b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:22.408405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5285d-213a-4ec0-b793-9902e47c6b55 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:22.410011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da5285d-213a-4ec0-b793-9902e47c6b55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:22.412723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da5285d-213a-4ec0-b793-9902e47c6b55 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:22.463097 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1757/3551] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:05:22 2022] POST /identity/v3/projects => generated 385 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:05:22.470581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5285d-213a-4ec0-b793-9902e47c6b55 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:22.488839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd383c8-aa01-49db-ba32-e2442e964509 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:22.610490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b26ed4-79f4-4606-81bf-1c7e53d4d718 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:22.611591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b26ed4-79f4-4606-81bf-1c7e53d4d718 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:22.612036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b26ed4-79f4-4606-81bf-1c7e53d4d718 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:22.612481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b26ed4-79f4-4606-81bf-1c7e53d4d718 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:22.613379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5285d-213a-4ec0-b793-9902e47c6b55 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:22.624189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b26ed4-79f4-4606-81bf-1c7e53d4d718 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:22.626291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b26ed4-79f4-4606-81bf-1c7e53d4d718 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:22.626976 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb9cde-88eb-4c29-bb31-88ef462ffd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:22.627677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb9cde-88eb-4c29-bb31-88ef462ffd31 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:22.628025 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb9cde-88eb-4c29-bb31-88ef462ffd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:22.628427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb9cde-88eb-4c29-bb31-88ef462ffd31 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:22.629114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bb9cde-88eb-4c29-bb31-88ef462ffd31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:22.631164 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bb9cde-88eb-4c29-bb31-88ef462ffd31 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:22.642190 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1795/3552] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:05:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:05:22.680224 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1758/3553] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:05:22 2022] POST /identity/v3/users => generated 299 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:05:22.684668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b26ed4-79f4-4606-81bf-1c7e53d4d718 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:22.698812 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b26ed4-79f4-4606-81bf-1c7e53d4d718 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:22.706408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e8fdd-00c4-4c72-a51d-14ec32e81ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:22.707258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e8fdd-00c4-4c72-a51d-14ec32e81ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:22.707612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e8fdd-00c4-4c72-a51d-14ec32e81ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:22.708024 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e8fdd-00c4-4c72-a51d-14ec32e81ce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:22.708829 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e8fdd-00c4-4c72-a51d-14ec32e81ce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:22.723490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e8fdd-00c4-4c72-a51d-14ec32e81ce5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:22.740541 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1796/3554] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:05:22.741765 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb9cde-88eb-4c29-bb31-88ef462ffd31 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:22.752580 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb9cde-88eb-4c29-bb31-88ef462ffd31 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:22.759643 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5543578-6be7-4b3d-937c-e8b773186b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:22.761241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5543578-6be7-4b3d-937c-e8b773186b15 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:22.761594 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5543578-6be7-4b3d-937c-e8b773186b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:22.762145 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5543578-6be7-4b3d-937c-e8b773186b15 admin admin] PATH_INFO: `/v3/projects/34ed65ed92a44b1bb13762937754142e/users/321e6cb22adf48eb9a1f1f5a8a48f6a1/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:22.790790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5543578-6be7-4b3d-937c-e8b773186b15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34ed65ed92a44b1bb13762937754142e, user_id=321e6cb22adf48eb9a1f1f5a8a48f6a1, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:22.794917 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5543578-6be7-4b3d-937c-e8b773186b15 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:22.813531 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1759/3555] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:05:22 2022] PUT /identity/v3/projects/34ed65ed92a44b1bb13762937754142e/users/321e6cb22adf48eb9a1f1f5a8a48f6a1/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:05:22.821668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e8fdd-00c4-4c72-a51d-14ec32e81ce5 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:22.843702 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e8fdd-00c4-4c72-a51d-14ec32e81ce5 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:22.933916 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99038a88-b7ae-4f11-a985-d102778ffe58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:22.934740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99038a88-b7ae-4f11-a985-d102778ffe58 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:22.935118 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99038a88-b7ae-4f11-a985-d102778ffe58 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:22.935487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99038a88-b7ae-4f11-a985-d102778ffe58 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:22.936548 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99038a88-b7ae-4f11-a985-d102778ffe58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:22.938413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99038a88-b7ae-4f11-a985-d102778ffe58 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:22.989320 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1797/3556] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:05:22.991274 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5543578-6be7-4b3d-937c-e8b773186b15 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:23.007470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5543578-6be7-4b3d-937c-e8b773186b15 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:23.024355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c168b0a-cbf0-4e62-8f98-f55165e30387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:23.027296 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c168b0a-cbf0-4e62-8f98-f55165e30387 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:23.027807 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c168b0a-cbf0-4e62-8f98-f55165e30387 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:23.028320 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c168b0a-cbf0-4e62-8f98-f55165e30387 admin admin] PATH_INFO: `/v3/projects/34ed65ed92a44b1bb13762937754142e/users/321e6cb22adf48eb9a1f1f5a8a48f6a1/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:23.032420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c168b0a-cbf0-4e62-8f98-f55165e30387 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34ed65ed92a44b1bb13762937754142e, user_id=321e6cb22adf48eb9a1f1f5a8a48f6a1, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:23.037672 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c168b0a-cbf0-4e62-8f98-f55165e30387 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:23.074713 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1760/3557] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:05:22 2022] PUT /identity/v3/projects/34ed65ed92a44b1bb13762937754142e/users/321e6cb22adf48eb9a1f1f5a8a48f6a1/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:05:23.080582 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af72ff-e2cf-427d-bf7e-fa85b9b56f88 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:23.081962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af72ff-e2cf-427d-bf7e-fa85b9b56f88 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:23.082488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af72ff-e2cf-427d-bf7e-fa85b9b56f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:23.132139 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:23.140200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-77af72ff-e2cf-427d-bf7e-fa85b9b56f88 None None] MFA Rules not processed for user `321e6cb22adf48eb9a1f1f5a8a48f6a1`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:23.163765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-77af72ff-e2cf-427d-bf7e-fa85b9b56f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:23.357361 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1798/3558] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:23 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:05:23.370103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c168b0a-cbf0-4e62-8f98-f55165e30387 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:23.372616 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5c168b0a-cbf0-4e62-8f98-f55165e30387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:23.547829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c168b0a-cbf0-4e62-8f98-f55165e30387 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:23.556003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a59a7-1851-45a6-829c-09c51937d722 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:23.557049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a59a7-1851-45a6-829c-09c51937d722 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:23.558644 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a59a7-1851-45a6-829c-09c51937d722 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:23.559091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a59a7-1851-45a6-829c-09c51937d722 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:23.570972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a59a7-1851-45a6-829c-09c51937d722 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:23.574335 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a59a7-1851-45a6-829c-09c51937d722 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:23.590089 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1761/3559] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:05:23 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:05:23.977931 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af72ff-e2cf-427d-bf7e-fa85b9b56f88 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:24.075881 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af72ff-e2cf-427d-bf7e-fa85b9b56f88 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:24.081589 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1464e442-5f91-46df-b292-cd90ce2aaec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:24.082369 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464e442-5f91-46df-b292-cd90ce2aaec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:24.083215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464e442-5f91-46df-b292-cd90ce2aaec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:24.083670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464e442-5f91-46df-b292-cd90ce2aaec5 admin admin] PATH_INFO: `/v3/users/c6b36a5f1720420f92caacce28cf6fc5` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:24.085292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1464e442-5f91-46df-b292-cd90ce2aaec5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6b36a5f1720420f92caacce28cf6fc5)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:24.087592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1464e442-5f91-46df-b292-cd90ce2aaec5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:24.159446 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1464e442-5f91-46df-b292-cd90ce2aaec5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6b36a5f1720420f92caacce28cf6fc5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:24.169173 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1464e442-5f91-46df-b292-cd90ce2aaec5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6b36a5f1720420f92caacce28cf6fc5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:24.170002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1464e442-5f91-46df-b292-cd90ce2aaec5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6b36a5f1720420f92caacce28cf6fc5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:24.171322 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1464e442-5f91-46df-b292-cd90ce2aaec5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6b36a5f1720420f92caacce28cf6fc5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:24.182966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1464e442-5f91-46df-b292-cd90ce2aaec5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6b36a5f1720420f92caacce28cf6fc5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:24.226416 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1799/3560] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:05:23 2022] DELETE /identity/v3/users/c6b36a5f1720420f92caacce28cf6fc5 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:05:24.231540 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e0da4-9e6b-4cd9-bb5d-2ebfa26067bc None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:24.232039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e0da4-9e6b-4cd9-bb5d-2ebfa26067bc None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:24.232890 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e0da4-9e6b-4cd9-bb5d-2ebfa26067bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:24.249126 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:24.258425 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a88e0da4-9e6b-4cd9-bb5d-2ebfa26067bc None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:24.261316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a88e0da4-9e6b-4cd9-bb5d-2ebfa26067bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:24.366724 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1762/3561] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:24.395518 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1464e442-5f91-46df-b292-cd90ce2aaec5 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:24.400490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1464e442-5f91-46df-b292-cd90ce2aaec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:24.468046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:24.606642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1464e442-5f91-46df-b292-cd90ce2aaec5 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:24.614237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21569f28-0027-4d89-807a-16d83f468a61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:24.615158 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21569f28-0027-4d89-807a-16d83f468a61 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:24.615450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21569f28-0027-4d89-807a-16d83f468a61 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:24.615728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21569f28-0027-4d89-807a-16d83f468a61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:24.641887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21569f28-0027-4d89-807a-16d83f468a61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:24.655366 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21569f28-0027-4d89-807a-16d83f468a61 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:24.673626 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1800/3562] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:05:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:05:26.041112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e0da4-9e6b-4cd9-bb5d-2ebfa26067bc None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:26.043255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a88e0da4-9e6b-4cd9-bb5d-2ebfa26067bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:26.068732 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e0da4-9e6b-4cd9-bb5d-2ebfa26067bc None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:26.094597 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d314c4-ac6b-412c-bc23-07b21ebc0ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:26.101605 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d314c4-ac6b-412c-bc23-07b21ebc0ffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:26.102405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d314c4-ac6b-412c-bc23-07b21ebc0ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:26.103318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d314c4-ac6b-412c-bc23-07b21ebc0ffa admin admin] PATH_INFO: `/v3/projects/b686c8ef8667480393ad48b1d8bf6237` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:26.107527 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d314c4-ac6b-412c-bc23-07b21ebc0ffa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b686c8ef8667480393ad48b1d8bf6237)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:26.113885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d314c4-ac6b-412c-bc23-07b21ebc0ffa admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:26.216675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-41d314c4-ac6b-412c-bc23-07b21ebc0ffa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b686c8ef8667480393ad48b1d8bf6237', 'request_id': 'req-41d314c4-ac6b-412c-bc23-07b21ebc0ffa'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:26.227562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-41d314c4-ac6b-412c-bc23-07b21ebc0ffa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b686c8ef8667480393ad48b1d8bf6237', 'request_id': 'req-41d314c4-ac6b-412c-bc23-07b21ebc0ffa'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:26.240102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-41d314c4-ac6b-412c-bc23-07b21ebc0ffa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b686c8ef8667480393ad48b1d8bf6237', 'request_id': 'req-41d314c4-ac6b-412c-bc23-07b21ebc0ffa'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:26.262056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-41d314c4-ac6b-412c-bc23-07b21ebc0ffa admin admin] The token cache is being invalidate because project b686c8ef8667480393ad48b1d8bf6237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:05:26.262356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-41d314c4-ac6b-412c-bc23-07b21ebc0ffa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:26.263564 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-41d314c4-ac6b-412c-bc23-07b21ebc0ffa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:26.269847 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1763/3563] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:05:26 2022] DELETE /identity/v3/projects/b686c8ef8667480393ad48b1d8bf6237 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:05:26.271327 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21569f28-0027-4d89-807a-16d83f468a61 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:26.292336 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21569f28-0027-4d89-807a-16d83f468a61 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:26.438737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cdf08a-9c7b-487f-8bd8-ad8ff1e22222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:26.439674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdf08a-9c7b-487f-8bd8-ad8ff1e22222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:26.440104 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdf08a-9c7b-487f-8bd8-ad8ff1e22222 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:26.440618 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdf08a-9c7b-487f-8bd8-ad8ff1e22222 admin admin] PATH_INFO: `/v3/users/321e6cb22adf48eb9a1f1f5a8a48f6a1` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:26.442383 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cdf08a-9c7b-487f-8bd8-ad8ff1e22222 admin admin] RBAC: Authorizing `identity:delete_user(user_id=321e6cb22adf48eb9a1f1f5a8a48f6a1)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:26.444711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cdf08a-9c7b-487f-8bd8-ad8ff1e22222 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:26.515331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d4cdf08a-9c7b-487f-8bd8-ad8ff1e22222 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '321e6cb22adf48eb9a1f1f5a8a48f6a1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:26.522847 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d4cdf08a-9c7b-487f-8bd8-ad8ff1e22222 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '321e6cb22adf48eb9a1f1f5a8a48f6a1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:26.523561 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d4cdf08a-9c7b-487f-8bd8-ad8ff1e22222 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '321e6cb22adf48eb9a1f1f5a8a48f6a1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:26.524170 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d4cdf08a-9c7b-487f-8bd8-ad8ff1e22222 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '321e6cb22adf48eb9a1f1f5a8a48f6a1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:26.531989 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d4cdf08a-9c7b-487f-8bd8-ad8ff1e22222 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '321e6cb22adf48eb9a1f1f5a8a48f6a1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:26.559151 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1801/3564] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:05:26 2022] DELETE /identity/v3/users/321e6cb22adf48eb9a1f1f5a8a48f6a1 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:05:28.173166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d314c4-ac6b-412c-bc23-07b21ebc0ffa admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:28.174894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-41d314c4-ac6b-412c-bc23-07b21ebc0ffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:28.198410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d314c4-ac6b-412c-bc23-07b21ebc0ffa admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:28.354759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159fb9d0-a1b8-4814-87a7-7948e01f2782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:28.355821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fb9d0-a1b8-4814-87a7-7948e01f2782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:28.356315 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fb9d0-a1b8-4814-87a7-7948e01f2782 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:28.356797 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fb9d0-a1b8-4814-87a7-7948e01f2782 admin admin] PATH_INFO: `/v3/projects/34ed65ed92a44b1bb13762937754142e` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:28.358673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159fb9d0-a1b8-4814-87a7-7948e01f2782 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34ed65ed92a44b1bb13762937754142e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:28.361151 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159fb9d0-a1b8-4814-87a7-7948e01f2782 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:28.429430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:28.461648 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-159fb9d0-a1b8-4814-87a7-7948e01f2782 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34ed65ed92a44b1bb13762937754142e', 'request_id': 'req-159fb9d0-a1b8-4814-87a7-7948e01f2782'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:28.482040 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-159fb9d0-a1b8-4814-87a7-7948e01f2782 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34ed65ed92a44b1bb13762937754142e', 'request_id': 'req-159fb9d0-a1b8-4814-87a7-7948e01f2782'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:28.494900 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-159fb9d0-a1b8-4814-87a7-7948e01f2782 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34ed65ed92a44b1bb13762937754142e', 'request_id': 'req-159fb9d0-a1b8-4814-87a7-7948e01f2782'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:28.533840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-159fb9d0-a1b8-4814-87a7-7948e01f2782 admin admin] The token cache is being invalidate because project 34ed65ed92a44b1bb13762937754142e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:05:28.534460 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-159fb9d0-a1b8-4814-87a7-7948e01f2782 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:28.535665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-159fb9d0-a1b8-4814-87a7-7948e01f2782 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:28.541462 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1764/3565] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:05:28 2022] DELETE /identity/v3/projects/34ed65ed92a44b1bb13762937754142e => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:05:28.543961 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038fbc2-ceac-48d4-97a1-8c1dcaca251e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:28.544779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038fbc2-ceac-48d4-97a1-8c1dcaca251e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:28.545063 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038fbc2-ceac-48d4-97a1-8c1dcaca251e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:28.593457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d038fbc2-ceac-48d4-97a1-8c1dcaca251e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:28.595822 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d038fbc2-ceac-48d4-97a1-8c1dcaca251e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:28.690267 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:28.755035 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1802/3566] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:28.763861 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac2260-aec6-4af1-b9ab-560748f23894 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:28.764254 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac2260-aec6-4af1-b9ab-560748f23894 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:28.764531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac2260-aec6-4af1-b9ab-560748f23894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:28.798822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f9ac2260-aec6-4af1-b9ab-560748f23894 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:28.800346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f9ac2260-aec6-4af1-b9ab-560748f23894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:28.817917 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1765/3567] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:28.822309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038fbc2-ceac-48d4-97a1-8c1dcaca251e None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:28.836676 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038fbc2-ceac-48d4-97a1-8c1dcaca251e None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:28.850636 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3505d-82fa-411a-be1c-c7085caa6030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:28.851274 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3505d-82fa-411a-be1c-c7085caa6030 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:28.851555 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3505d-82fa-411a-be1c-c7085caa6030 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:28.851894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3505d-82fa-411a-be1c-c7085caa6030 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:28.852572 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3505d-82fa-411a-be1c-c7085caa6030 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:05:28.852876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3505d-82fa-411a-be1c-c7085caa6030 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:28.854697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3505d-82fa-411a-be1c-c7085caa6030 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:28.889247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac2260-aec6-4af1-b9ab-560748f23894 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:28.894926 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1803/3568] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:05:28.901833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac2260-aec6-4af1-b9ab-560748f23894 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:28.921442 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0543ca8-cb69-4417-ba8d-e79144b2a94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:28.922129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0543ca8-cb69-4417-ba8d-e79144b2a94c admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:28.922431 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0543ca8-cb69-4417-ba8d-e79144b2a94c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:28.922737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0543ca8-cb69-4417-ba8d-e79144b2a94c admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:28.923449 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0543ca8-cb69-4417-ba8d-e79144b2a94c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:28.925575 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0543ca8-cb69-4417-ba8d-e79144b2a94c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:28.983124 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1766/3569] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:05:28 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:05:28.987612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3505d-82fa-411a-be1c-c7085caa6030 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:29.002897 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3505d-82fa-411a-be1c-c7085caa6030 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:29.127844 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e27413-de00-4ba9-a055-07e235aefa57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:29.128974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e27413-de00-4ba9-a055-07e235aefa57 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:29.129537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e27413-de00-4ba9-a055-07e235aefa57 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:29.130024 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e27413-de00-4ba9-a055-07e235aefa57 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:29.132230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e27413-de00-4ba9-a055-07e235aefa57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:29.134667 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e27413-de00-4ba9-a055-07e235aefa57 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:29.203353 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1804/3570] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:05:28 2022] POST /identity/v3/users => generated 292 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:05:29.207653 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0543ca8-cb69-4417-ba8d-e79144b2a94c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:29.221127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0543ca8-cb69-4417-ba8d-e79144b2a94c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:29.237571 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a546ae-9f87-430f-97f8-397620a440d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:29.238695 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a546ae-9f87-430f-97f8-397620a440d4 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:29.239125 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a546ae-9f87-430f-97f8-397620a440d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:29.239542 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a546ae-9f87-430f-97f8-397620a440d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:29.240483 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a546ae-9f87-430f-97f8-397620a440d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:29.243617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a546ae-9f87-430f-97f8-397620a440d4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:29.270219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e27413-de00-4ba9-a055-07e235aefa57 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:29.271235 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1767/3571] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:05:29.288799 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e27413-de00-4ba9-a055-07e235aefa57 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:29.295792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9febd4-e5f8-43ee-bc1b-64140c8c2574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:29.297148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9febd4-e5f8-43ee-bc1b-64140c8c2574 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:29.297440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9febd4-e5f8-43ee-bc1b-64140c8c2574 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:29.297718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9febd4-e5f8-43ee-bc1b-64140c8c2574 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:29.298381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9febd4-e5f8-43ee-bc1b-64140c8c2574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:29.300183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9febd4-e5f8-43ee-bc1b-64140c8c2574 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:29.320278 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1805/3572] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:05:29.325829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a546ae-9f87-430f-97f8-397620a440d4 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:29.337129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a546ae-9f87-430f-97f8-397620a440d4 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:29.360528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14bead3-3ffe-441d-b1e5-0f2e966fbb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:29.361372 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14bead3-3ffe-441d-b1e5-0f2e966fbb52 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:29.361718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14bead3-3ffe-441d-b1e5-0f2e966fbb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:29.362198 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14bead3-3ffe-441d-b1e5-0f2e966fbb52 admin admin] PATH_INFO: `/v3/projects/8482c922e64f40d4b95793ac70044614/users/e35e4972ca5547ca8abb304343bf1031/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:29.396952 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14bead3-3ffe-441d-b1e5-0f2e966fbb52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8482c922e64f40d4b95793ac70044614, user_id=e35e4972ca5547ca8abb304343bf1031, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:29.399970 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14bead3-3ffe-441d-b1e5-0f2e966fbb52 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:29.433583 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1768/3573] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:05:29 2022] PUT /identity/v3/projects/8482c922e64f40d4b95793ac70044614/users/e35e4972ca5547ca8abb304343bf1031/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:05:29.436013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91cbe6-695d-4411-aaaa-fefe309039f6 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:29.436342 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91cbe6-695d-4411-aaaa-fefe309039f6 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:29.436621 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91cbe6-695d-4411-aaaa-fefe309039f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:29.526398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-2e91cbe6-695d-4411-aaaa-fefe309039f6 None None] MFA Rules not processed for user `e35e4972ca5547ca8abb304343bf1031`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:29.532175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2e91cbe6-695d-4411-aaaa-fefe309039f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:29.726297 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1806/3574] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:29.728466 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14bead3-3ffe-441d-b1e5-0f2e966fbb52 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:29.910099 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14bead3-3ffe-441d-b1e5-0f2e966fbb52 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:29.917902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2848a8cc-bbae-414c-9f0a-99a8ce473685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:29.918605 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848a8cc-bbae-414c-9f0a-99a8ce473685 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:29.918892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848a8cc-bbae-414c-9f0a-99a8ce473685 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:29.919169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848a8cc-bbae-414c-9f0a-99a8ce473685 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:29.919797 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2848a8cc-bbae-414c-9f0a-99a8ce473685 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:29.922009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2848a8cc-bbae-414c-9f0a-99a8ce473685 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:29.961229 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1769/3575] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:05:29 2022] POST /identity/v3/projects => generated 381 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:05:29.965690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91cbe6-695d-4411-aaaa-fefe309039f6 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:29.983526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91cbe6-695d-4411-aaaa-fefe309039f6 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:30.089092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:30.127697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da05a91-66e9-4721-87ab-08887f37db3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:30.128348 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da05a91-66e9-4721-87ab-08887f37db3a admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:30.128910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da05a91-66e9-4721-87ab-08887f37db3a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:30.129055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da05a91-66e9-4721-87ab-08887f37db3a admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:30.129748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da05a91-66e9-4721-87ab-08887f37db3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:30.132023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da05a91-66e9-4721-87ab-08887f37db3a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:30.174766 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1807/3576] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:05:29 2022] POST /identity/v3/users => generated 297 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:05:30.179504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2848a8cc-bbae-414c-9f0a-99a8ce473685 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:30.228302 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2848a8cc-bbae-414c-9f0a-99a8ce473685 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:30.240702 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c2b80-9748-491e-a444-fe3089b00d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:30.241787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c2b80-9748-491e-a444-fe3089b00d92 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:30.242360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c2b80-9748-491e-a444-fe3089b00d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:30.242977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c2b80-9748-491e-a444-fe3089b00d92 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:30.243864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c2b80-9748-491e-a444-fe3089b00d92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:30.246176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c2b80-9748-491e-a444-fe3089b00d92 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:30.266187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da05a91-66e9-4721-87ab-08887f37db3a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:30.279277 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1770/3577] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:05:30.285909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da05a91-66e9-4721-87ab-08887f37db3a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:30.293385 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f8084-338c-4530-aa49-00d3ed3d02a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:30.294244 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f8084-338c-4530-aa49-00d3ed3d02a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:30.294664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f8084-338c-4530-aa49-00d3ed3d02a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:30.295038 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f8084-338c-4530-aa49-00d3ed3d02a0 admin admin] PATH_INFO: `/v3/projects/5a4f5d6a71d9409a953437cf19f8c132/users/5ad41d521b58449eaecccf3eef81fd44/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:30.331334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f8084-338c-4530-aa49-00d3ed3d02a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a4f5d6a71d9409a953437cf19f8c132, user_id=5ad41d521b58449eaecccf3eef81fd44, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:30.337877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f8084-338c-4530-aa49-00d3ed3d02a0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:30.374864 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1808/3578] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:05:30 2022] PUT /identity/v3/projects/5a4f5d6a71d9409a953437cf19f8c132/users/5ad41d521b58449eaecccf3eef81fd44/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:05:30.377690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c2b80-9748-491e-a444-fe3089b00d92 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:30.395489 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c2b80-9748-491e-a444-fe3089b00d92 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:30.477446 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:30.551877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d168ab-232d-4d7a-a3f8-9bdd8cfa3ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:30.552705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d168ab-232d-4d7a-a3f8-9bdd8cfa3ccd admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:30.554227 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d168ab-232d-4d7a-a3f8-9bdd8cfa3ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:30.555050 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d168ab-232d-4d7a-a3f8-9bdd8cfa3ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:30.558837 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d168ab-232d-4d7a-a3f8-9bdd8cfa3ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:30.562521 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d168ab-232d-4d7a-a3f8-9bdd8cfa3ccd admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:30.580246 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1771/3579] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:05:30.584604 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f8084-338c-4530-aa49-00d3ed3d02a0 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:30.604056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f8084-338c-4530-aa49-00d3ed3d02a0 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:30.622071 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176c771-5c72-4d90-bde7-2fe5b92cf290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:30.622923 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176c771-5c72-4d90-bde7-2fe5b92cf290 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:30.623547 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176c771-5c72-4d90-bde7-2fe5b92cf290 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:30.623893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176c771-5c72-4d90-bde7-2fe5b92cf290 admin admin] PATH_INFO: `/v3/projects/5a4f5d6a71d9409a953437cf19f8c132/users/5ad41d521b58449eaecccf3eef81fd44/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:30.633863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176c771-5c72-4d90-bde7-2fe5b92cf290 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a4f5d6a71d9409a953437cf19f8c132, user_id=5ad41d521b58449eaecccf3eef81fd44, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:30.637987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176c771-5c72-4d90-bde7-2fe5b92cf290 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:30.684127 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1809/3580] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:05:30 2022] PUT /identity/v3/projects/5a4f5d6a71d9409a953437cf19f8c132/users/5ad41d521b58449eaecccf3eef81fd44/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:05:30.686746 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0db68-a5c6-4003-b11e-43bc9efe1177 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:30.687042 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0db68-a5c6-4003-b11e-43bc9efe1177 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:30.687324 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0db68-a5c6-4003-b11e-43bc9efe1177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:30.740673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-31e0db68-a5c6-4003-b11e-43bc9efe1177 None None] MFA Rules not processed for user `5ad41d521b58449eaecccf3eef81fd44`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:30.742221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-31e0db68-a5c6-4003-b11e-43bc9efe1177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:30.905147 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1772/3581] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:30 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:30.912034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176c771-5c72-4d90-bde7-2fe5b92cf290 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:30.914475 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a176c771-5c72-4d90-bde7-2fe5b92cf290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:31.098903 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176c771-5c72-4d90-bde7-2fe5b92cf290 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:31.116629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0513f3a-ad79-4fc9-b641-1865c9c1094c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:31.117265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0513f3a-ad79-4fc9-b641-1865c9c1094c service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:31.118799 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0513f3a-ad79-4fc9-b641-1865c9c1094c service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:31.119092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0513f3a-ad79-4fc9-b641-1865c9c1094c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:31.138008 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0513f3a-ad79-4fc9-b641-1865c9c1094c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:31.145213 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0513f3a-ad79-4fc9-b641-1865c9c1094c service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:31.171692 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1810/3582] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:05:30 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:05:31.195636 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dede0b-3374-47ca-b045-8156890fd155 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:31.195930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dede0b-3374-47ca-b045-8156890fd155 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:31.196215 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dede0b-3374-47ca-b045-8156890fd155 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:31.198043 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1773/3583] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 21:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 21:05:31.219928 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0513f3a-ad79-4fc9-b641-1865c9c1094c service nova] Authenticating service token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 21:05:31.243517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0513f3a-ad79-4fc9-b641-1865c9c1094c service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:31.263751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0513f3a-ad79-4fc9-b641-1865c9c1094c service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:31.276700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de686b26-96a3-4173-a054-c758a976eb2d tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ad41d521b58449eaecccf3eef81fd44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a4f5d6a71d9409a953437cf19f8c132', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:31.277648 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de686b26-96a3-4173-a054-c758a976eb2d tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:31.278144 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de686b26-96a3-4173-a054-c758a976eb2d tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:31.278651 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de686b26-96a3-4173-a054-c758a976eb2d tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] PATH_INFO: `/v3/projects/8482c922e64f40d4b95793ac70044614` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:31.280071 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de686b26-96a3-4173-a054-c758a976eb2d tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] RBAC: Authorizing `identity:get_project(project_id=8482c922e64f40d4b95793ac70044614)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:31.287391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de686b26-96a3-4173-a054-c758a976eb2d tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:31.301851 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1811/3584] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 21:05:31 2022] GET /identity/v3/projects/8482c922e64f40d4b95793ac70044614 => generated 383 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:05:31.375533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c789c-fed3-4079-9cc5-fa1e5cb54c8b None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:31.378317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c789c-fed3-4079-9cc5-fa1e5cb54c8b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:31.378925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c789c-fed3-4079-9cc5-fa1e5cb54c8b None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:31.380557 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1774/3585] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 21:05:31 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 21:05:31.387431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de686b26-96a3-4173-a054-c758a976eb2d tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Authenticating service token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 21:05:31.410430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de686b26-96a3-4173-a054-c758a976eb2d tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:31.431075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de686b26-96a3-4173-a054-c758a976eb2d tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:31.445193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802f1ca-f4bd-4ac7-b81b-7ae1390a16b8 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ad41d521b58449eaecccf3eef81fd44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a4f5d6a71d9409a953437cf19f8c132', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:31.445962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802f1ca-f4bd-4ac7-b81b-7ae1390a16b8 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:31.446470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802f1ca-f4bd-4ac7-b81b-7ae1390a16b8 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:31.446976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802f1ca-f4bd-4ac7-b81b-7ae1390a16b8 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] PATH_INFO: `/v3/projects/8482c922e64f40d4b95793ac70044614` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:31.448681 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f802f1ca-f4bd-4ac7-b81b-7ae1390a16b8 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] RBAC: Authorizing `identity:get_project(project_id=8482c922e64f40d4b95793ac70044614)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:31.455714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f802f1ca-f4bd-4ac7-b81b-7ae1390a16b8 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:31.461213 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1812/3586] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 21:05:31 2022] GET /identity/v3/projects/8482c922e64f40d4b95793ac70044614 => generated 383 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:05:31.643511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c031e87-0886-43c0-abb2-fd468bdb14bd None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:31.643511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c031e87-0886-43c0-abb2-fd468bdb14bd None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:31.644328 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c031e87-0886-43c0-abb2-fd468bdb14bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:31.692460 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-3c031e87-0886-43c0-abb2-fd468bdb14bd None None] MFA Rules not processed for user `e35e4972ca5547ca8abb304343bf1031`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:31.694570 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3c031e87-0886-43c0-abb2-fd468bdb14bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:31.845030 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1775/3587] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:31.857148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802f1ca-f4bd-4ac7-b81b-7ae1390a16b8 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:31.884161 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802f1ca-f4bd-4ac7-b81b-7ae1390a16b8 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:31.914204 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6977526-1fcc-48c6-bd41-0ff2e54bb4a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:31.915749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6977526-1fcc-48c6-bd41-0ff2e54bb4a5 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:31.916409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6977526-1fcc-48c6-bd41-0ff2e54bb4a5 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:31.917111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6977526-1fcc-48c6-bd41-0ff2e54bb4a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:31.943877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6977526-1fcc-48c6-bd41-0ff2e54bb4a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:31.948619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6977526-1fcc-48c6-bd41-0ff2e54bb4a5 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:31.975486 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1813/3588] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:05:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:05:33.497633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ea79c-c6c5-40e1-a8ce-84ff8802432f None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:33.499200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ea79c-c6c5-40e1-a8ce-84ff8802432f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:33.499747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ea79c-c6c5-40e1-a8ce-84ff8802432f None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:33.504778 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1776/3589] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 21:05:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 21:05:33.522663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6977526-1fcc-48c6-bd41-0ff2e54bb4a5 service nova] Authenticating service token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 21:05:33.540643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6977526-1fcc-48c6-bd41-0ff2e54bb4a5 service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:33.579398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6977526-1fcc-48c6-bd41-0ff2e54bb4a5 service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:33.591096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60226906-18cf-4a2c-9ddd-1120dfdf67e6 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ad41d521b58449eaecccf3eef81fd44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a4f5d6a71d9409a953437cf19f8c132', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:33.595398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60226906-18cf-4a2c-9ddd-1120dfdf67e6 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:33.596132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60226906-18cf-4a2c-9ddd-1120dfdf67e6 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:33.597363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60226906-18cf-4a2c-9ddd-1120dfdf67e6 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] PATH_INFO: `/v3/projects/8482c922e64f40d4b95793ac70044614` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:33.599076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60226906-18cf-4a2c-9ddd-1120dfdf67e6 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] RBAC: Authorizing `identity:get_project(project_id=8482c922e64f40d4b95793ac70044614)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:33.603241 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60226906-18cf-4a2c-9ddd-1120dfdf67e6 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:33.615087 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1814/3590] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 21:05:33 2022] GET /identity/v3/projects/8482c922e64f40d4b95793ac70044614 => generated 383 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:05:33.867546 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9d1e1-ded0-4cc3-a209-bbfcdfefc9fc None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:33.868085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9d1e1-ded0-4cc3-a209-bbfcdfefc9fc None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:33.868710 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9d1e1-ded0-4cc3-a209-bbfcdfefc9fc None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:33.870281 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1777/3591] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 21:05:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 21:05:33.886161 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60226906-18cf-4a2c-9ddd-1120dfdf67e6 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Authenticating service token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 21:05:33.931945 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60226906-18cf-4a2c-9ddd-1120dfdf67e6 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:34.031330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60226906-18cf-4a2c-9ddd-1120dfdf67e6 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:34.068785 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a61480-3d75-417b-8e4e-b4601965dd28 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ad41d521b58449eaecccf3eef81fd44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a4f5d6a71d9409a953437cf19f8c132', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:34.069460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a61480-3d75-417b-8e4e-b4601965dd28 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:34.070485 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a61480-3d75-417b-8e4e-b4601965dd28 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:34.070938 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a61480-3d75-417b-8e4e-b4601965dd28 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] PATH_INFO: `/v3/projects/8482c922e64f40d4b95793ac70044614` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:34.075664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a61480-3d75-417b-8e4e-b4601965dd28 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] RBAC: Authorizing `identity:get_project(project_id=8482c922e64f40d4b95793ac70044614)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:34.083742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a61480-3d75-417b-8e4e-b4601965dd28 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:34.089435 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1815/3592] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 21:05:33 2022] GET /identity/v3/projects/8482c922e64f40d4b95793ac70044614 => generated 383 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:05:34.175405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c4479-1cd9-4383-ab24-121ec87c5ca7 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:34.175998 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c4479-1cd9-4383-ab24-121ec87c5ca7 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:34.177262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c4479-1cd9-4383-ab24-121ec87c5ca7 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:34.179228 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1778/3593] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 21:05:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 21:05:34.191806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a61480-3d75-417b-8e4e-b4601965dd28 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Authenticating service token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 21:05:34.194655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-96a61480-3d75-417b-8e4e-b4601965dd28 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:34.287286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a61480-3d75-417b-8e4e-b4601965dd28 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:34.325432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a61480-3d75-417b-8e4e-b4601965dd28 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:34.332420 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2afaf-9ff3-41b7-8809-e969fd24d4c3 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ad41d521b58449eaecccf3eef81fd44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a4f5d6a71d9409a953437cf19f8c132', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:34.333328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2afaf-9ff3-41b7-8809-e969fd24d4c3 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:34.333784 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2afaf-9ff3-41b7-8809-e969fd24d4c3 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:34.334513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2afaf-9ff3-41b7-8809-e969fd24d4c3 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] PATH_INFO: `/v3/projects/8482c922e64f40d4b95793ac70044614` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:34.336175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c2afaf-9ff3-41b7-8809-e969fd24d4c3 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] RBAC: Authorizing `identity:get_project(project_id=8482c922e64f40d4b95793ac70044614)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:34.349601 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c2afaf-9ff3-41b7-8809-e969fd24d4c3 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:34.354107 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1816/3594] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 21:05:34 2022] GET /identity/v3/projects/8482c922e64f40d4b95793ac70044614 => generated 383 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:05:34.580318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347470c-9b76-4467-89ae-ca8ede5f8f40 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:34.581042 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347470c-9b76-4467-89ae-ca8ede5f8f40 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:34.581425 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347470c-9b76-4467-89ae-ca8ede5f8f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:34.618490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-c347470c-9b76-4467-89ae-ca8ede5f8f40 None None] MFA Rules not processed for user `e35e4972ca5547ca8abb304343bf1031`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:34.623999 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c347470c-9b76-4467-89ae-ca8ede5f8f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:34.644565 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1779/3595] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:34.899885 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13f18a-f7cc-4991-9968-defefed6dab3 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:34.901086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13f18a-f7cc-4991-9968-defefed6dab3 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:34.901664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13f18a-f7cc-4991-9968-defefed6dab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:34.991584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-5f13f18a-f7cc-4991-9968-defefed6dab3 None None] MFA Rules not processed for user `7dcd210e197347f8ad1622ee882bee92`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:34.999001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5f13f18a-f7cc-4991-9968-defefed6dab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:35.033316 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:35.256762 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1817/3596] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:35.276476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db609e56-1058-444b-9b5c-60a9ef0d9ed8 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:35.276895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db609e56-1058-444b-9b5c-60a9ef0d9ed8 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:35.277390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db609e56-1058-444b-9b5c-60a9ef0d9ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:35.359860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-db609e56-1058-444b-9b5c-60a9ef0d9ed8 None None] MFA Rules not processed for user `7dcd210e197347f8ad1622ee882bee92`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:35.363076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-db609e56-1058-444b-9b5c-60a9ef0d9ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:35.376555 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1780/3597] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:35.599799 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13f18a-f7cc-4991-9968-defefed6dab3 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:35.631843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13f18a-f7cc-4991-9968-defefed6dab3 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:35.661921 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77607cde-dfd5-4b87-9654-417572763451 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:35.662865 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77607cde-dfd5-4b87-9654-417572763451 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:35.663354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77607cde-dfd5-4b87-9654-417572763451 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:35.663779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77607cde-dfd5-4b87-9654-417572763451 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:35.699665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77607cde-dfd5-4b87-9654-417572763451 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:35.701756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77607cde-dfd5-4b87-9654-417572763451 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:35.729735 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1818/3598] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:05:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:05:36.192348 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002a355-01f6-4653-9b78-169f13b66d2c None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:36.192864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002a355-01f6-4653-9b78-169f13b66d2c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:36.192947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002a355-01f6-4653-9b78-169f13b66d2c None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:36.196676 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1781/3599] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 21:05:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 21:05:36.212741 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77607cde-dfd5-4b87-9654-417572763451 service nova] Authenticating service token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 21:05:36.238094 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77607cde-dfd5-4b87-9654-417572763451 service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:36.250222 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77607cde-dfd5-4b87-9654-417572763451 service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:36.255930 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ec3ce-4486-454e-b60e-cce77622bf24 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ad41d521b58449eaecccf3eef81fd44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a4f5d6a71d9409a953437cf19f8c132', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:36.256935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ec3ce-4486-454e-b60e-cce77622bf24 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:36.257347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ec3ce-4486-454e-b60e-cce77622bf24 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:36.257728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ec3ce-4486-454e-b60e-cce77622bf24 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] PATH_INFO: `/v3/projects/8482c922e64f40d4b95793ac70044614` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:36.259430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ec3ce-4486-454e-b60e-cce77622bf24 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] RBAC: Authorizing `identity:get_project(project_id=8482c922e64f40d4b95793ac70044614)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:36.281519 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ec3ce-4486-454e-b60e-cce77622bf24 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:36.300713 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1819/3600] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 21:05:36 2022] GET /identity/v3/projects/8482c922e64f40d4b95793ac70044614 => generated 383 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:05:36.502332 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd88372-661a-41d3-b11f-70ffafaee3e9 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:36.502949 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd88372-661a-41d3-b11f-70ffafaee3e9 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:36.503488 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd88372-661a-41d3-b11f-70ffafaee3e9 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:36.505561 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1782/3601] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 21:05:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 21:05:36.512946 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ec3ce-4486-454e-b60e-cce77622bf24 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Authenticating service token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 21:05:36.552606 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ec3ce-4486-454e-b60e-cce77622bf24 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:36.575245 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ec3ce-4486-454e-b60e-cce77622bf24 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:36.581754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83723b-d33a-48bb-801e-5bf1b6c66362 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ad41d521b58449eaecccf3eef81fd44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a4f5d6a71d9409a953437cf19f8c132', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:36.582826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83723b-d33a-48bb-801e-5bf1b6c66362 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:36.583346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83723b-d33a-48bb-801e-5bf1b6c66362 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:36.583846 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83723b-d33a-48bb-801e-5bf1b6c66362 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] PATH_INFO: `/v3/projects/8482c922e64f40d4b95793ac70044614` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:36.585595 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb83723b-d33a-48bb-801e-5bf1b6c66362 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] RBAC: Authorizing `identity:get_project(project_id=8482c922e64f40d4b95793ac70044614)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:36.588724 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb83723b-d33a-48bb-801e-5bf1b6c66362 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:36.590967 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1820/3602] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 21:05:36 2022] GET /identity/v3/projects/8482c922e64f40d4b95793ac70044614 => generated 383 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:05:36.879316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd88372-661a-41d3-b11f-70ffafaee3e9 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:36.881599 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-cbd88372-661a-41d3-b11f-70ffafaee3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:37.045812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:37.104356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd88372-661a-41d3-b11f-70ffafaee3e9 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:37.116325 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643a4b7-fb0d-487f-8b8d-be74cc70d472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:37.117066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643a4b7-fb0d-487f-8b8d-be74cc70d472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:37.118038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643a4b7-fb0d-487f-8b8d-be74cc70d472 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:37.123790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643a4b7-fb0d-487f-8b8d-be74cc70d472 admin admin] PATH_INFO: `/v3/users/1f9190aa4d52460f8636df2d87f11792` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:37.125204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3643a4b7-fb0d-487f-8b8d-be74cc70d472 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f9190aa4d52460f8636df2d87f11792)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:37.128200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3643a4b7-fb0d-487f-8b8d-be74cc70d472 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:37.195948 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91337c-463e-461e-ac5f-a8aba39f9edc None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:37.196231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91337c-463e-461e-ac5f-a8aba39f9edc None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:37.196509 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91337c-463e-461e-ac5f-a8aba39f9edc None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:37.198185 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1821/3603] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 21:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 21:05:37.209200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91337c-463e-461e-ac5f-a8aba39f9edc None None] Authenticating service token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 21:05:37.232847 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91337c-463e-461e-ac5f-a8aba39f9edc None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:37.234325 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3643a4b7-fb0d-487f-8b8d-be74cc70d472 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f9190aa4d52460f8636df2d87f11792'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:37.235221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3643a4b7-fb0d-487f-8b8d-be74cc70d472 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f9190aa4d52460f8636df2d87f11792'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:37.236361 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3643a4b7-fb0d-487f-8b8d-be74cc70d472 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f9190aa4d52460f8636df2d87f11792'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:37.250907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91337c-463e-461e-ac5f-a8aba39f9edc None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:37.253975 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3643a4b7-fb0d-487f-8b8d-be74cc70d472 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f9190aa4d52460f8636df2d87f11792'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:37.273714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93af9e-a839-4ef8-9b48-fd6dacdd6350 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ad41d521b58449eaecccf3eef81fd44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a4f5d6a71d9409a953437cf19f8c132', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:37.274794 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93af9e-a839-4ef8-9b48-fd6dacdd6350 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:37.275343 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93af9e-a839-4ef8-9b48-fd6dacdd6350 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:37.275893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93af9e-a839-4ef8-9b48-fd6dacdd6350 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] PATH_INFO: `/v3/projects/8482c922e64f40d4b95793ac70044614` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:37.278168 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd93af9e-a839-4ef8-9b48-fd6dacdd6350 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] RBAC: Authorizing `identity:get_project(project_id=8482c922e64f40d4b95793ac70044614)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:37.279070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3643a4b7-fb0d-487f-8b8d-be74cc70d472 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f9190aa4d52460f8636df2d87f11792'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:37.281898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd93af9e-a839-4ef8-9b48-fd6dacdd6350 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:37.284725 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1822/3604] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 21:05:37 2022] GET /identity/v3/projects/8482c922e64f40d4b95793ac70044614 => generated 383 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:05:37.317783 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1783/3605] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:05:36 2022] DELETE /identity/v3/users/1f9190aa4d52460f8636df2d87f11792 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:05:37.415748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c33c9-64f7-401b-995e-3277566dcbfa None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:37.417631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c33c9-64f7-401b-995e-3277566dcbfa None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:37.418343 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c33c9-64f7-401b-995e-3277566dcbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:37.498369 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-ec3c33c9-64f7-401b-995e-3277566dcbfa None None] MFA Rules not processed for user `e35e4972ca5547ca8abb304343bf1031`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:37.514091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ec3c33c9-64f7-401b-995e-3277566dcbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:37.617237 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1823/3606] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:37.649912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643a4b7-fb0d-487f-8b8d-be74cc70d472 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:37.652326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3643a4b7-fb0d-487f-8b8d-be74cc70d472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:37.758718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643a4b7-fb0d-487f-8b8d-be74cc70d472 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:37.764276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2978d51-d8c3-4fee-8892-2baeabd2aa46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:37.765244 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2978d51-d8c3-4fee-8892-2baeabd2aa46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:37.765703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2978d51-d8c3-4fee-8892-2baeabd2aa46 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:37.766128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2978d51-d8c3-4fee-8892-2baeabd2aa46 admin admin] PATH_INFO: `/v3/users/a7e47a63c2e64d3584e044fae0fe2270` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:37.768153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2978d51-d8c3-4fee-8892-2baeabd2aa46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7e47a63c2e64d3584e044fae0fe2270)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:37.770408 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2978d51-d8c3-4fee-8892-2baeabd2aa46 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:37.848258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c2978d51-d8c3-4fee-8892-2baeabd2aa46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7e47a63c2e64d3584e044fae0fe2270'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:37.851130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c2978d51-d8c3-4fee-8892-2baeabd2aa46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7e47a63c2e64d3584e044fae0fe2270'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:37.852130 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c33c9-64f7-401b-995e-3277566dcbfa None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:37.852506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c2978d51-d8c3-4fee-8892-2baeabd2aa46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7e47a63c2e64d3584e044fae0fe2270'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:37.855183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ec3c33c9-64f7-401b-995e-3277566dcbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:37.866798 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c2978d51-d8c3-4fee-8892-2baeabd2aa46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7e47a63c2e64d3584e044fae0fe2270'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:37.880076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:37.886954 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c2978d51-d8c3-4fee-8892-2baeabd2aa46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7e47a63c2e64d3584e044fae0fe2270'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:37.894225 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c33c9-64f7-401b-995e-3277566dcbfa None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:37.906173 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1784/3607] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:05:37 2022] DELETE /identity/v3/users/a7e47a63c2e64d3584e044fae0fe2270 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:05:37.907779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b195b-ed40-4370-8000-62cf42c93c74 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:37.911256 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b195b-ed40-4370-8000-62cf42c93c74 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:37.911256 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b195b-ed40-4370-8000-62cf42c93c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:37.914062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e058183-a5f2-485f-8ddf-adb9da88061f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:37.914898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e058183-a5f2-485f-8ddf-adb9da88061f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:37.915091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e058183-a5f2-485f-8ddf-adb9da88061f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:37.915462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e058183-a5f2-485f-8ddf-adb9da88061f admin admin] PATH_INFO: `/v3/projects/92692c7d7d124e3599b2e764da8415ef` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:37.919341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e058183-a5f2-485f-8ddf-adb9da88061f admin admin] RBAC: Authorizing `identity:delete_project(project_id=92692c7d7d124e3599b2e764da8415ef)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:37.926295 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e058183-a5f2-485f-8ddf-adb9da88061f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:38.002498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-976b195b-ed40-4370-8000-62cf42c93c74 None None] MFA Rules not processed for user `e0943fdb586241b796e349e08c778f28`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:38.003869 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-976b195b-ed40-4370-8000-62cf42c93c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:38.128779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1e058183-a5f2-485f-8ddf-adb9da88061f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92692c7d7d124e3599b2e764da8415ef', 'request_id': 'req-1e058183-a5f2-485f-8ddf-adb9da88061f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:38.150150 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1e058183-a5f2-485f-8ddf-adb9da88061f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92692c7d7d124e3599b2e764da8415ef', 'request_id': 'req-1e058183-a5f2-485f-8ddf-adb9da88061f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:38.168293 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1e058183-a5f2-485f-8ddf-adb9da88061f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92692c7d7d124e3599b2e764da8415ef', 'request_id': 'req-1e058183-a5f2-485f-8ddf-adb9da88061f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:38.169814 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:38.193648 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1e058183-a5f2-485f-8ddf-adb9da88061f admin admin] The token cache is being invalidate because project 92692c7d7d124e3599b2e764da8415ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:05:38.193941 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1e058183-a5f2-485f-8ddf-adb9da88061f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:38.196863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1e058183-a5f2-485f-8ddf-adb9da88061f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:38.201406 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1824/3608] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:05:37 2022] DELETE /identity/v3/projects/92692c7d7d124e3599b2e764da8415ef => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:05:38.206514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf90d6-27d5-454d-8d35-cd8d827d8bd6 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:38.208084 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1785/3609] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:37 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:38.218307 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf90d6-27d5-454d-8d35-cd8d827d8bd6 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:38.219887 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4cbe69-03ce-4aab-ba00-f1a730f037a8 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:38.220929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4cbe69-03ce-4aab-ba00-f1a730f037a8 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:38.221767 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4cbe69-03ce-4aab-ba00-f1a730f037a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:38.222905 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf90d6-27d5-454d-8d35-cd8d827d8bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:38.255722 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-de4cbe69-03ce-4aab-ba00-f1a730f037a8 None None] MFA Rules not processed for user `e0943fdb586241b796e349e08c778f28`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:38.257860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-de4cbe69-03ce-4aab-ba00-f1a730f037a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:38.266208 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-93bf90d6-27d5-454d-8d35-cd8d827d8bd6 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:38.268146 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-93bf90d6-27d5-454d-8d35-cd8d827d8bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:38.357501 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1825/3610] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:38.360693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef8035-fbe8-42c1-b1d9-3c9d7250bad9 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:38.361602 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef8035-fbe8-42c1-b1d9-3c9d7250bad9 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:38.361989 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef8035-fbe8-42c1-b1d9-3c9d7250bad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:38.402831 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1786/3611] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:05:38.405448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-07ef8035-fbe8-42c1-b1d9-3c9d7250bad9 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:38.406827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-07ef8035-fbe8-42c1-b1d9-3c9d7250bad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:38.423543 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1826/3612] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:38.427587 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4cbe69-03ce-4aab-ba00-f1a730f037a8 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:38.442747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4cbe69-03ce-4aab-ba00-f1a730f037a8 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:38.450473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd5610-7715-401a-bf0c-629db32bd48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:38.451379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd5610-7715-401a-bf0c-629db32bd48e admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:38.451842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd5610-7715-401a-bf0c-629db32bd48e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:38.452275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd5610-7715-401a-bf0c-629db32bd48e admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:38.455929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd5610-7715-401a-bf0c-629db32bd48e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:05:38.456267 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd5610-7715-401a-bf0c-629db32bd48e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:38.458262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd5610-7715-401a-bf0c-629db32bd48e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:38.486937 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1787/3613] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:05:38.491342 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef8035-fbe8-42c1-b1d9-3c9d7250bad9 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:38.506942 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef8035-fbe8-42c1-b1d9-3c9d7250bad9 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:38.514052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac01aa-3cb8-430d-8840-c5e425a8341d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:38.514781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac01aa-3cb8-430d-8840-c5e425a8341d admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:38.514966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac01aa-3cb8-430d-8840-c5e425a8341d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:38.515439 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac01aa-3cb8-430d-8840-c5e425a8341d admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:38.516236 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac01aa-3cb8-430d-8840-c5e425a8341d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:38.518745 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac01aa-3cb8-430d-8840-c5e425a8341d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:38.571515 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1827/3614] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:05:38 2022] POST /identity/v3/projects => generated 411 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:05:38.576794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd5610-7715-401a-bf0c-629db32bd48e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:38.579344 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d9cd5610-7715-401a-bf0c-629db32bd48e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:38.586849 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac01aa-3cb8-430d-8840-c5e425a8341d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:38.809951 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:38.820452 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac01aa-3cb8-430d-8840-c5e425a8341d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:38.829085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd5610-7715-401a-bf0c-629db32bd48e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:38.831353 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb850087-1836-43cd-a129-fdca22ecf52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:38.831990 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb850087-1836-43cd-a129-fdca22ecf52b admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:38.832276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb850087-1836-43cd-a129-fdca22ecf52b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:38.832542 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb850087-1836-43cd-a129-fdca22ecf52b admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:38.833527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb850087-1836-43cd-a129-fdca22ecf52b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:38.835745 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb850087-1836-43cd-a129-fdca22ecf52b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:38.888609 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1828/3615] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:05:38 2022] POST /identity/v3/users => generated 306 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:05:38.888609 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb850087-1836-43cd-a129-fdca22ecf52b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:38.890344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-cb850087-1836-43cd-a129-fdca22ecf52b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:38.919873 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb850087-1836-43cd-a129-fdca22ecf52b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:38.933393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8147fd-3b9c-43e5-81aa-9cf50e3f7488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:38.933393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8147fd-3b9c-43e5-81aa-9cf50e3f7488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:38.933393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8147fd-3b9c-43e5-81aa-9cf50e3f7488 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:38.933393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8147fd-3b9c-43e5-81aa-9cf50e3f7488 admin admin] PATH_INFO: `/v3/projects/609ccfef33a94ae0ab5e082095e7ab1e` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:38.934838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8147fd-3b9c-43e5-81aa-9cf50e3f7488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=609ccfef33a94ae0ab5e082095e7ab1e)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:38.936780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8147fd-3b9c-43e5-81aa-9cf50e3f7488 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:39.032857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e66265-85fb-4c28-9c61-9fd1227b051d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:39.033504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e66265-85fb-4c28-9c61-9fd1227b051d service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:39.033790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e66265-85fb-4c28-9c61-9fd1227b051d service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:39.034402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e66265-85fb-4c28-9c61-9fd1227b051d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:39.039792 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c8e66265-85fb-4c28-9c61-9fd1227b051d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:39.048282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dd8147fd-3b9c-43e5-81aa-9cf50e3f7488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '609ccfef33a94ae0ab5e082095e7ab1e', 'request_id': 'req-dd8147fd-3b9c-43e5-81aa-9cf50e3f7488'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:39.050914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:39.064132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dd8147fd-3b9c-43e5-81aa-9cf50e3f7488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '609ccfef33a94ae0ab5e082095e7ab1e', 'request_id': 'req-dd8147fd-3b9c-43e5-81aa-9cf50e3f7488'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:39.077739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dd8147fd-3b9c-43e5-81aa-9cf50e3f7488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '609ccfef33a94ae0ab5e082095e7ab1e', 'request_id': 'req-dd8147fd-3b9c-43e5-81aa-9cf50e3f7488'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:39.108691 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dd8147fd-3b9c-43e5-81aa-9cf50e3f7488 admin admin] The token cache is being invalidate because project 609ccfef33a94ae0ab5e082095e7ab1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:05:39.109020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dd8147fd-3b9c-43e5-81aa-9cf50e3f7488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:39.118629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dd8147fd-3b9c-43e5-81aa-9cf50e3f7488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:39.123913 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1829/3616] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:05:38 2022] DELETE /identity/v3/projects/609ccfef33a94ae0ab5e082095e7ab1e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:05:39.123913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8147fd-3b9c-43e5-81aa-9cf50e3f7488 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:39.123913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-dd8147fd-3b9c-43e5-81aa-9cf50e3f7488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:39.165063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e66265-85fb-4c28-9c61-9fd1227b051d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:39.169640 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e66265-85fb-4c28-9c61-9fd1227b051d service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:39.196420 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1788/3617] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:05:38 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:05:39.200831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637b371-bb28-48b6-9973-aa3a7b3ddd81 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:39.201499 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637b371-bb28-48b6-9973-aa3a7b3ddd81 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:39.202024 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637b371-bb28-48b6-9973-aa3a7b3ddd81 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:39.203741 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1789/3618] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 21:05:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 21:05:39.207856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20663896-33e5-4379-943b-192c282fe2e1 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:39.208692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20663896-33e5-4379-943b-192c282fe2e1 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:39.209930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20663896-33e5-4379-943b-192c282fe2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:39.253589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-20663896-33e5-4379-943b-192c282fe2e1 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:39.259372 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8147fd-3b9c-43e5-81aa-9cf50e3f7488 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:39.259883 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-20663896-33e5-4379-943b-192c282fe2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:39.276449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422ede7-76b5-4816-b320-67c9b3a0a420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:39.277700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422ede7-76b5-4816-b320-67c9b3a0a420 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:39.277700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422ede7-76b5-4816-b320-67c9b3a0a420 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:39.277700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422ede7-76b5-4816-b320-67c9b3a0a420 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:39.278010 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422ede7-76b5-4816-b320-67c9b3a0a420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:39.279665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422ede7-76b5-4816-b320-67c9b3a0a420 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:39.284203 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1790/3619] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:39.285448 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20663896-33e5-4379-943b-192c282fe2e1 None None] Authenticating service token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 21:05:39.290468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-20663896-33e5-4379-943b-192c282fe2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:39.304092 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1830/3620] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:05:39.307942 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa295bb-e96a-4bdb-b1f8-02d43588a145 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:39.310912 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa295bb-e96a-4bdb-b1f8-02d43588a145 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:39.311358 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa295bb-e96a-4bdb-b1f8-02d43588a145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:39.363755 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-9fa295bb-e96a-4bdb-b1f8-02d43588a145 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:39.365009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9fa295bb-e96a-4bdb-b1f8-02d43588a145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:39.377551 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1831/3621] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:39.378625 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa295bb-e96a-4bdb-b1f8-02d43588a145 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:39.400511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa295bb-e96a-4bdb-b1f8-02d43588a145 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:39.410180 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c5771-cea8-4d63-ae2c-0c389a405bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:39.411090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c5771-cea8-4d63-ae2c-0c389a405bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:39.411528 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c5771-cea8-4d63-ae2c-0c389a405bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:39.411968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c5771-cea8-4d63-ae2c-0c389a405bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:39.412782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c5771-cea8-4d63-ae2c-0c389a405bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:39.414593 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c5771-cea8-4d63-ae2c-0c389a405bd1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:39.441156 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1832/3622] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:05:39.442156 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c5771-cea8-4d63-ae2c-0c389a405bd1 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:39.470599 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20663896-33e5-4379-943b-192c282fe2e1 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:39.473818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c5771-cea8-4d63-ae2c-0c389a405bd1 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:39.474782 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-20663896-33e5-4379-943b-192c282fe2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:39.487643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898acfe-af7c-4015-a6be-552855a376b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:39.488598 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898acfe-af7c-4015-a6be-552855a376b4 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:39.489048 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898acfe-af7c-4015-a6be-552855a376b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:39.489501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898acfe-af7c-4015-a6be-552855a376b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:39.490340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c898acfe-af7c-4015-a6be-552855a376b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:05:39.490955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c898acfe-af7c-4015-a6be-552855a376b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:39.492874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c898acfe-af7c-4015-a6be-552855a376b4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:39.530319 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1833/3623] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:05:39.531477 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898acfe-af7c-4015-a6be-552855a376b4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:39.544703 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898acfe-af7c-4015-a6be-552855a376b4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:39.554067 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:39.567464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc61c3-3fc6-48cc-8107-4142815428bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:39.568410 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc61c3-3fc6-48cc-8107-4142815428bf admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:39.568847 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc61c3-3fc6-48cc-8107-4142815428bf admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:39.569278 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc61c3-3fc6-48cc-8107-4142815428bf admin admin] PATH_INFO: `/v3/projects/64300b6685d7478f8bfa92c2d6eb91d6/users/10b30a7d1ce94193970bdc076d481578/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:39.611774 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc61c3-3fc6-48cc-8107-4142815428bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=64300b6685d7478f8bfa92c2d6eb91d6, user_id=10b30a7d1ce94193970bdc076d481578, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:39.615868 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc61c3-3fc6-48cc-8107-4142815428bf admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:39.636380 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1834/3624] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:05:39 2022] PUT /identity/v3/projects/64300b6685d7478f8bfa92c2d6eb91d6/users/10b30a7d1ce94193970bdc076d481578/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:05:39.639930 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc61c3-3fc6-48cc-8107-4142815428bf admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:39.655918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20663896-33e5-4379-943b-192c282fe2e1 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:39.794355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ade91f-3de6-4f3e-a7cd-0ae7266404d5 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ad41d521b58449eaecccf3eef81fd44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a4f5d6a71d9409a953437cf19f8c132', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:39.795045 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ade91f-3de6-4f3e-a7cd-0ae7266404d5 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:39.795320 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ade91f-3de6-4f3e-a7cd-0ae7266404d5 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:39.795643 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ade91f-3de6-4f3e-a7cd-0ae7266404d5 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] PATH_INFO: `/v3/projects/8482c922e64f40d4b95793ac70044614` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:39.797193 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ade91f-3de6-4f3e-a7cd-0ae7266404d5 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] RBAC: Authorizing `identity:get_project(project_id=8482c922e64f40d4b95793ac70044614)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:39.802307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ade91f-3de6-4f3e-a7cd-0ae7266404d5 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:39.804410 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1791/3625] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 21:05:39 2022] GET /identity/v3/projects/8482c922e64f40d4b95793ac70044614 => generated 383 bytes in 520 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:05:39.809384 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e31f8-3229-42af-95ff-1e14c2427d3e None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:39.809384 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e31f8-3229-42af-95ff-1e14c2427d3e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:39.809384 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e31f8-3229-42af-95ff-1e14c2427d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:39.863901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc61c3-3fc6-48cc-8107-4142815428bf admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:39.870560 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d41e31f8-3229-42af-95ff-1e14c2427d3e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:39.872441 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d41e31f8-3229-42af-95ff-1e14c2427d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:39.878110 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19cc5e-132c-4680-a699-39edb0a8e60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:39.878773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19cc5e-132c-4680-a699-39edb0a8e60a admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:39.879142 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19cc5e-132c-4680-a699-39edb0a8e60a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:39.879422 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19cc5e-132c-4680-a699-39edb0a8e60a admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:39.880053 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a19cc5e-132c-4680-a699-39edb0a8e60a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:39.882003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a19cc5e-132c-4680-a699-39edb0a8e60a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:39.895836 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1792/3626] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:39.907800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e31f8-3229-42af-95ff-1e14c2427d3e None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:39.913833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d41e31f8-3229-42af-95ff-1e14c2427d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:39.973469 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1835/3627] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:05:39 2022] POST /identity/v3/projects => generated 379 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:05:39.977468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19cc5e-132c-4680-a699-39edb0a8e60a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:39.994737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:40.087884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e31f8-3229-42af-95ff-1e14c2427d3e None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:40.201099 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19cc5e-132c-4680-a699-39edb0a8e60a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:40.216765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935df08-d1ff-4bc5-8ce1-5d43584e0af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:40.217416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935df08-d1ff-4bc5-8ce1-5d43584e0af8 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:40.217707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935df08-d1ff-4bc5-8ce1-5d43584e0af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:40.217985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935df08-d1ff-4bc5-8ce1-5d43584e0af8 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:40.225543 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f935df08-d1ff-4bc5-8ce1-5d43584e0af8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:40.230452 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f935df08-d1ff-4bc5-8ce1-5d43584e0af8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:40.296184 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1836/3628] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:05:39 2022] POST /identity/v3/users => generated 290 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:05:40.296827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935df08-d1ff-4bc5-8ce1-5d43584e0af8 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:40.310316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7df278-bfbd-42e8-b856-c4b2a48a01ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:40.311281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7df278-bfbd-42e8-b856-c4b2a48a01ce service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:40.311567 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7df278-bfbd-42e8-b856-c4b2a48a01ce service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:40.311838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7df278-bfbd-42e8-b856-c4b2a48a01ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:40.330763 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7df278-bfbd-42e8-b856-c4b2a48a01ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:40.332427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935df08-d1ff-4bc5-8ce1-5d43584e0af8 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:40.339240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7df278-bfbd-42e8-b856-c4b2a48a01ce service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:40.347932 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20505e89-9a47-469f-9a38-50dc4f79c310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:40.349799 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20505e89-9a47-469f-9a38-50dc4f79c310 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:40.350082 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20505e89-9a47-469f-9a38-50dc4f79c310 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:40.350361 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20505e89-9a47-469f-9a38-50dc4f79c310 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:40.352658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20505e89-9a47-469f-9a38-50dc4f79c310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:40.359957 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20505e89-9a47-469f-9a38-50dc4f79c310 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:40.374293 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1793/3629] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:05:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:05:40.398610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7df278-bfbd-42e8-b856-c4b2a48a01ce service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:40.399559 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1837/3630] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:05:40.435004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7df278-bfbd-42e8-b856-c4b2a48a01ce service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:40.449613 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c0fc2-9240-4408-b3fd-0cc618c24835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:40.450254 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c0fc2-9240-4408-b3fd-0cc618c24835 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:40.450634 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c0fc2-9240-4408-b3fd-0cc618c24835 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:40.453189 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c0fc2-9240-4408-b3fd-0cc618c24835 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:40.453963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c0fc2-9240-4408-b3fd-0cc618c24835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:40.457526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c0fc2-9240-4408-b3fd-0cc618c24835 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:40.483673 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1794/3631] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:05:40.487638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20505e89-9a47-469f-9a38-50dc4f79c310 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:40.507707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20505e89-9a47-469f-9a38-50dc4f79c310 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:40.549459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3252b-fe8e-44df-9dc4-3cccba585d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:40.554196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3252b-fe8e-44df-9dc4-3cccba585d18 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:40.554536 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3252b-fe8e-44df-9dc4-3cccba585d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:40.562226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3252b-fe8e-44df-9dc4-3cccba585d18 admin admin] PATH_INFO: `/v3/projects/fe2ae1b1c16d4dedb2585dde7dab8113/users/bdf1b5180a814cf39234892c6c1f26df/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:40.642057 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b3252b-fe8e-44df-9dc4-3cccba585d18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe2ae1b1c16d4dedb2585dde7dab8113, user_id=bdf1b5180a814cf39234892c6c1f26df, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:40.650124 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b3252b-fe8e-44df-9dc4-3cccba585d18 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:40.742296 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1838/3632] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:05:40 2022] PUT /identity/v3/projects/fe2ae1b1c16d4dedb2585dde7dab8113/users/bdf1b5180a814cf39234892c6c1f26df/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:05:40.748426 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c46d3b-69fe-46a5-9373-4c8bd5716909 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:40.749044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c46d3b-69fe-46a5-9373-4c8bd5716909 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:40.749627 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c46d3b-69fe-46a5-9373-4c8bd5716909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:40.779667 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3252b-fe8e-44df-9dc4-3cccba585d18 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:40.784537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a6b3252b-fe8e-44df-9dc4-3cccba585d18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:40.821872 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-02c46d3b-69fe-46a5-9373-4c8bd5716909 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:40.826503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-02c46d3b-69fe-46a5-9373-4c8bd5716909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:40.870211 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:40.977141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3252b-fe8e-44df-9dc4-3cccba585d18 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:40.988015 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1795/3633] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:40.988790 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22ec07-2fc9-4717-b70d-3fc01a896545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:40.989443 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22ec07-2fc9-4717-b70d-3fc01a896545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:40.989763 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22ec07-2fc9-4717-b70d-3fc01a896545 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:40.989983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22ec07-2fc9-4717-b70d-3fc01a896545 admin admin] PATH_INFO: `/v3/users/e35e4972ca5547ca8abb304343bf1031` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:40.997989 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22ec07-2fc9-4717-b70d-3fc01a896545 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e35e4972ca5547ca8abb304343bf1031)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:41.008583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22ec07-2fc9-4717-b70d-3fc01a896545 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:41.023818 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c46d3b-69fe-46a5-9373-4c8bd5716909 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:41.153757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ae22ec07-2fc9-4717-b70d-3fc01a896545 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e35e4972ca5547ca8abb304343bf1031'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:41.171211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ae22ec07-2fc9-4717-b70d-3fc01a896545 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e35e4972ca5547ca8abb304343bf1031'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:41.174187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ae22ec07-2fc9-4717-b70d-3fc01a896545 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e35e4972ca5547ca8abb304343bf1031'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:41.174983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ae22ec07-2fc9-4717-b70d-3fc01a896545 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e35e4972ca5547ca8abb304343bf1031'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:41.185733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:41.196186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ae22ec07-2fc9-4717-b70d-3fc01a896545 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e35e4972ca5547ca8abb304343bf1031'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:41.253740 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1839/3634] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:05:40 2022] DELETE /identity/v3/users/e35e4972ca5547ca8abb304343bf1031 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:05:41.256700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c46d3b-69fe-46a5-9373-4c8bd5716909 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:41.258179 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15bc9d-8e6a-4a0a-9504-bcd9ccaf423b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:41.258437 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15bc9d-8e6a-4a0a-9504-bcd9ccaf423b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:41.259301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15bc9d-8e6a-4a0a-9504-bcd9ccaf423b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:41.309088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-3f15bc9d-8e6a-4a0a-9504-bcd9ccaf423b None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:41.309943 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3f15bc9d-8e6a-4a0a-9504-bcd9ccaf423b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:41.431436 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3246e3-1519-43a7-b8fe-ead9e1c606d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:41.432725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3246e3-1519-43a7-b8fe-ead9e1c606d1 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:41.433010 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3246e3-1519-43a7-b8fe-ead9e1c606d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:41.433294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3246e3-1519-43a7-b8fe-ead9e1c606d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:41.444429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9a3246e3-1519-43a7-b8fe-ead9e1c606d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:41.487437 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1840/3635] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:41.503441 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15bc9d-8e6a-4a0a-9504-bcd9ccaf423b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:41.505267 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3f15bc9d-8e6a-4a0a-9504-bcd9ccaf423b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:41.527951 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15bc9d-8e6a-4a0a-9504-bcd9ccaf423b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:41.550850 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d62ca-e167-4e9c-9bac-e32874fb94b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:41.551909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d62ca-e167-4e9c-9bac-e32874fb94b4 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:41.552427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d62ca-e167-4e9c-9bac-e32874fb94b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:41.552956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d62ca-e167-4e9c-9bac-e32874fb94b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:41.583984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d62ca-e167-4e9c-9bac-e32874fb94b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:41.588857 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d62ca-e167-4e9c-9bac-e32874fb94b4 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:41.614631 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1841/3636] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:05:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:05:41.675554 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3246e3-1519-43a7-b8fe-ead9e1c606d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:41.677910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3246e3-1519-43a7-b8fe-ead9e1c606d1 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:41.706905 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1796/3637] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:05:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 683 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:05:43.974184 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d62ca-e167-4e9c-9bac-e32874fb94b4 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:43.977087 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-626d62ca-e167-4e9c-9bac-e32874fb94b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:44.003364 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d62ca-e167-4e9c-9bac-e32874fb94b4 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:44.014463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d5b04-f9ba-4e20-97d0-054c2470cead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:44.015568 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d5b04-f9ba-4e20-97d0-054c2470cead admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:44.016076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d5b04-f9ba-4e20-97d0-054c2470cead admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:44.016756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d5b04-f9ba-4e20-97d0-054c2470cead admin admin] PATH_INFO: `/v3/projects/8482c922e64f40d4b95793ac70044614` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:44.026867 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d5b04-f9ba-4e20-97d0-054c2470cead admin admin] RBAC: Authorizing `identity:delete_project(project_id=8482c922e64f40d4b95793ac70044614)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:44.029149 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d5b04-f9ba-4e20-97d0-054c2470cead admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:44.159188 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-524d5b04-f9ba-4e20-97d0-054c2470cead admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8482c922e64f40d4b95793ac70044614', 'request_id': 'req-524d5b04-f9ba-4e20-97d0-054c2470cead'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:44.180029 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-524d5b04-f9ba-4e20-97d0-054c2470cead admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8482c922e64f40d4b95793ac70044614', 'request_id': 'req-524d5b04-f9ba-4e20-97d0-054c2470cead'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:44.195108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-524d5b04-f9ba-4e20-97d0-054c2470cead admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8482c922e64f40d4b95793ac70044614', 'request_id': 'req-524d5b04-f9ba-4e20-97d0-054c2470cead'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:44.216015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-524d5b04-f9ba-4e20-97d0-054c2470cead admin admin] The token cache is being invalidate because project 8482c922e64f40d4b95793ac70044614 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:05:44.216343 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-524d5b04-f9ba-4e20-97d0-054c2470cead admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:44.220093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-524d5b04-f9ba-4e20-97d0-054c2470cead admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:44.228151 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1842/3638] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:05:43 2022] DELETE /identity/v3/projects/8482c922e64f40d4b95793ac70044614 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:05:44.230733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3246e3-1519-43a7-b8fe-ead9e1c606d1 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:44.246263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3246e3-1519-43a7-b8fe-ead9e1c606d1 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:44.301146 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:44.369747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab632f8e-0ea6-42ca-ab0d-45ced59f9f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:44.371178 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab632f8e-0ea6-42ca-ab0d-45ced59f9f72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:44.371666 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab632f8e-0ea6-42ca-ab0d-45ced59f9f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:44.372105 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab632f8e-0ea6-42ca-ab0d-45ced59f9f72 admin admin] PATH_INFO: `/v3/users/5ad41d521b58449eaecccf3eef81fd44` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:44.374208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab632f8e-0ea6-42ca-ab0d-45ced59f9f72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ad41d521b58449eaecccf3eef81fd44)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:44.377577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab632f8e-0ea6-42ca-ab0d-45ced59f9f72 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:44.462454 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ab632f8e-0ea6-42ca-ab0d-45ced59f9f72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ad41d521b58449eaecccf3eef81fd44'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:44.464137 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ab632f8e-0ea6-42ca-ab0d-45ced59f9f72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ad41d521b58449eaecccf3eef81fd44'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:44.465481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ab632f8e-0ea6-42ca-ab0d-45ced59f9f72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ad41d521b58449eaecccf3eef81fd44'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:44.482371 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ab632f8e-0ea6-42ca-ab0d-45ced59f9f72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ad41d521b58449eaecccf3eef81fd44'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:44.507018 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ab632f8e-0ea6-42ca-ab0d-45ced59f9f72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ad41d521b58449eaecccf3eef81fd44'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:44.529737 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1797/3639] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:05:44 2022] DELETE /identity/v3/users/5ad41d521b58449eaecccf3eef81fd44 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:05:44.575766 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d5b04-f9ba-4e20-97d0-054c2470cead admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:44.577915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-524d5b04-f9ba-4e20-97d0-054c2470cead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:44.651390 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:44.718268 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d5b04-f9ba-4e20-97d0-054c2470cead admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:44.882341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d83d1-406a-4017-a96e-112e656013ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:44.883872 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d83d1-406a-4017-a96e-112e656013ca service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:44.883872 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d83d1-406a-4017-a96e-112e656013ca service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:44.883872 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d83d1-406a-4017-a96e-112e656013ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:44.888932 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-da3d83d1-406a-4017-a96e-112e656013ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:44.999425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d83d1-406a-4017-a96e-112e656013ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:45.002227 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d83d1-406a-4017-a96e-112e656013ca service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:45.017025 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1843/3640] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:05:44 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:05:46.419292 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab632f8e-0ea6-42ca-ab0d-45ced59f9f72 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:46.422904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ab632f8e-0ea6-42ca-ab0d-45ced59f9f72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:46.622473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab632f8e-0ea6-42ca-ab0d-45ced59f9f72 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:46.631539 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef26119-3b95-4b1c-bdc7-ba5e2f366e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:46.636988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef26119-3b95-4b1c-bdc7-ba5e2f366e7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:46.637628 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef26119-3b95-4b1c-bdc7-ba5e2f366e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:46.638056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef26119-3b95-4b1c-bdc7-ba5e2f366e7e admin admin] PATH_INFO: `/v3/projects/5a4f5d6a71d9409a953437cf19f8c132` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:46.644327 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef26119-3b95-4b1c-bdc7-ba5e2f366e7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a4f5d6a71d9409a953437cf19f8c132)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:46.655221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef26119-3b95-4b1c-bdc7-ba5e2f366e7e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:46.796431 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:46.800523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5ef26119-3b95-4b1c-bdc7-ba5e2f366e7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a4f5d6a71d9409a953437cf19f8c132', 'request_id': 'req-5ef26119-3b95-4b1c-bdc7-ba5e2f366e7e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:46.824250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5ef26119-3b95-4b1c-bdc7-ba5e2f366e7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a4f5d6a71d9409a953437cf19f8c132', 'request_id': 'req-5ef26119-3b95-4b1c-bdc7-ba5e2f366e7e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:46.837644 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5ef26119-3b95-4b1c-bdc7-ba5e2f366e7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a4f5d6a71d9409a953437cf19f8c132', 'request_id': 'req-5ef26119-3b95-4b1c-bdc7-ba5e2f366e7e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:46.877269 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5ef26119-3b95-4b1c-bdc7-ba5e2f366e7e admin admin] The token cache is being invalidate because project 5a4f5d6a71d9409a953437cf19f8c132 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:05:46.877563 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5ef26119-3b95-4b1c-bdc7-ba5e2f366e7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:46.880231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5ef26119-3b95-4b1c-bdc7-ba5e2f366e7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:46.882442 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1798/3641] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:05:46 2022] DELETE /identity/v3/projects/5a4f5d6a71d9409a953437cf19f8c132 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:05:46.894012 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616d776-fde5-43fc-9ba8-5233c8556f78 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:46.894516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616d776-fde5-43fc-9ba8-5233c8556f78 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:46.894640 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616d776-fde5-43fc-9ba8-5233c8556f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:46.932647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-7616d776-fde5-43fc-9ba8-5233c8556f78 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:46.933897 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7616d776-fde5-43fc-9ba8-5233c8556f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:47.080866 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1844/3642] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:47.089502 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83bc51-b854-4dc7-a4e6-dd382ce3ad28 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:47.089826 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83bc51-b854-4dc7-a4e6-dd382ce3ad28 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:47.090124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83bc51-b854-4dc7-a4e6-dd382ce3ad28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:47.143851 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-7a83bc51-b854-4dc7-a4e6-dd382ce3ad28 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:47.149157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7a83bc51-b854-4dc7-a4e6-dd382ce3ad28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:47.186493 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1799/3643] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:47.192180 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616d776-fde5-43fc-9ba8-5233c8556f78 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:47.212085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616d776-fde5-43fc-9ba8-5233c8556f78 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:47.221388 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e22227-277b-497e-9f5c-e05006c348ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:47.223920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e22227-277b-497e-9f5c-e05006c348ed admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:47.224414 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e22227-277b-497e-9f5c-e05006c348ed admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:47.224694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e22227-277b-497e-9f5c-e05006c348ed admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:47.225451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e22227-277b-497e-9f5c-e05006c348ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:05:47.225763 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e22227-277b-497e-9f5c-e05006c348ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:47.228245 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e22227-277b-497e-9f5c-e05006c348ed admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:47.247007 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1845/3644] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:05:47.248093 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83bc51-b854-4dc7-a4e6-dd382ce3ad28 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:47.263039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83bc51-b854-4dc7-a4e6-dd382ce3ad28 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:47.283213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ed0e9-a333-416c-983d-a541e919ef27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:47.283851 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ed0e9-a333-416c-983d-a541e919ef27 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:47.284120 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ed0e9-a333-416c-983d-a541e919ef27 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:47.284388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ed0e9-a333-416c-983d-a541e919ef27 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:47.285016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18ed0e9-a333-416c-983d-a541e919ef27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:47.287669 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18ed0e9-a333-416c-983d-a541e919ef27 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:47.370614 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1800/3645] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:05:47 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:05:47.371680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e22227-277b-497e-9f5c-e05006c348ed admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:47.392802 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e22227-277b-497e-9f5c-e05006c348ed admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:47.447959 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:47.571984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422b4651-2d58-45b4-9c01-51a92ad4e012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:47.574362 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b4651-2d58-45b4-9c01-51a92ad4e012 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:47.575046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b4651-2d58-45b4-9c01-51a92ad4e012 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:47.575500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b4651-2d58-45b4-9c01-51a92ad4e012 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:47.576386 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422b4651-2d58-45b4-9c01-51a92ad4e012 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:47.578688 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422b4651-2d58-45b4-9c01-51a92ad4e012 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:47.615264 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1846/3646] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:05:47 2022] POST /identity/v3/users => generated 289 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:05:47.619301 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ed0e9-a333-416c-983d-a541e919ef27 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:47.631668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ed0e9-a333-416c-983d-a541e919ef27 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:47.660694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745f972-2c6a-4a10-bbc0-d6a905a51ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:47.661674 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745f972-2c6a-4a10-bbc0-d6a905a51ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:47.662307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745f972-2c6a-4a10-bbc0-d6a905a51ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:47.664020 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745f972-2c6a-4a10-bbc0-d6a905a51ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:47.670645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745f972-2c6a-4a10-bbc0-d6a905a51ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:47.672914 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745f972-2c6a-4a10-bbc0-d6a905a51ee7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:47.688025 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1801/3647] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:05:47.692291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422b4651-2d58-45b4-9c01-51a92ad4e012 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:47.715219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422b4651-2d58-45b4-9c01-51a92ad4e012 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:47.721716 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5169ee-4830-4262-9e62-f54ced932282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:47.722908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5169ee-4830-4262-9e62-f54ced932282 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:47.723385 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5169ee-4830-4262-9e62-f54ced932282 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:47.723879 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5169ee-4830-4262-9e62-f54ced932282 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:47.724686 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5169ee-4830-4262-9e62-f54ced932282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:47.727645 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5169ee-4830-4262-9e62-f54ced932282 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:47.749680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745f972-2c6a-4a10-bbc0-d6a905a51ee7 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:47.750203 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1847/3648] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:05:47.762913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745f972-2c6a-4a10-bbc0-d6a905a51ee7 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:47.768414 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b2c52-db9d-4cb8-8169-a2602ed6387d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:47.769363 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b2c52-db9d-4cb8-8169-a2602ed6387d admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:47.769811 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b2c52-db9d-4cb8-8169-a2602ed6387d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:47.770258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b2c52-db9d-4cb8-8169-a2602ed6387d admin admin] PATH_INFO: `/v3/projects/47c8524d2c6c44de8d40afa34e56dbf7/users/633e840f8663482b94bb469456dd0cf2/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:47.794706 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b2c52-db9d-4cb8-8169-a2602ed6387d admin admin] RBAC: Authorizing `identity:create_grant(project_id=47c8524d2c6c44de8d40afa34e56dbf7, user_id=633e840f8663482b94bb469456dd0cf2, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:47.797761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b2c52-db9d-4cb8-8169-a2602ed6387d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:47.817959 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1802/3649] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:05:47 2022] PUT /identity/v3/projects/47c8524d2c6c44de8d40afa34e56dbf7/users/633e840f8663482b94bb469456dd0cf2/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:05:47.830146 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e52e6-858b-4475-b314-3eebd9e10c42 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:47.830849 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e52e6-858b-4475-b314-3eebd9e10c42 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:47.832850 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e52e6-858b-4475-b314-3eebd9e10c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:47.885917 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-696e52e6-858b-4475-b314-3eebd9e10c42 None None] MFA Rules not processed for user `633e840f8663482b94bb469456dd0cf2`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:47.887231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-696e52e6-858b-4475-b314-3eebd9e10c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:47.996133 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1848/3650] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:48.000888 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b2c52-db9d-4cb8-8169-a2602ed6387d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:48.158354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b2c52-db9d-4cb8-8169-a2602ed6387d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:48.184420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58354a-1153-4fbf-9126-3b0b9c0cbf15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:48.185055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58354a-1153-4fbf-9126-3b0b9c0cbf15 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:48.186196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58354a-1153-4fbf-9126-3b0b9c0cbf15 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:48.186196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58354a-1153-4fbf-9126-3b0b9c0cbf15 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:48.186436 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58354a-1153-4fbf-9126-3b0b9c0cbf15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:48.188283 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58354a-1153-4fbf-9126-3b0b9c0cbf15 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:48.305928 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1803/3651] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:05:47 2022] POST /identity/v3/projects => generated 377 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:05:48.310472 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e52e6-858b-4475-b314-3eebd9e10c42 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:48.333008 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e52e6-858b-4475-b314-3eebd9e10c42 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:48.472137 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f778c-3a98-4bb8-a212-1bc5a1cfad5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:48.473877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f778c-3a98-4bb8-a212-1bc5a1cfad5f admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:48.474376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f778c-3a98-4bb8-a212-1bc5a1cfad5f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:48.475478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f778c-3a98-4bb8-a212-1bc5a1cfad5f admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:48.476457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f778c-3a98-4bb8-a212-1bc5a1cfad5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:48.478829 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f778c-3a98-4bb8-a212-1bc5a1cfad5f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:48.521591 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1849/3652] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:05:48 2022] POST /identity/v3/users => generated 295 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:05:48.522236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58354a-1153-4fbf-9126-3b0b9c0cbf15 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:48.535515 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58354a-1153-4fbf-9126-3b0b9c0cbf15 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:48.547720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4265d97-fd67-442c-a33d-c336c34c5b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:48.549005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4265d97-fd67-442c-a33d-c336c34c5b5a admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:48.549704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4265d97-fd67-442c-a33d-c336c34c5b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:48.550221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4265d97-fd67-442c-a33d-c336c34c5b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:48.551183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4265d97-fd67-442c-a33d-c336c34c5b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:48.553373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4265d97-fd67-442c-a33d-c336c34c5b5a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:48.583209 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1804/3653] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:05:48.587588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f778c-3a98-4bb8-a212-1bc5a1cfad5f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:48.601492 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f778c-3a98-4bb8-a212-1bc5a1cfad5f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:48.610006 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f925a9-d311-4fb1-a263-bebcd99a8ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:48.614137 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f925a9-d311-4fb1-a263-bebcd99a8ed0 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:48.614137 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f925a9-d311-4fb1-a263-bebcd99a8ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:48.614137 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f925a9-d311-4fb1-a263-bebcd99a8ed0 admin admin] PATH_INFO: `/v3/projects/89f678459bfe4b3db4c1d639090e6ddf/users/40ba58a0922a49bab19a5b2154415ff5/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:48.618276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:48.650004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f925a9-d311-4fb1-a263-bebcd99a8ed0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89f678459bfe4b3db4c1d639090e6ddf, user_id=40ba58a0922a49bab19a5b2154415ff5, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:48.653609 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f925a9-d311-4fb1-a263-bebcd99a8ed0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:48.711128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4265d97-fd67-442c-a33d-c336c34c5b5a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:48.712233 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1850/3654] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:05:48 2022] PUT /identity/v3/projects/89f678459bfe4b3db4c1d639090e6ddf/users/40ba58a0922a49bab19a5b2154415ff5/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:05:48.723641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4265d97-fd67-442c-a33d-c336c34c5b5a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:48.784813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:48.813554 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b30379-570f-456f-809e-08362deb7c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:48.814450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b30379-570f-456f-809e-08362deb7c9f admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:48.814964 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b30379-570f-456f-809e-08362deb7c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:48.815466 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b30379-570f-456f-809e-08362deb7c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:48.818809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b30379-570f-456f-809e-08362deb7c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:48.821200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b30379-570f-456f-809e-08362deb7c9f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:48.841724 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f925a9-d311-4fb1-a263-bebcd99a8ed0 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:48.853684 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1805/3655] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:05:48.855581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f925a9-d311-4fb1-a263-bebcd99a8ed0 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:48.861364 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84448baa-c0c6-4d85-b5fa-2347c396075b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:48.862335 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84448baa-c0c6-4d85-b5fa-2347c396075b admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:48.862821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84448baa-c0c6-4d85-b5fa-2347c396075b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:48.863853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84448baa-c0c6-4d85-b5fa-2347c396075b admin admin] PATH_INFO: `/v3/projects/89f678459bfe4b3db4c1d639090e6ddf/users/40ba58a0922a49bab19a5b2154415ff5/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:48.866379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84448baa-c0c6-4d85-b5fa-2347c396075b admin admin] RBAC: Authorizing `identity:create_grant(project_id=89f678459bfe4b3db4c1d639090e6ddf, user_id=40ba58a0922a49bab19a5b2154415ff5, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:48.872162 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84448baa-c0c6-4d85-b5fa-2347c396075b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:48.890968 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1851/3656] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:05:48 2022] PUT /identity/v3/projects/89f678459bfe4b3db4c1d639090e6ddf/users/40ba58a0922a49bab19a5b2154415ff5/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:05:48.904689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2aab87-1fb8-4682-a9af-9de1be41275f None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:48.904985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2aab87-1fb8-4682-a9af-9de1be41275f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:48.905469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2aab87-1fb8-4682-a9af-9de1be41275f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:48.972805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-ce2aab87-1fb8-4682-a9af-9de1be41275f None None] MFA Rules not processed for user `40ba58a0922a49bab19a5b2154415ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:48.975100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ce2aab87-1fb8-4682-a9af-9de1be41275f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:49.138984 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1806/3657] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:49.660382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84448baa-c0c6-4d85-b5fa-2347c396075b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:49.663892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-84448baa-c0c6-4d85-b5fa-2347c396075b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:49.784783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84448baa-c0c6-4d85-b5fa-2347c396075b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:49.795169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ded35-8583-4fd8-a3c7-15689544ae8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:49.796169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ded35-8583-4fd8-a3c7-15689544ae8f service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:49.796704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ded35-8583-4fd8-a3c7-15689544ae8f service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:49.797215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ded35-8583-4fd8-a3c7-15689544ae8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:49.823983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ded35-8583-4fd8-a3c7-15689544ae8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:49.827922 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ded35-8583-4fd8-a3c7-15689544ae8f service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:49.845128 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1852/3658] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:05:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:05:50.100528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2aab87-1fb8-4682-a9af-9de1be41275f None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:50.214508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2aab87-1fb8-4682-a9af-9de1be41275f None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:50.221009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa6421-acaf-43fa-97f3-4adbafc2effa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:50.222107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa6421-acaf-43fa-97f3-4adbafc2effa admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:50.222566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa6421-acaf-43fa-97f3-4adbafc2effa admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:50.223018 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa6421-acaf-43fa-97f3-4adbafc2effa admin admin] PATH_INFO: `/v3/users/633e840f8663482b94bb469456dd0cf2` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:50.225206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa6421-acaf-43fa-97f3-4adbafc2effa admin admin] RBAC: Authorizing `identity:delete_user(user_id=633e840f8663482b94bb469456dd0cf2)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:50.228501 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa6421-acaf-43fa-97f3-4adbafc2effa admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:50.301755 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9eaa6421-acaf-43fa-97f3-4adbafc2effa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '633e840f8663482b94bb469456dd0cf2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:50.302624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9eaa6421-acaf-43fa-97f3-4adbafc2effa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '633e840f8663482b94bb469456dd0cf2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:50.303363 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9eaa6421-acaf-43fa-97f3-4adbafc2effa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '633e840f8663482b94bb469456dd0cf2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:50.318990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9eaa6421-acaf-43fa-97f3-4adbafc2effa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '633e840f8663482b94bb469456dd0cf2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:50.336944 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:50.340399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9eaa6421-acaf-43fa-97f3-4adbafc2effa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '633e840f8663482b94bb469456dd0cf2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:50.364231 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1807/3659] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:05:50 2022] DELETE /identity/v3/users/633e840f8663482b94bb469456dd0cf2 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:05:50.366962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb3e78-13d1-4f0a-9312-9c39071f64e6 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:50.367370 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb3e78-13d1-4f0a-9312-9c39071f64e6 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:50.367783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb3e78-13d1-4f0a-9312-9c39071f64e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:50.407121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-69cb3e78-13d1-4f0a-9312-9c39071f64e6 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:50.410183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-69cb3e78-13d1-4f0a-9312-9c39071f64e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:50.569910 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1853/3660] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:50.600490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa6421-acaf-43fa-97f3-4adbafc2effa admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:50.601934 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9eaa6421-acaf-43fa-97f3-4adbafc2effa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:50.752826 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa6421-acaf-43fa-97f3-4adbafc2effa admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:50.765577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a80ae-5f91-4ff8-b8f1-43935e66cb69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:50.766217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a80ae-5f91-4ff8-b8f1-43935e66cb69 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:50.766507 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a80ae-5f91-4ff8-b8f1-43935e66cb69 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:50.766879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a80ae-5f91-4ff8-b8f1-43935e66cb69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:50.788566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a80ae-5f91-4ff8-b8f1-43935e66cb69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:50.793173 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a80ae-5f91-4ff8-b8f1-43935e66cb69 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:50.808093 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1808/3661] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:05:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:05:52.680456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb3e78-13d1-4f0a-9312-9c39071f64e6 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:52.683506 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-69cb3e78-13d1-4f0a-9312-9c39071f64e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:52.708484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb3e78-13d1-4f0a-9312-9c39071f64e6 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:52.724252 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd105f-64b7-44c0-ae5e-25ceb686cc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:52.725241 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd105f-64b7-44c0-ae5e-25ceb686cc2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:52.725713 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd105f-64b7-44c0-ae5e-25ceb686cc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:52.726942 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd105f-64b7-44c0-ae5e-25ceb686cc2e admin admin] PATH_INFO: `/v3/projects/47c8524d2c6c44de8d40afa34e56dbf7` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:52.729534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd105f-64b7-44c0-ae5e-25ceb686cc2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=47c8524d2c6c44de8d40afa34e56dbf7)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:52.735337 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd105f-64b7-44c0-ae5e-25ceb686cc2e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:52.848023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-82bd105f-64b7-44c0-ae5e-25ceb686cc2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47c8524d2c6c44de8d40afa34e56dbf7', 'request_id': 'req-82bd105f-64b7-44c0-ae5e-25ceb686cc2e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:52.865394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:52.868131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-82bd105f-64b7-44c0-ae5e-25ceb686cc2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47c8524d2c6c44de8d40afa34e56dbf7', 'request_id': 'req-82bd105f-64b7-44c0-ae5e-25ceb686cc2e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:52.887833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-82bd105f-64b7-44c0-ae5e-25ceb686cc2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47c8524d2c6c44de8d40afa34e56dbf7', 'request_id': 'req-82bd105f-64b7-44c0-ae5e-25ceb686cc2e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:52.913225 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-82bd105f-64b7-44c0-ae5e-25ceb686cc2e admin admin] The token cache is being invalidate because project 47c8524d2c6c44de8d40afa34e56dbf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:05:52.913668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-82bd105f-64b7-44c0-ae5e-25ceb686cc2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:52.916770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-82bd105f-64b7-44c0-ae5e-25ceb686cc2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:52.921309 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1854/3662] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:05:52 2022] DELETE /identity/v3/projects/47c8524d2c6c44de8d40afa34e56dbf7 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:05:52.922675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a80ae-5f91-4ff8-b8f1-43935e66cb69 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:52.940039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a80ae-5f91-4ff8-b8f1-43935e66cb69 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:53.133316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ed72d-cfdd-4189-ad44-97e7a0c24a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:53.134266 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ed72d-cfdd-4189-ad44-97e7a0c24a6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:53.134980 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ed72d-cfdd-4189-ad44-97e7a0c24a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:53.135477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ed72d-cfdd-4189-ad44-97e7a0c24a6e admin admin] PATH_INFO: `/v3/users/40ba58a0922a49bab19a5b2154415ff5` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:53.137504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ed72d-cfdd-4189-ad44-97e7a0c24a6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=40ba58a0922a49bab19a5b2154415ff5)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:53.139885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ed72d-cfdd-4189-ad44-97e7a0c24a6e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:53.268106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-cd1ed72d-cfdd-4189-ad44-97e7a0c24a6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40ba58a0922a49bab19a5b2154415ff5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:53.269492 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-cd1ed72d-cfdd-4189-ad44-97e7a0c24a6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40ba58a0922a49bab19a5b2154415ff5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:53.273189 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-cd1ed72d-cfdd-4189-ad44-97e7a0c24a6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40ba58a0922a49bab19a5b2154415ff5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:53.292594 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-cd1ed72d-cfdd-4189-ad44-97e7a0c24a6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40ba58a0922a49bab19a5b2154415ff5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:53.327534 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-cd1ed72d-cfdd-4189-ad44-97e7a0c24a6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40ba58a0922a49bab19a5b2154415ff5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:53.359347 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1809/3663] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:05:52 2022] DELETE /identity/v3/users/40ba58a0922a49bab19a5b2154415ff5 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:05:56.069398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd105f-64b7-44c0-ae5e-25ceb686cc2e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:56.072467 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-82bd105f-64b7-44c0-ae5e-25ceb686cc2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:56.112412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd105f-64b7-44c0-ae5e-25ceb686cc2e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:56.341147 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361e6d7-5137-414d-a894-c2437abe50bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:56.342121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361e6d7-5137-414d-a894-c2437abe50bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:56.342597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361e6d7-5137-414d-a894-c2437abe50bc admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:56.343029 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361e6d7-5137-414d-a894-c2437abe50bc admin admin] PATH_INFO: `/v3/projects/89f678459bfe4b3db4c1d639090e6ddf` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:56.345947 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361e6d7-5137-414d-a894-c2437abe50bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=89f678459bfe4b3db4c1d639090e6ddf)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:56.348446 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361e6d7-5137-414d-a894-c2437abe50bc admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:56.524301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f361e6d7-5137-414d-a894-c2437abe50bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89f678459bfe4b3db4c1d639090e6ddf', 'request_id': 'req-f361e6d7-5137-414d-a894-c2437abe50bc'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:56.534156 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f361e6d7-5137-414d-a894-c2437abe50bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89f678459bfe4b3db4c1d639090e6ddf', 'request_id': 'req-f361e6d7-5137-414d-a894-c2437abe50bc'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:56.545499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f361e6d7-5137-414d-a894-c2437abe50bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89f678459bfe4b3db4c1d639090e6ddf', 'request_id': 'req-f361e6d7-5137-414d-a894-c2437abe50bc'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:56.577177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f361e6d7-5137-414d-a894-c2437abe50bc admin admin] The token cache is being invalidate because project 89f678459bfe4b3db4c1d639090e6ddf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:05:56.577535 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f361e6d7-5137-414d-a894-c2437abe50bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:56.578245 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f361e6d7-5137-414d-a894-c2437abe50bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:56.580390 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1855/3664] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:05:56 2022] DELETE /identity/v3/projects/89f678459bfe4b3db4c1d639090e6ddf => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:05:56.585564 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccb5cf-21eb-49bd-9c19-ab1642fb6999 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:56.586647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccb5cf-21eb-49bd-9c19-ab1642fb6999 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:56.587119 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccb5cf-21eb-49bd-9c19-ab1642fb6999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:56.631985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:56.651515 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f2ccb5cf-21eb-49bd-9c19-ab1642fb6999 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:56.671049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f2ccb5cf-21eb-49bd-9c19-ab1642fb6999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:56.843061 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1810/3665] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:56.852468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388feaa-4f15-456e-b96a-62e19d3e73e9 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:56.852961 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388feaa-4f15-456e-b96a-62e19d3e73e9 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:56.853718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388feaa-4f15-456e-b96a-62e19d3e73e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:56.923767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b388feaa-4f15-456e-b96a-62e19d3e73e9 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:56.934161 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b388feaa-4f15-456e-b96a-62e19d3e73e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:56.971863 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1856/3666] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:56.973368 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ccb5cf-21eb-49bd-9c19-ab1642fb6999 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:56.997629 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ccb5cf-21eb-49bd-9c19-ab1642fb6999 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:57.036794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a74e76-55fd-44cd-bf87-1ff78b0467d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:57.037473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a74e76-55fd-44cd-bf87-1ff78b0467d3 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:57.040166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a74e76-55fd-44cd-bf87-1ff78b0467d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:57.040660 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a74e76-55fd-44cd-bf87-1ff78b0467d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:57.043304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a74e76-55fd-44cd-bf87-1ff78b0467d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:05:57.047372 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a74e76-55fd-44cd-bf87-1ff78b0467d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:57.050392 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a74e76-55fd-44cd-bf87-1ff78b0467d3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:57.088856 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1811/3667] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:05:57.094208 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388feaa-4f15-456e-b96a-62e19d3e73e9 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:57.115574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388feaa-4f15-456e-b96a-62e19d3e73e9 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:57.128663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e7de2-508c-4da1-b683-606404c83ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:57.129304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e7de2-508c-4da1-b683-606404c83ee7 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:57.129853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e7de2-508c-4da1-b683-606404c83ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:57.130140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e7de2-508c-4da1-b683-606404c83ee7 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:57.133262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e7de2-508c-4da1-b683-606404c83ee7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:57.136248 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e7de2-508c-4da1-b683-606404c83ee7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:57.209697 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1857/3668] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:05:57 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:05:57.219752 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a74e76-55fd-44cd-bf87-1ff78b0467d3 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:57.253376 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a74e76-55fd-44cd-bf87-1ff78b0467d3 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:57.430069 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d0ec7-f783-4cb6-8279-c6d8579720b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:57.430069 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d0ec7-f783-4cb6-8279-c6d8579720b0 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:57.430752 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d0ec7-f783-4cb6-8279-c6d8579720b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:57.433466 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d0ec7-f783-4cb6-8279-c6d8579720b0 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:57.434725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d0ec7-f783-4cb6-8279-c6d8579720b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:57.440363 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d0ec7-f783-4cb6-8279-c6d8579720b0 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:57.495394 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1812/3669] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:05:57 2022] POST /identity/v3/users => generated 289 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:05:57.499801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e7de2-508c-4da1-b683-606404c83ee7 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:57.519930 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e7de2-508c-4da1-b683-606404c83ee7 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:57.528694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a140c-3703-4fca-a2c9-307970d66373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:57.529402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a140c-3703-4fca-a2c9-307970d66373 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:57.530595 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a140c-3703-4fca-a2c9-307970d66373 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:57.531992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a140c-3703-4fca-a2c9-307970d66373 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:57.533154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a140c-3703-4fca-a2c9-307970d66373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:57.537947 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a140c-3703-4fca-a2c9-307970d66373 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:57.554961 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1858/3670] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:05:57.561094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d0ec7-f783-4cb6-8279-c6d8579720b0 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:57.585440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d0ec7-f783-4cb6-8279-c6d8579720b0 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:57.593238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8094eb-e8c7-4b59-8c1d-e6bada84e4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:57.594814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8094eb-e8c7-4b59-8c1d-e6bada84e4e3 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:57.595279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8094eb-e8c7-4b59-8c1d-e6bada84e4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:57.595708 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8094eb-e8c7-4b59-8c1d-e6bada84e4e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:57.599239 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8094eb-e8c7-4b59-8c1d-e6bada84e4e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:57.601278 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8094eb-e8c7-4b59-8c1d-e6bada84e4e3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:57.628193 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1813/3671] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:05:57.634013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a140c-3703-4fca-a2c9-307970d66373 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:57.654099 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a140c-3703-4fca-a2c9-307970d66373 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:57.678767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfbbdb-0940-4585-822f-0bed9be78dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:57.680238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfbbdb-0940-4585-822f-0bed9be78dbb admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:57.680738 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfbbdb-0940-4585-822f-0bed9be78dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:57.682027 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfbbdb-0940-4585-822f-0bed9be78dbb admin admin] PATH_INFO: `/v3/projects/ec9464cebb2d40e3930fb285b21b37c7/users/3d516f716bb443d483606e299f60d9fa/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:57.704659 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bfbbdb-0940-4585-822f-0bed9be78dbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec9464cebb2d40e3930fb285b21b37c7, user_id=3d516f716bb443d483606e299f60d9fa, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:57.711823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bfbbdb-0940-4585-822f-0bed9be78dbb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:57.739402 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1859/3672] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:05:57 2022] PUT /identity/v3/projects/ec9464cebb2d40e3930fb285b21b37c7/users/3d516f716bb443d483606e299f60d9fa/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:05:57.753515 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f8c15-84f1-4d7d-b70d-2c15597fc979 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:57.754833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f8c15-84f1-4d7d-b70d-2c15597fc979 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:57.755547 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f8c15-84f1-4d7d-b70d-2c15597fc979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:57.785429 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9cbb0-6523-42bd-b35a-c997190ee924 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:57.785709 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9cbb0-6523-42bd-b35a-c997190ee924 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:57.786066 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9cbb0-6523-42bd-b35a-c997190ee924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:57.819227 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:57.851375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-7d8f8c15-84f1-4d7d-b70d-2c15597fc979 None None] MFA Rules not processed for user `3d516f716bb443d483606e299f60d9fa`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:57.853989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7d8f8c15-84f1-4d7d-b70d-2c15597fc979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:57.859071 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-dfd9cbb0-6523-42bd-b35a-c997190ee924 None None] MFA Rules not processed for user `10b30a7d1ce94193970bdc076d481578`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:57.865284 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-dfd9cbb0-6523-42bd-b35a-c997190ee924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:58.077464 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1860/3673] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:57 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:58.080968 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1814/3674] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:58.089699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134087e3-f301-4947-9ec7-62ef1d20cd04 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:58.090240 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134087e3-f301-4947-9ec7-62ef1d20cd04 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:58.090740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134087e3-f301-4947-9ec7-62ef1d20cd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:58.168837 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-134087e3-f301-4947-9ec7-62ef1d20cd04 None None] MFA Rules not processed for user `10b30a7d1ce94193970bdc076d481578`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:58.170782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-134087e3-f301-4947-9ec7-62ef1d20cd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:58.194359 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f8c15-84f1-4d7d-b70d-2c15597fc979 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:58.196073 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7d8f8c15-84f1-4d7d-b70d-2c15597fc979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:58.202899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:58.209666 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1861/3675] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:58 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:58.422828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f8c15-84f1-4d7d-b70d-2c15597fc979 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:58.448541 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a092e37-9005-42b1-a24d-856c248203b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:58.449306 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a092e37-9005-42b1-a24d-856c248203b1 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:58.449664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a092e37-9005-42b1-a24d-856c248203b1 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:58.450009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a092e37-9005-42b1-a24d-856c248203b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:58.477947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a092e37-9005-42b1-a24d-856c248203b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:58.479919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a092e37-9005-42b1-a24d-856c248203b1 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:58.518361 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1815/3676] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:05:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:05:58.601406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134087e3-f301-4947-9ec7-62ef1d20cd04 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:58.627628 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134087e3-f301-4947-9ec7-62ef1d20cd04 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:58.645270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4aa91-38d2-4880-af85-5b9a90ce3c25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:58.648150 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4aa91-38d2-4880-af85-5b9a90ce3c25 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:58.649261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4aa91-38d2-4880-af85-5b9a90ce3c25 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:58.649856 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4aa91-38d2-4880-af85-5b9a90ce3c25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:58.672555 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4aa91-38d2-4880-af85-5b9a90ce3c25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:58.681800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4aa91-38d2-4880-af85-5b9a90ce3c25 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:58.710899 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1862/3677] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:05:58 2022] GET /identity/v3/auth/tokens => generated 3288 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:05:58.940607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4616d5-ab14-4170-a937-0edfc9128892 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:58.941205 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4616d5-ab14-4170-a937-0edfc9128892 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:58.941304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4616d5-ab14-4170-a937-0edfc9128892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:58.976085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90509427-5b75-4819-9bae-823b8287a798 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:58.978902 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90509427-5b75-4819-9bae-823b8287a798 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:58.979453 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90509427-5b75-4819-9bae-823b8287a798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:59.005346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-de4616d5-ab14-4170-a937-0edfc9128892 None None] MFA Rules not processed for user `bdf1b5180a814cf39234892c6c1f26df`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:59.007017 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-de4616d5-ab14-4170-a937-0edfc9128892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:59.066059 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-90509427-5b75-4819-9bae-823b8287a798 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:59.069500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-90509427-5b75-4819-9bae-823b8287a798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:59.185582 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1816/3678] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:59.195717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca2079-1127-4926-9d55-12ad5de42c63 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:59.196059 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca2079-1127-4926-9d55-12ad5de42c63 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:59.196447 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca2079-1127-4926-9d55-12ad5de42c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:59.214062 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1863/3679] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:05:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:05:59.242916 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-79ca2079-1127-4926-9d55-12ad5de42c63 None None] MFA Rules not processed for user `bdf1b5180a814cf39234892c6c1f26df`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:59.244934 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-79ca2079-1127-4926-9d55-12ad5de42c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:59.275091 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1817/3680] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:05:59.332337 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90509427-5b75-4819-9bae-823b8287a798 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:59.333941 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-90509427-5b75-4819-9bae-823b8287a798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:59.466945 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:59.538484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90509427-5b75-4819-9bae-823b8287a798 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:59.561381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493ddb2-b5a3-46c5-a083-350475be3580 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:59.564407 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493ddb2-b5a3-46c5-a083-350475be3580 service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:59.565805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493ddb2-b5a3-46c5-a083-350475be3580 service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:59.571854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493ddb2-b5a3-46c5-a083-350475be3580 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:59.582492 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca2079-1127-4926-9d55-12ad5de42c63 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:59.584350 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-79ca2079-1127-4926-9d55-12ad5de42c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:59.600760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c493ddb2-b5a3-46c5-a083-350475be3580 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:59.604086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c493ddb2-b5a3-46c5-a083-350475be3580 service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:59.631771 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1864/3681] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:05:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:05:59.713915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493ddb2-b5a3-46c5-a083-350475be3580 service swift] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:05:59.715859 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c493ddb2-b5a3-46c5-a083-350475be3580 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:05:59.765452 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493ddb2-b5a3-46c5-a083-350475be3580 service swift] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:59.775400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f1f0c-0e63-4d48-b2cd-7dcaf052e0d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:59.776918 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f1f0c-0e63-4d48-b2cd-7dcaf052e0d9 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:59.777311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f1f0c-0e63-4d48-b2cd-7dcaf052e0d9 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:59.777613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f1f0c-0e63-4d48-b2cd-7dcaf052e0d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:59.793492 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f1f0c-0e63-4d48-b2cd-7dcaf052e0d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:59.796551 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f1f0c-0e63-4d48-b2cd-7dcaf052e0d9 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:59.811948 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca2079-1127-4926-9d55-12ad5de42c63 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:05:59.814669 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1865/3682] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:05:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:05:59.828839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef914d-91d6-4e5d-a2f1-6317db750dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:05:59.833525 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef914d-91d6-4e5d-a2f1-6317db750dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:59.833525 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef914d-91d6-4e5d-a2f1-6317db750dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:59.833907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef914d-91d6-4e5d-a2f1-6317db750dc0 admin admin] PATH_INFO: `/v3/users/a2df7f5bd4ae4f6d918bb18721a6ac5b` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:59.835313 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef914d-91d6-4e5d-a2f1-6317db750dc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2df7f5bd4ae4f6d918bb18721a6ac5b)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:05:59.840589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef914d-91d6-4e5d-a2f1-6317db750dc0 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:05:59.867610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:59.925618 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7880e5-7f4e-446c-ab8b-929725e66444 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:05:59.927222 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7880e5-7f4e-446c-ab8b-929725e66444 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:05:59.927750 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7880e5-7f4e-446c-ab8b-929725e66444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:05:59.960863 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bfef914d-91d6-4e5d-a2f1-6317db750dc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2df7f5bd4ae4f6d918bb18721a6ac5b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:59.962218 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bfef914d-91d6-4e5d-a2f1-6317db750dc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2df7f5bd4ae4f6d918bb18721a6ac5b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:59.963939 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bfef914d-91d6-4e5d-a2f1-6317db750dc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2df7f5bd4ae4f6d918bb18721a6ac5b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:59.976813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bfef914d-91d6-4e5d-a2f1-6317db750dc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2df7f5bd4ae4f6d918bb18721a6ac5b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:05:59.989706 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-ac7880e5-7f4e-446c-ab8b-929725e66444 None None] MFA Rules not processed for user `3d516f716bb443d483606e299f60d9fa`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:05:59.992757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ac7880e5-7f4e-446c-ab8b-929725e66444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:00.005098 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1866/3683] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:05:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:06:00.033841 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bfef914d-91d6-4e5d-a2f1-6317db750dc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2df7f5bd4ae4f6d918bb18721a6ac5b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:00.070074 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1818/3684] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:05:59 2022] DELETE /identity/v3/users/a2df7f5bd4ae4f6d918bb18721a6ac5b => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:06:00.268992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7880e5-7f4e-446c-ab8b-929725e66444 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:00.270609 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ac7880e5-7f4e-446c-ab8b-929725e66444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:00.437630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7880e5-7f4e-446c-ab8b-929725e66444 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:00.651514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350022e7-d03a-4f89-9bae-5fe3f5503a7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:00.652501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350022e7-d03a-4f89-9bae-5fe3f5503a7e service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:00.652739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350022e7-d03a-4f89-9bae-5fe3f5503a7e service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:00.653237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350022e7-d03a-4f89-9bae-5fe3f5503a7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:00.655181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-350022e7-d03a-4f89-9bae-5fe3f5503a7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:00.661417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef914d-91d6-4e5d-a2f1-6317db750dc0 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:00.662869 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-bfef914d-91d6-4e5d-a2f1-6317db750dc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:00.671824 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350022e7-d03a-4f89-9bae-5fe3f5503a7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:00.673837 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350022e7-d03a-4f89-9bae-5fe3f5503a7e service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:00.690163 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1867/3685] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:06:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:06:00.830866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef914d-91d6-4e5d-a2f1-6317db750dc0 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:00.846316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9a828-3b50-4d6b-933a-39f005a942e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:00.847135 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9a828-3b50-4d6b-933a-39f005a942e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:00.848634 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9a828-3b50-4d6b-933a-39f005a942e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:00.848634 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9a828-3b50-4d6b-933a-39f005a942e7 admin admin] PATH_INFO: `/v3/projects/7dffa3e9ecbe4f118302bee4d90591ba` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:00.852189 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9a828-3b50-4d6b-933a-39f005a942e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dffa3e9ecbe4f118302bee4d90591ba)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:00.854805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9a828-3b50-4d6b-933a-39f005a942e7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:01.043078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-05d9a828-3b50-4d6b-933a-39f005a942e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dffa3e9ecbe4f118302bee4d90591ba', 'request_id': 'req-05d9a828-3b50-4d6b-933a-39f005a942e7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:01.052984 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-05d9a828-3b50-4d6b-933a-39f005a942e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dffa3e9ecbe4f118302bee4d90591ba', 'request_id': 'req-05d9a828-3b50-4d6b-933a-39f005a942e7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:01.066693 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-05d9a828-3b50-4d6b-933a-39f005a942e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dffa3e9ecbe4f118302bee4d90591ba', 'request_id': 'req-05d9a828-3b50-4d6b-933a-39f005a942e7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:01.108343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-05d9a828-3b50-4d6b-933a-39f005a942e7 admin admin] The token cache is being invalidate because project 7dffa3e9ecbe4f118302bee4d90591ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:06:01.108972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-05d9a828-3b50-4d6b-933a-39f005a942e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:01.111134 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-05d9a828-3b50-4d6b-933a-39f005a942e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:01.113468 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1819/3686] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:06:00 2022] DELETE /identity/v3/projects/7dffa3e9ecbe4f118302bee4d90591ba => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:06:01.120966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d384a1-073f-4e7a-aed1-87b655a9dc91 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:01.121244 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d384a1-073f-4e7a-aed1-87b655a9dc91 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:01.121622 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d384a1-073f-4e7a-aed1-87b655a9dc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:01.158400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-34d384a1-073f-4e7a-aed1-87b655a9dc91 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:06:01.159759 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-34d384a1-073f-4e7a-aed1-87b655a9dc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:01.288567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:01.318745 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1868/3687] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:06:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:06:01.327395 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d93959-e764-4bff-bca5-0498e7898529 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:01.331008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d93959-e764-4bff-bca5-0498e7898529 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:01.331292 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d93959-e764-4bff-bca5-0498e7898529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:01.402688 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-84d93959-e764-4bff-bca5-0498e7898529 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:06:01.411318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-84d93959-e764-4bff-bca5-0498e7898529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:01.450570 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1820/3688] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:06:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:06:01.454367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d384a1-073f-4e7a-aed1-87b655a9dc91 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:01.471958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d384a1-073f-4e7a-aed1-87b655a9dc91 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:01.486565 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200150b-b49a-4e42-bc39-aa564a4f3f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:01.487392 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200150b-b49a-4e42-bc39-aa564a4f3f4d admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:01.487525 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200150b-b49a-4e42-bc39-aa564a4f3f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:01.487779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200150b-b49a-4e42-bc39-aa564a4f3f4d admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:01.488439 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9200150b-b49a-4e42-bc39-aa564a4f3f4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:06:01.490704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9200150b-b49a-4e42-bc39-aa564a4f3f4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:01.495506 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9200150b-b49a-4e42-bc39-aa564a4f3f4d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:01.526023 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1869/3689] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:06:01.529447 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d93959-e764-4bff-bca5-0498e7898529 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:01.543639 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d93959-e764-4bff-bca5-0498e7898529 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:01.560726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d5213-a3cf-45b2-96ad-e359ba6f6333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:01.561754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d5213-a3cf-45b2-96ad-e359ba6f6333 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:01.562150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d5213-a3cf-45b2-96ad-e359ba6f6333 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:01.562608 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d5213-a3cf-45b2-96ad-e359ba6f6333 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:01.563536 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d5213-a3cf-45b2-96ad-e359ba6f6333 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:01.566987 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d5213-a3cf-45b2-96ad-e359ba6f6333 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:01.600577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:01.680198 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1821/3690] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:06:01 2022] POST /identity/v3/projects => generated 393 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:06:01.683398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200150b-b49a-4e42-bc39-aa564a4f3f4d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:01.701257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200150b-b49a-4e42-bc39-aa564a4f3f4d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:02.073117 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421cd8b-d79a-4e65-aab4-d016caaaa59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:02.073854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421cd8b-d79a-4e65-aab4-d016caaaa59d admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:02.074140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421cd8b-d79a-4e65-aab4-d016caaaa59d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:02.074418 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421cd8b-d79a-4e65-aab4-d016caaaa59d admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:02.075085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b421cd8b-d79a-4e65-aab4-d016caaaa59d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:02.089071 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b421cd8b-d79a-4e65-aab4-d016caaaa59d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:02.218128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d5213-a3cf-45b2-96ad-e359ba6f6333 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:02.220773 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1870/3691] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:06:01 2022] POST /identity/v3/users => generated 297 bytes in 538 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:06:02.232918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d5213-a3cf-45b2-96ad-e359ba6f6333 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:02.282605 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3f391-21db-4efb-9cfc-cd72ccd461cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:02.284587 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3f391-21db-4efb-9cfc-cd72ccd461cf admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:02.285444 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3f391-21db-4efb-9cfc-cd72ccd461cf admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:02.287869 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3f391-21db-4efb-9cfc-cd72ccd461cf admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:02.289036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc3f391-21db-4efb-9cfc-cd72ccd461cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:02.303865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc3f391-21db-4efb-9cfc-cd72ccd461cf admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:02.356538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421cd8b-d79a-4e65-aab4-d016caaaa59d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:02.370696 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1822/3692] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:06:02.373289 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421cd8b-d79a-4e65-aab4-d016caaaa59d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:02.404678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb1585-cdeb-498d-a010-b965ce870f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:02.405587 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb1585-cdeb-498d-a010-b965ce870f05 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:02.407024 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb1585-cdeb-498d-a010-b965ce870f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:02.408496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb1585-cdeb-498d-a010-b965ce870f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:02.409366 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb1585-cdeb-498d-a010-b965ce870f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:02.412355 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb1585-cdeb-498d-a010-b965ce870f05 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:02.441498 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1871/3693] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:06:02.442932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3f391-21db-4efb-9cfc-cd72ccd461cf admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:02.455565 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3f391-21db-4efb-9cfc-cd72ccd461cf admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:02.465481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd6770-6b77-45ef-acd6-4769f0a247b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:02.466877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd6770-6b77-45ef-acd6-4769f0a247b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:02.467876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd6770-6b77-45ef-acd6-4769f0a247b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:02.468662 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd6770-6b77-45ef-acd6-4769f0a247b3 admin admin] PATH_INFO: `/v3/projects/8046f1ab9c004060965dced02db4b7c4/users/f7cf258df10248d0bdcf64fa075c132c/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:02.501041 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd6770-6b77-45ef-acd6-4769f0a247b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8046f1ab9c004060965dced02db4b7c4, user_id=f7cf258df10248d0bdcf64fa075c132c, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:02.510707 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd6770-6b77-45ef-acd6-4769f0a247b3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:02.564043 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1823/3694] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:06:02 2022] PUT /identity/v3/projects/8046f1ab9c004060965dced02db4b7c4/users/f7cf258df10248d0bdcf64fa075c132c/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:06:02.571400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697925e-9c51-47cc-8098-0d7baca9ab87 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:02.572500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697925e-9c51-47cc-8098-0d7baca9ab87 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:02.573256 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697925e-9c51-47cc-8098-0d7baca9ab87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:02.710632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-c697925e-9c51-47cc-8098-0d7baca9ab87 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:06:02.717458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c697925e-9c51-47cc-8098-0d7baca9ab87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:02.853989 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1872/3695] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:06:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:06:02.899624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd6770-6b77-45ef-acd6-4769f0a247b3 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:02.902148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2bcd6770-6b77-45ef-acd6-4769f0a247b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:03.168670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd6770-6b77-45ef-acd6-4769f0a247b3 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:03.174438 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6911235-5fb9-4742-aaf1-b07b2021f53a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:03.175481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6911235-5fb9-4742-aaf1-b07b2021f53a service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:03.175766 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6911235-5fb9-4742-aaf1-b07b2021f53a service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:03.176188 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6911235-5fb9-4742-aaf1-b07b2021f53a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:03.192109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6911235-5fb9-4742-aaf1-b07b2021f53a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:03.194115 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6911235-5fb9-4742-aaf1-b07b2021f53a service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:03.214703 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1824/3696] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:06:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:06:03.358703 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c15c1-fe83-406c-a1fb-ded90d5f1689 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:03.359325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c15c1-fe83-406c-a1fb-ded90d5f1689 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:03.359632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c15c1-fe83-406c-a1fb-ded90d5f1689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:03.393172 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-525c15c1-fe83-406c-a1fb-ded90d5f1689 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:06:03.395657 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-525c15c1-fe83-406c-a1fb-ded90d5f1689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:03.561038 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1873/3697] 10.222.0.33 () {58 vars in 967 bytes} [Sat Aug 6 21:06:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:06:03.568388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6911235-5fb9-4742-aaf1-b07b2021f53a service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:03.570649 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b6911235-5fb9-4742-aaf1-b07b2021f53a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:03.803211 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6911235-5fb9-4742-aaf1-b07b2021f53a service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:03.831332 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34080eec-cadd-4613-860d-4f10ad925623 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:03.839290 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34080eec-cadd-4613-860d-4f10ad925623 service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:03.839894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34080eec-cadd-4613-860d-4f10ad925623 service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:03.840585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34080eec-cadd-4613-860d-4f10ad925623 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:03.873766 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34080eec-cadd-4613-860d-4f10ad925623 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:03.877250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34080eec-cadd-4613-860d-4f10ad925623 service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:03.916573 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1825/3698] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:06:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:06:04.069740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c15c1-fe83-406c-a1fb-ded90d5f1689 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:04.071527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-525c15c1-fe83-406c-a1fb-ded90d5f1689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:04.091061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c15c1-fe83-406c-a1fb-ded90d5f1689 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:04.097304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450cb27-2f70-406c-8842-489ccd31e966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:04.098942 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450cb27-2f70-406c-8842-489ccd31e966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:04.101614 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450cb27-2f70-406c-8842-489ccd31e966 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:04.102266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450cb27-2f70-406c-8842-489ccd31e966 admin admin] PATH_INFO: `/v3/users/3d516f716bb443d483606e299f60d9fa` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:04.104417 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450cb27-2f70-406c-8842-489ccd31e966 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d516f716bb443d483606e299f60d9fa)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:04.106877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450cb27-2f70-406c-8842-489ccd31e966 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:04.110983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:04.193048 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7450cb27-2f70-406c-8842-489ccd31e966 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d516f716bb443d483606e299f60d9fa'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:04.202012 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7450cb27-2f70-406c-8842-489ccd31e966 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d516f716bb443d483606e299f60d9fa'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:04.203166 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7450cb27-2f70-406c-8842-489ccd31e966 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d516f716bb443d483606e299f60d9fa'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:04.203891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7450cb27-2f70-406c-8842-489ccd31e966 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d516f716bb443d483606e299f60d9fa'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:04.215081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7450cb27-2f70-406c-8842-489ccd31e966 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d516f716bb443d483606e299f60d9fa'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:04.248243 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1874/3699] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:06:04 2022] DELETE /identity/v3/users/3d516f716bb443d483606e299f60d9fa => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:06:04.249662 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec11a4c-353a-478a-9611-babd208dc7af None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:04.250045 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec11a4c-353a-478a-9611-babd208dc7af None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:04.250421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec11a4c-353a-478a-9611-babd208dc7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:04.307838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-dec11a4c-353a-478a-9611-babd208dc7af None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:06:04.309515 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-dec11a4c-353a-478a-9611-babd208dc7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:04.455547 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:04.523515 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1826/3700] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:06:04.983357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450cb27-2f70-406c-8842-489ccd31e966 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:04.986302 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7450cb27-2f70-406c-8842-489ccd31e966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:05.138754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450cb27-2f70-406c-8842-489ccd31e966 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:05.146711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c4de5-6e21-4f43-bbbe-a17a5767ea21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:05.147312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c4de5-6e21-4f43-bbbe-a17a5767ea21 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:05.147860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c4de5-6e21-4f43-bbbe-a17a5767ea21 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:05.148731 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c4de5-6e21-4f43-bbbe-a17a5767ea21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:05.183999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c4de5-6e21-4f43-bbbe-a17a5767ea21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:05.195924 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c4de5-6e21-4f43-bbbe-a17a5767ea21 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:05.228949 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1875/3701] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:06:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:06:06.060814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4eda0a-28bf-49cf-b7c4-b6093942c379 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:06.061635 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4eda0a-28bf-49cf-b7c4-b6093942c379 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:06.062089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4eda0a-28bf-49cf-b7c4-b6093942c379 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:06.064458 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1827/3702] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 21:06:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 21:06:06.070475 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4575b-9365-42af-83d0-2243ab7f1105 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:06.071569 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4575b-9365-42af-83d0-2243ab7f1105 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:06.072642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4575b-9365-42af-83d0-2243ab7f1105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:06.174868 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-0be4575b-9365-42af-83d0-2243ab7f1105 None None] MFA Rules not processed for user `174e91100a184740b7c604730266dc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:06:06.176564 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0be4575b-9365-42af-83d0-2243ab7f1105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:06.199748 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1876/3703] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:06:06 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:06:06.218937 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4eda0a-28bf-49cf-b7c4-b6093942c379 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:06.221899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4e4eda0a-28bf-49cf-b7c4-b6093942c379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:06.254502 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4eda0a-28bf-49cf-b7c4-b6093942c379 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:06.267070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9e57e-3f40-4dba-bde5-b4a09d4eed92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:06.271506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9e57e-3f40-4dba-bde5-b4a09d4eed92 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:06.271650 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9e57e-3f40-4dba-bde5-b4a09d4eed92 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:06.271931 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9e57e-3f40-4dba-bde5-b4a09d4eed92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:06.295302 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9e57e-3f40-4dba-bde5-b4a09d4eed92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:06.298222 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9e57e-3f40-4dba-bde5-b4a09d4eed92 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:06.323015 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1828/3704] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:06:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:06:06.722766 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4575b-9365-42af-83d0-2243ab7f1105 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:06.725057 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0be4575b-9365-42af-83d0-2243ab7f1105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:06.746412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4575b-9365-42af-83d0-2243ab7f1105 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:06.755371 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfe085-8e12-4427-89f9-014190988cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:06.756456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfe085-8e12-4427-89f9-014190988cf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:06.756974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfe085-8e12-4427-89f9-014190988cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:06.757401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfe085-8e12-4427-89f9-014190988cf2 admin admin] PATH_INFO: `/v3/projects/ec9464cebb2d40e3930fb285b21b37c7` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:06.758891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfe085-8e12-4427-89f9-014190988cf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec9464cebb2d40e3930fb285b21b37c7)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:06.762101 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfe085-8e12-4427-89f9-014190988cf2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:06.852349 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9ecfe085-8e12-4427-89f9-014190988cf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec9464cebb2d40e3930fb285b21b37c7', 'request_id': 'req-9ecfe085-8e12-4427-89f9-014190988cf2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:06.862594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9ecfe085-8e12-4427-89f9-014190988cf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec9464cebb2d40e3930fb285b21b37c7', 'request_id': 'req-9ecfe085-8e12-4427-89f9-014190988cf2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:06.871146 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:06.883091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9ecfe085-8e12-4427-89f9-014190988cf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec9464cebb2d40e3930fb285b21b37c7', 'request_id': 'req-9ecfe085-8e12-4427-89f9-014190988cf2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:06.910769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9ecfe085-8e12-4427-89f9-014190988cf2 admin admin] The token cache is being invalidate because project ec9464cebb2d40e3930fb285b21b37c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:06:06.919235 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9ecfe085-8e12-4427-89f9-014190988cf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:06.920799 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9ecfe085-8e12-4427-89f9-014190988cf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:06.927184 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1877/3705] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:06:06 2022] DELETE /identity/v3/projects/ec9464cebb2d40e3930fb285b21b37c7 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:06:06.928524 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c86705-58f1-4709-8939-28942bb048fe None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:06.929376 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c86705-58f1-4709-8939-28942bb048fe None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:06.929808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c86705-58f1-4709-8939-28942bb048fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:06.977390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a2c86705-58f1-4709-8939-28942bb048fe None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:06:06.978851 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a2c86705-58f1-4709-8939-28942bb048fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:07.123008 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1829/3706] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:06:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:06:07.131407 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80607d26-98df-489a-bcd8-3c73feec7d69 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:07.131976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80607d26-98df-489a-bcd8-3c73feec7d69 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:07.132306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80607d26-98df-489a-bcd8-3c73feec7d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:07.164402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5d099-e708-4478-b7bc-7f7ef859d898 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:07.165006 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5d099-e708-4478-b7bc-7f7ef859d898 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:07.167833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5d099-e708-4478-b7bc-7f7ef859d898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:07.183127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-80607d26-98df-489a-bcd8-3c73feec7d69 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:06:07.185855 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-80607d26-98df-489a-bcd8-3c73feec7d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:07.219287 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1878/3707] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:06:07.219287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80607d26-98df-489a-bcd8-3c73feec7d69 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:07.233441 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-5ba5d099-e708-4478-b7bc-7f7ef859d898 None None] MFA Rules not processed for user `7dcd210e197347f8ad1622ee882bee92`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:06:07.234828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5ba5d099-e708-4478-b7bc-7f7ef859d898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:07.245150 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80607d26-98df-489a-bcd8-3c73feec7d69 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:07.251869 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452e616-bea1-46e1-aa40-1a61e076fa5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:07.254410 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452e616-bea1-46e1-aa40-1a61e076fa5e admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:07.254932 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452e616-bea1-46e1-aa40-1a61e076fa5e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:07.255411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452e616-bea1-46e1-aa40-1a61e076fa5e admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:07.256446 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452e616-bea1-46e1-aa40-1a61e076fa5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:06:07.256983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452e616-bea1-46e1-aa40-1a61e076fa5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:07.259252 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452e616-bea1-46e1-aa40-1a61e076fa5e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:07.291796 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1879/3708] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:06:07.296223 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452e616-bea1-46e1-aa40-1a61e076fa5e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:07.317705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452e616-bea1-46e1-aa40-1a61e076fa5e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:07.324301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09f730-f6a4-46f7-a026-6a0d4df9a2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:07.325005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09f730-f6a4-46f7-a026-6a0d4df9a2d6 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:07.325449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09f730-f6a4-46f7-a026-6a0d4df9a2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:07.325912 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09f730-f6a4-46f7-a026-6a0d4df9a2d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:07.326494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c09f730-f6a4-46f7-a026-6a0d4df9a2d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:07.329439 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c09f730-f6a4-46f7-a026-6a0d4df9a2d6 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:07.373094 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1880/3709] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:06:07 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:06:07.375125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09f730-f6a4-46f7-a026-6a0d4df9a2d6 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:07.438608 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1830/3710] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:06:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:06:07.530717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09f730-f6a4-46f7-a026-6a0d4df9a2d6 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:07.536811 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2f458-2770-439f-92c7-d971798b8174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:07.537439 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2f458-2770-439f-92c7-d971798b8174 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:07.538367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2f458-2770-439f-92c7-d971798b8174 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:07.538707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2f458-2770-439f-92c7-d971798b8174 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:07.539410 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b2f458-2770-439f-92c7-d971798b8174 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:07.542097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b2f458-2770-439f-92c7-d971798b8174 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:07.585791 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1881/3711] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:06:07 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:06:07.589463 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5d099-e708-4478-b7bc-7f7ef859d898 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:07.609953 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5d099-e708-4478-b7bc-7f7ef859d898 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:07.623780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1d445-913c-480f-a095-6eb8b03216c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:07.624412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1d445-913c-480f-a095-6eb8b03216c2 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:07.624690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1d445-913c-480f-a095-6eb8b03216c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:07.624961 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1d445-913c-480f-a095-6eb8b03216c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:07.625612 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef1d445-913c-480f-a095-6eb8b03216c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:07.629761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef1d445-913c-480f-a095-6eb8b03216c2 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:07.656427 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1831/3712] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:06:07.660162 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2f458-2770-439f-92c7-d971798b8174 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:07.675259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2f458-2770-439f-92c7-d971798b8174 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:07.682150 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae83c7-f473-439d-b61c-5c3fdf218edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:07.683026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae83c7-f473-439d-b61c-5c3fdf218edf admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:07.683736 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae83c7-f473-439d-b61c-5c3fdf218edf admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:07.684426 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae83c7-f473-439d-b61c-5c3fdf218edf admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:07.686138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae83c7-f473-439d-b61c-5c3fdf218edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:07.688040 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae83c7-f473-439d-b61c-5c3fdf218edf admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:07.744653 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1d445-913c-480f-a095-6eb8b03216c2 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:07.756798 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1882/3713] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:06:07.763957 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1d445-913c-480f-a095-6eb8b03216c2 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:07.784944 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff864b-f912-4fc5-8e87-8516f8607d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:07.786129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff864b-f912-4fc5-8e87-8516f8607d40 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:07.786620 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff864b-f912-4fc5-8e87-8516f8607d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:07.787075 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff864b-f912-4fc5-8e87-8516f8607d40 admin admin] PATH_INFO: `/v3/projects/6b68ddb3badb454dac41733610ea2b71/users/55a4c0dae0d04e55b786ca572769bf8c/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:07.845220 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff864b-f912-4fc5-8e87-8516f8607d40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b68ddb3badb454dac41733610ea2b71, user_id=55a4c0dae0d04e55b786ca572769bf8c, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:07.848233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff864b-f912-4fc5-8e87-8516f8607d40 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:07.878434 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1832/3714] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:06:07 2022] PUT /identity/v3/projects/6b68ddb3badb454dac41733610ea2b71/users/55a4c0dae0d04e55b786ca572769bf8c/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:06:07.890609 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc4614-f187-4e7c-a034-824561a06c05 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:07.890935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc4614-f187-4e7c-a034-824561a06c05 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:07.891284 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc4614-f187-4e7c-a034-824561a06c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:07.948018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-8bcc4614-f187-4e7c-a034-824561a06c05 None None] MFA Rules not processed for user `55a4c0dae0d04e55b786ca572769bf8c`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:06:07.953724 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8bcc4614-f187-4e7c-a034-824561a06c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:08.068256 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1883/3715] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:06:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:06:08.089334 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff864b-f912-4fc5-8e87-8516f8607d40 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:08.091469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-deff864b-f912-4fc5-8e87-8516f8607d40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:08.212348 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:08.285522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff864b-f912-4fc5-8e87-8516f8607d40 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:08.294266 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01192b-149d-4356-a91d-1a2c2529fa53 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10759b2abd4cafacf338551327775e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:08.294950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01192b-149d-4356-a91d-1a2c2529fa53 service glance] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:08.295204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01192b-149d-4356-a91d-1a2c2529fa53 service glance] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:08.295670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01192b-149d-4356-a91d-1a2c2529fa53 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:08.313944 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01192b-149d-4356-a91d-1a2c2529fa53 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:08.315621 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01192b-149d-4356-a91d-1a2c2529fa53 service glance] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:08.354664 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1833/3716] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:06:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:06:09.563823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b604837-16b0-40e2-b769-6f434cec2aa5 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:09.565513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b604837-16b0-40e2-b769-6f434cec2aa5 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:09.565964 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b604837-16b0-40e2-b769-6f434cec2aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:09.576463 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c30e54-3490-47f7-9cd7-e47bfc2919fe None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:09.577149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c30e54-3490-47f7-9cd7-e47bfc2919fe None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:09.577149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c30e54-3490-47f7-9cd7-e47bfc2919fe None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:09.578352 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1834/3717] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 21:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 21:06:09.584449 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae50ea5-ae1c-42dd-956b-90546a6c6cab None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:09.584998 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae50ea5-ae1c-42dd-956b-90546a6c6cab None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:09.585437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae50ea5-ae1c-42dd-956b-90546a6c6cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:09.626748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-eae50ea5-ae1c-42dd-956b-90546a6c6cab None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:06:09.628002 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-eae50ea5-ae1c-42dd-956b-90546a6c6cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:09.631626 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-8b604837-16b0-40e2-b769-6f434cec2aa5 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:06:09.632850 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8b604837-16b0-40e2-b769-6f434cec2aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:09.659361 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:09.781209 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1884/3718] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:06:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:06:09.794042 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b604837-16b0-40e2-b769-6f434cec2aa5 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:09.795935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8b604837-16b0-40e2-b769-6f434cec2aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:09.803356 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1835/3719] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:06:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:06:09.835037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae50ea5-ae1c-42dd-956b-90546a6c6cab None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:09.836479 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-eae50ea5-ae1c-42dd-956b-90546a6c6cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:09.871602 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae50ea5-ae1c-42dd-956b-90546a6c6cab None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:09.882137 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa97f0af-2857-412a-9941-0d21e2807bbc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:09.883068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97f0af-2857-412a-9941-0d21e2807bbc service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:09.883574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97f0af-2857-412a-9941-0d21e2807bbc service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:09.886224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97f0af-2857-412a-9941-0d21e2807bbc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:09.905750 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa97f0af-2857-412a-9941-0d21e2807bbc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:09.908251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa97f0af-2857-412a-9941-0d21e2807bbc service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:09.988103 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1836/3720] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:06:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:06:10.040987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b604837-16b0-40e2-b769-6f434cec2aa5 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:10.075376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19f71a-d884-4ca4-b309-b846729e1b1e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:10.077768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19f71a-d884-4ca4-b309-b846729e1b1e service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:10.090598 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19f71a-d884-4ca4-b309-b846729e1b1e service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:10.091688 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19f71a-d884-4ca4-b309-b846729e1b1e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:10.138627 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19f71a-d884-4ca4-b309-b846729e1b1e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:10.138627 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19f71a-d884-4ca4-b309-b846729e1b1e service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:10.147691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef80bbb-6d42-4c84-ac84-2ffb82c8732e None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:10.147985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef80bbb-6d42-4c84-ac84-2ffb82c8732e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:10.148264 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef80bbb-6d42-4c84-ac84-2ffb82c8732e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:10.154082 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1885/3721] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:06:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:06:10.188245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-bef80bbb-6d42-4c84-ac84-2ffb82c8732e None None] MFA Rules not processed for user `7dcd210e197347f8ad1622ee882bee92`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:06:10.194815 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-bef80bbb-6d42-4c84-ac84-2ffb82c8732e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:10.360136 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1837/3722] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:06:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:06:12.370423 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d0d24-7be5-4a05-b972-dbd6abfa6058 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:12.372520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d0d24-7be5-4a05-b972-dbd6abfa6058 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:12.373039 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d0d24-7be5-4a05-b972-dbd6abfa6058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:12.404590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-297d0d24-7be5-4a05-b972-dbd6abfa6058 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:06:12.406136 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-297d0d24-7be5-4a05-b972-dbd6abfa6058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:12.432233 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1886/3723] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:06:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:06:12.433109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef80bbb-6d42-4c84-ac84-2ffb82c8732e None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:12.452374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef80bbb-6d42-4c84-ac84-2ffb82c8732e None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:12.484064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf202a-525d-450f-81e4-2ff6431f265e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:12.485438 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf202a-525d-450f-81e4-2ff6431f265e service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:12.485874 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf202a-525d-450f-81e4-2ff6431f265e service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:12.486311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf202a-525d-450f-81e4-2ff6431f265e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:12.497603 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf202a-525d-450f-81e4-2ff6431f265e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:12.499499 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf202a-525d-450f-81e4-2ff6431f265e service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:12.511174 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1838/3724] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:06:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 06 21:06:14.305181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b5037-2f57-4596-bdee-3a0adbcbad6d None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:14.305766 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b5037-2f57-4596-bdee-3a0adbcbad6d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:14.305766 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b5037-2f57-4596-bdee-3a0adbcbad6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:14.346513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-cf0b5037-2f57-4596-bdee-3a0adbcbad6d None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:06:14.349653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-cf0b5037-2f57-4596-bdee-3a0adbcbad6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:14.375117 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1887/3725] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:06:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:06:14.391251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf202a-525d-450f-81e4-2ff6431f265e service swift] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:14.406839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf202a-525d-450f-81e4-2ff6431f265e service swift] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:14.422887 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a6937-f1f5-4416-89b8-76864b359126 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:14.423662 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a6937-f1f5-4416-89b8-76864b359126 service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:14.424130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a6937-f1f5-4416-89b8-76864b359126 service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:14.424643 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a6937-f1f5-4416-89b8-76864b359126 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:14.443291 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a6937-f1f5-4416-89b8-76864b359126 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:14.445280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a6937-f1f5-4416-89b8-76864b359126 service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:14.469519 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1839/3726] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:06:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:06:14.938465 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dddb12-213e-4907-9317-cbd0b87fbc62 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:14.938776 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dddb12-213e-4907-9317-cbd0b87fbc62 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:14.939067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dddb12-213e-4907-9317-cbd0b87fbc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:14.972355 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-f9dddb12-213e-4907-9317-cbd0b87fbc62 None None] MFA Rules not processed for user `55a4c0dae0d04e55b786ca572769bf8c`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:06:15.006318 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f9dddb12-213e-4907-9317-cbd0b87fbc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:15.019714 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1888/3727] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:06:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:06:16.887302 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3e0c3-913a-46bc-8e90-48edc6bdfddb None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:16.887921 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3e0c3-913a-46bc-8e90-48edc6bdfddb None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:16.887921 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3e0c3-913a-46bc-8e90-48edc6bdfddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:16.932378 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-23c3e0c3-913a-46bc-8e90-48edc6bdfddb None None] MFA Rules not processed for user `55a4c0dae0d04e55b786ca572769bf8c`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:06:16.933612 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-23c3e0c3-913a-46bc-8e90-48edc6bdfddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:16.960435 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1840/3728] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:06:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:06:17.835760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dddb12-213e-4907-9317-cbd0b87fbc62 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:17.851697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dddb12-213e-4907-9317-cbd0b87fbc62 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:17.859276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb1810-fbbe-494f-858a-4d6eb69c791f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:17.860350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb1810-fbbe-494f-858a-4d6eb69c791f service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:17.861709 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb1810-fbbe-494f-858a-4d6eb69c791f service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:17.862222 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb1810-fbbe-494f-858a-4d6eb69c791f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:17.865018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-38fb1810-fbbe-494f-858a-4d6eb69c791f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:17.884876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb1810-fbbe-494f-858a-4d6eb69c791f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:17.887939 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb1810-fbbe-494f-858a-4d6eb69c791f service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:17.902029 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1889/3729] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:06:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:06:19.176371 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5468e8-fdf0-4499-9b8a-ce1c343faf62 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:19.177216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5468e8-fdf0-4499-9b8a-ce1c343faf62 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:19.177555 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5468e8-fdf0-4499-9b8a-ce1c343faf62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:19.233789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-0e5468e8-fdf0-4499-9b8a-ce1c343faf62 None None] MFA Rules not processed for user `f7cf258df10248d0bdcf64fa075c132c`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:06:19.235137 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0e5468e8-fdf0-4499-9b8a-ce1c343faf62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:19.258281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:19.392525 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1841/3730] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:06:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:06:19.402772 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd24ae-d3e9-4da5-a185-df6e84dfbcca None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:19.403849 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd24ae-d3e9-4da5-a185-df6e84dfbcca None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:19.404381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd24ae-d3e9-4da5-a185-df6e84dfbcca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:19.443195 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-c4cd24ae-d3e9-4da5-a185-df6e84dfbcca None None] MFA Rules not processed for user `f7cf258df10248d0bdcf64fa075c132c`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:06:19.445664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c4cd24ae-d3e9-4da5-a185-df6e84dfbcca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:19.485704 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1890/3731] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:06:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:06:19.676061 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5468e8-fdf0-4499-9b8a-ce1c343faf62 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:19.677706 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0e5468e8-fdf0-4499-9b8a-ce1c343faf62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:19.794437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5468e8-fdf0-4499-9b8a-ce1c343faf62 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:19.801118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119dc31-232c-4058-a8a6-ed089e2f6eba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:19.802168 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119dc31-232c-4058-a8a6-ed089e2f6eba service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:19.802798 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119dc31-232c-4058-a8a6-ed089e2f6eba service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:19.803307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119dc31-232c-4058-a8a6-ed089e2f6eba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:19.817291 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119dc31-232c-4058-a8a6-ed089e2f6eba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:19.819991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119dc31-232c-4058-a8a6-ed089e2f6eba service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:19.859789 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1842/3732] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:06:19 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:06:22.551292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fa78b-96a6-4ecc-822e-46ea367a337c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:22.551917 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fa78b-96a6-4ecc-822e-46ea367a337c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:22.552481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fa78b-96a6-4ecc-822e-46ea367a337c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:22.603835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-188fa78b-96a6-4ecc-822e-46ea367a337c None None] MFA Rules not processed for user `f7cf258df10248d0bdcf64fa075c132c`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:06:22.617837 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-188fa78b-96a6-4ecc-822e-46ea367a337c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:22.637457 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1891/3733] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:06:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:06:24.527130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119dc31-232c-4058-a8a6-ed089e2f6eba service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:24.528583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e119dc31-232c-4058-a8a6-ed089e2f6eba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:24.708802 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119dc31-232c-4058-a8a6-ed089e2f6eba service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:24.719919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a1f2e-a3c3-4f0a-8ff5-5a1f7eb001ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:24.721297 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a1f2e-a3c3-4f0a-8ff5-5a1f7eb001ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:24.721651 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a1f2e-a3c3-4f0a-8ff5-5a1f7eb001ac admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:24.722052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a1f2e-a3c3-4f0a-8ff5-5a1f7eb001ac admin admin] PATH_INFO: `/v3/users/e0943fdb586241b796e349e08c778f28` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:24.723804 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a1f2e-a3c3-4f0a-8ff5-5a1f7eb001ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0943fdb586241b796e349e08c778f28)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:24.726153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a1f2e-a3c3-4f0a-8ff5-5a1f7eb001ac admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:24.857223 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:24.893671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-454a1f2e-a3c3-4f0a-8ff5-5a1f7eb001ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0943fdb586241b796e349e08c778f28'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:24.895093 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-454a1f2e-a3c3-4f0a-8ff5-5a1f7eb001ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0943fdb586241b796e349e08c778f28'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:24.896805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-454a1f2e-a3c3-4f0a-8ff5-5a1f7eb001ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0943fdb586241b796e349e08c778f28'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:24.909958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-454a1f2e-a3c3-4f0a-8ff5-5a1f7eb001ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0943fdb586241b796e349e08c778f28'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:24.945776 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-454a1f2e-a3c3-4f0a-8ff5-5a1f7eb001ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0943fdb586241b796e349e08c778f28'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:24.972223 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1843/3734] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:06:24 2022] DELETE /identity/v3/users/e0943fdb586241b796e349e08c778f28 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:06:25.359048 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188fa78b-96a6-4ecc-822e-46ea367a337c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:25.378049 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188fa78b-96a6-4ecc-822e-46ea367a337c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:25.510376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08d5811-5045-4aa1-b3e7-c48d80967957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:25.511504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d5811-5045-4aa1-b3e7-c48d80967957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:25.511797 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d5811-5045-4aa1-b3e7-c48d80967957 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:25.512108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d5811-5045-4aa1-b3e7-c48d80967957 admin admin] PATH_INFO: `/v3/projects/90a59ffcb8834a50b1e8fa57aa9e89d2` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:25.517979 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08d5811-5045-4aa1-b3e7-c48d80967957 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90a59ffcb8834a50b1e8fa57aa9e89d2)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:25.519981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08d5811-5045-4aa1-b3e7-c48d80967957 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:25.522700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:25.561722 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d69ce-b6dc-41e6-ac09-3b53739e73fa None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:25.562250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d69ce-b6dc-41e6-ac09-3b53739e73fa None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:25.562250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d69ce-b6dc-41e6-ac09-3b53739e73fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:25.601875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d08d5811-5045-4aa1-b3e7-c48d80967957 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'request_id': 'req-d08d5811-5045-4aa1-b3e7-c48d80967957'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:25.608560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d08d5811-5045-4aa1-b3e7-c48d80967957 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'request_id': 'req-d08d5811-5045-4aa1-b3e7-c48d80967957'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:25.621741 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d08d5811-5045-4aa1-b3e7-c48d80967957 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'request_id': 'req-d08d5811-5045-4aa1-b3e7-c48d80967957'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:25.637332 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f83d69ce-b6dc-41e6-ac09-3b53739e73fa None None] MFA Rules not processed for user `bdf1b5180a814cf39234892c6c1f26df`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:06:25.640043 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f83d69ce-b6dc-41e6-ac09-3b53739e73fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:25.653622 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d08d5811-5045-4aa1-b3e7-c48d80967957 admin admin] The token cache is being invalidate because project 90a59ffcb8834a50b1e8fa57aa9e89d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:06:25.655114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d08d5811-5045-4aa1-b3e7-c48d80967957 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:25.657468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d08d5811-5045-4aa1-b3e7-c48d80967957 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:25.660541 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1892/3735] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:06:25 2022] DELETE /identity/v3/projects/90a59ffcb8834a50b1e8fa57aa9e89d2 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:06:25.667976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83c948-98a4-46fa-bee0-40a7f2600db4 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:25.668494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83c948-98a4-46fa-bee0-40a7f2600db4 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:25.669064 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83c948-98a4-46fa-bee0-40a7f2600db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:25.716271 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-1e83c948-98a4-46fa-bee0-40a7f2600db4 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:06:25.719931 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1e83c948-98a4-46fa-bee0-40a7f2600db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:25.743774 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1844/3736] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:06:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:06:25.824665 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1893/3737] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:06:25.833874 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472fe9b-962a-4882-8e4b-dba690851298 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:25.834171 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472fe9b-962a-4882-8e4b-dba690851298 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:25.834433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472fe9b-962a-4882-8e4b-dba690851298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:25.864340 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-7472fe9b-962a-4882-8e4b-dba690851298 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:06:25.866204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7472fe9b-962a-4882-8e4b-dba690851298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:25.883740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83c948-98a4-46fa-bee0-40a7f2600db4 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:25.890345 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1845/3738] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:06:25.901013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83c948-98a4-46fa-bee0-40a7f2600db4 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:25.914179 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83be77-731b-48c3-a490-03f3b2b0e2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:25.915680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83be77-731b-48c3-a490-03f3b2b0e2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:25.916301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83be77-731b-48c3-a490-03f3b2b0e2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:25.916653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83be77-731b-48c3-a490-03f3b2b0e2c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:25.917535 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83be77-731b-48c3-a490-03f3b2b0e2c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:06:25.917793 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83be77-731b-48c3-a490-03f3b2b0e2c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:25.919577 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83be77-731b-48c3-a490-03f3b2b0e2c3 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:25.945982 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1894/3739] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:06:25.950576 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472fe9b-962a-4882-8e4b-dba690851298 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:25.963490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472fe9b-962a-4882-8e4b-dba690851298 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:25.969966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ffb755-9a68-4661-ba6d-807bb8235dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:25.970953 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffb755-9a68-4661-ba6d-807bb8235dcc admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:25.971416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffb755-9a68-4661-ba6d-807bb8235dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:25.971835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffb755-9a68-4661-ba6d-807bb8235dcc admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:25.972662 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ffb755-9a68-4661-ba6d-807bb8235dcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:25.976206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ffb755-9a68-4661-ba6d-807bb8235dcc admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:26.027169 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1846/3740] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:06:25 2022] POST /identity/v3/projects => generated 371 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:06:26.033806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83be77-731b-48c3-a490-03f3b2b0e2c3 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:26.050984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83be77-731b-48c3-a490-03f3b2b0e2c3 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:26.230611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d9640-2b12-4462-b1e4-ae17b918c39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:26.231527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d9640-2b12-4462-b1e4-ae17b918c39d admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:26.232069 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d9640-2b12-4462-b1e4-ae17b918c39d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:26.232348 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d9640-2b12-4462-b1e4-ae17b918c39d admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:26.232964 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d9640-2b12-4462-b1e4-ae17b918c39d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:26.235491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d9640-2b12-4462-b1e4-ae17b918c39d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:26.282927 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1895/3741] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:06:26 2022] POST /identity/v3/users => generated 286 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:06:26.293492 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ffb755-9a68-4661-ba6d-807bb8235dcc admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:26.310754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ffb755-9a68-4661-ba6d-807bb8235dcc admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:26.325459 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39d202-7227-4670-8e60-731dcf34848c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:26.327574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39d202-7227-4670-8e60-731dcf34848c admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:26.328243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39d202-7227-4670-8e60-731dcf34848c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:26.328958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39d202-7227-4670-8e60-731dcf34848c admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:26.329934 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c39d202-7227-4670-8e60-731dcf34848c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:26.332726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c39d202-7227-4670-8e60-731dcf34848c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:26.362900 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1847/3742] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:06:26.366499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d9640-2b12-4462-b1e4-ae17b918c39d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:26.382753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d9640-2b12-4462-b1e4-ae17b918c39d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:26.395449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc5531-3fe3-4002-bab2-51d293ca8129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:26.396086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc5531-3fe3-4002-bab2-51d293ca8129 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:26.396366 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc5531-3fe3-4002-bab2-51d293ca8129 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:26.396624 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc5531-3fe3-4002-bab2-51d293ca8129 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:26.397304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc5531-3fe3-4002-bab2-51d293ca8129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:26.398917 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc5531-3fe3-4002-bab2-51d293ca8129 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:26.407343 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:26.430195 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1896/3743] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:06:26.431716 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39d202-7227-4670-8e60-731dcf34848c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:26.447637 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39d202-7227-4670-8e60-731dcf34848c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:26.459602 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbee89-9e7f-4b06-a037-89a226740da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:26.460292 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbee89-9e7f-4b06-a037-89a226740da0 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:26.460586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbee89-9e7f-4b06-a037-89a226740da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:26.460846 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbee89-9e7f-4b06-a037-89a226740da0 admin admin] PATH_INFO: `/v3/projects/95da58be1d84408098e2cf3513db3846/users/d4b581ed648446a59900f2d275de4bf4/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:26.499419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cbee89-9e7f-4b06-a037-89a226740da0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95da58be1d84408098e2cf3513db3846, user_id=d4b581ed648446a59900f2d275de4bf4, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:26.504222 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cbee89-9e7f-4b06-a037-89a226740da0 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:26.541509 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fa663-535d-44ca-8e55-0dccbfd011ec None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:26.541806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fa663-535d-44ca-8e55-0dccbfd011ec None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:26.542441 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1848/3744] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:06:26 2022] PUT /identity/v3/projects/95da58be1d84408098e2cf3513db3846/users/d4b581ed648446a59900f2d275de4bf4/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:06:26.544178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fa663-535d-44ca-8e55-0dccbfd011ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:26.619315 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-6d1fa663-535d-44ca-8e55-0dccbfd011ec None None] MFA Rules not processed for user `d4b581ed648446a59900f2d275de4bf4`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:06:26.621086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6d1fa663-535d-44ca-8e55-0dccbfd011ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:26.814140 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1897/3745] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:06:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:06:26.818695 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ce573-70d4-4785-b1f7-c966ab4f0463 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:26.819276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ce573-70d4-4785-b1f7-c966ab4f0463 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:26.819276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ce573-70d4-4785-b1f7-c966ab4f0463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:26.842618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-177ce573-70d4-4785-b1f7-c966ab4f0463 None None] MFA Rules not processed for user `d4b581ed648446a59900f2d275de4bf4`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:06:26.843929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-177ce573-70d4-4785-b1f7-c966ab4f0463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:26.854812 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1849/3746] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:06:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:06:27.020851 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1fa663-535d-44ca-8e55-0dccbfd011ec None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:27.023370 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6d1fa663-535d-44ca-8e55-0dccbfd011ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:27.132333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1fa663-535d-44ca-8e55-0dccbfd011ec None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:27.138613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdecf1cd-f5a0-46d0-9ab2-902c328de4f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:27.139867 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdecf1cd-f5a0-46d0-9ab2-902c328de4f0 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:27.140152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdecf1cd-f5a0-46d0-9ab2-902c328de4f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:27.140415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdecf1cd-f5a0-46d0-9ab2-902c328de4f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:27.142218 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-fdecf1cd-f5a0-46d0-9ab2-902c328de4f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:27.239895 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdecf1cd-f5a0-46d0-9ab2-902c328de4f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:27.241530 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdecf1cd-f5a0-46d0-9ab2-902c328de4f0 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:27.254123 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1898/3747] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:06:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:06:28.567493 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ce573-70d4-4785-b1f7-c966ab4f0463 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:28.569892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-177ce573-70d4-4785-b1f7-c966ab4f0463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:28.703058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:28.747891 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ce573-70d4-4785-b1f7-c966ab4f0463 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:28.756516 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41475bc-47ea-429f-bdb0-a08b82f5b56a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:28.757374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41475bc-47ea-429f-bdb0-a08b82f5b56a service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:28.757972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41475bc-47ea-429f-bdb0-a08b82f5b56a service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:28.758422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41475bc-47ea-429f-bdb0-a08b82f5b56a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:28.772869 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41475bc-47ea-429f-bdb0-a08b82f5b56a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:28.775297 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41475bc-47ea-429f-bdb0-a08b82f5b56a service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:28.792197 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1850/3748] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:06:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:06:35.815817 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdecf1cd-f5a0-46d0-9ab2-902c328de4f0 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:35.817397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-fdecf1cd-f5a0-46d0-9ab2-902c328de4f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:35.889359 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:35.927794 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdecf1cd-f5a0-46d0-9ab2-902c328de4f0 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:35.934693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e40ffd-1b77-426e-bd30-205211d2b870 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:35.935990 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e40ffd-1b77-426e-bd30-205211d2b870 service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:35.936943 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e40ffd-1b77-426e-bd30-205211d2b870 service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:35.937542 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e40ffd-1b77-426e-bd30-205211d2b870 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:35.940522 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-61e40ffd-1b77-426e-bd30-205211d2b870 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:35.955217 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e40ffd-1b77-426e-bd30-205211d2b870 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:35.957127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e40ffd-1b77-426e-bd30-205211d2b870 service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:35.981609 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1899/3749] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:06:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:06:38.688719 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863102e9-10b2-4f4a-bbe1-048e4dcc6a42 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:38.689165 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863102e9-10b2-4f4a-bbe1-048e4dcc6a42 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:38.689248 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863102e9-10b2-4f4a-bbe1-048e4dcc6a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:38.767420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-863102e9-10b2-4f4a-bbe1-048e4dcc6a42 None None] MFA Rules not processed for user `7dcd210e197347f8ad1622ee882bee92`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:06:38.769106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-863102e9-10b2-4f4a-bbe1-048e4dcc6a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:38.856980 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1851/3750] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:06:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:06:43.129232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e40ffd-1b77-426e-bd30-205211d2b870 service placement] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:43.130701 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-61e40ffd-1b77-426e-bd30-205211d2b870 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:43.155001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e40ffd-1b77-426e-bd30-205211d2b870 service placement] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:43.171491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149eea39-2ec4-45d7-aecc-624c1b4917e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:43.172314 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149eea39-2ec4-45d7-aecc-624c1b4917e6 service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:43.172599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149eea39-2ec4-45d7-aecc-624c1b4917e6 service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:43.173236 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149eea39-2ec4-45d7-aecc-624c1b4917e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:43.175568 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-149eea39-2ec4-45d7-aecc-624c1b4917e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:43.191250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149eea39-2ec4-45d7-aecc-624c1b4917e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:43.193129 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149eea39-2ec4-45d7-aecc-624c1b4917e6 service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:43.214334 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1900/3751] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:06:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:06:46.372674 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863102e9-10b2-4f4a-bbe1-048e4dcc6a42 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:46.374784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-863102e9-10b2-4f4a-bbe1-048e4dcc6a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:46.392920 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863102e9-10b2-4f4a-bbe1-048e4dcc6a42 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:46.399630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e0688-d901-448a-800a-a1da33c4b870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:46.400615 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e0688-d901-448a-800a-a1da33c4b870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:46.401066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e0688-d901-448a-800a-a1da33c4b870 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:46.401503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e0688-d901-448a-800a-a1da33c4b870 admin admin] PATH_INFO: `/v3/users/dd9a63d793aa4a55822bfe108df664a3` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:46.403003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e0688-d901-448a-800a-a1da33c4b870 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd9a63d793aa4a55822bfe108df664a3)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:46.406453 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e0688-d901-448a-800a-a1da33c4b870 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:46.475415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-654e0688-d901-448a-800a-a1da33c4b870 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd9a63d793aa4a55822bfe108df664a3'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:46.476367 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-654e0688-d901-448a-800a-a1da33c4b870 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd9a63d793aa4a55822bfe108df664a3'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:46.477808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-654e0688-d901-448a-800a-a1da33c4b870 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd9a63d793aa4a55822bfe108df664a3'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:46.488212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-654e0688-d901-448a-800a-a1da33c4b870 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd9a63d793aa4a55822bfe108df664a3'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:46.512211 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-654e0688-d901-448a-800a-a1da33c4b870 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd9a63d793aa4a55822bfe108df664a3'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:46.530771 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1852/3752] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:06:46 2022] DELETE /identity/v3/users/dd9a63d793aa4a55822bfe108df664a3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:06:46.974466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149eea39-2ec4-45d7-aecc-624c1b4917e6 service placement] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:47.015555 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149eea39-2ec4-45d7-aecc-624c1b4917e6 service placement] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:47.095189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1c51d-3a1d-4c6c-9ee6-29d2efbae647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:47.096040 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1c51d-3a1d-4c6c-9ee6-29d2efbae647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:47.098582 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1c51d-3a1d-4c6c-9ee6-29d2efbae647 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:47.098986 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1c51d-3a1d-4c6c-9ee6-29d2efbae647 admin admin] PATH_INFO: `/v3/projects/26d35f36722e4fc8ac7d222cf93883e9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:47.100427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1c51d-3a1d-4c6c-9ee6-29d2efbae647 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26d35f36722e4fc8ac7d222cf93883e9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:47.102737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1c51d-3a1d-4c6c-9ee6-29d2efbae647 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:47.166109 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-edb1c51d-3a1d-4c6c-9ee6-29d2efbae647 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26d35f36722e4fc8ac7d222cf93883e9', 'request_id': 'req-edb1c51d-3a1d-4c6c-9ee6-29d2efbae647'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:47.176333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-edb1c51d-3a1d-4c6c-9ee6-29d2efbae647 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26d35f36722e4fc8ac7d222cf93883e9', 'request_id': 'req-edb1c51d-3a1d-4c6c-9ee6-29d2efbae647'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:47.190786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-edb1c51d-3a1d-4c6c-9ee6-29d2efbae647 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26d35f36722e4fc8ac7d222cf93883e9', 'request_id': 'req-edb1c51d-3a1d-4c6c-9ee6-29d2efbae647'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:47.206894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-edb1c51d-3a1d-4c6c-9ee6-29d2efbae647 admin admin] The token cache is being invalidate because project 26d35f36722e4fc8ac7d222cf93883e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:06:47.207534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-edb1c51d-3a1d-4c6c-9ee6-29d2efbae647 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:47.208350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-edb1c51d-3a1d-4c6c-9ee6-29d2efbae647 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:47.212692 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1901/3753] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:06:46 2022] DELETE /identity/v3/projects/26d35f36722e4fc8ac7d222cf93883e9 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:06:47.213991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e0688-d901-448a-800a-a1da33c4b870 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:47.217371 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-654e0688-d901-448a-800a-a1da33c4b870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:47.239923 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e0688-d901-448a-800a-a1da33c4b870 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:47.330458 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:47.339128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c9143-22c7-4d5c-b37c-d71c82fff6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:47.339880 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c9143-22c7-4d5c-b37c-d71c82fff6ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:47.340526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c9143-22c7-4d5c-b37c-d71c82fff6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:47.342936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c9143-22c7-4d5c-b37c-d71c82fff6ab admin admin] PATH_INFO: `/v3/users/09abf99d2b254ebb983fa6ec55bc5969` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:47.344332 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c9143-22c7-4d5c-b37c-d71c82fff6ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=09abf99d2b254ebb983fa6ec55bc5969)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:47.346915 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c9143-22c7-4d5c-b37c-d71c82fff6ab admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:47.447380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fb5c9143-22c7-4d5c-b37c-d71c82fff6ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09abf99d2b254ebb983fa6ec55bc5969'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:47.448712 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fb5c9143-22c7-4d5c-b37c-d71c82fff6ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09abf99d2b254ebb983fa6ec55bc5969'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:47.449415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fb5c9143-22c7-4d5c-b37c-d71c82fff6ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09abf99d2b254ebb983fa6ec55bc5969'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:47.458941 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fb5c9143-22c7-4d5c-b37c-d71c82fff6ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09abf99d2b254ebb983fa6ec55bc5969'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:47.477160 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fb5c9143-22c7-4d5c-b37c-d71c82fff6ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09abf99d2b254ebb983fa6ec55bc5969'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:47.494023 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1853/3754] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:06:47 2022] DELETE /identity/v3/users/09abf99d2b254ebb983fa6ec55bc5969 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:06:47.813325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1c51d-3a1d-4c6c-9ee6-29d2efbae647 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:47.814873 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-edb1c51d-3a1d-4c6c-9ee6-29d2efbae647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:47.828009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1c51d-3a1d-4c6c-9ee6-29d2efbae647 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:47.888208 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:47.905157 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87318a7c-02f8-49eb-89ac-d5a13580929d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:47.905807 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87318a7c-02f8-49eb-89ac-d5a13580929d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:47.906083 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87318a7c-02f8-49eb-89ac-d5a13580929d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:47.906352 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87318a7c-02f8-49eb-89ac-d5a13580929d admin admin] PATH_INFO: `/v3/projects/1a8b1bb5c0ab47328f44a4284fc3d3d2` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:47.907542 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87318a7c-02f8-49eb-89ac-d5a13580929d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a8b1bb5c0ab47328f44a4284fc3d3d2)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:47.909435 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87318a7c-02f8-49eb-89ac-d5a13580929d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:47.954489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-87318a7c-02f8-49eb-89ac-d5a13580929d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a8b1bb5c0ab47328f44a4284fc3d3d2', 'request_id': 'req-87318a7c-02f8-49eb-89ac-d5a13580929d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:47.959754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-87318a7c-02f8-49eb-89ac-d5a13580929d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a8b1bb5c0ab47328f44a4284fc3d3d2', 'request_id': 'req-87318a7c-02f8-49eb-89ac-d5a13580929d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:47.967616 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-87318a7c-02f8-49eb-89ac-d5a13580929d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a8b1bb5c0ab47328f44a4284fc3d3d2', 'request_id': 'req-87318a7c-02f8-49eb-89ac-d5a13580929d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:47.980975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-87318a7c-02f8-49eb-89ac-d5a13580929d admin admin] The token cache is being invalidate because project 1a8b1bb5c0ab47328f44a4284fc3d3d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:06:47.981602 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-87318a7c-02f8-49eb-89ac-d5a13580929d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:47.982147 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-87318a7c-02f8-49eb-89ac-d5a13580929d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:06:47.983860 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1902/3755] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:06:47 2022] DELETE /identity/v3/projects/1a8b1bb5c0ab47328f44a4284fc3d3d2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:06:47.988673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae2f7a-32bf-437b-ae64-33ab90a59c05 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:47.988971 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae2f7a-32bf-437b-ae64-33ab90a59c05 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:47.989247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae2f7a-32bf-437b-ae64-33ab90a59c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:48.008851 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d3ae2f7a-32bf-437b-ae64-33ab90a59c05 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:06:48.010191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d3ae2f7a-32bf-437b-ae64-33ab90a59c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:48.071771 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1854/3756] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:06:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:06:48.081526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d95fec-71fa-4512-a1e0-eacddccbd26e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:48.081820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d95fec-71fa-4512-a1e0-eacddccbd26e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:48.082117 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d95fec-71fa-4512-a1e0-eacddccbd26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:48.103560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-45d95fec-71fa-4512-a1e0-eacddccbd26e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:06:48.104977 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-45d95fec-71fa-4512-a1e0-eacddccbd26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:48.116114 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1903/3757] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:06:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:06:48.120238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae2f7a-32bf-437b-ae64-33ab90a59c05 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:48.130977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae2f7a-32bf-437b-ae64-33ab90a59c05 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:48.135677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99fa14-bac3-48de-9a2c-62801c599cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:48.136284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99fa14-bac3-48de-9a2c-62801c599cab admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:48.136560 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99fa14-bac3-48de-9a2c-62801c599cab admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:48.136825 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99fa14-bac3-48de-9a2c-62801c599cab admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:48.137476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99fa14-bac3-48de-9a2c-62801c599cab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:06:48.137773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99fa14-bac3-48de-9a2c-62801c599cab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:48.139529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99fa14-bac3-48de-9a2c-62801c599cab admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:48.153345 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1855/3758] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:06:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:06:48.157755 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d95fec-71fa-4512-a1e0-eacddccbd26e None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:48.167867 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d95fec-71fa-4512-a1e0-eacddccbd26e None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:48.173368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b3656-2be8-4228-972c-e177d6e244ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:48.176253 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b3656-2be8-4228-972c-e177d6e244ae admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:48.176549 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b3656-2be8-4228-972c-e177d6e244ae admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:48.176827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b3656-2be8-4228-972c-e177d6e244ae admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:48.177555 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b3656-2be8-4228-972c-e177d6e244ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:48.179777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b3656-2be8-4228-972c-e177d6e244ae admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:48.220687 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1904/3759] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:06:48 2022] POST /identity/v3/projects => generated 397 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:06:48.221942 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99fa14-bac3-48de-9a2c-62801c599cab admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:48.232990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99fa14-bac3-48de-9a2c-62801c599cab admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:48.344461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285fdf7-ae82-4fb0-9509-32fa7f4fcfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:48.345413 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285fdf7-ae82-4fb0-9509-32fa7f4fcfed admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:48.345873 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285fdf7-ae82-4fb0-9509-32fa7f4fcfed admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:48.346310 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285fdf7-ae82-4fb0-9509-32fa7f4fcfed admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:48.347639 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6285fdf7-ae82-4fb0-9509-32fa7f4fcfed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:48.349735 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6285fdf7-ae82-4fb0-9509-32fa7f4fcfed admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:48.361480 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:48.382701 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1856/3760] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:06:48 2022] POST /identity/v3/users => generated 299 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:06:48.384714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b3656-2be8-4228-972c-e177d6e244ae admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:48.396759 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b3656-2be8-4228-972c-e177d6e244ae admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:48.412543 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ce0af-88a9-4caa-8c57-60d17339dbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:48.413427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ce0af-88a9-4caa-8c57-60d17339dbdf admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:48.415421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ce0af-88a9-4caa-8c57-60d17339dbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:48.415793 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ce0af-88a9-4caa-8c57-60d17339dbdf admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:48.417009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ce0af-88a9-4caa-8c57-60d17339dbdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:48.418346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ce0af-88a9-4caa-8c57-60d17339dbdf admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:48.433690 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1905/3761] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:06:48.435512 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285fdf7-ae82-4fb0-9509-32fa7f4fcfed admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:48.449076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285fdf7-ae82-4fb0-9509-32fa7f4fcfed admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:48.456836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5e8d8-3869-490f-8fc4-8aa04f4ed030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:48.458609 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5e8d8-3869-490f-8fc4-8aa04f4ed030 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:48.459080 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5e8d8-3869-490f-8fc4-8aa04f4ed030 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:48.459684 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5e8d8-3869-490f-8fc4-8aa04f4ed030 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:48.460654 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5e8d8-3869-490f-8fc4-8aa04f4ed030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:48.462752 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5e8d8-3869-490f-8fc4-8aa04f4ed030 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:48.477561 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1857/3762] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:06:48.481576 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ce0af-88a9-4caa-8c57-60d17339dbdf admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:48.492277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ce0af-88a9-4caa-8c57-60d17339dbdf admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:48.497875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c8f96-b8dc-4e49-a85d-f9a9bd119704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:48.498569 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c8f96-b8dc-4e49-a85d-f9a9bd119704 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:48.498894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c8f96-b8dc-4e49-a85d-f9a9bd119704 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:48.499168 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c8f96-b8dc-4e49-a85d-f9a9bd119704 admin admin] PATH_INFO: `/v3/projects/162c0275fc334a30bbb857e86295550b/users/91c6b895ecbe442083862557052c0cc3/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:48.518125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c8f96-b8dc-4e49-a85d-f9a9bd119704 admin admin] RBAC: Authorizing `identity:create_grant(project_id=162c0275fc334a30bbb857e86295550b, user_id=91c6b895ecbe442083862557052c0cc3, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:48.520967 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c8f96-b8dc-4e49-a85d-f9a9bd119704 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:48.543559 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1906/3763] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:06:48 2022] PUT /identity/v3/projects/162c0275fc334a30bbb857e86295550b/users/91c6b895ecbe442083862557052c0cc3/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:06:48.548902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb130222-9385-4710-963d-563c8a96b8f3 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:48.549255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb130222-9385-4710-963d-563c8a96b8f3 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:48.549725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb130222-9385-4710-963d-563c8a96b8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:48.572482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-cb130222-9385-4710-963d-563c8a96b8f3 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:06:48.574403 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-cb130222-9385-4710-963d-563c8a96b8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:48.707092 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1858/3764] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:06:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:06:48.707232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c8f96-b8dc-4e49-a85d-f9a9bd119704 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:48.707232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a08c8f96-b8dc-4e49-a85d-f9a9bd119704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:48.797383 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c8f96-b8dc-4e49-a85d-f9a9bd119704 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:48.807409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f4d98-b195-4be5-9005-1e7c34b90122 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:48.808127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f4d98-b195-4be5-9005-1e7c34b90122 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:48.808294 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f4d98-b195-4be5-9005-1e7c34b90122 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:48.808587 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f4d98-b195-4be5-9005-1e7c34b90122 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:48.818338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f4d98-b195-4be5-9005-1e7c34b90122 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:48.819802 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f4d98-b195-4be5-9005-1e7c34b90122 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:48.832996 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1907/3765] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:06:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:06:50.164019 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c0456-e0f1-47db-a24f-bf4268198c3c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:50.168763 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c0456-e0f1-47db-a24f-bf4268198c3c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:50.168763 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c0456-e0f1-47db-a24f-bf4268198c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:50.205505 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-340c0456-e0f1-47db-a24f-bf4268198c3c None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:06:50.208974 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-340c0456-e0f1-47db-a24f-bf4268198c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:50.288904 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1859/3766] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:06:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:06:50.303044 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f4d98-b195-4be5-9005-1e7c34b90122 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:50.306114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-669f4d98-b195-4be5-9005-1e7c34b90122 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:50.355330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:50.498204 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f4d98-b195-4be5-9005-1e7c34b90122 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:50.512236 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b86ed-c513-45e7-a406-c21e3aade88f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:50.513170 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b86ed-c513-45e7-a406-c21e3aade88f service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:50.516672 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b86ed-c513-45e7-a406-c21e3aade88f service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:50.517253 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b86ed-c513-45e7-a406-c21e3aade88f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:50.540992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b86ed-c513-45e7-a406-c21e3aade88f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:50.546398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b86ed-c513-45e7-a406-c21e3aade88f service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:50.574157 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1908/3767] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:06:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:06:59.352817 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ef05f-0a16-44ff-983c-039968fc4ad1 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:59.354192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ef05f-0a16-44ff-983c-039968fc4ad1 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:59.354743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ef05f-0a16-44ff-983c-039968fc4ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:59.406726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-714ef05f-0a16-44ff-983c-039968fc4ad1 None None] MFA Rules not processed for user `91c6b895ecbe442083862557052c0cc3`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:06:59.408503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-714ef05f-0a16-44ff-983c-039968fc4ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:59.510219 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1860/3768] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:06:59 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:06:59.525438 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc303357-00cd-41f6-9b1f-cc976b97a47f None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:59.525973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc303357-00cd-41f6-9b1f-cc976b97a47f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:59.525973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc303357-00cd-41f6-9b1f-cc976b97a47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:59.573419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-fc303357-00cd-41f6-9b1f-cc976b97a47f None None] MFA Rules not processed for user `91c6b895ecbe442083862557052c0cc3`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:06:59.578630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-fc303357-00cd-41f6-9b1f-cc976b97a47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:59.603630 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1909/3769] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:06:59 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:06:59.614612 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ef05f-0a16-44ff-983c-039968fc4ad1 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:59.616468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-714ef05f-0a16-44ff-983c-039968fc4ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:59.646637 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:59.753465 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ef05f-0a16-44ff-983c-039968fc4ad1 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:59.778126 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edba7a4-1004-486a-86c6-072c604a869e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:59.778976 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edba7a4-1004-486a-86c6-072c604a869e service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:59.779420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edba7a4-1004-486a-86c6-072c604a869e service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:59.779856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edba7a4-1004-486a-86c6-072c604a869e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:59.789508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edba7a4-1004-486a-86c6-072c604a869e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:59.791703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edba7a4-1004-486a-86c6-072c604a869e service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:06:59.816336 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1861/3770] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:06:59 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:06:59.871948 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc303357-00cd-41f6-9b1f-cc976b97a47f None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:06:59.874214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-fc303357-00cd-41f6-9b1f-cc976b97a47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:06:59.905779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc303357-00cd-41f6-9b1f-cc976b97a47f None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:06:59.919322 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2bc9e-e718-42f8-aa88-104e804dccc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:06:59.919976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2bc9e-e718-42f8-aa88-104e804dccc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:06:59.920253 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2bc9e-e718-42f8-aa88-104e804dccc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:06:59.920524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2bc9e-e718-42f8-aa88-104e804dccc5 admin admin] PATH_INFO: `/v3/users/10b30a7d1ce94193970bdc076d481578` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:06:59.921840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2bc9e-e718-42f8-aa88-104e804dccc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10b30a7d1ce94193970bdc076d481578)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:06:59.923862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2bc9e-e718-42f8-aa88-104e804dccc5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:00.012572 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6bd2bc9e-e718-42f8-aa88-104e804dccc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10b30a7d1ce94193970bdc076d481578'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:00.034381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6bd2bc9e-e718-42f8-aa88-104e804dccc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10b30a7d1ce94193970bdc076d481578'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:00.035187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6bd2bc9e-e718-42f8-aa88-104e804dccc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10b30a7d1ce94193970bdc076d481578'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:00.035884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6bd2bc9e-e718-42f8-aa88-104e804dccc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10b30a7d1ce94193970bdc076d481578'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:00.066089 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6bd2bc9e-e718-42f8-aa88-104e804dccc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10b30a7d1ce94193970bdc076d481578'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:00.109721 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1910/3771] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:06:59 2022] DELETE /identity/v3/users/10b30a7d1ce94193970bdc076d481578 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:07:01.010408 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edba7a4-1004-486a-86c6-072c604a869e service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:01.029836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edba7a4-1004-486a-86c6-072c604a869e service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:01.209150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a22b0-2354-4222-9d91-fa67b81ba798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:01.209809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a22b0-2354-4222-9d91-fa67b81ba798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:01.210165 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a22b0-2354-4222-9d91-fa67b81ba798 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:01.210417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a22b0-2354-4222-9d91-fa67b81ba798 admin admin] PATH_INFO: `/v3/projects/64300b6685d7478f8bfa92c2d6eb91d6` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:01.215870 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a22b0-2354-4222-9d91-fa67b81ba798 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64300b6685d7478f8bfa92c2d6eb91d6)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:01.218205 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a22b0-2354-4222-9d91-fa67b81ba798 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:01.387641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4f1a22b0-2354-4222-9d91-fa67b81ba798 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64300b6685d7478f8bfa92c2d6eb91d6', 'request_id': 'req-4f1a22b0-2354-4222-9d91-fa67b81ba798'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:01.436171 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4f1a22b0-2354-4222-9d91-fa67b81ba798 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64300b6685d7478f8bfa92c2d6eb91d6', 'request_id': 'req-4f1a22b0-2354-4222-9d91-fa67b81ba798'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:01.453967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4f1a22b0-2354-4222-9d91-fa67b81ba798 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64300b6685d7478f8bfa92c2d6eb91d6', 'request_id': 'req-4f1a22b0-2354-4222-9d91-fa67b81ba798'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:01.487101 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4f1a22b0-2354-4222-9d91-fa67b81ba798 admin admin] The token cache is being invalidate because project 64300b6685d7478f8bfa92c2d6eb91d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:07:01.489260 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4f1a22b0-2354-4222-9d91-fa67b81ba798 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:01.490036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4f1a22b0-2354-4222-9d91-fa67b81ba798 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:01.494239 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1862/3772] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:01 2022] DELETE /identity/v3/projects/64300b6685d7478f8bfa92c2d6eb91d6 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:07:01.499357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85b75f-7448-4f26-ac7e-80d816793d5d None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:01.499853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85b75f-7448-4f26-ac7e-80d816793d5d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:01.499988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85b75f-7448-4f26-ac7e-80d816793d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:01.542929 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-9f85b75f-7448-4f26-ac7e-80d816793d5d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:01.552806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9f85b75f-7448-4f26-ac7e-80d816793d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:01.751742 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1911/3773] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:07:01.760644 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54c93d-dbe4-4b69-ae02-a190201a7751 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:01.760932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54c93d-dbe4-4b69-ae02-a190201a7751 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:01.761212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54c93d-dbe4-4b69-ae02-a190201a7751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:01.802934 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-df54c93d-dbe4-4b69-ae02-a190201a7751 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:01.805192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-df54c93d-dbe4-4b69-ae02-a190201a7751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:01.830890 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1863/3774] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:07:01.842909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85b75f-7448-4f26-ac7e-80d816793d5d None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:01.858051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85b75f-7448-4f26-ac7e-80d816793d5d None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:01.878687 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502bd29f-e22c-4a19-96a7-978580e58268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:01.879462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bd29f-e22c-4a19-96a7-978580e58268 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:01.879847 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bd29f-e22c-4a19-96a7-978580e58268 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:01.880246 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bd29f-e22c-4a19-96a7-978580e58268 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:01.881008 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502bd29f-e22c-4a19-96a7-978580e58268 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:07:01.882345 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502bd29f-e22c-4a19-96a7-978580e58268 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:01.886581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502bd29f-e22c-4a19-96a7-978580e58268 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:01.902196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:01.936361 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1912/3775] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:07:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:07:01.937071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54c93d-dbe4-4b69-ae02-a190201a7751 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:01.967062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54c93d-dbe4-4b69-ae02-a190201a7751 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:01.981223 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb08fc-a0d1-49cd-988e-4d006c5ada9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:01.982577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb08fc-a0d1-49cd-988e-4d006c5ada9e admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:01.982577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb08fc-a0d1-49cd-988e-4d006c5ada9e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:01.982577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb08fc-a0d1-49cd-988e-4d006c5ada9e admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:01.984929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb08fc-a0d1-49cd-988e-4d006c5ada9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:01.986934 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb08fc-a0d1-49cd-988e-4d006c5ada9e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:02.056113 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1864/3776] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:07:01 2022] POST /identity/v3/projects => generated 403 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:07:02.060006 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502bd29f-e22c-4a19-96a7-978580e58268 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:02.089320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502bd29f-e22c-4a19-96a7-978580e58268 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:02.193311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb536f-1221-476f-8455-58be175773b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:02.194418 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb536f-1221-476f-8455-58be175773b3 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:02.194909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb536f-1221-476f-8455-58be175773b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:02.195769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb536f-1221-476f-8455-58be175773b3 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:02.196429 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb536f-1221-476f-8455-58be175773b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:02.199080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb536f-1221-476f-8455-58be175773b3 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:02.256136 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1913/3777] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:07:02 2022] POST /identity/v3/users => generated 302 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:07:02.260279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb08fc-a0d1-49cd-988e-4d006c5ada9e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:02.269094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:02.285804 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb08fc-a0d1-49cd-988e-4d006c5ada9e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:02.302581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18111565-224d-4b5a-8ae6-25e96befc14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:02.303291 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18111565-224d-4b5a-8ae6-25e96befc14b admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:02.303925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18111565-224d-4b5a-8ae6-25e96befc14b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:02.304209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18111565-224d-4b5a-8ae6-25e96befc14b admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:02.308299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18111565-224d-4b5a-8ae6-25e96befc14b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:02.311595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18111565-224d-4b5a-8ae6-25e96befc14b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:02.358479 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1865/3778] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:07:02.362495 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb536f-1221-476f-8455-58be175773b3 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:02.376819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb536f-1221-476f-8455-58be175773b3 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:02.402047 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb4fd5-7f52-4f4a-8b1e-d16ae111deeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:02.403679 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb4fd5-7f52-4f4a-8b1e-d16ae111deeb admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:02.405958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb4fd5-7f52-4f4a-8b1e-d16ae111deeb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:02.407168 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb4fd5-7f52-4f4a-8b1e-d16ae111deeb admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:02.409052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb4fd5-7f52-4f4a-8b1e-d16ae111deeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:02.412046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb4fd5-7f52-4f4a-8b1e-d16ae111deeb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:02.451806 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1914/3779] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:07:02.453253 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18111565-224d-4b5a-8ae6-25e96befc14b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:02.465836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18111565-224d-4b5a-8ae6-25e96befc14b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:02.482443 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f115be-fda9-4134-bf30-a364f7054b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:02.483319 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f115be-fda9-4134-bf30-a364f7054b7d admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:02.483804 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f115be-fda9-4134-bf30-a364f7054b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:02.484080 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f115be-fda9-4134-bf30-a364f7054b7d admin admin] PATH_INFO: `/v3/projects/25f2ce52da0f43a5b70a00759931805c/users/f0f7bfd0aa3c440e9a525037066b70a0/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:02.533266 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f115be-fda9-4134-bf30-a364f7054b7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=25f2ce52da0f43a5b70a00759931805c, user_id=f0f7bfd0aa3c440e9a525037066b70a0, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:02.548663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f115be-fda9-4134-bf30-a364f7054b7d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:02.580424 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1866/3780] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:07:02 2022] PUT /identity/v3/projects/25f2ce52da0f43a5b70a00759931805c/users/f0f7bfd0aa3c440e9a525037066b70a0/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:07:02.585176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4033874-0fdb-4c27-996e-d4f4bef5dd1a None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:02.585711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4033874-0fdb-4c27-996e-d4f4bef5dd1a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:02.586093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4033874-0fdb-4c27-996e-d4f4bef5dd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:02.632402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b4033874-0fdb-4c27-996e-d4f4bef5dd1a None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:02.633976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b4033874-0fdb-4c27-996e-d4f4bef5dd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:02.778586 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1915/3781] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:07:02.787992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f115be-fda9-4134-bf30-a364f7054b7d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:02.790646 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-57f115be-fda9-4134-bf30-a364f7054b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:02.878568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f115be-fda9-4134-bf30-a364f7054b7d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:02.883890 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15273746-14b7-4e57-9434-5fe0e2a69e6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:02.883890 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15273746-14b7-4e57-9434-5fe0e2a69e6e service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:02.883890 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15273746-14b7-4e57-9434-5fe0e2a69e6e service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:02.884565 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15273746-14b7-4e57-9434-5fe0e2a69e6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:02.895761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15273746-14b7-4e57-9434-5fe0e2a69e6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:02.897351 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15273746-14b7-4e57-9434-5fe0e2a69e6e service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:02.919379 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1867/3782] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:07:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:07:03.310190 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39504d73-ded6-4663-8605-a75af9a6e45b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:03.313678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39504d73-ded6-4663-8605-a75af9a6e45b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:03.314006 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39504d73-ded6-4663-8605-a75af9a6e45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:03.387631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-39504d73-ded6-4663-8605-a75af9a6e45b None None] MFA Rules not processed for user `7dcd210e197347f8ad1622ee882bee92`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:03.390180 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-39504d73-ded6-4663-8605-a75af9a6e45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:03.637796 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1916/3783] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:07:03.927139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc5201-11eb-45ea-9b58-6ace3db2bd08 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:03.927744 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc5201-11eb-45ea-9b58-6ace3db2bd08 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:03.927922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc5201-11eb-45ea-9b58-6ace3db2bd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:03.985983 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-5bfc5201-11eb-45ea-9b58-6ace3db2bd08 None None] MFA Rules not processed for user `bdf1b5180a814cf39234892c6c1f26df`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:03.987692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5bfc5201-11eb-45ea-9b58-6ace3db2bd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:04.110996 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1868/3784] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:07:13.624449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=88,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:14.098009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=65,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:14.656261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39504d73-ded6-4663-8605-a75af9a6e45b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:14.657335 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-39504d73-ded6-4663-8605-a75af9a6e45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:14.678494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39504d73-ded6-4663-8605-a75af9a6e45b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:14.690111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d744c-af18-47aa-8f11-4b525a0dd5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:14.692118 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d744c-af18-47aa-8f11-4b525a0dd5cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:14.692666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d744c-af18-47aa-8f11-4b525a0dd5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:14.692963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d744c-af18-47aa-8f11-4b525a0dd5cf admin admin] PATH_INFO: `/v3/users/d4b581ed648446a59900f2d275de4bf4` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:14.694610 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d744c-af18-47aa-8f11-4b525a0dd5cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4b581ed648446a59900f2d275de4bf4)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:14.698156 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d744c-af18-47aa-8f11-4b525a0dd5cf admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:14.779964 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fd5d744c-af18-47aa-8f11-4b525a0dd5cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4b581ed648446a59900f2d275de4bf4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:14.800500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fd5d744c-af18-47aa-8f11-4b525a0dd5cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4b581ed648446a59900f2d275de4bf4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:14.802188 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fd5d744c-af18-47aa-8f11-4b525a0dd5cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4b581ed648446a59900f2d275de4bf4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:14.803833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fd5d744c-af18-47aa-8f11-4b525a0dd5cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4b581ed648446a59900f2d275de4bf4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:14.821351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fd5d744c-af18-47aa-8f11-4b525a0dd5cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4b581ed648446a59900f2d275de4bf4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:14.860334 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1917/3785] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:07:14 2022] DELETE /identity/v3/users/d4b581ed648446a59900f2d275de4bf4 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:07:14.868277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972ce85-04e5-420d-a4d5-76996dec309a None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:14.869053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972ce85-04e5-420d-a4d5-76996dec309a None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:14.870003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972ce85-04e5-420d-a4d5-76996dec309a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:14.901651 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-c972ce85-04e5-420d-a4d5-76996dec309a None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:14.903947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c972ce85-04e5-420d-a4d5-76996dec309a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:15.024686 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1869/3786] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:07:15.040701 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d744c-af18-47aa-8f11-4b525a0dd5cf admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:15.043092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-fd5d744c-af18-47aa-8f11-4b525a0dd5cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:15.171557 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d744c-af18-47aa-8f11-4b525a0dd5cf admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:15.177171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748547b-012d-4e51-a3cf-f9cc43d20e94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:15.177910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748547b-012d-4e51-a3cf-f9cc43d20e94 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:15.178194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748547b-012d-4e51-a3cf-f9cc43d20e94 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:15.178509 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748547b-012d-4e51-a3cf-f9cc43d20e94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:15.198269 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e748547b-012d-4e51-a3cf-f9cc43d20e94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:15.202115 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e748547b-012d-4e51-a3cf-f9cc43d20e94 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:15.224809 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1918/3787] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:07:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:07:16.196971 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972ce85-04e5-420d-a4d5-76996dec309a None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:16.198806 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c972ce85-04e5-420d-a4d5-76996dec309a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:16.220310 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972ce85-04e5-420d-a4d5-76996dec309a None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:16.234997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c7a59-7ca1-449c-ac06-97cae568deae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:16.235784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c7a59-7ca1-449c-ac06-97cae568deae admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:16.236174 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c7a59-7ca1-449c-ac06-97cae568deae admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:16.236537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c7a59-7ca1-449c-ac06-97cae568deae admin admin] PATH_INFO: `/v3/projects/95da58be1d84408098e2cf3513db3846` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:16.238970 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c7a59-7ca1-449c-ac06-97cae568deae admin admin] RBAC: Authorizing `identity:delete_project(project_id=95da58be1d84408098e2cf3513db3846)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:16.241434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c7a59-7ca1-449c-ac06-97cae568deae admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:16.337564 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8e5c7a59-7ca1-449c-ac06-97cae568deae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95da58be1d84408098e2cf3513db3846', 'request_id': 'req-8e5c7a59-7ca1-449c-ac06-97cae568deae'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:16.366390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8e5c7a59-7ca1-449c-ac06-97cae568deae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95da58be1d84408098e2cf3513db3846', 'request_id': 'req-8e5c7a59-7ca1-449c-ac06-97cae568deae'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:16.380870 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8e5c7a59-7ca1-449c-ac06-97cae568deae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95da58be1d84408098e2cf3513db3846', 'request_id': 'req-8e5c7a59-7ca1-449c-ac06-97cae568deae'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:16.422100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8e5c7a59-7ca1-449c-ac06-97cae568deae admin admin] The token cache is being invalidate because project 95da58be1d84408098e2cf3513db3846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:07:16.450609 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8e5c7a59-7ca1-449c-ac06-97cae568deae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:16.454687 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8e5c7a59-7ca1-449c-ac06-97cae568deae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:16.462814 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1870/3788] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:16 2022] DELETE /identity/v3/projects/95da58be1d84408098e2cf3513db3846 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:07:16.469853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9563b3-1a79-425e-9ac7-efb923d74773 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:16.470311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9563b3-1a79-425e-9ac7-efb923d74773 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:16.470654 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9563b3-1a79-425e-9ac7-efb923d74773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:16.527954 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-3a9563b3-1a79-425e-9ac7-efb923d74773 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:16.534865 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3a9563b3-1a79-425e-9ac7-efb923d74773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:16.754226 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1919/3789] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:07:16.757727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7f9f5-ce66-44fc-aef4-3d394db9b143 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:16.758459 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7f9f5-ce66-44fc-aef4-3d394db9b143 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:16.760388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7f9f5-ce66-44fc-aef4-3d394db9b143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:16.790602 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-2ae7f9f5-ce66-44fc-aef4-3d394db9b143 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:16.792714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2ae7f9f5-ce66-44fc-aef4-3d394db9b143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:16.805064 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1871/3790] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:07:16.808904 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9563b3-1a79-425e-9ac7-efb923d74773 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:16.819534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9563b3-1a79-425e-9ac7-efb923d74773 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:16.825555 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a5458-8670-43d3-9baa-8663777b0c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:16.826277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a5458-8670-43d3-9baa-8663777b0c7c admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:16.826789 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a5458-8670-43d3-9baa-8663777b0c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:16.827286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a5458-8670-43d3-9baa-8663777b0c7c admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:16.828279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a5458-8670-43d3-9baa-8663777b0c7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:07:16.828756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a5458-8670-43d3-9baa-8663777b0c7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:16.830591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a5458-8670-43d3-9baa-8663777b0c7c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:16.846505 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1920/3791] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:07:16.850496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7f9f5-ce66-44fc-aef4-3d394db9b143 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:16.876081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7f9f5-ce66-44fc-aef4-3d394db9b143 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:16.889458 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab18ff0-2516-4abc-93f9-d61c7051929d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:16.894432 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab18ff0-2516-4abc-93f9-d61c7051929d admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:16.895055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab18ff0-2516-4abc-93f9-d61c7051929d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:16.895506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab18ff0-2516-4abc-93f9-d61c7051929d admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:16.896308 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab18ff0-2516-4abc-93f9-d61c7051929d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:16.900020 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab18ff0-2516-4abc-93f9-d61c7051929d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:16.956426 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1872/3792] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:07:16 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:07:16.959609 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a5458-8670-43d3-9baa-8663777b0c7c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:16.965278 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:16.971784 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a5458-8670-43d3-9baa-8663777b0c7c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:17.076431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c9b91-c4cd-49cc-9973-70466131763d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:17.077294 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c9b91-c4cd-49cc-9973-70466131763d admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:17.077584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c9b91-c4cd-49cc-9973-70466131763d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:17.077840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c9b91-c4cd-49cc-9973-70466131763d admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:17.078799 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c9b91-c4cd-49cc-9973-70466131763d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:17.083777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c9b91-c4cd-49cc-9973-70466131763d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:17.116566 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1921/3793] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:07:16 2022] POST /identity/v3/users => generated 287 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:07:17.120552 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab18ff0-2516-4abc-93f9-d61c7051929d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:17.134566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab18ff0-2516-4abc-93f9-d61c7051929d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:17.140835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a5c55-a842-473e-8f75-d952f945ed3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:17.141722 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a5c55-a842-473e-8f75-d952f945ed3a admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:17.142287 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a5c55-a842-473e-8f75-d952f945ed3a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:17.142695 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a5c55-a842-473e-8f75-d952f945ed3a admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:17.144489 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a5c55-a842-473e-8f75-d952f945ed3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:17.145614 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a5c55-a842-473e-8f75-d952f945ed3a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:17.165809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c9b91-c4cd-49cc-9973-70466131763d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:17.174318 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1873/3794] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:07:17.185470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c9b91-c4cd-49cc-9973-70466131763d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:17.197842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e6dd0-320b-4cec-8159-4069c880d484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:17.200399 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e6dd0-320b-4cec-8159-4069c880d484 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:17.200841 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e6dd0-320b-4cec-8159-4069c880d484 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:17.201280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e6dd0-320b-4cec-8159-4069c880d484 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:17.202142 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e6dd0-320b-4cec-8159-4069c880d484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:17.205012 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e6dd0-320b-4cec-8159-4069c880d484 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:17.222595 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1922/3795] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:07:17.226491 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a5c55-a842-473e-8f75-d952f945ed3a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:17.238905 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a5c55-a842-473e-8f75-d952f945ed3a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:17.245632 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63636b4-e3ea-47a0-897c-a0f3494f19a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:17.247167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63636b4-e3ea-47a0-897c-a0f3494f19a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:17.247458 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63636b4-e3ea-47a0-897c-a0f3494f19a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:17.247877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63636b4-e3ea-47a0-897c-a0f3494f19a8 admin admin] PATH_INFO: `/v3/projects/251bd93dd4924a7790ed5313975d90a9/users/6887aa30a0584334a58d8cab1e8cb4c3/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:17.266979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63636b4-e3ea-47a0-897c-a0f3494f19a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=251bd93dd4924a7790ed5313975d90a9, user_id=6887aa30a0584334a58d8cab1e8cb4c3, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:17.273659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63636b4-e3ea-47a0-897c-a0f3494f19a8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:17.295574 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1874/3796] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:07:17 2022] PUT /identity/v3/projects/251bd93dd4924a7790ed5313975d90a9/users/6887aa30a0584334a58d8cab1e8cb4c3/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:07:17.306835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77688d0c-ae37-4cb3-a03d-fc51c691446d None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:17.307534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77688d0c-ae37-4cb3-a03d-fc51c691446d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:17.308144 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77688d0c-ae37-4cb3-a03d-fc51c691446d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:17.345584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-77688d0c-ae37-4cb3-a03d-fc51c691446d None None] MFA Rules not processed for user `6887aa30a0584334a58d8cab1e8cb4c3`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:17.346889 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-77688d0c-ae37-4cb3-a03d-fc51c691446d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:17.460813 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1923/3797] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:07:17.473997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5e82c-4be7-43ee-a985-0da7b736ec08 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:17.474509 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5e82c-4be7-43ee-a985-0da7b736ec08 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:17.474958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5e82c-4be7-43ee-a985-0da7b736ec08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:17.518523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-90d5e82c-4be7-43ee-a985-0da7b736ec08 None None] MFA Rules not processed for user `6887aa30a0584334a58d8cab1e8cb4c3`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:17.519781 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-90d5e82c-4be7-43ee-a985-0da7b736ec08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:17.539353 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1875/3798] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:07:17.565479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77688d0c-ae37-4cb3-a03d-fc51c691446d None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:17.567137 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-77688d0c-ae37-4cb3-a03d-fc51c691446d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:17.668713 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77688d0c-ae37-4cb3-a03d-fc51c691446d None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:17.681194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317f043-b0ac-424b-befc-3e0bbe0c05c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:17.681937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317f043-b0ac-424b-befc-3e0bbe0c05c9 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:17.682092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317f043-b0ac-424b-befc-3e0bbe0c05c9 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:17.682367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317f043-b0ac-424b-befc-3e0bbe0c05c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:17.691007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:17.695386 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2317f043-b0ac-424b-befc-3e0bbe0c05c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:17.697611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2317f043-b0ac-424b-befc-3e0bbe0c05c9 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:17.721732 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1924/3799] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:07:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:07:19.012469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284c12c-b834-402c-bd04-cafdc657bec4 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:19.013382 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284c12c-b834-402c-bd04-cafdc657bec4 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:19.013917 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284c12c-b834-402c-bd04-cafdc657bec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:19.087327 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:19.098677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-2284c12c-b834-402c-bd04-cafdc657bec4 None None] MFA Rules not processed for user `f0f7bfd0aa3c440e9a525037066b70a0`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:19.103390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2284c12c-b834-402c-bd04-cafdc657bec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:19.253823 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1876/3800] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:19 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:07:19.286960 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317f043-b0ac-424b-befc-3e0bbe0c05c9 service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:19.287979 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2317f043-b0ac-424b-befc-3e0bbe0c05c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:19.315042 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317f043-b0ac-424b-befc-3e0bbe0c05c9 service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:19.326273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ec09c-5f35-4c8b-8965-569a24323a0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:19.328055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ec09c-5f35-4c8b-8965-569a24323a0b service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:19.329038 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ec09c-5f35-4c8b-8965-569a24323a0b service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:19.329798 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ec09c-5f35-4c8b-8965-569a24323a0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:19.347002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ec09c-5f35-4c8b-8965-569a24323a0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:19.349641 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ec09c-5f35-4c8b-8965-569a24323a0b service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:19.363359 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1925/3801] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:07:19 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:07:19.687315 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65942e44-142a-4506-bf45-7ae4aa2cf1a3 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:19.687599 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65942e44-142a-4506-bf45-7ae4aa2cf1a3 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:19.687878 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65942e44-142a-4506-bf45-7ae4aa2cf1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:19.713996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-65942e44-142a-4506-bf45-7ae4aa2cf1a3 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:19.715496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-65942e44-142a-4506-bf45-7ae4aa2cf1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:19.842301 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1877/3802] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:07:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:07:19.855444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ec09c-5f35-4c8b-8965-569a24323a0b service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:19.856888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9e0ec09c-5f35-4c8b-8965-569a24323a0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:19.970068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ec09c-5f35-4c8b-8965-569a24323a0b service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:19.977540 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba50ffd-7879-4bb8-b2bd-9614eba2b0f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:19.978304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba50ffd-7879-4bb8-b2bd-9614eba2b0f7 service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:19.978948 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba50ffd-7879-4bb8-b2bd-9614eba2b0f7 service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:19.979091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba50ffd-7879-4bb8-b2bd-9614eba2b0f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:19.988554 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba50ffd-7879-4bb8-b2bd-9614eba2b0f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:19.991550 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba50ffd-7879-4bb8-b2bd-9614eba2b0f7 service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:20.000190 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1926/3803] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:07:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:07:27.436352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65942e44-142a-4506-bf45-7ae4aa2cf1a3 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:27.438970 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-65942e44-142a-4506-bf45-7ae4aa2cf1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:27.587051 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65942e44-142a-4506-bf45-7ae4aa2cf1a3 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:27.594475 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd27f68-1a9a-412b-b3e3-36326cf5a136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:27.595512 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd27f68-1a9a-412b-b3e3-36326cf5a136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:27.596304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd27f68-1a9a-412b-b3e3-36326cf5a136 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:27.596863 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd27f68-1a9a-412b-b3e3-36326cf5a136 admin admin] PATH_INFO: `/v3/users/f0f7bfd0aa3c440e9a525037066b70a0` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:27.598252 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd27f68-1a9a-412b-b3e3-36326cf5a136 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0f7bfd0aa3c440e9a525037066b70a0)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:27.600973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd27f68-1a9a-412b-b3e3-36326cf5a136 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:27.720232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3dd27f68-1a9a-412b-b3e3-36326cf5a136 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0f7bfd0aa3c440e9a525037066b70a0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:27.721357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3dd27f68-1a9a-412b-b3e3-36326cf5a136 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0f7bfd0aa3c440e9a525037066b70a0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:27.721848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3dd27f68-1a9a-412b-b3e3-36326cf5a136 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0f7bfd0aa3c440e9a525037066b70a0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:27.726513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:27.739281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3dd27f68-1a9a-412b-b3e3-36326cf5a136 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0f7bfd0aa3c440e9a525037066b70a0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:27.760145 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3dd27f68-1a9a-412b-b3e3-36326cf5a136 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0f7bfd0aa3c440e9a525037066b70a0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:27.781435 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1878/3804] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:07:27 2022] DELETE /identity/v3/users/f0f7bfd0aa3c440e9a525037066b70a0 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:07:28.117499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba50ffd-7879-4bb8-b2bd-9614eba2b0f7 service swift] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:28.137324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba50ffd-7879-4bb8-b2bd-9614eba2b0f7 service swift] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:28.306897 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23874cb2-b6d8-49bd-aa81-a883f157ce62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:28.308840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23874cb2-b6d8-49bd-aa81-a883f157ce62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:28.311754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23874cb2-b6d8-49bd-aa81-a883f157ce62 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:28.311909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23874cb2-b6d8-49bd-aa81-a883f157ce62 admin admin] PATH_INFO: `/v3/projects/25f2ce52da0f43a5b70a00759931805c` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:28.313244 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23874cb2-b6d8-49bd-aa81-a883f157ce62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25f2ce52da0f43a5b70a00759931805c)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:28.317526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23874cb2-b6d8-49bd-aa81-a883f157ce62 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:28.398382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-23874cb2-b6d8-49bd-aa81-a883f157ce62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25f2ce52da0f43a5b70a00759931805c', 'request_id': 'req-23874cb2-b6d8-49bd-aa81-a883f157ce62'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:28.422034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-23874cb2-b6d8-49bd-aa81-a883f157ce62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25f2ce52da0f43a5b70a00759931805c', 'request_id': 'req-23874cb2-b6d8-49bd-aa81-a883f157ce62'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:28.436722 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-23874cb2-b6d8-49bd-aa81-a883f157ce62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25f2ce52da0f43a5b70a00759931805c', 'request_id': 'req-23874cb2-b6d8-49bd-aa81-a883f157ce62'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:28.440804 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaea344-2596-4545-8377-f5a022dbba98 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:28.441366 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaea344-2596-4545-8377-f5a022dbba98 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:28.441366 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaea344-2596-4545-8377-f5a022dbba98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:28.465486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-23874cb2-b6d8-49bd-aa81-a883f157ce62 admin admin] The token cache is being invalidate because project 25f2ce52da0f43a5b70a00759931805c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:07:28.465783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-23874cb2-b6d8-49bd-aa81-a883f157ce62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:28.466926 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-23874cb2-b6d8-49bd-aa81-a883f157ce62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:28.472887 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1927/3805] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:28 2022] DELETE /identity/v3/projects/25f2ce52da0f43a5b70a00759931805c => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:07:28.473999 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-caaea344-2596-4545-8377-f5a022dbba98 None None] MFA Rules not processed for user `7dcd210e197347f8ad1622ee882bee92`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:28.474907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a66b6-57f2-43c4-b5eb-808844de6305 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:28.475211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a66b6-57f2-43c4-b5eb-808844de6305 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:28.476008 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a66b6-57f2-43c4-b5eb-808844de6305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:28.477250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-caaea344-2596-4545-8377-f5a022dbba98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:28.500760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:28.533413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-0c7a66b6-57f2-43c4-b5eb-808844de6305 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:28.544981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0c7a66b6-57f2-43c4-b5eb-808844de6305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:28.606442 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1879/3806] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:07:28.714072 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1928/3807] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:07:28.716335 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b77fac-68fe-45f1-a888-2c32172ca1d0 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:28.716784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b77fac-68fe-45f1-a888-2c32172ca1d0 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:28.717210 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b77fac-68fe-45f1-a888-2c32172ca1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:28.760790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f2b77fac-68fe-45f1-a888-2c32172ca1d0 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:28.762046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f2b77fac-68fe-45f1-a888-2c32172ca1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:28.778483 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1880/3808] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:07:28.782732 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a66b6-57f2-43c4-b5eb-808844de6305 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:28.793336 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a66b6-57f2-43c4-b5eb-808844de6305 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:28.801999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f9284-117d-4079-9938-7d1cac7ede12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:28.801999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f9284-117d-4079-9938-7d1cac7ede12 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:28.801999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f9284-117d-4079-9938-7d1cac7ede12 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:28.801999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f9284-117d-4079-9938-7d1cac7ede12 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:28.802529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f9284-117d-4079-9938-7d1cac7ede12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:07:28.802529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f9284-117d-4079-9938-7d1cac7ede12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:28.802880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f9284-117d-4079-9938-7d1cac7ede12 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:28.824024 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b77fac-68fe-45f1-a888-2c32172ca1d0 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:28.830783 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1929/3809] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:07:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:07:28.848425 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b77fac-68fe-45f1-a888-2c32172ca1d0 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:28.860891 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8710d-8ffe-4f15-b8be-d3c732389660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:28.861912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8710d-8ffe-4f15-b8be-d3c732389660 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:28.862408 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8710d-8ffe-4f15-b8be-d3c732389660 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:28.862938 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8710d-8ffe-4f15-b8be-d3c732389660 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:28.864445 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8710d-8ffe-4f15-b8be-d3c732389660 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:28.866929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8710d-8ffe-4f15-b8be-d3c732389660 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:28.957024 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1881/3810] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:07:28 2022] POST /identity/v3/projects => generated 391 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:07:28.958344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f9284-117d-4079-9938-7d1cac7ede12 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:28.973403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f9284-117d-4079-9938-7d1cac7ede12 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:29.070588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc920e-ebf6-4e91-a0b6-530fa94743d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:29.071233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc920e-ebf6-4e91-a0b6-530fa94743d5 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:29.071512 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc920e-ebf6-4e91-a0b6-530fa94743d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:29.071777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc920e-ebf6-4e91-a0b6-530fa94743d5 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:29.072674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc920e-ebf6-4e91-a0b6-530fa94743d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:29.074574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc920e-ebf6-4e91-a0b6-530fa94743d5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:29.125514 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1930/3811] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:07:28 2022] POST /identity/v3/users => generated 296 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:07:29.127706 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8710d-8ffe-4f15-b8be-d3c732389660 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:29.143424 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8710d-8ffe-4f15-b8be-d3c732389660 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:29.165107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f48b5f-880a-45f9-92dd-277287524aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:29.165978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f48b5f-880a-45f9-92dd-277287524aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:29.166260 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f48b5f-880a-45f9-92dd-277287524aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:29.166528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f48b5f-880a-45f9-92dd-277287524aa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:29.167200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f48b5f-880a-45f9-92dd-277287524aa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:29.168837 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f48b5f-880a-45f9-92dd-277287524aa6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:29.193910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc920e-ebf6-4e91-a0b6-530fa94743d5 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:29.205420 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc920e-ebf6-4e91-a0b6-530fa94743d5 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:29.208024 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1882/3812] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:07:29.221932 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e852a-74a3-4d7d-be85-bddb6708389b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:29.223180 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e852a-74a3-4d7d-be85-bddb6708389b admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:29.223463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e852a-74a3-4d7d-be85-bddb6708389b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:29.223737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e852a-74a3-4d7d-be85-bddb6708389b admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:29.224469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e852a-74a3-4d7d-be85-bddb6708389b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:29.226124 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e852a-74a3-4d7d-be85-bddb6708389b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:29.251562 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1931/3813] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:07:29.252991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f48b5f-880a-45f9-92dd-277287524aa6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:29.270054 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f48b5f-880a-45f9-92dd-277287524aa6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:29.275459 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5a175-b5a5-46a5-a9fd-c8d63f237f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:29.276149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5a175-b5a5-46a5-a9fd-c8d63f237f4b admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:29.276422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5a175-b5a5-46a5-a9fd-c8d63f237f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:29.276692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5a175-b5a5-46a5-a9fd-c8d63f237f4b admin admin] PATH_INFO: `/v3/projects/46174b291ccf4b98bff3fd99bbe207b0/users/975674971c944823a47fce804a1c848c/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:29.294309 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b5a175-b5a5-46a5-a9fd-c8d63f237f4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=46174b291ccf4b98bff3fd99bbe207b0, user_id=975674971c944823a47fce804a1c848c, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:29.296914 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b5a175-b5a5-46a5-a9fd-c8d63f237f4b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:29.331152 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1883/3814] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:07:29 2022] PUT /identity/v3/projects/46174b291ccf4b98bff3fd99bbe207b0/users/975674971c944823a47fce804a1c848c/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:07:29.332039 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d3aa7-f3b6-4ab9-a846-9ab58d2224fd None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:29.332159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d3aa7-f3b6-4ab9-a846-9ab58d2224fd None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:29.332403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d3aa7-f3b6-4ab9-a846-9ab58d2224fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:29.388340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-719d3aa7-f3b6-4ab9-a846-9ab58d2224fd None None] MFA Rules not processed for user `975674971c944823a47fce804a1c848c`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:29.389587 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-719d3aa7-f3b6-4ab9-a846-9ab58d2224fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:29.471173 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:29.479003 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1932/3815] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:07:29.595053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5a175-b5a5-46a5-a9fd-c8d63f237f4b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:29.597370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-42b5a175-b5a5-46a5-a9fd-c8d63f237f4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:29.816698 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5a175-b5a5-46a5-a9fd-c8d63f237f4b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:29.830191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d7794-909e-49f4-94d7-b18738b74c63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:29.832781 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d7794-909e-49f4-94d7-b18738b74c63 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:29.833017 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d7794-909e-49f4-94d7-b18738b74c63 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:29.836209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d7794-909e-49f4-94d7-b18738b74c63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:29.849358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:29.864427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d7794-909e-49f4-94d7-b18738b74c63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:29.867563 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d7794-909e-49f4-94d7-b18738b74c63 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:29.881217 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1884/3816] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:07:29 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:07:30.374104 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d3aa7-f3b6-4ab9-a846-9ab58d2224fd None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:30.497849 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d3aa7-f3b6-4ab9-a846-9ab58d2224fd None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:30.508811 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684a100-68e7-4a4c-85a5-2da3cbe8cee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:30.510036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684a100-68e7-4a4c-85a5-2da3cbe8cee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:30.510643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684a100-68e7-4a4c-85a5-2da3cbe8cee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:30.511081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684a100-68e7-4a4c-85a5-2da3cbe8cee5 admin admin] PATH_INFO: `/v3/users/975674971c944823a47fce804a1c848c` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:30.512576 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684a100-68e7-4a4c-85a5-2da3cbe8cee5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=975674971c944823a47fce804a1c848c)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:30.514878 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684a100-68e7-4a4c-85a5-2da3cbe8cee5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:30.625375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f684a100-68e7-4a4c-85a5-2da3cbe8cee5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '975674971c944823a47fce804a1c848c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:30.642026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f684a100-68e7-4a4c-85a5-2da3cbe8cee5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '975674971c944823a47fce804a1c848c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:30.642840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f684a100-68e7-4a4c-85a5-2da3cbe8cee5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '975674971c944823a47fce804a1c848c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:30.643850 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f684a100-68e7-4a4c-85a5-2da3cbe8cee5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '975674971c944823a47fce804a1c848c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:30.659155 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f684a100-68e7-4a4c-85a5-2da3cbe8cee5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '975674971c944823a47fce804a1c848c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:30.774511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a046f-08ea-4ad8-9571-a43d94fe49a1 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:30.775187 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a046f-08ea-4ad8-9571-a43d94fe49a1 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:30.775187 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a046f-08ea-4ad8-9571-a43d94fe49a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:30.777976 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1933/3817] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:07:30 2022] DELETE /identity/v3/users/975674971c944823a47fce804a1c848c => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:07:30.823542 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-2f0a046f-08ea-4ad8-9571-a43d94fe49a1 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:30.824764 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2f0a046f-08ea-4ad8-9571-a43d94fe49a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:30.975070 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1885/3818] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:07:31.007309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684a100-68e7-4a4c-85a5-2da3cbe8cee5 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:31.009211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f684a100-68e7-4a4c-85a5-2da3cbe8cee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:31.215458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684a100-68e7-4a4c-85a5-2da3cbe8cee5 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:31.223540 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9174e8-da49-4056-b458-25be0f7d5188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:31.224955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9174e8-da49-4056-b458-25be0f7d5188 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:31.225985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9174e8-da49-4056-b458-25be0f7d5188 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:31.226973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9174e8-da49-4056-b458-25be0f7d5188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:31.243153 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9174e8-da49-4056-b458-25be0f7d5188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:31.245237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9174e8-da49-4056-b458-25be0f7d5188 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:31.262370 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1934/3819] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:07:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:07:32.079897 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a046f-08ea-4ad8-9571-a43d94fe49a1 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:32.097011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2f0a046f-08ea-4ad8-9571-a43d94fe49a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:32.150347 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a046f-08ea-4ad8-9571-a43d94fe49a1 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:32.260840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07027cb7-e5f6-4b56-b899-a97bb2cffdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:32.262130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07027cb7-e5f6-4b56-b899-a97bb2cffdf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:32.263291 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07027cb7-e5f6-4b56-b899-a97bb2cffdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:32.263581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07027cb7-e5f6-4b56-b899-a97bb2cffdf6 admin admin] PATH_INFO: `/v3/projects/46174b291ccf4b98bff3fd99bbe207b0` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:32.269885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07027cb7-e5f6-4b56-b899-a97bb2cffdf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46174b291ccf4b98bff3fd99bbe207b0)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:32.281791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07027cb7-e5f6-4b56-b899-a97bb2cffdf6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:32.396165 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-07027cb7-e5f6-4b56-b899-a97bb2cffdf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46174b291ccf4b98bff3fd99bbe207b0', 'request_id': 'req-07027cb7-e5f6-4b56-b899-a97bb2cffdf6'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:32.404182 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-07027cb7-e5f6-4b56-b899-a97bb2cffdf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46174b291ccf4b98bff3fd99bbe207b0', 'request_id': 'req-07027cb7-e5f6-4b56-b899-a97bb2cffdf6'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:32.414919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-07027cb7-e5f6-4b56-b899-a97bb2cffdf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46174b291ccf4b98bff3fd99bbe207b0', 'request_id': 'req-07027cb7-e5f6-4b56-b899-a97bb2cffdf6'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:32.435624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-07027cb7-e5f6-4b56-b899-a97bb2cffdf6 admin admin] The token cache is being invalidate because project 46174b291ccf4b98bff3fd99bbe207b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:07:32.437048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-07027cb7-e5f6-4b56-b899-a97bb2cffdf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:32.438508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-07027cb7-e5f6-4b56-b899-a97bb2cffdf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:32.452336 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1886/3820] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:32 2022] DELETE /identity/v3/projects/46174b291ccf4b98bff3fd99bbe207b0 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:07:32.456063 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec88e8d-899a-48a0-a771-0ea1d92252f6 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:32.456620 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec88e8d-899a-48a0-a771-0ea1d92252f6 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:32.456775 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec88e8d-899a-48a0-a771-0ea1d92252f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:32.527492 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-6ec88e8d-899a-48a0-a771-0ea1d92252f6 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:32.529072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6ec88e8d-899a-48a0-a771-0ea1d92252f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:32.588876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:32.689836 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1935/3821] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:07:32.698240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ecfc43-5756-4c6e-ab46-4079901bbe5e None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:32.705156 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ecfc43-5756-4c6e-ab46-4079901bbe5e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:32.705383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ecfc43-5756-4c6e-ab46-4079901bbe5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:32.815665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-09ecfc43-5756-4c6e-ab46-4079901bbe5e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:32.817674 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-09ecfc43-5756-4c6e-ab46-4079901bbe5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:32.836888 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1887/3822] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:07:32.841688 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec88e8d-899a-48a0-a771-0ea1d92252f6 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:32.853478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec88e8d-899a-48a0-a771-0ea1d92252f6 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:32.866522 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294f253-e88f-4f0a-a34e-e17019d61850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:32.868421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294f253-e88f-4f0a-a34e-e17019d61850 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:32.870061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294f253-e88f-4f0a-a34e-e17019d61850 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:32.870617 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294f253-e88f-4f0a-a34e-e17019d61850 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:32.873640 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3294f253-e88f-4f0a-a34e-e17019d61850 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:07:32.874220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3294f253-e88f-4f0a-a34e-e17019d61850 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:32.878714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3294f253-e88f-4f0a-a34e-e17019d61850 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:32.917271 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1936/3823] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:07:32.918595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ecfc43-5756-4c6e-ab46-4079901bbe5e None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:32.931011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ecfc43-5756-4c6e-ab46-4079901bbe5e None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:32.943058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb7844-257a-48b5-9274-4f4c8bf940fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:32.944737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb7844-257a-48b5-9274-4f4c8bf940fb admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:32.945174 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb7844-257a-48b5-9274-4f4c8bf940fb admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:32.945615 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb7844-257a-48b5-9274-4f4c8bf940fb admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:32.946394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcb7844-257a-48b5-9274-4f4c8bf940fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:32.948492 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcb7844-257a-48b5-9274-4f4c8bf940fb admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:33.019674 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1888/3824] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:07:32 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:07:33.023737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294f253-e88f-4f0a-a34e-e17019d61850 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:33.046428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294f253-e88f-4f0a-a34e-e17019d61850 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:33.247959 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3922b2-22b2-45b3-951e-4b4622c5ad83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:33.249480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3922b2-22b2-45b3-951e-4b4622c5ad83 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:33.249937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3922b2-22b2-45b3-951e-4b4622c5ad83 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:33.251876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3922b2-22b2-45b3-951e-4b4622c5ad83 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:33.253290 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3922b2-22b2-45b3-951e-4b4622c5ad83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:33.259866 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3922b2-22b2-45b3-951e-4b4622c5ad83 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:33.324468 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1937/3825] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:07:33 2022] POST /identity/v3/users => generated 292 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:07:33.326717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb7844-257a-48b5-9274-4f4c8bf940fb admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:33.352052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb7844-257a-48b5-9274-4f4c8bf940fb admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:33.372054 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc43ad-29d5-40a3-bf4f-8926e36f9a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:33.372691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc43ad-29d5-40a3-bf4f-8926e36f9a49 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:33.372968 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc43ad-29d5-40a3-bf4f-8926e36f9a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:33.375892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc43ad-29d5-40a3-bf4f-8926e36f9a49 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:33.376890 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc43ad-29d5-40a3-bf4f-8926e36f9a49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:33.386066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc43ad-29d5-40a3-bf4f-8926e36f9a49 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:33.424627 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1889/3826] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:07:33.429411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3922b2-22b2-45b3-951e-4b4622c5ad83 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:33.445953 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3922b2-22b2-45b3-951e-4b4622c5ad83 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:33.459073 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3da921-99b0-4a78-9547-40b45f838053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:33.460113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3da921-99b0-4a78-9547-40b45f838053 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:33.460916 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3da921-99b0-4a78-9547-40b45f838053 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:33.460916 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3da921-99b0-4a78-9547-40b45f838053 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:33.461309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3da921-99b0-4a78-9547-40b45f838053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:33.468292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3da921-99b0-4a78-9547-40b45f838053 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:33.491729 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1938/3827] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:07:33.495937 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc43ad-29d5-40a3-bf4f-8926e36f9a49 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:33.518444 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc43ad-29d5-40a3-bf4f-8926e36f9a49 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:33.533469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ece5d4-66b4-4842-bb53-02469ea4a492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:33.534799 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ece5d4-66b4-4842-bb53-02469ea4a492 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:33.535339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ece5d4-66b4-4842-bb53-02469ea4a492 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:33.537099 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ece5d4-66b4-4842-bb53-02469ea4a492 admin admin] PATH_INFO: `/v3/projects/adb095f83ef34d36bbb3604853edc50a/users/e8ee2d63b9e142bcb53571239367c1f4/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:33.570302 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ece5d4-66b4-4842-bb53-02469ea4a492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adb095f83ef34d36bbb3604853edc50a, user_id=e8ee2d63b9e142bcb53571239367c1f4, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:33.574052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ece5d4-66b4-4842-bb53-02469ea4a492 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:33.598211 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1890/3828] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:07:33 2022] PUT /identity/v3/projects/adb095f83ef34d36bbb3604853edc50a/users/e8ee2d63b9e142bcb53571239367c1f4/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:07:33.610948 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c20c8-9e63-4e5f-88f2-4740bad52465 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:33.611229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c20c8-9e63-4e5f-88f2-4740bad52465 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:33.611505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c20c8-9e63-4e5f-88f2-4740bad52465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:33.702822 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d62c20c8-9e63-4e5f-88f2-4740bad52465 None None] MFA Rules not processed for user `e8ee2d63b9e142bcb53571239367c1f4`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:33.704168 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d62c20c8-9e63-4e5f-88f2-4740bad52465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:33.834252 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1939/3829] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:07:34.154231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ece5d4-66b4-4842-bb53-02469ea4a492 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:34.156283 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-44ece5d4-66b4-4842-bb53-02469ea4a492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:34.186976 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:34.310712 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ece5d4-66b4-4842-bb53-02469ea4a492 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:34.320957 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4f6cc-f073-45de-a88c-fa3b35995344 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:34.322804 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4f6cc-f073-45de-a88c-fa3b35995344 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:34.323307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4f6cc-f073-45de-a88c-fa3b35995344 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:34.323803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4f6cc-f073-45de-a88c-fa3b35995344 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:34.347183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4f6cc-f073-45de-a88c-fa3b35995344 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:34.350912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4f6cc-f073-45de-a88c-fa3b35995344 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:34.373443 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1891/3830] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:07:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:07:36.088506 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c0434-4539-4f8c-96f2-5341f3c43a83 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:36.089791 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c0434-4539-4f8c-96f2-5341f3c43a83 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:36.090306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c0434-4539-4f8c-96f2-5341f3c43a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:36.161345 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-493c0434-4539-4f8c-96f2-5341f3c43a83 None None] MFA Rules not processed for user `bdf1b5180a814cf39234892c6c1f26df`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:36.171760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-493c0434-4539-4f8c-96f2-5341f3c43a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:36.200331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:36.266110 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4f6cc-f073-45de-a88c-fa3b35995344 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:36.325574 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1940/3831] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:07:36.376353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4f6cc-f073-45de-a88c-fa3b35995344 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:36.389719 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52425d51-dd05-4f8b-b8c5-d6c06eb1a3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:36.390670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52425d51-dd05-4f8b-b8c5-d6c06eb1a3e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:36.394347 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52425d51-dd05-4f8b-b8c5-d6c06eb1a3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:36.394848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52425d51-dd05-4f8b-b8c5-d6c06eb1a3e7 admin admin] PATH_INFO: `/v3/users/e8ee2d63b9e142bcb53571239367c1f4` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:36.396729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52425d51-dd05-4f8b-b8c5-d6c06eb1a3e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8ee2d63b9e142bcb53571239367c1f4)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:36.400248 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52425d51-dd05-4f8b-b8c5-d6c06eb1a3e7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:36.531309 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-52425d51-dd05-4f8b-b8c5-d6c06eb1a3e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8ee2d63b9e142bcb53571239367c1f4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:36.532265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-52425d51-dd05-4f8b-b8c5-d6c06eb1a3e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8ee2d63b9e142bcb53571239367c1f4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:36.533094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-52425d51-dd05-4f8b-b8c5-d6c06eb1a3e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8ee2d63b9e142bcb53571239367c1f4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:36.559775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-52425d51-dd05-4f8b-b8c5-d6c06eb1a3e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8ee2d63b9e142bcb53571239367c1f4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:36.580363 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-52425d51-dd05-4f8b-b8c5-d6c06eb1a3e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8ee2d63b9e142bcb53571239367c1f4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:36.616971 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1892/3832] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:07:36 2022] DELETE /identity/v3/users/e8ee2d63b9e142bcb53571239367c1f4 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:07:36.621103 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42bb9c-073f-4302-bd7c-d3ba1242f836 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:36.621556 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42bb9c-073f-4302-bd7c-d3ba1242f836 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:36.621923 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42bb9c-073f-4302-bd7c-d3ba1242f836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:36.660253 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-ea42bb9c-073f-4302-bd7c-d3ba1242f836 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:36.672968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ea42bb9c-073f-4302-bd7c-d3ba1242f836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:36.756431 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1941/3833] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:07:36.794041 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52425d51-dd05-4f8b-b8c5-d6c06eb1a3e7 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:36.797404 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-52425d51-dd05-4f8b-b8c5-d6c06eb1a3e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:36.834225 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:36.903205 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52425d51-dd05-4f8b-b8c5-d6c06eb1a3e7 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:36.908168 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a807eb1-83fb-441f-99eb-a18d6244a4a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:36.909314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a807eb1-83fb-441f-99eb-a18d6244a4a9 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:36.909904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a807eb1-83fb-441f-99eb-a18d6244a4a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:36.910362 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a807eb1-83fb-441f-99eb-a18d6244a4a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:36.944948 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a807eb1-83fb-441f-99eb-a18d6244a4a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:36.946668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a807eb1-83fb-441f-99eb-a18d6244a4a9 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:37.003066 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1893/3834] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:07:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:07:37.152750 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42bb9c-073f-4302-bd7c-d3ba1242f836 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:37.152750 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ea42bb9c-073f-4302-bd7c-d3ba1242f836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:37.176515 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42bb9c-073f-4302-bd7c-d3ba1242f836 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:37.193772 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f62196-72bb-416f-87b2-96a76e086079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:37.195014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f62196-72bb-416f-87b2-96a76e086079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:37.195346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f62196-72bb-416f-87b2-96a76e086079 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:37.195785 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f62196-72bb-416f-87b2-96a76e086079 admin admin] PATH_INFO: `/v3/users/91c6b895ecbe442083862557052c0cc3` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:37.197968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f62196-72bb-416f-87b2-96a76e086079 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91c6b895ecbe442083862557052c0cc3)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:37.204391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f62196-72bb-416f-87b2-96a76e086079 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:37.310592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-95f62196-72bb-416f-87b2-96a76e086079 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91c6b895ecbe442083862557052c0cc3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:37.320918 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-95f62196-72bb-416f-87b2-96a76e086079 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91c6b895ecbe442083862557052c0cc3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:37.322048 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-95f62196-72bb-416f-87b2-96a76e086079 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91c6b895ecbe442083862557052c0cc3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:37.322972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-95f62196-72bb-416f-87b2-96a76e086079 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91c6b895ecbe442083862557052c0cc3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:37.343742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-95f62196-72bb-416f-87b2-96a76e086079 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91c6b895ecbe442083862557052c0cc3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:37.375630 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1942/3835] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:07:37 2022] DELETE /identity/v3/users/91c6b895ecbe442083862557052c0cc3 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:07:37.825494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a807eb1-83fb-441f-99eb-a18d6244a4a9 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:37.847597 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a807eb1-83fb-441f-99eb-a18d6244a4a9 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:37.912114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f62196-72bb-416f-87b2-96a76e086079 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:37.915151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-95f62196-72bb-416f-87b2-96a76e086079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:37.953852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aeebe2-d201-4e26-a569-3657ae2d0def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:37.954768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aeebe2-d201-4e26-a569-3657ae2d0def admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:37.955118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aeebe2-d201-4e26-a569-3657ae2d0def admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:37.955484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aeebe2-d201-4e26-a569-3657ae2d0def admin admin] PATH_INFO: `/v3/projects/162c0275fc334a30bbb857e86295550b` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:37.956707 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aeebe2-d201-4e26-a569-3657ae2d0def admin admin] RBAC: Authorizing `identity:delete_project(project_id=162c0275fc334a30bbb857e86295550b)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:37.960322 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aeebe2-d201-4e26-a569-3657ae2d0def admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:38.003020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:38.033742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e4aeebe2-d201-4e26-a569-3657ae2d0def admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '162c0275fc334a30bbb857e86295550b', 'request_id': 'req-e4aeebe2-d201-4e26-a569-3657ae2d0def'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:38.041497 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e4aeebe2-d201-4e26-a569-3657ae2d0def admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '162c0275fc334a30bbb857e86295550b', 'request_id': 'req-e4aeebe2-d201-4e26-a569-3657ae2d0def'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:38.069421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e4aeebe2-d201-4e26-a569-3657ae2d0def admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '162c0275fc334a30bbb857e86295550b', 'request_id': 'req-e4aeebe2-d201-4e26-a569-3657ae2d0def'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:38.083914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f62196-72bb-416f-87b2-96a76e086079 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:38.094514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e4aeebe2-d201-4e26-a569-3657ae2d0def admin admin] The token cache is being invalidate because project 162c0275fc334a30bbb857e86295550b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:07:38.095098 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e4aeebe2-d201-4e26-a569-3657ae2d0def admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:38.096250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e4aeebe2-d201-4e26-a569-3657ae2d0def admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:38.098867 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1894/3836] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:37 2022] DELETE /identity/v3/projects/162c0275fc334a30bbb857e86295550b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:07:38.104678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428a8a8-6eb3-4c90-a5f7-09c85b121066 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:38.105255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428a8a8-6eb3-4c90-a5f7-09c85b121066 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:38.105757 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428a8a8-6eb3-4c90-a5f7-09c85b121066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:38.149868 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-0428a8a8-6eb3-4c90-a5f7-09c85b121066 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:38.153607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0428a8a8-6eb3-4c90-a5f7-09c85b121066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:38.157839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baec897-9d74-46f1-a793-d5bbcd278d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:38.158574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baec897-9d74-46f1-a793-d5bbcd278d0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:38.158979 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baec897-9d74-46f1-a793-d5bbcd278d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:38.159633 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baec897-9d74-46f1-a793-d5bbcd278d0f admin admin] PATH_INFO: `/v3/projects/adb095f83ef34d36bbb3604853edc50a` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:38.160915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baec897-9d74-46f1-a793-d5bbcd278d0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=adb095f83ef34d36bbb3604853edc50a)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:38.165147 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baec897-9d74-46f1-a793-d5bbcd278d0f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:38.177921 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1895/3837] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:07:38.185190 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8473a-e76c-468a-832e-ba125c85109e None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:38.185677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8473a-e76c-468a-832e-ba125c85109e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:38.186140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8473a-e76c-468a-832e-ba125c85109e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:38.228982 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-69d8473a-e76c-468a-832e-ba125c85109e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:38.230838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-69d8473a-e76c-468a-832e-ba125c85109e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:38.265752 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1896/3838] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:07:38.267819 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8473a-e76c-468a-832e-ba125c85109e None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:38.277938 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1baec897-9d74-46f1-a793-d5bbcd278d0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adb095f83ef34d36bbb3604853edc50a', 'request_id': 'req-1baec897-9d74-46f1-a793-d5bbcd278d0f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:38.290151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1baec897-9d74-46f1-a793-d5bbcd278d0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adb095f83ef34d36bbb3604853edc50a', 'request_id': 'req-1baec897-9d74-46f1-a793-d5bbcd278d0f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:38.296149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8473a-e76c-468a-832e-ba125c85109e None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:38.306459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1baec897-9d74-46f1-a793-d5bbcd278d0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adb095f83ef34d36bbb3604853edc50a', 'request_id': 'req-1baec897-9d74-46f1-a793-d5bbcd278d0f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:38.344334 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:38.368147 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1baec897-9d74-46f1-a793-d5bbcd278d0f admin admin] The token cache is being invalidate because project adb095f83ef34d36bbb3604853edc50a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:07:38.368503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1baec897-9d74-46f1-a793-d5bbcd278d0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:38.372008 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1baec897-9d74-46f1-a793-d5bbcd278d0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:38.376244 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1943/3839] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:37 2022] DELETE /identity/v3/projects/adb095f83ef34d36bbb3604853edc50a => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:07:38.381479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09507f5d-db97-4118-8938-b9933e23371c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:38.382098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09507f5d-db97-4118-8938-b9933e23371c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:38.383482 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09507f5d-db97-4118-8938-b9933e23371c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:38.387762 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa1034-b7e4-4a05-b720-e7c7b81011a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:38.388475 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa1034-b7e4-4a05-b720-e7c7b81011a6 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:38.388769 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa1034-b7e4-4a05-b720-e7c7b81011a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:38.389048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa1034-b7e4-4a05-b720-e7c7b81011a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:38.389713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa1034-b7e4-4a05-b720-e7c7b81011a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:07:38.390004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa1034-b7e4-4a05-b720-e7c7b81011a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:38.393149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa1034-b7e4-4a05-b720-e7c7b81011a6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:38.422793 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1897/3840] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:07:38.422793 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa1034-b7e4-4a05-b720-e7c7b81011a6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:38.429201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d5fa1034-b7e4-4a05-b720-e7c7b81011a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:38.432957 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-09507f5d-db97-4118-8938-b9933e23371c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:38.436235 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-09507f5d-db97-4118-8938-b9933e23371c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:38.453121 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa1034-b7e4-4a05-b720-e7c7b81011a6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:38.460055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3a3ed4-9099-4a8c-880d-6bacbde084f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:38.460746 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a3ed4-9099-4a8c-880d-6bacbde084f3 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:38.461034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a3ed4-9099-4a8c-880d-6bacbde084f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:38.461298 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a3ed4-9099-4a8c-880d-6bacbde084f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:38.467425 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1944/3841] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:07:38.467595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3a3ed4-9099-4a8c-880d-6bacbde084f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:38.467595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3a3ed4-9099-4a8c-880d-6bacbde084f3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:38.469190 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89037f80-bd81-4045-a9ae-ca1baa73332c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:38.469576 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89037f80-bd81-4045-a9ae-ca1baa73332c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:38.469887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89037f80-bd81-4045-a9ae-ca1baa73332c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:38.501885 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-89037f80-bd81-4045-a9ae-ca1baa73332c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:38.503493 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-89037f80-bd81-4045-a9ae-ca1baa73332c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:38.505366 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1898/3842] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:07:38 2022] POST /identity/v3/projects => generated 379 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:07:38.509606 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3a3ed4-9099-4a8c-880d-6bacbde084f3 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:38.588852 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1945/3843] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:07:38.593570 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89037f80-bd81-4045-a9ae-ca1baa73332c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:38.594457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3a3ed4-9099-4a8c-880d-6bacbde084f3 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:38.600604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f806f-7b57-47c5-975d-15b7f2ada4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:38.601619 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f806f-7b57-47c5-975d-15b7f2ada4e1 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:38.602198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:38.602399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f806f-7b57-47c5-975d-15b7f2ada4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:38.602728 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f806f-7b57-47c5-975d-15b7f2ada4e1 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:38.603405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f806f-7b57-47c5-975d-15b7f2ada4e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:38.605573 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f806f-7b57-47c5-975d-15b7f2ada4e1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:38.607246 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89037f80-bd81-4045-a9ae-ca1baa73332c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:38.619988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aca768-4f42-423b-8a6f-8d66cf16eeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:38.621309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aca768-4f42-423b-8a6f-8d66cf16eeaf admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:38.622079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aca768-4f42-423b-8a6f-8d66cf16eeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:38.624497 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aca768-4f42-423b-8a6f-8d66cf16eeaf admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:38.626523 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aca768-4f42-423b-8a6f-8d66cf16eeaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:07:38.626935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aca768-4f42-423b-8a6f-8d66cf16eeaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:38.628955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aca768-4f42-423b-8a6f-8d66cf16eeaf admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:38.647257 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1899/3844] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:07:38 2022] POST /identity/v3/users => generated 290 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:07:38.648311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f806f-7b57-47c5-975d-15b7f2ada4e1 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:38.653851 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1946/3845] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:07:38.658799 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aca768-4f42-423b-8a6f-8d66cf16eeaf admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:38.667764 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f806f-7b57-47c5-975d-15b7f2ada4e1 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:38.676935 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f75f1-4279-41ec-9ed5-0123ed35e1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:38.677327 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f75f1-4279-41ec-9ed5-0123ed35e1aa admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:38.677678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f75f1-4279-41ec-9ed5-0123ed35e1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:38.678017 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f75f1-4279-41ec-9ed5-0123ed35e1aa admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:38.680034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f75f1-4279-41ec-9ed5-0123ed35e1aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:38.684490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f75f1-4279-41ec-9ed5-0123ed35e1aa admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:38.687037 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aca768-4f42-423b-8a6f-8d66cf16eeaf admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:38.705711 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1900/3846] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:07:38.707114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f75f1-4279-41ec-9ed5-0123ed35e1aa admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:38.711321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083eaaf-3c87-4ff9-9a3c-603058cd3aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:38.713375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083eaaf-3c87-4ff9-9a3c-603058cd3aec admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:38.717011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083eaaf-3c87-4ff9-9a3c-603058cd3aec admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:38.717874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083eaaf-3c87-4ff9-9a3c-603058cd3aec admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:38.719446 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7083eaaf-3c87-4ff9-9a3c-603058cd3aec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:38.722728 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f75f1-4279-41ec-9ed5-0123ed35e1aa admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:38.726363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7083eaaf-3c87-4ff9-9a3c-603058cd3aec admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:38.732620 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7d08b-79e8-4c49-ace2-b6ffc163e706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:38.733647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7d08b-79e8-4c49-ace2-b6ffc163e706 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:38.734103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7d08b-79e8-4c49-ace2-b6ffc163e706 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:38.734929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7d08b-79e8-4c49-ace2-b6ffc163e706 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:38.735951 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7d08b-79e8-4c49-ace2-b6ffc163e706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:38.740496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7d08b-79e8-4c49-ace2-b6ffc163e706 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:38.762331 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1901/3847] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:07:38.763415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7d08b-79e8-4c49-ace2-b6ffc163e706 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:38.776484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7d08b-79e8-4c49-ace2-b6ffc163e706 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:38.783869 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea696c7-212d-4ed3-ab5b-bb85e387c931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:38.784833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea696c7-212d-4ed3-ab5b-bb85e387c931 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:38.785197 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea696c7-212d-4ed3-ab5b-bb85e387c931 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:38.785889 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea696c7-212d-4ed3-ab5b-bb85e387c931 admin admin] PATH_INFO: `/v3/projects/a6d936b54a5842938a3efb3f6aec12aa/users/202b371f27b1434184f9be6970abe9db/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:38.816551 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1947/3848] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:07:38 2022] POST /identity/v3/projects => generated 397 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:07:38.820070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea696c7-212d-4ed3-ab5b-bb85e387c931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6d936b54a5842938a3efb3f6aec12aa, user_id=202b371f27b1434184f9be6970abe9db, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:38.820679 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083eaaf-3c87-4ff9-9a3c-603058cd3aec admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:38.823216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea696c7-212d-4ed3-ab5b-bb85e387c931 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:38.860289 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1902/3849] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:07:38 2022] PUT /identity/v3/projects/a6d936b54a5842938a3efb3f6aec12aa/users/202b371f27b1434184f9be6970abe9db/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:07:38.862535 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925f8e0-64b7-486f-b77c-930a876a73d0 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:38.862920 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925f8e0-64b7-486f-b77c-930a876a73d0 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:38.863309 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925f8e0-64b7-486f-b77c-930a876a73d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:38.899894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-7925f8e0-64b7-486f-b77c-930a876a73d0 None None] MFA Rules not processed for user `202b371f27b1434184f9be6970abe9db`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:38.901842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7925f8e0-64b7-486f-b77c-930a876a73d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:39.027622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:39.053919 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083eaaf-3c87-4ff9-9a3c-603058cd3aec admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:39.133382 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1903/3850] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:07:39.136260 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a9ca1-f480-4b32-ad9e-990782d8571d None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:39.136677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a9ca1-f480-4b32-ad9e-990782d8571d None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:39.137039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a9ca1-f480-4b32-ad9e-990782d8571d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:39.179989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d11a9ca1-f480-4b32-ad9e-990782d8571d None None] MFA Rules not processed for user `202b371f27b1434184f9be6970abe9db`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:39.181480 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d11a9ca1-f480-4b32-ad9e-990782d8571d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:39.192826 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1904/3851] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:07:39.204849 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a9ca1-f480-4b32-ad9e-990782d8571d None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:39.207624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d11a9ca1-f480-4b32-ad9e-990782d8571d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:39.276896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74c2ba-12aa-4856-a966-9b797b4cfed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:39.277366 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74c2ba-12aa-4856-a966-9b797b4cfed9 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:39.277699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74c2ba-12aa-4856-a966-9b797b4cfed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:39.277977 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74c2ba-12aa-4856-a966-9b797b4cfed9 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:39.278860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f74c2ba-12aa-4856-a966-9b797b4cfed9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:39.281247 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f74c2ba-12aa-4856-a966-9b797b4cfed9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:39.324822 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1948/3852] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:07:38 2022] POST /identity/v3/users => generated 299 bytes in 502 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:07:39.326223 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74c2ba-12aa-4856-a966-9b797b4cfed9 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:39.344343 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74c2ba-12aa-4856-a966-9b797b4cfed9 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:39.356066 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420ad2c-41cb-4f9f-8392-8604f01de875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:39.356690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420ad2c-41cb-4f9f-8392-8604f01de875 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:39.356972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420ad2c-41cb-4f9f-8392-8604f01de875 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:39.357240 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420ad2c-41cb-4f9f-8392-8604f01de875 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:39.360020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1420ad2c-41cb-4f9f-8392-8604f01de875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:39.365428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1420ad2c-41cb-4f9f-8392-8604f01de875 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:39.391408 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a9ca1-f480-4b32-ad9e-990782d8571d None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:39.396528 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1949/3853] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:07:39.399025 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420ad2c-41cb-4f9f-8392-8604f01de875 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:39.410405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7946907-5a4c-42f8-b0d3-5849eed02805 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:39.411056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7946907-5a4c-42f8-b0d3-5849eed02805 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:39.411331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7946907-5a4c-42f8-b0d3-5849eed02805 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:39.411600 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7946907-5a4c-42f8-b0d3-5849eed02805 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:39.419216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420ad2c-41cb-4f9f-8392-8604f01de875 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:39.434717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7946907-5a4c-42f8-b0d3-5849eed02805 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:39.437312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7946907-5a4c-42f8-b0d3-5849eed02805 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:39.443103 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af737f-9013-4220-bdf2-380f1bfd9adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:39.443735 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af737f-9013-4220-bdf2-380f1bfd9adb admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:39.444230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af737f-9013-4220-bdf2-380f1bfd9adb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:39.444523 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af737f-9013-4220-bdf2-380f1bfd9adb admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:39.445160 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6af737f-9013-4220-bdf2-380f1bfd9adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:39.447397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6af737f-9013-4220-bdf2-380f1bfd9adb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:39.474025 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1905/3854] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:07:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:07:39.480797 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1950/3855] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:07:39.485143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7946907-5a4c-42f8-b0d3-5849eed02805 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:39.503709 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7946907-5a4c-42f8-b0d3-5849eed02805 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:39.513100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfc25a-d27f-4cb9-ba55-374bb0817211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:39.514085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfc25a-d27f-4cb9-ba55-374bb0817211 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:39.514363 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfc25a-d27f-4cb9-ba55-374bb0817211 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:39.514670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfc25a-d27f-4cb9-ba55-374bb0817211 admin admin] PATH_INFO: `/v3/projects/2d3e740659b544daa4c0c148d11d3c20/users/8da2a3ff79cb443fb55f0ad75fe1023b/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:39.534938 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbfc25a-d27f-4cb9-ba55-374bb0817211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d3e740659b544daa4c0c148d11d3c20, user_id=8da2a3ff79cb443fb55f0ad75fe1023b, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:39.539602 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbfc25a-d27f-4cb9-ba55-374bb0817211 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:39.565982 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1906/3856] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:07:39 2022] PUT /identity/v3/projects/2d3e740659b544daa4c0c148d11d3c20/users/8da2a3ff79cb443fb55f0ad75fe1023b/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:07:39.577412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59988ca-f959-48dd-891a-25c3621cad49 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:39.577870 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59988ca-f959-48dd-891a-25c3621cad49 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:39.578145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59988ca-f959-48dd-891a-25c3621cad49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:39.657661 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-e59988ca-f959-48dd-891a-25c3621cad49 None None] MFA Rules not processed for user `8da2a3ff79cb443fb55f0ad75fe1023b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:39.658884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e59988ca-f959-48dd-891a-25c3621cad49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:39.748111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:39.835098 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1951/3857] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:39 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:07:39.916913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfc25a-d27f-4cb9-ba55-374bb0817211 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:40.047900 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfc25a-d27f-4cb9-ba55-374bb0817211 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:40.056545 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5f2e0-46f6-4747-8970-6d0c3a293688 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:40.057198 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5f2e0-46f6-4747-8970-6d0c3a293688 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:40.057477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5f2e0-46f6-4747-8970-6d0c3a293688 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:40.057814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5f2e0-46f6-4747-8970-6d0c3a293688 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:40.068918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5f2e0-46f6-4747-8970-6d0c3a293688 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:40.071746 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5f2e0-46f6-4747-8970-6d0c3a293688 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:40.091325 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1907/3858] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:07:39 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:07:40.221544 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7d062-fbc9-4b80-b6d2-4aec2aed776d None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:40.221832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7d062-fbc9-4b80-b6d2-4aec2aed776d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:40.222110 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7d062-fbc9-4b80-b6d2-4aec2aed776d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:40.257969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-f5a7d062-fbc9-4b80-b6d2-4aec2aed776d None None] MFA Rules not processed for user `8da2a3ff79cb443fb55f0ad75fe1023b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:40.259221 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f5a7d062-fbc9-4b80-b6d2-4aec2aed776d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:40.284248 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1952/3859] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:40 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:07:41.078117 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5f2e0-46f6-4747-8970-6d0c3a293688 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:41.161456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:41.222793 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5f2e0-46f6-4747-8970-6d0c3a293688 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:41.229212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea0438-5369-48b4-aad7-72665774c5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:41.229844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea0438-5369-48b4-aad7-72665774c5df admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:41.230204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea0438-5369-48b4-aad7-72665774c5df admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:41.230422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea0438-5369-48b4-aad7-72665774c5df admin admin] PATH_INFO: `/v3/users/8da2a3ff79cb443fb55f0ad75fe1023b` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:41.231701 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea0438-5369-48b4-aad7-72665774c5df admin admin] RBAC: Authorizing `identity:delete_user(user_id=8da2a3ff79cb443fb55f0ad75fe1023b)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:41.233949 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea0438-5369-48b4-aad7-72665774c5df admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:41.300386 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3eea0438-5369-48b4-aad7-72665774c5df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8da2a3ff79cb443fb55f0ad75fe1023b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:41.301782 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3eea0438-5369-48b4-aad7-72665774c5df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8da2a3ff79cb443fb55f0ad75fe1023b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:41.303085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3eea0438-5369-48b4-aad7-72665774c5df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8da2a3ff79cb443fb55f0ad75fe1023b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:41.315297 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3eea0438-5369-48b4-aad7-72665774c5df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8da2a3ff79cb443fb55f0ad75fe1023b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:41.332141 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3eea0438-5369-48b4-aad7-72665774c5df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8da2a3ff79cb443fb55f0ad75fe1023b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:41.353229 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1908/3860] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:07:41 2022] DELETE /identity/v3/users/8da2a3ff79cb443fb55f0ad75fe1023b => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:07:41.354301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa937216-c2a2-4d5d-8cb1-0f9915afa5a8 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:41.354825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa937216-c2a2-4d5d-8cb1-0f9915afa5a8 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:41.354909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa937216-c2a2-4d5d-8cb1-0f9915afa5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:41.382951 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-aa937216-c2a2-4d5d-8cb1-0f9915afa5a8 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:41.384299 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-aa937216-c2a2-4d5d-8cb1-0f9915afa5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:41.462718 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1953/3861] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:07:41.475601 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea0438-5369-48b4-aad7-72665774c5df admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:41.477087 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3eea0438-5369-48b4-aad7-72665774c5df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:41.581092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea0438-5369-48b4-aad7-72665774c5df admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:41.588261 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c19f20-d93e-4478-a62a-249420b96995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:41.589005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c19f20-d93e-4478-a62a-249420b96995 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:41.589289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c19f20-d93e-4478-a62a-249420b96995 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:41.589690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c19f20-d93e-4478-a62a-249420b96995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:41.611126 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c19f20-d93e-4478-a62a-249420b96995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:41.613234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c19f20-d93e-4478-a62a-249420b96995 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:41.639979 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1909/3862] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:07:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:07:42.227070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa937216-c2a2-4d5d-8cb1-0f9915afa5a8 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:42.228843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-aa937216-c2a2-4d5d-8cb1-0f9915afa5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:42.248392 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa937216-c2a2-4d5d-8cb1-0f9915afa5a8 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:42.256392 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098f220-c598-4003-9b40-e5af1a1f3e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:42.257905 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098f220-c598-4003-9b40-e5af1a1f3e49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:42.258257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098f220-c598-4003-9b40-e5af1a1f3e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:42.258674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098f220-c598-4003-9b40-e5af1a1f3e49 admin admin] PATH_INFO: `/v3/projects/2d3e740659b544daa4c0c148d11d3c20` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:42.259955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098f220-c598-4003-9b40-e5af1a1f3e49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d3e740659b544daa4c0c148d11d3c20)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:42.262142 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098f220-c598-4003-9b40-e5af1a1f3e49 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:42.326157 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3098f220-c598-4003-9b40-e5af1a1f3e49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d3e740659b544daa4c0c148d11d3c20', 'request_id': 'req-3098f220-c598-4003-9b40-e5af1a1f3e49'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:42.331834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3098f220-c598-4003-9b40-e5af1a1f3e49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d3e740659b544daa4c0c148d11d3c20', 'request_id': 'req-3098f220-c598-4003-9b40-e5af1a1f3e49'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:42.340387 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3098f220-c598-4003-9b40-e5af1a1f3e49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d3e740659b544daa4c0c148d11d3c20', 'request_id': 'req-3098f220-c598-4003-9b40-e5af1a1f3e49'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:42.352529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3098f220-c598-4003-9b40-e5af1a1f3e49 admin admin] The token cache is being invalidate because project 2d3e740659b544daa4c0c148d11d3c20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:07:42.352990 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3098f220-c598-4003-9b40-e5af1a1f3e49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:42.353644 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3098f220-c598-4003-9b40-e5af1a1f3e49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:42.355165 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1954/3863] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:42 2022] DELETE /identity/v3/projects/2d3e740659b544daa4c0c148d11d3c20 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:07:42.360056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eccf03-c7ec-467a-92bf-a878b765a71c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:42.360494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eccf03-c7ec-467a-92bf-a878b765a71c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:42.360818 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eccf03-c7ec-467a-92bf-a878b765a71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:42.381914 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-85eccf03-c7ec-467a-92bf-a878b765a71c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:42.382930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-85eccf03-c7ec-467a-92bf-a878b765a71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:42.426339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:42.453410 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1910/3864] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:07:42.459550 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23993269-ac5b-468a-8710-567150d0707e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:42.459681 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23993269-ac5b-468a-8710-567150d0707e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:42.460192 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23993269-ac5b-468a-8710-567150d0707e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:42.481811 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-23993269-ac5b-468a-8710-567150d0707e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:42.483225 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-23993269-ac5b-468a-8710-567150d0707e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:42.492277 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1955/3865] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:07:42.496590 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eccf03-c7ec-467a-92bf-a878b765a71c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:42.508137 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eccf03-c7ec-467a-92bf-a878b765a71c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:42.513079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf96f01-b350-4b19-bd6b-01d54d24c39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:42.513691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf96f01-b350-4b19-bd6b-01d54d24c39e admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:42.513981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf96f01-b350-4b19-bd6b-01d54d24c39e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:42.514401 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf96f01-b350-4b19-bd6b-01d54d24c39e admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:42.515060 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf96f01-b350-4b19-bd6b-01d54d24c39e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:07:42.515393 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf96f01-b350-4b19-bd6b-01d54d24c39e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:42.516979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf96f01-b350-4b19-bd6b-01d54d24c39e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:42.533102 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1911/3866] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:07:42.534240 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23993269-ac5b-468a-8710-567150d0707e None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:42.545959 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23993269-ac5b-468a-8710-567150d0707e None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:42.552813 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d395300-7296-410f-b96c-d5117b61b8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:42.553667 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d395300-7296-410f-b96c-d5117b61b8c5 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:42.555456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d395300-7296-410f-b96c-d5117b61b8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:42.555456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d395300-7296-410f-b96c-d5117b61b8c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:42.555932 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d395300-7296-410f-b96c-d5117b61b8c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:42.558047 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d395300-7296-410f-b96c-d5117b61b8c5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:42.595901 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1956/3867] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:07:42 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:07:42.600049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf96f01-b350-4b19-bd6b-01d54d24c39e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:42.619028 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf96f01-b350-4b19-bd6b-01d54d24c39e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:42.695070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbb387-82b5-4954-b39e-a3124026d3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:42.695791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbb387-82b5-4954-b39e-a3124026d3b2 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:42.696223 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbb387-82b5-4954-b39e-a3124026d3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:42.696564 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbb387-82b5-4954-b39e-a3124026d3b2 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:42.697341 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acbb387-82b5-4954-b39e-a3124026d3b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:42.699731 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acbb387-82b5-4954-b39e-a3124026d3b2 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:42.721676 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1912/3868] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:07:42 2022] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:07:42.726455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d395300-7296-410f-b96c-d5117b61b8c5 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:42.742434 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d395300-7296-410f-b96c-d5117b61b8c5 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:42.747460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576451f4-5079-42c4-8869-051f6a51f63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:42.748250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576451f4-5079-42c4-8869-051f6a51f63b admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:42.748978 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576451f4-5079-42c4-8869-051f6a51f63b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:42.748978 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576451f4-5079-42c4-8869-051f6a51f63b admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:42.750283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576451f4-5079-42c4-8869-051f6a51f63b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:42.752750 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576451f4-5079-42c4-8869-051f6a51f63b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:42.774484 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1957/3869] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:07:42.776429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbb387-82b5-4954-b39e-a3124026d3b2 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:42.802659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbb387-82b5-4954-b39e-a3124026d3b2 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:42.811160 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca04e42-81f0-4abf-ab1f-8ec81e95d8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:42.811829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca04e42-81f0-4abf-ab1f-8ec81e95d8de admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:42.812164 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca04e42-81f0-4abf-ab1f-8ec81e95d8de admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:42.812509 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca04e42-81f0-4abf-ab1f-8ec81e95d8de admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:42.813233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca04e42-81f0-4abf-ab1f-8ec81e95d8de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:42.815371 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca04e42-81f0-4abf-ab1f-8ec81e95d8de admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:42.827790 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1913/3870] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:07:42.832212 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576451f4-5079-42c4-8869-051f6a51f63b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:42.847262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576451f4-5079-42c4-8869-051f6a51f63b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:42.852316 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fed21-e02d-4e6a-8906-e7319cebbdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:42.853003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fed21-e02d-4e6a-8906-e7319cebbdcc admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:42.853295 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fed21-e02d-4e6a-8906-e7319cebbdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:42.853573 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fed21-e02d-4e6a-8906-e7319cebbdcc admin admin] PATH_INFO: `/v3/projects/3389d5492b224ef9963f6305139ae9b8/users/469d18e4c7db4b0d989f7c5b72e744f7/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:42.864400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:42.874785 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739fed21-e02d-4e6a-8906-e7319cebbdcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3389d5492b224ef9963f6305139ae9b8, user_id=469d18e4c7db4b0d989f7c5b72e744f7, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:42.890771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739fed21-e02d-4e6a-8906-e7319cebbdcc admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:42.898066 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1958/3871] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:07:42 2022] PUT /identity/v3/projects/3389d5492b224ef9963f6305139ae9b8/users/469d18e4c7db4b0d989f7c5b72e744f7/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:07:42.903153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6dc90-1fc5-4362-88fb-6d324413e707 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:42.903497 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6dc90-1fc5-4362-88fb-6d324413e707 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:42.903774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6dc90-1fc5-4362-88fb-6d324413e707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:42.924581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-47b6dc90-1fc5-4362-88fb-6d324413e707 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:42.925847 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-47b6dc90-1fc5-4362-88fb-6d324413e707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:43.036519 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1914/3872] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:07:43.050005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fed21-e02d-4e6a-8906-e7319cebbdcc admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:43.053895 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-739fed21-e02d-4e6a-8906-e7319cebbdcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:43.146215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fed21-e02d-4e6a-8906-e7319cebbdcc admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:43.158908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314be324-504a-43e5-ae9f-f46763cdf1b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:43.159539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314be324-504a-43e5-ae9f-f46763cdf1b1 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:43.159819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314be324-504a-43e5-ae9f-f46763cdf1b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:43.160137 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314be324-504a-43e5-ae9f-f46763cdf1b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:43.173575 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314be324-504a-43e5-ae9f-f46763cdf1b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:43.175147 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314be324-504a-43e5-ae9f-f46763cdf1b1 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:43.197557 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1959/3873] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:07:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:07:49.136843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f91fb-fd63-46e9-adda-58593c579385 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:49.137781 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f91fb-fd63-46e9-adda-58593c579385 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:49.138236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f91fb-fd63-46e9-adda-58593c579385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:49.212324 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-cb5f91fb-fd63-46e9-adda-58593c579385 None None] MFA Rules not processed for user `469d18e4c7db4b0d989f7c5b72e744f7`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:49.213645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-cb5f91fb-fd63-46e9-adda-58593c579385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:49.313503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314be324-504a-43e5-ae9f-f46763cdf1b1 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:49.315389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-314be324-504a-43e5-ae9f-f46763cdf1b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:49.337913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314be324-504a-43e5-ae9f-f46763cdf1b1 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:49.343417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:49.351449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b7d55-2716-4c3d-afe5-991e06e16864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:49.352504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b7d55-2716-4c3d-afe5-991e06e16864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:49.352504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b7d55-2716-4c3d-afe5-991e06e16864 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:49.352725 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b7d55-2716-4c3d-afe5-991e06e16864 admin admin] PATH_INFO: `/v3/users/202b371f27b1434184f9be6970abe9db` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:49.354458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b7d55-2716-4c3d-afe5-991e06e16864 admin admin] RBAC: Authorizing `identity:delete_user(user_id=202b371f27b1434184f9be6970abe9db)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:49.358276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b7d55-2716-4c3d-afe5-991e06e16864 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:49.414202 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1915/3874] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:07:49.442216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f91fb-fd63-46e9-adda-58593c579385 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:49.445377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-cb5f91fb-fd63-46e9-adda-58593c579385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:49.460766 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-266b7d55-2716-4c3d-afe5-991e06e16864 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '202b371f27b1434184f9be6970abe9db'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:49.469780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-266b7d55-2716-4c3d-afe5-991e06e16864 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '202b371f27b1434184f9be6970abe9db'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:49.472194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-266b7d55-2716-4c3d-afe5-991e06e16864 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '202b371f27b1434184f9be6970abe9db'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:49.473131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-266b7d55-2716-4c3d-afe5-991e06e16864 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '202b371f27b1434184f9be6970abe9db'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:49.496392 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-266b7d55-2716-4c3d-afe5-991e06e16864 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '202b371f27b1434184f9be6970abe9db'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:49.530532 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1960/3875] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:07:49 2022] DELETE /identity/v3/users/202b371f27b1434184f9be6970abe9db => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:07:49.536604 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fe98f-4540-4787-8243-21598869e57b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:49.537076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fe98f-4540-4787-8243-21598869e57b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:49.538053 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fe98f-4540-4787-8243-21598869e57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:49.569635 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f91fb-fd63-46e9-adda-58593c579385 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:49.615161 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-999fe98f-4540-4787-8243-21598869e57b None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:49.621746 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-999fe98f-4540-4787-8243-21598869e57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:49.716068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac9cd1-bf40-44dc-af37-7ac8c0fbee7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:49.718510 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac9cd1-bf40-44dc-af37-7ac8c0fbee7d service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:49.718958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac9cd1-bf40-44dc-af37-7ac8c0fbee7d service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:49.719238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac9cd1-bf40-44dc-af37-7ac8c0fbee7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:49.727711 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f4ac9cd1-bf40-44dc-af37-7ac8c0fbee7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:49.819899 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1961/3876] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:07:49.840198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999fe98f-4540-4787-8243-21598869e57b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:49.845784 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-999fe98f-4540-4787-8243-21598869e57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:49.853603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:49.867789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac9cd1-bf40-44dc-af37-7ac8c0fbee7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:49.870133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac9cd1-bf40-44dc-af37-7ac8c0fbee7d service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:49.911329 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1916/3877] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:07:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:07:50.006835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999fe98f-4540-4787-8243-21598869e57b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:50.020008 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b9e14-a528-43b4-a214-c4b2115b4ec6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:50.021104 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b9e14-a528-43b4-a214-c4b2115b4ec6 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:50.022729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b9e14-a528-43b4-a214-c4b2115b4ec6 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:50.023364 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b9e14-a528-43b4-a214-c4b2115b4ec6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:50.060344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b9e14-a528-43b4-a214-c4b2115b4ec6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:50.061820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b9e14-a528-43b4-a214-c4b2115b4ec6 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:50.079223 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1962/3878] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:07:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:07:50.136828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a5789-c7b0-4db3-a0b6-fc8f35b31f83 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:50.137360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a5789-c7b0-4db3-a0b6-fc8f35b31f83 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:50.138304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a5789-c7b0-4db3-a0b6-fc8f35b31f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:50.172773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-9c2a5789-c7b0-4db3-a0b6-fc8f35b31f83 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:50.174678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9c2a5789-c7b0-4db3-a0b6-fc8f35b31f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:50.190704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:50.271672 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1917/3879] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:07:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:07:50.311140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b9e14-a528-43b4-a214-c4b2115b4ec6 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:50.312587 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1c9b9e14-a528-43b4-a214-c4b2115b4ec6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:50.435913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b9e14-a528-43b4-a214-c4b2115b4ec6 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:50.444141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ddca5d-a7b2-4dd1-84fa-2c273cd3ea13 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:50.446564 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddca5d-a7b2-4dd1-84fa-2c273cd3ea13 service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:50.446939 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddca5d-a7b2-4dd1-84fa-2c273cd3ea13 service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:50.447218 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddca5d-a7b2-4dd1-84fa-2c273cd3ea13 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:50.460107 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ddca5d-a7b2-4dd1-84fa-2c273cd3ea13 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:50.461840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ddca5d-a7b2-4dd1-84fa-2c273cd3ea13 service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:50.481633 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1963/3880] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:07:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 06 21:07:51.031359 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a5789-c7b0-4db3-a0b6-fc8f35b31f83 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:51.033763 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9c2a5789-c7b0-4db3-a0b6-fc8f35b31f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:51.068850 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a5789-c7b0-4db3-a0b6-fc8f35b31f83 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:51.089212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c8520-2c75-4948-824c-a94ccc19467a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:51.090000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c8520-2c75-4948-824c-a94ccc19467a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:51.090357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c8520-2c75-4948-824c-a94ccc19467a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:51.090658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c8520-2c75-4948-824c-a94ccc19467a admin admin] PATH_INFO: `/v3/projects/a6d936b54a5842938a3efb3f6aec12aa` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:51.092542 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c8520-2c75-4948-824c-a94ccc19467a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6d936b54a5842938a3efb3f6aec12aa)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:51.098421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c8520-2c75-4948-824c-a94ccc19467a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:51.229789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b77c8520-2c75-4948-824c-a94ccc19467a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6d936b54a5842938a3efb3f6aec12aa', 'request_id': 'req-b77c8520-2c75-4948-824c-a94ccc19467a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:51.241050 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b77c8520-2c75-4948-824c-a94ccc19467a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6d936b54a5842938a3efb3f6aec12aa', 'request_id': 'req-b77c8520-2c75-4948-824c-a94ccc19467a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:51.257793 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b77c8520-2c75-4948-824c-a94ccc19467a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6d936b54a5842938a3efb3f6aec12aa', 'request_id': 'req-b77c8520-2c75-4948-824c-a94ccc19467a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:51.308837 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b77c8520-2c75-4948-824c-a94ccc19467a admin admin] The token cache is being invalidate because project a6d936b54a5842938a3efb3f6aec12aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:07:51.309311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b77c8520-2c75-4948-824c-a94ccc19467a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:51.310520 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b77c8520-2c75-4948-824c-a94ccc19467a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:07:51.315890 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1918/3881] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:51 2022] DELETE /identity/v3/projects/a6d936b54a5842938a3efb3f6aec12aa => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:07:51.317729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3d94f-c9a5-4012-a928-3518545e2ed6 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:51.318174 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3d94f-c9a5-4012-a928-3518545e2ed6 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:51.319022 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3d94f-c9a5-4012-a928-3518545e2ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:51.368265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-e1e3d94f-c9a5-4012-a928-3518545e2ed6 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:51.370656 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e1e3d94f-c9a5-4012-a928-3518545e2ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:51.547960 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1964/3882] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:07:51.555820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c198c-c262-46b5-b191-f364f67d922d None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:51.555820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c198c-c262-46b5-b191-f364f67d922d None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:51.555820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c198c-c262-46b5-b191-f364f67d922d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:51.616797 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-364c198c-c262-46b5-b191-f364f67d922d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:51.619519 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-364c198c-c262-46b5-b191-f364f67d922d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:51.653505 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1919/3883] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:07:51.654269 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e3d94f-c9a5-4012-a928-3518545e2ed6 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:51.671818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e3d94f-c9a5-4012-a928-3518545e2ed6 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:51.694315 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd852e-cb07-41e5-b588-c75b05b1d98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:51.695079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd852e-cb07-41e5-b588-c75b05b1d98f admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:51.695365 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd852e-cb07-41e5-b588-c75b05b1d98f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:51.695640 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd852e-cb07-41e5-b588-c75b05b1d98f admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:51.696325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd852e-cb07-41e5-b588-c75b05b1d98f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:07:51.696622 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd852e-cb07-41e5-b588-c75b05b1d98f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:51.698932 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd852e-cb07-41e5-b588-c75b05b1d98f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:51.716487 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1965/3884] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:07:51.722028 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c198c-c262-46b5-b191-f364f67d922d None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:51.733308 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c198c-c262-46b5-b191-f364f67d922d None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:51.743490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43448bb-8780-4099-b9c7-0580eb3cf7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:51.744362 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43448bb-8780-4099-b9c7-0580eb3cf7f2 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:51.745294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43448bb-8780-4099-b9c7-0580eb3cf7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:51.745294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43448bb-8780-4099-b9c7-0580eb3cf7f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:51.746255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43448bb-8780-4099-b9c7-0580eb3cf7f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:51.749394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43448bb-8780-4099-b9c7-0580eb3cf7f2 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:51.813261 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1920/3885] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:07:51 2022] POST /identity/v3/projects => generated 381 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:07:51.817658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd852e-cb07-41e5-b588-c75b05b1d98f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:51.843077 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd852e-cb07-41e5-b588-c75b05b1d98f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:51.880467 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:51.989259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42f727-d22e-4ab0-b810-1d35630b6a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:51.990975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42f727-d22e-4ab0-b810-1d35630b6a25 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:51.991507 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42f727-d22e-4ab0-b810-1d35630b6a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:51.992004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42f727-d22e-4ab0-b810-1d35630b6a25 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:51.993479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42f727-d22e-4ab0-b810-1d35630b6a25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:51.996857 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42f727-d22e-4ab0-b810-1d35630b6a25 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:52.041133 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1966/3886] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:07:51 2022] POST /identity/v3/users => generated 291 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:07:52.042362 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43448bb-8780-4099-b9c7-0580eb3cf7f2 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:52.059656 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43448bb-8780-4099-b9c7-0580eb3cf7f2 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:52.072478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b52d35-6b07-492d-a5c2-5c640c9efac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:52.074773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b52d35-6b07-492d-a5c2-5c640c9efac3 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:52.075107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b52d35-6b07-492d-a5c2-5c640c9efac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:52.075531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b52d35-6b07-492d-a5c2-5c640c9efac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:52.076288 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b52d35-6b07-492d-a5c2-5c640c9efac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:52.079154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b52d35-6b07-492d-a5c2-5c640c9efac3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:52.119240 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1921/3887] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:07:52.120702 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42f727-d22e-4ab0-b810-1d35630b6a25 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:52.136623 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42f727-d22e-4ab0-b810-1d35630b6a25 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:52.158084 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825f9b3-1246-418f-abc1-f7d7fe883b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:52.159269 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825f9b3-1246-418f-abc1-f7d7fe883b44 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:52.159549 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825f9b3-1246-418f-abc1-f7d7fe883b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:52.159819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825f9b3-1246-418f-abc1-f7d7fe883b44 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:52.161103 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825f9b3-1246-418f-abc1-f7d7fe883b44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:52.163491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825f9b3-1246-418f-abc1-f7d7fe883b44 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:52.181837 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1967/3888] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:07:52.185738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b52d35-6b07-492d-a5c2-5c640c9efac3 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:52.203485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b52d35-6b07-492d-a5c2-5c640c9efac3 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:52.217734 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f60aaf-0b86-4159-ab99-ac00c2c8ee24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:52.219022 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f60aaf-0b86-4159-ab99-ac00c2c8ee24 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:52.219438 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f60aaf-0b86-4159-ab99-ac00c2c8ee24 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:52.219989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f60aaf-0b86-4159-ab99-ac00c2c8ee24 admin admin] PATH_INFO: `/v3/projects/980210caadb14685afa7afb9bbf6c651/users/a6955ef07c6f447187f1ad99c2a7b7b9/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:52.270140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f60aaf-0b86-4159-ab99-ac00c2c8ee24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=980210caadb14685afa7afb9bbf6c651, user_id=a6955ef07c6f447187f1ad99c2a7b7b9, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:52.276172 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f60aaf-0b86-4159-ab99-ac00c2c8ee24 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:52.303925 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1922/3889] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:07:52 2022] PUT /identity/v3/projects/980210caadb14685afa7afb9bbf6c651/users/a6955ef07c6f447187f1ad99c2a7b7b9/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:07:52.309292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c10bda-15c1-4049-b663-03604c1d1a5b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:52.309586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c10bda-15c1-4049-b663-03604c1d1a5b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:52.309918 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c10bda-15c1-4049-b663-03604c1d1a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:52.353021 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-68c10bda-15c1-4049-b663-03604c1d1a5b None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:52.354344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-68c10bda-15c1-4049-b663-03604c1d1a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:52.540105 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1968/3890] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:07:52.550520 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f60aaf-0b86-4159-ab99-ac00c2c8ee24 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:07:52.552954 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f3f60aaf-0b86-4159-ab99-ac00c2c8ee24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:52.674057 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:52.702977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f60aaf-0b86-4159-ab99-ac00c2c8ee24 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:07:52.713177 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ddae1f-c3d8-438e-b7d8-c9a32d991c6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:07:52.713802 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddae1f-c3d8-438e-b7d8-c9a32d991c6a service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:52.714083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddae1f-c3d8-438e-b7d8-c9a32d991c6a service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:52.714352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddae1f-c3d8-438e-b7d8-c9a32d991c6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:52.753762 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ddae1f-c3d8-438e-b7d8-c9a32d991c6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:07:52.755257 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ddae1f-c3d8-438e-b7d8-c9a32d991c6a service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:07:52.783037 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1923/3891] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:07:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:07:53.177052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb67a19-9dfd-47e1-9f67-2d071227e63d None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:53.177619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb67a19-9dfd-47e1-9f67-2d071227e63d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:53.177619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb67a19-9dfd-47e1-9f67-2d071227e63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:53.214370 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-2cb67a19-9dfd-47e1-9f67-2d071227e63d None None] MFA Rules not processed for user `469d18e4c7db4b0d989f7c5b72e744f7`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:53.219181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2cb67a19-9dfd-47e1-9f67-2d071227e63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:07:53.294629 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1969/3892] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:07:59.940554 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77272b0f-46cf-4a2d-b45a-ea3313b3307f None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:07:59.941554 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77272b0f-46cf-4a2d-b45a-ea3313b3307f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:07:59.941995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77272b0f-46cf-4a2d-b45a-ea3313b3307f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:07:59.968132 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-77272b0f-46cf-4a2d-b45a-ea3313b3307f None None] MFA Rules not processed for user `7dcd210e197347f8ad1622ee882bee92`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:07:59.970740 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-77272b0f-46cf-4a2d-b45a-ea3313b3307f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:00.118527 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1924/3893] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:07:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:03.253649 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb67a19-9dfd-47e1-9f67-2d071227e63d None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:03.255191 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2cb67a19-9dfd-47e1-9f67-2d071227e63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:03.299917 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb67a19-9dfd-47e1-9f67-2d071227e63d None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:03.320628 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a4fa8-e7f3-4477-ac30-882fbc6d7baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:03.323792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a4fa8-e7f3-4477-ac30-882fbc6d7baa admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:03.327038 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a4fa8-e7f3-4477-ac30-882fbc6d7baa admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:03.328117 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a4fa8-e7f3-4477-ac30-882fbc6d7baa admin admin] PATH_INFO: `/v3/users/6887aa30a0584334a58d8cab1e8cb4c3` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:03.333236 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218a4fa8-e7f3-4477-ac30-882fbc6d7baa admin admin] RBAC: Authorizing `identity:delete_user(user_id=6887aa30a0584334a58d8cab1e8cb4c3)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:03.345629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218a4fa8-e7f3-4477-ac30-882fbc6d7baa admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:03.472762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:03.486876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-218a4fa8-e7f3-4477-ac30-882fbc6d7baa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6887aa30a0584334a58d8cab1e8cb4c3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:03.498946 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-218a4fa8-e7f3-4477-ac30-882fbc6d7baa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6887aa30a0584334a58d8cab1e8cb4c3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:03.500033 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-218a4fa8-e7f3-4477-ac30-882fbc6d7baa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6887aa30a0584334a58d8cab1e8cb4c3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:03.500811 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-218a4fa8-e7f3-4477-ac30-882fbc6d7baa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6887aa30a0584334a58d8cab1e8cb4c3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:03.516286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-218a4fa8-e7f3-4477-ac30-882fbc6d7baa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6887aa30a0584334a58d8cab1e8cb4c3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:03.543935 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1970/3894] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:08:03 2022] DELETE /identity/v3/users/6887aa30a0584334a58d8cab1e8cb4c3 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:03.549461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ee707-7603-463c-9e0b-e1c7601a291a None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:03.550529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ee707-7603-463c-9e0b-e1c7601a291a None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:03.551036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ee707-7603-463c-9e0b-e1c7601a291a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:03.578080 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-ee8ee707-7603-463c-9e0b-e1c7601a291a None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:03.580089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ee8ee707-7603-463c-9e0b-e1c7601a291a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:03.731959 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1925/3895] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:08:03.745765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a4fa8-e7f3-4477-ac30-882fbc6d7baa admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:03.747586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-218a4fa8-e7f3-4477-ac30-882fbc6d7baa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:03.897431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a4fa8-e7f3-4477-ac30-882fbc6d7baa admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:03.909438 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80ea08-3376-4e5e-aa69-3a372d3b8c4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:03.910145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80ea08-3376-4e5e-aa69-3a372d3b8c4f service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:03.910423 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80ea08-3376-4e5e-aa69-3a372d3b8c4f service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:03.910720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80ea08-3376-4e5e-aa69-3a372d3b8c4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:03.977226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80ea08-3376-4e5e-aa69-3a372d3b8c4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:03.994123 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80ea08-3376-4e5e-aa69-3a372d3b8c4f service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:04.035382 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1971/3896] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:08:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:08:06.152374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ee707-7603-463c-9e0b-e1c7601a291a None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:06.154431 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ee8ee707-7603-463c-9e0b-e1c7601a291a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:06.169123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ee707-7603-463c-9e0b-e1c7601a291a None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:06.177896 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4992141-e3da-4368-8ee0-4af7d6a22516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:06.179404 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4992141-e3da-4368-8ee0-4af7d6a22516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:06.180218 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4992141-e3da-4368-8ee0-4af7d6a22516 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:06.180729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4992141-e3da-4368-8ee0-4af7d6a22516 admin admin] PATH_INFO: `/v3/projects/251bd93dd4924a7790ed5313975d90a9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:06.182383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4992141-e3da-4368-8ee0-4af7d6a22516 admin admin] RBAC: Authorizing `identity:delete_project(project_id=251bd93dd4924a7790ed5313975d90a9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:06.185424 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4992141-e3da-4368-8ee0-4af7d6a22516 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:06.315829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d4992141-e3da-4368-8ee0-4af7d6a22516 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '251bd93dd4924a7790ed5313975d90a9', 'request_id': 'req-d4992141-e3da-4368-8ee0-4af7d6a22516'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:06.323967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d4992141-e3da-4368-8ee0-4af7d6a22516 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '251bd93dd4924a7790ed5313975d90a9', 'request_id': 'req-d4992141-e3da-4368-8ee0-4af7d6a22516'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:06.335083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d4992141-e3da-4368-8ee0-4af7d6a22516 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '251bd93dd4924a7790ed5313975d90a9', 'request_id': 'req-d4992141-e3da-4368-8ee0-4af7d6a22516'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:06.370281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d4992141-e3da-4368-8ee0-4af7d6a22516 admin admin] The token cache is being invalidate because project 251bd93dd4924a7790ed5313975d90a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:08:06.371042 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d4992141-e3da-4368-8ee0-4af7d6a22516 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:06.374450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d4992141-e3da-4368-8ee0-4af7d6a22516 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:06.379747 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1926/3897] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:08:06 2022] DELETE /identity/v3/projects/251bd93dd4924a7790ed5313975d90a9 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:06.386297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bb774-13d2-460a-8e21-a0edd1390d72 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:06.387833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bb774-13d2-460a-8e21-a0edd1390d72 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:06.388288 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bb774-13d2-460a-8e21-a0edd1390d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:06.427220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-ba2bb774-13d2-460a-8e21-a0edd1390d72 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:06.447436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ba2bb774-13d2-460a-8e21-a0edd1390d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:06.674680 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1972/3898] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:06.675257 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5649054-b879-463e-b075-9877b5824f11 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:06.675581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5649054-b879-463e-b075-9877b5824f11 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:06.676030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5649054-b879-463e-b075-9877b5824f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:06.701368 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d5649054-b879-463e-b075-9877b5824f11 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:06.702990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d5649054-b879-463e-b075-9877b5824f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:06.716889 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2bb774-13d2-460a-8e21-a0edd1390d72 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:06.717867 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1927/3899] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:06.729898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2bb774-13d2-460a-8e21-a0edd1390d72 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:06.736992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d15202-6c4a-4867-9a80-db1c17c9d27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:06.741001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d15202-6c4a-4867-9a80-db1c17c9d27b admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:06.741643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d15202-6c4a-4867-9a80-db1c17c9d27b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:06.742194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d15202-6c4a-4867-9a80-db1c17c9d27b admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:06.750193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d15202-6c4a-4867-9a80-db1c17c9d27b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:08:06.750778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d15202-6c4a-4867-9a80-db1c17c9d27b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:06.752620 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d15202-6c4a-4867-9a80-db1c17c9d27b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:06.791231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5649054-b879-463e-b075-9877b5824f11 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:06.798257 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:06.813223 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5649054-b879-463e-b075-9877b5824f11 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:06.814072 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1973/3900] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:08:06.837122 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe7bc8-d9b7-4c22-83d3-fae0902c769f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:06.837779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe7bc8-d9b7-4c22-83d3-fae0902c769f admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:06.838065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe7bc8-d9b7-4c22-83d3-fae0902c769f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:06.840820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe7bc8-d9b7-4c22-83d3-fae0902c769f admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:06.842961 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe7bc8-d9b7-4c22-83d3-fae0902c769f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:06.847137 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe7bc8-d9b7-4c22-83d3-fae0902c769f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:06.929531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eeea7e-7585-421c-b1ba-227dbe10a6c1 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:06.930081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eeea7e-7585-421c-b1ba-227dbe10a6c1 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:06.930363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eeea7e-7585-421c-b1ba-227dbe10a6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:06.977544 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-41eeea7e-7585-421c-b1ba-227dbe10a6c1 None None] MFA Rules not processed for user `bdf1b5180a814cf39234892c6c1f26df`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:06.982613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-41eeea7e-7585-421c-b1ba-227dbe10a6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:07.004663 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1928/3901] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:08:06 2022] POST /identity/v3/projects => generated 365 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:08:07.007632 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe7bc8-d9b7-4c22-83d3-fae0902c769f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:07.122350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:07.167127 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1974/3902] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:07.309264 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe7bc8-d9b7-4c22-83d3-fae0902c769f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:07.320688 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a5f54-2e90-4a07-bd39-1ca835b1691e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:07.321798 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a5f54-2e90-4a07-bd39-1ca835b1691e admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:07.322225 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a5f54-2e90-4a07-bd39-1ca835b1691e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:07.322694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a5f54-2e90-4a07-bd39-1ca835b1691e admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:07.323463 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a5f54-2e90-4a07-bd39-1ca835b1691e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:07.325559 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a5f54-2e90-4a07-bd39-1ca835b1691e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:07.382410 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1929/3903] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:08:07 2022] POST /identity/v3/users => generated 283 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:08:07.383398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eeea7e-7585-421c-b1ba-227dbe10a6c1 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:07.401820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eeea7e-7585-421c-b1ba-227dbe10a6c1 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:07.425250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c51ad8-28cc-4c86-98b9-0c86bd5c670a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:07.425895 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c51ad8-28cc-4c86-98b9-0c86bd5c670a admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:07.436030 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c51ad8-28cc-4c86-98b9-0c86bd5c670a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:07.436492 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c51ad8-28cc-4c86-98b9-0c86bd5c670a admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:07.438941 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c51ad8-28cc-4c86-98b9-0c86bd5c670a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:07.440849 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c51ad8-28cc-4c86-98b9-0c86bd5c670a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:07.474060 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a5f54-2e90-4a07-bd39-1ca835b1691e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:07.475391 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1975/3904] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:08:07.488897 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a5f54-2e90-4a07-bd39-1ca835b1691e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:07.513075 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322b058-6978-499f-a9be-38052265f738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:07.513942 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322b058-6978-499f-a9be-38052265f738 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:07.516624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322b058-6978-499f-a9be-38052265f738 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:07.516901 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322b058-6978-499f-a9be-38052265f738 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:07.517581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4322b058-6978-499f-a9be-38052265f738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:07.531306 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4322b058-6978-499f-a9be-38052265f738 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:07.580751 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1930/3905] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:08:07.588114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c51ad8-28cc-4c86-98b9-0c86bd5c670a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:07.603707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c51ad8-28cc-4c86-98b9-0c86bd5c670a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:07.611909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a2305-fd9f-47c9-bb6a-5bc05435e17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:07.612682 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a2305-fd9f-47c9-bb6a-5bc05435e17b admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:07.613258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a2305-fd9f-47c9-bb6a-5bc05435e17b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:07.613628 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a2305-fd9f-47c9-bb6a-5bc05435e17b admin admin] PATH_INFO: `/v3/projects/561e7cedf06f4664895ec6ee3a6678ba/users/8fa068c89e234ea084cd1129f049f861/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:07.660571 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a2305-fd9f-47c9-bb6a-5bc05435e17b admin admin] RBAC: Authorizing `identity:create_grant(project_id=561e7cedf06f4664895ec6ee3a6678ba, user_id=8fa068c89e234ea084cd1129f049f861, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:07.665411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a2305-fd9f-47c9-bb6a-5bc05435e17b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:07.691746 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1976/3906] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:08:07 2022] PUT /identity/v3/projects/561e7cedf06f4664895ec6ee3a6678ba/users/8fa068c89e234ea084cd1129f049f861/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:07.704057 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd906416-02b9-4218-a7b6-0b5b2dd5cf3a None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:07.704353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd906416-02b9-4218-a7b6-0b5b2dd5cf3a None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:07.704618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd906416-02b9-4218-a7b6-0b5b2dd5cf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:07.800720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-cd906416-02b9-4218-a7b6-0b5b2dd5cf3a None None] MFA Rules not processed for user `8fa068c89e234ea084cd1129f049f861`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:07.806394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-cd906416-02b9-4218-a7b6-0b5b2dd5cf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:07.971950 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1931/3907] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:07.983592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a2305-fd9f-47c9-bb6a-5bc05435e17b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:07.985389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5e4a2305-fd9f-47c9-bb6a-5bc05435e17b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:08.084878 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6917a52-27aa-450d-82e2-ae4c09d227b9 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:08.085457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6917a52-27aa-450d-82e2-ae4c09d227b9 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:08.086151 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6917a52-27aa-450d-82e2-ae4c09d227b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:08.132857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-e6917a52-27aa-450d-82e2-ae4c09d227b9 None None] MFA Rules not processed for user `a6955ef07c6f447187f1ad99c2a7b7b9`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:08.134898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e6917a52-27aa-450d-82e2-ae4c09d227b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:08.221062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a2305-fd9f-47c9-bb6a-5bc05435e17b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:08.222276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:08.231343 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf823ca-acc6-423b-b83d-9d22d62588a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:08.231984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf823ca-acc6-423b-b83d-9d22d62588a0 service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:08.232391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf823ca-acc6-423b-b83d-9d22d62588a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:08.232962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf823ca-acc6-423b-b83d-9d22d62588a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:08.266394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf823ca-acc6-423b-b83d-9d22d62588a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:08.267887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf823ca-acc6-423b-b83d-9d22d62588a0 service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:08.301216 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1977/3908] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:08:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:08:08.308105 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1932/3909] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:08.321698 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22da2a7-b0e2-4c38-88f3-3d81d5a12b9a None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:08.322183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22da2a7-b0e2-4c38-88f3-3d81d5a12b9a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:08.322597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22da2a7-b0e2-4c38-88f3-3d81d5a12b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:08.347980 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-f22da2a7-b0e2-4c38-88f3-3d81d5a12b9a None None] MFA Rules not processed for user `a6955ef07c6f447187f1ad99c2a7b7b9`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:08.357665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f22da2a7-b0e2-4c38-88f3-3d81d5a12b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:08.393686 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1978/3910] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:08.888546 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6917a52-27aa-450d-82e2-ae4c09d227b9 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:08.890003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e6917a52-27aa-450d-82e2-ae4c09d227b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:09.051604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6917a52-27aa-450d-82e2-ae4c09d227b9 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:09.066683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6058028-478b-4d91-8a3e-c78e2a5ecc1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:09.067876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6058028-478b-4d91-8a3e-c78e2a5ecc1b service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:09.068392 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6058028-478b-4d91-8a3e-c78e2a5ecc1b service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:09.069004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6058028-478b-4d91-8a3e-c78e2a5ecc1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:09.095928 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6058028-478b-4d91-8a3e-c78e2a5ecc1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:09.097898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6058028-478b-4d91-8a3e-c78e2a5ecc1b service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:09.111821 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1933/3911] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:08:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:08:09.659315 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22da2a7-b0e2-4c38-88f3-3d81d5a12b9a None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:09.662805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f22da2a7-b0e2-4c38-88f3-3d81d5a12b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:09.688863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22da2a7-b0e2-4c38-88f3-3d81d5a12b9a None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:09.696470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5e985-e0f1-404c-ab8a-206cf9ff8206 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:09.697604 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5e985-e0f1-404c-ab8a-206cf9ff8206 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:09.698120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5e985-e0f1-404c-ab8a-206cf9ff8206 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:09.698672 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5e985-e0f1-404c-ab8a-206cf9ff8206 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:09.701703 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-05f5e985-e0f1-404c-ab8a-206cf9ff8206 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:09.924952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f5e985-e0f1-404c-ab8a-206cf9ff8206 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:09.927091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f5e985-e0f1-404c-ab8a-206cf9ff8206 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:09.969644 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1979/3912] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:08:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:08:15.582079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695ed50-9e6d-4dcc-9577-2036b539224d None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:15.586296 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695ed50-9e6d-4dcc-9577-2036b539224d None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:15.587928 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695ed50-9e6d-4dcc-9577-2036b539224d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:15.654817 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-0695ed50-9e6d-4dcc-9577-2036b539224d None None] MFA Rules not processed for user `f7cf258df10248d0bdcf64fa075c132c`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:15.667224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0695ed50-9e6d-4dcc-9577-2036b539224d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:15.778857 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1934/3913] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:15 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:19.941253 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=75,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:24.888827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee92b3e-739e-4b22-a569-ba97291f9ea3 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:24.889446 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee92b3e-739e-4b22-a569-ba97291f9ea3 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:24.889446 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee92b3e-739e-4b22-a569-ba97291f9ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:24.926041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-0ee92b3e-739e-4b22-a569-ba97291f9ea3 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:24.927771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0ee92b3e-739e-4b22-a569-ba97291f9ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:25.013141 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695ed50-9e6d-4dcc-9577-2036b539224d None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:25.131493 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1980/3914] 10.222.0.33 () {58 vars in 967 bytes} [Sat Aug 6 21:08:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:25.132727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee92b3e-739e-4b22-a569-ba97291f9ea3 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:25.134339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0ee92b3e-739e-4b22-a569-ba97291f9ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:25.179655 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695ed50-9e6d-4dcc-9577-2036b539224d None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:25.191261 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585b97a-9931-4a22-862a-fed917d1efd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:25.193580 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585b97a-9931-4a22-862a-fed917d1efd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:25.194114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585b97a-9931-4a22-862a-fed917d1efd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:25.196895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585b97a-9931-4a22-862a-fed917d1efd6 admin admin] PATH_INFO: `/v3/users/8fa068c89e234ea084cd1129f049f861` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:25.198569 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585b97a-9931-4a22-862a-fed917d1efd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fa068c89e234ea084cd1129f049f861)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:25.203153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585b97a-9931-4a22-862a-fed917d1efd6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:25.228477 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee92b3e-739e-4b22-a569-ba97291f9ea3 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:25.235765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3fb0c-6682-4166-a62d-870b6b1bc7d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:25.236373 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3fb0c-6682-4166-a62d-870b6b1bc7d8 service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:25.236658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3fb0c-6682-4166-a62d-870b6b1bc7d8 service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:25.236950 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3fb0c-6682-4166-a62d-870b6b1bc7d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:25.240490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:25.256262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3fb0c-6682-4166-a62d-870b6b1bc7d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:25.257991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3fb0c-6682-4166-a62d-870b6b1bc7d8 service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:25.268286 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1981/3915] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:08:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:08:25.309115 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9585b97a-9931-4a22-862a-fed917d1efd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fa068c89e234ea084cd1129f049f861'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:25.310128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9585b97a-9931-4a22-862a-fed917d1efd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fa068c89e234ea084cd1129f049f861'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:25.310947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9585b97a-9931-4a22-862a-fed917d1efd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fa068c89e234ea084cd1129f049f861'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:25.322723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9585b97a-9931-4a22-862a-fed917d1efd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fa068c89e234ea084cd1129f049f861'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:25.371846 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9585b97a-9931-4a22-862a-fed917d1efd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fa068c89e234ea084cd1129f049f861'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:25.443279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ac3c0-42ec-4352-9317-f7bcc38f96f3 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:25.444420 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ac3c0-42ec-4352-9317-f7bcc38f96f3 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:25.444920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ac3c0-42ec-4352-9317-f7bcc38f96f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:25.447009 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1935/3916] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:08:25 2022] DELETE /identity/v3/users/8fa068c89e234ea084cd1129f049f861 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:25.480427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-f78ac3c0-42ec-4352-9317-f7bcc38f96f3 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:25.482068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f78ac3c0-42ec-4352-9317-f7bcc38f96f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:25.565286 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1982/3917] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:25.660108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585b97a-9931-4a22-862a-fed917d1efd6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:25.671109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9585b97a-9931-4a22-862a-fed917d1efd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:25.849542 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb537a-80ef-465d-8dc3-3e8571945d30 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:25.850840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb537a-80ef-465d-8dc3-3e8571945d30 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:25.851139 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb537a-80ef-465d-8dc3-3e8571945d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:25.857578 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585b97a-9931-4a22-862a-fed917d1efd6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:25.863918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83d6a6-e356-4443-90a0-7f0632804d77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:25.865626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83d6a6-e356-4443-90a0-7f0632804d77 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:25.866152 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83d6a6-e356-4443-90a0-7f0632804d77 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:25.866689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83d6a6-e356-4443-90a0-7f0632804d77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:25.880822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83d6a6-e356-4443-90a0-7f0632804d77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:25.886244 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83d6a6-e356-4443-90a0-7f0632804d77 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:25.891824 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-24eb537a-80ef-465d-8dc3-3e8571945d30 None None] MFA Rules not processed for user `7dcd210e197347f8ad1622ee882bee92`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:25.896551 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-24eb537a-80ef-465d-8dc3-3e8571945d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:25.915919 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1936/3918] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:08:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:08:25.964698 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:26.010897 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1983/3919] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:08:26.410124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83d6a6-e356-4443-90a0-7f0632804d77 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:26.412887 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7d83d6a6-e356-4443-90a0-7f0632804d77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:26.449287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfec9d-87a2-411d-b9b6-22fa5107f4ce None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:26.449917 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfec9d-87a2-411d-b9b6-22fa5107f4ce None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:26.450349 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfec9d-87a2-411d-b9b6-22fa5107f4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:26.452548 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83d6a6-e356-4443-90a0-7f0632804d77 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:26.460359 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea1453-c646-4d94-9add-158f3444e710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:26.462601 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea1453-c646-4d94-9add-158f3444e710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:26.463193 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea1453-c646-4d94-9add-158f3444e710 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:26.463624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea1453-c646-4d94-9add-158f3444e710 admin admin] PATH_INFO: `/v3/projects/561e7cedf06f4664895ec6ee3a6678ba` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:26.464967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea1453-c646-4d94-9add-158f3444e710 admin admin] RBAC: Authorizing `identity:delete_project(project_id=561e7cedf06f4664895ec6ee3a6678ba)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:26.467091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea1453-c646-4d94-9add-158f3444e710 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:26.474256 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-8ccfec9d-87a2-411d-b9b6-22fa5107f4ce None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:26.475958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8ccfec9d-87a2-411d-b9b6-22fa5107f4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:26.568065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d8ea1453-c646-4d94-9add-158f3444e710 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '561e7cedf06f4664895ec6ee3a6678ba', 'request_id': 'req-d8ea1453-c646-4d94-9add-158f3444e710'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:26.575049 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1984/3920] 10.222.0.33 () {58 vars in 967 bytes} [Sat Aug 6 21:08:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:26.585777 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d8ea1453-c646-4d94-9add-158f3444e710 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '561e7cedf06f4664895ec6ee3a6678ba', 'request_id': 'req-d8ea1453-c646-4d94-9add-158f3444e710'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:26.590912 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccfec9d-87a2-411d-b9b6-22fa5107f4ce None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:26.593831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8ccfec9d-87a2-411d-b9b6-22fa5107f4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:26.596104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d8ea1453-c646-4d94-9add-158f3444e710 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '561e7cedf06f4664895ec6ee3a6678ba', 'request_id': 'req-d8ea1453-c646-4d94-9add-158f3444e710'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:26.614535 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d8ea1453-c646-4d94-9add-158f3444e710 admin admin] The token cache is being invalidate because project 561e7cedf06f4664895ec6ee3a6678ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:08:26.615266 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d8ea1453-c646-4d94-9add-158f3444e710 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:26.616185 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d8ea1453-c646-4d94-9add-158f3444e710 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:26.617863 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1937/3921] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:08:26 2022] DELETE /identity/v3/projects/561e7cedf06f4664895ec6ee3a6678ba => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:26.624778 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec997a-8a89-4307-84d2-03ceefe93df0 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:26.625357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec997a-8a89-4307-84d2-03ceefe93df0 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:26.625893 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec997a-8a89-4307-84d2-03ceefe93df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:26.656072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-fbec997a-8a89-4307-84d2-03ceefe93df0 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:26.657573 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-fbec997a-8a89-4307-84d2-03ceefe93df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:26.689524 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:26.697619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccfec9d-87a2-411d-b9b6-22fa5107f4ce None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:26.769395 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1938/3922] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:26.777866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d8129-f10b-4304-9b1c-af82006173da None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:26.778279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d8129-f10b-4304-9b1c-af82006173da None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:26.778715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d8129-f10b-4304-9b1c-af82006173da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:26.789154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d70c0-ac1e-4390-ac5b-f50ce0f316f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:26.790041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d70c0-ac1e-4390-ac5b-f50ce0f316f1 service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:26.790516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d70c0-ac1e-4390-ac5b-f50ce0f316f1 service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:26.791056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d70c0-ac1e-4390-ac5b-f50ce0f316f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:26.793711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8b4d70c0-ac1e-4390-ac5b-f50ce0f316f1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:26.803038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-753d8129-f10b-4304-9b1c-af82006173da None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:26.804444 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-753d8129-f10b-4304-9b1c-af82006173da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:26.814208 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1939/3923] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:08:26.818779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d8129-f10b-4304-9b1c-af82006173da None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:26.829429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d8129-f10b-4304-9b1c-af82006173da None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:26.832501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:26.836758 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee339e9f-3469-44de-ae52-d237a8c7def4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:26.837891 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee339e9f-3469-44de-ae52-d237a8c7def4 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:26.838393 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee339e9f-3469-44de-ae52-d237a8c7def4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:26.838978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee339e9f-3469-44de-ae52-d237a8c7def4 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:26.839822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee339e9f-3469-44de-ae52-d237a8c7def4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:08:26.840281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee339e9f-3469-44de-ae52-d237a8c7def4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:26.842242 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee339e9f-3469-44de-ae52-d237a8c7def4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:26.855505 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1940/3924] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:08:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:08:26.860220 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee339e9f-3469-44de-ae52-d237a8c7def4 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:26.872588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee339e9f-3469-44de-ae52-d237a8c7def4 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:26.878374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f0d5e-9abb-45cc-99b7-18782f4b02c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:26.879405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f0d5e-9abb-45cc-99b7-18782f4b02c4 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:26.879536 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f0d5e-9abb-45cc-99b7-18782f4b02c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:26.880344 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f0d5e-9abb-45cc-99b7-18782f4b02c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:26.881018 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f0d5e-9abb-45cc-99b7-18782f4b02c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:26.882983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d70c0-ac1e-4390-ac5b-f50ce0f316f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:26.883682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f0d5e-9abb-45cc-99b7-18782f4b02c4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:26.885018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d70c0-ac1e-4390-ac5b-f50ce0f316f1 service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:26.895231 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1985/3925] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:08:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 06 21:08:26.931052 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1941/3926] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:08:26 2022] POST /identity/v3/projects => generated 367 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:08:26.935085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d70c0-ac1e-4390-ac5b-f50ce0f316f1 service swift] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:26.948599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d70c0-ac1e-4390-ac5b-f50ce0f316f1 service swift] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:27.019195 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dedc7e-4cd3-4b85-bb9d-cd832332697f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:27.019877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dedc7e-4cd3-4b85-bb9d-cd832332697f admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:27.020455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dedc7e-4cd3-4b85-bb9d-cd832332697f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:27.021113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dedc7e-4cd3-4b85-bb9d-cd832332697f admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:27.022342 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dedc7e-4cd3-4b85-bb9d-cd832332697f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:27.025468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dedc7e-4cd3-4b85-bb9d-cd832332697f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:27.066973 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1986/3927] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:08:26 2022] POST /identity/v3/users => generated 284 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:08:27.071569 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f0d5e-9abb-45cc-99b7-18782f4b02c4 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:27.088011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f0d5e-9abb-45cc-99b7-18782f4b02c4 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:27.104557 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c79bc6-21e0-44ce-b806-86507ddcc5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:27.105500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c79bc6-21e0-44ce-b806-86507ddcc5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:27.105779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c79bc6-21e0-44ce-b806-86507ddcc5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:27.106059 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c79bc6-21e0-44ce-b806-86507ddcc5b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:27.106739 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c79bc6-21e0-44ce-b806-86507ddcc5b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:27.108472 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c79bc6-21e0-44ce-b806-86507ddcc5b2 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:27.143865 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1942/3928] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:08:27.144643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dedc7e-4cd3-4b85-bb9d-cd832332697f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:27.160523 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dedc7e-4cd3-4b85-bb9d-cd832332697f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:27.167227 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472646e-29ff-4ff3-bd78-424387e4cad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:27.168183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472646e-29ff-4ff3-bd78-424387e4cad8 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:27.168662 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472646e-29ff-4ff3-bd78-424387e4cad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:27.169140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472646e-29ff-4ff3-bd78-424387e4cad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:27.170630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472646e-29ff-4ff3-bd78-424387e4cad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:27.173742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472646e-29ff-4ff3-bd78-424387e4cad8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:27.188227 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1987/3929] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:08:27.193419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c79bc6-21e0-44ce-b806-86507ddcc5b2 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:27.211277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c79bc6-21e0-44ce-b806-86507ddcc5b2 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:27.243856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49ea56-add2-4043-803d-8e893c80ad27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:27.245029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49ea56-add2-4043-803d-8e893c80ad27 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:27.246926 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49ea56-add2-4043-803d-8e893c80ad27 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:27.247290 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49ea56-add2-4043-803d-8e893c80ad27 admin admin] PATH_INFO: `/v3/projects/fba5267bbdf74ba0bda44b4d4b60c4e8/users/23cbb52872514943b88bcda8a9bfa7aa/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:27.265203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49ea56-add2-4043-803d-8e893c80ad27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fba5267bbdf74ba0bda44b4d4b60c4e8, user_id=23cbb52872514943b88bcda8a9bfa7aa, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:27.269286 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49ea56-add2-4043-803d-8e893c80ad27 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:27.295064 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1943/3930] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:08:27 2022] PUT /identity/v3/projects/fba5267bbdf74ba0bda44b4d4b60c4e8/users/23cbb52872514943b88bcda8a9bfa7aa/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:27.301212 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62cafe-f9dc-481a-9222-167777ad5790 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:27.301741 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62cafe-f9dc-481a-9222-167777ad5790 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:27.302217 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62cafe-f9dc-481a-9222-167777ad5790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:27.344223 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-1f62cafe-f9dc-481a-9222-167777ad5790 None None] MFA Rules not processed for user `23cbb52872514943b88bcda8a9bfa7aa`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:27.345698 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1f62cafe-f9dc-481a-9222-167777ad5790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:27.447693 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1988/3931] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:08:27.451917 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49ea56-add2-4043-803d-8e893c80ad27 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:27.592102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49ea56-add2-4043-803d-8e893c80ad27 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:27.601686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81506f-7d86-4356-a078-7e9b7d4249ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:27.602964 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81506f-7d86-4356-a078-7e9b7d4249ce admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:27.603427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81506f-7d86-4356-a078-7e9b7d4249ce admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:27.603990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81506f-7d86-4356-a078-7e9b7d4249ce admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:27.605108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81506f-7d86-4356-a078-7e9b7d4249ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:27.608675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81506f-7d86-4356-a078-7e9b7d4249ce admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:27.658593 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1944/3932] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:08:27 2022] POST /identity/v3/projects => generated 367 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:08:27.661154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62cafe-f9dc-481a-9222-167777ad5790 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:27.686707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62cafe-f9dc-481a-9222-167777ad5790 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:27.779941 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:27.859736 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb1ac2-d82f-4e1f-bb1b-0cc5400d77ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:27.860365 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb1ac2-d82f-4e1f-bb1b-0cc5400d77ba admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:27.860646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb1ac2-d82f-4e1f-bb1b-0cc5400d77ba admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:27.860924 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb1ac2-d82f-4e1f-bb1b-0cc5400d77ba admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:27.861556 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb1ac2-d82f-4e1f-bb1b-0cc5400d77ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:27.863537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb1ac2-d82f-4e1f-bb1b-0cc5400d77ba admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:27.900519 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1989/3933] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:08:27 2022] POST /identity/v3/users => generated 290 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:08:27.904607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81506f-7d86-4356-a078-7e9b7d4249ce admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:27.921523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81506f-7d86-4356-a078-7e9b7d4249ce admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:27.927637 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799babdb-3483-4d47-897f-d3b07aa9daaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:27.928456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799babdb-3483-4d47-897f-d3b07aa9daaa admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:27.928955 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799babdb-3483-4d47-897f-d3b07aa9daaa admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:27.929305 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799babdb-3483-4d47-897f-d3b07aa9daaa admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:27.930698 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799babdb-3483-4d47-897f-d3b07aa9daaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:27.932539 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799babdb-3483-4d47-897f-d3b07aa9daaa admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:27.946760 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1945/3934] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:08:27.951417 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb1ac2-d82f-4e1f-bb1b-0cc5400d77ba admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:27.966530 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb1ac2-d82f-4e1f-bb1b-0cc5400d77ba admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:27.971784 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7599c-2922-4c5c-aacf-3e6298fb28b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:27.972533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7599c-2922-4c5c-aacf-3e6298fb28b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:27.972819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7599c-2922-4c5c-aacf-3e6298fb28b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:27.973230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7599c-2922-4c5c-aacf-3e6298fb28b5 admin admin] PATH_INFO: `/v3/projects/673d901384364a75a810c13e71fdadf4/users/e2803df17e824a50bdce4ec2458bdda2/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:28.000508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7599c-2922-4c5c-aacf-3e6298fb28b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=673d901384364a75a810c13e71fdadf4, user_id=e2803df17e824a50bdce4ec2458bdda2, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:28.003673 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7599c-2922-4c5c-aacf-3e6298fb28b5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:28.021555 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1990/3935] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:08:27 2022] PUT /identity/v3/projects/673d901384364a75a810c13e71fdadf4/users/e2803df17e824a50bdce4ec2458bdda2/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:28.025389 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799babdb-3483-4d47-897f-d3b07aa9daaa admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:28.039452 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799babdb-3483-4d47-897f-d3b07aa9daaa admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:28.062159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:28.099100 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e70a82-04ee-470b-9387-f942ae3bf349 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:28.099708 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e70a82-04ee-470b-9387-f942ae3bf349 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:28.100196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e70a82-04ee-470b-9387-f942ae3bf349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:28.128321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d5e70a82-04ee-470b-9387-f942ae3bf349 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:28.129863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d5e70a82-04ee-470b-9387-f942ae3bf349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:28.180207 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19d399-3c7c-4b0b-be7e-16a8ea687d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:28.180962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19d399-3c7c-4b0b-be7e-16a8ea687d83 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:28.181147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19d399-3c7c-4b0b-be7e-16a8ea687d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:28.181374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19d399-3c7c-4b0b-be7e-16a8ea687d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:28.185752 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19d399-3c7c-4b0b-be7e-16a8ea687d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:28.187685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19d399-3c7c-4b0b-be7e-16a8ea687d83 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:28.205181 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1946/3936] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:08:28.209346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19d399-3c7c-4b0b-be7e-16a8ea687d83 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:28.226796 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19d399-3c7c-4b0b-be7e-16a8ea687d83 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:28.236094 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1991/3937] 10.222.0.33 () {58 vars in 967 bytes} [Sat Aug 6 21:08:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:08:28.243313 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1e0f5-bde5-4eab-b808-4515d0f3d222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:28.244308 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1e0f5-bde5-4eab-b808-4515d0f3d222 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:28.244743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1e0f5-bde5-4eab-b808-4515d0f3d222 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:28.245218 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1e0f5-bde5-4eab-b808-4515d0f3d222 admin admin] PATH_INFO: `/v3/projects/673d901384364a75a810c13e71fdadf4/users/e2803df17e824a50bdce4ec2458bdda2/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:28.251216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc1e0f5-bde5-4eab-b808-4515d0f3d222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=673d901384364a75a810c13e71fdadf4, user_id=e2803df17e824a50bdce4ec2458bdda2, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:28.258117 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc1e0f5-bde5-4eab-b808-4515d0f3d222 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:28.262363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e70a82-04ee-470b-9387-f942ae3bf349 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:28.264500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d5e70a82-04ee-470b-9387-f942ae3bf349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:28.294422 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1947/3938] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:08:28 2022] PUT /identity/v3/projects/673d901384364a75a810c13e71fdadf4/users/e2803df17e824a50bdce4ec2458bdda2/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:28.306940 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3423fea-a800-4f98-901f-fe6361465021 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:28.308727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3423fea-a800-4f98-901f-fe6361465021 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:28.310413 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3423fea-a800-4f98-901f-fe6361465021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:28.350278 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d3423fea-a800-4f98-901f-fe6361465021 None None] MFA Rules not processed for user `e2803df17e824a50bdce4ec2458bdda2`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:28.352138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d3423fea-a800-4f98-901f-fe6361465021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:28.379416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e70a82-04ee-470b-9387-f942ae3bf349 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:28.535903 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:28.540498 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1948/3939] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:28 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:28.546663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3423fea-a800-4f98-901f-fe6361465021 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:28.574808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3423fea-a800-4f98-901f-fe6361465021 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:28.575875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03407218-682a-49fe-af84-ea0dc44a89ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:28.576720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03407218-682a-49fe-af84-ea0dc44a89ac service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:28.577911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03407218-682a-49fe-af84-ea0dc44a89ac service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:28.578353 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03407218-682a-49fe-af84-ea0dc44a89ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:28.591040 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef73f2-bd35-4827-8bfc-1f0451cde458 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2803df17e824a50bdce4ec2458bdda2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673d901384364a75a810c13e71fdadf4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:28.591972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef73f2-bd35-4827-8bfc-1f0451cde458 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:28.592464 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef73f2-bd35-4827-8bfc-1f0451cde458 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:28.594882 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef73f2-bd35-4827-8bfc-1f0451cde458 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] PATH_INFO: `/v3/policies` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:28.596048 ncdv-master-1 devstack@keystone.service[102758]: WARNING oslo_log.versionutils [None req-17ef73f2-bd35-4827-8bfc-1f0451cde458 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 06 21:08:28.596912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef73f2-bd35-4827-8bfc-1f0451cde458 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:28.602399 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-17ef73f2-bd35-4827-8bfc-1f0451cde458 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:08:28.602399 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:08:28.602399 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:08:28.606597 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef73f2-bd35-4827-8bfc-1f0451cde458 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:28.653613 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1949/3940] 10.222.0.33 () {60 vars in 1152 bytes} [Sat Aug 6 21:08:28 2022] POST /identity/v3/policies => generated 229 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:08:28.659943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef73f2-bd35-4827-8bfc-1f0451cde458 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:28.683112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef73f2-bd35-4827-8bfc-1f0451cde458 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:28.694342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d56be5-2576-43ae-a3d5-70df13266764 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2803df17e824a50bdce4ec2458bdda2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673d901384364a75a810c13e71fdadf4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:28.696860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d56be5-2576-43ae-a3d5-70df13266764 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:28.697527 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d56be5-2576-43ae-a3d5-70df13266764 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:28.699521 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d56be5-2576-43ae-a3d5-70df13266764 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] PATH_INFO: `/v3/policies/b8c266fa911e4a66aff5aa4a8f498c69` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:28.702127 ncdv-master-1 devstack@keystone.service[102758]: WARNING oslo_log.versionutils [None req-39d56be5-2576-43ae-a3d5-70df13266764 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 06 21:08:28.703240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d56be5-2576-43ae-a3d5-70df13266764 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=b8c266fa911e4a66aff5aa4a8f498c69)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:28.705821 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-39d56be5-2576-43ae-a3d5-70df13266764 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:08:28.705821 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:08:28.705821 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:08:28.708905 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d56be5-2576-43ae-a3d5-70df13266764 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:28.734060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03407218-682a-49fe-af84-ea0dc44a89ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:28.735906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03407218-682a-49fe-af84-ea0dc44a89ac service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:28.751967 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1992/3941] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:08:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 06 21:08:28.764762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03407218-682a-49fe-af84-ea0dc44a89ac service swift] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:28.771531 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1950/3942] 10.222.0.33 () {60 vars in 1252 bytes} [Sat Aug 6 21:08:28 2022] PATCH /identity/v3/policies/b8c266fa911e4a66aff5aa4a8f498c69 => generated 237 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:08:28.785844 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03407218-682a-49fe-af84-ea0dc44a89ac service swift] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:28.792928 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111da8a-f4d2-4ab9-8942-167d497d4613 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2803df17e824a50bdce4ec2458bdda2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673d901384364a75a810c13e71fdadf4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:28.793761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111da8a-f4d2-4ab9-8942-167d497d4613 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:28.794285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111da8a-f4d2-4ab9-8942-167d497d4613 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:28.794737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111da8a-f4d2-4ab9-8942-167d497d4613 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] PATH_INFO: `/v3/policies/b8c266fa911e4a66aff5aa4a8f498c69` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:28.795942 ncdv-master-1 devstack@keystone.service[102759]: WARNING oslo_log.versionutils [None req-b111da8a-f4d2-4ab9-8942-167d497d4613 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 06 21:08:28.796747 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111da8a-f4d2-4ab9-8942-167d497d4613 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=b8c266fa911e4a66aff5aa4a8f498c69)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:28.798029 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-b111da8a-f4d2-4ab9-8942-167d497d4613 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:08:28.798029 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:08:28.798029 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:08:28.799379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111da8a-f4d2-4ab9-8942-167d497d4613 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:28.822787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d56be5-2576-43ae-a3d5-70df13266764 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:28.828802 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1993/3943] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:08:28 2022] GET /identity/v3/policies/b8c266fa911e4a66aff5aa4a8f498c69 => generated 237 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:08:28.842646 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d56be5-2576-43ae-a3d5-70df13266764 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:28.862392 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90036f1-23b0-4644-8c7b-98b888aeac97 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2803df17e824a50bdce4ec2458bdda2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673d901384364a75a810c13e71fdadf4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:28.863357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90036f1-23b0-4644-8c7b-98b888aeac97 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:28.863864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90036f1-23b0-4644-8c7b-98b888aeac97 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:28.864921 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90036f1-23b0-4644-8c7b-98b888aeac97 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] PATH_INFO: `/v3/policies/b8c266fa911e4a66aff5aa4a8f498c69` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:28.866093 ncdv-master-1 devstack@keystone.service[102758]: WARNING oslo_log.versionutils [None req-d90036f1-23b0-4644-8c7b-98b888aeac97 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 06 21:08:28.868779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90036f1-23b0-4644-8c7b-98b888aeac97 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=b8c266fa911e4a66aff5aa4a8f498c69)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:28.870433 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-d90036f1-23b0-4644-8c7b-98b888aeac97 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:08:28.870433 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:08:28.870433 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:08:28.875368 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90036f1-23b0-4644-8c7b-98b888aeac97 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:28.903380 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1951/3944] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:08:28 2022] DELETE /identity/v3/policies/b8c266fa911e4a66aff5aa4a8f498c69 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:28.908695 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111da8a-f4d2-4ab9-8942-167d497d4613 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:28.923703 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111da8a-f4d2-4ab9-8942-167d497d4613 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:28.931611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06f9fa-69ad-46e2-baeb-9921a39c826c tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2803df17e824a50bdce4ec2458bdda2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673d901384364a75a810c13e71fdadf4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:28.932514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06f9fa-69ad-46e2-baeb-9921a39c826c tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:28.932971 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06f9fa-69ad-46e2-baeb-9921a39c826c tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:28.933388 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06f9fa-69ad-46e2-baeb-9921a39c826c tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] PATH_INFO: `/v3/policies` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:28.934419 ncdv-master-1 devstack@keystone.service[102759]: WARNING oslo_log.versionutils [None req-1a06f9fa-69ad-46e2-baeb-9921a39c826c tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 06 21:08:28.935039 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a06f9fa-69ad-46e2-baeb-9921a39c826c tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:28.936606 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-1a06f9fa-69ad-46e2-baeb-9921a39c826c tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:08:28.936606 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:08:28.936606 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:08:28.937835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a06f9fa-69ad-46e2-baeb-9921a39c826c tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:28.984543 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1994/3945] 10.222.0.33 () {60 vars in 1152 bytes} [Sat Aug 6 21:08:28 2022] POST /identity/v3/policies => generated 230 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:08:28.985627 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90036f1-23b0-4644-8c7b-98b888aeac97 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:29.002224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90036f1-23b0-4644-8c7b-98b888aeac97 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:29.016427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2606d22-d965-460e-9408-be42c8e5ecf0 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2803df17e824a50bdce4ec2458bdda2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673d901384364a75a810c13e71fdadf4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:29.016939 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2606d22-d965-460e-9408-be42c8e5ecf0 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:29.017224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2606d22-d965-460e-9408-be42c8e5ecf0 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:29.017546 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2606d22-d965-460e-9408-be42c8e5ecf0 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] PATH_INFO: `/v3/policies` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:29.018781 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2606d22-d965-460e-9408-be42c8e5ecf0 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:29.020902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2606d22-d965-460e-9408-be42c8e5ecf0 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:29.078526 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1952/3946] 10.222.0.33 () {60 vars in 1152 bytes} [Sat Aug 6 21:08:28 2022] POST /identity/v3/policies => generated 229 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:08:29.080096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06f9fa-69ad-46e2-baeb-9921a39c826c tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:29.096561 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06f9fa-69ad-46e2-baeb-9921a39c826c tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:29.113216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad85300-64f9-4031-93e7-910cba54f736 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2803df17e824a50bdce4ec2458bdda2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673d901384364a75a810c13e71fdadf4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:29.113867 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad85300-64f9-4031-93e7-910cba54f736 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:29.114657 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad85300-64f9-4031-93e7-910cba54f736 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:29.114944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad85300-64f9-4031-93e7-910cba54f736 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] PATH_INFO: `/v3/policies` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:29.116183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad85300-64f9-4031-93e7-910cba54f736 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:29.118032 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad85300-64f9-4031-93e7-910cba54f736 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:29.161511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2606d22-d965-460e-9408-be42c8e5ecf0 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:29.163281 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1995/3947] 10.222.0.33 () {60 vars in 1152 bytes} [Sat Aug 6 21:08:29 2022] POST /identity/v3/policies => generated 229 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:08:29.176985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2606d22-d965-460e-9408-be42c8e5ecf0 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:29.195230 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95d95e-f960-48df-8fd0-b1ffd3bc4a21 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2803df17e824a50bdce4ec2458bdda2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673d901384364a75a810c13e71fdadf4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:29.195879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95d95e-f960-48df-8fd0-b1ffd3bc4a21 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:29.196208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95d95e-f960-48df-8fd0-b1ffd3bc4a21 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:29.196488 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95d95e-f960-48df-8fd0-b1ffd3bc4a21 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] PATH_INFO: `/v3/policies` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:29.197283 ncdv-master-1 devstack@keystone.service[102758]: WARNING oslo_log.versionutils [None req-7d95d95e-f960-48df-8fd0-b1ffd3bc4a21 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 06 21:08:29.197831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d95d95e-f960-48df-8fd0-b1ffd3bc4a21 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:29.199122 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-7d95d95e-f960-48df-8fd0-b1ffd3bc4a21 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:08:29.199122 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:08:29.199122 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:08:29.200023 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d95d95e-f960-48df-8fd0-b1ffd3bc4a21 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:29.232162 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1953/3948] 10.222.0.33 () {58 vars in 1131 bytes} [Sat Aug 6 21:08:29 2022] GET /identity/v3/policies => generated 764 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:08:29.236185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad85300-64f9-4031-93e7-910cba54f736 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:29.260089 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad85300-64f9-4031-93e7-910cba54f736 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:29.267226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547c3fc-4488-4e76-85a0-f0d35affc499 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2803df17e824a50bdce4ec2458bdda2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673d901384364a75a810c13e71fdadf4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:29.268089 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547c3fc-4488-4e76-85a0-f0d35affc499 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:29.268376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547c3fc-4488-4e76-85a0-f0d35affc499 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:29.268655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547c3fc-4488-4e76-85a0-f0d35affc499 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] PATH_INFO: `/v3/policies/aca3c0dab9c74606ad990bededae95e4` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:29.269453 ncdv-master-1 devstack@keystone.service[102759]: WARNING oslo_log.versionutils [None req-a547c3fc-4488-4e76-85a0-f0d35affc499 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 06 21:08:29.270003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547c3fc-4488-4e76-85a0-f0d35affc499 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=aca3c0dab9c74606ad990bededae95e4)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:29.274923 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-a547c3fc-4488-4e76-85a0-f0d35affc499 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:08:29.274923 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:08:29.274923 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:08:29.276207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547c3fc-4488-4e76-85a0-f0d35affc499 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:29.315453 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1996/3949] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:08:29 2022] DELETE /identity/v3/policies/aca3c0dab9c74606ad990bededae95e4 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:29.320138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95d95e-f960-48df-8fd0-b1ffd3bc4a21 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:29.338269 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95d95e-f960-48df-8fd0-b1ffd3bc4a21 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:29.353158 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b830db-c813-402f-bde2-e7f74e80d31f tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2803df17e824a50bdce4ec2458bdda2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673d901384364a75a810c13e71fdadf4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:29.353720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b830db-c813-402f-bde2-e7f74e80d31f tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:29.354004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b830db-c813-402f-bde2-e7f74e80d31f tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:29.354275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b830db-c813-402f-bde2-e7f74e80d31f tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] PATH_INFO: `/v3/policies/8af51881c5824e7298cf3d400a105882` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:29.355570 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b830db-c813-402f-bde2-e7f74e80d31f tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=8af51881c5824e7298cf3d400a105882)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:29.360491 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b830db-c813-402f-bde2-e7f74e80d31f tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:29.396244 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:29.408433 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1954/3950] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:08:29 2022] DELETE /identity/v3/policies/8af51881c5824e7298cf3d400a105882 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:29.413687 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547c3fc-4488-4e76-85a0-f0d35affc499 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:29.429221 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547c3fc-4488-4e76-85a0-f0d35affc499 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:29.448987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a70586-1899-4ecc-b2a1-409f7d066726 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2803df17e824a50bdce4ec2458bdda2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673d901384364a75a810c13e71fdadf4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:29.449671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a70586-1899-4ecc-b2a1-409f7d066726 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:29.450200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a70586-1899-4ecc-b2a1-409f7d066726 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:29.450792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a70586-1899-4ecc-b2a1-409f7d066726 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] PATH_INFO: `/v3/policies/f7b11b3f54e442468c961958312900c5` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:29.455811 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a70586-1899-4ecc-b2a1-409f7d066726 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=f7b11b3f54e442468c961958312900c5)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:29.462610 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a70586-1899-4ecc-b2a1-409f7d066726 tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:29.499470 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1997/3951] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:08:29 2022] DELETE /identity/v3/policies/f7b11b3f54e442468c961958312900c5 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:29.506183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b830db-c813-402f-bde2-e7f74e80d31f tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:29.589830 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b830db-c813-402f-bde2-e7f74e80d31f tempest-PoliciesTestJSON-847602240 tempest-PoliciesTestJSON-847602240-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:29.596969 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e603ede-63ed-4e5b-9666-3c6032c7282a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:29.597909 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e603ede-63ed-4e5b-9666-3c6032c7282a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:29.598356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e603ede-63ed-4e5b-9666-3c6032c7282a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:29.600308 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e603ede-63ed-4e5b-9666-3c6032c7282a admin admin] PATH_INFO: `/v3/users/23cbb52872514943b88bcda8a9bfa7aa` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:29.602000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e603ede-63ed-4e5b-9666-3c6032c7282a admin admin] RBAC: Authorizing `identity:delete_user(user_id=23cbb52872514943b88bcda8a9bfa7aa)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:29.604416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e603ede-63ed-4e5b-9666-3c6032c7282a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:29.699900 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1e603ede-63ed-4e5b-9666-3c6032c7282a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23cbb52872514943b88bcda8a9bfa7aa'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:29.702953 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1e603ede-63ed-4e5b-9666-3c6032c7282a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23cbb52872514943b88bcda8a9bfa7aa'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:29.703912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1e603ede-63ed-4e5b-9666-3c6032c7282a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23cbb52872514943b88bcda8a9bfa7aa'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:29.722597 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1e603ede-63ed-4e5b-9666-3c6032c7282a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23cbb52872514943b88bcda8a9bfa7aa'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:29.749884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1e603ede-63ed-4e5b-9666-3c6032c7282a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23cbb52872514943b88bcda8a9bfa7aa'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:29.781322 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1955/3952] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:08:29 2022] DELETE /identity/v3/users/23cbb52872514943b88bcda8a9bfa7aa => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:29.786867 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44b6e2-66ef-412a-8072-3e0c8d3fb9ce None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:29.787883 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44b6e2-66ef-412a-8072-3e0c8d3fb9ce None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:29.788369 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44b6e2-66ef-412a-8072-3e0c8d3fb9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:29.829969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-2d44b6e2-66ef-412a-8072-3e0c8d3fb9ce None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:29.832630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2d44b6e2-66ef-412a-8072-3e0c8d3fb9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:29.968375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e603ede-63ed-4e5b-9666-3c6032c7282a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:29.970050 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1e603ede-63ed-4e5b-9666-3c6032c7282a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:29.971887 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1998/3953] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:30.076388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e603ede-63ed-4e5b-9666-3c6032c7282a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:30.080963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b33ac-3a92-4e1c-91d4-a5e441911cb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:30.081641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b33ac-3a92-4e1c-91d4-a5e441911cb6 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:30.081958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b33ac-3a92-4e1c-91d4-a5e441911cb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:30.083296 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b33ac-3a92-4e1c-91d4-a5e441911cb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:30.104018 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b33ac-3a92-4e1c-91d4-a5e441911cb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:30.105503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b33ac-3a92-4e1c-91d4-a5e441911cb6 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:30.148499 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1956/3954] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:08:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:08:30.568669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44b6e2-66ef-412a-8072-3e0c8d3fb9ce None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:30.570190 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2d44b6e2-66ef-412a-8072-3e0c8d3fb9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:30.592090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44b6e2-66ef-412a-8072-3e0c8d3fb9ce None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:30.606220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b113b5-da2a-488a-91bd-6fb6e9dad1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:30.606894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b113b5-da2a-488a-91bd-6fb6e9dad1e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:30.608468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b113b5-da2a-488a-91bd-6fb6e9dad1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:30.608819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b113b5-da2a-488a-91bd-6fb6e9dad1e2 admin admin] PATH_INFO: `/v3/projects/fba5267bbdf74ba0bda44b4d4b60c4e8` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:30.610076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b113b5-da2a-488a-91bd-6fb6e9dad1e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fba5267bbdf74ba0bda44b4d4b60c4e8)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:30.616162 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b113b5-da2a-488a-91bd-6fb6e9dad1e2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:30.655673 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:30.702472 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-51b113b5-da2a-488a-91bd-6fb6e9dad1e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fba5267bbdf74ba0bda44b4d4b60c4e8', 'request_id': 'req-51b113b5-da2a-488a-91bd-6fb6e9dad1e2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:30.708660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-51b113b5-da2a-488a-91bd-6fb6e9dad1e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fba5267bbdf74ba0bda44b4d4b60c4e8', 'request_id': 'req-51b113b5-da2a-488a-91bd-6fb6e9dad1e2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:30.717609 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-51b113b5-da2a-488a-91bd-6fb6e9dad1e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fba5267bbdf74ba0bda44b4d4b60c4e8', 'request_id': 'req-51b113b5-da2a-488a-91bd-6fb6e9dad1e2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:30.731708 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-51b113b5-da2a-488a-91bd-6fb6e9dad1e2 admin admin] The token cache is being invalidate because project fba5267bbdf74ba0bda44b4d4b60c4e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:08:30.732005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-51b113b5-da2a-488a-91bd-6fb6e9dad1e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:30.732669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-51b113b5-da2a-488a-91bd-6fb6e9dad1e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:30.734603 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 1999/3955] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:08:30 2022] DELETE /identity/v3/projects/fba5267bbdf74ba0bda44b4d4b60c4e8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:30.739511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b33ac-3a92-4e1c-91d4-a5e441911cb6 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:30.753055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b33ac-3a92-4e1c-91d4-a5e441911cb6 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:30.774301 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:30.819540 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f14229-bb84-42dc-a378-8ed3b8417973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:30.820173 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f14229-bb84-42dc-a378-8ed3b8417973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:30.820443 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f14229-bb84-42dc-a378-8ed3b8417973 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:30.820708 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f14229-bb84-42dc-a378-8ed3b8417973 admin admin] PATH_INFO: `/v3/users/e2803df17e824a50bdce4ec2458bdda2` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:30.821823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f14229-bb84-42dc-a378-8ed3b8417973 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2803df17e824a50bdce4ec2458bdda2)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:30.823791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f14229-bb84-42dc-a378-8ed3b8417973 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:30.873355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-49f14229-bb84-42dc-a378-8ed3b8417973 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2803df17e824a50bdce4ec2458bdda2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:30.873895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-49f14229-bb84-42dc-a378-8ed3b8417973 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2803df17e824a50bdce4ec2458bdda2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:30.874505 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-49f14229-bb84-42dc-a378-8ed3b8417973 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2803df17e824a50bdce4ec2458bdda2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:30.884083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-49f14229-bb84-42dc-a378-8ed3b8417973 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2803df17e824a50bdce4ec2458bdda2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:30.897625 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-49f14229-bb84-42dc-a378-8ed3b8417973 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2803df17e824a50bdce4ec2458bdda2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:30.910421 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1957/3956] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:08:30 2022] DELETE /identity/v3/users/e2803df17e824a50bdce4ec2458bdda2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:31.221315 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b113b5-da2a-488a-91bd-6fb6e9dad1e2 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:31.223017 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-51b113b5-da2a-488a-91bd-6fb6e9dad1e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:31.237025 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b113b5-da2a-488a-91bd-6fb6e9dad1e2 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:31.306339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36d775-1ce0-4837-a6a5-289ef023f038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:31.307015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36d775-1ce0-4837-a6a5-289ef023f038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:31.307291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36d775-1ce0-4837-a6a5-289ef023f038 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:31.307558 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36d775-1ce0-4837-a6a5-289ef023f038 admin admin] PATH_INFO: `/v3/projects/673d901384364a75a810c13e71fdadf4` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:31.308684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36d775-1ce0-4837-a6a5-289ef023f038 admin admin] RBAC: Authorizing `identity:delete_project(project_id=673d901384364a75a810c13e71fdadf4)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:31.310837 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36d775-1ce0-4837-a6a5-289ef023f038 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:31.374623 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cb36d775-1ce0-4837-a6a5-289ef023f038 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '673d901384364a75a810c13e71fdadf4', 'request_id': 'req-cb36d775-1ce0-4837-a6a5-289ef023f038'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:31.381495 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cb36d775-1ce0-4837-a6a5-289ef023f038 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '673d901384364a75a810c13e71fdadf4', 'request_id': 'req-cb36d775-1ce0-4837-a6a5-289ef023f038'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:31.391302 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cb36d775-1ce0-4837-a6a5-289ef023f038 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '673d901384364a75a810c13e71fdadf4', 'request_id': 'req-cb36d775-1ce0-4837-a6a5-289ef023f038'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:31.408761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cb36d775-1ce0-4837-a6a5-289ef023f038 admin admin] The token cache is being invalidate because project 673d901384364a75a810c13e71fdadf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:08:31.409310 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cb36d775-1ce0-4837-a6a5-289ef023f038 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:31.410450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cb36d775-1ce0-4837-a6a5-289ef023f038 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:31.412828 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2000/3957] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:08:31 2022] DELETE /identity/v3/projects/673d901384364a75a810c13e71fdadf4 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:31.418388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d349b9c-340f-4a2c-b29a-3454d3b463d2 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:31.418834 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d349b9c-340f-4a2c-b29a-3454d3b463d2 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:31.419221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d349b9c-340f-4a2c-b29a-3454d3b463d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:31.449682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-0d349b9c-340f-4a2c-b29a-3454d3b463d2 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:31.452105 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0d349b9c-340f-4a2c-b29a-3454d3b463d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:31.530908 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1958/3958] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:31.532829 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea177d-1144-4280-9bf2-03a173b74b78 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:31.533197 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea177d-1144-4280-9bf2-03a173b74b78 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:31.533434 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea177d-1144-4280-9bf2-03a173b74b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:31.585054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-bdea177d-1144-4280-9bf2-03a173b74b78 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:31.586887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-bdea177d-1144-4280-9bf2-03a173b74b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:31.615162 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2001/3959] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:31.617876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d349b9c-340f-4a2c-b29a-3454d3b463d2 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:31.634007 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d349b9c-340f-4a2c-b29a-3454d3b463d2 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:31.641103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a06ca-30c4-41a1-b877-a65ec5ddd91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:31.642952 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a06ca-30c4-41a1-b877-a65ec5ddd91c admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:31.642952 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a06ca-30c4-41a1-b877-a65ec5ddd91c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:31.642952 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a06ca-30c4-41a1-b877-a65ec5ddd91c admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:31.643378 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a06ca-30c4-41a1-b877-a65ec5ddd91c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:08:31.643869 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a06ca-30c4-41a1-b877-a65ec5ddd91c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:31.645964 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a06ca-30c4-41a1-b877-a65ec5ddd91c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:31.683106 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea177d-1144-4280-9bf2-03a173b74b78 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:31.683276 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1959/3960] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:08:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:08:31.702914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea177d-1144-4280-9bf2-03a173b74b78 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:31.708063 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043ca54-9a96-4dbb-986a-9f6087679c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:31.708677 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043ca54-9a96-4dbb-986a-9f6087679c5e admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:31.708953 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043ca54-9a96-4dbb-986a-9f6087679c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:31.709740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043ca54-9a96-4dbb-986a-9f6087679c5e admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:31.709889 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043ca54-9a96-4dbb-986a-9f6087679c5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:31.712049 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043ca54-9a96-4dbb-986a-9f6087679c5e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:31.745718 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2002/3961] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:08:31 2022] POST /identity/v3/projects => generated 397 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:08:31.749514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a06ca-30c4-41a1-b877-a65ec5ddd91c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:31.760450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a06ca-30c4-41a1-b877-a65ec5ddd91c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:31.792090 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:31.845854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622ef77-7f6c-4807-9250-395c8fc82201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:31.846639 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622ef77-7f6c-4807-9250-395c8fc82201 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:31.847010 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622ef77-7f6c-4807-9250-395c8fc82201 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:31.847287 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622ef77-7f6c-4807-9250-395c8fc82201 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:31.848207 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622ef77-7f6c-4807-9250-395c8fc82201 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:31.850493 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622ef77-7f6c-4807-9250-395c8fc82201 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:31.875811 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1960/3962] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:08:31 2022] POST /identity/v3/users => generated 299 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:08:31.880550 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043ca54-9a96-4dbb-986a-9f6087679c5e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:31.890911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043ca54-9a96-4dbb-986a-9f6087679c5e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:31.919347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ebec5a-1349-4762-ba1c-59ca162b733c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:31.920098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebec5a-1349-4762-ba1c-59ca162b733c admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:31.920455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebec5a-1349-4762-ba1c-59ca162b733c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:31.920800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebec5a-1349-4762-ba1c-59ca162b733c admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:31.921658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ebec5a-1349-4762-ba1c-59ca162b733c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:31.923380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ebec5a-1349-4762-ba1c-59ca162b733c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:31.932626 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:31.941699 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2003/3963] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:08:31 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:08:31.947051 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622ef77-7f6c-4807-9250-395c8fc82201 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:31.972020 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622ef77-7f6c-4807-9250-395c8fc82201 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:31.979221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962f3ee-794c-48cf-bff5-86b354bd95ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:31.979839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962f3ee-794c-48cf-bff5-86b354bd95ba admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:31.980118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962f3ee-794c-48cf-bff5-86b354bd95ba admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:31.980391 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962f3ee-794c-48cf-bff5-86b354bd95ba admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:31.982967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962f3ee-794c-48cf-bff5-86b354bd95ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:31.984673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962f3ee-794c-48cf-bff5-86b354bd95ba admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:32.001452 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1961/3964] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:08:31 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:08:32.002106 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ebec5a-1349-4762-ba1c-59ca162b733c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:32.015358 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ebec5a-1349-4762-ba1c-59ca162b733c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:32.023767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434fa6d4-278d-40bc-af32-a632ddf6039c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:32.024914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fa6d4-278d-40bc-af32-a632ddf6039c admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:32.025470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fa6d4-278d-40bc-af32-a632ddf6039c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:32.027576 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fa6d4-278d-40bc-af32-a632ddf6039c admin admin] PATH_INFO: `/v3/projects/bcea52916c874bfca80e5c59414c1ff0/users/8e9595f673714964874486c28a79ae80/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:32.057133 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434fa6d4-278d-40bc-af32-a632ddf6039c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcea52916c874bfca80e5c59414c1ff0, user_id=8e9595f673714964874486c28a79ae80, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:32.064556 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434fa6d4-278d-40bc-af32-a632ddf6039c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:32.092568 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2004/3965] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:08:32 2022] PUT /identity/v3/projects/bcea52916c874bfca80e5c59414c1ff0/users/8e9595f673714964874486c28a79ae80/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:08:32.103692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6b5fd-240f-466c-8618-a837d28457be None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:32.103982 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6b5fd-240f-466c-8618-a837d28457be None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:32.104285 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6b5fd-240f-466c-8618-a837d28457be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:32.144704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-60e6b5fd-240f-466c-8618-a837d28457be None None] MFA Rules not processed for user `8e9595f673714964874486c28a79ae80`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:32.146792 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-60e6b5fd-240f-466c-8618-a837d28457be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:32.222002 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1962/3966] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:32 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:32.227131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434fa6d4-278d-40bc-af32-a632ddf6039c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:32.311834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434fa6d4-278d-40bc-af32-a632ddf6039c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:32.316854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0802a-3716-45ca-b7df-960d10ca46aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:32.317639 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0802a-3716-45ca-b7df-960d10ca46aa admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:32.317920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0802a-3716-45ca-b7df-960d10ca46aa admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:32.318391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0802a-3716-45ca-b7df-960d10ca46aa admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:32.319147 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a0802a-3716-45ca-b7df-960d10ca46aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:32.321939 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a0802a-3716-45ca-b7df-960d10ca46aa admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:32.356948 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2005/3967] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:08:32 2022] POST /identity/v3/projects => generated 395 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:08:32.358243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6b5fd-240f-466c-8618-a837d28457be None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:32.370262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6b5fd-240f-466c-8618-a837d28457be None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:32.435106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2762e-6641-4331-a64f-e27c050fb4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:32.435690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2762e-6641-4331-a64f-e27c050fb4c0 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:32.435993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2762e-6641-4331-a64f-e27c050fb4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:32.436241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2762e-6641-4331-a64f-e27c050fb4c0 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:32.436897 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2762e-6641-4331-a64f-e27c050fb4c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:32.439007 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2762e-6641-4331-a64f-e27c050fb4c0 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:32.462170 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1963/3968] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:08:32 2022] POST /identity/v3/users => generated 304 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:08:32.466198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0802a-3716-45ca-b7df-960d10ca46aa admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:32.477800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0802a-3716-45ca-b7df-960d10ca46aa admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:32.483040 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d9dbf-c62e-4792-833e-cba97976bdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:32.483664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d9dbf-c62e-4792-833e-cba97976bdfa admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:32.483943 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d9dbf-c62e-4792-833e-cba97976bdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:32.484216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d9dbf-c62e-4792-833e-cba97976bdfa admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:32.484856 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d9dbf-c62e-4792-833e-cba97976bdfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:32.486470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d9dbf-c62e-4792-833e-cba97976bdfa admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:32.499283 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2006/3969] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:08:32.503640 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2762e-6641-4331-a64f-e27c050fb4c0 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:32.514522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2762e-6641-4331-a64f-e27c050fb4c0 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:32.519468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bc7ed-77b6-4952-98e8-fdba0e499361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:32.520658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bc7ed-77b6-4952-98e8-fdba0e499361 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:32.520976 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bc7ed-77b6-4952-98e8-fdba0e499361 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:32.521328 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bc7ed-77b6-4952-98e8-fdba0e499361 admin admin] PATH_INFO: `/v3/projects/cb6bec7efd1d49d5a9f0e1b0356ed67b/users/4f34876fba7b4405a82cbeacd8009a77/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:32.538563 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5bc7ed-77b6-4952-98e8-fdba0e499361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb6bec7efd1d49d5a9f0e1b0356ed67b, user_id=4f34876fba7b4405a82cbeacd8009a77, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:32.541417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5bc7ed-77b6-4952-98e8-fdba0e499361 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:32.558207 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1964/3970] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:08:32 2022] PUT /identity/v3/projects/cb6bec7efd1d49d5a9f0e1b0356ed67b/users/4f34876fba7b4405a82cbeacd8009a77/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:32.562500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d9dbf-c62e-4792-833e-cba97976bdfa admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:32.573318 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d9dbf-c62e-4792-833e-cba97976bdfa admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:32.644264 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89dd1ec-92bf-4d87-9a80-6af7b749285e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:32.644881 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89dd1ec-92bf-4d87-9a80-6af7b749285e admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:32.645686 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89dd1ec-92bf-4d87-9a80-6af7b749285e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:32.646069 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89dd1ec-92bf-4d87-9a80-6af7b749285e admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:32.646935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89dd1ec-92bf-4d87-9a80-6af7b749285e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:32.649747 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89dd1ec-92bf-4d87-9a80-6af7b749285e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:32.660055 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2007/3971] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:08:32.670757 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bc7ed-77b6-4952-98e8-fdba0e499361 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:32.673071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:32.680780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bc7ed-77b6-4952-98e8-fdba0e499361 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:32.690759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b083d-7962-4826-bc59-289656474ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:32.691913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b083d-7962-4826-bc59-289656474ff8 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:32.693116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b083d-7962-4826-bc59-289656474ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:32.693632 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b083d-7962-4826-bc59-289656474ff8 admin admin] PATH_INFO: `/v3/projects/cb6bec7efd1d49d5a9f0e1b0356ed67b/users/4f34876fba7b4405a82cbeacd8009a77/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:32.697429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b083d-7962-4826-bc59-289656474ff8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb6bec7efd1d49d5a9f0e1b0356ed67b, user_id=4f34876fba7b4405a82cbeacd8009a77, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:32.701336 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b083d-7962-4826-bc59-289656474ff8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:32.745106 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1965/3972] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:08:32 2022] PUT /identity/v3/projects/cb6bec7efd1d49d5a9f0e1b0356ed67b/users/4f34876fba7b4405a82cbeacd8009a77/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:08:32.844592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ee49b-fbe5-4685-8590-932170ec3e88 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:32.844875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ee49b-fbe5-4685-8590-932170ec3e88 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:32.845168 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ee49b-fbe5-4685-8590-932170ec3e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:32.883259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b96ee49b-fbe5-4685-8590-932170ec3e88 None None] MFA Rules not processed for user `4f34876fba7b4405a82cbeacd8009a77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:32.884525 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b96ee49b-fbe5-4685-8590-932170ec3e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:32.935242 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:32.991748 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2008/3973] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:32 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:08:32.996951 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b083d-7962-4826-bc59-289656474ff8 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:33.087655 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b083d-7962-4826-bc59-289656474ff8 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:33.093368 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd20f20-d310-4026-b457-69c777fa9dd4 tempest-ProjectsNegativeStaticTestJSON-2146587473 tempest-ProjectsNegativeStaticTestJSON-2146587473-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e9595f673714964874486c28a79ae80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcea52916c874bfca80e5c59414c1ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:33.095559 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd20f20-d310-4026-b457-69c777fa9dd4 tempest-ProjectsNegativeStaticTestJSON-2146587473 tempest-ProjectsNegativeStaticTestJSON-2146587473-project] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:33.096094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd20f20-d310-4026-b457-69c777fa9dd4 tempest-ProjectsNegativeStaticTestJSON-2146587473 tempest-ProjectsNegativeStaticTestJSON-2146587473-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:33.096558 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd20f20-d310-4026-b457-69c777fa9dd4 tempest-ProjectsNegativeStaticTestJSON-2146587473 tempest-ProjectsNegativeStaticTestJSON-2146587473-project] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:33.097392 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd20f20-d310-4026-b457-69c777fa9dd4 tempest-ProjectsNegativeStaticTestJSON-2146587473 tempest-ProjectsNegativeStaticTestJSON-2146587473-project] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:33.116949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-5bd20f20-d310-4026-b457-69c777fa9dd4 tempest-ProjectsNegativeStaticTestJSON-2146587473 tempest-ProjectsNegativeStaticTestJSON-2146587473-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Aug 06 21:08:33.116949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:08:33.116949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:08:33.116949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:08:33.116949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:08:33.116949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:08:33.116949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:08:33.116949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:08:33.116949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:08:33.116949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:08:33.116949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:08:33.116949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:08:33.116949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Aug 06 21:08:33.116949 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Aug 06 21:08:33.118093 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Aug 06 21:08:33.118093 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application enforcer_obj._enforce( Aug 06 21:08:33.118093 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Aug 06 21:08:33.118093 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Aug 06 21:08:33.118093 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 06 21:08:33.118093 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Aug 06 21:08:33.118093 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Aug 06 21:08:33.118093 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:08:33.122817 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1966/3974] 10.222.0.33 () {60 vars in 1152 bytes} [Sat Aug 6 21:08:32 2022] POST /identity/v3/projects => generated 136 bytes in 126 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:08:33.128481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ee49b-fbe5-4685-8590-932170ec3e88 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:33.163443 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ee49b-fbe5-4685-8590-932170ec3e88 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:33.182258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0365b-0128-419e-aa4b-7e14d8be6ed4 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f34876fba7b4405a82cbeacd8009a77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb6bec7efd1d49d5a9f0e1b0356ed67b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:33.182942 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0365b-0128-419e-aa4b-7e14d8be6ed4 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:33.184788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0365b-0128-419e-aa4b-7e14d8be6ed4 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:33.184788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0365b-0128-419e-aa4b-7e14d8be6ed4 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:33.185394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0365b-0128-419e-aa4b-7e14d8be6ed4 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:33.188083 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0365b-0128-419e-aa4b-7e14d8be6ed4 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:33.213793 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-15a0365b-0128-419e-aa4b-7e14d8be6ed4 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] Invalid input for field 'name': '' is too short Aug 06 21:08:33.213793 ncdv-master-1 devstack@keystone.service[102759]: Failed validating 'minLength' in schema['properties']['name']: Aug 06 21:08:33.213793 ncdv-master-1 devstack@keystone.service[102759]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 06 21:08:33.213793 ncdv-master-1 devstack@keystone.service[102759]: On instance['name']: Aug 06 21:08:33.213793 ncdv-master-1 devstack@keystone.service[102759]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 06 21:08:33.213793 ncdv-master-1 devstack@keystone.service[102759]: Failed validating 'minLength' in schema['properties']['name']: Aug 06 21:08:33.213793 ncdv-master-1 devstack@keystone.service[102759]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 06 21:08:33.213793 ncdv-master-1 devstack@keystone.service[102759]: On instance['name']: Aug 06 21:08:33.213793 ncdv-master-1 devstack@keystone.service[102759]: '' Aug 06 21:08:33.213793 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:08:33.213793 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 06 21:08:33.213793 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 06 21:08:33.213793 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 21:08:33.213793 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise error Aug 06 21:08:33.213793 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Aug 06 21:08:33.213793 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:08:33.213793 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 06 21:08:33.213793 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 06 21:08:33.213793 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:08:33.213793 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application On instance['name']: Aug 06 21:08:33.213793 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application '' Aug 06 21:08:33.213793 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:08:33.213793 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 21:08:33.215534 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:08:33.215534 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:08:33.215534 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:08:33.215534 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:08:33.215534 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:08:33.215534 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:08:33.215534 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:08:33.215534 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:08:33.215534 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:08:33.215534 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:08:33.215534 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:08:33.215534 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:08:33.215534 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Aug 06 21:08:33.215534 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Aug 06 21:08:33.215534 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 06 21:08:33.215534 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 06 21:08:33.215534 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 06 21:08:33.216635 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 06 21:08:33.216635 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 06 21:08:33.216635 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:08:33.216635 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 06 21:08:33.216635 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 06 21:08:33.216635 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:08:33.216635 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application On instance['name']: Aug 06 21:08:33.216635 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application '' Aug 06 21:08:33.216635 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:08:33.221498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd20f20-d310-4026-b457-69c777fa9dd4 tempest-ProjectsNegativeStaticTestJSON-2146587473 tempest-ProjectsNegativeStaticTestJSON-2146587473-project] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:33.221678 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2009/3975] 10.222.0.33 () {60 vars in 1152 bytes} [Sat Aug 6 21:08:33 2022] POST /identity/v3/projects => generated 283 bytes in 94 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 06 21:08:33.239642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd20f20-d310-4026-b457-69c777fa9dd4 tempest-ProjectsNegativeStaticTestJSON-2146587473 tempest-ProjectsNegativeStaticTestJSON-2146587473-project] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:33.248661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a1640-d2fb-4668-a00a-7ca0a30bbbaa tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f34876fba7b4405a82cbeacd8009a77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb6bec7efd1d49d5a9f0e1b0356ed67b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:33.249565 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a1640-d2fb-4668-a00a-7ca0a30bbbaa tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:33.249897 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a1640-d2fb-4668-a00a-7ca0a30bbbaa tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:33.250317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a1640-d2fb-4668-a00a-7ca0a30bbbaa tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:33.251116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a1640-d2fb-4668-a00a-7ca0a30bbbaa tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:33.253708 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a1640-d2fb-4668-a00a-7ca0a30bbbaa tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:33.266270 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-c58a1640-d2fb-4668-a00a-7ca0a30bbbaa tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 06 21:08:33.266270 ncdv-master-1 devstack@keystone.service[102758]: Failed validating 'maxLength' in schema['properties']['name']: Aug 06 21:08:33.266270 ncdv-master-1 devstack@keystone.service[102758]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 06 21:08:33.266270 ncdv-master-1 devstack@keystone.service[102758]: On instance['name']: Aug 06 21:08:33.266270 ncdv-master-1 devstack@keystone.service[102758]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 06 21:08:33.266270 ncdv-master-1 devstack@keystone.service[102758]: Failed validating 'maxLength' in schema['properties']['name']: Aug 06 21:08:33.266270 ncdv-master-1 devstack@keystone.service[102758]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 06 21:08:33.266270 ncdv-master-1 devstack@keystone.service[102758]: On instance['name']: Aug 06 21:08:33.266270 ncdv-master-1 devstack@keystone.service[102758]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 06 21:08:33.266270 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:08:33.266270 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 06 21:08:33.266270 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 06 21:08:33.266270 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 21:08:33.266270 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise error Aug 06 21:08:33.266270 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 06 21:08:33.266270 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:08:33.266270 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 06 21:08:33.266270 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 06 21:08:33.267701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:08:33.267701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application On instance['name']: Aug 06 21:08:33.267701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 06 21:08:33.267701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:08:33.267701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 21:08:33.267701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:08:33.267701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:08:33.267701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:08:33.267701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:08:33.267701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:08:33.267701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:08:33.267701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:08:33.267701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:08:33.267701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:08:33.267701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:08:33.267701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:08:33.267701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:08:33.267701 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Aug 06 21:08:33.268951 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Aug 06 21:08:33.268951 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 06 21:08:33.268951 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 06 21:08:33.268951 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 06 21:08:33.268951 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 06 21:08:33.268951 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 06 21:08:33.268951 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:08:33.268951 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 06 21:08:33.268951 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 06 21:08:33.268951 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:08:33.268951 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application On instance['name']: Aug 06 21:08:33.268951 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 06 21:08:33.268951 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:08:33.273728 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1967/3976] 10.222.0.33 () {60 vars in 1152 bytes} [Sat Aug 6 21:08:33 2022] POST /identity/v3/projects => generated 412 bytes in 53 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 06 21:08:33.274475 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0365b-0128-419e-aa4b-7e14d8be6ed4 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:33.287345 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0365b-0128-419e-aa4b-7e14d8be6ed4 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:33.293038 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322533f-efaa-43dd-9850-047292e62596 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f34876fba7b4405a82cbeacd8009a77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb6bec7efd1d49d5a9f0e1b0356ed67b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:33.293695 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322533f-efaa-43dd-9850-047292e62596 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:33.293978 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322533f-efaa-43dd-9850-047292e62596 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:33.294250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322533f-efaa-43dd-9850-047292e62596 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] PATH_INFO: `/v3/projects/ff5349ac0fbd4805b2f8d16d9e78f1f7` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:33.308162 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322533f-efaa-43dd-9850-047292e62596 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ff5349ac0fbd4805b2f8d16d9e78f1f7)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:33.311185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322533f-efaa-43dd-9850-047292e62596 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:33.337945 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-8322533f-efaa-43dd-9850-047292e62596 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] Could not find project: ff5349ac0fbd4805b2f8d16d9e78f1f7.: keystone.exception.ProjectNotFound: Could not find project: ff5349ac0fbd4805b2f8d16d9e78f1f7. Aug 06 21:08:33.337945 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:08:33.337945 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:08:33.337945 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:08:33.337945 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:08:33.337945 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:08:33.337945 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:08:33.337945 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:08:33.337945 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:08:33.337945 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:08:33.337945 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:08:33.337945 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:08:33.337945 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Aug 06 21:08:33.337945 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Aug 06 21:08:33.339227 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:08:33.339227 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:08:33.339227 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Aug 06 21:08:33.339227 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Aug 06 21:08:33.339227 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 21:08:33.339227 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 21:08:33.339227 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 21:08:33.339227 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 21:08:33.339227 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: ff5349ac0fbd4805b2f8d16d9e78f1f7. Aug 06 21:08:33.339227 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:08:33.340424 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2010/3977] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:08:33 2022] DELETE /identity/v3/projects/ff5349ac0fbd4805b2f8d16d9e78f1f7 => generated 113 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 06 21:08:33.345276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a1640-d2fb-4668-a00a-7ca0a30bbbaa tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:33.364131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a1640-d2fb-4668-a00a-7ca0a30bbbaa tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:33.376705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93e8ee-469a-4a22-8ffd-524275db9bf2 tempest-ProjectsNegativeStaticTestJSON-2146587473 tempest-ProjectsNegativeStaticTestJSON-2146587473-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e9595f673714964874486c28a79ae80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcea52916c874bfca80e5c59414c1ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:33.377430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93e8ee-469a-4a22-8ffd-524275db9bf2 tempest-ProjectsNegativeStaticTestJSON-2146587473 tempest-ProjectsNegativeStaticTestJSON-2146587473-project] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:33.377715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93e8ee-469a-4a22-8ffd-524275db9bf2 tempest-ProjectsNegativeStaticTestJSON-2146587473 tempest-ProjectsNegativeStaticTestJSON-2146587473-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:33.378314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93e8ee-469a-4a22-8ffd-524275db9bf2 tempest-ProjectsNegativeStaticTestJSON-2146587473 tempest-ProjectsNegativeStaticTestJSON-2146587473-project] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:33.378659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93e8ee-469a-4a22-8ffd-524275db9bf2 tempest-ProjectsNegativeStaticTestJSON-2146587473 tempest-ProjectsNegativeStaticTestJSON-2146587473-project] RBAC: Authorizing `identity:list_projects()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:33.380004 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-ae93e8ee-469a-4a22-8ffd-524275db9bf2 tempest-ProjectsNegativeStaticTestJSON-2146587473 tempest-ProjectsNegativeStaticTestJSON-2146587473-project] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:08:33.380004 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:08:33.380004 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:08:33.387690 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-ae93e8ee-469a-4a22-8ffd-524275db9bf2 tempest-ProjectsNegativeStaticTestJSON-2146587473 tempest-ProjectsNegativeStaticTestJSON-2146587473-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Aug 06 21:08:33.387690 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:08:33.387690 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:08:33.387690 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:08:33.387690 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:08:33.387690 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:08:33.387690 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:08:33.387690 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:08:33.387690 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:08:33.387690 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:08:33.387690 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:08:33.387690 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:08:33.387690 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Aug 06 21:08:33.387690 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._list_projects() Aug 06 21:08:33.388927 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Aug 06 21:08:33.388927 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Aug 06 21:08:33.388927 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Aug 06 21:08:33.388927 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application enforcer_obj._enforce( Aug 06 21:08:33.388927 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Aug 06 21:08:33.388927 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Aug 06 21:08:33.388927 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 06 21:08:33.388927 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Aug 06 21:08:33.388927 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Aug 06 21:08:33.388927 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:08:33.394643 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1968/3978] 10.222.0.33 () {58 vars in 1131 bytes} [Sat Aug 6 21:08:33 2022] GET /identity/v3/projects => generated 135 bytes in 50 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:08:33.396877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322533f-efaa-43dd-9850-047292e62596 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:33.409933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322533f-efaa-43dd-9850-047292e62596 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:33.418590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ccb32-9487-448c-840e-9c7284740541 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f34876fba7b4405a82cbeacd8009a77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb6bec7efd1d49d5a9f0e1b0356ed67b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:33.419435 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ccb32-9487-448c-840e-9c7284740541 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:33.419725 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ccb32-9487-448c-840e-9c7284740541 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:33.420173 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ccb32-9487-448c-840e-9c7284740541 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:33.420983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ccb32-9487-448c-840e-9c7284740541 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:33.423227 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ccb32-9487-448c-840e-9c7284740541 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:33.425909 ncdv-master-1 devstack@keystone.service[102759]: WARNING keystone.server.flask.common [None req-ba9ccb32-9487-448c-840e-9c7284740541 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 06 21:08:33.464089 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2011/3979] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:08:33 2022] POST /identity/v3/projects => generated 358 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:08:33.468420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93e8ee-469a-4a22-8ffd-524275db9bf2 tempest-ProjectsNegativeStaticTestJSON-2146587473 tempest-ProjectsNegativeStaticTestJSON-2146587473-project] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:33.482046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93e8ee-469a-4a22-8ffd-524275db9bf2 tempest-ProjectsNegativeStaticTestJSON-2146587473 tempest-ProjectsNegativeStaticTestJSON-2146587473-project] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:33.566055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9cfcb-924d-4db6-b2f5-f782619526a1 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f34876fba7b4405a82cbeacd8009a77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb6bec7efd1d49d5a9f0e1b0356ed67b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:33.566712 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9cfcb-924d-4db6-b2f5-f782619526a1 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:33.567003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9cfcb-924d-4db6-b2f5-f782619526a1 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:33.567277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9cfcb-924d-4db6-b2f5-f782619526a1 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:33.567892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9cfcb-924d-4db6-b2f5-f782619526a1 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:33.569764 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9cfcb-924d-4db6-b2f5-f782619526a1 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:33.589976 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.sql.core [None req-11e9cfcb-924d-4db6-b2f5-f782619526a1 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1871855284' for key 'project.ixu_project_name_domain_id'") Aug 06 21:08:33.589976 ncdv-master-1 devstack@keystone.service[102758]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 06 21:08:33.589976 ncdv-master-1 devstack@keystone.service[102758]: [parameters: {'id': '5c9563f79b614bd6a247fe5d8dbceb3e', 'name': 'tempest-project-dup-1871855284', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 06 21:08:33.589976 ncdv-master-1 devstack@keystone.service[102758]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=102758) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 06 21:08:33.602222 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-11e9cfcb-924d-4db6-b2f5-f782619526a1 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1871855284, project id 5c9563f79b614bd6a247fe5d8dbceb3e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1871855284, project id 5c9563f79b614bd6a247fe5d8dbceb3e. Aug 06 21:08:33.602222 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:08:33.602222 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 06 21:08:33.602222 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 06 21:08:33.602222 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 06 21:08:33.602222 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 06 21:08:33.602222 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 06 21:08:33.602222 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application result = self._query(query) Aug 06 21:08:33.602222 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 06 21:08:33.602222 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application conn.query(q) Aug 06 21:08:33.602222 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 06 21:08:33.602222 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 06 21:08:33.603789 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 06 21:08:33.603789 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application result.read() Aug 06 21:08:33.603789 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 06 21:08:33.603789 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 06 21:08:33.603789 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 06 21:08:33.603789 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 06 21:08:33.603789 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 06 21:08:33.603789 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 06 21:08:33.603789 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 06 21:08:33.603789 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 06 21:08:33.603789 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-1871855284' for key 'project.ixu_project_name_domain_id'") Aug 06 21:08:33.603789 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:08:33.603789 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 06 21:08:33.603789 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:08:33.603789 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:08:33.603789 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 06 21:08:33.603789 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 06 21:08:33.605858 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 06 21:08:33.605858 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 06 21:08:33.605858 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 06 21:08:33.605858 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application next(self.gen) Aug 06 21:08:33.605858 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 06 21:08:33.605858 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application yield resource Aug 06 21:08:33.605858 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 06 21:08:33.605858 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application next(self.gen) Aug 06 21:08:33.605858 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 06 21:08:33.605858 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self.session.rollback() Aug 06 21:08:33.605858 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 21:08:33.605858 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self.force_reraise() Aug 06 21:08:33.605858 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 21:08:33.605858 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise self.value Aug 06 21:08:33.605858 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 06 21:08:33.605858 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 06 21:08:33.605858 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 06 21:08:33.605858 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application session.commit() Aug 06 21:08:33.610099 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 06 21:08:33.610099 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 06 21:08:33.610099 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 06 21:08:33.610099 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._prepare_impl() Aug 06 21:08:33.610099 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 06 21:08:33.610099 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self.session.flush() Aug 06 21:08:33.610099 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 06 21:08:33.610099 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._flush(objects) Aug 06 21:08:33.610099 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 06 21:08:33.610099 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 06 21:08:33.610099 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 06 21:08:33.610099 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application compat.raise_( Aug 06 21:08:33.610099 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 06 21:08:33.610099 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception Aug 06 21:08:33.610099 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 06 21:08:33.610099 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application flush_context.execute() Aug 06 21:08:33.610099 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 06 21:08:33.611715 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rec.execute(self) Aug 06 21:08:33.611715 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 06 21:08:33.611715 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 06 21:08:33.611715 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 06 21:08:33.611715 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 06 21:08:33.611715 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 06 21:08:33.611715 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 06 21:08:33.611715 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 06 21:08:33.611715 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 06 21:08:33.611715 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 06 21:08:33.611715 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 06 21:08:33.611715 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 06 21:08:33.611715 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 06 21:08:33.611715 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 06 21:08:33.611715 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 06 21:08:33.611715 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 06 21:08:33.613199 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 06 21:08:33.613199 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 06 21:08:33.613199 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception Aug 06 21:08:33.613199 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 06 21:08:33.613199 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 06 21:08:33.613199 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 06 21:08:33.613199 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 06 21:08:33.613199 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 06 21:08:33.613199 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application result = self._query(query) Aug 06 21:08:33.613199 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 06 21:08:33.613199 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application conn.query(q) Aug 06 21:08:33.613199 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 06 21:08:33.613199 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 06 21:08:33.613199 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 06 21:08:33.613199 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application result.read() Aug 06 21:08:33.613199 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 06 21:08:33.613199 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 06 21:08:33.615331 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 06 21:08:33.615331 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 06 21:08:33.615331 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 06 21:08:33.615331 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 06 21:08:33.615331 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 06 21:08:33.615331 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 06 21:08:33.615331 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1871855284' for key 'project.ixu_project_name_domain_id'") Aug 06 21:08:33.615331 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 06 21:08:33.615331 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [parameters: {'id': '5c9563f79b614bd6a247fe5d8dbceb3e', 'name': 'tempest-project-dup-1871855284', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 06 21:08:33.615331 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 06 21:08:33.615331 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:08:33.615331 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 21:08:33.615331 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:08:33.615331 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:08:33.615331 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 06 21:08:33.616653 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 06 21:08:33.616653 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 06 21:08:33.616653 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 06 21:08:33.616653 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-1871855284 at domain ID default. Aug 06 21:08:33.616653 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:08:33.616653 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 21:08:33.616653 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:08:33.616653 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:08:33.616653 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:08:33.616653 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:08:33.616653 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:08:33.616653 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:08:33.616653 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:08:33.616653 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:08:33.616653 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:08:33.616653 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:08:33.616653 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:08:33.620557 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:08:33.620557 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 06 21:08:33.620557 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 06 21:08:33.620557 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:08:33.620557 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:08:33.620557 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 06 21:08:33.620557 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 06 21:08:33.620557 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1871855284, project id 5c9563f79b614bd6a247fe5d8dbceb3e. Aug 06 21:08:33.620557 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:08:33.620557 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1969/3980] 10.222.0.33 () {60 vars in 1152 bytes} [Sat Aug 6 21:08:33 2022] POST /identity/v3/projects => generated 285 bytes in 140 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 06 21:08:33.621610 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ccb32-9487-448c-840e-9c7284740541 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:33.624452 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ccb32-9487-448c-840e-9c7284740541 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:33.630926 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c76688-459c-4739-b944-d16194e78535 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f34876fba7b4405a82cbeacd8009a77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb6bec7efd1d49d5a9f0e1b0356ed67b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:33.631653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c76688-459c-4739-b944-d16194e78535 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:33.632246 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c76688-459c-4739-b944-d16194e78535 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:33.632450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c76688-459c-4739-b944-d16194e78535 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] PATH_INFO: `/v3/projects/a890769b3c98400fb6c27f35b07bce37` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:33.634085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c76688-459c-4739-b944-d16194e78535 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a890769b3c98400fb6c27f35b07bce37)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:33.636320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c76688-459c-4739-b944-d16194e78535 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:33.695785 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d5c76688-459c-4739-b944-d16194e78535 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a890769b3c98400fb6c27f35b07bce37', 'request_id': 'req-d5c76688-459c-4739-b944-d16194e78535'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:33.702428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d5c76688-459c-4739-b944-d16194e78535 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a890769b3c98400fb6c27f35b07bce37', 'request_id': 'req-d5c76688-459c-4739-b944-d16194e78535'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:33.711209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d5c76688-459c-4739-b944-d16194e78535 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a890769b3c98400fb6c27f35b07bce37', 'request_id': 'req-d5c76688-459c-4739-b944-d16194e78535'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:33.724925 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d5c76688-459c-4739-b944-d16194e78535 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] The token cache is being invalidate because project a890769b3c98400fb6c27f35b07bce37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:08:33.725138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d5c76688-459c-4739-b944-d16194e78535 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:33.725880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d5c76688-459c-4739-b944-d16194e78535 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:33.727726 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2012/3981] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:08:33 2022] DELETE /identity/v3/projects/a890769b3c98400fb6c27f35b07bce37 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:33.733351 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9cfcb-924d-4db6-b2f5-f782619526a1 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:33.735682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-11e9cfcb-924d-4db6-b2f5-f782619526a1 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:33.847501 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9cfcb-924d-4db6-b2f5-f782619526a1 tempest-ProjectsNegativeStaticTestJSON-387544457 tempest-ProjectsNegativeStaticTestJSON-387544457-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:33.882105 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:33.963294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9cc693-c2b5-44a2-98c1-e56ec686bb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:33.964069 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9cc693-c2b5-44a2-98c1-e56ec686bb97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:33.964420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9cc693-c2b5-44a2-98c1-e56ec686bb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:33.964765 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9cc693-c2b5-44a2-98c1-e56ec686bb97 admin admin] PATH_INFO: `/v3/users/8e9595f673714964874486c28a79ae80` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:33.966537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9cc693-c2b5-44a2-98c1-e56ec686bb97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e9595f673714964874486c28a79ae80)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:33.969148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9cc693-c2b5-44a2-98c1-e56ec686bb97 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:34.035247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fc9cc693-c2b5-44a2-98c1-e56ec686bb97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e9595f673714964874486c28a79ae80'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:34.036692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fc9cc693-c2b5-44a2-98c1-e56ec686bb97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e9595f673714964874486c28a79ae80'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:34.043100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fc9cc693-c2b5-44a2-98c1-e56ec686bb97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e9595f673714964874486c28a79ae80'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:34.057035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fc9cc693-c2b5-44a2-98c1-e56ec686bb97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e9595f673714964874486c28a79ae80'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:34.101705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fc9cc693-c2b5-44a2-98c1-e56ec686bb97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e9595f673714964874486c28a79ae80'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:34.131872 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ec2da-b9aa-45d1-8a90-682602c7270e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:34.132167 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ec2da-b9aa-45d1-8a90-682602c7270e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:34.133070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ec2da-b9aa-45d1-8a90-682602c7270e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:34.137037 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1970/3982] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:08:33 2022] DELETE /identity/v3/users/8e9595f673714964874486c28a79ae80 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:34.161947 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-671ec2da-b9aa-45d1-8a90-682602c7270e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:34.164636 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-671ec2da-b9aa-45d1-8a90-682602c7270e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:34.310667 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2013/3983] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:34.377630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9cc693-c2b5-44a2-98c1-e56ec686bb97 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:34.383347 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-fc9cc693-c2b5-44a2-98c1-e56ec686bb97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:34.572593 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9cc693-c2b5-44a2-98c1-e56ec686bb97 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:34.585621 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4927c16-7229-477e-b27d-f9d8083ee2e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:34.586807 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4927c16-7229-477e-b27d-f9d8083ee2e3 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:34.588347 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4927c16-7229-477e-b27d-f9d8083ee2e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:34.588630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4927c16-7229-477e-b27d-f9d8083ee2e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:34.603269 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4927c16-7229-477e-b27d-f9d8083ee2e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:34.604966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4927c16-7229-477e-b27d-f9d8083ee2e3 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:34.647110 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1971/3984] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:08:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:08:35.475717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ec2da-b9aa-45d1-8a90-682602c7270e None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:35.477177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-671ec2da-b9aa-45d1-8a90-682602c7270e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:35.515179 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ec2da-b9aa-45d1-8a90-682602c7270e None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:35.526718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cd90c-6e02-402c-9b17-509186c44bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:35.527479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cd90c-6e02-402c-9b17-509186c44bc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:35.529996 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cd90c-6e02-402c-9b17-509186c44bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:35.530409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cd90c-6e02-402c-9b17-509186c44bc1 admin admin] PATH_INFO: `/v3/projects/bcea52916c874bfca80e5c59414c1ff0` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:35.534856 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161cd90c-6e02-402c-9b17-509186c44bc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcea52916c874bfca80e5c59414c1ff0)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:35.537095 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161cd90c-6e02-402c-9b17-509186c44bc1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:35.562778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:35.636384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-161cd90c-6e02-402c-9b17-509186c44bc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcea52916c874bfca80e5c59414c1ff0', 'request_id': 'req-161cd90c-6e02-402c-9b17-509186c44bc1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:35.653885 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-161cd90c-6e02-402c-9b17-509186c44bc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcea52916c874bfca80e5c59414c1ff0', 'request_id': 'req-161cd90c-6e02-402c-9b17-509186c44bc1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:35.669457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-161cd90c-6e02-402c-9b17-509186c44bc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcea52916c874bfca80e5c59414c1ff0', 'request_id': 'req-161cd90c-6e02-402c-9b17-509186c44bc1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:35.698999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-161cd90c-6e02-402c-9b17-509186c44bc1 admin admin] The token cache is being invalidate because project bcea52916c874bfca80e5c59414c1ff0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:08:35.699368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-161cd90c-6e02-402c-9b17-509186c44bc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:35.700277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-161cd90c-6e02-402c-9b17-509186c44bc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:35.701973 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2014/3985] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:08:35 2022] DELETE /identity/v3/projects/bcea52916c874bfca80e5c59414c1ff0 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:35.706347 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4927c16-7229-477e-b27d-f9d8083ee2e3 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:35.721866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4927c16-7229-477e-b27d-f9d8083ee2e3 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:35.800642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:35.818144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9e928-5ac7-49ab-a594-a7dd5135d670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:35.819200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9e928-5ac7-49ab-a594-a7dd5135d670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:35.819723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9e928-5ac7-49ab-a594-a7dd5135d670 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:35.820203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9e928-5ac7-49ab-a594-a7dd5135d670 admin admin] PATH_INFO: `/v3/users/4f34876fba7b4405a82cbeacd8009a77` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:35.821481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9e928-5ac7-49ab-a594-a7dd5135d670 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f34876fba7b4405a82cbeacd8009a77)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:35.823551 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9e928-5ac7-49ab-a594-a7dd5135d670 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:35.885239 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0cd9e928-5ac7-49ab-a594-a7dd5135d670 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f34876fba7b4405a82cbeacd8009a77'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:35.885992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0cd9e928-5ac7-49ab-a594-a7dd5135d670 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f34876fba7b4405a82cbeacd8009a77'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:35.886686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0cd9e928-5ac7-49ab-a594-a7dd5135d670 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f34876fba7b4405a82cbeacd8009a77'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:35.899925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0cd9e928-5ac7-49ab-a594-a7dd5135d670 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f34876fba7b4405a82cbeacd8009a77'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:35.916716 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0cd9e928-5ac7-49ab-a594-a7dd5135d670 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f34876fba7b4405a82cbeacd8009a77'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:35.931521 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1972/3986] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:08:35 2022] DELETE /identity/v3/users/4f34876fba7b4405a82cbeacd8009a77 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:37.203857 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cd90c-6e02-402c-9b17-509186c44bc1 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:37.206334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-161cd90c-6e02-402c-9b17-509186c44bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:37.221183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cd90c-6e02-402c-9b17-509186c44bc1 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:37.291989 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163fee8-9a77-4d4b-8787-3b778699a902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:37.292650 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163fee8-9a77-4d4b-8787-3b778699a902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:37.292928 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163fee8-9a77-4d4b-8787-3b778699a902 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:37.293200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163fee8-9a77-4d4b-8787-3b778699a902 admin admin] PATH_INFO: `/v3/projects/cb6bec7efd1d49d5a9f0e1b0356ed67b` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:37.294303 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9163fee8-9a77-4d4b-8787-3b778699a902 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb6bec7efd1d49d5a9f0e1b0356ed67b)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:37.296260 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9163fee8-9a77-4d4b-8787-3b778699a902 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:37.353414 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9163fee8-9a77-4d4b-8787-3b778699a902 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb6bec7efd1d49d5a9f0e1b0356ed67b', 'request_id': 'req-9163fee8-9a77-4d4b-8787-3b778699a902'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:37.360133 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9163fee8-9a77-4d4b-8787-3b778699a902 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb6bec7efd1d49d5a9f0e1b0356ed67b', 'request_id': 'req-9163fee8-9a77-4d4b-8787-3b778699a902'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:37.374971 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9163fee8-9a77-4d4b-8787-3b778699a902 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb6bec7efd1d49d5a9f0e1b0356ed67b', 'request_id': 'req-9163fee8-9a77-4d4b-8787-3b778699a902'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:37.388601 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9163fee8-9a77-4d4b-8787-3b778699a902 admin admin] The token cache is being invalidate because project cb6bec7efd1d49d5a9f0e1b0356ed67b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:08:37.388985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9163fee8-9a77-4d4b-8787-3b778699a902 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:37.389756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9163fee8-9a77-4d4b-8787-3b778699a902 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:37.391504 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2015/3987] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:08:37 2022] DELETE /identity/v3/projects/cb6bec7efd1d49d5a9f0e1b0356ed67b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:37.396658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d3266-8174-4bc8-9438-fc3cb829ba49 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:37.397206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d3266-8174-4bc8-9438-fc3cb829ba49 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:37.401865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d3266-8174-4bc8-9438-fc3cb829ba49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:37.462181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-345d3266-8174-4bc8-9438-fc3cb829ba49 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:37.465300 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-345d3266-8174-4bc8-9438-fc3cb829ba49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:37.573183 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1973/3988] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:08:37.576807 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6495af-a09f-4c77-a189-cf60ac0957b4 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:37.577409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6495af-a09f-4c77-a189-cf60ac0957b4 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:37.577747 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6495af-a09f-4c77-a189-cf60ac0957b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:37.602715 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-0e6495af-a09f-4c77-a189-cf60ac0957b4 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:37.603957 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0e6495af-a09f-4c77-a189-cf60ac0957b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:37.613524 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2016/3989] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:37.618790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d3266-8174-4bc8-9438-fc3cb829ba49 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:37.636149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d3266-8174-4bc8-9438-fc3cb829ba49 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:37.641624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f418ec-608f-4840-864b-c8c240656222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:37.642350 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f418ec-608f-4840-864b-c8c240656222 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:37.642793 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f418ec-608f-4840-864b-c8c240656222 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:37.643171 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f418ec-608f-4840-864b-c8c240656222 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:37.643942 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f418ec-608f-4840-864b-c8c240656222 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:08:37.644343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f418ec-608f-4840-864b-c8c240656222 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:37.646097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f418ec-608f-4840-864b-c8c240656222 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:37.661784 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1974/3990] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:08:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:08:37.666224 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6495af-a09f-4c77-a189-cf60ac0957b4 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:37.683132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6495af-a09f-4c77-a189-cf60ac0957b4 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:37.689262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522f5bf-be29-41c4-8a2e-21752f2d619e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:37.689987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522f5bf-be29-41c4-8a2e-21752f2d619e admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:37.690394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522f5bf-be29-41c4-8a2e-21752f2d619e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:37.690868 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522f5bf-be29-41c4-8a2e-21752f2d619e admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:37.691612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d522f5bf-be29-41c4-8a2e-21752f2d619e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:37.694448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d522f5bf-be29-41c4-8a2e-21752f2d619e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:37.734917 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:37.751762 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2017/3991] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:08:37 2022] POST /identity/v3/projects => generated 369 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:08:37.758089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f418ec-608f-4840-864b-c8c240656222 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:37.782385 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f418ec-608f-4840-864b-c8c240656222 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:37.864741 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:37.880758 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65b4a9-0ec1-46d4-bdda-ea643ff23e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:37.881388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65b4a9-0ec1-46d4-bdda-ea643ff23e0b admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:37.881657 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65b4a9-0ec1-46d4-bdda-ea643ff23e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:37.881937 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65b4a9-0ec1-46d4-bdda-ea643ff23e0b admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:37.882717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b65b4a9-0ec1-46d4-bdda-ea643ff23e0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:37.884721 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b65b4a9-0ec1-46d4-bdda-ea643ff23e0b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:37.916449 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1975/3992] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:08:37 2022] POST /identity/v3/users => generated 285 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:08:37.920533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522f5bf-be29-41c4-8a2e-21752f2d619e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:37.932000 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522f5bf-be29-41c4-8a2e-21752f2d619e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:37.937086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c5962-06ff-4b16-a512-88753c2516b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:37.937584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c5962-06ff-4b16-a512-88753c2516b8 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:37.937939 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c5962-06ff-4b16-a512-88753c2516b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:37.938586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c5962-06ff-4b16-a512-88753c2516b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:37.939167 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c5962-06ff-4b16-a512-88753c2516b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:37.941015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c5962-06ff-4b16-a512-88753c2516b8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:37.953280 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2018/3993] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:08:37.958124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65b4a9-0ec1-46d4-bdda-ea643ff23e0b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:37.970071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65b4a9-0ec1-46d4-bdda-ea643ff23e0b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:37.975481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c032e-0b80-4b09-b1ab-c69bb3f5b7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:37.976192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c032e-0b80-4b09-b1ab-c69bb3f5b7b6 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:37.976534 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c032e-0b80-4b09-b1ab-c69bb3f5b7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:37.977156 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c032e-0b80-4b09-b1ab-c69bb3f5b7b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:37.977872 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c032e-0b80-4b09-b1ab-c69bb3f5b7b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:37.988923 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c032e-0b80-4b09-b1ab-c69bb3f5b7b6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:38.007343 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1976/3994] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:08:38.009290 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c5962-06ff-4b16-a512-88753c2516b8 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:38.026942 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c5962-06ff-4b16-a512-88753c2516b8 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:38.040756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ca318-4570-492f-b9b5-354a9cd0c7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:38.041734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ca318-4570-492f-b9b5-354a9cd0c7b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:38.042460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ca318-4570-492f-b9b5-354a9cd0c7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:38.043062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ca318-4570-492f-b9b5-354a9cd0c7b6 admin admin] PATH_INFO: `/v3/projects/ce348d7bfedd4dafa7080115187ba833/users/b5d7cf56c9414c92b21779dc7ca7b027/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:38.071382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ca318-4570-492f-b9b5-354a9cd0c7b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce348d7bfedd4dafa7080115187ba833, user_id=b5d7cf56c9414c92b21779dc7ca7b027, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:38.079972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ca318-4570-492f-b9b5-354a9cd0c7b6 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:38.126152 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2019/3995] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:08:38 2022] PUT /identity/v3/projects/ce348d7bfedd4dafa7080115187ba833/users/b5d7cf56c9414c92b21779dc7ca7b027/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:08:38.140245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1f133-b17a-4fd8-9fa8-60b591b90cca None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:38.140612 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1f133-b17a-4fd8-9fa8-60b591b90cca None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:38.140815 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1f133-b17a-4fd8-9fa8-60b591b90cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:38.208204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-1ee1f133-b17a-4fd8-9fa8-60b591b90cca None None] MFA Rules not processed for user `b5d7cf56c9414c92b21779dc7ca7b027`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:38.209473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1ee1f133-b17a-4fd8-9fa8-60b591b90cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:38.340152 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1977/3996] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:38.344519 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ca318-4570-492f-b9b5-354a9cd0c7b6 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:38.449977 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ca318-4570-492f-b9b5-354a9cd0c7b6 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:38.460107 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b3565-fda5-4789-a85b-e0aa1595a759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:38.460748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b3565-fda5-4789-a85b-e0aa1595a759 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:38.461026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b3565-fda5-4789-a85b-e0aa1595a759 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:38.461383 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b3565-fda5-4789-a85b-e0aa1595a759 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:38.461924 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b3565-fda5-4789-a85b-e0aa1595a759 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:38.468173 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b3565-fda5-4789-a85b-e0aa1595a759 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:38.533452 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2020/3997] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:08:38 2022] POST /identity/v3/projects => generated 369 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:08:38.538093 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1f133-b17a-4fd8-9fa8-60b591b90cca None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:38.555485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1f133-b17a-4fd8-9fa8-60b591b90cca None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:38.695047 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a5e62-1882-4641-b41a-4a493c9566e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:38.695674 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a5e62-1882-4641-b41a-4a493c9566e7 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:38.695959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a5e62-1882-4641-b41a-4a493c9566e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:38.696237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a5e62-1882-4641-b41a-4a493c9566e7 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:38.696877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a5e62-1882-4641-b41a-4a493c9566e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:38.699916 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a5e62-1882-4641-b41a-4a493c9566e7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:38.744909 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1978/3998] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:08:38 2022] POST /identity/v3/users => generated 291 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:08:38.751097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b3565-fda5-4789-a85b-e0aa1595a759 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:38.763256 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b3565-fda5-4789-a85b-e0aa1595a759 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:38.778966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2635ed-eb9a-444b-9b08-a279500e1b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:38.779607 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2635ed-eb9a-444b-9b08-a279500e1b37 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:38.779891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2635ed-eb9a-444b-9b08-a279500e1b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:38.780169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2635ed-eb9a-444b-9b08-a279500e1b37 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:38.783771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2635ed-eb9a-444b-9b08-a279500e1b37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:38.787475 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2635ed-eb9a-444b-9b08-a279500e1b37 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:38.815563 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2021/3999] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:08:38.817734 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a5e62-1882-4641-b41a-4a493c9566e7 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:38.834645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a5e62-1882-4641-b41a-4a493c9566e7 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:38.849282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500071c-f0d0-485a-90d8-59931c588981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:38.850251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500071c-f0d0-485a-90d8-59931c588981 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:38.850735 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500071c-f0d0-485a-90d8-59931c588981 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:38.851200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500071c-f0d0-485a-90d8-59931c588981 admin admin] PATH_INFO: `/v3/projects/ff34c1eb32a9461a9e4d98760fa6b76f/users/4dd83504e39c4ee4b53872001f2c5e76/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:38.881981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a500071c-f0d0-485a-90d8-59931c588981 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff34c1eb32a9461a9e4d98760fa6b76f, user_id=4dd83504e39c4ee4b53872001f2c5e76, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:38.885518 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a500071c-f0d0-485a-90d8-59931c588981 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:38.908662 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1979/4000] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:08:38 2022] PUT /identity/v3/projects/ff34c1eb32a9461a9e4d98760fa6b76f/users/4dd83504e39c4ee4b53872001f2c5e76/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:38.909967 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2635ed-eb9a-444b-9b08-a279500e1b37 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:38.922097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2635ed-eb9a-444b-9b08-a279500e1b37 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:39.055076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c10ef-53fb-48ac-a015-bd0ad5a245ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:39.055076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c10ef-53fb-48ac-a015-bd0ad5a245ae admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:39.055076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c10ef-53fb-48ac-a015-bd0ad5a245ae admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:39.055076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c10ef-53fb-48ac-a015-bd0ad5a245ae admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:39.055646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c10ef-53fb-48ac-a015-bd0ad5a245ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:39.057680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c10ef-53fb-48ac-a015-bd0ad5a245ae admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:39.069486 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2022/4001] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:08:39.073675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500071c-f0d0-485a-90d8-59931c588981 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:39.094898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500071c-f0d0-485a-90d8-59931c588981 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:39.109116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6409f-f665-4acb-95f4-79e7c5dc1439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:39.109978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6409f-f665-4acb-95f4-79e7c5dc1439 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:39.110361 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6409f-f665-4acb-95f4-79e7c5dc1439 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:39.110699 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6409f-f665-4acb-95f4-79e7c5dc1439 admin admin] PATH_INFO: `/v3/projects/ff34c1eb32a9461a9e4d98760fa6b76f/users/4dd83504e39c4ee4b53872001f2c5e76/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:39.120130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff6409f-f665-4acb-95f4-79e7c5dc1439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff34c1eb32a9461a9e4d98760fa6b76f, user_id=4dd83504e39c4ee4b53872001f2c5e76, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:39.127604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff6409f-f665-4acb-95f4-79e7c5dc1439 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:39.158819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44061945-e28a-4151-ba57-8396af7f0953 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:39.159113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44061945-e28a-4151-ba57-8396af7f0953 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:39.159564 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44061945-e28a-4151-ba57-8396af7f0953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:39.163728 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1980/4002] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:08:39 2022] PUT /identity/v3/projects/ff34c1eb32a9461a9e4d98760fa6b76f/users/4dd83504e39c4ee4b53872001f2c5e76/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:39.240164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-44061945-e28a-4151-ba57-8396af7f0953 None None] MFA Rules not processed for user `4dd83504e39c4ee4b53872001f2c5e76`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:39.242902 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-44061945-e28a-4151-ba57-8396af7f0953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:39.284864 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:39.395981 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2023/4003] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:39 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:39.398761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6409f-f665-4acb-95f4-79e7c5dc1439 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:39.417978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6409f-f665-4acb-95f4-79e7c5dc1439 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:39.424529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e62162-5f41-48e3-a104-d69547d28ce4 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd83504e39c4ee4b53872001f2c5e76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff34c1eb32a9461a9e4d98760fa6b76f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:39.427052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e62162-5f41-48e3-a104-d69547d28ce4 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:39.427594 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e62162-5f41-48e3-a104-d69547d28ce4 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:39.428168 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e62162-5f41-48e3-a104-d69547d28ce4 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] PATH_INFO: `/v3/services` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:39.429430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e62162-5f41-48e3-a104-d69547d28ce4 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:39.431526 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-38e62162-5f41-48e3-a104-d69547d28ce4 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:08:39.431526 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:08:39.431526 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:08:39.432851 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e62162-5f41-48e3-a104-d69547d28ce4 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:39.447965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:39.464877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44061945-e28a-4151-ba57-8396af7f0953 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:39.479079 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1981/4004] 10.222.0.33 () {60 vars in 1152 bytes} [Sat Aug 6 21:08:39 2022] POST /identity/v3/services => generated 238 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:08:39.483818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44061945-e28a-4151-ba57-8396af7f0953 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:39.515596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ac8ab-b5a9-4cdd-9868-01eba68acce9 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd83504e39c4ee4b53872001f2c5e76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff34c1eb32a9461a9e4d98760fa6b76f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:39.516343 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ac8ab-b5a9-4cdd-9868-01eba68acce9 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:39.516710 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ac8ab-b5a9-4cdd-9868-01eba68acce9 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:39.517104 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ac8ab-b5a9-4cdd-9868-01eba68acce9 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] PATH_INFO: `/v3/services/d9c40a1a0438406eb05416bd4c378351` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:39.517811 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ac8ab-b5a9-4cdd-9868-01eba68acce9 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: Authorizing `identity:delete_service(service_id=d9c40a1a0438406eb05416bd4c378351)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:39.521644 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-f76ac8ab-b5a9-4cdd-9868-01eba68acce9 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:08:39.521644 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:08:39.521644 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:08:39.523007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ac8ab-b5a9-4cdd-9868-01eba68acce9 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:39.696085 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2024/4005] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:08:39 2022] DELETE /identity/v3/services/d9c40a1a0438406eb05416bd4c378351 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:39.698154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e62162-5f41-48e3-a104-d69547d28ce4 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:39.715500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e62162-5f41-48e3-a104-d69547d28ce4 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:39.759179 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23b56c-1e7a-4bf0-a378-8b060917119e tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd83504e39c4ee4b53872001f2c5e76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff34c1eb32a9461a9e4d98760fa6b76f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:39.760922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23b56c-1e7a-4bf0-a378-8b060917119e tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:39.762049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23b56c-1e7a-4bf0-a378-8b060917119e tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:39.775720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23b56c-1e7a-4bf0-a378-8b060917119e tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] PATH_INFO: `/v3/services` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:39.778050 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e23b56c-1e7a-4bf0-a378-8b060917119e tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:39.781082 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e23b56c-1e7a-4bf0-a378-8b060917119e tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:39.808888 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1982/4006] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:08:39 2022] POST /identity/v3/services => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:08:39.809903 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ac8ab-b5a9-4cdd-9868-01eba68acce9 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:39.833324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ac8ab-b5a9-4cdd-9868-01eba68acce9 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:39.884673 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286c11c-a063-48ea-b50c-aa03190392b1 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd83504e39c4ee4b53872001f2c5e76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff34c1eb32a9461a9e4d98760fa6b76f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:39.885496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286c11c-a063-48ea-b50c-aa03190392b1 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:39.885901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286c11c-a063-48ea-b50c-aa03190392b1 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:39.886955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286c11c-a063-48ea-b50c-aa03190392b1 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] PATH_INFO: `/v3/services/a72b08088ad84d8f8ce9898684bdb09f` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:39.887770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c286c11c-a063-48ea-b50c-aa03190392b1 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: Authorizing `identity:update_service(service_id=a72b08088ad84d8f8ce9898684bdb09f)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:39.890901 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-c286c11c-a063-48ea-b50c-aa03190392b1 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:08:39.890901 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:08:39.890901 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:08:39.892143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c286c11c-a063-48ea-b50c-aa03190392b1 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:39.976365 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2025/4007] 10.222.0.33 () {60 vars in 1252 bytes} [Sat Aug 6 21:08:39 2022] PATCH /identity/v3/services/a72b08088ad84d8f8ce9898684bdb09f => generated 282 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:08:39.978468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23b56c-1e7a-4bf0-a378-8b060917119e tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:39.998299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23b56c-1e7a-4bf0-a378-8b060917119e tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:40.049074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce09ed-9fac-4a75-827e-5ecfd6facaaf tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd83504e39c4ee4b53872001f2c5e76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff34c1eb32a9461a9e4d98760fa6b76f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:40.049753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce09ed-9fac-4a75-827e-5ecfd6facaaf tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:40.050034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce09ed-9fac-4a75-827e-5ecfd6facaaf tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:40.050306 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce09ed-9fac-4a75-827e-5ecfd6facaaf tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] PATH_INFO: `/v3/services/a72b08088ad84d8f8ce9898684bdb09f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:40.050988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce09ed-9fac-4a75-827e-5ecfd6facaaf tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: Authorizing `identity:get_service(service_id=a72b08088ad84d8f8ce9898684bdb09f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:40.052618 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-ddce09ed-9fac-4a75-827e-5ecfd6facaaf tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:08:40.052618 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:08:40.052618 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:08:40.053599 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce09ed-9fac-4a75-827e-5ecfd6facaaf tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:40.070258 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1983/4008] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:08:39 2022] GET /identity/v3/services/a72b08088ad84d8f8ce9898684bdb09f => generated 282 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:08:40.074319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286c11c-a063-48ea-b50c-aa03190392b1 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:40.094671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286c11c-a063-48ea-b50c-aa03190392b1 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:40.107434 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fef1e-cb7e-4526-8d2a-4125ac3ba1ca tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd83504e39c4ee4b53872001f2c5e76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff34c1eb32a9461a9e4d98760fa6b76f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:40.108322 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fef1e-cb7e-4526-8d2a-4125ac3ba1ca tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:40.108477 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fef1e-cb7e-4526-8d2a-4125ac3ba1ca tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:40.108647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fef1e-cb7e-4526-8d2a-4125ac3ba1ca tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] PATH_INFO: `/v3/services/a72b08088ad84d8f8ce9898684bdb09f` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:40.109362 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7fef1e-cb7e-4526-8d2a-4125ac3ba1ca tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: Authorizing `identity:delete_service(service_id=a72b08088ad84d8f8ce9898684bdb09f)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:40.110896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7fef1e-cb7e-4526-8d2a-4125ac3ba1ca tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:40.147667 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2026/4009] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:08:40 2022] DELETE /identity/v3/services/a72b08088ad84d8f8ce9898684bdb09f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:40.152230 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce09ed-9fac-4a75-827e-5ecfd6facaaf tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:40.168433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce09ed-9fac-4a75-827e-5ecfd6facaaf tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:40.213204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9230e-6cde-47f4-9ff8-2c04ef582b2a tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd83504e39c4ee4b53872001f2c5e76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff34c1eb32a9461a9e4d98760fa6b76f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:40.214211 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9230e-6cde-47f4-9ff8-2c04ef582b2a tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:40.214499 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9230e-6cde-47f4-9ff8-2c04ef582b2a tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:40.214871 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9230e-6cde-47f4-9ff8-2c04ef582b2a tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] PATH_INFO: `/v3/services/a72b08088ad84d8f8ce9898684bdb09f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:40.220279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe9230e-6cde-47f4-9ff8-2c04ef582b2a tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: Authorizing `identity:get_service(service_id=a72b08088ad84d8f8ce9898684bdb09f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:40.225234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe9230e-6cde-47f4-9ff8-2c04ef582b2a tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:40.273310 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-8fe9230e-6cde-47f4-9ff8-2c04ef582b2a tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] Could not find service: a72b08088ad84d8f8ce9898684bdb09f.: keystone.exception.ServiceNotFound: Could not find service: a72b08088ad84d8f8ce9898684bdb09f. Aug 06 21:08:40.273310 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:08:40.273310 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 21:08:40.273310 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 21:08:40.273310 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 21:08:40.273310 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 21:08:40.273310 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 21:08:40.273310 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 21:08:40.273310 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: a72b08088ad84d8f8ce9898684bdb09f. Aug 06 21:08:40.273310 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:08:40.273310 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 21:08:40.273310 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:08:40.273310 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:08:40.273310 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:08:40.273310 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:08:40.274827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:08:40.274827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:08:40.274827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:08:40.274827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:08:40.274827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:08:40.274827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:08:40.274827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:08:40.274827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:08:40.274827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 21:08:40.274827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 21:08:40.274827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 21:08:40.274827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 21:08:40.274827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:08:40.274827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:08:40.274827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 21:08:40.274827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 21:08:40.276057 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 21:08:40.276057 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 21:08:40.276057 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 21:08:40.276057 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 21:08:40.276057 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 21:08:40.276057 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 21:08:40.276057 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 21:08:40.276057 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 21:08:40.276057 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 21:08:40.276057 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 21:08:40.276057 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 21:08:40.276057 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 21:08:40.276057 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 21:08:40.276057 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 21:08:40.276057 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: a72b08088ad84d8f8ce9898684bdb09f. Aug 06 21:08:40.276057 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:08:40.287346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fef1e-cb7e-4526-8d2a-4125ac3ba1ca tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:40.288826 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1984/4010] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:08:40 2022] GET /identity/v3/services/a72b08088ad84d8f8ce9898684bdb09f => generated 113 bytes in 137 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:08:40.305723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fef1e-cb7e-4526-8d2a-4125ac3ba1ca tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:40.319550 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1c8b8-7d01-413e-97bc-68b038de6140 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd83504e39c4ee4b53872001f2c5e76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff34c1eb32a9461a9e4d98760fa6b76f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:40.320104 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1c8b8-7d01-413e-97bc-68b038de6140 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:40.320397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1c8b8-7d01-413e-97bc-68b038de6140 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:40.320660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1c8b8-7d01-413e-97bc-68b038de6140 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:40.321500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1c8b8-7d01-413e-97bc-68b038de6140 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:40.322525 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-eab1c8b8-7d01-413e-97bc-68b038de6140 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:08:40.322525 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:08:40.322525 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:08:40.328038 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1c8b8-7d01-413e-97bc-68b038de6140 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:40.361169 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2027/4011] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:08:40 2022] POST /identity/v3/services => generated 272 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:08:40.367530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9230e-6cde-47f4-9ff8-2c04ef582b2a tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:40.388475 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9230e-6cde-47f4-9ff8-2c04ef582b2a tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:40.423425 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c4aaf-b9b6-447b-8915-61846a6e50bc tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd83504e39c4ee4b53872001f2c5e76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff34c1eb32a9461a9e4d98760fa6b76f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:40.423791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c4aaf-b9b6-447b-8915-61846a6e50bc tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:40.424183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c4aaf-b9b6-447b-8915-61846a6e50bc tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:40.424386 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c4aaf-b9b6-447b-8915-61846a6e50bc tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] PATH_INFO: `/v3/services` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:40.425036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c4aaf-b9b6-447b-8915-61846a6e50bc tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:40.426929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c4aaf-b9b6-447b-8915-61846a6e50bc tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:40.467021 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1985/4012] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:08:40 2022] POST /identity/v3/services => generated 273 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:08:40.468777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1c8b8-7d01-413e-97bc-68b038de6140 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:40.482186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1c8b8-7d01-413e-97bc-68b038de6140 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:40.507054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad81ed-d2f6-434f-92ee-7881a83ead9a tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd83504e39c4ee4b53872001f2c5e76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff34c1eb32a9461a9e4d98760fa6b76f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:40.510950 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad81ed-d2f6-434f-92ee-7881a83ead9a tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:40.511469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad81ed-d2f6-434f-92ee-7881a83ead9a tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:40.511755 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad81ed-d2f6-434f-92ee-7881a83ead9a tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:40.512674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad81ed-d2f6-434f-92ee-7881a83ead9a tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:40.515030 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad81ed-d2f6-434f-92ee-7881a83ead9a tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:40.543249 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2028/4013] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:08:40 2022] POST /identity/v3/services => generated 273 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:08:40.549992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c4aaf-b9b6-447b-8915-61846a6e50bc tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:40.585343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c4aaf-b9b6-447b-8915-61846a6e50bc tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:40.621523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7eb98-044a-4009-9837-0aec3b9e6a91 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd83504e39c4ee4b53872001f2c5e76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff34c1eb32a9461a9e4d98760fa6b76f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:40.622605 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7eb98-044a-4009-9837-0aec3b9e6a91 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:40.622605 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7eb98-044a-4009-9837-0aec3b9e6a91 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:40.623725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7eb98-044a-4009-9837-0aec3b9e6a91 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] PATH_INFO: `/v3/services` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:40.623725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef7eb98-044a-4009-9837-0aec3b9e6a91 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:40.624773 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-7ef7eb98-044a-4009-9837-0aec3b9e6a91 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:08:40.624773 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:08:40.624773 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:08:40.626534 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef7eb98-044a-4009-9837-0aec3b9e6a91 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:40.640347 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1986/4014] 10.222.0.33 () {58 vars in 1131 bytes} [Sat Aug 6 21:08:40 2022] GET /identity/v3/services => generated 2973 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:08:40.644699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad81ed-d2f6-434f-92ee-7881a83ead9a tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:40.657449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad81ed-d2f6-434f-92ee-7881a83ead9a tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:40.666354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b636bfa-80b4-49a8-8c2a-4ade4977f0c6 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd83504e39c4ee4b53872001f2c5e76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff34c1eb32a9461a9e4d98760fa6b76f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:40.667440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b636bfa-80b4-49a8-8c2a-4ade4977f0c6 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:40.667946 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b636bfa-80b4-49a8-8c2a-4ade4977f0c6 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:40.668626 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b636bfa-80b4-49a8-8c2a-4ade4977f0c6 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:40.669542 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b636bfa-80b4-49a8-8c2a-4ade4977f0c6 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-60388724) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:08:40.669951 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b636bfa-80b4-49a8-8c2a-4ade4977f0c6 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:40.671164 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-2b636bfa-80b4-49a8-8c2a-4ade4977f0c6 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:08:40.671164 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:08:40.671164 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:08:40.672722 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b636bfa-80b4-49a8-8c2a-4ade4977f0c6 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:40.693770 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2029/4015] 10.222.0.33 () {58 vars in 1218 bytes} [Sat Aug 6 21:08:40 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-60388724 => generated 413 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:08:40.698078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7eb98-044a-4009-9837-0aec3b9e6a91 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:40.712660 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7eb98-044a-4009-9837-0aec3b9e6a91 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:40.728482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373866c4-8e09-4443-8dc4-73024b275538 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd83504e39c4ee4b53872001f2c5e76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff34c1eb32a9461a9e4d98760fa6b76f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:40.729283 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373866c4-8e09-4443-8dc4-73024b275538 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:40.730219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373866c4-8e09-4443-8dc4-73024b275538 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:40.730750 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373866c4-8e09-4443-8dc4-73024b275538 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] PATH_INFO: `/v3/services` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:40.732212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373866c4-8e09-4443-8dc4-73024b275538 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-825148757) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:08:40.732733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373866c4-8e09-4443-8dc4-73024b275538 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:40.735012 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373866c4-8e09-4443-8dc4-73024b275538 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:40.745174 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1987/4016] 10.222.0.33 () {58 vars in 1220 bytes} [Sat Aug 6 21:08:40 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-825148757 => generated 415 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:08:40.757301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b636bfa-80b4-49a8-8c2a-4ade4977f0c6 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:40.779675 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b636bfa-80b4-49a8-8c2a-4ade4977f0c6 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:40.784890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99be4ad-a4c1-46d9-b859-382a553bd2a7 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd83504e39c4ee4b53872001f2c5e76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff34c1eb32a9461a9e4d98760fa6b76f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:40.785771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99be4ad-a4c1-46d9-b859-382a553bd2a7 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:40.786402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99be4ad-a4c1-46d9-b859-382a553bd2a7 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:40.786895 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99be4ad-a4c1-46d9-b859-382a553bd2a7 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:40.787906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99be4ad-a4c1-46d9-b859-382a553bd2a7 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-677404311) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:08:40.788391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99be4ad-a4c1-46d9-b859-382a553bd2a7 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:40.791473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99be4ad-a4c1-46d9-b859-382a553bd2a7 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:40.798168 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2030/4017] 10.222.0.33 () {58 vars in 1220 bytes} [Sat Aug 6 21:08:40 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-677404311 => generated 415 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:08:40.803920 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373866c4-8e09-4443-8dc4-73024b275538 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:40.818662 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373866c4-8e09-4443-8dc4-73024b275538 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:40.824036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a51160-cb1b-430e-9512-d07330d43b81 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd83504e39c4ee4b53872001f2c5e76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff34c1eb32a9461a9e4d98760fa6b76f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:40.825102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a51160-cb1b-430e-9512-d07330d43b81 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:40.825459 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a51160-cb1b-430e-9512-d07330d43b81 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:40.825918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a51160-cb1b-430e-9512-d07330d43b81 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] PATH_INFO: `/v3/services/01bc2afe36be49dab8f01432016db8d8` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:40.827111 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a51160-cb1b-430e-9512-d07330d43b81 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: Authorizing `identity:delete_service(service_id=01bc2afe36be49dab8f01432016db8d8)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:40.829034 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-86a51160-cb1b-430e-9512-d07330d43b81 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:08:40.829034 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:08:40.829034 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:08:40.830307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a51160-cb1b-430e-9512-d07330d43b81 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:40.866641 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1988/4018] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:08:40 2022] DELETE /identity/v3/services/01bc2afe36be49dab8f01432016db8d8 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:40.870799 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99be4ad-a4c1-46d9-b859-382a553bd2a7 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:40.885985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99be4ad-a4c1-46d9-b859-382a553bd2a7 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:40.903125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb5b77-4417-4646-9c7d-ddd847a54cf4 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd83504e39c4ee4b53872001f2c5e76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff34c1eb32a9461a9e4d98760fa6b76f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:40.904046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb5b77-4417-4646-9c7d-ddd847a54cf4 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:40.904423 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb5b77-4417-4646-9c7d-ddd847a54cf4 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:40.904960 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb5b77-4417-4646-9c7d-ddd847a54cf4 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] PATH_INFO: `/v3/services/91e4aa22624341458b9ae1d3b1b2e37b` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:40.905612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb5b77-4417-4646-9c7d-ddd847a54cf4 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: Authorizing `identity:delete_service(service_id=91e4aa22624341458b9ae1d3b1b2e37b)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:40.907349 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb5b77-4417-4646-9c7d-ddd847a54cf4 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:40.953007 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2031/4019] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:08:40 2022] DELETE /identity/v3/services/91e4aa22624341458b9ae1d3b1b2e37b => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:40.957029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a51160-cb1b-430e-9512-d07330d43b81 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:40.983459 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a51160-cb1b-430e-9512-d07330d43b81 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:41.010576 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0ac0e-c36c-481a-80b1-488fc4584233 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd83504e39c4ee4b53872001f2c5e76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff34c1eb32a9461a9e4d98760fa6b76f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:41.011222 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0ac0e-c36c-481a-80b1-488fc4584233 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:41.011552 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0ac0e-c36c-481a-80b1-488fc4584233 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:41.011972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0ac0e-c36c-481a-80b1-488fc4584233 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] PATH_INFO: `/v3/services/3591523a867644e29ae711199e9c4f12` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:41.012562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0ac0e-c36c-481a-80b1-488fc4584233 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: Authorizing `identity:delete_service(service_id=3591523a867644e29ae711199e9c4f12)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:41.015273 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0ac0e-c36c-481a-80b1-488fc4584233 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:41.043075 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1989/4020] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:08:40 2022] DELETE /identity/v3/services/3591523a867644e29ae711199e9c4f12 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:41.049002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb5b77-4417-4646-9c7d-ddd847a54cf4 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:41.073792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:41.185154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb5b77-4417-4646-9c7d-ddd847a54cf4 tempest-ServicesTestJSON-1473941733 tempest-ServicesTestJSON-1473941733-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:41.207204 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c680fd-dedd-4c2f-b13c-e78c9454d3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:41.209148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c680fd-dedd-4c2f-b13c-e78c9454d3b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:41.209646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c680fd-dedd-4c2f-b13c-e78c9454d3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:41.210124 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c680fd-dedd-4c2f-b13c-e78c9454d3b8 admin admin] PATH_INFO: `/v3/users/b5d7cf56c9414c92b21779dc7ca7b027` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:41.212415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c680fd-dedd-4c2f-b13c-e78c9454d3b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5d7cf56c9414c92b21779dc7ca7b027)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:41.215722 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c680fd-dedd-4c2f-b13c-e78c9454d3b8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:41.332959 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-32c680fd-dedd-4c2f-b13c-e78c9454d3b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5d7cf56c9414c92b21779dc7ca7b027'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:41.342619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-32c680fd-dedd-4c2f-b13c-e78c9454d3b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5d7cf56c9414c92b21779dc7ca7b027'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:41.343480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-32c680fd-dedd-4c2f-b13c-e78c9454d3b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5d7cf56c9414c92b21779dc7ca7b027'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:41.344170 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-32c680fd-dedd-4c2f-b13c-e78c9454d3b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5d7cf56c9414c92b21779dc7ca7b027'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:41.356803 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-32c680fd-dedd-4c2f-b13c-e78c9454d3b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5d7cf56c9414c92b21779dc7ca7b027'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:41.398493 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2032/4021] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:08:41 2022] DELETE /identity/v3/users/b5d7cf56c9414c92b21779dc7ca7b027 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:41.404044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1582c-1639-4b01-8354-3c6324e3aa3f None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:41.404354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1582c-1639-4b01-8354-3c6324e3aa3f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:41.404607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1582c-1639-4b01-8354-3c6324e3aa3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:41.443574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f5b1582c-1639-4b01-8354-3c6324e3aa3f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:41.444720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f5b1582c-1639-4b01-8354-3c6324e3aa3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:41.544570 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:41.576729 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1990/4022] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:41.593930 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c680fd-dedd-4c2f-b13c-e78c9454d3b8 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:41.598361 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-32c680fd-dedd-4c2f-b13c-e78c9454d3b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:41.630982 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bf39f-0a74-4eaf-8683-de5045e72861 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:41.631263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bf39f-0a74-4eaf-8683-de5045e72861 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:41.631748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bf39f-0a74-4eaf-8683-de5045e72861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:41.710741 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-566bf39f-0a74-4eaf-8683-de5045e72861 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:41.712269 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-566bf39f-0a74-4eaf-8683-de5045e72861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:41.831253 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c680fd-dedd-4c2f-b13c-e78c9454d3b8 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:41.854282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b5834-c486-485e-98f1-bd4b253499a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:41.855109 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b5834-c486-485e-98f1-bd4b253499a1 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:41.855496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b5834-c486-485e-98f1-bd4b253499a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:41.855881 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b5834-c486-485e-98f1-bd4b253499a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:41.875976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b5834-c486-485e-98f1-bd4b253499a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:41.877575 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b5834-c486-485e-98f1-bd4b253499a1 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:41.881823 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1991/4023] 10.222.0.33 () {58 vars in 967 bytes} [Sat Aug 6 21:08:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:41.890725 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2033/4024] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:08:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:08:41.901761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bf39f-0a74-4eaf-8683-de5045e72861 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:41.903746 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-566bf39f-0a74-4eaf-8683-de5045e72861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:42.038419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bf39f-0a74-4eaf-8683-de5045e72861 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:42.045945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773c314-a5a5-4b55-8544-1712caaa0fe5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:42.046901 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773c314-a5a5-4b55-8544-1712caaa0fe5 service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:42.047495 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773c314-a5a5-4b55-8544-1712caaa0fe5 service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:42.047930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773c314-a5a5-4b55-8544-1712caaa0fe5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:42.062122 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773c314-a5a5-4b55-8544-1712caaa0fe5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:42.065487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773c314-a5a5-4b55-8544-1712caaa0fe5 service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:42.077892 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1992/4025] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:08:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:08:42.384198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd35c0-5029-4b2a-b743-e96f378a45fb None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:42.385207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd35c0-5029-4b2a-b743-e96f378a45fb None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:42.385499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd35c0-5029-4b2a-b743-e96f378a45fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:42.435399 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-50fd35c0-5029-4b2a-b743-e96f378a45fb None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:42.437475 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-50fd35c0-5029-4b2a-b743-e96f378a45fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:42.448869 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2034/4026] 10.222.0.33 () {58 vars in 967 bytes} [Sat Aug 6 21:08:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:42.466690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773c314-a5a5-4b55-8544-1712caaa0fe5 service swift] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:42.478925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773c314-a5a5-4b55-8544-1712caaa0fe5 service swift] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:42.486890 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac12b6d-eb73-4765-b919-4563c41662eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:42.487817 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac12b6d-eb73-4765-b919-4563c41662eb service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:42.488040 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac12b6d-eb73-4765-b919-4563c41662eb service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:42.488416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac12b6d-eb73-4765-b919-4563c41662eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:42.505485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac12b6d-eb73-4765-b919-4563c41662eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:42.507228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac12b6d-eb73-4765-b919-4563c41662eb service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:42.537832 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1993/4027] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:08:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:08:42.712460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd35c0-5029-4b2a-b743-e96f378a45fb None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:42.714071 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-50fd35c0-5029-4b2a-b743-e96f378a45fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:42.733112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:42.757537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd35c0-5029-4b2a-b743-e96f378a45fb None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:42.763565 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4eab3e-97bc-418b-a234-a52156bedbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:42.764375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4eab3e-97bc-418b-a234-a52156bedbb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:42.764661 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4eab3e-97bc-418b-a234-a52156bedbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:42.765019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4eab3e-97bc-418b-a234-a52156bedbb7 admin admin] PATH_INFO: `/v3/projects/ce348d7bfedd4dafa7080115187ba833` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:42.766635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4eab3e-97bc-418b-a234-a52156bedbb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce348d7bfedd4dafa7080115187ba833)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:42.777336 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4eab3e-97bc-418b-a234-a52156bedbb7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:42.841057 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361add6-e899-48d4-ad97-72d647d79bcc None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:42.842026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361add6-e899-48d4-ad97-72d647d79bcc None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:42.847008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361add6-e899-48d4-ad97-72d647d79bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:42.851346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4e4eab3e-97bc-418b-a234-a52156bedbb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce348d7bfedd4dafa7080115187ba833', 'request_id': 'req-4e4eab3e-97bc-418b-a234-a52156bedbb7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:42.871367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4e4eab3e-97bc-418b-a234-a52156bedbb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce348d7bfedd4dafa7080115187ba833', 'request_id': 'req-4e4eab3e-97bc-418b-a234-a52156bedbb7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:42.885379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4e4eab3e-97bc-418b-a234-a52156bedbb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce348d7bfedd4dafa7080115187ba833', 'request_id': 'req-4e4eab3e-97bc-418b-a234-a52156bedbb7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:42.890243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-e361add6-e899-48d4-ad97-72d647d79bcc None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:42.891515 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e361add6-e899-48d4-ad97-72d647d79bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:42.913167 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4e4eab3e-97bc-418b-a234-a52156bedbb7 admin admin] The token cache is being invalidate because project ce348d7bfedd4dafa7080115187ba833 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:08:42.913455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4e4eab3e-97bc-418b-a234-a52156bedbb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:42.914725 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4e4eab3e-97bc-418b-a234-a52156bedbb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:42.916833 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2035/4028] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:08:42 2022] DELETE /identity/v3/projects/ce348d7bfedd4dafa7080115187ba833 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:42.922257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4eab3e-97bc-418b-a234-a52156bedbb7 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:42.925288 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4e4eab3e-97bc-418b-a234-a52156bedbb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:43.023564 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1994/4029] 10.222.0.33 () {58 vars in 967 bytes} [Sat Aug 6 21:08:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:43.052106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361add6-e899-48d4-ad97-72d647d79bcc None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:43.055379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e361add6-e899-48d4-ad97-72d647d79bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:43.091474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:43.115827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4eab3e-97bc-418b-a234-a52156bedbb7 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:43.143602 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f15f90-de02-4651-9e79-9320d2c38247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:43.146096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f15f90-de02-4651-9e79-9320d2c38247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:43.147020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f15f90-de02-4651-9e79-9320d2c38247 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:43.149250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f15f90-de02-4651-9e79-9320d2c38247 admin admin] PATH_INFO: `/v3/users/4dd83504e39c4ee4b53872001f2c5e76` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:43.155655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f15f90-de02-4651-9e79-9320d2c38247 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dd83504e39c4ee4b53872001f2c5e76)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:43.158726 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f15f90-de02-4651-9e79-9320d2c38247 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:43.241566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361add6-e899-48d4-ad97-72d647d79bcc None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:43.249008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52f0b1-6a69-4f82-9d6e-653349682c10 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:43.249633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52f0b1-6a69-4f82-9d6e-653349682c10 service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:43.250240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52f0b1-6a69-4f82-9d6e-653349682c10 service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:43.250528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52f0b1-6a69-4f82-9d6e-653349682c10 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:43.261441 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52f0b1-6a69-4f82-9d6e-653349682c10 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:43.263948 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52f0b1-6a69-4f82-9d6e-653349682c10 service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:43.271479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-12f15f90-de02-4651-9e79-9320d2c38247 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dd83504e39c4ee4b53872001f2c5e76'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:43.280893 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1995/4030] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:08:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:08:43.287270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-12f15f90-de02-4651-9e79-9320d2c38247 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dd83504e39c4ee4b53872001f2c5e76'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:43.288632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-12f15f90-de02-4651-9e79-9320d2c38247 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dd83504e39c4ee4b53872001f2c5e76'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:43.289307 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-12f15f90-de02-4651-9e79-9320d2c38247 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dd83504e39c4ee4b53872001f2c5e76'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:43.306857 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-12f15f90-de02-4651-9e79-9320d2c38247 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dd83504e39c4ee4b53872001f2c5e76'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:43.343701 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2036/4031] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:08:42 2022] DELETE /identity/v3/users/4dd83504e39c4ee4b53872001f2c5e76 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:43.444253 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52f0b1-6a69-4f82-9d6e-653349682c10 service swift] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:43.446065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9a52f0b1-6a69-4f82-9d6e-653349682c10 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:43.462460 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52f0b1-6a69-4f82-9d6e-653349682c10 service swift] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:43.569916 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efec75c-a55d-489b-a196-ac75b435361d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:43.570980 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efec75c-a55d-489b-a196-ac75b435361d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:43.571491 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efec75c-a55d-489b-a196-ac75b435361d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:43.571948 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efec75c-a55d-489b-a196-ac75b435361d admin admin] PATH_INFO: `/v3/users/55a4c0dae0d04e55b786ca572769bf8c` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:43.573303 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efec75c-a55d-489b-a196-ac75b435361d admin admin] RBAC: Authorizing `identity:delete_user(user_id=55a4c0dae0d04e55b786ca572769bf8c)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:43.575975 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efec75c-a55d-489b-a196-ac75b435361d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:43.795012 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5efec75c-a55d-489b-a196-ac75b435361d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55a4c0dae0d04e55b786ca572769bf8c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:43.796215 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5efec75c-a55d-489b-a196-ac75b435361d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55a4c0dae0d04e55b786ca572769bf8c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:43.798268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5efec75c-a55d-489b-a196-ac75b435361d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55a4c0dae0d04e55b786ca572769bf8c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:43.827963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5efec75c-a55d-489b-a196-ac75b435361d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55a4c0dae0d04e55b786ca572769bf8c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:43.859255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5efec75c-a55d-489b-a196-ac75b435361d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55a4c0dae0d04e55b786ca572769bf8c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:43.901402 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1996/4032] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:08:43 2022] DELETE /identity/v3/users/55a4c0dae0d04e55b786ca572769bf8c => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:43.905610 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd808cc-3476-45d7-90d9-0366efc4d157 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:43.906178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd808cc-3476-45d7-90d9-0366efc4d157 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:43.906304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd808cc-3476-45d7-90d9-0366efc4d157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:43.928197 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:43.952257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-5dd808cc-3476-45d7-90d9-0366efc4d157 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:43.953634 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5dd808cc-3476-45d7-90d9-0366efc4d157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:44.073297 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2037/4033] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:08:44.099427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efec75c-a55d-489b-a196-ac75b435361d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:44.108748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5efec75c-a55d-489b-a196-ac75b435361d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:44.150976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd808cc-3476-45d7-90d9-0366efc4d157 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:44.156159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5dd808cc-3476-45d7-90d9-0366efc4d157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:44.186777 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:44.187922 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd808cc-3476-45d7-90d9-0366efc4d157 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:44.216196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bc940-563d-45a9-90a5-96c148a3925f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:44.219093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bc940-563d-45a9-90a5-96c148a3925f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:44.219439 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bc940-563d-45a9-90a5-96c148a3925f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:44.219724 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bc940-563d-45a9-90a5-96c148a3925f admin admin] PATH_INFO: `/v3/projects/ff34c1eb32a9461a9e4d98760fa6b76f` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:44.223431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3bc940-563d-45a9-90a5-96c148a3925f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff34c1eb32a9461a9e4d98760fa6b76f)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:44.231560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3bc940-563d-45a9-90a5-96c148a3925f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:44.340441 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efec75c-a55d-489b-a196-ac75b435361d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:44.366773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2f3bc940-563d-45a9-90a5-96c148a3925f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff34c1eb32a9461a9e4d98760fa6b76f', 'request_id': 'req-2f3bc940-563d-45a9-90a5-96c148a3925f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:44.403063 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2f3bc940-563d-45a9-90a5-96c148a3925f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff34c1eb32a9461a9e4d98760fa6b76f', 'request_id': 'req-2f3bc940-563d-45a9-90a5-96c148a3925f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:44.409412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2f3bc940-563d-45a9-90a5-96c148a3925f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff34c1eb32a9461a9e4d98760fa6b76f', 'request_id': 'req-2f3bc940-563d-45a9-90a5-96c148a3925f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:44.427840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2f3bc940-563d-45a9-90a5-96c148a3925f admin admin] The token cache is being invalidate because project ff34c1eb32a9461a9e4d98760fa6b76f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:08:44.428486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2f3bc940-563d-45a9-90a5-96c148a3925f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:44.429432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2f3bc940-563d-45a9-90a5-96c148a3925f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:44.432084 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2038/4034] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:08:44 2022] DELETE /identity/v3/projects/ff34c1eb32a9461a9e4d98760fa6b76f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:44.437881 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67857a-6859-4d64-88c7-faf33e3f41b9 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:44.438573 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67857a-6859-4d64-88c7-faf33e3f41b9 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:44.439431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67857a-6859-4d64-88c7-faf33e3f41b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:44.465646 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd566f-2bce-47a1-bf19-63983033c333 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:44.466730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd566f-2bce-47a1-bf19-63983033c333 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:44.467411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd566f-2bce-47a1-bf19-63983033c333 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:44.467907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd566f-2bce-47a1-bf19-63983033c333 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:44.472250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b5bd566f-2bce-47a1-bf19-63983033c333 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:44.491941 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-db67857a-6859-4d64-88c7-faf33e3f41b9 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:44.495746 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-db67857a-6859-4d64-88c7-faf33e3f41b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:44.607139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd566f-2bce-47a1-bf19-63983033c333 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:44.608795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd566f-2bce-47a1-bf19-63983033c333 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:44.624335 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1997/4035] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:08:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:08:44.696006 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2039/4036] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:08:44.704311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe39de-53dc-4126-851e-a948e417880e None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:44.704630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe39de-53dc-4126-851e-a948e417880e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:44.704916 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe39de-53dc-4126-851e-a948e417880e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:44.756548 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-8afe39de-53dc-4126-851e-a948e417880e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:44.758445 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8afe39de-53dc-4126-851e-a948e417880e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:44.769387 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1998/4037] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:08:44.774741 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67857a-6859-4d64-88c7-faf33e3f41b9 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:44.790852 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67857a-6859-4d64-88c7-faf33e3f41b9 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:44.796929 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5203f-77cb-4819-af43-5f2a76817353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:44.797751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5203f-77cb-4819-af43-5f2a76817353 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:44.798132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5203f-77cb-4819-af43-5f2a76817353 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:44.798526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5203f-77cb-4819-af43-5f2a76817353 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:44.799742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5203f-77cb-4819-af43-5f2a76817353 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:08:44.800349 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5203f-77cb-4819-af43-5f2a76817353 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:44.803929 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5203f-77cb-4819-af43-5f2a76817353 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:44.831685 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2040/4038] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:08:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:08:44.836907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe39de-53dc-4126-851e-a948e417880e None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:44.856326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe39de-53dc-4126-851e-a948e417880e None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:44.866766 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e3b37-068b-49b4-a758-c5d7aac1059f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:44.868439 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e3b37-068b-49b4-a758-c5d7aac1059f admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:44.869959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e3b37-068b-49b4-a758-c5d7aac1059f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:44.871550 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e3b37-068b-49b4-a758-c5d7aac1059f admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:44.872837 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e3b37-068b-49b4-a758-c5d7aac1059f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:44.883393 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e3b37-068b-49b4-a758-c5d7aac1059f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:44.994509 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 1999/4039] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:08:44 2022] POST /identity/v3/projects => generated 369 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:08:44.998468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5203f-77cb-4819-af43-5f2a76817353 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:45.045995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5203f-77cb-4819-af43-5f2a76817353 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:45.086512 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:45.129299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e3b37-068b-49b4-a758-c5d7aac1059f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:45.131514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e19e3b37-068b-49b4-a758-c5d7aac1059f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:45.225308 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b831e-320b-479c-801a-8dd93e0f4741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:45.227330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b831e-320b-479c-801a-8dd93e0f4741 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:45.227718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b831e-320b-479c-801a-8dd93e0f4741 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:45.229353 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b831e-320b-479c-801a-8dd93e0f4741 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:45.230931 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b831e-320b-479c-801a-8dd93e0f4741 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:45.233600 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b831e-320b-479c-801a-8dd93e0f4741 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:45.253318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:45.273848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e3b37-068b-49b4-a758-c5d7aac1059f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:45.282143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4f5dd-62f9-494a-8b22-3e45d743481b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:45.283417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4f5dd-62f9-494a-8b22-3e45d743481b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:45.284011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4f5dd-62f9-494a-8b22-3e45d743481b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:45.284164 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4f5dd-62f9-494a-8b22-3e45d743481b admin admin] PATH_INFO: `/v3/projects/6b68ddb3badb454dac41733610ea2b71` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:45.285831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4f5dd-62f9-494a-8b22-3e45d743481b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b68ddb3badb454dac41733610ea2b71)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:45.288213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4f5dd-62f9-494a-8b22-3e45d743481b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:45.292409 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2041/4040] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:08:44 2022] POST /identity/v3/users => generated 285 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:08:45.294362 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b831e-320b-479c-801a-8dd93e0f4741 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:45.321659 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b831e-320b-479c-801a-8dd93e0f4741 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:45.335171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f766531-585c-452a-8e40-aeb2c47c8bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:45.336059 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f766531-585c-452a-8e40-aeb2c47c8bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:45.336455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f766531-585c-452a-8e40-aeb2c47c8bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:45.336884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f766531-585c-452a-8e40-aeb2c47c8bf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:45.337629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f766531-585c-452a-8e40-aeb2c47c8bf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:45.339674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f766531-585c-452a-8e40-aeb2c47c8bf2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:45.357869 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2042/4041] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:08:45.359212 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f766531-585c-452a-8e40-aeb2c47c8bf2 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:45.372905 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f766531-585c-452a-8e40-aeb2c47c8bf2 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:45.382297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0082ee-8ce5-4609-a5b5-bda1d031fca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:45.383213 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0082ee-8ce5-4609-a5b5-bda1d031fca4 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:45.384473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0082ee-8ce5-4609-a5b5-bda1d031fca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:45.385038 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0082ee-8ce5-4609-a5b5-bda1d031fca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:45.386179 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0082ee-8ce5-4609-a5b5-bda1d031fca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:45.388568 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0082ee-8ce5-4609-a5b5-bda1d031fca4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:45.423930 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2043/4042] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:08:45.423930 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0082ee-8ce5-4609-a5b5-bda1d031fca4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:45.430092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-76d4f5dd-62f9-494a-8b22-3e45d743481b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b68ddb3badb454dac41733610ea2b71', 'request_id': 'req-76d4f5dd-62f9-494a-8b22-3e45d743481b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:45.436000 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0082ee-8ce5-4609-a5b5-bda1d031fca4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:45.440178 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-76d4f5dd-62f9-494a-8b22-3e45d743481b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b68ddb3badb454dac41733610ea2b71', 'request_id': 'req-76d4f5dd-62f9-494a-8b22-3e45d743481b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:45.452055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-76d4f5dd-62f9-494a-8b22-3e45d743481b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b68ddb3badb454dac41733610ea2b71', 'request_id': 'req-76d4f5dd-62f9-494a-8b22-3e45d743481b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:45.483599 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-76d4f5dd-62f9-494a-8b22-3e45d743481b admin admin] The token cache is being invalidate because project 6b68ddb3badb454dac41733610ea2b71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:08:45.484041 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-76d4f5dd-62f9-494a-8b22-3e45d743481b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:45.485353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-76d4f5dd-62f9-494a-8b22-3e45d743481b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:45.498920 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2000/4043] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:08:45 2022] DELETE /identity/v3/projects/6b68ddb3badb454dac41733610ea2b71 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:45.520964 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645be91-3deb-4c74-9cb3-66d21296fbc5 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:45.521296 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645be91-3deb-4c74-9cb3-66d21296fbc5 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:45.521584 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645be91-3deb-4c74-9cb3-66d21296fbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:45.555080 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-3645be91-3deb-4c74-9cb3-66d21296fbc5 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:45.556354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3645be91-3deb-4c74-9cb3-66d21296fbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:45.557189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad079ab6-db60-4aff-b7ef-3e1dc1485c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:45.558519 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad079ab6-db60-4aff-b7ef-3e1dc1485c07 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:45.558821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad079ab6-db60-4aff-b7ef-3e1dc1485c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:45.559096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad079ab6-db60-4aff-b7ef-3e1dc1485c07 admin admin] PATH_INFO: `/v3/projects/3908fe3487964b5fb7d977b580cbd8fb/users/92805ad8258743d49f79d4de7026d161/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:45.572438 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2001/4044] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:45.573357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645be91-3deb-4c74-9cb3-66d21296fbc5 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:45.576440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3645be91-3deb-4c74-9cb3-66d21296fbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:45.587166 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad079ab6-db60-4aff-b7ef-3e1dc1485c07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3908fe3487964b5fb7d977b580cbd8fb, user_id=92805ad8258743d49f79d4de7026d161, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:45.593176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645be91-3deb-4c74-9cb3-66d21296fbc5 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:45.594734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad079ab6-db60-4aff-b7ef-3e1dc1485c07 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:45.607408 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8cb94-c229-4053-a532-a1f45ca1352e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:45.611527 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2044/4045] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:08:45 2022] PUT /identity/v3/projects/3908fe3487964b5fb7d977b580cbd8fb/users/92805ad8258743d49f79d4de7026d161/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:45.613226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8cb94-c229-4053-a532-a1f45ca1352e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:45.613371 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4db88-dc4f-4fc8-a266-053bd09c2fcf None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:45.614275 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4db88-dc4f-4fc8-a266-053bd09c2fcf None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:45.614753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8cb94-c229-4053-a532-a1f45ca1352e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:45.614896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4db88-dc4f-4fc8-a266-053bd09c2fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:45.615393 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8cb94-c229-4053-a532-a1f45ca1352e admin admin] PATH_INFO: `/v3/users/a6955ef07c6f447187f1ad99c2a7b7b9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:45.618239 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8cb94-c229-4053-a532-a1f45ca1352e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6955ef07c6f447187f1ad99c2a7b7b9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:45.620705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8cb94-c229-4053-a532-a1f45ca1352e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:45.641115 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-e5b4db88-dc4f-4fc8-a266-053bd09c2fcf None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:45.642756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e5b4db88-dc4f-4fc8-a266-053bd09c2fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:45.691718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e0b8cb94-c229-4053-a532-a1f45ca1352e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6955ef07c6f447187f1ad99c2a7b7b9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:45.692575 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e0b8cb94-c229-4053-a532-a1f45ca1352e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6955ef07c6f447187f1ad99c2a7b7b9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:45.693244 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e0b8cb94-c229-4053-a532-a1f45ca1352e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6955ef07c6f447187f1ad99c2a7b7b9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:45.707418 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e0b8cb94-c229-4053-a532-a1f45ca1352e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6955ef07c6f447187f1ad99c2a7b7b9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:45.722149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e0b8cb94-c229-4053-a532-a1f45ca1352e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6955ef07c6f447187f1ad99c2a7b7b9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:45.725969 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2045/4046] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:45.727632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3982408-658a-46f3-904d-8b2edacf94a8 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:45.727927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3982408-658a-46f3-904d-8b2edacf94a8 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:45.728207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3982408-658a-46f3-904d-8b2edacf94a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:45.746832 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2002/4047] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:08:45 2022] DELETE /identity/v3/users/a6955ef07c6f447187f1ad99c2a7b7b9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:45.747088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:45.747211 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8cb94-c229-4053-a532-a1f45ca1352e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:45.766268 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d3982408-658a-46f3-904d-8b2edacf94a8 None None] MFA Rules not processed for user `92805ad8258743d49f79d4de7026d161`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:45.767808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d3982408-658a-46f3-904d-8b2edacf94a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:45.820312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:45.842925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8cb94-c229-4053-a532-a1f45ca1352e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:45.850944 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb97e1c-923b-49b4-ab5f-41e535ea2aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:45.852102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb97e1c-923b-49b4-ab5f-41e535ea2aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:45.852609 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb97e1c-923b-49b4-ab5f-41e535ea2aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:45.853493 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb97e1c-923b-49b4-ab5f-41e535ea2aa4 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:45.854434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb97e1c-923b-49b4-ab5f-41e535ea2aa4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:08:45.855028 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb97e1c-923b-49b4-ab5f-41e535ea2aa4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:45.856869 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb97e1c-923b-49b4-ab5f-41e535ea2aa4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:45.870727 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2046/4048] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:45.876462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3982408-658a-46f3-904d-8b2edacf94a8 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:45.887665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3982408-658a-46f3-904d-8b2edacf94a8 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:45.893049 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2003/4049] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:08:45.893241 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dcb1a8-3834-4770-a695-8f2d386aed26 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92805ad8258743d49f79d4de7026d161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3908fe3487964b5fb7d977b580cbd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:45.895559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcb1a8-3834-4770-a695-8f2d386aed26 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:45.895998 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcb1a8-3834-4770-a695-8f2d386aed26 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:45.896339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcb1a8-3834-4770-a695-8f2d386aed26 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] PATH_INFO: `/v3/users/92805ad8258743d49f79d4de7026d161/application_credentials` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:45.896642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb97e1c-923b-49b4-ab5f-41e535ea2aa4 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:45.897505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dcb1a8-3834-4770-a695-8f2d386aed26 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] RBAC: Authorizing `identity:create_application_credential(user_id=92805ad8258743d49f79d4de7026d161)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:45.899057 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dcb1a8-3834-4770-a695-8f2d386aed26 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:45.912670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb97e1c-923b-49b4-ab5f-41e535ea2aa4 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:45.921698 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71357493-0b59-4d53-a69b-64926b361b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:45.922528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71357493-0b59-4d53-a69b-64926b361b32 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:45.923290 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71357493-0b59-4d53-a69b-64926b361b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:45.923838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71357493-0b59-4d53-a69b-64926b361b32 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:45.924640 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71357493-0b59-4d53-a69b-64926b361b32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:45.928524 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71357493-0b59-4d53-a69b-64926b361b32 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:45.971384 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2004/4050] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:08:45 2022] POST /identity/v3/projects => generated 379 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:08:45.973604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71357493-0b59-4d53-a69b-64926b361b32 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:46.052382 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2047/4051] 10.222.0.33 () {60 vars in 1315 bytes} [Sat Aug 6 21:08:45 2022] POST /identity/v3/users/92805ad8258743d49f79d4de7026d161/application_credentials => generated 921 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:08:46.056157 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dcb1a8-3834-4770-a695-8f2d386aed26 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:46.058815 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-20dcb1a8-3834-4770-a695-8f2d386aed26 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:46.061389 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71357493-0b59-4d53-a69b-64926b361b32 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:46.066645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd8851-8343-4999-9f9f-77b9b9c3879f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:46.067605 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd8851-8343-4999-9f9f-77b9b9c3879f admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:46.068070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd8851-8343-4999-9f9f-77b9b9c3879f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:46.068440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd8851-8343-4999-9f9f-77b9b9c3879f admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:46.069133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd8851-8343-4999-9f9f-77b9b9c3879f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:46.071326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd8851-8343-4999-9f9f-77b9b9c3879f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:46.075226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dcb1a8-3834-4770-a695-8f2d386aed26 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:46.080771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3c134-ff5b-48d6-9163-3afbaddca522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:46.081414 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3c134-ff5b-48d6-9163-3afbaddca522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:46.081695 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3c134-ff5b-48d6-9163-3afbaddca522 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:46.081969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3c134-ff5b-48d6-9163-3afbaddca522 admin admin] PATH_INFO: `/v3/projects/980210caadb14685afa7afb9bbf6c651` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:46.083780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3c134-ff5b-48d6-9163-3afbaddca522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=980210caadb14685afa7afb9bbf6c651)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:46.085720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3c134-ff5b-48d6-9163-3afbaddca522 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:46.103750 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2005/4052] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:08:45 2022] POST /identity/v3/users => generated 290 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:08:46.108204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd8851-8343-4999-9f9f-77b9b9c3879f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:46.144501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bfe3c134-ff5b-48d6-9163-3afbaddca522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '980210caadb14685afa7afb9bbf6c651', 'request_id': 'req-bfe3c134-ff5b-48d6-9163-3afbaddca522'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:46.153310 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bfe3c134-ff5b-48d6-9163-3afbaddca522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '980210caadb14685afa7afb9bbf6c651', 'request_id': 'req-bfe3c134-ff5b-48d6-9163-3afbaddca522'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:46.163026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bfe3c134-ff5b-48d6-9163-3afbaddca522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '980210caadb14685afa7afb9bbf6c651', 'request_id': 'req-bfe3c134-ff5b-48d6-9163-3afbaddca522'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:46.173453 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd8851-8343-4999-9f9f-77b9b9c3879f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:46.175656 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bfe3c134-ff5b-48d6-9163-3afbaddca522 admin admin] The token cache is being invalidate because project 980210caadb14685afa7afb9bbf6c651 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:08:46.175995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bfe3c134-ff5b-48d6-9163-3afbaddca522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:46.176747 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bfe3c134-ff5b-48d6-9163-3afbaddca522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:46.178335 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2048/4053] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:08:46 2022] DELETE /identity/v3/projects/980210caadb14685afa7afb9bbf6c651 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:46.179143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3c134-ff5b-48d6-9163-3afbaddca522 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:46.180734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-bfe3c134-ff5b-48d6-9163-3afbaddca522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:46.186968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:46.237226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018e360-3998-48f6-ac5f-c2a245fe5afe tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92805ad8258743d49f79d4de7026d161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3908fe3487964b5fb7d977b580cbd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:46.237878 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018e360-3998-48f6-ac5f-c2a245fe5afe tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:46.238178 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018e360-3998-48f6-ac5f-c2a245fe5afe tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:46.238566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018e360-3998-48f6-ac5f-c2a245fe5afe tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] PATH_INFO: `/v3/users/92805ad8258743d49f79d4de7026d161/access_rules/eedd53be7b4143738826462441cca0fd` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:46.239990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8018e360-3998-48f6-ac5f-c2a245fe5afe tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] RBAC: Authorizing `identity:delete_access_rule(user_id=92805ad8258743d49f79d4de7026d161, access_rule_id=eedd53be7b4143738826462441cca0fd)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:46.241420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8018e360-3998-48f6-ac5f-c2a245fe5afe tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:46.251381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3c134-ff5b-48d6-9163-3afbaddca522 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:46.256919 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b6f09-9ea7-4c01-b7fd-5f5d120c3faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:46.257669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b6f09-9ea7-4c01-b7fd-5f5d120c3faf admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:46.257949 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b6f09-9ea7-4c01-b7fd-5f5d120c3faf admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:46.258223 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b6f09-9ea7-4c01-b7fd-5f5d120c3faf admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:46.258899 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b6f09-9ea7-4c01-b7fd-5f5d120c3faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:46.260532 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b6f09-9ea7-4c01-b7fd-5f5d120c3faf admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:46.271708 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2049/4054] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:08:46.272821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac24198-dbd9-4464-9f70-d9400e867f58 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:46.273137 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac24198-dbd9-4464-9f70-d9400e867f58 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:46.273412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac24198-dbd9-4464-9f70-d9400e867f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:46.284466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-8018e360-3998-48f6-ac5f-c2a245fe5afe tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Aug 06 21:08:46.284466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:08:46.284466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Aug 06 21:08:46.284466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application session.delete(ref) Aug 06 21:08:46.284466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 06 21:08:46.284466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application next(self.gen) Aug 06 21:08:46.284466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 06 21:08:46.284466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application yield resource Aug 06 21:08:46.284466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 06 21:08:46.284466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application next(self.gen) Aug 06 21:08:46.284466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 06 21:08:46.284466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self.session.rollback() Aug 06 21:08:46.284466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 21:08:46.284466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self.force_reraise() Aug 06 21:08:46.284466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 21:08:46.284466 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise self.value Aug 06 21:08:46.285746 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 06 21:08:46.285746 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 06 21:08:46.285746 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 06 21:08:46.285746 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application session.commit() Aug 06 21:08:46.285746 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 06 21:08:46.285746 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 06 21:08:46.285746 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 06 21:08:46.285746 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._prepare_impl() Aug 06 21:08:46.285746 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 06 21:08:46.285746 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self.session.flush() Aug 06 21:08:46.285746 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 06 21:08:46.285746 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._flush(objects) Aug 06 21:08:46.285746 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 06 21:08:46.285746 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 06 21:08:46.285746 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 06 21:08:46.285746 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application compat.raise_( Aug 06 21:08:46.286869 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 06 21:08:46.286869 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception Aug 06 21:08:46.286869 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 06 21:08:46.286869 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application flush_context.execute() Aug 06 21:08:46.286869 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 06 21:08:46.286869 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rec.execute(self) Aug 06 21:08:46.286869 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Aug 06 21:08:46.286869 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Aug 06 21:08:46.286869 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Aug 06 21:08:46.286869 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._synchronize( Aug 06 21:08:46.286869 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Aug 06 21:08:46.286869 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Aug 06 21:08:46.286869 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Aug 06 21:08:46.286869 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise AssertionError( Aug 06 21:08:46.286869 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Aug 06 21:08:46.286869 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:08:46.288012 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 21:08:46.288012 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:08:46.288012 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:08:46.288012 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:08:46.288012 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:08:46.288012 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:08:46.288012 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:08:46.288012 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:08:46.288012 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:08:46.288012 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:08:46.288012 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:08:46.288012 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:08:46.288012 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:08:46.288012 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Aug 06 21:08:46.288012 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Aug 06 21:08:46.288012 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:08:46.288012 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:08:46.289188 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Aug 06 21:08:46.289188 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Aug 06 21:08:46.289188 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Aug 06 21:08:46.289188 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Aug 06 21:08:46.289188 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Aug 06 21:08:46.289188 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:08:46.289188 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2006/4055] 10.222.0.33 () {58 vars in 1362 bytes} [Sat Aug 6 21:08:46 2022] DELETE /identity/v3/users/92805ad8258743d49f79d4de7026d161/access_rules/eedd53be7b4143738826462441cca0fd => generated 89 bytes in 181 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Aug 06 21:08:46.289188 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018e360-3998-48f6-ac5f-c2a245fe5afe tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:46.294883 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-6ac24198-dbd9-4464-9f70-d9400e867f58 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:46.296164 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:46.296348 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6ac24198-dbd9-4464-9f70-d9400e867f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:46.303504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018e360-3998-48f6-ac5f-c2a245fe5afe tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:46.306684 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2050/4056] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:46.307742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac24198-dbd9-4464-9f70-d9400e867f58 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:46.309017 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6ac24198-dbd9-4464-9f70-d9400e867f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:46.309246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8e4cf-4ec3-40af-8b20-dd3725c082ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:46.309843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8e4cf-4ec3-40af-8b20-dd3725c082ea admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:46.310124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8e4cf-4ec3-40af-8b20-dd3725c082ea admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:46.310456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8e4cf-4ec3-40af-8b20-dd3725c082ea admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:46.311056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c8e4cf-4ec3-40af-8b20-dd3725c082ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:46.312665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c8e4cf-4ec3-40af-8b20-dd3725c082ea admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:46.322789 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac24198-dbd9-4464-9f70-d9400e867f58 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:46.324320 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2007/4057] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:08:46.325677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f386b-2f79-4c0f-8fba-dc88f4a1acf9 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:46.325960 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f386b-2f79-4c0f-8fba-dc88f4a1acf9 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:46.326289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f386b-2f79-4c0f-8fba-dc88f4a1acf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:46.330592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0c142-3f23-444f-9072-803e2ea74c88 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92805ad8258743d49f79d4de7026d161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3908fe3487964b5fb7d977b580cbd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:46.331262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0c142-3f23-444f-9072-803e2ea74c88 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:46.331537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0c142-3f23-444f-9072-803e2ea74c88 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:46.331813 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0c142-3f23-444f-9072-803e2ea74c88 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] PATH_INFO: `/v3/users/92805ad8258743d49f79d4de7026d161/application_credentials/34d255cf8b6141a68d8df31835e300d2` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:46.348424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0c142-3f23-444f-9072-803e2ea74c88 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] RBAC: Authorizing `identity:delete_application_credential(user_id=92805ad8258743d49f79d4de7026d161, application_credential_id=34d255cf8b6141a68d8df31835e300d2)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:46.349047 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-ae7f386b-2f79-4c0f-8fba-dc88f4a1acf9 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:46.349934 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0c142-3f23-444f-9072-803e2ea74c88 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:46.350244 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ae7f386b-2f79-4c0f-8fba-dc88f4a1acf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:46.358379 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2008/4058] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:46.359124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f386b-2f79-4c0f-8fba-dc88f4a1acf9 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:46.372682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f386b-2f79-4c0f-8fba-dc88f4a1acf9 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:46.378197 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2051/4059] 10.222.0.33 () {58 vars in 1395 bytes} [Sat Aug 6 21:08:46 2022] DELETE /identity/v3/users/92805ad8258743d49f79d4de7026d161/application_credentials/34d255cf8b6141a68d8df31835e300d2 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:46.378442 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed371f47-341b-44a8-9c5a-66ecfb738b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:46.380761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0c142-3f23-444f-9072-803e2ea74c88 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:46.380906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed371f47-341b-44a8-9c5a-66ecfb738b4d admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:46.380906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed371f47-341b-44a8-9c5a-66ecfb738b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:46.380906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed371f47-341b-44a8-9c5a-66ecfb738b4d admin admin] PATH_INFO: `/v3/projects/1b06f18250f34f7db9b0bcf9de3dc999/users/76ea7215906c4ab7b48a9f8c204cbd72/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:46.393485 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0c142-3f23-444f-9072-803e2ea74c88 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:46.402480 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed371f47-341b-44a8-9c5a-66ecfb738b4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b06f18250f34f7db9b0bcf9de3dc999, user_id=76ea7215906c4ab7b48a9f8c204cbd72, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:46.405859 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed371f47-341b-44a8-9c5a-66ecfb738b4d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:46.406388 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bdcf0-f7ed-4c55-af6d-7c199b8ce952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:46.407649 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bdcf0-f7ed-4c55-af6d-7c199b8ce952 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:46.407649 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bdcf0-f7ed-4c55-af6d-7c199b8ce952 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:46.407876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bdcf0-f7ed-4c55-af6d-7c199b8ce952 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:46.408606 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bdcf0-f7ed-4c55-af6d-7c199b8ce952 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:08:46.408995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bdcf0-f7ed-4c55-af6d-7c199b8ce952 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:46.411420 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bdcf0-f7ed-4c55-af6d-7c199b8ce952 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:46.422858 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2009/4060] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:08:46 2022] PUT /identity/v3/projects/1b06f18250f34f7db9b0bcf9de3dc999/users/76ea7215906c4ab7b48a9f8c204cbd72/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:46.426700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed371f47-341b-44a8-9c5a-66ecfb738b4d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:46.436119 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2052/4061] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:08:46.436119 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163c82c-4679-48a6-b0ff-239747c780b1 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:46.436119 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163c82c-4679-48a6-b0ff-239747c780b1 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:46.436119 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163c82c-4679-48a6-b0ff-239747c780b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:46.469062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-0163c82c-4679-48a6-b0ff-239747c780b1 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:46.470512 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0163c82c-4679-48a6-b0ff-239747c780b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:46.517050 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed371f47-341b-44a8-9c5a-66ecfb738b4d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:46.537269 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b05e70-f39b-4294-8fac-5d5e172ad67e tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92805ad8258743d49f79d4de7026d161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3908fe3487964b5fb7d977b580cbd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:46.538234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b05e70-f39b-4294-8fac-5d5e172ad67e tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:46.538710 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b05e70-f39b-4294-8fac-5d5e172ad67e tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:46.539154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b05e70-f39b-4294-8fac-5d5e172ad67e tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] PATH_INFO: `/v3/users/92805ad8258743d49f79d4de7026d161/access_rules` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:46.543697 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b05e70-f39b-4294-8fac-5d5e172ad67e tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] RBAC: Authorizing `identity:list_access_rules(user_id=92805ad8258743d49f79d4de7026d161)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:46.545529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b05e70-f39b-4294-8fac-5d5e172ad67e tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:46.562725 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2010/4062] 10.222.0.33 () {58 vars in 1260 bytes} [Sat Aug 6 21:08:46 2022] GET /identity/v3/users/92805ad8258743d49f79d4de7026d161/access_rules => generated 369 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:08:46.563699 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b05e70-f39b-4294-8fac-5d5e172ad67e tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:46.604887 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2053/4063] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:46.622625 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163c82c-4679-48a6-b0ff-239747c780b1 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:46.637958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163c82c-4679-48a6-b0ff-239747c780b1 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:46.645034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206d2b6-4617-46c0-8ecc-ca5a424b5b70 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92805ad8258743d49f79d4de7026d161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3908fe3487964b5fb7d977b580cbd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:46.646233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206d2b6-4617-46c0-8ecc-ca5a424b5b70 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:46.646748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206d2b6-4617-46c0-8ecc-ca5a424b5b70 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:46.646748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206d2b6-4617-46c0-8ecc-ca5a424b5b70 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] PATH_INFO: `/v3/users/92805ad8258743d49f79d4de7026d161/access_rules/eedd53be7b4143738826462441cca0fd` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:46.648772 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206d2b6-4617-46c0-8ecc-ca5a424b5b70 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] RBAC: Authorizing `identity:delete_access_rule(user_id=92805ad8258743d49f79d4de7026d161, access_rule_id=eedd53be7b4143738826462441cca0fd)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:46.650786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206d2b6-4617-46c0-8ecc-ca5a424b5b70 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:46.694325 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2054/4064] 10.222.0.33 () {58 vars in 1362 bytes} [Sat Aug 6 21:08:46 2022] DELETE /identity/v3/users/92805ad8258743d49f79d4de7026d161/access_rules/eedd53be7b4143738826462441cca0fd => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:46.699365 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206d2b6-4617-46c0-8ecc-ca5a424b5b70 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:46.705261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5206d2b6-4617-46c0-8ecc-ca5a424b5b70 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:46.761560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:46.777622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b05e70-f39b-4294-8fac-5d5e172ad67e tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:46.784547 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad14edc-940a-41d7-9883-ba074a7a153a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:46.785578 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad14edc-940a-41d7-9883-ba074a7a153a admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:46.785713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad14edc-940a-41d7-9883-ba074a7a153a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:46.786577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad14edc-940a-41d7-9883-ba074a7a153a admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:46.786789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad14edc-940a-41d7-9883-ba074a7a153a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:46.789058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad14edc-940a-41d7-9883-ba074a7a153a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:46.798922 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206d2b6-4617-46c0-8ecc-ca5a424b5b70 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:46.804527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c15701-1828-4cf9-92f2-17fbdd535f91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:46.805986 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c15701-1828-4cf9-92f2-17fbdd535f91 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:46.806537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c15701-1828-4cf9-92f2-17fbdd535f91 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:46.807079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c15701-1828-4cf9-92f2-17fbdd535f91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:46.820168 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c15701-1828-4cf9-92f2-17fbdd535f91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:46.821669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c15701-1828-4cf9-92f2-17fbdd535f91 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:46.827411 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2011/4065] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:08:46 2022] POST /identity/v3/projects => generated 403 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:08:46.828290 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad14edc-940a-41d7-9883-ba074a7a153a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:46.834481 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2055/4066] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:08:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:08:46.835449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c15701-1828-4cf9-92f2-17fbdd535f91 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:46.837368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a0c15701-1828-4cf9-92f2-17fbdd535f91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:46.855224 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c15701-1828-4cf9-92f2-17fbdd535f91 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:46.891073 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:46.905472 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad14edc-940a-41d7-9883-ba074a7a153a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:46.911641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a719636-8352-47f8-913f-9c7246935f60 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92805ad8258743d49f79d4de7026d161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3908fe3487964b5fb7d977b580cbd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:46.912578 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a719636-8352-47f8-913f-9c7246935f60 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:46.913169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a719636-8352-47f8-913f-9c7246935f60 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:46.913309 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a719636-8352-47f8-913f-9c7246935f60 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] PATH_INFO: `/v3/users/92805ad8258743d49f79d4de7026d161/access_rules` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:46.915044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a719636-8352-47f8-913f-9c7246935f60 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] RBAC: Authorizing `identity:list_access_rules(user_id=92805ad8258743d49f79d4de7026d161)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:46.916694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a719636-8352-47f8-913f-9c7246935f60 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:46.922014 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2012/4067] 10.222.0.33 () {58 vars in 1260 bytes} [Sat Aug 6 21:08:46 2022] GET /identity/v3/users/92805ad8258743d49f79d4de7026d161/access_rules => generated 158 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:08:46.922858 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a719636-8352-47f8-913f-9c7246935f60 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:46.932097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7de02d-257a-410a-93c5-8d042d665d5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:46.933208 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7de02d-257a-410a-93c5-8d042d665d5c service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:46.933744 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7de02d-257a-410a-93c5-8d042d665d5c service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:46.934586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7de02d-257a-410a-93c5-8d042d665d5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:46.937479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ca7de02d-257a-410a-93c5-8d042d665d5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:46.940751 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a719636-8352-47f8-913f-9c7246935f60 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:46.945994 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02ba14-20c0-4c44-82e2-925b4b884c94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:46.947062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02ba14-20c0-4c44-82e2-925b4b884c94 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:46.947284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02ba14-20c0-4c44-82e2-925b4b884c94 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:46.948191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02ba14-20c0-4c44-82e2-925b4b884c94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:46.949662 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-af02ba14-20c0-4c44-82e2-925b4b884c94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:47.030416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7de02d-257a-410a-93c5-8d042d665d5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:47.031920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7de02d-257a-410a-93c5-8d042d665d5c service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:47.047357 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2056/4068] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:08:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:08:47.050300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7de02d-257a-410a-93c5-8d042d665d5c service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:47.063045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7de02d-257a-410a-93c5-8d042d665d5c service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:47.064550 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af02ba14-20c0-4c44-82e2-925b4b884c94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:47.066677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af02ba14-20c0-4c44-82e2-925b4b884c94 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:47.069007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab012dd4-691e-40b1-87bf-9f0d4639d3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:47.069692 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab012dd4-691e-40b1-87bf-9f0d4639d3e8 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:47.070044 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab012dd4-691e-40b1-87bf-9f0d4639d3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:47.070409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab012dd4-691e-40b1-87bf-9f0d4639d3e8 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:47.071200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab012dd4-691e-40b1-87bf-9f0d4639d3e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:47.073271 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab012dd4-691e-40b1-87bf-9f0d4639d3e8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:47.099615 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2013/4069] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:08:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:08:47.100837 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02ba14-20c0-4c44-82e2-925b4b884c94 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:47.108019 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2057/4070] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:08:47 2022] POST /identity/v3/users => generated 302 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:08:47.109666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab012dd4-691e-40b1-87bf-9f0d4639d3e8 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:47.116490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02ba14-20c0-4c44-82e2-925b4b884c94 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:47.122738 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab012dd4-691e-40b1-87bf-9f0d4639d3e8 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:47.124250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117399fe-5489-4056-a955-68755c619ad5 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92805ad8258743d49f79d4de7026d161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3908fe3487964b5fb7d977b580cbd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:47.125561 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117399fe-5489-4056-a955-68755c619ad5 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:47.125854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117399fe-5489-4056-a955-68755c619ad5 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:47.126139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117399fe-5489-4056-a955-68755c619ad5 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] PATH_INFO: `/v3/users/92805ad8258743d49f79d4de7026d161/application_credentials` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:47.126839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117399fe-5489-4056-a955-68755c619ad5 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] RBAC: Authorizing `identity:create_application_credential(user_id=92805ad8258743d49f79d4de7026d161)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:47.129505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe98a6-9864-4a00-8269-679eb13f8dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:47.130322 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe98a6-9864-4a00-8269-679eb13f8dde admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:47.131356 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe98a6-9864-4a00-8269-679eb13f8dde admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:47.131807 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe98a6-9864-4a00-8269-679eb13f8dde admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:47.132113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117399fe-5489-4056-a955-68755c619ad5 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:47.132868 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe98a6-9864-4a00-8269-679eb13f8dde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:47.135910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe98a6-9864-4a00-8269-679eb13f8dde admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:47.165654 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2058/4071] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:08:47.167305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe98a6-9864-4a00-8269-679eb13f8dde admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:47.183030 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe98a6-9864-4a00-8269-679eb13f8dde admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:47.188819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fe957-c7f5-4d91-bb1a-9ca7dd8135a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:47.190187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fe957-c7f5-4d91-bb1a-9ca7dd8135a7 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:47.190525 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fe957-c7f5-4d91-bb1a-9ca7dd8135a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:47.191350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fe957-c7f5-4d91-bb1a-9ca7dd8135a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:47.192642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850fe957-c7f5-4d91-bb1a-9ca7dd8135a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:47.202946 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850fe957-c7f5-4d91-bb1a-9ca7dd8135a7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:47.222086 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2059/4072] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:08:47.222086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fe957-c7f5-4d91-bb1a-9ca7dd8135a7 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:47.232909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fe957-c7f5-4d91-bb1a-9ca7dd8135a7 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:47.238694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c78fab-6ff7-4468-ab4d-36de8d8916e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:47.239459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c78fab-6ff7-4468-ab4d-36de8d8916e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:47.239898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c78fab-6ff7-4468-ab4d-36de8d8916e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:47.240864 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c78fab-6ff7-4468-ab4d-36de8d8916e4 admin admin] PATH_INFO: `/v3/projects/9ed8f9cbedd14527bb98ac545eaf70d8/users/c3601924229d4254817f827b64c9380e/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:47.266976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c78fab-6ff7-4468-ab4d-36de8d8916e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ed8f9cbedd14527bb98ac545eaf70d8, user_id=c3601924229d4254817f827b64c9380e, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:47.272029 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c78fab-6ff7-4468-ab4d-36de8d8916e4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:47.312068 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2060/4073] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:08:47 2022] PUT /identity/v3/projects/9ed8f9cbedd14527bb98ac545eaf70d8/users/c3601924229d4254817f827b64c9380e/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:47.323238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333519e8-372f-47e9-99e1-313badce9937 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:47.324762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333519e8-372f-47e9-99e1-313badce9937 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:47.324762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333519e8-372f-47e9-99e1-313badce9937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:47.334816 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2014/4074] 10.222.0.33 () {60 vars in 1315 bytes} [Sat Aug 6 21:08:47 2022] POST /identity/v3/users/92805ad8258743d49f79d4de7026d161/application_credentials => generated 921 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:08:47.339930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117399fe-5489-4056-a955-68755c619ad5 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:47.360050 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117399fe-5489-4056-a955-68755c619ad5 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:47.377515 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-333519e8-372f-47e9-99e1-313badce9937 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:47.378671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-333519e8-372f-47e9-99e1-313badce9937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:47.392554 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:47.468307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:47.478503 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2061/4075] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:47.478739 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b37ddd-c4a0-4807-8ac5-f4156ea54b2f tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92805ad8258743d49f79d4de7026d161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3908fe3487964b5fb7d977b580cbd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:47.479521 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b37ddd-c4a0-4807-8ac5-f4156ea54b2f tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:47.479521 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b37ddd-c4a0-4807-8ac5-f4156ea54b2f tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:47.479787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b37ddd-c4a0-4807-8ac5-f4156ea54b2f tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] PATH_INFO: `/v3/users/92805ad8258743d49f79d4de7026d161/access_rules` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:47.481256 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b37ddd-c4a0-4807-8ac5-f4156ea54b2f tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] RBAC: Authorizing `identity:list_access_rules(user_id=92805ad8258743d49f79d4de7026d161)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:47.482983 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b37ddd-c4a0-4807-8ac5-f4156ea54b2f tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:47.490419 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2015/4076] 10.222.0.33 () {58 vars in 1260 bytes} [Sat Aug 6 21:08:47 2022] GET /identity/v3/users/92805ad8258743d49f79d4de7026d161/access_rules => generated 369 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:08:47.496609 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b37ddd-c4a0-4807-8ac5-f4156ea54b2f tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:47.497214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333519e8-372f-47e9-99e1-313badce9937 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:47.511052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b37ddd-c4a0-4807-8ac5-f4156ea54b2f tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:47.518000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dbda0e-cb30-462d-8632-936f3b7c6698 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92805ad8258743d49f79d4de7026d161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3908fe3487964b5fb7d977b580cbd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:47.518905 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbda0e-cb30-462d-8632-936f3b7c6698 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:47.519192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbda0e-cb30-462d-8632-936f3b7c6698 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:47.519469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbda0e-cb30-462d-8632-936f3b7c6698 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] PATH_INFO: `/v3/users/92805ad8258743d49f79d4de7026d161/application_credentials` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:47.520849 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dbda0e-cb30-462d-8632-936f3b7c6698 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] RBAC: Authorizing `identity:create_application_credential(user_id=92805ad8258743d49f79d4de7026d161)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:47.522448 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dbda0e-cb30-462d-8632-936f3b7c6698 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:47.606296 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333519e8-372f-47e9-99e1-313badce9937 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:47.612043 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7b844-26c4-4e82-8647-68414422e3af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:47.612879 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7b844-26c4-4e82-8647-68414422e3af service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:47.613607 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7b844-26c4-4e82-8647-68414422e3af service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:47.613999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7b844-26c4-4e82-8647-68414422e3af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:47.627185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7b844-26c4-4e82-8647-68414422e3af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:47.629302 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7b844-26c4-4e82-8647-68414422e3af service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:47.646351 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2062/4077] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:08:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:08:47.670681 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2016/4078] 10.222.0.33 () {60 vars in 1315 bytes} [Sat Aug 6 21:08:47 2022] POST /identity/v3/users/92805ad8258743d49f79d4de7026d161/application_credentials => generated 921 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:08:47.674972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7b844-26c4-4e82-8647-68414422e3af service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:47.715388 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7b844-26c4-4e82-8647-68414422e3af service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:47.722462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982bae1-3268-4044-b60e-c0f539d18ef4 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92805ad8258743d49f79d4de7026d161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3908fe3487964b5fb7d977b580cbd8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:47.724652 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982bae1-3268-4044-b60e-c0f539d18ef4 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:47.724855 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982bae1-3268-4044-b60e-c0f539d18ef4 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:47.725366 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982bae1-3268-4044-b60e-c0f539d18ef4 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] PATH_INFO: `/v3/users/92805ad8258743d49f79d4de7026d161/access_rules/a1b4a64774774501bca5e366c8ab1fb0` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:47.727436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982bae1-3268-4044-b60e-c0f539d18ef4 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] RBAC: Authorizing `identity:get_access_rule(user_id=92805ad8258743d49f79d4de7026d161, access_rule_id=a1b4a64774774501bca5e366c8ab1fb0)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:47.728991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982bae1-3268-4044-b60e-c0f539d18ef4 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:47.752814 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2063/4079] 10.222.0.33 () {58 vars in 1359 bytes} [Sat Aug 6 21:08:47 2022] GET /identity/v3/users/92805ad8258743d49f79d4de7026d161/access_rules/a1b4a64774774501bca5e366c8ab1fb0 => generated 229 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:08:47.756485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dbda0e-cb30-462d-8632-936f3b7c6698 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:47.758864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-29dbda0e-cb30-462d-8632-936f3b7c6698 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:47.794020 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dbda0e-cb30-462d-8632-936f3b7c6698 tempest-AccessRulesV3Test-854756831 tempest-AccessRulesV3Test-854756831-project] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:47.806956 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf55c6-6adc-422c-84c1-d3728a8329f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:47.809004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf55c6-6adc-422c-84c1-d3728a8329f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:47.809537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf55c6-6adc-422c-84c1-d3728a8329f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:47.810040 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf55c6-6adc-422c-84c1-d3728a8329f2 admin admin] PATH_INFO: `/v3/users/92805ad8258743d49f79d4de7026d161` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:47.812712 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf55c6-6adc-422c-84c1-d3728a8329f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92805ad8258743d49f79d4de7026d161)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:47.821590 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf55c6-6adc-422c-84c1-d3728a8329f2 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:47.907150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-efdf55c6-6adc-422c-84c1-d3728a8329f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92805ad8258743d49f79d4de7026d161'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:47.907812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-efdf55c6-6adc-422c-84c1-d3728a8329f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92805ad8258743d49f79d4de7026d161'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:47.908423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-efdf55c6-6adc-422c-84c1-d3728a8329f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92805ad8258743d49f79d4de7026d161'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:47.918970 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-efdf55c6-6adc-422c-84c1-d3728a8329f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92805ad8258743d49f79d4de7026d161'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:47.985734 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-efdf55c6-6adc-422c-84c1-d3728a8329f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92805ad8258743d49f79d4de7026d161'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:48.003433 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2017/4080] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:08:47 2022] DELETE /identity/v3/users/92805ad8258743d49f79d4de7026d161 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:08:48.008851 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29055993-7371-4a18-a99a-86a63fe02dbb None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:48.009385 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29055993-7371-4a18-a99a-86a63fe02dbb None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:48.009835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29055993-7371-4a18-a99a-86a63fe02dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:48.034039 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-29055993-7371-4a18-a99a-86a63fe02dbb None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:48.036203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-29055993-7371-4a18-a99a-86a63fe02dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:48.127298 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2064/4081] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:48.137878 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf55c6-6adc-422c-84c1-d3728a8329f2 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:48.140430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-efdf55c6-6adc-422c-84c1-d3728a8329f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:48.204695 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:48.279870 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf55c6-6adc-422c-84c1-d3728a8329f2 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:48.290385 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f542edf-5d20-4f4a-944c-4990ab30e39c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:48.294135 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f542edf-5d20-4f4a-944c-4990ab30e39c service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:48.294583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f542edf-5d20-4f4a-944c-4990ab30e39c service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:48.294861 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f542edf-5d20-4f4a-944c-4990ab30e39c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:48.320772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f542edf-5d20-4f4a-944c-4990ab30e39c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:48.322570 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f542edf-5d20-4f4a-944c-4990ab30e39c service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:48.336036 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2018/4082] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:08:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:08:49.287712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29055993-7371-4a18-a99a-86a63fe02dbb None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:49.311171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29055993-7371-4a18-a99a-86a63fe02dbb None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:49.318970 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae56449-2c1e-4155-9d57-ec1b0f397c99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:49.320086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae56449-2c1e-4155-9d57-ec1b0f397c99 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:49.320365 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae56449-2c1e-4155-9d57-ec1b0f397c99 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:49.320636 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae56449-2c1e-4155-9d57-ec1b0f397c99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:49.323370 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3ae56449-2c1e-4155-9d57-ec1b0f397c99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:49.402987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:49.438437 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae56449-2c1e-4155-9d57-ec1b0f397c99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:49.440996 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae56449-2c1e-4155-9d57-ec1b0f397c99 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:49.463132 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2065/4083] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:08:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:08:49.543835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f542edf-5d20-4f4a-944c-4990ab30e39c service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:49.544991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3f542edf-5d20-4f4a-944c-4990ab30e39c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:49.566331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f542edf-5d20-4f4a-944c-4990ab30e39c service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:49.577680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a9664-b699-4fe3-b6ae-2090c7c21616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:49.579482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a9664-b699-4fe3-b6ae-2090c7c21616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:49.580201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a9664-b699-4fe3-b6ae-2090c7c21616 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:49.580805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a9664-b699-4fe3-b6ae-2090c7c21616 admin admin] PATH_INFO: `/v3/projects/3908fe3487964b5fb7d977b580cbd8fb` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:49.600781 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a9664-b699-4fe3-b6ae-2090c7c21616 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3908fe3487964b5fb7d977b580cbd8fb)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:49.606360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a9664-b699-4fe3-b6ae-2090c7c21616 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:49.745738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-517a9664-b699-4fe3-b6ae-2090c7c21616 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3908fe3487964b5fb7d977b580cbd8fb', 'request_id': 'req-517a9664-b699-4fe3-b6ae-2090c7c21616'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:49.758147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-517a9664-b699-4fe3-b6ae-2090c7c21616 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3908fe3487964b5fb7d977b580cbd8fb', 'request_id': 'req-517a9664-b699-4fe3-b6ae-2090c7c21616'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:49.772108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-517a9664-b699-4fe3-b6ae-2090c7c21616 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3908fe3487964b5fb7d977b580cbd8fb', 'request_id': 'req-517a9664-b699-4fe3-b6ae-2090c7c21616'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:49.803265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-517a9664-b699-4fe3-b6ae-2090c7c21616 admin admin] The token cache is being invalidate because project 3908fe3487964b5fb7d977b580cbd8fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:08:49.803862 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-517a9664-b699-4fe3-b6ae-2090c7c21616 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:49.807314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-517a9664-b699-4fe3-b6ae-2090c7c21616 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:49.813327 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2019/4084] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:08:49 2022] DELETE /identity/v3/projects/3908fe3487964b5fb7d977b580cbd8fb => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:49.815462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d43b4-c825-4c5a-b602-9ebdaa5dd820 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:49.815752 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d43b4-c825-4c5a-b602-9ebdaa5dd820 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:49.816023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d43b4-c825-4c5a-b602-9ebdaa5dd820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:49.861779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b00d43b4-c825-4c5a-b602-9ebdaa5dd820 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:49.870820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b00d43b4-c825-4c5a-b602-9ebdaa5dd820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:50.054319 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2066/4085] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:50.062702 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6903fa8-49ad-4b12-ae75-eea24a86819d None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:50.062989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6903fa8-49ad-4b12-ae75-eea24a86819d None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:50.063565 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6903fa8-49ad-4b12-ae75-eea24a86819d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:50.094210 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f6903fa8-49ad-4b12-ae75-eea24a86819d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:50.095522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f6903fa8-49ad-4b12-ae75-eea24a86819d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:50.109245 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d43b4-c825-4c5a-b602-9ebdaa5dd820 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:50.110135 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2020/4086] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:50.121490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d43b4-c825-4c5a-b602-9ebdaa5dd820 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:50.173774 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbe53c-92b3-4894-ae73-ecf6e351afb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:50.174722 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbe53c-92b3-4894-ae73-ecf6e351afb7 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:50.175173 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbe53c-92b3-4894-ae73-ecf6e351afb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:50.175609 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbe53c-92b3-4894-ae73-ecf6e351afb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:50.177247 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afbe53c-92b3-4894-ae73-ecf6e351afb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:08:50.177782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afbe53c-92b3-4894-ae73-ecf6e351afb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:50.179722 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afbe53c-92b3-4894-ae73-ecf6e351afb7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:50.196195 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2067/4087] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:08:50.202160 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6903fa8-49ad-4b12-ae75-eea24a86819d None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:50.216297 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6903fa8-49ad-4b12-ae75-eea24a86819d None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:50.227230 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506f795-67fc-452b-9b40-18ed50e569f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:50.228350 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506f795-67fc-452b-9b40-18ed50e569f4 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:50.228681 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506f795-67fc-452b-9b40-18ed50e569f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:50.229070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506f795-67fc-452b-9b40-18ed50e569f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:50.229873 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506f795-67fc-452b-9b40-18ed50e569f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:50.232409 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506f795-67fc-452b-9b40-18ed50e569f4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:50.308369 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbe53c-92b3-4894-ae73-ecf6e351afb7 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:50.320717 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2021/4088] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:08:50 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:08:50.324177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbe53c-92b3-4894-ae73-ecf6e351afb7 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:50.403636 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd93e50-39c1-41c7-b60e-4f1cc3c96319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:50.405265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd93e50-39c1-41c7-b60e-4f1cc3c96319 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:50.405705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd93e50-39c1-41c7-b60e-4f1cc3c96319 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:50.406339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd93e50-39c1-41c7-b60e-4f1cc3c96319 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:50.407266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd93e50-39c1-41c7-b60e-4f1cc3c96319 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:50.409497 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd93e50-39c1-41c7-b60e-4f1cc3c96319 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:50.464084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506f795-67fc-452b-9b40-18ed50e569f4 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:50.464371 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2068/4089] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:08:50 2022] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:08:50.484036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506f795-67fc-452b-9b40-18ed50e569f4 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:50.498166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b87ba2-0c4b-42db-95c0-619271e598f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:50.501381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b87ba2-0c4b-42db-95c0-619271e598f0 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:50.501728 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b87ba2-0c4b-42db-95c0-619271e598f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:50.502007 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b87ba2-0c4b-42db-95c0-619271e598f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:50.504240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b87ba2-0c4b-42db-95c0-619271e598f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:50.507576 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b87ba2-0c4b-42db-95c0-619271e598f0 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:50.521252 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2022/4090] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:08:50.525800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd93e50-39c1-41c7-b60e-4f1cc3c96319 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:50.539115 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd93e50-39c1-41c7-b60e-4f1cc3c96319 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:50.545432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d57bd-3a9e-441b-942a-e4ef96fcc7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:50.546174 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d57bd-3a9e-441b-942a-e4ef96fcc7fa admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:50.546531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d57bd-3a9e-441b-942a-e4ef96fcc7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:50.546864 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d57bd-3a9e-441b-942a-e4ef96fcc7fa admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:50.548121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65d57bd-3a9e-441b-942a-e4ef96fcc7fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:50.549190 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65d57bd-3a9e-441b-942a-e4ef96fcc7fa admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:50.569290 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2069/4091] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:08:50.570325 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b87ba2-0c4b-42db-95c0-619271e598f0 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:50.597173 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b87ba2-0c4b-42db-95c0-619271e598f0 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:50.612876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2a916-3d82-4c27-ac4f-342372d9336b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:50.616266 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2a916-3d82-4c27-ac4f-342372d9336b admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:50.616904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2a916-3d82-4c27-ac4f-342372d9336b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:50.617419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2a916-3d82-4c27-ac4f-342372d9336b admin admin] PATH_INFO: `/v3/projects/0a565926e51d490c884c3a8774c1932a/users/58c234d2dd3d4b52a53220ec5f716cd7/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:50.681783 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2a916-3d82-4c27-ac4f-342372d9336b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a565926e51d490c884c3a8774c1932a, user_id=58c234d2dd3d4b52a53220ec5f716cd7, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:50.684843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2a916-3d82-4c27-ac4f-342372d9336b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:50.719984 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2023/4092] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:08:50 2022] PUT /identity/v3/projects/0a565926e51d490c884c3a8774c1932a/users/58c234d2dd3d4b52a53220ec5f716cd7/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:08:50.732261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6794e36-1b71-46d7-a5e0-1015e7fdfcfb None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:50.732679 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6794e36-1b71-46d7-a5e0-1015e7fdfcfb None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:50.733136 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6794e36-1b71-46d7-a5e0-1015e7fdfcfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:50.792963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b6794e36-1b71-46d7-a5e0-1015e7fdfcfb None None] MFA Rules not processed for user `58c234d2dd3d4b52a53220ec5f716cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:50.795203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b6794e36-1b71-46d7-a5e0-1015e7fdfcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:50.937861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:51.041237 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2070/4093] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:51.042359 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2a916-3d82-4c27-ac4f-342372d9336b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:51.064638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2a916-3d82-4c27-ac4f-342372d9336b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:51.069859 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec7b6d-2207-41d2-90ca-926b2cf98fc3 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c234d2dd3d4b52a53220ec5f716cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a565926e51d490c884c3a8774c1932a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:51.070518 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec7b6d-2207-41d2-90ca-926b2cf98fc3 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:51.070839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec7b6d-2207-41d2-90ca-926b2cf98fc3 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:51.071128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec7b6d-2207-41d2-90ca-926b2cf98fc3 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] PATH_INFO: `/v3/users/58c234d2dd3d4b52a53220ec5f716cd7/password` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:51.169324 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fbec7b6d-2207-41d2-90ca-926b2cf98fc3 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '58c234d2dd3d4b52a53220ec5f716cd7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:51.185253 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2024/4094] 10.222.0.33 () {60 vars in 1269 bytes} [Sat Aug 6 21:08:51 2022] POST /identity/v3/users/58c234d2dd3d4b52a53220ec5f716cd7/password => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:52.191999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffa196-81db-4051-be3b-9c15fe3ba454 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:52.193161 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffa196-81db-4051-be3b-9c15fe3ba454 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:52.193618 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffa196-81db-4051-be3b-9c15fe3ba454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:52.215718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-daffa196-81db-4051-be3b-9c15fe3ba454 None None] MFA Rules not processed for user `58c234d2dd3d4b52a53220ec5f716cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:52.216935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-daffa196-81db-4051-be3b-9c15fe3ba454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:52.221656 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2071/4095] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:52 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 21:08:52.226959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237388bf-d8ce-4159-b4dc-29c3fc1179f4 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:52.227870 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237388bf-d8ce-4159-b4dc-29c3fc1179f4 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:52.228128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237388bf-d8ce-4159-b4dc-29c3fc1179f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:52.252501 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-237388bf-d8ce-4159-b4dc-29c3fc1179f4 None None] MFA Rules not processed for user `58c234d2dd3d4b52a53220ec5f716cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:52.253730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-237388bf-d8ce-4159-b4dc-29c3fc1179f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:52.262390 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2025/4096] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:52.274050 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffa196-81db-4051-be3b-9c15fe3ba454 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:52.300825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffa196-81db-4051-be3b-9c15fe3ba454 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:52.310046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3708e2-8163-420c-b493-b3a0517f087d tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c234d2dd3d4b52a53220ec5f716cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a565926e51d490c884c3a8774c1932a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:52.310939 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3708e2-8163-420c-b493-b3a0517f087d tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:52.315934 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3708e2-8163-420c-b493-b3a0517f087d tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:52.317008 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3708e2-8163-420c-b493-b3a0517f087d tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] PATH_INFO: `/v3/users/58c234d2dd3d4b52a53220ec5f716cd7/password` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:52.424517 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-7f3708e2-8163-420c-b493-b3a0517f087d tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 06 21:08:52.424517 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:08:52.424517 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:08:52.424517 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:08:52.424517 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:08:52.424517 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:08:52.424517 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:08:52.424517 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:08:52.424517 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:08:52.424517 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:08:52.424517 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:08:52.424517 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:08:52.424517 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 06 21:08:52.425709 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 06 21:08:52.425709 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Aug 06 21:08:52.425709 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Aug 06 21:08:52.425709 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:08:52.425709 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:08:52.425709 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 21:08:52.425709 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 21:08:52.425709 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Aug 06 21:08:52.425709 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Aug 06 21:08:52.425709 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Aug 06 21:08:52.425709 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Aug 06 21:08:52.425709 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Aug 06 21:08:52.425709 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Aug 06 21:08:52.425709 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 06 21:08:52.425709 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:08:52.449668 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2072/4097] 10.222.0.33 () {60 vars in 1269 bytes} [Sat Aug 6 21:08:52 2022] POST /identity/v3/users/58c234d2dd3d4b52a53220ec5f716cd7/password => generated 188 bytes in 183 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 06 21:08:52.453099 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237388bf-d8ce-4159-b4dc-29c3fc1179f4 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:52.468682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237388bf-d8ce-4159-b4dc-29c3fc1179f4 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:52.478497 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ff789-3843-4a0d-b35b-da0075a97850 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c234d2dd3d4b52a53220ec5f716cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a565926e51d490c884c3a8774c1932a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:52.479538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ff789-3843-4a0d-b35b-da0075a97850 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:52.480047 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ff789-3843-4a0d-b35b-da0075a97850 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:52.480553 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ff789-3843-4a0d-b35b-da0075a97850 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] PATH_INFO: `/v3/users/58c234d2dd3d4b52a53220ec5f716cd7/password` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:52.553274 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=86,keystone:DELETE=8,keystone:INSERT=5,keystone:UPDATE=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:52.621687 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-405ff789-3843-4a0d-b35b-da0075a97850 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 06 21:08:52.621687 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:08:52.621687 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:08:52.621687 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:08:52.621687 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:08:52.621687 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:08:52.621687 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:08:52.621687 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:08:52.621687 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:08:52.621687 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:08:52.621687 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:08:52.621687 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:08:52.621687 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 06 21:08:52.623094 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 06 21:08:52.623094 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Aug 06 21:08:52.623094 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Aug 06 21:08:52.623094 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:08:52.623094 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:08:52.623094 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 21:08:52.623094 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 21:08:52.623094 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Aug 06 21:08:52.623094 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Aug 06 21:08:52.623094 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Aug 06 21:08:52.623094 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Aug 06 21:08:52.623094 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Aug 06 21:08:52.623094 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Aug 06 21:08:52.623094 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 06 21:08:52.623094 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:08:52.638815 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2026/4098] 10.222.0.33 () {60 vars in 1269 bytes} [Sat Aug 6 21:08:52 2022] POST /identity/v3/users/58c234d2dd3d4b52a53220ec5f716cd7/password => generated 188 bytes in 186 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 06 21:08:52.639540 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3708e2-8163-420c-b493-b3a0517f087d tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:52.654413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3708e2-8163-420c-b493-b3a0517f087d tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:52.683834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e0651c-36b5-4c95-a31a-37e4e3be169f tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c234d2dd3d4b52a53220ec5f716cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a565926e51d490c884c3a8774c1932a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:52.685249 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0651c-36b5-4c95-a31a-37e4e3be169f tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:52.685703 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0651c-36b5-4c95-a31a-37e4e3be169f tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:52.686140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0651c-36b5-4c95-a31a-37e4e3be169f tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] PATH_INFO: `/v3/users/58c234d2dd3d4b52a53220ec5f716cd7/password` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:52.793298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-47e0651c-36b5-4c95-a31a-37e4e3be169f tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '58c234d2dd3d4b52a53220ec5f716cd7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:52.819972 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2073/4099] 10.222.0.33 () {60 vars in 1269 bytes} [Sat Aug 6 21:08:52 2022] POST /identity/v3/users/58c234d2dd3d4b52a53220ec5f716cd7/password => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:08:53.441866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ff789-3843-4a0d-b35b-da0075a97850 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:53.443724 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-405ff789-3843-4a0d-b35b-da0075a97850 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:53.702538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ff789-3843-4a0d-b35b-da0075a97850 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:53.716768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c80eb-4f09-4c88-9716-a0d7bedf5e0c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:53.717773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c80eb-4f09-4c88-9716-a0d7bedf5e0c service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:53.718765 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c80eb-4f09-4c88-9716-a0d7bedf5e0c service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:53.719235 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c80eb-4f09-4c88-9716-a0d7bedf5e0c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:53.722946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ca1c80eb-4f09-4c88-9716-a0d7bedf5e0c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:53.747892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c80eb-4f09-4c88-9716-a0d7bedf5e0c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:53.749743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c80eb-4f09-4c88-9716-a0d7bedf5e0c service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:53.792977 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2027/4100] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:08:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:08:53.826000 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea111d8a-e126-4136-8740-b6cbade9aa74 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:53.831521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea111d8a-e126-4136-8740-b6cbade9aa74 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:53.831521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea111d8a-e126-4136-8740-b6cbade9aa74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:53.883448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-ea111d8a-e126-4136-8740-b6cbade9aa74 None None] MFA Rules not processed for user `58c234d2dd3d4b52a53220ec5f716cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:53.884986 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ea111d8a-e126-4136-8740-b6cbade9aa74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:53.898530 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2074/4101] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:53 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 21:08:53.900386 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c71f07-d038-4bf2-b209-04a0ce6facd5 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:53.900850 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c71f07-d038-4bf2-b209-04a0ce6facd5 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:53.901125 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c71f07-d038-4bf2-b209-04a0ce6facd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:53.974919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-95c71f07-d038-4bf2-b209-04a0ce6facd5 None None] MFA Rules not processed for user `58c234d2dd3d4b52a53220ec5f716cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:53.976627 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-95c71f07-d038-4bf2-b209-04a0ce6facd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:54.014704 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2028/4102] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:54.015468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea111d8a-e126-4136-8740-b6cbade9aa74 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:54.048381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea111d8a-e126-4136-8740-b6cbade9aa74 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:54.063247 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbb948-652c-4bf6-94d3-affcf7a195c3 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c234d2dd3d4b52a53220ec5f716cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a565926e51d490c884c3a8774c1932a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:54.064682 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbb948-652c-4bf6-94d3-affcf7a195c3 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:54.065227 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbb948-652c-4bf6-94d3-affcf7a195c3 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:54.065666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbb948-652c-4bf6-94d3-affcf7a195c3 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] PATH_INFO: `/v3/users/58c234d2dd3d4b52a53220ec5f716cd7/password` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:54.141456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4afbb948-652c-4bf6-94d3-affcf7a195c3 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '58c234d2dd3d4b52a53220ec5f716cd7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:54.159312 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2075/4103] 10.222.0.33 () {60 vars in 1269 bytes} [Sat Aug 6 21:08:54 2022] POST /identity/v3/users/58c234d2dd3d4b52a53220ec5f716cd7/password => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:55.164183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5996c4b-032d-4ff7-983a-ef3d5adb6331 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:55.164715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5996c4b-032d-4ff7-983a-ef3d5adb6331 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:55.165185 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5996c4b-032d-4ff7-983a-ef3d5adb6331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:55.215068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-c5996c4b-032d-4ff7-983a-ef3d5adb6331 None None] MFA Rules not processed for user `58c234d2dd3d4b52a53220ec5f716cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:55.217038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c5996c4b-032d-4ff7-983a-ef3d5adb6331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:55.227165 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2029/4104] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:55 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 21:08:55.232506 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856551a-b17f-49d1-9241-3f53259460f6 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:55.233657 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856551a-b17f-49d1-9241-3f53259460f6 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:55.234100 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856551a-b17f-49d1-9241-3f53259460f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:55.258839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-f856551a-b17f-49d1-9241-3f53259460f6 None None] MFA Rules not processed for user `58c234d2dd3d4b52a53220ec5f716cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:55.260354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f856551a-b17f-49d1-9241-3f53259460f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:55.291028 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2076/4105] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:55.294301 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5996c4b-032d-4ff7-983a-ef3d5adb6331 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:55.319734 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5996c4b-032d-4ff7-983a-ef3d5adb6331 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:55.330161 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4005f-481a-465f-8055-5323ea558b60 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c234d2dd3d4b52a53220ec5f716cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a565926e51d490c884c3a8774c1932a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:55.333916 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4005f-481a-465f-8055-5323ea558b60 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:55.334740 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4005f-481a-465f-8055-5323ea558b60 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:55.338943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4005f-481a-465f-8055-5323ea558b60 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] PATH_INFO: `/v3/users/58c234d2dd3d4b52a53220ec5f716cd7/password` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:55.458789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-02e4005f-481a-465f-8055-5323ea558b60 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '58c234d2dd3d4b52a53220ec5f716cd7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:55.478086 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2030/4106] 10.222.0.33 () {60 vars in 1269 bytes} [Sat Aug 6 21:08:55 2022] POST /identity/v3/users/58c234d2dd3d4b52a53220ec5f716cd7/password => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:56.483507 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28373637-19dd-42c5-8a3e-cf77d267dd06 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:56.486477 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28373637-19dd-42c5-8a3e-cf77d267dd06 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:56.486477 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28373637-19dd-42c5-8a3e-cf77d267dd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:56.520823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-28373637-19dd-42c5-8a3e-cf77d267dd06 None None] MFA Rules not processed for user `58c234d2dd3d4b52a53220ec5f716cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:56.524624 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-28373637-19dd-42c5-8a3e-cf77d267dd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:56.548049 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2077/4107] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:56 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 21:08:56.553255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485baf3-7449-463d-afef-e8a4d72471ed None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:56.554224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485baf3-7449-463d-afef-e8a4d72471ed None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:56.554738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485baf3-7449-463d-afef-e8a4d72471ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:56.606024 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-3485baf3-7449-463d-afef-e8a4d72471ed None None] MFA Rules not processed for user `58c234d2dd3d4b52a53220ec5f716cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:56.611043 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3485baf3-7449-463d-afef-e8a4d72471ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:56.630461 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2031/4108] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:56.636041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28373637-19dd-42c5-8a3e-cf77d267dd06 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:56.651538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28373637-19dd-42c5-8a3e-cf77d267dd06 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:56.657137 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d4840-da47-42b0-8ccc-43d9426dec7c tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c234d2dd3d4b52a53220ec5f716cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a565926e51d490c884c3a8774c1932a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:56.658068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d4840-da47-42b0-8ccc-43d9426dec7c tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:56.658516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d4840-da47-42b0-8ccc-43d9426dec7c tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:56.659133 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d4840-da47-42b0-8ccc-43d9426dec7c tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] PATH_INFO: `/v3/users/58c234d2dd3d4b52a53220ec5f716cd7/password` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:56.731325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b39d4840-da47-42b0-8ccc-43d9426dec7c tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '58c234d2dd3d4b52a53220ec5f716cd7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:08:56.765171 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2078/4109] 10.222.0.33 () {60 vars in 1269 bytes} [Sat Aug 6 21:08:56 2022] POST /identity/v3/users/58c234d2dd3d4b52a53220ec5f716cd7/password => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:08:57.772821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475c684-b414-4f2b-a2bf-3403c1d319f3 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:57.774110 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475c684-b414-4f2b-a2bf-3403c1d319f3 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:57.776825 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475c684-b414-4f2b-a2bf-3403c1d319f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:57.835931 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-6475c684-b414-4f2b-a2bf-3403c1d319f3 None None] MFA Rules not processed for user `58c234d2dd3d4b52a53220ec5f716cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:57.839181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6475c684-b414-4f2b-a2bf-3403c1d319f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:57.855073 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2032/4110] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:57 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 21:08:58.047550 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cd741-93d1-41dd-b494-3424b297a533 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:58.048138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cd741-93d1-41dd-b494-3424b297a533 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:58.048357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cd741-93d1-41dd-b494-3424b297a533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:58.077398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-070cd741-93d1-41dd-b494-3424b297a533 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:58.079074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-070cd741-93d1-41dd-b494-3424b297a533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:58.146371 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=86,keystone:UPDATE=3,keystone:INSERT=6,keystone:DELETE=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:58.186888 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2079/4111] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:08:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:58.208084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475c684-b414-4f2b-a2bf-3403c1d319f3 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:08:58.209692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6475c684-b414-4f2b-a2bf-3403c1d319f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:58.371084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475c684-b414-4f2b-a2bf-3403c1d319f3 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:08:58.388068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfa249-e329-41f0-a818-01a2123eb9d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:08:58.390399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfa249-e329-41f0-a818-01a2123eb9d4 service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:58.390399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfa249-e329-41f0-a818-01a2123eb9d4 service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:58.390399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfa249-e329-41f0-a818-01a2123eb9d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:58.419783 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccfa249-e329-41f0-a818-01a2123eb9d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:08:58.430137 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccfa249-e329-41f0-a818-01a2123eb9d4 service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:08:58.447180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:58.463977 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2033/4112] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:08:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 06 21:08:58.858134 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a888a13-7a25-468e-a2c6-fd4cee0ea5be None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:58.858853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a888a13-7a25-468e-a2c6-fd4cee0ea5be None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:58.859300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a888a13-7a25-468e-a2c6-fd4cee0ea5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:58.946818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-0a888a13-7a25-468e-a2c6-fd4cee0ea5be None None] MFA Rules not processed for user `58c234d2dd3d4b52a53220ec5f716cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:58.948872 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0a888a13-7a25-468e-a2c6-fd4cee0ea5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:58.990679 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46d102-8441-46ce-a867-e203be132e31 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:58.991814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46d102-8441-46ce-a867-e203be132e31 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:58.992752 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46d102-8441-46ce-a867-e203be132e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:58.993418 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2080/4113] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:08:59.077670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-9f46d102-8441-46ce-a867-e203be132e31 None None] MFA Rules not processed for user `58c234d2dd3d4b52a53220ec5f716cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:59.091013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9f46d102-8441-46ce-a867-e203be132e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:08:59.101632 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2034/4114] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:58 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 21:08:59.107168 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c28c30-f2f5-4f4c-b5a0-318676255f3d None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:59.107733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c28c30-f2f5-4f4c-b5a0-318676255f3d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:59.109634 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c28c30-f2f5-4f4c-b5a0-318676255f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:59.254528 ncdv-master-1 devstack@keystone.service[102759]: WARNING keystone.server.flask.application [None req-22c28c30-f2f5-4f4c-b5a0-318676255f3d None None] Authorization failed. The request you have made requires authentication. from 10.222.0.33: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 06 21:08:59.257648 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2081/4115] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:59 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 152 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 06 21:08:59.263700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235a214-3320-4cea-a59c-a975fca0db22 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:59.264773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235a214-3320-4cea-a59c-a975fca0db22 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:59.265511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235a214-3320-4cea-a59c-a975fca0db22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:59.388530 ncdv-master-1 devstack@keystone.service[102758]: WARNING keystone.server.flask.application [None req-1235a214-3320-4cea-a59c-a975fca0db22 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.33: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 06 21:08:59.390804 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2035/4116] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:59 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 129 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 06 21:08:59.399586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5b6c5-6d33-4fc3-b726-8b579b1d5d45 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:59.400622 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5b6c5-6d33-4fc3-b726-8b579b1d5d45 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:59.401420 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5b6c5-6d33-4fc3-b726-8b579b1d5d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:59.458961 ncdv-master-1 devstack@keystone.service[102759]: WARNING keystone.server.flask.application [None req-d0b5b6c5-6d33-4fc3-b726-8b579b1d5d45 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.33: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 06 21:08:59.462080 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2082/4117] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:59 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 67 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 06 21:08:59.879359 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae24ca-b088-43e1-9c65-0fc6569f32ad None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:08:59.879804 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae24ca-b088-43e1-9c65-0fc6569f32ad None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:08:59.880586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae24ca-b088-43e1-9c65-0fc6569f32ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:08:59.984874 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-b9ae24ca-b088-43e1-9c65-0fc6569f32ad None None] MFA Rules not processed for user `76ea7215906c4ab7b48a9f8c204cbd72`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:08:59.986731 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b9ae24ca-b088-43e1-9c65-0fc6569f32ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:00.157833 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2036/4118] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:08:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:00.179506 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5b6c5-6d33-4fc3-b726-8b579b1d5d45 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:00.181755 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d0b5b6c5-6d33-4fc3-b726-8b579b1d5d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:00.349593 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5b6c5-6d33-4fc3-b726-8b579b1d5d45 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:00.366468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43e201-2f1b-497f-8e44-deab879a3d93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:00.367109 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43e201-2f1b-497f-8e44-deab879a3d93 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:00.367564 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43e201-2f1b-497f-8e44-deab879a3d93 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:00.368018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43e201-2f1b-497f-8e44-deab879a3d93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:00.387295 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43e201-2f1b-497f-8e44-deab879a3d93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:00.389170 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43e201-2f1b-497f-8e44-deab879a3d93 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:00.414989 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2083/4119] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:09:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:09:02.406533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26e873-7569-4d2a-a5c4-dd58f6338367 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:02.406533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26e873-7569-4d2a-a5c4-dd58f6338367 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:02.406533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26e873-7569-4d2a-a5c4-dd58f6338367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:02.500796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43e201-2f1b-497f-8e44-deab879a3d93 service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:02.506366 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-bf43e201-2f1b-497f-8e44-deab879a3d93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:02.546878 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-fc26e873-7569-4d2a-a5c4-dd58f6338367 None None] MFA Rules not processed for user `c3601924229d4254817f827b64c9380e`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:02.561771 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-fc26e873-7569-4d2a-a5c4-dd58f6338367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:02.791467 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2037/4120] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:02 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:02.792947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26e873-7569-4d2a-a5c4-dd58f6338367 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:02.797086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-fc26e873-7569-4d2a-a5c4-dd58f6338367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:02.798068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43e201-2f1b-497f-8e44-deab879a3d93 service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:02.809957 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af74fe6-23fd-40ee-bce6-31ddf4ca5389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:02.810947 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af74fe6-23fd-40ee-bce6-31ddf4ca5389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:02.811986 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af74fe6-23fd-40ee-bce6-31ddf4ca5389 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:02.814536 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af74fe6-23fd-40ee-bce6-31ddf4ca5389 admin admin] PATH_INFO: `/v3/users/78f7a58ae0b24b6a9aca96713dfe99b4` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:02.819021 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af74fe6-23fd-40ee-bce6-31ddf4ca5389 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78f7a58ae0b24b6a9aca96713dfe99b4)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:02.821611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af74fe6-23fd-40ee-bce6-31ddf4ca5389 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:02.829891 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26e873-7569-4d2a-a5c4-dd58f6338367 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:02.841841 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a725c70-4338-4935-a29c-85e506af5aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:02.843749 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a725c70-4338-4935-a29c-85e506af5aeb admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:02.846742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a725c70-4338-4935-a29c-85e506af5aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:02.847123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a725c70-4338-4935-a29c-85e506af5aeb admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:02.848690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a725c70-4338-4935-a29c-85e506af5aeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:02.856965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a725c70-4338-4935-a29c-85e506af5aeb admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:02.923564 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2038/4121] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:09:02 2022] POST /identity/v3/projects => generated 403 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:02.928465 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a725c70-4338-4935-a29c-85e506af5aeb admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:02.932118 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:DELETE=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:02.944600 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8af74fe6-23fd-40ee-bce6-31ddf4ca5389 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78f7a58ae0b24b6a9aca96713dfe99b4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:02.962476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8af74fe6-23fd-40ee-bce6-31ddf4ca5389 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78f7a58ae0b24b6a9aca96713dfe99b4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:02.963901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8af74fe6-23fd-40ee-bce6-31ddf4ca5389 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78f7a58ae0b24b6a9aca96713dfe99b4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:02.964717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8af74fe6-23fd-40ee-bce6-31ddf4ca5389 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78f7a58ae0b24b6a9aca96713dfe99b4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:02.987914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8af74fe6-23fd-40ee-bce6-31ddf4ca5389 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78f7a58ae0b24b6a9aca96713dfe99b4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:03.008010 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:03.025782 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2084/4122] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:09:02 2022] DELETE /identity/v3/users/78f7a58ae0b24b6a9aca96713dfe99b4 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:03.089842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a725c70-4338-4935-a29c-85e506af5aeb admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:03.262305 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debaaf4-2ee2-427b-8378-d4cb9c43e88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:03.263208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debaaf4-2ee2-427b-8378-d4cb9c43e88c admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:03.263341 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debaaf4-2ee2-427b-8378-d4cb9c43e88c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:03.264396 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debaaf4-2ee2-427b-8378-d4cb9c43e88c admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:03.265038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debaaf4-2ee2-427b-8378-d4cb9c43e88c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:03.268011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debaaf4-2ee2-427b-8378-d4cb9c43e88c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:03.336385 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2039/4123] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:09:02 2022] POST /identity/v3/users => generated 302 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:09:03.340585 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af74fe6-23fd-40ee-bce6-31ddf4ca5389 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:03.342431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8af74fe6-23fd-40ee-bce6-31ddf4ca5389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:03.365962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af74fe6-23fd-40ee-bce6-31ddf4ca5389 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:03.384739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb35cb-65d7-40d6-88e9-03ecf9ae6449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:03.385678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb35cb-65d7-40d6-88e9-03ecf9ae6449 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:03.386130 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb35cb-65d7-40d6-88e9-03ecf9ae6449 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:03.386684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb35cb-65d7-40d6-88e9-03ecf9ae6449 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:03.387524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb35cb-65d7-40d6-88e9-03ecf9ae6449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:03.389327 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb35cb-65d7-40d6-88e9-03ecf9ae6449 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:03.416488 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debaaf4-2ee2-427b-8378-d4cb9c43e88c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:03.424702 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2085/4124] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:09:03.434520 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debaaf4-2ee2-427b-8378-d4cb9c43e88c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:03.456096 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfcfc7-c11e-4d24-a770-f2fdbfc88cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:03.456712 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfcfc7-c11e-4d24-a770-f2fdbfc88cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:03.459863 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfcfc7-c11e-4d24-a770-f2fdbfc88cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:03.460201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfcfc7-c11e-4d24-a770-f2fdbfc88cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:03.461026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cfcfc7-c11e-4d24-a770-f2fdbfc88cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:03.466296 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cfcfc7-c11e-4d24-a770-f2fdbfc88cb4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:03.496170 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2040/4125] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:09:03.498760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb35cb-65d7-40d6-88e9-03ecf9ae6449 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:03.512228 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb35cb-65d7-40d6-88e9-03ecf9ae6449 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:03.540642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d7db1-5c6b-4b6c-8e75-030ae945db87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:03.541260 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d7db1-5c6b-4b6c-8e75-030ae945db87 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:03.541544 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d7db1-5c6b-4b6c-8e75-030ae945db87 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:03.547346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d7db1-5c6b-4b6c-8e75-030ae945db87 admin admin] PATH_INFO: `/v3/projects/6f65aeac4595423f89d77bbefddce2eb/users/60937cf67d164238a35870c98b53f0ef/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:03.617217 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d7db1-5c6b-4b6c-8e75-030ae945db87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f65aeac4595423f89d77bbefddce2eb, user_id=60937cf67d164238a35870c98b53f0ef, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:03.620391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d7db1-5c6b-4b6c-8e75-030ae945db87 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:03.655005 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2086/4126] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:09:03 2022] PUT /identity/v3/projects/6f65aeac4595423f89d77bbefddce2eb/users/60937cf67d164238a35870c98b53f0ef/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:03.897975 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfcfc7-c11e-4d24-a770-f2fdbfc88cb4 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:03.900785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-83cfcfc7-c11e-4d24-a770-f2fdbfc88cb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:03.944757 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfcfc7-c11e-4d24-a770-f2fdbfc88cb4 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:04.138780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32085c-e9b2-4907-b8fe-a5a6db019e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:04.139577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32085c-e9b2-4907-b8fe-a5a6db019e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:04.140074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32085c-e9b2-4907-b8fe-a5a6db019e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:04.140366 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32085c-e9b2-4907-b8fe-a5a6db019e9b admin admin] PATH_INFO: `/v3/projects/e1ed29bedd5e4f4788958bad354166f3` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:04.141677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32085c-e9b2-4907-b8fe-a5a6db019e9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1ed29bedd5e4f4788958bad354166f3)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:04.143815 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32085c-e9b2-4907-b8fe-a5a6db019e9b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:04.301589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2b32085c-e9b2-4907-b8fe-a5a6db019e9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1ed29bedd5e4f4788958bad354166f3', 'request_id': 'req-2b32085c-e9b2-4907-b8fe-a5a6db019e9b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:04.311837 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2b32085c-e9b2-4907-b8fe-a5a6db019e9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1ed29bedd5e4f4788958bad354166f3', 'request_id': 'req-2b32085c-e9b2-4907-b8fe-a5a6db019e9b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:04.314377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:04.321166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2b32085c-e9b2-4907-b8fe-a5a6db019e9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1ed29bedd5e4f4788958bad354166f3', 'request_id': 'req-2b32085c-e9b2-4907-b8fe-a5a6db019e9b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:04.355458 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2b32085c-e9b2-4907-b8fe-a5a6db019e9b admin admin] The token cache is being invalidate because project e1ed29bedd5e4f4788958bad354166f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:09:04.356634 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2b32085c-e9b2-4907-b8fe-a5a6db019e9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:04.363769 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2b32085c-e9b2-4907-b8fe-a5a6db019e9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:04.367181 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2041/4127] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:09:03 2022] DELETE /identity/v3/projects/e1ed29bedd5e4f4788958bad354166f3 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:04.371768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d7db1-5c6b-4b6c-8e75-030ae945db87 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:04.375517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e81d7db1-5c6b-4b6c-8e75-030ae945db87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:04.406897 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d7db1-5c6b-4b6c-8e75-030ae945db87 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:04.559868 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd112c59-1247-4aa8-9b67-7687ecd82978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:04.561954 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd112c59-1247-4aa8-9b67-7687ecd82978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:04.562462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd112c59-1247-4aa8-9b67-7687ecd82978 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:04.563097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd112c59-1247-4aa8-9b67-7687ecd82978 admin admin] PATH_INFO: `/v3/users/f06e774b04164833ab25fb139011fb0b` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:04.565374 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd112c59-1247-4aa8-9b67-7687ecd82978 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f06e774b04164833ab25fb139011fb0b)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:04.569669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd112c59-1247-4aa8-9b67-7687ecd82978 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:04.765443 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dd112c59-1247-4aa8-9b67-7687ecd82978 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f06e774b04164833ab25fb139011fb0b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:04.778066 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dd112c59-1247-4aa8-9b67-7687ecd82978 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f06e774b04164833ab25fb139011fb0b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:04.779879 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dd112c59-1247-4aa8-9b67-7687ecd82978 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f06e774b04164833ab25fb139011fb0b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:04.781556 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dd112c59-1247-4aa8-9b67-7687ecd82978 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f06e774b04164833ab25fb139011fb0b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:04.795844 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dd112c59-1247-4aa8-9b67-7687ecd82978 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f06e774b04164833ab25fb139011fb0b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:04.821015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:04.834192 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2087/4128] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:09:04 2022] DELETE /identity/v3/users/f06e774b04164833ab25fb139011fb0b => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:05.484944 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32085c-e9b2-4907-b8fe-a5a6db019e9b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:05.504529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32085c-e9b2-4907-b8fe-a5a6db019e9b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:05.730516 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936a184-dc84-42f3-bef6-fce2f599fe89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:05.731210 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936a184-dc84-42f3-bef6-fce2f599fe89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:05.741032 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936a184-dc84-42f3-bef6-fce2f599fe89 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:05.741636 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936a184-dc84-42f3-bef6-fce2f599fe89 admin admin] PATH_INFO: `/v3/projects/8bd254c943c1499e88f92af865635df0` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:05.746233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936a184-dc84-42f3-bef6-fce2f599fe89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bd254c943c1499e88f92af865635df0)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:05.751338 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936a184-dc84-42f3-bef6-fce2f599fe89 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:05.960596 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c936a184-dc84-42f3-bef6-fce2f599fe89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bd254c943c1499e88f92af865635df0', 'request_id': 'req-c936a184-dc84-42f3-bef6-fce2f599fe89'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:05.976986 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c936a184-dc84-42f3-bef6-fce2f599fe89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bd254c943c1499e88f92af865635df0', 'request_id': 'req-c936a184-dc84-42f3-bef6-fce2f599fe89'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:05.991783 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c936a184-dc84-42f3-bef6-fce2f599fe89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bd254c943c1499e88f92af865635df0', 'request_id': 'req-c936a184-dc84-42f3-bef6-fce2f599fe89'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:06.048588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c936a184-dc84-42f3-bef6-fce2f599fe89 admin admin] The token cache is being invalidate because project 8bd254c943c1499e88f92af865635df0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:09:06.048963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c936a184-dc84-42f3-bef6-fce2f599fe89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:06.049716 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c936a184-dc84-42f3-bef6-fce2f599fe89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:06.056516 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2042/4129] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:09:05 2022] DELETE /identity/v3/projects/8bd254c943c1499e88f92af865635df0 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:06.058190 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86581b6e-c349-40e9-aac1-ffe492c1569b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:06.058718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86581b6e-c349-40e9-aac1-ffe492c1569b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:06.065681 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86581b6e-c349-40e9-aac1-ffe492c1569b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:06.113442 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-86581b6e-c349-40e9-aac1-ffe492c1569b None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:06.120463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-86581b6e-c349-40e9-aac1-ffe492c1569b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:06.452803 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2088/4130] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:09:06.455096 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f5748-db5b-46c8-8daf-492619083b98 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:06.457851 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f5748-db5b-46c8-8daf-492619083b98 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:06.459568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f5748-db5b-46c8-8daf-492619083b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:06.521289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-725f5748-db5b-46c8-8daf-492619083b98 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:06.522872 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-725f5748-db5b-46c8-8daf-492619083b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:06.539631 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2043/4131] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:06.544151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86581b6e-c349-40e9-aac1-ffe492c1569b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:06.580728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86581b6e-c349-40e9-aac1-ffe492c1569b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:06.615680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1e7d0-6a87-4890-a7ac-36a00cc65002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:06.617357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1e7d0-6a87-4890-a7ac-36a00cc65002 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:06.620090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1e7d0-6a87-4890-a7ac-36a00cc65002 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:06.625773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1e7d0-6a87-4890-a7ac-36a00cc65002 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:06.626678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db1e7d0-6a87-4890-a7ac-36a00cc65002 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:09:06.627892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db1e7d0-6a87-4890-a7ac-36a00cc65002 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:06.631758 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db1e7d0-6a87-4890-a7ac-36a00cc65002 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:06.670009 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2089/4132] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:09:06.682731 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f5748-db5b-46c8-8daf-492619083b98 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:06.700848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f5748-db5b-46c8-8daf-492619083b98 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:06.712123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230741b0-c35b-4861-a194-7ff87edb0b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:06.712824 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230741b0-c35b-4861-a194-7ff87edb0b2e admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:06.713320 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230741b0-c35b-4861-a194-7ff87edb0b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:06.713749 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230741b0-c35b-4861-a194-7ff87edb0b2e admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:06.714283 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230741b0-c35b-4861-a194-7ff87edb0b2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:06.716324 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230741b0-c35b-4861-a194-7ff87edb0b2e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:06.770373 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2044/4133] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:09:06 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:06.773897 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1e7d0-6a87-4890-a7ac-36a00cc65002 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:06.794661 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1e7d0-6a87-4890-a7ac-36a00cc65002 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:07.051802 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e9994b-b6c2-4309-b11e-9cd56445633e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:07.053325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9994b-b6c2-4309-b11e-9cd56445633e admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:07.053325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9994b-b6c2-4309-b11e-9cd56445633e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:07.053325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9994b-b6c2-4309-b11e-9cd56445633e admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:07.059145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e9994b-b6c2-4309-b11e-9cd56445633e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:07.067880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e9994b-b6c2-4309-b11e-9cd56445633e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:07.127758 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2090/4134] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:09:06 2022] POST /identity/v3/users => generated 292 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:07.132186 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230741b0-c35b-4861-a194-7ff87edb0b2e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:07.147610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230741b0-c35b-4861-a194-7ff87edb0b2e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:07.169525 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35783eb8-0017-4937-a125-4fb1daa7d026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:07.172196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35783eb8-0017-4937-a125-4fb1daa7d026 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:07.174776 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35783eb8-0017-4937-a125-4fb1daa7d026 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:07.175064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35783eb8-0017-4937-a125-4fb1daa7d026 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:07.176896 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35783eb8-0017-4937-a125-4fb1daa7d026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:07.182705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35783eb8-0017-4937-a125-4fb1daa7d026 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:07.225622 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2045/4135] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:09:07.229807 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e9994b-b6c2-4309-b11e-9cd56445633e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:07.245439 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e9994b-b6c2-4309-b11e-9cd56445633e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:07.258871 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a610d-c9ba-4a4b-ba0e-0ea6cac2f310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:07.259555 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a610d-c9ba-4a4b-ba0e-0ea6cac2f310 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:07.259969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a610d-c9ba-4a4b-ba0e-0ea6cac2f310 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:07.260252 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a610d-c9ba-4a4b-ba0e-0ea6cac2f310 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:07.260909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a610d-c9ba-4a4b-ba0e-0ea6cac2f310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:07.262566 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a610d-c9ba-4a4b-ba0e-0ea6cac2f310 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:07.305039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35783eb8-0017-4937-a125-4fb1daa7d026 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:07.311741 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2091/4136] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:09:07.318235 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35783eb8-0017-4937-a125-4fb1daa7d026 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:07.330711 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d70ab9-0e4c-473d-b1d4-183a1a589046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:07.332861 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d70ab9-0e4c-473d-b1d4-183a1a589046 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:07.333402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d70ab9-0e4c-473d-b1d4-183a1a589046 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:07.333885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d70ab9-0e4c-473d-b1d4-183a1a589046 admin admin] PATH_INFO: `/v3/projects/591beac720d74a8889ad521c436e64c3/users/22318132bfd04aa0886eb9b14a983731/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:07.378760 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d70ab9-0e4c-473d-b1d4-183a1a589046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=591beac720d74a8889ad521c436e64c3, user_id=22318132bfd04aa0886eb9b14a983731, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:07.386906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d70ab9-0e4c-473d-b1d4-183a1a589046 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:07.443811 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2046/4137] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:09:07 2022] PUT /identity/v3/projects/591beac720d74a8889ad521c436e64c3/users/22318132bfd04aa0886eb9b14a983731/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:09:07.448858 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054fc55-3e2a-4343-8c18-88dac6e6d53a None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:07.449007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054fc55-3e2a-4343-8c18-88dac6e6d53a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:07.449203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054fc55-3e2a-4343-8c18-88dac6e6d53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:07.499520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-0054fc55-3e2a-4343-8c18-88dac6e6d53a None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:07.500657 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0054fc55-3e2a-4343-8c18-88dac6e6d53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:07.721395 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2092/4138] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:07.762870 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d70ab9-0e4c-473d-b1d4-183a1a589046 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:07.766678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f5d70ab9-0e4c-473d-b1d4-183a1a589046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:07.794865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:07.977964 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d70ab9-0e4c-473d-b1d4-183a1a589046 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:07.998290 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf3397-2065-4ee7-b98b-9e8204f1fb25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:08.001199 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf3397-2065-4ee7-b98b-9e8204f1fb25 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:08.003522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf3397-2065-4ee7-b98b-9e8204f1fb25 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:08.005597 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf3397-2065-4ee7-b98b-9e8204f1fb25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:08.068243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf3397-2065-4ee7-b98b-9e8204f1fb25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:08.069867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf3397-2065-4ee7-b98b-9e8204f1fb25 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:08.106971 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2047/4139] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:09:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:09:10.478205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d317cf-223a-48c4-b260-00e93a08b9b1 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:10.479166 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d317cf-223a-48c4-b260-00e93a08b9b1 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:10.479983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d317cf-223a-48c4-b260-00e93a08b9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:10.487862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:10.579692 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a3d317cf-223a-48c4-b260-00e93a08b9b1 None None] MFA Rules not processed for user `58c234d2dd3d4b52a53220ec5f716cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:10.602896 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf3397-2065-4ee7-b98b-9e8204f1fb25 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:10.605802 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3dcf3397-2065-4ee7-b98b-9e8204f1fb25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:10.611851 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a3d317cf-223a-48c4-b260-00e93a08b9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:10.618145 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2093/4140] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:10 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 21:09:10.626158 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d317cf-223a-48c4-b260-00e93a08b9b1 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:10.633002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a3d317cf-223a-48c4-b260-00e93a08b9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:10.644947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf3397-2065-4ee7-b98b-9e8204f1fb25 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:10.678225 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c6b61-9949-4ec7-9380-1ec82b6dbede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:10.689532 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c6b61-9949-4ec7-9380-1ec82b6dbede admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:10.690275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c6b61-9949-4ec7-9380-1ec82b6dbede admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:10.691628 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c6b61-9949-4ec7-9380-1ec82b6dbede admin admin] PATH_INFO: `/v3/users/76ea7215906c4ab7b48a9f8c204cbd72` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:10.693483 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c6b61-9949-4ec7-9380-1ec82b6dbede admin admin] RBAC: Authorizing `identity:delete_user(user_id=76ea7215906c4ab7b48a9f8c204cbd72)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:10.702416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c6b61-9949-4ec7-9380-1ec82b6dbede admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:10.836107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9c5c6b61-9949-4ec7-9380-1ec82b6dbede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76ea7215906c4ab7b48a9f8c204cbd72'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:10.837184 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9c5c6b61-9949-4ec7-9380-1ec82b6dbede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76ea7215906c4ab7b48a9f8c204cbd72'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:10.838089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9c5c6b61-9949-4ec7-9380-1ec82b6dbede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76ea7215906c4ab7b48a9f8c204cbd72'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:10.852910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d317cf-223a-48c4-b260-00e93a08b9b1 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:10.866371 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9c5c6b61-9949-4ec7-9380-1ec82b6dbede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76ea7215906c4ab7b48a9f8c204cbd72'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:10.870298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40108c60-6f07-4f0b-9cc2-a5f8bd628a33 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c234d2dd3d4b52a53220ec5f716cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a565926e51d490c884c3a8774c1932a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:10.875387 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40108c60-6f07-4f0b-9cc2-a5f8bd628a33 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:10.876736 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40108c60-6f07-4f0b-9cc2-a5f8bd628a33 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:10.878944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40108c60-6f07-4f0b-9cc2-a5f8bd628a33 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] PATH_INFO: `/v3/users/58c234d2dd3d4b52a53220ec5f716cd7/password` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:10.908359 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9c5c6b61-9949-4ec7-9380-1ec82b6dbede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76ea7215906c4ab7b48a9f8c204cbd72'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:10.943937 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2048/4141] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:09:10 2022] DELETE /identity/v3/users/76ea7215906c4ab7b48a9f8c204cbd72 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:09:10.999018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-40108c60-6f07-4f0b-9cc2-a5f8bd628a33 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '58c234d2dd3d4b52a53220ec5f716cd7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:11.023474 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2094/4142] 10.222.0.33 () {60 vars in 1269 bytes} [Sat Aug 6 21:09:10 2022] POST /identity/v3/users/58c234d2dd3d4b52a53220ec5f716cd7/password => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:11.376652 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c6b61-9949-4ec7-9380-1ec82b6dbede admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:11.378269 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9c5c6b61-9949-4ec7-9380-1ec82b6dbede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:11.516686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c6b61-9949-4ec7-9380-1ec82b6dbede admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:11.532381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbbec45-c3b6-4b52-b674-20da37a3554f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:11.532843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbec45-c3b6-4b52-b674-20da37a3554f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:11.533131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbec45-c3b6-4b52-b674-20da37a3554f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:11.535198 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbec45-c3b6-4b52-b674-20da37a3554f admin admin] PATH_INFO: `/v3/projects/1b06f18250f34f7db9b0bcf9de3dc999` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:11.539089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbbec45-c3b6-4b52-b674-20da37a3554f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b06f18250f34f7db9b0bcf9de3dc999)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:11.543685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbbec45-c3b6-4b52-b674-20da37a3554f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:11.667590 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:11.712920 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-edbbec45-c3b6-4b52-b674-20da37a3554f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b06f18250f34f7db9b0bcf9de3dc999', 'request_id': 'req-edbbec45-c3b6-4b52-b674-20da37a3554f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:11.727155 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-edbbec45-c3b6-4b52-b674-20da37a3554f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b06f18250f34f7db9b0bcf9de3dc999', 'request_id': 'req-edbbec45-c3b6-4b52-b674-20da37a3554f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:11.742832 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-edbbec45-c3b6-4b52-b674-20da37a3554f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b06f18250f34f7db9b0bcf9de3dc999', 'request_id': 'req-edbbec45-c3b6-4b52-b674-20da37a3554f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:11.772960 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-edbbec45-c3b6-4b52-b674-20da37a3554f admin admin] The token cache is being invalidate because project 1b06f18250f34f7db9b0bcf9de3dc999 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:09:11.773513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-edbbec45-c3b6-4b52-b674-20da37a3554f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:11.774963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-edbbec45-c3b6-4b52-b674-20da37a3554f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:11.785580 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2049/4143] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:09:11 2022] DELETE /identity/v3/projects/1b06f18250f34f7db9b0bcf9de3dc999 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:11.790665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1e0d9-f048-4a0c-a7a4-ac3498abd7ee None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:11.791517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1e0d9-f048-4a0c-a7a4-ac3498abd7ee None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:11.792010 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1e0d9-f048-4a0c-a7a4-ac3498abd7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:11.821120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-18b1e0d9-f048-4a0c-a7a4-ac3498abd7ee None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:11.822669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-18b1e0d9-f048-4a0c-a7a4-ac3498abd7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:11.910118 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2095/4144] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:11.918361 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6869d-6129-4a31-9c01-333eb989f7cc None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:11.918731 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6869d-6129-4a31-9c01-333eb989f7cc None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:11.918989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6869d-6129-4a31-9c01-333eb989f7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:11.954527 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-9bd6869d-6129-4a31-9c01-333eb989f7cc None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:11.956087 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9bd6869d-6129-4a31-9c01-333eb989f7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:11.975048 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1e0d9-f048-4a0c-a7a4-ac3498abd7ee None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:11.985039 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2050/4145] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:12.008728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1e0d9-f048-4a0c-a7a4-ac3498abd7ee None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:12.027424 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879beb5-155c-4e38-83fa-52c2a6ca1629 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:12.027739 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879beb5-155c-4e38-83fa-52c2a6ca1629 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:12.028057 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879beb5-155c-4e38-83fa-52c2a6ca1629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:12.070361 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1965cc6-f442-4551-8ba7-4fcad519081a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:12.071045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1965cc6-f442-4551-8ba7-4fcad519081a admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:12.071378 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1965cc6-f442-4551-8ba7-4fcad519081a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:12.085446 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1965cc6-f442-4551-8ba7-4fcad519081a admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:12.086306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1965cc6-f442-4551-8ba7-4fcad519081a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:09:12.086646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1965cc6-f442-4551-8ba7-4fcad519081a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:12.088293 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1965cc6-f442-4551-8ba7-4fcad519081a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:12.189957 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2096/4146] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:09:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:09:12.203566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-6879beb5-155c-4e38-83fa-52c2a6ca1629 None None] MFA Rules not processed for user `58c234d2dd3d4b52a53220ec5f716cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:12.205988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1965cc6-f442-4551-8ba7-4fcad519081a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:12.218691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6879beb5-155c-4e38-83fa-52c2a6ca1629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:12.232183 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2051/4147] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:12 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 21:09:12.239578 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7271159-117d-4096-a1d4-da4cd6576306 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:12.240003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7271159-117d-4096-a1d4-da4cd6576306 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:12.240707 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7271159-117d-4096-a1d4-da4cd6576306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:12.261847 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e7271159-117d-4096-a1d4-da4cd6576306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:12.274853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1965cc6-f442-4551-8ba7-4fcad519081a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:12.306153 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b9535-165f-4d7d-87b7-27ded3220bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:12.314831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b9535-165f-4d7d-87b7-27ded3220bc2 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:12.315115 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b9535-165f-4d7d-87b7-27ded3220bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:12.322990 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b9535-165f-4d7d-87b7-27ded3220bc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:12.326509 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b9535-165f-4d7d-87b7-27ded3220bc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:12.335825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b9535-165f-4d7d-87b7-27ded3220bc2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:12.434621 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2097/4148] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:09:12 2022] POST /identity/v3/projects => generated 385 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:12.439852 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b9535-165f-4d7d-87b7-27ded3220bc2 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:12.511628 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=93,keystone:UPDATE=2,keystone:INSERT=3,keystone:DELETE=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:12.573804 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b9535-165f-4d7d-87b7-27ded3220bc2 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:12.607719 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c83cdd-0277-4bf5-9551-b92f2ae6c84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:12.609651 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c83cdd-0277-4bf5-9551-b92f2ae6c84d admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:12.610107 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c83cdd-0277-4bf5-9551-b92f2ae6c84d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:12.610503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c83cdd-0277-4bf5-9551-b92f2ae6c84d admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:12.611658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c83cdd-0277-4bf5-9551-b92f2ae6c84d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:12.618869 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c83cdd-0277-4bf5-9551-b92f2ae6c84d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:12.646996 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-e7271159-117d-4096-a1d4-da4cd6576306 None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Aug 06 21:09:12.646996 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:09:12.646996 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:09:12.646996 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:09:12.646996 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:09:12.646996 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:09:12.646996 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:09:12.646996 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:09:12.646996 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:09:12.646996 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:09:12.646996 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:09:12.646996 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:09:12.646996 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 06 21:09:12.646996 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 06 21:09:12.646996 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 06 21:09:12.646996 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 06 21:09:12.648292 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Aug 06 21:09:12.648292 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Aug 06 21:09:12.648292 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Aug 06 21:09:12.648292 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Aug 06 21:09:12.648292 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Aug 06 21:09:12.648292 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Aug 06 21:09:12.648292 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Aug 06 21:09:12.648292 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Aug 06 21:09:12.648292 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:09:12.648292 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:09:12.648292 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Aug 06 21:09:12.648292 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Aug 06 21:09:12.648292 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Aug 06 21:09:12.648292 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self.check_revocation(token) Aug 06 21:09:12.648292 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:09:12.648292 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:09:12.649598 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Aug 06 21:09:12.649598 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Aug 06 21:09:12.649598 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:09:12.649598 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:09:12.649598 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Aug 06 21:09:12.649598 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Aug 06 21:09:12.649598 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:09:12.649598 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:09:12.649598 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Aug 06 21:09:12.649598 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Aug 06 21:09:12.649598 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Aug 06 21:09:12.649598 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:09:12.649598 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2052/4149] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:12 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 413 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 21:09:12.656918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec1a25-8fb4-4c62-b0a9-97fb108d1ded None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:12.657457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec1a25-8fb4-4c62-b0a9-97fb108d1ded None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:12.659095 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec1a25-8fb4-4c62-b0a9-97fb108d1ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:12.716534 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2098/4150] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:09:12 2022] POST /identity/v3/users => generated 293 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:12.717760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c83cdd-0277-4bf5-9551-b92f2ae6c84d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:12.763809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c83cdd-0277-4bf5-9551-b92f2ae6c84d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:12.773702 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7143529-3bea-4d8b-ba7d-abadc4a545d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:12.775263 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7143529-3bea-4d8b-ba7d-abadc4a545d9 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:12.775699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7143529-3bea-4d8b-ba7d-abadc4a545d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:12.776051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7143529-3bea-4d8b-ba7d-abadc4a545d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:12.776707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7143529-3bea-4d8b-ba7d-abadc4a545d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:12.778590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7143529-3bea-4d8b-ba7d-abadc4a545d9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:12.790672 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2099/4151] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:09:12 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:09:12.796158 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7143529-3bea-4d8b-ba7d-abadc4a545d9 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:12.831025 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7143529-3bea-4d8b-ba7d-abadc4a545d9 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:12.845911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1910b-d672-4471-81b8-4c2139ebabe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:12.848244 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1910b-d672-4471-81b8-4c2139ebabe2 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:12.848809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1910b-d672-4471-81b8-4c2139ebabe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:12.849265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1910b-d672-4471-81b8-4c2139ebabe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:12.852186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f1910b-d672-4471-81b8-4c2139ebabe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:12.857330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f1910b-d672-4471-81b8-4c2139ebabe2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:12.901759 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2100/4152] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:09:12 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:09:12.906266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1910b-d672-4471-81b8-4c2139ebabe2 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:12.930443 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1910b-d672-4471-81b8-4c2139ebabe2 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:12.944144 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fce196-1e3f-44b0-a891-bbeb514e5660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:12.945195 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fce196-1e3f-44b0-a891-bbeb514e5660 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:12.945650 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fce196-1e3f-44b0-a891-bbeb514e5660 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:12.946132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fce196-1e3f-44b0-a891-bbeb514e5660 admin admin] PATH_INFO: `/v3/projects/9eb5b0ae5ee3431d941f8654d285617a/users/f883ade601bc49c3bdcce7a44d6d461f/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:12.965861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fce196-1e3f-44b0-a891-bbeb514e5660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eb5b0ae5ee3431d941f8654d285617a, user_id=f883ade601bc49c3bdcce7a44d6d461f, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:12.969415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fce196-1e3f-44b0-a891-bbeb514e5660 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:12.977224 ncdv-master-1 devstack@keystone.service[102758]: WARNING keystone.server.flask.application [None req-ceec1a25-8fb4-4c62-b0a9-97fb108d1ded None None] Authorization failed. The request you have made requires authentication. from 10.222.0.33: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 06 21:09:12.992075 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2053/4153] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:12 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 338 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 06 21:09:12.994613 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2101/4154] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:09:12 2022] PUT /identity/v3/projects/9eb5b0ae5ee3431d941f8654d285617a/users/f883ade601bc49c3bdcce7a44d6d461f/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:12.999914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c74081-d788-4f22-b442-45f999378fc7 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:13.000412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c74081-d788-4f22-b442-45f999378fc7 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:13.000894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c74081-d788-4f22-b442-45f999378fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:13.001191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79385f6c-e441-4ed4-b364-c9923530c9fe None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:13.002342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79385f6c-e441-4ed4-b364-c9923530c9fe None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:13.005836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79385f6c-e441-4ed4-b364-c9923530c9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:13.028265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-83c74081-d788-4f22-b442-45f999378fc7 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:13.031251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-83c74081-d788-4f22-b442-45f999378fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:13.114692 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2102/4155] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:13.135803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-79385f6c-e441-4ed4-b364-c9923530c9fe None None] MFA Rules not processed for user `58c234d2dd3d4b52a53220ec5f716cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:13.137632 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-79385f6c-e441-4ed4-b364-c9923530c9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:13.197624 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c74081-d788-4f22-b442-45f999378fc7 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:13.199454 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-83c74081-d788-4f22-b442-45f999378fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:13.310145 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2054/4156] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:13.312870 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79385f6c-e441-4ed4-b364-c9923530c9fe None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:13.336472 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79385f6c-e441-4ed4-b364-c9923530c9fe None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:13.352162 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f13327-d98b-48f5-8364-848edd2036c4 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c234d2dd3d4b52a53220ec5f716cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a565926e51d490c884c3a8774c1932a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:13.353176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f13327-d98b-48f5-8364-848edd2036c4 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:13.353622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f13327-d98b-48f5-8364-848edd2036c4 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:13.354103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f13327-d98b-48f5-8364-848edd2036c4 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] PATH_INFO: `/v3/users/58c234d2dd3d4b52a53220ec5f716cd7/password` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:13.441456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c74081-d788-4f22-b442-45f999378fc7 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:13.467574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c33af-81fc-4d60-9dc9-ab28d49d5ce9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:13.472870 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c33af-81fc-4d60-9dc9-ab28d49d5ce9 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:13.472870 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c33af-81fc-4d60-9dc9-ab28d49d5ce9 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:13.472870 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c33af-81fc-4d60-9dc9-ab28d49d5ce9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:13.493069 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=2,keystone:UPDATE=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:13.498483 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c33af-81fc-4d60-9dc9-ab28d49d5ce9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:13.506687 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-30f13327-d98b-48f5-8364-848edd2036c4 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '58c234d2dd3d4b52a53220ec5f716cd7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:13.508667 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c33af-81fc-4d60-9dc9-ab28d49d5ce9 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:13.532374 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2055/4157] 10.222.0.33 () {60 vars in 1269 bytes} [Sat Aug 6 21:09:13 2022] POST /identity/v3/users/58c234d2dd3d4b52a53220ec5f716cd7/password => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:13.545218 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2103/4158] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:09:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:09:14.541674 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d6f35-141f-439f-abc0-f4608a6266e4 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:14.545836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d6f35-141f-439f-abc0-f4608a6266e4 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:14.546414 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d6f35-141f-439f-abc0-f4608a6266e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:14.571317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-879d6f35-141f-439f-abc0-f4608a6266e4 None None] MFA Rules not processed for user `58c234d2dd3d4b52a53220ec5f716cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:14.572957 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-879d6f35-141f-439f-abc0-f4608a6266e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:14.578321 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2056/4159] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:14 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 21:09:14.586795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68840f-0c1d-46ef-bffa-9e8af58a3fb8 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:14.588125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68840f-0c1d-46ef-bffa-9e8af58a3fb8 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:14.591254 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68840f-0c1d-46ef-bffa-9e8af58a3fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:14.651345 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-7c68840f-0c1d-46ef-bffa-9e8af58a3fb8 None None] MFA Rules not processed for user `58c234d2dd3d4b52a53220ec5f716cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:14.652842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7c68840f-0c1d-46ef-bffa-9e8af58a3fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:14.689365 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2104/4160] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:14.691524 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d6f35-141f-439f-abc0-f4608a6266e4 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:14.723104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d6f35-141f-439f-abc0-f4608a6266e4 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:14.747356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52677eec-f788-4fa4-a086-7790c1b15198 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c234d2dd3d4b52a53220ec5f716cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a565926e51d490c884c3a8774c1932a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:14.748055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52677eec-f788-4fa4-a086-7790c1b15198 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:14.748358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52677eec-f788-4fa4-a086-7790c1b15198 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:14.749745 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52677eec-f788-4fa4-a086-7790c1b15198 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] PATH_INFO: `/v3/users/58c234d2dd3d4b52a53220ec5f716cd7/password` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:14.844590 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-52677eec-f788-4fa4-a086-7790c1b15198 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '58c234d2dd3d4b52a53220ec5f716cd7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:14.870421 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2057/4161] 10.222.0.33 () {60 vars in 1269 bytes} [Sat Aug 6 21:09:14 2022] POST /identity/v3/users/58c234d2dd3d4b52a53220ec5f716cd7/password => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:09:15.711360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8e47b-1cc5-447a-a8f3-175ff93d61ff None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:15.712187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8e47b-1cc5-447a-a8f3-175ff93d61ff None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:15.712569 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8e47b-1cc5-447a-a8f3-175ff93d61ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:15.730125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:15.815304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-e5e8e47b-1cc5-447a-a8f3-175ff93d61ff None None] MFA Rules not processed for user `f883ade601bc49c3bdcce7a44d6d461f`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:15.818008 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e5e8e47b-1cc5-447a-a8f3-175ff93d61ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:15.880244 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd69722-2550-4116-9735-d588cdaab934 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:15.880885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd69722-2550-4116-9735-d588cdaab934 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:15.880885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd69722-2550-4116-9735-d588cdaab934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:15.939330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-dfd69722-2550-4116-9735-d588cdaab934 None None] MFA Rules not processed for user `58c234d2dd3d4b52a53220ec5f716cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:15.944455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-dfd69722-2550-4116-9735-d588cdaab934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:15.963007 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2058/4162] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:15 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 21:09:15.979172 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62496b3-9d12-4e7f-83d0-19c273f61bec None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:15.979491 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62496b3-9d12-4e7f-83d0-19c273f61bec None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:15.987166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62496b3-9d12-4e7f-83d0-19c273f61bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:16.085122 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f62496b3-9d12-4e7f-83d0-19c273f61bec None None] MFA Rules not processed for user `58c234d2dd3d4b52a53220ec5f716cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:16.097215 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f62496b3-9d12-4e7f-83d0-19c273f61bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:16.123108 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2105/4163] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:16.132174 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c869c6d-fd57-487b-b347-4a8b5dee9c79 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:16.132559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c869c6d-fd57-487b-b347-4a8b5dee9c79 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:16.134171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c869c6d-fd57-487b-b347-4a8b5dee9c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:16.160964 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2059/4164] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:16.175406 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62496b3-9d12-4e7f-83d0-19c273f61bec None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:16.195430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62496b3-9d12-4e7f-83d0-19c273f61bec None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:16.201764 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-5c869c6d-fd57-487b-b347-4a8b5dee9c79 None None] MFA Rules not processed for user `f883ade601bc49c3bdcce7a44d6d461f`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:16.203849 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738d24e-a8af-411c-9ca0-916295f7a429 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58c234d2dd3d4b52a53220ec5f716cd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a565926e51d490c884c3a8774c1932a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:16.205053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738d24e-a8af-411c-9ca0-916295f7a429 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:16.205272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5c869c6d-fd57-487b-b347-4a8b5dee9c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:16.206478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738d24e-a8af-411c-9ca0-916295f7a429 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:16.208541 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738d24e-a8af-411c-9ca0-916295f7a429 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] PATH_INFO: `/v3/users/58c234d2dd3d4b52a53220ec5f716cd7/password` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:16.223713 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2106/4165] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:16.235771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c869c6d-fd57-487b-b347-4a8b5dee9c79 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:16.237539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5c869c6d-fd57-487b-b347-4a8b5dee9c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:16.385108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7738d24e-a8af-411c-9ca0-916295f7a429 tempest-IdentityV3UsersTest-1018894518 tempest-IdentityV3UsersTest-1018894518-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '58c234d2dd3d4b52a53220ec5f716cd7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:16.438217 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2060/4166] 10.222.0.33 () {60 vars in 1269 bytes} [Sat Aug 6 21:09:16 2022] POST /identity/v3/users/58c234d2dd3d4b52a53220ec5f716cd7/password => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:16.443537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c869c6d-fd57-487b-b347-4a8b5dee9c79 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:16.464707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70063eaf-1be3-497b-adc4-a17dec9fb694 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:16.465594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70063eaf-1be3-497b-adc4-a17dec9fb694 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:16.465999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70063eaf-1be3-497b-adc4-a17dec9fb694 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:16.466421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70063eaf-1be3-497b-adc4-a17dec9fb694 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:16.492732 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70063eaf-1be3-497b-adc4-a17dec9fb694 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:16.494363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70063eaf-1be3-497b-adc4-a17dec9fb694 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:16.513810 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2107/4167] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:09:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:09:17.444105 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda0e1d-dc37-45ab-bc30-2bfa4d3f914c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:17.444713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda0e1d-dc37-45ab-bc30-2bfa4d3f914c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:17.445041 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda0e1d-dc37-45ab-bc30-2bfa4d3f914c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:17.511123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-7eda0e1d-dc37-45ab-bc30-2bfa4d3f914c None None] MFA Rules not processed for user `58c234d2dd3d4b52a53220ec5f716cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:17.524187 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7eda0e1d-dc37-45ab-bc30-2bfa4d3f914c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:17.532118 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2061/4168] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:17 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 21:09:18.072893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9e806-f70c-427c-8ee1-5d8040f543d6 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:18.073395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9e806-f70c-427c-8ee1-5d8040f543d6 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:18.073714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9e806-f70c-427c-8ee1-5d8040f543d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:18.134581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-efc9e806-f70c-427c-8ee1-5d8040f543d6 None None] MFA Rules not processed for user `60937cf67d164238a35870c98b53f0ef`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:18.137986 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-efc9e806-f70c-427c-8ee1-5d8040f543d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:18.253830 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda0e1d-dc37-45ab-bc30-2bfa4d3f914c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:18.272886 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda0e1d-dc37-45ab-bc30-2bfa4d3f914c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:18.305167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc36e2-98ea-454b-9d0e-14d792d4f964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:18.307776 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc36e2-98ea-454b-9d0e-14d792d4f964 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:18.308668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc36e2-98ea-454b-9d0e-14d792d4f964 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:18.309217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc36e2-98ea-454b-9d0e-14d792d4f964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:18.317385 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-81bc36e2-98ea-454b-9d0e-14d792d4f964 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:18.369189 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc36e2-98ea-454b-9d0e-14d792d4f964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:18.377392 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc36e2-98ea-454b-9d0e-14d792d4f964 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:18.414142 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2108/4169] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:18 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:18.421517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fd16b-3bbc-49da-b268-9ac1b92fae7f None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:18.422089 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fd16b-3bbc-49da-b268-9ac1b92fae7f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:18.423346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fd16b-3bbc-49da-b268-9ac1b92fae7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:18.426515 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2062/4170] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:09:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:09:18.447253 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:18.488782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-c57fd16b-3bbc-49da-b268-9ac1b92fae7f None None] MFA Rules not processed for user `c3601924229d4254817f827b64c9380e`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:18.491944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c57fd16b-3bbc-49da-b268-9ac1b92fae7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:18.530908 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc36e2-98ea-454b-9d0e-14d792d4f964 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:18.552834 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc36e2-98ea-454b-9d0e-14d792d4f964 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:18.569312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9ed4d-8db0-4176-ac19-b3127efd7d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:18.570491 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9ed4d-8db0-4176-ac19-b3127efd7d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:18.571029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9ed4d-8db0-4176-ac19-b3127efd7d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:18.571527 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9ed4d-8db0-4176-ac19-b3127efd7d3a admin admin] PATH_INFO: `/v3/users/f883ade601bc49c3bdcce7a44d6d461f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:18.575792 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea9ed4d-8db0-4176-ac19-b3127efd7d3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f883ade601bc49c3bdcce7a44d6d461f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:18.578677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea9ed4d-8db0-4176-ac19-b3127efd7d3a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:18.658784 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2109/4171] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:18 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:18.669533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c055e21-9f66-4fa2-ab17-63ef2711e08b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:18.669533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c055e21-9f66-4fa2-ab17-63ef2711e08b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:18.669533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c055e21-9f66-4fa2-ab17-63ef2711e08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:18.691438 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dea9ed4d-8db0-4176-ac19-b3127efd7d3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f883ade601bc49c3bdcce7a44d6d461f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:18.693800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dea9ed4d-8db0-4176-ac19-b3127efd7d3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f883ade601bc49c3bdcce7a44d6d461f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:18.695379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dea9ed4d-8db0-4176-ac19-b3127efd7d3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f883ade601bc49c3bdcce7a44d6d461f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:18.713041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-3c055e21-9f66-4fa2-ab17-63ef2711e08b None None] MFA Rules not processed for user `58c234d2dd3d4b52a53220ec5f716cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:18.716285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3c055e21-9f66-4fa2-ab17-63ef2711e08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:18.717431 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dea9ed4d-8db0-4176-ac19-b3127efd7d3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f883ade601bc49c3bdcce7a44d6d461f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:18.729060 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2110/4172] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:18.735723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c055e21-9f66-4fa2-ab17-63ef2711e08b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:18.737319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3c055e21-9f66-4fa2-ab17-63ef2711e08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:18.738940 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dea9ed4d-8db0-4176-ac19-b3127efd7d3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f883ade601bc49c3bdcce7a44d6d461f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:18.763715 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c055e21-9f66-4fa2-ab17-63ef2711e08b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:18.774251 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2063/4173] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:09:18 2022] DELETE /identity/v3/users/f883ade601bc49c3bdcce7a44d6d461f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:18.877247 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b889da2-075f-4fa0-95a6-a4ebdadb0f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:18.878152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b889da2-075f-4fa0-95a6-a4ebdadb0f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:18.878884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b889da2-075f-4fa0-95a6-a4ebdadb0f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:18.879537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b889da2-075f-4fa0-95a6-a4ebdadb0f3a admin admin] PATH_INFO: `/v3/users/58c234d2dd3d4b52a53220ec5f716cd7` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:18.880807 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b889da2-075f-4fa0-95a6-a4ebdadb0f3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=58c234d2dd3d4b52a53220ec5f716cd7)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:18.887034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b889da2-075f-4fa0-95a6-a4ebdadb0f3a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:18.997324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3b889da2-075f-4fa0-95a6-a4ebdadb0f3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58c234d2dd3d4b52a53220ec5f716cd7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:19.012340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3b889da2-075f-4fa0-95a6-a4ebdadb0f3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58c234d2dd3d4b52a53220ec5f716cd7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:19.015040 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3b889da2-075f-4fa0-95a6-a4ebdadb0f3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58c234d2dd3d4b52a53220ec5f716cd7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:19.016715 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3b889da2-075f-4fa0-95a6-a4ebdadb0f3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58c234d2dd3d4b52a53220ec5f716cd7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:19.039011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3b889da2-075f-4fa0-95a6-a4ebdadb0f3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58c234d2dd3d4b52a53220ec5f716cd7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:19.080231 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2111/4174] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:09:18 2022] DELETE /identity/v3/users/58c234d2dd3d4b52a53220ec5f716cd7 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:19.086258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89326656-0e09-4286-b614-674c241c1f6c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:19.086574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89326656-0e09-4286-b614-674c241c1f6c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:19.086850 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89326656-0e09-4286-b614-674c241c1f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:19.127652 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-89326656-0e09-4286-b614-674c241c1f6c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:19.129711 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-89326656-0e09-4286-b614-674c241c1f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:19.156672 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=77,keystone:INSERT=6,keystone:DELETE=15,keystone:UPDATE=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:19.300486 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2064/4175] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:19.424602 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b889da2-075f-4fa0-95a6-a4ebdadb0f3a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:19.426102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89326656-0e09-4286-b614-674c241c1f6c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:19.426633 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3b889da2-075f-4fa0-95a6-a4ebdadb0f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:19.427904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-89326656-0e09-4286-b614-674c241c1f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:19.495530 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:19.588874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b889da2-075f-4fa0-95a6-a4ebdadb0f3a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:19.600036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21a4b9-a7f1-4eb0-8fb5-ad4eb02d820c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:19.600675 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21a4b9-a7f1-4eb0-8fb5-ad4eb02d820c service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:19.600960 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21a4b9-a7f1-4eb0-8fb5-ad4eb02d820c service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:19.601239 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21a4b9-a7f1-4eb0-8fb5-ad4eb02d820c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:19.628684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21a4b9-a7f1-4eb0-8fb5-ad4eb02d820c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:19.631937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21a4b9-a7f1-4eb0-8fb5-ad4eb02d820c service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:19.632860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89326656-0e09-4286-b614-674c241c1f6c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:19.648786 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17db1e5-58c8-4877-b982-0d44021b1217 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:19.649422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17db1e5-58c8-4877-b982-0d44021b1217 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:19.649702 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17db1e5-58c8-4877-b982-0d44021b1217 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:19.649978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17db1e5-58c8-4877-b982-0d44021b1217 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:19.653719 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f17db1e5-58c8-4877-b982-0d44021b1217 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:19.657552 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2112/4176] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:09:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:09:19.782008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17db1e5-58c8-4877-b982-0d44021b1217 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:19.784739 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17db1e5-58c8-4877-b982-0d44021b1217 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:19.812600 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2065/4177] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:09:19 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:09:20.167339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21a4b9-a7f1-4eb0-8fb5-ad4eb02d820c service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:20.168820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ff21a4b9-a7f1-4eb0-8fb5-ad4eb02d820c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:20.193946 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21a4b9-a7f1-4eb0-8fb5-ad4eb02d820c service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:20.210442 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c409a01-efe2-4930-a4cc-91cb6666ccaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:20.211281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c409a01-efe2-4930-a4cc-91cb6666ccaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:20.211744 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c409a01-efe2-4930-a4cc-91cb6666ccaa admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:20.212024 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c409a01-efe2-4930-a4cc-91cb6666ccaa admin admin] PATH_INFO: `/v3/projects/9eb5b0ae5ee3431d941f8654d285617a` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:20.213217 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c409a01-efe2-4930-a4cc-91cb6666ccaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eb5b0ae5ee3431d941f8654d285617a)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:20.216066 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c409a01-efe2-4930-a4cc-91cb6666ccaa admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:20.341560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3c409a01-efe2-4930-a4cc-91cb6666ccaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eb5b0ae5ee3431d941f8654d285617a', 'request_id': 'req-3c409a01-efe2-4930-a4cc-91cb6666ccaa'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:20.368617 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3c409a01-efe2-4930-a4cc-91cb6666ccaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eb5b0ae5ee3431d941f8654d285617a', 'request_id': 'req-3c409a01-efe2-4930-a4cc-91cb6666ccaa'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:20.391019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3c409a01-efe2-4930-a4cc-91cb6666ccaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eb5b0ae5ee3431d941f8654d285617a', 'request_id': 'req-3c409a01-efe2-4930-a4cc-91cb6666ccaa'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:20.429312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3c409a01-efe2-4930-a4cc-91cb6666ccaa admin admin] The token cache is being invalidate because project 9eb5b0ae5ee3431d941f8654d285617a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:09:20.430321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3c409a01-efe2-4930-a4cc-91cb6666ccaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:20.431234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3c409a01-efe2-4930-a4cc-91cb6666ccaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:20.434761 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2113/4178] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:09:20 2022] DELETE /identity/v3/projects/9eb5b0ae5ee3431d941f8654d285617a => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:20.443429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c7e50-8493-4eed-9f7a-56a48ca15fb4 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:20.443772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c7e50-8493-4eed-9f7a-56a48ca15fb4 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:20.444006 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c7e50-8493-4eed-9f7a-56a48ca15fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:20.494304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-200c7e50-8493-4eed-9f7a-56a48ca15fb4 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:20.495722 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-200c7e50-8493-4eed-9f7a-56a48ca15fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:20.618906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:20.656185 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2066/4179] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:20.659328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae217f7-3469-4652-87a5-54d7c7ea01c2 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:20.659883 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae217f7-3469-4652-87a5-54d7c7ea01c2 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:20.660226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae217f7-3469-4652-87a5-54d7c7ea01c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:20.748788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-5ae217f7-3469-4652-87a5-54d7c7ea01c2 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:20.761869 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5ae217f7-3469-4652-87a5-54d7c7ea01c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:20.825457 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2114/4180] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:20.830996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c7e50-8493-4eed-9f7a-56a48ca15fb4 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:20.858264 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c7e50-8493-4eed-9f7a-56a48ca15fb4 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:20.880893 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c330a03-67ba-4b86-92a1-e386874c579f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:20.881704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c330a03-67ba-4b86-92a1-e386874c579f admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:20.881993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c330a03-67ba-4b86-92a1-e386874c579f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:20.882277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c330a03-67ba-4b86-92a1-e386874c579f admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:20.883112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c330a03-67ba-4b86-92a1-e386874c579f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:09:20.884127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c330a03-67ba-4b86-92a1-e386874c579f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:20.886867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c330a03-67ba-4b86-92a1-e386874c579f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:20.917480 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2067/4181] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:09:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:09:20.922107 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae217f7-3469-4652-87a5-54d7c7ea01c2 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:20.935759 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae217f7-3469-4652-87a5-54d7c7ea01c2 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:20.964032 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a1935-b781-4db0-9ff8-4f9d4783edcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:20.964660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a1935-b781-4db0-9ff8-4f9d4783edcc admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:20.964972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a1935-b781-4db0-9ff8-4f9d4783edcc admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:20.965657 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a1935-b781-4db0-9ff8-4f9d4783edcc admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:20.965798 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a1935-b781-4db0-9ff8-4f9d4783edcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:20.967938 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a1935-b781-4db0-9ff8-4f9d4783edcc admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:21.063968 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2115/4182] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:09:20 2022] POST /identity/v3/projects => generated 371 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:21.064577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c330a03-67ba-4b86-92a1-e386874c579f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:21.077009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c330a03-67ba-4b86-92a1-e386874c579f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:21.230576 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc5b2d-d997-45d2-821e-67d171fa69bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:21.231496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc5b2d-d997-45d2-821e-67d171fa69bf admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:21.231959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc5b2d-d997-45d2-821e-67d171fa69bf admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:21.232426 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc5b2d-d997-45d2-821e-67d171fa69bf admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:21.234000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cc5b2d-d997-45d2-821e-67d171fa69bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:21.236272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cc5b2d-d997-45d2-821e-67d171fa69bf admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:21.288954 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2068/4183] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:09:21 2022] POST /identity/v3/users => generated 286 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:21.290356 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a1935-b781-4db0-9ff8-4f9d4783edcc admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:21.305508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a1935-b781-4db0-9ff8-4f9d4783edcc admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:21.326183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b1de4-f6c4-4373-8a82-6c2a3782e073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:21.326840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b1de4-f6c4-4373-8a82-6c2a3782e073 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:21.327126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b1de4-f6c4-4373-8a82-6c2a3782e073 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:21.327399 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b1de4-f6c4-4373-8a82-6c2a3782e073 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:21.328053 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b1de4-f6c4-4373-8a82-6c2a3782e073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:21.329671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b1de4-f6c4-4373-8a82-6c2a3782e073 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:21.366208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc5b2d-d997-45d2-821e-67d171fa69bf admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:21.367946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-91cc5b2d-d997-45d2-821e-67d171fa69bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:21.378599 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2116/4184] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:09:21.390409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b1de4-f6c4-4373-8a82-6c2a3782e073 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:21.432922 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b1de4-f6c4-4373-8a82-6c2a3782e073 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:21.446377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76121f-7b26-4866-88ac-b2be03bf2eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:21.447422 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76121f-7b26-4866-88ac-b2be03bf2eda admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:21.448368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76121f-7b26-4866-88ac-b2be03bf2eda admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:21.448892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76121f-7b26-4866-88ac-b2be03bf2eda admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:21.449772 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c76121f-7b26-4866-88ac-b2be03bf2eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:21.452415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c76121f-7b26-4866-88ac-b2be03bf2eda admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:21.475935 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2117/4185] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:09:21.480051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76121f-7b26-4866-88ac-b2be03bf2eda admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:21.500935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76121f-7b26-4866-88ac-b2be03bf2eda admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:21.519087 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007429a2-db7b-4b90-8382-8ea77f073244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:21.522318 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007429a2-db7b-4b90-8382-8ea77f073244 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:21.524002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007429a2-db7b-4b90-8382-8ea77f073244 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:21.524528 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007429a2-db7b-4b90-8382-8ea77f073244 admin admin] PATH_INFO: `/v3/projects/1183f05c7baa447bb6c04f41d9e1b536/users/8559fd7d224849cc890e9a05dc46498c/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:21.558885 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007429a2-db7b-4b90-8382-8ea77f073244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1183f05c7baa447bb6c04f41d9e1b536, user_id=8559fd7d224849cc890e9a05dc46498c, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:21.562331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007429a2-db7b-4b90-8382-8ea77f073244 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:21.576883 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc5b2d-d997-45d2-821e-67d171fa69bf admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:21.599109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd0c9b-fd5b-4e3b-b2e2-66bae522ca95 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:21.600297 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd0c9b-fd5b-4e3b-b2e2-66bae522ca95 service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:21.600761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd0c9b-fd5b-4e3b-b2e2-66bae522ca95 service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:21.601499 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd0c9b-fd5b-4e3b-b2e2-66bae522ca95 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:21.610844 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2118/4186] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:09:21 2022] PUT /identity/v3/projects/1183f05c7baa447bb6c04f41d9e1b536/users/8559fd7d224849cc890e9a05dc46498c/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:21.616205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a5fb6-6bac-4b73-ad60-fa8e592b09f9 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:21.617399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-17cd0c9b-fd5b-4e3b-b2e2-66bae522ca95 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:21.618364 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a5fb6-6bac-4b73-ad60-fa8e592b09f9 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:21.618672 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a5fb6-6bac-4b73-ad60-fa8e592b09f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:21.658704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd0c9b-fd5b-4e3b-b2e2-66bae522ca95 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:21.667588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd0c9b-fd5b-4e3b-b2e2-66bae522ca95 service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:21.685448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-101a5fb6-6bac-4b73-ad60-fa8e592b09f9 None None] MFA Rules not processed for user `8559fd7d224849cc890e9a05dc46498c`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:21.697942 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-101a5fb6-6bac-4b73-ad60-fa8e592b09f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:21.723060 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2069/4187] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:09:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:09:21.724288 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd0c9b-fd5b-4e3b-b2e2-66bae522ca95 service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:21.729713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-17cd0c9b-fd5b-4e3b-b2e2-66bae522ca95 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:21.757890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:21.780716 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd0c9b-fd5b-4e3b-b2e2-66bae522ca95 service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:21.896226 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2119/4188] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:21.902257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a5fb6-6bac-4b73-ad60-fa8e592b09f9 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:22.123526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30c8f3-3103-4c03-9fe5-c1499b95fc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:22.124436 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30c8f3-3103-4c03-9fe5-c1499b95fc22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:22.134656 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30c8f3-3103-4c03-9fe5-c1499b95fc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:22.134983 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30c8f3-3103-4c03-9fe5-c1499b95fc22 admin admin] PATH_INFO: `/v3/projects/0a565926e51d490c884c3a8774c1932a` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:22.138200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b30c8f3-3103-4c03-9fe5-c1499b95fc22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a565926e51d490c884c3a8774c1932a)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:22.140081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b30c8f3-3103-4c03-9fe5-c1499b95fc22 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:22.142299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:22.228054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a5fb6-6bac-4b73-ad60-fa8e592b09f9 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:22.254249 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e51d05-a909-4016-888a-adf1933ce6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:22.255092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e51d05-a909-4016-888a-adf1933ce6e0 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:22.255372 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e51d05-a909-4016-888a-adf1933ce6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:22.255651 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e51d05-a909-4016-888a-adf1933ce6e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:22.256280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e51d05-a909-4016-888a-adf1933ce6e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:22.258205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e51d05-a909-4016-888a-adf1933ce6e0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:22.341813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1b30c8f3-3103-4c03-9fe5-c1499b95fc22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a565926e51d490c884c3a8774c1932a', 'request_id': 'req-1b30c8f3-3103-4c03-9fe5-c1499b95fc22'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:22.348770 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2120/4189] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:09:21 2022] POST /identity/v3/projects => generated 371 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:22.352471 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e51d05-a909-4016-888a-adf1933ce6e0 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:22.365991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1b30c8f3-3103-4c03-9fe5-c1499b95fc22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a565926e51d490c884c3a8774c1932a', 'request_id': 'req-1b30c8f3-3103-4c03-9fe5-c1499b95fc22'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:22.386456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1b30c8f3-3103-4c03-9fe5-c1499b95fc22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a565926e51d490c884c3a8774c1932a', 'request_id': 'req-1b30c8f3-3103-4c03-9fe5-c1499b95fc22'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:22.416857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1b30c8f3-3103-4c03-9fe5-c1499b95fc22 admin admin] The token cache is being invalidate because project 0a565926e51d490c884c3a8774c1932a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:09:22.417316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1b30c8f3-3103-4c03-9fe5-c1499b95fc22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:22.419322 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1b30c8f3-3103-4c03-9fe5-c1499b95fc22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:22.423821 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2070/4190] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:09:21 2022] DELETE /identity/v3/projects/0a565926e51d490c884c3a8774c1932a => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:22.432709 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb82e8-691e-49e9-b00f-94600a6235bc None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:22.432709 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb82e8-691e-49e9-b00f-94600a6235bc None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:22.432709 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb82e8-691e-49e9-b00f-94600a6235bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:22.477273 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a7fb82e8-691e-49e9-b00f-94600a6235bc None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:22.478791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a7fb82e8-691e-49e9-b00f-94600a6235bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:22.492833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e51d05-a909-4016-888a-adf1933ce6e0 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:22.505176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b026c-58d9-4ce9-b353-980a5937b793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:22.508606 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b026c-58d9-4ce9-b353-980a5937b793 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:22.509034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b026c-58d9-4ce9-b353-980a5937b793 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:22.509523 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b026c-58d9-4ce9-b353-980a5937b793 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:22.519459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323b026c-58d9-4ce9-b353-980a5937b793 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:22.524827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323b026c-58d9-4ce9-b353-980a5937b793 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:22.530757 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2071/4191] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:22.535381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1245cee-0fa5-4e77-8c74-15a9764fcc41 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:22.537251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1245cee-0fa5-4e77-8c74-15a9764fcc41 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:22.537696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1245cee-0fa5-4e77-8c74-15a9764fcc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:22.578868 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2121/4192] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:09:22 2022] POST /identity/v3/users => generated 292 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:09:22.583085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b026c-58d9-4ce9-b353-980a5937b793 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:22.584913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-323b026c-58d9-4ce9-b353-980a5937b793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:22.614503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-b1245cee-0fa5-4e77-8c74-15a9764fcc41 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:22.615872 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b1245cee-0fa5-4e77-8c74-15a9764fcc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:22.626583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b026c-58d9-4ce9-b353-980a5937b793 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:22.636207 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2072/4193] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:22.641974 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1245cee-0fa5-4e77-8c74-15a9764fcc41 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:22.646359 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183256a-81c1-4b1f-b34b-f9bfea58e8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:22.649374 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183256a-81c1-4b1f-b34b-f9bfea58e8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:22.649635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183256a-81c1-4b1f-b34b-f9bfea58e8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:22.649920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183256a-81c1-4b1f-b34b-f9bfea58e8d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:22.654424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1183256a-81c1-4b1f-b34b-f9bfea58e8d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:22.658699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1183256a-81c1-4b1f-b34b-f9bfea58e8d9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:22.663109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1245cee-0fa5-4e77-8c74-15a9764fcc41 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:22.673562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914631f-c2be-4482-866a-e9ec90218391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:22.676514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914631f-c2be-4482-866a-e9ec90218391 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:22.676987 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914631f-c2be-4482-866a-e9ec90218391 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:22.677221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914631f-c2be-4482-866a-e9ec90218391 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:22.678175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d914631f-c2be-4482-866a-e9ec90218391 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:09:22.678498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d914631f-c2be-4482-866a-e9ec90218391 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:22.680853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d914631f-c2be-4482-866a-e9ec90218391 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:22.695103 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2122/4194] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:09:22.698783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183256a-81c1-4b1f-b34b-f9bfea58e8d9 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:22.700520 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2073/4195] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:09:22.705138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914631f-c2be-4482-866a-e9ec90218391 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:22.726125 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914631f-c2be-4482-866a-e9ec90218391 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:22.731567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183256a-81c1-4b1f-b34b-f9bfea58e8d9 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:22.735544 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba9ac9-3da9-4239-afb6-79e67c7ffbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:22.738615 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba9ac9-3da9-4239-afb6-79e67c7ffbbf admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:22.738990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba9ac9-3da9-4239-afb6-79e67c7ffbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:22.739728 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba9ac9-3da9-4239-afb6-79e67c7ffbbf admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:22.740592 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba9ac9-3da9-4239-afb6-79e67c7ffbbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:22.742847 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214bc83-fa1a-4434-83e0-bc96013a4333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:22.745005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba9ac9-3da9-4239-afb6-79e67c7ffbbf admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:22.745495 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214bc83-fa1a-4434-83e0-bc96013a4333 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:22.746439 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214bc83-fa1a-4434-83e0-bc96013a4333 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:22.747234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214bc83-fa1a-4434-83e0-bc96013a4333 admin admin] PATH_INFO: `/v3/projects/8c776f7b8ebb421280793c3b68445cbd/users/daf9605e9f3946a0879b9783e478c62f/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:22.804079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214bc83-fa1a-4434-83e0-bc96013a4333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c776f7b8ebb421280793c3b68445cbd, user_id=daf9605e9f3946a0879b9783e478c62f, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:22.808371 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2074/4196] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:09:22 2022] POST /identity/v3/projects => generated 391 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:22.809334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214bc83-fa1a-4434-83e0-bc96013a4333 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:22.812290 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba9ac9-3da9-4239-afb6-79e67c7ffbbf admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:22.834670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:22.855610 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2123/4197] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:09:22 2022] PUT /identity/v3/projects/8c776f7b8ebb421280793c3b68445cbd/users/daf9605e9f3946a0879b9783e478c62f/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:22.859468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214bc83-fa1a-4434-83e0-bc96013a4333 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:23.091779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214bc83-fa1a-4434-83e0-bc96013a4333 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:23.097234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba9ac9-3da9-4239-afb6-79e67c7ffbbf admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:23.136553 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437c25f-056a-4ca0-ad81-8f71468f6f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:23.142003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437c25f-056a-4ca0-ad81-8f71468f6f20 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:23.142307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437c25f-056a-4ca0-ad81-8f71468f6f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:23.142645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437c25f-056a-4ca0-ad81-8f71468f6f20 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:23.149538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6437c25f-056a-4ca0-ad81-8f71468f6f20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:23.152731 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc25d5-fe64-4657-bd51-6c77a2c8620b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:23.153656 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc25d5-fe64-4657-bd51-6c77a2c8620b admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:23.154127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc25d5-fe64-4657-bd51-6c77a2c8620b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:23.156775 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc25d5-fe64-4657-bd51-6c77a2c8620b admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:23.157787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc25d5-fe64-4657-bd51-6c77a2c8620b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:23.164666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc25d5-fe64-4657-bd51-6c77a2c8620b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:23.173639 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6437c25f-056a-4ca0-ad81-8f71468f6f20 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:23.197039 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2124/4198] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:09:23.201070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc25d5-fe64-4657-bd51-6c77a2c8620b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:23.243154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc25d5-fe64-4657-bd51-6c77a2c8620b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:23.270839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39126c1c-c28d-49bc-8b6d-6a1dab24424a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:23.271527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39126c1c-c28d-49bc-8b6d-6a1dab24424a admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:23.272309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39126c1c-c28d-49bc-8b6d-6a1dab24424a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:23.272598 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39126c1c-c28d-49bc-8b6d-6a1dab24424a admin admin] PATH_INFO: `/v3/projects/8c776f7b8ebb421280793c3b68445cbd/users/daf9605e9f3946a0879b9783e478c62f/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:23.273456 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2075/4199] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:09:22 2022] POST /identity/v3/users => generated 302 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:23.274648 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437c25f-056a-4ca0-ad81-8f71468f6f20 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:23.279652 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39126c1c-c28d-49bc-8b6d-6a1dab24424a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c776f7b8ebb421280793c3b68445cbd, user_id=daf9605e9f3946a0879b9783e478c62f, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:23.287830 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39126c1c-c28d-49bc-8b6d-6a1dab24424a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:23.311290 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437c25f-056a-4ca0-ad81-8f71468f6f20 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:23.321720 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2125/4200] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:09:23 2022] PUT /identity/v3/projects/8c776f7b8ebb421280793c3b68445cbd/users/daf9605e9f3946a0879b9783e478c62f/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:23.333920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286e130-cd07-49d1-aa90-05ed5dbeae45 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:23.334249 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286e130-cd07-49d1-aa90-05ed5dbeae45 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:23.334615 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286e130-cd07-49d1-aa90-05ed5dbeae45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:23.398123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:23.416142 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-c286e130-cd07-49d1-aa90-05ed5dbeae45 None None] MFA Rules not processed for user `daf9605e9f3946a0879b9783e478c62f`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:23.422189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c286e130-cd07-49d1-aa90-05ed5dbeae45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:23.560941 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97864d0-db93-41bb-8998-135d26d6ca36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:23.567838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97864d0-db93-41bb-8998-135d26d6ca36 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:23.570955 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97864d0-db93-41bb-8998-135d26d6ca36 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:23.571612 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97864d0-db93-41bb-8998-135d26d6ca36 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:23.573938 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97864d0-db93-41bb-8998-135d26d6ca36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:23.589931 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97864d0-db93-41bb-8998-135d26d6ca36 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:23.636784 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2076/4201] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:09:23.655297 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97864d0-db93-41bb-8998-135d26d6ca36 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:23.701719 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2126/4202] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:09:23.708164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286e130-cd07-49d1-aa90-05ed5dbeae45 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:23.719058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97864d0-db93-41bb-8998-135d26d6ca36 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:23.749123 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286e130-cd07-49d1-aa90-05ed5dbeae45 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:23.750930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c65146-5aea-43a1-a3de-f7bd71abf8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:23.752162 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c65146-5aea-43a1-a3de-f7bd71abf8f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:23.754063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c65146-5aea-43a1-a3de-f7bd71abf8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:23.754984 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c65146-5aea-43a1-a3de-f7bd71abf8f7 admin admin] PATH_INFO: `/v3/projects/fe45cffcf6c34359b9a19da0cb3dcf58/users/71f22a95b8484c94a823a139ec54fcbb/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:23.769076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc048ac-3c4f-45b4-8c45-96c4c3c2a382 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daf9605e9f3946a0879b9783e478c62f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c776f7b8ebb421280793c3b68445cbd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:23.770105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc048ac-3c4f-45b4-8c45-96c4c3c2a382 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:23.772092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc048ac-3c4f-45b4-8c45-96c4c3c2a382 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:23.772850 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc048ac-3c4f-45b4-8c45-96c4c3c2a382 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:23.774487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc048ac-3c4f-45b4-8c45-96c4c3c2a382 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:23.779760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc048ac-3c4f-45b4-8c45-96c4c3c2a382 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:23.821431 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c65146-5aea-43a1-a3de-f7bd71abf8f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe45cffcf6c34359b9a19da0cb3dcf58, user_id=71f22a95b8484c94a823a139ec54fcbb, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:23.842318 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2127/4203] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:09:23 2022] POST /identity/v3/services => generated 287 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:23.845427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc048ac-3c4f-45b4-8c45-96c4c3c2a382 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:23.860677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c65146-5aea-43a1-a3de-f7bd71abf8f7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:23.910641 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2077/4204] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:09:23 2022] PUT /identity/v3/projects/fe45cffcf6c34359b9a19da0cb3dcf58/users/71f22a95b8484c94a823a139ec54fcbb/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:23.911787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c65146-5aea-43a1-a3de-f7bd71abf8f7 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:23.949248 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc048ac-3c4f-45b4-8c45-96c4c3c2a382 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:24.101883 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c65146-5aea-43a1-a3de-f7bd71abf8f7 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:24.149978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf45b1-b2b2-40d2-8908-f37b1619cbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:24.151138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf45b1-b2b2-40d2-8908-f37b1619cbb9 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:24.151614 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf45b1-b2b2-40d2-8908-f37b1619cbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:24.152051 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf45b1-b2b2-40d2-8908-f37b1619cbb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:24.152979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf45b1-b2b2-40d2-8908-f37b1619cbb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:24.157806 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf45b1-b2b2-40d2-8908-f37b1619cbb9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:24.169944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:24.189221 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2078/4205] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:09:24.193881 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf45b1-b2b2-40d2-8908-f37b1619cbb9 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:24.213308 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf45b1-b2b2-40d2-8908-f37b1619cbb9 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:24.220411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5badcafd-24fe-4378-951b-6aac981380a8 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daf9605e9f3946a0879b9783e478c62f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c776f7b8ebb421280793c3b68445cbd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:24.223170 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badcafd-24fe-4378-951b-6aac981380a8 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:24.226169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badcafd-24fe-4378-951b-6aac981380a8 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:24.226598 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badcafd-24fe-4378-951b-6aac981380a8 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:24.229788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5badcafd-24fe-4378-951b-6aac981380a8 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:24.233232 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-5badcafd-24fe-4378-951b-6aac981380a8 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:24.233232 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:09:24.233232 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:09:24.240256 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5badcafd-24fe-4378-951b-6aac981380a8 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:24.245171 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7bdf8-dc19-46a3-8e5a-efb073cec0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:24.246112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7bdf8-dc19-46a3-8e5a-efb073cec0d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:24.246580 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7bdf8-dc19-46a3-8e5a-efb073cec0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:24.247015 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7bdf8-dc19-46a3-8e5a-efb073cec0d3 admin admin] PATH_INFO: `/v3/projects/fe45cffcf6c34359b9a19da0cb3dcf58/users/71f22a95b8484c94a823a139ec54fcbb/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:24.252481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7bdf8-dc19-46a3-8e5a-efb073cec0d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe45cffcf6c34359b9a19da0cb3dcf58, user_id=71f22a95b8484c94a823a139ec54fcbb, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:24.262118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7bdf8-dc19-46a3-8e5a-efb073cec0d3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:24.290016 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2128/4206] 10.222.0.33 () {60 vars in 1213 bytes} [Sat Aug 6 21:09:23 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 332 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:24.293773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5badcafd-24fe-4378-951b-6aac981380a8 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:24.311776 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2079/4207] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:09:24 2022] PUT /identity/v3/projects/fe45cffcf6c34359b9a19da0cb3dcf58/users/71f22a95b8484c94a823a139ec54fcbb/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:24.325365 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bead81-ec19-475c-8366-7fb91a65059c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:24.325928 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bead81-ec19-475c-8366-7fb91a65059c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:24.326392 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bead81-ec19-475c-8366-7fb91a65059c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:24.355413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5badcafd-24fe-4378-951b-6aac981380a8 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:24.457427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a4bead81-ec19-475c-8366-7fb91a65059c None None] MFA Rules not processed for user `71f22a95b8484c94a823a139ec54fcbb`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:24.464242 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a4bead81-ec19-475c-8366-7fb91a65059c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:24.483666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0a877-7e32-447e-a9b4-c5e28f541337 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daf9605e9f3946a0879b9783e478c62f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c776f7b8ebb421280793c3b68445cbd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:24.484547 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0a877-7e32-447e-a9b4-c5e28f541337 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:24.484842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0a877-7e32-447e-a9b4-c5e28f541337 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:24.485170 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0a877-7e32-447e-a9b4-c5e28f541337 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:24.486292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c0a877-7e32-447e-a9b4-c5e28f541337 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:24.489056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c0a877-7e32-447e-a9b4-c5e28f541337 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:24.577396 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2129/4208] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:09:24 2022] POST /identity/v3/services => generated 288 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:24.582423 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0a877-7e32-447e-a9b4-c5e28f541337 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:24.626486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0a877-7e32-447e-a9b4-c5e28f541337 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:24.647330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a670434-3014-44d6-8c59-4811a43c8467 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daf9605e9f3946a0879b9783e478c62f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c776f7b8ebb421280793c3b68445cbd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:24.647994 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a670434-3014-44d6-8c59-4811a43c8467 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:24.648280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a670434-3014-44d6-8c59-4811a43c8467 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:24.648563 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a670434-3014-44d6-8c59-4811a43c8467 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:24.653111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a670434-3014-44d6-8c59-4811a43c8467 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:24.655911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a670434-3014-44d6-8c59-4811a43c8467 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:24.692090 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2130/4209] 10.222.0.33 () {60 vars in 1213 bytes} [Sat Aug 6 21:09:24 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 331 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:24.696068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a670434-3014-44d6-8c59-4811a43c8467 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:24.710989 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a670434-3014-44d6-8c59-4811a43c8467 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:24.720859 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f4d42-3f3b-4c54-881c-af657cd72c51 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daf9605e9f3946a0879b9783e478c62f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c776f7b8ebb421280793c3b68445cbd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:24.722183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f4d42-3f3b-4c54-881c-af657cd72c51 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:24.722863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f4d42-3f3b-4c54-881c-af657cd72c51 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:24.723423 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f4d42-3f3b-4c54-881c-af657cd72c51 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:24.724422 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f4d42-3f3b-4c54-881c-af657cd72c51 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:24.726185 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-736f4d42-3f3b-4c54-881c-af657cd72c51 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:24.726185 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:09:24.726185 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:09:24.728099 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f4d42-3f3b-4c54-881c-af657cd72c51 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:24.815729 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2131/4210] 10.222.0.33 () {58 vars in 1191 bytes} [Sat Aug 6 21:09:24 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 761 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:09:24.836787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f4d42-3f3b-4c54-881c-af657cd72c51 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:24.944400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f4d42-3f3b-4c54-881c-af657cd72c51 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:24.949501 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2080/4211] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:24 2022] POST /identity/v3/auth/tokens => generated 3600 bytes in 626 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:09:24.953745 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bead81-ec19-475c-8366-7fb91a65059c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:24.999129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:25.057055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b12a56-260e-4dd1-ab41-e87757aae6ec tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daf9605e9f3946a0879b9783e478c62f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c776f7b8ebb421280793c3b68445cbd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:25.057943 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b12a56-260e-4dd1-ab41-e87757aae6ec tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:25.058354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b12a56-260e-4dd1-ab41-e87757aae6ec tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:25.058848 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b12a56-260e-4dd1-ab41-e87757aae6ec tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/e078b3c18b78415c912e9234757d88f4` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:25.059467 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b12a56-260e-4dd1-ab41-e87757aae6ec tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=e078b3c18b78415c912e9234757d88f4)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:25.064239 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-61b12a56-260e-4dd1-ab41-e87757aae6ec tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:25.064239 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:09:25.064239 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:09:25.072658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b12a56-260e-4dd1-ab41-e87757aae6ec tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:25.106975 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2132/4212] 10.222.0.33 () {58 vars in 1290 bytes} [Sat Aug 6 21:09:24 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/e078b3c18b78415c912e9234757d88f4 => generated 331 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:09:25.108210 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b12a56-260e-4dd1-ab41-e87757aae6ec tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:25.167709 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b12a56-260e-4dd1-ab41-e87757aae6ec tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:25.227588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3569c-9714-4f09-a7f3-364e05a85141 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daf9605e9f3946a0879b9783e478c62f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c776f7b8ebb421280793c3b68445cbd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:25.245286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3569c-9714-4f09-a7f3-364e05a85141 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] REQUEST_METHOD: `HEAD` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:25.262578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3569c-9714-4f09-a7f3-364e05a85141 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:25.262578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3569c-9714-4f09-a7f3-364e05a85141 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/e078b3c18b78415c912e9234757d88f4` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:25.273568 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3569c-9714-4f09-a7f3-364e05a85141 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=e078b3c18b78415c912e9234757d88f4)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:25.280968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3569c-9714-4f09-a7f3-364e05a85141 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:25.322733 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2133/4213] 10.222.0.33 () {58 vars in 1291 bytes} [Sat Aug 6 21:09:25 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/e078b3c18b78415c912e9234757d88f4 => generated 0 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 06 21:09:25.332316 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3569c-9714-4f09-a7f3-364e05a85141 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:25.394134 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3569c-9714-4f09-a7f3-364e05a85141 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:25.397818 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bead81-ec19-475c-8366-7fb91a65059c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:25.410928 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca92370-0eac-4265-86eb-05d97aef2768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:25.411346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca92370-0eac-4265-86eb-05d97aef2768 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:25.411624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca92370-0eac-4265-86eb-05d97aef2768 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:25.412086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca92370-0eac-4265-86eb-05d97aef2768 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:25.412900 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca92370-0eac-4265-86eb-05d97aef2768 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:25.421348 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243b444-cb22-4cbe-ace6-56c695cc408d tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daf9605e9f3946a0879b9783e478c62f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c776f7b8ebb421280793c3b68445cbd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:25.422598 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243b444-cb22-4cbe-ace6-56c695cc408d tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:25.424911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243b444-cb22-4cbe-ace6-56c695cc408d tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:25.425242 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243b444-cb22-4cbe-ace6-56c695cc408d tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/e078b3c18b78415c912e9234757d88f4` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:25.429280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7243b444-cb22-4cbe-ace6-56c695cc408d tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=e078b3c18b78415c912e9234757d88f4)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:25.437558 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-7243b444-cb22-4cbe-ace6-56c695cc408d tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:25.437558 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:09:25.437558 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:09:25.437906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca92370-0eac-4265-86eb-05d97aef2768 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:25.439420 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7243b444-cb22-4cbe-ace6-56c695cc408d tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:25.492621 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2134/4214] 10.222.0.33 () {58 vars in 1293 bytes} [Sat Aug 6 21:09:25 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/e078b3c18b78415c912e9234757d88f4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:25.494832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243b444-cb22-4cbe-ace6-56c695cc408d tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:25.520697 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2081/4215] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:09:24 2022] POST /identity/v3/projects => generated 393 bytes in 567 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:25.525227 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca92370-0eac-4265-86eb-05d97aef2768 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:25.549217 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243b444-cb22-4cbe-ace6-56c695cc408d tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:25.748636 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644fe6cd-29c7-462d-a74e-1edd3561ef17 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daf9605e9f3946a0879b9783e478c62f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c776f7b8ebb421280793c3b68445cbd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:25.749455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fe6cd-29c7-462d-a74e-1edd3561ef17 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:25.749844 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fe6cd-29c7-462d-a74e-1edd3561ef17 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:25.750134 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fe6cd-29c7-462d-a74e-1edd3561ef17 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:25.751643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644fe6cd-29c7-462d-a74e-1edd3561ef17 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:25.755463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644fe6cd-29c7-462d-a74e-1edd3561ef17 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:25.771343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca92370-0eac-4265-86eb-05d97aef2768 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:25.774853 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2135/4216] 10.222.0.33 () {58 vars in 1191 bytes} [Sat Aug 6 21:09:25 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 449 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:09:25.776870 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644fe6cd-29c7-462d-a74e-1edd3561ef17 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:25.788113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f260e9-b8fe-44cb-9564-df9e844a6cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:25.788976 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f260e9-b8fe-44cb-9564-df9e844a6cd0 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:25.789257 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f260e9-b8fe-44cb-9564-df9e844a6cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:25.789531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f260e9-b8fe-44cb-9564-df9e844a6cd0 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:25.790154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f260e9-b8fe-44cb-9564-df9e844a6cd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:25.792330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f260e9-b8fe-44cb-9564-df9e844a6cd0 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:25.803186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644fe6cd-29c7-462d-a74e-1edd3561ef17 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:25.818635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825278f1-1de2-44db-9f3d-f4d86cefc411 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daf9605e9f3946a0879b9783e478c62f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c776f7b8ebb421280793c3b68445cbd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:25.819255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825278f1-1de2-44db-9f3d-f4d86cefc411 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:25.822863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825278f1-1de2-44db-9f3d-f4d86cefc411 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:25.823237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825278f1-1de2-44db-9f3d-f4d86cefc411 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/e078b3c18b78415c912e9234757d88f4` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:25.823970 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825278f1-1de2-44db-9f3d-f4d86cefc411 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=e078b3c18b78415c912e9234757d88f4)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:25.829923 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825278f1-1de2-44db-9f3d-f4d86cefc411 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:25.848826 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2082/4217] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:09:25 2022] POST /identity/v3/users => generated 297 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:25.852688 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f260e9-b8fe-44cb-9564-df9e844a6cd0 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:25.864595 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-825278f1-1de2-44db-9f3d-f4d86cefc411 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Could not find Endpoint Group: e078b3c18b78415c912e9234757d88f4.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: e078b3c18b78415c912e9234757d88f4. Aug 06 21:09:25.864595 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:09:25.864595 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:09:25.864595 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:09:25.864595 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:09:25.864595 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:09:25.864595 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:09:25.864595 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:09:25.864595 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:09:25.864595 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:09:25.864595 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:09:25.864595 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:09:25.864595 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Aug 06 21:09:25.864595 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Aug 06 21:09:25.865799 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Aug 06 21:09:25.865799 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Aug 06 21:09:25.865799 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Aug 06 21:09:25.865799 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Aug 06 21:09:25.865799 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: e078b3c18b78415c912e9234757d88f4. Aug 06 21:09:25.865799 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:09:25.870352 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2136/4218] 10.222.0.33 () {58 vars in 1293 bytes} [Sat Aug 6 21:09:25 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/e078b3c18b78415c912e9234757d88f4 => generated 120 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:09:25.871806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825278f1-1de2-44db-9f3d-f4d86cefc411 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:25.877451 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f260e9-b8fe-44cb-9564-df9e844a6cd0 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:25.903919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb37679-0021-49a1-ba8d-fadd283d70ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:25.905232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb37679-0021-49a1-ba8d-fadd283d70ed admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:25.905517 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb37679-0021-49a1-ba8d-fadd283d70ed admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:25.905795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb37679-0021-49a1-ba8d-fadd283d70ed admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:25.908638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb37679-0021-49a1-ba8d-fadd283d70ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:25.912104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb37679-0021-49a1-ba8d-fadd283d70ed admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:25.936916 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825278f1-1de2-44db-9f3d-f4d86cefc411 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:25.962927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5446b5-9ab8-400d-a0c9-9997013bf8fe tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daf9605e9f3946a0879b9783e478c62f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c776f7b8ebb421280793c3b68445cbd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:25.963459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5446b5-9ab8-400d-a0c9-9997013bf8fe tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:25.963596 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2083/4219] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:09:25.964512 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5446b5-9ab8-400d-a0c9-9997013bf8fe tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:25.964873 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5446b5-9ab8-400d-a0c9-9997013bf8fe tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] PATH_INFO: `/v3/services/7730559e14414cbfb6d632a13bb51c9f` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:25.965796 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb37679-0021-49a1-ba8d-fadd283d70ed admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:25.967479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5446b5-9ab8-400d-a0c9-9997013bf8fe tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorizing `identity:delete_service(service_id=7730559e14414cbfb6d632a13bb51c9f)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:25.973022 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5446b5-9ab8-400d-a0c9-9997013bf8fe tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:25.988102 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:26.001908 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb37679-0021-49a1-ba8d-fadd283d70ed admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:26.027363 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4862836-deda-4590-bd2f-bcf065f4e044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:26.032176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4862836-deda-4590-bd2f-bcf065f4e044 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:26.032463 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4862836-deda-4590-bd2f-bcf065f4e044 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:26.038354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4862836-deda-4590-bd2f-bcf065f4e044 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:26.038872 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4862836-deda-4590-bd2f-bcf065f4e044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:26.046636 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4862836-deda-4590-bd2f-bcf065f4e044 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:26.069776 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2137/4220] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:09:25 2022] DELETE /identity/v3/services/7730559e14414cbfb6d632a13bb51c9f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:26.078001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5446b5-9ab8-400d-a0c9-9997013bf8fe tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:26.091898 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2084/4221] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:09:26.092930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4862836-deda-4590-bd2f-bcf065f4e044 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:26.123523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4862836-deda-4590-bd2f-bcf065f4e044 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:26.189386 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f53269-8628-47e9-9587-b1946dc3c165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:26.191881 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f53269-8628-47e9-9587-b1946dc3c165 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:26.192159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f53269-8628-47e9-9587-b1946dc3c165 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:26.192954 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5446b5-9ab8-400d-a0c9-9997013bf8fe tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:26.194066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f53269-8628-47e9-9587-b1946dc3c165 admin admin] PATH_INFO: `/v3/projects/65aea8c33ad1467490ba721eaf17120a/users/8c929d1eb837476f8561259a70b8a0e5/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:26.211552 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8bbf65-0242-4f68-a179-3ae66baf8076 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daf9605e9f3946a0879b9783e478c62f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c776f7b8ebb421280793c3b68445cbd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:26.212184 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bbf65-0242-4f68-a179-3ae66baf8076 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:26.214711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bbf65-0242-4f68-a179-3ae66baf8076 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:26.215037 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bbf65-0242-4f68-a179-3ae66baf8076 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:26.215915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8bbf65-0242-4f68-a179-3ae66baf8076 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:26.223895 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8bbf65-0242-4f68-a179-3ae66baf8076 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:26.250663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f53269-8628-47e9-9587-b1946dc3c165 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65aea8c33ad1467490ba721eaf17120a, user_id=8c929d1eb837476f8561259a70b8a0e5, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:26.258282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f53269-8628-47e9-9587-b1946dc3c165 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:26.265561 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2138/4222] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:09:26 2022] POST /identity/v3/services => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:26.267106 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8bbf65-0242-4f68-a179-3ae66baf8076 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:26.334346 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2085/4223] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:09:26 2022] PUT /identity/v3/projects/65aea8c33ad1467490ba721eaf17120a/users/8c929d1eb837476f8561259a70b8a0e5/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:26.334346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f53269-8628-47e9-9587-b1946dc3c165 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:26.334346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c6f53269-8628-47e9-9587-b1946dc3c165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:26.343735 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8bbf65-0242-4f68-a179-3ae66baf8076 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:26.376938 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:26.547722 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fafe2-3365-4fca-85c5-a4d6816638b8 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daf9605e9f3946a0879b9783e478c62f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c776f7b8ebb421280793c3b68445cbd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:26.549222 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fafe2-3365-4fca-85c5-a4d6816638b8 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:26.549222 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fafe2-3365-4fca-85c5-a4d6816638b8 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:26.549552 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fafe2-3365-4fca-85c5-a4d6816638b8 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:26.550090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320fafe2-3365-4fca-85c5-a4d6816638b8 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:26.567230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320fafe2-3365-4fca-85c5-a4d6816638b8 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:26.577528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f53269-8628-47e9-9587-b1946dc3c165 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:26.590416 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2139/4224] 10.222.0.33 () {60 vars in 1213 bytes} [Sat Aug 6 21:09:26 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 332 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:26.590416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91839c-1472-4486-a9a0-34c0893293d8 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:26.590416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91839c-1472-4486-a9a0-34c0893293d8 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:26.590416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91839c-1472-4486-a9a0-34c0893293d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:26.620230 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0a9ee-78f7-4f09-8fc9-7494892e0a09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:26.620880 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0a9ee-78f7-4f09-8fc9-7494892e0a09 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:26.623533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0a9ee-78f7-4f09-8fc9-7494892e0a09 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:26.623829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0a9ee-78f7-4f09-8fc9-7494892e0a09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:26.631396 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e1d0a9ee-78f7-4f09-8fc9-7494892e0a09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:26.687594 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0a9ee-78f7-4f09-8fc9-7494892e0a09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:26.687807 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-0f91839c-1472-4486-a9a0-34c0893293d8 None None] MFA Rules not processed for user `8c929d1eb837476f8561259a70b8a0e5`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:26.689323 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0f91839c-1472-4486-a9a0-34c0893293d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:26.700653 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0a9ee-78f7-4f09-8fc9-7494892e0a09 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:26.740329 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2086/4225] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:09:26 2022] GET /identity/v3/auth/tokens => generated 3638 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:09:26.744621 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0a9ee-78f7-4f09-8fc9-7494892e0a09 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:26.769099 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0a9ee-78f7-4f09-8fc9-7494892e0a09 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:26.779586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b22dc8-2fe0-405d-a067-54442f59f0ed tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daf9605e9f3946a0879b9783e478c62f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c776f7b8ebb421280793c3b68445cbd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:26.780321 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b22dc8-2fe0-405d-a067-54442f59f0ed tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:26.780623 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b22dc8-2fe0-405d-a067-54442f59f0ed tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:26.782372 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b22dc8-2fe0-405d-a067-54442f59f0ed tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] PATH_INFO: `/v3/services` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:26.783373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b22dc8-2fe0-405d-a067-54442f59f0ed tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:26.786395 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b22dc8-2fe0-405d-a067-54442f59f0ed tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:26.826765 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2087/4226] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:09:26 2022] POST /identity/v3/services => generated 289 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:26.831123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b22dc8-2fe0-405d-a067-54442f59f0ed tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:26.873988 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2140/4227] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:26 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:26.875364 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f91839c-1472-4486-a9a0-34c0893293d8 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:26.879007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0f91839c-1472-4486-a9a0-34c0893293d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:26.926167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b22dc8-2fe0-405d-a067-54442f59f0ed tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:26.945572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e72d2-c4e5-4f86-af59-89e711e5f3c7 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daf9605e9f3946a0879b9783e478c62f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c776f7b8ebb421280793c3b68445cbd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:26.946290 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e72d2-c4e5-4f86-af59-89e711e5f3c7 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:26.946603 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e72d2-c4e5-4f86-af59-89e711e5f3c7 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:26.946889 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e72d2-c4e5-4f86-af59-89e711e5f3c7 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/bf199af8ddd64da19b16766f7eb949f0` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:26.951129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20e72d2-c4e5-4f86-af59-89e711e5f3c7 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=bf199af8ddd64da19b16766f7eb949f0)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:26.952181 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-a20e72d2-c4e5-4f86-af59-89e711e5f3c7 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:26.952181 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:09:26.952181 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:09:26.953099 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20e72d2-c4e5-4f86-af59-89e711e5f3c7 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:27.007139 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2088/4228] 10.222.0.33 () {60 vars in 1313 bytes} [Sat Aug 6 21:09:26 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/bf199af8ddd64da19b16766f7eb949f0 => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:09:27.008954 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e72d2-c4e5-4f86-af59-89e711e5f3c7 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:27.029771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:27.041037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e72d2-c4e5-4f86-af59-89e711e5f3c7 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:27.055641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa26ad3-1107-48de-bfe4-9499c791f6c9 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daf9605e9f3946a0879b9783e478c62f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c776f7b8ebb421280793c3b68445cbd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:27.056574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa26ad3-1107-48de-bfe4-9499c791f6c9 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:27.057057 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa26ad3-1107-48de-bfe4-9499c791f6c9 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:27.057559 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa26ad3-1107-48de-bfe4-9499c791f6c9 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] PATH_INFO: `/v3/services/5e5a9c7482754871b0d8c7e5035e8251` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:27.058402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa26ad3-1107-48de-bfe4-9499c791f6c9 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorizing `identity:delete_service(service_id=5e5a9c7482754871b0d8c7e5035e8251)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:27.060343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa26ad3-1107-48de-bfe4-9499c791f6c9 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:27.072608 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f91839c-1472-4486-a9a0-34c0893293d8 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:27.082335 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33966256-9c8f-45d3-885f-a69ca95c689c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10759b2abd4cafacf338551327775e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:27.083251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33966256-9c8f-45d3-885f-a69ca95c689c service glance] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:27.084270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33966256-9c8f-45d3-885f-a69ca95c689c service glance] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:27.084660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33966256-9c8f-45d3-885f-a69ca95c689c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:27.111595 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2089/4229] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:09:27 2022] DELETE /identity/v3/services/5e5a9c7482754871b0d8c7e5035e8251 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:27.120965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa26ad3-1107-48de-bfe4-9499c791f6c9 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:27.158160 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa26ad3-1107-48de-bfe4-9499c791f6c9 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:27.169755 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833fd80-9d61-4c01-90e1-04675e8f525e tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daf9605e9f3946a0879b9783e478c62f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c776f7b8ebb421280793c3b68445cbd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:27.171345 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833fd80-9d61-4c01-90e1-04675e8f525e tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:27.173047 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833fd80-9d61-4c01-90e1-04675e8f525e tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:27.173342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833fd80-9d61-4c01-90e1-04675e8f525e tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/bf199af8ddd64da19b16766f7eb949f0` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:27.173989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833fd80-9d61-4c01-90e1-04675e8f525e tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=bf199af8ddd64da19b16766f7eb949f0)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:27.177577 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-8833fd80-9d61-4c01-90e1-04675e8f525e tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:27.177577 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:09:27.177577 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:09:27.178575 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833fd80-9d61-4c01-90e1-04675e8f525e tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:27.225901 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2090/4230] 10.222.0.33 () {58 vars in 1293 bytes} [Sat Aug 6 21:09:27 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/bf199af8ddd64da19b16766f7eb949f0 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:27.228775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833fd80-9d61-4c01-90e1-04675e8f525e tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:27.257402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33966256-9c8f-45d3-885f-a69ca95c689c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:27.261643 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833fd80-9d61-4c01-90e1-04675e8f525e tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:27.262530 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33966256-9c8f-45d3-885f-a69ca95c689c service glance] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:27.278294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7074e96-0e51-46e2-801a-f670e40b1175 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daf9605e9f3946a0879b9783e478c62f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c776f7b8ebb421280793c3b68445cbd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:27.278294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7074e96-0e51-46e2-801a-f670e40b1175 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:27.278647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7074e96-0e51-46e2-801a-f670e40b1175 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:27.279288 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7074e96-0e51-46e2-801a-f670e40b1175 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] PATH_INFO: `/v3/services/23e1a584157f4a5cac4ee2de71dd4f32` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:27.279742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7074e96-0e51-46e2-801a-f670e40b1175 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorizing `identity:delete_service(service_id=23e1a584157f4a5cac4ee2de71dd4f32)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:27.281375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7074e96-0e51-46e2-801a-f670e40b1175 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:27.312973 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2141/4231] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:09:26 2022] GET /identity/v3/auth/tokens => generated 3601 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:09:27.328117 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2091/4232] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:09:27 2022] DELETE /identity/v3/services/23e1a584157f4a5cac4ee2de71dd4f32 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:27.335664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33966256-9c8f-45d3-885f-a69ca95c689c service glance] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:27.364961 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33966256-9c8f-45d3-885f-a69ca95c689c service glance] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:27.436641 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac0291-52b5-4a8f-923e-88f376bae28e tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daf9605e9f3946a0879b9783e478c62f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c776f7b8ebb421280793c3b68445cbd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:27.436641 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac0291-52b5-4a8f-923e-88f376bae28e tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:27.436641 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac0291-52b5-4a8f-923e-88f376bae28e tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:27.438269 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac0291-52b5-4a8f-923e-88f376bae28e tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/8d2c81d2b6b54d2cae276206995c2ba4` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:27.454235 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac0291-52b5-4a8f-923e-88f376bae28e tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=8d2c81d2b6b54d2cae276206995c2ba4)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:27.462525 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac0291-52b5-4a8f-923e-88f376bae28e tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:27.485204 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2142/4233] 10.222.0.33 () {58 vars in 1293 bytes} [Sat Aug 6 21:09:27 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/8d2c81d2b6b54d2cae276206995c2ba4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:27.489352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7074e96-0e51-46e2-801a-f670e40b1175 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:27.509004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7074e96-0e51-46e2-801a-f670e40b1175 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:27.515917 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f5d20-f055-4b67-baae-8385cd08f236 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daf9605e9f3946a0879b9783e478c62f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c776f7b8ebb421280793c3b68445cbd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:27.519163 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f5d20-f055-4b67-baae-8385cd08f236 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:27.522941 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f5d20-f055-4b67-baae-8385cd08f236 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:27.523641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f5d20-f055-4b67-baae-8385cd08f236 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] PATH_INFO: `/v3/services/12440acaa2ff4285901ebb481e5f3528` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:27.524641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f5d20-f055-4b67-baae-8385cd08f236 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorizing `identity:delete_service(service_id=12440acaa2ff4285901ebb481e5f3528)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:27.526729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f5d20-f055-4b67-baae-8385cd08f236 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:27.580184 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2092/4234] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:09:27 2022] DELETE /identity/v3/services/12440acaa2ff4285901ebb481e5f3528 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:27.585182 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac0291-52b5-4a8f-923e-88f376bae28e tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:27.764838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac0291-52b5-4a8f-923e-88f376bae28e tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:27.801718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f5d20-f055-4b67-baae-8385cd08f236 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:27.802149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-bf4f5d20-f055-4b67-baae-8385cd08f236 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:27.832117 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3033f-0666-40b4-92f5-b3beb8a1235e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:27.833874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3033f-0666-40b4-92f5-b3beb8a1235e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:27.835252 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3033f-0666-40b4-92f5-b3beb8a1235e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:27.835540 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3033f-0666-40b4-92f5-b3beb8a1235e admin admin] PATH_INFO: `/v3/users/8559fd7d224849cc890e9a05dc46498c` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:27.839481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f3033f-0666-40b4-92f5-b3beb8a1235e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8559fd7d224849cc890e9a05dc46498c)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:27.844068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f3033f-0666-40b4-92f5-b3beb8a1235e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:27.870244 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:UPDATE=1,keystone:DELETE=8 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:28.031101 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:28.053927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-47f3033f-0666-40b4-92f5-b3beb8a1235e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8559fd7d224849cc890e9a05dc46498c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:28.079261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-47f3033f-0666-40b4-92f5-b3beb8a1235e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8559fd7d224849cc890e9a05dc46498c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:28.084186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-47f3033f-0666-40b4-92f5-b3beb8a1235e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8559fd7d224849cc890e9a05dc46498c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:28.085700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-47f3033f-0666-40b4-92f5-b3beb8a1235e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8559fd7d224849cc890e9a05dc46498c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:28.117951 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f5d20-f055-4b67-baae-8385cd08f236 tempest-EndPointGroupsTest-967165734 tempest-EndPointGroupsTest-967165734-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:28.121733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-47f3033f-0666-40b4-92f5-b3beb8a1235e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8559fd7d224849cc890e9a05dc46498c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:28.133138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904520c-1786-4f23-9581-e0bf47f291fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:28.134228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904520c-1786-4f23-9581-e0bf47f291fa service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:28.134853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904520c-1786-4f23-9581-e0bf47f291fa service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:28.135954 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904520c-1786-4f23-9581-e0bf47f291fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:28.138209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c904520c-1786-4f23-9581-e0bf47f291fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:28.176729 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2143/4235] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:09:27 2022] DELETE /identity/v3/users/8559fd7d224849cc890e9a05dc46498c => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:28.181053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c904520c-1786-4f23-9581-e0bf47f291fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:28.181792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911da8b-228f-444f-98e0-0d56014b6975 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:28.182148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911da8b-228f-444f-98e0-0d56014b6975 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:28.182431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911da8b-228f-444f-98e0-0d56014b6975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:28.185650 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c904520c-1786-4f23-9581-e0bf47f291fa service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:28.210692 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2093/4236] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:09:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:09:28.232549 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-5911da8b-228f-444f-98e0-0d56014b6975 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:28.236974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5911da8b-228f-444f-98e0-0d56014b6975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:28.435531 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2144/4237] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:28.497993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904520c-1786-4f23-9581-e0bf47f291fa service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:28.499918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c904520c-1786-4f23-9581-e0bf47f291fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:28.520411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904520c-1786-4f23-9581-e0bf47f291fa service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:28.616112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61d5d7-f1da-4eb2-826b-c9b8d7d3553a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:28.616787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61d5d7-f1da-4eb2-826b-c9b8d7d3553a service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:28.617070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61d5d7-f1da-4eb2-826b-c9b8d7d3553a service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:28.617349 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61d5d7-f1da-4eb2-826b-c9b8d7d3553a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:28.629013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61d5d7-f1da-4eb2-826b-c9b8d7d3553a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:28.631844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61d5d7-f1da-4eb2-826b-c9b8d7d3553a service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:28.671715 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2094/4238] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:09:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:09:29.047204 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911da8b-228f-444f-98e0-0d56014b6975 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:29.051207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5911da8b-228f-444f-98e0-0d56014b6975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:29.074775 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911da8b-228f-444f-98e0-0d56014b6975 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:29.090484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca4ad7-e9ff-486a-a6ea-efe37217e032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:29.091234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca4ad7-e9ff-486a-a6ea-efe37217e032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:29.091799 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca4ad7-e9ff-486a-a6ea-efe37217e032 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:29.092174 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca4ad7-e9ff-486a-a6ea-efe37217e032 admin admin] PATH_INFO: `/v3/users/71f22a95b8484c94a823a139ec54fcbb` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:29.094083 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca4ad7-e9ff-486a-a6ea-efe37217e032 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71f22a95b8484c94a823a139ec54fcbb)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:29.096808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca4ad7-e9ff-486a-a6ea-efe37217e032 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:29.177933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-50ca4ad7-e9ff-486a-a6ea-efe37217e032 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71f22a95b8484c94a823a139ec54fcbb'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:29.189607 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-50ca4ad7-e9ff-486a-a6ea-efe37217e032 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71f22a95b8484c94a823a139ec54fcbb'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:29.191526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-50ca4ad7-e9ff-486a-a6ea-efe37217e032 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71f22a95b8484c94a823a139ec54fcbb'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:29.192960 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-50ca4ad7-e9ff-486a-a6ea-efe37217e032 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71f22a95b8484c94a823a139ec54fcbb'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:29.208552 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-50ca4ad7-e9ff-486a-a6ea-efe37217e032 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71f22a95b8484c94a823a139ec54fcbb'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:29.226326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70981f0-103d-4d55-8c23-217f0e9208de None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:29.227426 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70981f0-103d-4d55-8c23-217f0e9208de None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:29.227891 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70981f0-103d-4d55-8c23-217f0e9208de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:29.269485 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2145/4239] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:09:29 2022] DELETE /identity/v3/users/71f22a95b8484c94a823a139ec54fcbb => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:29.275509 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3bc40-e49a-4276-b0f3-1d23475c0f16 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:29.275878 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3bc40-e49a-4276-b0f3-1d23475c0f16 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:29.276636 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3bc40-e49a-4276-b0f3-1d23475c0f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:29.329690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-e70981f0-103d-4d55-8c23-217f0e9208de None None] MFA Rules not processed for user `22318132bfd04aa0886eb9b14a983731`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:29.331675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e70981f0-103d-4d55-8c23-217f0e9208de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:29.352960 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-05c3bc40-e49a-4276-b0f3-1d23475c0f16 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:29.354632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-05c3bc40-e49a-4276-b0f3-1d23475c0f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:29.441892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:29.550967 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2095/4240] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:09:29.552692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f8ada-c5f0-4b5e-95f0-834e199377ef None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:29.555144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f8ada-c5f0-4b5e-95f0-834e199377ef None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:29.556349 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f8ada-c5f0-4b5e-95f0-834e199377ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:29.572390 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2146/4241] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:29.585612 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-437f8ada-c5f0-4b5e-95f0-834e199377ef None None] MFA Rules not processed for user `22318132bfd04aa0886eb9b14a983731`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:29.587178 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-437f8ada-c5f0-4b5e-95f0-834e199377ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:29.592053 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3bc40-e49a-4276-b0f3-1d23475c0f16 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:29.594401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-05c3bc40-e49a-4276-b0f3-1d23475c0f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:29.614403 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2096/4242] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:29.672260 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3bc40-e49a-4276-b0f3-1d23475c0f16 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:29.687438 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47bfc3-3c71-424e-be7e-c49be2e58fdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:29.688842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47bfc3-3c71-424e-be7e-c49be2e58fdf service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:29.688842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47bfc3-3c71-424e-be7e-c49be2e58fdf service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:29.688842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47bfc3-3c71-424e-be7e-c49be2e58fdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:29.704624 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a47bfc3-3c71-424e-be7e-c49be2e58fdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:29.707051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a47bfc3-3c71-424e-be7e-c49be2e58fdf service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:29.722706 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2147/4243] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:09:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:09:29.776974 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f8ada-c5f0-4b5e-95f0-834e199377ef None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:29.787316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-437f8ada-c5f0-4b5e-95f0-834e199377ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:29.819111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47bfc3-3c71-424e-be7e-c49be2e58fdf service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:29.821189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5a47bfc3-3c71-424e-be7e-c49be2e58fdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:29.853959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:29.859533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47bfc3-3c71-424e-be7e-c49be2e58fdf service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:29.881044 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151186d4-1483-4737-a7ae-1f54529bccd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:29.882425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151186d4-1483-4737-a7ae-1f54529bccd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:29.882754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151186d4-1483-4737-a7ae-1f54529bccd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:29.883073 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151186d4-1483-4737-a7ae-1f54529bccd0 admin admin] PATH_INFO: `/v3/projects/1183f05c7baa447bb6c04f41d9e1b536` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:29.887491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151186d4-1483-4737-a7ae-1f54529bccd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1183f05c7baa447bb6c04f41d9e1b536)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:29.896142 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151186d4-1483-4737-a7ae-1f54529bccd0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:29.959286 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f8ada-c5f0-4b5e-95f0-834e199377ef None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:29.971323 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6770a0f-bb86-4d8a-b300-3afb4321c46d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:29.973923 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6770a0f-bb86-4d8a-b300-3afb4321c46d service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:29.974757 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6770a0f-bb86-4d8a-b300-3afb4321c46d service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:29.976048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6770a0f-bb86-4d8a-b300-3afb4321c46d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:29.991045 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6770a0f-bb86-4d8a-b300-3afb4321c46d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:29.994208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6770a0f-bb86-4d8a-b300-3afb4321c46d service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:30.008864 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2097/4244] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:09:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:09:30.025848 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-151186d4-1483-4737-a7ae-1f54529bccd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1183f05c7baa447bb6c04f41d9e1b536', 'request_id': 'req-151186d4-1483-4737-a7ae-1f54529bccd0'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:30.042629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-151186d4-1483-4737-a7ae-1f54529bccd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1183f05c7baa447bb6c04f41d9e1b536', 'request_id': 'req-151186d4-1483-4737-a7ae-1f54529bccd0'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:30.061305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-151186d4-1483-4737-a7ae-1f54529bccd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1183f05c7baa447bb6c04f41d9e1b536', 'request_id': 'req-151186d4-1483-4737-a7ae-1f54529bccd0'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:30.114290 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-151186d4-1483-4737-a7ae-1f54529bccd0 admin admin] The token cache is being invalidate because project 1183f05c7baa447bb6c04f41d9e1b536 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:09:30.118226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-151186d4-1483-4737-a7ae-1f54529bccd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:30.118890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-151186d4-1483-4737-a7ae-1f54529bccd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:30.122681 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2148/4245] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:09:29 2022] DELETE /identity/v3/projects/1183f05c7baa447bb6c04f41d9e1b536 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:30.129307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6770a0f-bb86-4d8a-b300-3afb4321c46d service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:30.152268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6770a0f-bb86-4d8a-b300-3afb4321c46d service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:30.240367 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cef1d3-4054-4f15-8817-4846af3988f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:30.241077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cef1d3-4054-4f15-8817-4846af3988f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:30.241307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cef1d3-4054-4f15-8817-4846af3988f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:30.241542 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cef1d3-4054-4f15-8817-4846af3988f7 admin admin] PATH_INFO: `/v3/users/daf9605e9f3946a0879b9783e478c62f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:30.242797 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cef1d3-4054-4f15-8817-4846af3988f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daf9605e9f3946a0879b9783e478c62f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:30.245547 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cef1d3-4054-4f15-8817-4846af3988f7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:30.332302 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-50cef1d3-4054-4f15-8817-4846af3988f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daf9605e9f3946a0879b9783e478c62f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:30.333333 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-50cef1d3-4054-4f15-8817-4846af3988f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daf9605e9f3946a0879b9783e478c62f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:30.334077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-50cef1d3-4054-4f15-8817-4846af3988f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daf9605e9f3946a0879b9783e478c62f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:30.345214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-50cef1d3-4054-4f15-8817-4846af3988f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daf9605e9f3946a0879b9783e478c62f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:30.369581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-50cef1d3-4054-4f15-8817-4846af3988f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daf9605e9f3946a0879b9783e478c62f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:30.393258 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2098/4246] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:09:30 2022] DELETE /identity/v3/users/daf9605e9f3946a0879b9783e478c62f => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:31.116576 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151186d4-1483-4737-a7ae-1f54529bccd0 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:31.118780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-151186d4-1483-4737-a7ae-1f54529bccd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:31.147674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151186d4-1483-4737-a7ae-1f54529bccd0 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:31.315612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:31.326866 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9dfe0d-f806-4bcd-940e-4647ed6c3bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:31.327632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9dfe0d-f806-4bcd-940e-4647ed6c3bba admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:31.328158 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9dfe0d-f806-4bcd-940e-4647ed6c3bba admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:31.329064 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9dfe0d-f806-4bcd-940e-4647ed6c3bba admin admin] PATH_INFO: `/v3/projects/fe45cffcf6c34359b9a19da0cb3dcf58` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:31.330883 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9dfe0d-f806-4bcd-940e-4647ed6c3bba admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe45cffcf6c34359b9a19da0cb3dcf58)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:31.333734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9dfe0d-f806-4bcd-940e-4647ed6c3bba admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:31.427206 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fb9dfe0d-f806-4bcd-940e-4647ed6c3bba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe45cffcf6c34359b9a19da0cb3dcf58', 'request_id': 'req-fb9dfe0d-f806-4bcd-940e-4647ed6c3bba'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:31.437337 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fb9dfe0d-f806-4bcd-940e-4647ed6c3bba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe45cffcf6c34359b9a19da0cb3dcf58', 'request_id': 'req-fb9dfe0d-f806-4bcd-940e-4647ed6c3bba'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:31.459675 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fb9dfe0d-f806-4bcd-940e-4647ed6c3bba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe45cffcf6c34359b9a19da0cb3dcf58', 'request_id': 'req-fb9dfe0d-f806-4bcd-940e-4647ed6c3bba'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:31.485484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fb9dfe0d-f806-4bcd-940e-4647ed6c3bba admin admin] The token cache is being invalidate because project fe45cffcf6c34359b9a19da0cb3dcf58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:09:31.486150 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fb9dfe0d-f806-4bcd-940e-4647ed6c3bba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:31.491280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fb9dfe0d-f806-4bcd-940e-4647ed6c3bba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:31.494417 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2149/4247] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:09:31 2022] DELETE /identity/v3/projects/fe45cffcf6c34359b9a19da0cb3dcf58 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:31.498879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cef1d3-4054-4f15-8817-4846af3988f7 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:31.501410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-50cef1d3-4054-4f15-8817-4846af3988f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:31.543184 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cef1d3-4054-4f15-8817-4846af3988f7 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:31.652036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:31.680114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9dfe0d-f806-4bcd-940e-4647ed6c3bba admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:31.707974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-fb9dfe0d-f806-4bcd-940e-4647ed6c3bba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:31.789580 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717eb46-2e87-471e-81d7-4667eb3f5623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:31.794348 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717eb46-2e87-471e-81d7-4667eb3f5623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:31.794348 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717eb46-2e87-471e-81d7-4667eb3f5623 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:31.794348 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717eb46-2e87-471e-81d7-4667eb3f5623 admin admin] PATH_INFO: `/v3/users/8c929d1eb837476f8561259a70b8a0e5` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:31.800669 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717eb46-2e87-471e-81d7-4667eb3f5623 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c929d1eb837476f8561259a70b8a0e5)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:31.803582 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717eb46-2e87-471e-81d7-4667eb3f5623 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:31.912136 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6717eb46-2e87-471e-81d7-4667eb3f5623 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c929d1eb837476f8561259a70b8a0e5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:31.913522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6717eb46-2e87-471e-81d7-4667eb3f5623 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c929d1eb837476f8561259a70b8a0e5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:31.914915 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6717eb46-2e87-471e-81d7-4667eb3f5623 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c929d1eb837476f8561259a70b8a0e5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:31.937858 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6717eb46-2e87-471e-81d7-4667eb3f5623 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c929d1eb837476f8561259a70b8a0e5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:31.960464 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6717eb46-2e87-471e-81d7-4667eb3f5623 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c929d1eb837476f8561259a70b8a0e5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:31.965900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9dfe0d-f806-4bcd-940e-4647ed6c3bba admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:31.980668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72148f3d-48a9-4193-b96b-ddfd99bee50e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:31.981082 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72148f3d-48a9-4193-b96b-ddfd99bee50e service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:31.981377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72148f3d-48a9-4193-b96b-ddfd99bee50e service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:31.981664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72148f3d-48a9-4193-b96b-ddfd99bee50e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:31.983272 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2099/4248] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:09:31 2022] DELETE /identity/v3/users/8c929d1eb837476f8561259a70b8a0e5 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:31.987757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-72148f3d-48a9-4193-b96b-ddfd99bee50e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:32.005384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72148f3d-48a9-4193-b96b-ddfd99bee50e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:32.007274 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72148f3d-48a9-4193-b96b-ddfd99bee50e service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:32.022845 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2150/4249] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:09:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:09:32.392322 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717eb46-2e87-471e-81d7-4667eb3f5623 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:32.396128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6717eb46-2e87-471e-81d7-4667eb3f5623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:32.583788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717eb46-2e87-471e-81d7-4667eb3f5623 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:32.590908 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3284a-c32e-41ef-919b-f46cbd2b50c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:32.592250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3284a-c32e-41ef-919b-f46cbd2b50c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:32.592813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3284a-c32e-41ef-919b-f46cbd2b50c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:32.593309 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3284a-c32e-41ef-919b-f46cbd2b50c1 admin admin] PATH_INFO: `/v3/projects/8c776f7b8ebb421280793c3b68445cbd` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:32.595827 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3284a-c32e-41ef-919b-f46cbd2b50c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c776f7b8ebb421280793c3b68445cbd)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:32.600130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3284a-c32e-41ef-919b-f46cbd2b50c1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:32.722438 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-edc3284a-c32e-41ef-919b-f46cbd2b50c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c776f7b8ebb421280793c3b68445cbd', 'request_id': 'req-edc3284a-c32e-41ef-919b-f46cbd2b50c1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:32.723880 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:32.735301 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-edc3284a-c32e-41ef-919b-f46cbd2b50c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c776f7b8ebb421280793c3b68445cbd', 'request_id': 'req-edc3284a-c32e-41ef-919b-f46cbd2b50c1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:32.750911 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-edc3284a-c32e-41ef-919b-f46cbd2b50c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c776f7b8ebb421280793c3b68445cbd', 'request_id': 'req-edc3284a-c32e-41ef-919b-f46cbd2b50c1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:32.779457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-edc3284a-c32e-41ef-919b-f46cbd2b50c1 admin admin] The token cache is being invalidate because project 8c776f7b8ebb421280793c3b68445cbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:09:32.780039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-edc3284a-c32e-41ef-919b-f46cbd2b50c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:32.781659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-edc3284a-c32e-41ef-919b-f46cbd2b50c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:32.784071 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2100/4250] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:09:32 2022] DELETE /identity/v3/projects/8c776f7b8ebb421280793c3b68445cbd => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:32.788870 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391099a-6dfe-4605-8153-5bd5fca7c64a None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:32.789574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391099a-6dfe-4605-8153-5bd5fca7c64a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:32.789574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391099a-6dfe-4605-8153-5bd5fca7c64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:32.828451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-e391099a-6dfe-4605-8153-5bd5fca7c64a None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:32.831222 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e391099a-6dfe-4605-8153-5bd5fca7c64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:32.848759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3284a-c32e-41ef-919b-f46cbd2b50c1 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:32.851383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-edc3284a-c32e-41ef-919b-f46cbd2b50c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:32.916826 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2151/4251] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:32.918350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf0200-e54d-4a49-b881-eccdfc5065d8 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:32.918837 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf0200-e54d-4a49-b881-eccdfc5065d8 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:32.919123 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf0200-e54d-4a49-b881-eccdfc5065d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:32.942452 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-5bcf0200-e54d-4a49-b881-eccdfc5065d8 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:32.943976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5bcf0200-e54d-4a49-b881-eccdfc5065d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:32.952863 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2152/4252] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:32.958119 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf0200-e54d-4a49-b881-eccdfc5065d8 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:32.960306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5bcf0200-e54d-4a49-b881-eccdfc5065d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:32.966944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:33.006136 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3284a-c32e-41ef-919b-f46cbd2b50c1 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:33.013535 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2d917-793b-45e5-b1e6-5775881df7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:33.014416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2d917-793b-45e5-b1e6-5775881df7a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:33.014822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2d917-793b-45e5-b1e6-5775881df7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:33.015178 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2d917-793b-45e5-b1e6-5775881df7a4 admin admin] PATH_INFO: `/v3/projects/65aea8c33ad1467490ba721eaf17120a` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:33.016640 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2d917-793b-45e5-b1e6-5775881df7a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65aea8c33ad1467490ba721eaf17120a)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:33.019483 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2d917-793b-45e5-b1e6-5775881df7a4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:33.050622 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf0200-e54d-4a49-b881-eccdfc5065d8 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:33.061380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b47fc-d752-4e1e-a794-7004193a1256 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:33.062325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b47fc-d752-4e1e-a794-7004193a1256 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:33.062734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b47fc-d752-4e1e-a794-7004193a1256 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:33.063179 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b47fc-d752-4e1e-a794-7004193a1256 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:33.079112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3a7b47fc-d752-4e1e-a794-7004193a1256 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:33.090613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7b47fc-d752-4e1e-a794-7004193a1256 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:33.094683 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7b47fc-d752-4e1e-a794-7004193a1256 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:33.125720 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2153/4253] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:09:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:09:33.130008 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b47fc-d752-4e1e-a794-7004193a1256 service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:33.137835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c7e2d917-793b-45e5-b1e6-5775881df7a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65aea8c33ad1467490ba721eaf17120a', 'request_id': 'req-c7e2d917-793b-45e5-b1e6-5775881df7a4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:33.147894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c7e2d917-793b-45e5-b1e6-5775881df7a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65aea8c33ad1467490ba721eaf17120a', 'request_id': 'req-c7e2d917-793b-45e5-b1e6-5775881df7a4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:33.149092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b47fc-d752-4e1e-a794-7004193a1256 service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:33.154810 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c7e2d917-793b-45e5-b1e6-5775881df7a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65aea8c33ad1467490ba721eaf17120a', 'request_id': 'req-c7e2d917-793b-45e5-b1e6-5775881df7a4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:33.178246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c7e2d917-793b-45e5-b1e6-5775881df7a4 admin admin] The token cache is being invalidate because project 65aea8c33ad1467490ba721eaf17120a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:09:33.179019 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c7e2d917-793b-45e5-b1e6-5775881df7a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:33.180625 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c7e2d917-793b-45e5-b1e6-5775881df7a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:33.182592 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2101/4254] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:09:32 2022] DELETE /identity/v3/projects/65aea8c33ad1467490ba721eaf17120a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:09:33.189490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a023953-c5a3-468e-91b3-5a0372f3f96f None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:33.190853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a023953-c5a3-468e-91b3-5a0372f3f96f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:33.191376 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a023953-c5a3-468e-91b3-5a0372f3f96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:33.221219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-4a023953-c5a3-468e-91b3-5a0372f3f96f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:33.223457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4a023953-c5a3-468e-91b3-5a0372f3f96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:33.239328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ccfe7-4c70-415e-a6ee-012f46657a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:33.240111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ccfe7-4c70-415e-a6ee-012f46657a12 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:33.240394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ccfe7-4c70-415e-a6ee-012f46657a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:33.240820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ccfe7-4c70-415e-a6ee-012f46657a12 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:33.241801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ccfe7-4c70-415e-a6ee-012f46657a12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:09:33.242112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ccfe7-4c70-415e-a6ee-012f46657a12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:33.243909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ccfe7-4c70-415e-a6ee-012f46657a12 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:33.283785 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2154/4255] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:09:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:09:33.285266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ccfe7-4c70-415e-a6ee-012f46657a12 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:33.291662 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3e1ccfe7-4c70-415e-a6ee-012f46657a12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:33.315541 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ccfe7-4c70-415e-a6ee-012f46657a12 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:33.325743 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a48ba-c105-4913-b986-0097d43fa08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:33.327821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a48ba-c105-4913-b986-0097d43fa08c admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:33.328586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a48ba-c105-4913-b986-0097d43fa08c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:33.328869 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a48ba-c105-4913-b986-0097d43fa08c admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:33.329521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790a48ba-c105-4913-b986-0097d43fa08c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:33.334956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790a48ba-c105-4913-b986-0097d43fa08c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:33.384496 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2102/4256] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:33.392538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e24f61-4892-487d-b0e7-aef6eedbcb24 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:33.394999 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e24f61-4892-487d-b0e7-aef6eedbcb24 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:33.395389 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e24f61-4892-487d-b0e7-aef6eedbcb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:33.397517 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2155/4257] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:09:33 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:33.401792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a48ba-c105-4913-b986-0097d43fa08c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:33.433544 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-83e24f61-4892-487d-b0e7-aef6eedbcb24 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:33.435618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-83e24f61-4892-487d-b0e7-aef6eedbcb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:33.443542 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:33.548659 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2103/4258] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:33.572201 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a48ba-c105-4913-b986-0097d43fa08c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:33.578169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e24f61-4892-487d-b0e7-aef6eedbcb24 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:33.618337 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11520d49-233e-4cc3-abb4-0feb4d385888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:33.622639 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11520d49-233e-4cc3-abb4-0feb4d385888 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:33.623135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11520d49-233e-4cc3-abb4-0feb4d385888 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:33.623762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11520d49-233e-4cc3-abb4-0feb4d385888 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:33.624958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11520d49-233e-4cc3-abb4-0feb4d385888 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:33.632788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11520d49-233e-4cc3-abb4-0feb4d385888 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:33.636164 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e24f61-4892-487d-b0e7-aef6eedbcb24 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:33.648911 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803bc2a0-7041-4013-ad84-b005ef36382f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:33.650445 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803bc2a0-7041-4013-ad84-b005ef36382f admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:33.651425 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803bc2a0-7041-4013-ad84-b005ef36382f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:33.651951 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803bc2a0-7041-4013-ad84-b005ef36382f admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:33.656006 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803bc2a0-7041-4013-ad84-b005ef36382f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:09:33.656204 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:33.656822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803bc2a0-7041-4013-ad84-b005ef36382f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:33.661549 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803bc2a0-7041-4013-ad84-b005ef36382f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:33.700398 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2156/4259] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:09:33 2022] POST /identity/v3/users => generated 294 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:09:33.701955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11520d49-233e-4cc3-abb4-0feb4d385888 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:33.720449 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2104/4260] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:09:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:09:33.726109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803bc2a0-7041-4013-ad84-b005ef36382f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:33.728936 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11520d49-233e-4cc3-abb4-0feb4d385888 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:33.745205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553693d-1f1f-44dc-9ffa-b3c2b7dd7348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:33.746151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553693d-1f1f-44dc-9ffa-b3c2b7dd7348 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:33.746892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553693d-1f1f-44dc-9ffa-b3c2b7dd7348 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:33.747885 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553693d-1f1f-44dc-9ffa-b3c2b7dd7348 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:33.749299 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553693d-1f1f-44dc-9ffa-b3c2b7dd7348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:33.754366 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803bc2a0-7041-4013-ad84-b005ef36382f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:33.756103 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553693d-1f1f-44dc-9ffa-b3c2b7dd7348 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:33.787516 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb35533-fdf2-4041-be9f-8328366fa495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:33.788140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb35533-fdf2-4041-be9f-8328366fa495 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:33.792263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb35533-fdf2-4041-be9f-8328366fa495 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:33.792263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb35533-fdf2-4041-be9f-8328366fa495 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:33.792263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb35533-fdf2-4041-be9f-8328366fa495 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:33.792263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb35533-fdf2-4041-be9f-8328366fa495 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:33.802396 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2157/4261] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:09:33.809236 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553693d-1f1f-44dc-9ffa-b3c2b7dd7348 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:33.835344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553693d-1f1f-44dc-9ffa-b3c2b7dd7348 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:33.848550 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a4ec0-a72e-4a34-82b8-41f9325b16bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:33.851435 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a4ec0-a72e-4a34-82b8-41f9325b16bd admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:33.851728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a4ec0-a72e-4a34-82b8-41f9325b16bd admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:33.851853 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2105/4262] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:09:33 2022] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:33.852219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a4ec0-a72e-4a34-82b8-41f9325b16bd admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:33.852707 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb35533-fdf2-4041-be9f-8328366fa495 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:33.852853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a4ec0-a72e-4a34-82b8-41f9325b16bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:33.854656 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a4ec0-a72e-4a34-82b8-41f9325b16bd admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:33.889999 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2158/4263] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:09:33.891781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a4ec0-a72e-4a34-82b8-41f9325b16bd admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:33.910811 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a4ec0-a72e-4a34-82b8-41f9325b16bd admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:33.952729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb35533-fdf2-4041-be9f-8328366fa495 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:33.959895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e40787-faba-44cb-94ed-8a80e8239ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:33.960511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e40787-faba-44cb-94ed-8a80e8239ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:33.960791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e40787-faba-44cb-94ed-8a80e8239ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:33.961064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e40787-faba-44cb-94ed-8a80e8239ad2 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:33.961683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e40787-faba-44cb-94ed-8a80e8239ad2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:33.963704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e40787-faba-44cb-94ed-8a80e8239ad2 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:33.978864 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca0468-eb42-4114-847e-b26df6e28653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:33.979541 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca0468-eb42-4114-847e-b26df6e28653 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:33.979846 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca0468-eb42-4114-847e-b26df6e28653 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:33.980124 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca0468-eb42-4114-847e-b26df6e28653 admin admin] PATH_INFO: `/v3/projects/36af49960c97428ab8ae9bfc057032dc/users/7c898c0a2e9a42b5866b8cd8b8993093/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:33.989042 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2106/4264] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:09:33 2022] POST /identity/v3/users => generated 286 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:33.990762 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edaa52e-0dbc-4021-bf8f-3b63479d9d9c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:33.991147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edaa52e-0dbc-4021-bf8f-3b63479d9d9c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:33.991505 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edaa52e-0dbc-4021-bf8f-3b63479d9d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:33.997617 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca0468-eb42-4114-847e-b26df6e28653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36af49960c97428ab8ae9bfc057032dc, user_id=7c898c0a2e9a42b5866b8cd8b8993093, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:34.000340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca0468-eb42-4114-847e-b26df6e28653 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:34.016577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-5edaa52e-0dbc-4021-bf8f-3b63479d9d9c None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:34.017975 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5edaa52e-0dbc-4021-bf8f-3b63479d9d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:34.026212 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2159/4265] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:09:33 2022] PUT /identity/v3/projects/36af49960c97428ab8ae9bfc057032dc/users/7c898c0a2e9a42b5866b8cd8b8993093/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:09:34.026212 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca0468-eb42-4114-847e-b26df6e28653 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:34.114465 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca0468-eb42-4114-847e-b26df6e28653 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:34.116878 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:34.121553 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2107/4266] 10.222.0.33 () {58 vars in 967 bytes} [Sat Aug 6 21:09:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:34.123170 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59746949-637c-4b8d-941d-74ac0bd83851 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:34.124018 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59746949-637c-4b8d-941d-74ac0bd83851 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:34.124394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59746949-637c-4b8d-941d-74ac0bd83851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:34.125699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a27d3f-4c2e-426b-99b9-9fe39a650e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:34.126371 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a27d3f-4c2e-426b-99b9-9fe39a650e48 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:34.127087 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a27d3f-4c2e-426b-99b9-9fe39a650e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:34.127979 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a27d3f-4c2e-426b-99b9-9fe39a650e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:34.137830 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a27d3f-4c2e-426b-99b9-9fe39a650e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:34.139884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a27d3f-4c2e-426b-99b9-9fe39a650e48 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:34.158316 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2160/4267] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:09:34.159793 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a27d3f-4c2e-426b-99b9-9fe39a650e48 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:34.162989 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-85a27d3f-4c2e-426b-99b9-9fe39a650e48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:34.165027 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-59746949-637c-4b8d-941d-74ac0bd83851 None None] MFA Rules not processed for user `7c898c0a2e9a42b5866b8cd8b8993093`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:34.166814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-59746949-637c-4b8d-941d-74ac0bd83851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:34.323707 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2108/4268] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:34.329452 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59746949-637c-4b8d-941d-74ac0bd83851 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:34.345901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:34.354718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59746949-637c-4b8d-941d-74ac0bd83851 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:34.364262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c5cac-e9cd-4c90-91e2-7fe3a4f6547d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:34.366389 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c5cac-e9cd-4c90-91e2-7fe3a4f6547d admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:34.366936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c5cac-e9cd-4c90-91e2-7fe3a4f6547d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:34.369549 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c5cac-e9cd-4c90-91e2-7fe3a4f6547d admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:34.370433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c5cac-e9cd-4c90-91e2-7fe3a4f6547d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:34.373463 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c5cac-e9cd-4c90-91e2-7fe3a4f6547d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:34.404835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a27d3f-4c2e-426b-99b9-9fe39a650e48 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:34.415109 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29949e4e-379f-4749-9b46-e654a964586c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:34.415733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29949e4e-379f-4749-9b46-e654a964586c service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:34.416059 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29949e4e-379f-4749-9b46-e654a964586c service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:34.416482 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29949e4e-379f-4749-9b46-e654a964586c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:34.424651 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2109/4269] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:09:34.425448 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c5cac-e9cd-4c90-91e2-7fe3a4f6547d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:34.426796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29949e4e-379f-4749-9b46-e654a964586c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:34.428602 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29949e4e-379f-4749-9b46-e654a964586c service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:34.438798 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2161/4270] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:09:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:09:34.439647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29949e4e-379f-4749-9b46-e654a964586c service swift] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:34.450947 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29949e4e-379f-4749-9b46-e654a964586c service swift] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:34.458001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2c535-c1fe-41cf-988c-9dccefbe5c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:34.458863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2c535-c1fe-41cf-988c-9dccefbe5c41 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:34.459196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2c535-c1fe-41cf-988c-9dccefbe5c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:34.459476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2c535-c1fe-41cf-988c-9dccefbe5c41 admin admin] PATH_INFO: `/v3/projects/c598d72843744d5494f230958f567909/users/444a3a1bc01f48ddbc12d34eaef8a450/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:34.461504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c5cac-e9cd-4c90-91e2-7fe3a4f6547d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:34.483439 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2c535-c1fe-41cf-988c-9dccefbe5c41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c598d72843744d5494f230958f567909, user_id=444a3a1bc01f48ddbc12d34eaef8a450, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:34.485030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0edda9-3a87-4eda-9541-4dbc8601aabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:34.486397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2c535-c1fe-41cf-988c-9dccefbe5c41 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:34.487544 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0edda9-3a87-4eda-9541-4dbc8601aabf admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:34.488903 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0edda9-3a87-4eda-9541-4dbc8601aabf admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:34.490484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0edda9-3a87-4eda-9541-4dbc8601aabf admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:34.494588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0edda9-3a87-4eda-9541-4dbc8601aabf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:34.501253 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0edda9-3a87-4eda-9541-4dbc8601aabf admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:34.525368 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2162/4271] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:09:34 2022] PUT /identity/v3/projects/c598d72843744d5494f230958f567909/users/444a3a1bc01f48ddbc12d34eaef8a450/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:34.539810 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e0ff7-43a7-419c-9744-35a2de97d77b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:34.540512 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e0ff7-43a7-419c-9744-35a2de97d77b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:34.541167 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e0ff7-43a7-419c-9744-35a2de97d77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:34.580264 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2110/4272] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:09:34 2022] POST /identity/v3/projects => generated 387 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:34.582913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0edda9-3a87-4eda-9541-4dbc8601aabf admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:34.598296 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-6d6e0ff7-43a7-419c-9744-35a2de97d77b None None] MFA Rules not processed for user `444a3a1bc01f48ddbc12d34eaef8a450`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:34.599883 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6d6e0ff7-43a7-419c-9744-35a2de97d77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:34.697473 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2163/4273] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:34.720405 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e0ff7-43a7-419c-9744-35a2de97d77b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:34.721385 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6d6e0ff7-43a7-419c-9744-35a2de97d77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:34.768607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0edda9-3a87-4eda-9541-4dbc8601aabf admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:34.787033 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c75988-365c-4e54-8fe3-fc0e0f9789bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:34.787344 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c75988-365c-4e54-8fe3-fc0e0f9789bd admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:34.787809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c75988-365c-4e54-8fe3-fc0e0f9789bd admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:34.787921 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c75988-365c-4e54-8fe3-fc0e0f9789bd admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:34.788484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c75988-365c-4e54-8fe3-fc0e0f9789bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:34.790408 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c75988-365c-4e54-8fe3-fc0e0f9789bd admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:34.850351 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2111/4274] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:09:34 2022] POST /identity/v3/users => generated 300 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:34.853018 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c75988-365c-4e54-8fe3-fc0e0f9789bd admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:34.894118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c75988-365c-4e54-8fe3-fc0e0f9789bd admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:34.920244 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f37f93-ce9d-492b-9b8d-fa6d5d588bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:34.920873 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f37f93-ce9d-492b-9b8d-fa6d5d588bcd admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:34.921150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f37f93-ce9d-492b-9b8d-fa6d5d588bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:34.921422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f37f93-ce9d-492b-9b8d-fa6d5d588bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:34.922062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f37f93-ce9d-492b-9b8d-fa6d5d588bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:34.923699 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f37f93-ce9d-492b-9b8d-fa6d5d588bcd admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:34.930851 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e0ff7-43a7-419c-9744-35a2de97d77b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:34.944946 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901932a-0fa7-453a-83d1-7aa7b59c23df service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10759b2abd4cafacf338551327775e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:34.945572 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901932a-0fa7-453a-83d1-7aa7b59c23df service glance] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:34.945860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901932a-0fa7-453a-83d1-7aa7b59c23df service glance] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:34.946138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901932a-0fa7-453a-83d1-7aa7b59c23df service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:34.968740 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2112/4275] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:09:34.973683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f37f93-ce9d-492b-9b8d-fa6d5d588bcd admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:34.978343 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901932a-0fa7-453a-83d1-7aa7b59c23df service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:34.982210 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901932a-0fa7-453a-83d1-7aa7b59c23df service glance] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:35.001495 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f37f93-ce9d-492b-9b8d-fa6d5d588bcd admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:35.004146 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2164/4276] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:09:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:09:35.009794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c164493-4001-4a04-b69b-156cf6e41808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:35.010722 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c164493-4001-4a04-b69b-156cf6e41808 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:35.011234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c164493-4001-4a04-b69b-156cf6e41808 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:35.011872 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c164493-4001-4a04-b69b-156cf6e41808 admin admin] PATH_INFO: `/v3/projects/f697443fb8c24846a0747b5163082d24/users/b6252f3f1b6a4baf880774cc51a98161/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:35.055513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c164493-4001-4a04-b69b-156cf6e41808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f697443fb8c24846a0747b5163082d24, user_id=b6252f3f1b6a4baf880774cc51a98161, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:35.058648 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c164493-4001-4a04-b69b-156cf6e41808 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:35.108105 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2113/4277] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:09:34 2022] PUT /identity/v3/projects/f697443fb8c24846a0747b5163082d24/users/b6252f3f1b6a4baf880774cc51a98161/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:09:35.112938 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901932a-0fa7-453a-83d1-7aa7b59c23df service glance] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:35.129336 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901932a-0fa7-453a-83d1-7aa7b59c23df service glance] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:35.196334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:35.266018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad01892-7a46-4538-8e6d-60c78d584d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:35.268672 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad01892-7a46-4538-8e6d-60c78d584d46 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:35.270585 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad01892-7a46-4538-8e6d-60c78d584d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:35.271777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad01892-7a46-4538-8e6d-60c78d584d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:35.273358 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad01892-7a46-4538-8e6d-60c78d584d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:35.275045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad01892-7a46-4538-8e6d-60c78d584d46 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:35.304718 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2165/4278] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:09:35.308157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c164493-4001-4a04-b69b-156cf6e41808 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:35.319492 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13806907-cc99-40ea-955a-86cb25b54997 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:35.319778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13806907-cc99-40ea-955a-86cb25b54997 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:35.320052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13806907-cc99-40ea-955a-86cb25b54997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:35.328852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c164493-4001-4a04-b69b-156cf6e41808 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:35.353381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e5b3c-26a3-41c2-890e-df19985263a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:35.354250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e5b3c-26a3-41c2-890e-df19985263a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:35.354601 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e5b3c-26a3-41c2-890e-df19985263a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:35.354824 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e5b3c-26a3-41c2-890e-df19985263a1 admin admin] PATH_INFO: `/v3/projects/f697443fb8c24846a0747b5163082d24/users/b6252f3f1b6a4baf880774cc51a98161/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:35.365848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e5b3c-26a3-41c2-890e-df19985263a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f697443fb8c24846a0747b5163082d24, user_id=b6252f3f1b6a4baf880774cc51a98161, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:35.368820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e5b3c-26a3-41c2-890e-df19985263a1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:35.382912 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-13806907-cc99-40ea-955a-86cb25b54997 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:35.384494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-13806907-cc99-40ea-955a-86cb25b54997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:35.389073 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:35.401996 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2114/4279] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:09:35 2022] PUT /identity/v3/projects/f697443fb8c24846a0747b5163082d24/users/b6252f3f1b6a4baf880774cc51a98161/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:35.504962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad447ed0-8cbc-40e6-9970-5c61837f7fa2 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:35.504962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad447ed0-8cbc-40e6-9970-5c61837f7fa2 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:35.504962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad447ed0-8cbc-40e6-9970-5c61837f7fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:35.542889 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2166/4280] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:09:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:35.561467 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13806907-cc99-40ea-955a-86cb25b54997 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:35.573091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-ad447ed0-8cbc-40e6-9970-5c61837f7fa2 None None] MFA Rules not processed for user `b6252f3f1b6a4baf880774cc51a98161`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:35.576637 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ad447ed0-8cbc-40e6-9970-5c61837f7fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:35.714216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13806907-cc99-40ea-955a-86cb25b54997 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:35.724636 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa78e2-60f2-45e9-882b-13abc23b3aaa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:35.725267 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa78e2-60f2-45e9-882b-13abc23b3aaa service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:35.725547 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa78e2-60f2-45e9-882b-13abc23b3aaa service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:35.725822 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa78e2-60f2-45e9-882b-13abc23b3aaa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:35.730057 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2115/4281] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:35 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:09:35.735320 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad447ed0-8cbc-40e6-9970-5c61837f7fa2 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:35.737565 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa78e2-60f2-45e9-882b-13abc23b3aaa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:35.739229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa78e2-60f2-45e9-882b-13abc23b3aaa service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:35.748763 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2167/4282] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:09:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 06 21:09:35.761220 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad447ed0-8cbc-40e6-9970-5c61837f7fa2 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:35.767144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed72f2-2d8c-447d-b581-29a8dc607580 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6252f3f1b6a4baf880774cc51a98161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f697443fb8c24846a0747b5163082d24', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:35.767791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed72f2-2d8c-447d-b581-29a8dc607580 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:35.768101 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed72f2-2d8c-447d-b581-29a8dc607580 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:35.768573 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed72f2-2d8c-447d-b581-29a8dc607580 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] PATH_INFO: `/v3/services` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:35.768968 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed72f2-2d8c-447d-b581-29a8dc607580 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:35.772205 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed72f2-2d8c-447d-b581-29a8dc607580 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:35.809896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa78e2-60f2-45e9-882b-13abc23b3aaa service swift] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:35.811230 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2116/4283] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:09:35 2022] POST /identity/v3/services => generated 286 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:35.823822 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa78e2-60f2-45e9-882b-13abc23b3aaa service swift] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:35.857271 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6d412-0992-4654-ac9a-b550c8b3f8fd tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6252f3f1b6a4baf880774cc51a98161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f697443fb8c24846a0747b5163082d24', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:35.857802 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6d412-0992-4654-ac9a-b550c8b3f8fd tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:35.858040 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6d412-0992-4654-ac9a-b550c8b3f8fd tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:35.858308 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6d412-0992-4654-ac9a-b550c8b3f8fd tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:35.859022 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a6d412-0992-4654-ac9a-b550c8b3f8fd tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:35.860193 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-36a6d412-0992-4654-ac9a-b550c8b3f8fd tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:35.860193 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:09:35.860193 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:09:35.861262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a6d412-0992-4654-ac9a-b550c8b3f8fd tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:35.881646 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-36a6d412-0992-4654-ac9a-b550c8b3f8fd tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 06 21:09:35.881646 ncdv-master-1 devstack@keystone.service[102759]: Failed validating 'type' in schema['properties']['enabled']: Aug 06 21:09:35.881646 ncdv-master-1 devstack@keystone.service[102759]: {'enum': [True, False, None], 'type': 'boolean'} Aug 06 21:09:35.881646 ncdv-master-1 devstack@keystone.service[102759]: On instance['enabled']: Aug 06 21:09:35.881646 ncdv-master-1 devstack@keystone.service[102759]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 06 21:09:35.881646 ncdv-master-1 devstack@keystone.service[102759]: Failed validating 'type' in schema['properties']['enabled']: Aug 06 21:09:35.881646 ncdv-master-1 devstack@keystone.service[102759]: {'enum': [True, False, None], 'type': 'boolean'} Aug 06 21:09:35.881646 ncdv-master-1 devstack@keystone.service[102759]: On instance['enabled']: Aug 06 21:09:35.881646 ncdv-master-1 devstack@keystone.service[102759]: 'False' Aug 06 21:09:35.881646 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:09:35.881646 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 06 21:09:35.881646 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 06 21:09:35.881646 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 21:09:35.881646 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise error Aug 06 21:09:35.881646 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Aug 06 21:09:35.881646 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:09:35.881646 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 06 21:09:35.881646 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 06 21:09:35.881646 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:09:35.881646 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application On instance['enabled']: Aug 06 21:09:35.881646 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application 'False' Aug 06 21:09:35.881646 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:09:35.881646 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 21:09:35.883896 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:09:35.883896 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:09:35.883896 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:09:35.883896 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:09:35.883896 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:09:35.883896 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:09:35.883896 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:09:35.883896 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:09:35.883896 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:09:35.883896 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:09:35.883896 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:09:35.883896 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:09:35.883896 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Aug 06 21:09:35.883896 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Aug 06 21:09:35.883896 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 06 21:09:35.883896 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 06 21:09:35.883896 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 06 21:09:35.885266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 06 21:09:35.885266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 06 21:09:35.885266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:09:35.885266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 06 21:09:35.885266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 06 21:09:35.885266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:09:35.885266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application On instance['enabled']: Aug 06 21:09:35.885266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application 'False' Aug 06 21:09:35.885266 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:09:35.887007 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2168/4284] 10.222.0.33 () {60 vars in 1156 bytes} [Sat Aug 6 21:09:35 2022] POST /identity/v3/endpoints => generated 283 bytes in 77 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 06 21:09:35.891931 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed72f2-2d8c-447d-b581-29a8dc607580 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:35.910319 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed72f2-2d8c-447d-b581-29a8dc607580 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:35.917716 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f3a8b-10e1-45b0-99cb-fee0f0f13681 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6252f3f1b6a4baf880774cc51a98161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f697443fb8c24846a0747b5163082d24', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:35.918830 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f3a8b-10e1-45b0-99cb-fee0f0f13681 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:35.919183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f3a8b-10e1-45b0-99cb-fee0f0f13681 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:35.919567 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f3a8b-10e1-45b0-99cb-fee0f0f13681 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:35.920415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f3a8b-10e1-45b0-99cb-fee0f0f13681 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:35.922025 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-160f3a8b-10e1-45b0-99cb-fee0f0f13681 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:35.922025 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:09:35.922025 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:09:35.923095 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f3a8b-10e1-45b0-99cb-fee0f0f13681 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:35.932563 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-160f3a8b-10e1-45b0-99cb-fee0f0f13681 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 06 21:09:35.932563 ncdv-master-1 devstack@keystone.service[102758]: Failed validating 'type' in schema['properties']['enabled']: Aug 06 21:09:35.932563 ncdv-master-1 devstack@keystone.service[102758]: {'enum': [True, False, None], 'type': 'boolean'} Aug 06 21:09:35.932563 ncdv-master-1 devstack@keystone.service[102758]: On instance['enabled']: Aug 06 21:09:35.932563 ncdv-master-1 devstack@keystone.service[102758]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 06 21:09:35.932563 ncdv-master-1 devstack@keystone.service[102758]: Failed validating 'type' in schema['properties']['enabled']: Aug 06 21:09:35.932563 ncdv-master-1 devstack@keystone.service[102758]: {'enum': [True, False, None], 'type': 'boolean'} Aug 06 21:09:35.932563 ncdv-master-1 devstack@keystone.service[102758]: On instance['enabled']: Aug 06 21:09:35.932563 ncdv-master-1 devstack@keystone.service[102758]: 'True' Aug 06 21:09:35.932563 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:09:35.932563 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 06 21:09:35.932563 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 06 21:09:35.932563 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 21:09:35.932563 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise error Aug 06 21:09:35.932563 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Aug 06 21:09:35.932563 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:09:35.932563 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 06 21:09:35.932563 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 06 21:09:35.932563 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:09:35.932563 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application On instance['enabled']: Aug 06 21:09:35.932563 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application 'True' Aug 06 21:09:35.932563 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:09:35.932563 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 21:09:35.934306 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:09:35.934306 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:09:35.934306 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:09:35.934306 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:09:35.934306 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:09:35.934306 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:09:35.934306 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:09:35.934306 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:09:35.934306 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:09:35.934306 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:09:35.934306 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:09:35.934306 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:09:35.934306 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Aug 06 21:09:35.934306 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Aug 06 21:09:35.934306 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 06 21:09:35.934306 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 06 21:09:35.934306 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 06 21:09:35.935649 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 06 21:09:35.935649 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 06 21:09:35.935649 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:09:35.935649 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 06 21:09:35.935649 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 06 21:09:35.935649 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:09:35.935649 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application On instance['enabled']: Aug 06 21:09:35.935649 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application 'True' Aug 06 21:09:35.935649 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:09:35.935649 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2117/4285] 10.222.0.33 () {60 vars in 1156 bytes} [Sat Aug 6 21:09:35 2022] POST /identity/v3/endpoints => generated 281 bytes in 43 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 06 21:09:35.939106 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6d412-0992-4654-ac9a-b550c8b3f8fd tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:35.959291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6d412-0992-4654-ac9a-b550c8b3f8fd tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:35.965678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34359f-cb21-45ba-b7cb-99b1d184166d tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6252f3f1b6a4baf880774cc51a98161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f697443fb8c24846a0747b5163082d24', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:35.966967 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34359f-cb21-45ba-b7cb-99b1d184166d tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:35.968606 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34359f-cb21-45ba-b7cb-99b1d184166d tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:35.968937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34359f-cb21-45ba-b7cb-99b1d184166d tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:35.969792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e34359f-cb21-45ba-b7cb-99b1d184166d tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:35.976123 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e34359f-cb21-45ba-b7cb-99b1d184166d tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:36.029127 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-0e34359f-cb21-45ba-b7cb-99b1d184166d tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-5519631. To ensure interoperability, identifiers should be a valid uuid. Aug 06 21:09:36.029127 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 06 21:09:36.029127 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:09:36.134800 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2169/4286] 10.222.0.33 () {60 vars in 1156 bytes} [Sat Aug 6 21:09:35 2022] POST /identity/v3/endpoints => generated 354 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:09:36.138475 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f3a8b-10e1-45b0-99cb-fee0f0f13681 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:36.156347 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f3a8b-10e1-45b0-99cb-fee0f0f13681 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:36.188122 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a67753-a045-495d-b65b-e4835d261a90 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6252f3f1b6a4baf880774cc51a98161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f697443fb8c24846a0747b5163082d24', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:36.188945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a67753-a045-495d-b65b-e4835d261a90 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:36.189246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a67753-a045-495d-b65b-e4835d261a90 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:36.189719 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a67753-a045-495d-b65b-e4835d261a90 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] PATH_INFO: `/v3/regions/tempest-region-5519631` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:36.190644 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a67753-a045-495d-b65b-e4835d261a90 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-5519631)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:36.192500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a67753-a045-495d-b65b-e4835d261a90 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:36.199765 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2118/4287] 10.222.0.33 () {58 vars in 1197 bytes} [Sat Aug 6 21:09:36 2022] GET /identity/v3/regions/tempest-region-5519631 => generated 174 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:09:36.202940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34359f-cb21-45ba-b7cb-99b1d184166d tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:36.220874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34359f-cb21-45ba-b7cb-99b1d184166d tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:36.221140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ce982-e204-43a7-aef0-2f8de37ba378 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:36.222419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ce982-e204-43a7-aef0-2f8de37ba378 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:36.222842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ce982-e204-43a7-aef0-2f8de37ba378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:36.227017 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70e26a-d6a7-444e-827d-1afe5ae02273 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6252f3f1b6a4baf880774cc51a98161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f697443fb8c24846a0747b5163082d24', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:36.228046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70e26a-d6a7-444e-827d-1afe5ae02273 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:36.228531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70e26a-d6a7-444e-827d-1afe5ae02273 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:36.228968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70e26a-d6a7-444e-827d-1afe5ae02273 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] PATH_INFO: `/v3/endpoints/0ce3ff15d4aa4904bed3c7d73ec74123` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:36.232467 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:36.246231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70e26a-d6a7-444e-827d-1afe5ae02273 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=0ce3ff15d4aa4904bed3c7d73ec74123)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:36.247619 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-3c70e26a-d6a7-444e-827d-1afe5ae02273 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:36.247619 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:09:36.247619 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:09:36.250513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70e26a-d6a7-444e-827d-1afe5ae02273 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:36.259902 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-3c70e26a-d6a7-444e-827d-1afe5ae02273 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 06 21:09:36.259902 ncdv-master-1 devstack@keystone.service[102759]: Failed validating 'type' in schema['properties']['enabled']: Aug 06 21:09:36.259902 ncdv-master-1 devstack@keystone.service[102759]: {'enum': [True, False, None], 'type': 'boolean'} Aug 06 21:09:36.259902 ncdv-master-1 devstack@keystone.service[102759]: On instance['enabled']: Aug 06 21:09:36.259902 ncdv-master-1 devstack@keystone.service[102759]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 06 21:09:36.259902 ncdv-master-1 devstack@keystone.service[102759]: Failed validating 'type' in schema['properties']['enabled']: Aug 06 21:09:36.259902 ncdv-master-1 devstack@keystone.service[102759]: {'enum': [True, False, None], 'type': 'boolean'} Aug 06 21:09:36.259902 ncdv-master-1 devstack@keystone.service[102759]: On instance['enabled']: Aug 06 21:09:36.259902 ncdv-master-1 devstack@keystone.service[102759]: 'False' Aug 06 21:09:36.259902 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:09:36.259902 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 06 21:09:36.259902 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 06 21:09:36.259902 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 21:09:36.259902 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise error Aug 06 21:09:36.259902 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Aug 06 21:09:36.259902 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:09:36.259902 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 06 21:09:36.259902 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 06 21:09:36.259902 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:09:36.259902 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application On instance['enabled']: Aug 06 21:09:36.259902 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application 'False' Aug 06 21:09:36.259902 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:09:36.259902 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 21:09:36.261986 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:09:36.261986 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:09:36.261986 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:09:36.261986 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:09:36.261986 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:09:36.261986 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:09:36.261986 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:09:36.261986 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:09:36.261986 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:09:36.261986 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:09:36.261986 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:09:36.261986 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:09:36.261986 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Aug 06 21:09:36.261986 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Aug 06 21:09:36.261986 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 06 21:09:36.261986 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 06 21:09:36.261986 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 06 21:09:36.263373 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 06 21:09:36.263373 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 06 21:09:36.263373 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:09:36.263373 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 06 21:09:36.263373 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 06 21:09:36.263373 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:09:36.263373 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application On instance['enabled']: Aug 06 21:09:36.263373 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application 'False' Aug 06 21:09:36.263373 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:09:36.270583 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2170/4288] 10.222.0.33 () {60 vars in 1255 bytes} [Sat Aug 6 21:09:36 2022] PATCH /identity/v3/endpoints/0ce3ff15d4aa4904bed3c7d73ec74123 => generated 283 bytes in 70 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 06 21:09:36.271574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70e26a-d6a7-444e-827d-1afe5ae02273 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:36.282927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70e26a-d6a7-444e-827d-1afe5ae02273 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:36.284071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d04ce982-e204-43a7-aef0-2f8de37ba378 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:36.288745 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d04ce982-e204-43a7-aef0-2f8de37ba378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:36.289209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469e1fc-17d1-4d2e-8c02-a77eb19e23a9 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6252f3f1b6a4baf880774cc51a98161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f697443fb8c24846a0747b5163082d24', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:36.289826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469e1fc-17d1-4d2e-8c02-a77eb19e23a9 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:36.290250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469e1fc-17d1-4d2e-8c02-a77eb19e23a9 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:36.290524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469e1fc-17d1-4d2e-8c02-a77eb19e23a9 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] PATH_INFO: `/v3/endpoints/0ce3ff15d4aa4904bed3c7d73ec74123` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:36.291744 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469e1fc-17d1-4d2e-8c02-a77eb19e23a9 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=0ce3ff15d4aa4904bed3c7d73ec74123)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:36.292746 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-9469e1fc-17d1-4d2e-8c02-a77eb19e23a9 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:36.292746 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:09:36.292746 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:09:36.293627 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469e1fc-17d1-4d2e-8c02-a77eb19e23a9 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:36.311787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9469e1fc-17d1-4d2e-8c02-a77eb19e23a9 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '0ce3ff15d4aa4904bed3c7d73ec74123', 'request_id': 'req-9469e1fc-17d1-4d2e-8c02-a77eb19e23a9'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:36.332272 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2119/4289] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:09:36 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:36.345275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ce982-e204-43a7-aef0-2f8de37ba378 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:36.349433 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2171/4290] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:36 2022] DELETE /identity/v3/endpoints/0ce3ff15d4aa4904bed3c7d73ec74123 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:36.350403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469e1fc-17d1-4d2e-8c02-a77eb19e23a9 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:36.385481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469e1fc-17d1-4d2e-8c02-a77eb19e23a9 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:36.392233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1b47c-ee20-4472-8def-3905cb1b33e0 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6252f3f1b6a4baf880774cc51a98161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f697443fb8c24846a0747b5163082d24', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:36.393276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1b47c-ee20-4472-8def-3905cb1b33e0 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:36.393686 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1b47c-ee20-4472-8def-3905cb1b33e0 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:36.393933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1b47c-ee20-4472-8def-3905cb1b33e0 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] PATH_INFO: `/v3/regions/tempest-region-5519631` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:36.395264 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1b47c-ee20-4472-8def-3905cb1b33e0 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-5519631)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:36.396115 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-fce1b47c-ee20-4472-8def-3905cb1b33e0 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:36.396115 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:09:36.396115 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:09:36.397721 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1b47c-ee20-4472-8def-3905cb1b33e0 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:36.418056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ce982-e204-43a7-aef0-2f8de37ba378 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:36.462408 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2f235-a216-4827-91ed-54cfef4f8a1a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:36.463090 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2f235-a216-4827-91ed-54cfef4f8a1a service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:36.463411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2f235-a216-4827-91ed-54cfef4f8a1a service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:36.466140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2f235-a216-4827-91ed-54cfef4f8a1a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:36.471784 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2172/4291] 10.222.0.33 () {58 vars in 1200 bytes} [Sat Aug 6 21:09:36 2022] DELETE /identity/v3/regions/tempest-region-5519631 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:36.472900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1b47c-ee20-4472-8def-3905cb1b33e0 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:36.491561 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff2f235-a216-4827-91ed-54cfef4f8a1a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:36.495755 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff2f235-a216-4827-91ed-54cfef4f8a1a service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:36.535497 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2120/4292] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:09:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:09:36.541491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1b47c-ee20-4472-8def-3905cb1b33e0 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:36.582487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c53577-ab32-4257-b41b-78dfdc6928b0 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6252f3f1b6a4baf880774cc51a98161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f697443fb8c24846a0747b5163082d24', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:36.583158 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c53577-ab32-4257-b41b-78dfdc6928b0 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:36.583497 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c53577-ab32-4257-b41b-78dfdc6928b0 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:36.583700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c53577-ab32-4257-b41b-78dfdc6928b0 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:36.584427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c53577-ab32-4257-b41b-78dfdc6928b0 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:36.587421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c53577-ab32-4257-b41b-78dfdc6928b0 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:36.641152 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-55c53577-ab32-4257-b41b-78dfdc6928b0 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-706124681. To ensure interoperability, identifiers should be a valid uuid. Aug 06 21:09:36.641152 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 06 21:09:36.641152 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:09:36.712613 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2f235-a216-4827-91ed-54cfef4f8a1a service swift] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:36.723372 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2173/4293] 10.222.0.33 () {60 vars in 1156 bytes} [Sat Aug 6 21:09:36 2022] POST /identity/v3/endpoints => generated 358 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:36.727529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2f235-a216-4827-91ed-54cfef4f8a1a service swift] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:36.752551 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d0cef-65c5-4353-975b-2c351ad5123c tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6252f3f1b6a4baf880774cc51a98161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f697443fb8c24846a0747b5163082d24', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:36.753268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d0cef-65c5-4353-975b-2c351ad5123c tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:36.753678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d0cef-65c5-4353-975b-2c351ad5123c tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:36.754021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d0cef-65c5-4353-975b-2c351ad5123c tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] PATH_INFO: `/v3/regions/tempest-region-706124681` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:36.754716 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d0cef-65c5-4353-975b-2c351ad5123c tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-706124681)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:36.755969 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d0cef-65c5-4353-975b-2c351ad5123c tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:36.758382 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2121/4294] 10.222.0.33 () {58 vars in 1203 bytes} [Sat Aug 6 21:09:36 2022] GET /identity/v3/regions/tempest-region-706124681 => generated 178 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:09:36.763617 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c53577-ab32-4257-b41b-78dfdc6928b0 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:36.783239 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c53577-ab32-4257-b41b-78dfdc6928b0 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:36.799352 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c843c7-1587-43fa-a2ed-f0c4420ca0f8 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6252f3f1b6a4baf880774cc51a98161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f697443fb8c24846a0747b5163082d24', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:36.800218 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c843c7-1587-43fa-a2ed-f0c4420ca0f8 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:36.800511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c843c7-1587-43fa-a2ed-f0c4420ca0f8 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:36.800794 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c843c7-1587-43fa-a2ed-f0c4420ca0f8 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] PATH_INFO: `/v3/endpoints/2247caf0a5654e0395edf8f28e0c74a8` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:36.813737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c843c7-1587-43fa-a2ed-f0c4420ca0f8 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=2247caf0a5654e0395edf8f28e0c74a8)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:36.821826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c843c7-1587-43fa-a2ed-f0c4420ca0f8 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:36.845222 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-a7c843c7-1587-43fa-a2ed-f0c4420ca0f8 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 06 21:09:36.845222 ncdv-master-1 devstack@keystone.service[102759]: Failed validating 'type' in schema['properties']['enabled']: Aug 06 21:09:36.845222 ncdv-master-1 devstack@keystone.service[102759]: {'enum': [True, False, None], 'type': 'boolean'} Aug 06 21:09:36.845222 ncdv-master-1 devstack@keystone.service[102759]: On instance['enabled']: Aug 06 21:09:36.845222 ncdv-master-1 devstack@keystone.service[102759]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 06 21:09:36.845222 ncdv-master-1 devstack@keystone.service[102759]: Failed validating 'type' in schema['properties']['enabled']: Aug 06 21:09:36.845222 ncdv-master-1 devstack@keystone.service[102759]: {'enum': [True, False, None], 'type': 'boolean'} Aug 06 21:09:36.845222 ncdv-master-1 devstack@keystone.service[102759]: On instance['enabled']: Aug 06 21:09:36.845222 ncdv-master-1 devstack@keystone.service[102759]: 'True' Aug 06 21:09:36.845222 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:09:36.845222 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 06 21:09:36.845222 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 06 21:09:36.845222 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 21:09:36.845222 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise error Aug 06 21:09:36.845222 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Aug 06 21:09:36.845222 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:09:36.845222 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 06 21:09:36.845222 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 06 21:09:36.845222 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:09:36.845222 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application On instance['enabled']: Aug 06 21:09:36.845222 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application 'True' Aug 06 21:09:36.845222 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:09:36.845222 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 21:09:36.847418 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:09:36.847418 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:09:36.847418 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:09:36.847418 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:09:36.847418 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:09:36.847418 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:09:36.847418 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:09:36.847418 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:09:36.847418 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:09:36.847418 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:09:36.847418 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:09:36.847418 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:09:36.847418 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Aug 06 21:09:36.847418 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Aug 06 21:09:36.847418 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 06 21:09:36.847418 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 06 21:09:36.847418 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 06 21:09:36.848725 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 06 21:09:36.848725 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 06 21:09:36.848725 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:09:36.848725 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 06 21:09:36.848725 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 06 21:09:36.848725 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:09:36.848725 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application On instance['enabled']: Aug 06 21:09:36.848725 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application 'True' Aug 06 21:09:36.848725 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:09:36.855876 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2174/4295] 10.222.0.33 () {60 vars in 1255 bytes} [Sat Aug 6 21:09:36 2022] PATCH /identity/v3/endpoints/2247caf0a5654e0395edf8f28e0c74a8 => generated 281 bytes in 91 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 06 21:09:36.857825 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d0cef-65c5-4353-975b-2c351ad5123c tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:36.875037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d0cef-65c5-4353-975b-2c351ad5123c tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:36.881793 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc6e27-2829-4a81-b91d-16d77aa2fb2c tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6252f3f1b6a4baf880774cc51a98161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f697443fb8c24846a0747b5163082d24', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:36.884406 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc6e27-2829-4a81-b91d-16d77aa2fb2c tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:36.885483 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc6e27-2829-4a81-b91d-16d77aa2fb2c tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:36.886610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc6e27-2829-4a81-b91d-16d77aa2fb2c tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] PATH_INFO: `/v3/endpoints/2247caf0a5654e0395edf8f28e0c74a8` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:36.889671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc6e27-2829-4a81-b91d-16d77aa2fb2c tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=2247caf0a5654e0395edf8f28e0c74a8)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:36.893497 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-27cc6e27-2829-4a81-b91d-16d77aa2fb2c tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:36.893497 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:09:36.893497 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:09:36.898747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc6e27-2829-4a81-b91d-16d77aa2fb2c tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:36.928050 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-27cc6e27-2829-4a81-b91d-16d77aa2fb2c tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '2247caf0a5654e0395edf8f28e0c74a8', 'request_id': 'req-27cc6e27-2829-4a81-b91d-16d77aa2fb2c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:36.946950 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2122/4296] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:36 2022] DELETE /identity/v3/endpoints/2247caf0a5654e0395edf8f28e0c74a8 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:36.952191 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c843c7-1587-43fa-a2ed-f0c4420ca0f8 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:36.967266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c843c7-1587-43fa-a2ed-f0c4420ca0f8 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:36.999818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68c612-e5ea-4504-bfba-50eb201aafb3 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6252f3f1b6a4baf880774cc51a98161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f697443fb8c24846a0747b5163082d24', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:37.000702 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68c612-e5ea-4504-bfba-50eb201aafb3 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:37.001000 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68c612-e5ea-4504-bfba-50eb201aafb3 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:37.001275 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68c612-e5ea-4504-bfba-50eb201aafb3 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] PATH_INFO: `/v3/regions/tempest-region-706124681` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:37.003888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf68c612-e5ea-4504-bfba-50eb201aafb3 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-706124681)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:37.003888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf68c612-e5ea-4504-bfba-50eb201aafb3 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:37.032434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a05ab-0546-459a-964f-be442eaa09ad None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:37.032770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a05ab-0546-459a-964f-be442eaa09ad None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:37.033049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a05ab-0546-459a-964f-be442eaa09ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:37.083607 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2175/4297] 10.222.0.33 () {58 vars in 1206 bytes} [Sat Aug 6 21:09:36 2022] DELETE /identity/v3/regions/tempest-region-706124681 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:37.087186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6aef7-e28f-471e-b5d4-64b5f87c9a5b None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:37.087724 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6aef7-e28f-471e-b5d4-64b5f87c9a5b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:37.088002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6aef7-e28f-471e-b5d4-64b5f87c9a5b None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:37.093662 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2176/4298] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 21:09:37 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 21:09:37.094512 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd6aef7-e28f-471e-b5d4-64b5f87c9a5b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:37.096780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-3c6a05ab-0546-459a-964f-be442eaa09ad None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:37.101682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3c6a05ab-0546-459a-964f-be442eaa09ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:37.170036 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2123/4299] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:09:37 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:09:37.171649 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221db4c6-ffcc-4c57-8252-23411268a23f None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:37.172090 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221db4c6-ffcc-4c57-8252-23411268a23f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:37.172530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221db4c6-ffcc-4c57-8252-23411268a23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:37.197738 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd6aef7-e28f-471e-b5d4-64b5f87c9a5b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:37.220778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaacb7e-39fd-4141-9457-93a469ec6411 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6252f3f1b6a4baf880774cc51a98161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f697443fb8c24846a0747b5163082d24', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:37.221474 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaacb7e-39fd-4141-9457-93a469ec6411 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:37.221805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaacb7e-39fd-4141-9457-93a469ec6411 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:37.222051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaacb7e-39fd-4141-9457-93a469ec6411 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] PATH_INFO: `/v3/services/01225d175987476db16bab0420139220` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:37.222387 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-221db4c6-ffcc-4c57-8252-23411268a23f None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:37.223806 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-221db4c6-ffcc-4c57-8252-23411268a23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:37.224756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaacb7e-39fd-4141-9457-93a469ec6411 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: Authorizing `identity:delete_service(service_id=01225d175987476db16bab0420139220)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:37.227143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaacb7e-39fd-4141-9457-93a469ec6411 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:37.278945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:37.321532 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2177/4300] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:09:37 2022] DELETE /identity/v3/services/01225d175987476db16bab0420139220 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:37.324117 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaacb7e-39fd-4141-9457-93a469ec6411 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:37.458312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaacb7e-39fd-4141-9457-93a469ec6411 tempest-EndpointsNegativeTestJSON-1445759901 tempest-EndpointsNegativeTestJSON-1445759901-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:37.514656 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2aa26f-68fe-4de5-80e8-3313921d54c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:37.524176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2aa26f-68fe-4de5-80e8-3313921d54c2 service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:37.524409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2aa26f-68fe-4de5-80e8-3313921d54c2 service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:37.524662 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2aa26f-68fe-4de5-80e8-3313921d54c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:37.575938 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2aa26f-68fe-4de5-80e8-3313921d54c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:37.578168 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2aa26f-68fe-4de5-80e8-3313921d54c2 service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:37.629699 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2178/4301] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:09:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:09:37.631092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2aa26f-68fe-4de5-80e8-3313921d54c2 service swift] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:37.672788 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2124/4302] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:09:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 502 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:37.750905 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221db4c6-ffcc-4c57-8252-23411268a23f None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:37.755708 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-221db4c6-ffcc-4c57-8252-23411268a23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:37.797014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221db4c6-ffcc-4c57-8252-23411268a23f None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:37.797148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:37.827072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84d9b0-3f20-45ba-98e4-32eb205d46da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:37.827870 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84d9b0-3f20-45ba-98e4-32eb205d46da service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:37.829018 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84d9b0-3f20-45ba-98e4-32eb205d46da service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:37.829248 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84d9b0-3f20-45ba-98e4-32eb205d46da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:37.862808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe84d9b0-3f20-45ba-98e4-32eb205d46da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:37.864490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe84d9b0-3f20-45ba-98e4-32eb205d46da service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:37.912804 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2125/4303] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:09:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:09:37.958126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2aa26f-68fe-4de5-80e8-3313921d54c2 service swift] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:37.969587 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3d530-b738-4ec2-91e4-cc3331368562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:37.970237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3d530-b738-4ec2-91e4-cc3331368562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:37.970513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3d530-b738-4ec2-91e4-cc3331368562 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:37.970902 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3d530-b738-4ec2-91e4-cc3331368562 admin admin] PATH_INFO: `/v3/users/7c898c0a2e9a42b5866b8cd8b8993093` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:37.974458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac3d530-b738-4ec2-91e4-cc3331368562 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c898c0a2e9a42b5866b8cd8b8993093)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:37.976623 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac3d530-b738-4ec2-91e4-cc3331368562 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:38.085724 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bac3d530-b738-4ec2-91e4-cc3331368562 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c898c0a2e9a42b5866b8cd8b8993093'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:38.102981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bac3d530-b738-4ec2-91e4-cc3331368562 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c898c0a2e9a42b5866b8cd8b8993093'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:38.109199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bac3d530-b738-4ec2-91e4-cc3331368562 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c898c0a2e9a42b5866b8cd8b8993093'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:38.119214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bac3d530-b738-4ec2-91e4-cc3331368562 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c898c0a2e9a42b5866b8cd8b8993093'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:38.132293 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bac3d530-b738-4ec2-91e4-cc3331368562 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c898c0a2e9a42b5866b8cd8b8993093'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:38.166010 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2179/4304] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:09:37 2022] DELETE /identity/v3/users/7c898c0a2e9a42b5866b8cd8b8993093 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:38.170749 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c3a36-eb1e-4b7d-8487-f91c47bbb87f None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:38.171038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c3a36-eb1e-4b7d-8487-f91c47bbb87f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:38.171375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c3a36-eb1e-4b7d-8487-f91c47bbb87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:38.191955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66429ead-2e37-466e-a4d5-5e7385b47dc0 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:38.192242 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66429ead-2e37-466e-a4d5-5e7385b47dc0 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:38.192519 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66429ead-2e37-466e-a4d5-5e7385b47dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:38.219195 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-9d6c3a36-eb1e-4b7d-8487-f91c47bbb87f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:38.220513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9d6c3a36-eb1e-4b7d-8487-f91c47bbb87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:38.266342 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-66429ead-2e37-466e-a4d5-5e7385b47dc0 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:38.272182 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-66429ead-2e37-466e-a4d5-5e7385b47dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:38.406942 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2126/4305] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:38.452900 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c3a36-eb1e-4b7d-8487-f91c47bbb87f None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:38.455822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9d6c3a36-eb1e-4b7d-8487-f91c47bbb87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:38.466451 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2180/4306] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:09:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:38.488416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66429ead-2e37-466e-a4d5-5e7385b47dc0 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:38.494680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-66429ead-2e37-466e-a4d5-5e7385b47dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:38.601565 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:38.698487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c3a36-eb1e-4b7d-8487-f91c47bbb87f None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:38.711670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42391cdc-8664-4113-924b-3a90938e63c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:38.712353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42391cdc-8664-4113-924b-3a90938e63c3 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:38.712673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42391cdc-8664-4113-924b-3a90938e63c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:38.714115 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42391cdc-8664-4113-924b-3a90938e63c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:38.735043 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42391cdc-8664-4113-924b-3a90938e63c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:38.739889 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42391cdc-8664-4113-924b-3a90938e63c3 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:38.744289 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66429ead-2e37-466e-a4d5-5e7385b47dc0 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:38.760051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b283e-d171-41af-a71f-927247b10164 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:38.761204 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b283e-d171-41af-a71f-927247b10164 service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:38.764151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b283e-d171-41af-a71f-927247b10164 service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:38.764662 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b283e-d171-41af-a71f-927247b10164 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:38.770007 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2127/4307] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:09:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:09:38.780275 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b283e-d171-41af-a71f-927247b10164 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:38.782619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b283e-d171-41af-a71f-927247b10164 service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:38.806262 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2181/4308] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:09:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:09:39.201673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77b4e4-90f5-4cc0-8bba-9d8eb0cf1554 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:39.202394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77b4e4-90f5-4cc0-8bba-9d8eb0cf1554 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:39.202394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77b4e4-90f5-4cc0-8bba-9d8eb0cf1554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:39.255573 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-df77b4e4-90f5-4cc0-8bba-9d8eb0cf1554 None None] MFA Rules not processed for user `bdf1b5180a814cf39234892c6c1f26df`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:39.257112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-df77b4e4-90f5-4cc0-8bba-9d8eb0cf1554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:39.311354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:39.338960 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0097c6f-8c0c-4fe8-8ae6-e094889909b2 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:39.339459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0097c6f-8c0c-4fe8-8ae6-e094889909b2 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:39.339566 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0097c6f-8c0c-4fe8-8ae6-e094889909b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:39.376610 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-c0097c6f-8c0c-4fe8-8ae6-e094889909b2 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:39.379434 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c0097c6f-8c0c-4fe8-8ae6-e094889909b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:39.397750 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2182/4309] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:09:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:09:39.417867 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0097c6f-8c0c-4fe8-8ae6-e094889909b2 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:39.440932 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2128/4310] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:39.450297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0097c6f-8c0c-4fe8-8ae6-e094889909b2 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:39.459829 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c46c3c-8de3-42d6-ba81-85afc2b97b9d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:39.461293 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c46c3c-8de3-42d6-ba81-85afc2b97b9d service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:39.462232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c46c3c-8de3-42d6-ba81-85afc2b97b9d service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:39.462924 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c46c3c-8de3-42d6-ba81-85afc2b97b9d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:39.480132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c46c3c-8de3-42d6-ba81-85afc2b97b9d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:39.483368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c46c3c-8de3-42d6-ba81-85afc2b97b9d service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:39.511116 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2183/4311] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:09:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:09:40.020901 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004fc2c-7757-4630-8996-562dc74e5941 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:40.021196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004fc2c-7757-4630-8996-562dc74e5941 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:40.021915 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004fc2c-7757-4630-8996-562dc74e5941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:40.047932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-7004fc2c-7757-4630-8996-562dc74e5941 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:40.050524 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7004fc2c-7757-4630-8996-562dc74e5941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:40.065669 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2129/4312] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:09:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:40.079126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c46c3c-8de3-42d6-ba81-85afc2b97b9d service swift] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:40.128508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c46c3c-8de3-42d6-ba81-85afc2b97b9d service swift] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:40.161729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66220c8-6156-48d0-877b-8de95170373a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:40.162513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66220c8-6156-48d0-877b-8de95170373a service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:40.162834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66220c8-6156-48d0-877b-8de95170373a service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:40.163110 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66220c8-6156-48d0-877b-8de95170373a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:40.190005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66220c8-6156-48d0-877b-8de95170373a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:40.194506 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66220c8-6156-48d0-877b-8de95170373a service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:40.221688 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2184/4313] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:09:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:09:40.834345 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004fc2c-7757-4630-8996-562dc74e5941 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:40.837199 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7004fc2c-7757-4630-8996-562dc74e5941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:40.883976 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004fc2c-7757-4630-8996-562dc74e5941 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:40.903940 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd3027-db3f-487a-a89d-7df3ce7c24a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:40.905353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd3027-db3f-487a-a89d-7df3ce7c24a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:40.906922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd3027-db3f-487a-a89d-7df3ce7c24a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:40.908011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd3027-db3f-487a-a89d-7df3ce7c24a8 admin admin] PATH_INFO: `/v3/projects/36af49960c97428ab8ae9bfc057032dc` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:40.911638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd3027-db3f-487a-a89d-7df3ce7c24a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36af49960c97428ab8ae9bfc057032dc)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:40.915733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd3027-db3f-487a-a89d-7df3ce7c24a8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:41.052203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-05fd3027-db3f-487a-a89d-7df3ce7c24a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36af49960c97428ab8ae9bfc057032dc', 'request_id': 'req-05fd3027-db3f-487a-a89d-7df3ce7c24a8'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:41.059516 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-05fd3027-db3f-487a-a89d-7df3ce7c24a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36af49960c97428ab8ae9bfc057032dc', 'request_id': 'req-05fd3027-db3f-487a-a89d-7df3ce7c24a8'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:41.070845 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-05fd3027-db3f-487a-a89d-7df3ce7c24a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36af49960c97428ab8ae9bfc057032dc', 'request_id': 'req-05fd3027-db3f-487a-a89d-7df3ce7c24a8'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:41.103689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-05fd3027-db3f-487a-a89d-7df3ce7c24a8 admin admin] The token cache is being invalidate because project 36af49960c97428ab8ae9bfc057032dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:09:41.103689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-05fd3027-db3f-487a-a89d-7df3ce7c24a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:41.103689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-05fd3027-db3f-487a-a89d-7df3ce7c24a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:41.115581 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2130/4314] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:09:40 2022] DELETE /identity/v3/projects/36af49960c97428ab8ae9bfc057032dc => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:41.119777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66220c8-6156-48d0-877b-8de95170373a service swift] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:41.134472 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66220c8-6156-48d0-877b-8de95170373a service swift] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:41.299417 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ffc3d-d44a-4d07-8778-d592ebb949fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:41.300885 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ffc3d-d44a-4d07-8778-d592ebb949fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:41.302328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ffc3d-d44a-4d07-8778-d592ebb949fb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:41.302751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ffc3d-d44a-4d07-8778-d592ebb949fb admin admin] PATH_INFO: `/v3/users/b6252f3f1b6a4baf880774cc51a98161` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:41.304442 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ffc3d-d44a-4d07-8778-d592ebb949fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6252f3f1b6a4baf880774cc51a98161)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:41.307439 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ffc3d-d44a-4d07-8778-d592ebb949fb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:41.421397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-078ffc3d-d44a-4d07-8778-d592ebb949fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6252f3f1b6a4baf880774cc51a98161'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:41.431179 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-078ffc3d-d44a-4d07-8778-d592ebb949fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6252f3f1b6a4baf880774cc51a98161'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:41.432225 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-078ffc3d-d44a-4d07-8778-d592ebb949fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6252f3f1b6a4baf880774cc51a98161'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:41.433038 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-078ffc3d-d44a-4d07-8778-d592ebb949fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6252f3f1b6a4baf880774cc51a98161'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:41.448967 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-078ffc3d-d44a-4d07-8778-d592ebb949fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6252f3f1b6a4baf880774cc51a98161'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:41.477534 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2185/4315] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:09:41 2022] DELETE /identity/v3/users/b6252f3f1b6a4baf880774cc51a98161 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:42.026663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee9561-6f27-47b3-88a5-a64eaa4e2d2c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:42.027515 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee9561-6f27-47b3-88a5-a64eaa4e2d2c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:42.027979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee9561-6f27-47b3-88a5-a64eaa4e2d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:42.049785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-5aee9561-6f27-47b3-88a5-a64eaa4e2d2c None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:42.051395 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5aee9561-6f27-47b3-88a5-a64eaa4e2d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:42.175518 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2131/4316] 10.222.0.33 () {58 vars in 967 bytes} [Sat Aug 6 21:09:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:42.197102 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ffc3d-d44a-4d07-8778-d592ebb949fb admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:42.200112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-078ffc3d-d44a-4d07-8778-d592ebb949fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:42.227825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:42.313910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ffc3d-d44a-4d07-8778-d592ebb949fb admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:42.320232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c60fd-7b02-432a-b599-db2e0f482c36 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:42.320852 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c60fd-7b02-432a-b599-db2e0f482c36 service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:42.321325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c60fd-7b02-432a-b599-db2e0f482c36 service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:42.321845 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c60fd-7b02-432a-b599-db2e0f482c36 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:42.335708 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c60fd-7b02-432a-b599-db2e0f482c36 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:42.337934 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c60fd-7b02-432a-b599-db2e0f482c36 service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:42.348956 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2186/4317] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:09:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:09:42.405716 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee9561-6f27-47b3-88a5-a64eaa4e2d2c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:42.409763 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5aee9561-6f27-47b3-88a5-a64eaa4e2d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:42.510107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:42.576761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba7000-82c6-4b74-a06b-b907847e4bf6 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:42.577123 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba7000-82c6-4b74-a06b-b907847e4bf6 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:42.577464 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee9561-6f27-47b3-88a5-a64eaa4e2d2c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:42.577595 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba7000-82c6-4b74-a06b-b907847e4bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:42.584922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52991451-f332-449f-8b2e-a572ec58802f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:42.585679 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52991451-f332-449f-8b2e-a572ec58802f service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:42.586468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52991451-f332-449f-8b2e-a572ec58802f service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:42.586947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52991451-f332-449f-8b2e-a572ec58802f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:42.589547 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-52991451-f332-449f-8b2e-a572ec58802f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:42.601781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-fdba7000-82c6-4b74-a06b-b907847e4bf6 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:42.603478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-fdba7000-82c6-4b74-a06b-b907847e4bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:42.614343 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2187/4318] 10.222.0.33 () {58 vars in 967 bytes} [Sat Aug 6 21:09:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:09:42.634025 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba7000-82c6-4b74-a06b-b907847e4bf6 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:42.666621 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba7000-82c6-4b74-a06b-b907847e4bf6 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:42.678605 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e29e0a-dbb9-467f-9bef-462b977a7f69 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:42.679341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e29e0a-dbb9-467f-9bef-462b977a7f69 service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:42.680097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e29e0a-dbb9-467f-9bef-462b977a7f69 service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:42.681677 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e29e0a-dbb9-467f-9bef-462b977a7f69 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:42.701699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e29e0a-dbb9-467f-9bef-462b977a7f69 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:42.706339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e29e0a-dbb9-467f-9bef-462b977a7f69 service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:42.726593 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52991451-f332-449f-8b2e-a572ec58802f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:42.728266 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52991451-f332-449f-8b2e-a572ec58802f service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:42.733131 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2188/4319] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:09:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:09:42.764908 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2132/4320] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:09:42 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:09:42.886825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e29e0a-dbb9-467f-9bef-462b977a7f69 service swift] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:42.890908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e8e29e0a-dbb9-467f-9bef-462b977a7f69 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:43.025276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfd0af-a055-4064-aa29-a581914c72a5 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:43.025905 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfd0af-a055-4064-aa29-a581914c72a5 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:43.026452 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfd0af-a055-4064-aa29-a581914c72a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:43.047131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e29e0a-dbb9-467f-9bef-462b977a7f69 service swift] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:43.052129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-c3cfd0af-a055-4064-aa29-a581914c72a5 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:43.053411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c3cfd0af-a055-4064-aa29-a581914c72a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:43.059971 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46c3ed-9662-4d33-8f4f-22e133afabff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:43.061501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46c3ed-9662-4d33-8f4f-22e133afabff admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:43.061952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46c3ed-9662-4d33-8f4f-22e133afabff admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:43.062299 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46c3ed-9662-4d33-8f4f-22e133afabff admin admin] PATH_INFO: `/v3/users/7dcd210e197347f8ad1622ee882bee92` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:43.063614 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b46c3ed-9662-4d33-8f4f-22e133afabff admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dcd210e197347f8ad1622ee882bee92)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:43.066824 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b46c3ed-9662-4d33-8f4f-22e133afabff admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:43.070964 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2133/4321] 10.222.0.33 () {58 vars in 967 bytes} [Sat Aug 6 21:09:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:09:43.090993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cfd0af-a055-4064-aa29-a581914c72a5 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:43.124232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cfd0af-a055-4064-aa29-a581914c72a5 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:43.137842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f1979-3f40-497c-a2e6-06e842b56f25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:43.140078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f1979-3f40-497c-a2e6-06e842b56f25 service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:43.141109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f1979-3f40-497c-a2e6-06e842b56f25 service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:43.141634 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f1979-3f40-497c-a2e6-06e842b56f25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:43.151842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8b46c3ed-9662-4d33-8f4f-22e133afabff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dcd210e197347f8ad1622ee882bee92'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:43.160270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8b46c3ed-9662-4d33-8f4f-22e133afabff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dcd210e197347f8ad1622ee882bee92'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:43.160999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8b46c3ed-9662-4d33-8f4f-22e133afabff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dcd210e197347f8ad1622ee882bee92'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:43.161939 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8b46c3ed-9662-4d33-8f4f-22e133afabff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dcd210e197347f8ad1622ee882bee92'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:43.168075 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f1979-3f40-497c-a2e6-06e842b56f25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:43.170015 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f1979-3f40-497c-a2e6-06e842b56f25 service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:43.172274 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8b46c3ed-9662-4d33-8f4f-22e133afabff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dcd210e197347f8ad1622ee882bee92'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:43.190874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:43.196822 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2189/4322] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:09:42 2022] DELETE /identity/v3/users/7dcd210e197347f8ad1622ee882bee92 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:43.204476 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2134/4323] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:09:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:09:43.396033 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aea085-26d2-4f35-8243-bea5635b3da4 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:43.396680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aea085-26d2-4f35-8243-bea5635b3da4 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:43.396680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aea085-26d2-4f35-8243-bea5635b3da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:43.421362 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-34aea085-26d2-4f35-8243-bea5635b3da4 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:43.422498 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-34aea085-26d2-4f35-8243-bea5635b3da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:43.498341 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f1979-3f40-497c-a2e6-06e842b56f25 service swift] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:43.513861 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f1979-3f40-497c-a2e6-06e842b56f25 service swift] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:43.543726 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2190/4324] 10.222.0.33 () {58 vars in 967 bytes} [Sat Aug 6 21:09:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:43.557078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aea085-26d2-4f35-8243-bea5635b3da4 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:43.558770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-34aea085-26d2-4f35-8243-bea5635b3da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:43.625178 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b518b-4feb-4259-b156-b6b054bf1871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:43.625914 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b518b-4feb-4259-b156-b6b054bf1871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:43.626487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b518b-4feb-4259-b156-b6b054bf1871 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:43.627547 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b518b-4feb-4259-b156-b6b054bf1871 admin admin] PATH_INFO: `/v3/projects/dbbbe30122a7461ea225294728dc8af7` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:43.628971 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634b518b-4feb-4259-b156-b6b054bf1871 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbbbe30122a7461ea225294728dc8af7)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:43.631320 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634b518b-4feb-4259-b156-b6b054bf1871 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:43.677831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aea085-26d2-4f35-8243-bea5635b3da4 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:43.684883 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570fa9d6-b73b-40df-9909-55b76867ffed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:43.685976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fa9d6-b73b-40df-9909-55b76867ffed service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:43.686260 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fa9d6-b73b-40df-9909-55b76867ffed service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:43.686534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fa9d6-b73b-40df-9909-55b76867ffed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:43.700246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:43.701441 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570fa9d6-b73b-40df-9909-55b76867ffed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:43.703522 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570fa9d6-b73b-40df-9909-55b76867ffed service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:43.704299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-634b518b-4feb-4259-b156-b6b054bf1871 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbbbe30122a7461ea225294728dc8af7', 'request_id': 'req-634b518b-4feb-4259-b156-b6b054bf1871'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:43.716213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-634b518b-4feb-4259-b156-b6b054bf1871 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbbbe30122a7461ea225294728dc8af7', 'request_id': 'req-634b518b-4feb-4259-b156-b6b054bf1871'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:43.718731 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2191/4325] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:09:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 06 21:09:43.724123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-634b518b-4feb-4259-b156-b6b054bf1871 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbbbe30122a7461ea225294728dc8af7', 'request_id': 'req-634b518b-4feb-4259-b156-b6b054bf1871'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:43.745139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-634b518b-4feb-4259-b156-b6b054bf1871 admin admin] The token cache is being invalidate because project dbbbe30122a7461ea225294728dc8af7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:09:43.745530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-634b518b-4feb-4259-b156-b6b054bf1871 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:43.746240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-634b518b-4feb-4259-b156-b6b054bf1871 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:43.748220 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2135/4326] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:09:43 2022] DELETE /identity/v3/projects/dbbbe30122a7461ea225294728dc8af7 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:43.753928 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da369c17-80f9-490c-9580-b19e060987e1 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:43.754699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da369c17-80f9-490c-9580-b19e060987e1 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:43.755204 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da369c17-80f9-490c-9580-b19e060987e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:43.791532 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-da369c17-80f9-490c-9580-b19e060987e1 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:43.793074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-da369c17-80f9-490c-9580-b19e060987e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:43.910254 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2192/4327] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:43.919053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7217d92-9b69-48c6-af9f-3e90487ff679 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:43.919342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7217d92-9b69-48c6-af9f-3e90487ff679 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:43.919620 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7217d92-9b69-48c6-af9f-3e90487ff679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:43.922392 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b6a1c-5896-4f48-a6d0-52aa386977d2 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:43.922795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b6a1c-5896-4f48-a6d0-52aa386977d2 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:43.923181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b6a1c-5896-4f48-a6d0-52aa386977d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:43.943820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f7217d92-9b69-48c6-af9f-3e90487ff679 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:43.945950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f7217d92-9b69-48c6-af9f-3e90487ff679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:43.948410 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-568b6a1c-5896-4f48-a6d0-52aa386977d2 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:43.949798 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-568b6a1c-5896-4f48-a6d0-52aa386977d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:43.958154 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2136/4328] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:43.959472 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7217d92-9b69-48c6-af9f-3e90487ff679 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:43.960826 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f7217d92-9b69-48c6-af9f-3e90487ff679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:43.977310 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7217d92-9b69-48c6-af9f-3e90487ff679 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:43.983194 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01cb91a-18c4-48ae-8de1-e3bb052dae55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:43.984455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cb91a-18c4-48ae-8de1-e3bb052dae55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:43.985678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cb91a-18c4-48ae-8de1-e3bb052dae55 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:43.985678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cb91a-18c4-48ae-8de1-e3bb052dae55 admin admin] PATH_INFO: `/v3/projects/f697443fb8c24846a0747b5163082d24` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:43.987918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01cb91a-18c4-48ae-8de1-e3bb052dae55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f697443fb8c24846a0747b5163082d24)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:43.991005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01cb91a-18c4-48ae-8de1-e3bb052dae55 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:43.996332 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:44.036774 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2193/4329] 10.222.0.33 () {58 vars in 967 bytes} [Sat Aug 6 21:09:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:44.037652 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b6a1c-5896-4f48-a6d0-52aa386977d2 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:44.055436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b6a1c-5896-4f48-a6d0-52aa386977d2 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:44.063770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fcd33-3577-4f69-ae18-a2b2584627dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:44.066452 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fcd33-3577-4f69-ae18-a2b2584627dd admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:44.067326 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fcd33-3577-4f69-ae18-a2b2584627dd admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:44.067614 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fcd33-3577-4f69-ae18-a2b2584627dd admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:44.068567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fcd33-3577-4f69-ae18-a2b2584627dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:09:44.068922 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fcd33-3577-4f69-ae18-a2b2584627dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:44.072301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fcd33-3577-4f69-ae18-a2b2584627dd admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:44.116256 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2194/4330] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:09:44.116256 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fcd33-3577-4f69-ae18-a2b2584627dd admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:44.116256 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-bd1fcd33-3577-4f69-ae18-a2b2584627dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:44.129413 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f01cb91a-18c4-48ae-8de1-e3bb052dae55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f697443fb8c24846a0747b5163082d24', 'request_id': 'req-f01cb91a-18c4-48ae-8de1-e3bb052dae55'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:44.138715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f01cb91a-18c4-48ae-8de1-e3bb052dae55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f697443fb8c24846a0747b5163082d24', 'request_id': 'req-f01cb91a-18c4-48ae-8de1-e3bb052dae55'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:44.149108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f01cb91a-18c4-48ae-8de1-e3bb052dae55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f697443fb8c24846a0747b5163082d24', 'request_id': 'req-f01cb91a-18c4-48ae-8de1-e3bb052dae55'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:44.184162 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f01cb91a-18c4-48ae-8de1-e3bb052dae55 admin admin] The token cache is being invalidate because project f697443fb8c24846a0747b5163082d24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:09:44.185013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f01cb91a-18c4-48ae-8de1-e3bb052dae55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:44.189021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f01cb91a-18c4-48ae-8de1-e3bb052dae55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:44.195724 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2137/4331] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:09:43 2022] DELETE /identity/v3/projects/f697443fb8c24846a0747b5163082d24 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:44.196989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01cb91a-18c4-48ae-8de1-e3bb052dae55 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:44.199067 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f01cb91a-18c4-48ae-8de1-e3bb052dae55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:44.228152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fcd33-3577-4f69-ae18-a2b2584627dd admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:44.287170 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01cb91a-18c4-48ae-8de1-e3bb052dae55 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:44.292987 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40baa1f0-2275-4b73-a2da-84fa9333f258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:44.294105 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40baa1f0-2275-4b73-a2da-84fa9333f258 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:44.294456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40baa1f0-2275-4b73-a2da-84fa9333f258 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:44.295237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40baa1f0-2275-4b73-a2da-84fa9333f258 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:44.295953 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40baa1f0-2275-4b73-a2da-84fa9333f258 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:44.298312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40baa1f0-2275-4b73-a2da-84fa9333f258 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:44.341427 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2138/4332] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:09:44 2022] POST /identity/v3/projects => generated 363 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:44.343146 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1adc895-8f64-46e3-a7df-13e5e943f914 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:44.343428 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1adc895-8f64-46e3-a7df-13e5e943f914 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:44.343771 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1adc895-8f64-46e3-a7df-13e5e943f914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:44.348511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24eb547-f898-4deb-8098-bed0938f938c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:44.350220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24eb547-f898-4deb-8098-bed0938f938c service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:44.350766 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24eb547-f898-4deb-8098-bed0938f938c service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:44.351317 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24eb547-f898-4deb-8098-bed0938f938c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:44.355348 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d24eb547-f898-4deb-8098-bed0938f938c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:44.375503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d1adc895-8f64-46e3-a7df-13e5e943f914 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:44.377272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d1adc895-8f64-46e3-a7df-13e5e943f914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:44.428475 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:44.455811 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24eb547-f898-4deb-8098-bed0938f938c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:44.458598 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24eb547-f898-4deb-8098-bed0938f938c service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:44.471321 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2195/4333] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:09:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:09:44.472241 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24eb547-f898-4deb-8098-bed0938f938c service swift] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:44.479478 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2139/4334] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:44.487118 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24eb547-f898-4deb-8098-bed0938f938c service swift] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:44.489465 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169c0a9-2e2c-4c0c-b61a-8f78741fbacc None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:44.489680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169c0a9-2e2c-4c0c-b61a-8f78741fbacc None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:44.490461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169c0a9-2e2c-4c0c-b61a-8f78741fbacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:44.493276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed0d62-695e-44a6-9a96-f809de9e91e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:44.494002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed0d62-695e-44a6-9a96-f809de9e91e6 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:44.494389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed0d62-695e-44a6-9a96-f809de9e91e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:44.494792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed0d62-695e-44a6-9a96-f809de9e91e6 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:44.495512 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed0d62-695e-44a6-9a96-f809de9e91e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:44.497517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed0d62-695e-44a6-9a96-f809de9e91e6 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:44.510947 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:44.518692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d169c0a9-2e2c-4c0c-b61a-8f78741fbacc None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:44.520661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d169c0a9-2e2c-4c0c-b61a-8f78741fbacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:44.529725 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2196/4335] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:09:44 2022] POST /identity/v3/users => generated 282 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:44.531549 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2140/4336] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:44.535702 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed0d62-695e-44a6-9a96-f809de9e91e6 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:44.536733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169c0a9-2e2c-4c0c-b61a-8f78741fbacc None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:44.559268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169c0a9-2e2c-4c0c-b61a-8f78741fbacc None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:44.560134 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed0d62-695e-44a6-9a96-f809de9e91e6 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:44.568571 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60cbc58-499f-408a-9b9f-6c44322c230b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:44.569285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cbc58-499f-408a-9b9f-6c44322c230b admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:44.569574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cbc58-499f-408a-9b9f-6c44322c230b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:44.569888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cbc58-499f-408a-9b9f-6c44322c230b admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:44.570561 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60cbc58-499f-408a-9b9f-6c44322c230b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:44.572474 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60cbc58-499f-408a-9b9f-6c44322c230b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:44.579386 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d53cd-293b-4546-8541-f66c46f25f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:44.582613 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d53cd-293b-4546-8541-f66c46f25f93 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:44.583474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d53cd-293b-4546-8541-f66c46f25f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:44.584574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d53cd-293b-4546-8541-f66c46f25f93 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:44.587392 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d53cd-293b-4546-8541-f66c46f25f93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:09:44.589217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d53cd-293b-4546-8541-f66c46f25f93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:44.591426 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2197/4337] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:09:44.592786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60cbc58-499f-408a-9b9f-6c44322c230b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:44.597139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d53cd-293b-4546-8541-f66c46f25f93 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:44.613827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60cbc58-499f-408a-9b9f-6c44322c230b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:44.625094 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59889038-1587-49db-a670-77f66dcd4f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:44.625782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59889038-1587-49db-a670-77f66dcd4f8e admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:44.626067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59889038-1587-49db-a670-77f66dcd4f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:44.628914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59889038-1587-49db-a670-77f66dcd4f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:44.629815 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59889038-1587-49db-a670-77f66dcd4f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:44.631553 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59889038-1587-49db-a670-77f66dcd4f8e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:44.635180 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2141/4338] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:09:44.640092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d53cd-293b-4546-8541-f66c46f25f93 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:44.651142 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2198/4339] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:09:44.653988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59889038-1587-49db-a670-77f66dcd4f8e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:44.657456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d53cd-293b-4546-8541-f66c46f25f93 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:44.686604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec797899-c9f2-4560-89e4-0b7adba5ab87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:44.687234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec797899-c9f2-4560-89e4-0b7adba5ab87 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:44.687527 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec797899-c9f2-4560-89e4-0b7adba5ab87 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:44.687785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec797899-c9f2-4560-89e4-0b7adba5ab87 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:44.688421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec797899-c9f2-4560-89e4-0b7adba5ab87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:44.690987 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec797899-c9f2-4560-89e4-0b7adba5ab87 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:44.691542 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59889038-1587-49db-a670-77f66dcd4f8e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:44.698728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44daa9e9-33f4-440d-9b25-be06b55b4015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:44.699788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44daa9e9-33f4-440d-9b25-be06b55b4015 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:44.700354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44daa9e9-33f4-440d-9b25-be06b55b4015 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:44.700863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44daa9e9-33f4-440d-9b25-be06b55b4015 admin admin] PATH_INFO: `/v3/projects/07905b27412340eaad541d96ed9f5c29/users/99a532383c034bd5b32c90e72a10a260/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:44.737923 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2142/4340] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:09:44 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:44.739022 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec797899-c9f2-4560-89e4-0b7adba5ab87 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:44.745393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44daa9e9-33f4-440d-9b25-be06b55b4015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07905b27412340eaad541d96ed9f5c29, user_id=99a532383c034bd5b32c90e72a10a260, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:44.748780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44daa9e9-33f4-440d-9b25-be06b55b4015 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:44.785269 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2199/4341] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:09:44 2022] PUT /identity/v3/projects/07905b27412340eaad541d96ed9f5c29/users/99a532383c034bd5b32c90e72a10a260/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:44.787081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54a84e-ea00-4de1-b2b7-60a520e3b789 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:44.787370 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54a84e-ea00-4de1-b2b7-60a520e3b789 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:44.787648 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54a84e-ea00-4de1-b2b7-60a520e3b789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:44.815019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-fa54a84e-ea00-4de1-b2b7-60a520e3b789 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:44.818150 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-fa54a84e-ea00-4de1-b2b7-60a520e3b789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:44.822267 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec797899-c9f2-4560-89e4-0b7adba5ab87 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:44.902735 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2200/4342] 10.222.0.33 () {58 vars in 967 bytes} [Sat Aug 6 21:09:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:44.904128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f450d-8093-4566-adfd-418ed4b48bfb None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:44.904325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f450d-8093-4566-adfd-418ed4b48bfb None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:44.904603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f450d-8093-4566-adfd-418ed4b48bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:44.945019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-856f450d-8093-4566-adfd-418ed4b48bfb None None] MFA Rules not processed for user `99a532383c034bd5b32c90e72a10a260`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:44.946306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-856f450d-8093-4566-adfd-418ed4b48bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:44.978072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422b740-a9d2-48dd-94ef-ccf3276ddbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:44.978732 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422b740-a9d2-48dd-94ef-ccf3276ddbd2 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:44.979013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422b740-a9d2-48dd-94ef-ccf3276ddbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:44.979281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422b740-a9d2-48dd-94ef-ccf3276ddbd2 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:44.979908 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422b740-a9d2-48dd-94ef-ccf3276ddbd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:44.983703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422b740-a9d2-48dd-94ef-ccf3276ddbd2 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:45.022353 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2143/4343] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:09:44 2022] POST /identity/v3/users => generated 283 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:45.023402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422b740-a9d2-48dd-94ef-ccf3276ddbd2 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:45.025545 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1422b740-a9d2-48dd-94ef-ccf3276ddbd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:45.070654 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2201/4344] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:45.073394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f450d-8093-4566-adfd-418ed4b48bfb None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:45.090579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:45.091317 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f450d-8093-4566-adfd-418ed4b48bfb None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:45.100544 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae757e19-93ba-40dd-99c3-f57a598ee443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:45.101231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae757e19-93ba-40dd-99c3-f57a598ee443 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:45.101506 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae757e19-93ba-40dd-99c3-f57a598ee443 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:45.101774 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae757e19-93ba-40dd-99c3-f57a598ee443 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:45.102460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae757e19-93ba-40dd-99c3-f57a598ee443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:45.105791 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae757e19-93ba-40dd-99c3-f57a598ee443 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:45.126646 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2202/4345] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:09:45.129188 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae757e19-93ba-40dd-99c3-f57a598ee443 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:45.147716 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae757e19-93ba-40dd-99c3-f57a598ee443 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:45.156281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422b740-a9d2-48dd-94ef-ccf3276ddbd2 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:45.159229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4358f-f528-4277-8d77-c98611988af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:45.159861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4358f-f528-4277-8d77-c98611988af3 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:45.160712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4358f-f528-4277-8d77-c98611988af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:45.160991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4358f-f528-4277-8d77-c98611988af3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:45.161670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f4358f-f528-4277-8d77-c98611988af3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:45.163813 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f4358f-f528-4277-8d77-c98611988af3 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:45.170494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d3173-03ce-4a75-9c33-94b92a0ff0d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:45.171156 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d3173-03ce-4a75-9c33-94b92a0ff0d7 service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:45.171435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d3173-03ce-4a75-9c33-94b92a0ff0d7 service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:45.171715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d3173-03ce-4a75-9c33-94b92a0ff0d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:45.186995 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2203/4346] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:09:45.191704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4358f-f528-4277-8d77-c98611988af3 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:45.191864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d3173-03ce-4a75-9c33-94b92a0ff0d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:45.194791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d3173-03ce-4a75-9c33-94b92a0ff0d7 service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:45.203413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4358f-f528-4277-8d77-c98611988af3 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:45.209664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb190a6c-cb54-4d4c-9023-73bf73cd9f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:45.210395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb190a6c-cb54-4d4c-9023-73bf73cd9f1e admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:45.210900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb190a6c-cb54-4d4c-9023-73bf73cd9f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:45.211818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb190a6c-cb54-4d4c-9023-73bf73cd9f1e admin admin] PATH_INFO: `/v3/projects/42912bfdbcd3468cb021cef15d7014e4/users/27e03ce06b3242c58046ee96895068ee/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:45.220077 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2144/4347] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:09:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:09:45.235980 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb190a6c-cb54-4d4c-9023-73bf73cd9f1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=42912bfdbcd3468cb021cef15d7014e4, user_id=27e03ce06b3242c58046ee96895068ee, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:45.239599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb190a6c-cb54-4d4c-9023-73bf73cd9f1e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:45.259261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:45.287929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1333b6-c24d-44fd-8069-0bb1dabf99fd None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:45.288207 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1333b6-c24d-44fd-8069-0bb1dabf99fd None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:45.288480 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1333b6-c24d-44fd-8069-0bb1dabf99fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:45.308356 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2204/4348] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:09:45 2022] PUT /identity/v3/projects/42912bfdbcd3468cb021cef15d7014e4/users/27e03ce06b3242c58046ee96895068ee/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:45.311367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb190a6c-cb54-4d4c-9023-73bf73cd9f1e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:45.319060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-eb190a6c-cb54-4d4c-9023-73bf73cd9f1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:45.336814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-8e1333b6-c24d-44fd-8069-0bb1dabf99fd None None] MFA Rules not processed for user `f7cf258df10248d0bdcf64fa075c132c`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:45.338062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8e1333b6-c24d-44fd-8069-0bb1dabf99fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:45.498876 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2145/4349] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:45.498876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31ba2f-9436-4d45-8a1f-28771174117e None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:45.498876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31ba2f-9436-4d45-8a1f-28771174117e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:45.498876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31ba2f-9436-4d45-8a1f-28771174117e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:45.522280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb190a6c-cb54-4d4c-9023-73bf73cd9f1e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:45.535205 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-7d31ba2f-9436-4d45-8a1f-28771174117e None None] MFA Rules not processed for user `27e03ce06b3242c58046ee96895068ee`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:45.535772 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9698d9d-865f-408d-90d8-560484fe170e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:45.536713 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9698d9d-865f-408d-90d8-560484fe170e service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:45.536999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9698d9d-865f-408d-90d8-560484fe170e service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:45.537408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9698d9d-865f-408d-90d8-560484fe170e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:45.539263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7d31ba2f-9436-4d45-8a1f-28771174117e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:45.631155 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9698d9d-865f-408d-90d8-560484fe170e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:45.634359 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9698d9d-865f-408d-90d8-560484fe170e service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:45.671364 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2205/4350] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:09:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:09:45.672587 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9698d9d-865f-408d-90d8-560484fe170e service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:45.677658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b9698d9d-865f-408d-90d8-560484fe170e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:45.715879 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2146/4351] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:45.721947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31ba2f-9436-4d45-8a1f-28771174117e None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:45.791862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9698d9d-865f-408d-90d8-560484fe170e service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:45.798321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b8139-45ff-4ca4-8ec9-532c415aeb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:45.799549 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b8139-45ff-4ca4-8ec9-532c415aeb43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:45.799822 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b8139-45ff-4ca4-8ec9-532c415aeb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:45.800099 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b8139-45ff-4ca4-8ec9-532c415aeb43 admin admin] PATH_INFO: `/v3/users/444a3a1bc01f48ddbc12d34eaef8a450` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:45.801618 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b8139-45ff-4ca4-8ec9-532c415aeb43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=444a3a1bc01f48ddbc12d34eaef8a450)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:45.804230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b8139-45ff-4ca4-8ec9-532c415aeb43 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:45.832073 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:45.868014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:45.870152 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31ba2f-9436-4d45-8a1f-28771174117e None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:45.888650 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104fcd8-9bb3-47d8-90e5-6431168276e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:45.889528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104fcd8-9bb3-47d8-90e5-6431168276e6 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:45.890244 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104fcd8-9bb3-47d8-90e5-6431168276e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:45.890838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104fcd8-9bb3-47d8-90e5-6431168276e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:45.891486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104fcd8-9bb3-47d8-90e5-6431168276e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:45.894112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104fcd8-9bb3-47d8-90e5-6431168276e6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:45.896670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-904b8139-45ff-4ca4-8ec9-532c415aeb43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '444a3a1bc01f48ddbc12d34eaef8a450'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:45.908193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-904b8139-45ff-4ca4-8ec9-532c415aeb43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '444a3a1bc01f48ddbc12d34eaef8a450'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:45.909268 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-904b8139-45ff-4ca4-8ec9-532c415aeb43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '444a3a1bc01f48ddbc12d34eaef8a450'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:45.910950 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-904b8139-45ff-4ca4-8ec9-532c415aeb43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '444a3a1bc01f48ddbc12d34eaef8a450'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:45.944777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-904b8139-45ff-4ca4-8ec9-532c415aeb43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '444a3a1bc01f48ddbc12d34eaef8a450'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:45.970087 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2147/4352] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:09:45 2022] POST /identity/v3/projects => generated 367 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:09:45.970087 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104fcd8-9bb3-47d8-90e5-6431168276e6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:45.972818 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5104fcd8-9bb3-47d8-90e5-6431168276e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:45.974363 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2206/4353] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:09:45 2022] DELETE /identity/v3/users/444a3a1bc01f48ddbc12d34eaef8a450 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:45.975906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b8139-45ff-4ca4-8ec9-532c415aeb43 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:45.977109 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-904b8139-45ff-4ca4-8ec9-532c415aeb43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:46.078962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b8139-45ff-4ca4-8ec9-532c415aeb43 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:46.086052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168815f-e10a-4c94-8075-d4393fa40c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:46.086890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168815f-e10a-4c94-8075-d4393fa40c94 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:46.089627 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168815f-e10a-4c94-8075-d4393fa40c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:46.089627 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168815f-e10a-4c94-8075-d4393fa40c94 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:46.092584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168815f-e10a-4c94-8075-d4393fa40c94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:46.098523 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168815f-e10a-4c94-8075-d4393fa40c94 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:46.157798 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2207/4354] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:09:45 2022] POST /identity/v3/users => generated 290 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:46.159035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554719c0-6404-4e14-9925-6125eadfd330 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:46.159412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554719c0-6404-4e14-9925-6125eadfd330 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:46.159677 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554719c0-6404-4e14-9925-6125eadfd330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:46.193104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104fcd8-9bb3-47d8-90e5-6431168276e6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:46.215889 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-554719c0-6404-4e14-9925-6125eadfd330 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:46.216329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c49ff-4981-4435-8006-c198b85d42fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:46.217088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c49ff-4981-4435-8006-c198b85d42fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:46.217369 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c49ff-4981-4435-8006-c198b85d42fc admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:46.217645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c49ff-4981-4435-8006-c198b85d42fc admin admin] PATH_INFO: `/v3/users/99a532383c034bd5b32c90e72a10a260` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:46.220289 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-554719c0-6404-4e14-9925-6125eadfd330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:46.224222 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c49ff-4981-4435-8006-c198b85d42fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=99a532383c034bd5b32c90e72a10a260)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:46.226607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c49ff-4981-4435-8006-c198b85d42fc admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:46.258710 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2208/4355] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:46.259990 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554719c0-6404-4e14-9925-6125eadfd330 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:46.294840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554719c0-6404-4e14-9925-6125eadfd330 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:46.305808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af092dc-835f-489c-9cf6-6fdf67854ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:46.306467 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af092dc-835f-489c-9cf6-6fdf67854ced admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:46.306849 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af092dc-835f-489c-9cf6-6fdf67854ced admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:46.307081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af092dc-835f-489c-9cf6-6fdf67854ced admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:46.307840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af092dc-835f-489c-9cf6-6fdf67854ced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:46.309615 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af092dc-835f-489c-9cf6-6fdf67854ced admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:46.328347 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2209/4356] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:09:46.332749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af092dc-835f-489c-9cf6-6fdf67854ced admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:46.360441 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af092dc-835f-489c-9cf6-6fdf67854ced admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:46.362270 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b93c49ff-4981-4435-8006-c198b85d42fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99a532383c034bd5b32c90e72a10a260'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:46.364015 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b93c49ff-4981-4435-8006-c198b85d42fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99a532383c034bd5b32c90e72a10a260'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:46.365011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b93c49ff-4981-4435-8006-c198b85d42fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99a532383c034bd5b32c90e72a10a260'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:46.368279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafef09c-83d3-4965-90f4-399cedef941b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:46.369013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafef09c-83d3-4965-90f4-399cedef941b admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:46.369368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafef09c-83d3-4965-90f4-399cedef941b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:46.370465 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafef09c-83d3-4965-90f4-399cedef941b admin admin] PATH_INFO: `/v3/projects/30efd3b31efe4edc8004897f83c7547b/users/887916818677458a832f520e4d35df2c/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:46.381920 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b93c49ff-4981-4435-8006-c198b85d42fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99a532383c034bd5b32c90e72a10a260'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:46.397576 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafef09c-83d3-4965-90f4-399cedef941b admin admin] RBAC: Authorizing `identity:create_grant(project_id=30efd3b31efe4edc8004897f83c7547b, user_id=887916818677458a832f520e4d35df2c, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:46.406657 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafef09c-83d3-4965-90f4-399cedef941b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:46.428419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b93c49ff-4981-4435-8006-c198b85d42fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99a532383c034bd5b32c90e72a10a260'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:46.431678 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2210/4357] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:09:46 2022] PUT /identity/v3/projects/30efd3b31efe4edc8004897f83c7547b/users/887916818677458a832f520e4d35df2c/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:46.434412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafef09c-83d3-4965-90f4-399cedef941b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:46.436919 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-eafef09c-83d3-4965-90f4-399cedef941b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:46.460215 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2148/4358] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:09:45 2022] DELETE /identity/v3/users/99a532383c034bd5b32c90e72a10a260 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:46.461017 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c49ff-4981-4435-8006-c198b85d42fc admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:46.467849 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b93c49ff-4981-4435-8006-c198b85d42fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:46.587586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafef09c-83d3-4965-90f4-399cedef941b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:46.628496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:46.715281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507036e-0a18-4d97-ac5d-ec7a0d43f861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:46.715993 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507036e-0a18-4d97-ac5d-ec7a0d43f861 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:46.716340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507036e-0a18-4d97-ac5d-ec7a0d43f861 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:46.716683 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507036e-0a18-4d97-ac5d-ec7a0d43f861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:46.719061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1507036e-0a18-4d97-ac5d-ec7a0d43f861 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:46.719674 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:46.745907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c49ff-4981-4435-8006-c198b85d42fc admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:46.764843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b309e-6857-4034-bbee-3df27e9d668a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:46.765542 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b309e-6857-4034-bbee-3df27e9d668a admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:46.765823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b309e-6857-4034-bbee-3df27e9d668a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:46.766088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b309e-6857-4034-bbee-3df27e9d668a admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:46.767102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b309e-6857-4034-bbee-3df27e9d668a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:46.769148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b309e-6857-4034-bbee-3df27e9d668a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:46.793110 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2149/4359] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:09:46.797792 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f9674-29b8-474c-91a9-493716d687bf None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:46.798121 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f9674-29b8-474c-91a9-493716d687bf None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:46.798346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f9674-29b8-474c-91a9-493716d687bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:46.823434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-2e2f9674-29b8-474c-91a9-493716d687bf None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:46.824818 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2e2f9674-29b8-474c-91a9-493716d687bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:46.837642 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2150/4360] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:46.837642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f9674-29b8-474c-91a9-493716d687bf None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:46.848695 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f9674-29b8-474c-91a9-493716d687bf None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:46.865808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed257481-f1da-4bb4-a56d-3fd35a911d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:46.866677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed257481-f1da-4bb4-a56d-3fd35a911d43 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:46.867102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed257481-f1da-4bb4-a56d-3fd35a911d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:46.867540 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed257481-f1da-4bb4-a56d-3fd35a911d43 admin admin] PATH_INFO: `/v3/projects/30efd3b31efe4edc8004897f83c7547b/users/887916818677458a832f520e4d35df2c/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:46.875826 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed257481-f1da-4bb4-a56d-3fd35a911d43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30efd3b31efe4edc8004897f83c7547b, user_id=887916818677458a832f520e4d35df2c, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:46.886494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed257481-f1da-4bb4-a56d-3fd35a911d43 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:46.889875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507036e-0a18-4d97-ac5d-ec7a0d43f861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:46.892949 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507036e-0a18-4d97-ac5d-ec7a0d43f861 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:46.907244 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2211/4361] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:09:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:09:46.908229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507036e-0a18-4d97-ac5d-ec7a0d43f861 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:46.909978 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1507036e-0a18-4d97-ac5d-ec7a0d43f861 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:46.921527 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2151/4362] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:09:46 2022] PUT /identity/v3/projects/30efd3b31efe4edc8004897f83c7547b/users/887916818677458a832f520e4d35df2c/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:46.926767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507036e-0a18-4d97-ac5d-ec7a0d43f861 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:46.933949 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b7fa8-4612-47ca-8605-eb5fa7c9f973 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:46.934310 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b7fa8-4612-47ca-8605-eb5fa7c9f973 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:46.934673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b7fa8-4612-47ca-8605-eb5fa7c9f973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:46.997870 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f65b7fa8-4612-47ca-8605-eb5fa7c9f973 None None] MFA Rules not processed for user `887916818677458a832f520e4d35df2c`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:46.999435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f65b7fa8-4612-47ca-8605-eb5fa7c9f973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:47.030714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc359d-a574-47a9-ac45-6046a117bb22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:47.031631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc359d-a574-47a9-ac45-6046a117bb22 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:47.032075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc359d-a574-47a9-ac45-6046a117bb22 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:47.032505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc359d-a574-47a9-ac45-6046a117bb22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:47.118069 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2152/4363] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:46 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:47.121448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc359d-a574-47a9-ac45-6046a117bb22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:47.123195 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc359d-a574-47a9-ac45-6046a117bb22 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:47.123797 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b7fa8-4612-47ca-8605-eb5fa7c9f973 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:47.134447 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b7fa8-4612-47ca-8605-eb5fa7c9f973 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:47.137440 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2212/4364] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:09:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:09:47.141090 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd7236-144b-43fe-9ebf-08e516c5d9d9 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:47.141998 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd7236-144b-43fe-9ebf-08e516c5d9d9 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:47.142769 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd7236-144b-43fe-9ebf-08e516c5d9d9 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:47.143306 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd7236-144b-43fe-9ebf-08e516c5d9d9 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:47.144243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd7236-144b-43fe-9ebf-08e516c5d9d9 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:47.145641 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-aebd7236-144b-43fe-9ebf-08e516c5d9d9 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:47.145641 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:09:47.145641 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:09:47.147030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd7236-144b-43fe-9ebf-08e516c5d9d9 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:47.170724 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2153/4365] 10.222.0.33 () {60 vars in 1143 bytes} [Sat Aug 6 21:09:47 2022] POST /identity/v3/roles => generated 235 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:47.175909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc359d-a574-47a9-ac45-6046a117bb22 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:47.252697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc359d-a574-47a9-ac45-6046a117bb22 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:47.280396 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11271e70-fca6-4170-a7ab-90cab9b81102 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:47.281390 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11271e70-fca6-4170-a7ab-90cab9b81102 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:47.281844 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11271e70-fca6-4170-a7ab-90cab9b81102 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:47.282283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11271e70-fca6-4170-a7ab-90cab9b81102 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:47.284723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11271e70-fca6-4170-a7ab-90cab9b81102 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:47.287814 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-11271e70-fca6-4170-a7ab-90cab9b81102 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:47.287814 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:09:47.287814 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:09:47.292073 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11271e70-fca6-4170-a7ab-90cab9b81102 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:47.327714 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2213/4366] 10.222.0.33 () {60 vars in 1143 bytes} [Sat Aug 6 21:09:47 2022] POST /identity/v3/roles => generated 234 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:47.332375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd7236-144b-43fe-9ebf-08e516c5d9d9 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:47.343380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd7236-144b-43fe-9ebf-08e516c5d9d9 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:47.365083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3abc1-d061-4946-96e0-2008573e301f tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:47.365712 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3abc1-d061-4946-96e0-2008573e301f tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:47.365991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3abc1-d061-4946-96e0-2008573e301f tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:47.366268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3abc1-d061-4946-96e0-2008573e301f tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:47.366949 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3abc1-d061-4946-96e0-2008573e301f tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:47.368623 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3abc1-d061-4946-96e0-2008573e301f tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:47.393926 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2154/4367] 10.222.0.33 () {60 vars in 1143 bytes} [Sat Aug 6 21:09:47 2022] POST /identity/v3/roles => generated 235 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:09:47.399012 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11271e70-fca6-4170-a7ab-90cab9b81102 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:47.417529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:47.428734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11271e70-fca6-4170-a7ab-90cab9b81102 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:47.438922 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bddd2d6-47e4-4622-97ab-f33605193ca7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:47.441040 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddd2d6-47e4-4622-97ab-f33605193ca7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:47.441040 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddd2d6-47e4-4622-97ab-f33605193ca7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:47.441040 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddd2d6-47e4-4622-97ab-f33605193ca7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:47.441490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bddd2d6-47e4-4622-97ab-f33605193ca7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:47.442170 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-4bddd2d6-47e4-4622-97ab-f33605193ca7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:47.442170 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:09:47.442170 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:09:47.444025 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bddd2d6-47e4-4622-97ab-f33605193ca7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:47.474581 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2214/4368] 10.222.0.33 () {60 vars in 1149 bytes} [Sat Aug 6 21:09:47 2022] POST /identity/v3/domains => generated 275 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:47.479291 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3abc1-d061-4946-96e0-2008573e301f tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:47.497056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3abc1-d061-4946-96e0-2008573e301f tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:47.619513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0076258-6a8b-4248-b7d4-d48ead1a9eb3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:47.621669 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0076258-6a8b-4248-b7d4-d48ead1a9eb3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:47.622123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0076258-6a8b-4248-b7d4-d48ead1a9eb3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:47.622787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0076258-6a8b-4248-b7d4-d48ead1a9eb3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:47.623468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0076258-6a8b-4248-b7d4-d48ead1a9eb3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:47.627552 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0076258-6a8b-4248-b7d4-d48ead1a9eb3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:47.695361 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2155/4369] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:09:47 2022] POST /identity/v3/projects => generated 398 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:47.699905 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bddd2d6-47e4-4622-97ab-f33605193ca7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:47.722366 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bddd2d6-47e4-4622-97ab-f33605193ca7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:47.818627 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7a797-b5e7-4602-b53a-a72bf0c22c09 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:47.819909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7a797-b5e7-4602-b53a-a72bf0c22c09 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:47.820461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7a797-b5e7-4602-b53a-a72bf0c22c09 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:47.820969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7a797-b5e7-4602-b53a-a72bf0c22c09 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/groups` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:47.822049 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7a797-b5e7-4602-b53a-a72bf0c22c09 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:47.823352 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-c0f7a797-b5e7-4602-b53a-a72bf0c22c09 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:47.823352 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:09:47.823352 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:09:47.825215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7a797-b5e7-4602-b53a-a72bf0c22c09 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:47.850444 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2215/4370] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:09:47 2022] POST /identity/v3/groups => generated 301 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:47.854181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0076258-6a8b-4248-b7d4-d48ead1a9eb3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:47.862375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:47.867574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0076258-6a8b-4248-b7d4-d48ead1a9eb3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:47.875856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69386af-8aaa-46e3-aeb4-bb0b69b32b8c tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:47.876577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69386af-8aaa-46e3-aeb4-bb0b69b32b8c tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:47.876894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69386af-8aaa-46e3-aeb4-bb0b69b32b8c tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:47.877263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69386af-8aaa-46e3-aeb4-bb0b69b32b8c tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:47.877992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69386af-8aaa-46e3-aeb4-bb0b69b32b8c tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:47.879730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69386af-8aaa-46e3-aeb4-bb0b69b32b8c tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:47.904528 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2156/4371] 10.222.0.33 () {60 vars in 1143 bytes} [Sat Aug 6 21:09:47 2022] POST /identity/v3/roles => generated 235 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:47.905899 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7a797-b5e7-4602-b53a-a72bf0c22c09 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:47.923047 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7a797-b5e7-4602-b53a-a72bf0c22c09 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:47.938280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ecd79-62c7-4da0-af65-f9000b5f7b55 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:47.938280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ecd79-62c7-4da0-af65-f9000b5f7b55 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:47.938280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ecd79-62c7-4da0-af65-f9000b5f7b55 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:47.941473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ecd79-62c7-4da0-af65-f9000b5f7b55 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:47.941473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ecd79-62c7-4da0-af65-f9000b5f7b55 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:47.947461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ecd79-62c7-4da0-af65-f9000b5f7b55 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:47.988913 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2216/4372] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:09:47 2022] POST /identity/v3/users => generated 442 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:47.990730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69386af-8aaa-46e3-aeb4-bb0b69b32b8c tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:48.003506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69386af-8aaa-46e3-aeb4-bb0b69b32b8c tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:48.011137 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946ca9e-9ec3-410c-bccf-265cc4e8522f tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:48.011808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946ca9e-9ec3-410c-bccf-265cc4e8522f tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:48.012058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946ca9e-9ec3-410c-bccf-265cc4e8522f tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:48.012343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946ca9e-9ec3-410c-bccf-265cc4e8522f tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:48.013035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946ca9e-9ec3-410c-bccf-265cc4e8522f tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:48.015139 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-5946ca9e-9ec3-410c-bccf-265cc4e8522f tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:48.015139 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:09:48.015139 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:09:48.016082 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946ca9e-9ec3-410c-bccf-265cc4e8522f tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:48.037446 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2157/4373] 10.222.0.33 () {60 vars in 1143 bytes} [Sat Aug 6 21:09:47 2022] POST /identity/v3/roles => generated 270 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:09:48.041509 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ecd79-62c7-4da0-af65-f9000b5f7b55 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:48.062679 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ecd79-62c7-4da0-af65-f9000b5f7b55 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:48.072023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72758a3-c363-4b78-94d7-d4511867ea5b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:48.073941 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72758a3-c363-4b78-94d7-d4511867ea5b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:48.075504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72758a3-c363-4b78-94d7-d4511867ea5b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:48.076658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72758a3-c363-4b78-94d7-d4511867ea5b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/projects/c38ab9e6a9de4f9abaa70787dad987f4/users/bb7dbc691f9845988f3f0b50842f1992/roles/71fcb14fbed54e92b8c771c514a48639` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:48.099517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72758a3-c363-4b78-94d7-d4511867ea5b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c38ab9e6a9de4f9abaa70787dad987f4, user_id=bb7dbc691f9845988f3f0b50842f1992, role_id=71fcb14fbed54e92b8c771c514a48639)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:48.102596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72758a3-c363-4b78-94d7-d4511867ea5b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:48.126086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946ca9e-9ec3-410c-bccf-265cc4e8522f tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:48.129101 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5946ca9e-9ec3-410c-bccf-265cc4e8522f tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:48.137189 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2217/4374] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:09:48 2022] PUT /identity/v3/projects/c38ab9e6a9de4f9abaa70787dad987f4/users/bb7dbc691f9845988f3f0b50842f1992/roles/71fcb14fbed54e92b8c771c514a48639 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:09:48.140172 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72758a3-c363-4b78-94d7-d4511867ea5b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:48.261492 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946ca9e-9ec3-410c-bccf-265cc4e8522f tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:48.353220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72758a3-c363-4b78-94d7-d4511867ea5b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:48.364914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6490d7-637c-43ed-8188-5d9668c5f5d6 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:48.365487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6490d7-637c-43ed-8188-5d9668c5f5d6 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:48.365868 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6490d7-637c-43ed-8188-5d9668c5f5d6 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:48.366059 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6490d7-637c-43ed-8188-5d9668c5f5d6 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:48.366788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6490d7-637c-43ed-8188-5d9668c5f5d6 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Adding query filter params (scope.project.id=c38ab9e6a9de4f9abaa70787dad987f4, user.id=bb7dbc691f9845988f3f0b50842f1992) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:09:48.367106 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6490d7-637c-43ed-8188-5d9668c5f5d6 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:48.368299 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-3c6490d7-637c-43ed-8188-5d9668c5f5d6 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:48.368299 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:09:48.368299 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:09:48.373005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6490d7-637c-43ed-8188-5d9668c5f5d6 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:48.419481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2206d9-7c78-48f8-905e-64a276102f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:48.420824 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2206d9-7c78-48f8-905e-64a276102f07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:48.421305 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2206d9-7c78-48f8-905e-64a276102f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:48.421738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2206d9-7c78-48f8-905e-64a276102f07 admin admin] PATH_INFO: `/v3/projects/07905b27412340eaad541d96ed9f5c29` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:48.426214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2206d9-7c78-48f8-905e-64a276102f07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07905b27412340eaad541d96ed9f5c29)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:48.437408 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2206d9-7c78-48f8-905e-64a276102f07 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:48.489344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:48.501169 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2218/4375] 10.222.0.33 () {58 vars in 1356 bytes} [Sat Aug 6 21:09:48 2022] GET /identity/v3/role_assignments?scope.project.id=c38ab9e6a9de4f9abaa70787dad987f4&user.id=bb7dbc691f9845988f3f0b50842f1992&effective => generated 228 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:09:48.501169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6490d7-637c-43ed-8188-5d9668c5f5d6 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:48.506351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3c6490d7-637c-43ed-8188-5d9668c5f5d6 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:48.538912 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6490d7-637c-43ed-8188-5d9668c5f5d6 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:48.540721 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ac2206d9-7c78-48f8-905e-64a276102f07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07905b27412340eaad541d96ed9f5c29', 'request_id': 'req-ac2206d9-7c78-48f8-905e-64a276102f07'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:48.552278 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ac2206d9-7c78-48f8-905e-64a276102f07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07905b27412340eaad541d96ed9f5c29', 'request_id': 'req-ac2206d9-7c78-48f8-905e-64a276102f07'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:48.562458 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ac2206d9-7c78-48f8-905e-64a276102f07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07905b27412340eaad541d96ed9f5c29', 'request_id': 'req-ac2206d9-7c78-48f8-905e-64a276102f07'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:48.590977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ac2206d9-7c78-48f8-905e-64a276102f07 admin admin] The token cache is being invalidate because project 07905b27412340eaad541d96ed9f5c29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:09:48.591293 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ac2206d9-7c78-48f8-905e-64a276102f07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:48.592422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ac2206d9-7c78-48f8-905e-64a276102f07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:48.601872 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2158/4376] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:09:48 2022] DELETE /identity/v3/projects/07905b27412340eaad541d96ed9f5c29 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:48.603973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2206d9-7c78-48f8-905e-64a276102f07 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:48.609316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ac2206d9-7c78-48f8-905e-64a276102f07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:48.660131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1329a-1e5f-4775-ae2f-9b765af4bd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:48.660964 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1329a-1e5f-4775-ae2f-9b765af4bd58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:48.661343 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1329a-1e5f-4775-ae2f-9b765af4bd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:48.661582 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:48.661825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1329a-1e5f-4775-ae2f-9b765af4bd58 admin admin] PATH_INFO: `/v3/projects/c598d72843744d5494f230958f567909` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:48.663697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd1329a-1e5f-4775-ae2f-9b765af4bd58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c598d72843744d5494f230958f567909)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:48.665712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd1329a-1e5f-4775-ae2f-9b765af4bd58 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:48.748861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6fd1329a-1e5f-4775-ae2f-9b765af4bd58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c598d72843744d5494f230958f567909', 'request_id': 'req-6fd1329a-1e5f-4775-ae2f-9b765af4bd58'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:48.755815 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2206d9-7c78-48f8-905e-64a276102f07 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:48.761610 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6fd1329a-1e5f-4775-ae2f-9b765af4bd58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c598d72843744d5494f230958f567909', 'request_id': 'req-6fd1329a-1e5f-4775-ae2f-9b765af4bd58'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:48.776092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6fd1329a-1e5f-4775-ae2f-9b765af4bd58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c598d72843744d5494f230958f567909', 'request_id': 'req-6fd1329a-1e5f-4775-ae2f-9b765af4bd58'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:48.791121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6fd1329a-1e5f-4775-ae2f-9b765af4bd58 admin admin] The token cache is being invalidate because project c598d72843744d5494f230958f567909 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:09:48.791726 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6fd1329a-1e5f-4775-ae2f-9b765af4bd58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:48.792878 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6fd1329a-1e5f-4775-ae2f-9b765af4bd58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:48.795007 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2219/4377] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:09:48 2022] DELETE /identity/v3/projects/c598d72843744d5494f230958f567909 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:48.796708 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e51947-bd0f-4d00-a16b-b09fe3091af0 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:48.797224 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e51947-bd0f-4d00-a16b-b09fe3091af0 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:48.797667 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e51947-bd0f-4d00-a16b-b09fe3091af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:48.827532 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-e5e51947-bd0f-4d00-a16b-b09fe3091af0 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:48.829195 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e5e51947-bd0f-4d00-a16b-b09fe3091af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:48.900688 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10048ead-28bd-4c52-b060-badc4788006d tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:48.901455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10048ead-28bd-4c52-b060-badc4788006d tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:48.902044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10048ead-28bd-4c52-b060-badc4788006d tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:48.902182 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10048ead-28bd-4c52-b060-badc4788006d tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/projects/c38ab9e6a9de4f9abaa70787dad987f4/users/bb7dbc691f9845988f3f0b50842f1992/roles/71fcb14fbed54e92b8c771c514a48639` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:48.905668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10048ead-28bd-4c52-b060-badc4788006d tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=c38ab9e6a9de4f9abaa70787dad987f4, user_id=bb7dbc691f9845988f3f0b50842f1992, role_id=71fcb14fbed54e92b8c771c514a48639)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:48.907642 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-10048ead-28bd-4c52-b060-badc4788006d tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:48.907642 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:09:48.907642 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:09:48.910227 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10048ead-28bd-4c52-b060-badc4788006d tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:48.918797 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-10048ead-28bd-4c52-b060-badc4788006d tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invalidating the token cache because role 71fcb14fbed54e92b8c771c514a48639 was removed from user bb7dbc691f9845988f3f0b50842f1992 on project c38ab9e6a9de4f9abaa70787dad987f4. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:09:48.919097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-10048ead-28bd-4c52-b060-badc4788006d tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:48.919858 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-10048ead-28bd-4c52-b060-badc4788006d tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:48.948363 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2159/4378] 10.222.0.33 () {58 vars in 1467 bytes} [Sat Aug 6 21:09:48 2022] DELETE /identity/v3/projects/c38ab9e6a9de4f9abaa70787dad987f4/users/bb7dbc691f9845988f3f0b50842f1992/roles/71fcb14fbed54e92b8c771c514a48639 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:48.950048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f77a3-fb70-4142-82b6-fb03c18dd004 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:48.950978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f77a3-fb70-4142-82b6-fb03c18dd004 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:48.952693 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f77a3-fb70-4142-82b6-fb03c18dd004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:48.982364 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2220/4379] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:48.983743 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e51947-bd0f-4d00-a16b-b09fe3091af0 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:48.988608 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e5e51947-bd0f-4d00-a16b-b09fe3091af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:49.000913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-b35f77a3-fb70-4142-82b6-fb03c18dd004 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:49.003500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b35f77a3-fb70-4142-82b6-fb03c18dd004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:49.011009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e51947-bd0f-4d00-a16b-b09fe3091af0 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:49.075497 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:49.123483 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2160/4380] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:49.126029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd558d4-8bc8-4764-91ac-c04a8a4cbaf5 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:49.126029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd558d4-8bc8-4764-91ac-c04a8a4cbaf5 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:49.126371 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd558d4-8bc8-4764-91ac-c04a8a4cbaf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:49.134733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6caeb-dd16-44bc-a2be-197e59b1afa7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:49.138184 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6caeb-dd16-44bc-a2be-197e59b1afa7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:49.138797 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6caeb-dd16-44bc-a2be-197e59b1afa7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:49.139353 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6caeb-dd16-44bc-a2be-197e59b1afa7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/71fcb14fbed54e92b8c771c514a48639` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:49.142338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6caeb-dd16-44bc-a2be-197e59b1afa7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=71fcb14fbed54e92b8c771c514a48639)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:49.145391 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-c9b6caeb-dd16-44bc-a2be-197e59b1afa7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:49.145391 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:09:49.145391 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:09:49.147251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6caeb-dd16-44bc-a2be-197e59b1afa7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:49.153508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-ccd558d4-8bc8-4764-91ac-c04a8a4cbaf5 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:49.155399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ccd558d4-8bc8-4764-91ac-c04a8a4cbaf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:49.165291 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2161/4381] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:49.168591 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271821b0-912f-48ac-b74a-d58f24738b36 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:49.168591 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271821b0-912f-48ac-b74a-d58f24738b36 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:49.168591 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271821b0-912f-48ac-b74a-d58f24738b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:49.193794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-271821b0-912f-48ac-b74a-d58f24738b36 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:49.195274 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-271821b0-912f-48ac-b74a-d58f24738b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:49.213338 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2162/4382] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:49.214478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271821b0-912f-48ac-b74a-d58f24738b36 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:49.225060 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271821b0-912f-48ac-b74a-d58f24738b36 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:49.232328 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4b71b-0bd6-4826-ae4e-92b690f4ed0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:49.232991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4b71b-0bd6-4826-ae4e-92b690f4ed0b admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:49.233272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4b71b-0bd6-4826-ae4e-92b690f4ed0b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:49.234106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4b71b-0bd6-4826-ae4e-92b690f4ed0b admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:49.234250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4b71b-0bd6-4826-ae4e-92b690f4ed0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:09:49.234468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4b71b-0bd6-4826-ae4e-92b690f4ed0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:49.236181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4b71b-0bd6-4826-ae4e-92b690f4ed0b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:49.241745 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c9b6caeb-dd16-44bc-a2be-197e59b1afa7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invalidating the token cache because role 71fcb14fbed54e92b8c771c514a48639 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:09:49.242365 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c9b6caeb-dd16-44bc-a2be-197e59b1afa7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:49.244086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c9b6caeb-dd16-44bc-a2be-197e59b1afa7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:49.248833 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2221/4383] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:09:48 2022] DELETE /identity/v3/roles/71fcb14fbed54e92b8c771c514a48639 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:49.254161 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2163/4384] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:09:49.254834 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4b71b-0bd6-4826-ae4e-92b690f4ed0b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:49.256566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-38e4b71b-0bd6-4826-ae4e-92b690f4ed0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:49.271265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6caeb-dd16-44bc-a2be-197e59b1afa7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:49.273117 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4b71b-0bd6-4826-ae4e-92b690f4ed0b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:49.279518 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c9b6caeb-dd16-44bc-a2be-197e59b1afa7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:49.297110 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:49.392030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f68b3-b89a-477d-99ac-00692884f4da tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:49.393283 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f68b3-b89a-477d-99ac-00692884f4da tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:49.393556 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f68b3-b89a-477d-99ac-00692884f4da tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:49.394487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f68b3-b89a-477d-99ac-00692884f4da tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/projects/c38ab9e6a9de4f9abaa70787dad987f4/users/bb7dbc691f9845988f3f0b50842f1992/roles/4667ef3b3c2f41edb6a21f228ae5d03f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:49.401175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f68b3-b89a-477d-99ac-00692884f4da tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c38ab9e6a9de4f9abaa70787dad987f4, user_id=bb7dbc691f9845988f3f0b50842f1992, role_id=4667ef3b3c2f41edb6a21f228ae5d03f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:49.404541 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f68b3-b89a-477d-99ac-00692884f4da tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:49.424144 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2164/4385] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:09:49 2022] PUT /identity/v3/projects/c38ab9e6a9de4f9abaa70787dad987f4/users/bb7dbc691f9845988f3f0b50842f1992/roles/4667ef3b3c2f41edb6a21f228ae5d03f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:49.425738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f68b3-b89a-477d-99ac-00692884f4da tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:49.430420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-012f68b3-b89a-477d-99ac-00692884f4da tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:49.443992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6caeb-dd16-44bc-a2be-197e59b1afa7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:49.511417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f68b3-b89a-477d-99ac-00692884f4da tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:49.518889 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d479542-733b-459b-9cf1-df6edf63f1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:49.519283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3854e3-1340-4813-b266-c46628e1b6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:49.519612 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d479542-733b-459b-9cf1-df6edf63f1e7 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:49.519897 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d479542-733b-459b-9cf1-df6edf63f1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:49.520165 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d479542-733b-459b-9cf1-df6edf63f1e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:49.520397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3854e3-1340-4813-b266-c46628e1b6be admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:49.520777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3854e3-1340-4813-b266-c46628e1b6be admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:49.520902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d479542-733b-459b-9cf1-df6edf63f1e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:49.521222 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3854e3-1340-4813-b266-c46628e1b6be admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:49.522855 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3854e3-1340-4813-b266-c46628e1b6be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:09:49.523002 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d479542-733b-459b-9cf1-df6edf63f1e7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:49.523357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3854e3-1340-4813-b266-c46628e1b6be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:49.525902 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3854e3-1340-4813-b266-c46628e1b6be admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:49.543001 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2222/4386] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:09:49.544004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3854e3-1340-4813-b266-c46628e1b6be admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:49.569037 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2165/4387] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:09:49 2022] POST /identity/v3/projects => generated 365 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:49.569037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d479542-733b-459b-9cf1-df6edf63f1e7 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:49.629597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:49.646791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d479542-733b-459b-9cf1-df6edf63f1e7 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:49.652517 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aef556-024d-42d7-92b7-6d505f4b436f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:49.653568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aef556-024d-42d7-92b7-6d505f4b436f admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:49.654120 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aef556-024d-42d7-92b7-6d505f4b436f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:49.654660 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aef556-024d-42d7-92b7-6d505f4b436f admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:49.655501 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aef556-024d-42d7-92b7-6d505f4b436f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:49.658829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aef556-024d-42d7-92b7-6d505f4b436f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:49.659686 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3854e3-1340-4813-b266-c46628e1b6be admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:49.705776 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2166/4388] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:09:49 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:49.707767 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aef556-024d-42d7-92b7-6d505f4b436f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:49.734965 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9767f-648d-4f43-8202-9d7241235927 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:49.735709 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9767f-648d-4f43-8202-9d7241235927 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:49.736550 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9767f-648d-4f43-8202-9d7241235927 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:49.736825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9767f-648d-4f43-8202-9d7241235927 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/4667ef3b3c2f41edb6a21f228ae5d03f/implies/aa0eb96c9709455487fe75fb882b1253` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:49.739386 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9767f-648d-4f43-8202-9d7241235927 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=4667ef3b3c2f41edb6a21f228ae5d03f, implied_role_id=aa0eb96c9709455487fe75fb882b1253)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:49.740404 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-68c9767f-648d-4f43-8202-9d7241235927 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:49.740404 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:09:49.740404 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:09:49.741697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9767f-648d-4f43-8202-9d7241235927 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:49.758409 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:49.777423 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2223/4389] 10.222.0.33 () {60 vars in 1363 bytes} [Sat Aug 6 21:09:49 2022] PUT /identity/v3/roles/4667ef3b3c2f41edb6a21f228ae5d03f/implies/aa0eb96c9709455487fe75fb882b1253 => generated 520 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:49.778747 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9767f-648d-4f43-8202-9d7241235927 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:49.800467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aef556-024d-42d7-92b7-6d505f4b436f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:49.850806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9767f-648d-4f43-8202-9d7241235927 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:49.855929 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abedf8-075f-4be1-b853-a51d5679a69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:49.856536 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abedf8-075f-4be1-b853-a51d5679a69d admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:49.856812 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abedf8-075f-4be1-b853-a51d5679a69d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:49.857081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abedf8-075f-4be1-b853-a51d5679a69d admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:49.857695 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abedf8-075f-4be1-b853-a51d5679a69d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:49.859700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abedf8-075f-4be1-b853-a51d5679a69d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:49.867850 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e004d-74f4-44a3-b849-6951583dc455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:49.869180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e004d-74f4-44a3-b849-6951583dc455 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:49.869694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e004d-74f4-44a3-b849-6951583dc455 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:49.869976 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e004d-74f4-44a3-b849-6951583dc455 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:49.870627 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e004d-74f4-44a3-b849-6951583dc455 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:49.872587 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e004d-74f4-44a3-b849-6951583dc455 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:49.885174 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2224/4390] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:09:49 2022] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:49.886295 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abedf8-075f-4be1-b853-a51d5679a69d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:49.902056 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2167/4391] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:09:49 2022] POST /identity/v3/users => generated 283 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:49.903050 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e004d-74f4-44a3-b849-6951583dc455 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:49.918159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e004d-74f4-44a3-b849-6951583dc455 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:49.925729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d0d84-1cd6-484e-8449-2a27c3ddd3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:49.926405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d0d84-1cd6-484e-8449-2a27c3ddd3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:49.926776 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d0d84-1cd6-484e-8449-2a27c3ddd3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:49.927052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d0d84-1cd6-484e-8449-2a27c3ddd3a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:49.927699 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d0d84-1cd6-484e-8449-2a27c3ddd3a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:49.929342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d0d84-1cd6-484e-8449-2a27c3ddd3a2 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:49.943878 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2168/4392] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:09:49 2022] GET /identity/v3/roles => generated 2323 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:09:49.944781 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d0d84-1cd6-484e-8449-2a27c3ddd3a2 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:49.957803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d0d84-1cd6-484e-8449-2a27c3ddd3a2 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:49.963939 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047ab75-9d39-45cb-b82c-471b6ed41547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:49.964546 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047ab75-9d39-45cb-b82c-471b6ed41547 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:49.964822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047ab75-9d39-45cb-b82c-471b6ed41547 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:49.965121 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047ab75-9d39-45cb-b82c-471b6ed41547 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:49.965780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047ab75-9d39-45cb-b82c-471b6ed41547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:49.967421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047ab75-9d39-45cb-b82c-471b6ed41547 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:49.983678 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2169/4393] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:09:49 2022] GET /identity/v3/roles => generated 2323 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:09:49.984541 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047ab75-9d39-45cb-b82c-471b6ed41547 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:49.994638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:50.000176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047ab75-9d39-45cb-b82c-471b6ed41547 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:50.005382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abedf8-075f-4be1-b853-a51d5679a69d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:50.008685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b783d-e09f-48c3-9167-763476bfa62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:50.009509 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b783d-e09f-48c3-9167-763476bfa62b admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:50.009792 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b783d-e09f-48c3-9167-763476bfa62b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:50.010060 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b783d-e09f-48c3-9167-763476bfa62b admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:50.010790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b783d-e09f-48c3-9167-763476bfa62b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:50.011116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74024e3-2fe9-47fe-8caf-9ebd987a0325 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:50.011687 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74024e3-2fe9-47fe-8caf-9ebd987a0325 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:50.011976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74024e3-2fe9-47fe-8caf-9ebd987a0325 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:50.012250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74024e3-2fe9-47fe-8caf-9ebd987a0325 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:50.012443 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b783d-e09f-48c3-9167-763476bfa62b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:50.013205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74024e3-2fe9-47fe-8caf-9ebd987a0325 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Adding query filter params (scope.project.id=c38ab9e6a9de4f9abaa70787dad987f4, user.id=bb7dbc691f9845988f3f0b50842f1992) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:09:50.013528 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74024e3-2fe9-47fe-8caf-9ebd987a0325 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:50.016954 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74024e3-2fe9-47fe-8caf-9ebd987a0325 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:50.041617 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2170/4394] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:09:49 2022] GET /identity/v3/roles => generated 2323 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:09:50.041617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b783d-e09f-48c3-9167-763476bfa62b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:50.053178 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b783d-e09f-48c3-9167-763476bfa62b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:50.061710 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe611f2a-808e-4d24-9f70-2c74692c71ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:50.062436 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe611f2a-808e-4d24-9f70-2c74692c71ec admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:50.062816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe611f2a-808e-4d24-9f70-2c74692c71ec admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:50.063153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe611f2a-808e-4d24-9f70-2c74692c71ec admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:50.063865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe611f2a-808e-4d24-9f70-2c74692c71ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:50.066185 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe611f2a-808e-4d24-9f70-2c74692c71ec admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:50.079354 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2171/4395] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:09:50 2022] GET /identity/v3/roles => generated 2323 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:09:50.081270 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe611f2a-808e-4d24-9f70-2c74692c71ec admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:50.095455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe611f2a-808e-4d24-9f70-2c74692c71ec admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:50.111391 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a8bcf-c213-4d29-bc65-e3c2f9075bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:50.112201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a8bcf-c213-4d29-bc65-e3c2f9075bc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:50.112544 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a8bcf-c213-4d29-bc65-e3c2f9075bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:50.113165 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a8bcf-c213-4d29-bc65-e3c2f9075bc4 admin admin] PATH_INFO: `/v3/projects/55484d9bd01a4364b7316bd119ac8d9a/users/44d40dcfb9f140c49b343d3e4331dfbe/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:50.125367 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2225/4396] 10.222.0.33 () {58 vars in 1356 bytes} [Sat Aug 6 21:09:49 2022] GET /identity/v3/role_assignments?scope.project.id=c38ab9e6a9de4f9abaa70787dad987f4&user.id=bb7dbc691f9845988f3f0b50842f1992&effective => generated 1061 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:09:50.125367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74024e3-2fe9-47fe-8caf-9ebd987a0325 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:50.141046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74024e3-2fe9-47fe-8caf-9ebd987a0325 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:50.145011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a8bcf-c213-4d29-bc65-e3c2f9075bc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55484d9bd01a4364b7316bd119ac8d9a, user_id=44d40dcfb9f140c49b343d3e4331dfbe, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:50.148304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a8bcf-c213-4d29-bc65-e3c2f9075bc4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:50.149171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20605a8-0fe1-4cbd-b284-66d38a5aaca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:50.151307 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20605a8-0fe1-4cbd-b284-66d38a5aaca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:50.151667 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20605a8-0fe1-4cbd-b284-66d38a5aaca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:50.152022 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20605a8-0fe1-4cbd-b284-66d38a5aaca5 admin admin] PATH_INFO: `/v3/projects/ae7a24bfa0bd4684bb0871f2d814c040/users/9132a8f57b2246a88d1f2157c2f63963/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:50.173866 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20605a8-0fe1-4cbd-b284-66d38a5aaca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae7a24bfa0bd4684bb0871f2d814c040, user_id=9132a8f57b2246a88d1f2157c2f63963, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:50.175932 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2172/4397] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:09:50 2022] PUT /identity/v3/projects/55484d9bd01a4364b7316bd119ac8d9a/users/44d40dcfb9f140c49b343d3e4331dfbe/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:50.185550 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a8bcf-c213-4d29-bc65-e3c2f9075bc4 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:50.185707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20605a8-0fe1-4cbd-b284-66d38a5aaca5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:50.212697 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2226/4398] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:09:50 2022] PUT /identity/v3/projects/ae7a24bfa0bd4684bb0871f2d814c040/users/9132a8f57b2246a88d1f2157c2f63963/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:50.225741 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ffff2-1be8-437d-96a6-1dcee2561c4d None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:50.226015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ffff2-1be8-437d-96a6-1dcee2561c4d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:50.226901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ffff2-1be8-437d-96a6-1dcee2561c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:50.280507 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-611ffff2-1be8-437d-96a6-1dcee2561c4d None None] MFA Rules not processed for user `44d40dcfb9f140c49b343d3e4331dfbe`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:50.282423 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-611ffff2-1be8-437d-96a6-1dcee2561c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:50.336167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:50.348398 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a8bcf-c213-4d29-bc65-e3c2f9075bc4 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:50.441104 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2227/4399] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:50.443087 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc43a7c-8521-46c0-9677-f6d87f7111be None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:50.443087 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc43a7c-8521-46c0-9677-f6d87f7111be None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:50.443440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc43a7c-8521-46c0-9677-f6d87f7111be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:50.495183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-ecc43a7c-8521-46c0-9677-f6d87f7111be None None] MFA Rules not processed for user `9132a8f57b2246a88d1f2157c2f63963`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:50.496543 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ecc43a7c-8521-46c0-9677-f6d87f7111be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:50.499132 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a6f46-b658-437d-8754-55e56cb14b6a tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:50.500551 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a6f46-b658-437d-8754-55e56cb14b6a tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:50.502080 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a6f46-b658-437d-8754-55e56cb14b6a tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:50.502381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a6f46-b658-437d-8754-55e56cb14b6a tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/4667ef3b3c2f41edb6a21f228ae5d03f/implies/aa0eb96c9709455487fe75fb882b1253` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:50.507080 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a6f46-b658-437d-8754-55e56cb14b6a tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=4667ef3b3c2f41edb6a21f228ae5d03f, implied_role_id=aa0eb96c9709455487fe75fb882b1253)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:50.508146 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-c08a6f46-b658-437d-8754-55e56cb14b6a tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:50.508146 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:09:50.508146 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:09:50.511196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a6f46-b658-437d-8754-55e56cb14b6a tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:50.547027 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2173/4400] 10.222.0.33 () {58 vars in 1347 bytes} [Sat Aug 6 21:09:50 2022] DELETE /identity/v3/roles/4667ef3b3c2f41edb6a21f228ae5d03f/implies/aa0eb96c9709455487fe75fb882b1253 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:50.549816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a6f46-b658-437d-8754-55e56cb14b6a tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:50.656691 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2228/4401] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:50.656691 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc43a7c-8521-46c0-9677-f6d87f7111be None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:50.668069 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:50.680715 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc43a7c-8521-46c0-9677-f6d87f7111be None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:50.757353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a6f46-b658-437d-8754-55e56cb14b6a tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:50.773324 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952bfcf-cde8-4f62-9589-554fffdc9cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:50.774838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952bfcf-cde8-4f62-9589-554fffdc9cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:50.775121 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952bfcf-cde8-4f62-9589-554fffdc9cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:50.775403 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952bfcf-cde8-4f62-9589-554fffdc9cb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:50.776039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7952bfcf-cde8-4f62-9589-554fffdc9cb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:50.778250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7952bfcf-cde8-4f62-9589-554fffdc9cb4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:50.829571 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b860c-52e2-4c96-a37a-acf96edc17fa tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:50.830287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b860c-52e2-4c96-a37a-acf96edc17fa tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:50.830601 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b860c-52e2-4c96-a37a-acf96edc17fa tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:50.830880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b860c-52e2-4c96-a37a-acf96edc17fa tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:50.832722 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b860c-52e2-4c96-a37a-acf96edc17fa tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Adding query filter params (scope.project.id=c38ab9e6a9de4f9abaa70787dad987f4, user.id=bb7dbc691f9845988f3f0b50842f1992) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:09:50.833041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b860c-52e2-4c96-a37a-acf96edc17fa tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:50.838415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b860c-52e2-4c96-a37a-acf96edc17fa tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:50.845880 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2174/4402] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:09:50 2022] POST /identity/v3/projects => generated 383 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:50.851038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952bfcf-cde8-4f62-9589-554fffdc9cb4 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:50.945215 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2229/4403] 10.222.0.33 () {58 vars in 1356 bytes} [Sat Aug 6 21:09:50 2022] GET /identity/v3/role_assignments?scope.project.id=c38ab9e6a9de4f9abaa70787dad987f4&user.id=bb7dbc691f9845988f3f0b50842f1992&effective => generated 577 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:09:50.946164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b860c-52e2-4c96-a37a-acf96edc17fa tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:50.952557 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3f8b860c-52e2-4c96-a37a-acf96edc17fa tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:50.954239 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952bfcf-cde8-4f62-9589-554fffdc9cb4 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:50.960524 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaec4fb-cead-4ddc-b53f-53f74a0dc1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:50.961540 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaec4fb-cead-4ddc-b53f-53f74a0dc1f0 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:50.962218 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaec4fb-cead-4ddc-b53f-53f74a0dc1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:50.962692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaec4fb-cead-4ddc-b53f-53f74a0dc1f0 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:50.965170 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaec4fb-cead-4ddc-b53f-53f74a0dc1f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:50.967376 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaec4fb-cead-4ddc-b53f-53f74a0dc1f0 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:51.017165 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2175/4404] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:09:50 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:51.018599 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaec4fb-cead-4ddc-b53f-53f74a0dc1f0 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:51.055575 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:51.137517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b860c-52e2-4c96-a37a-acf96edc17fa tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:51.162428 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaec4fb-cead-4ddc-b53f-53f74a0dc1f0 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:51.169230 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec95f6-d53c-4a6e-b641-d352f40f3b70 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:51.170433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec95f6-d53c-4a6e-b641-d352f40f3b70 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:51.170433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec95f6-d53c-4a6e-b641-d352f40f3b70 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:51.171061 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec95f6-d53c-4a6e-b641-d352f40f3b70 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/4667ef3b3c2f41edb6a21f228ae5d03f/implies/aa0eb96c9709455487fe75fb882b1253` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:51.172860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec95f6-d53c-4a6e-b641-d352f40f3b70 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=4667ef3b3c2f41edb6a21f228ae5d03f, implied_role_id=aa0eb96c9709455487fe75fb882b1253)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:51.175649 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec95f6-d53c-4a6e-b641-d352f40f3b70 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:51.207472 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-edec95f6-d53c-4a6e-b641-d352f40f3b70 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] 4667ef3b3c2f41edb6a21f228ae5d03f does not imply aa0eb96c9709455487fe75fb882b1253.: keystone.exception.ImpliedRoleNotFound: 4667ef3b3c2f41edb6a21f228ae5d03f does not imply aa0eb96c9709455487fe75fb882b1253. Aug 06 21:09:51.207472 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:09:51.207472 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Aug 06 21:09:51.207472 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = query.one() Aug 06 21:09:51.207472 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Aug 06 21:09:51.207472 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._iter().one() Aug 06 21:09:51.207472 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Aug 06 21:09:51.207472 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._only_one_row( Aug 06 21:09:51.207472 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 06 21:09:51.207472 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 06 21:09:51.207472 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 06 21:09:51.207472 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:09:51.207472 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 21:09:51.207472 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:09:51.207472 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:09:51.207472 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:09:51.208956 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:09:51.208956 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:09:51.208956 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:09:51.208956 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:09:51.208956 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:09:51.208956 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:09:51.208956 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:09:51.208956 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:09:51.208956 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:09:51.208956 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Aug 06 21:09:51.208956 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Aug 06 21:09:51.208956 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:09:51.208956 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:09:51.208956 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Aug 06 21:09:51.208956 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Aug 06 21:09:51.208956 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Aug 06 21:09:51.210278 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Aug 06 21:09:51.210278 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Aug 06 21:09:51.210278 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Aug 06 21:09:51.210278 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 4667ef3b3c2f41edb6a21f228ae5d03f does not imply aa0eb96c9709455487fe75fb882b1253. Aug 06 21:09:51.210278 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:09:51.211645 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2176/4405] 10.222.0.33 () {58 vars in 1347 bytes} [Sat Aug 6 21:09:51 2022] DELETE /identity/v3/roles/4667ef3b3c2f41edb6a21f228ae5d03f/implies/aa0eb96c9709455487fe75fb882b1253 => generated 137 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:09:51.212692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec95f6-d53c-4a6e-b641-d352f40f3b70 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:51.231752 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:51.233628 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec95f6-d53c-4a6e-b641-d352f40f3b70 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:51.241403 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e81c2-270e-4ce1-b87d-dc764624d453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:51.242397 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e81c2-270e-4ce1-b87d-dc764624d453 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:51.242915 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e81c2-270e-4ce1-b87d-dc764624d453 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:51.243359 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e81c2-270e-4ce1-b87d-dc764624d453 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:51.244111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c50112-d74a-4516-b372-a9c16e5fb0b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:51.244473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e81c2-270e-4ce1-b87d-dc764624d453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:51.244743 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c50112-d74a-4516-b372-a9c16e5fb0b0 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:51.245072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c50112-d74a-4516-b372-a9c16e5fb0b0 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:51.245365 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c50112-d74a-4516-b372-a9c16e5fb0b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:51.248411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e81c2-270e-4ce1-b87d-dc764624d453 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:51.266223 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2177/4406] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:09:51 2022] GET /identity/v3/roles => generated 2323 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:09:51.268294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e81c2-270e-4ce1-b87d-dc764624d453 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:51.284468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e81c2-270e-4ce1-b87d-dc764624d453 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:51.293443 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c73c3-2659-4625-ab6d-f3cd43022dc0 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:51.295136 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c73c3-2659-4625-ab6d-f3cd43022dc0 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:51.295744 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c73c3-2659-4625-ab6d-f3cd43022dc0 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:51.296330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c73c3-2659-4625-ab6d-f3cd43022dc0 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/projects/c38ab9e6a9de4f9abaa70787dad987f4/users/bb7dbc691f9845988f3f0b50842f1992/roles/4667ef3b3c2f41edb6a21f228ae5d03f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:51.300481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c73c3-2659-4625-ab6d-f3cd43022dc0 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=c38ab9e6a9de4f9abaa70787dad987f4, user_id=bb7dbc691f9845988f3f0b50842f1992, role_id=4667ef3b3c2f41edb6a21f228ae5d03f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:51.304266 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c73c3-2659-4625-ab6d-f3cd43022dc0 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:51.311589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-815c73c3-2659-4625-ab6d-f3cd43022dc0 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invalidating the token cache because role 4667ef3b3c2f41edb6a21f228ae5d03f was removed from user bb7dbc691f9845988f3f0b50842f1992 on project c38ab9e6a9de4f9abaa70787dad987f4. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:09:51.312119 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-815c73c3-2659-4625-ab6d-f3cd43022dc0 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:51.313240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-815c73c3-2659-4625-ab6d-f3cd43022dc0 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:51.315787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c50112-d74a-4516-b372-a9c16e5fb0b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:51.317602 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c50112-d74a-4516-b372-a9c16e5fb0b0 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:51.331546 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2230/4407] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:09:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:09:51.332743 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c50112-d74a-4516-b372-a9c16e5fb0b0 service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:51.339632 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2178/4408] 10.222.0.33 () {58 vars in 1467 bytes} [Sat Aug 6 21:09:51 2022] DELETE /identity/v3/projects/c38ab9e6a9de4f9abaa70787dad987f4/users/bb7dbc691f9845988f3f0b50842f1992/roles/4667ef3b3c2f41edb6a21f228ae5d03f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:51.340651 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c73c3-2659-4625-ab6d-f3cd43022dc0 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:51.342586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-815c73c3-2659-4625-ab6d-f3cd43022dc0 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:51.348742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c50112-d74a-4516-b372-a9c16e5fb0b0 service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:51.446328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb7bb8-f3fb-450b-97c9-97b550d829c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:51.446994 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb7bb8-f3fb-450b-97c9-97b550d829c8 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:51.447276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb7bb8-f3fb-450b-97c9-97b550d829c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:51.447553 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb7bb8-f3fb-450b-97c9-97b550d829c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:51.448206 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb7bb8-f3fb-450b-97c9-97b550d829c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:51.452208 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb7bb8-f3fb-450b-97c9-97b550d829c8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:51.515276 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2231/4409] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:09:51 2022] GET /identity/v3/roles => generated 2323 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:09:51.522710 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2e4da-bad3-4e25-b929-83cba3a570fe None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:51.523267 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2e4da-bad3-4e25-b929-83cba3a570fe None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:51.526384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2e4da-bad3-4e25-b929-83cba3a570fe None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:51.529899 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2232/4410] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 21:09:51 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 21:09:51.531802 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2e4da-bad3-4e25-b929-83cba3a570fe None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:51.536096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-95c2e4da-bad3-4e25-b929-83cba3a570fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:51.553234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c73c3-2659-4625-ab6d-f3cd43022dc0 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:51.563046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39012fff-09a8-4c07-9dc2-987a34f40597 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:51.566105 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39012fff-09a8-4c07-9dc2-987a34f40597 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:51.566322 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39012fff-09a8-4c07-9dc2-987a34f40597 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:51.566625 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39012fff-09a8-4c07-9dc2-987a34f40597 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:51.567323 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39012fff-09a8-4c07-9dc2-987a34f40597 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:51.568962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39012fff-09a8-4c07-9dc2-987a34f40597 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:51.571585 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2e4da-bad3-4e25-b929-83cba3a570fe None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:51.583344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b046a-7dae-41fc-9c2f-cc99bdb1e981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:51.584896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b046a-7dae-41fc-9c2f-cc99bdb1e981 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:51.584896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b046a-7dae-41fc-9c2f-cc99bdb1e981 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:51.587528 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b046a-7dae-41fc-9c2f-cc99bdb1e981 admin admin] PATH_INFO: `/v3/projects/2a913c1e3497464a81dc38c992c571dd/users/21e71accb39c433ebb96fed270123418/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:51.613281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842b046a-7dae-41fc-9c2f-cc99bdb1e981 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a913c1e3497464a81dc38c992c571dd, user_id=21e71accb39c433ebb96fed270123418, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:51.617629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842b046a-7dae-41fc-9c2f-cc99bdb1e981 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:51.635665 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2179/4411] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:09:51 2022] POST /identity/v3/roles => generated 271 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:51.636732 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39012fff-09a8-4c07-9dc2-987a34f40597 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating service token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 21:09:51.641918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-39012fff-09a8-4c07-9dc2-987a34f40597 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:51.645302 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2233/4412] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:09:51 2022] PUT /identity/v3/projects/2a913c1e3497464a81dc38c992c571dd/users/21e71accb39c433ebb96fed270123418/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:51.649076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b046a-7dae-41fc-9c2f-cc99bdb1e981 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:51.746720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b046a-7dae-41fc-9c2f-cc99bdb1e981 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:51.753336 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad238e03-bb70-4dbf-be65-917327b6dec0 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:51.753963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad238e03-bb70-4dbf-be65-917327b6dec0 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:51.754251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad238e03-bb70-4dbf-be65-917327b6dec0 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:51.754525 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad238e03-bb70-4dbf-be65-917327b6dec0 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:51.755239 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad238e03-bb70-4dbf-be65-917327b6dec0 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Adding query filter params (domain_id=a5153a1147c447a885b462c25f843a4f) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:09:51.755562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad238e03-bb70-4dbf-be65-917327b6dec0 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:51.757215 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-ad238e03-bb70-4dbf-be65-917327b6dec0 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:51.757215 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:09:51.757215 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:09:51.757866 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad238e03-bb70-4dbf-be65-917327b6dec0 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:51.767987 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2234/4413] 10.222.0.33 () {58 vars in 1207 bytes} [Sat Aug 6 21:09:51 2022] GET /identity/v3/roles?domain_id=a5153a1147c447a885b462c25f843a4f => generated 408 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:09:51.769291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929236b-8810-4fc3-ab6c-540a44d14033 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:51.769572 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929236b-8810-4fc3-ab6c-540a44d14033 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:51.769843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929236b-8810-4fc3-ab6c-540a44d14033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:51.778327 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39012fff-09a8-4c07-9dc2-987a34f40597 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:51.780813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-39012fff-09a8-4c07-9dc2-987a34f40597 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:51.785968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:51.801074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:51.805802 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-2929236b-8810-4fc3-ab6c-540a44d14033 None None] MFA Rules not processed for user `21e71accb39c433ebb96fed270123418`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:51.807075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2929236b-8810-4fc3-ab6c-540a44d14033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:51.889106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39012fff-09a8-4c07-9dc2-987a34f40597 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:51.926536 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2235/4414] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:51.927491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929236b-8810-4fc3-ab6c-540a44d14033 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:51.945770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929236b-8810-4fc3-ab6c-540a44d14033 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:51.956313 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31383e3-f38e-448d-932c-221d7691ef2d tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:51.957514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31383e3-f38e-448d-932c-221d7691ef2d tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:51.957802 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31383e3-f38e-448d-932c-221d7691ef2d tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:51.958266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31383e3-f38e-448d-932c-221d7691ef2d tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/544616d6a6fc48d28880adc071cd78ff` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:51.961791 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31383e3-f38e-448d-932c-221d7691ef2d tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=544616d6a6fc48d28880adc071cd78ff)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:51.963694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31383e3-f38e-448d-932c-221d7691ef2d tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:51.997631 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4e1cf-95c3-4467-94ca-fa8c9c8d1ee0 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9132a8f57b2246a88d1f2157c2f63963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae7a24bfa0bd4684bb0871f2d814c040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:51.999428 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4e1cf-95c3-4467-94ca-fa8c9c8d1ee0 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:52.001351 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4e1cf-95c3-4467-94ca-fa8c9c8d1ee0 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:52.003233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4e1cf-95c3-4467-94ca-fa8c9c8d1ee0 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] PATH_INFO: `/v3/projects/ae7a24bfa0bd4684bb0871f2d814c040` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:52.005758 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4e1cf-95c3-4467-94ca-fa8c9c8d1ee0 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] RBAC: Authorizing `identity:get_project(project_id=ae7a24bfa0bd4684bb0871f2d814c040)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:52.012555 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4e1cf-95c3-4467-94ca-fa8c9c8d1ee0 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:52.018418 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2180/4415] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 21:09:51 2022] GET /identity/v3/projects/ae7a24bfa0bd4684bb0871f2d814c040 => generated 365 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:09:52.019424 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4e1cf-95c3-4467-94ca-fa8c9c8d1ee0 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:52.026818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f31383e3-f38e-448d-932c-221d7691ef2d tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invalidating the token cache because role 544616d6a6fc48d28880adc071cd78ff has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:09:52.027670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f31383e3-f38e-448d-932c-221d7691ef2d tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:52.029044 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f31383e3-f38e-448d-932c-221d7691ef2d tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:52.037733 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2236/4416] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:09:51 2022] DELETE /identity/v3/roles/544616d6a6fc48d28880adc071cd78ff => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:52.041690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31383e3-f38e-448d-932c-221d7691ef2d tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:52.045843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f31383e3-f38e-448d-932c-221d7691ef2d tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:52.180417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4e1cf-95c3-4467-94ca-fa8c9c8d1ee0 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:52.182650 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31383e3-f38e-448d-932c-221d7691ef2d tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:52.188428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f421758-87fd-4d23-9737-ef62e166eb9a tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:52.189528 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f421758-87fd-4d23-9737-ef62e166eb9a tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:52.189980 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f421758-87fd-4d23-9737-ef62e166eb9a tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:52.190405 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f421758-87fd-4d23-9737-ef62e166eb9a tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:52.191307 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f421758-87fd-4d23-9737-ef62e166eb9a tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Adding query filter params (domain_id=a5153a1147c447a885b462c25f843a4f) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:09:52.191681 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f421758-87fd-4d23-9737-ef62e166eb9a tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:52.194183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f421758-87fd-4d23-9737-ef62e166eb9a tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:52.206320 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2237/4417] 10.222.0.33 () {58 vars in 1207 bytes} [Sat Aug 6 21:09:52 2022] GET /identity/v3/roles?domain_id=a5153a1147c447a885b462c25f843a4f => generated 148 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:09:52.210922 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f421758-87fd-4d23-9737-ef62e166eb9a tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:52.234764 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f421758-87fd-4d23-9737-ef62e166eb9a tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:52.244156 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d78a39-92b9-4416-928c-118f02e76123 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:52.245648 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d78a39-92b9-4416-928c-118f02e76123 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:52.246441 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d78a39-92b9-4416-928c-118f02e76123 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:52.246911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d78a39-92b9-4416-928c-118f02e76123 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/544616d6a6fc48d28880adc071cd78ff` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:52.269810 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d78a39-92b9-4416-928c-118f02e76123 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 21:09:52.275706 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-b0d78a39-92b9-4416-928c-118f02e76123 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Could not find role: 544616d6a6fc48d28880adc071cd78ff.: keystone.exception.RoleNotFound: Could not find role: 544616d6a6fc48d28880adc071cd78ff. Aug 06 21:09:52.275706 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:09:52.275706 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:09:52.275706 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:09:52.275706 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:09:52.275706 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:09:52.275706 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:09:52.275706 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:09:52.275706 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:09:52.275706 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:09:52.275706 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:09:52.275706 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:09:52.275706 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Aug 06 21:09:52.275706 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Aug 06 21:09:52.277099 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 21:09:52.277099 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 21:09:52.277099 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 21:09:52.277099 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 21:09:52.277099 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:09:52.277099 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:09:52.277099 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 21:09:52.277099 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 21:09:52.277099 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 21:09:52.277099 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 21:09:52.277099 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 21:09:52.277099 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 21:09:52.277099 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 21:09:52.277099 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 21:09:52.277099 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 21:09:52.277099 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 21:09:52.278442 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 21:09:52.278442 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 21:09:52.278442 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 21:09:52.278442 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 21:09:52.278442 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 21:09:52.278442 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 21:09:52.278442 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 21:09:52.278442 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 21:09:52.278442 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 21:09:52.278442 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 21:09:52.278442 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 544616d6a6fc48d28880adc071cd78ff. Aug 06 21:09:52.278442 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:09:52.288284 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2238/4418] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:09:52 2022] DELETE /identity/v3/roles/544616d6a6fc48d28880adc071cd78ff => generated 110 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:09:52.293075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d78a39-92b9-4416-928c-118f02e76123 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:52.315922 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d78a39-92b9-4416-928c-118f02e76123 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:52.327406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c641b21-0c19-46da-9a0a-01c463b6adb3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:52.330203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c641b21-0c19-46da-9a0a-01c463b6adb3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:52.330508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c641b21-0c19-46da-9a0a-01c463b6adb3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:52.332514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c641b21-0c19-46da-9a0a-01c463b6adb3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/domains/a5153a1147c447a885b462c25f843a4f/groups/c72ce26ea05d49378eb63cefeccc7067/roles/60a015264f4c412da4288d651404c30f` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:52.347144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944dd38-c311-4e46-bcb7-a728f64efde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:52.348221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944dd38-c311-4e46-bcb7-a728f64efde1 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:52.348738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944dd38-c311-4e46-bcb7-a728f64efde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:52.349226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944dd38-c311-4e46-bcb7-a728f64efde1 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:52.350051 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f944dd38-c311-4e46-bcb7-a728f64efde1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:52.351207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c641b21-0c19-46da-9a0a-01c463b6adb3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=a5153a1147c447a885b462c25f843a4f, group_id=c72ce26ea05d49378eb63cefeccc7067, role_id=60a015264f4c412da4288d651404c30f)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:52.356041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c641b21-0c19-46da-9a0a-01c463b6adb3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:52.357130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f944dd38-c311-4e46-bcb7-a728f64efde1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:52.392119 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2239/4419] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:09:52 2022] PUT /identity/v3/domains/a5153a1147c447a885b462c25f843a4f/groups/c72ce26ea05d49378eb63cefeccc7067/roles/60a015264f4c412da4288d651404c30f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:09:52.395884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c641b21-0c19-46da-9a0a-01c463b6adb3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:52.437647 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2181/4420] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:09:52 2022] POST /identity/v3/projects => generated 383 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:52.447326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944dd38-c311-4e46-bcb7-a728f64efde1 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:52.449350 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f944dd38-c311-4e46-bcb7-a728f64efde1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:52.462407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:52.528822 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:52.689430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c641b21-0c19-46da-9a0a-01c463b6adb3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:52.712639 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944dd38-c311-4e46-bcb7-a728f64efde1 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:52.738716 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc5662-c530-4f39-8b44-8cabfef2ad9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:52.739911 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc5662-c530-4f39-8b44-8cabfef2ad9b admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:52.740467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc5662-c530-4f39-8b44-8cabfef2ad9b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:52.740953 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc5662-c530-4f39-8b44-8cabfef2ad9b admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:52.742308 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc5662-c530-4f39-8b44-8cabfef2ad9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:52.747526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc5662-c530-4f39-8b44-8cabfef2ad9b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:52.778112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1891320c-1a37-40b0-83f5-2dc4689d2b17 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:52.778826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891320c-1a37-40b0-83f5-2dc4689d2b17 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:52.780504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891320c-1a37-40b0-83f5-2dc4689d2b17 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:52.780504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891320c-1a37-40b0-83f5-2dc4689d2b17 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/domains/a5153a1147c447a885b462c25f843a4f/groups/c72ce26ea05d49378eb63cefeccc7067/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:52.785378 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1891320c-1a37-40b0-83f5-2dc4689d2b17 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=a5153a1147c447a885b462c25f843a4f, group_id=c72ce26ea05d49378eb63cefeccc7067)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:52.788443 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-1891320c-1a37-40b0-83f5-2dc4689d2b17 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:52.788443 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:09:52.788443 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:09:52.791542 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1891320c-1a37-40b0-83f5-2dc4689d2b17 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:52.798499 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2182/4421] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:09:52 2022] POST /identity/v3/users => generated 298 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:52.801074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc55e0-535d-401d-98f5-c93b32864748 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:52.804306 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc55e0-535d-401d-98f5-c93b32864748 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:52.805254 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc55e0-535d-401d-98f5-c93b32864748 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:52.808173 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2183/4422] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 21:09:52 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 21:09:52.811004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc55e0-535d-401d-98f5-c93b32864748 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:52.817797 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2240/4423] 10.222.0.33 () {58 vars in 1365 bytes} [Sat Aug 6 21:09:52 2022] GET /identity/v3/domains/a5153a1147c447a885b462c25f843a4f/groups/c72ce26ea05d49378eb63cefeccc7067/roles => generated 410 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:09:52.817797 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1891320c-1a37-40b0-83f5-2dc4689d2b17 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating service token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 21:09:52.819909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1891320c-1a37-40b0-83f5-2dc4689d2b17 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:52.852694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc55e0-535d-401d-98f5-c93b32864748 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:52.863974 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50496d46-af35-4ce5-b47c-2fbd6daab371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:52.865017 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50496d46-af35-4ce5-b47c-2fbd6daab371 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:52.868244 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50496d46-af35-4ce5-b47c-2fbd6daab371 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:52.868857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50496d46-af35-4ce5-b47c-2fbd6daab371 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:52.869787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50496d46-af35-4ce5-b47c-2fbd6daab371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:52.871671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50496d46-af35-4ce5-b47c-2fbd6daab371 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:52.908336 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2184/4424] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:09:52 2022] GET /identity/v3/roles => generated 2323 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:09:52.909588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50496d46-af35-4ce5-b47c-2fbd6daab371 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:52.925930 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1891320c-1a37-40b0-83f5-2dc4689d2b17 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:52.927324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1891320c-1a37-40b0-83f5-2dc4689d2b17 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:52.946037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50496d46-af35-4ce5-b47c-2fbd6daab371 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:52.956276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ab726-d62e-4700-9737-6f58c85b73ae tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:52.957959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ab726-d62e-4700-9737-6f58c85b73ae tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `HEAD` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:52.959991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ab726-d62e-4700-9737-6f58c85b73ae tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:52.960381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ab726-d62e-4700-9737-6f58c85b73ae tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/domains/a5153a1147c447a885b462c25f843a4f/groups/c72ce26ea05d49378eb63cefeccc7067/roles/60a015264f4c412da4288d651404c30f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:52.964044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ab726-d62e-4700-9737-6f58c85b73ae tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=a5153a1147c447a885b462c25f843a4f, group_id=c72ce26ea05d49378eb63cefeccc7067, role_id=60a015264f4c412da4288d651404c30f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:52.977019 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-bf2ab726-d62e-4700-9737-6f58c85b73ae tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:52.977019 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:09:52.977019 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:09:52.979544 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ab726-d62e-4700-9737-6f58c85b73ae tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:52.996933 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2185/4425] 10.222.0.33 () {58 vars in 1465 bytes} [Sat Aug 6 21:09:52 2022] HEAD /identity/v3/domains/a5153a1147c447a885b462c25f843a4f/groups/c72ce26ea05d49378eb63cefeccc7067/roles/60a015264f4c412da4288d651404c30f => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:53.000958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ab726-d62e-4700-9737-6f58c85b73ae tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:53.010229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1891320c-1a37-40b0-83f5-2dc4689d2b17 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:53.015521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a091c-8bc2-4e10-84f2-47ddce4460f5 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9132a8f57b2246a88d1f2157c2f63963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae7a24bfa0bd4684bb0871f2d814c040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:53.016210 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a091c-8bc2-4e10-84f2-47ddce4460f5 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:53.016496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a091c-8bc2-4e10-84f2-47ddce4460f5 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:53.016773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a091c-8bc2-4e10-84f2-47ddce4460f5 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] PATH_INFO: `/v3/projects/ae7a24bfa0bd4684bb0871f2d814c040` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:53.018347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a091c-8bc2-4e10-84f2-47ddce4460f5 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] RBAC: Authorizing `identity:get_project(project_id=ae7a24bfa0bd4684bb0871f2d814c040)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:53.020232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a091c-8bc2-4e10-84f2-47ddce4460f5 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:53.022194 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2241/4426] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 21:09:52 2022] GET /identity/v3/projects/ae7a24bfa0bd4684bb0871f2d814c040 => generated 365 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:09:53.028883 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ab726-d62e-4700-9737-6f58c85b73ae tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:53.037307 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a091c-8bc2-4e10-84f2-47ddce4460f5 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:53.041286 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c29f6-8233-4045-aef5-3a5aba9d9dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:53.042011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c29f6-8233-4045-aef5-3a5aba9d9dfd admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:53.042292 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c29f6-8233-4045-aef5-3a5aba9d9dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:53.042576 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c29f6-8233-4045-aef5-3a5aba9d9dfd admin admin] PATH_INFO: `/v3/projects/211f9a50cfe24ad1bbaf526a1366ddec/users/a35e42d2429944cda1761a21b9da9a03/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:53.048053 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:53.076582 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a091c-8bc2-4e10-84f2-47ddce4460f5 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:53.088147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c29f6-8233-4045-aef5-3a5aba9d9dfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=211f9a50cfe24ad1bbaf526a1366ddec, user_id=a35e42d2429944cda1761a21b9da9a03, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:53.090832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1876a2c-459a-4c72-80a7-5c4f65aabcac tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:53.091617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c29f6-8233-4045-aef5-3a5aba9d9dfd admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:53.091880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1876a2c-459a-4c72-80a7-5c4f65aabcac tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:53.092344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1876a2c-459a-4c72-80a7-5c4f65aabcac tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:53.092800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1876a2c-459a-4c72-80a7-5c4f65aabcac tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/domains/a5153a1147c447a885b462c25f843a4f/groups/c72ce26ea05d49378eb63cefeccc7067/roles/60a015264f4c412da4288d651404c30f` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:53.107914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1876a2c-459a-4c72-80a7-5c4f65aabcac tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=a5153a1147c447a885b462c25f843a4f, group_id=c72ce26ea05d49378eb63cefeccc7067, role_id=60a015264f4c412da4288d651404c30f)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:53.109202 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-f1876a2c-459a-4c72-80a7-5c4f65aabcac tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:53.109202 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:09:53.109202 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:09:53.111779 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2186/4427] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:09:52 2022] PUT /identity/v3/projects/211f9a50cfe24ad1bbaf526a1366ddec/users/a35e42d2429944cda1761a21b9da9a03/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:53.115810 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c29f6-8233-4045-aef5-3a5aba9d9dfd admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:53.117436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1876a2c-459a-4c72-80a7-5c4f65aabcac tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:53.130212 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f1876a2c-459a-4c72-80a7-5c4f65aabcac tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invalidating the token cache because role 60a015264f4c412da4288d651404c30f was removed from group c72ce26ea05d49378eb63cefeccc7067 on domain a5153a1147c447a885b462c25f843a4f. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:09:53.130863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f1876a2c-459a-4c72-80a7-5c4f65aabcac tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:53.131833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f1876a2c-459a-4c72-80a7-5c4f65aabcac tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:53.157713 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2242/4428] 10.222.0.33 () {58 vars in 1467 bytes} [Sat Aug 6 21:09:53 2022] DELETE /identity/v3/domains/a5153a1147c447a885b462c25f843a4f/groups/c72ce26ea05d49378eb63cefeccc7067/roles/60a015264f4c412da4288d651404c30f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:53.163097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1876a2c-459a-4c72-80a7-5c4f65aabcac tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:53.165454 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f1876a2c-459a-4c72-80a7-5c4f65aabcac tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:53.204659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c29f6-8233-4045-aef5-3a5aba9d9dfd admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:53.268087 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1876a2c-459a-4c72-80a7-5c4f65aabcac tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:53.275425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d732bb6-28e5-479d-92b0-fcfe42b8ea9d tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:53.276711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d732bb6-28e5-479d-92b0-fcfe42b8ea9d tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:53.276994 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d732bb6-28e5-479d-92b0-fcfe42b8ea9d tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:53.277271 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d732bb6-28e5-479d-92b0-fcfe42b8ea9d tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/projects/c38ab9e6a9de4f9abaa70787dad987f4/groups/c72ce26ea05d49378eb63cefeccc7067/roles/60a015264f4c412da4288d651404c30f` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:53.280346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d732bb6-28e5-479d-92b0-fcfe42b8ea9d tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c38ab9e6a9de4f9abaa70787dad987f4, group_id=c72ce26ea05d49378eb63cefeccc7067, role_id=60a015264f4c412da4288d651404c30f)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:53.283201 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d732bb6-28e5-479d-92b0-fcfe42b8ea9d tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:53.309841 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2243/4429] 10.222.0.33 () {60 vars in 1486 bytes} [Sat Aug 6 21:09:53 2022] PUT /identity/v3/projects/c38ab9e6a9de4f9abaa70787dad987f4/groups/c72ce26ea05d49378eb63cefeccc7067/roles/60a015264f4c412da4288d651404c30f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:53.313930 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d732bb6-28e5-479d-92b0-fcfe42b8ea9d tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:53.323365 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:53.331447 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1254c83-c1cf-4f58-9cd3-2392ef44206b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:53.333764 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1254c83-c1cf-4f58-9cd3-2392ef44206b admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:53.335281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1254c83-c1cf-4f58-9cd3-2392ef44206b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:53.336085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1254c83-c1cf-4f58-9cd3-2392ef44206b admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:53.337005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1254c83-c1cf-4f58-9cd3-2392ef44206b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:53.340169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1254c83-c1cf-4f58-9cd3-2392ef44206b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:53.376025 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2187/4430] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:09:53 2022] GET /identity/v3/roles => generated 2323 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:09:53.381593 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1254c83-c1cf-4f58-9cd3-2392ef44206b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:53.384631 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d1254c83-c1cf-4f58-9cd3-2392ef44206b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:53.425521 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1254c83-c1cf-4f58-9cd3-2392ef44206b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:53.443875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d732bb6-28e5-479d-92b0-fcfe42b8ea9d tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:53.450773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfc480-21d7-4c4d-8137-80cb4fd86beb tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:53.451521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfc480-21d7-4c4d-8137-80cb4fd86beb tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:53.452326 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfc480-21d7-4c4d-8137-80cb4fd86beb tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:53.452326 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfc480-21d7-4c4d-8137-80cb4fd86beb tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/projects/c38ab9e6a9de4f9abaa70787dad987f4/groups/c72ce26ea05d49378eb63cefeccc7067/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:53.454163 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cfc480-21d7-4c4d-8137-80cb4fd86beb tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:list_grants(project_id=c38ab9e6a9de4f9abaa70787dad987f4, group_id=c72ce26ea05d49378eb63cefeccc7067)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:53.459507 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cfc480-21d7-4c4d-8137-80cb4fd86beb tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:53.490875 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2244/4431] 10.222.0.33 () {58 vars in 1368 bytes} [Sat Aug 6 21:09:53 2022] GET /identity/v3/projects/c38ab9e6a9de4f9abaa70787dad987f4/groups/c72ce26ea05d49378eb63cefeccc7067/roles => generated 411 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:09:53.492268 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0d847-8dae-4803-8a4a-8c683c020688 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:53.492559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0d847-8dae-4803-8a4a-8c683c020688 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:53.492838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0d847-8dae-4803-8a4a-8c683c020688 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:53.494389 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2245/4432] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 21:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 21:09:53.495190 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0d847-8dae-4803-8a4a-8c683c020688 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:53.523680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af73688-e475-4b22-a814-b93b4b39eddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:53.524520 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af73688-e475-4b22-a814-b93b4b39eddc admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:53.526229 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af73688-e475-4b22-a814-b93b4b39eddc admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:53.527365 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af73688-e475-4b22-a814-b93b4b39eddc admin admin] PATH_INFO: `/v3/projects/211f9a50cfe24ad1bbaf526a1366ddec/users/a35e42d2429944cda1761a21b9da9a03/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:53.532556 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0d847-8dae-4803-8a4a-8c683c020688 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:53.538594 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af73688-e475-4b22-a814-b93b4b39eddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=211f9a50cfe24ad1bbaf526a1366ddec, user_id=a35e42d2429944cda1761a21b9da9a03, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:53.539631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5ea80-d472-4795-9337-f6b652c96f48 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:53.540538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5ea80-d472-4795-9337-f6b652c96f48 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:53.541193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5ea80-d472-4795-9337-f6b652c96f48 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:53.541639 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5ea80-d472-4795-9337-f6b652c96f48 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/groups/c72ce26ea05d49378eb63cefeccc7067/users/bb7dbc691f9845988f3f0b50842f1992` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:53.542000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af73688-e475-4b22-a814-b93b4b39eddc admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:53.544138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5ea80-d472-4795-9337-f6b652c96f48 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=c72ce26ea05d49378eb63cefeccc7067, user_id=bb7dbc691f9845988f3f0b50842f1992)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:53.546423 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-bdd5ea80-d472-4795-9337-f6b652c96f48 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:53.546423 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:09:53.546423 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:09:53.549048 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5ea80-d472-4795-9337-f6b652c96f48 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:53.572744 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2188/4433] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:09:53 2022] PUT /identity/v3/projects/211f9a50cfe24ad1bbaf526a1366ddec/users/a35e42d2429944cda1761a21b9da9a03/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:53.574694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af73688-e475-4b22-a814-b93b4b39eddc admin admin] Authenticating service token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 21:09:53.581127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7af73688-e475-4b22-a814-b93b4b39eddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:53.613749 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2246/4434] 10.222.0.33 () {60 vars in 1360 bytes} [Sat Aug 6 21:09:53 2022] PUT /identity/v3/groups/c72ce26ea05d49378eb63cefeccc7067/users/bb7dbc691f9845988f3f0b50842f1992 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:53.616424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f68c7-5539-4986-819f-6cd4ccf08fcb None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:53.616825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f68c7-5539-4986-819f-6cd4ccf08fcb None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:53.617697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f68c7-5539-4986-819f-6cd4ccf08fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:53.658532 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-bc3f68c7-5539-4986-819f-6cd4ccf08fcb None None] MFA Rules not processed for user `a35e42d2429944cda1761a21b9da9a03`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:53.659998 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-bc3f68c7-5539-4986-819f-6cd4ccf08fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:53.727397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:53.771119 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af73688-e475-4b22-a814-b93b4b39eddc admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:53.772499 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7af73688-e475-4b22-a814-b93b4b39eddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:53.792356 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2247/4435] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:53.797126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68ec3a-1324-4343-9bab-8837a1da43f7 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:53.797511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68ec3a-1324-4343-9bab-8837a1da43f7 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:53.798020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68ec3a-1324-4343-9bab-8837a1da43f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:53.865616 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-bb68ec3a-1324-4343-9bab-8837a1da43f7 None None] MFA Rules not processed for user `bb7dbc691f9845988f3f0b50842f1992`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:53.867035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-bb68ec3a-1324-4343-9bab-8837a1da43f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:53.867973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af73688-e475-4b22-a814-b93b4b39eddc admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:53.912322 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:53.944773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32dea15-dec0-4e50-9cf3-88f900f63415 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9132a8f57b2246a88d1f2157c2f63963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae7a24bfa0bd4684bb0871f2d814c040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:53.945260 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32dea15-dec0-4e50-9cf3-88f900f63415 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:53.945874 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32dea15-dec0-4e50-9cf3-88f900f63415 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:53.946108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32dea15-dec0-4e50-9cf3-88f900f63415 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] PATH_INFO: `/v3/projects/ae7a24bfa0bd4684bb0871f2d814c040` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:53.947208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32dea15-dec0-4e50-9cf3-88f900f63415 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] RBAC: Authorizing `identity:get_project(project_id=ae7a24bfa0bd4684bb0871f2d814c040)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:53.949096 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32dea15-dec0-4e50-9cf3-88f900f63415 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:53.951507 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2189/4436] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 21:09:53 2022] GET /identity/v3/projects/ae7a24bfa0bd4684bb0871f2d814c040 => generated 365 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:09:53.952509 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32dea15-dec0-4e50-9cf3-88f900f63415 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:53.954348 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d32dea15-dec0-4e50-9cf3-88f900f63415 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:54.013849 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2248/4437] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:53 2022] POST /identity/v3/auth/tokens => generated 3261 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:54.015295 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb998a-1fe8-4721-afb3-33498071802d None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:54.015643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb998a-1fe8-4721-afb3-33498071802d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:54.016032 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb998a-1fe8-4721-afb3-33498071802d None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:54.019013 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2249/4438] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 21:09:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 21:09:54.020440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb998a-1fe8-4721-afb3-33498071802d None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:54.045821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32dea15-dec0-4e50-9cf3-88f900f63415 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:54.051988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7915c6a-c659-4aed-9c84-6cba4400ff94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:54.052668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7915c6a-c659-4aed-9c84-6cba4400ff94 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:54.053019 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7915c6a-c659-4aed-9c84-6cba4400ff94 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:54.053385 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7915c6a-c659-4aed-9c84-6cba4400ff94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:54.060338 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f7915c6a-c659-4aed-9c84-6cba4400ff94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:54.120649 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb998a-1fe8-4721-afb3-33498071802d None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:54.125979 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97af171-5370-4855-9163-a44905ee22a3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:54.127101 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97af171-5370-4855-9163-a44905ee22a3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `HEAD` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:54.127416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97af171-5370-4855-9163-a44905ee22a3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:54.127694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97af171-5370-4855-9163-a44905ee22a3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/projects/c38ab9e6a9de4f9abaa70787dad987f4/groups/c72ce26ea05d49378eb63cefeccc7067/roles/60a015264f4c412da4288d651404c30f` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:54.131019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97af171-5370-4855-9163-a44905ee22a3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:check_grant(project_id=c38ab9e6a9de4f9abaa70787dad987f4, group_id=c72ce26ea05d49378eb63cefeccc7067, role_id=60a015264f4c412da4288d651404c30f)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:54.132055 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-d97af171-5370-4855-9163-a44905ee22a3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:54.132055 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:09:54.132055 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:09:54.134637 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97af171-5370-4855-9163-a44905ee22a3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:54.143023 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2250/4439] 10.222.0.33 () {58 vars in 1468 bytes} [Sat Aug 6 21:09:54 2022] HEAD /identity/v3/projects/c38ab9e6a9de4f9abaa70787dad987f4/groups/c72ce26ea05d49378eb63cefeccc7067/roles/60a015264f4c412da4288d651404c30f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:54.144270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97af171-5370-4855-9163-a44905ee22a3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating service token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 21:09:54.188370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7915c6a-c659-4aed-9c84-6cba4400ff94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:54.190665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7915c6a-c659-4aed-9c84-6cba4400ff94 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:54.198727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:54.220638 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2190/4440] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:09:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:09:54.222915 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7915c6a-c659-4aed-9c84-6cba4400ff94 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:54.237003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7915c6a-c659-4aed-9c84-6cba4400ff94 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:54.265982 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628d720-4c65-4272-8c2b-d4e445f5467f tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:54.268565 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628d720-4c65-4272-8c2b-d4e445f5467f tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:54.269058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628d720-4c65-4272-8c2b-d4e445f5467f tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:54.269977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628d720-4c65-4272-8c2b-d4e445f5467f tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/projects/c38ab9e6a9de4f9abaa70787dad987f4/groups/c72ce26ea05d49378eb63cefeccc7067/roles/60a015264f4c412da4288d651404c30f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:54.272580 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b628d720-4c65-4272-8c2b-d4e445f5467f tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=c38ab9e6a9de4f9abaa70787dad987f4, group_id=c72ce26ea05d49378eb63cefeccc7067, role_id=60a015264f4c412da4288d651404c30f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:54.276114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b628d720-4c65-4272-8c2b-d4e445f5467f tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:54.299658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b628d720-4c65-4272-8c2b-d4e445f5467f tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invalidating the token cache because role 60a015264f4c412da4288d651404c30f was removed from group c72ce26ea05d49378eb63cefeccc7067 on project c38ab9e6a9de4f9abaa70787dad987f4. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:09:54.301377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b628d720-4c65-4272-8c2b-d4e445f5467f tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:54.302452 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b628d720-4c65-4272-8c2b-d4e445f5467f tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:54.311752 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97af171-5370-4855-9163-a44905ee22a3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:54.343690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97af171-5370-4855-9163-a44905ee22a3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:54.344003 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2191/4441] 10.222.0.33 () {58 vars in 1470 bytes} [Sat Aug 6 21:09:54 2022] DELETE /identity/v3/projects/c38ab9e6a9de4f9abaa70787dad987f4/groups/c72ce26ea05d49378eb63cefeccc7067/roles/60a015264f4c412da4288d651404c30f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:54.350945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628d720-4c65-4272-8c2b-d4e445f5467f tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:54.355428 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b628d720-4c65-4272-8c2b-d4e445f5467f tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:54.454652 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b50f2-c5a0-4cdf-98a4-f1c22deec236 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9132a8f57b2246a88d1f2157c2f63963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae7a24bfa0bd4684bb0871f2d814c040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:54.456428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b50f2-c5a0-4cdf-98a4-f1c22deec236 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:54.456811 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b50f2-c5a0-4cdf-98a4-f1c22deec236 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:54.457186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b50f2-c5a0-4cdf-98a4-f1c22deec236 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] PATH_INFO: `/v3/projects/ae7a24bfa0bd4684bb0871f2d814c040` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:54.458176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b50f2-c5a0-4cdf-98a4-f1c22deec236 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] RBAC: Authorizing `identity:get_project(project_id=ae7a24bfa0bd4684bb0871f2d814c040)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:54.460153 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b50f2-c5a0-4cdf-98a4-f1c22deec236 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:54.463358 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2251/4442] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 21:09:54 2022] GET /identity/v3/projects/ae7a24bfa0bd4684bb0871f2d814c040 => generated 365 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:09:54.510045 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628d720-4c65-4272-8c2b-d4e445f5467f tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:54.514445 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37108953-6298-4541-a336-da530de138dd None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:54.515090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37108953-6298-4541-a336-da530de138dd None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:54.515731 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37108953-6298-4541-a336-da530de138dd None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:54.517990 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2252/4443] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 21:09:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 21:09:54.523595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9bf54a-c5d7-4253-aef7-5fa96eb5c80a tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:54.524283 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9bf54a-c5d7-4253-aef7-5fa96eb5c80a tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:54.524566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9bf54a-c5d7-4253-aef7-5fa96eb5c80a tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:54.524853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9bf54a-c5d7-4253-aef7-5fa96eb5c80a tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/groups/c72ce26ea05d49378eb63cefeccc7067/users/bb7dbc691f9845988f3f0b50842f1992` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:54.525734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37108953-6298-4541-a336-da530de138dd None None] Authenticating service token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 21:09:54.528457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9bf54a-c5d7-4253-aef7-5fa96eb5c80a tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=c72ce26ea05d49378eb63cefeccc7067, user_id=bb7dbc691f9845988f3f0b50842f1992)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:54.529021 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-0d9bf54a-c5d7-4253-aef7-5fa96eb5c80a tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:54.529021 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:09:54.529021 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:09:54.531160 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9bf54a-c5d7-4253-aef7-5fa96eb5c80a tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:54.535894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-37108953-6298-4541-a336-da530de138dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:54.555166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0d9bf54a-c5d7-4253-aef7-5fa96eb5c80a tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'bb7dbc691f9845988f3f0b50842f1992'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:54.588534 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2192/4444] 10.222.0.33 () {58 vars in 1344 bytes} [Sat Aug 6 21:09:54 2022] DELETE /identity/v3/groups/c72ce26ea05d49378eb63cefeccc7067/users/bb7dbc691f9845988f3f0b50842f1992 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:54.591048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9bf54a-c5d7-4253-aef7-5fa96eb5c80a tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:54.609843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:54.729057 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37108953-6298-4541-a336-da530de138dd None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:54.733209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-37108953-6298-4541-a336-da530de138dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:54.757172 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9bf54a-c5d7-4253-aef7-5fa96eb5c80a tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:54.771330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37108953-6298-4541-a336-da530de138dd None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:54.772539 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c353ee-c477-4677-a470-d3bc25ef3ac1 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:54.773227 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c353ee-c477-4677-a470-d3bc25ef3ac1 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:54.773619 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c353ee-c477-4677-a470-d3bc25ef3ac1 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:54.773764 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c353ee-c477-4677-a470-d3bc25ef3ac1 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/system/groups/c72ce26ea05d49378eb63cefeccc7067/roles/60a015264f4c412da4288d651404c30f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:54.775572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c353ee-c477-4677-a470-d3bc25ef3ac1 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=c72ce26ea05d49378eb63cefeccc7067, role_id=60a015264f4c412da4288d651404c30f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:54.776588 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-b4c353ee-c477-4677-a470-d3bc25ef3ac1 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:54.776588 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:09:54.776588 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:09:54.777480 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c353ee-c477-4677-a470-d3bc25ef3ac1 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:54.791655 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2193/4445] 10.222.0.33 () {60 vars in 1381 bytes} [Sat Aug 6 21:09:54 2022] PUT /identity/v3/system/groups/c72ce26ea05d49378eb63cefeccc7067/roles/60a015264f4c412da4288d651404c30f => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:54.796581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c353ee-c477-4677-a470-d3bc25ef3ac1 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:54.816199 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c353ee-c477-4677-a470-d3bc25ef3ac1 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:54.823588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d10b3-37bf-4683-8edb-93beb39a076c tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:54.824241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d10b3-37bf-4683-8edb-93beb39a076c tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:54.824522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d10b3-37bf-4683-8edb-93beb39a076c tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:54.824804 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d10b3-37bf-4683-8edb-93beb39a076c tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/system/groups/c72ce26ea05d49378eb63cefeccc7067/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:54.826029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d10b3-37bf-4683-8edb-93beb39a076c tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=c72ce26ea05d49378eb63cefeccc7067)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:54.827092 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-503d10b3-37bf-4683-8edb-93beb39a076c tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:54.827092 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:09:54.827092 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:09:54.827969 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d10b3-37bf-4683-8edb-93beb39a076c tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:54.868183 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2194/4446] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Aug 6 21:09:54 2022] GET /identity/v3/system/groups/c72ce26ea05d49378eb63cefeccc7067/roles => generated 376 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:09:54.871279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d10b3-37bf-4683-8edb-93beb39a076c tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:54.900368 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d10b3-37bf-4683-8edb-93beb39a076c tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:54.912264 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2d32a-a5be-424e-8920-ad309d11b822 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:54.913843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a671c-4068-428a-b6f1-6bee7e24b477 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9132a8f57b2246a88d1f2157c2f63963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae7a24bfa0bd4684bb0871f2d814c040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:54.914084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2d32a-a5be-424e-8920-ad309d11b822 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `HEAD` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:54.915093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a671c-4068-428a-b6f1-6bee7e24b477 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:54.915486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a671c-4068-428a-b6f1-6bee7e24b477 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:54.915865 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a671c-4068-428a-b6f1-6bee7e24b477 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] PATH_INFO: `/v3/projects/ae7a24bfa0bd4684bb0871f2d814c040` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:54.916271 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2d32a-a5be-424e-8920-ad309d11b822 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:54.916718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2d32a-a5be-424e-8920-ad309d11b822 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/system/groups/c72ce26ea05d49378eb63cefeccc7067/roles/60a015264f4c412da4288d651404c30f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:54.917145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a671c-4068-428a-b6f1-6bee7e24b477 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] RBAC: Authorizing `identity:get_project(project_id=ae7a24bfa0bd4684bb0871f2d814c040)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:54.918925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2d32a-a5be-424e-8920-ad309d11b822 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=c72ce26ea05d49378eb63cefeccc7067, role_id=60a015264f4c412da4288d651404c30f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:54.919313 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a671c-4068-428a-b6f1-6bee7e24b477 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:54.920364 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-3ab2d32a-a5be-424e-8920-ad309d11b822 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:54.920364 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:09:54.920364 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:09:54.921803 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2253/4447] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 21:09:54 2022] GET /identity/v3/projects/ae7a24bfa0bd4684bb0871f2d814c040 => generated 365 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:09:54.934357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2d32a-a5be-424e-8920-ad309d11b822 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:54.951326 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2195/4448] 10.222.0.33 () {58 vars in 1363 bytes} [Sat Aug 6 21:09:54 2022] HEAD /identity/v3/system/groups/c72ce26ea05d49378eb63cefeccc7067/roles/60a015264f4c412da4288d651404c30f => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:09:54.955780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a671c-4068-428a-b6f1-6bee7e24b477 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:54.972129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2d32a-a5be-424e-8920-ad309d11b822 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:54.974238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a671c-4068-428a-b6f1-6bee7e24b477 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:54.975489 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3ab2d32a-a5be-424e-8920-ad309d11b822 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:54.991941 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eea8bb-818a-4ba4-804e-07ed612a126d tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:54.993972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eea8bb-818a-4ba4-804e-07ed612a126d tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:54.994308 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eea8bb-818a-4ba4-804e-07ed612a126d tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:54.995090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eea8bb-818a-4ba4-804e-07ed612a126d tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/system/groups/c72ce26ea05d49378eb63cefeccc7067/roles/60a015264f4c412da4288d651404c30f` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:55.001053 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eea8bb-818a-4ba4-804e-07ed612a126d tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=c72ce26ea05d49378eb63cefeccc7067, role_id=60a015264f4c412da4288d651404c30f)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:55.003774 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-50eea8bb-818a-4ba4-804e-07ed612a126d tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:55.003774 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:09:55.003774 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:09:55.004709 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eea8bb-818a-4ba4-804e-07ed612a126d tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:55.027056 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2254/4449] 10.222.0.33 () {58 vars in 1365 bytes} [Sat Aug 6 21:09:54 2022] DELETE /identity/v3/system/groups/c72ce26ea05d49378eb63cefeccc7067/roles/60a015264f4c412da4288d651404c30f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:55.029681 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eea8bb-818a-4ba4-804e-07ed612a126d tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:55.076406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:55.091855 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eea8bb-818a-4ba4-804e-07ed612a126d tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:55.096196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2d32a-a5be-424e-8920-ad309d11b822 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:55.102705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f968a2c-5516-4574-aeba-0aa4d633d3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:55.103604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f968a2c-5516-4574-aeba-0aa4d633d3c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:55.103946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f968a2c-5516-4574-aeba-0aa4d633d3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:55.104284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f968a2c-5516-4574-aeba-0aa4d633d3c7 admin admin] PATH_INFO: `/v3/users/9132a8f57b2246a88d1f2157c2f63963` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:55.105801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f968a2c-5516-4574-aeba-0aa4d633d3c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9132a8f57b2246a88d1f2157c2f63963)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:55.108122 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f968a2c-5516-4574-aeba-0aa4d633d3c7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:55.116270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ef537-2f56-44a6-b52a-28e3384d7c50 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:55.118628 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ef537-2f56-44a6-b52a-28e3384d7c50 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:55.119069 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ef537-2f56-44a6-b52a-28e3384d7c50 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:55.119486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ef537-2f56-44a6-b52a-28e3384d7c50 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/domains/a5153a1147c447a885b462c25f843a4f/users/bb7dbc691f9845988f3f0b50842f1992/roles/60a015264f4c412da4288d651404c30f` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:55.122995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ef537-2f56-44a6-b52a-28e3384d7c50 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=a5153a1147c447a885b462c25f843a4f, user_id=bb7dbc691f9845988f3f0b50842f1992, role_id=60a015264f4c412da4288d651404c30f)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:55.127218 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ef537-2f56-44a6-b52a-28e3384d7c50 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:55.148708 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2255/4450] 10.222.0.33 () {60 vars in 1480 bytes} [Sat Aug 6 21:09:55 2022] PUT /identity/v3/domains/a5153a1147c447a885b462c25f843a4f/users/bb7dbc691f9845988f3f0b50842f1992/roles/60a015264f4c412da4288d651404c30f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:55.157233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ef537-2f56-44a6-b52a-28e3384d7c50 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:55.208121 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3f968a2c-5516-4574-aeba-0aa4d633d3c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9132a8f57b2246a88d1f2157c2f63963'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:55.208876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3f968a2c-5516-4574-aeba-0aa4d633d3c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9132a8f57b2246a88d1f2157c2f63963'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:55.209672 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3f968a2c-5516-4574-aeba-0aa4d633d3c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9132a8f57b2246a88d1f2157c2f63963'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:55.227689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3f968a2c-5516-4574-aeba-0aa4d633d3c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9132a8f57b2246a88d1f2157c2f63963'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:55.242194 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3f968a2c-5516-4574-aeba-0aa4d633d3c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9132a8f57b2246a88d1f2157c2f63963'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:55.248455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:55.275722 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ef537-2f56-44a6-b52a-28e3384d7c50 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:55.277655 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2196/4451] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:09:54 2022] DELETE /identity/v3/users/9132a8f57b2246a88d1f2157c2f63963 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:09:55.284481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073404e-fc85-4c7a-ab01-9012394e44eb None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:55.285098 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073404e-fc85-4c7a-ab01-9012394e44eb None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:55.285391 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073404e-fc85-4c7a-ab01-9012394e44eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:55.315720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-e073404e-fc85-4c7a-ab01-9012394e44eb None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:55.317337 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e073404e-fc85-4c7a-ab01-9012394e44eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:55.418239 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2197/4452] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:55.463557 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073404e-fc85-4c7a-ab01-9012394e44eb None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:55.468090 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e073404e-fc85-4c7a-ab01-9012394e44eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:55.588424 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073404e-fc85-4c7a-ab01-9012394e44eb None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:55.592565 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0920fd-a19a-437e-b7ce-07ea65dae3bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:55.593201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0920fd-a19a-437e-b7ce-07ea65dae3bc service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:55.593548 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0920fd-a19a-437e-b7ce-07ea65dae3bc service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:55.593826 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0920fd-a19a-437e-b7ce-07ea65dae3bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:55.605773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0920fd-a19a-437e-b7ce-07ea65dae3bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:55.607596 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0920fd-a19a-437e-b7ce-07ea65dae3bc service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:55.630183 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2198/4453] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:09:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:09:55.699030 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db821b-6f52-4357-b20f-b3714fba9bea tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:55.699715 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db821b-6f52-4357-b20f-b3714fba9bea tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:55.699995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db821b-6f52-4357-b20f-b3714fba9bea tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:55.700263 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db821b-6f52-4357-b20f-b3714fba9bea tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/domains/a5153a1147c447a885b462c25f843a4f/users/bb7dbc691f9845988f3f0b50842f1992/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:55.702050 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db821b-6f52-4357-b20f-b3714fba9bea tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=a5153a1147c447a885b462c25f843a4f, user_id=bb7dbc691f9845988f3f0b50842f1992)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:55.706529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db821b-6f52-4357-b20f-b3714fba9bea tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:55.735604 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2256/4454] 10.222.0.33 () {58 vars in 1362 bytes} [Sat Aug 6 21:09:55 2022] GET /identity/v3/domains/a5153a1147c447a885b462c25f843a4f/users/bb7dbc691f9845988f3f0b50842f1992/roles => generated 409 bytes in 583 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:09:55.737134 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0920fd-a19a-437e-b7ce-07ea65dae3bc service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:55.738751 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-fc0920fd-a19a-437e-b7ce-07ea65dae3bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:55.758727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0920fd-a19a-437e-b7ce-07ea65dae3bc service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:55.765037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96470822-4260-45bd-a621-4240e16a4300 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:55.766009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96470822-4260-45bd-a621-4240e16a4300 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `HEAD` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:55.766360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96470822-4260-45bd-a621-4240e16a4300 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:55.766724 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96470822-4260-45bd-a621-4240e16a4300 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/domains/a5153a1147c447a885b462c25f843a4f/users/bb7dbc691f9845988f3f0b50842f1992/roles/60a015264f4c412da4288d651404c30f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:55.769256 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96470822-4260-45bd-a621-4240e16a4300 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=a5153a1147c447a885b462c25f843a4f, user_id=bb7dbc691f9845988f3f0b50842f1992, role_id=60a015264f4c412da4288d651404c30f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:55.773633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96470822-4260-45bd-a621-4240e16a4300 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:55.786098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db821b-6f52-4357-b20f-b3714fba9bea tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:55.787445 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2199/4455] 10.222.0.33 () {58 vars in 1462 bytes} [Sat Aug 6 21:09:55 2022] HEAD /identity/v3/domains/a5153a1147c447a885b462c25f843a4f/users/bb7dbc691f9845988f3f0b50842f1992/roles/60a015264f4c412da4288d651404c30f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:09:55.798944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db821b-6f52-4357-b20f-b3714fba9bea tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:55.804463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255db8f-3fef-4d52-9f06-9bc77d151fab tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:55.805641 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255db8f-3fef-4d52-9f06-9bc77d151fab tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:55.805924 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255db8f-3fef-4d52-9f06-9bc77d151fab tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:55.806195 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255db8f-3fef-4d52-9f06-9bc77d151fab tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/domains/a5153a1147c447a885b462c25f843a4f/users/bb7dbc691f9845988f3f0b50842f1992/roles/60a015264f4c412da4288d651404c30f` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:55.812366 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255db8f-3fef-4d52-9f06-9bc77d151fab tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=a5153a1147c447a885b462c25f843a4f, user_id=bb7dbc691f9845988f3f0b50842f1992, role_id=60a015264f4c412da4288d651404c30f)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:55.815177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255db8f-3fef-4d52-9f06-9bc77d151fab tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:55.823546 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2255db8f-3fef-4d52-9f06-9bc77d151fab tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invalidating the token cache because role 60a015264f4c412da4288d651404c30f was removed from user bb7dbc691f9845988f3f0b50842f1992 on domain a5153a1147c447a885b462c25f843a4f. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:09:55.823911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2255db8f-3fef-4d52-9f06-9bc77d151fab tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:55.824562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2255db8f-3fef-4d52-9f06-9bc77d151fab tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:55.850774 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2257/4456] 10.222.0.33 () {58 vars in 1464 bytes} [Sat Aug 6 21:09:55 2022] DELETE /identity/v3/domains/a5153a1147c447a885b462c25f843a4f/users/bb7dbc691f9845988f3f0b50842f1992/roles/60a015264f4c412da4288d651404c30f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:55.852922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96470822-4260-45bd-a621-4240e16a4300 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:55.855222 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-96470822-4260-45bd-a621-4240e16a4300 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:55.872683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96470822-4260-45bd-a621-4240e16a4300 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:55.947327 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a1a30-3d20-4148-9ba9-d83a5361f3c5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:55.948061 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a1a30-3d20-4148-9ba9-d83a5361f3c5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:55.948362 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a1a30-3d20-4148-9ba9-d83a5361f3c5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:55.948670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a1a30-3d20-4148-9ba9-d83a5361f3c5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/projects/c38ab9e6a9de4f9abaa70787dad987f4/users/bb7dbc691f9845988f3f0b50842f1992/roles/60a015264f4c412da4288d651404c30f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:55.951068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a1a30-3d20-4148-9ba9-d83a5361f3c5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c38ab9e6a9de4f9abaa70787dad987f4, user_id=bb7dbc691f9845988f3f0b50842f1992, role_id=60a015264f4c412da4288d651404c30f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:55.954004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a1a30-3d20-4148-9ba9-d83a5361f3c5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:55.971631 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2200/4457] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:09:55 2022] PUT /identity/v3/projects/c38ab9e6a9de4f9abaa70787dad987f4/users/bb7dbc691f9845988f3f0b50842f1992/roles/60a015264f4c412da4288d651404c30f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:55.975820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255db8f-3fef-4d52-9f06-9bc77d151fab tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:55.992903 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255db8f-3fef-4d52-9f06-9bc77d151fab tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:56.104393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198d9cc-e3bc-4158-8e39-21483c3fbee4 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:56.105067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198d9cc-e3bc-4158-8e39-21483c3fbee4 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:56.105067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198d9cc-e3bc-4158-8e39-21483c3fbee4 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:56.105440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198d9cc-e3bc-4158-8e39-21483c3fbee4 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/projects/c38ab9e6a9de4f9abaa70787dad987f4/users/bb7dbc691f9845988f3f0b50842f1992/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:56.107389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198d9cc-e3bc-4158-8e39-21483c3fbee4 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:list_grants(project_id=c38ab9e6a9de4f9abaa70787dad987f4, user_id=bb7dbc691f9845988f3f0b50842f1992)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:56.109515 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198d9cc-e3bc-4158-8e39-21483c3fbee4 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:56.123479 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2258/4458] 10.222.0.33 () {58 vars in 1365 bytes} [Sat Aug 6 21:09:55 2022] GET /identity/v3/projects/c38ab9e6a9de4f9abaa70787dad987f4/users/bb7dbc691f9845988f3f0b50842f1992/roles => generated 410 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:09:56.128157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a1a30-3d20-4148-9ba9-d83a5361f3c5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:56.139104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a1a30-3d20-4148-9ba9-d83a5361f3c5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:56.145735 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b59b8-a452-4de5-974c-ae63571640f8 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:56.146397 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b59b8-a452-4de5-974c-ae63571640f8 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `HEAD` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:56.146719 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b59b8-a452-4de5-974c-ae63571640f8 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:56.147200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b59b8-a452-4de5-974c-ae63571640f8 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/projects/c38ab9e6a9de4f9abaa70787dad987f4/users/bb7dbc691f9845988f3f0b50842f1992/roles/60a015264f4c412da4288d651404c30f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:56.149367 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b59b8-a452-4de5-974c-ae63571640f8 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:check_grant(project_id=c38ab9e6a9de4f9abaa70787dad987f4, user_id=bb7dbc691f9845988f3f0b50842f1992, role_id=60a015264f4c412da4288d651404c30f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:56.152103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b59b8-a452-4de5-974c-ae63571640f8 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:56.158574 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2201/4459] 10.222.0.33 () {58 vars in 1465 bytes} [Sat Aug 6 21:09:56 2022] HEAD /identity/v3/projects/c38ab9e6a9de4f9abaa70787dad987f4/users/bb7dbc691f9845988f3f0b50842f1992/roles/60a015264f4c412da4288d651404c30f => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:56.162710 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198d9cc-e3bc-4158-8e39-21483c3fbee4 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:56.169951 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:56.176781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198d9cc-e3bc-4158-8e39-21483c3fbee4 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:56.186140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a499875-e553-4a5b-9d2a-dbe74a1c4894 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:56.187498 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a499875-e553-4a5b-9d2a-dbe74a1c4894 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:56.187785 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a499875-e553-4a5b-9d2a-dbe74a1c4894 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:56.188062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a499875-e553-4a5b-9d2a-dbe74a1c4894 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/projects/c38ab9e6a9de4f9abaa70787dad987f4/users/bb7dbc691f9845988f3f0b50842f1992/roles/60a015264f4c412da4288d651404c30f` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:56.193600 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a499875-e553-4a5b-9d2a-dbe74a1c4894 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=c38ab9e6a9de4f9abaa70787dad987f4, user_id=bb7dbc691f9845988f3f0b50842f1992, role_id=60a015264f4c412da4288d651404c30f)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:56.196552 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a499875-e553-4a5b-9d2a-dbe74a1c4894 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:56.202927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2a499875-e553-4a5b-9d2a-dbe74a1c4894 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invalidating the token cache because role 60a015264f4c412da4288d651404c30f was removed from user bb7dbc691f9845988f3f0b50842f1992 on project c38ab9e6a9de4f9abaa70787dad987f4. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:09:56.203265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2a499875-e553-4a5b-9d2a-dbe74a1c4894 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:56.204061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2a499875-e553-4a5b-9d2a-dbe74a1c4894 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:56.222602 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2259/4460] 10.222.0.33 () {58 vars in 1467 bytes} [Sat Aug 6 21:09:56 2022] DELETE /identity/v3/projects/c38ab9e6a9de4f9abaa70787dad987f4/users/bb7dbc691f9845988f3f0b50842f1992/roles/60a015264f4c412da4288d651404c30f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:09:56.226782 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b59b8-a452-4de5-974c-ae63571640f8 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:56.228547 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a39b59b8-a452-4de5-974c-ae63571640f8 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:56.243759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b59b8-a452-4de5-974c-ae63571640f8 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:56.257987 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:56.316266 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14f776-0b46-446d-aad6-f2c33487a3b5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:56.317294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14f776-0b46-446d-aad6-f2c33487a3b5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:56.317587 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14f776-0b46-446d-aad6-f2c33487a3b5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:56.317975 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14f776-0b46-446d-aad6-f2c33487a3b5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/system/users/bb7dbc691f9845988f3f0b50842f1992/roles/60a015264f4c412da4288d651404c30f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:56.320189 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14f776-0b46-446d-aad6-f2c33487a3b5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bb7dbc691f9845988f3f0b50842f1992, role_id=60a015264f4c412da4288d651404c30f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:56.321276 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-ac14f776-0b46-446d-aad6-f2c33487a3b5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:56.321276 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:09:56.321276 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:09:56.322215 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14f776-0b46-446d-aad6-f2c33487a3b5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:56.330221 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2202/4461] 10.222.0.33 () {60 vars in 1378 bytes} [Sat Aug 6 21:09:56 2022] PUT /identity/v3/system/users/bb7dbc691f9845988f3f0b50842f1992/roles/60a015264f4c412da4288d651404c30f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:56.334696 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a499875-e553-4a5b-9d2a-dbe74a1c4894 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:56.344931 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a499875-e553-4a5b-9d2a-dbe74a1c4894 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:56.350851 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625e49a-3f98-48bf-aef0-6255ec1794ef tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:56.351472 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625e49a-3f98-48bf-aef0-6255ec1794ef tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:56.351755 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625e49a-3f98-48bf-aef0-6255ec1794ef tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:56.352822 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625e49a-3f98-48bf-aef0-6255ec1794ef tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/system/users/bb7dbc691f9845988f3f0b50842f1992/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:56.353152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625e49a-3f98-48bf-aef0-6255ec1794ef tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=bb7dbc691f9845988f3f0b50842f1992)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:56.354827 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-a625e49a-3f98-48bf-aef0-6255ec1794ef tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:56.354827 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:09:56.354827 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:09:56.355145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625e49a-3f98-48bf-aef0-6255ec1794ef tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:56.371710 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2260/4462] 10.222.0.33 () {58 vars in 1260 bytes} [Sat Aug 6 21:09:56 2022] GET /identity/v3/system/users/bb7dbc691f9845988f3f0b50842f1992/roles => generated 375 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:09:56.375967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14f776-0b46-446d-aad6-f2c33487a3b5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:56.387570 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14f776-0b46-446d-aad6-f2c33487a3b5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:56.396469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065b3f6-2a1f-4a8d-8c64-c36e4711e985 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:56.397238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065b3f6-2a1f-4a8d-8c64-c36e4711e985 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `HEAD` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:56.397973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065b3f6-2a1f-4a8d-8c64-c36e4711e985 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:56.397973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065b3f6-2a1f-4a8d-8c64-c36e4711e985 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/system/users/bb7dbc691f9845988f3f0b50842f1992/roles/60a015264f4c412da4288d651404c30f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:56.400422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065b3f6-2a1f-4a8d-8c64-c36e4711e985 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=bb7dbc691f9845988f3f0b50842f1992, role_id=60a015264f4c412da4288d651404c30f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:56.401723 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-3065b3f6-2a1f-4a8d-8c64-c36e4711e985 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:56.401723 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:09:56.401723 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:09:56.402869 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065b3f6-2a1f-4a8d-8c64-c36e4711e985 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:56.410372 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2203/4463] 10.222.0.33 () {58 vars in 1360 bytes} [Sat Aug 6 21:09:56 2022] HEAD /identity/v3/system/users/bb7dbc691f9845988f3f0b50842f1992/roles/60a015264f4c412da4288d651404c30f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:56.414431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625e49a-3f98-48bf-aef0-6255ec1794ef tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:56.426233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625e49a-3f98-48bf-aef0-6255ec1794ef tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:56.432460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb38fa-053d-483f-8f4e-fb7480f65abd tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:56.433203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb38fa-053d-483f-8f4e-fb7480f65abd tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:56.433549 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb38fa-053d-483f-8f4e-fb7480f65abd tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:56.433884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb38fa-053d-483f-8f4e-fb7480f65abd tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/system/users/bb7dbc691f9845988f3f0b50842f1992/roles/60a015264f4c412da4288d651404c30f` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:56.437118 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb38fa-053d-483f-8f4e-fb7480f65abd tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=bb7dbc691f9845988f3f0b50842f1992, role_id=60a015264f4c412da4288d651404c30f)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:56.438069 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-c5cb38fa-053d-483f-8f4e-fb7480f65abd tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:56.438069 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:09:56.438069 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:09:56.439462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb38fa-053d-483f-8f4e-fb7480f65abd tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:56.456457 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2261/4464] 10.222.0.33 () {58 vars in 1362 bytes} [Sat Aug 6 21:09:56 2022] DELETE /identity/v3/system/users/bb7dbc691f9845988f3f0b50842f1992/roles/60a015264f4c412da4288d651404c30f => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:56.461757 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065b3f6-2a1f-4a8d-8c64-c36e4711e985 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:56.474608 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065b3f6-2a1f-4a8d-8c64-c36e4711e985 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:56.480482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d350a-588d-428b-9257-23f1f2a3ee71 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:56.481132 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d350a-588d-428b-9257-23f1f2a3ee71 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:56.481420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d350a-588d-428b-9257-23f1f2a3ee71 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:56.481698 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d350a-588d-428b-9257-23f1f2a3ee71 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:56.482361 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d350a-588d-428b-9257-23f1f2a3ee71 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:56.484084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d350a-588d-428b-9257-23f1f2a3ee71 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:56.508617 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2204/4465] 10.222.0.33 () {60 vars in 1143 bytes} [Sat Aug 6 21:09:56 2022] POST /identity/v3/roles => generated 269 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:56.509852 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb38fa-053d-483f-8f4e-fb7480f65abd tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:56.552354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb38fa-053d-483f-8f4e-fb7480f65abd tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:56.561582 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c5a52-ee2d-486b-979b-d26f1ec41ae5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:56.562205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c5a52-ee2d-486b-979b-d26f1ec41ae5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:56.562506 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c5a52-ee2d-486b-979b-d26f1ec41ae5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:56.562783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c5a52-ee2d-486b-979b-d26f1ec41ae5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:56.563447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c5a52-ee2d-486b-979b-d26f1ec41ae5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:56.566578 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-8f9c5a52-ee2d-486b-979b-d26f1ec41ae5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:56.566578 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:09:56.566578 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:09:56.569296 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c5a52-ee2d-486b-979b-d26f1ec41ae5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:56.614598 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2262/4466] 10.222.0.33 () {60 vars in 1143 bytes} [Sat Aug 6 21:09:56 2022] POST /identity/v3/roles => generated 269 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:56.619245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d350a-588d-428b-9257-23f1f2a3ee71 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:56.635643 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d350a-588d-428b-9257-23f1f2a3ee71 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:56.647617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3cb7f0-8a53-4738-9fad-4e3372e681ea tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:56.649196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cb7f0-8a53-4738-9fad-4e3372e681ea tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:56.650068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cb7f0-8a53-4738-9fad-4e3372e681ea tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:56.650068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cb7f0-8a53-4738-9fad-4e3372e681ea tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/3ea70c93d5e5454d8f2afa11564f8c05/implies/93ba2cdd71374857a94f7f25695009c0` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:56.653438 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3cb7f0-8a53-4738-9fad-4e3372e681ea tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=3ea70c93d5e5454d8f2afa11564f8c05, implied_role_id=93ba2cdd71374857a94f7f25695009c0)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:56.654653 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-4f3cb7f0-8a53-4738-9fad-4e3372e681ea tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:56.654653 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:09:56.654653 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:09:56.655872 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3cb7f0-8a53-4738-9fad-4e3372e681ea tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:56.727672 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2205/4467] 10.222.0.33 () {60 vars in 1363 bytes} [Sat Aug 6 21:09:56 2022] PUT /identity/v3/roles/3ea70c93d5e5454d8f2afa11564f8c05/implies/93ba2cdd71374857a94f7f25695009c0 => generated 529 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:56.732779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c5a52-ee2d-486b-979b-d26f1ec41ae5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:56.754140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c5a52-ee2d-486b-979b-d26f1ec41ae5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:56.843408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52705335-320e-41a0-ba62-bc08f3568d24 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:56.844108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52705335-320e-41a0-ba62-bc08f3568d24 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:56.844820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52705335-320e-41a0-ba62-bc08f3568d24 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:56.845654 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52705335-320e-41a0-ba62-bc08f3568d24 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:56.846646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52705335-320e-41a0-ba62-bc08f3568d24 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:56.849521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52705335-320e-41a0-ba62-bc08f3568d24 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:56.882148 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2263/4468] 10.222.0.33 () {60 vars in 1149 bytes} [Sat Aug 6 21:09:56 2022] POST /identity/v3/domains => generated 276 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:09:56.886131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3cb7f0-8a53-4738-9fad-4e3372e681ea tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:56.897339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3cb7f0-8a53-4738-9fad-4e3372e681ea tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:56.972113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b75e75-bace-4ed2-bdf6-db01c4120082 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:56.973194 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b75e75-bace-4ed2-bdf6-db01c4120082 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:56.973699 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b75e75-bace-4ed2-bdf6-db01c4120082 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:56.973981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b75e75-bace-4ed2-bdf6-db01c4120082 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:56.974698 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b75e75-bace-4ed2-bdf6-db01c4120082 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:56.976832 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b75e75-bace-4ed2-bdf6-db01c4120082 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:56.995197 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2206/4469] 10.222.0.33 () {60 vars in 1143 bytes} [Sat Aug 6 21:09:56 2022] POST /identity/v3/roles => generated 270 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:09:56.999323 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52705335-320e-41a0-ba62-bc08f3568d24 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:57.011055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52705335-320e-41a0-ba62-bc08f3568d24 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:57.034613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0604e6-d9c8-4b2d-a7ef-1a5c07e362d7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:57.037800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0604e6-d9c8-4b2d-a7ef-1a5c07e362d7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:57.038147 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0604e6-d9c8-4b2d-a7ef-1a5c07e362d7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:57.038591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0604e6-d9c8-4b2d-a7ef-1a5c07e362d7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/3ea70c93d5e5454d8f2afa11564f8c05/implies/3aec3e1c32b146c7b010a5de30a38a12` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:57.044638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0604e6-d9c8-4b2d-a7ef-1a5c07e362d7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=3ea70c93d5e5454d8f2afa11564f8c05, implied_role_id=3aec3e1c32b146c7b010a5de30a38a12)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:57.046596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0604e6-d9c8-4b2d-a7ef-1a5c07e362d7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:57.087293 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2264/4470] 10.222.0.33 () {60 vars in 1363 bytes} [Sat Aug 6 21:09:56 2022] PUT /identity/v3/roles/3ea70c93d5e5454d8f2afa11564f8c05/implies/3aec3e1c32b146c7b010a5de30a38a12 => generated 530 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:57.091858 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b75e75-bace-4ed2-bdf6-db01c4120082 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:57.102187 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b75e75-bace-4ed2-bdf6-db01c4120082 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:57.186696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c72d0f-59a3-446e-b01c-338718700042 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:57.187428 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c72d0f-59a3-446e-b01c-338718700042 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:57.187778 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c72d0f-59a3-446e-b01c-338718700042 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:57.188585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c72d0f-59a3-446e-b01c-338718700042 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/3ea70c93d5e5454d8f2afa11564f8c05/implies/60a015264f4c412da4288d651404c30f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:57.191801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c72d0f-59a3-446e-b01c-338718700042 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=3ea70c93d5e5454d8f2afa11564f8c05, implied_role_id=60a015264f4c412da4288d651404c30f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:57.193604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c72d0f-59a3-446e-b01c-338718700042 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:57.195179 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:57.230123 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2207/4471] 10.222.0.33 () {60 vars in 1363 bytes} [Sat Aug 6 21:09:57 2022] PUT /identity/v3/roles/3ea70c93d5e5454d8f2afa11564f8c05/implies/60a015264f4c412da4288d651404c30f => generated 525 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:09:57.234901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0604e6-d9c8-4b2d-a7ef-1a5c07e362d7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:57.250997 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0604e6-d9c8-4b2d-a7ef-1a5c07e362d7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:57.332868 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c72d0f-59a3-446e-b01c-338718700042 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:57.337173 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c7c72d0f-59a3-446e-b01c-338718700042 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:57.439749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bb989-d2d9-4b62-a915-e4c964d24a0c tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:57.440404 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bb989-d2d9-4b62-a915-e4c964d24a0c tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:57.440688 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bb989-d2d9-4b62-a915-e4c964d24a0c tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:57.440966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bb989-d2d9-4b62-a915-e4c964d24a0c tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/60a015264f4c412da4288d651404c30f/implies/3ea70c93d5e5454d8f2afa11564f8c05` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:57.442696 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44bb989-d2d9-4b62-a915-e4c964d24a0c tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=60a015264f4c412da4288d651404c30f, implied_role_id=3ea70c93d5e5454d8f2afa11564f8c05)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:57.444377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44bb989-d2d9-4b62-a915-e4c964d24a0c tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:57.486357 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-f44bb989-d2d9-4b62-a915-e4c964d24a0c tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] 3ea70c93d5e5454d8f2afa11564f8c05 cannot be an implied roles.: keystone.exception.InvalidImpliedRole: 3ea70c93d5e5454d8f2afa11564f8c05 cannot be an implied roles. Aug 06 21:09:57.486357 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:09:57.486357 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:09:57.486357 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:09:57.486357 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:09:57.486357 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:09:57.486357 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:09:57.486357 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:09:57.486357 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:09:57.486357 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:09:57.486357 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:09:57.486357 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:09:57.486357 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Aug 06 21:09:57.486357 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Aug 06 21:09:57.488161 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:09:57.488161 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:09:57.488161 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Aug 06 21:09:57.488161 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Aug 06 21:09:57.488161 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: 3ea70c93d5e5454d8f2afa11564f8c05 cannot be an implied roles. Aug 06 21:09:57.488161 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:09:57.501920 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2265/4472] 10.222.0.33 () {60 vars in 1363 bytes} [Sat Aug 6 21:09:57 2022] PUT /identity/v3/roles/60a015264f4c412da4288d651404c30f/implies/3ea70c93d5e5454d8f2afa11564f8c05 => generated 116 bytes in 264 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:09:57.502712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bb989-d2d9-4b62-a915-e4c964d24a0c tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:57.512926 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f44bb989-d2d9-4b62-a915-e4c964d24a0c tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:57.526640 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:57.549167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c72d0f-59a3-446e-b01c-338718700042 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:57.556760 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd2015-fd6a-4b3c-802d-447ad619e6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:57.557420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd2015-fd6a-4b3c-802d-447ad619e6d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:57.557751 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd2015-fd6a-4b3c-802d-447ad619e6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:57.558037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd2015-fd6a-4b3c-802d-447ad619e6d7 admin admin] PATH_INFO: `/v3/projects/ae7a24bfa0bd4684bb0871f2d814c040` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:57.571430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd2015-fd6a-4b3c-802d-447ad619e6d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae7a24bfa0bd4684bb0871f2d814c040)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:57.573807 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd2015-fd6a-4b3c-802d-447ad619e6d7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:57.672021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ecfd2015-fd6a-4b3c-802d-447ad619e6d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae7a24bfa0bd4684bb0871f2d814c040', 'request_id': 'req-ecfd2015-fd6a-4b3c-802d-447ad619e6d7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:57.682262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ecfd2015-fd6a-4b3c-802d-447ad619e6d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae7a24bfa0bd4684bb0871f2d814c040', 'request_id': 'req-ecfd2015-fd6a-4b3c-802d-447ad619e6d7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:57.684655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bb989-d2d9-4b62-a915-e4c964d24a0c tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:57.696568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ecfd2015-fd6a-4b3c-802d-447ad619e6d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae7a24bfa0bd4684bb0871f2d814c040', 'request_id': 'req-ecfd2015-fd6a-4b3c-802d-447ad619e6d7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:57.722527 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ecfd2015-fd6a-4b3c-802d-447ad619e6d7 admin admin] The token cache is being invalidate because project ae7a24bfa0bd4684bb0871f2d814c040 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:09:57.724910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ecfd2015-fd6a-4b3c-802d-447ad619e6d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:57.725149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ecfd2015-fd6a-4b3c-802d-447ad619e6d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:57.730104 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2208/4473] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:09:57 2022] DELETE /identity/v3/projects/ae7a24bfa0bd4684bb0871f2d814c040 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:57.732087 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd2015-fd6a-4b3c-802d-447ad619e6d7 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:57.739857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ecfd2015-fd6a-4b3c-802d-447ad619e6d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:57.827476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a66ca-62bb-4b3a-a0f1-83e082e00415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:57.828488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a66ca-62bb-4b3a-a0f1-83e082e00415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:57.828952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a66ca-62bb-4b3a-a0f1-83e082e00415 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:57.829959 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a66ca-62bb-4b3a-a0f1-83e082e00415 admin admin] PATH_INFO: `/v3/users/469d18e4c7db4b0d989f7c5b72e744f7` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:57.834814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd2015-fd6a-4b3c-802d-447ad619e6d7 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:57.835889 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859a66ca-62bb-4b3a-a0f1-83e082e00415 admin admin] RBAC: Authorizing `identity:delete_user(user_id=469d18e4c7db4b0d989f7c5b72e744f7)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:57.838834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859a66ca-62bb-4b3a-a0f1-83e082e00415 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:57.840028 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a70e8-a18b-4487-ad8e-28a3bc57dc58 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:57.840950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a70e8-a18b-4487-ad8e-28a3bc57dc58 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:57.841373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a70e8-a18b-4487-ad8e-28a3bc57dc58 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:57.841733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a70e8-a18b-4487-ad8e-28a3bc57dc58 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/3ea70c93d5e5454d8f2afa11564f8c05/implies/60a015264f4c412da4288d651404c30f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:57.844901 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a70e8-a18b-4487-ad8e-28a3bc57dc58 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=3ea70c93d5e5454d8f2afa11564f8c05, implied_role_id=60a015264f4c412da4288d651404c30f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:57.846426 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a70e8-a18b-4487-ad8e-28a3bc57dc58 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:57.863575 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2209/4474] 10.222.0.33 () {58 vars in 1347 bytes} [Sat Aug 6 21:09:57 2022] DELETE /identity/v3/roles/3ea70c93d5e5454d8f2afa11564f8c05/implies/60a015264f4c412da4288d651404c30f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:57.865760 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dcf747-dcaf-4212-82e8-4ed9aabb6cd9 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:57.866606 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dcf747-dcaf-4212-82e8-4ed9aabb6cd9 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:57.867060 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dcf747-dcaf-4212-82e8-4ed9aabb6cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:57.889483 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:57.897650 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-00dcf747-dcaf-4212-82e8-4ed9aabb6cd9 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:57.899725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-00dcf747-dcaf-4212-82e8-4ed9aabb6cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:57.948378 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-859a66ca-62bb-4b3a-a0f1-83e082e00415 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '469d18e4c7db4b0d989f7c5b72e744f7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:57.977626 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-859a66ca-62bb-4b3a-a0f1-83e082e00415 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '469d18e4c7db4b0d989f7c5b72e744f7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:57.978418 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-859a66ca-62bb-4b3a-a0f1-83e082e00415 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '469d18e4c7db4b0d989f7c5b72e744f7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:57.979364 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-859a66ca-62bb-4b3a-a0f1-83e082e00415 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '469d18e4c7db4b0d989f7c5b72e744f7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:57.993162 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-859a66ca-62bb-4b3a-a0f1-83e082e00415 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '469d18e4c7db4b0d989f7c5b72e744f7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:58.042825 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2266/4475] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:09:57 2022] DELETE /identity/v3/users/469d18e4c7db4b0d989f7c5b72e744f7 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:58.045171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a66ca-62bb-4b3a-a0f1-83e082e00415 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:58.049447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-859a66ca-62bb-4b3a-a0f1-83e082e00415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:58.071647 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2210/4476] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:58.077446 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8d48e-0fda-4ad9-8d44-8fe5bc4761f0 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:58.078057 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8d48e-0fda-4ad9-8d44-8fe5bc4761f0 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:58.078959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8d48e-0fda-4ad9-8d44-8fe5bc4761f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:58.145946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-01a8d48e-0fda-4ad9-8d44-8fe5bc4761f0 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:58.148567 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-01a8d48e-0fda-4ad9-8d44-8fe5bc4761f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:58.167194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:58.234917 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a66ca-62bb-4b3a-a0f1-83e082e00415 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:58.248459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9c0a7-662a-49d5-a4b6-73ad4ea28a75 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:58.249736 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9c0a7-662a-49d5-a4b6-73ad4ea28a75 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:58.252390 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9c0a7-662a-49d5-a4b6-73ad4ea28a75 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:58.253285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9c0a7-662a-49d5-a4b6-73ad4ea28a75 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/3ea70c93d5e5454d8f2afa11564f8c05/implies/3aec3e1c32b146c7b010a5de30a38a12` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:58.260816 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9c0a7-662a-49d5-a4b6-73ad4ea28a75 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=3ea70c93d5e5454d8f2afa11564f8c05, implied_role_id=3aec3e1c32b146c7b010a5de30a38a12)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:58.262371 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-25e9c0a7-662a-49d5-a4b6-73ad4ea28a75 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:58.262371 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:09:58.262371 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:09:58.266126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9c0a7-662a-49d5-a4b6-73ad4ea28a75 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:58.289625 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2267/4477] 10.222.0.33 () {58 vars in 1347 bytes} [Sat Aug 6 21:09:58 2022] DELETE /identity/v3/roles/3ea70c93d5e5454d8f2afa11564f8c05/implies/3aec3e1c32b146c7b010a5de30a38a12 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:58.294409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9c0a7-662a-49d5-a4b6-73ad4ea28a75 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:58.337576 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2211/4478] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:58.347423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8d48e-0fda-4ad9-8d44-8fe5bc4761f0 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:58.385538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8d48e-0fda-4ad9-8d44-8fe5bc4761f0 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:58.486978 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9c0a7-662a-49d5-a4b6-73ad4ea28a75 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:58.500820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905984a-7965-423c-9520-2816b6e915c3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:58.503456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905984a-7965-423c-9520-2816b6e915c3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:58.507168 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905984a-7965-423c-9520-2816b6e915c3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:58.508376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905984a-7965-423c-9520-2816b6e915c3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/3aec3e1c32b146c7b010a5de30a38a12` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:58.514368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905984a-7965-423c-9520-2816b6e915c3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=3aec3e1c32b146c7b010a5de30a38a12)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:58.520199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905984a-7965-423c-9520-2816b6e915c3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:58.560432 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f5ed3-9060-4bcb-b93f-086b791cb6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:58.561548 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f5ed3-9060-4bcb-b93f-086b791cb6b4 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:58.562050 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f5ed3-9060-4bcb-b93f-086b791cb6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:58.562530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f5ed3-9060-4bcb-b93f-086b791cb6b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:58.569979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f5ed3-9060-4bcb-b93f-086b791cb6b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:09:58.570347 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f5ed3-9060-4bcb-b93f-086b791cb6b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:58.576225 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f5ed3-9060-4bcb-b93f-086b791cb6b4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:58.611884 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2212/4479] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:09:58.618690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f5ed3-9060-4bcb-b93f-086b791cb6b4 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:58.625041 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3c8f5ed3-9060-4bcb-b93f-086b791cb6b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:58.629372 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9905984a-7965-423c-9520-2816b6e915c3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invalidating the token cache because role 3aec3e1c32b146c7b010a5de30a38a12 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:09:58.630858 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9905984a-7965-423c-9520-2816b6e915c3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:58.633354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9905984a-7965-423c-9520-2816b6e915c3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:58.640616 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2268/4480] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:09:58 2022] DELETE /identity/v3/roles/3aec3e1c32b146c7b010a5de30a38a12 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:09:58.644771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905984a-7965-423c-9520-2816b6e915c3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:58.655577 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9905984a-7965-423c-9520-2816b6e915c3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:58.661257 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f5ed3-9060-4bcb-b93f-086b791cb6b4 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:58.778825 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:58.800704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf0ba8-07ff-4d41-86bb-86646ce8a309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:58.802027 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf0ba8-07ff-4d41-86bb-86646ce8a309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:58.802304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf0ba8-07ff-4d41-86bb-86646ce8a309 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:58.802600 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf0ba8-07ff-4d41-86bb-86646ce8a309 admin admin] PATH_INFO: `/v3/projects/3389d5492b224ef9963f6305139ae9b8` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:58.803998 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf0ba8-07ff-4d41-86bb-86646ce8a309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3389d5492b224ef9963f6305139ae9b8)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:58.806437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf0ba8-07ff-4d41-86bb-86646ce8a309 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:58.863593 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905984a-7965-423c-9520-2816b6e915c3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:58.893192 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5204b5-faa4-4e3a-93d6-91763bd1f488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:58.894370 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5204b5-faa4-4e3a-93d6-91763bd1f488 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:58.895711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5204b5-faa4-4e3a-93d6-91763bd1f488 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:58.896575 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5204b5-faa4-4e3a-93d6-91763bd1f488 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:58.897756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5204b5-faa4-4e3a-93d6-91763bd1f488 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:58.900961 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5204b5-faa4-4e3a-93d6-91763bd1f488 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:58.911202 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6dbf0ba8-07ff-4d41-86bb-86646ce8a309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3389d5492b224ef9963f6305139ae9b8', 'request_id': 'req-6dbf0ba8-07ff-4d41-86bb-86646ce8a309'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:58.923996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6dbf0ba8-07ff-4d41-86bb-86646ce8a309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3389d5492b224ef9963f6305139ae9b8', 'request_id': 'req-6dbf0ba8-07ff-4d41-86bb-86646ce8a309'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:58.945407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6dbf0ba8-07ff-4d41-86bb-86646ce8a309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3389d5492b224ef9963f6305139ae9b8', 'request_id': 'req-6dbf0ba8-07ff-4d41-86bb-86646ce8a309'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:58.986585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6dbf0ba8-07ff-4d41-86bb-86646ce8a309 admin admin] The token cache is being invalidate because project 3389d5492b224ef9963f6305139ae9b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:09:58.986585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6dbf0ba8-07ff-4d41-86bb-86646ce8a309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:58.986585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6dbf0ba8-07ff-4d41-86bb-86646ce8a309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:58.986585 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2213/4481] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:09:58 2022] DELETE /identity/v3/projects/3389d5492b224ef9963f6305139ae9b8 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:58.986585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf0ba8-07ff-4d41-86bb-86646ce8a309 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:58.987679 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2269/4482] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:09:58 2022] POST /identity/v3/projects => generated 375 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:58.987679 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5204b5-faa4-4e3a-93d6-91763bd1f488 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:58.987858 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6dbf0ba8-07ff-4d41-86bb-86646ce8a309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:58.992869 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4c5204b5-faa4-4e3a-93d6-91763bd1f488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:59.060857 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:59.097757 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf0ba8-07ff-4d41-86bb-86646ce8a309 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:59.176484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5204b5-faa4-4e3a-93d6-91763bd1f488 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:59.192846 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4ed21-0274-4106-9bf0-1c700d2e97e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:59.193801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4ed21-0274-4106-9bf0-1c700d2e97e4 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:59.194277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4ed21-0274-4106-9bf0-1c700d2e97e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:59.194909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4ed21-0274-4106-9bf0-1c700d2e97e4 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:59.196307 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb4ed21-0274-4106-9bf0-1c700d2e97e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:59.200504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb4ed21-0274-4106-9bf0-1c700d2e97e4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:59.202853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01ea67-f373-4006-bbad-9947892045fa tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:59.203516 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01ea67-f373-4006-bbad-9947892045fa tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:59.203802 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01ea67-f373-4006-bbad-9947892045fa tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:59.204227 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01ea67-f373-4006-bbad-9947892045fa tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/domains/e103285063a44a3cbeb778715f5b1d54` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:59.218036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc01ea67-f373-4006-bbad-9947892045fa tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e103285063a44a3cbeb778715f5b1d54)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:59.219119 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-bc01ea67-f373-4006-bbad-9947892045fa tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:59.219119 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:09:59.219119 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:09:59.220487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc01ea67-f373-4006-bbad-9947892045fa tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:59.246736 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2270/4483] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:09:58 2022] POST /identity/v3/users => generated 288 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:09:59.252127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaad00b-41c2-4a78-94b4-04fba0843eb2 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:59.252775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:59.255255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaad00b-41c2-4a78-94b4-04fba0843eb2 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:59.255413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaad00b-41c2-4a78-94b4-04fba0843eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:59.286718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-cbaad00b-41c2-4a78-94b4-04fba0843eb2 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:59.287944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-cbaad00b-41c2-4a78-94b4-04fba0843eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:59.300335 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bc01ea67-f373-4006-bbad-9947892045fa tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e103285063a44a3cbeb778715f5b1d54'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:59.301647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bc01ea67-f373-4006-bbad-9947892045fa tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e103285063a44a3cbeb778715f5b1d54'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:59.310696 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2271/4484] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:59.310696 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaad00b-41c2-4a78-94b4-04fba0843eb2 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:59.335653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaad00b-41c2-4a78-94b4-04fba0843eb2 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:59.381163 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bc01ea67-f373-4006-bbad-9947892045fa tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e103285063a44a3cbeb778715f5b1d54'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:59.382854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bc01ea67-f373-4006-bbad-9947892045fa tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e103285063a44a3cbeb778715f5b1d54'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:59.394137 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2214/4485] 10.222.0.33 () {60 vars in 1249 bytes} [Sat Aug 6 21:09:58 2022] PATCH /identity/v3/domains/e103285063a44a3cbeb778715f5b1d54 => generated 277 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:09:59.395805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524fc27-1f87-44e3-ad33-ea165c360c95 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:59.399067 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524fc27-1f87-44e3-ad33-ea165c360c95 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:59.399067 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524fc27-1f87-44e3-ad33-ea165c360c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:59.456259 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-5524fc27-1f87-44e3-ad33-ea165c360c95 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:09:59.462838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5524fc27-1f87-44e3-ad33-ea165c360c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:59.487666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f86619-311a-4da7-8076-8b25922795f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:59.489360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f86619-311a-4da7-8076-8b25922795f0 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:59.489836 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f86619-311a-4da7-8076-8b25922795f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:59.490395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f86619-311a-4da7-8076-8b25922795f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:59.491289 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f86619-311a-4da7-8076-8b25922795f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:59.493502 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f86619-311a-4da7-8076-8b25922795f0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:59.511401 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2272/4486] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:09:59 2022] GET /identity/v3/roles => generated 2323 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:09:59.512984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f86619-311a-4da7-8076-8b25922795f0 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:59.515428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f6f86619-311a-4da7-8076-8b25922795f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:59.562803 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2215/4487] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:09:59.562803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524fc27-1f87-44e3-ad33-ea165c360c95 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:59.562803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5524fc27-1f87-44e3-ad33-ea165c360c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:09:59.577804 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524fc27-1f87-44e3-ad33-ea165c360c95 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:59.583496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f6f8e-b034-42e9-b1ee-27a080cebfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:59.584370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f6f8e-b034-42e9-b1ee-27a080cebfd8 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:59.584653 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f6f8e-b034-42e9-b1ee-27a080cebfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:59.585057 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f6f8e-b034-42e9-b1ee-27a080cebfd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:59.585842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f6f8e-b034-42e9-b1ee-27a080cebfd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:59.587471 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f6f8e-b034-42e9-b1ee-27a080cebfd8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:59.610117 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2216/4488] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:09:59 2022] GET /identity/v3/roles => generated 2323 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:09:59.612402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f6f8e-b034-42e9-b1ee-27a080cebfd8 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:59.614135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f86619-311a-4da7-8076-8b25922795f0 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:59.620520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774928c0-ea7d-41a9-b775-e05403a7f0e4 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:59.621497 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774928c0-ea7d-41a9-b775-e05403a7f0e4 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:59.622280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774928c0-ea7d-41a9-b775-e05403a7f0e4 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:59.623081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774928c0-ea7d-41a9-b775-e05403a7f0e4 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/domains/e103285063a44a3cbeb778715f5b1d54` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:59.629600 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f6f8e-b034-42e9-b1ee-27a080cebfd8 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:59.639822 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774928c0-ea7d-41a9-b775-e05403a7f0e4 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e103285063a44a3cbeb778715f5b1d54)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:59.641483 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-774928c0-ea7d-41a9-b775-e05403a7f0e4 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:09:59.641483 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:09:59.641483 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:09:59.642967 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774928c0-ea7d-41a9-b775-e05403a7f0e4 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:59.655965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd31540-ef3c-498d-b59d-ebd14a9cc222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:59.656784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd31540-ef3c-498d-b59d-ebd14a9cc222 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:59.657050 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd31540-ef3c-498d-b59d-ebd14a9cc222 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:59.657235 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd31540-ef3c-498d-b59d-ebd14a9cc222 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:59.659248 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd31540-ef3c-498d-b59d-ebd14a9cc222 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:09:59.659629 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd31540-ef3c-498d-b59d-ebd14a9cc222 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:59.662635 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd31540-ef3c-498d-b59d-ebd14a9cc222 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:59.713847 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2217/4489] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:09:59.715033 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd31540-ef3c-498d-b59d-ebd14a9cc222 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:59.718870 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-774928c0-ea7d-41a9-b775-e05403a7f0e4 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e103285063a44a3cbeb778715f5b1d54'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:59.742091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd31540-ef3c-498d-b59d-ebd14a9cc222 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:09:59.749635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-774928c0-ea7d-41a9-b775-e05403a7f0e4 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e103285063a44a3cbeb778715f5b1d54'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:59.753210 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223eb93d-eb14-4edd-a05b-c9ce61f7cf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:09:59.753895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223eb93d-eb14-4edd-a05b-c9ce61f7cf32 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:59.754168 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223eb93d-eb14-4edd-a05b-c9ce61f7cf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:59.754872 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223eb93d-eb14-4edd-a05b-c9ce61f7cf32 admin admin] PATH_INFO: `/v3/projects/4e89e3a691344a5c80cff594dfa57437/users/9b16de3d5abf48a3a67e3c00fbca370c/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:09:59.767787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:59.793850 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223eb93d-eb14-4edd-a05b-c9ce61f7cf32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e89e3a691344a5c80cff594dfa57437, user_id=9b16de3d5abf48a3a67e3c00fbca370c, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:09:59.797585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223eb93d-eb14-4edd-a05b-c9ce61f7cf32 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:09:59.828847 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2218/4490] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:09:59 2022] PUT /identity/v3/projects/4e89e3a691344a5c80cff594dfa57437/users/9b16de3d5abf48a3a67e3c00fbca370c/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:59.829776 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223eb93d-eb14-4edd-a05b-c9ce61f7cf32 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:09:59.885502 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-774928c0-ea7d-41a9-b775-e05403a7f0e4 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e103285063a44a3cbeb778715f5b1d54', 'request_id': 'req-774928c0-ea7d-41a9-b775-e05403a7f0e4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:59.892856 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-774928c0-ea7d-41a9-b775-e05403a7f0e4 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e103285063a44a3cbeb778715f5b1d54', 'request_id': 'req-774928c0-ea7d-41a9-b775-e05403a7f0e4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:59.910326 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-774928c0-ea7d-41a9-b775-e05403a7f0e4 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e103285063a44a3cbeb778715f5b1d54', 'request_id': 'req-774928c0-ea7d-41a9-b775-e05403a7f0e4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:59.933671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-774928c0-ea7d-41a9-b775-e05403a7f0e4 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] The token cache is being invalidate because project e103285063a44a3cbeb778715f5b1d54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:09:59.933968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-774928c0-ea7d-41a9-b775-e05403a7f0e4 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:59.935114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-774928c0-ea7d-41a9-b775-e05403a7f0e4 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:59.970003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-774928c0-ea7d-41a9-b775-e05403a7f0e4 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e103285063a44a3cbeb778715f5b1d54', 'request_id': 'req-774928c0-ea7d-41a9-b775-e05403a7f0e4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:59.980005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-774928c0-ea7d-41a9-b775-e05403a7f0e4 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e103285063a44a3cbeb778715f5b1d54', 'request_id': 'req-774928c0-ea7d-41a9-b775-e05403a7f0e4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:59.980781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-774928c0-ea7d-41a9-b775-e05403a7f0e4 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e103285063a44a3cbeb778715f5b1d54', 'request_id': 'req-774928c0-ea7d-41a9-b775-e05403a7f0e4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:09:59.994999 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2273/4491] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:09:59 2022] DELETE /identity/v3/domains/e103285063a44a3cbeb778715f5b1d54 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:09:59.998381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21c018-bd32-46b3-9e80-18d5b1179a85 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:09:59.998381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21c018-bd32-46b3-9e80-18d5b1179a85 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:09:59.998381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21c018-bd32-46b3-9e80-18d5b1179a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:00.034043 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223eb93d-eb14-4edd-a05b-c9ce61f7cf32 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:00.087830 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-0c21c018-bd32-46b3-9e80-18d5b1179a85 None None] MFA Rules not processed for user `9b16de3d5abf48a3a67e3c00fbca370c`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:00.090368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0c21c018-bd32-46b3-9e80-18d5b1179a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:00.126352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:00.199321 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c060b55-45e9-44d8-9efb-efa39e73c6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:00.200516 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c060b55-45e9-44d8-9efb-efa39e73c6b4 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:00.201865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c060b55-45e9-44d8-9efb-efa39e73c6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:00.202669 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c060b55-45e9-44d8-9efb-efa39e73c6b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:00.205270 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c060b55-45e9-44d8-9efb-efa39e73c6b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:00.210664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c060b55-45e9-44d8-9efb-efa39e73c6b4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:00.226887 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2274/4492] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:09:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:00.227920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21c018-bd32-46b3-9e80-18d5b1179a85 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:00.233425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0c21c018-bd32-46b3-9e80-18d5b1179a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:00.272364 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2219/4493] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:09:59 2022] POST /identity/v3/projects => generated 379 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:00.273370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c060b55-45e9-44d8-9efb-efa39e73c6b4 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:00.278105 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0c060b55-45e9-44d8-9efb-efa39e73c6b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:00.416065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21c018-bd32-46b3-9e80-18d5b1179a85 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:00.422842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c060b55-45e9-44d8-9efb-efa39e73c6b4 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:00.430436 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf0332-62c1-4302-8aa1-dd5e6a150db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:00.431678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf0332-62c1-4302-8aa1-dd5e6a150db4 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:00.432158 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf0332-62c1-4302-8aa1-dd5e6a150db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:00.432598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf0332-62c1-4302-8aa1-dd5e6a150db4 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:00.433685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf0332-62c1-4302-8aa1-dd5e6a150db4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:00.437519 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf0332-62c1-4302-8aa1-dd5e6a150db4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:00.442611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:00.499842 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2220/4494] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:10:00 2022] POST /identity/v3/projects => generated 371 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:00.500651 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf0332-62c1-4302-8aa1-dd5e6a150db4 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:00.506668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9edf0332-62c1-4302-8aa1-dd5e6a150db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:00.541888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb99086-467e-485b-b4d1-cc22474996f9 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:00.542690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb99086-467e-485b-b4d1-cc22474996f9 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:00.543111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb99086-467e-485b-b4d1-cc22474996f9 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:00.544070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb99086-467e-485b-b4d1-cc22474996f9 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/3ea70c93d5e5454d8f2afa11564f8c05/implies/93ba2cdd71374857a94f7f25695009c0` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:00.546495 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb99086-467e-485b-b4d1-cc22474996f9 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=3ea70c93d5e5454d8f2afa11564f8c05, implied_role_id=93ba2cdd71374857a94f7f25695009c0)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:00.548712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb99086-467e-485b-b4d1-cc22474996f9 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:00.568837 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2275/4495] 10.222.0.33 () {58 vars in 1347 bytes} [Sat Aug 6 21:10:00 2022] DELETE /identity/v3/roles/3ea70c93d5e5454d8f2afa11564f8c05/implies/93ba2cdd71374857a94f7f25695009c0 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:00.568837 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb99086-467e-485b-b4d1-cc22474996f9 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:00.640462 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf0332-62c1-4302-8aa1-dd5e6a150db4 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:00.648262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc3146-c971-4874-a348-59fccdf509dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:00.648971 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc3146-c971-4874-a348-59fccdf509dc admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:00.649249 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc3146-c971-4874-a348-59fccdf509dc admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:00.649520 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc3146-c971-4874-a348-59fccdf509dc admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:00.650192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc3146-c971-4874-a348-59fccdf509dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:00.652151 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc3146-c971-4874-a348-59fccdf509dc admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:00.653857 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb99086-467e-485b-b4d1-cc22474996f9 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:00.659757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11eb02-1d68-42bc-b67b-f299dcfbfab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:00.660660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11eb02-1d68-42bc-b67b-f299dcfbfab4 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:00.661086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11eb02-1d68-42bc-b67b-f299dcfbfab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:00.661565 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11eb02-1d68-42bc-b67b-f299dcfbfab4 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:00.662329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a11eb02-1d68-42bc-b67b-f299dcfbfab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:00.668607 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a11eb02-1d68-42bc-b67b-f299dcfbfab4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:00.694465 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2276/4496] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:10:00 2022] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:00.695418 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11eb02-1d68-42bc-b67b-f299dcfbfab4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:00.714702 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2221/4497] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:10:00 2022] POST /identity/v3/users => generated 290 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:00.714702 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc3146-c971-4874-a348-59fccdf509dc admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:00.725359 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc3146-c971-4874-a348-59fccdf509dc admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:00.732259 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322d6ac-627d-4f31-8491-9089d61d8065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:00.733279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322d6ac-627d-4f31-8491-9089d61d8065 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:00.733675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322d6ac-627d-4f31-8491-9089d61d8065 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:00.734446 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322d6ac-627d-4f31-8491-9089d61d8065 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:00.735382 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5322d6ac-627d-4f31-8491-9089d61d8065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:00.737338 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5322d6ac-627d-4f31-8491-9089d61d8065 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:00.753670 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2222/4498] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:00 2022] GET /identity/v3/roles => generated 2323 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:00.754831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322d6ac-627d-4f31-8491-9089d61d8065 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:00.770100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322d6ac-627d-4f31-8491-9089d61d8065 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:00.780598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac2b4c-fc82-4e92-b7e3-1a63ccbf00b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:00.782028 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac2b4c-fc82-4e92-b7e3-1a63ccbf00b4 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:00.783443 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac2b4c-fc82-4e92-b7e3-1a63ccbf00b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:00.783841 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac2b4c-fc82-4e92-b7e3-1a63ccbf00b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:00.786447 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac2b4c-fc82-4e92-b7e3-1a63ccbf00b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:00.791268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac2b4c-fc82-4e92-b7e3-1a63ccbf00b4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:00.840556 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2223/4499] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:00 2022] GET /identity/v3/roles => generated 2323 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:00.841642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac2b4c-fc82-4e92-b7e3-1a63ccbf00b4 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:00.847339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11eb02-1d68-42bc-b67b-f299dcfbfab4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:00.855992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b637e-5f9f-40cb-a80b-04bd90450033 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:00.856911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b637e-5f9f-40cb-a80b-04bd90450033 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:00.857324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b637e-5f9f-40cb-a80b-04bd90450033 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:00.858752 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b637e-5f9f-40cb-a80b-04bd90450033 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/93ba2cdd71374857a94f7f25695009c0` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:00.860289 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b637e-5f9f-40cb-a80b-04bd90450033 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=93ba2cdd71374857a94f7f25695009c0)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:00.863825 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac2b4c-fc82-4e92-b7e3-1a63ccbf00b4 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:00.864413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b637e-5f9f-40cb-a80b-04bd90450033 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:00.882309 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e3f32-6183-4c8c-a057-2d464a6abd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:00.882525 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e3f32-6183-4c8c-a057-2d464a6abd3e admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:00.882834 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e3f32-6183-4c8c-a057-2d464a6abd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:00.883112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e3f32-6183-4c8c-a057-2d464a6abd3e admin admin] PATH_INFO: `/v3/projects/b80ca61c71974da3a09673e49155f437/users/62040644427440c0a66defca92a38646/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:00.912263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:00.922046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e12b637e-5f9f-40cb-a80b-04bd90450033 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invalidating the token cache because role 93ba2cdd71374857a94f7f25695009c0 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:00.922304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e3f32-6183-4c8c-a057-2d464a6abd3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b80ca61c71974da3a09673e49155f437, user_id=62040644427440c0a66defca92a38646, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:00.922879 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e12b637e-5f9f-40cb-a80b-04bd90450033 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:00.926297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e12b637e-5f9f-40cb-a80b-04bd90450033 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:00.929464 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2277/4500] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:00 2022] DELETE /identity/v3/roles/93ba2cdd71374857a94f7f25695009c0 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:00.930842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b637e-5f9f-40cb-a80b-04bd90450033 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:00.932300 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e3f32-6183-4c8c-a057-2d464a6abd3e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:00.932879 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e12b637e-5f9f-40cb-a80b-04bd90450033 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:00.940124 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:00.960671 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2224/4501] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:10:00 2022] PUT /identity/v3/projects/b80ca61c71974da3a09673e49155f437/users/62040644427440c0a66defca92a38646/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:00.960671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e3f32-6183-4c8c-a057-2d464a6abd3e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:00.962447 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-149e3f32-6183-4c8c-a057-2d464a6abd3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:01.120394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b637e-5f9f-40cb-a80b-04bd90450033 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:01.144260 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e3f32-6183-4c8c-a057-2d464a6abd3e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:01.150459 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa0a5c-91f6-4921-8ad2-a1d4fa8861a5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:01.151181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa0a5c-91f6-4921-8ad2-a1d4fa8861a5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:01.151560 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa0a5c-91f6-4921-8ad2-a1d4fa8861a5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:01.151868 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa0a5c-91f6-4921-8ad2-a1d4fa8861a5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/3ea70c93d5e5454d8f2afa11564f8c05` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:01.153397 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa0a5c-91f6-4921-8ad2-a1d4fa8861a5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=3ea70c93d5e5454d8f2afa11564f8c05)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:01.154683 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-6efa0a5c-91f6-4921-8ad2-a1d4fa8861a5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:10:01.154683 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:10:01.154683 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:10:01.157113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa0a5c-91f6-4921-8ad2-a1d4fa8861a5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:01.224541 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda303a-a9d0-4728-b242-880642abc3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:01.225203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda303a-a9d0-4728-b242-880642abc3f3 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:01.225479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda303a-a9d0-4728-b242-880642abc3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:01.225900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda303a-a9d0-4728-b242-880642abc3f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:01.226700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cda303a-a9d0-4728-b242-880642abc3f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:01.228770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cda303a-a9d0-4728-b242-880642abc3f3 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:01.234932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6efa0a5c-91f6-4921-8ad2-a1d4fa8861a5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invalidating the token cache because role 3ea70c93d5e5454d8f2afa11564f8c05 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:01.237840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6efa0a5c-91f6-4921-8ad2-a1d4fa8861a5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:01.240587 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6efa0a5c-91f6-4921-8ad2-a1d4fa8861a5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:01.245097 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2225/4502] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:00 2022] DELETE /identity/v3/roles/3ea70c93d5e5454d8f2afa11564f8c05 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:01.245889 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2278/4503] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:00 2022] GET /identity/v3/roles => generated 2323 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:01.247086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda303a-a9d0-4728-b242-880642abc3f3 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:01.248462 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa0a5c-91f6-4921-8ad2-a1d4fa8861a5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:01.252709 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6efa0a5c-91f6-4921-8ad2-a1d4fa8861a5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:01.252856 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6cda303a-a9d0-4728-b242-880642abc3f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:01.306094 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda303a-a9d0-4728-b242-880642abc3f3 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:01.428256 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa0a5c-91f6-4921-8ad2-a1d4fa8861a5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:01.438263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c757b8-e494-4d88-b354-dd8c89238d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:01.438263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c757b8-e494-4d88-b354-dd8c89238d09 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:01.438263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c757b8-e494-4d88-b354-dd8c89238d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:01.438263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c757b8-e494-4d88-b354-dd8c89238d09 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:01.439318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c757b8-e494-4d88-b354-dd8c89238d09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:01.444779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c757b8-e494-4d88-b354-dd8c89238d09 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:01.475870 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2226/4504] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:01 2022] GET /identity/v3/roles => generated 2323 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:01.477878 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c757b8-e494-4d88-b354-dd8c89238d09 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:01.484465 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c3c757b8-e494-4d88-b354-dd8c89238d09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:01.514062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ab9e4-aa44-4ed2-af86-ebc89a882ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:01.514969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ab9e4-aa44-4ed2-af86-ebc89a882ff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:01.515317 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ab9e4-aa44-4ed2-af86-ebc89a882ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:01.515778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ab9e4-aa44-4ed2-af86-ebc89a882ff6 admin admin] PATH_INFO: `/v3/projects/734f4706c86040eba82cde45971d4c5b/users/17004e771b6a47cb88e8aa31e197b25a/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:01.545315 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ab9e4-aa44-4ed2-af86-ebc89a882ff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=734f4706c86040eba82cde45971d4c5b, user_id=17004e771b6a47cb88e8aa31e197b25a, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:01.561082 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ab9e4-aa44-4ed2-af86-ebc89a882ff6 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:01.594478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:01.604302 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2279/4505] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:10:01 2022] PUT /identity/v3/projects/734f4706c86040eba82cde45971d4c5b/users/17004e771b6a47cb88e8aa31e197b25a/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:01.606477 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ab9e4-aa44-4ed2-af86-ebc89a882ff6 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:01.621415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c757b8-e494-4d88-b354-dd8c89238d09 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:01.680782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:01.714965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888dad5b-f43c-4045-af79-28a70ff772a8 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:01.716612 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dad5b-f43c-4045-af79-28a70ff772a8 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:01.716612 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dad5b-f43c-4045-af79-28a70ff772a8 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:01.716612 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dad5b-f43c-4045-af79-28a70ff772a8 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/4667ef3b3c2f41edb6a21f228ae5d03f/implies/aa0eb96c9709455487fe75fb882b1253` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:01.720124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888dad5b-f43c-4045-af79-28a70ff772a8 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=4667ef3b3c2f41edb6a21f228ae5d03f, implied_role_id=aa0eb96c9709455487fe75fb882b1253)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:01.723308 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888dad5b-f43c-4045-af79-28a70ff772a8 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:01.757569 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ab9e4-aa44-4ed2-af86-ebc89a882ff6 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:01.762324 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2227/4506] 10.222.0.33 () {60 vars in 1363 bytes} [Sat Aug 6 21:10:01 2022] PUT /identity/v3/roles/4667ef3b3c2f41edb6a21f228ae5d03f/implies/aa0eb96c9709455487fe75fb882b1253 => generated 520 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:01.763667 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0251b8c-6ac3-42da-a361-458d9e9baf62 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:01.763960 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0251b8c-6ac3-42da-a361-458d9e9baf62 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:01.764241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0251b8c-6ac3-42da-a361-458d9e9baf62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:01.788064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f0251b8c-6ac3-42da-a361-458d9e9baf62 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:01.789302 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f0251b8c-6ac3-42da-a361-458d9e9baf62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:01.851719 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b097439-6e18-44e0-a783-679d6ab8731e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:01.853007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b097439-6e18-44e0-a783-679d6ab8731e admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:01.853724 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b097439-6e18-44e0-a783-679d6ab8731e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:01.854287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b097439-6e18-44e0-a783-679d6ab8731e admin admin] PATH_INFO: `/v3/projects/b80ca61c71974da3a09673e49155f437/users/62040644427440c0a66defca92a38646/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:01.856740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b097439-6e18-44e0-a783-679d6ab8731e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b80ca61c71974da3a09673e49155f437, user_id=62040644427440c0a66defca92a38646, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:01.860207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b097439-6e18-44e0-a783-679d6ab8731e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:01.862256 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2228/4507] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:01.868723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0251b8c-6ac3-42da-a361-458d9e9baf62 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:01.895013 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2280/4508] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:10:01 2022] PUT /identity/v3/projects/b80ca61c71974da3a09673e49155f437/users/62040644427440c0a66defca92a38646/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:01.896223 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b097439-6e18-44e0-a783-679d6ab8731e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:01.906567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1b097439-6e18-44e0-a783-679d6ab8731e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:01.959823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0251b8c-6ac3-42da-a361-458d9e9baf62 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:01.992380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:02.040577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f8087-727d-4d10-8264-93a168f18073 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:02.043135 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f8087-727d-4d10-8264-93a168f18073 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `HEAD` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:02.043435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f8087-727d-4d10-8264-93a168f18073 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:02.043825 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f8087-727d-4d10-8264-93a168f18073 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/4667ef3b3c2f41edb6a21f228ae5d03f/implies/aa0eb96c9709455487fe75fb882b1253` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:02.045654 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f8087-727d-4d10-8264-93a168f18073 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=4667ef3b3c2f41edb6a21f228ae5d03f, implied_role_id=aa0eb96c9709455487fe75fb882b1253)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:02.046931 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-c42f8087-727d-4d10-8264-93a168f18073 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:10:02.046931 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:10:02.046931 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:10:02.047842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f8087-727d-4d10-8264-93a168f18073 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:02.049388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f8087-727d-4d10-8264-93a168f18073 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=4667ef3b3c2f41edb6a21f228ae5d03f, implied_role_id=aa0eb96c9709455487fe75fb882b1253)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:02.050457 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-c42f8087-727d-4d10-8264-93a168f18073 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:10:02.050457 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:10:02.050457 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:10:02.051447 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f8087-727d-4d10-8264-93a168f18073 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:02.062997 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2229/4509] 10.222.0.33 () {58 vars in 1345 bytes} [Sat Aug 6 21:10:01 2022] HEAD /identity/v3/roles/4667ef3b3c2f41edb6a21f228ae5d03f/implies/aa0eb96c9709455487fe75fb882b1253 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:02.065289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbd40a-d2b9-4b30-be96-e51e5c90d965 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:02.065583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbd40a-d2b9-4b30-be96-e51e5c90d965 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:02.065915 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbd40a-d2b9-4b30-be96-e51e5c90d965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:02.094063 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b097439-6e18-44e0-a783-679d6ab8731e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:02.099981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b70fdb-c579-47df-8f38-fd66d41c1dfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:02.100602 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b70fdb-c579-47df-8f38-fd66d41c1dfd service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:02.100881 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b70fdb-c579-47df-8f38-fd66d41c1dfd service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:02.101155 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b70fdb-c579-47df-8f38-fd66d41c1dfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:02.113450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-18fbd40a-d2b9-4b30-be96-e51e5c90d965 None None] MFA Rules not processed for user `62040644427440c0a66defca92a38646`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:02.115928 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-18fbd40a-d2b9-4b30-be96-e51e5c90d965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:02.247984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b70fdb-c579-47df-8f38-fd66d41c1dfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:02.252534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b70fdb-c579-47df-8f38-fd66d41c1dfd service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:02.276243 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2230/4510] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:02 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:02.279496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbd40a-d2b9-4b30-be96-e51e5c90d965 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:02.288618 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2281/4511] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:10:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:10:02.290695 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b70fdb-c579-47df-8f38-fd66d41c1dfd service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:02.306097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbd40a-d2b9-4b30-be96-e51e5c90d965 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:02.311653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b70fdb-c579-47df-8f38-fd66d41c1dfd service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:02.316419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d092abd-d582-4f35-90a9-5bb5e2ad5f9e tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:02.317658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d092abd-d582-4f35-90a9-5bb5e2ad5f9e tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:02.318646 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d092abd-d582-4f35-90a9-5bb5e2ad5f9e tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:02.320107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d092abd-d582-4f35-90a9-5bb5e2ad5f9e tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/4667ef3b3c2f41edb6a21f228ae5d03f/implies/aa0eb96c9709455487fe75fb882b1253` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:02.323777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa84b8b-c7d8-4a26-b792-e63b6377bbd3 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62040644427440c0a66defca92a38646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ca61c71974da3a09673e49155f437', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:02.324659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d092abd-d582-4f35-90a9-5bb5e2ad5f9e tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=4667ef3b3c2f41edb6a21f228ae5d03f, implied_role_id=aa0eb96c9709455487fe75fb882b1253)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:02.326472 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa84b8b-c7d8-4a26-b792-e63b6377bbd3 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:02.327009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa84b8b-c7d8-4a26-b792-e63b6377bbd3 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:02.330354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d092abd-d582-4f35-90a9-5bb5e2ad5f9e tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:02.330751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa84b8b-c7d8-4a26-b792-e63b6377bbd3 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:02.331632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa84b8b-c7d8-4a26-b792-e63b6377bbd3 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:02.335335 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa84b8b-c7d8-4a26-b792-e63b6377bbd3 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:02.351088 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2231/4512] 10.222.0.33 () {58 vars in 1344 bytes} [Sat Aug 6 21:10:02 2022] GET /identity/v3/roles/4667ef3b3c2f41edb6a21f228ae5d03f/implies/aa0eb96c9709455487fe75fb882b1253 => generated 520 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:02.353217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d092abd-d582-4f35-90a9-5bb5e2ad5f9e tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:02.377163 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d092abd-d582-4f35-90a9-5bb5e2ad5f9e tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:02.389164 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488eb590-6fde-4249-84ce-02285b0d4ec7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:02.390100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488eb590-6fde-4249-84ce-02285b0d4ec7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:02.390691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488eb590-6fde-4249-84ce-02285b0d4ec7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:02.394883 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488eb590-6fde-4249-84ce-02285b0d4ec7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/4667ef3b3c2f41edb6a21f228ae5d03f/implies/aa0eb96c9709455487fe75fb882b1253` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:02.395091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:02.400901 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488eb590-6fde-4249-84ce-02285b0d4ec7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=4667ef3b3c2f41edb6a21f228ae5d03f, implied_role_id=aa0eb96c9709455487fe75fb882b1253)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:02.405151 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488eb590-6fde-4249-84ce-02285b0d4ec7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:02.428565 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2282/4513] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:10:02 2022] POST /identity/v3/projects => generated 351 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:02.431334 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2232/4514] 10.222.0.33 () {58 vars in 1347 bytes} [Sat Aug 6 21:10:02 2022] DELETE /identity/v3/roles/4667ef3b3c2f41edb6a21f228ae5d03f/implies/aa0eb96c9709455487fe75fb882b1253 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:02.431949 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa84b8b-c7d8-4a26-b792-e63b6377bbd3 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:02.439772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488eb590-6fde-4249-84ce-02285b0d4ec7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:02.582268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488eb590-6fde-4249-84ce-02285b0d4ec7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:02.584988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa84b8b-c7d8-4a26-b792-e63b6377bbd3 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:02.593198 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5baebe7-282c-485f-93f9-69518319b386 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:02.594365 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5baebe7-282c-485f-93f9-69518319b386 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:02.603534 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5baebe7-282c-485f-93f9-69518319b386 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:02.604265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5baebe7-282c-485f-93f9-69518319b386 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/4667ef3b3c2f41edb6a21f228ae5d03f/implies/aa0eb96c9709455487fe75fb882b1253` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:02.607091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5baebe7-282c-485f-93f9-69518319b386 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=4667ef3b3c2f41edb6a21f228ae5d03f, implied_role_id=aa0eb96c9709455487fe75fb882b1253)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:02.609329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5baebe7-282c-485f-93f9-69518319b386 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:02.620719 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-a5baebe7-282c-485f-93f9-69518319b386 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] 4667ef3b3c2f41edb6a21f228ae5d03f does not imply aa0eb96c9709455487fe75fb882b1253.: keystone.exception.ImpliedRoleNotFound: 4667ef3b3c2f41edb6a21f228ae5d03f does not imply aa0eb96c9709455487fe75fb882b1253. Aug 06 21:10:02.620719 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:10:02.620719 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Aug 06 21:10:02.620719 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = query.one() Aug 06 21:10:02.620719 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Aug 06 21:10:02.620719 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._iter().one() Aug 06 21:10:02.620719 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Aug 06 21:10:02.620719 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._only_one_row( Aug 06 21:10:02.620719 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 06 21:10:02.620719 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 06 21:10:02.620719 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 06 21:10:02.620719 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:10:02.620719 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 21:10:02.620719 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:10:02.620719 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:10:02.620719 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:10:02.622334 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:10:02.622334 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:10:02.622334 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:10:02.622334 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:10:02.622334 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:10:02.622334 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:10:02.622334 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:10:02.622334 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:10:02.622334 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:10:02.622334 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Aug 06 21:10:02.622334 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Aug 06 21:10:02.622334 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Aug 06 21:10:02.622334 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Aug 06 21:10:02.622334 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Aug 06 21:10:02.622334 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Aug 06 21:10:02.622334 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Aug 06 21:10:02.624079 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Aug 06 21:10:02.624079 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 4667ef3b3c2f41edb6a21f228ae5d03f does not imply aa0eb96c9709455487fe75fb882b1253. Aug 06 21:10:02.624079 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:10:02.628524 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2233/4515] 10.222.0.33 () {58 vars in 1344 bytes} [Sat Aug 6 21:10:02 2022] GET /identity/v3/roles/4667ef3b3c2f41edb6a21f228ae5d03f/implies/aa0eb96c9709455487fe75fb882b1253 => generated 137 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:10:02.633106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5baebe7-282c-485f-93f9-69518319b386 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:02.651039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5baebe7-282c-485f-93f9-69518319b386 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:02.661509 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4dc8d-3504-4391-a278-7d2dd89dd1d6 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:02.662756 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4dc8d-3504-4391-a278-7d2dd89dd1d6 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:02.670666 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4dc8d-3504-4391-a278-7d2dd89dd1d6 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:02.670666 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4dc8d-3504-4391-a278-7d2dd89dd1d6 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/4667ef3b3c2f41edb6a21f228ae5d03f/implies/aa0eb96c9709455487fe75fb882b1253` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:02.670666 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4dc8d-3504-4391-a278-7d2dd89dd1d6 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=4667ef3b3c2f41edb6a21f228ae5d03f, implied_role_id=aa0eb96c9709455487fe75fb882b1253)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:02.674843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4dc8d-3504-4391-a278-7d2dd89dd1d6 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:02.694272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990c872-0aad-4331-950e-5ef25dad090b tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62040644427440c0a66defca92a38646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ca61c71974da3a09673e49155f437', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:02.695220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990c872-0aad-4331-950e-5ef25dad090b tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:02.695664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990c872-0aad-4331-950e-5ef25dad090b tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:02.696119 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990c872-0aad-4331-950e-5ef25dad090b tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:02.696915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7990c872-0aad-4331-950e-5ef25dad090b tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:02.697049 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-eeb4dc8d-3504-4391-a278-7d2dd89dd1d6 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] 4667ef3b3c2f41edb6a21f228ae5d03f does not imply aa0eb96c9709455487fe75fb882b1253.: keystone.exception.ImpliedRoleNotFound: 4667ef3b3c2f41edb6a21f228ae5d03f does not imply aa0eb96c9709455487fe75fb882b1253. Aug 06 21:10:02.697049 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:10:02.697049 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Aug 06 21:10:02.697049 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = query.one() Aug 06 21:10:02.697049 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Aug 06 21:10:02.697049 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._iter().one() Aug 06 21:10:02.697049 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Aug 06 21:10:02.697049 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._only_one_row( Aug 06 21:10:02.697049 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 06 21:10:02.697049 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 06 21:10:02.697049 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 06 21:10:02.697049 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:10:02.697049 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 21:10:02.697049 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:10:02.697049 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:10:02.697049 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:10:02.698410 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:10:02.698410 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:10:02.698410 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:10:02.698410 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:10:02.698410 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:10:02.698410 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:10:02.698410 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:10:02.698410 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:10:02.698410 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:10:02.698410 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Aug 06 21:10:02.698410 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Aug 06 21:10:02.698410 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:10:02.698410 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:10:02.698410 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Aug 06 21:10:02.698410 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Aug 06 21:10:02.698410 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Aug 06 21:10:02.699758 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Aug 06 21:10:02.699758 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Aug 06 21:10:02.699758 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Aug 06 21:10:02.699758 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 4667ef3b3c2f41edb6a21f228ae5d03f does not imply aa0eb96c9709455487fe75fb882b1253. Aug 06 21:10:02.699758 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:10:02.702867 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7990c872-0aad-4331-950e-5ef25dad090b tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:02.708712 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2234/4516] 10.222.0.33 () {58 vars in 1347 bytes} [Sat Aug 6 21:10:02 2022] DELETE /identity/v3/roles/4667ef3b3c2f41edb6a21f228ae5d03f/implies/aa0eb96c9709455487fe75fb882b1253 => generated 137 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:10:02.713528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4dc8d-3504-4391-a278-7d2dd89dd1d6 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:02.742003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4dc8d-3504-4391-a278-7d2dd89dd1d6 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:02.753990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf9bfb-2e8b-43ad-9805-c4d2e9b09a5b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:02.755067 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf9bfb-2e8b-43ad-9805-c4d2e9b09a5b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:02.755601 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf9bfb-2e8b-43ad-9805-c4d2e9b09a5b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:02.756045 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf9bfb-2e8b-43ad-9805-c4d2e9b09a5b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/4667ef3b3c2f41edb6a21f228ae5d03f/implies/aa0eb96c9709455487fe75fb882b1253` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:02.758173 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf9bfb-2e8b-43ad-9805-c4d2e9b09a5b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=4667ef3b3c2f41edb6a21f228ae5d03f, implied_role_id=aa0eb96c9709455487fe75fb882b1253)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:02.760108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf9bfb-2e8b-43ad-9805-c4d2e9b09a5b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:02.768454 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2283/4517] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:10:02 2022] POST /identity/v3/projects => generated 351 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:02.773955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990c872-0aad-4331-950e-5ef25dad090b tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:02.799358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:02.821575 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2235/4518] 10.222.0.33 () {60 vars in 1363 bytes} [Sat Aug 6 21:10:02 2022] PUT /identity/v3/roles/4667ef3b3c2f41edb6a21f228ae5d03f/implies/aa0eb96c9709455487fe75fb882b1253 => generated 520 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:02.825508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf9bfb-2e8b-43ad-9805-c4d2e9b09a5b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:02.912800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990c872-0aad-4331-950e-5ef25dad090b tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:02.938262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf9bfb-2e8b-43ad-9805-c4d2e9b09a5b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:02.944307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78e6d9-4e63-4b58-ad86-f8360b146d77 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:02.945222 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78e6d9-4e63-4b58-ad86-f8360b146d77 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:02.945571 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78e6d9-4e63-4b58-ad86-f8360b146d77 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:02.945910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78e6d9-4e63-4b58-ad86-f8360b146d77 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/4667ef3b3c2f41edb6a21f228ae5d03f/implies/307117d7c2a444059532ac6640a7b5b7` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:02.947836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78e6d9-4e63-4b58-ad86-f8360b146d77 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=4667ef3b3c2f41edb6a21f228ae5d03f, implied_role_id=307117d7c2a444059532ac6640a7b5b7)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:02.949630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78e6d9-4e63-4b58-ad86-f8360b146d77 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:02.964338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:02.981981 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2236/4519] 10.222.0.33 () {60 vars in 1363 bytes} [Sat Aug 6 21:10:02 2022] PUT /identity/v3/roles/4667ef3b3c2f41edb6a21f228ae5d03f/implies/307117d7c2a444059532ac6640a7b5b7 => generated 521 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:02.986351 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78e6d9-4e63-4b58-ad86-f8360b146d77 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:03.030080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db126bac-aed6-4124-97d3-2f543b11e7ca tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62040644427440c0a66defca92a38646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ca61c71974da3a09673e49155f437', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:03.031547 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db126bac-aed6-4124-97d3-2f543b11e7ca tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:03.031547 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db126bac-aed6-4124-97d3-2f543b11e7ca tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:03.033730 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db126bac-aed6-4124-97d3-2f543b11e7ca tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] PATH_INFO: `/v3/users/9b16de3d5abf48a3a67e3c00fbca370c` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:03.037113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db126bac-aed6-4124-97d3-2f543b11e7ca tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: Authorizing `identity:get_user(user_id=9b16de3d5abf48a3a67e3c00fbca370c)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:03.040546 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db126bac-aed6-4124-97d3-2f543b11e7ca tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:03.051102 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2284/4520] 10.222.0.33 () {58 vars in 1221 bytes} [Sat Aug 6 21:10:02 2022] GET /identity/v3/users/9b16de3d5abf48a3a67e3c00fbca370c => generated 288 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:03.054501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db126bac-aed6-4124-97d3-2f543b11e7ca tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:03.080916 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db126bac-aed6-4124-97d3-2f543b11e7ca tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:03.191806 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78e6d9-4e63-4b58-ad86-f8360b146d77 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:03.204011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990658f9-5dd9-42a4-9671-db4fbbd2558c tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:03.208478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990658f9-5dd9-42a4-9671-db4fbbd2558c tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:03.208691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990658f9-5dd9-42a4-9671-db4fbbd2558c tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:03.209236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990658f9-5dd9-42a4-9671-db4fbbd2558c tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/307117d7c2a444059532ac6640a7b5b7/implies/60a015264f4c412da4288d651404c30f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:03.212878 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990658f9-5dd9-42a4-9671-db4fbbd2558c tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=307117d7c2a444059532ac6640a7b5b7, implied_role_id=60a015264f4c412da4288d651404c30f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:03.214502 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990658f9-5dd9-42a4-9671-db4fbbd2558c tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:03.253919 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd8be2-03a3-4196-a359-da86b56059f3 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62040644427440c0a66defca92a38646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ca61c71974da3a09673e49155f437', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:03.254601 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd8be2-03a3-4196-a359-da86b56059f3 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:03.255558 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd8be2-03a3-4196-a359-da86b56059f3 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:03.255912 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd8be2-03a3-4196-a359-da86b56059f3 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] PATH_INFO: `/v3/credentials` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:03.256708 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd8be2-03a3-4196-a359-da86b56059f3 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:03.258629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd8be2-03a3-4196-a359-da86b56059f3 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:03.287492 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2237/4521] 10.222.0.33 () {60 vars in 1363 bytes} [Sat Aug 6 21:10:02 2022] PUT /identity/v3/roles/307117d7c2a444059532ac6640a7b5b7/implies/60a015264f4c412da4288d651404c30f => generated 521 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:03.289046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990658f9-5dd9-42a4-9671-db4fbbd2558c tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:03.295091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-990658f9-5dd9-42a4-9671-db4fbbd2558c tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:03.311719 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2285/4522] 10.222.0.33 () {60 vars in 1162 bytes} [Sat Aug 6 21:10:03 2022] POST /identity/v3/credentials => generated 430 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:03.312965 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd8be2-03a3-4196-a359-da86b56059f3 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:03.328692 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd8be2-03a3-4196-a359-da86b56059f3 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:03.445054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef67d2-aa61-4f64-8407-5b54c6d1b6fb tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:03.446898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef67d2-aa61-4f64-8407-5b54c6d1b6fb tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:03.447193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef67d2-aa61-4f64-8407-5b54c6d1b6fb tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:03.448125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef67d2-aa61-4f64-8407-5b54c6d1b6fb tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:03.448334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef67d2-aa61-4f64-8407-5b54c6d1b6fb tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:03.449422 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-5eef67d2-aa61-4f64-8407-5b54c6d1b6fb tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:10:03.449422 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:10:03.449422 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:10:03.450675 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef67d2-aa61-4f64-8407-5b54c6d1b6fb tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:03.474733 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2286/4523] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Aug 6 21:10:03 2022] GET /identity/v3/role_inferences => generated 1607 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:03.475674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef67d2-aa61-4f64-8407-5b54c6d1b6fb tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:03.496332 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:03.504951 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990658f9-5dd9-42a4-9671-db4fbbd2558c tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:03.517498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4de496-2ec6-4ea5-bea4-9807e40de901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:03.521048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4de496-2ec6-4ea5-bea4-9807e40de901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:03.521661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4de496-2ec6-4ea5-bea4-9807e40de901 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:03.524024 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4de496-2ec6-4ea5-bea4-9807e40de901 admin admin] PATH_INFO: `/v3/users/c3601924229d4254817f827b64c9380e` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:03.526923 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4de496-2ec6-4ea5-bea4-9807e40de901 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3601924229d4254817f827b64c9380e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:03.529727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4de496-2ec6-4ea5-bea4-9807e40de901 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:03.579208 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef67d2-aa61-4f64-8407-5b54c6d1b6fb tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:03.587312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c3137-1c5c-4e6c-8325-3dd12ec78c5b tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62040644427440c0a66defca92a38646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ca61c71974da3a09673e49155f437', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:03.587986 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c3137-1c5c-4e6c-8325-3dd12ec78c5b tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:03.588257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c3137-1c5c-4e6c-8325-3dd12ec78c5b tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:03.588496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c3137-1c5c-4e6c-8325-3dd12ec78c5b tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] PATH_INFO: `/v3/credentials/211ecd07c29c6bd1b838900ba72167e2a7bdf1f0ea9307ed3b921be98f118531` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:03.591182 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c3137-1c5c-4e6c-8325-3dd12ec78c5b tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=211ecd07c29c6bd1b838900ba72167e2a7bdf1f0ea9307ed3b921be98f118531)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:03.592998 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c3137-1c5c-4e6c-8325-3dd12ec78c5b tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:03.601974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c3137-1c5c-4e6c-8325-3dd12ec78c5b tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=211ecd07c29c6bd1b838900ba72167e2a7bdf1f0ea9307ed3b921be98f118531)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:03.608118 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c3137-1c5c-4e6c-8325-3dd12ec78c5b tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:03.630057 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-de4de496-2ec6-4ea5-bea4-9807e40de901 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3601924229d4254817f827b64c9380e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:03.630821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-de4de496-2ec6-4ea5-bea4-9807e40de901 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3601924229d4254817f827b64c9380e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:03.631450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-de4de496-2ec6-4ea5-bea4-9807e40de901 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3601924229d4254817f827b64c9380e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:03.644459 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-de4de496-2ec6-4ea5-bea4-9807e40de901 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3601924229d4254817f827b64c9380e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:03.650409 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2287/4524] 10.222.0.33 () {60 vars in 1358 bytes} [Sat Aug 6 21:10:03 2022] PATCH /identity/v3/credentials/211ecd07c29c6bd1b838900ba72167e2a7bdf1f0ea9307ed3b921be98f118531 => generated 435 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:03.659536 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c3137-1c5c-4e6c-8325-3dd12ec78c5b tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:03.666464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-bf6c3137-1c5c-4e6c-8325-3dd12ec78c5b tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:03.683217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-de4de496-2ec6-4ea5-bea4-9807e40de901 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3601924229d4254817f827b64c9380e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:03.694449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:03.710592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c3137-1c5c-4e6c-8325-3dd12ec78c5b tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:03.721450 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2238/4525] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:03 2022] DELETE /identity/v3/users/c3601924229d4254817f827b64c9380e => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:03.721450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4de496-2ec6-4ea5-bea4-9807e40de901 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:03.722301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89731c6-9d3a-42a3-9861-c3bde1ebf18b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:03.723372 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89731c6-9d3a-42a3-9861-c3bde1ebf18b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:03.724413 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-de4de496-2ec6-4ea5-bea4-9807e40de901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:03.725663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89731c6-9d3a-42a3-9861-c3bde1ebf18b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:03.725971 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89731c6-9d3a-42a3-9861-c3bde1ebf18b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/307117d7c2a444059532ac6640a7b5b7/implies/60a015264f4c412da4288d651404c30f` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:03.729435 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89731c6-9d3a-42a3-9861-c3bde1ebf18b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=307117d7c2a444059532ac6640a7b5b7, implied_role_id=60a015264f4c412da4288d651404c30f)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:03.731091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89731c6-9d3a-42a3-9861-c3bde1ebf18b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:03.757782 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2288/4526] 10.222.0.33 () {58 vars in 1347 bytes} [Sat Aug 6 21:10:03 2022] DELETE /identity/v3/roles/307117d7c2a444059532ac6640a7b5b7/implies/60a015264f4c412da4288d651404c30f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:03.769851 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89731c6-9d3a-42a3-9861-c3bde1ebf18b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:03.874161 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4de496-2ec6-4ea5-bea4-9807e40de901 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:03.892458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89731c6-9d3a-42a3-9861-c3bde1ebf18b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:03.900329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822dbeb-4f63-4aaa-9057-b9337a9d6ffc tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:03.901075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822dbeb-4f63-4aaa-9057-b9337a9d6ffc tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:03.901312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822dbeb-4f63-4aaa-9057-b9337a9d6ffc tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:03.901562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822dbeb-4f63-4aaa-9057-b9337a9d6ffc tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/4667ef3b3c2f41edb6a21f228ae5d03f/implies/307117d7c2a444059532ac6640a7b5b7` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:03.903365 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5822dbeb-4f63-4aaa-9057-b9337a9d6ffc tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=4667ef3b3c2f41edb6a21f228ae5d03f, implied_role_id=307117d7c2a444059532ac6640a7b5b7)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:03.905779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5822dbeb-4f63-4aaa-9057-b9337a9d6ffc tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:03.924638 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2289/4527] 10.222.0.33 () {58 vars in 1347 bytes} [Sat Aug 6 21:10:03 2022] DELETE /identity/v3/roles/4667ef3b3c2f41edb6a21f228ae5d03f/implies/307117d7c2a444059532ac6640a7b5b7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:03.929185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822dbeb-4f63-4aaa-9057-b9337a9d6ffc tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:04.025449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822dbeb-4f63-4aaa-9057-b9337a9d6ffc tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:04.038398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2f786-7404-4e22-83f1-20ec48334fd3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:04.039115 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2f786-7404-4e22-83f1-20ec48334fd3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:04.039397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2f786-7404-4e22-83f1-20ec48334fd3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:04.039781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2f786-7404-4e22-83f1-20ec48334fd3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/4667ef3b3c2f41edb6a21f228ae5d03f/implies/aa0eb96c9709455487fe75fb882b1253` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:04.045082 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2f786-7404-4e22-83f1-20ec48334fd3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=4667ef3b3c2f41edb6a21f228ae5d03f, implied_role_id=aa0eb96c9709455487fe75fb882b1253)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:04.046835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2f786-7404-4e22-83f1-20ec48334fd3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:04.046989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d0766-0f9b-4c63-b2c2-7970a32fc63f tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62040644427440c0a66defca92a38646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ca61c71974da3a09673e49155f437', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:04.047859 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d0766-0f9b-4c63-b2c2-7970a32fc63f tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:04.048787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d0766-0f9b-4c63-b2c2-7970a32fc63f tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:04.049149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d0766-0f9b-4c63-b2c2-7970a32fc63f tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] PATH_INFO: `/v3/credentials/211ecd07c29c6bd1b838900ba72167e2a7bdf1f0ea9307ed3b921be98f118531` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:04.053729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d0766-0f9b-4c63-b2c2-7970a32fc63f tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=211ecd07c29c6bd1b838900ba72167e2a7bdf1f0ea9307ed3b921be98f118531)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:04.057344 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d0766-0f9b-4c63-b2c2-7970a32fc63f tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:04.068336 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2239/4528] 10.222.0.33 () {58 vars in 1335 bytes} [Sat Aug 6 21:10:03 2022] GET /identity/v3/credentials/211ecd07c29c6bd1b838900ba72167e2a7bdf1f0ea9307ed3b921be98f118531 => generated 435 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:04.069477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d0766-0f9b-4c63-b2c2-7970a32fc63f tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:04.069979 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2290/4529] 10.222.0.33 () {58 vars in 1347 bytes} [Sat Aug 6 21:10:03 2022] DELETE /identity/v3/roles/4667ef3b3c2f41edb6a21f228ae5d03f/implies/aa0eb96c9709455487fe75fb882b1253 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:04.075210 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2f786-7404-4e22-83f1-20ec48334fd3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:04.098586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d0766-0f9b-4c63-b2c2-7970a32fc63f tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:04.149458 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:04.210499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2f786-7404-4e22-83f1-20ec48334fd3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:04.217839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569bd48-633d-47c4-9e0d-a9fad653a9ba tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:04.218385 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569bd48-633d-47c4-9e0d-a9fad653a9ba tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:04.218786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569bd48-633d-47c4-9e0d-a9fad653a9ba tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:04.219050 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569bd48-633d-47c4-9e0d-a9fad653a9ba tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:04.220265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c569bd48-633d-47c4-9e0d-a9fad653a9ba tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:04.220940 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9418a97-859f-48a6-9c8f-93f22101c34f tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62040644427440c0a66defca92a38646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ca61c71974da3a09673e49155f437', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:04.221886 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9418a97-859f-48a6-9c8f-93f22101c34f tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:04.222014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c569bd48-633d-47c4-9e0d-a9fad653a9ba tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:04.222207 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9418a97-859f-48a6-9c8f-93f22101c34f tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:04.222485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9418a97-859f-48a6-9c8f-93f22101c34f tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] PATH_INFO: `/v3/credentials/211ecd07c29c6bd1b838900ba72167e2a7bdf1f0ea9307ed3b921be98f118531` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:04.225167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9418a97-859f-48a6-9c8f-93f22101c34f tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=211ecd07c29c6bd1b838900ba72167e2a7bdf1f0ea9307ed3b921be98f118531)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:04.227682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9418a97-859f-48a6-9c8f-93f22101c34f tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:04.237176 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2291/4530] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:04 2022] GET /identity/v3/roles => generated 2323 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:04.238189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569bd48-633d-47c4-9e0d-a9fad653a9ba tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:04.241913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c569bd48-633d-47c4-9e0d-a9fad653a9ba tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:04.296439 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2240/4531] 10.222.0.33 () {58 vars in 1338 bytes} [Sat Aug 6 21:10:04 2022] DELETE /identity/v3/credentials/211ecd07c29c6bd1b838900ba72167e2a7bdf1f0ea9307ed3b921be98f118531 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:04.299237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:04.302006 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9418a97-859f-48a6-9c8f-93f22101c34f tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:04.326725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9418a97-859f-48a6-9c8f-93f22101c34f tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:04.334565 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e04ea-8b47-489c-b56b-11d22d1c03e4 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:04.338098 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e04ea-8b47-489c-b56b-11d22d1c03e4 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:04.338596 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e04ea-8b47-489c-b56b-11d22d1c03e4 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:04.339141 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e04ea-8b47-489c-b56b-11d22d1c03e4 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:04.339682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e04ea-8b47-489c-b56b-11d22d1c03e4 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:04.341968 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e04ea-8b47-489c-b56b-11d22d1c03e4 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:04.375545 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2241/4532] 10.222.0.33 () {60 vars in 1143 bytes} [Sat Aug 6 21:10:04 2022] POST /identity/v3/roles => generated 235 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:04.378405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e04ea-8b47-489c-b56b-11d22d1c03e4 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:04.400240 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569bd48-633d-47c4-9e0d-a9fad653a9ba tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:04.403844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e04ea-8b47-489c-b56b-11d22d1c03e4 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:04.415484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0232f7f-3815-4fe0-8eec-4535f4ad36ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:04.415735 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5343fd-8da8-47ce-ac04-38dfda69333c tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62040644427440c0a66defca92a38646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ca61c71974da3a09673e49155f437', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:04.416143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0232f7f-3815-4fe0-8eec-4535f4ad36ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:04.416424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0232f7f-3815-4fe0-8eec-4535f4ad36ba admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:04.416728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0232f7f-3815-4fe0-8eec-4535f4ad36ba admin admin] PATH_INFO: `/v3/projects/9ed8f9cbedd14527bb98ac545eaf70d8` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:04.418360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0232f7f-3815-4fe0-8eec-4535f4ad36ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ed8f9cbedd14527bb98ac545eaf70d8)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:04.419690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5343fd-8da8-47ce-ac04-38dfda69333c tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:04.419690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5343fd-8da8-47ce-ac04-38dfda69333c tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:04.419963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5343fd-8da8-47ce-ac04-38dfda69333c tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] PATH_INFO: `/v3/credentials` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:04.420466 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5343fd-8da8-47ce-ac04-38dfda69333c tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:04.420604 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0232f7f-3815-4fe0-8eec-4535f4ad36ba admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:04.428937 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5343fd-8da8-47ce-ac04-38dfda69333c tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:04.469286 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2242/4533] 10.222.0.33 () {60 vars in 1162 bytes} [Sat Aug 6 21:10:04 2022] POST /identity/v3/credentials => generated 430 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:04.470783 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5343fd-8da8-47ce-ac04-38dfda69333c tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:04.498718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5343fd-8da8-47ce-ac04-38dfda69333c tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:04.500476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f0232f7f-3815-4fe0-8eec-4535f4ad36ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ed8f9cbedd14527bb98ac545eaf70d8', 'request_id': 'req-f0232f7f-3815-4fe0-8eec-4535f4ad36ba'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:04.508562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f0232f7f-3815-4fe0-8eec-4535f4ad36ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ed8f9cbedd14527bb98ac545eaf70d8', 'request_id': 'req-f0232f7f-3815-4fe0-8eec-4535f4ad36ba'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:04.520533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f0232f7f-3815-4fe0-8eec-4535f4ad36ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ed8f9cbedd14527bb98ac545eaf70d8', 'request_id': 'req-f0232f7f-3815-4fe0-8eec-4535f4ad36ba'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:04.549514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f0232f7f-3815-4fe0-8eec-4535f4ad36ba admin admin] The token cache is being invalidate because project 9ed8f9cbedd14527bb98ac545eaf70d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:04.550278 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f0232f7f-3815-4fe0-8eec-4535f4ad36ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:04.552257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f0232f7f-3815-4fe0-8eec-4535f4ad36ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:04.555507 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2292/4534] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:10:04 2022] DELETE /identity/v3/projects/9ed8f9cbedd14527bb98ac545eaf70d8 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:04.558564 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0232f7f-3815-4fe0-8eec-4535f4ad36ba admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:04.561875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f0232f7f-3815-4fe0-8eec-4535f4ad36ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:04.623114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85fc2a-f1b0-4b02-b57d-4ccbd03c990b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:04.624446 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85fc2a-f1b0-4b02-b57d-4ccbd03c990b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:04.624875 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85fc2a-f1b0-4b02-b57d-4ccbd03c990b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:04.625244 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85fc2a-f1b0-4b02-b57d-4ccbd03c990b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/9abe87581ad64ec1946fcf2e0444155f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:04.628434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85fc2a-f1b0-4b02-b57d-4ccbd03c990b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:update_role(role_id=9abe87581ad64ec1946fcf2e0444155f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:04.632368 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-df85fc2a-f1b0-4b02-b57d-4ccbd03c990b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:10:04.632368 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:10:04.632368 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:10:04.635521 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85fc2a-f1b0-4b02-b57d-4ccbd03c990b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:04.689792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0232f7f-3815-4fe0-8eec-4535f4ad36ba admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:04.695423 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2243/4535] 10.222.0.33 () {60 vars in 1243 bytes} [Sat Aug 6 21:10:04 2022] PATCH /identity/v3/roles/9abe87581ad64ec1946fcf2e0444155f => generated 238 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:04.696372 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85fc2a-f1b0-4b02-b57d-4ccbd03c990b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:04.700046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-df85fc2a-f1b0-4b02-b57d-4ccbd03c990b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:04.705549 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9a1ab-a1f6-4b69-a10f-bc2c799c7f84 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62040644427440c0a66defca92a38646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ca61c71974da3a09673e49155f437', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:04.706180 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9a1ab-a1f6-4b69-a10f-bc2c799c7f84 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:04.706469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9a1ab-a1f6-4b69-a10f-bc2c799c7f84 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:04.706764 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9a1ab-a1f6-4b69-a10f-bc2c799c7f84 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] PATH_INFO: `/v3/credentials` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:04.707414 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9a1ab-a1f6-4b69-a10f-bc2c799c7f84 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:04.709770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9a1ab-a1f6-4b69-a10f-bc2c799c7f84 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:04.747824 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2293/4536] 10.222.0.33 () {60 vars in 1162 bytes} [Sat Aug 6 21:10:04 2022] POST /identity/v3/credentials => generated 430 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:04.751800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9a1ab-a1f6-4b69-a10f-bc2c799c7f84 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:04.757705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-95b9a1ab-a1f6-4b69-a10f-bc2c799c7f84 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:04.788613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9a1ab-a1f6-4b69-a10f-bc2c799c7f84 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:04.797471 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ba2ba-d227-405e-ab3e-aba076fb1ab9 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:04.798986 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ba2ba-d227-405e-ab3e-aba076fb1ab9 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:04.804243 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ba2ba-d227-405e-ab3e-aba076fb1ab9 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:04.805282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ba2ba-d227-405e-ab3e-aba076fb1ab9 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/9abe87581ad64ec1946fcf2e0444155f` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:04.824828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85fc2a-f1b0-4b02-b57d-4ccbd03c990b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:04.827801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ba2ba-d227-405e-ab3e-aba076fb1ab9 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:get_role(role_id=9abe87581ad64ec1946fcf2e0444155f)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:04.828957 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-949ba2ba-d227-405e-ab3e-aba076fb1ab9 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:10:04.828957 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:10:04.828957 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:10:04.830806 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491b8fb-5a9e-496d-b7a9-1ca77fad2e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:04.831456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491b8fb-5a9e-496d-b7a9-1ca77fad2e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:04.831590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ba2ba-d227-405e-ab3e-aba076fb1ab9 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:04.831738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491b8fb-5a9e-496d-b7a9-1ca77fad2e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:04.832017 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491b8fb-5a9e-496d-b7a9-1ca77fad2e86 admin admin] PATH_INFO: `/v3/users/60937cf67d164238a35870c98b53f0ef` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:04.833594 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491b8fb-5a9e-496d-b7a9-1ca77fad2e86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60937cf67d164238a35870c98b53f0ef)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:04.835889 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491b8fb-5a9e-496d-b7a9-1ca77fad2e86 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:04.836264 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2294/4537] 10.222.0.33 () {58 vars in 1221 bytes} [Sat Aug 6 21:10:04 2022] GET /identity/v3/roles/9abe87581ad64ec1946fcf2e0444155f => generated 238 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:04.838682 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ba2ba-d227-405e-ab3e-aba076fb1ab9 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:04.876060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ba2ba-d227-405e-ab3e-aba076fb1ab9 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:04.877172 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:04.895047 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2b97a-f5e8-486c-ab3c-d61f60deb99e tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62040644427440c0a66defca92a38646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ca61c71974da3a09673e49155f437', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:04.896866 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2b97a-f5e8-486c-ab3c-d61f60deb99e tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:04.897234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2b97a-f5e8-486c-ab3c-d61f60deb99e tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:04.898369 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2b97a-f5e8-486c-ab3c-d61f60deb99e tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] PATH_INFO: `/v3/credentials` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:04.901552 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c2b97a-f5e8-486c-ab3c-d61f60deb99e tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:04.906271 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c2b97a-f5e8-486c-ab3c-d61f60deb99e tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:04.925671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c2b97a-f5e8-486c-ab3c-d61f60deb99e tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:04.930661 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c2b97a-f5e8-486c-ab3c-d61f60deb99e tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:04.933837 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c2b97a-f5e8-486c-ab3c-d61f60deb99e tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:04.938253 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c2b97a-f5e8-486c-ab3c-d61f60deb99e tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:04.943753 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2295/4538] 10.222.0.33 () {58 vars in 1140 bytes} [Sat Aug 6 21:10:04 2022] GET /identity/v3/credentials => generated 945 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:04.945382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2b97a-f5e8-486c-ab3c-d61f60deb99e tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:04.953377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4491b8fb-5a9e-496d-b7a9-1ca77fad2e86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60937cf67d164238a35870c98b53f0ef'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:04.954160 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4491b8fb-5a9e-496d-b7a9-1ca77fad2e86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60937cf67d164238a35870c98b53f0ef'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:04.954853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4491b8fb-5a9e-496d-b7a9-1ca77fad2e86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60937cf67d164238a35870c98b53f0ef'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:04.971965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4491b8fb-5a9e-496d-b7a9-1ca77fad2e86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60937cf67d164238a35870c98b53f0ef'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:04.972429 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2b97a-f5e8-486c-ab3c-d61f60deb99e tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:04.982024 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79625419-c0bf-4bc2-a9ea-1a46e6d4bb39 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:04.982819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79625419-c0bf-4bc2-a9ea-1a46e6d4bb39 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:04.983101 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79625419-c0bf-4bc2-a9ea-1a46e6d4bb39 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:04.983389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79625419-c0bf-4bc2-a9ea-1a46e6d4bb39 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:04.984517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79625419-c0bf-4bc2-a9ea-1a46e6d4bb39 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:04.986387 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79625419-c0bf-4bc2-a9ea-1a46e6d4bb39 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:04.995879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4491b8fb-5a9e-496d-b7a9-1ca77fad2e86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60937cf67d164238a35870c98b53f0ef'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:05.010664 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2296/4539] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:04 2022] GET /identity/v3/roles => generated 2552 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:05.012823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79625419-c0bf-4bc2-a9ea-1a46e6d4bb39 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:05.014929 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-79625419-c0bf-4bc2-a9ea-1a46e6d4bb39 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:05.025920 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2244/4540] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:04 2022] DELETE /identity/v3/users/60937cf67d164238a35870c98b53f0ef => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:05.027079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491b8fb-5a9e-496d-b7a9-1ca77fad2e86 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:05.029612 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4491b8fb-5a9e-496d-b7a9-1ca77fad2e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:05.035211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79625419-c0bf-4bc2-a9ea-1a46e6d4bb39 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:05.052024 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:05.137753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491b8fb-5a9e-496d-b7a9-1ca77fad2e86 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:05.144326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93febd53-d716-4d3c-a445-e2cf9f8f9dad tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:05.144955 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93febd53-d716-4d3c-a445-e2cf9f8f9dad tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:05.145235 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93febd53-d716-4d3c-a445-e2cf9f8f9dad tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:05.145556 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93febd53-d716-4d3c-a445-e2cf9f8f9dad tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/9abe87581ad64ec1946fcf2e0444155f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:05.147028 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93febd53-d716-4d3c-a445-e2cf9f8f9dad tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9abe87581ad64ec1946fcf2e0444155f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:05.148231 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-93febd53-d716-4d3c-a445-e2cf9f8f9dad tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:10:05.148231 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:10:05.148231 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:10:05.149285 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93febd53-d716-4d3c-a445-e2cf9f8f9dad tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:05.153828 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524733e-b606-4401-92df-bb88fb008ca8 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62040644427440c0a66defca92a38646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ca61c71974da3a09673e49155f437', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:05.161237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524733e-b606-4401-92df-bb88fb008ca8 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:05.163052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524733e-b606-4401-92df-bb88fb008ca8 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:05.165029 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524733e-b606-4401-92df-bb88fb008ca8 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] PATH_INFO: `/v3/credentials/f6a4f4ceaaa0a11f85448cc687eff1191fcbd0fa73f360b3bef33851cfa6d0d4` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:05.172524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f524733e-b606-4401-92df-bb88fb008ca8 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=f6a4f4ceaaa0a11f85448cc687eff1191fcbd0fa73f360b3bef33851cfa6d0d4)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:05.182672 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f524733e-b606-4401-92df-bb88fb008ca8 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:05.215787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-93febd53-d716-4d3c-a445-e2cf9f8f9dad tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invalidating the token cache because role 9abe87581ad64ec1946fcf2e0444155f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:05.215787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-93febd53-d716-4d3c-a445-e2cf9f8f9dad tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:05.216936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-93febd53-d716-4d3c-a445-e2cf9f8f9dad tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:05.219304 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2245/4541] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:05 2022] DELETE /identity/v3/roles/9abe87581ad64ec1946fcf2e0444155f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:05.225098 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93febd53-d716-4d3c-a445-e2cf9f8f9dad tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:05.227085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-93febd53-d716-4d3c-a445-e2cf9f8f9dad tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:05.243851 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2297/4542] 10.222.0.33 () {58 vars in 1338 bytes} [Sat Aug 6 21:10:05 2022] DELETE /identity/v3/credentials/f6a4f4ceaaa0a11f85448cc687eff1191fcbd0fa73f360b3bef33851cfa6d0d4 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:05.245559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524733e-b606-4401-92df-bb88fb008ca8 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:05.248444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f524733e-b606-4401-92df-bb88fb008ca8 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:05.292621 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524733e-b606-4401-92df-bb88fb008ca8 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:05.304038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:05.309927 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93febd53-d716-4d3c-a445-e2cf9f8f9dad tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:05.318924 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e78e7-658a-4abc-b6bf-0ba22076ed11 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:05.322003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e78e7-658a-4abc-b6bf-0ba22076ed11 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:05.322828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e78e7-658a-4abc-b6bf-0ba22076ed11 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:05.324403 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e78e7-658a-4abc-b6bf-0ba22076ed11 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/4667ef3b3c2f41edb6a21f228ae5d03f/implies/aa0eb96c9709455487fe75fb882b1253` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:05.328576 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e78e7-658a-4abc-b6bf-0ba22076ed11 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=4667ef3b3c2f41edb6a21f228ae5d03f, implied_role_id=aa0eb96c9709455487fe75fb882b1253)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:05.335679 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e78e7-658a-4abc-b6bf-0ba22076ed11 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:05.384757 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2246/4543] 10.222.0.33 () {60 vars in 1363 bytes} [Sat Aug 6 21:10:05 2022] PUT /identity/v3/roles/4667ef3b3c2f41edb6a21f228ae5d03f/implies/aa0eb96c9709455487fe75fb882b1253 => generated 520 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:05.385988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e78e7-658a-4abc-b6bf-0ba22076ed11 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:05.414704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f04712-3106-4ee4-93af-504cb19a84a5 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62040644427440c0a66defca92a38646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ca61c71974da3a09673e49155f437', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:05.415358 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f04712-3106-4ee4-93af-504cb19a84a5 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:05.415689 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f04712-3106-4ee4-93af-504cb19a84a5 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:05.415975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f04712-3106-4ee4-93af-504cb19a84a5 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] PATH_INFO: `/v3/credentials/affa7fc4c24a57c31abc53029988bcc64c18bb411d18fe6962601ee95ce04bb6` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:05.418652 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f04712-3106-4ee4-93af-504cb19a84a5 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=affa7fc4c24a57c31abc53029988bcc64c18bb411d18fe6962601ee95ce04bb6)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:05.419754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f04712-3106-4ee4-93af-504cb19a84a5 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:05.453794 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2298/4544] 10.222.0.33 () {58 vars in 1338 bytes} [Sat Aug 6 21:10:05 2022] DELETE /identity/v3/credentials/affa7fc4c24a57c31abc53029988bcc64c18bb411d18fe6962601ee95ce04bb6 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:05.455803 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f04712-3106-4ee4-93af-504cb19a84a5 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:05.483344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f04712-3106-4ee4-93af-504cb19a84a5 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:05.608448 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e78e7-658a-4abc-b6bf-0ba22076ed11 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:05.614827 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ae68a-5141-41d9-aab5-1901c5a09cf2 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:05.615775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ae68a-5141-41d9-aab5-1901c5a09cf2 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:05.616249 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ae68a-5141-41d9-aab5-1901c5a09cf2 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:05.616759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ae68a-5141-41d9-aab5-1901c5a09cf2 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/4667ef3b3c2f41edb6a21f228ae5d03f/implies/307117d7c2a444059532ac6640a7b5b7` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:05.619548 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ae68a-5141-41d9-aab5-1901c5a09cf2 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=4667ef3b3c2f41edb6a21f228ae5d03f, implied_role_id=307117d7c2a444059532ac6640a7b5b7)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:05.621689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ae68a-5141-41d9-aab5-1901c5a09cf2 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:05.688368 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2247/4545] 10.222.0.33 () {60 vars in 1363 bytes} [Sat Aug 6 21:10:05 2022] PUT /identity/v3/roles/4667ef3b3c2f41edb6a21f228ae5d03f/implies/307117d7c2a444059532ac6640a7b5b7 => generated 521 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:05.690479 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ae68a-5141-41d9-aab5-1901c5a09cf2 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:05.693855 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e1c80-e4a6-489e-858f-139a05a028d8 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62040644427440c0a66defca92a38646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ca61c71974da3a09673e49155f437', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:05.695499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e1c80-e4a6-489e-858f-139a05a028d8 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:05.697443 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e1c80-e4a6-489e-858f-139a05a028d8 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:05.698459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e1c80-e4a6-489e-858f-139a05a028d8 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] PATH_INFO: `/v3/projects/7187c3d2581a4067b602ddae71661e86` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:05.710713 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e1c80-e4a6-489e-858f-139a05a028d8 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7187c3d2581a4067b602ddae71661e86)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:05.713144 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e1c80-e4a6-489e-858f-139a05a028d8 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:05.801177 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ae68a-5141-41d9-aab5-1901c5a09cf2 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:05.823419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:05.853498 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-676e1c80-e4a6-489e-858f-139a05a028d8 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7187c3d2581a4067b602ddae71661e86', 'request_id': 'req-676e1c80-e4a6-489e-858f-139a05a028d8'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:05.866533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-676e1c80-e4a6-489e-858f-139a05a028d8 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7187c3d2581a4067b602ddae71661e86', 'request_id': 'req-676e1c80-e4a6-489e-858f-139a05a028d8'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:05.888572 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-676e1c80-e4a6-489e-858f-139a05a028d8 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7187c3d2581a4067b602ddae71661e86', 'request_id': 'req-676e1c80-e4a6-489e-858f-139a05a028d8'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:05.912029 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-676e1c80-e4a6-489e-858f-139a05a028d8 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] The token cache is being invalidate because project 7187c3d2581a4067b602ddae71661e86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:05.912399 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-676e1c80-e4a6-489e-858f-139a05a028d8 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:05.913096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-676e1c80-e4a6-489e-858f-139a05a028d8 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:05.916360 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2299/4546] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:10:05 2022] DELETE /identity/v3/projects/7187c3d2581a4067b602ddae71661e86 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:05.917438 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e1c80-e4a6-489e-858f-139a05a028d8 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:05.920851 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-676e1c80-e4a6-489e-858f-139a05a028d8 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:05.928150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb705ea5-3489-4902-8c33-dfc24e0b2632 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:05.928821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb705ea5-3489-4902-8c33-dfc24e0b2632 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:05.929107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb705ea5-3489-4902-8c33-dfc24e0b2632 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:05.929387 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb705ea5-3489-4902-8c33-dfc24e0b2632 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/307117d7c2a444059532ac6640a7b5b7/implies/60a015264f4c412da4288d651404c30f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:05.931848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb705ea5-3489-4902-8c33-dfc24e0b2632 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=307117d7c2a444059532ac6640a7b5b7, implied_role_id=60a015264f4c412da4288d651404c30f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:05.933608 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb705ea5-3489-4902-8c33-dfc24e0b2632 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:05.943260 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:05.971387 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2248/4547] 10.222.0.33 () {60 vars in 1363 bytes} [Sat Aug 6 21:10:05 2022] PUT /identity/v3/roles/307117d7c2a444059532ac6640a7b5b7/implies/60a015264f4c412da4288d651404c30f => generated 521 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:05.972406 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb705ea5-3489-4902-8c33-dfc24e0b2632 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:05.974472 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-eb705ea5-3489-4902-8c33-dfc24e0b2632 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:06.036804 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e1c80-e4a6-489e-858f-139a05a028d8 tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:06.124907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb705ea5-3489-4902-8c33-dfc24e0b2632 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:06.135405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e07b8-76c9-4e6a-a644-3e33f787a85c tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62040644427440c0a66defca92a38646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ca61c71974da3a09673e49155f437', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:06.136212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e07b8-76c9-4e6a-a644-3e33f787a85c tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:06.136948 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e07b8-76c9-4e6a-a644-3e33f787a85c tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:06.136948 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e07b8-76c9-4e6a-a644-3e33f787a85c tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] PATH_INFO: `/v3/projects/59d60ded67bd43188a6becb768cadb36` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:06.138165 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e07b8-76c9-4e6a-a644-3e33f787a85c tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: Authorizing `identity:delete_project(project_id=59d60ded67bd43188a6becb768cadb36)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:06.141183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e07b8-76c9-4e6a-a644-3e33f787a85c tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:06.236320 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f86e07b8-76c9-4e6a-a644-3e33f787a85c tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59d60ded67bd43188a6becb768cadb36', 'request_id': 'req-f86e07b8-76c9-4e6a-a644-3e33f787a85c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:06.237862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82036cd-90dd-4db9-88b2-07b3414505f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:06.238786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82036cd-90dd-4db9-88b2-07b3414505f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:06.239130 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82036cd-90dd-4db9-88b2-07b3414505f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:06.239417 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82036cd-90dd-4db9-88b2-07b3414505f3 admin admin] PATH_INFO: `/v3/projects/6f65aeac4595423f89d77bbefddce2eb` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:06.240742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82036cd-90dd-4db9-88b2-07b3414505f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f65aeac4595423f89d77bbefddce2eb)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:06.243605 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82036cd-90dd-4db9-88b2-07b3414505f3 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:06.253661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f86e07b8-76c9-4e6a-a644-3e33f787a85c tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59d60ded67bd43188a6becb768cadb36', 'request_id': 'req-f86e07b8-76c9-4e6a-a644-3e33f787a85c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:06.268655 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f86e07b8-76c9-4e6a-a644-3e33f787a85c tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59d60ded67bd43188a6becb768cadb36', 'request_id': 'req-f86e07b8-76c9-4e6a-a644-3e33f787a85c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:06.292854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f86e07b8-76c9-4e6a-a644-3e33f787a85c tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] The token cache is being invalidate because project 59d60ded67bd43188a6becb768cadb36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:06.293173 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f86e07b8-76c9-4e6a-a644-3e33f787a85c tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:06.294933 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f86e07b8-76c9-4e6a-a644-3e33f787a85c tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:06.296679 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2249/4548] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:10:05 2022] DELETE /identity/v3/projects/59d60ded67bd43188a6becb768cadb36 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:06.297486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e07b8-76c9-4e6a-a644-3e33f787a85c tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:06.305589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f86e07b8-76c9-4e6a-a644-3e33f787a85c tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:06.330861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a82036cd-90dd-4db9-88b2-07b3414505f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f65aeac4595423f89d77bbefddce2eb', 'request_id': 'req-a82036cd-90dd-4db9-88b2-07b3414505f3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:06.337842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a82036cd-90dd-4db9-88b2-07b3414505f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f65aeac4595423f89d77bbefddce2eb', 'request_id': 'req-a82036cd-90dd-4db9-88b2-07b3414505f3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:06.349096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a82036cd-90dd-4db9-88b2-07b3414505f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f65aeac4595423f89d77bbefddce2eb', 'request_id': 'req-a82036cd-90dd-4db9-88b2-07b3414505f3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:06.366304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a82036cd-90dd-4db9-88b2-07b3414505f3 admin admin] The token cache is being invalidate because project 6f65aeac4595423f89d77bbefddce2eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:06.367683 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a82036cd-90dd-4db9-88b2-07b3414505f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:06.368501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a82036cd-90dd-4db9-88b2-07b3414505f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:06.375050 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2300/4549] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:10:05 2022] DELETE /identity/v3/projects/6f65aeac4595423f89d77bbefddce2eb => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:06.376082 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82036cd-90dd-4db9-88b2-07b3414505f3 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:06.378023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a82036cd-90dd-4db9-88b2-07b3414505f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:06.393764 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:06.448619 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e07b8-76c9-4e6a-a644-3e33f787a85c tempest-CredentialsTestJSON-67562135 tempest-CredentialsTestJSON-67562135-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:06.472583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82036cd-90dd-4db9-88b2-07b3414505f3 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:06.479237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4700a-f4a0-43ea-aaa8-d2866160a9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:06.480097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4700a-f4a0-43ea-aaa8-d2866160a9ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:06.480758 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4700a-f4a0-43ea-aaa8-d2866160a9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:06.481143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4700a-f4a0-43ea-aaa8-d2866160a9ff admin admin] PATH_INFO: `/v3/users/9b16de3d5abf48a3a67e3c00fbca370c` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:06.483861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4700a-f4a0-43ea-aaa8-d2866160a9ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b16de3d5abf48a3a67e3c00fbca370c)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:06.486136 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4700a-f4a0-43ea-aaa8-d2866160a9ff admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:06.490271 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:06.554974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5dd4700a-f4a0-43ea-aaa8-d2866160a9ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b16de3d5abf48a3a67e3c00fbca370c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:06.567623 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5dd4700a-f4a0-43ea-aaa8-d2866160a9ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b16de3d5abf48a3a67e3c00fbca370c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:06.568988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5dd4700a-f4a0-43ea-aaa8-d2866160a9ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b16de3d5abf48a3a67e3c00fbca370c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:06.569664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5dd4700a-f4a0-43ea-aaa8-d2866160a9ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b16de3d5abf48a3a67e3c00fbca370c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:06.573213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514ab9d-7a50-4e98-8cc6-2c7c0f6626b5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:06.575775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514ab9d-7a50-4e98-8cc6-2c7c0f6626b5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:06.576060 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514ab9d-7a50-4e98-8cc6-2c7c0f6626b5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:06.576514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514ab9d-7a50-4e98-8cc6-2c7c0f6626b5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/307117d7c2a444059532ac6640a7b5b7/implies` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:06.580418 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5dd4700a-f4a0-43ea-aaa8-d2866160a9ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b16de3d5abf48a3a67e3c00fbca370c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:06.581300 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8514ab9d-7a50-4e98-8cc6-2c7c0f6626b5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=307117d7c2a444059532ac6640a7b5b7)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:06.582182 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-8514ab9d-7a50-4e98-8cc6-2c7c0f6626b5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:10:06.582182 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:10:06.582182 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:10:06.583238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8514ab9d-7a50-4e98-8cc6-2c7c0f6626b5 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:06.600087 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2250/4550] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:10:06 2022] GET /identity/v3/roles/307117d7c2a444059532ac6640a7b5b7/implies => generated 490 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:06.601786 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8efe5-cb2b-461b-840a-bf2dabf6f097 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:06.602074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8efe5-cb2b-461b-840a-bf2dabf6f097 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:06.602345 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8efe5-cb2b-461b-840a-bf2dabf6f097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:06.621411 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2301/4551] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:06 2022] DELETE /identity/v3/users/9b16de3d5abf48a3a67e3c00fbca370c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:06.624276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4700a-f4a0-43ea-aaa8-d2866160a9ff admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:06.626424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5dd4700a-f4a0-43ea-aaa8-d2866160a9ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:06.636952 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-b7a8efe5-cb2b-461b-840a-bf2dabf6f097 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:06.638321 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b7a8efe5-cb2b-461b-840a-bf2dabf6f097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:06.745548 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4700a-f4a0-43ea-aaa8-d2866160a9ff admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:06.753882 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9cce53-03c7-4b2f-a08a-ad7c3726e176 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:06.754831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9cce53-03c7-4b2f-a08a-ad7c3726e176 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:06.755239 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9cce53-03c7-4b2f-a08a-ad7c3726e176 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:06.755619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9cce53-03c7-4b2f-a08a-ad7c3726e176 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/4667ef3b3c2f41edb6a21f228ae5d03f/implies` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:06.756880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9cce53-03c7-4b2f-a08a-ad7c3726e176 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=4667ef3b3c2f41edb6a21f228ae5d03f)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:06.757996 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-1c9cce53-03c7-4b2f-a08a-ad7c3726e176 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:10:06.757996 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:10:06.757996 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:10:06.759202 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9cce53-03c7-4b2f-a08a-ad7c3726e176 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:06.764020 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2251/4552] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:06.765539 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59941d8f-e862-4fea-a0e2-d31a4864fe4b None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:06.766043 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59941d8f-e862-4fea-a0e2-d31a4864fe4b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:06.774869 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59941d8f-e862-4fea-a0e2-d31a4864fe4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:06.776308 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2302/4553] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:10:06 2022] GET /identity/v3/roles/4667ef3b3c2f41edb6a21f228ae5d03f/implies => generated 660 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:06.778689 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e46e91-2704-4828-893b-1f95755028fe None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:06.778980 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e46e91-2704-4828-893b-1f95755028fe None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:06.779252 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e46e91-2704-4828-893b-1f95755028fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:06.819801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-59941d8f-e862-4fea-a0e2-d31a4864fe4b None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:06.821624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-59941d8f-e862-4fea-a0e2-d31a4864fe4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:06.822823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-43e46e91-2704-4828-893b-1f95755028fe None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:06.827470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-43e46e91-2704-4828-893b-1f95755028fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:06.831340 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2252/4554] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:06.832360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59941d8f-e862-4fea-a0e2-d31a4864fe4b None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:06.843630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59941d8f-e862-4fea-a0e2-d31a4864fe4b None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:06.849403 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd505fdd-ad5d-44df-8610-7f0f291ec6d1 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:06.850369 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd505fdd-ad5d-44df-8610-7f0f291ec6d1 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:06.850845 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd505fdd-ad5d-44df-8610-7f0f291ec6d1 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:06.851281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd505fdd-ad5d-44df-8610-7f0f291ec6d1 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/307117d7c2a444059532ac6640a7b5b7/implies/60a015264f4c412da4288d651404c30f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:06.854414 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2303/4555] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:06.855956 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd505fdd-ad5d-44df-8610-7f0f291ec6d1 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=307117d7c2a444059532ac6640a7b5b7, implied_role_id=60a015264f4c412da4288d651404c30f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:06.859297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e46e91-2704-4828-893b-1f95755028fe None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:06.865729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd505fdd-ad5d-44df-8610-7f0f291ec6d1 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:06.879551 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e46e91-2704-4828-893b-1f95755028fe None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:06.888679 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297022b-549b-4f2d-ab99-be9319088e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:06.889151 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2253/4556] 10.222.0.33 () {58 vars in 1347 bytes} [Sat Aug 6 21:10:06 2022] DELETE /identity/v3/roles/307117d7c2a444059532ac6640a7b5b7/implies/60a015264f4c412da4288d651404c30f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:06.889293 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297022b-549b-4f2d-ab99-be9319088e18 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:06.889845 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297022b-549b-4f2d-ab99-be9319088e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:06.890126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297022b-549b-4f2d-ab99-be9319088e18 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:06.890812 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b297022b-549b-4f2d-ab99-be9319088e18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:10:06.891053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd505fdd-ad5d-44df-8610-7f0f291ec6d1 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:06.891169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b297022b-549b-4f2d-ab99-be9319088e18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:06.894960 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b297022b-549b-4f2d-ab99-be9319088e18 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:06.897636 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-bd505fdd-ad5d-44df-8610-7f0f291ec6d1 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:06.910991 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2304/4557] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:06.911935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297022b-549b-4f2d-ab99-be9319088e18 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:06.919092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:06.927287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297022b-549b-4f2d-ab99-be9319088e18 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:07.024490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5858f6-e252-4921-8516-44721e92f35b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:07.025145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5858f6-e252-4921-8516-44721e92f35b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:07.025427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5858f6-e252-4921-8516-44721e92f35b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:07.025843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5858f6-e252-4921-8516-44721e92f35b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/4667ef3b3c2f41edb6a21f228ae5d03f/implies/307117d7c2a444059532ac6640a7b5b7` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:07.027319 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd505fdd-ad5d-44df-8610-7f0f291ec6d1 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:07.028267 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5858f6-e252-4921-8516-44721e92f35b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=4667ef3b3c2f41edb6a21f228ae5d03f, implied_role_id=307117d7c2a444059532ac6640a7b5b7)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:07.030257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5858f6-e252-4921-8516-44721e92f35b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:07.033488 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716cf68-22e5-485e-9059-bc6104e52233 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:07.034103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716cf68-22e5-485e-9059-bc6104e52233 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:07.034434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716cf68-22e5-485e-9059-bc6104e52233 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:07.034898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716cf68-22e5-485e-9059-bc6104e52233 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:07.043133 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2305/4558] 10.222.0.33 () {58 vars in 1347 bytes} [Sat Aug 6 21:10:06 2022] DELETE /identity/v3/roles/4667ef3b3c2f41edb6a21f228ae5d03f/implies/307117d7c2a444059532ac6640a7b5b7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:07.044444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5858f6-e252-4921-8516-44721e92f35b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:07.151424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5858f6-e252-4921-8516-44721e92f35b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:07.160574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48471466-107d-46a2-9033-7249e17b1b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:07.163058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:07.164336 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48471466-107d-46a2-9033-7249e17b1b26 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:07.165070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48471466-107d-46a2-9033-7249e17b1b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:07.166212 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48471466-107d-46a2-9033-7249e17b1b26 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:07.166893 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716cf68-22e5-485e-9059-bc6104e52233 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:07.168431 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716cf68-22e5-485e-9059-bc6104e52233 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:07.170262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48471466-107d-46a2-9033-7249e17b1b26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:07.176596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48471466-107d-46a2-9033-7249e17b1b26 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:07.191657 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2254/4559] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:10:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:10:07.192610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716cf68-22e5-485e-9059-bc6104e52233 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:07.215638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716cf68-22e5-485e-9059-bc6104e52233 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:07.247443 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2306/4560] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:10:07 2022] POST /identity/v3/projects => generated 361 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:07.248381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48471466-107d-46a2-9033-7249e17b1b26 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:07.350381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d60ae-965f-43b8-999d-cc43ed3dde6e tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:07.351022 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d60ae-965f-43b8-999d-cc43ed3dde6e tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:07.351280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d60ae-965f-43b8-999d-cc43ed3dde6e tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:07.351561 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d60ae-965f-43b8-999d-cc43ed3dde6e tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/4667ef3b3c2f41edb6a21f228ae5d03f/implies/aa0eb96c9709455487fe75fb882b1253` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:07.368282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d60ae-965f-43b8-999d-cc43ed3dde6e tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=4667ef3b3c2f41edb6a21f228ae5d03f, implied_role_id=aa0eb96c9709455487fe75fb882b1253)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:07.382645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d60ae-965f-43b8-999d-cc43ed3dde6e tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:07.393711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48471466-107d-46a2-9033-7249e17b1b26 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:07.400714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f46e40b-d13f-4845-9d8d-69f59cd7d67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:07.401571 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46e40b-d13f-4845-9d8d-69f59cd7d67d admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:07.403082 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46e40b-d13f-4845-9d8d-69f59cd7d67d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:07.403415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46e40b-d13f-4845-9d8d-69f59cd7d67d admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:07.404229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f46e40b-d13f-4845-9d8d-69f59cd7d67d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:07.406593 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f46e40b-d13f-4845-9d8d-69f59cd7d67d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:07.412815 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2255/4561] 10.222.0.33 () {58 vars in 1347 bytes} [Sat Aug 6 21:10:07 2022] DELETE /identity/v3/roles/4667ef3b3c2f41edb6a21f228ae5d03f/implies/aa0eb96c9709455487fe75fb882b1253 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:07.420812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d60ae-965f-43b8-999d-cc43ed3dde6e tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:07.444481 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2307/4562] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:10:07 2022] POST /identity/v3/users => generated 281 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:07.449240 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f46e40b-d13f-4845-9d8d-69f59cd7d67d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:07.467366 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f46e40b-d13f-4845-9d8d-69f59cd7d67d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:07.495117 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:07.575882 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d60ae-965f-43b8-999d-cc43ed3dde6e tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:07.578448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02285c2-153d-4864-82cc-183e9cad653a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:07.578915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02285c2-153d-4864-82cc-183e9cad653a admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:07.578915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02285c2-153d-4864-82cc-183e9cad653a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:07.580148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02285c2-153d-4864-82cc-183e9cad653a admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:07.580998 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02285c2-153d-4864-82cc-183e9cad653a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:07.582953 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02285c2-153d-4864-82cc-183e9cad653a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:07.592744 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3715b98-ee4d-4a2d-8f9a-03471da75bb8 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:07.593399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3715b98-ee4d-4a2d-8f9a-03471da75bb8 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:07.594264 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3715b98-ee4d-4a2d-8f9a-03471da75bb8 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:07.594264 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3715b98-ee4d-4a2d-8f9a-03471da75bb8 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/domains/e103285063a44a3cbeb778715f5b1d54` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:07.596979 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2308/4563] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:07 2022] GET /identity/v3/roles => generated 2323 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:07.601481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02285c2-153d-4864-82cc-183e9cad653a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:07.604538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3715b98-ee4d-4a2d-8f9a-03471da75bb8 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 21:10:07.611827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-c3715b98-ee4d-4a2d-8f9a-03471da75bb8 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Could not find domain: e103285063a44a3cbeb778715f5b1d54.: keystone.exception.DomainNotFound: Could not find domain: e103285063a44a3cbeb778715f5b1d54. Aug 06 21:10:07.611827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:10:07.611827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 06 21:10:07.611827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 06 21:10:07.611827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 21:10:07.611827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 21:10:07.611827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 21:10:07.611827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 21:10:07.611827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: e103285063a44a3cbeb778715f5b1d54. Aug 06 21:10:07.611827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:10:07.611827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 21:10:07.611827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:10:07.611827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:10:07.611827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:10:07.611827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:10:07.611827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:10:07.613497 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:10:07.613497 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:10:07.613497 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:10:07.613497 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:10:07.613497 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:10:07.613497 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:10:07.613497 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:10:07.613497 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 06 21:10:07.613497 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 06 21:10:07.613497 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 21:10:07.613497 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 21:10:07.613497 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 21:10:07.613497 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 21:10:07.613497 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:10:07.613497 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:10:07.613497 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 21:10:07.614933 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 21:10:07.614933 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 21:10:07.614933 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 21:10:07.614933 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 21:10:07.614933 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 21:10:07.614933 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 21:10:07.614933 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 21:10:07.614933 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 21:10:07.614933 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 21:10:07.614933 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 21:10:07.614933 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 21:10:07.614933 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 21:10:07.614933 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 21:10:07.614933 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 06 21:10:07.614933 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 21:10:07.614933 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: e103285063a44a3cbeb778715f5b1d54. Aug 06 21:10:07.614933 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:10:07.616390 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2256/4564] 10.222.0.33 () {60 vars in 1249 bytes} [Sat Aug 6 21:10:07 2022] PATCH /identity/v3/domains/e103285063a44a3cbeb778715f5b1d54 => generated 112 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:10:07.617398 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3715b98-ee4d-4a2d-8f9a-03471da75bb8 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:07.630489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02285c2-153d-4864-82cc-183e9cad653a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:07.636929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3715b98-ee4d-4a2d-8f9a-03471da75bb8 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:07.647164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f97ba7-f3af-4547-a9f1-58a41c4429e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:07.647927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f97ba7-f3af-4547-a9f1-58a41c4429e2 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:07.648309 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b5914-6d8a-4705-9071-05f309c115c7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:07.648482 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f97ba7-f3af-4547-a9f1-58a41c4429e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:07.648772 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f97ba7-f3af-4547-a9f1-58a41c4429e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:07.648957 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b5914-6d8a-4705-9071-05f309c115c7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:07.649241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b5914-6d8a-4705-9071-05f309c115c7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:07.649516 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b5914-6d8a-4705-9071-05f309c115c7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/users/bb7dbc691f9845988f3f0b50842f1992` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:07.649782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f97ba7-f3af-4547-a9f1-58a41c4429e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:07.651531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f97ba7-f3af-4547-a9f1-58a41c4429e2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:07.652158 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b5914-6d8a-4705-9071-05f309c115c7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:delete_user(user_id=bb7dbc691f9845988f3f0b50842f1992)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:07.654085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b5914-6d8a-4705-9071-05f309c115c7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:07.686937 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2309/4565] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:07 2022] GET /identity/v3/roles => generated 2323 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:07.689480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f97ba7-f3af-4547-a9f1-58a41c4429e2 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:07.715986 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f97ba7-f3af-4547-a9f1-58a41c4429e2 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:07.731334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a2493-d74b-4100-8fd6-29363b2cb713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:07.732237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a2493-d74b-4100-8fd6-29363b2cb713 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:07.732906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a2493-d74b-4100-8fd6-29363b2cb713 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:07.734015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a2493-d74b-4100-8fd6-29363b2cb713 admin admin] PATH_INFO: `/v3/projects/3f654ca751b54267bf893038d15d906d/users/f700f5602a124adabe7670edec1daaba/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:07.773143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a2493-d74b-4100-8fd6-29363b2cb713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f654ca751b54267bf893038d15d906d, user_id=f700f5602a124adabe7670edec1daaba, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:07.780442 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a2493-d74b-4100-8fd6-29363b2cb713 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:07.795642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-360b5914-6d8a-4705-9071-05f309c115c7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb7dbc691f9845988f3f0b50842f1992'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:07.798902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-360b5914-6d8a-4705-9071-05f309c115c7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb7dbc691f9845988f3f0b50842f1992'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:07.801008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-360b5914-6d8a-4705-9071-05f309c115c7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb7dbc691f9845988f3f0b50842f1992'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:07.817678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-360b5914-6d8a-4705-9071-05f309c115c7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb7dbc691f9845988f3f0b50842f1992'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:07.822590 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2310/4566] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:10:07 2022] PUT /identity/v3/projects/3f654ca751b54267bf893038d15d906d/users/f700f5602a124adabe7670edec1daaba/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:07.835520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168e95e-ca22-48d1-ba2e-159ee2a79ca4 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:07.835933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168e95e-ca22-48d1-ba2e-159ee2a79ca4 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:07.836056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168e95e-ca22-48d1-ba2e-159ee2a79ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:07.864981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-360b5914-6d8a-4705-9071-05f309c115c7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb7dbc691f9845988f3f0b50842f1992'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:07.895610 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2257/4567] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:07 2022] DELETE /identity/v3/users/bb7dbc691f9845988f3f0b50842f1992 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:10:07.897214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b5914-6d8a-4705-9071-05f309c115c7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:07.898452 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-360b5914-6d8a-4705-9071-05f309c115c7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:07.905555 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:07.918125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d168e95e-ca22-48d1-ba2e-159ee2a79ca4 None None] MFA Rules not processed for user `f700f5602a124adabe7670edec1daaba`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:07.919842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d168e95e-ca22-48d1-ba2e-159ee2a79ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:08.039375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b5914-6d8a-4705-9071-05f309c115c7 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:08.045930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a52f7-e4f6-475d-b45e-76b098ed9191 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:08.047379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a52f7-e4f6-475d-b45e-76b098ed9191 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:08.048597 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a52f7-e4f6-475d-b45e-76b098ed9191 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:08.048992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a52f7-e4f6-475d-b45e-76b098ed9191 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/60a015264f4c412da4288d651404c30f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:08.051030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a52f7-e4f6-475d-b45e-76b098ed9191 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:delete_role(role_id=60a015264f4c412da4288d651404c30f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:08.053097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a52f7-e4f6-475d-b45e-76b098ed9191 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:08.081078 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2311/4568] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:10:08.130233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168e95e-ca22-48d1-ba2e-159ee2a79ca4 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:08.131729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d168e95e-ca22-48d1-ba2e-159ee2a79ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:08.158803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-514a52f7-e4f6-475d-b45e-76b098ed9191 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invalidating the token cache because role 60a015264f4c412da4288d651404c30f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:08.159090 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-514a52f7-e4f6-475d-b45e-76b098ed9191 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:08.159867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-514a52f7-e4f6-475d-b45e-76b098ed9191 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:08.167382 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2258/4569] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:07 2022] DELETE /identity/v3/roles/60a015264f4c412da4288d651404c30f => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:08.170829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a52f7-e4f6-475d-b45e-76b098ed9191 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:08.174060 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-514a52f7-e4f6-475d-b45e-76b098ed9191 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:08.261233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168e95e-ca22-48d1-ba2e-159ee2a79ca4 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:08.266009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a52f7-e4f6-475d-b45e-76b098ed9191 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:08.272643 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3756cf-1e8b-461b-8079-9de8cbf407ee tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:08.272917 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3756cf-1e8b-461b-8079-9de8cbf407ee tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:08.273302 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3756cf-1e8b-461b-8079-9de8cbf407ee tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:08.273724 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3756cf-1e8b-461b-8079-9de8cbf407ee tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/groups/c72ce26ea05d49378eb63cefeccc7067` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:08.275696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3756cf-1e8b-461b-8079-9de8cbf407ee tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:delete_group(group_id=c72ce26ea05d49378eb63cefeccc7067)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:08.276819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:08.276993 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-ee3756cf-1e8b-461b-8079-9de8cbf407ee tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:10:08.276993 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:10:08.276993 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:10:08.278267 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3756cf-1e8b-461b-8079-9de8cbf407ee tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:08.358115 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2259/4570] 10.222.0.33 () {58 vars in 1227 bytes} [Sat Aug 6 21:10:08 2022] DELETE /identity/v3/groups/c72ce26ea05d49378eb63cefeccc7067 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:08.360829 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa660fde-679a-4246-bff2-dafa758713b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:08.362557 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa660fde-679a-4246-bff2-dafa758713b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:08.363300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa660fde-679a-4246-bff2-dafa758713b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:08.363585 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa660fde-679a-4246-bff2-dafa758713b5 admin admin] PATH_INFO: `/v3/users/f700f5602a124adabe7670edec1daaba` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:08.364960 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa660fde-679a-4246-bff2-dafa758713b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f700f5602a124adabe7670edec1daaba)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:08.367366 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa660fde-679a-4246-bff2-dafa758713b5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:08.372535 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3756cf-1e8b-461b-8079-9de8cbf407ee tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:08.432301 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:08.461373 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fa660fde-679a-4246-bff2-dafa758713b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f700f5602a124adabe7670edec1daaba'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:08.473147 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fa660fde-679a-4246-bff2-dafa758713b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f700f5602a124adabe7670edec1daaba'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:08.474140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fa660fde-679a-4246-bff2-dafa758713b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f700f5602a124adabe7670edec1daaba'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:08.475826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fa660fde-679a-4246-bff2-dafa758713b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f700f5602a124adabe7670edec1daaba'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:08.488082 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fa660fde-679a-4246-bff2-dafa758713b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f700f5602a124adabe7670edec1daaba'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:08.493062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3756cf-1e8b-461b-8079-9de8cbf407ee tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:08.499787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3eac66-9863-42d0-b4c6-25997737407b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:08.500288 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3eac66-9863-42d0-b4c6-25997737407b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:08.500580 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3eac66-9863-42d0-b4c6-25997737407b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:08.500916 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3eac66-9863-42d0-b4c6-25997737407b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/projects/c38ab9e6a9de4f9abaa70787dad987f4` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:08.503013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3eac66-9863-42d0-b4c6-25997737407b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c38ab9e6a9de4f9abaa70787dad987f4)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:08.505058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3eac66-9863-42d0-b4c6-25997737407b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:08.529446 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2312/4571] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:08 2022] DELETE /identity/v3/users/f700f5602a124adabe7670edec1daaba => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:08.535545 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24060d-0982-40cf-82af-7c99acf26728 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:08.536087 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24060d-0982-40cf-82af-7c99acf26728 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:08.536674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24060d-0982-40cf-82af-7c99acf26728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:08.566331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-ee24060d-0982-40cf-82af-7c99acf26728 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:08.568464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ee24060d-0982-40cf-82af-7c99acf26728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:08.581759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ea3eac66-9863-42d0-b4c6-25997737407b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c38ab9e6a9de4f9abaa70787dad987f4', 'request_id': 'req-ea3eac66-9863-42d0-b4c6-25997737407b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:08.588779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ea3eac66-9863-42d0-b4c6-25997737407b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c38ab9e6a9de4f9abaa70787dad987f4', 'request_id': 'req-ea3eac66-9863-42d0-b4c6-25997737407b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:08.599132 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ea3eac66-9863-42d0-b4c6-25997737407b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c38ab9e6a9de4f9abaa70787dad987f4', 'request_id': 'req-ea3eac66-9863-42d0-b4c6-25997737407b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:08.619935 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ea3eac66-9863-42d0-b4c6-25997737407b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] The token cache is being invalidate because project c38ab9e6a9de4f9abaa70787dad987f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:08.620375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ea3eac66-9863-42d0-b4c6-25997737407b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:08.621111 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ea3eac66-9863-42d0-b4c6-25997737407b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:08.623423 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2260/4572] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:10:08 2022] DELETE /identity/v3/projects/c38ab9e6a9de4f9abaa70787dad987f4 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:08.627503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3eac66-9863-42d0-b4c6-25997737407b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:08.628982 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ea3eac66-9863-42d0-b4c6-25997737407b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:08.655867 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2313/4573] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:08.670104 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24060d-0982-40cf-82af-7c99acf26728 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:08.689118 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ee24060d-0982-40cf-82af-7c99acf26728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:08.743995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:08.751575 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3eac66-9863-42d0-b4c6-25997737407b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:08.756855 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b2440-21a1-4886-8ef6-6f052cb73c44 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:08.757744 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b2440-21a1-4886-8ef6-6f052cb73c44 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:08.758216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b2440-21a1-4886-8ef6-6f052cb73c44 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:08.758706 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b2440-21a1-4886-8ef6-6f052cb73c44 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/domains/a5153a1147c447a885b462c25f843a4f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:08.760181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b2440-21a1-4886-8ef6-6f052cb73c44 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a5153a1147c447a885b462c25f843a4f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:08.761987 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b2440-21a1-4886-8ef6-6f052cb73c44 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:08.787023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24060d-0982-40cf-82af-7c99acf26728 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:08.792130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9c1b2440-21a1-4886-8ef6-6f052cb73c44 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a5153a1147c447a885b462c25f843a4f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:08.793093 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9c1b2440-21a1-4886-8ef6-6f052cb73c44 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a5153a1147c447a885b462c25f843a4f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:08.793508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e1aef-5595-486c-85e6-967fcf975a73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:08.794369 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e1aef-5595-486c-85e6-967fcf975a73 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:08.794904 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e1aef-5595-486c-85e6-967fcf975a73 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:08.795281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e1aef-5595-486c-85e6-967fcf975a73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:08.798586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-244e1aef-5595-486c-85e6-967fcf975a73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:08.819978 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e1aef-5595-486c-85e6-967fcf975a73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:08.823472 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e1aef-5595-486c-85e6-967fcf975a73 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:08.836803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9c1b2440-21a1-4886-8ef6-6f052cb73c44 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a5153a1147c447a885b462c25f843a4f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:08.837742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9c1b2440-21a1-4886-8ef6-6f052cb73c44 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a5153a1147c447a885b462c25f843a4f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:08.840056 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2314/4574] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:10:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:10:08.844495 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2261/4575] 10.222.0.33 () {60 vars in 1249 bytes} [Sat Aug 6 21:10:08 2022] PATCH /identity/v3/domains/a5153a1147c447a885b462c25f843a4f => generated 276 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:10:08.848064 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e1aef-5595-486c-85e6-967fcf975a73 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:08.850731 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-244e1aef-5595-486c-85e6-967fcf975a73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:08.865416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e1aef-5595-486c-85e6-967fcf975a73 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:08.969458 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b2440-21a1-4886-8ef6-6f052cb73c44 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:08.971767 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9c1b2440-21a1-4886-8ef6-6f052cb73c44 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:08.975165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ec3f4-053a-4391-a93e-b6c9809333f3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:08.975871 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ec3f4-053a-4391-a93e-b6c9809333f3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:08.976150 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ec3f4-053a-4391-a93e-b6c9809333f3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:08.976361 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ec3f4-053a-4391-a93e-b6c9809333f3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/domains/a5153a1147c447a885b462c25f843a4f` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:08.997618 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ec3f4-053a-4391-a93e-b6c9809333f3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a5153a1147c447a885b462c25f843a4f)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:09.001474 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ec3f4-053a-4391-a93e-b6c9809333f3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:09.053242 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0f2ec3f4-053a-4391-a93e-b6c9809333f3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a5153a1147c447a885b462c25f843a4f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:09.065186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0f2ec3f4-053a-4391-a93e-b6c9809333f3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a5153a1147c447a885b462c25f843a4f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:09.071777 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:09.176680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b2440-21a1-4886-8ef6-6f052cb73c44 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:09.205130 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0f2ec3f4-053a-4391-a93e-b6c9809333f3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5153a1147c447a885b462c25f843a4f', 'request_id': 'req-0f2ec3f4-053a-4391-a93e-b6c9809333f3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:09.218587 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0f2ec3f4-053a-4391-a93e-b6c9809333f3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5153a1147c447a885b462c25f843a4f', 'request_id': 'req-0f2ec3f4-053a-4391-a93e-b6c9809333f3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:09.236598 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0f2ec3f4-053a-4391-a93e-b6c9809333f3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5153a1147c447a885b462c25f843a4f', 'request_id': 'req-0f2ec3f4-053a-4391-a93e-b6c9809333f3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:09.253597 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b62b33-9f72-49a2-b804-452667c09087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:09.254750 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b62b33-9f72-49a2-b804-452667c09087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:09.255537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b62b33-9f72-49a2-b804-452667c09087 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:09.255537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b62b33-9f72-49a2-b804-452667c09087 admin admin] PATH_INFO: `/v3/projects/4e89e3a691344a5c80cff594dfa57437` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:09.256757 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b62b33-9f72-49a2-b804-452667c09087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e89e3a691344a5c80cff594dfa57437)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:09.258927 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b62b33-9f72-49a2-b804-452667c09087 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:09.260838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0f2ec3f4-053a-4391-a93e-b6c9809333f3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] The token cache is being invalidate because project a5153a1147c447a885b462c25f843a4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:09.261140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0f2ec3f4-053a-4391-a93e-b6c9809333f3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:09.261854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0f2ec3f4-053a-4391-a93e-b6c9809333f3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:09.284120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0f2ec3f4-053a-4391-a93e-b6c9809333f3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a5153a1147c447a885b462c25f843a4f', 'request_id': 'req-0f2ec3f4-053a-4391-a93e-b6c9809333f3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:09.293722 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0f2ec3f4-053a-4391-a93e-b6c9809333f3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a5153a1147c447a885b462c25f843a4f', 'request_id': 'req-0f2ec3f4-053a-4391-a93e-b6c9809333f3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:09.294449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0f2ec3f4-053a-4391-a93e-b6c9809333f3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a5153a1147c447a885b462c25f843a4f', 'request_id': 'req-0f2ec3f4-053a-4391-a93e-b6c9809333f3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:09.305762 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2315/4576] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:10:08 2022] DELETE /identity/v3/domains/a5153a1147c447a885b462c25f843a4f => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:09.309728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ec3f4-053a-4391-a93e-b6c9809333f3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:09.315738 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0f2ec3f4-053a-4391-a93e-b6c9809333f3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:09.344478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:09.363314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f9b62b33-9f72-49a2-b804-452667c09087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e89e3a691344a5c80cff594dfa57437', 'request_id': 'req-f9b62b33-9f72-49a2-b804-452667c09087'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:09.373673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f9b62b33-9f72-49a2-b804-452667c09087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e89e3a691344a5c80cff594dfa57437', 'request_id': 'req-f9b62b33-9f72-49a2-b804-452667c09087'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:09.388512 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f9b62b33-9f72-49a2-b804-452667c09087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e89e3a691344a5c80cff594dfa57437', 'request_id': 'req-f9b62b33-9f72-49a2-b804-452667c09087'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:09.409661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f9b62b33-9f72-49a2-b804-452667c09087 admin admin] The token cache is being invalidate because project 4e89e3a691344a5c80cff594dfa57437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:09.410030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f9b62b33-9f72-49a2-b804-452667c09087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:09.410754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f9b62b33-9f72-49a2-b804-452667c09087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:09.412672 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2262/4577] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:10:08 2022] DELETE /identity/v3/projects/4e89e3a691344a5c80cff594dfa57437 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:09.413508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b62b33-9f72-49a2-b804-452667c09087 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:09.415755 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f9b62b33-9f72-49a2-b804-452667c09087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:09.473648 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ec3f4-053a-4391-a93e-b6c9809333f3 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:09.499793 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b62b33-9f72-49a2-b804-452667c09087 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:09.506689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d41096-e8ea-4b21-ac68-0ac39ab4b63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:09.507347 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d41096-e8ea-4b21-ac68-0ac39ab4b63a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:09.507625 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d41096-e8ea-4b21-ac68-0ac39ab4b63a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:09.507896 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d41096-e8ea-4b21-ac68-0ac39ab4b63a admin admin] PATH_INFO: `/v3/projects/3f654ca751b54267bf893038d15d906d` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:09.509638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d41096-e8ea-4b21-ac68-0ac39ab4b63a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f654ca751b54267bf893038d15d906d)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:09.511884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d41096-e8ea-4b21-ac68-0ac39ab4b63a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:09.513577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:09.569671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f081f3d-2bd1-4fd5-9cf9-a4dc45847a26 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:09.570741 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f081f3d-2bd1-4fd5-9cf9-a4dc45847a26 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:09.571254 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f081f3d-2bd1-4fd5-9cf9-a4dc45847a26 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:09.572284 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f081f3d-2bd1-4fd5-9cf9-a4dc45847a26 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/307117d7c2a444059532ac6640a7b5b7` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:09.574838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f081f3d-2bd1-4fd5-9cf9-a4dc45847a26 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:delete_role(role_id=307117d7c2a444059532ac6640a7b5b7)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:09.577411 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-2f081f3d-2bd1-4fd5-9cf9-a4dc45847a26 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:10:09.577411 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:10:09.577411 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:10:09.592259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f081f3d-2bd1-4fd5-9cf9-a4dc45847a26 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:09.618102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-90d41096-e8ea-4b21-ac68-0ac39ab4b63a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f654ca751b54267bf893038d15d906d', 'request_id': 'req-90d41096-e8ea-4b21-ac68-0ac39ab4b63a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:09.625628 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-90d41096-e8ea-4b21-ac68-0ac39ab4b63a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f654ca751b54267bf893038d15d906d', 'request_id': 'req-90d41096-e8ea-4b21-ac68-0ac39ab4b63a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:09.633329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-90d41096-e8ea-4b21-ac68-0ac39ab4b63a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f654ca751b54267bf893038d15d906d', 'request_id': 'req-90d41096-e8ea-4b21-ac68-0ac39ab4b63a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:09.660885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-90d41096-e8ea-4b21-ac68-0ac39ab4b63a admin admin] The token cache is being invalidate because project 3f654ca751b54267bf893038d15d906d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:09.667148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-90d41096-e8ea-4b21-ac68-0ac39ab4b63a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:09.669223 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-90d41096-e8ea-4b21-ac68-0ac39ab4b63a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:09.677301 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2263/4578] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:10:09 2022] DELETE /identity/v3/projects/3f654ca751b54267bf893038d15d906d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:09.683387 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d41096-e8ea-4b21-ac68-0ac39ab4b63a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:09.685405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-90d41096-e8ea-4b21-ac68-0ac39ab4b63a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:09.687949 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2f081f3d-2bd1-4fd5-9cf9-a4dc45847a26 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invalidating the token cache because role 307117d7c2a444059532ac6640a7b5b7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:09.688807 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2f081f3d-2bd1-4fd5-9cf9-a4dc45847a26 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:09.689610 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2f081f3d-2bd1-4fd5-9cf9-a4dc45847a26 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:09.693675 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2316/4579] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:09 2022] DELETE /identity/v3/roles/307117d7c2a444059532ac6640a7b5b7 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:09.698737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2af50-25b1-4787-83fb-bf60ae1660ec None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:09.699000 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2af50-25b1-4787-83fb-bf60ae1660ec None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:09.699309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2af50-25b1-4787-83fb-bf60ae1660ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:09.744346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-e4a2af50-25b1-4787-83fb-bf60ae1660ec None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:09.748645 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e4a2af50-25b1-4787-83fb-bf60ae1660ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:09.865774 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2317/4580] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:09.867395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2af50-25b1-4787-83fb-bf60ae1660ec None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:09.871308 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e4a2af50-25b1-4787-83fb-bf60ae1660ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:09.879936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d41096-e8ea-4b21-ac68-0ac39ab4b63a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:09.886526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98c7cb-a123-4d3b-b00f-c24cd0ad0785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:09.886526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98c7cb-a123-4d3b-b00f-c24cd0ad0785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:09.886526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98c7cb-a123-4d3b-b00f-c24cd0ad0785 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:09.887144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98c7cb-a123-4d3b-b00f-c24cd0ad0785 admin admin] PATH_INFO: `/v3/users/62040644427440c0a66defca92a38646` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:09.888530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98c7cb-a123-4d3b-b00f-c24cd0ad0785 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62040644427440c0a66defca92a38646)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:09.890670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98c7cb-a123-4d3b-b00f-c24cd0ad0785 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:09.915951 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:09.974435 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2af50-25b1-4787-83fb-bf60ae1660ec None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:09.992133 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdca301-9de8-45da-a16c-a00631e02683 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:09.996325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdca301-9de8-45da-a16c-a00631e02683 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:09.996940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdca301-9de8-45da-a16c-a00631e02683 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:09.997402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdca301-9de8-45da-a16c-a00631e02683 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/aa0eb96c9709455487fe75fb882b1253` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:09.998076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-cb98c7cb-a123-4d3b-b00f-c24cd0ad0785 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62040644427440c0a66defca92a38646'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:09.998793 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-cb98c7cb-a123-4d3b-b00f-c24cd0ad0785 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62040644427440c0a66defca92a38646'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:10.001377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-cb98c7cb-a123-4d3b-b00f-c24cd0ad0785 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62040644427440c0a66defca92a38646'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:10.004638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdca301-9de8-45da-a16c-a00631e02683 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:delete_role(role_id=aa0eb96c9709455487fe75fb882b1253)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:10.006268 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdca301-9de8-45da-a16c-a00631e02683 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:10.014290 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-cb98c7cb-a123-4d3b-b00f-c24cd0ad0785 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62040644427440c0a66defca92a38646'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:10.056743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-cb98c7cb-a123-4d3b-b00f-c24cd0ad0785 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62040644427440c0a66defca92a38646'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:10.080991 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2264/4581] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:09 2022] DELETE /identity/v3/users/62040644427440c0a66defca92a38646 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:10.101031 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bfdca301-9de8-45da-a16c-a00631e02683 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invalidating the token cache because role aa0eb96c9709455487fe75fb882b1253 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:10.101031 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bfdca301-9de8-45da-a16c-a00631e02683 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:10.101031 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bfdca301-9de8-45da-a16c-a00631e02683 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:10.101031 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2318/4582] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:09 2022] DELETE /identity/v3/roles/aa0eb96c9709455487fe75fb882b1253 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:10.101544 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d197b0-d548-40b1-b364-74f15c771df2 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:10.101544 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d197b0-d548-40b1-b364-74f15c771df2 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:10.101544 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d197b0-d548-40b1-b364-74f15c771df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:10.101786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdca301-9de8-45da-a16c-a00631e02683 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:10.103528 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-bfdca301-9de8-45da-a16c-a00631e02683 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:10.155880 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-69d197b0-d548-40b1-b364-74f15c771df2 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:10.163225 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-69d197b0-d548-40b1-b364-74f15c771df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:10.189183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:10.323577 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdca301-9de8-45da-a16c-a00631e02683 tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:10.337322 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeabda0-588b-44fc-a8ae-60d74db22dd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:10.338917 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeabda0-588b-44fc-a8ae-60d74db22dd0 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:10.341031 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeabda0-588b-44fc-a8ae-60d74db22dd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:10.341435 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeabda0-588b-44fc-a8ae-60d74db22dd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:10.347200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5aeabda0-588b-44fc-a8ae-60d74db22dd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:10.348632 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2265/4583] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:10.349318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d197b0-d548-40b1-b364-74f15c771df2 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:10.350852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-69d197b0-d548-40b1-b364-74f15c771df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:10.490492 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeabda0-588b-44fc-a8ae-60d74db22dd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:10.492651 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeabda0-588b-44fc-a8ae-60d74db22dd0 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:10.509256 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2319/4584] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:10:10 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:10:10.510149 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeabda0-588b-44fc-a8ae-60d74db22dd0 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:10.536108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeabda0-588b-44fc-a8ae-60d74db22dd0 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:10.539676 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d197b0-d548-40b1-b364-74f15c771df2 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:10.551805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac9db9-f5d4-4dc4-a579-d364e012480b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '887916818677458a832f520e4d35df2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30efd3b31efe4edc8004897f83c7547b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:10.552464 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac9db9-f5d4-4dc4-a579-d364e012480b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:10.552743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac9db9-f5d4-4dc4-a579-d364e012480b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:10.553017 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac9db9-f5d4-4dc4-a579-d364e012480b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] PATH_INFO: `/v3/roles/4667ef3b3c2f41edb6a21f228ae5d03f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:10.553327 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61daed57-566a-48c1-a29b-5fbf85548c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:10.553963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61daed57-566a-48c1-a29b-5fbf85548c26 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:10.554243 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61daed57-566a-48c1-a29b-5fbf85548c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:10.554517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61daed57-566a-48c1-a29b-5fbf85548c26 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:10.555464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61daed57-566a-48c1-a29b-5fbf85548c26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:10:10.555771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61daed57-566a-48c1-a29b-5fbf85548c26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:10.555896 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac9db9-f5d4-4dc4-a579-d364e012480b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4667ef3b3c2f41edb6a21f228ae5d03f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:10.557430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac9db9-f5d4-4dc4-a579-d364e012480b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:10.559841 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61daed57-566a-48c1-a29b-5fbf85548c26 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:10.591002 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2320/4585] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:10.596486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61daed57-566a-48c1-a29b-5fbf85548c26 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:10.631763 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61daed57-566a-48c1-a29b-5fbf85548c26 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:10.645949 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4415c24-3b2f-498f-afd6-b02fe49e5ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:10.646923 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4415c24-3b2f-498f-afd6-b02fe49e5ab0 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:10.647188 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4415c24-3b2f-498f-afd6-b02fe49e5ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:10.647474 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4415c24-3b2f-498f-afd6-b02fe49e5ab0 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:10.648155 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4415c24-3b2f-498f-afd6-b02fe49e5ab0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:10.650319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4415c24-3b2f-498f-afd6-b02fe49e5ab0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:10.661674 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7fac9db9-f5d4-4dc4-a579-d364e012480b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invalidating the token cache because role 4667ef3b3c2f41edb6a21f228ae5d03f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:10.662397 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7fac9db9-f5d4-4dc4-a579-d364e012480b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:10.663427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7fac9db9-f5d4-4dc4-a579-d364e012480b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:10.685083 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2266/4586] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:10 2022] DELETE /identity/v3/roles/4667ef3b3c2f41edb6a21f228ae5d03f => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:10.687543 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac9db9-f5d4-4dc4-a579-d364e012480b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:10.689322 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7fac9db9-f5d4-4dc4-a579-d364e012480b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:10.749987 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2321/4587] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:10:10 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:10:10.749987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4415c24-3b2f-498f-afd6-b02fe49e5ab0 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:10.754076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b4415c24-3b2f-498f-afd6-b02fe49e5ab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:10.765454 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:10.856904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac9db9-f5d4-4dc4-a579-d364e012480b tempest-RolesV3TestJSON-1364195425 tempest-RolesV3TestJSON-1364195425-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:10.865084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69184a-e9f1-4206-801a-3b1a4d19a867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:10.866467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69184a-e9f1-4206-801a-3b1a4d19a867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:10.866467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69184a-e9f1-4206-801a-3b1a4d19a867 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:10.866467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69184a-e9f1-4206-801a-3b1a4d19a867 admin admin] PATH_INFO: `/v3/projects/b80ca61c71974da3a09673e49155f437` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:10.868541 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69184a-e9f1-4206-801a-3b1a4d19a867 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b80ca61c71974da3a09673e49155f437)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:10.869897 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4415c24-3b2f-498f-afd6-b02fe49e5ab0 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:10.874116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69184a-e9f1-4206-801a-3b1a4d19a867 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:10.875301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342caae-f46d-431b-b893-7b1249bd9c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:10.875985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342caae-f46d-431b-b893-7b1249bd9c86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:10.876416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342caae-f46d-431b-b893-7b1249bd9c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:10.876907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342caae-f46d-431b-b893-7b1249bd9c86 admin admin] PATH_INFO: `/v3/users/27e03ce06b3242c58046ee96895068ee` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:10.878156 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342caae-f46d-431b-b893-7b1249bd9c86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27e03ce06b3242c58046ee96895068ee)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:10.880295 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342caae-f46d-431b-b893-7b1249bd9c86 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:10.916730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:10.957203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-be69184a-e9f1-4206-801a-3b1a4d19a867 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b80ca61c71974da3a09673e49155f437', 'request_id': 'req-be69184a-e9f1-4206-801a-3b1a4d19a867'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:10.963944 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-be69184a-e9f1-4206-801a-3b1a4d19a867 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b80ca61c71974da3a09673e49155f437', 'request_id': 'req-be69184a-e9f1-4206-801a-3b1a4d19a867'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:10.979198 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-be69184a-e9f1-4206-801a-3b1a4d19a867 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b80ca61c71974da3a09673e49155f437', 'request_id': 'req-be69184a-e9f1-4206-801a-3b1a4d19a867'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:10.986537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6342caae-f46d-431b-b893-7b1249bd9c86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27e03ce06b3242c58046ee96895068ee'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:11.005290 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6342caae-f46d-431b-b893-7b1249bd9c86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27e03ce06b3242c58046ee96895068ee'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:11.006774 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6342caae-f46d-431b-b893-7b1249bd9c86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27e03ce06b3242c58046ee96895068ee'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:11.008265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6342caae-f46d-431b-b893-7b1249bd9c86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27e03ce06b3242c58046ee96895068ee'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:11.011206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-be69184a-e9f1-4206-801a-3b1a4d19a867 admin admin] The token cache is being invalidate because project b80ca61c71974da3a09673e49155f437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:11.011788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-be69184a-e9f1-4206-801a-3b1a4d19a867 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:11.013277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-be69184a-e9f1-4206-801a-3b1a4d19a867 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:11.017192 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2267/4588] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:10:10 2022] DELETE /identity/v3/projects/b80ca61c71974da3a09673e49155f437 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:11.018472 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69184a-e9f1-4206-801a-3b1a4d19a867 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:11.024528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-be69184a-e9f1-4206-801a-3b1a4d19a867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:11.027630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6342caae-f46d-431b-b893-7b1249bd9c86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27e03ce06b3242c58046ee96895068ee'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:11.068144 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2322/4589] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:10 2022] DELETE /identity/v3/users/27e03ce06b3242c58046ee96895068ee => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:11.071960 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549d784-aa4d-4b52-9c1b-f0011cd0d585 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:11.072364 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549d784-aa4d-4b52-9c1b-f0011cd0d585 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:11.072739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549d784-aa4d-4b52-9c1b-f0011cd0d585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:11.125060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-4549d784-aa4d-4b52-9c1b-f0011cd0d585 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:11.127718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4549d784-aa4d-4b52-9c1b-f0011cd0d585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:11.134004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69184a-e9f1-4206-801a-3b1a4d19a867 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:11.244007 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2323/4590] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:11.247563 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4bc14-b813-4bb3-a4bf-bf7b13ff6bd6 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:11.249094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7d586-1fd2-4946-9f93-f4cca77a1c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:11.251918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7d586-1fd2-4946-9f93-f4cca77a1c10 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:11.252551 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7d586-1fd2-4946-9f93-f4cca77a1c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:11.252737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4bc14-b813-4bb3-a4bf-bf7b13ff6bd6 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:11.253109 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4bc14-b813-4bb3-a4bf-bf7b13ff6bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:11.253346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7d586-1fd2-4946-9f93-f4cca77a1c10 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:11.255206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7d586-1fd2-4946-9f93-f4cca77a1c10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:11.258187 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7d586-1fd2-4946-9f93-f4cca77a1c10 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:11.325592 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2268/4591] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:10:11 2022] POST /identity/v3/users => generated 293 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:11.336689 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-21e4bc14-b813-4bb3-a4bf-bf7b13ff6bd6 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:11.339777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-21e4bc14-b813-4bb3-a4bf-bf7b13ff6bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:11.353358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d82b36-9335-4f24-8468-c2685dd1e8e3 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:11.353746 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d82b36-9335-4f24-8468-c2685dd1e8e3 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:11.354051 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d82b36-9335-4f24-8468-c2685dd1e8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:11.371286 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2324/4592] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:11.373723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4bc14-b813-4bb3-a4bf-bf7b13ff6bd6 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:11.423509 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4bc14-b813-4bb3-a4bf-bf7b13ff6bd6 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:11.433663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba8860-4750-4741-b940-a647987fdb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:11.434460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba8860-4750-4741-b940-a647987fdb4b admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:11.434713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f9d82b36-9335-4f24-8468-c2685dd1e8e3 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:11.434948 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba8860-4750-4741-b940-a647987fdb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:11.435320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba8860-4750-4741-b940-a647987fdb4b admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:11.435935 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f9d82b36-9335-4f24-8468-c2685dd1e8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:11.436157 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba8860-4750-4741-b940-a647987fdb4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:11.437883 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba8860-4750-4741-b940-a647987fdb4b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:11.456268 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2325/4593] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:11.456268 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba8860-4750-4741-b940-a647987fdb4b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:11.464566 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-39ba8860-4750-4741-b940-a647987fdb4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:11.477133 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:11.480125 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2269/4594] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:11.480996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d82b36-9335-4f24-8468-c2685dd1e8e3 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:11.503645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d82b36-9335-4f24-8468-c2685dd1e8e3 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:11.515157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e94a4-efec-4857-b7b2-288c90d1c4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:11.515691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e94a4-efec-4857-b7b2-288c90d1c4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:11.515967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e94a4-efec-4857-b7b2-288c90d1c4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:11.516234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e94a4-efec-4857-b7b2-288c90d1c4c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:11.517427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e94a4-efec-4857-b7b2-288c90d1c4c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:11.519404 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e94a4-efec-4857-b7b2-288c90d1c4c6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:11.548350 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2270/4595] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:11.553982 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e94a4-efec-4857-b7b2-288c90d1c4c6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:11.584494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e94a4-efec-4857-b7b2-288c90d1c4c6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:11.631976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba8860-4750-4741-b940-a647987fdb4b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:11.632787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0d8d1-223f-42d4-ba90-3df48e8d2e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:11.633427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0d8d1-223f-42d4-ba90-3df48e8d2e8f admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:11.633710 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0d8d1-223f-42d4-ba90-3df48e8d2e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:11.633982 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0d8d1-223f-42d4-ba90-3df48e8d2e8f admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:11.634690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0d8d1-223f-42d4-ba90-3df48e8d2e8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:10:11.634993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0d8d1-223f-42d4-ba90-3df48e8d2e8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:11.636645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0d8d1-223f-42d4-ba90-3df48e8d2e8f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:11.642852 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7854d-3491-44f9-abc6-3c412ad17abb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:11.647167 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7854d-3491-44f9-abc6-3c412ad17abb service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:11.648368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7854d-3491-44f9-abc6-3c412ad17abb service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:11.648915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7854d-3491-44f9-abc6-3c412ad17abb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:11.663245 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2271/4596] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:11.663245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0d8d1-223f-42d4-ba90-3df48e8d2e8f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:11.674314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0d8d1-223f-42d4-ba90-3df48e8d2e8f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:11.679526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb599ce-04e5-4094-93b4-2a10cb199525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:11.680476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb599ce-04e5-4094-93b4-2a10cb199525 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:11.680750 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb599ce-04e5-4094-93b4-2a10cb199525 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:11.681022 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb599ce-04e5-4094-93b4-2a10cb199525 admin admin] PATH_INFO: `/v3/projects/f4980bb21b59412ca004d8069525d3b9/users/1d7b9e27983940dcaf0e92f62273c588/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:11.691031 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:11.699653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7854d-3491-44f9-abc6-3c412ad17abb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:11.701563 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7854d-3491-44f9-abc6-3c412ad17abb service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:11.716698 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb599ce-04e5-4094-93b4-2a10cb199525 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4980bb21b59412ca004d8069525d3b9, user_id=1d7b9e27983940dcaf0e92f62273c588, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:11.720500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb599ce-04e5-4094-93b4-2a10cb199525 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:11.734715 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2326/4597] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:10:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:10:11.738671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7854d-3491-44f9-abc6-3c412ad17abb service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:11.747773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7854d-3491-44f9-abc6-3c412ad17abb service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:11.763475 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2272/4598] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:10:11 2022] PUT /identity/v3/projects/f4980bb21b59412ca004d8069525d3b9/users/1d7b9e27983940dcaf0e92f62273c588/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:11.770323 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdae855-346f-4a61-b11d-87617b0f149d None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:11.770880 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdae855-346f-4a61-b11d-87617b0f149d None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:11.771219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdae855-346f-4a61-b11d-87617b0f149d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:11.795823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-dcdae855-346f-4a61-b11d-87617b0f149d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:11.798519 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-dcdae855-346f-4a61-b11d-87617b0f149d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:11.873966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d787789-d52b-4e18-b22c-db4ca43ee1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:11.876126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d787789-d52b-4e18-b22c-db4ca43ee1a9 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:11.876490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d787789-d52b-4e18-b22c-db4ca43ee1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:11.876873 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d787789-d52b-4e18-b22c-db4ca43ee1a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:11.879028 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d787789-d52b-4e18-b22c-db4ca43ee1a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:11.883803 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d787789-d52b-4e18-b22c-db4ca43ee1a9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:11.943360 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2327/4599] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:10:11 2022] POST /identity/v3/projects => generated 367 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:11.945499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d787789-d52b-4e18-b22c-db4ca43ee1a9 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:11.955161 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2273/4600] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:10:12.004418 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdae855-346f-4a61-b11d-87617b0f149d None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:12.006736 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-dcdae855-346f-4a61-b11d-87617b0f149d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:12.093645 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d787789-d52b-4e18-b22c-db4ca43ee1a9 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:12.110635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6794f2d-f5c5-40e9-9394-8080590b97b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:12.111279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6794f2d-f5c5-40e9-9394-8080590b97b3 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:12.111555 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6794f2d-f5c5-40e9-9394-8080590b97b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:12.111830 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6794f2d-f5c5-40e9-9394-8080590b97b3 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:12.113347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6794f2d-f5c5-40e9-9394-8080590b97b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:12.115491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6794f2d-f5c5-40e9-9394-8080590b97b3 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:12.131449 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdae855-346f-4a61-b11d-87617b0f149d None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:12.169000 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2328/4601] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:10:11 2022] POST /identity/v3/users => generated 284 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:12.172831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6794f2d-f5c5-40e9-9394-8080590b97b3 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:12.195542 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6794f2d-f5c5-40e9-9394-8080590b97b3 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:12.206763 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a95768-305a-4a68-8bad-c3549b8d1f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:12.209001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a95768-305a-4a68-8bad-c3549b8d1f90 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:12.209452 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a95768-305a-4a68-8bad-c3549b8d1f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:12.209965 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a95768-305a-4a68-8bad-c3549b8d1f90 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:12.211177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a95768-305a-4a68-8bad-c3549b8d1f90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:12.213049 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a95768-305a-4a68-8bad-c3549b8d1f90 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:12.240112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ef9ee-7693-46a7-acf7-84237f9f6a6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:12.241383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ef9ee-7693-46a7-acf7-84237f9f6a6d service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:12.242467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ef9ee-7693-46a7-acf7-84237f9f6a6d service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:12.242779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ef9ee-7693-46a7-acf7-84237f9f6a6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:12.259689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ef9ee-7693-46a7-acf7-84237f9f6a6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:12.263181 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2329/4602] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:12.263487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ef9ee-7693-46a7-acf7-84237f9f6a6d service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:12.278843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a95768-305a-4a68-8bad-c3549b8d1f90 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:12.283865 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2274/4603] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:10:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:10:12.314469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a95768-305a-4a68-8bad-c3549b8d1f90 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:12.335341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ef395-7f4b-4762-b43c-911019de8bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:12.336765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ef395-7f4b-4762-b43c-911019de8bcd admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:12.337246 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ef395-7f4b-4762-b43c-911019de8bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:12.337583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ef395-7f4b-4762-b43c-911019de8bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:12.339744 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ef395-7f4b-4762-b43c-911019de8bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:12.344221 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ef395-7f4b-4762-b43c-911019de8bcd admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:12.366137 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2330/4604] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:12.369689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ef9ee-7693-46a7-acf7-84237f9f6a6d service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:12.381079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb804334-a4c7-413d-bcc0-c50dbb3d5016 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:12.381448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb804334-a4c7-413d-bcc0-c50dbb3d5016 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:12.381915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb804334-a4c7-413d-bcc0-c50dbb3d5016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:12.385614 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ef9ee-7693-46a7-acf7-84237f9f6a6d service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:12.395166 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:12.402974 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2847fe-c813-4657-b97a-9aa6930e090e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:12.403809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2847fe-c813-4657-b97a-9aa6930e090e admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:12.404095 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2847fe-c813-4657-b97a-9aa6930e090e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:12.404372 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2847fe-c813-4657-b97a-9aa6930e090e admin admin] PATH_INFO: `/v3/projects/da5a3bb9462d49d8a04fadc576b17a47/users/5341b1d8513f4c949ed62101039b983e/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:12.435597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-fb804334-a4c7-413d-bcc0-c50dbb3d5016 None None] MFA Rules not processed for user `17004e771b6a47cb88e8aa31e197b25a`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:12.437424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-fb804334-a4c7-413d-bcc0-c50dbb3d5016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:12.442107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2847fe-c813-4657-b97a-9aa6930e090e admin admin] RBAC: Authorizing `identity:create_grant(project_id=da5a3bb9462d49d8a04fadc576b17a47, user_id=5341b1d8513f4c949ed62101039b983e, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:12.458774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2847fe-c813-4657-b97a-9aa6930e090e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:12.482624 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2275/4605] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:10:12 2022] PUT /identity/v3/projects/da5a3bb9462d49d8a04fadc576b17a47/users/5341b1d8513f4c949ed62101039b983e/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:12.490583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90703067-c41c-4b5a-af9b-14c5eeefb6d5 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:12.490910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90703067-c41c-4b5a-af9b-14c5eeefb6d5 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:12.491176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90703067-c41c-4b5a-af9b-14c5eeefb6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:12.527299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-90703067-c41c-4b5a-af9b-14c5eeefb6d5 None None] MFA Rules not processed for user `5341b1d8513f4c949ed62101039b983e`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:12.529006 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-90703067-c41c-4b5a-af9b-14c5eeefb6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:12.541674 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2331/4606] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:12.543844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:12.552656 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93825fe-5ff0-4231-986c-638b6be8e642 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:12.553578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93825fe-5ff0-4231-986c-638b6be8e642 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:12.554105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93825fe-5ff0-4231-986c-638b6be8e642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:12.578048 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-c93825fe-5ff0-4231-986c-638b6be8e642 None None] MFA Rules not processed for user `17004e771b6a47cb88e8aa31e197b25a`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:12.579914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c93825fe-5ff0-4231-986c-638b6be8e642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:12.656715 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2276/4607] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:10:12.661646 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90703067-c41c-4b5a-af9b-14c5eeefb6d5 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:12.695029 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2332/4608] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:10:12.706914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93825fe-5ff0-4231-986c-638b6be8e642 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:12.708878 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c93825fe-5ff0-4231-986c-638b6be8e642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:12.776925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90703067-c41c-4b5a-af9b-14c5eeefb6d5 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:12.784462 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5370afe-77e3-4af2-8f42-4ced364525b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:12.785084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5370afe-77e3-4af2-8f42-4ced364525b8 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:12.785516 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5370afe-77e3-4af2-8f42-4ced364525b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:12.786365 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5370afe-77e3-4af2-8f42-4ced364525b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:12.786564 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5370afe-77e3-4af2-8f42-4ced364525b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:12.788800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5370afe-77e3-4af2-8f42-4ced364525b8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:12.831541 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2277/4609] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:10:12 2022] POST /identity/v3/projects => generated 367 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:12.831768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93825fe-5ff0-4231-986c-638b6be8e642 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:12.833591 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5370afe-77e3-4af2-8f42-4ced364525b8 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:12.883968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:12.945243 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb726e94-71ef-4cb7-b6f3-0c1b58456063 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:12.945875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb726e94-71ef-4cb7-b6f3-0c1b58456063 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:12.946152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb726e94-71ef-4cb7-b6f3-0c1b58456063 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:12.946421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb726e94-71ef-4cb7-b6f3-0c1b58456063 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:12.947856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5370afe-77e3-4af2-8f42-4ced364525b8 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:12.955239 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768db17-91b9-4130-b7f1-ce47e40ed719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:12.956491 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768db17-91b9-4130-b7f1-ce47e40ed719 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:12.956981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768db17-91b9-4130-b7f1-ce47e40ed719 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:12.957481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768db17-91b9-4130-b7f1-ce47e40ed719 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:12.959395 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b768db17-91b9-4130-b7f1-ce47e40ed719 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:12.962325 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b768db17-91b9-4130-b7f1-ce47e40ed719 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:13.001022 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2278/4610] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:10:12 2022] POST /identity/v3/users => generated 290 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:10:13.001594 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768db17-91b9-4130-b7f1-ce47e40ed719 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:13.017932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768db17-91b9-4130-b7f1-ce47e40ed719 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:13.023124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097884e-2096-4723-ba62-23da37d74b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:13.024505 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097884e-2096-4723-ba62-23da37d74b89 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:13.025002 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097884e-2096-4723-ba62-23da37d74b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:13.025580 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097884e-2096-4723-ba62-23da37d74b89 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:13.026400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097884e-2096-4723-ba62-23da37d74b89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:13.027016 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb726e94-71ef-4cb7-b6f3-0c1b58456063 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:13.028697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb726e94-71ef-4cb7-b6f3-0c1b58456063 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:13.032501 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097884e-2096-4723-ba62-23da37d74b89 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:13.058026 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2333/4612] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:10:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:10:13.058244 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2279/4612] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:13.061404 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb726e94-71ef-4cb7-b6f3-0c1b58456063 service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:13.092805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb726e94-71ef-4cb7-b6f3-0c1b58456063 service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:13.108041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f137eae-b139-40f9-8d32-c989b3b8b97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:13.109385 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f137eae-b139-40f9-8d32-c989b3b8b97f admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:13.109385 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f137eae-b139-40f9-8d32-c989b3b8b97f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:13.116026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f137eae-b139-40f9-8d32-c989b3b8b97f admin admin] PATH_INFO: `/v3/projects/f62390481db34d4d94f32dd793cd9917/users/d17cdc909fbb49ff9a70ba7411019d73/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:13.136911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f137eae-b139-40f9-8d32-c989b3b8b97f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f62390481db34d4d94f32dd793cd9917, user_id=d17cdc909fbb49ff9a70ba7411019d73, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:13.140885 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f137eae-b139-40f9-8d32-c989b3b8b97f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:13.162482 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2334/4613] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:10:13 2022] PUT /identity/v3/projects/f62390481db34d4d94f32dd793cd9917/users/d17cdc909fbb49ff9a70ba7411019d73/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:13.163922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097884e-2096-4723-ba62-23da37d74b89 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:13.180136 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097884e-2096-4723-ba62-23da37d74b89 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:13.202620 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:13.276307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb6816-2b3f-4b6d-9b1f-beba619abd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:13.277390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb6816-2b3f-4b6d-9b1f-beba619abd61 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:13.277800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb6816-2b3f-4b6d-9b1f-beba619abd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:13.278001 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb6816-2b3f-4b6d-9b1f-beba619abd61 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:13.278803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb6816-2b3f-4b6d-9b1f-beba619abd61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:13.281036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb6816-2b3f-4b6d-9b1f-beba619abd61 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:13.306037 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f137eae-b139-40f9-8d32-c989b3b8b97f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:13.306486 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2280/4614] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:13.318290 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f137eae-b139-40f9-8d32-c989b3b8b97f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:13.325547 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dcc4c8-c724-45b2-bfe2-691f479ff26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:13.326453 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcc4c8-c724-45b2-bfe2-691f479ff26b admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:13.326921 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcc4c8-c724-45b2-bfe2-691f479ff26b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:13.327371 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcc4c8-c724-45b2-bfe2-691f479ff26b admin admin] PATH_INFO: `/v3/projects/f62390481db34d4d94f32dd793cd9917/users/d17cdc909fbb49ff9a70ba7411019d73/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:13.327568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb6816-2b3f-4b6d-9b1f-beba619abd61 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:13.329877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e5cb6816-2b3f-4b6d-9b1f-beba619abd61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:13.330903 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dcc4c8-c724-45b2-bfe2-691f479ff26b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f62390481db34d4d94f32dd793cd9917, user_id=d17cdc909fbb49ff9a70ba7411019d73, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:13.334450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dcc4c8-c724-45b2-bfe2-691f479ff26b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:13.350286 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2335/4615] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:10:13 2022] PUT /identity/v3/projects/f62390481db34d4d94f32dd793cd9917/users/d17cdc909fbb49ff9a70ba7411019d73/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:10:13.361058 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264f437-7c00-49c9-8c66-7a2186411457 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:13.361835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb6816-2b3f-4b6d-9b1f-beba619abd61 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:13.362623 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264f437-7c00-49c9-8c66-7a2186411457 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:13.363061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264f437-7c00-49c9-8c66-7a2186411457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:13.447853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-6264f437-7c00-49c9-8c66-7a2186411457 None None] MFA Rules not processed for user `d17cdc909fbb49ff9a70ba7411019d73`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:13.451023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6264f437-7c00-49c9-8c66-7a2186411457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:13.459245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f747b63-41e5-402e-ad40-78521a39ce74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:13.461434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f747b63-41e5-402e-ad40-78521a39ce74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:13.461434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f747b63-41e5-402e-ad40-78521a39ce74 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:13.462381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f747b63-41e5-402e-ad40-78521a39ce74 admin admin] PATH_INFO: `/v3/projects/42912bfdbcd3468cb021cef15d7014e4` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:13.465728 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f747b63-41e5-402e-ad40-78521a39ce74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42912bfdbcd3468cb021cef15d7014e4)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:13.468147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f747b63-41e5-402e-ad40-78521a39ce74 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:13.570292 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1f747b63-41e5-402e-ad40-78521a39ce74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42912bfdbcd3468cb021cef15d7014e4', 'request_id': 'req-1f747b63-41e5-402e-ad40-78521a39ce74'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:13.576747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1f747b63-41e5-402e-ad40-78521a39ce74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42912bfdbcd3468cb021cef15d7014e4', 'request_id': 'req-1f747b63-41e5-402e-ad40-78521a39ce74'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:13.584398 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1f747b63-41e5-402e-ad40-78521a39ce74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42912bfdbcd3468cb021cef15d7014e4', 'request_id': 'req-1f747b63-41e5-402e-ad40-78521a39ce74'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:13.600618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1f747b63-41e5-402e-ad40-78521a39ce74 admin admin] The token cache is being invalidate because project 42912bfdbcd3468cb021cef15d7014e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:13.601265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1f747b63-41e5-402e-ad40-78521a39ce74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:13.602334 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1f747b63-41e5-402e-ad40-78521a39ce74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:13.604720 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2281/4616] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:10:13 2022] DELETE /identity/v3/projects/42912bfdbcd3468cb021cef15d7014e4 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:13.606147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f747b63-41e5-402e-ad40-78521a39ce74 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:13.609129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1f747b63-41e5-402e-ad40-78521a39ce74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:13.621118 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2336/4617] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:10:13.622590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6264f437-7c00-49c9-8c66-7a2186411457 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:13.646093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6264f437-7c00-49c9-8c66-7a2186411457 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:13.673140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:13.690744 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f747b63-41e5-402e-ad40-78521a39ce74 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:13.691714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:13.698478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b7076-ae06-435c-8f12-d48e189e70db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:13.699435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b7076-ae06-435c-8f12-d48e189e70db service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:13.700178 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b7076-ae06-435c-8f12-d48e189e70db service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:13.700865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b7076-ae06-435c-8f12-d48e189e70db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:13.703839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ae3b7076-ae06-435c-8f12-d48e189e70db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:13.718860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b7076-ae06-435c-8f12-d48e189e70db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:13.721862 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b7076-ae06-435c-8f12-d48e189e70db service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:13.734003 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2282/4618] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:10:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:10:13.735852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b7076-ae06-435c-8f12-d48e189e70db service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:13.737816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ae3b7076-ae06-435c-8f12-d48e189e70db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:13.805733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d93d2-5c16-4975-a00f-12b0ccfb5b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:13.806406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d93d2-5c16-4975-a00f-12b0ccfb5b0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:13.806711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d93d2-5c16-4975-a00f-12b0ccfb5b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:13.806984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d93d2-5c16-4975-a00f-12b0ccfb5b0e admin admin] PATH_INFO: `/v3/users/887916818677458a832f520e4d35df2c` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:13.811201 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d93d2-5c16-4975-a00f-12b0ccfb5b0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=887916818677458a832f520e4d35df2c)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:13.815907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d93d2-5c16-4975-a00f-12b0ccfb5b0e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:13.912849 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b7076-ae06-435c-8f12-d48e189e70db service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:13.925845 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d34d93d2-5c16-4975-a00f-12b0ccfb5b0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '887916818677458a832f520e4d35df2c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:13.928550 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8bc29-35bc-48f1-a679-17a54137fe20 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17cdc909fbb49ff9a70ba7411019d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f62390481db34d4d94f32dd793cd9917', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:13.929869 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8bc29-35bc-48f1-a679-17a54137fe20 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:13.930258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8bc29-35bc-48f1-a679-17a54137fe20 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:13.930665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8bc29-35bc-48f1-a679-17a54137fe20 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:13.931435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8bc29-35bc-48f1-a679-17a54137fe20 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:13.933794 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-40c8bc29-35bc-48f1-a679-17a54137fe20 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:10:13.933794 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:10:13.933794 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:10:13.935019 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8bc29-35bc-48f1-a679-17a54137fe20 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:13.936646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d34d93d2-5c16-4975-a00f-12b0ccfb5b0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '887916818677458a832f520e4d35df2c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:13.937642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d34d93d2-5c16-4975-a00f-12b0ccfb5b0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '887916818677458a832f520e4d35df2c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:13.939028 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d34d93d2-5c16-4975-a00f-12b0ccfb5b0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '887916818677458a832f520e4d35df2c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:13.955248 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d34d93d2-5c16-4975-a00f-12b0ccfb5b0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '887916818677458a832f520e4d35df2c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:13.973860 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2283/4619] 10.222.0.33 () {60 vars in 1150 bytes} [Sat Aug 6 21:10:13 2022] POST /identity/v3/domains => generated 277 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:13.978890 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8bc29-35bc-48f1-a679-17a54137fe20 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:13.983471 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-40c8bc29-35bc-48f1-a679-17a54137fe20 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:13.997201 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2337/4620] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:13 2022] DELETE /identity/v3/users/887916818677458a832f520e4d35df2c => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:14.101958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8bc29-35bc-48f1-a679-17a54137fe20 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:14.184904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff010c-480e-4af2-97dd-47af9e5ceeec tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17cdc909fbb49ff9a70ba7411019d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f62390481db34d4d94f32dd793cd9917', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:14.186742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff010c-480e-4af2-97dd-47af9e5ceeec tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:14.186742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff010c-480e-4af2-97dd-47af9e5ceeec tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:14.186742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff010c-480e-4af2-97dd-47af9e5ceeec tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:14.187053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff010c-480e-4af2-97dd-47af9e5ceeec tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:14.190012 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff010c-480e-4af2-97dd-47af9e5ceeec tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:14.221517 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2284/4621] 10.222.0.33 () {60 vars in 1150 bytes} [Sat Aug 6 21:10:13 2022] POST /identity/v3/domains => generated 275 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:14.226205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d93d2-5c16-4975-a00f-12b0ccfb5b0e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:14.239083 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d93d2-5c16-4975-a00f-12b0ccfb5b0e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:14.320840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1398fd4-7766-4050-a8a5-d2c467fd8472 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17cdc909fbb49ff9a70ba7411019d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f62390481db34d4d94f32dd793cd9917', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:14.321550 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1398fd4-7766-4050-a8a5-d2c467fd8472 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:14.322525 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1398fd4-7766-4050-a8a5-d2c467fd8472 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:14.322525 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1398fd4-7766-4050-a8a5-d2c467fd8472 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:14.323142 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1398fd4-7766-4050-a8a5-d2c467fd8472 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:14.325120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1398fd4-7766-4050-a8a5-d2c467fd8472 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:14.363807 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2338/4622] 10.222.0.33 () {60 vars in 1150 bytes} [Sat Aug 6 21:10:14 2022] POST /identity/v3/domains => generated 277 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:14.365622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff010c-480e-4af2-97dd-47af9e5ceeec tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:14.384153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff010c-480e-4af2-97dd-47af9e5ceeec tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:14.416066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:14.501656 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f40ef5-4390-475f-b15e-c3371ee166bc tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17cdc909fbb49ff9a70ba7411019d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f62390481db34d4d94f32dd793cd9917', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:14.502262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f40ef5-4390-475f-b15e-c3371ee166bc tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:14.502541 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f40ef5-4390-475f-b15e-c3371ee166bc tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:14.502840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f40ef5-4390-475f-b15e-c3371ee166bc tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:14.503510 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f40ef5-4390-475f-b15e-c3371ee166bc tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:14.505132 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f40ef5-4390-475f-b15e-c3371ee166bc tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:14.538422 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2285/4623] 10.222.0.33 () {60 vars in 1150 bytes} [Sat Aug 6 21:10:14 2022] POST /identity/v3/domains => generated 279 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:14.542716 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1398fd4-7766-4050-a8a5-d2c467fd8472 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:14.559868 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1398fd4-7766-4050-a8a5-d2c467fd8472 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:14.635500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:14.716771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff98e7-a019-4c76-9a3e-1ef7c79966a5 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17cdc909fbb49ff9a70ba7411019d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f62390481db34d4d94f32dd793cd9917', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:14.717424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff98e7-a019-4c76-9a3e-1ef7c79966a5 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:14.718016 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff98e7-a019-4c76-9a3e-1ef7c79966a5 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:14.718016 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff98e7-a019-4c76-9a3e-1ef7c79966a5 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] PATH_INFO: `/v3/domains/90f2a66cc4cc44c9844f5e21d250905e` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:14.734741 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff98e7-a019-4c76-9a3e-1ef7c79966a5 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=90f2a66cc4cc44c9844f5e21d250905e)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:14.743776 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff98e7-a019-4c76-9a3e-1ef7c79966a5 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:14.805725 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0aff98e7-a019-4c76-9a3e-1ef7c79966a5 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '90f2a66cc4cc44c9844f5e21d250905e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:14.814353 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0aff98e7-a019-4c76-9a3e-1ef7c79966a5 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '90f2a66cc4cc44c9844f5e21d250905e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:14.912671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0aff98e7-a019-4c76-9a3e-1ef7c79966a5 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90f2a66cc4cc44c9844f5e21d250905e', 'request_id': 'req-0aff98e7-a019-4c76-9a3e-1ef7c79966a5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:14.920793 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0aff98e7-a019-4c76-9a3e-1ef7c79966a5 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90f2a66cc4cc44c9844f5e21d250905e', 'request_id': 'req-0aff98e7-a019-4c76-9a3e-1ef7c79966a5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:14.949077 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0aff98e7-a019-4c76-9a3e-1ef7c79966a5 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90f2a66cc4cc44c9844f5e21d250905e', 'request_id': 'req-0aff98e7-a019-4c76-9a3e-1ef7c79966a5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:14.967662 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0aff98e7-a019-4c76-9a3e-1ef7c79966a5 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] The token cache is being invalidate because project 90f2a66cc4cc44c9844f5e21d250905e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:14.968494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0aff98e7-a019-4c76-9a3e-1ef7c79966a5 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:14.971462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0aff98e7-a019-4c76-9a3e-1ef7c79966a5 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:14.987082 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0aff98e7-a019-4c76-9a3e-1ef7c79966a5 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '90f2a66cc4cc44c9844f5e21d250905e', 'request_id': 'req-0aff98e7-a019-4c76-9a3e-1ef7c79966a5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:14.992266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0aff98e7-a019-4c76-9a3e-1ef7c79966a5 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '90f2a66cc4cc44c9844f5e21d250905e', 'request_id': 'req-0aff98e7-a019-4c76-9a3e-1ef7c79966a5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:14.993144 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0aff98e7-a019-4c76-9a3e-1ef7c79966a5 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '90f2a66cc4cc44c9844f5e21d250905e', 'request_id': 'req-0aff98e7-a019-4c76-9a3e-1ef7c79966a5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:15.004918 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2339/4624] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:10:14 2022] DELETE /identity/v3/domains/90f2a66cc4cc44c9844f5e21d250905e => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:15.008079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f40ef5-4390-475f-b15e-c3371ee166bc tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:15.010202 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e6f40ef5-4390-475f-b15e-c3371ee166bc tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:15.025249 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f40ef5-4390-475f-b15e-c3371ee166bc tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:15.169297 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98170edd-51bf-49fd-91d4-efba2958273f tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17cdc909fbb49ff9a70ba7411019d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f62390481db34d4d94f32dd793cd9917', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:15.169941 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98170edd-51bf-49fd-91d4-efba2958273f tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:15.170297 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98170edd-51bf-49fd-91d4-efba2958273f tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:15.170525 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98170edd-51bf-49fd-91d4-efba2958273f tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:15.171164 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98170edd-51bf-49fd-91d4-efba2958273f tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:15.172824 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98170edd-51bf-49fd-91d4-efba2958273f tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:15.208020 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2286/4625] 10.222.0.33 () {60 vars in 1149 bytes} [Sat Aug 6 21:10:15 2022] POST /identity/v3/domains => generated 249 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:10:15.212469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff98e7-a019-4c76-9a3e-1ef7c79966a5 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:15.225730 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff98e7-a019-4c76-9a3e-1ef7c79966a5 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:15.412939 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98170edd-51bf-49fd-91d4-efba2958273f tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:15.418682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-98170edd-51bf-49fd-91d4-efba2958273f tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:15.471023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c32e3-ad60-4a0e-ae4b-7bd0cb479d2d tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17cdc909fbb49ff9a70ba7411019d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f62390481db34d4d94f32dd793cd9917', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:15.471670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c32e3-ad60-4a0e-ae4b-7bd0cb479d2d tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:15.471959 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c32e3-ad60-4a0e-ae4b-7bd0cb479d2d tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:15.472234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c32e3-ad60-4a0e-ae4b-7bd0cb479d2d tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] PATH_INFO: `/v3/domains/39c22be0b31b46e2a42ac8fe4453e451` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:15.504514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13c32e3-ad60-4a0e-ae4b-7bd0cb479d2d tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=39c22be0b31b46e2a42ac8fe4453e451)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:15.505549 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-a13c32e3-ad60-4a0e-ae4b-7bd0cb479d2d tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:10:15.505549 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:10:15.505549 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:10:15.506455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13c32e3-ad60-4a0e-ae4b-7bd0cb479d2d tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:15.525319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:15.568750 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98170edd-51bf-49fd-91d4-efba2958273f tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:15.584403 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8eb76-bcf5-4e9f-a6ed-e9f6a8bca8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:15.585055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8eb76-bcf5-4e9f-a6ed-e9f6a8bca8a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:15.585331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8eb76-bcf5-4e9f-a6ed-e9f6a8bca8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:15.585599 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8eb76-bcf5-4e9f-a6ed-e9f6a8bca8a6 admin admin] PATH_INFO: `/v3/projects/30efd3b31efe4edc8004897f83c7547b` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:15.591179 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8eb76-bcf5-4e9f-a6ed-e9f6a8bca8a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30efd3b31efe4edc8004897f83c7547b)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:15.595496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8eb76-bcf5-4e9f-a6ed-e9f6a8bca8a6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:15.596360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a13c32e3-ad60-4a0e-ae4b-7bd0cb479d2d tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '39c22be0b31b46e2a42ac8fe4453e451'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:15.597186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a13c32e3-ad60-4a0e-ae4b-7bd0cb479d2d tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '39c22be0b31b46e2a42ac8fe4453e451'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:15.665365 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a13c32e3-ad60-4a0e-ae4b-7bd0cb479d2d tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '39c22be0b31b46e2a42ac8fe4453e451'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:15.666627 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a13c32e3-ad60-4a0e-ae4b-7bd0cb479d2d tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '39c22be0b31b46e2a42ac8fe4453e451'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:15.678783 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2340/4626] 10.222.0.33 () {60 vars in 1249 bytes} [Sat Aug 6 21:10:15 2022] PATCH /identity/v3/domains/39c22be0b31b46e2a42ac8fe4453e451 => generated 250 bytes in 467 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:15.680388 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c32e3-ad60-4a0e-ae4b-7bd0cb479d2d tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:15.686334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a13c32e3-ad60-4a0e-ae4b-7bd0cb479d2d tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:15.701313 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8ea8eb76-bcf5-4e9f-a6ed-e9f6a8bca8a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30efd3b31efe4edc8004897f83c7547b', 'request_id': 'req-8ea8eb76-bcf5-4e9f-a6ed-e9f6a8bca8a6'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:15.703062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:15.715187 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8ea8eb76-bcf5-4e9f-a6ed-e9f6a8bca8a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30efd3b31efe4edc8004897f83c7547b', 'request_id': 'req-8ea8eb76-bcf5-4e9f-a6ed-e9f6a8bca8a6'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:15.735226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8ea8eb76-bcf5-4e9f-a6ed-e9f6a8bca8a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30efd3b31efe4edc8004897f83c7547b', 'request_id': 'req-8ea8eb76-bcf5-4e9f-a6ed-e9f6a8bca8a6'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:15.760831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8ea8eb76-bcf5-4e9f-a6ed-e9f6a8bca8a6 admin admin] The token cache is being invalidate because project 30efd3b31efe4edc8004897f83c7547b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:15.761430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8ea8eb76-bcf5-4e9f-a6ed-e9f6a8bca8a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:15.763280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8ea8eb76-bcf5-4e9f-a6ed-e9f6a8bca8a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:15.768225 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2287/4627] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:10:15 2022] DELETE /identity/v3/projects/30efd3b31efe4edc8004897f83c7547b => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:15.776349 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829df4ef-7e53-41bf-b336-f8e846e51dd1 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:15.776713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829df4ef-7e53-41bf-b336-f8e846e51dd1 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:15.776926 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829df4ef-7e53-41bf-b336-f8e846e51dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:15.831593 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-829df4ef-7e53-41bf-b336-f8e846e51dd1 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:15.834997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-829df4ef-7e53-41bf-b336-f8e846e51dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:15.862420 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c32e3-ad60-4a0e-ae4b-7bd0cb479d2d tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:15.964445 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851e7de-a5d4-4875-9e87-b8d1a4e7aa68 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17cdc909fbb49ff9a70ba7411019d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f62390481db34d4d94f32dd793cd9917', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:15.965104 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851e7de-a5d4-4875-9e87-b8d1a4e7aa68 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:15.965389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851e7de-a5d4-4875-9e87-b8d1a4e7aa68 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:15.965665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851e7de-a5d4-4875-9e87-b8d1a4e7aa68 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] PATH_INFO: `/v3/domains/39c22be0b31b46e2a42ac8fe4453e451` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:15.995595 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2288/4628] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:15.995838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851e7de-a5d4-4875-9e87-b8d1a4e7aa68 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=39c22be0b31b46e2a42ac8fe4453e451)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:15.998138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b692b6d-9b76-4eaf-8ce8-7652d6119015 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:15.998138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b692b6d-9b76-4eaf-8ce8-7652d6119015 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:15.998138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b692b6d-9b76-4eaf-8ce8-7652d6119015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:15.999524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851e7de-a5d4-4875-9e87-b8d1a4e7aa68 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:16.034017 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-8b692b6d-9b76-4eaf-8ce8-7652d6119015 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:16.036702 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8b692b6d-9b76-4eaf-8ce8-7652d6119015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:16.064200 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2289/4629] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:16.065494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b692b6d-9b76-4eaf-8ce8-7652d6119015 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:16.084684 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b692b6d-9b76-4eaf-8ce8-7652d6119015 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:16.102127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5797c60-d1d4-4b2d-8702-039c348aa76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:16.102127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5797c60-d1d4-4b2d-8702-039c348aa76f admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:16.102127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5797c60-d1d4-4b2d-8702-039c348aa76f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:16.102127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5797c60-d1d4-4b2d-8702-039c348aa76f admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:16.102692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5797c60-d1d4-4b2d-8702-039c348aa76f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:10:16.102692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5797c60-d1d4-4b2d-8702-039c348aa76f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:16.103062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a851e7de-a5d4-4875-9e87-b8d1a4e7aa68 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '39c22be0b31b46e2a42ac8fe4453e451'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:16.103821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5797c60-d1d4-4b2d-8702-039c348aa76f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:16.108755 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a851e7de-a5d4-4875-9e87-b8d1a4e7aa68 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '39c22be0b31b46e2a42ac8fe4453e451'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:16.132796 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2290/4630] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:16.133727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5797c60-d1d4-4b2d-8702-039c348aa76f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:16.170372 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5797c60-d1d4-4b2d-8702-039c348aa76f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:16.201018 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f8976-2f51-45dc-aa0d-71fd775c4ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:16.204540 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f8976-2f51-45dc-aa0d-71fd775c4ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:16.204828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f8976-2f51-45dc-aa0d-71fd775c4ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:16.208584 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f8976-2f51-45dc-aa0d-71fd775c4ae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:16.208758 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:16.210194 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f8976-2f51-45dc-aa0d-71fd775c4ae6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:16.212288 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f8976-2f51-45dc-aa0d-71fd775c4ae6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:16.215460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a851e7de-a5d4-4875-9e87-b8d1a4e7aa68 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39c22be0b31b46e2a42ac8fe4453e451', 'request_id': 'req-a851e7de-a5d4-4875-9e87-b8d1a4e7aa68'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:16.225666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a851e7de-a5d4-4875-9e87-b8d1a4e7aa68 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39c22be0b31b46e2a42ac8fe4453e451', 'request_id': 'req-a851e7de-a5d4-4875-9e87-b8d1a4e7aa68'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:16.238039 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a851e7de-a5d4-4875-9e87-b8d1a4e7aa68 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39c22be0b31b46e2a42ac8fe4453e451', 'request_id': 'req-a851e7de-a5d4-4875-9e87-b8d1a4e7aa68'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:16.256315 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a851e7de-a5d4-4875-9e87-b8d1a4e7aa68 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] The token cache is being invalidate because project 39c22be0b31b46e2a42ac8fe4453e451 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:16.257064 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a851e7de-a5d4-4875-9e87-b8d1a4e7aa68 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:16.258112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a851e7de-a5d4-4875-9e87-b8d1a4e7aa68 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:16.270237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a851e7de-a5d4-4875-9e87-b8d1a4e7aa68 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '39c22be0b31b46e2a42ac8fe4453e451', 'request_id': 'req-a851e7de-a5d4-4875-9e87-b8d1a4e7aa68'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:16.275803 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a851e7de-a5d4-4875-9e87-b8d1a4e7aa68 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '39c22be0b31b46e2a42ac8fe4453e451', 'request_id': 'req-a851e7de-a5d4-4875-9e87-b8d1a4e7aa68'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:16.277088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a851e7de-a5d4-4875-9e87-b8d1a4e7aa68 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '39c22be0b31b46e2a42ac8fe4453e451', 'request_id': 'req-a851e7de-a5d4-4875-9e87-b8d1a4e7aa68'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:16.290068 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2341/4631] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:10:15 2022] DELETE /identity/v3/domains/39c22be0b31b46e2a42ac8fe4453e451 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:16.291440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851e7de-a5d4-4875-9e87-b8d1a4e7aa68 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:16.294290 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a851e7de-a5d4-4875-9e87-b8d1a4e7aa68 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:16.325995 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2291/4632] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:10:16 2022] POST /identity/v3/projects => generated 367 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:16.341062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f8976-2f51-45dc-aa0d-71fd775c4ae6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:16.349389 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f71f8976-2f51-45dc-aa0d-71fd775c4ae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:16.383563 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851e7de-a5d4-4875-9e87-b8d1a4e7aa68 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:16.483538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211a8d8-ac63-4a1c-bb21-cc6135314488 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17cdc909fbb49ff9a70ba7411019d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f62390481db34d4d94f32dd793cd9917', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:16.484321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211a8d8-ac63-4a1c-bb21-cc6135314488 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:16.484833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211a8d8-ac63-4a1c-bb21-cc6135314488 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:16.485134 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211a8d8-ac63-4a1c-bb21-cc6135314488 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:16.485985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d211a8d8-ac63-4a1c-bb21-cc6135314488 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:16.488584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d211a8d8-ac63-4a1c-bb21-cc6135314488 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:16.528446 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2342/4633] 10.222.0.33 () {60 vars in 1149 bytes} [Sat Aug 6 21:10:16 2022] POST /identity/v3/domains => generated 278 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:16.529610 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211a8d8-ac63-4a1c-bb21-cc6135314488 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:16.648344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:16.673526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f8976-2f51-45dc-aa0d-71fd775c4ae6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:16.701654 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211a8d8-ac63-4a1c-bb21-cc6135314488 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:16.712803 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5341c-1aae-4988-b1f6-5c9981e2fb74 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17cdc909fbb49ff9a70ba7411019d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f62390481db34d4d94f32dd793cd9917', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:16.713886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5341c-1aae-4988-b1f6-5c9981e2fb74 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:16.714248 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5341c-1aae-4988-b1f6-5c9981e2fb74 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:16.714633 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5341c-1aae-4988-b1f6-5c9981e2fb74 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] PATH_INFO: `/v3/domains/d361e9ad0a674956a28bf80a102d363a` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:16.735040 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b5341c-1aae-4988-b1f6-5c9981e2fb74 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d361e9ad0a674956a28bf80a102d363a)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:16.737019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b5341c-1aae-4988-b1f6-5c9981e2fb74 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:16.769232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-34b5341c-1aae-4988-b1f6-5c9981e2fb74 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd361e9ad0a674956a28bf80a102d363a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:16.770498 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-34b5341c-1aae-4988-b1f6-5c9981e2fb74 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd361e9ad0a674956a28bf80a102d363a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:16.839085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:16.864561 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-34b5341c-1aae-4988-b1f6-5c9981e2fb74 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd361e9ad0a674956a28bf80a102d363a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:16.865772 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-34b5341c-1aae-4988-b1f6-5c9981e2fb74 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd361e9ad0a674956a28bf80a102d363a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:16.872603 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2343/4634] 10.222.0.33 () {60 vars in 1250 bytes} [Sat Aug 6 21:10:16 2022] PATCH /identity/v3/domains/d361e9ad0a674956a28bf80a102d363a => generated 278 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:16.881580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5341c-1aae-4988-b1f6-5c9981e2fb74 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:16.885691 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-34b5341c-1aae-4988-b1f6-5c9981e2fb74 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:16.892138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055f3fe-df21-4a7c-a328-36364224d91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:16.893049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055f3fe-df21-4a7c-a328-36364224d91c admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:16.893691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055f3fe-df21-4a7c-a328-36364224d91c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:16.894227 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055f3fe-df21-4a7c-a328-36364224d91c admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:16.895659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f055f3fe-df21-4a7c-a328-36364224d91c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:16.898231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f055f3fe-df21-4a7c-a328-36364224d91c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:16.946012 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2292/4635] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:10:16 2022] POST /identity/v3/users => generated 284 bytes in 605 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:16.951204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055f3fe-df21-4a7c-a328-36364224d91c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:16.955565 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f055f3fe-df21-4a7c-a328-36364224d91c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:16.988006 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055f3fe-df21-4a7c-a328-36364224d91c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:17.068652 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5341c-1aae-4988-b1f6-5c9981e2fb74 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:17.113143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8bc30b-13eb-4dad-b36f-c68eae6f456d tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17cdc909fbb49ff9a70ba7411019d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f62390481db34d4d94f32dd793cd9917', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:17.116421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bc30b-13eb-4dad-b36f-c68eae6f456d tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:17.118993 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bc30b-13eb-4dad-b36f-c68eae6f456d tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:17.119489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bc30b-13eb-4dad-b36f-c68eae6f456d tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] PATH_INFO: `/v3/domains/d361e9ad0a674956a28bf80a102d363a` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:17.134345 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8bc30b-13eb-4dad-b36f-c68eae6f456d tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=d361e9ad0a674956a28bf80a102d363a)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:17.136472 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45347b-3540-40bb-9c37-aad1ddcfa712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:17.137616 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8bc30b-13eb-4dad-b36f-c68eae6f456d tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:17.138432 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45347b-3540-40bb-9c37-aad1ddcfa712 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:17.138839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45347b-3540-40bb-9c37-aad1ddcfa712 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:17.139211 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45347b-3540-40bb-9c37-aad1ddcfa712 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:17.139965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45347b-3540-40bb-9c37-aad1ddcfa712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:17.140624 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2344/4636] 10.222.0.33 () {58 vars in 1227 bytes} [Sat Aug 6 21:10:16 2022] GET /identity/v3/domains/d361e9ad0a674956a28bf80a102d363a => generated 278 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:17.144245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45347b-3540-40bb-9c37-aad1ddcfa712 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:17.146538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8bc30b-13eb-4dad-b36f-c68eae6f456d tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:17.161093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8bc30b-13eb-4dad-b36f-c68eae6f456d tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:17.165419 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2293/4637] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:17.166885 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc512c45-d790-45d0-97f0-61ceabe5437b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17cdc909fbb49ff9a70ba7411019d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f62390481db34d4d94f32dd793cd9917', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:17.167707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc512c45-d790-45d0-97f0-61ceabe5437b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:17.168220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc512c45-d790-45d0-97f0-61ceabe5437b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:17.168693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc512c45-d790-45d0-97f0-61ceabe5437b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] PATH_INFO: `/v3/domains/d361e9ad0a674956a28bf80a102d363a` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:17.169479 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45347b-3540-40bb-9c37-aad1ddcfa712 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:17.170081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc512c45-d790-45d0-97f0-61ceabe5437b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d361e9ad0a674956a28bf80a102d363a)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:17.171768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc512c45-d790-45d0-97f0-61ceabe5437b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:17.192627 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45347b-3540-40bb-9c37-aad1ddcfa712 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:17.201734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bc512c45-d790-45d0-97f0-61ceabe5437b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd361e9ad0a674956a28bf80a102d363a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:17.206293 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bc512c45-d790-45d0-97f0-61ceabe5437b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd361e9ad0a674956a28bf80a102d363a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:17.216557 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b66b6f-e6dc-46b4-a7e5-7be2f3cebe21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:17.219748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b66b6f-e6dc-46b4-a7e5-7be2f3cebe21 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:17.220752 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b66b6f-e6dc-46b4-a7e5-7be2f3cebe21 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:17.221274 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b66b6f-e6dc-46b4-a7e5-7be2f3cebe21 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:17.223124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b66b6f-e6dc-46b4-a7e5-7be2f3cebe21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:17.226083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b66b6f-e6dc-46b4-a7e5-7be2f3cebe21 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:17.260992 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2294/4638] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:17.264087 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b66b6f-e6dc-46b4-a7e5-7be2f3cebe21 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:17.268058 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bc512c45-d790-45d0-97f0-61ceabe5437b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd361e9ad0a674956a28bf80a102d363a', 'request_id': 'req-bc512c45-d790-45d0-97f0-61ceabe5437b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:17.287893 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b66b6f-e6dc-46b4-a7e5-7be2f3cebe21 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:17.297200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bc512c45-d790-45d0-97f0-61ceabe5437b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd361e9ad0a674956a28bf80a102d363a', 'request_id': 'req-bc512c45-d790-45d0-97f0-61ceabe5437b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:17.318200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bc512c45-d790-45d0-97f0-61ceabe5437b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd361e9ad0a674956a28bf80a102d363a', 'request_id': 'req-bc512c45-d790-45d0-97f0-61ceabe5437b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:17.348036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bc512c45-d790-45d0-97f0-61ceabe5437b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] The token cache is being invalidate because project d361e9ad0a674956a28bf80a102d363a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:17.348601 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bc512c45-d790-45d0-97f0-61ceabe5437b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:17.351464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bc512c45-d790-45d0-97f0-61ceabe5437b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:17.356604 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:17.376686 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bc512c45-d790-45d0-97f0-61ceabe5437b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd361e9ad0a674956a28bf80a102d363a', 'request_id': 'req-bc512c45-d790-45d0-97f0-61ceabe5437b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:17.386631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bc512c45-d790-45d0-97f0-61ceabe5437b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd361e9ad0a674956a28bf80a102d363a', 'request_id': 'req-bc512c45-d790-45d0-97f0-61ceabe5437b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:17.388388 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bc512c45-d790-45d0-97f0-61ceabe5437b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd361e9ad0a674956a28bf80a102d363a', 'request_id': 'req-bc512c45-d790-45d0-97f0-61ceabe5437b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:17.399500 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2345/4639] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:10:17 2022] DELETE /identity/v3/domains/d361e9ad0a674956a28bf80a102d363a => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:17.400655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc512c45-d790-45d0-97f0-61ceabe5437b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:17.413028 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-bc512c45-d790-45d0-97f0-61ceabe5437b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:17.464371 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25bd76-57fb-4f8a-af0f-1573aada1e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:17.465503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25bd76-57fb-4f8a-af0f-1573aada1e41 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:17.465793 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25bd76-57fb-4f8a-af0f-1573aada1e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:17.466075 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25bd76-57fb-4f8a-af0f-1573aada1e41 admin admin] PATH_INFO: `/v3/projects/ffe141a5c1984cfdba5e15410d856075/users/13d213ada93a4ccf8bf51a03bccd91e6/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:17.498321 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a25bd76-57fb-4f8a-af0f-1573aada1e41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffe141a5c1984cfdba5e15410d856075, user_id=13d213ada93a4ccf8bf51a03bccd91e6, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:17.513093 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a25bd76-57fb-4f8a-af0f-1573aada1e41 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:17.542107 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2295/4640] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:10:17 2022] PUT /identity/v3/projects/ffe141a5c1984cfdba5e15410d856075/users/13d213ada93a4ccf8bf51a03bccd91e6/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:17.555182 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf292f99-f162-45ae-9855-c42b31007044 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:17.559456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf292f99-f162-45ae-9855-c42b31007044 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:17.561456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf292f99-f162-45ae-9855-c42b31007044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:17.614049 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc512c45-d790-45d0-97f0-61ceabe5437b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:17.653146 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-cf292f99-f162-45ae-9855-c42b31007044 None None] MFA Rules not processed for user `13d213ada93a4ccf8bf51a03bccd91e6`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:17.655442 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-cf292f99-f162-45ae-9855-c42b31007044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:17.724639 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:17.727533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750d5fe-ed6d-4334-9f57-edc2bedf8f90 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17cdc909fbb49ff9a70ba7411019d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f62390481db34d4d94f32dd793cd9917', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:17.728174 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750d5fe-ed6d-4334-9f57-edc2bedf8f90 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:17.728470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750d5fe-ed6d-4334-9f57-edc2bedf8f90 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:17.728751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750d5fe-ed6d-4334-9f57-edc2bedf8f90 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:17.732168 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750d5fe-ed6d-4334-9f57-edc2bedf8f90 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:17.736483 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750d5fe-ed6d-4334-9f57-edc2bedf8f90 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:17.785945 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2346/4641] 10.222.0.33 () {58 vars in 1128 bytes} [Sat Aug 6 21:10:17 2022] GET /identity/v3/domains => generated 1347 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:17.789718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750d5fe-ed6d-4334-9f57-edc2bedf8f90 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:17.801986 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2296/4642] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:17.803128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf292f99-f162-45ae-9855-c42b31007044 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:17.804873 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-cf292f99-f162-45ae-9855-c42b31007044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:17.817112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750d5fe-ed6d-4334-9f57-edc2bedf8f90 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:17.828352 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a575ec-56c5-43ae-9cba-2512c6a23875 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17cdc909fbb49ff9a70ba7411019d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f62390481db34d4d94f32dd793cd9917', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:17.829500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a575ec-56c5-43ae-9cba-2512c6a23875 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:17.829500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a575ec-56c5-43ae-9cba-2512c6a23875 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:17.830230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a575ec-56c5-43ae-9cba-2512c6a23875 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] PATH_INFO: `/v3/domains/d361e9ad0a674956a28bf80a102d363a` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:17.856537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a575ec-56c5-43ae-9cba-2512c6a23875 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 21:10:17.856537 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-c5a575ec-56c5-43ae-9cba-2512c6a23875 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Could not find domain: d361e9ad0a674956a28bf80a102d363a.: keystone.exception.DomainNotFound: Could not find domain: d361e9ad0a674956a28bf80a102d363a. Aug 06 21:10:17.856537 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:10:17.856537 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 06 21:10:17.856537 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 06 21:10:17.856537 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 21:10:17.856537 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 21:10:17.856537 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 21:10:17.856537 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 21:10:17.856537 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d361e9ad0a674956a28bf80a102d363a. Aug 06 21:10:17.856537 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:10:17.856537 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 21:10:17.856537 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:10:17.857778 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:10:17.857778 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:10:17.857778 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:10:17.857778 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:10:17.857778 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:10:17.857778 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:10:17.857778 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:10:17.857778 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:10:17.857778 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:10:17.857778 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:10:17.857778 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:10:17.857778 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 06 21:10:17.857778 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 06 21:10:17.857778 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 21:10:17.857778 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 21:10:17.857778 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 21:10:17.859247 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 21:10:17.859247 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:10:17.859247 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:10:17.859247 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 21:10:17.859247 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 21:10:17.859247 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 21:10:17.859247 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 21:10:17.859247 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 21:10:17.859247 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 21:10:17.859247 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 21:10:17.859247 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 21:10:17.859247 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 21:10:17.859247 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 21:10:17.859247 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 21:10:17.859247 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 21:10:17.859247 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 21:10:17.859247 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 21:10:17.861020 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 06 21:10:17.861020 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 21:10:17.861020 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: d361e9ad0a674956a28bf80a102d363a. Aug 06 21:10:17.861020 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:10:17.861020 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2347/4643] 10.222.0.33 () {60 vars in 1249 bytes} [Sat Aug 6 21:10:17 2022] PATCH /identity/v3/domains/d361e9ad0a674956a28bf80a102d363a => generated 112 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:10:17.862587 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a575ec-56c5-43ae-9cba-2512c6a23875 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:17.887065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a575ec-56c5-43ae-9cba-2512c6a23875 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:17.896057 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b2a4a-9775-4fae-8021-7efc452b6764 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17cdc909fbb49ff9a70ba7411019d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f62390481db34d4d94f32dd793cd9917', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:17.896558 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b2a4a-9775-4fae-8021-7efc452b6764 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:17.896850 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b2a4a-9775-4fae-8021-7efc452b6764 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:17.897133 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b2a4a-9775-4fae-8021-7efc452b6764 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:17.897896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b2a4a-9775-4fae-8021-7efc452b6764 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:17.900107 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b2a4a-9775-4fae-8021-7efc452b6764 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:17.935783 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf292f99-f162-45ae-9855-c42b31007044 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:17.942608 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2348/4644] 10.222.0.33 () {60 vars in 1149 bytes} [Sat Aug 6 21:10:17 2022] POST /identity/v3/domains => generated 276 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:17.946685 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b2a4a-9775-4fae-8021-7efc452b6764 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:17.949190 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed68503-9026-4047-9a09-367dfc041b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:17.949903 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed68503-9026-4047-9a09-367dfc041b25 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:17.950678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed68503-9026-4047-9a09-367dfc041b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:17.950678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed68503-9026-4047-9a09-367dfc041b25 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:17.952731 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed68503-9026-4047-9a09-367dfc041b25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:17.954730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed68503-9026-4047-9a09-367dfc041b25 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:18.020005 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2297/4645] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:10:17 2022] POST /identity/v3/projects => generated 367 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:18.024205 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed68503-9026-4047-9a09-367dfc041b25 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:18.096790 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b2a4a-9775-4fae-8021-7efc452b6764 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:18.105846 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:18.145994 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed68503-9026-4047-9a09-367dfc041b25 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:18.159437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e540bb-9a1f-4427-924f-d3f637685660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:18.160171 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e540bb-9a1f-4427-924f-d3f637685660 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:18.160552 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e540bb-9a1f-4427-924f-d3f637685660 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:18.160925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e540bb-9a1f-4427-924f-d3f637685660 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:18.161870 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e540bb-9a1f-4427-924f-d3f637685660 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:18.166232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e540bb-9a1f-4427-924f-d3f637685660 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:18.211144 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2298/4646] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:10:18 2022] POST /identity/v3/users => generated 290 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:18.212147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e540bb-9a1f-4427-924f-d3f637685660 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:18.221004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b18c2-32f4-4017-b0b5-f4344d085dc6 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17cdc909fbb49ff9a70ba7411019d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f62390481db34d4d94f32dd793cd9917', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:18.221846 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b18c2-32f4-4017-b0b5-f4344d085dc6 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:18.222139 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b18c2-32f4-4017-b0b5-f4344d085dc6 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:18.222417 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b18c2-32f4-4017-b0b5-f4344d085dc6 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:18.223148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b18c2-32f4-4017-b0b5-f4344d085dc6 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:18.223889 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e540bb-9a1f-4427-924f-d3f637685660 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:18.225335 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b18c2-32f4-4017-b0b5-f4344d085dc6 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:18.230664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6efb9-06fd-432c-880e-d10c0c234307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:18.231725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6efb9-06fd-432c-880e-d10c0c234307 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:18.232221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6efb9-06fd-432c-880e-d10c0c234307 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:18.232861 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6efb9-06fd-432c-880e-d10c0c234307 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:18.233960 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6efb9-06fd-432c-880e-d10c0c234307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:18.236553 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6efb9-06fd-432c-880e-d10c0c234307 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:18.255316 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2299/4647] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:18.264647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6efb9-06fd-432c-880e-d10c0c234307 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:18.275636 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2349/4648] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:10:17 2022] POST /identity/v3/users => generated 348 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:18.279761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6efb9-06fd-432c-880e-d10c0c234307 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:18.282405 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b18c2-32f4-4017-b0b5-f4344d085dc6 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:18.285519 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e97972-1fb0-4365-9dfe-9f852e961fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:18.286391 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e97972-1fb0-4365-9dfe-9f852e961fac admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:18.286824 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e97972-1fb0-4365-9dfe-9f852e961fac admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:18.287176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e97972-1fb0-4365-9dfe-9f852e961fac admin admin] PATH_INFO: `/v3/projects/6f17b5ec61f04803a679b49407cb2dae/users/0d193e51d7d94668a62b7aa59720452e/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:18.297023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b18c2-32f4-4017-b0b5-f4344d085dc6 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:18.307815 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5e310-2464-41eb-b504-7fa005d7926a tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17cdc909fbb49ff9a70ba7411019d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f62390481db34d4d94f32dd793cd9917', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:18.308737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5e310-2464-41eb-b504-7fa005d7926a tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:18.309030 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5e310-2464-41eb-b504-7fa005d7926a tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:18.309313 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5e310-2464-41eb-b504-7fa005d7926a tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] PATH_INFO: `/v3/groups` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:18.310060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf5e310-2464-41eb-b504-7fa005d7926a tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:18.312435 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf5e310-2464-41eb-b504-7fa005d7926a tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:18.312625 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e97972-1fb0-4365-9dfe-9f852e961fac admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f17b5ec61f04803a679b49407cb2dae, user_id=0d193e51d7d94668a62b7aa59720452e, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:18.316875 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e97972-1fb0-4365-9dfe-9f852e961fac admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:18.337714 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2300/4649] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:10:18 2022] PUT /identity/v3/projects/6f17b5ec61f04803a679b49407cb2dae/users/0d193e51d7d94668a62b7aa59720452e/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:18.337906 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2350/4650] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:10:18 2022] POST /identity/v3/groups => generated 324 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:18.339398 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e97972-1fb0-4365-9dfe-9f852e961fac admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:18.339542 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5e310-2464-41eb-b504-7fa005d7926a tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:18.354729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5e310-2464-41eb-b504-7fa005d7926a tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:18.360578 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:18.442516 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e97972-1fb0-4365-9dfe-9f852e961fac admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:18.451807 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93ffbf-f159-4e81-a126-daa5dfa9c418 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17cdc909fbb49ff9a70ba7411019d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f62390481db34d4d94f32dd793cd9917', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:18.455927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93ffbf-f159-4e81-a126-daa5dfa9c418 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:18.456976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93ffbf-f159-4e81-a126-daa5dfa9c418 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:18.457462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93ffbf-f159-4e81-a126-daa5dfa9c418 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] PATH_INFO: `/v3/domains/41577a96eb2b4108ad4a72ea0e36bbe6` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:18.459078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee93ffbf-f159-4e81-a126-daa5dfa9c418 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=41577a96eb2b4108ad4a72ea0e36bbe6)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:18.461520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee93ffbf-f159-4e81-a126-daa5dfa9c418 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:18.463407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c1b37-0094-47fc-9c52-52dcb63a7576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:18.464039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c1b37-0094-47fc-9c52-52dcb63a7576 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:18.464358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c1b37-0094-47fc-9c52-52dcb63a7576 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:18.468661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c1b37-0094-47fc-9c52-52dcb63a7576 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:18.468661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c1b37-0094-47fc-9c52-52dcb63a7576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:18.468661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c1b37-0094-47fc-9c52-52dcb63a7576 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:18.491748 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2301/4651] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:18.494777 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c1b37-0094-47fc-9c52-52dcb63a7576 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:18.496549 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ee93ffbf-f159-4e81-a126-daa5dfa9c418 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '41577a96eb2b4108ad4a72ea0e36bbe6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:18.497714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ee93ffbf-f159-4e81-a126-daa5dfa9c418 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '41577a96eb2b4108ad4a72ea0e36bbe6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:18.523543 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c1b37-0094-47fc-9c52-52dcb63a7576 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:18.536320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ee93ffbf-f159-4e81-a126-daa5dfa9c418 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '41577a96eb2b4108ad4a72ea0e36bbe6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:18.537146 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ee93ffbf-f159-4e81-a126-daa5dfa9c418 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '41577a96eb2b4108ad4a72ea0e36bbe6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:18.557761 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2351/4652] 10.222.0.33 () {60 vars in 1249 bytes} [Sat Aug 6 21:10:18 2022] PATCH /identity/v3/domains/41577a96eb2b4108ad4a72ea0e36bbe6 => generated 277 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:18.565134 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93ffbf-f159-4e81-a126-daa5dfa9c418 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:18.568211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ee93ffbf-f159-4e81-a126-daa5dfa9c418 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:18.651468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99236b07-eeca-4ca5-b57c-afffad3d08eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:18.652551 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99236b07-eeca-4ca5-b57c-afffad3d08eb admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:18.653169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99236b07-eeca-4ca5-b57c-afffad3d08eb admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:18.653612 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99236b07-eeca-4ca5-b57c-afffad3d08eb admin admin] PATH_INFO: `/v3/projects/6f17b5ec61f04803a679b49407cb2dae/users/0d193e51d7d94668a62b7aa59720452e/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:18.658332 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99236b07-eeca-4ca5-b57c-afffad3d08eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f17b5ec61f04803a679b49407cb2dae, user_id=0d193e51d7d94668a62b7aa59720452e, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:18.662178 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99236b07-eeca-4ca5-b57c-afffad3d08eb admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:18.697910 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2302/4653] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:10:18 2022] PUT /identity/v3/projects/6f17b5ec61f04803a679b49407cb2dae/users/0d193e51d7d94668a62b7aa59720452e/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:18.708182 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:18.712109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38ffa7-e7e6-46fc-9170-f4e4dcc5d18d None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:18.712509 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38ffa7-e7e6-46fc-9170-f4e4dcc5d18d None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:18.712884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38ffa7-e7e6-46fc-9170-f4e4dcc5d18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:18.731288 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93ffbf-f159-4e81-a126-daa5dfa9c418 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:18.752450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-9c38ffa7-e7e6-46fc-9170-f4e4dcc5d18d None None] MFA Rules not processed for user `0d193e51d7d94668a62b7aa59720452e`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:18.753782 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9c38ffa7-e7e6-46fc-9170-f4e4dcc5d18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:18.820638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa37b27-1318-496a-a715-5b5d91a8cab3 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17cdc909fbb49ff9a70ba7411019d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f62390481db34d4d94f32dd793cd9917', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:18.821824 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa37b27-1318-496a-a715-5b5d91a8cab3 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:18.822284 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa37b27-1318-496a-a715-5b5d91a8cab3 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:18.822789 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa37b27-1318-496a-a715-5b5d91a8cab3 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] PATH_INFO: `/v3/domains/41577a96eb2b4108ad4a72ea0e36bbe6` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:18.836392 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa37b27-1318-496a-a715-5b5d91a8cab3 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=41577a96eb2b4108ad4a72ea0e36bbe6)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:18.838886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa37b27-1318-496a-a715-5b5d91a8cab3 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:18.859081 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2303/4654] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:18.860937 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38ffa7-e7e6-46fc-9170-f4e4dcc5d18d None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:18.863128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9c38ffa7-e7e6-46fc-9170-f4e4dcc5d18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:18.898426 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0fa37b27-1318-496a-a715-5b5d91a8cab3 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '41577a96eb2b4108ad4a72ea0e36bbe6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:18.903579 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0fa37b27-1318-496a-a715-5b5d91a8cab3 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '41577a96eb2b4108ad4a72ea0e36bbe6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:18.909075 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:18.981913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38ffa7-e7e6-46fc-9170-f4e4dcc5d18d None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:19.103705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c8ff6-e581-4d79-9f35-c7f169fe2d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:19.104429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c8ff6-e581-4d79-9f35-c7f169fe2d06 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:19.104703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c8ff6-e581-4d79-9f35-c7f169fe2d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:19.104976 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c8ff6-e581-4d79-9f35-c7f169fe2d06 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:19.105607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c8ff6-e581-4d79-9f35-c7f169fe2d06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:19.107740 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c8ff6-e581-4d79-9f35-c7f169fe2d06 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:19.126320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0fa37b27-1318-496a-a715-5b5d91a8cab3 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec0cddc1c53f4af7b50dba12b5f61d68'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:19.132046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=11 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:19.136458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0fa37b27-1318-496a-a715-5b5d91a8cab3 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec0cddc1c53f4af7b50dba12b5f61d68'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:19.137364 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0fa37b27-1318-496a-a715-5b5d91a8cab3 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec0cddc1c53f4af7b50dba12b5f61d68'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:19.138105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0fa37b27-1318-496a-a715-5b5d91a8cab3 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec0cddc1c53f4af7b50dba12b5f61d68'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:19.151164 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2304/4655] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:10:18 2022] POST /identity/v3/projects => generated 367 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:19.157200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c8ff6-e581-4d79-9f35-c7f169fe2d06 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:19.159465 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0fa37b27-1318-496a-a715-5b5d91a8cab3 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec0cddc1c53f4af7b50dba12b5f61d68'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:19.164702 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3f4c8ff6-e581-4d79-9f35-c7f169fe2d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:19.258211 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c8ff6-e581-4d79-9f35-c7f169fe2d06 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:19.280805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0fa37b27-1318-496a-a715-5b5d91a8cab3 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41577a96eb2b4108ad4a72ea0e36bbe6', 'request_id': 'req-0fa37b27-1318-496a-a715-5b5d91a8cab3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:19.290734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0fa37b27-1318-496a-a715-5b5d91a8cab3 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41577a96eb2b4108ad4a72ea0e36bbe6', 'request_id': 'req-0fa37b27-1318-496a-a715-5b5d91a8cab3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:19.304430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0fa37b27-1318-496a-a715-5b5d91a8cab3 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41577a96eb2b4108ad4a72ea0e36bbe6', 'request_id': 'req-0fa37b27-1318-496a-a715-5b5d91a8cab3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:19.325675 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0fa37b27-1318-496a-a715-5b5d91a8cab3 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] The token cache is being invalidate because project 41577a96eb2b4108ad4a72ea0e36bbe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:19.325984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0fa37b27-1318-496a-a715-5b5d91a8cab3 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:19.326780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0fa37b27-1318-496a-a715-5b5d91a8cab3 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:19.342411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0fa37b27-1318-496a-a715-5b5d91a8cab3 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '41577a96eb2b4108ad4a72ea0e36bbe6', 'request_id': 'req-0fa37b27-1318-496a-a715-5b5d91a8cab3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:19.348863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0fa37b27-1318-496a-a715-5b5d91a8cab3 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '41577a96eb2b4108ad4a72ea0e36bbe6', 'request_id': 'req-0fa37b27-1318-496a-a715-5b5d91a8cab3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:19.349629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0fa37b27-1318-496a-a715-5b5d91a8cab3 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '41577a96eb2b4108ad4a72ea0e36bbe6', 'request_id': 'req-0fa37b27-1318-496a-a715-5b5d91a8cab3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:19.363511 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2352/4656] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:10:18 2022] DELETE /identity/v3/domains/41577a96eb2b4108ad4a72ea0e36bbe6 => generated 0 bytes in 798 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:19.364455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa37b27-1318-496a-a715-5b5d91a8cab3 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:19.367309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0fa37b27-1318-496a-a715-5b5d91a8cab3 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:19.393110 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cb035-b724-4f6e-b01e-c0c51febdaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:19.399535 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cb035-b724-4f6e-b01e-c0c51febdaa6 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:19.400448 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cb035-b724-4f6e-b01e-c0c51febdaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:19.400926 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cb035-b724-4f6e-b01e-c0c51febdaa6 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:19.401759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444cb035-b724-4f6e-b01e-c0c51febdaa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:19.404386 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444cb035-b724-4f6e-b01e-c0c51febdaa6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:19.423753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:19.451246 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2305/4657] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:10:19 2022] POST /identity/v3/users => generated 284 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:19.452776 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cb035-b724-4f6e-b01e-c0c51febdaa6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:19.455322 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-444cb035-b724-4f6e-b01e-c0c51febdaa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:19.470902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cb035-b724-4f6e-b01e-c0c51febdaa6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:19.477622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cef03c-4b50-4303-844b-122685be0588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:19.478503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cef03c-4b50-4303-844b-122685be0588 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:19.478986 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cef03c-4b50-4303-844b-122685be0588 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:19.479456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cef03c-4b50-4303-844b-122685be0588 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:19.480440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cef03c-4b50-4303-844b-122685be0588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:19.482430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cef03c-4b50-4303-844b-122685be0588 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:19.495594 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2306/4658] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:19.501488 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cef03c-4b50-4303-844b-122685be0588 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:19.515626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cef03c-4b50-4303-844b-122685be0588 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:19.521703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646296f0-1cad-46da-be1f-27263aa74f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:19.522765 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646296f0-1cad-46da-be1f-27263aa74f4e admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:19.523241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646296f0-1cad-46da-be1f-27263aa74f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:19.523694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646296f0-1cad-46da-be1f-27263aa74f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:19.524524 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646296f0-1cad-46da-be1f-27263aa74f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:19.526774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646296f0-1cad-46da-be1f-27263aa74f4e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:19.544159 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2307/4659] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:19.545479 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646296f0-1cad-46da-be1f-27263aa74f4e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:19.559154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646296f0-1cad-46da-be1f-27263aa74f4e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:19.569127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec7936-74f8-4ba7-ad58-b9c9b7686015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:19.570098 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec7936-74f8-4ba7-ad58-b9c9b7686015 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:19.570584 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec7936-74f8-4ba7-ad58-b9c9b7686015 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:19.571058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec7936-74f8-4ba7-ad58-b9c9b7686015 admin admin] PATH_INFO: `/v3/projects/6f03bc1de7174fe1afac7baace1fc7ec/users/6a651aed8c0b464dbe29546467e5294b/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:19.573504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa37b27-1318-496a-a715-5b5d91a8cab3 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:19.587013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad2efb-2ee5-4f7b-a45a-c824b68ad0bb tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17cdc909fbb49ff9a70ba7411019d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f62390481db34d4d94f32dd793cd9917', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:19.589110 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad2efb-2ee5-4f7b-a45a-c824b68ad0bb tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:19.589329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad2efb-2ee5-4f7b-a45a-c824b68ad0bb tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:19.589621 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad2efb-2ee5-4f7b-a45a-c824b68ad0bb tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] PATH_INFO: `/v3/domains/41577a96eb2b4108ad4a72ea0e36bbe6` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:19.592046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec7936-74f8-4ba7-ad58-b9c9b7686015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f03bc1de7174fe1afac7baace1fc7ec, user_id=6a651aed8c0b464dbe29546467e5294b, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:19.596770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec7936-74f8-4ba7-ad58-b9c9b7686015 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:19.608869 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad2efb-2ee5-4f7b-a45a-c824b68ad0bb tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=41577a96eb2b4108ad4a72ea0e36bbe6)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:19.611059 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad2efb-2ee5-4f7b-a45a-c824b68ad0bb tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:19.624877 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2308/4660] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:10:19 2022] PUT /identity/v3/projects/6f03bc1de7174fe1afac7baace1fc7ec/users/6a651aed8c0b464dbe29546467e5294b/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:19.633941 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e390432-ba2f-4ac1-81f2-0d753cae9b22 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:19.634112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e390432-ba2f-4ac1-81f2-0d753cae9b22 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:19.634342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e390432-ba2f-4ac1-81f2-0d753cae9b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:19.645063 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-13ad2efb-2ee5-4f7b-a45a-c824b68ad0bb tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Could not find domain: 41577a96eb2b4108ad4a72ea0e36bbe6.: keystone.exception.DomainNotFound: Could not find domain: 41577a96eb2b4108ad4a72ea0e36bbe6. Aug 06 21:10:19.645063 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:10:19.645063 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 06 21:10:19.645063 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 06 21:10:19.645063 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 21:10:19.645063 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 21:10:19.645063 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 21:10:19.645063 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 21:10:19.645063 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 41577a96eb2b4108ad4a72ea0e36bbe6. Aug 06 21:10:19.645063 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:10:19.645063 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 21:10:19.645063 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:10:19.645063 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:10:19.645063 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:10:19.645063 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:10:19.645063 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:10:19.646592 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:10:19.646592 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:10:19.646592 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:10:19.646592 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:10:19.646592 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:10:19.646592 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:10:19.646592 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:10:19.646592 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 21:10:19.646592 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 21:10:19.646592 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 21:10:19.646592 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 21:10:19.646592 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:10:19.646592 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:10:19.646592 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 21:10:19.646592 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 21:10:19.646592 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 21:10:19.646592 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 21:10:19.648061 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 21:10:19.648061 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 21:10:19.648061 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 21:10:19.648061 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 21:10:19.648061 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 21:10:19.648061 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 21:10:19.648061 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 21:10:19.648061 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 21:10:19.648061 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 21:10:19.648061 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 21:10:19.648061 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 06 21:10:19.648061 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 21:10:19.648061 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 41577a96eb2b4108ad4a72ea0e36bbe6. Aug 06 21:10:19.648061 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:10:19.648061 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2353/4661] 10.222.0.33 () {58 vars in 1227 bytes} [Sat Aug 6 21:10:19 2022] GET /identity/v3/domains/41577a96eb2b4108ad4a72ea0e36bbe6 => generated 112 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:10:19.650941 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad2efb-2ee5-4f7b-a45a-c824b68ad0bb tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:19.664222 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad2efb-2ee5-4f7b-a45a-c824b68ad0bb tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:19.689044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-9e390432-ba2f-4ac1-81f2-0d753cae9b22 None None] MFA Rules not processed for user `6a651aed8c0b464dbe29546467e5294b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:19.690755 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9e390432-ba2f-4ac1-81f2-0d753cae9b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:19.723437 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=84,keystone:INSERT=2,keystone:DELETE=14 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:19.754594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa404e1-11be-499f-8148-a2168f1e513e tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17cdc909fbb49ff9a70ba7411019d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f62390481db34d4d94f32dd793cd9917', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:19.756103 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa404e1-11be-499f-8148-a2168f1e513e tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:19.757170 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa404e1-11be-499f-8148-a2168f1e513e tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:19.757676 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa404e1-11be-499f-8148-a2168f1e513e tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] PATH_INFO: `/v3/users/ec0cddc1c53f4af7b50dba12b5f61d68` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:19.768749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa404e1-11be-499f-8148-a2168f1e513e tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorizing `identity:get_user(user_id=ec0cddc1c53f4af7b50dba12b5f61d68)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:19.771680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa404e1-11be-499f-8148-a2168f1e513e tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:19.786308 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-8fa404e1-11be-499f-8148-a2168f1e513e tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Could not find user: ec0cddc1c53f4af7b50dba12b5f61d68.: keystone.exception.UserNotFound: Could not find user: ec0cddc1c53f4af7b50dba12b5f61d68. Aug 06 21:10:19.786308 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:10:19.786308 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:10:19.786308 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:10:19.786308 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:10:19.786308 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:10:19.786308 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:10:19.786308 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:10:19.786308 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:10:19.786308 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:10:19.786308 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:10:19.786308 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:10:19.786308 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 21:10:19.786308 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 21:10:19.786308 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 21:10:19.787735 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 21:10:19.787735 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:10:19.787735 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:10:19.787735 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 21:10:19.787735 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 21:10:19.787735 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 21:10:19.787735 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 21:10:19.787735 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 21:10:19.787735 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 21:10:19.787735 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 21:10:19.787735 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 21:10:19.787735 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 21:10:19.787735 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 21:10:19.787735 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 21:10:19.787735 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 21:10:19.787735 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 21:10:19.787735 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 21:10:19.788979 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 21:10:19.788979 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 21:10:19.788979 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 21:10:19.788979 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 21:10:19.788979 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 21:10:19.788979 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 21:10:19.788979 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 21:10:19.788979 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 21:10:19.788979 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 21:10:19.788979 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 21:10:19.788979 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: ec0cddc1c53f4af7b50dba12b5f61d68. Aug 06 21:10:19.788979 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:10:19.792178 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2354/4662] 10.222.0.33 () {58 vars in 1221 bytes} [Sat Aug 6 21:10:19 2022] GET /identity/v3/users/ec0cddc1c53f4af7b50dba12b5f61d68 => generated 110 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:10:19.794710 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2309/4663] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:10:19.801597 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e390432-ba2f-4ac1-81f2-0d753cae9b22 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:19.802785 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa404e1-11be-499f-8148-a2168f1e513e tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:19.807330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8fa404e1-11be-499f-8148-a2168f1e513e tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:19.820094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e390432-ba2f-4ac1-81f2-0d753cae9b22 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:19.843922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72412f6e-25c7-46b7-9079-199ef81ce4b7 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17cdc909fbb49ff9a70ba7411019d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f62390481db34d4d94f32dd793cd9917', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:19.845398 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72412f6e-25c7-46b7-9079-199ef81ce4b7 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:19.846477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72412f6e-25c7-46b7-9079-199ef81ce4b7 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:19.847418 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72412f6e-25c7-46b7-9079-199ef81ce4b7 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] PATH_INFO: `/v3/groups/3a8d90de3dfc4232b4a6cf0d306e84c5` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:19.862008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72412f6e-25c7-46b7-9079-199ef81ce4b7 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorizing `identity:get_group(group_id=3a8d90de3dfc4232b4a6cf0d306e84c5)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:19.863185 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-72412f6e-25c7-46b7-9079-199ef81ce4b7 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:10:19.863185 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:10:19.863185 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:10:19.864564 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72412f6e-25c7-46b7-9079-199ef81ce4b7 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:19.885827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-72412f6e-25c7-46b7-9079-199ef81ce4b7 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Could not find group: 3a8d90de3dfc4232b4a6cf0d306e84c5.: keystone.exception.GroupNotFound: Could not find group: 3a8d90de3dfc4232b4a6cf0d306e84c5. Aug 06 21:10:19.885827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:10:19.885827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:10:19.885827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:10:19.885827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:10:19.885827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:10:19.885827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:10:19.885827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:10:19.885827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:10:19.885827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:10:19.885827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:10:19.885827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:10:19.885827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Aug 06 21:10:19.885827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_group(group_id) Aug 06 21:10:19.885827 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Aug 06 21:10:19.887409 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Aug 06 21:10:19.887409 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:10:19.887409 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:10:19.887409 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 21:10:19.887409 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 21:10:19.887409 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 21:10:19.887409 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 21:10:19.887409 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 21:10:19.887409 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 21:10:19.887409 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 21:10:19.887409 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 21:10:19.887409 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 21:10:19.887409 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 21:10:19.887409 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 21:10:19.887409 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 21:10:19.887409 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 21:10:19.887409 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 21:10:19.888874 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 21:10:19.888874 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 21:10:19.888874 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 21:10:19.888874 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 21:10:19.888874 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Aug 06 21:10:19.888874 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Aug 06 21:10:19.888874 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Aug 06 21:10:19.888874 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Aug 06 21:10:19.888874 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Aug 06 21:10:19.888874 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Aug 06 21:10:19.888874 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 3a8d90de3dfc4232b4a6cf0d306e84c5. Aug 06 21:10:19.888874 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:10:19.890479 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2310/4664] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:19 2022] GET /identity/v3/groups/3a8d90de3dfc4232b4a6cf0d306e84c5 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:10:19.892376 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72412f6e-25c7-46b7-9079-199ef81ce4b7 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:19.906638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72412f6e-25c7-46b7-9079-199ef81ce4b7 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:19.913199 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e2d0e-af7e-4682-b361-a7fdff94b5e8 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17cdc909fbb49ff9a70ba7411019d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f62390481db34d4d94f32dd793cd9917', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:19.914058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e2d0e-af7e-4682-b361-a7fdff94b5e8 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:19.914394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e2d0e-af7e-4682-b361-a7fdff94b5e8 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:19.914703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e2d0e-af7e-4682-b361-a7fdff94b5e8 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] PATH_INFO: `/v3/groups/3a8d90de3dfc4232b4a6cf0d306e84c5` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:19.921726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e2d0e-af7e-4682-b361-a7fdff94b5e8 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 21:10:19.924200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa404e1-11be-499f-8148-a2168f1e513e tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:19.927523 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-e62e2d0e-af7e-4682-b361-a7fdff94b5e8 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Could not find group: 3a8d90de3dfc4232b4a6cf0d306e84c5.: keystone.exception.GroupNotFound: Could not find group: 3a8d90de3dfc4232b4a6cf0d306e84c5. Aug 06 21:10:19.927523 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:10:19.927523 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:10:19.927523 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:10:19.927523 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:10:19.927523 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:10:19.927523 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:10:19.927523 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:10:19.927523 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:10:19.927523 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:10:19.927523 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:10:19.927523 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:10:19.927523 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Aug 06 21:10:19.927523 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Aug 06 21:10:19.928625 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 21:10:19.928625 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 21:10:19.928625 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 21:10:19.928625 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 21:10:19.928625 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:10:19.928625 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:10:19.928625 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 21:10:19.928625 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 21:10:19.928625 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 21:10:19.928625 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 21:10:19.928625 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 21:10:19.928625 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 21:10:19.928625 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 21:10:19.928625 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 21:10:19.928625 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 21:10:19.928625 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 21:10:19.928625 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 21:10:19.930481 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 21:10:19.930481 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 21:10:19.930481 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 21:10:19.930481 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 21:10:19.930481 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 21:10:19.930481 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 21:10:19.930481 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 21:10:19.930481 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Aug 06 21:10:19.930481 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Aug 06 21:10:19.930481 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Aug 06 21:10:19.930481 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Aug 06 21:10:19.930481 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Aug 06 21:10:19.930481 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Aug 06 21:10:19.930481 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 3a8d90de3dfc4232b4a6cf0d306e84c5. Aug 06 21:10:19.930481 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:10:19.932485 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2311/4665] 10.222.0.33 () {58 vars in 1227 bytes} [Sat Aug 6 21:10:19 2022] DELETE /identity/v3/groups/3a8d90de3dfc4232b4a6cf0d306e84c5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:10:19.933655 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e2d0e-af7e-4682-b361-a7fdff94b5e8 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:19.935627 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940459b-f682-4a85-99f4-503a94341c45 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:19.936460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940459b-f682-4a85-99f4-503a94341c45 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:19.936914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940459b-f682-4a85-99f4-503a94341c45 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:19.937460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940459b-f682-4a85-99f4-503a94341c45 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:19.939002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d940459b-f682-4a85-99f4-503a94341c45 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:19.941858 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d940459b-f682-4a85-99f4-503a94341c45 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:19.945547 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e2d0e-af7e-4682-b361-a7fdff94b5e8 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:19.952252 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f943711-9d49-4cd9-b6a6-73b5c907c933 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17cdc909fbb49ff9a70ba7411019d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f62390481db34d4d94f32dd793cd9917', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:19.953056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f943711-9d49-4cd9-b6a6-73b5c907c933 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:19.953470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f943711-9d49-4cd9-b6a6-73b5c907c933 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:19.953909 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f943711-9d49-4cd9-b6a6-73b5c907c933 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] PATH_INFO: `/v3/users/ec0cddc1c53f4af7b50dba12b5f61d68` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:19.965368 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2355/4666] 10.222.0.33 () {60 vars in 1149 bytes} [Sat Aug 6 21:10:19 2022] POST /identity/v3/domains => generated 275 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:19.965654 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f943711-9d49-4cd9-b6a6-73b5c907c933 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ec0cddc1c53f4af7b50dba12b5f61d68)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:19.967715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f943711-9d49-4cd9-b6a6-73b5c907c933 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:19.969785 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940459b-f682-4a85-99f4-503a94341c45 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:19.986452 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-8f943711-9d49-4cd9-b6a6-73b5c907c933 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Could not find user: ec0cddc1c53f4af7b50dba12b5f61d68.: keystone.exception.UserNotFound: Could not find user: ec0cddc1c53f4af7b50dba12b5f61d68. Aug 06 21:10:19.986452 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:10:19.986452 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:10:19.986452 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:10:19.986452 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:10:19.986452 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:10:19.986452 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:10:19.986452 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:10:19.986452 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:10:19.986452 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:10:19.986452 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:10:19.986452 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:10:19.986452 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Aug 06 21:10:19.986452 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Aug 06 21:10:19.989622 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:10:19.989622 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:10:19.989622 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 21:10:19.989622 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 21:10:19.989622 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 21:10:19.989622 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 21:10:19.989622 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Aug 06 21:10:19.989622 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Aug 06 21:10:19.989622 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:10:19.989622 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:10:19.989622 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 21:10:19.989622 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 21:10:19.989622 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 21:10:19.989622 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 21:10:19.989622 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 21:10:19.989622 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 21:10:19.989622 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 21:10:19.989622 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 21:10:19.991484 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 21:10:19.991484 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 21:10:19.991484 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 21:10:19.991484 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 21:10:19.991484 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 21:10:19.991484 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 21:10:19.991484 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 21:10:19.991484 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 21:10:19.991484 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 21:10:19.991484 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 21:10:19.991484 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 21:10:19.991484 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 21:10:19.991484 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 21:10:19.991484 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 21:10:19.991484 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 21:10:19.991484 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 21:10:19.991484 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: ec0cddc1c53f4af7b50dba12b5f61d68. Aug 06 21:10:19.991484 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:10:19.993696 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2312/4667] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:19 2022] DELETE /identity/v3/users/ec0cddc1c53f4af7b50dba12b5f61d68 => generated 110 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:10:19.993696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f943711-9d49-4cd9-b6a6-73b5c907c933 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:20.013468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f943711-9d49-4cd9-b6a6-73b5c907c933 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:20.093404 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940459b-f682-4a85-99f4-503a94341c45 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:20.101673 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c1c2c-3be4-454b-a59a-f3e769e4b4af tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:20.102425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c1c2c-3be4-454b-a59a-f3e769e4b4af tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:20.102797 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c1c2c-3be4-454b-a59a-f3e769e4b4af tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:20.103131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c1c2c-3be4-454b-a59a-f3e769e4b4af tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:20.103853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c1c2c-3be4-454b-a59a-f3e769e4b4af tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:20.105595 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c1c2c-3be4-454b-a59a-f3e769e4b4af tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:20.117398 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bee8e8-3099-40e3-aa9c-47ba4afc3bcc tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17cdc909fbb49ff9a70ba7411019d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f62390481db34d4d94f32dd793cd9917', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:20.118120 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bee8e8-3099-40e3-aa9c-47ba4afc3bcc tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:20.119266 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bee8e8-3099-40e3-aa9c-47ba4afc3bcc tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:20.119548 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bee8e8-3099-40e3-aa9c-47ba4afc3bcc tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] PATH_INFO: `/v3/domains/41577a96eb2b4108ad4a72ea0e36bbe6` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:20.134363 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2356/4668] 10.222.0.33 () {60 vars in 1143 bytes} [Sat Aug 6 21:10:19 2022] POST /identity/v3/roles => generated 240 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:20.138697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c1c2c-3be4-454b-a59a-f3e769e4b4af tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:20.139773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bee8e8-3099-40e3-aa9c-47ba4afc3bcc tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 21:10:20.152945 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-45bee8e8-3099-40e3-aa9c-47ba4afc3bcc tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Could not find domain: 41577a96eb2b4108ad4a72ea0e36bbe6.: keystone.exception.DomainNotFound: Could not find domain: 41577a96eb2b4108ad4a72ea0e36bbe6. Aug 06 21:10:20.152945 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:10:20.152945 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 06 21:10:20.152945 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 06 21:10:20.152945 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 21:10:20.152945 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 21:10:20.152945 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 21:10:20.152945 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 21:10:20.152945 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 41577a96eb2b4108ad4a72ea0e36bbe6. Aug 06 21:10:20.152945 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:10:20.152945 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 21:10:20.152945 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:10:20.152945 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:10:20.152945 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:10:20.152945 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:10:20.152945 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:10:20.155086 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:10:20.155086 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:10:20.155086 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:10:20.155086 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:10:20.155086 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:10:20.155086 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:10:20.155086 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:10:20.155086 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 06 21:10:20.155086 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 06 21:10:20.155086 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 21:10:20.155086 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 21:10:20.155086 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 21:10:20.155086 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 21:10:20.155086 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:10:20.155086 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:10:20.155086 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 21:10:20.156431 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 21:10:20.156431 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 21:10:20.156431 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 21:10:20.156431 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 21:10:20.156431 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 21:10:20.156431 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 21:10:20.156431 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 21:10:20.156431 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 21:10:20.156431 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 21:10:20.156431 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 21:10:20.156431 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 21:10:20.156431 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 21:10:20.156431 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 21:10:20.156431 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 06 21:10:20.156431 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 21:10:20.156431 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 41577a96eb2b4108ad4a72ea0e36bbe6. Aug 06 21:10:20.156431 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:10:20.161427 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2313/4669] 10.222.0.33 () {60 vars in 1249 bytes} [Sat Aug 6 21:10:19 2022] PATCH /identity/v3/domains/41577a96eb2b4108ad4a72ea0e36bbe6 => generated 112 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 06 21:10:20.164382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c1c2c-3be4-454b-a59a-f3e769e4b4af tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:20.166075 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bee8e8-3099-40e3-aa9c-47ba4afc3bcc tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:20.174894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:20.179076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070dbac-4948-4c17-af0c-657e4e6a04d7 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:20.180097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070dbac-4948-4c17-af0c-657e4e6a04d7 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:20.180378 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070dbac-4948-4c17-af0c-657e4e6a04d7 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:20.180732 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070dbac-4948-4c17-af0c-657e4e6a04d7 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/domains/e792baa1d7ec4e75bde41316a9680499/users/6a651aed8c0b464dbe29546467e5294b/roles/774e1b32e9ff4f1991714eade1841ad7` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:20.186324 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bee8e8-3099-40e3-aa9c-47ba4afc3bcc tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:20.217181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef34c8-31ec-4aac-921a-7bb0b3d23c15 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17cdc909fbb49ff9a70ba7411019d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f62390481db34d4d94f32dd793cd9917', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:20.218196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef34c8-31ec-4aac-921a-7bb0b3d23c15 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:20.218196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef34c8-31ec-4aac-921a-7bb0b3d23c15 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:20.218442 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef34c8-31ec-4aac-921a-7bb0b3d23c15 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:20.219250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef34c8-31ec-4aac-921a-7bb0b3d23c15 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:20.221317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef34c8-31ec-4aac-921a-7bb0b3d23c15 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:20.227240 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070dbac-4948-4c17-af0c-657e4e6a04d7 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=e792baa1d7ec4e75bde41316a9680499, user_id=6a651aed8c0b464dbe29546467e5294b, role_id=774e1b32e9ff4f1991714eade1841ad7)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:20.234128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070dbac-4948-4c17-af0c-657e4e6a04d7 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:20.263200 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2357/4670] 10.222.0.33 () {60 vars in 1480 bytes} [Sat Aug 6 21:10:20 2022] PUT /identity/v3/domains/e792baa1d7ec4e75bde41316a9680499/users/6a651aed8c0b464dbe29546467e5294b/roles/774e1b32e9ff4f1991714eade1841ad7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:20.268143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070dbac-4948-4c17-af0c-657e4e6a04d7 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:20.270297 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2314/4671] 10.222.0.33 () {58 vars in 1128 bytes} [Sat Aug 6 21:10:20 2022] GET /identity/v3/domains => generated 1611 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:20.276783 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef34c8-31ec-4aac-921a-7bb0b3d23c15 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:20.305876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef34c8-31ec-4aac-921a-7bb0b3d23c15 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:20.343261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:20.367059 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070dbac-4948-4c17-af0c-657e4e6a04d7 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:20.375642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f57a3f-7cb2-4331-8bb2-e553967b5295 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:20.376598 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f57a3f-7cb2-4331-8bb2-e553967b5295 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:20.376872 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f57a3f-7cb2-4331-8bb2-e553967b5295 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:20.387421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f57a3f-7cb2-4331-8bb2-e553967b5295 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:20.387421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f57a3f-7cb2-4331-8bb2-e553967b5295 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:20.387421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f57a3f-7cb2-4331-8bb2-e553967b5295 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:20.424700 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2358/4672] 10.222.0.33 () {60 vars in 1149 bytes} [Sat Aug 6 21:10:20 2022] POST /identity/v3/domains => generated 276 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:10:20.426070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f57a3f-7cb2-4331-8bb2-e553967b5295 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:20.457256 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f946857-a2ef-413e-ad1c-767d47da774a tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17cdc909fbb49ff9a70ba7411019d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f62390481db34d4d94f32dd793cd9917', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:20.457815 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f946857-a2ef-413e-ad1c-767d47da774a tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:20.458166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f946857-a2ef-413e-ad1c-767d47da774a tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:20.458506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f946857-a2ef-413e-ad1c-767d47da774a tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:20.459309 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f946857-a2ef-413e-ad1c-767d47da774a tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:10:20.459691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f946857-a2ef-413e-ad1c-767d47da774a tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:20.461775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f946857-a2ef-413e-ad1c-767d47da774a tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:20.495097 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2315/4673] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:10:20 2022] GET /identity/v3/domains?enabled=True => generated 1623 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:20.501282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f946857-a2ef-413e-ad1c-767d47da774a tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:20.524771 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f946857-a2ef-413e-ad1c-767d47da774a tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:20.549325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f57a3f-7cb2-4331-8bb2-e553967b5295 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:20.555149 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd8096-3804-431f-8c69-212e71220896 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:20.556014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd8096-3804-431f-8c69-212e71220896 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:20.556484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd8096-3804-431f-8c69-212e71220896 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:20.556949 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd8096-3804-431f-8c69-212e71220896 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:20.557779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd8096-3804-431f-8c69-212e71220896 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:20.559588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd8096-3804-431f-8c69-212e71220896 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:20.583053 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2359/4674] 10.222.0.33 () {60 vars in 1143 bytes} [Sat Aug 6 21:10:20 2022] POST /identity/v3/roles => generated 240 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:10:20.588111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd8096-3804-431f-8c69-212e71220896 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:20.607040 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd8096-3804-431f-8c69-212e71220896 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:20.613382 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202633a-7622-4d3f-95c7-4774986edd76 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17cdc909fbb49ff9a70ba7411019d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f62390481db34d4d94f32dd793cd9917', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:20.614133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202633a-7622-4d3f-95c7-4774986edd76 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:20.614426 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202633a-7622-4d3f-95c7-4774986edd76 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:20.614900 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202633a-7622-4d3f-95c7-4774986edd76 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:20.615558 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202633a-7622-4d3f-95c7-4774986edd76 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-1331798496) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:10:20.617094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202633a-7622-4d3f-95c7-4774986edd76 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:20.619379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202633a-7622-4d3f-95c7-4774986edd76 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:20.622670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e331f-ad64-4d7c-a295-905bc304c8da tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:20.623305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e331f-ad64-4d7c-a295-905bc304c8da tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:20.623586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e331f-ad64-4d7c-a295-905bc304c8da tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:20.623862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e331f-ad64-4d7c-a295-905bc304c8da tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/groups` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:20.624904 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175e331f-ad64-4d7c-a295-905bc304c8da tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:20.626526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175e331f-ad64-4d7c-a295-905bc304c8da tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:20.645538 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2316/4675] 10.222.0.33 () {58 vars in 1199 bytes} [Sat Aug 6 21:10:20 2022] GET /identity/v3/domains?name=tempest-test_domain-1331798496 => generated 409 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:10:20.651054 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202633a-7622-4d3f-95c7-4774986edd76 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:20.678419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202633a-7622-4d3f-95c7-4774986edd76 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:20.691801 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2360/4676] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:10:20 2022] POST /identity/v3/groups => generated 325 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:20.696922 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e331f-ad64-4d7c-a295-905bc304c8da tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:20.698452 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b786707-489c-464d-b32b-92ad3627e215 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17cdc909fbb49ff9a70ba7411019d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f62390481db34d4d94f32dd793cd9917', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:20.699318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b786707-489c-464d-b32b-92ad3627e215 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:20.700222 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b786707-489c-464d-b32b-92ad3627e215 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:20.700497 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b786707-489c-464d-b32b-92ad3627e215 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] PATH_INFO: `/v3/domains/41577a96eb2b4108ad4a72ea0e36bbe6` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:20.703508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-175e331f-ad64-4d7c-a295-905bc304c8da tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:20.727505 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b786707-489c-464d-b32b-92ad3627e215 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 21:10:20.733573 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-3b786707-489c-464d-b32b-92ad3627e215 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Could not find domain: 41577a96eb2b4108ad4a72ea0e36bbe6.: keystone.exception.DomainNotFound: Could not find domain: 41577a96eb2b4108ad4a72ea0e36bbe6. Aug 06 21:10:20.733573 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:10:20.733573 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 06 21:10:20.733573 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 06 21:10:20.733573 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 21:10:20.733573 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 21:10:20.733573 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 21:10:20.733573 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 21:10:20.733573 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 41577a96eb2b4108ad4a72ea0e36bbe6. Aug 06 21:10:20.733573 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:10:20.733573 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 21:10:20.733573 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:10:20.733573 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:10:20.733573 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:10:20.733573 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:10:20.733573 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:10:20.739635 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:10:20.739635 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:10:20.739635 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:10:20.739635 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:10:20.739635 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:10:20.739635 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:10:20.739635 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:10:20.739635 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 06 21:10:20.739635 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 06 21:10:20.739635 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 21:10:20.739635 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 21:10:20.739635 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 21:10:20.739635 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 21:10:20.739635 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:10:20.739635 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:10:20.739635 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 21:10:20.741369 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 21:10:20.741369 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 21:10:20.741369 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 21:10:20.741369 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 21:10:20.741369 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 21:10:20.741369 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 21:10:20.741369 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 21:10:20.741369 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 21:10:20.741369 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 21:10:20.741369 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 21:10:20.741369 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 21:10:20.741369 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 21:10:20.741369 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 21:10:20.741369 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 06 21:10:20.741369 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 21:10:20.741369 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 41577a96eb2b4108ad4a72ea0e36bbe6. Aug 06 21:10:20.741369 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:10:20.742947 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2317/4677] 10.222.0.33 () {60 vars in 1249 bytes} [Sat Aug 6 21:10:20 2022] PATCH /identity/v3/domains/41577a96eb2b4108ad4a72ea0e36bbe6 => generated 112 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:10:20.742947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b786707-489c-464d-b32b-92ad3627e215 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:20.771072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b786707-489c-464d-b32b-92ad3627e215 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:20.776945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f3aed-1e43-447e-a4b8-fab874ce3185 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:20.778369 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f3aed-1e43-447e-a4b8-fab874ce3185 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:20.778722 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f3aed-1e43-447e-a4b8-fab874ce3185 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:20.779001 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f3aed-1e43-447e-a4b8-fab874ce3185 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/groups/e6b841390f584097a41e294f8a52cc45/users/6a651aed8c0b464dbe29546467e5294b` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:20.788407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f3aed-1e43-447e-a4b8-fab874ce3185 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=e6b841390f584097a41e294f8a52cc45, user_id=6a651aed8c0b464dbe29546467e5294b)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:20.789444 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-2e1f3aed-1e43-447e-a4b8-fab874ce3185 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:10:20.789444 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:10:20.789444 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:10:20.790725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f3aed-1e43-447e-a4b8-fab874ce3185 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:20.826574 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2318/4678] 10.222.0.33 () {60 vars in 1360 bytes} [Sat Aug 6 21:10:20 2022] PUT /identity/v3/groups/e6b841390f584097a41e294f8a52cc45/users/6a651aed8c0b464dbe29546467e5294b => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:20.827653 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f3aed-1e43-447e-a4b8-fab874ce3185 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:20.850483 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e331f-ad64-4d7c-a295-905bc304c8da tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:20.889845 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:20.912900 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f3aed-1e43-447e-a4b8-fab874ce3185 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:20.917967 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b8550-e2d2-466b-bce9-69c35cfa3580 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:20.918655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b8550-e2d2-466b-bce9-69c35cfa3580 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:20.919010 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b8550-e2d2-466b-bce9-69c35cfa3580 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:20.919291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b8550-e2d2-466b-bce9-69c35cfa3580 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:20.919717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdf1c4-a75b-43b6-b93d-024527e2b944 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17cdc909fbb49ff9a70ba7411019d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f62390481db34d4d94f32dd793cd9917', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:20.920733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdf1c4-a75b-43b6-b93d-024527e2b944 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:20.921155 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-611b8550-e2d2-466b-bce9-69c35cfa3580 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:20.921361 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdf1c4-a75b-43b6-b93d-024527e2b944 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:20.921795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdf1c4-a75b-43b6-b93d-024527e2b944 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] PATH_INFO: `/v3/domains/da8459ec60cf442e9ff8832dfb79857d` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:20.935778 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cdf1c4-a75b-43b6-b93d-024527e2b944 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=da8459ec60cf442e9ff8832dfb79857d)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:20.936858 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:20.940092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cdf1c4-a75b-43b6-b93d-024527e2b944 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:20.994682 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b8550-e2d2-466b-bce9-69c35cfa3580 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:20.996232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b8550-e2d2-466b-bce9-69c35cfa3580 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:21.008817 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2361/4679] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:10:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:10:21.009611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b8550-e2d2-466b-bce9-69c35cfa3580 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:21.012454 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2319/4680] 10.222.0.33 () {60 vars in 1249 bytes} [Sat Aug 6 21:10:20 2022] PATCH /identity/v3/domains/da8459ec60cf442e9ff8832dfb79857d => generated 277 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:21.016930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdf1c4-a75b-43b6-b93d-024527e2b944 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:21.038618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdf1c4-a75b-43b6-b93d-024527e2b944 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:21.052826 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1652b-d380-4c88-b65f-e5aa990d260b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17cdc909fbb49ff9a70ba7411019d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f62390481db34d4d94f32dd793cd9917', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:21.053865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1652b-d380-4c88-b65f-e5aa990d260b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:21.055597 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1652b-d380-4c88-b65f-e5aa990d260b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:21.056073 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1652b-d380-4c88-b65f-e5aa990d260b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] PATH_INFO: `/v3/domains/da8459ec60cf442e9ff8832dfb79857d` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:21.075996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1652b-d380-4c88-b65f-e5aa990d260b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=da8459ec60cf442e9ff8832dfb79857d)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:21.077510 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-c1d1652b-d380-4c88-b65f-e5aa990d260b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:10:21.077510 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:10:21.077510 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:10:21.080513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1652b-d380-4c88-b65f-e5aa990d260b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:21.127847 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c1d1652b-d380-4c88-b65f-e5aa990d260b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'da8459ec60cf442e9ff8832dfb79857d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:21.153466 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c1d1652b-d380-4c88-b65f-e5aa990d260b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'da8459ec60cf442e9ff8832dfb79857d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:21.177832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b8550-e2d2-466b-bce9-69c35cfa3580 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:21.188298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c51737-789b-4b0d-a29b-80519a2d975c tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:21.189217 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c51737-789b-4b0d-a29b-80519a2d975c tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:21.189491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c51737-789b-4b0d-a29b-80519a2d975c tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:21.189768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c51737-789b-4b0d-a29b-80519a2d975c tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/domains/94409b883d784213bd09ee1c33d06c2e/groups/e6b841390f584097a41e294f8a52cc45/roles/0973045b688940cba71f79cd929dfbbf` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:21.196425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c51737-789b-4b0d-a29b-80519a2d975c tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=94409b883d784213bd09ee1c33d06c2e, group_id=e6b841390f584097a41e294f8a52cc45, role_id=0973045b688940cba71f79cd929dfbbf)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:21.200609 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c51737-789b-4b0d-a29b-80519a2d975c tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:21.221391 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2362/4681] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:10:21 2022] PUT /identity/v3/domains/94409b883d784213bd09ee1c33d06c2e/groups/e6b841390f584097a41e294f8a52cc45/roles/0973045b688940cba71f79cd929dfbbf => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:21.225759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c1d1652b-d380-4c88-b65f-e5aa990d260b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da8459ec60cf442e9ff8832dfb79857d', 'request_id': 'req-c1d1652b-d380-4c88-b65f-e5aa990d260b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:21.231979 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c51737-789b-4b0d-a29b-80519a2d975c tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:21.233188 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c1d1652b-d380-4c88-b65f-e5aa990d260b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da8459ec60cf442e9ff8832dfb79857d', 'request_id': 'req-c1d1652b-d380-4c88-b65f-e5aa990d260b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:21.244116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c1d1652b-d380-4c88-b65f-e5aa990d260b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da8459ec60cf442e9ff8832dfb79857d', 'request_id': 'req-c1d1652b-d380-4c88-b65f-e5aa990d260b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:21.267450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c1d1652b-d380-4c88-b65f-e5aa990d260b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] The token cache is being invalidate because project da8459ec60cf442e9ff8832dfb79857d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:21.268897 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c1d1652b-d380-4c88-b65f-e5aa990d260b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:21.269713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c1d1652b-d380-4c88-b65f-e5aa990d260b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:21.311058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c1d1652b-d380-4c88-b65f-e5aa990d260b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'da8459ec60cf442e9ff8832dfb79857d', 'request_id': 'req-c1d1652b-d380-4c88-b65f-e5aa990d260b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:21.312033 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c1d1652b-d380-4c88-b65f-e5aa990d260b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'da8459ec60cf442e9ff8832dfb79857d', 'request_id': 'req-c1d1652b-d380-4c88-b65f-e5aa990d260b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:21.312686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c1d1652b-d380-4c88-b65f-e5aa990d260b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'da8459ec60cf442e9ff8832dfb79857d', 'request_id': 'req-c1d1652b-d380-4c88-b65f-e5aa990d260b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:21.331695 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2320/4682] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:10:21 2022] DELETE /identity/v3/domains/da8459ec60cf442e9ff8832dfb79857d => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:21.340486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1652b-d380-4c88-b65f-e5aa990d260b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:21.347710 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c1d1652b-d380-4c88-b65f-e5aa990d260b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:21.404214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c51737-789b-4b0d-a29b-80519a2d975c tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:21.419836 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080bd61-f620-4594-a298-d35d68ed1919 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:21.420595 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080bd61-f620-4594-a298-d35d68ed1919 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:21.421739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080bd61-f620-4594-a298-d35d68ed1919 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:21.423518 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080bd61-f620-4594-a298-d35d68ed1919 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:21.424460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3080bd61-f620-4594-a298-d35d68ed1919 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:21.431266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3080bd61-f620-4594-a298-d35d68ed1919 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:21.467267 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:21.468439 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2363/4683] 10.222.0.33 () {60 vars in 1149 bytes} [Sat Aug 6 21:10:21 2022] POST /identity/v3/domains => generated 276 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:10:21.473402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080bd61-f620-4594-a298-d35d68ed1919 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:21.478457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3080bd61-f620-4594-a298-d35d68ed1919 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:21.527637 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1652b-d380-4c88-b65f-e5aa990d260b tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:21.587585 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:21.633423 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080bd61-f620-4594-a298-d35d68ed1919 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:21.643305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a02601-4207-4d9e-a376-faeffc00e6cc tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:21.644215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a02601-4207-4d9e-a376-faeffc00e6cc tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:21.644566 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a02601-4207-4d9e-a376-faeffc00e6cc tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:21.644938 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a02601-4207-4d9e-a376-faeffc00e6cc tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:21.645781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a02601-4207-4d9e-a376-faeffc00e6cc tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:21.647551 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a02601-4207-4d9e-a376-faeffc00e6cc tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:21.690487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418914e5-e10c-49f9-bead-8225fad23910 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17cdc909fbb49ff9a70ba7411019d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f62390481db34d4d94f32dd793cd9917', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:21.691347 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2364/4684] 10.222.0.33 () {60 vars in 1143 bytes} [Sat Aug 6 21:10:21 2022] POST /identity/v3/roles => generated 240 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:21.691644 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418914e5-e10c-49f9-bead-8225fad23910 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:21.692016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418914e5-e10c-49f9-bead-8225fad23910 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:21.692443 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418914e5-e10c-49f9-bead-8225fad23910 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] PATH_INFO: `/v3/domains/afbd50dfb038489c9f59d080886aee62` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:21.696125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a02601-4207-4d9e-a376-faeffc00e6cc tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:21.711935 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418914e5-e10c-49f9-bead-8225fad23910 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=afbd50dfb038489c9f59d080886aee62)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:21.713837 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418914e5-e10c-49f9-bead-8225fad23910 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:21.716377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a02601-4207-4d9e-a376-faeffc00e6cc tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:21.723202 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ef5e7-8ce3-4ea7-9c80-372b0e1232ee tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:21.724166 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ef5e7-8ce3-4ea7-9c80-372b0e1232ee tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:21.724551 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ef5e7-8ce3-4ea7-9c80-372b0e1232ee tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:21.724982 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ef5e7-8ce3-4ea7-9c80-372b0e1232ee tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/domains/e515fbf3a7864f83b7c081a2b87c137c/users/6a651aed8c0b464dbe29546467e5294b/roles/be4959b47ba24958838e7a99d405a23b` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:21.762472 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-418914e5-e10c-49f9-bead-8225fad23910 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'afbd50dfb038489c9f59d080886aee62'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:21.762717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ef5e7-8ce3-4ea7-9c80-372b0e1232ee tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=e515fbf3a7864f83b7c081a2b87c137c, user_id=6a651aed8c0b464dbe29546467e5294b, role_id=be4959b47ba24958838e7a99d405a23b)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:21.763245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-418914e5-e10c-49f9-bead-8225fad23910 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'afbd50dfb038489c9f59d080886aee62'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:21.765659 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ef5e7-8ce3-4ea7-9c80-372b0e1232ee tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:21.797736 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2365/4685] 10.222.0.33 () {60 vars in 1480 bytes} [Sat Aug 6 21:10:21 2022] PUT /identity/v3/domains/e515fbf3a7864f83b7c081a2b87c137c/users/6a651aed8c0b464dbe29546467e5294b/roles/be4959b47ba24958838e7a99d405a23b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:10:21.802067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ef5e7-8ce3-4ea7-9c80-372b0e1232ee tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:21.804488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8b8ef5e7-8ce3-4ea7-9c80-372b0e1232ee tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:21.834097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-418914e5-e10c-49f9-bead-8225fad23910 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'afbd50dfb038489c9f59d080886aee62'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:21.835389 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-418914e5-e10c-49f9-bead-8225fad23910 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'afbd50dfb038489c9f59d080886aee62'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:21.845937 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2321/4686] 10.222.0.33 () {60 vars in 1249 bytes} [Sat Aug 6 21:10:21 2022] PATCH /identity/v3/domains/afbd50dfb038489c9f59d080886aee62 => generated 276 bytes in 503 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:21.847647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418914e5-e10c-49f9-bead-8225fad23910 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:21.851238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-418914e5-e10c-49f9-bead-8225fad23910 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:21.987208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418914e5-e10c-49f9-bead-8225fad23910 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:22.001165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ef5e7-8ce3-4ea7-9c80-372b0e1232ee tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:22.017401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec908c-f8a0-4366-a24b-f33aab8f2d4b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:22.019984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec908c-f8a0-4366-a24b-f33aab8f2d4b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:22.020273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec908c-f8a0-4366-a24b-f33aab8f2d4b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:22.020585 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec908c-f8a0-4366-a24b-f33aab8f2d4b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:22.021260 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec908c-f8a0-4366-a24b-f33aab8f2d4b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:22.024646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec908c-f8a0-4366-a24b-f33aab8f2d4b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:22.055034 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2366/4687] 10.222.0.33 () {60 vars in 1149 bytes} [Sat Aug 6 21:10:21 2022] POST /identity/v3/domains => generated 276 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:22.056764 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec908c-f8a0-4366-a24b-f33aab8f2d4b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:22.059558 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-35ec908c-f8a0-4366-a24b-f33aab8f2d4b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:22.090587 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:22.134994 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397eae9-9f36-4658-931f-58991bf8c0cf tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17cdc909fbb49ff9a70ba7411019d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f62390481db34d4d94f32dd793cd9917', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:22.135658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397eae9-9f36-4658-931f-58991bf8c0cf tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:22.135941 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397eae9-9f36-4658-931f-58991bf8c0cf tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:22.136217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397eae9-9f36-4658-931f-58991bf8c0cf tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] PATH_INFO: `/v3/domains/afbd50dfb038489c9f59d080886aee62` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:22.175813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397eae9-9f36-4658-931f-58991bf8c0cf tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=afbd50dfb038489c9f59d080886aee62)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:22.177518 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397eae9-9f36-4658-931f-58991bf8c0cf tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:22.237106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c397eae9-9f36-4658-931f-58991bf8c0cf tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'afbd50dfb038489c9f59d080886aee62'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:22.247431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec908c-f8a0-4366-a24b-f33aab8f2d4b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:22.262027 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24554f-4d2c-4b7f-b42e-309b1a1dd76b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:22.263061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24554f-4d2c-4b7f-b42e-309b1a1dd76b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:22.264734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24554f-4d2c-4b7f-b42e-309b1a1dd76b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:22.265472 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24554f-4d2c-4b7f-b42e-309b1a1dd76b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:22.267280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d24554f-4d2c-4b7f-b42e-309b1a1dd76b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:22.267548 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c397eae9-9f36-4658-931f-58991bf8c0cf tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'afbd50dfb038489c9f59d080886aee62'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:22.271560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d24554f-4d2c-4b7f-b42e-309b1a1dd76b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:22.316112 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2367/4688] 10.222.0.33 () {60 vars in 1143 bytes} [Sat Aug 6 21:10:22 2022] POST /identity/v3/roles => generated 240 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:22.317193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24554f-4d2c-4b7f-b42e-309b1a1dd76b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:22.331697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24554f-4d2c-4b7f-b42e-309b1a1dd76b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:22.337582 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b012081-18bc-4252-ab3c-deb7dbca4e93 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:22.338684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b012081-18bc-4252-ab3c-deb7dbca4e93 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:22.339717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b012081-18bc-4252-ab3c-deb7dbca4e93 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:22.340257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b012081-18bc-4252-ab3c-deb7dbca4e93 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/groups` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:22.341870 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b012081-18bc-4252-ab3c-deb7dbca4e93 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:22.344981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b012081-18bc-4252-ab3c-deb7dbca4e93 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:22.390201 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2368/4689] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:10:22 2022] POST /identity/v3/groups => generated 327 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:22.394363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b012081-18bc-4252-ab3c-deb7dbca4e93 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:22.408062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b012081-18bc-4252-ab3c-deb7dbca4e93 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:22.411026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c397eae9-9f36-4658-931f-58991bf8c0cf tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afbd50dfb038489c9f59d080886aee62', 'request_id': 'req-c397eae9-9f36-4658-931f-58991bf8c0cf'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:22.430591 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c397eae9-9f36-4658-931f-58991bf8c0cf tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afbd50dfb038489c9f59d080886aee62', 'request_id': 'req-c397eae9-9f36-4658-931f-58991bf8c0cf'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:22.441189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:22.448307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c397eae9-9f36-4658-931f-58991bf8c0cf tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afbd50dfb038489c9f59d080886aee62', 'request_id': 'req-c397eae9-9f36-4658-931f-58991bf8c0cf'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:22.477773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c397eae9-9f36-4658-931f-58991bf8c0cf tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] The token cache is being invalidate because project afbd50dfb038489c9f59d080886aee62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:22.478252 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c397eae9-9f36-4658-931f-58991bf8c0cf tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:22.479425 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c397eae9-9f36-4658-931f-58991bf8c0cf tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:22.509954 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c397eae9-9f36-4658-931f-58991bf8c0cf tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'afbd50dfb038489c9f59d080886aee62', 'request_id': 'req-c397eae9-9f36-4658-931f-58991bf8c0cf'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:22.518676 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c397eae9-9f36-4658-931f-58991bf8c0cf tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'afbd50dfb038489c9f59d080886aee62', 'request_id': 'req-c397eae9-9f36-4658-931f-58991bf8c0cf'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:22.518676 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c397eae9-9f36-4658-931f-58991bf8c0cf tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'afbd50dfb038489c9f59d080886aee62', 'request_id': 'req-c397eae9-9f36-4658-931f-58991bf8c0cf'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:22.520665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9982fc-9c14-4921-9542-4effe89b6e86 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:22.521527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9982fc-9c14-4921-9542-4effe89b6e86 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:22.521814 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9982fc-9c14-4921-9542-4effe89b6e86 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:22.522385 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9982fc-9c14-4921-9542-4effe89b6e86 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/groups/ef5fe4dd3f904440875fcc4ef6bc4df8/users/6a651aed8c0b464dbe29546467e5294b` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:22.529279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9982fc-9c14-4921-9542-4effe89b6e86 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=ef5fe4dd3f904440875fcc4ef6bc4df8, user_id=6a651aed8c0b464dbe29546467e5294b)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:22.532238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9982fc-9c14-4921-9542-4effe89b6e86 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:22.564960 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2322/4690] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:10:21 2022] DELETE /identity/v3/domains/afbd50dfb038489c9f59d080886aee62 => generated 0 bytes in 715 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:22.566962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397eae9-9f36-4658-931f-58991bf8c0cf tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:22.571597 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c397eae9-9f36-4658-931f-58991bf8c0cf tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:22.584160 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2369/4691] 10.222.0.33 () {60 vars in 1360 bytes} [Sat Aug 6 21:10:22 2022] PUT /identity/v3/groups/ef5fe4dd3f904440875fcc4ef6bc4df8/users/6a651aed8c0b464dbe29546467e5294b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:22.586463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9982fc-9c14-4921-9542-4effe89b6e86 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:22.590854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0a9982fc-9c14-4921-9542-4effe89b6e86 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:22.674512 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397eae9-9f36-4658-931f-58991bf8c0cf tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:22.725667 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:22.800479 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e1a42-3026-47de-9163-65d480baf7a9 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17cdc909fbb49ff9a70ba7411019d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f62390481db34d4d94f32dd793cd9917', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:22.801182 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e1a42-3026-47de-9163-65d480baf7a9 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:22.801465 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e1a42-3026-47de-9163-65d480baf7a9 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:22.801778 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e1a42-3026-47de-9163-65d480baf7a9 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] PATH_INFO: `/v3/domains/d26a7e164ab546238e94b731e52e22fd` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:22.803806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9982fc-9c14-4921-9542-4effe89b6e86 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:22.811540 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145dcf7-adb4-411a-9bdd-856d5d176675 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:22.813507 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145dcf7-adb4-411a-9bdd-856d5d176675 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:22.814093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145dcf7-adb4-411a-9bdd-856d5d176675 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:22.814675 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145dcf7-adb4-411a-9bdd-856d5d176675 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/domains/b77d9c02a39d45a1aabb466e49453a1e/groups/ef5fe4dd3f904440875fcc4ef6bc4df8/roles/3a210f311b314553bc3770496fa6f40d` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:22.815570 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e1a42-3026-47de-9163-65d480baf7a9 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d26a7e164ab546238e94b731e52e22fd)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:22.817193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5145dcf7-adb4-411a-9bdd-856d5d176675 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=b77d9c02a39d45a1aabb466e49453a1e, group_id=ef5fe4dd3f904440875fcc4ef6bc4df8, role_id=3a210f311b314553bc3770496fa6f40d)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:22.817343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e1a42-3026-47de-9163-65d480baf7a9 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:22.823114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5145dcf7-adb4-411a-9bdd-856d5d176675 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:22.847497 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5c0e1a42-3026-47de-9163-65d480baf7a9 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd26a7e164ab546238e94b731e52e22fd'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:22.848351 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5c0e1a42-3026-47de-9163-65d480baf7a9 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd26a7e164ab546238e94b731e52e22fd'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:22.852052 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2370/4692] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:10:22 2022] PUT /identity/v3/domains/b77d9c02a39d45a1aabb466e49453a1e/groups/ef5fe4dd3f904440875fcc4ef6bc4df8/roles/3a210f311b314553bc3770496fa6f40d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:22.856328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145dcf7-adb4-411a-9bdd-856d5d176675 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:22.860592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5145dcf7-adb4-411a-9bdd-856d5d176675 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:22.926124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5c0e1a42-3026-47de-9163-65d480baf7a9 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd26a7e164ab546238e94b731e52e22fd'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:22.926975 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5c0e1a42-3026-47de-9163-65d480baf7a9 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd26a7e164ab546238e94b731e52e22fd'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:22.930396 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2323/4693] 10.222.0.33 () {60 vars in 1249 bytes} [Sat Aug 6 21:10:22 2022] PATCH /identity/v3/domains/d26a7e164ab546238e94b731e52e22fd => generated 278 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:22.933944 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e1a42-3026-47de-9163-65d480baf7a9 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:22.935371 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5c0e1a42-3026-47de-9163-65d480baf7a9 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:23.020611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145dcf7-adb4-411a-9bdd-856d5d176675 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:23.044728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:23.073728 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e1a42-3026-47de-9163-65d480baf7a9 tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:23.083853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47d17c-5df8-4702-a26e-2028ec987deb tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17cdc909fbb49ff9a70ba7411019d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f62390481db34d4d94f32dd793cd9917', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:23.084714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47d17c-5df8-4702-a26e-2028ec987deb tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:23.085167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47d17c-5df8-4702-a26e-2028ec987deb tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:23.085776 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47d17c-5df8-4702-a26e-2028ec987deb tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] PATH_INFO: `/v3/domains/d26a7e164ab546238e94b731e52e22fd` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:23.123266 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47d17c-5df8-4702-a26e-2028ec987deb tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d26a7e164ab546238e94b731e52e22fd)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:23.124901 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47d17c-5df8-4702-a26e-2028ec987deb tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:23.141674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260397de-8e26-468c-a82d-b05c4410c0e6 tempest-TokensV3TestJSON-722602685 tempest-TokensV3TestJSON-722602685-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a651aed8c0b464dbe29546467e5294b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f03bc1de7174fe1afac7baace1fc7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:23.142855 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260397de-8e26-468c-a82d-b05c4410c0e6 tempest-TokensV3TestJSON-722602685 tempest-TokensV3TestJSON-722602685-project] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:23.143920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260397de-8e26-468c-a82d-b05c4410c0e6 tempest-TokensV3TestJSON-722602685 tempest-TokensV3TestJSON-722602685-project] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:23.144210 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260397de-8e26-468c-a82d-b05c4410c0e6 tempest-TokensV3TestJSON-722602685 tempest-TokensV3TestJSON-722602685-project] PATH_INFO: `/v3/auth/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:23.145130 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260397de-8e26-468c-a82d-b05c4410c0e6 tempest-TokensV3TestJSON-722602685 tempest-TokensV3TestJSON-722602685-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:23.146354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260397de-8e26-468c-a82d-b05c4410c0e6 tempest-TokensV3TestJSON-722602685 tempest-TokensV3TestJSON-722602685-project] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:23.184840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dc47d17c-5df8-4702-a26e-2028ec987deb tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd26a7e164ab546238e94b731e52e22fd'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:23.207470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dc47d17c-5df8-4702-a26e-2028ec987deb tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd26a7e164ab546238e94b731e52e22fd'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:23.234049 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2371/4694] 10.222.0.33 () {58 vars in 1143 bytes} [Sat Aug 6 21:10:22 2022] GET /identity/v3/auth/domains => generated 1171 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:23.238591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260397de-8e26-468c-a82d-b05c4410c0e6 tempest-TokensV3TestJSON-722602685 tempest-TokensV3TestJSON-722602685-project] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:23.243109 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-260397de-8e26-468c-a82d-b05c4410c0e6 tempest-TokensV3TestJSON-722602685 tempest-TokensV3TestJSON-722602685-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:23.299705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dc47d17c-5df8-4702-a26e-2028ec987deb tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd26a7e164ab546238e94b731e52e22fd', 'request_id': 'req-dc47d17c-5df8-4702-a26e-2028ec987deb'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:23.304472 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:DELETE=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:23.316063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dc47d17c-5df8-4702-a26e-2028ec987deb tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd26a7e164ab546238e94b731e52e22fd', 'request_id': 'req-dc47d17c-5df8-4702-a26e-2028ec987deb'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:23.329224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dc47d17c-5df8-4702-a26e-2028ec987deb tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd26a7e164ab546238e94b731e52e22fd', 'request_id': 'req-dc47d17c-5df8-4702-a26e-2028ec987deb'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:23.355547 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dc47d17c-5df8-4702-a26e-2028ec987deb tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] The token cache is being invalidate because project d26a7e164ab546238e94b731e52e22fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:23.355885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dc47d17c-5df8-4702-a26e-2028ec987deb tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:23.360784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dc47d17c-5df8-4702-a26e-2028ec987deb tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:23.375046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dc47d17c-5df8-4702-a26e-2028ec987deb tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd26a7e164ab546238e94b731e52e22fd', 'request_id': 'req-dc47d17c-5df8-4702-a26e-2028ec987deb'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:23.377394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dc47d17c-5df8-4702-a26e-2028ec987deb tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd26a7e164ab546238e94b731e52e22fd', 'request_id': 'req-dc47d17c-5df8-4702-a26e-2028ec987deb'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:23.377909 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dc47d17c-5df8-4702-a26e-2028ec987deb tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd26a7e164ab546238e94b731e52e22fd', 'request_id': 'req-dc47d17c-5df8-4702-a26e-2028ec987deb'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:23.393376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260397de-8e26-468c-a82d-b05c4410c0e6 tempest-TokensV3TestJSON-722602685 tempest-TokensV3TestJSON-722602685-project] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:23.409386 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2324/4695] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:10:22 2022] DELETE /identity/v3/domains/d26a7e164ab546238e94b731e52e22fd => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:23.413601 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47d17c-5df8-4702-a26e-2028ec987deb tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:23.417943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-dc47d17c-5df8-4702-a26e-2028ec987deb tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:23.447065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:23.466258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938277a-3fb4-43d5-9d4b-2022af1cf1df tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:23.466975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938277a-3fb4-43d5-9d4b-2022af1cf1df tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:23.467257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938277a-3fb4-43d5-9d4b-2022af1cf1df tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:23.467536 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938277a-3fb4-43d5-9d4b-2022af1cf1df tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/domains/b77d9c02a39d45a1aabb466e49453a1e/groups/ef5fe4dd3f904440875fcc4ef6bc4df8/roles/3a210f311b314553bc3770496fa6f40d` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:23.470194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938277a-3fb4-43d5-9d4b-2022af1cf1df tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=b77d9c02a39d45a1aabb466e49453a1e, group_id=ef5fe4dd3f904440875fcc4ef6bc4df8, role_id=3a210f311b314553bc3770496fa6f40d)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:23.472900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938277a-3fb4-43d5-9d4b-2022af1cf1df tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:23.482007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7938277a-3fb4-43d5-9d4b-2022af1cf1df tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invalidating the token cache because role 3a210f311b314553bc3770496fa6f40d was removed from group ef5fe4dd3f904440875fcc4ef6bc4df8 on domain b77d9c02a39d45a1aabb466e49453a1e. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:23.482411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7938277a-3fb4-43d5-9d4b-2022af1cf1df tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:23.483079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7938277a-3fb4-43d5-9d4b-2022af1cf1df tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:23.508903 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2372/4696] 10.222.0.33 () {58 vars in 1467 bytes} [Sat Aug 6 21:10:23 2022] DELETE /identity/v3/domains/b77d9c02a39d45a1aabb466e49453a1e/groups/ef5fe4dd3f904440875fcc4ef6bc4df8/roles/3a210f311b314553bc3770496fa6f40d => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:23.513040 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938277a-3fb4-43d5-9d4b-2022af1cf1df tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:23.515431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7938277a-3fb4-43d5-9d4b-2022af1cf1df tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:23.579562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47d17c-5df8-4702-a26e-2028ec987deb tempest-DomainsTestJSON-1402197849 tempest-DomainsTestJSON-1402197849-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:23.661606 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938277a-3fb4-43d5-9d4b-2022af1cf1df tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:23.675338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f50e03-39b2-4e46-9e82-87b40e40d252 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:23.677847 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f50e03-39b2-4e46-9e82-87b40e40d252 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:23.678094 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f50e03-39b2-4e46-9e82-87b40e40d252 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:23.679918 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f50e03-39b2-4e46-9e82-87b40e40d252 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/groups/ef5fe4dd3f904440875fcc4ef6bc4df8/users/6a651aed8c0b464dbe29546467e5294b` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:23.683952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f50e03-39b2-4e46-9e82-87b40e40d252 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=ef5fe4dd3f904440875fcc4ef6bc4df8, user_id=6a651aed8c0b464dbe29546467e5294b)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:23.685224 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-f8f50e03-39b2-4e46-9e82-87b40e40d252 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:10:23.685224 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:10:23.685224 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:10:23.694402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f50e03-39b2-4e46-9e82-87b40e40d252 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:23.708106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b43a3a-12c3-4d2c-8c14-058b70948d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:23.708856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b43a3a-12c3-4d2c-8c14-058b70948d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:23.709228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b43a3a-12c3-4d2c-8c14-058b70948d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:23.710174 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b43a3a-12c3-4d2c-8c14-058b70948d9b admin admin] PATH_INFO: `/v3/users/5341b1d8513f4c949ed62101039b983e` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:23.711815 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b43a3a-12c3-4d2c-8c14-058b70948d9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5341b1d8513f4c949ed62101039b983e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:23.715116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f8f50e03-39b2-4e46-9e82-87b40e40d252 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '6a651aed8c0b464dbe29546467e5294b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:23.715706 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b43a3a-12c3-4d2c-8c14-058b70948d9b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:23.743613 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2373/4697] 10.222.0.33 () {58 vars in 1344 bytes} [Sat Aug 6 21:10:23 2022] DELETE /identity/v3/groups/ef5fe4dd3f904440875fcc4ef6bc4df8/users/6a651aed8c0b464dbe29546467e5294b => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:23.746009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f50e03-39b2-4e46-9e82-87b40e40d252 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:23.826354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-15b43a3a-12c3-4d2c-8c14-058b70948d9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5341b1d8513f4c949ed62101039b983e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:23.829131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-15b43a3a-12c3-4d2c-8c14-058b70948d9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5341b1d8513f4c949ed62101039b983e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:23.830876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-15b43a3a-12c3-4d2c-8c14-058b70948d9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5341b1d8513f4c949ed62101039b983e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:23.850853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-15b43a3a-12c3-4d2c-8c14-058b70948d9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5341b1d8513f4c949ed62101039b983e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:23.884993 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f50e03-39b2-4e46-9e82-87b40e40d252 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:23.899262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:23.900636 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706bc7c-119c-4904-bc9d-e3888ea60b29 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:23.901367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706bc7c-119c-4904-bc9d-e3888ea60b29 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:23.902060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706bc7c-119c-4904-bc9d-e3888ea60b29 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:23.902060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706bc7c-119c-4904-bc9d-e3888ea60b29 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/groups/ef5fe4dd3f904440875fcc4ef6bc4df8` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:23.902925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-15b43a3a-12c3-4d2c-8c14-058b70948d9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5341b1d8513f4c949ed62101039b983e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:23.903589 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706bc7c-119c-4904-bc9d-e3888ea60b29 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:delete_group(group_id=ef5fe4dd3f904440875fcc4ef6bc4df8)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:23.904675 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-a706bc7c-119c-4904-bc9d-e3888ea60b29 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:10:23.904675 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:10:23.904675 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:10:23.906093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706bc7c-119c-4904-bc9d-e3888ea60b29 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:23.952617 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2325/4698] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:23 2022] DELETE /identity/v3/users/5341b1d8513f4c949ed62101039b983e => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:23.959503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fada670-2a54-4cb7-9fdf-7adb3c5d3db2 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:23.961693 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fada670-2a54-4cb7-9fdf-7adb3c5d3db2 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:23.962022 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fada670-2a54-4cb7-9fdf-7adb3c5d3db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:23.999197 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2374/4699] 10.222.0.33 () {58 vars in 1227 bytes} [Sat Aug 6 21:10:23 2022] DELETE /identity/v3/groups/ef5fe4dd3f904440875fcc4ef6bc4df8 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:23.999434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-5fada670-2a54-4cb7-9fdf-7adb3c5d3db2 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:24.001670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5fada670-2a54-4cb7-9fdf-7adb3c5d3db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:24.003393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706bc7c-119c-4904-bc9d-e3888ea60b29 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:24.007471 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a706bc7c-119c-4904-bc9d-e3888ea60b29 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:24.031128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:24.099148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706bc7c-119c-4904-bc9d-e3888ea60b29 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:24.106001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f10db-e638-4950-bea4-b23773b9449e tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:24.107186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f10db-e638-4950-bea4-b23773b9449e tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:24.107760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f10db-e638-4950-bea4-b23773b9449e tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:24.108201 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f10db-e638-4950-bea4-b23773b9449e tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/roles/3a210f311b314553bc3770496fa6f40d` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:24.111765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f10db-e638-4950-bea4-b23773b9449e tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3a210f311b314553bc3770496fa6f40d)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:24.114203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f10db-e638-4950-bea4-b23773b9449e tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:24.140616 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2326/4700] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:24.163294 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-398f10db-e638-4950-bea4-b23773b9449e tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invalidating the token cache because role 3a210f311b314553bc3770496fa6f40d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:24.164138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-398f10db-e638-4950-bea4-b23773b9449e tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:24.165093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-398f10db-e638-4950-bea4-b23773b9449e tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:24.167445 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2375/4701] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:24 2022] DELETE /identity/v3/roles/3a210f311b314553bc3770496fa6f40d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:24.171904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fada670-2a54-4cb7-9fdf-7adb3c5d3db2 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:24.185236 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f10db-e638-4950-bea4-b23773b9449e tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:24.187839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-398f10db-e638-4950-bea4-b23773b9449e tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:24.188813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fada670-2a54-4cb7-9fdf-7adb3c5d3db2 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:24.306426 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f10db-e638-4950-bea4-b23773b9449e tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:24.313864 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477987fc-0b59-4978-be92-6bf7a0095bed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:24.315409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477987fc-0b59-4978-be92-6bf7a0095bed service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:24.315697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477987fc-0b59-4978-be92-6bf7a0095bed service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:24.318453 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477987fc-0b59-4978-be92-6bf7a0095bed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:24.330260 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-477987fc-0b59-4978-be92-6bf7a0095bed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:24.377689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854ed93-c8a7-4cbf-9888-4a214e42184f tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:24.378316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854ed93-c8a7-4cbf-9888-4a214e42184f tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:24.378636 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854ed93-c8a7-4cbf-9888-4a214e42184f tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:24.378919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854ed93-c8a7-4cbf-9888-4a214e42184f tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/domains/b77d9c02a39d45a1aabb466e49453a1e` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:24.380227 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1854ed93-c8a7-4cbf-9888-4a214e42184f tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b77d9c02a39d45a1aabb466e49453a1e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:24.381859 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1854ed93-c8a7-4cbf-9888-4a214e42184f tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:24.443974 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1854ed93-c8a7-4cbf-9888-4a214e42184f tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b77d9c02a39d45a1aabb466e49453a1e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:24.444380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1854ed93-c8a7-4cbf-9888-4a214e42184f tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b77d9c02a39d45a1aabb466e49453a1e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:24.499233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1854ed93-c8a7-4cbf-9888-4a214e42184f tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b77d9c02a39d45a1aabb466e49453a1e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:24.500871 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477987fc-0b59-4978-be92-6bf7a0095bed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:24.502463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477987fc-0b59-4978-be92-6bf7a0095bed service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:24.507731 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1854ed93-c8a7-4cbf-9888-4a214e42184f tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b77d9c02a39d45a1aabb466e49453a1e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:24.517592 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2327/4702] 10.222.0.33 () {60 vars in 1249 bytes} [Sat Aug 6 21:10:24 2022] PATCH /identity/v3/domains/b77d9c02a39d45a1aabb466e49453a1e => generated 277 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:24.525769 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854ed93-c8a7-4cbf-9888-4a214e42184f tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:24.529144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1854ed93-c8a7-4cbf-9888-4a214e42184f tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:24.533835 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2376/4703] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:10:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:10:24.611180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:24.639906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854ed93-c8a7-4cbf-9888-4a214e42184f tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:24.651149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5933a40-da20-438b-8a1f-720db10b9f3d tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:24.652898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5933a40-da20-438b-8a1f-720db10b9f3d tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:24.653188 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5933a40-da20-438b-8a1f-720db10b9f3d tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:24.653468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5933a40-da20-438b-8a1f-720db10b9f3d tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/domains/b77d9c02a39d45a1aabb466e49453a1e` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:24.681129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5933a40-da20-438b-8a1f-720db10b9f3d tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b77d9c02a39d45a1aabb466e49453a1e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:24.682802 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5933a40-da20-438b-8a1f-720db10b9f3d tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:24.732729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c5933a40-da20-438b-8a1f-720db10b9f3d tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b77d9c02a39d45a1aabb466e49453a1e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:24.747936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c5933a40-da20-438b-8a1f-720db10b9f3d tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b77d9c02a39d45a1aabb466e49453a1e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:24.813593 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c5933a40-da20-438b-8a1f-720db10b9f3d tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b77d9c02a39d45a1aabb466e49453a1e', 'request_id': 'req-c5933a40-da20-438b-8a1f-720db10b9f3d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:24.822478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c5933a40-da20-438b-8a1f-720db10b9f3d tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b77d9c02a39d45a1aabb466e49453a1e', 'request_id': 'req-c5933a40-da20-438b-8a1f-720db10b9f3d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:24.833182 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c5933a40-da20-438b-8a1f-720db10b9f3d tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b77d9c02a39d45a1aabb466e49453a1e', 'request_id': 'req-c5933a40-da20-438b-8a1f-720db10b9f3d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:24.862326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c5933a40-da20-438b-8a1f-720db10b9f3d tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] The token cache is being invalidate because project b77d9c02a39d45a1aabb466e49453a1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:24.862785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c5933a40-da20-438b-8a1f-720db10b9f3d tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:24.864123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c5933a40-da20-438b-8a1f-720db10b9f3d tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:24.876156 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c5933a40-da20-438b-8a1f-720db10b9f3d tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b77d9c02a39d45a1aabb466e49453a1e', 'request_id': 'req-c5933a40-da20-438b-8a1f-720db10b9f3d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:24.877382 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c5933a40-da20-438b-8a1f-720db10b9f3d tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b77d9c02a39d45a1aabb466e49453a1e', 'request_id': 'req-c5933a40-da20-438b-8a1f-720db10b9f3d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:24.878290 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c5933a40-da20-438b-8a1f-720db10b9f3d tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b77d9c02a39d45a1aabb466e49453a1e', 'request_id': 'req-c5933a40-da20-438b-8a1f-720db10b9f3d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:24.897623 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2328/4704] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:10:24 2022] DELETE /identity/v3/domains/b77d9c02a39d45a1aabb466e49453a1e => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:24.901642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477987fc-0b59-4978-be92-6bf7a0095bed service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:24.903748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-477987fc-0b59-4978-be92-6bf7a0095bed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:24.921067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477987fc-0b59-4978-be92-6bf7a0095bed service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:24.960426 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:24.999355 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54f233-5241-4cd2-9f8b-ab6b2169270b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:25.000731 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54f233-5241-4cd2-9f8b-ab6b2169270b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:25.001826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54f233-5241-4cd2-9f8b-ab6b2169270b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:25.002117 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54f233-5241-4cd2-9f8b-ab6b2169270b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/domains/e515fbf3a7864f83b7c081a2b87c137c/users/6a651aed8c0b464dbe29546467e5294b/roles/be4959b47ba24958838e7a99d405a23b` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:25.004615 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54f233-5241-4cd2-9f8b-ab6b2169270b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=e515fbf3a7864f83b7c081a2b87c137c, user_id=6a651aed8c0b464dbe29546467e5294b, role_id=be4959b47ba24958838e7a99d405a23b)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:25.007577 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54f233-5241-4cd2-9f8b-ab6b2169270b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:25.014583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1a54f233-5241-4cd2-9f8b-ab6b2169270b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invalidating the token cache because role be4959b47ba24958838e7a99d405a23b was removed from user 6a651aed8c0b464dbe29546467e5294b on domain e515fbf3a7864f83b7c081a2b87c137c. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:25.015292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1a54f233-5241-4cd2-9f8b-ab6b2169270b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:25.016998 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1a54f233-5241-4cd2-9f8b-ab6b2169270b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:25.042248 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2377/4705] 10.222.0.33 () {58 vars in 1464 bytes} [Sat Aug 6 21:10:24 2022] DELETE /identity/v3/domains/e515fbf3a7864f83b7c081a2b87c137c/users/6a651aed8c0b464dbe29546467e5294b/roles/be4959b47ba24958838e7a99d405a23b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:25.043866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5933a40-da20-438b-8a1f-720db10b9f3d tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:25.045804 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c5933a40-da20-438b-8a1f-720db10b9f3d tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:25.099463 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5933a40-da20-438b-8a1f-720db10b9f3d tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:25.230526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa7f27-f1df-45bd-9b42-7d97c47a294f tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:25.231195 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa7f27-f1df-45bd-9b42-7d97c47a294f tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:25.231475 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa7f27-f1df-45bd-9b42-7d97c47a294f tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:25.231753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa7f27-f1df-45bd-9b42-7d97c47a294f tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/roles/be4959b47ba24958838e7a99d405a23b` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:25.233191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa7f27-f1df-45bd-9b42-7d97c47a294f tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:delete_role(role_id=be4959b47ba24958838e7a99d405a23b)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:25.234970 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa7f27-f1df-45bd-9b42-7d97c47a294f tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:25.310981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:25.333117 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-36fa7f27-f1df-45bd-9b42-7d97c47a294f tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invalidating the token cache because role be4959b47ba24958838e7a99d405a23b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:25.334675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-36fa7f27-f1df-45bd-9b42-7d97c47a294f tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:25.336500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-36fa7f27-f1df-45bd-9b42-7d97c47a294f tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:25.339730 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2329/4706] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:25 2022] DELETE /identity/v3/roles/be4959b47ba24958838e7a99d405a23b => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:25.343746 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54f233-5241-4cd2-9f8b-ab6b2169270b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:25.346153 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1a54f233-5241-4cd2-9f8b-ab6b2169270b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:25.365394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54f233-5241-4cd2-9f8b-ab6b2169270b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:25.512492 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45006907-1ac3-48cc-aed2-ce731da03c96 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:25.513199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45006907-1ac3-48cc-aed2-ce731da03c96 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:25.513199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45006907-1ac3-48cc-aed2-ce731da03c96 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:25.519892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45006907-1ac3-48cc-aed2-ce731da03c96 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/domains/e515fbf3a7864f83b7c081a2b87c137c` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:25.526329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45006907-1ac3-48cc-aed2-ce731da03c96 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e515fbf3a7864f83b7c081a2b87c137c)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:25.528007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45006907-1ac3-48cc-aed2-ce731da03c96 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:25.577538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-45006907-1ac3-48cc-aed2-ce731da03c96 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e515fbf3a7864f83b7c081a2b87c137c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:25.579055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-45006907-1ac3-48cc-aed2-ce731da03c96 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e515fbf3a7864f83b7c081a2b87c137c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:25.627875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-45006907-1ac3-48cc-aed2-ce731da03c96 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e515fbf3a7864f83b7c081a2b87c137c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:25.628525 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-45006907-1ac3-48cc-aed2-ce731da03c96 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e515fbf3a7864f83b7c081a2b87c137c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:25.635237 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2378/4707] 10.222.0.33 () {60 vars in 1249 bytes} [Sat Aug 6 21:10:25 2022] PATCH /identity/v3/domains/e515fbf3a7864f83b7c081a2b87c137c => generated 277 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:25.635894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa7f27-f1df-45bd-9b42-7d97c47a294f tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:25.637406 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-36fa7f27-f1df-45bd-9b42-7d97c47a294f tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:25.653041 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa7f27-f1df-45bd-9b42-7d97c47a294f tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:25.758786 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e8e75-2cc9-4312-abe1-4e7399a3e404 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:25.759572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e8e75-2cc9-4312-abe1-4e7399a3e404 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:25.759856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e8e75-2cc9-4312-abe1-4e7399a3e404 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:25.760128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e8e75-2cc9-4312-abe1-4e7399a3e404 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/domains/e515fbf3a7864f83b7c081a2b87c137c` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:25.775812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e8e75-2cc9-4312-abe1-4e7399a3e404 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e515fbf3a7864f83b7c081a2b87c137c)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:25.780325 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e8e75-2cc9-4312-abe1-4e7399a3e404 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:25.840576 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-132e8e75-2cc9-4312-abe1-4e7399a3e404 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e515fbf3a7864f83b7c081a2b87c137c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:25.864440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-132e8e75-2cc9-4312-abe1-4e7399a3e404 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e515fbf3a7864f83b7c081a2b87c137c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:25.929247 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45006907-1ac3-48cc-aed2-ce731da03c96 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:25.931197 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-45006907-1ac3-48cc-aed2-ce731da03c96 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:25.949172 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-132e8e75-2cc9-4312-abe1-4e7399a3e404 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e515fbf3a7864f83b7c081a2b87c137c', 'request_id': 'req-132e8e75-2cc9-4312-abe1-4e7399a3e404'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:25.957614 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-132e8e75-2cc9-4312-abe1-4e7399a3e404 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e515fbf3a7864f83b7c081a2b87c137c', 'request_id': 'req-132e8e75-2cc9-4312-abe1-4e7399a3e404'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:25.976116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-132e8e75-2cc9-4312-abe1-4e7399a3e404 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e515fbf3a7864f83b7c081a2b87c137c', 'request_id': 'req-132e8e75-2cc9-4312-abe1-4e7399a3e404'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:26.005125 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-132e8e75-2cc9-4312-abe1-4e7399a3e404 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] The token cache is being invalidate because project e515fbf3a7864f83b7c081a2b87c137c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:26.005994 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-132e8e75-2cc9-4312-abe1-4e7399a3e404 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:26.008371 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-132e8e75-2cc9-4312-abe1-4e7399a3e404 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:26.027625 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-132e8e75-2cc9-4312-abe1-4e7399a3e404 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e515fbf3a7864f83b7c081a2b87c137c', 'request_id': 'req-132e8e75-2cc9-4312-abe1-4e7399a3e404'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:26.030850 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-132e8e75-2cc9-4312-abe1-4e7399a3e404 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e515fbf3a7864f83b7c081a2b87c137c', 'request_id': 'req-132e8e75-2cc9-4312-abe1-4e7399a3e404'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:26.032686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-132e8e75-2cc9-4312-abe1-4e7399a3e404 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e515fbf3a7864f83b7c081a2b87c137c', 'request_id': 'req-132e8e75-2cc9-4312-abe1-4e7399a3e404'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:26.061137 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2330/4708] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:10:25 2022] DELETE /identity/v3/domains/e515fbf3a7864f83b7c081a2b87c137c => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:26.079751 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e8e75-2cc9-4312-abe1-4e7399a3e404 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:26.087898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-132e8e75-2cc9-4312-abe1-4e7399a3e404 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:26.138334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45006907-1ac3-48cc-aed2-ce731da03c96 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:26.147912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:26.224617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e8e75-2cc9-4312-abe1-4e7399a3e404 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:26.228074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:26.247280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc8b58-631d-4c75-89f9-c79a46d166af tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:26.249633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc8b58-631d-4c75-89f9-c79a46d166af tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:26.250529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc8b58-631d-4c75-89f9-c79a46d166af tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:26.252315 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc8b58-631d-4c75-89f9-c79a46d166af tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/domains/94409b883d784213bd09ee1c33d06c2e/groups/e6b841390f584097a41e294f8a52cc45/roles/0973045b688940cba71f79cd929dfbbf` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:26.264630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc8b58-631d-4c75-89f9-c79a46d166af tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=94409b883d784213bd09ee1c33d06c2e, group_id=e6b841390f584097a41e294f8a52cc45, role_id=0973045b688940cba71f79cd929dfbbf)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:26.280886 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc8b58-631d-4c75-89f9-c79a46d166af tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:26.307170 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9abc8b58-631d-4c75-89f9-c79a46d166af tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invalidating the token cache because role 0973045b688940cba71f79cd929dfbbf was removed from group e6b841390f584097a41e294f8a52cc45 on domain 94409b883d784213bd09ee1c33d06c2e. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:26.307824 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9abc8b58-631d-4c75-89f9-c79a46d166af tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:26.311516 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9abc8b58-631d-4c75-89f9-c79a46d166af tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:26.322116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56ad9d7-4aa7-457f-8f0e-c2ef4c3ecef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:26.322820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ad9d7-4aa7-457f-8f0e-c2ef4c3ecef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:26.324223 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ad9d7-4aa7-457f-8f0e-c2ef4c3ecef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:26.324507 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ad9d7-4aa7-457f-8f0e-c2ef4c3ecef4 admin admin] PATH_INFO: `/v3/projects/da5a3bb9462d49d8a04fadc576b17a47` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:26.325712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56ad9d7-4aa7-457f-8f0e-c2ef4c3ecef4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da5a3bb9462d49d8a04fadc576b17a47)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:26.351709 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56ad9d7-4aa7-457f-8f0e-c2ef4c3ecef4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:26.376229 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2331/4709] 10.222.0.33 () {58 vars in 1467 bytes} [Sat Aug 6 21:10:26 2022] DELETE /identity/v3/domains/94409b883d784213bd09ee1c33d06c2e/groups/e6b841390f584097a41e294f8a52cc45/roles/0973045b688940cba71f79cd929dfbbf => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:26.380327 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc8b58-631d-4c75-89f9-c79a46d166af tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:26.382018 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9abc8b58-631d-4c75-89f9-c79a46d166af tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:26.455607 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c56ad9d7-4aa7-457f-8f0e-c2ef4c3ecef4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da5a3bb9462d49d8a04fadc576b17a47', 'request_id': 'req-c56ad9d7-4aa7-457f-8f0e-c2ef4c3ecef4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:26.465222 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c56ad9d7-4aa7-457f-8f0e-c2ef4c3ecef4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da5a3bb9462d49d8a04fadc576b17a47', 'request_id': 'req-c56ad9d7-4aa7-457f-8f0e-c2ef4c3ecef4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:26.519246 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c56ad9d7-4aa7-457f-8f0e-c2ef4c3ecef4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da5a3bb9462d49d8a04fadc576b17a47', 'request_id': 'req-c56ad9d7-4aa7-457f-8f0e-c2ef4c3ecef4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:26.604309 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc8b58-631d-4c75-89f9-c79a46d166af tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:26.613956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c56ad9d7-4aa7-457f-8f0e-c2ef4c3ecef4 admin admin] The token cache is being invalidate because project da5a3bb9462d49d8a04fadc576b17a47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:26.614329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c56ad9d7-4aa7-457f-8f0e-c2ef4c3ecef4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:26.617126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c56ad9d7-4aa7-457f-8f0e-c2ef4c3ecef4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:26.621849 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2379/4710] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:10:25 2022] DELETE /identity/v3/projects/da5a3bb9462d49d8a04fadc576b17a47 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:10:26.627274 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56ad9d7-4aa7-457f-8f0e-c2ef4c3ecef4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:26.632755 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c56ad9d7-4aa7-457f-8f0e-c2ef4c3ecef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:26.802036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d46f3-feae-45a7-bc2a-bc44b0e20718 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:26.803034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d46f3-feae-45a7-bc2a-bc44b0e20718 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:26.803543 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d46f3-feae-45a7-bc2a-bc44b0e20718 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:26.803995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d46f3-feae-45a7-bc2a-bc44b0e20718 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/groups/e6b841390f584097a41e294f8a52cc45/users/6a651aed8c0b464dbe29546467e5294b` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:26.808784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d46f3-feae-45a7-bc2a-bc44b0e20718 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=e6b841390f584097a41e294f8a52cc45, user_id=6a651aed8c0b464dbe29546467e5294b)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:26.811007 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d46f3-feae-45a7-bc2a-bc44b0e20718 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:26.828634 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5d6d46f3-feae-45a7-bc2a-bc44b0e20718 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '6a651aed8c0b464dbe29546467e5294b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:26.865736 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2332/4711] 10.222.0.33 () {58 vars in 1344 bytes} [Sat Aug 6 21:10:26 2022] DELETE /identity/v3/groups/e6b841390f584097a41e294f8a52cc45/users/6a651aed8c0b464dbe29546467e5294b => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:10:26.871326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d46f3-feae-45a7-bc2a-bc44b0e20718 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:26.873330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5d6d46f3-feae-45a7-bc2a-bc44b0e20718 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:26.877798 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56ad9d7-4aa7-457f-8f0e-c2ef4c3ecef4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:26.978474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:26.990143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d46f3-feae-45a7-bc2a-bc44b0e20718 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:26.997696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a0522-e4e8-4575-92ab-cfec04853b5b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:26.997913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a0522-e4e8-4575-92ab-cfec04853b5b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:26.998230 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a0522-e4e8-4575-92ab-cfec04853b5b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:26.999267 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a0522-e4e8-4575-92ab-cfec04853b5b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/groups/e6b841390f584097a41e294f8a52cc45` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:26.999423 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31bbd00-6092-472d-b9ab-401c79fd382b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:27.001002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31bbd00-6092-472d-b9ab-401c79fd382b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:27.001002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31bbd00-6092-472d-b9ab-401c79fd382b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:27.001471 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31bbd00-6092-472d-b9ab-401c79fd382b admin admin] PATH_INFO: `/v3/users/d17cdc909fbb49ff9a70ba7411019d73` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:27.001866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a0522-e4e8-4575-92ab-cfec04853b5b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:delete_group(group_id=e6b841390f584097a41e294f8a52cc45)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:27.004547 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a0522-e4e8-4575-92ab-cfec04853b5b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:27.007281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31bbd00-6092-472d-b9ab-401c79fd382b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d17cdc909fbb49ff9a70ba7411019d73)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:27.010286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31bbd00-6092-472d-b9ab-401c79fd382b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:27.028539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:27.082513 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2333/4712] 10.222.0.33 () {58 vars in 1227 bytes} [Sat Aug 6 21:10:26 2022] DELETE /identity/v3/groups/e6b841390f584097a41e294f8a52cc45 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:27.084983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a31bbd00-6092-472d-b9ab-401c79fd382b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd17cdc909fbb49ff9a70ba7411019d73'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:27.086725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a0522-e4e8-4575-92ab-cfec04853b5b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:27.095666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a31bbd00-6092-472d-b9ab-401c79fd382b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd17cdc909fbb49ff9a70ba7411019d73'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:27.096663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a31bbd00-6092-472d-b9ab-401c79fd382b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd17cdc909fbb49ff9a70ba7411019d73'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:27.097581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a31bbd00-6092-472d-b9ab-401c79fd382b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd17cdc909fbb49ff9a70ba7411019d73'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:27.111063 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a31bbd00-6092-472d-b9ab-401c79fd382b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd17cdc909fbb49ff9a70ba7411019d73'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:27.148925 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2380/4713] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:26 2022] DELETE /identity/v3/users/d17cdc909fbb49ff9a70ba7411019d73 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:27.199381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a0522-e4e8-4575-92ab-cfec04853b5b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:27.272745 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85e14b-c680-415f-8067-5f4def48299b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:27.273448 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85e14b-c680-415f-8067-5f4def48299b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:27.273677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85e14b-c680-415f-8067-5f4def48299b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:27.273923 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85e14b-c680-415f-8067-5f4def48299b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/roles/0973045b688940cba71f79cd929dfbbf` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:27.275506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85e14b-c680-415f-8067-5f4def48299b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0973045b688940cba71f79cd929dfbbf)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:27.277300 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85e14b-c680-415f-8067-5f4def48299b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:27.380064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dd85e14b-c680-415f-8067-5f4def48299b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invalidating the token cache because role 0973045b688940cba71f79cd929dfbbf has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:27.380660 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dd85e14b-c680-415f-8067-5f4def48299b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:27.382329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dd85e14b-c680-415f-8067-5f4def48299b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:27.386713 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2334/4714] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:27 2022] DELETE /identity/v3/roles/0973045b688940cba71f79cd929dfbbf => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:10:27.391648 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31bbd00-6092-472d-b9ab-401c79fd382b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:27.394007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a31bbd00-6092-472d-b9ab-401c79fd382b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:27.434569 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31bbd00-6092-472d-b9ab-401c79fd382b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:27.548542 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9f780-dc41-48fe-a075-8c29cd566a79 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:27.550042 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9f780-dc41-48fe-a075-8c29cd566a79 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:27.550535 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9f780-dc41-48fe-a075-8c29cd566a79 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:27.551262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9f780-dc41-48fe-a075-8c29cd566a79 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/domains/94409b883d784213bd09ee1c33d06c2e` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:27.553661 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9f780-dc41-48fe-a075-8c29cd566a79 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=94409b883d784213bd09ee1c33d06c2e)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:27.556374 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9f780-dc41-48fe-a075-8c29cd566a79 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:27.598678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-84d9f780-dc41-48fe-a075-8c29cd566a79 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '94409b883d784213bd09ee1c33d06c2e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:27.599798 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-84d9f780-dc41-48fe-a075-8c29cd566a79 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '94409b883d784213bd09ee1c33d06c2e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:27.643586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-84d9f780-dc41-48fe-a075-8c29cd566a79 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '94409b883d784213bd09ee1c33d06c2e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:27.644421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-84d9f780-dc41-48fe-a075-8c29cd566a79 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '94409b883d784213bd09ee1c33d06c2e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:27.647356 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2381/4715] 10.222.0.33 () {60 vars in 1249 bytes} [Sat Aug 6 21:10:27 2022] PATCH /identity/v3/domains/94409b883d784213bd09ee1c33d06c2e => generated 277 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:27.651044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85e14b-c680-415f-8067-5f4def48299b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:27.653156 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-dd85e14b-c680-415f-8067-5f4def48299b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:27.685511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85e14b-c680-415f-8067-5f4def48299b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:27.741157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:27.797419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ffd008-5996-4b1b-b75c-17bc7fbef9ae tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:27.799172 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffd008-5996-4b1b-b75c-17bc7fbef9ae tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:27.800172 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffd008-5996-4b1b-b75c-17bc7fbef9ae tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:27.803139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffd008-5996-4b1b-b75c-17bc7fbef9ae tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/domains/94409b883d784213bd09ee1c33d06c2e` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:27.833993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ffd008-5996-4b1b-b75c-17bc7fbef9ae tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=94409b883d784213bd09ee1c33d06c2e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:27.836307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ffd008-5996-4b1b-b75c-17bc7fbef9ae tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:27.882594 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-61ffd008-5996-4b1b-b75c-17bc7fbef9ae tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '94409b883d784213bd09ee1c33d06c2e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:27.900297 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-61ffd008-5996-4b1b-b75c-17bc7fbef9ae tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '94409b883d784213bd09ee1c33d06c2e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:27.970337 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-61ffd008-5996-4b1b-b75c-17bc7fbef9ae tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94409b883d784213bd09ee1c33d06c2e', 'request_id': 'req-61ffd008-5996-4b1b-b75c-17bc7fbef9ae'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:27.978036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-61ffd008-5996-4b1b-b75c-17bc7fbef9ae tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94409b883d784213bd09ee1c33d06c2e', 'request_id': 'req-61ffd008-5996-4b1b-b75c-17bc7fbef9ae'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:27.987740 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-61ffd008-5996-4b1b-b75c-17bc7fbef9ae tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94409b883d784213bd09ee1c33d06c2e', 'request_id': 'req-61ffd008-5996-4b1b-b75c-17bc7fbef9ae'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:28.027042 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-61ffd008-5996-4b1b-b75c-17bc7fbef9ae tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] The token cache is being invalidate because project 94409b883d784213bd09ee1c33d06c2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:28.027493 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-61ffd008-5996-4b1b-b75c-17bc7fbef9ae tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:28.029089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-61ffd008-5996-4b1b-b75c-17bc7fbef9ae tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:28.040977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-61ffd008-5996-4b1b-b75c-17bc7fbef9ae tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '94409b883d784213bd09ee1c33d06c2e', 'request_id': 'req-61ffd008-5996-4b1b-b75c-17bc7fbef9ae'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:28.041817 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-61ffd008-5996-4b1b-b75c-17bc7fbef9ae tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '94409b883d784213bd09ee1c33d06c2e', 'request_id': 'req-61ffd008-5996-4b1b-b75c-17bc7fbef9ae'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:28.043846 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-61ffd008-5996-4b1b-b75c-17bc7fbef9ae tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '94409b883d784213bd09ee1c33d06c2e', 'request_id': 'req-61ffd008-5996-4b1b-b75c-17bc7fbef9ae'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:28.055283 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2335/4716] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:10:27 2022] DELETE /identity/v3/domains/94409b883d784213bd09ee1c33d06c2e => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:10:28.059163 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9f780-dc41-48fe-a075-8c29cd566a79 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:28.061303 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-84d9f780-dc41-48fe-a075-8c29cd566a79 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:28.079540 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9f780-dc41-48fe-a075-8c29cd566a79 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:28.155661 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:28.167840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88722125-a84d-4ebe-90c1-f6ff6bfb8ee0 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:28.169554 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88722125-a84d-4ebe-90c1-f6ff6bfb8ee0 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:28.171876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88722125-a84d-4ebe-90c1-f6ff6bfb8ee0 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:28.171876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88722125-a84d-4ebe-90c1-f6ff6bfb8ee0 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/domains/e792baa1d7ec4e75bde41316a9680499/users/6a651aed8c0b464dbe29546467e5294b/roles/774e1b32e9ff4f1991714eade1841ad7` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:28.175731 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88722125-a84d-4ebe-90c1-f6ff6bfb8ee0 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=e792baa1d7ec4e75bde41316a9680499, user_id=6a651aed8c0b464dbe29546467e5294b, role_id=774e1b32e9ff4f1991714eade1841ad7)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:28.180049 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88722125-a84d-4ebe-90c1-f6ff6bfb8ee0 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:28.188158 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-88722125-a84d-4ebe-90c1-f6ff6bfb8ee0 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invalidating the token cache because role 774e1b32e9ff4f1991714eade1841ad7 was removed from user 6a651aed8c0b464dbe29546467e5294b on domain e792baa1d7ec4e75bde41316a9680499. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:28.188977 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-88722125-a84d-4ebe-90c1-f6ff6bfb8ee0 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:28.191061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-88722125-a84d-4ebe-90c1-f6ff6bfb8ee0 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:28.209965 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2382/4717] 10.222.0.33 () {58 vars in 1464 bytes} [Sat Aug 6 21:10:28 2022] DELETE /identity/v3/domains/e792baa1d7ec4e75bde41316a9680499/users/6a651aed8c0b464dbe29546467e5294b/roles/774e1b32e9ff4f1991714eade1841ad7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:28.216171 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ffd008-5996-4b1b-b75c-17bc7fbef9ae tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:28.218035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-61ffd008-5996-4b1b-b75c-17bc7fbef9ae tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:28.233974 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ffd008-5996-4b1b-b75c-17bc7fbef9ae tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:28.350830 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540401f3-4efa-41d3-b66b-aeb4f2f8f9f0 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:28.362160 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540401f3-4efa-41d3-b66b-aeb4f2f8f9f0 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:28.362902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540401f3-4efa-41d3-b66b-aeb4f2f8f9f0 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:28.363402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540401f3-4efa-41d3-b66b-aeb4f2f8f9f0 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/roles/774e1b32e9ff4f1991714eade1841ad7` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:28.367899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540401f3-4efa-41d3-b66b-aeb4f2f8f9f0 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:delete_role(role_id=774e1b32e9ff4f1991714eade1841ad7)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:28.373486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540401f3-4efa-41d3-b66b-aeb4f2f8f9f0 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:28.382994 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:28.426971 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88722125-a84d-4ebe-90c1-f6ff6bfb8ee0 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:28.428911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-88722125-a84d-4ebe-90c1-f6ff6bfb8ee0 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:28.471024 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-540401f3-4efa-41d3-b66b-aeb4f2f8f9f0 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invalidating the token cache because role 774e1b32e9ff4f1991714eade1841ad7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:28.471620 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-540401f3-4efa-41d3-b66b-aeb4f2f8f9f0 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:28.472819 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-540401f3-4efa-41d3-b66b-aeb4f2f8f9f0 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:28.477098 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2336/4718] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:28 2022] DELETE /identity/v3/roles/774e1b32e9ff4f1991714eade1841ad7 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:28.483001 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540401f3-4efa-41d3-b66b-aeb4f2f8f9f0 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:28.489032 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-540401f3-4efa-41d3-b66b-aeb4f2f8f9f0 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:28.610538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540401f3-4efa-41d3-b66b-aeb4f2f8f9f0 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:28.619438 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a09219-15d0-4f2c-a5d6-2424fd63e521 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:28.620260 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88722125-a84d-4ebe-90c1-f6ff6bfb8ee0 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:28.620748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a09219-15d0-4f2c-a5d6-2424fd63e521 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:28.621138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a09219-15d0-4f2c-a5d6-2424fd63e521 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:28.621517 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a09219-15d0-4f2c-a5d6-2424fd63e521 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/domains/e792baa1d7ec4e75bde41316a9680499` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:28.623106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a09219-15d0-4f2c-a5d6-2424fd63e521 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e792baa1d7ec4e75bde41316a9680499)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:28.625210 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a09219-15d0-4f2c-a5d6-2424fd63e521 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:28.654949 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-40a09219-15d0-4f2c-a5d6-2424fd63e521 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e792baa1d7ec4e75bde41316a9680499'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:28.655913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-40a09219-15d0-4f2c-a5d6-2424fd63e521 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e792baa1d7ec4e75bde41316a9680499'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:28.724499 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-40a09219-15d0-4f2c-a5d6-2424fd63e521 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e792baa1d7ec4e75bde41316a9680499'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:28.725354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-40a09219-15d0-4f2c-a5d6-2424fd63e521 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e792baa1d7ec4e75bde41316a9680499'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:28.731699 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2337/4719] 10.222.0.33 () {60 vars in 1249 bytes} [Sat Aug 6 21:10:28 2022] PATCH /identity/v3/domains/e792baa1d7ec4e75bde41316a9680499 => generated 276 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:28.733266 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a09219-15d0-4f2c-a5d6-2424fd63e521 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:28.734986 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-40a09219-15d0-4f2c-a5d6-2424fd63e521 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:28.771146 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c3c52-a314-49f5-81bd-3708f14394c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:28.773666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c3c52-a314-49f5-81bd-3708f14394c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:28.777177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c3c52-a314-49f5-81bd-3708f14394c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:28.777491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c3c52-a314-49f5-81bd-3708f14394c6 admin admin] PATH_INFO: `/v3/projects/f62390481db34d4d94f32dd793cd9917` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:28.778876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c3c52-a314-49f5-81bd-3708f14394c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f62390481db34d4d94f32dd793cd9917)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:28.785183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c3c52-a314-49f5-81bd-3708f14394c6 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:28.863605 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a09219-15d0-4f2c-a5d6-2424fd63e521 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:28.875635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4a5c3c52-a314-49f5-81bd-3708f14394c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f62390481db34d4d94f32dd793cd9917', 'request_id': 'req-4a5c3c52-a314-49f5-81bd-3708f14394c6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:28.884710 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4a5c3c52-a314-49f5-81bd-3708f14394c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f62390481db34d4d94f32dd793cd9917', 'request_id': 'req-4a5c3c52-a314-49f5-81bd-3708f14394c6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:28.904075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4a5c3c52-a314-49f5-81bd-3708f14394c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f62390481db34d4d94f32dd793cd9917', 'request_id': 'req-4a5c3c52-a314-49f5-81bd-3708f14394c6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:28.929005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:28.931044 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4a5c3c52-a314-49f5-81bd-3708f14394c6 admin admin] The token cache is being invalidate because project f62390481db34d4d94f32dd793cd9917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:28.931571 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4a5c3c52-a314-49f5-81bd-3708f14394c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:28.934020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4a5c3c52-a314-49f5-81bd-3708f14394c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:28.939492 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2383/4720] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:10:28 2022] DELETE /identity/v3/projects/f62390481db34d4d94f32dd793cd9917 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:28.943913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66251129-e7ec-4761-97eb-d75ad765e2a6 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:28.944310 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66251129-e7ec-4761-97eb-d75ad765e2a6 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:28.944766 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66251129-e7ec-4761-97eb-d75ad765e2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:28.965119 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3d9db-7181-4ca1-8e44-aa484047d2f4 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:28.967546 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3d9db-7181-4ca1-8e44-aa484047d2f4 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:28.968142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3d9db-7181-4ca1-8e44-aa484047d2f4 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:28.968612 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3d9db-7181-4ca1-8e44-aa484047d2f4 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/domains/e792baa1d7ec4e75bde41316a9680499` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:28.986406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-66251129-e7ec-4761-97eb-d75ad765e2a6 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:28.988579 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-66251129-e7ec-4761-97eb-d75ad765e2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:29.000944 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a3d9db-7181-4ca1-8e44-aa484047d2f4 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e792baa1d7ec4e75bde41316a9680499)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:29.004060 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a3d9db-7181-4ca1-8e44-aa484047d2f4 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:29.020639 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:29.070329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e0a3d9db-7181-4ca1-8e44-aa484047d2f4 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e792baa1d7ec4e75bde41316a9680499'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:29.087309 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e0a3d9db-7181-4ca1-8e44-aa484047d2f4 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e792baa1d7ec4e75bde41316a9680499'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:29.179418 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e0a3d9db-7181-4ca1-8e44-aa484047d2f4 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e792baa1d7ec4e75bde41316a9680499', 'request_id': 'req-e0a3d9db-7181-4ca1-8e44-aa484047d2f4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:29.197211 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e0a3d9db-7181-4ca1-8e44-aa484047d2f4 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e792baa1d7ec4e75bde41316a9680499', 'request_id': 'req-e0a3d9db-7181-4ca1-8e44-aa484047d2f4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:29.211336 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e0a3d9db-7181-4ca1-8e44-aa484047d2f4 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e792baa1d7ec4e75bde41316a9680499', 'request_id': 'req-e0a3d9db-7181-4ca1-8e44-aa484047d2f4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:29.217851 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2384/4721] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:29.224178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30324073-8780-4928-b7d9-7aec620431a8 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:29.224793 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30324073-8780-4928-b7d9-7aec620431a8 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:29.225429 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30324073-8780-4928-b7d9-7aec620431a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:29.240682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e0a3d9db-7181-4ca1-8e44-aa484047d2f4 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] The token cache is being invalidate because project e792baa1d7ec4e75bde41316a9680499 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:29.240978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e0a3d9db-7181-4ca1-8e44-aa484047d2f4 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:29.242949 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e0a3d9db-7181-4ca1-8e44-aa484047d2f4 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:29.259047 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e0a3d9db-7181-4ca1-8e44-aa484047d2f4 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e792baa1d7ec4e75bde41316a9680499', 'request_id': 'req-e0a3d9db-7181-4ca1-8e44-aa484047d2f4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:29.259798 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e0a3d9db-7181-4ca1-8e44-aa484047d2f4 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e792baa1d7ec4e75bde41316a9680499', 'request_id': 'req-e0a3d9db-7181-4ca1-8e44-aa484047d2f4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:29.267069 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e0a3d9db-7181-4ca1-8e44-aa484047d2f4 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e792baa1d7ec4e75bde41316a9680499', 'request_id': 'req-e0a3d9db-7181-4ca1-8e44-aa484047d2f4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:29.278200 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2338/4722] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:10:28 2022] DELETE /identity/v3/domains/e792baa1d7ec4e75bde41316a9680499 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:29.284453 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3d9db-7181-4ca1-8e44-aa484047d2f4 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:29.286323 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e0a3d9db-7181-4ca1-8e44-aa484047d2f4 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:29.310772 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-30324073-8780-4928-b7d9-7aec620431a8 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:29.315731 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-30324073-8780-4928-b7d9-7aec620431a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:29.441021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3d9db-7181-4ca1-8e44-aa484047d2f4 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:29.449467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1ac1d-e872-48f6-8523-76c0f2619d38 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:29.452417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1ac1d-e872-48f6-8523-76c0f2619d38 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:29.453988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1ac1d-e872-48f6-8523-76c0f2619d38 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:29.453988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1ac1d-e872-48f6-8523-76c0f2619d38 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:29.454752 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1ac1d-e872-48f6-8523-76c0f2619d38 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:29.457867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1ac1d-e872-48f6-8523-76c0f2619d38 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:29.473039 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2339/4723] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:29.476776 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1ac1d-e872-48f6-8523-76c0f2619d38 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:29.490074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1ac1d-e872-48f6-8523-76c0f2619d38 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:29.514072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c86db-1002-478d-bf75-17494bd6e0bc tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:29.514818 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c86db-1002-478d-bf75-17494bd6e0bc tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:29.515105 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c86db-1002-478d-bf75-17494bd6e0bc tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:29.515387 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c86db-1002-478d-bf75-17494bd6e0bc tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/projects/ffe141a5c1984cfdba5e15410d856075/users/0d193e51d7d94668a62b7aa59720452e/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:29.519910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c86db-1002-478d-bf75-17494bd6e0bc tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ffe141a5c1984cfdba5e15410d856075, user_id=0d193e51d7d94668a62b7aa59720452e, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:29.523317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c86db-1002-478d-bf75-17494bd6e0bc tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:29.525021 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2385/4724] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:10:29.529317 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30324073-8780-4928-b7d9-7aec620431a8 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:29.542963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30324073-8780-4928-b7d9-7aec620431a8 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:29.551657 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2340/4725] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:10:29 2022] PUT /identity/v3/projects/ffe141a5c1984cfdba5e15410d856075/users/0d193e51d7d94668a62b7aa59720452e/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:10:29.553138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c86db-1002-478d-bf75-17494bd6e0bc tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:29.564765 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:29.746276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d86e70-4931-4c93-bdf5-b4f3d8f3dd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:29.747108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d86e70-4931-4c93-bdf5-b4f3d8f3dd0b admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:29.747484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d86e70-4931-4c93-bdf5-b4f3d8f3dd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:29.747857 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d86e70-4931-4c93-bdf5-b4f3d8f3dd0b admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:29.747991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c86db-1002-478d-bf75-17494bd6e0bc tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:29.748764 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d86e70-4931-4c93-bdf5-b4f3d8f3dd0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:10:29.749161 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d86e70-4931-4c93-bdf5-b4f3d8f3dd0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:29.751252 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d86e70-4931-4c93-bdf5-b4f3d8f3dd0b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:29.753881 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4a60d-ddf6-4dbe-b43b-4c51f66fa493 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:29.754518 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4a60d-ddf6-4dbe-b43b-4c51f66fa493 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:29.754846 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4a60d-ddf6-4dbe-b43b-4c51f66fa493 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:29.755125 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4a60d-ddf6-4dbe-b43b-4c51f66fa493 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:29.755797 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4a60d-ddf6-4dbe-b43b-4c51f66fa493 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:29.757476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4a60d-ddf6-4dbe-b43b-4c51f66fa493 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:29.791130 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2386/4726] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:10:29.792327 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d86e70-4931-4c93-bdf5-b4f3d8f3dd0b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:29.814666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d86e70-4931-4c93-bdf5-b4f3d8f3dd0b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:29.827327 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecda5b-2d1f-4bf4-8fda-97f9aee284d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:29.828269 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecda5b-2d1f-4bf4-8fda-97f9aee284d2 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:29.828749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecda5b-2d1f-4bf4-8fda-97f9aee284d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:29.829181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecda5b-2d1f-4bf4-8fda-97f9aee284d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:29.829991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ecda5b-2d1f-4bf4-8fda-97f9aee284d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:29.832132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ecda5b-2d1f-4bf4-8fda-97f9aee284d2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:29.863393 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2341/4727] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 21:10:29 2022] GET /identity/v3/auth/projects => generated 824 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:29.865069 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4a60d-ddf6-4dbe-b43b-4c51f66fa493 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:29.882506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4a60d-ddf6-4dbe-b43b-4c51f66fa493 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:29.890076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1da3c1-5aa8-4b3a-b21f-b780b7637d9a tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:29.891183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1da3c1-5aa8-4b3a-b21f-b780b7637d9a tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:29.891479 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1da3c1-5aa8-4b3a-b21f-b780b7637d9a tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:29.892023 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1da3c1-5aa8-4b3a-b21f-b780b7637d9a tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/projects/ffe141a5c1984cfdba5e15410d856075/users/0d193e51d7d94668a62b7aa59720452e/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:29.894613 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1da3c1-5aa8-4b3a-b21f-b780b7637d9a tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=ffe141a5c1984cfdba5e15410d856075, user_id=0d193e51d7d94668a62b7aa59720452e, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:29.898904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1da3c1-5aa8-4b3a-b21f-b780b7637d9a tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:29.906036 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2387/4728] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:10:29 2022] POST /identity/v3/projects => generated 369 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:29.907574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecda5b-2d1f-4bf4-8fda-97f9aee284d2 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:29.908216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ee1da3c1-5aa8-4b3a-b21f-b780b7637d9a tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invalidating the token cache because role ab245eea8a714462a00c4546309de9c9 was removed from user 0d193e51d7d94668a62b7aa59720452e on project ffe141a5c1984cfdba5e15410d856075. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:29.908523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ee1da3c1-5aa8-4b3a-b21f-b780b7637d9a tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:29.909386 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ee1da3c1-5aa8-4b3a-b21f-b780b7637d9a tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:29.928289 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2342/4729] 10.222.0.33 () {58 vars in 1467 bytes} [Sat Aug 6 21:10:29 2022] DELETE /identity/v3/projects/ffe141a5c1984cfdba5e15410d856075/users/0d193e51d7d94668a62b7aa59720452e/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:29.936496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1da3c1-5aa8-4b3a-b21f-b780b7637d9a tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:29.939137 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ee1da3c1-5aa8-4b3a-b21f-b780b7637d9a tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:29.994900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:30.034777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecda5b-2d1f-4bf4-8fda-97f9aee284d2 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:30.089717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1da3c1-5aa8-4b3a-b21f-b780b7637d9a tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:30.101262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f1ade-fb51-4bcc-bbe8-3221beb84a14 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:30.101896 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f1ade-fb51-4bcc-bbe8-3221beb84a14 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:30.102178 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f1ade-fb51-4bcc-bbe8-3221beb84a14 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:30.102455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f1ade-fb51-4bcc-bbe8-3221beb84a14 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:30.103113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f1ade-fb51-4bcc-bbe8-3221beb84a14 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:30.105044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f1ade-fb51-4bcc-bbe8-3221beb84a14 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:30.141933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2dc1e-877f-464b-a852-82488ad14813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:30.142723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2dc1e-877f-464b-a852-82488ad14813 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:30.143241 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2dc1e-877f-464b-a852-82488ad14813 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:30.143691 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2dc1e-877f-464b-a852-82488ad14813 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:30.144248 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d2dc1e-877f-464b-a852-82488ad14813 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:30.146622 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d2dc1e-877f-464b-a852-82488ad14813 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:30.165755 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2343/4730] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:10:29 2022] POST /identity/v3/users => generated 321 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:30.170642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f1ade-fb51-4bcc-bbe8-3221beb84a14 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:30.178399 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2388/4731] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:10:29 2022] POST /identity/v3/users => generated 285 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:30.182100 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2dc1e-877f-464b-a852-82488ad14813 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:30.184300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d0d2dc1e-877f-464b-a852-82488ad14813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:30.199245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f1ade-fb51-4bcc-bbe8-3221beb84a14 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:30.199647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2dc1e-877f-464b-a852-82488ad14813 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:30.206271 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44ecd7-9389-439e-8a51-0238a52d99ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:30.207058 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44ecd7-9389-439e-8a51-0238a52d99ea admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:30.207226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218dabe-3710-4042-9dfb-f4ba1e1ec231 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:30.207555 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44ecd7-9389-439e-8a51-0238a52d99ea admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:30.207845 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218dabe-3710-4042-9dfb-f4ba1e1ec231 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:30.207999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44ecd7-9389-439e-8a51-0238a52d99ea admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:30.208127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218dabe-3710-4042-9dfb-f4ba1e1ec231 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:30.208394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218dabe-3710-4042-9dfb-f4ba1e1ec231 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:30.209203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44ecd7-9389-439e-8a51-0238a52d99ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:30.209598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218dabe-3710-4042-9dfb-f4ba1e1ec231 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:30.211553 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218dabe-3710-4042-9dfb-f4ba1e1ec231 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:30.211905 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44ecd7-9389-439e-8a51-0238a52d99ea admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:30.228374 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2389/4732] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:30.229780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44ecd7-9389-439e-8a51-0238a52d99ea admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:30.243496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44ecd7-9389-439e-8a51-0238a52d99ea admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:30.248940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272dab8-ebad-4889-b15e-bd8d5f043d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:30.252762 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2344/4733] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:10:30 2022] POST /identity/v3/projects => generated 362 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:30.253103 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272dab8-ebad-4889-b15e-bd8d5f043d20 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:30.253593 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272dab8-ebad-4889-b15e-bd8d5f043d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:30.254066 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272dab8-ebad-4889-b15e-bd8d5f043d20 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:30.254332 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218dabe-3710-4042-9dfb-f4ba1e1ec231 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:30.255224 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e272dab8-ebad-4889-b15e-bd8d5f043d20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:30.257060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e272dab8-ebad-4889-b15e-bd8d5f043d20 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:30.273821 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2390/4734] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:30.274622 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272dab8-ebad-4889-b15e-bd8d5f043d20 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:30.279858 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:30.285514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272dab8-ebad-4889-b15e-bd8d5f043d20 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:30.366677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218dabe-3710-4042-9dfb-f4ba1e1ec231 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:30.373202 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69620ad5-f674-4bdd-ba4b-08a08431ede9 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:30.375484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69620ad5-f674-4bdd-ba4b-08a08431ede9 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:30.376303 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69620ad5-f674-4bdd-ba4b-08a08431ede9 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:30.376787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69620ad5-f674-4bdd-ba4b-08a08431ede9 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:30.377664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69620ad5-f674-4bdd-ba4b-08a08431ede9 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:30.380167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69620ad5-f674-4bdd-ba4b-08a08431ede9 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:30.381105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e210f-9d99-48de-8ecd-261086fe5c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:30.382073 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e210f-9d99-48de-8ecd-261086fe5c71 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:30.382574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e210f-9d99-48de-8ecd-261086fe5c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:30.382938 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e210f-9d99-48de-8ecd-261086fe5c71 admin admin] PATH_INFO: `/v3/projects/bb48a1f177b04571912a36e282b48f40/users/0d64dc8b24774c62b80fd19e143786a6/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:30.430026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e210f-9d99-48de-8ecd-261086fe5c71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb48a1f177b04571912a36e282b48f40, user_id=0d64dc8b24774c62b80fd19e143786a6, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:30.434943 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e210f-9d99-48de-8ecd-261086fe5c71 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:30.445558 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2345/4735] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:10:30 2022] POST /identity/v3/projects => generated 361 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:30.447006 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69620ad5-f674-4bdd-ba4b-08a08431ede9 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:30.474156 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2391/4736] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:10:30 2022] PUT /identity/v3/projects/bb48a1f177b04571912a36e282b48f40/users/0d64dc8b24774c62b80fd19e143786a6/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:30.487769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9a15a-c89e-45b8-84ff-699cf73ec832 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:30.487769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9a15a-c89e-45b8-84ff-699cf73ec832 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:30.488162 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9a15a-c89e-45b8-84ff-699cf73ec832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:30.535495 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-20c9a15a-c89e-45b8-84ff-699cf73ec832 None None] MFA Rules not processed for user `bdf1b5180a814cf39234892c6c1f26df`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:30.536875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-20c9a15a-c89e-45b8-84ff-699cf73ec832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:30.565611 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69620ad5-f674-4bdd-ba4b-08a08431ede9 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:30.599328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:30.653533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953d1cd-aeca-4563-a07c-b510c12d90dc tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:30.654168 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953d1cd-aeca-4563-a07c-b510c12d90dc tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:30.654452 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953d1cd-aeca-4563-a07c-b510c12d90dc tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:30.654778 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953d1cd-aeca-4563-a07c-b510c12d90dc tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:30.655477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f953d1cd-aeca-4563-a07c-b510c12d90dc tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:30.658838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f953d1cd-aeca-4563-a07c-b510c12d90dc tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:30.660385 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2392/4737] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:30.661881 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64406956-618f-4774-966e-7dc9208c22bb None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:30.662264 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64406956-618f-4774-966e-7dc9208c22bb None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:30.681527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64406956-618f-4774-966e-7dc9208c22bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:30.689130 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2346/4738] 10.222.0.33 () {60 vars in 1143 bytes} [Sat Aug 6 21:10:30 2022] POST /identity/v3/roles => generated 240 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:30.693958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953d1cd-aeca-4563-a07c-b510c12d90dc tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:30.724975 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953d1cd-aeca-4563-a07c-b510c12d90dc tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:30.736133 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-64406956-618f-4774-966e-7dc9208c22bb None None] MFA Rules not processed for user `0d64dc8b24774c62b80fd19e143786a6`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:30.737533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-64406956-618f-4774-966e-7dc9208c22bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:30.745838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b1cb0-c8f3-4cbb-a42f-f92f6166e03c tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:30.747396 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b1cb0-c8f3-4cbb-a42f-f92f6166e03c tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:30.747898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b1cb0-c8f3-4cbb-a42f-f92f6166e03c tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:30.749715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b1cb0-c8f3-4cbb-a42f-f92f6166e03c tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/projects/299c78cb76b6487a857eff8d904d6d6a/users/00a9ceb291a0423bae82f63b9cccce20/roles/d3f468740e0441ccb79876ddd41c984c` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:30.783313 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b1cb0-c8f3-4cbb-a42f-f92f6166e03c tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:create_grant(project_id=299c78cb76b6487a857eff8d904d6d6a, user_id=00a9ceb291a0423bae82f63b9cccce20, role_id=d3f468740e0441ccb79876ddd41c984c)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:30.786085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b1cb0-c8f3-4cbb-a42f-f92f6166e03c tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:30.818969 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2347/4739] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:10:30 2022] PUT /identity/v3/projects/299c78cb76b6487a857eff8d904d6d6a/users/00a9ceb291a0423bae82f63b9cccce20/roles/d3f468740e0441ccb79876ddd41c984c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:30.823094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b1cb0-c8f3-4cbb-a42f-f92f6166e03c tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:30.835038 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2393/4740] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:30.839784 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64406956-618f-4774-966e-7dc9208c22bb None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:30.848712 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:30.925961 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b1cb0-c8f3-4cbb-a42f-f92f6166e03c tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:30.940872 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50981d-4546-4323-92c3-d7b22881392e tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:30.943796 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50981d-4546-4323-92c3-d7b22881392e tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:30.944985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50981d-4546-4323-92c3-d7b22881392e tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:30.945368 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50981d-4546-4323-92c3-d7b22881392e tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/projects/cd5fb404f02f420da09bf52776d437c2/users/00a9ceb291a0423bae82f63b9cccce20/roles/d3f468740e0441ccb79876ddd41c984c` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:30.949899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c50981d-4546-4323-92c3-d7b22881392e tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:create_grant(project_id=cd5fb404f02f420da09bf52776d437c2, user_id=00a9ceb291a0423bae82f63b9cccce20, role_id=d3f468740e0441ccb79876ddd41c984c)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:30.954231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c50981d-4546-4323-92c3-d7b22881392e tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:30.985747 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64406956-618f-4774-966e-7dc9208c22bb None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:30.986968 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2348/4741] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:10:30 2022] PUT /identity/v3/projects/cd5fb404f02f420da09bf52776d437c2/users/00a9ceb291a0423bae82f63b9cccce20/roles/d3f468740e0441ccb79876ddd41c984c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:10:30.991262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19570ab9-3714-4cdb-b04b-bbff242b1a45 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:30.991904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19570ab9-3714-4cdb-b04b-bbff242b1a45 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:30.992334 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19570ab9-3714-4cdb-b04b-bbff242b1a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:31.030670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-19570ab9-3714-4cdb-b04b-bbff242b1a45 None None] MFA Rules not processed for user `00a9ceb291a0423bae82f63b9cccce20`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:31.033519 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-19570ab9-3714-4cdb-b04b-bbff242b1a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:31.038415 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2349/4742] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:30 2022] POST /identity/v3/auth/tokens => generated 334 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 21:10:31.043292 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34479b2d-c69c-457e-ad16-e74f2fe888b8 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:31.043774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34479b2d-c69c-457e-ad16-e74f2fe888b8 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:31.044196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34479b2d-c69c-457e-ad16-e74f2fe888b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:31.076280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-34479b2d-c69c-457e-ad16-e74f2fe888b8 None None] MFA Rules not processed for user `00a9ceb291a0423bae82f63b9cccce20`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:31.082884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-34479b2d-c69c-457e-ad16-e74f2fe888b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:31.084935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945afd73-0ee5-4813-a4f5-8d806eb5fac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:31.089020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945afd73-0ee5-4813-a4f5-8d806eb5fac4 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:31.089552 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945afd73-0ee5-4813-a4f5-8d806eb5fac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:31.090003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945afd73-0ee5-4813-a4f5-8d806eb5fac4 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:31.090876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945afd73-0ee5-4813-a4f5-8d806eb5fac4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:31.097103 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945afd73-0ee5-4813-a4f5-8d806eb5fac4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:31.160278 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:31.172933 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2394/4743] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:10:30 2022] POST /identity/v3/projects => generated 369 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:31.176526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945afd73-0ee5-4813-a4f5-8d806eb5fac4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:31.223342 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2350/4744] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:31 2022] POST /identity/v3/auth/tokens => generated 3223 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 406 bytes (2 switches on core 0) Aug 06 21:10:31.231375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34479b2d-c69c-457e-ad16-e74f2fe888b8 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:31.313120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945afd73-0ee5-4813-a4f5-8d806eb5fac4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:31.318891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d65ed-6a31-4e8d-a0d5-596c1e46bb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:31.319499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d65ed-6a31-4e8d-a0d5-596c1e46bb38 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:31.319773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d65ed-6a31-4e8d-a0d5-596c1e46bb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:31.320044 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d65ed-6a31-4e8d-a0d5-596c1e46bb38 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:31.320673 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d65ed-6a31-4e8d-a0d5-596c1e46bb38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:31.322718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d65ed-6a31-4e8d-a0d5-596c1e46bb38 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:31.352269 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2395/4745] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:10:31 2022] POST /identity/v3/users => generated 291 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:31.355761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d65ed-6a31-4e8d-a0d5-596c1e46bb38 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:31.366436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d65ed-6a31-4e8d-a0d5-596c1e46bb38 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:31.374237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693e667-e85d-4308-96d8-145aa3fc97e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:31.375572 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693e667-e85d-4308-96d8-145aa3fc97e6 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:31.376703 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693e667-e85d-4308-96d8-145aa3fc97e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:31.376978 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693e667-e85d-4308-96d8-145aa3fc97e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:31.377753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5693e667-e85d-4308-96d8-145aa3fc97e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:31.379666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5693e667-e85d-4308-96d8-145aa3fc97e6 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:31.394921 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2396/4746] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:31 2022] GET /identity/v3/roles => generated 1651 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:10:31.398937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693e667-e85d-4308-96d8-145aa3fc97e6 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:31.412950 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693e667-e85d-4308-96d8-145aa3fc97e6 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:31.419307 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117d386-01fe-490d-a7bb-d2bac00e2094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:31.420324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117d386-01fe-490d-a7bb-d2bac00e2094 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:31.421134 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117d386-01fe-490d-a7bb-d2bac00e2094 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:31.421620 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117d386-01fe-490d-a7bb-d2bac00e2094 admin admin] PATH_INFO: `/v3/projects/ea8c7d7d44da4921870b3c3deeb668e7/users/29dcf5fe4a7e4028a0f3a37c3a2012c5/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:31.465508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117d386-01fe-490d-a7bb-d2bac00e2094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea8c7d7d44da4921870b3c3deeb668e7, user_id=29dcf5fe4a7e4028a0f3a37c3a2012c5, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:31.470074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34479b2d-c69c-457e-ad16-e74f2fe888b8 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:31.471636 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117d386-01fe-490d-a7bb-d2bac00e2094 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:31.497758 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2397/4747] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:10:31 2022] PUT /identity/v3/projects/ea8c7d7d44da4921870b3c3deeb668e7/users/29dcf5fe4a7e4028a0f3a37c3a2012c5/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:10:31.501496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117d386-01fe-490d-a7bb-d2bac00e2094 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:31.560564 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:31.583900 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65775c15-9752-4652-9d6d-82b0455d1287 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:31.585623 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65775c15-9752-4652-9d6d-82b0455d1287 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:31.585993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65775c15-9752-4652-9d6d-82b0455d1287 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:31.586277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65775c15-9752-4652-9d6d-82b0455d1287 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:31.637266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117d386-01fe-490d-a7bb-d2bac00e2094 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:31.644394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d56885-25a0-4db5-a144-10cb52dc7aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:31.645304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d56885-25a0-4db5-a144-10cb52dc7aed admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:31.645465 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d56885-25a0-4db5-a144-10cb52dc7aed admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:31.645785 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d56885-25a0-4db5-a144-10cb52dc7aed admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:31.646503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d56885-25a0-4db5-a144-10cb52dc7aed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:31.648402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d56885-25a0-4db5-a144-10cb52dc7aed admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:31.662708 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2398/4748] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:31 2022] GET /identity/v3/roles => generated 1651 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:10:31.678874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d56885-25a0-4db5-a144-10cb52dc7aed admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:31.693531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d56885-25a0-4db5-a144-10cb52dc7aed admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:31.700819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e682f2-a76e-41ce-8184-e58aa24103f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:31.701556 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e682f2-a76e-41ce-8184-e58aa24103f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:31.701914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e682f2-a76e-41ce-8184-e58aa24103f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:31.702250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e682f2-a76e-41ce-8184-e58aa24103f1 admin admin] PATH_INFO: `/v3/projects/ea8c7d7d44da4921870b3c3deeb668e7/users/29dcf5fe4a7e4028a0f3a37c3a2012c5/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:31.704988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e682f2-a76e-41ce-8184-e58aa24103f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea8c7d7d44da4921870b3c3deeb668e7, user_id=29dcf5fe4a7e4028a0f3a37c3a2012c5, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:31.709662 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e682f2-a76e-41ce-8184-e58aa24103f1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:31.714873 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65775c15-9752-4652-9d6d-82b0455d1287 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:31.720930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65775c15-9752-4652-9d6d-82b0455d1287 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:31.729184 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2399/4749] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:10:31 2022] PUT /identity/v3/projects/ea8c7d7d44da4921870b3c3deeb668e7/users/29dcf5fe4a7e4028a0f3a37c3a2012c5/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:31.741469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528de314-9b52-4e43-9830-2d84541260a0 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:31.742205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528de314-9b52-4e43-9830-2d84541260a0 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:31.742726 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528de314-9b52-4e43-9830-2d84541260a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:31.744307 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2351/4750] 10.222.0.33 () {56 vars in 1308 bytes} [Sat Aug 6 21:10:31 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:31.748300 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b94371-eab1-472f-aa82-c74a8eb043a0 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:31.748866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b94371-eab1-472f-aa82-c74a8eb043a0 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:31.749372 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b94371-eab1-472f-aa82-c74a8eb043a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:31.764186 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-37b94371-eab1-472f-aa82-c74a8eb043a0 None None] MFA Rules not processed for user `00a9ceb291a0423bae82f63b9cccce20`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:31.765499 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-37b94371-eab1-472f-aa82-c74a8eb043a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:31.835320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-528de314-9b52-4e43-9830-2d84541260a0 None None] MFA Rules not processed for user `29dcf5fe4a7e4028a0f3a37c3a2012c5`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:31.837933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-528de314-9b52-4e43-9830-2d84541260a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:31.906565 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2352/4751] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:31 2022] POST /identity/v3/auth/tokens => generated 3223 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 406 bytes (2 switches on core 0) Aug 06 21:10:31.911439 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b94371-eab1-472f-aa82-c74a8eb043a0 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:31.925173 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:32.008577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b94371-eab1-472f-aa82-c74a8eb043a0 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:32.014478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4b53a-df7f-493c-b0de-0b405b1fea84 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:32.015662 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4b53a-df7f-493c-b0de-0b405b1fea84 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:32.016384 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4b53a-df7f-493c-b0de-0b405b1fea84 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:32.016879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4b53a-df7f-493c-b0de-0b405b1fea84 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/roles/d3f468740e0441ccb79876ddd41c984c` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:32.018877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b4b53a-df7f-493c-b0de-0b405b1fea84 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d3f468740e0441ccb79876ddd41c984c)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:32.020735 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b4b53a-df7f-493c-b0de-0b405b1fea84 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:32.038040 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2400/4752] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:31 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:32.038040 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528de314-9b52-4e43-9830-2d84541260a0 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:32.056716 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528de314-9b52-4e43-9830-2d84541260a0 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:32.064851 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5472eb-698f-4ab2-a55b-d7852f02b958 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:32.065492 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5472eb-698f-4ab2-a55b-d7852f02b958 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:32.065849 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5472eb-698f-4ab2-a55b-d7852f02b958 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:32.066196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5472eb-698f-4ab2-a55b-d7852f02b958 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:32.066965 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5472eb-698f-4ab2-a55b-d7852f02b958 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:32.068889 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5472eb-698f-4ab2-a55b-d7852f02b958 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:32.081548 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:32.099133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e7b4b53a-df7f-493c-b0de-0b405b1fea84 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invalidating the token cache because role d3f468740e0441ccb79876ddd41c984c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:32.099482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e7b4b53a-df7f-493c-b0de-0b405b1fea84 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:32.101172 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e7b4b53a-df7f-493c-b0de-0b405b1fea84 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:32.103286 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2401/4753] 10.222.0.33 () {60 vars in 1149 bytes} [Sat Aug 6 21:10:32 2022] POST /identity/v3/domains => generated 277 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:32.108146 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2353/4754] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:31 2022] DELETE /identity/v3/roles/d3f468740e0441ccb79876ddd41c984c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:32.109336 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4b53a-df7f-493c-b0de-0b405b1fea84 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:32.110391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5472eb-698f-4ab2-a55b-d7852f02b958 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:32.112432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3d5472eb-698f-4ab2-a55b-d7852f02b958 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:32.112933 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e7b4b53a-df7f-493c-b0de-0b405b1fea84 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:32.205643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5472eb-698f-4ab2-a55b-d7852f02b958 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:32.215773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4b53a-df7f-493c-b0de-0b405b1fea84 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:32.226530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240b315-821f-4c6a-b5b1-ce1790f64e70 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:32.227215 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240b315-821f-4c6a-b5b1-ce1790f64e70 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:32.227499 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240b315-821f-4c6a-b5b1-ce1790f64e70 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:32.227776 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240b315-821f-4c6a-b5b1-ce1790f64e70 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/projects/cd5fb404f02f420da09bf52776d437c2` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:32.230193 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240b315-821f-4c6a-b5b1-ce1790f64e70 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cd5fb404f02f420da09bf52776d437c2)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:32.235707 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240b315-821f-4c6a-b5b1-ce1790f64e70 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:32.295946 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86cb55a-6853-493a-8d00-eff3cb9dc784 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:32.296839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cb55a-6853-493a-8d00-eff3cb9dc784 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:32.297287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cb55a-6853-493a-8d00-eff3cb9dc784 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:32.297693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cb55a-6853-493a-8d00-eff3cb9dc784 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/groups` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:32.298578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86cb55a-6853-493a-8d00-eff3cb9dc784 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:32.301545 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86cb55a-6853-493a-8d00-eff3cb9dc784 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:32.325804 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e240b315-821f-4c6a-b5b1-ce1790f64e70 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd5fb404f02f420da09bf52776d437c2', 'request_id': 'req-e240b315-821f-4c6a-b5b1-ce1790f64e70'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:32.343278 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e240b315-821f-4c6a-b5b1-ce1790f64e70 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd5fb404f02f420da09bf52776d437c2', 'request_id': 'req-e240b315-821f-4c6a-b5b1-ce1790f64e70'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:32.358215 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e240b315-821f-4c6a-b5b1-ce1790f64e70 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd5fb404f02f420da09bf52776d437c2', 'request_id': 'req-e240b315-821f-4c6a-b5b1-ce1790f64e70'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:32.364637 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2402/4755] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:10:32 2022] POST /identity/v3/groups => generated 280 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:32.373081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86cb55a-6853-493a-8d00-eff3cb9dc784 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:32.405619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86cb55a-6853-493a-8d00-eff3cb9dc784 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:32.408167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e240b315-821f-4c6a-b5b1-ce1790f64e70 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] The token cache is being invalidate because project cd5fb404f02f420da09bf52776d437c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:32.408713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e240b315-821f-4c6a-b5b1-ce1790f64e70 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:32.410381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e240b315-821f-4c6a-b5b1-ce1790f64e70 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:32.413350 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2354/4756] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:10:32 2022] DELETE /identity/v3/projects/cd5fb404f02f420da09bf52776d437c2 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:32.419587 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240b315-821f-4c6a-b5b1-ce1790f64e70 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:32.421336 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e240b315-821f-4c6a-b5b1-ce1790f64e70 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:32.513914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:32.564365 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240b315-821f-4c6a-b5b1-ce1790f64e70 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:32.569394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626cd495-ab2f-41a0-8714-0869a8ca3f7b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:32.570281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626cd495-ab2f-41a0-8714-0869a8ca3f7b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:32.571041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626cd495-ab2f-41a0-8714-0869a8ca3f7b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:32.571488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626cd495-ab2f-41a0-8714-0869a8ca3f7b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/groups/0ffaf84f6c4f435a84b2da93a1bafa91` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:32.574180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bf735-49e8-4e25-ac9b-8a444674d57a tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:32.574959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bf735-49e8-4e25-ac9b-8a444674d57a tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:32.575338 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bf735-49e8-4e25-ac9b-8a444674d57a tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:32.575713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bf735-49e8-4e25-ac9b-8a444674d57a tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/projects/cd5fb404f02f420da09bf52776d437c2` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:32.589388 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626cd495-ab2f-41a0-8714-0869a8ca3f7b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:update_group(group_id=0ffaf84f6c4f435a84b2da93a1bafa91)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:32.590777 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-626cd495-ab2f-41a0-8714-0869a8ca3f7b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:10:32.590777 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:10:32.590777 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:10:32.592583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626cd495-ab2f-41a0-8714-0869a8ca3f7b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:32.592963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1bf735-49e8-4e25-ac9b-8a444674d57a tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cd5fb404f02f420da09bf52776d437c2)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:32.595494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1bf735-49e8-4e25-ac9b-8a444674d57a tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:32.635348 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-1a1bf735-49e8-4e25-ac9b-8a444674d57a tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Could not find project: cd5fb404f02f420da09bf52776d437c2.: keystone.exception.ProjectNotFound: Could not find project: cd5fb404f02f420da09bf52776d437c2. Aug 06 21:10:32.635348 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:10:32.635348 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:10:32.635348 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:10:32.635348 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:10:32.635348 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:10:32.635348 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:10:32.635348 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:10:32.635348 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:10:32.635348 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:10:32.635348 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:10:32.635348 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:10:32.635348 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Aug 06 21:10:32.635348 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Aug 06 21:10:32.636847 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:10:32.636847 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:10:32.636847 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Aug 06 21:10:32.636847 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Aug 06 21:10:32.636847 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 21:10:32.636847 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 21:10:32.636847 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 21:10:32.636847 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 21:10:32.636847 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: cd5fb404f02f420da09bf52776d437c2. Aug 06 21:10:32.636847 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:10:32.638574 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2355/4757] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:10:32 2022] DELETE /identity/v3/projects/cd5fb404f02f420da09bf52776d437c2 => generated 113 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:10:32.639851 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb54ca-898f-4681-9182-d04e327788bb None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:32.640224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb54ca-898f-4681-9182-d04e327788bb None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:32.640761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb54ca-898f-4681-9182-d04e327788bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:32.652523 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2403/4758] 10.222.0.33 () {60 vars in 1247 bytes} [Sat Aug 6 21:10:32 2022] PATCH /identity/v3/groups/0ffaf84f6c4f435a84b2da93a1bafa91 => generated 292 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:32.654011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8686043-e6fb-4c3d-b0cf-27d60e5f8424 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:32.654289 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8686043-e6fb-4c3d-b0cf-27d60e5f8424 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:32.654612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8686043-e6fb-4c3d-b0cf-27d60e5f8424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:32.716150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-2cbb54ca-898f-4681-9182-d04e327788bb None None] MFA Rules not processed for user `1d7b9e27983940dcaf0e92f62273c588`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:32.717628 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2cbb54ca-898f-4681-9182-d04e327788bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:32.739689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:32.740105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-c8686043-e6fb-4c3d-b0cf-27d60e5f8424 None None] MFA Rules not processed for user `22318132bfd04aa0886eb9b14a983731`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:32.741863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c8686043-e6fb-4c3d-b0cf-27d60e5f8424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:32.885098 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2356/4759] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:32.892471 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb54ca-898f-4681-9182-d04e327788bb None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:32.913172 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb54ca-898f-4681-9182-d04e327788bb None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:32.923269 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2404/4760] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:32.928701 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8686043-e6fb-4c3d-b0cf-27d60e5f8424 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:32.931300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c8686043-e6fb-4c3d-b0cf-27d60e5f8424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:32.932770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157d843-dfe4-4be0-adde-8b073a626ba1 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:32.933423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157d843-dfe4-4be0-adde-8b073a626ba1 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:32.933700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157d843-dfe4-4be0-adde-8b073a626ba1 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:32.933970 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157d843-dfe4-4be0-adde-8b073a626ba1 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/projects/299c78cb76b6487a857eff8d904d6d6a` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:32.935889 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5157d843-dfe4-4be0-adde-8b073a626ba1 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:delete_project(project_id=299c78cb76b6487a857eff8d904d6d6a)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:32.938152 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5157d843-dfe4-4be0-adde-8b073a626ba1 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:32.959446 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8686043-e6fb-4c3d-b0cf-27d60e5f8424 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:32.971716 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c654d89-b4c8-40b7-96a7-0e69b964b561 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:32.972356 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c654d89-b4c8-40b7-96a7-0e69b964b561 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:32.972641 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c654d89-b4c8-40b7-96a7-0e69b964b561 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:32.972913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c654d89-b4c8-40b7-96a7-0e69b964b561 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/groups/0ffaf84f6c4f435a84b2da93a1bafa91` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:32.986771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c654d89-b4c8-40b7-96a7-0e69b964b561 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:get_group(group_id=0ffaf84f6c4f435a84b2da93a1bafa91)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:32.987802 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-9c654d89-b4c8-40b7-96a7-0e69b964b561 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:10:32.987802 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:10:32.987802 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:10:32.989013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c654d89-b4c8-40b7-96a7-0e69b964b561 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:32.998331 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2405/4761] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:32 2022] GET /identity/v3/groups/0ffaf84f6c4f435a84b2da93a1bafa91 => generated 292 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:32.999690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c654d89-b4c8-40b7-96a7-0e69b964b561 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:33.020529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c654d89-b4c8-40b7-96a7-0e69b964b561 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:33.038902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5157d843-dfe4-4be0-adde-8b073a626ba1 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '299c78cb76b6487a857eff8d904d6d6a', 'request_id': 'req-5157d843-dfe4-4be0-adde-8b073a626ba1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:33.051117 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5157d843-dfe4-4be0-adde-8b073a626ba1 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '299c78cb76b6487a857eff8d904d6d6a', 'request_id': 'req-5157d843-dfe4-4be0-adde-8b073a626ba1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:33.063855 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5157d843-dfe4-4be0-adde-8b073a626ba1 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '299c78cb76b6487a857eff8d904d6d6a', 'request_id': 'req-5157d843-dfe4-4be0-adde-8b073a626ba1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:33.099310 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5157d843-dfe4-4be0-adde-8b073a626ba1 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] The token cache is being invalidate because project 299c78cb76b6487a857eff8d904d6d6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:33.100312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5157d843-dfe4-4be0-adde-8b073a626ba1 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:33.103185 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5157d843-dfe4-4be0-adde-8b073a626ba1 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:33.108888 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2357/4762] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:10:32 2022] DELETE /identity/v3/projects/299c78cb76b6487a857eff8d904d6d6a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:33.113825 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157d843-dfe4-4be0-adde-8b073a626ba1 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:33.115730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5157d843-dfe4-4be0-adde-8b073a626ba1 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:33.159733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39fad7-a1ab-479b-a8f9-236c615ab94c tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:33.160987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39fad7-a1ab-479b-a8f9-236c615ab94c tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:33.161310 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39fad7-a1ab-479b-a8f9-236c615ab94c tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:33.161545 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39fad7-a1ab-479b-a8f9-236c615ab94c tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/groups/0ffaf84f6c4f435a84b2da93a1bafa91` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:33.163395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39fad7-a1ab-479b-a8f9-236c615ab94c tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:update_group(group_id=0ffaf84f6c4f435a84b2da93a1bafa91)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:33.166659 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39fad7-a1ab-479b-a8f9-236c615ab94c tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:33.206703 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2406/4763] 10.222.0.33 () {60 vars in 1246 bytes} [Sat Aug 6 21:10:32 2022] PATCH /identity/v3/groups/0ffaf84f6c4f435a84b2da93a1bafa91 => generated 309 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:33.206703 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39fad7-a1ab-479b-a8f9-236c615ab94c tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:33.215517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2f39fad7-a1ab-479b-a8f9-236c615ab94c tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:33.286896 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157d843-dfe4-4be0-adde-8b073a626ba1 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:33.293283 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74f890-4111-4169-bd0c-2c2295ff3cdd tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:33.294179 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74f890-4111-4169-bd0c-2c2295ff3cdd tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:33.295124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74f890-4111-4169-bd0c-2c2295ff3cdd tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:33.295124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74f890-4111-4169-bd0c-2c2295ff3cdd tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/users/00a9ceb291a0423bae82f63b9cccce20` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:33.296486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74f890-4111-4169-bd0c-2c2295ff3cdd tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorizing `identity:delete_user(user_id=00a9ceb291a0423bae82f63b9cccce20)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:33.299590 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74f890-4111-4169-bd0c-2c2295ff3cdd tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:33.397084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:33.417079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:UPDATE=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:33.423841 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9f74f890-4111-4169-bd0c-2c2295ff3cdd tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00a9ceb291a0423bae82f63b9cccce20'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:33.426848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9f74f890-4111-4169-bd0c-2c2295ff3cdd tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00a9ceb291a0423bae82f63b9cccce20'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:33.430070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9f74f890-4111-4169-bd0c-2c2295ff3cdd tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00a9ceb291a0423bae82f63b9cccce20'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:33.447403 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9f74f890-4111-4169-bd0c-2c2295ff3cdd tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00a9ceb291a0423bae82f63b9cccce20'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:33.476762 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9f74f890-4111-4169-bd0c-2c2295ff3cdd tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00a9ceb291a0423bae82f63b9cccce20'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:33.480370 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39fad7-a1ab-479b-a8f9-236c615ab94c tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:33.495793 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2358/4764] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:33 2022] DELETE /identity/v3/users/00a9ceb291a0423bae82f63b9cccce20 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:33.496668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74f890-4111-4169-bd0c-2c2295ff3cdd tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:33.500967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9f74f890-4111-4169-bd0c-2c2295ff3cdd tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:33.505051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310400a-9d7d-4aae-a2cf-90520bf8808b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:33.505574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310400a-9d7d-4aae-a2cf-90520bf8808b service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:33.505858 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310400a-9d7d-4aae-a2cf-90520bf8808b service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:33.506165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310400a-9d7d-4aae-a2cf-90520bf8808b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:33.511417 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d310400a-9d7d-4aae-a2cf-90520bf8808b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:33.669391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310400a-9d7d-4aae-a2cf-90520bf8808b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:33.671542 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74f890-4111-4169-bd0c-2c2295ff3cdd tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:33.673623 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310400a-9d7d-4aae-a2cf-90520bf8808b service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:33.691607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fcc2f-bc62-433c-94cf-1d6dbc12146c tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:33.695275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fcc2f-bc62-433c-94cf-1d6dbc12146c tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:33.696994 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fcc2f-bc62-433c-94cf-1d6dbc12146c tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:33.697473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fcc2f-bc62-433c-94cf-1d6dbc12146c tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/groups/0ffaf84f6c4f435a84b2da93a1bafa91` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:33.712060 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09fcc2f-bc62-433c-94cf-1d6dbc12146c tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:delete_group(group_id=0ffaf84f6c4f435a84b2da93a1bafa91)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:33.718188 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09fcc2f-bc62-433c-94cf-1d6dbc12146c tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:33.718961 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2407/4765] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:10:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:10:33.720908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310400a-9d7d-4aae-a2cf-90520bf8808b service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:33.722861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d310400a-9d7d-4aae-a2cf-90520bf8808b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:33.772545 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310400a-9d7d-4aae-a2cf-90520bf8808b service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:33.906200 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2359/4766] 10.222.0.33 () {58 vars in 1227 bytes} [Sat Aug 6 21:10:33 2022] DELETE /identity/v3/groups/0ffaf84f6c4f435a84b2da93a1bafa91 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:33.911752 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fcc2f-bc62-433c-94cf-1d6dbc12146c tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:33.947048 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5af7a-0d8f-404a-aa46-684e30146574 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:33.948721 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5af7a-0d8f-404a-aa46-684e30146574 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:33.950961 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5af7a-0d8f-404a-aa46-684e30146574 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:33.951442 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5af7a-0d8f-404a-aa46-684e30146574 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/domains/b77d9c02a39d45a1aabb466e49453a1e` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:33.983943 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5af7a-0d8f-404a-aa46-684e30146574 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 21:10:34.017881 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-dca5af7a-0d8f-404a-aa46-684e30146574 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Could not find domain: b77d9c02a39d45a1aabb466e49453a1e.: keystone.exception.DomainNotFound: Could not find domain: b77d9c02a39d45a1aabb466e49453a1e. Aug 06 21:10:34.017881 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:10:34.017881 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 06 21:10:34.017881 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 06 21:10:34.017881 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 21:10:34.017881 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 21:10:34.017881 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 21:10:34.017881 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 21:10:34.017881 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: b77d9c02a39d45a1aabb466e49453a1e. Aug 06 21:10:34.017881 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:10:34.017881 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 21:10:34.017881 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:10:34.017881 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:10:34.017881 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:10:34.017881 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:10:34.017881 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:10:34.019478 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:10:34.019478 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:10:34.019478 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:10:34.019478 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:10:34.019478 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:10:34.019478 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:10:34.019478 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:10:34.019478 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 06 21:10:34.019478 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 06 21:10:34.019478 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 21:10:34.019478 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 21:10:34.019478 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 21:10:34.019478 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 21:10:34.019478 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:10:34.019478 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:10:34.019478 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 21:10:34.020846 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 21:10:34.020846 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 21:10:34.020846 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 21:10:34.020846 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 21:10:34.020846 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 21:10:34.020846 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 21:10:34.020846 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 21:10:34.020846 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 21:10:34.020846 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 21:10:34.020846 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 21:10:34.020846 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 21:10:34.020846 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 21:10:34.020846 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 21:10:34.020846 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 06 21:10:34.020846 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 21:10:34.020846 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: b77d9c02a39d45a1aabb466e49453a1e. Aug 06 21:10:34.020846 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:10:34.032166 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2408/4767] 10.222.0.33 () {60 vars in 1249 bytes} [Sat Aug 6 21:10:33 2022] PATCH /identity/v3/domains/b77d9c02a39d45a1aabb466e49453a1e => generated 112 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:10:34.036086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5af7a-0d8f-404a-aa46-684e30146574 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:34.075287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5af7a-0d8f-404a-aa46-684e30146574 tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:34.145467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fcc2f-bc62-433c-94cf-1d6dbc12146c tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:34.160289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174923d6-5e8b-4b8b-925c-d1364bf3f3e1 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:34.160580 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174923d6-5e8b-4b8b-925c-d1364bf3f3e1 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:34.160815 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174923d6-5e8b-4b8b-925c-d1364bf3f3e1 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:34.161096 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174923d6-5e8b-4b8b-925c-d1364bf3f3e1 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/groups` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:34.161734 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174923d6-5e8b-4b8b-925c-d1364bf3f3e1 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:34.165326 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-174923d6-5e8b-4b8b-925c-d1364bf3f3e1 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:10:34.165326 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:10:34.165326 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:10:34.168037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174923d6-5e8b-4b8b-925c-d1364bf3f3e1 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:34.207841 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2360/4768] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:10:33 2022] POST /identity/v3/groups => generated 325 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:34.209992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174923d6-5e8b-4b8b-925c-d1364bf3f3e1 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:34.221604 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd8cbc-db98-4c0b-aa21-6faba030655c tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:34.222743 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd8cbc-db98-4c0b-aa21-6faba030655c tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:34.223265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd8cbc-db98-4c0b-aa21-6faba030655c tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:34.223753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd8cbc-db98-4c0b-aa21-6faba030655c tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/domains/e515fbf3a7864f83b7c081a2b87c137c` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:34.236670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:34.242499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd8cbc-db98-4c0b-aa21-6faba030655c tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 21:10:34.261368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-86cd8cbc-db98-4c0b-aa21-6faba030655c tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Could not find domain: e515fbf3a7864f83b7c081a2b87c137c.: keystone.exception.DomainNotFound: Could not find domain: e515fbf3a7864f83b7c081a2b87c137c. Aug 06 21:10:34.261368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:10:34.261368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 06 21:10:34.261368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 06 21:10:34.261368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 21:10:34.261368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 21:10:34.261368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 21:10:34.261368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 21:10:34.261368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: e515fbf3a7864f83b7c081a2b87c137c. Aug 06 21:10:34.261368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:10:34.261368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 21:10:34.261368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:10:34.261368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:10:34.261368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:10:34.261368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:10:34.261368 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:10:34.263441 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:10:34.263441 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:10:34.263441 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:10:34.263441 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:10:34.263441 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:10:34.263441 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:10:34.263441 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:10:34.263441 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 06 21:10:34.263441 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 06 21:10:34.263441 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 21:10:34.263441 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 21:10:34.263441 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 21:10:34.263441 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 21:10:34.263441 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:10:34.263441 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:10:34.263441 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 21:10:34.264587 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 21:10:34.264587 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 21:10:34.264587 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 21:10:34.264587 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 21:10:34.264587 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 21:10:34.264587 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 21:10:34.264587 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 21:10:34.264587 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 21:10:34.264587 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 21:10:34.264587 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 21:10:34.264587 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 21:10:34.264587 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 21:10:34.264587 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 21:10:34.264587 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 06 21:10:34.264587 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 21:10:34.264587 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: e515fbf3a7864f83b7c081a2b87c137c. Aug 06 21:10:34.264587 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:10:34.269451 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2409/4769] 10.222.0.33 () {60 vars in 1249 bytes} [Sat Aug 6 21:10:34 2022] PATCH /identity/v3/domains/e515fbf3a7864f83b7c081a2b87c137c => generated 112 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:10:34.277054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd8cbc-db98-4c0b-aa21-6faba030655c tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:34.281393 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174923d6-5e8b-4b8b-925c-d1364bf3f3e1 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:34.292142 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd8cbc-db98-4c0b-aa21-6faba030655c tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:34.299718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b5100-3719-4eb7-92c8-de5daed7191b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:34.300366 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b5100-3719-4eb7-92c8-de5daed7191b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:34.300652 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b5100-3719-4eb7-92c8-de5daed7191b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:34.300928 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b5100-3719-4eb7-92c8-de5daed7191b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/domains/94409b883d784213bd09ee1c33d06c2e` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:34.317264 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b41b41-7cb9-431a-a203-8025a8a815cb tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:34.318163 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b41b41-7cb9-431a-a203-8025a8a815cb tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:34.320402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b41b41-7cb9-431a-a203-8025a8a815cb tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:34.320748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b41b41-7cb9-431a-a203-8025a8a815cb tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:34.321640 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b41b41-7cb9-431a-a203-8025a8a815cb tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:34.324349 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b41b41-7cb9-431a-a203-8025a8a815cb tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:34.338203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b5100-3719-4eb7-92c8-de5daed7191b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 21:10:34.353181 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-f40b5100-3719-4eb7-92c8-de5daed7191b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Could not find domain: 94409b883d784213bd09ee1c33d06c2e.: keystone.exception.DomainNotFound: Could not find domain: 94409b883d784213bd09ee1c33d06c2e. Aug 06 21:10:34.353181 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:10:34.353181 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 06 21:10:34.353181 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 06 21:10:34.353181 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 21:10:34.353181 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 21:10:34.353181 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 21:10:34.353181 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 21:10:34.353181 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 94409b883d784213bd09ee1c33d06c2e. Aug 06 21:10:34.353181 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:10:34.353181 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 21:10:34.353181 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:10:34.353181 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:10:34.353181 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:10:34.353181 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:10:34.353181 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:10:34.354640 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:10:34.354640 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:10:34.354640 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:10:34.354640 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:10:34.354640 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:10:34.354640 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:10:34.354640 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:10:34.354640 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 06 21:10:34.354640 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 06 21:10:34.354640 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 21:10:34.354640 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 21:10:34.354640 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 21:10:34.354640 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 21:10:34.354640 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:10:34.354640 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:10:34.354640 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 21:10:34.355822 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 21:10:34.355822 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 21:10:34.355822 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 21:10:34.355822 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 21:10:34.355822 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 21:10:34.355822 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 21:10:34.355822 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 21:10:34.355822 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 21:10:34.355822 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 21:10:34.355822 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 21:10:34.355822 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 21:10:34.355822 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 21:10:34.355822 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 21:10:34.355822 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 06 21:10:34.355822 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 21:10:34.355822 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 94409b883d784213bd09ee1c33d06c2e. Aug 06 21:10:34.355822 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:10:34.363919 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2410/4770] 10.222.0.33 () {60 vars in 1249 bytes} [Sat Aug 6 21:10:34 2022] PATCH /identity/v3/domains/94409b883d784213bd09ee1c33d06c2e => generated 112 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:10:34.370664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b5100-3719-4eb7-92c8-de5daed7191b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:34.417548 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b5100-3719-4eb7-92c8-de5daed7191b tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:34.428480 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2361/4771] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:10:34 2022] POST /identity/v3/users => generated 321 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:34.432821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39059f27-9a84-4f63-a320-1bfac71d5e3c tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d193e51d7d94668a62b7aa59720452e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f17b5ec61f04803a679b49407cb2dae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:34.433218 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b41b41-7cb9-431a-a203-8025a8a815cb tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:34.434852 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39059f27-9a84-4f63-a320-1bfac71d5e3c tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:34.436833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39059f27-9a84-4f63-a320-1bfac71d5e3c tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:34.438201 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39059f27-9a84-4f63-a320-1bfac71d5e3c tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] PATH_INFO: `/v3/domains/e792baa1d7ec4e75bde41316a9680499` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:34.461530 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39059f27-9a84-4f63-a320-1bfac71d5e3c tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 21:10:34.468246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b41b41-7cb9-431a-a203-8025a8a815cb tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:34.473036 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-39059f27-9a84-4f63-a320-1bfac71d5e3c tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Could not find domain: e792baa1d7ec4e75bde41316a9680499.: keystone.exception.DomainNotFound: Could not find domain: e792baa1d7ec4e75bde41316a9680499. Aug 06 21:10:34.473036 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:10:34.473036 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 06 21:10:34.473036 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 06 21:10:34.473036 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 21:10:34.473036 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 21:10:34.473036 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 21:10:34.473036 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 21:10:34.473036 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: e792baa1d7ec4e75bde41316a9680499. Aug 06 21:10:34.473036 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:10:34.473036 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 21:10:34.473036 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:10:34.473036 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:10:34.473036 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:10:34.473036 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:10:34.473036 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:10:34.474302 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:10:34.474302 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:10:34.474302 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:10:34.474302 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:10:34.474302 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:10:34.474302 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:10:34.474302 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:10:34.474302 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 06 21:10:34.474302 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 06 21:10:34.474302 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 21:10:34.474302 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 21:10:34.474302 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 21:10:34.474302 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 21:10:34.474302 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:10:34.474302 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:10:34.474302 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 21:10:34.475574 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 21:10:34.475574 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 21:10:34.475574 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 21:10:34.475574 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 21:10:34.475574 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 21:10:34.475574 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 21:10:34.475574 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 21:10:34.475574 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 21:10:34.475574 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 21:10:34.475574 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 21:10:34.475574 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 21:10:34.475574 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 21:10:34.475574 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 21:10:34.475574 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 06 21:10:34.475574 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 21:10:34.475574 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: e792baa1d7ec4e75bde41316a9680499. Aug 06 21:10:34.475574 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:10:34.476783 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2411/4772] 10.222.0.33 () {60 vars in 1249 bytes} [Sat Aug 6 21:10:34 2022] PATCH /identity/v3/domains/e792baa1d7ec4e75bde41316a9680499 => generated 112 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:10:34.480638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39059f27-9a84-4f63-a320-1bfac71d5e3c tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:34.483984 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d5860-b337-477a-8f64-da53bbc95e41 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:34.486857 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-39059f27-9a84-4f63-a320-1bfac71d5e3c tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:34.489442 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d5860-b337-477a-8f64-da53bbc95e41 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:34.494894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d5860-b337-477a-8f64-da53bbc95e41 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:34.495568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d5860-b337-477a-8f64-da53bbc95e41 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/groups/2ce4b0293b4c416983d380dc44addb54/users/6b187063590144b591a16bf78d69d431` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:34.503888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:34.578981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d5860-b337-477a-8f64-da53bbc95e41 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=2ce4b0293b4c416983d380dc44addb54, user_id=6b187063590144b591a16bf78d69d431)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:34.587649 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d5860-b337-477a-8f64-da53bbc95e41 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:34.695461 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2362/4773] 10.222.0.33 () {60 vars in 1360 bytes} [Sat Aug 6 21:10:34 2022] PUT /identity/v3/groups/2ce4b0293b4c416983d380dc44addb54/users/6b187063590144b591a16bf78d69d431 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:34.699261 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d5860-b337-477a-8f64-da53bbc95e41 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:34.746461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39059f27-9a84-4f63-a320-1bfac71d5e3c tempest-TokensV3TestJSON-814153968 tempest-TokensV3TestJSON-814153968-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:34.957103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d5860-b337-477a-8f64-da53bbc95e41 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:34.973597 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2e7ad-50ca-4454-b1dc-290071a5d82f tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:34.974232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2e7ad-50ca-4454-b1dc-290071a5d82f tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:34.974510 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2e7ad-50ca-4454-b1dc-290071a5d82f tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:34.974870 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2e7ad-50ca-4454-b1dc-290071a5d82f tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:34.976139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2e7ad-50ca-4454-b1dc-290071a5d82f tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:34.978767 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2e7ad-50ca-4454-b1dc-290071a5d82f tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:34.988157 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f093d649-5351-48e5-9dda-3728d3616c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:34.988804 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093d649-5351-48e5-9dda-3728d3616c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:34.989081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093d649-5351-48e5-9dda-3728d3616c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:34.989351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093d649-5351-48e5-9dda-3728d3616c4a admin admin] PATH_INFO: `/v3/users/13d213ada93a4ccf8bf51a03bccd91e6` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:34.990469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f093d649-5351-48e5-9dda-3728d3616c4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=13d213ada93a4ccf8bf51a03bccd91e6)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:34.993783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f093d649-5351-48e5-9dda-3728d3616c4a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:35.032378 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2363/4774] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:10:34 2022] POST /identity/v3/users => generated 321 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:35.037000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2e7ad-50ca-4454-b1dc-290071a5d82f tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:35.050993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2e7ad-50ca-4454-b1dc-290071a5d82f tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:35.057795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890d4e0-5b9a-4af0-b812-d16979adca8b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:35.058968 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890d4e0-5b9a-4af0-b812-d16979adca8b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:35.059553 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890d4e0-5b9a-4af0-b812-d16979adca8b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:35.060139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890d4e0-5b9a-4af0-b812-d16979adca8b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/groups/2ce4b0293b4c416983d380dc44addb54/users/ae3666defc8541b08baaeb63c12cf62b` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:35.105733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890d4e0-5b9a-4af0-b812-d16979adca8b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=2ce4b0293b4c416983d380dc44addb54, user_id=ae3666defc8541b08baaeb63c12cf62b)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:35.108017 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890d4e0-5b9a-4af0-b812-d16979adca8b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:35.129981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f093d649-5351-48e5-9dda-3728d3616c4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13d213ada93a4ccf8bf51a03bccd91e6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:35.155103 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f093d649-5351-48e5-9dda-3728d3616c4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13d213ada93a4ccf8bf51a03bccd91e6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:35.160068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f093d649-5351-48e5-9dda-3728d3616c4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13d213ada93a4ccf8bf51a03bccd91e6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:35.162257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f093d649-5351-48e5-9dda-3728d3616c4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13d213ada93a4ccf8bf51a03bccd91e6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:35.175645 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2364/4775] 10.222.0.33 () {60 vars in 1360 bytes} [Sat Aug 6 21:10:35 2022] PUT /identity/v3/groups/2ce4b0293b4c416983d380dc44addb54/users/ae3666defc8541b08baaeb63c12cf62b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:35.177718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890d4e0-5b9a-4af0-b812-d16979adca8b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:35.183472 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0890d4e0-5b9a-4af0-b812-d16979adca8b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:35.183761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f093d649-5351-48e5-9dda-3728d3616c4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13d213ada93a4ccf8bf51a03bccd91e6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:35.229221 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2412/4776] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:34 2022] DELETE /identity/v3/users/13d213ada93a4ccf8bf51a03bccd91e6 => generated 0 bytes in 749 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:35.235667 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1a061-4b55-4417-a9b0-4411cc61c9f9 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:35.236005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1a061-4b55-4417-a9b0-4411cc61c9f9 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:35.236903 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1a061-4b55-4417-a9b0-4411cc61c9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:35.316263 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a5e1a061-4b55-4417-a9b0-4411cc61c9f9 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:35.323892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a5e1a061-4b55-4417-a9b0-4411cc61c9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:35.417601 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:35.424650 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890d4e0-5b9a-4af0-b812-d16979adca8b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:35.443795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:35.518759 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2413/4777] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:35.544646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1a061-4b55-4417-a9b0-4411cc61c9f9 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:35.547403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a5e1a061-4b55-4417-a9b0-4411cc61c9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:35.575970 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa8e05-245c-4203-a0fe-ca19a4a21ca7 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:35.577157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa8e05-245c-4203-a0fe-ca19a4a21ca7 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:35.578403 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa8e05-245c-4203-a0fe-ca19a4a21ca7 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:35.579843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa8e05-245c-4203-a0fe-ca19a4a21ca7 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:35.581270 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fa8e05-245c-4203-a0fe-ca19a4a21ca7 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:35.583850 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fa8e05-245c-4203-a0fe-ca19a4a21ca7 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:35.648953 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2365/4778] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:10:35 2022] POST /identity/v3/users => generated 323 bytes in 472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:35.650532 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa8e05-245c-4203-a0fe-ca19a4a21ca7 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:35.680223 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1a061-4b55-4417-a9b0-4411cc61c9f9 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:35.684312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa8e05-245c-4203-a0fe-ca19a4a21ca7 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:35.685445 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9847e-6c6c-4485-819b-3406b1d84a3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:35.686091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9847e-6c6c-4485-819b-3406b1d84a3f service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:35.686332 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9847e-6c6c-4485-819b-3406b1d84a3f service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:35.686658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9847e-6c6c-4485-819b-3406b1d84a3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:35.704975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9847e-6c6c-4485-819b-3406b1d84a3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:35.707298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9847e-6c6c-4485-819b-3406b1d84a3f service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:35.711935 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8155d-3424-4068-b0f9-a4adbfddf38b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:35.713845 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8155d-3424-4068-b0f9-a4adbfddf38b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:35.714523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8155d-3424-4068-b0f9-a4adbfddf38b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:35.715231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8155d-3424-4068-b0f9-a4adbfddf38b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/groups/2ce4b0293b4c416983d380dc44addb54/users/c73cad8f7aeb46f887152af887fbcd56` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:35.751573 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2414/4779] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:10:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:10:35.787565 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd8155d-3424-4068-b0f9-a4adbfddf38b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=2ce4b0293b4c416983d380dc44addb54, user_id=c73cad8f7aeb46f887152af887fbcd56)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:35.795919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd8155d-3424-4068-b0f9-a4adbfddf38b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:35.917179 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2366/4780] 10.222.0.33 () {60 vars in 1360 bytes} [Sat Aug 6 21:10:35 2022] PUT /identity/v3/groups/2ce4b0293b4c416983d380dc44addb54/users/c73cad8f7aeb46f887152af887fbcd56 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:35.921286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9847e-6c6c-4485-819b-3406b1d84a3f service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:35.946364 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9847e-6c6c-4485-819b-3406b1d84a3f service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:36.087364 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd683a20-e12d-46d6-8c24-e9bf3554788b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:36.090479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd683a20-e12d-46d6-8c24-e9bf3554788b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:36.091332 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd683a20-e12d-46d6-8c24-e9bf3554788b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:36.092618 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd683a20-e12d-46d6-8c24-e9bf3554788b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/groups/2ce4b0293b4c416983d380dc44addb54/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:36.095735 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd683a20-e12d-46d6-8c24-e9bf3554788b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=2ce4b0293b4c416983d380dc44addb54)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:36.096975 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-fd683a20-e12d-46d6-8c24-e9bf3554788b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:10:36.096975 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:10:36.096975 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:10:36.102274 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd683a20-e12d-46d6-8c24-e9bf3554788b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:36.136455 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2415/4781] 10.222.0.33 () {58 vars in 1242 bytes} [Sat Aug 6 21:10:35 2022] GET /identity/v3/groups/2ce4b0293b4c416983d380dc44addb54/users => generated 1081 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:36.141296 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8155d-3424-4068-b0f9-a4adbfddf38b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:36.167973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8155d-3424-4068-b0f9-a4adbfddf38b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:36.235446 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824cef9-a3d3-4a64-86af-8557e0fdfedd tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:36.251587 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824cef9-a3d3-4a64-86af-8557e0fdfedd tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `HEAD` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:36.252211 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824cef9-a3d3-4a64-86af-8557e0fdfedd tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:36.252688 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824cef9-a3d3-4a64-86af-8557e0fdfedd tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/groups/2ce4b0293b4c416983d380dc44addb54/users/6b187063590144b591a16bf78d69d431` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:36.272965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5824cef9-a3d3-4a64-86af-8557e0fdfedd tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=2ce4b0293b4c416983d380dc44addb54, user_id=6b187063590144b591a16bf78d69d431)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:36.297014 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-5824cef9-a3d3-4a64-86af-8557e0fdfedd tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:10:36.297014 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:10:36.297014 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:10:36.299316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5824cef9-a3d3-4a64-86af-8557e0fdfedd tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:36.341468 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2367/4782] 10.222.0.33 () {58 vars in 1342 bytes} [Sat Aug 6 21:10:36 2022] HEAD /identity/v3/groups/2ce4b0293b4c416983d380dc44addb54/users/6b187063590144b591a16bf78d69d431 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:36.343186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd683a20-e12d-46d6-8c24-e9bf3554788b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:36.365531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd683a20-e12d-46d6-8c24-e9bf3554788b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:36.375096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2a10b-010f-4a7a-a32d-34858a16c71d tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:36.376013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2a10b-010f-4a7a-a32d-34858a16c71d tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:36.376390 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2a10b-010f-4a7a-a32d-34858a16c71d tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:36.377122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2a10b-010f-4a7a-a32d-34858a16c71d tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/groups/2ce4b0293b4c416983d380dc44addb54/users/6b187063590144b591a16bf78d69d431` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:36.380255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc2a10b-010f-4a7a-a32d-34858a16c71d tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=2ce4b0293b4c416983d380dc44addb54, user_id=6b187063590144b591a16bf78d69d431)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:36.383018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc2a10b-010f-4a7a-a32d-34858a16c71d tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:36.398460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-edc2a10b-010f-4a7a-a32d-34858a16c71d tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '6b187063590144b591a16bf78d69d431'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:36.445209 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2416/4783] 10.222.0.33 () {58 vars in 1344 bytes} [Sat Aug 6 21:10:36 2022] DELETE /identity/v3/groups/2ce4b0293b4c416983d380dc44addb54/users/6b187063590144b591a16bf78d69d431 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:36.448791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824cef9-a3d3-4a64-86af-8557e0fdfedd tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:36.464401 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824cef9-a3d3-4a64-86af-8557e0fdfedd tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:36.623189 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467d968-f6cd-4545-8c85-cf9dc1a03430 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:36.624906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467d968-f6cd-4545-8c85-cf9dc1a03430 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `HEAD` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:36.625743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467d968-f6cd-4545-8c85-cf9dc1a03430 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:36.626099 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467d968-f6cd-4545-8c85-cf9dc1a03430 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/groups/2ce4b0293b4c416983d380dc44addb54/users/ae3666defc8541b08baaeb63c12cf62b` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:36.630909 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467d968-f6cd-4545-8c85-cf9dc1a03430 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=2ce4b0293b4c416983d380dc44addb54, user_id=ae3666defc8541b08baaeb63c12cf62b)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:36.641082 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467d968-f6cd-4545-8c85-cf9dc1a03430 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:36.670628 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2368/4784] 10.222.0.33 () {58 vars in 1342 bytes} [Sat Aug 6 21:10:36 2022] HEAD /identity/v3/groups/2ce4b0293b4c416983d380dc44addb54/users/ae3666defc8541b08baaeb63c12cf62b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:36.675781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2a10b-010f-4a7a-a32d-34858a16c71d tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:36.693199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2a10b-010f-4a7a-a32d-34858a16c71d tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:36.699585 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f2f3e-5e0e-4d1a-82fe-e7b19d747aac tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:36.701510 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f2f3e-5e0e-4d1a-82fe-e7b19d747aac tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:36.702012 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f2f3e-5e0e-4d1a-82fe-e7b19d747aac tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:36.702480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f2f3e-5e0e-4d1a-82fe-e7b19d747aac tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/groups/2ce4b0293b4c416983d380dc44addb54/users/ae3666defc8541b08baaeb63c12cf62b` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:36.704499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f2f3e-5e0e-4d1a-82fe-e7b19d747aac tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=2ce4b0293b4c416983d380dc44addb54, user_id=ae3666defc8541b08baaeb63c12cf62b)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:36.708143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f2f3e-5e0e-4d1a-82fe-e7b19d747aac tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:36.722614 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e99f2f3e-5e0e-4d1a-82fe-e7b19d747aac tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'ae3666defc8541b08baaeb63c12cf62b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:36.749436 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2417/4785] 10.222.0.33 () {58 vars in 1344 bytes} [Sat Aug 6 21:10:36 2022] DELETE /identity/v3/groups/2ce4b0293b4c416983d380dc44addb54/users/ae3666defc8541b08baaeb63c12cf62b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:36.753678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467d968-f6cd-4545-8c85-cf9dc1a03430 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:36.767403 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467d968-f6cd-4545-8c85-cf9dc1a03430 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:36.848204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:36.871891 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4801c80-042d-44ea-8cfe-0c2231fcb12d tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:36.872671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4801c80-042d-44ea-8cfe-0c2231fcb12d tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `HEAD` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:36.873056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4801c80-042d-44ea-8cfe-0c2231fcb12d tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:36.873446 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4801c80-042d-44ea-8cfe-0c2231fcb12d tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/groups/2ce4b0293b4c416983d380dc44addb54/users/c73cad8f7aeb46f887152af887fbcd56` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:36.877998 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4801c80-042d-44ea-8cfe-0c2231fcb12d tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=2ce4b0293b4c416983d380dc44addb54, user_id=c73cad8f7aeb46f887152af887fbcd56)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:36.880376 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4801c80-042d-44ea-8cfe-0c2231fcb12d tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:36.901284 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2369/4786] 10.222.0.33 () {58 vars in 1342 bytes} [Sat Aug 6 21:10:36 2022] HEAD /identity/v3/groups/2ce4b0293b4c416983d380dc44addb54/users/c73cad8f7aeb46f887152af887fbcd56 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:36.905512 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f2f3e-5e0e-4d1a-82fe-e7b19d747aac tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:36.920842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f2f3e-5e0e-4d1a-82fe-e7b19d747aac tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:36.927794 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ba8f4-f80d-419c-aa4c-fc4b5f46083b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:36.928537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ba8f4-f80d-419c-aa4c-fc4b5f46083b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:36.928828 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ba8f4-f80d-419c-aa4c-fc4b5f46083b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:36.929187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ba8f4-f80d-419c-aa4c-fc4b5f46083b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/groups/2ce4b0293b4c416983d380dc44addb54/users/c73cad8f7aeb46f887152af887fbcd56` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:36.931326 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ba8f4-f80d-419c-aa4c-fc4b5f46083b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=2ce4b0293b4c416983d380dc44addb54, user_id=c73cad8f7aeb46f887152af887fbcd56)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:36.933352 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ba8f4-f80d-419c-aa4c-fc4b5f46083b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:36.946848 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a00ba8f4-f80d-419c-aa4c-fc4b5f46083b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c73cad8f7aeb46f887152af887fbcd56'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:36.980033 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2418/4787] 10.222.0.33 () {58 vars in 1344 bytes} [Sat Aug 6 21:10:36 2022] DELETE /identity/v3/groups/2ce4b0293b4c416983d380dc44addb54/users/c73cad8f7aeb46f887152af887fbcd56 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:36.983209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4801c80-042d-44ea-8cfe-0c2231fcb12d tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:37.009022 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4801c80-042d-44ea-8cfe-0c2231fcb12d tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:37.157223 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c83af-abf0-47bf-a64b-7ae1581ada1e tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:37.158212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c83af-abf0-47bf-a64b-7ae1581ada1e tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:37.158700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c83af-abf0-47bf-a64b-7ae1581ada1e tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:37.159154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c83af-abf0-47bf-a64b-7ae1581ada1e tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/groups/2ce4b0293b4c416983d380dc44addb54/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:37.163881 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c83af-abf0-47bf-a64b-7ae1581ada1e tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=2ce4b0293b4c416983d380dc44addb54)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:37.165185 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-b29c83af-abf0-47bf-a64b-7ae1581ada1e tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:10:37.165185 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:10:37.165185 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:10:37.166796 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c83af-abf0-47bf-a64b-7ae1581ada1e tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:37.185638 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2370/4788] 10.222.0.33 () {58 vars in 1242 bytes} [Sat Aug 6 21:10:36 2022] GET /identity/v3/groups/2ce4b0293b4c416983d380dc44addb54/users => generated 145 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:37.192076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ba8f4-f80d-419c-aa4c-fc4b5f46083b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:37.205860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:37.219027 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ba8f4-f80d-419c-aa4c-fc4b5f46083b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:37.224687 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ae930-ef49-42a9-aa91-f89abe4d78c3 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:37.226720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ae930-ef49-42a9-aa91-f89abe4d78c3 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:37.227316 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ae930-ef49-42a9-aa91-f89abe4d78c3 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:37.228535 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ae930-ef49-42a9-aa91-f89abe4d78c3 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/users/c73cad8f7aeb46f887152af887fbcd56` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:37.233901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ae930-ef49-42a9-aa91-f89abe4d78c3 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c73cad8f7aeb46f887152af887fbcd56)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:37.237432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ae930-ef49-42a9-aa91-f89abe4d78c3 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:37.311036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-105ae930-ef49-42a9-aa91-f89abe4d78c3 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c73cad8f7aeb46f887152af887fbcd56'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:37.322300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-105ae930-ef49-42a9-aa91-f89abe4d78c3 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c73cad8f7aeb46f887152af887fbcd56'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:37.323594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-105ae930-ef49-42a9-aa91-f89abe4d78c3 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c73cad8f7aeb46f887152af887fbcd56'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:37.324922 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-105ae930-ef49-42a9-aa91-f89abe4d78c3 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c73cad8f7aeb46f887152af887fbcd56'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:37.339814 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-105ae930-ef49-42a9-aa91-f89abe4d78c3 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c73cad8f7aeb46f887152af887fbcd56'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:37.365620 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2419/4789] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:37 2022] DELETE /identity/v3/users/c73cad8f7aeb46f887152af887fbcd56 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:10:37.369981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c83af-abf0-47bf-a64b-7ae1581ada1e tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:37.372666 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b29c83af-abf0-47bf-a64b-7ae1581ada1e tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:37.394597 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c83af-abf0-47bf-a64b-7ae1581ada1e tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:37.576004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ae930-ef49-42a9-aa91-f89abe4d78c3 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:37.578664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-105ae930-ef49-42a9-aa91-f89abe4d78c3 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:37.633405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810fd0ce-999d-46df-bdf0-95340254b9ef tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:37.636815 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fd0ce-999d-46df-bdf0-95340254b9ef tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:37.639484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fd0ce-999d-46df-bdf0-95340254b9ef tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:37.642662 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fd0ce-999d-46df-bdf0-95340254b9ef tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/users/ae3666defc8541b08baaeb63c12cf62b` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:37.653062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810fd0ce-999d-46df-bdf0-95340254b9ef tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ae3666defc8541b08baaeb63c12cf62b)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:37.661654 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810fd0ce-999d-46df-bdf0-95340254b9ef tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:37.831340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ae930-ef49-42a9-aa91-f89abe4d78c3 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:37.837400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-810fd0ce-999d-46df-bdf0-95340254b9ef tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae3666defc8541b08baaeb63c12cf62b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:37.840150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-810fd0ce-999d-46df-bdf0-95340254b9ef tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae3666defc8541b08baaeb63c12cf62b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:37.842070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-810fd0ce-999d-46df-bdf0-95340254b9ef tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae3666defc8541b08baaeb63c12cf62b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:37.844044 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a364f-9062-4533-8f83-ed687312b950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:37.844999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a364f-9062-4533-8f83-ed687312b950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:37.845453 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a364f-9062-4533-8f83-ed687312b950 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:37.845925 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a364f-9062-4533-8f83-ed687312b950 admin admin] PATH_INFO: `/v3/projects/ffe141a5c1984cfdba5e15410d856075` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:37.851457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a364f-9062-4533-8f83-ed687312b950 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffe141a5c1984cfdba5e15410d856075)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:37.853666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a364f-9062-4533-8f83-ed687312b950 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:37.898872 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-810fd0ce-999d-46df-bdf0-95340254b9ef tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae3666defc8541b08baaeb63c12cf62b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:37.925142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-810fd0ce-999d-46df-bdf0-95340254b9ef tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae3666defc8541b08baaeb63c12cf62b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:37.928962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:37.957725 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ff0a364f-9062-4533-8f83-ed687312b950 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffe141a5c1984cfdba5e15410d856075', 'request_id': 'req-ff0a364f-9062-4533-8f83-ed687312b950'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:37.965402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ff0a364f-9062-4533-8f83-ed687312b950 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffe141a5c1984cfdba5e15410d856075', 'request_id': 'req-ff0a364f-9062-4533-8f83-ed687312b950'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:37.977599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ff0a364f-9062-4533-8f83-ed687312b950 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffe141a5c1984cfdba5e15410d856075', 'request_id': 'req-ff0a364f-9062-4533-8f83-ed687312b950'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:37.990522 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2371/4790] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:37 2022] DELETE /identity/v3/users/ae3666defc8541b08baaeb63c12cf62b => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:37.995325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ff0a364f-9062-4533-8f83-ed687312b950 admin admin] The token cache is being invalidate because project ffe141a5c1984cfdba5e15410d856075 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:37.995548 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810fd0ce-999d-46df-bdf0-95340254b9ef tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:37.996521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ff0a364f-9062-4533-8f83-ed687312b950 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:37.997456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ff0a364f-9062-4533-8f83-ed687312b950 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:38.000456 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2420/4791] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:10:37 2022] DELETE /identity/v3/projects/ffe141a5c1984cfdba5e15410d856075 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:38.001836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-810fd0ce-999d-46df-bdf0-95340254b9ef tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:38.004229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a364f-9062-4533-8f83-ed687312b950 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:38.007582 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ff0a364f-9062-4533-8f83-ed687312b950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:38.022722 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:38.143838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810fd0ce-999d-46df-bdf0-95340254b9ef tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:38.168737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5bd46-298a-438f-9122-b3733b1c7e13 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:38.173586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5bd46-298a-438f-9122-b3733b1c7e13 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:38.177633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5bd46-298a-438f-9122-b3733b1c7e13 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:38.183754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5bd46-298a-438f-9122-b3733b1c7e13 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/users/6b187063590144b591a16bf78d69d431` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:38.193483 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b5bd46-298a-438f-9122-b3733b1c7e13 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6b187063590144b591a16bf78d69d431)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:38.204465 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b5bd46-298a-438f-9122-b3733b1c7e13 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:38.310212 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a364f-9062-4533-8f83-ed687312b950 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:38.337289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-14b5bd46-298a-438f-9122-b3733b1c7e13 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b187063590144b591a16bf78d69d431'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:38.338670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-14b5bd46-298a-438f-9122-b3733b1c7e13 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b187063590144b591a16bf78d69d431'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:38.341603 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-14b5bd46-298a-438f-9122-b3733b1c7e13 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b187063590144b591a16bf78d69d431'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:38.362935 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-14b5bd46-298a-438f-9122-b3733b1c7e13 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b187063590144b591a16bf78d69d431'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:38.385102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-14b5bd46-298a-438f-9122-b3733b1c7e13 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b187063590144b591a16bf78d69d431'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:38.405955 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2372/4792] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:37 2022] DELETE /identity/v3/users/6b187063590144b591a16bf78d69d431 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:38.410835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5bd46-298a-438f-9122-b3733b1c7e13 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:38.413664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-14b5bd46-298a-438f-9122-b3733b1c7e13 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:38.420641 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07662489-b1cb-4279-8eec-1b1c315cb9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:38.422019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07662489-b1cb-4279-8eec-1b1c315cb9b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:38.422384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07662489-b1cb-4279-8eec-1b1c315cb9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:38.423406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07662489-b1cb-4279-8eec-1b1c315cb9b1 admin admin] PATH_INFO: `/v3/users/0d193e51d7d94668a62b7aa59720452e` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:38.424774 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07662489-b1cb-4279-8eec-1b1c315cb9b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d193e51d7d94668a62b7aa59720452e)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:38.427060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07662489-b1cb-4279-8eec-1b1c315cb9b1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:38.520127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-07662489-b1cb-4279-8eec-1b1c315cb9b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d193e51d7d94668a62b7aa59720452e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:38.535650 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-07662489-b1cb-4279-8eec-1b1c315cb9b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d193e51d7d94668a62b7aa59720452e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:38.536856 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-07662489-b1cb-4279-8eec-1b1c315cb9b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d193e51d7d94668a62b7aa59720452e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:38.537980 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-07662489-b1cb-4279-8eec-1b1c315cb9b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d193e51d7d94668a62b7aa59720452e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:38.551257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-07662489-b1cb-4279-8eec-1b1c315cb9b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d193e51d7d94668a62b7aa59720452e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:38.590741 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5bd46-298a-438f-9122-b3733b1c7e13 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:38.596258 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2421/4793] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:38 2022] DELETE /identity/v3/users/0d193e51d7d94668a62b7aa59720452e => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:38.597377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07662489-b1cb-4279-8eec-1b1c315cb9b1 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:38.598085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f3161-09e0-47ee-8da2-83bbc872d9c9 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:38.598916 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f3161-09e0-47ee-8da2-83bbc872d9c9 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:38.599337 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f3161-09e0-47ee-8da2-83bbc872d9c9 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:38.599773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f3161-09e0-47ee-8da2-83bbc872d9c9 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/groups/2ce4b0293b4c416983d380dc44addb54` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:38.600478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-07662489-b1cb-4279-8eec-1b1c315cb9b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:38.601172 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f3161-09e0-47ee-8da2-83bbc872d9c9 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:delete_group(group_id=2ce4b0293b4c416983d380dc44addb54)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:38.603933 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f3161-09e0-47ee-8da2-83bbc872d9c9 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:38.623221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:38.677649 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:38.693578 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2373/4794] 10.222.0.33 () {58 vars in 1227 bytes} [Sat Aug 6 21:10:38 2022] DELETE /identity/v3/groups/2ce4b0293b4c416983d380dc44addb54 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:38.695703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f3161-09e0-47ee-8da2-83bbc872d9c9 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:38.699831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-926f3161-09e0-47ee-8da2-83bbc872d9c9 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:38.734184 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07662489-b1cb-4279-8eec-1b1c315cb9b1 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:38.820582 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f3161-09e0-47ee-8da2-83bbc872d9c9 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:38.826753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0bfe06-143d-42f4-bbf1-ebd38d495d3b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:38.828238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0bfe06-143d-42f4-bbf1-ebd38d495d3b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:38.828905 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0bfe06-143d-42f4-bbf1-ebd38d495d3b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:38.829280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0bfe06-143d-42f4-bbf1-ebd38d495d3b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/groups` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:38.830016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0bfe06-143d-42f4-bbf1-ebd38d495d3b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:38.832660 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0bfe06-143d-42f4-bbf1-ebd38d495d3b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:38.849910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05cf8e0-05f7-4a26-a550-64dd060bbf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:38.850647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cf8e0-05f7-4a26-a550-64dd060bbf5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:38.850923 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cf8e0-05f7-4a26-a550-64dd060bbf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:38.851205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cf8e0-05f7-4a26-a550-64dd060bbf5a admin admin] PATH_INFO: `/v3/users/44d40dcfb9f140c49b343d3e4331dfbe` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:38.853020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05cf8e0-05f7-4a26-a550-64dd060bbf5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=44d40dcfb9f140c49b343d3e4331dfbe)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:38.856106 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05cf8e0-05f7-4a26-a550-64dd060bbf5a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:38.869020 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2374/4795] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:10:38 2022] POST /identity/v3/groups => generated 327 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:38.870113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0bfe06-143d-42f4-bbf1-ebd38d495d3b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:38.902805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0bfe06-143d-42f4-bbf1-ebd38d495d3b tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:38.918004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6629e-5910-4b4a-afa6-f46dac835501 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:38.918818 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6629e-5910-4b4a-afa6-f46dac835501 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:38.919149 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d05cf8e0-05f7-4a26-a550-64dd060bbf5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44d40dcfb9f140c49b343d3e4331dfbe'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:38.919291 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6629e-5910-4b4a-afa6-f46dac835501 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:38.919652 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6629e-5910-4b4a-afa6-f46dac835501 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/groups` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:38.920537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6629e-5910-4b4a-afa6-f46dac835501 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:38.923293 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6629e-5910-4b4a-afa6-f46dac835501 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:38.933419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d05cf8e0-05f7-4a26-a550-64dd060bbf5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44d40dcfb9f140c49b343d3e4331dfbe'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:38.935685 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d05cf8e0-05f7-4a26-a550-64dd060bbf5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44d40dcfb9f140c49b343d3e4331dfbe'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:38.938461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d05cf8e0-05f7-4a26-a550-64dd060bbf5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44d40dcfb9f140c49b343d3e4331dfbe'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:38.954470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d05cf8e0-05f7-4a26-a550-64dd060bbf5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44d40dcfb9f140c49b343d3e4331dfbe'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:38.961461 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2375/4796] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:10:38 2022] POST /identity/v3/groups => generated 325 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:38.964090 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6629e-5910-4b4a-afa6-f46dac835501 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:38.970103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-42f6629e-5910-4b4a-afa6-f46dac835501 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:38.999156 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2422/4797] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:38 2022] DELETE /identity/v3/users/44d40dcfb9f140c49b343d3e4331dfbe => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:39.004476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7e2c8-0cfa-4330-8020-51706d6e6aff None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:39.005060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7e2c8-0cfa-4330-8020-51706d6e6aff None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:39.005417 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7e2c8-0cfa-4330-8020-51706d6e6aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:39.008697 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6629e-5910-4b4a-afa6-f46dac835501 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:39.054978 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-74e7e2c8-0cfa-4330-8020-51706d6e6aff None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:39.058578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-74e7e2c8-0cfa-4330-8020-51706d6e6aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:39.118069 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2561f4-a00f-4c6f-94f5-1dabe750cde5 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:39.118985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2561f4-a00f-4c6f-94f5-1dabe750cde5 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:39.119603 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2561f4-a00f-4c6f-94f5-1dabe750cde5 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:39.121569 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2561f4-a00f-4c6f-94f5-1dabe750cde5 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/groups` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:39.122359 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2561f4-a00f-4c6f-94f5-1dabe750cde5 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:39.125373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2561f4-a00f-4c6f-94f5-1dabe750cde5 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:39.148098 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2376/4798] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:10:38 2022] POST /identity/v3/groups => generated 325 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:10:39.154306 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2561f4-a00f-4c6f-94f5-1dabe750cde5 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:39.171298 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2561f4-a00f-4c6f-94f5-1dabe750cde5 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:39.179354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cc44f-b137-45f6-9691-1a4e6411cd93 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:39.180717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cc44f-b137-45f6-9691-1a4e6411cd93 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:39.181254 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cc44f-b137-45f6-9691-1a4e6411cd93 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:39.181759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cc44f-b137-45f6-9691-1a4e6411cd93 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/groups` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:39.184253 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44cc44f-b137-45f6-9691-1a4e6411cd93 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:39.185574 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-f44cc44f-b137-45f6-9691-1a4e6411cd93 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:10:39.185574 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:10:39.185574 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:10:39.189147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44cc44f-b137-45f6-9691-1a4e6411cd93 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:39.200985 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2377/4799] 10.222.0.33 () {58 vars in 1125 bytes} [Sat Aug 6 21:10:39 2022] GET /identity/v3/groups => generated 1487 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:39.205401 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cc44f-b137-45f6-9691-1a4e6411cd93 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:39.221501 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cc44f-b137-45f6-9691-1a4e6411cd93 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:39.224649 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:39.237040 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c66d71-2f77-42f5-825e-83ccc0ec2c97 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:39.238311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c66d71-2f77-42f5-825e-83ccc0ec2c97 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:39.238655 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c66d71-2f77-42f5-825e-83ccc0ec2c97 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:39.238939 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c66d71-2f77-42f5-825e-83ccc0ec2c97 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/groups/a42b159290a04943b38df6a738956dda` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:39.242573 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2423/4800] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:39.250971 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c66d71-2f77-42f5-825e-83ccc0ec2c97 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:delete_group(group_id=a42b159290a04943b38df6a738956dda)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:39.253099 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c66d71-2f77-42f5-825e-83ccc0ec2c97 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:39.272915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7e2c8-0cfa-4330-8020-51706d6e6aff None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:39.279734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-74e7e2c8-0cfa-4330-8020-51706d6e6aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:39.303653 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:39.354611 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2378/4801] 10.222.0.33 () {58 vars in 1227 bytes} [Sat Aug 6 21:10:39 2022] DELETE /identity/v3/groups/a42b159290a04943b38df6a738956dda => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:39.358228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c66d71-2f77-42f5-825e-83ccc0ec2c97 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:39.446708 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7e2c8-0cfa-4330-8020-51706d6e6aff None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:39.505006 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c66d71-2f77-42f5-825e-83ccc0ec2c97 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:39.535155 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f347faa-9420-4a85-86c1-33f44dea6b9d tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:39.535994 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f347faa-9420-4a85-86c1-33f44dea6b9d tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:39.536118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f347faa-9420-4a85-86c1-33f44dea6b9d tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:39.536350 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f347faa-9420-4a85-86c1-33f44dea6b9d tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/groups/589d4ff9dc334cc49165a6043f47e4fb` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:39.557866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f347faa-9420-4a85-86c1-33f44dea6b9d tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:delete_group(group_id=589d4ff9dc334cc49165a6043f47e4fb)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:39.559930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f347faa-9420-4a85-86c1-33f44dea6b9d tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:39.588397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f59428-a7b6-4358-bfb6-0397b3631295 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:39.589039 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f59428-a7b6-4358-bfb6-0397b3631295 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:39.591335 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f59428-a7b6-4358-bfb6-0397b3631295 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:39.592331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f59428-a7b6-4358-bfb6-0397b3631295 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:39.708576 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2379/4802] 10.222.0.33 () {58 vars in 1227 bytes} [Sat Aug 6 21:10:39 2022] DELETE /identity/v3/groups/589d4ff9dc334cc49165a6043f47e4fb => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:10:39.708576 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f347faa-9420-4a85-86c1-33f44dea6b9d tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:39.831007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f59428-a7b6-4358-bfb6-0397b3631295 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:39.833782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f59428-a7b6-4358-bfb6-0397b3631295 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:39.880313 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2424/4803] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:10:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:10:39.917134 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f347faa-9420-4a85-86c1-33f44dea6b9d tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:39.928645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf6c13-4211-4e19-b4bf-802393c3143f tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:39.930053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf6c13-4211-4e19-b4bf-802393c3143f tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:39.930727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf6c13-4211-4e19-b4bf-802393c3143f tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:39.931201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf6c13-4211-4e19-b4bf-802393c3143f tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/groups/6ed18e611599479d8d3b8d0ff6abb826` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:39.951307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf6c13-4211-4e19-b4bf-802393c3143f tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:delete_group(group_id=6ed18e611599479d8d3b8d0ff6abb826)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:39.956574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf6c13-4211-4e19-b4bf-802393c3143f tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:40.036068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:DELETE=10 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:40.088529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f59428-a7b6-4358-bfb6-0397b3631295 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:40.089479 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2380/4804] 10.222.0.33 () {58 vars in 1227 bytes} [Sat Aug 6 21:10:39 2022] DELETE /identity/v3/groups/6ed18e611599479d8d3b8d0ff6abb826 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:10:40.146457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f59428-a7b6-4358-bfb6-0397b3631295 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:40.356197 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7db11a-e47c-4a92-8323-74df280e9429 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:40.357697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7db11a-e47c-4a92-8323-74df280e9429 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:40.358469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7db11a-e47c-4a92-8323-74df280e9429 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:40.358824 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7db11a-e47c-4a92-8323-74df280e9429 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:40.360515 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7db11a-e47c-4a92-8323-74df280e9429 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:40.364112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7db11a-e47c-4a92-8323-74df280e9429 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:40.380531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:40.409738 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2425/4805] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:10:40 2022] POST /identity/v3/users => generated 321 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:10:40.411422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf6c13-4211-4e19-b4bf-802393c3143f tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:40.429018 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf6c13-4211-4e19-b4bf-802393c3143f tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:40.436228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d8054-e3ef-4f20-82a6-d001e100d8a8 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:40.437122 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d8054-e3ef-4f20-82a6-d001e100d8a8 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:40.437749 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d8054-e3ef-4f20-82a6-d001e100d8a8 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:40.438339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d8054-e3ef-4f20-82a6-d001e100d8a8 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/groups` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:40.439236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d8054-e3ef-4f20-82a6-d001e100d8a8 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:40.441815 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d8054-e3ef-4f20-82a6-d001e100d8a8 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:40.466811 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2381/4806] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:10:40 2022] POST /identity/v3/groups => generated 326 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:40.467625 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7db11a-e47c-4a92-8323-74df280e9429 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:40.483221 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7db11a-e47c-4a92-8323-74df280e9429 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:40.489768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ff05b-a2f0-4fcc-bdde-f51d2032e1ea tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:40.490659 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ff05b-a2f0-4fcc-bdde-f51d2032e1ea tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:40.491075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ff05b-a2f0-4fcc-bdde-f51d2032e1ea tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:40.491485 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ff05b-a2f0-4fcc-bdde-f51d2032e1ea tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/groups/caece1e8294041ba932d607a12bee39f/users/9645f15bd63847ea8ad56d4d24b0d5fa` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:40.526755 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ff05b-a2f0-4fcc-bdde-f51d2032e1ea tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=caece1e8294041ba932d607a12bee39f, user_id=9645f15bd63847ea8ad56d4d24b0d5fa)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:40.528759 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ff05b-a2f0-4fcc-bdde-f51d2032e1ea tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:40.572590 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2426/4807] 10.222.0.33 () {60 vars in 1360 bytes} [Sat Aug 6 21:10:40 2022] PUT /identity/v3/groups/caece1e8294041ba932d607a12bee39f/users/9645f15bd63847ea8ad56d4d24b0d5fa => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:40.575387 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d8054-e3ef-4f20-82a6-d001e100d8a8 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:40.589938 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d8054-e3ef-4f20-82a6-d001e100d8a8 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:40.747099 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d328bb72-cf3c-427b-8a29-8b5316399b8f tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:40.748225 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328bb72-cf3c-427b-8a29-8b5316399b8f tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:40.748537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328bb72-cf3c-427b-8a29-8b5316399b8f tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:40.748949 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328bb72-cf3c-427b-8a29-8b5316399b8f tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/groups` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:40.750578 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d328bb72-cf3c-427b-8a29-8b5316399b8f tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:40.755046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d328bb72-cf3c-427b-8a29-8b5316399b8f tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:40.773450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ff05b-a2f0-4fcc-bdde-f51d2032e1ea tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:40.776234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f03ff05b-a2f0-4fcc-bdde-f51d2032e1ea tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:40.834342 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2382/4808] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:10:40 2022] POST /identity/v3/groups => generated 325 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:40.835306 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d328bb72-cf3c-427b-8a29-8b5316399b8f tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:40.848562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d328bb72-cf3c-427b-8a29-8b5316399b8f tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:40.934060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ff05b-a2f0-4fcc-bdde-f51d2032e1ea tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:40.941538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467a35a-5ff9-4fea-a43a-303eaeb73b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:40.942445 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467a35a-5ff9-4fea-a43a-303eaeb73b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:40.942862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467a35a-5ff9-4fea-a43a-303eaeb73b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:40.943241 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467a35a-5ff9-4fea-a43a-303eaeb73b49 admin admin] PATH_INFO: `/v3/projects/6f17b5ec61f04803a679b49407cb2dae` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:40.944779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467a35a-5ff9-4fea-a43a-303eaeb73b49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f17b5ec61f04803a679b49407cb2dae)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:40.947642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467a35a-5ff9-4fea-a43a-303eaeb73b49 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:41.059581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e467a35a-5ff9-4fea-a43a-303eaeb73b49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f17b5ec61f04803a679b49407cb2dae', 'request_id': 'req-e467a35a-5ff9-4fea-a43a-303eaeb73b49'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:41.082750 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e467a35a-5ff9-4fea-a43a-303eaeb73b49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f17b5ec61f04803a679b49407cb2dae', 'request_id': 'req-e467a35a-5ff9-4fea-a43a-303eaeb73b49'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:41.113910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e467a35a-5ff9-4fea-a43a-303eaeb73b49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f17b5ec61f04803a679b49407cb2dae', 'request_id': 'req-e467a35a-5ff9-4fea-a43a-303eaeb73b49'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:41.130388 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e467a35a-5ff9-4fea-a43a-303eaeb73b49 admin admin] The token cache is being invalidate because project 6f17b5ec61f04803a679b49407cb2dae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:41.130871 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e467a35a-5ff9-4fea-a43a-303eaeb73b49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:41.132112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e467a35a-5ff9-4fea-a43a-303eaeb73b49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:41.137271 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2427/4809] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:10:40 2022] DELETE /identity/v3/projects/6f17b5ec61f04803a679b49407cb2dae => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:10:41.138604 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467a35a-5ff9-4fea-a43a-303eaeb73b49 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:41.142701 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e467a35a-5ff9-4fea-a43a-303eaeb73b49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:41.211835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:41.243571 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467a35a-5ff9-4fea-a43a-303eaeb73b49 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:41.252920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd3cad-a9f1-4250-b05c-150cd9531140 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:41.256545 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd3cad-a9f1-4250-b05c-150cd9531140 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:41.259896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd3cad-a9f1-4250-b05c-150cd9531140 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:41.260213 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd3cad-a9f1-4250-b05c-150cd9531140 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/groups/7dee5bc0a5af4264972b13f82c860b30/users/9645f15bd63847ea8ad56d4d24b0d5fa` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:41.298783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd3cad-a9f1-4250-b05c-150cd9531140 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=7dee5bc0a5af4264972b13f82c860b30, user_id=9645f15bd63847ea8ad56d4d24b0d5fa)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:41.300865 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd3cad-a9f1-4250-b05c-150cd9531140 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:41.317748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d328bb72-cf3c-427b-8a29-8b5316399b8f tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:41.344551 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2428/4810] 10.222.0.33 () {60 vars in 1360 bytes} [Sat Aug 6 21:10:41 2022] PUT /identity/v3/groups/7dee5bc0a5af4264972b13f82c860b30/users/9645f15bd63847ea8ad56d4d24b0d5fa => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:41.348758 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd3cad-a9f1-4250-b05c-150cd9531140 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:41.368583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-becd3cad-a9f1-4250-b05c-150cd9531140 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:41.524839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12264a5c-9908-4f10-8b70-c7ccd0166d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:41.527396 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12264a5c-9908-4f10-8b70-c7ccd0166d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:41.527702 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12264a5c-9908-4f10-8b70-c7ccd0166d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:41.527973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12264a5c-9908-4f10-8b70-c7ccd0166d2d admin admin] PATH_INFO: `/v3/projects/55484d9bd01a4364b7316bd119ac8d9a` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:41.530063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12264a5c-9908-4f10-8b70-c7ccd0166d2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=55484d9bd01a4364b7316bd119ac8d9a)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:41.532754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12264a5c-9908-4f10-8b70-c7ccd0166d2d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:41.538440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd3cad-a9f1-4250-b05c-150cd9531140 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:41.545392 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc6671-1dc3-4542-aab1-4b4b93abbe95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:41.547741 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc6671-1dc3-4542-aab1-4b4b93abbe95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:41.548210 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc6671-1dc3-4542-aab1-4b4b93abbe95 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:41.548648 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc6671-1dc3-4542-aab1-4b4b93abbe95 admin admin] PATH_INFO: `/v3/users/6a651aed8c0b464dbe29546467e5294b` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:41.549995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc6671-1dc3-4542-aab1-4b4b93abbe95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a651aed8c0b464dbe29546467e5294b)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:41.552376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc6671-1dc3-4542-aab1-4b4b93abbe95 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:41.569230 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:41.640983 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-12264a5c-9908-4f10-8b70-c7ccd0166d2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55484d9bd01a4364b7316bd119ac8d9a', 'request_id': 'req-12264a5c-9908-4f10-8b70-c7ccd0166d2d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:41.655160 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-12264a5c-9908-4f10-8b70-c7ccd0166d2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55484d9bd01a4364b7316bd119ac8d9a', 'request_id': 'req-12264a5c-9908-4f10-8b70-c7ccd0166d2d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:41.658586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a8cc6671-1dc3-4542-aab1-4b4b93abbe95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a651aed8c0b464dbe29546467e5294b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:41.673050 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-12264a5c-9908-4f10-8b70-c7ccd0166d2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55484d9bd01a4364b7316bd119ac8d9a', 'request_id': 'req-12264a5c-9908-4f10-8b70-c7ccd0166d2d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:41.681220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a8cc6671-1dc3-4542-aab1-4b4b93abbe95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a651aed8c0b464dbe29546467e5294b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:41.683034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a8cc6671-1dc3-4542-aab1-4b4b93abbe95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a651aed8c0b464dbe29546467e5294b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:41.684797 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a8cc6671-1dc3-4542-aab1-4b4b93abbe95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a651aed8c0b464dbe29546467e5294b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:41.705693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a8cc6671-1dc3-4542-aab1-4b4b93abbe95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a651aed8c0b464dbe29546467e5294b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:41.708122 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-12264a5c-9908-4f10-8b70-c7ccd0166d2d admin admin] The token cache is being invalidate because project 55484d9bd01a4364b7316bd119ac8d9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:41.708411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-12264a5c-9908-4f10-8b70-c7ccd0166d2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:41.711721 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-12264a5c-9908-4f10-8b70-c7ccd0166d2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:41.717859 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2383/4811] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:10:40 2022] DELETE /identity/v3/projects/55484d9bd01a4364b7316bd119ac8d9a => generated 0 bytes in 880 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:41.722641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12264a5c-9908-4f10-8b70-c7ccd0166d2d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:41.725151 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-12264a5c-9908-4f10-8b70-c7ccd0166d2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:41.754261 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2429/4812] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:41 2022] DELETE /identity/v3/users/6a651aed8c0b464dbe29546467e5294b => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:41.757282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae6eb7-ad2c-48e3-9b3f-d4161c8e8de3 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:41.758848 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae6eb7-ad2c-48e3-9b3f-d4161c8e8de3 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:41.759126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae6eb7-ad2c-48e3-9b3f-d4161c8e8de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:41.808774 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b8ae6eb7-ad2c-48e3-9b3f-d4161c8e8de3 None None] MFA Rules not processed for user `1d7b9e27983940dcaf0e92f62273c588`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:41.814026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b8ae6eb7-ad2c-48e3-9b3f-d4161c8e8de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:41.914080 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12264a5c-9908-4f10-8b70-c7ccd0166d2d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:41.930723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:41.965393 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2430/4813] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:41.965393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae6eb7-ad2c-48e3-9b3f-d4161c8e8de3 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:41.965393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b8ae6eb7-ad2c-48e3-9b3f-d4161c8e8de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:42.059423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423d7ee-5a18-4843-a636-ef94d20af621 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:42.060094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423d7ee-5a18-4843-a636-ef94d20af621 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:42.060372 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423d7ee-5a18-4843-a636-ef94d20af621 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:42.060641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423d7ee-5a18-4843-a636-ef94d20af621 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/users/9645f15bd63847ea8ad56d4d24b0d5fa/groups` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:42.064553 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423d7ee-5a18-4843-a636-ef94d20af621 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=9645f15bd63847ea8ad56d4d24b0d5fa)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:42.069271 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423d7ee-5a18-4843-a636-ef94d20af621 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:42.090593 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2384/4814] 10.222.0.33 () {58 vars in 1242 bytes} [Sat Aug 6 21:10:41 2022] GET /identity/v3/users/9645f15bd63847ea8ad56d4d24b0d5fa/groups => generated 837 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:42.095638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423d7ee-5a18-4843-a636-ef94d20af621 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:42.106135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae6eb7-ad2c-48e3-9b3f-d4161c8e8de3 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:42.113903 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51936d-7793-4a9b-b83d-3b41502093a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:42.114888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51936d-7793-4a9b-b83d-3b41502093a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:42.115323 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423d7ee-5a18-4843-a636-ef94d20af621 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:42.116835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51936d-7793-4a9b-b83d-3b41502093a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:42.119135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51936d-7793-4a9b-b83d-3b41502093a3 admin admin] PATH_INFO: `/v3/users/21e71accb39c433ebb96fed270123418` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:42.123629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce51936d-7793-4a9b-b83d-3b41502093a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21e71accb39c433ebb96fed270123418)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:42.123775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cb04f-c28d-4e47-acc1-fc3e4f1cbaa4 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:42.124500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cb04f-c28d-4e47-acc1-fc3e4f1cbaa4 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:42.125036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cb04f-c28d-4e47-acc1-fc3e4f1cbaa4 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:42.125338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce51936d-7793-4a9b-b83d-3b41502093a3 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:42.125632 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cb04f-c28d-4e47-acc1-fc3e4f1cbaa4 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/groups/7dee5bc0a5af4264972b13f82c860b30` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:42.127088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cb04f-c28d-4e47-acc1-fc3e4f1cbaa4 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:delete_group(group_id=7dee5bc0a5af4264972b13f82c860b30)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:42.139166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cb04f-c28d-4e47-acc1-fc3e4f1cbaa4 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:42.213480 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:42.236435 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2385/4815] 10.222.0.33 () {58 vars in 1227 bytes} [Sat Aug 6 21:10:42 2022] DELETE /identity/v3/groups/7dee5bc0a5af4264972b13f82c860b30 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:42.238110 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cb04f-c28d-4e47-acc1-fc3e4f1cbaa4 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:42.254582 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ce51936d-7793-4a9b-b83d-3b41502093a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21e71accb39c433ebb96fed270123418'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:42.270896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ce51936d-7793-4a9b-b83d-3b41502093a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21e71accb39c433ebb96fed270123418'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:42.272228 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ce51936d-7793-4a9b-b83d-3b41502093a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21e71accb39c433ebb96fed270123418'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:42.272881 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ce51936d-7793-4a9b-b83d-3b41502093a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21e71accb39c433ebb96fed270123418'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:42.283394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ce51936d-7793-4a9b-b83d-3b41502093a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21e71accb39c433ebb96fed270123418'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:42.323916 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2431/4816] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:41 2022] DELETE /identity/v3/users/21e71accb39c433ebb96fed270123418 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:42.384817 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cb04f-c28d-4e47-acc1-fc3e4f1cbaa4 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:42.475058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b4120-18da-43be-b16c-f9766d17ec6e tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:42.476054 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b4120-18da-43be-b16c-f9766d17ec6e tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:42.477682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b4120-18da-43be-b16c-f9766d17ec6e tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:42.478566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b4120-18da-43be-b16c-f9766d17ec6e tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/groups/caece1e8294041ba932d607a12bee39f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:42.481416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b4120-18da-43be-b16c-f9766d17ec6e tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:delete_group(group_id=caece1e8294041ba932d607a12bee39f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:42.489254 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b4120-18da-43be-b16c-f9766d17ec6e tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:42.514499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51936d-7793-4a9b-b83d-3b41502093a3 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:42.517454 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ce51936d-7793-4a9b-b83d-3b41502093a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:42.570665 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2386/4817] 10.222.0.33 () {58 vars in 1227 bytes} [Sat Aug 6 21:10:42 2022] DELETE /identity/v3/groups/caece1e8294041ba932d607a12bee39f => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:42.575780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b4120-18da-43be-b16c-f9766d17ec6e tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:42.580377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-eb6b4120-18da-43be-b16c-f9766d17ec6e tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:42.631827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51936d-7793-4a9b-b83d-3b41502093a3 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:42.655444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:42.702125 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b4120-18da-43be-b16c-f9766d17ec6e tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:42.708779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23a6a5-1f9a-4483-b8a1-890060d3f3d3 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:42.709914 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23a6a5-1f9a-4483-b8a1-890060d3f3d3 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:42.710890 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23a6a5-1f9a-4483-b8a1-890060d3f3d3 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:42.710890 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23a6a5-1f9a-4483-b8a1-890060d3f3d3 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/users/9645f15bd63847ea8ad56d4d24b0d5fa` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:42.711809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23a6a5-1f9a-4483-b8a1-890060d3f3d3 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9645f15bd63847ea8ad56d4d24b0d5fa)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:42.714195 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23a6a5-1f9a-4483-b8a1-890060d3f3d3 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:42.726497 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:42.754880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf17ebd-4128-4e25-b24a-2a7eb1b5f6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:42.755549 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf17ebd-4128-4e25-b24a-2a7eb1b5f6d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:42.755855 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf17ebd-4128-4e25-b24a-2a7eb1b5f6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:42.756090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf17ebd-4128-4e25-b24a-2a7eb1b5f6d5 admin admin] PATH_INFO: `/v3/projects/6f03bc1de7174fe1afac7baace1fc7ec` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:42.759363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf17ebd-4128-4e25-b24a-2a7eb1b5f6d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f03bc1de7174fe1afac7baace1fc7ec)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:42.762626 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf17ebd-4128-4e25-b24a-2a7eb1b5f6d5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:42.800605 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1a23a6a5-1f9a-4483-b8a1-890060d3f3d3 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9645f15bd63847ea8ad56d4d24b0d5fa'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:42.802026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1a23a6a5-1f9a-4483-b8a1-890060d3f3d3 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9645f15bd63847ea8ad56d4d24b0d5fa'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:42.802762 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1a23a6a5-1f9a-4483-b8a1-890060d3f3d3 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9645f15bd63847ea8ad56d4d24b0d5fa'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:42.816103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1a23a6a5-1f9a-4483-b8a1-890060d3f3d3 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9645f15bd63847ea8ad56d4d24b0d5fa'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:42.833177 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1a23a6a5-1f9a-4483-b8a1-890060d3f3d3 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9645f15bd63847ea8ad56d4d24b0d5fa'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:42.841654 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4bf17ebd-4128-4e25-b24a-2a7eb1b5f6d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f03bc1de7174fe1afac7baace1fc7ec', 'request_id': 'req-4bf17ebd-4128-4e25-b24a-2a7eb1b5f6d5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:42.851804 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4bf17ebd-4128-4e25-b24a-2a7eb1b5f6d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f03bc1de7174fe1afac7baace1fc7ec', 'request_id': 'req-4bf17ebd-4128-4e25-b24a-2a7eb1b5f6d5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:42.854871 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2387/4818] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:42 2022] DELETE /identity/v3/users/9645f15bd63847ea8ad56d4d24b0d5fa => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:42.855851 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23a6a5-1f9a-4483-b8a1-890060d3f3d3 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:42.858009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1a23a6a5-1f9a-4483-b8a1-890060d3f3d3 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:42.862034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4bf17ebd-4128-4e25-b24a-2a7eb1b5f6d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f03bc1de7174fe1afac7baace1fc7ec', 'request_id': 'req-4bf17ebd-4128-4e25-b24a-2a7eb1b5f6d5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:42.876993 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4bf17ebd-4128-4e25-b24a-2a7eb1b5f6d5 admin admin] The token cache is being invalidate because project 6f03bc1de7174fe1afac7baace1fc7ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:42.877543 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4bf17ebd-4128-4e25-b24a-2a7eb1b5f6d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:42.878293 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4bf17ebd-4128-4e25-b24a-2a7eb1b5f6d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:42.884334 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2432/4819] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:10:42 2022] DELETE /identity/v3/projects/6f03bc1de7174fe1afac7baace1fc7ec => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:10:42.885857 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16be1c-4441-4241-af9c-b21fbda9b227 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:42.886086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16be1c-4441-4241-af9c-b21fbda9b227 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:42.886367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16be1c-4441-4241-af9c-b21fbda9b227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:42.935730 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-5c16be1c-4441-4241-af9c-b21fbda9b227 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:42.938465 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5c16be1c-4441-4241-af9c-b21fbda9b227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:43.012109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23a6a5-1f9a-4483-b8a1-890060d3f3d3 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:43.019460 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e38ab-3166-45e1-942f-e28717b3ffd0 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:43.020634 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e38ab-3166-45e1-942f-e28717b3ffd0 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:43.021021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e38ab-3166-45e1-942f-e28717b3ffd0 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:43.021894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e38ab-3166-45e1-942f-e28717b3ffd0 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/domains/569ca8566c454eb2a93c239caaa3dbf9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:43.022941 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e38ab-3166-45e1-942f-e28717b3ffd0 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=569ca8566c454eb2a93c239caaa3dbf9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:43.025264 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e38ab-3166-45e1-942f-e28717b3ffd0 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:43.037447 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2433/4820] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:43.039361 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac130d7-d114-4c3d-8a84-e9cade920e08 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:43.039791 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac130d7-d114-4c3d-8a84-e9cade920e08 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:43.040190 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac130d7-d114-4c3d-8a84-e9cade920e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:43.055319 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a95e38ab-3166-45e1-942f-e28717b3ffd0 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '569ca8566c454eb2a93c239caaa3dbf9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:43.057035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a95e38ab-3166-45e1-942f-e28717b3ffd0 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '569ca8566c454eb2a93c239caaa3dbf9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:43.072862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-7ac130d7-d114-4c3d-8a84-e9cade920e08 None None] MFA Rules not processed for user `17004e771b6a47cb88e8aa31e197b25a`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:43.074511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7ac130d7-d114-4c3d-8a84-e9cade920e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:43.104353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a95e38ab-3166-45e1-942f-e28717b3ffd0 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '569ca8566c454eb2a93c239caaa3dbf9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:43.105111 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a95e38ab-3166-45e1-942f-e28717b3ffd0 tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '569ca8566c454eb2a93c239caaa3dbf9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:43.114376 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2388/4821] 10.222.0.33 () {60 vars in 1249 bytes} [Sat Aug 6 21:10:42 2022] PATCH /identity/v3/domains/569ca8566c454eb2a93c239caaa3dbf9 => generated 278 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:43.116559 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152278b-ecd2-45b8-968d-de2d6f231bed None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:43.117217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152278b-ecd2-45b8-968d-de2d6f231bed None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:43.117676 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152278b-ecd2-45b8-968d-de2d6f231bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:43.152430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-e152278b-ecd2-45b8-968d-de2d6f231bed None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:43.154233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e152278b-ecd2-45b8-968d-de2d6f231bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:43.155433 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:43.200484 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2434/4822] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:43.201502 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac130d7-d114-4c3d-8a84-e9cade920e08 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:43.208420 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7ac130d7-d114-4c3d-8a84-e9cade920e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:43.266612 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:43.309090 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2389/4823] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:43.314692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152278b-ecd2-45b8-968d-de2d6f231bed None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:43.332853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152278b-ecd2-45b8-968d-de2d6f231bed None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:43.340471 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64416b56-cfa9-4b62-8b54-504370a96d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:43.341337 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64416b56-cfa9-4b62-8b54-504370a96d0b admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:43.341929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64416b56-cfa9-4b62-8b54-504370a96d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:43.342488 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64416b56-cfa9-4b62-8b54-504370a96d0b admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:43.344020 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64416b56-cfa9-4b62-8b54-504370a96d0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:10:43.344745 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64416b56-cfa9-4b62-8b54-504370a96d0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:43.347240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64416b56-cfa9-4b62-8b54-504370a96d0b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:43.352751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac130d7-d114-4c3d-8a84-e9cade920e08 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:43.362424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef011330-1162-4a89-86bf-5e695c1589cd tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29dcf5fe4a7e4028a0f3a37c3a2012c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea8c7d7d44da4921870b3c3deeb668e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:43.363467 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef011330-1162-4a89-86bf-5e695c1589cd tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:43.363753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef011330-1162-4a89-86bf-5e695c1589cd tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:43.364166 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef011330-1162-4a89-86bf-5e695c1589cd tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] PATH_INFO: `/v3/domains/569ca8566c454eb2a93c239caaa3dbf9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:43.369786 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2390/4824] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:43.370957 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64416b56-cfa9-4b62-8b54-504370a96d0b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:43.372703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-64416b56-cfa9-4b62-8b54-504370a96d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:43.387315 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64416b56-cfa9-4b62-8b54-504370a96d0b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:43.398999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef011330-1162-4a89-86bf-5e695c1589cd tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=569ca8566c454eb2a93c239caaa3dbf9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:43.401426 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef011330-1162-4a89-86bf-5e695c1589cd tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:43.422718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3df0e6-4788-4ea1-9c38-7e4944d895cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:43.423415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3df0e6-4788-4ea1-9c38-7e4944d895cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:43.423649 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3df0e6-4788-4ea1-9c38-7e4944d895cc admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:43.423981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3df0e6-4788-4ea1-9c38-7e4944d895cc admin admin] PATH_INFO: `/v3/projects/2a913c1e3497464a81dc38c992c571dd` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:43.426599 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3df0e6-4788-4ea1-9c38-7e4944d895cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a913c1e3497464a81dc38c992c571dd)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:43.432622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3df0e6-4788-4ea1-9c38-7e4944d895cc admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:43.490711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ef011330-1162-4a89-86bf-5e695c1589cd tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '569ca8566c454eb2a93c239caaa3dbf9'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:43.490711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ef011330-1162-4a89-86bf-5e695c1589cd tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '569ca8566c454eb2a93c239caaa3dbf9'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:43.524936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dc3df0e6-4788-4ea1-9c38-7e4944d895cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a913c1e3497464a81dc38c992c571dd', 'request_id': 'req-dc3df0e6-4788-4ea1-9c38-7e4944d895cc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:43.534368 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dc3df0e6-4788-4ea1-9c38-7e4944d895cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a913c1e3497464a81dc38c992c571dd', 'request_id': 'req-dc3df0e6-4788-4ea1-9c38-7e4944d895cc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:43.555157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dc3df0e6-4788-4ea1-9c38-7e4944d895cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a913c1e3497464a81dc38c992c571dd', 'request_id': 'req-dc3df0e6-4788-4ea1-9c38-7e4944d895cc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:43.577201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dc3df0e6-4788-4ea1-9c38-7e4944d895cc admin admin] The token cache is being invalidate because project 2a913c1e3497464a81dc38c992c571dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:43.578247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dc3df0e6-4788-4ea1-9c38-7e4944d895cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:43.578927 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dc3df0e6-4788-4ea1-9c38-7e4944d895cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:43.582845 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2391/4825] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:10:43 2022] DELETE /identity/v3/projects/2a913c1e3497464a81dc38c992c571dd => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:43.584540 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3df0e6-4788-4ea1-9c38-7e4944d895cc admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:43.586411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-dc3df0e6-4788-4ea1-9c38-7e4944d895cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:43.591074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ef011330-1162-4a89-86bf-5e695c1589cd tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '569ca8566c454eb2a93c239caaa3dbf9', 'request_id': 'req-ef011330-1162-4a89-86bf-5e695c1589cd'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:43.612126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ef011330-1162-4a89-86bf-5e695c1589cd tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '569ca8566c454eb2a93c239caaa3dbf9', 'request_id': 'req-ef011330-1162-4a89-86bf-5e695c1589cd'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:43.644645 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ef011330-1162-4a89-86bf-5e695c1589cd tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '569ca8566c454eb2a93c239caaa3dbf9', 'request_id': 'req-ef011330-1162-4a89-86bf-5e695c1589cd'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:43.678486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ef011330-1162-4a89-86bf-5e695c1589cd tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] The token cache is being invalidate because project 569ca8566c454eb2a93c239caaa3dbf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:43.679206 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ef011330-1162-4a89-86bf-5e695c1589cd tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:43.681036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ef011330-1162-4a89-86bf-5e695c1589cd tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:43.700364 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ef011330-1162-4a89-86bf-5e695c1589cd tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '569ca8566c454eb2a93c239caaa3dbf9', 'request_id': 'req-ef011330-1162-4a89-86bf-5e695c1589cd'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:43.707782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ef011330-1162-4a89-86bf-5e695c1589cd tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '569ca8566c454eb2a93c239caaa3dbf9', 'request_id': 'req-ef011330-1162-4a89-86bf-5e695c1589cd'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:43.708981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ef011330-1162-4a89-86bf-5e695c1589cd tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '569ca8566c454eb2a93c239caaa3dbf9', 'request_id': 'req-ef011330-1162-4a89-86bf-5e695c1589cd'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:43.715901 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3df0e6-4788-4ea1-9c38-7e4944d895cc admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:43.726806 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2435/4826] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:10:43 2022] DELETE /identity/v3/domains/569ca8566c454eb2a93c239caaa3dbf9 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:43.727692 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef011330-1162-4a89-86bf-5e695c1589cd tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:43.733414 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ef011330-1162-4a89-86bf-5e695c1589cd tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:43.820089 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:43.842931 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a6fc9-1f28-409a-818e-8a0ccdede42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:43.843754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a6fc9-1f28-409a-818e-8a0ccdede42c admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:43.844126 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a6fc9-1f28-409a-818e-8a0ccdede42c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:43.844403 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a6fc9-1f28-409a-818e-8a0ccdede42c admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:43.845036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4a6fc9-1f28-409a-818e-8a0ccdede42c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:43.847015 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4a6fc9-1f28-409a-818e-8a0ccdede42c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:43.864579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:43.882487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef011330-1162-4a89-86bf-5e695c1589cd tempest-GroupsV3TestJSON-1690380921 tempest-GroupsV3TestJSON-1690380921-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:43.886741 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2392/4827] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:10:43 2022] POST /identity/v3/projects => generated 369 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:43.887634 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a6fc9-1f28-409a-818e-8a0ccdede42c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:43.890985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574dc97e-5e4b-4edc-ae0b-bfbed50fb7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:43.892031 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574dc97e-5e4b-4edc-ae0b-bfbed50fb7e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:43.892488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574dc97e-5e4b-4edc-ae0b-bfbed50fb7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:43.892948 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574dc97e-5e4b-4edc-ae0b-bfbed50fb7e1 admin admin] PATH_INFO: `/v3/users/a35e42d2429944cda1761a21b9da9a03` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:43.894491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574dc97e-5e4b-4edc-ae0b-bfbed50fb7e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a35e42d2429944cda1761a21b9da9a03)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:43.896927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574dc97e-5e4b-4edc-ae0b-bfbed50fb7e1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:43.899461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-db4a6fc9-1f28-409a-818e-8a0ccdede42c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:44.007795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-574dc97e-5e4b-4edc-ae0b-bfbed50fb7e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a35e42d2429944cda1761a21b9da9a03'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:44.019122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-574dc97e-5e4b-4edc-ae0b-bfbed50fb7e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a35e42d2429944cda1761a21b9da9a03'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:44.020009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-574dc97e-5e4b-4edc-ae0b-bfbed50fb7e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a35e42d2429944cda1761a21b9da9a03'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:44.020748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-574dc97e-5e4b-4edc-ae0b-bfbed50fb7e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a35e42d2429944cda1761a21b9da9a03'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:44.031761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-574dc97e-5e4b-4edc-ae0b-bfbed50fb7e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a35e42d2429944cda1761a21b9da9a03'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:44.037884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a6fc9-1f28-409a-818e-8a0ccdede42c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:44.047445 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65009976-2ce2-481a-8f65-7abcdab15c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:44.048546 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65009976-2ce2-481a-8f65-7abcdab15c8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:44.048832 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65009976-2ce2-481a-8f65-7abcdab15c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:44.049246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65009976-2ce2-481a-8f65-7abcdab15c8b admin admin] PATH_INFO: `/v3/users/0d64dc8b24774c62b80fd19e143786a6` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:44.051193 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65009976-2ce2-481a-8f65-7abcdab15c8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d64dc8b24774c62b80fd19e143786a6)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:44.054364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65009976-2ce2-481a-8f65-7abcdab15c8b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:44.063759 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2436/4828] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:43 2022] DELETE /identity/v3/users/a35e42d2429944cda1761a21b9da9a03 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:44.064880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574dc97e-5e4b-4edc-ae0b-bfbed50fb7e1 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:44.066934 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-574dc97e-5e4b-4edc-ae0b-bfbed50fb7e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:44.157607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-65009976-2ce2-481a-8f65-7abcdab15c8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d64dc8b24774c62b80fd19e143786a6'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:44.158310 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-65009976-2ce2-481a-8f65-7abcdab15c8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d64dc8b24774c62b80fd19e143786a6'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:44.160692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-65009976-2ce2-481a-8f65-7abcdab15c8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d64dc8b24774c62b80fd19e143786a6'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:44.164533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574dc97e-5e4b-4edc-ae0b-bfbed50fb7e1 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:44.170442 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c836484-3ae5-41f8-abc4-94b0b25fff59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:44.172361 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c836484-3ae5-41f8-abc4-94b0b25fff59 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:44.172361 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c836484-3ae5-41f8-abc4-94b0b25fff59 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:44.172361 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c836484-3ae5-41f8-abc4-94b0b25fff59 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:44.173143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c836484-3ae5-41f8-abc4-94b0b25fff59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:44.174865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-65009976-2ce2-481a-8f65-7abcdab15c8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d64dc8b24774c62b80fd19e143786a6'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:44.175742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c836484-3ae5-41f8-abc4-94b0b25fff59 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:44.198968 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-65009976-2ce2-481a-8f65-7abcdab15c8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d64dc8b24774c62b80fd19e143786a6'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:44.203907 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2437/4829] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:10:44 2022] POST /identity/v3/users => generated 285 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:44.215585 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c836484-3ae5-41f8-abc4-94b0b25fff59 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:44.223232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9c836484-3ae5-41f8-abc4-94b0b25fff59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:44.243215 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2393/4830] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:43 2022] DELETE /identity/v3/users/0d64dc8b24774c62b80fd19e143786a6 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:44.247929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5e24f-9988-4430-8ecd-d1d92f802fae None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:44.248335 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5e24f-9988-4430-8ecd-d1d92f802fae None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:44.248683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5e24f-9988-4430-8ecd-d1d92f802fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:44.249914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c836484-3ae5-41f8-abc4-94b0b25fff59 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:44.284991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-23d5e24f-9988-4430-8ecd-d1d92f802fae None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:44.286522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-23d5e24f-9988-4430-8ecd-d1d92f802fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:44.332158 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:44.375964 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2394/4831] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:44.387289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5e24f-9988-4430-8ecd-d1d92f802fae None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:44.387604 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9cd5a-0d9c-4379-8ac0-3a7ce5fb3c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:44.388251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9cd5a-0d9c-4379-8ac0-3a7ce5fb3c6d admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:44.388584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9cd5a-0d9c-4379-8ac0-3a7ce5fb3c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:44.388865 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9cd5a-0d9c-4379-8ac0-3a7ce5fb3c6d admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:44.389523 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9cd5a-0d9c-4379-8ac0-3a7ce5fb3c6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:44.390454 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-23d5e24f-9988-4430-8ecd-d1d92f802fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:44.395487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9cd5a-0d9c-4379-8ac0-3a7ce5fb3c6d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:44.408890 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:44.421448 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2438/4832] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:44.422535 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9cd5a-0d9c-4379-8ac0-3a7ce5fb3c6d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:44.435009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9cd5a-0d9c-4379-8ac0-3a7ce5fb3c6d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:44.445346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a0ab5-7b99-4f16-8bc2-0f545332e271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:44.445970 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a0ab5-7b99-4f16-8bc2-0f545332e271 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:44.446249 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a0ab5-7b99-4f16-8bc2-0f545332e271 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:44.446522 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a0ab5-7b99-4f16-8bc2-0f545332e271 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:44.447713 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a0ab5-7b99-4f16-8bc2-0f545332e271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:44.450293 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a0ab5-7b99-4f16-8bc2-0f545332e271 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:44.465597 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2439/4833] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:44.470021 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a0ab5-7b99-4f16-8bc2-0f545332e271 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:44.481329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a0ab5-7b99-4f16-8bc2-0f545332e271 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:44.490081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3bf17e-9013-4043-ba3c-a354e8c30697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:44.491525 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bf17e-9013-4043-ba3c-a354e8c30697 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:44.491824 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bf17e-9013-4043-ba3c-a354e8c30697 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:44.492096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bf17e-9013-4043-ba3c-a354e8c30697 admin admin] PATH_INFO: `/v3/projects/28dcec975cfc435cbd4e776c59faaf9e/users/35fc318b696c45a986823df52c1997a4/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:44.513395 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5e24f-9988-4430-8ecd-d1d92f802fae None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:44.521354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549acd87-c551-4f06-8db9-d772b5ab021a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:44.521986 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549acd87-c551-4f06-8db9-d772b5ab021a service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:44.522259 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549acd87-c551-4f06-8db9-d772b5ab021a service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:44.522531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549acd87-c551-4f06-8db9-d772b5ab021a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:44.525992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3bf17e-9013-4043-ba3c-a354e8c30697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28dcec975cfc435cbd4e776c59faaf9e, user_id=35fc318b696c45a986823df52c1997a4, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:44.528697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3bf17e-9013-4043-ba3c-a354e8c30697 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:44.547606 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549acd87-c551-4f06-8db9-d772b5ab021a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:44.549072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549acd87-c551-4f06-8db9-d772b5ab021a service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:44.557188 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2440/4834] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:10:44 2022] PUT /identity/v3/projects/28dcec975cfc435cbd4e776c59faaf9e/users/35fc318b696c45a986823df52c1997a4/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:44.568645 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abde22-74bf-4efb-82fa-aa87d6c7a8ed None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:44.568995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abde22-74bf-4efb-82fa-aa87d6c7a8ed None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:44.569351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abde22-74bf-4efb-82fa-aa87d6c7a8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:44.570414 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2395/4835] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:10:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:10:44.646691 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-33abde22-74bf-4efb-82fa-aa87d6c7a8ed None None] MFA Rules not processed for user `35fc318b696c45a986823df52c1997a4`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:44.647932 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-33abde22-74bf-4efb-82fa-aa87d6c7a8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:44.798410 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2441/4836] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:10:44.802683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549acd87-c551-4f06-8db9-d772b5ab021a service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:44.837712 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549acd87-c551-4f06-8db9-d772b5ab021a service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:45.015575 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94f0e0-9e3a-4547-acd8-30acff8be826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:45.015841 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94f0e0-9e3a-4547-acd8-30acff8be826 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:45.016194 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94f0e0-9e3a-4547-acd8-30acff8be826 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:45.016772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94f0e0-9e3a-4547-acd8-30acff8be826 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:45.018790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e94f0e0-9e3a-4547-acd8-30acff8be826 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:45.024479 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e94f0e0-9e3a-4547-acd8-30acff8be826 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:45.098637 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2396/4837] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:10:44 2022] POST /identity/v3/projects => generated 369 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:45.099894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abde22-74bf-4efb-82fa-aa87d6c7a8ed None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:45.121899 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abde22-74bf-4efb-82fa-aa87d6c7a8ed None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:45.244530 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7c7e2-2425-4305-9c66-f845307ec0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:45.245215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7c7e2-2425-4305-9c66-f845307ec0f8 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:45.245535 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7c7e2-2425-4305-9c66-f845307ec0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:45.245864 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7c7e2-2425-4305-9c66-f845307ec0f8 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:45.246727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c7c7e2-2425-4305-9c66-f845307ec0f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:45.249761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c7c7e2-2425-4305-9c66-f845307ec0f8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:45.315264 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2442/4838] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:10:45 2022] POST /identity/v3/users => generated 291 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:45.316426 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94f0e0-9e3a-4547-acd8-30acff8be826 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:45.331914 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94f0e0-9e3a-4547-acd8-30acff8be826 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:45.351021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91218f-aa36-43d4-94e2-cad8ef4d1681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:45.352485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91218f-aa36-43d4-94e2-cad8ef4d1681 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:45.352780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91218f-aa36-43d4-94e2-cad8ef4d1681 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:45.354144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91218f-aa36-43d4-94e2-cad8ef4d1681 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:45.356826 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d91218f-aa36-43d4-94e2-cad8ef4d1681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:45.359738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d91218f-aa36-43d4-94e2-cad8ef4d1681 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:45.385059 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2397/4839] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:45.386947 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7c7e2-2425-4305-9c66-f845307ec0f8 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:45.421312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7c7e2-2425-4305-9c66-f845307ec0f8 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:45.435235 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1be156-1502-461d-90d0-ed0d226d9064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:45.436468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1be156-1502-461d-90d0-ed0d226d9064 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:45.437607 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1be156-1502-461d-90d0-ed0d226d9064 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:45.438162 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1be156-1502-461d-90d0-ed0d226d9064 admin admin] PATH_INFO: `/v3/projects/a56c49c64bfb4772ac49de67b52412ef/users/496ef01e6d6d4e45aa3889887ae7f380/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:45.462564 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91218f-aa36-43d4-94e2-cad8ef4d1681 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:45.464476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1d91218f-aa36-43d4-94e2-cad8ef4d1681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:45.479347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1be156-1502-461d-90d0-ed0d226d9064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a56c49c64bfb4772ac49de67b52412ef, user_id=496ef01e6d6d4e45aa3889887ae7f380, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:45.482725 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1be156-1502-461d-90d0-ed0d226d9064 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:45.487643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:45.491984 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91218f-aa36-43d4-94e2-cad8ef4d1681 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:45.509995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d1ce6-06d1-4a0e-a85f-c43e02f9f878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:45.511565 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2443/4840] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:10:45 2022] PUT /identity/v3/projects/a56c49c64bfb4772ac49de67b52412ef/users/496ef01e6d6d4e45aa3889887ae7f380/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:45.511836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d1ce6-06d1-4a0e-a85f-c43e02f9f878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:45.512482 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1be156-1502-461d-90d0-ed0d226d9064 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:45.514240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d1ce6-06d1-4a0e-a85f-c43e02f9f878 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:45.514240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d1ce6-06d1-4a0e-a85f-c43e02f9f878 admin admin] PATH_INFO: `/v3/projects/bb48a1f177b04571912a36e282b48f40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:45.519114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d1ce6-06d1-4a0e-a85f-c43e02f9f878 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb48a1f177b04571912a36e282b48f40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:45.524516 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d1ce6-06d1-4a0e-a85f-c43e02f9f878 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:45.634062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1be156-1502-461d-90d0-ed0d226d9064 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:45.657593 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-374d1ce6-06d1-4a0e-a85f-c43e02f9f878 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb48a1f177b04571912a36e282b48f40', 'request_id': 'req-374d1ce6-06d1-4a0e-a85f-c43e02f9f878'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:45.672611 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-374d1ce6-06d1-4a0e-a85f-c43e02f9f878 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb48a1f177b04571912a36e282b48f40', 'request_id': 'req-374d1ce6-06d1-4a0e-a85f-c43e02f9f878'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:45.690954 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-374d1ce6-06d1-4a0e-a85f-c43e02f9f878 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb48a1f177b04571912a36e282b48f40', 'request_id': 'req-374d1ce6-06d1-4a0e-a85f-c43e02f9f878'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:45.716144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-374d1ce6-06d1-4a0e-a85f-c43e02f9f878 admin admin] The token cache is being invalidate because project bb48a1f177b04571912a36e282b48f40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:45.716485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-374d1ce6-06d1-4a0e-a85f-c43e02f9f878 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:45.731308 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-374d1ce6-06d1-4a0e-a85f-c43e02f9f878 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:45.737446 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2398/4841] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:10:45 2022] DELETE /identity/v3/projects/bb48a1f177b04571912a36e282b48f40 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:45.739863 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d1ce6-06d1-4a0e-a85f-c43e02f9f878 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:45.741460 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-374d1ce6-06d1-4a0e-a85f-c43e02f9f878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:45.760621 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:45.777232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8e821-42fd-4b74-b259-ea43b5794a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:45.779085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8e821-42fd-4b74-b259-ea43b5794a6c admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:45.779517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8e821-42fd-4b74-b259-ea43b5794a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:45.780272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8e821-42fd-4b74-b259-ea43b5794a6c admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:45.781293 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf8e821-42fd-4b74-b259-ea43b5794a6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:45.783305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf8e821-42fd-4b74-b259-ea43b5794a6c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:45.797034 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2444/4842] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:45.801439 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8e821-42fd-4b74-b259-ea43b5794a6c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:45.807493 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-faf8e821-42fd-4b74-b259-ea43b5794a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:45.841251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8e821-42fd-4b74-b259-ea43b5794a6c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:45.854529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f92b4e-97d2-4da8-91c9-415427ffa00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:45.855471 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f92b4e-97d2-4da8-91c9-415427ffa00f admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:45.855768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f92b4e-97d2-4da8-91c9-415427ffa00f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:45.856041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f92b4e-97d2-4da8-91c9-415427ffa00f admin admin] PATH_INFO: `/v3/projects/a56c49c64bfb4772ac49de67b52412ef/users/496ef01e6d6d4e45aa3889887ae7f380/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:45.860108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f92b4e-97d2-4da8-91c9-415427ffa00f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a56c49c64bfb4772ac49de67b52412ef, user_id=496ef01e6d6d4e45aa3889887ae7f380, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:45.862097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d1ce6-06d1-4a0e-a85f-c43e02f9f878 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:45.866584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f92b4e-97d2-4da8-91c9-415427ffa00f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:45.878206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2e92e-213b-43cc-857e-c11cc61f22a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:45.879933 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2e92e-213b-43cc-857e-c11cc61f22a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:45.881218 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2e92e-213b-43cc-857e-c11cc61f22a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:45.881538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2e92e-213b-43cc-857e-c11cc61f22a4 admin admin] PATH_INFO: `/v3/users/29dcf5fe4a7e4028a0f3a37c3a2012c5` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:45.884951 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2e92e-213b-43cc-857e-c11cc61f22a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29dcf5fe4a7e4028a0f3a37c3a2012c5)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:45.887568 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2445/4843] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:10:45 2022] PUT /identity/v3/projects/a56c49c64bfb4772ac49de67b52412ef/users/496ef01e6d6d4e45aa3889887ae7f380/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:45.894660 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2e92e-213b-43cc-857e-c11cc61f22a4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:45.900539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21040b-770d-48b8-b907-242edd56d4c2 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:45.901032 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21040b-770d-48b8-b907-242edd56d4c2 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:45.901572 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21040b-770d-48b8-b907-242edd56d4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:45.941098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-3d21040b-770d-48b8-b907-242edd56d4c2 None None] MFA Rules not processed for user `496ef01e6d6d4e45aa3889887ae7f380`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:45.942494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3d21040b-770d-48b8-b907-242edd56d4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:45.987069 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d4f2e92e-213b-43cc-857e-c11cc61f22a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29dcf5fe4a7e4028a0f3a37c3a2012c5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:45.988160 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d4f2e92e-213b-43cc-857e-c11cc61f22a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29dcf5fe4a7e4028a0f3a37c3a2012c5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:45.989038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d4f2e92e-213b-43cc-857e-c11cc61f22a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29dcf5fe4a7e4028a0f3a37c3a2012c5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:46.003923 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d4f2e92e-213b-43cc-857e-c11cc61f22a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29dcf5fe4a7e4028a0f3a37c3a2012c5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:46.028592 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d4f2e92e-213b-43cc-857e-c11cc61f22a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29dcf5fe4a7e4028a0f3a37c3a2012c5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:46.107446 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2446/4844] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:46.109244 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21040b-770d-48b8-b907-242edd56d4c2 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:46.111670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3d21040b-770d-48b8-b907-242edd56d4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:46.122237 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2399/4845] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:45 2022] DELETE /identity/v3/users/29dcf5fe4a7e4028a0f3a37c3a2012c5 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:46.127464 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2e92e-213b-43cc-857e-c11cc61f22a4 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:46.153858 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:46.255016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2e92e-213b-43cc-857e-c11cc61f22a4 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:46.264907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21040b-770d-48b8-b907-242edd56d4c2 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:46.270978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64427d5b-c5b7-4286-aad9-90ee021548e3 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:46.271549 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64427d5b-c5b7-4286-aad9-90ee021548e3 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:46.271908 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64427d5b-c5b7-4286-aad9-90ee021548e3 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:46.272315 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64427d5b-c5b7-4286-aad9-90ee021548e3 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:46.273020 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64427d5b-c5b7-4286-aad9-90ee021548e3 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:46.276323 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64427d5b-c5b7-4286-aad9-90ee021548e3 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:46.342501 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2400/4846] 10.222.0.33 () {60 vars in 1152 bytes} [Sat Aug 6 21:10:46 2022] POST /identity/v3/projects => generated 328 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:46.345202 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64427d5b-c5b7-4286-aad9-90ee021548e3 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:46.385708 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:46.422840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f976855-31a6-445c-bd70-0bebc6ba36b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:46.423516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f976855-31a6-445c-bd70-0bebc6ba36b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:46.423889 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f976855-31a6-445c-bd70-0bebc6ba36b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:46.424160 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f976855-31a6-445c-bd70-0bebc6ba36b6 admin admin] PATH_INFO: `/v3/projects/211f9a50cfe24ad1bbaf526a1366ddec` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:46.426199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f976855-31a6-445c-bd70-0bebc6ba36b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=211f9a50cfe24ad1bbaf526a1366ddec)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:46.428393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f976855-31a6-445c-bd70-0bebc6ba36b6 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:46.517299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64427d5b-c5b7-4286-aad9-90ee021548e3 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:46.544673 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6f976855-31a6-445c-bd70-0bebc6ba36b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '211f9a50cfe24ad1bbaf526a1366ddec', 'request_id': 'req-6f976855-31a6-445c-bd70-0bebc6ba36b6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:46.554112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6f976855-31a6-445c-bd70-0bebc6ba36b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '211f9a50cfe24ad1bbaf526a1366ddec', 'request_id': 'req-6f976855-31a6-445c-bd70-0bebc6ba36b6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:46.573505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6f976855-31a6-445c-bd70-0bebc6ba36b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '211f9a50cfe24ad1bbaf526a1366ddec', 'request_id': 'req-6f976855-31a6-445c-bd70-0bebc6ba36b6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:46.600338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6f976855-31a6-445c-bd70-0bebc6ba36b6 admin admin] The token cache is being invalidate because project 211f9a50cfe24ad1bbaf526a1366ddec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:46.600338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6f976855-31a6-445c-bd70-0bebc6ba36b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:46.600338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6f976855-31a6-445c-bd70-0bebc6ba36b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:46.608792 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2447/4847] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:10:46 2022] DELETE /identity/v3/projects/211f9a50cfe24ad1bbaf526a1366ddec => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:46.611240 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627ba24-27a9-4178-a5ca-3e6b760f68a1 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:46.611575 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627ba24-27a9-4178-a5ca-3e6b760f68a1 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:46.611928 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627ba24-27a9-4178-a5ca-3e6b760f68a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:46.648241 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-9627ba24-27a9-4178-a5ca-3e6b760f68a1 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:46.649669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9627ba24-27a9-4178-a5ca-3e6b760f68a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:46.714363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:46.736727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde96d3f-083b-4add-b1c5-3e105cb42db6 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:46.739060 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde96d3f-083b-4add-b1c5-3e105cb42db6 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:46.739353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde96d3f-083b-4add-b1c5-3e105cb42db6 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:46.739635 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde96d3f-083b-4add-b1c5-3e105cb42db6 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:46.744900 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde96d3f-083b-4add-b1c5-3e105cb42db6 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:46.751484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde96d3f-083b-4add-b1c5-3e105cb42db6 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:46.759041 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2448/4848] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:46.761735 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9493cc-0db7-4d25-9bb0-854cf13ac1fa None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:46.762892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9493cc-0db7-4d25-9bb0-854cf13ac1fa None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:46.765607 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9493cc-0db7-4d25-9bb0-854cf13ac1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:46.807612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-5f9493cc-0db7-4d25-9bb0-854cf13ac1fa None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:46.809094 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5f9493cc-0db7-4d25-9bb0-854cf13ac1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:46.816442 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2401/4849] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:10:46 2022] POST /identity/v3/users => generated 416 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:46.820972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde96d3f-083b-4add-b1c5-3e105cb42db6 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:46.821492 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2449/4850] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:46.824340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9493cc-0db7-4d25-9bb0-854cf13ac1fa None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:46.825187 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-cde96d3f-083b-4add-b1c5-3e105cb42db6 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:46.852058 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9493cc-0db7-4d25-9bb0-854cf13ac1fa None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:46.855432 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde96d3f-083b-4add-b1c5-3e105cb42db6 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:46.864620 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8482a-e203-4017-9534-809cdc259eae tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:46.867154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8482a-e203-4017-9534-809cdc259eae tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:46.868281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8482a-e203-4017-9534-809cdc259eae tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:46.868592 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8482a-e203-4017-9534-809cdc259eae tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:46.868781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f5e2c-93be-452c-ae6a-d8c6f001ccda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:46.869991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db8482a-e203-4017-9534-809cdc259eae tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:46.870189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f5e2c-93be-452c-ae6a-d8c6f001ccda admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:46.870476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f5e2c-93be-452c-ae6a-d8c6f001ccda admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:46.871119 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f5e2c-93be-452c-ae6a-d8c6f001ccda admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:46.871885 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f5e2c-93be-452c-ae6a-d8c6f001ccda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:10:46.872072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db8482a-e203-4017-9534-809cdc259eae tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:46.872239 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f5e2c-93be-452c-ae6a-d8c6f001ccda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:46.874020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f5e2c-93be-452c-ae6a-d8c6f001ccda admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:46.909713 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2402/4851] 10.222.0.33 () {60 vars in 1143 bytes} [Sat Aug 6 21:10:46 2022] POST /identity/v3/roles => generated 243 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:46.912004 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2450/4852] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:46.912901 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8482a-e203-4017-9534-809cdc259eae tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:46.913984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f5e2c-93be-452c-ae6a-d8c6f001ccda admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:46.950585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8482a-e203-4017-9534-809cdc259eae tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:46.950585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781872a1-7387-4c89-bb2d-03ed68c95781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:46.951328 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781872a1-7387-4c89-bb2d-03ed68c95781 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:46.951617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781872a1-7387-4c89-bb2d-03ed68c95781 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:46.951897 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781872a1-7387-4c89-bb2d-03ed68c95781 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:46.955593 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781872a1-7387-4c89-bb2d-03ed68c95781 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:46.957542 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781872a1-7387-4c89-bb2d-03ed68c95781 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:46.967500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f5e2c-93be-452c-ae6a-d8c6f001ccda admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:47.000447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a6fb7-a987-4674-a90d-d954e8d392b3 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:47.001265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a6fb7-a987-4674-a90d-d954e8d392b3 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:47.001546 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a6fb7-a987-4674-a90d-d954e8d392b3 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:47.001813 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a6fb7-a987-4674-a90d-d954e8d392b3 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:47.002476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a6fb7-a987-4674-a90d-d954e8d392b3 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:47.005859 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a6fb7-a987-4674-a90d-d954e8d392b3 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:47.045599 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2451/4853] 10.222.0.33 () {60 vars in 1143 bytes} [Sat Aug 6 21:10:46 2022] POST /identity/v3/roles => generated 247 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:47.049587 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a6fb7-a987-4674-a90d-d954e8d392b3 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:47.052956 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2403/4854] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:10:46 2022] POST /identity/v3/projects => generated 375 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:47.055853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781872a1-7387-4c89-bb2d-03ed68c95781 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:47.077133 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a6fb7-a987-4674-a90d-d954e8d392b3 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:47.221574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1596f5a-5ab3-489a-87b6-a63c72054c54 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:47.224036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781872a1-7387-4c89-bb2d-03ed68c95781 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:47.225441 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1596f5a-5ab3-489a-87b6-a63c72054c54 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:47.225770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1596f5a-5ab3-489a-87b6-a63c72054c54 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:47.226844 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1596f5a-5ab3-489a-87b6-a63c72054c54 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/projects/b776c2183b5f489ab8f7bbc98616a990/users/3678c14989b147a78ec844149e0f3e4b/roles/c212b05d5a05452fb3af3f9545ea29a0` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:47.239990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8d0a6-40e2-40d8-95ad-1f15416c8231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:47.240244 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8d0a6-40e2-40d8-95ad-1f15416c8231 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:47.241888 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8d0a6-40e2-40d8-95ad-1f15416c8231 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:47.242354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8d0a6-40e2-40d8-95ad-1f15416c8231 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:47.243015 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8d0a6-40e2-40d8-95ad-1f15416c8231 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:47.245955 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8d0a6-40e2-40d8-95ad-1f15416c8231 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:47.247788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1596f5a-5ab3-489a-87b6-a63c72054c54 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b776c2183b5f489ab8f7bbc98616a990, user_id=3678c14989b147a78ec844149e0f3e4b, role_id=c212b05d5a05452fb3af3f9545ea29a0)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:47.253247 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1596f5a-5ab3-489a-87b6-a63c72054c54 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:47.279078 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2452/4855] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:10:47 2022] PUT /identity/v3/projects/b776c2183b5f489ab8f7bbc98616a990/users/3678c14989b147a78ec844149e0f3e4b/roles/c212b05d5a05452fb3af3f9545ea29a0 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:47.285031 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1596f5a-5ab3-489a-87b6-a63c72054c54 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:47.291979 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2404/4856] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:10:47 2022] POST /identity/v3/users => generated 288 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:47.296544 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8d0a6-40e2-40d8-95ad-1f15416c8231 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:47.305981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:47.310869 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8d0a6-40e2-40d8-95ad-1f15416c8231 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:47.412515 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1596f5a-5ab3-489a-87b6-a63c72054c54 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:47.440889 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9371b0-753b-41b5-8391-c50fd83e87ce tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:47.444430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9371b0-753b-41b5-8391-c50fd83e87ce tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:47.444834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9371b0-753b-41b5-8391-c50fd83e87ce tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:47.445122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9371b0-753b-41b5-8391-c50fd83e87ce tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/projects/b776c2183b5f489ab8f7bbc98616a990/users/3678c14989b147a78ec844149e0f3e4b/roles/7dfce56f6fd340028adcf6d173cf9f8a` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:47.457598 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9371b0-753b-41b5-8391-c50fd83e87ce tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b776c2183b5f489ab8f7bbc98616a990, user_id=3678c14989b147a78ec844149e0f3e4b, role_id=7dfce56f6fd340028adcf6d173cf9f8a)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:47.461300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9371b0-753b-41b5-8391-c50fd83e87ce tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:47.479521 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9c4e8-a117-49dd-b12d-5626a7f4726e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:47.480517 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9c4e8-a117-49dd-b12d-5626a7f4726e admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:47.480517 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9c4e8-a117-49dd-b12d-5626a7f4726e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:47.480791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9c4e8-a117-49dd-b12d-5626a7f4726e admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:47.486730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9c4e8-a117-49dd-b12d-5626a7f4726e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:47.488554 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9c4e8-a117-49dd-b12d-5626a7f4726e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:47.506753 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2453/4857] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:10:47 2022] PUT /identity/v3/projects/b776c2183b5f489ab8f7bbc98616a990/users/3678c14989b147a78ec844149e0f3e4b/roles/7dfce56f6fd340028adcf6d173cf9f8a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:10:47.510521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9371b0-753b-41b5-8391-c50fd83e87ce tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:47.527877 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2405/4858] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:47 2022] GET /identity/v3/roles => generated 1892 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:10:47.529052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9c4e8-a117-49dd-b12d-5626a7f4726e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:47.541928 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9c4e8-a117-49dd-b12d-5626a7f4726e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:47.604275 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:47.627354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd24665-3829-4c5d-bf63-49444d2b1215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:47.628406 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd24665-3829-4c5d-bf63-49444d2b1215 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:47.628893 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd24665-3829-4c5d-bf63-49444d2b1215 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:47.629321 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd24665-3829-4c5d-bf63-49444d2b1215 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:47.630907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd24665-3829-4c5d-bf63-49444d2b1215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:47.633164 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd24665-3829-4c5d-bf63-49444d2b1215 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:47.655112 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2406/4859] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:47 2022] GET /identity/v3/roles => generated 1892 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:47.657451 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd24665-3829-4c5d-bf63-49444d2b1215 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:47.665920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9371b0-753b-41b5-8391-c50fd83e87ce tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:47.672866 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc250c-fafb-4ff6-82fa-cc132f6a7a1e tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:47.673311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd24665-3829-4c5d-bf63-49444d2b1215 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:47.673658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc250c-fafb-4ff6-82fa-cc132f6a7a1e tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:47.674082 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc250c-fafb-4ff6-82fa-cc132f6a7a1e tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:47.674437 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc250c-fafb-4ff6-82fa-cc132f6a7a1e tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:47.675245 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc250c-fafb-4ff6-82fa-cc132f6a7a1e tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:47.679138 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-2bdc250c-fafb-4ff6-82fa-cc132f6a7a1e tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:10:47.679138 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:10:47.679138 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:10:47.680355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2472ca30-23b5-41c6-8b8e-19608aad28ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:47.681113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc250c-fafb-4ff6-82fa-cc132f6a7a1e tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:47.681224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472ca30-23b5-41c6-8b8e-19608aad28ac admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:47.681561 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472ca30-23b5-41c6-8b8e-19608aad28ac admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:47.682167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472ca30-23b5-41c6-8b8e-19608aad28ac admin admin] PATH_INFO: `/v3/projects/86ab008e18d34931ad32d7a2d9280c5b/users/8b7ac06540414930b1e7753de17a13da/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:47.733632 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2472ca30-23b5-41c6-8b8e-19608aad28ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=86ab008e18d34931ad32d7a2d9280c5b, user_id=8b7ac06540414930b1e7753de17a13da, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:47.736690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2472ca30-23b5-41c6-8b8e-19608aad28ac admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:47.752128 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2454/4860] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:47 2022] GET /identity/v3/users => generated 7778 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:10:47.761550 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2407/4861] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:10:47 2022] PUT /identity/v3/projects/86ab008e18d34931ad32d7a2d9280c5b/users/8b7ac06540414930b1e7753de17a13da/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:47.771770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee872f3a-6191-4fb5-9e6f-127b459e2150 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:47.773012 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3f3d6-ebda-447a-bcd7-e567e2486ff9 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:47.773383 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3f3d6-ebda-447a-bcd7-e567e2486ff9 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:47.773669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3f3d6-ebda-447a-bcd7-e567e2486ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:47.773961 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee872f3a-6191-4fb5-9e6f-127b459e2150 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:47.774232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee872f3a-6191-4fb5-9e6f-127b459e2150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:47.818363 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-ee872f3a-6191-4fb5-9e6f-127b459e2150 None None] MFA Rules not processed for user `8b7ac06540414930b1e7753de17a13da`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:47.819516 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ee872f3a-6191-4fb5-9e6f-127b459e2150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:47.842141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-edb3f3d6-ebda-447a-bcd7-e567e2486ff9 None None] MFA Rules not processed for user `3678c14989b147a78ec844149e0f3e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:47.845456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-edb3f3d6-ebda-447a-bcd7-e567e2486ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:47.909649 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2408/4862] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:47.910794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee872f3a-6191-4fb5-9e6f-127b459e2150 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:47.931327 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:48.045843 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2455/4863] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:47 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:48.054347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c11fe-b2b0-4b28-9d20-f5ab49647c99 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:48.055030 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c11fe-b2b0-4b28-9d20-f5ab49647c99 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:48.055316 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c11fe-b2b0-4b28-9d20-f5ab49647c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:48.055870 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee872f3a-6191-4fb5-9e6f-127b459e2150 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:48.070327 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba039e-e226-4855-b77c-654c0e58d729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:48.076960 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba039e-e226-4855-b77c-654c0e58d729 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:48.078225 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba039e-e226-4855-b77c-654c0e58d729 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:48.078749 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba039e-e226-4855-b77c-654c0e58d729 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:48.079534 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba039e-e226-4855-b77c-654c0e58d729 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:48.082055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba039e-e226-4855-b77c-654c0e58d729 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:48.123038 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-ff7c11fe-b2b0-4b28-9d20-f5ab49647c99 None None] MFA Rules not processed for user `3678c14989b147a78ec844149e0f3e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:48.129183 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2409/4864] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:10:47 2022] POST /identity/v3/projects => generated 377 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:48.130623 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba039e-e226-4855-b77c-654c0e58d729 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:48.133731 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ff7c11fe-b2b0-4b28-9d20-f5ab49647c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:48.248459 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba039e-e226-4855-b77c-654c0e58d729 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:48.261138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4886b-f376-40b9-98f1-5114096b4b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:48.261777 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4886b-f376-40b9-98f1-5114096b4b1f admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:48.262037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4886b-f376-40b9-98f1-5114096b4b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:48.262307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4886b-f376-40b9-98f1-5114096b4b1f admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:48.268443 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc4886b-f376-40b9-98f1-5114096b4b1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:48.273816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc4886b-f376-40b9-98f1-5114096b4b1f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:48.315997 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2456/4865] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:48 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:48.321379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c11fe-b2b0-4b28-9d20-f5ab49647c99 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:48.330676 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2410/4866] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:10:48 2022] POST /identity/v3/users => generated 295 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:48.331646 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4886b-f376-40b9-98f1-5114096b4b1f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:48.349478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c11fe-b2b0-4b28-9d20-f5ab49647c99 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:48.360127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4886b-f376-40b9-98f1-5114096b4b1f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:48.372513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e25da-1a01-444a-8895-48273247cd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:48.375476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e6277-1bee-4501-bc5e-61e8846870c4 tempest-TrustsV3TestJSON-180204044 tempest-user-1435577658] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3678c14989b147a78ec844149e0f3e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b776c2183b5f489ab8f7bbc98616a990', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1024677508', 'tempest-DelegatedRole-884555374'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:48.375692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e25da-1a01-444a-8895-48273247cd10 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:48.375979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e25da-1a01-444a-8895-48273247cd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:48.376658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e6277-1bee-4501-bc5e-61e8846870c4 tempest-TrustsV3TestJSON-180204044 tempest-user-1435577658] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:48.377397 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e25da-1a01-444a-8895-48273247cd10 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:48.378270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e6277-1bee-4501-bc5e-61e8846870c4 tempest-TrustsV3TestJSON-180204044 tempest-user-1435577658] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:48.379302 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e6277-1bee-4501-bc5e-61e8846870c4 tempest-TrustsV3TestJSON-180204044 tempest-user-1435577658] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:48.380712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e6277-1bee-4501-bc5e-61e8846870c4 tempest-TrustsV3TestJSON-180204044 tempest-user-1435577658] RBAC: Authorizing `identity:create_trust()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:48.380850 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e25da-1a01-444a-8895-48273247cd10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:48.382509 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e25da-1a01-444a-8895-48273247cd10 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:48.382984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e6277-1bee-4501-bc5e-61e8846870c4 tempest-TrustsV3TestJSON-180204044 tempest-user-1435577658] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:48.416433 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2411/4867] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:48 2022] GET /identity/v3/roles => generated 1892 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:48.419160 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e25da-1a01-444a-8895-48273247cd10 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:48.443503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e25da-1a01-444a-8895-48273247cd10 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:48.459476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211e50e-0070-4713-a03c-79bb641205c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:48.460168 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211e50e-0070-4713-a03c-79bb641205c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:48.460583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211e50e-0070-4713-a03c-79bb641205c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:48.468046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211e50e-0070-4713-a03c-79bb641205c7 admin admin] PATH_INFO: `/v3/projects/c0959e877edd414396cc2583158e12cf/users/cee713ee83054c3e8ef260c9acfaeb95/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:48.502709 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211e50e-0070-4713-a03c-79bb641205c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0959e877edd414396cc2583158e12cf, user_id=cee713ee83054c3e8ef260c9acfaeb95, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:48.511879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211e50e-0070-4713-a03c-79bb641205c7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:48.543963 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2412/4868] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:10:48 2022] PUT /identity/v3/projects/c0959e877edd414396cc2583158e12cf/users/cee713ee83054c3e8ef260c9acfaeb95/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:48.547895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211e50e-0070-4713-a03c-79bb641205c7 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:48.551187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:48.598254 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2457/4869] 10.222.0.33 () {60 vars in 1174 bytes} [Sat Aug 6 21:10:48 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:48.599444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e6277-1bee-4501-bc5e-61e8846870c4 tempest-TrustsV3TestJSON-180204044 tempest-user-1435577658] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:48.628916 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:48.659501 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211e50e-0070-4713-a03c-79bb641205c7 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:48.670620 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7561291-5e17-4731-b7fb-7e7d5d928947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:48.672414 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7561291-5e17-4731-b7fb-7e7d5d928947 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:48.672981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7561291-5e17-4731-b7fb-7e7d5d928947 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:48.673470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7561291-5e17-4731-b7fb-7e7d5d928947 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:48.695061 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7561291-5e17-4731-b7fb-7e7d5d928947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:48.698165 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7561291-5e17-4731-b7fb-7e7d5d928947 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:48.718577 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2413/4870] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:48 2022] GET /identity/v3/roles => generated 1892 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:48.722504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7561291-5e17-4731-b7fb-7e7d5d928947 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:48.741733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7561291-5e17-4731-b7fb-7e7d5d928947 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:48.746349 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e6277-1bee-4501-bc5e-61e8846870c4 tempest-TrustsV3TestJSON-180204044 tempest-user-1435577658] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:48.753396 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b71fd-d247-41a5-90b6-176ca01c5437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:48.755151 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b71fd-d247-41a5-90b6-176ca01c5437 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:48.756125 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b71fd-d247-41a5-90b6-176ca01c5437 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:48.756416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b71fd-d247-41a5-90b6-176ca01c5437 admin admin] PATH_INFO: `/v3/projects/c0959e877edd414396cc2583158e12cf/users/cee713ee83054c3e8ef260c9acfaeb95/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:48.760459 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b71fd-d247-41a5-90b6-176ca01c5437 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0959e877edd414396cc2583158e12cf, user_id=cee713ee83054c3e8ef260c9acfaeb95, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:48.764003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b71fd-d247-41a5-90b6-176ca01c5437 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:48.808627 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2414/4871] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:10:48 2022] PUT /identity/v3/projects/c0959e877edd414396cc2583158e12cf/users/cee713ee83054c3e8ef260c9acfaeb95/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:10:48.840790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759afc8-41cc-4a15-b702-06b404b72691 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:48.842833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759afc8-41cc-4a15-b702-06b404b72691 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:48.843992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759afc8-41cc-4a15-b702-06b404b72691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:48.864273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb7cbf-fdbc-4790-a866-d5e1175cd457 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:48.865493 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb7cbf-fdbc-4790-a866-d5e1175cd457 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:48.867032 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb7cbf-fdbc-4790-a866-d5e1175cd457 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:48.867324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb7cbf-fdbc-4790-a866-d5e1175cd457 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:48.871106 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb7cbf-fdbc-4790-a866-d5e1175cd457 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:48.873307 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-99bb7cbf-fdbc-4790-a866-d5e1175cd457 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:10:48.873307 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:10:48.873307 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:10:48.875404 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb7cbf-fdbc-4790-a866-d5e1175cd457 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:48.923897 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2458/4872] 10.222.0.33 () {58 vars in 1155 bytes} [Sat Aug 6 21:10:48 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:48.929143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb7cbf-fdbc-4790-a866-d5e1175cd457 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:48.978214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-3759afc8-41cc-4a15-b702-06b404b72691 None None] MFA Rules not processed for user `cee713ee83054c3e8ef260c9acfaeb95`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:48.980008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3759afc8-41cc-4a15-b702-06b404b72691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:49.113966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb7cbf-fdbc-4790-a866-d5e1175cd457 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:49.172930 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:49.189413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275f156-a753-4186-a607-d4575e5f37e2 tempest-TrustsV3TestJSON-180204044 tempest-user-1435577658] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3678c14989b147a78ec844149e0f3e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b776c2183b5f489ab8f7bbc98616a990', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1024677508', 'tempest-DelegatedRole-884555374'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:49.190080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275f156-a753-4186-a607-d4575e5f37e2 tempest-TrustsV3TestJSON-180204044 tempest-user-1435577658] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:49.190365 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275f156-a753-4186-a607-d4575e5f37e2 tempest-TrustsV3TestJSON-180204044 tempest-user-1435577658] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:49.190687 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275f156-a753-4186-a607-d4575e5f37e2 tempest-TrustsV3TestJSON-180204044 tempest-user-1435577658] PATH_INFO: `/v3/OS-TRUST/trusts/132e7e0e34194e57979f6b0d446abbd0` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:49.203361 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275f156-a753-4186-a607-d4575e5f37e2 tempest-TrustsV3TestJSON-180204044 tempest-user-1435577658] RBAC: Authorizing `identity:delete_trust(trust_id=132e7e0e34194e57979f6b0d446abbd0)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:49.205354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275f156-a753-4186-a607-d4575e5f37e2 tempest-TrustsV3TestJSON-180204044 tempest-user-1435577658] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:49.216547 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2415/4873] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:49.218363 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759afc8-41cc-4a15-b702-06b404b72691 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:49.224790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3759afc8-41cc-4a15-b702-06b404b72691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:49.238174 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7275f156-a753-4186-a607-d4575e5f37e2 tempest-TrustsV3TestJSON-180204044 tempest-user-1435577658] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '132e7e0e34194e57979f6b0d446abbd0', 'request_id': 'req-7275f156-a753-4186-a607-d4575e5f37e2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:49.239081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7275f156-a753-4186-a607-d4575e5f37e2 tempest-TrustsV3TestJSON-180204044 tempest-user-1435577658] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '132e7e0e34194e57979f6b0d446abbd0', 'request_id': 'req-7275f156-a753-4186-a607-d4575e5f37e2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:49.239821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7275f156-a753-4186-a607-d4575e5f37e2 tempest-TrustsV3TestJSON-180204044 tempest-user-1435577658] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '132e7e0e34194e57979f6b0d446abbd0', 'request_id': 'req-7275f156-a753-4186-a607-d4575e5f37e2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:49.289651 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2459/4874] 10.222.0.33 () {58 vars in 1254 bytes} [Sat Aug 6 21:10:48 2022] DELETE /identity/v3/OS-TRUST/trusts/132e7e0e34194e57979f6b0d446abbd0 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:49.289651 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275f156-a753-4186-a607-d4575e5f37e2 tempest-TrustsV3TestJSON-180204044 tempest-user-1435577658] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:49.291444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7275f156-a753-4186-a607-d4575e5f37e2 tempest-TrustsV3TestJSON-180204044 tempest-user-1435577658] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:49.410438 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759afc8-41cc-4a15-b702-06b404b72691 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:49.429181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275f156-a753-4186-a607-d4575e5f37e2 tempest-TrustsV3TestJSON-180204044 tempest-user-1435577658] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:49.432559 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4251a-30ea-4bb8-9426-9d4a4c335af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:49.433394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4251a-30ea-4bb8-9426-9d4a4c335af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:49.433591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57091df9-31ec-4222-b36c-c8a7959dc6ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:49.433915 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4251a-30ea-4bb8-9426-9d4a4c335af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:49.434221 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57091df9-31ec-4222-b36c-c8a7959dc6ca service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:49.434373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4251a-30ea-4bb8-9426-9d4a4c335af7 admin admin] PATH_INFO: `/v3/projects/ea8c7d7d44da4921870b3c3deeb668e7` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:49.434478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57091df9-31ec-4222-b36c-c8a7959dc6ca service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:49.434780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57091df9-31ec-4222-b36c-c8a7959dc6ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:49.438336 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-57091df9-31ec-4222-b36c-c8a7959dc6ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:49.438583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4251a-30ea-4bb8-9426-9d4a4c335af7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea8c7d7d44da4921870b3c3deeb668e7)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:49.441197 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4251a-30ea-4bb8-9426-9d4a4c335af7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:49.457495 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57091df9-31ec-4222-b36c-c8a7959dc6ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:49.459781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57091df9-31ec-4222-b36c-c8a7959dc6ca service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:49.474243 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2460/4875] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:10:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:10:49.475219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57091df9-31ec-4222-b36c-c8a7959dc6ca service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:49.476560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-57091df9-31ec-4222-b36c-c8a7959dc6ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:49.495631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57091df9-31ec-4222-b36c-c8a7959dc6ca service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:49.531535 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7dc4251a-30ea-4bb8-9426-9d4a4c335af7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea8c7d7d44da4921870b3c3deeb668e7', 'request_id': 'req-7dc4251a-30ea-4bb8-9426-9d4a4c335af7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:49.536301 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:49.548657 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7dc4251a-30ea-4bb8-9426-9d4a4c335af7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea8c7d7d44da4921870b3c3deeb668e7', 'request_id': 'req-7dc4251a-30ea-4bb8-9426-9d4a4c335af7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:49.567836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7dc4251a-30ea-4bb8-9426-9d4a4c335af7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea8c7d7d44da4921870b3c3deeb668e7', 'request_id': 'req-7dc4251a-30ea-4bb8-9426-9d4a4c335af7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:49.581347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a621e0-29e4-4937-b205-15738fa17086 tempest-TrustsV3TestJSON-180204044 tempest-user-1435577658] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3678c14989b147a78ec844149e0f3e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b776c2183b5f489ab8f7bbc98616a990', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1024677508', 'tempest-DelegatedRole-884555374'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:49.582098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a621e0-29e4-4937-b205-15738fa17086 tempest-TrustsV3TestJSON-180204044 tempest-user-1435577658] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:49.582378 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a621e0-29e4-4937-b205-15738fa17086 tempest-TrustsV3TestJSON-180204044 tempest-user-1435577658] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:49.582895 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a621e0-29e4-4937-b205-15738fa17086 tempest-TrustsV3TestJSON-180204044 tempest-user-1435577658] PATH_INFO: `/v3/OS-TRUST/trusts/132e7e0e34194e57979f6b0d446abbd0` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:49.612945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7dc4251a-30ea-4bb8-9426-9d4a4c335af7 admin admin] The token cache is being invalidate because project ea8c7d7d44da4921870b3c3deeb668e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:49.613289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7dc4251a-30ea-4bb8-9426-9d4a4c335af7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:49.614227 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7dc4251a-30ea-4bb8-9426-9d4a4c335af7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:49.618177 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2416/4876] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:10:49 2022] DELETE /identity/v3/projects/ea8c7d7d44da4921870b3c3deeb668e7 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:49.625826 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb676ae-dc94-4511-9f59-fca9e4f56073 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:49.627074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb676ae-dc94-4511-9f59-fca9e4f56073 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:49.629730 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-26a621e0-29e4-4937-b205-15738fa17086 tempest-TrustsV3TestJSON-180204044 tempest-user-1435577658] Could not find trust: 132e7e0e34194e57979f6b0d446abbd0.: keystone.exception.TrustNotFound: Could not find trust: 132e7e0e34194e57979f6b0d446abbd0. Aug 06 21:10:49.629730 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:10:49.629730 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:10:49.629730 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:10:49.629730 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:10:49.629730 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:10:49.629730 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:10:49.629730 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:10:49.629730 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:10:49.629730 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:10:49.629730 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:10:49.629730 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:10:49.629730 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 06 21:10:49.629730 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 06 21:10:49.629730 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 06 21:10:49.630619 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 06 21:10:49.630619 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 06 21:10:49.630619 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 06 21:10:49.630619 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 06 21:10:49.630619 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 06 21:10:49.630619 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:10:49.630619 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:10:49.630619 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 06 21:10:49.630619 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 06 21:10:49.630619 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 06 21:10:49.630619 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 06 21:10:49.630619 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 132e7e0e34194e57979f6b0d446abbd0. Aug 06 21:10:49.630619 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:10:49.632925 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2461/4877] 10.222.0.33 () {58 vars in 1251 bytes} [Sat Aug 6 21:10:49 2022] GET /identity/v3/OS-TRUST/trusts/132e7e0e34194e57979f6b0d446abbd0 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:10:49.634482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb676ae-dc94-4511-9f59-fca9e4f56073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:49.635744 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a621e0-29e4-4937-b205-15738fa17086 tempest-TrustsV3TestJSON-180204044 tempest-user-1435577658] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:49.638488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-26a621e0-29e4-4937-b205-15738fa17086 tempest-TrustsV3TestJSON-180204044 tempest-user-1435577658] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:49.669944 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-dbb676ae-dc94-4511-9f59-fca9e4f56073 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:49.672662 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-dbb676ae-dc94-4511-9f59-fca9e4f56073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:49.796663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a621e0-29e4-4937-b205-15738fa17086 tempest-TrustsV3TestJSON-180204044 tempest-user-1435577658] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:49.808221 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9400fec-db30-4fc4-9fed-57201a8c21c7 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:49.810095 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9400fec-db30-4fc4-9fed-57201a8c21c7 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:49.810497 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9400fec-db30-4fc4-9fed-57201a8c21c7 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:49.812048 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9400fec-db30-4fc4-9fed-57201a8c21c7 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/roles/7dfce56f6fd340028adcf6d173cf9f8a` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:49.817051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9400fec-db30-4fc4-9fed-57201a8c21c7 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7dfce56f6fd340028adcf6d173cf9f8a)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:49.818889 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9400fec-db30-4fc4-9fed-57201a8c21c7 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:49.827000 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:49.838231 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2417/4878] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:49.841638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dad519-66bd-498b-a8cb-c458ef086895 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:49.841988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dad519-66bd-498b-a8cb-c458ef086895 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:49.842357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dad519-66bd-498b-a8cb-c458ef086895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:49.877734 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-46dad519-66bd-498b-a8cb-c458ef086895 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:49.879590 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-46dad519-66bd-498b-a8cb-c458ef086895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:49.900956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c9400fec-db30-4fc4-9fed-57201a8c21c7 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invalidating the token cache because role 7dfce56f6fd340028adcf6d173cf9f8a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:49.901518 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c9400fec-db30-4fc4-9fed-57201a8c21c7 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:49.902876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c9400fec-db30-4fc4-9fed-57201a8c21c7 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:49.908631 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2462/4879] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:49 2022] DELETE /identity/v3/roles/7dfce56f6fd340028adcf6d173cf9f8a => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:49.912882 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9400fec-db30-4fc4-9fed-57201a8c21c7 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:49.914817 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c9400fec-db30-4fc4-9fed-57201a8c21c7 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:49.921034 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2418/4880] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:49.922466 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dad519-66bd-498b-a8cb-c458ef086895 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:49.939533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dad519-66bd-498b-a8cb-c458ef086895 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:50.079725 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9400fec-db30-4fc4-9fed-57201a8c21c7 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:50.090741 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10cb7d8-44bc-46d7-bd33-94a3361a015c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:50.091679 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8121c78-98a3-4053-ba65-9225ee7ab2fc tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:50.092384 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cb7d8-44bc-46d7-bd33-94a3361a015c admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:50.093904 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8121c78-98a3-4053-ba65-9225ee7ab2fc tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:50.094329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cb7d8-44bc-46d7-bd33-94a3361a015c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:50.094752 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cb7d8-44bc-46d7-bd33-94a3361a015c admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:50.095194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8121c78-98a3-4053-ba65-9225ee7ab2fc tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:50.096018 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10cb7d8-44bc-46d7-bd33-94a3361a015c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:10:50.096403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8121c78-98a3-4053-ba65-9225ee7ab2fc tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/roles/c212b05d5a05452fb3af3f9545ea29a0` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:50.097134 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10cb7d8-44bc-46d7-bd33-94a3361a015c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:50.099455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8121c78-98a3-4053-ba65-9225ee7ab2fc tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c212b05d5a05452fb3af3f9545ea29a0)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:50.102104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10cb7d8-44bc-46d7-bd33-94a3361a015c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:50.104759 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8121c78-98a3-4053-ba65-9225ee7ab2fc tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:50.157864 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2419/4881] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:50.163513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10cb7d8-44bc-46d7-bd33-94a3361a015c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:50.168952 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f10cb7d8-44bc-46d7-bd33-94a3361a015c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:50.252247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10cb7d8-44bc-46d7-bd33-94a3361a015c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:50.279621 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807c215-0d86-41ef-9b1e-6d5a04247d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:50.283075 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807c215-0d86-41ef-9b1e-6d5a04247d66 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:50.286676 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807c215-0d86-41ef-9b1e-6d5a04247d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:50.287767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b8121c78-98a3-4053-ba65-9225ee7ab2fc tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invalidating the token cache because role c212b05d5a05452fb3af3f9545ea29a0 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:50.294949 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807c215-0d86-41ef-9b1e-6d5a04247d66 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:50.295587 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b8121c78-98a3-4053-ba65-9225ee7ab2fc tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:50.297615 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807c215-0d86-41ef-9b1e-6d5a04247d66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:50.298095 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b8121c78-98a3-4053-ba65-9225ee7ab2fc tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:50.307826 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807c215-0d86-41ef-9b1e-6d5a04247d66 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:50.308284 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2463/4882] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:49 2022] DELETE /identity/v3/roles/c212b05d5a05452fb3af3f9545ea29a0 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:10:50.313297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8121c78-98a3-4053-ba65-9225ee7ab2fc tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:50.323214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b8121c78-98a3-4053-ba65-9225ee7ab2fc tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:50.401405 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2420/4883] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:10:50 2022] POST /identity/v3/projects => generated 379 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:50.406289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807c215-0d86-41ef-9b1e-6d5a04247d66 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:50.411373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9807c215-0d86-41ef-9b1e-6d5a04247d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:50.528485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:50.535224 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8121c78-98a3-4053-ba65-9225ee7ab2fc tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:50.570165 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807c215-0d86-41ef-9b1e-6d5a04247d66 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:50.582875 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168ebaa-7972-46de-8e0c-f0b0d087cbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:50.584580 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168ebaa-7972-46de-8e0c-f0b0d087cbd3 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:50.584769 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168ebaa-7972-46de-8e0c-f0b0d087cbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:50.585029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168ebaa-7972-46de-8e0c-f0b0d087cbd3 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:50.587242 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168ebaa-7972-46de-8e0c-f0b0d087cbd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:50.593332 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168ebaa-7972-46de-8e0c-f0b0d087cbd3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:50.645717 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2421/4884] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:10:50 2022] POST /identity/v3/users => generated 290 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:10:50.650499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:50.652461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168ebaa-7972-46de-8e0c-f0b0d087cbd3 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:50.688937 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168ebaa-7972-46de-8e0c-f0b0d087cbd3 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:50.695878 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba3ff5-3fbf-4556-81da-fdd2af841291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:50.701131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba3ff5-3fbf-4556-81da-fdd2af841291 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:50.701468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba3ff5-3fbf-4556-81da-fdd2af841291 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:50.701744 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba3ff5-3fbf-4556-81da-fdd2af841291 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:50.702503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba3ff5-3fbf-4556-81da-fdd2af841291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:50.704208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba3ff5-3fbf-4556-81da-fdd2af841291 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:50.720820 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2422/4885] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:50.721824 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba3ff5-3fbf-4556-81da-fdd2af841291 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:50.734750 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba3ff5-3fbf-4556-81da-fdd2af841291 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:50.741030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54b1f6-d2f4-494f-8bf2-cfe10048e5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:50.742090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ac19a-3a7b-438e-9733-f74f7861ff27 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:50.743261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ac19a-3a7b-438e-9733-f74f7861ff27 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:50.743707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ac19a-3a7b-438e-9733-f74f7861ff27 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:50.743985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ac19a-3a7b-438e-9733-f74f7861ff27 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/users/3678c14989b147a78ec844149e0f3e4b` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:50.746741 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54b1f6-d2f4-494f-8bf2-cfe10048e5ef admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:50.747134 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54b1f6-d2f4-494f-8bf2-cfe10048e5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:50.747510 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ac19a-3a7b-438e-9733-f74f7861ff27 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3678c14989b147a78ec844149e0f3e4b)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:50.747617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54b1f6-d2f4-494f-8bf2-cfe10048e5ef admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:50.748613 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54b1f6-d2f4-494f-8bf2-cfe10048e5ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:50.751498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54b1f6-d2f4-494f-8bf2-cfe10048e5ef admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:50.754312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ac19a-3a7b-438e-9733-f74f7861ff27 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:50.766773 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2423/4886] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:50.773749 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54b1f6-d2f4-494f-8bf2-cfe10048e5ef admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:50.799727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54b1f6-d2f4-494f-8bf2-cfe10048e5ef admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:50.815806 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad47483-581f-4cbb-b86d-661d888d53b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:50.816515 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad47483-581f-4cbb-b86d-661d888d53b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:50.816788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad47483-581f-4cbb-b86d-661d888d53b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:50.817153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad47483-581f-4cbb-b86d-661d888d53b4 admin admin] PATH_INFO: `/v3/projects/b2372e3caffc48689c7cf829f77d24ef/users/b3eb13397d09494986ab115f556c34e8/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:50.847889 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad47483-581f-4cbb-b86d-661d888d53b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2372e3caffc48689c7cf829f77d24ef, user_id=b3eb13397d09494986ab115f556c34e8, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:50.850655 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad47483-581f-4cbb-b86d-661d888d53b4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:50.872967 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2424/4887] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:10:50 2022] PUT /identity/v3/projects/b2372e3caffc48689c7cf829f77d24ef/users/b3eb13397d09494986ab115f556c34e8/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:50.887924 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf99798-2229-4ec9-8fbf-2c8958b665c5 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:50.888421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf99798-2229-4ec9-8fbf-2c8958b665c5 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:50.888779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf99798-2229-4ec9-8fbf-2c8958b665c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:50.916478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e41ac19a-3a7b-438e-9733-f74f7861ff27 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3678c14989b147a78ec844149e0f3e4b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:50.938790 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e41ac19a-3a7b-438e-9733-f74f7861ff27 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3678c14989b147a78ec844149e0f3e4b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:50.942122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e41ac19a-3a7b-438e-9733-f74f7861ff27 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3678c14989b147a78ec844149e0f3e4b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:50.942879 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e41ac19a-3a7b-438e-9733-f74f7861ff27 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3678c14989b147a78ec844149e0f3e4b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:50.962234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e41ac19a-3a7b-438e-9733-f74f7861ff27 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3678c14989b147a78ec844149e0f3e4b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:50.963827 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-7bf99798-2229-4ec9-8fbf-2c8958b665c5 None None] MFA Rules not processed for user `b3eb13397d09494986ab115f556c34e8`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:50.968103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7bf99798-2229-4ec9-8fbf-2c8958b665c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:51.025221 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2464/4888] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:50 2022] DELETE /identity/v3/users/3678c14989b147a78ec844149e0f3e4b => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:51.029470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ac19a-3a7b-438e-9733-f74f7861ff27 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:51.032430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e41ac19a-3a7b-438e-9733-f74f7861ff27 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:51.209529 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2425/4889] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:51.210708 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf99798-2229-4ec9-8fbf-2c8958b665c5 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:51.233319 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf99798-2229-4ec9-8fbf-2c8958b665c5 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:51.328389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ac19a-3a7b-438e-9733-f74f7861ff27 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:51.353105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb33e11-112e-45ec-a327-4d1eec6658bf tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:51.353803 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb33e11-112e-45ec-a327-4d1eec6658bf tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:51.354339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb33e11-112e-45ec-a327-4d1eec6658bf tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:51.354667 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb33e11-112e-45ec-a327-4d1eec6658bf tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/projects/b776c2183b5f489ab8f7bbc98616a990` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:51.357113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb33e11-112e-45ec-a327-4d1eec6658bf tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b776c2183b5f489ab8f7bbc98616a990)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:51.365057 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb33e11-112e-45ec-a327-4d1eec6658bf tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:51.426459 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0078ac-164b-4a03-b488-2e6518e2c0b4 tempest-DefaultDomainTestJSON-1064826615 tempest-DefaultDomainTestJSON-1064826615-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3eb13397d09494986ab115f556c34e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2372e3caffc48689c7cf829f77d24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:51.428370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0078ac-164b-4a03-b488-2e6518e2c0b4 tempest-DefaultDomainTestJSON-1064826615 tempest-DefaultDomainTestJSON-1064826615-project] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:51.428370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0078ac-164b-4a03-b488-2e6518e2c0b4 tempest-DefaultDomainTestJSON-1064826615 tempest-DefaultDomainTestJSON-1064826615-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:51.428370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0078ac-164b-4a03-b488-2e6518e2c0b4 tempest-DefaultDomainTestJSON-1064826615 tempest-DefaultDomainTestJSON-1064826615-project] PATH_INFO: `/v3/domains/default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:51.431342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0078ac-164b-4a03-b488-2e6518e2c0b4 tempest-DefaultDomainTestJSON-1064826615 tempest-DefaultDomainTestJSON-1064826615-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:51.439800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0078ac-164b-4a03-b488-2e6518e2c0b4 tempest-DefaultDomainTestJSON-1064826615 tempest-DefaultDomainTestJSON-1064826615-project] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:51.450412 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2426/4890] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Aug 6 21:10:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:51.451412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0078ac-164b-4a03-b488-2e6518e2c0b4 tempest-DefaultDomainTestJSON-1064826615 tempest-DefaultDomainTestJSON-1064826615-project] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:51.457519 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7f0078ac-164b-4a03-b488-2e6518e2c0b4 tempest-DefaultDomainTestJSON-1064826615 tempest-DefaultDomainTestJSON-1064826615-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:51.508505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9eb33e11-112e-45ec-a327-4d1eec6658bf tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b776c2183b5f489ab8f7bbc98616a990', 'request_id': 'req-9eb33e11-112e-45ec-a327-4d1eec6658bf'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:51.513030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:51.516781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9eb33e11-112e-45ec-a327-4d1eec6658bf tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b776c2183b5f489ab8f7bbc98616a990', 'request_id': 'req-9eb33e11-112e-45ec-a327-4d1eec6658bf'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:51.520492 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:51.534580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9eb33e11-112e-45ec-a327-4d1eec6658bf tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b776c2183b5f489ab8f7bbc98616a990', 'request_id': 'req-9eb33e11-112e-45ec-a327-4d1eec6658bf'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:51.557411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9eb33e11-112e-45ec-a327-4d1eec6658bf tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] The token cache is being invalidate because project b776c2183b5f489ab8f7bbc98616a990 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:51.557739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9eb33e11-112e-45ec-a327-4d1eec6658bf tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:51.558648 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9eb33e11-112e-45ec-a327-4d1eec6658bf tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:51.566091 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2465/4891] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:10:51 2022] DELETE /identity/v3/projects/b776c2183b5f489ab8f7bbc98616a990 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:51.567639 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb33e11-112e-45ec-a327-4d1eec6658bf tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:51.569224 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9eb33e11-112e-45ec-a327-4d1eec6658bf tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:51.572978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0078ac-164b-4a03-b488-2e6518e2c0b4 tempest-DefaultDomainTestJSON-1064826615 tempest-DefaultDomainTestJSON-1064826615-project] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:51.658505 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7714dc0-c542-41f3-9c85-0644567546d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:51.659978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7714dc0-c542-41f3-9c85-0644567546d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:51.660697 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7714dc0-c542-41f3-9c85-0644567546d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:51.661159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7714dc0-c542-41f3-9c85-0644567546d5 admin admin] PATH_INFO: `/v3/users/b3eb13397d09494986ab115f556c34e8` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:51.675533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7714dc0-c542-41f3-9c85-0644567546d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3eb13397d09494986ab115f556c34e8)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:51.682340 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7714dc0-c542-41f3-9c85-0644567546d5 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:51.713438 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb33e11-112e-45ec-a327-4d1eec6658bf tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:51.720511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945265f-b4ea-4517-b18b-f9470edb54f1 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:51.722503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945265f-b4ea-4517-b18b-f9470edb54f1 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:51.723019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945265f-b4ea-4517-b18b-f9470edb54f1 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:51.723924 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945265f-b4ea-4517-b18b-f9470edb54f1 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:51.724708 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945265f-b4ea-4517-b18b-f9470edb54f1 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:51.727992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945265f-b4ea-4517-b18b-f9470edb54f1 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:51.785815 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2466/4892] 10.222.0.33 () {60 vars in 1152 bytes} [Sat Aug 6 21:10:51 2022] POST /identity/v3/projects => generated 329 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:51.787584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945265f-b4ea-4517-b18b-f9470edb54f1 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:51.788195 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b7714dc0-c542-41f3-9c85-0644567546d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3eb13397d09494986ab115f556c34e8'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:51.790411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b7714dc0-c542-41f3-9c85-0644567546d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3eb13397d09494986ab115f556c34e8'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:51.793029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b7714dc0-c542-41f3-9c85-0644567546d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3eb13397d09494986ab115f556c34e8'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:51.810500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b7714dc0-c542-41f3-9c85-0644567546d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3eb13397d09494986ab115f556c34e8'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:51.837068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b7714dc0-c542-41f3-9c85-0644567546d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3eb13397d09494986ab115f556c34e8'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:51.874974 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2427/4893] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:51 2022] DELETE /identity/v3/users/b3eb13397d09494986ab115f556c34e8 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:51.880231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24589f-dc79-4fb0-8ee1-1faeda81edba None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:51.880524 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24589f-dc79-4fb0-8ee1-1faeda81edba None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:51.880800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24589f-dc79-4fb0-8ee1-1faeda81edba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:51.927468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-9b24589f-dc79-4fb0-8ee1-1faeda81edba None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:51.928691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9b24589f-dc79-4fb0-8ee1-1faeda81edba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:51.953445 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945265f-b4ea-4517-b18b-f9470edb54f1 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:52.055201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:52.065238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd149c-6443-4c60-9c6d-ae3cd549762c tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:52.066275 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd149c-6443-4c60-9c6d-ae3cd549762c tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:52.067496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd149c-6443-4c60-9c6d-ae3cd549762c tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:52.078262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd149c-6443-4c60-9c6d-ae3cd549762c tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:52.079169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd149c-6443-4c60-9c6d-ae3cd549762c tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:52.087165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd149c-6443-4c60-9c6d-ae3cd549762c tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:52.088718 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2428/4894] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:52.113837 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24589f-dc79-4fb0-8ee1-1faeda81edba None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:52.115688 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9b24589f-dc79-4fb0-8ee1-1faeda81edba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:52.122112 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2467/4895] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:10:51 2022] POST /identity/v3/users => generated 416 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:10:52.125520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd149c-6443-4c60-9c6d-ae3cd549762c tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:52.134962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e0bd149c-6443-4c60-9c6d-ae3cd549762c tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:52.162806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd149c-6443-4c60-9c6d-ae3cd549762c tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:52.174520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f60775-be2c-4fee-9d86-f8457bea00ed tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:52.175187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f60775-be2c-4fee-9d86-f8457bea00ed tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:52.175473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f60775-be2c-4fee-9d86-f8457bea00ed tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:52.175894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f60775-be2c-4fee-9d86-f8457bea00ed tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:52.176559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f60775-be2c-4fee-9d86-f8457bea00ed tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:52.178482 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f60775-be2c-4fee-9d86-f8457bea00ed tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:52.185623 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:INSERT=6,keystone:DELETE=1,keystone:SELECT=93 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:52.208500 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2468/4896] 10.222.0.33 () {60 vars in 1143 bytes} [Sat Aug 6 21:10:52 2022] POST /identity/v3/roles => generated 243 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:52.216659 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f60775-be2c-4fee-9d86-f8457bea00ed tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:52.242487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24589f-dc79-4fb0-8ee1-1faeda81edba None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:52.249130 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f60775-be2c-4fee-9d86-f8457bea00ed tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:52.251609 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2294b8b-f8c9-4d37-b77d-1b54cc5bac6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:52.252548 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2294b8b-f8c9-4d37-b77d-1b54cc5bac6b service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:52.252965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2294b8b-f8c9-4d37-b77d-1b54cc5bac6b service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:52.254075 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2294b8b-f8c9-4d37-b77d-1b54cc5bac6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:52.256893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0aca1-5465-4ffc-b379-994c28e3b809 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:52.258918 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0aca1-5465-4ffc-b379-994c28e3b809 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:52.259489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0aca1-5465-4ffc-b379-994c28e3b809 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:52.259845 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0aca1-5465-4ffc-b379-994c28e3b809 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:52.260962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c0aca1-5465-4ffc-b379-994c28e3b809 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:52.263634 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c0aca1-5465-4ffc-b379-994c28e3b809 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:52.276353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2294b8b-f8c9-4d37-b77d-1b54cc5bac6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:52.279792 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2294b8b-f8c9-4d37-b77d-1b54cc5bac6b service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:52.287230 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2469/4897] 10.222.0.33 () {60 vars in 1143 bytes} [Sat Aug 6 21:10:52 2022] POST /identity/v3/roles => generated 247 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:52.291318 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0aca1-5465-4ffc-b379-994c28e3b809 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:52.308337 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2429/4898] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:10:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:10:52.317985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0aca1-5465-4ffc-b379-994c28e3b809 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:52.326448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ac71a-ae8c-48a9-9285-aa4813b3b91e tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:52.329398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ac71a-ae8c-48a9-9285-aa4813b3b91e tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:52.329874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ac71a-ae8c-48a9-9285-aa4813b3b91e tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:52.330298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ac71a-ae8c-48a9-9285-aa4813b3b91e tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/projects/56a385c703fe444f81ab5c50a1a104fe/users/57094b6c827c4f3e947bd1a2ae9d6c8f/roles/6faed82a743542e0b33fb0501e471c96` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:52.348424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859ac71a-ae8c-48a9-9285-aa4813b3b91e tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:create_grant(project_id=56a385c703fe444f81ab5c50a1a104fe, user_id=57094b6c827c4f3e947bd1a2ae9d6c8f, role_id=6faed82a743542e0b33fb0501e471c96)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:52.351537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859ac71a-ae8c-48a9-9285-aa4813b3b91e tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:52.372232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2294b8b-f8c9-4d37-b77d-1b54cc5bac6b service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:52.372904 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2470/4899] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:10:52 2022] PUT /identity/v3/projects/56a385c703fe444f81ab5c50a1a104fe/users/57094b6c827c4f3e947bd1a2ae9d6c8f/roles/6faed82a743542e0b33fb0501e471c96 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:52.385742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2294b8b-f8c9-4d37-b77d-1b54cc5bac6b service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:52.463406 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8add6-5f95-458c-9e98-fef9c8c9c73b tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:52.464355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8add6-5f95-458c-9e98-fef9c8c9c73b tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:52.464640 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8add6-5f95-458c-9e98-fef9c8c9c73b tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:52.465007 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8add6-5f95-458c-9e98-fef9c8c9c73b tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/projects/56a385c703fe444f81ab5c50a1a104fe/users/57094b6c827c4f3e947bd1a2ae9d6c8f/roles/5a535963b4ad44e4a41a9fc5462ca6f7` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:52.470656 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8add6-5f95-458c-9e98-fef9c8c9c73b tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:create_grant(project_id=56a385c703fe444f81ab5c50a1a104fe, user_id=57094b6c827c4f3e947bd1a2ae9d6c8f, role_id=5a535963b4ad44e4a41a9fc5462ca6f7)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:52.475118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8add6-5f95-458c-9e98-fef9c8c9c73b tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:52.514409 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2430/4900] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:10:52 2022] PUT /identity/v3/projects/56a385c703fe444f81ab5c50a1a104fe/users/57094b6c827c4f3e947bd1a2ae9d6c8f/roles/5a535963b4ad44e4a41a9fc5462ca6f7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:10:52.518405 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ac71a-ae8c-48a9-9285-aa4813b3b91e tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:52.533568 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ac71a-ae8c-48a9-9285-aa4813b3b91e tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:52.636876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeca751-016e-4481-bf06-4ba4a08b503f tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:52.637628 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeca751-016e-4481-bf06-4ba4a08b503f tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:52.637985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeca751-016e-4481-bf06-4ba4a08b503f tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:52.638416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeca751-016e-4481-bf06-4ba4a08b503f tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:52.639199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeca751-016e-4481-bf06-4ba4a08b503f tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:52.643634 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeca751-016e-4481-bf06-4ba4a08b503f tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:52.693686 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2471/4901] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:52 2022] GET /identity/v3/users => generated 8064 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:52.697397 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da57fc2-7c17-4435-8b7d-d6b802374c52 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:52.698389 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da57fc2-7c17-4435-8b7d-d6b802374c52 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:52.699194 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da57fc2-7c17-4435-8b7d-d6b802374c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:52.767731 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-2da57fc2-7c17-4435-8b7d-d6b802374c52 None None] MFA Rules not processed for user `57094b6c827c4f3e947bd1a2ae9d6c8f`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:52.769599 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2da57fc2-7c17-4435-8b7d-d6b802374c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:52.871920 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2431/4902] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:52 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:52.879155 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415fb59-37c5-4cc2-806e-9fcc5859eb1e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:52.879443 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415fb59-37c5-4cc2-806e-9fcc5859eb1e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:52.879719 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415fb59-37c5-4cc2-806e-9fcc5859eb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:52.929775 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-4415fb59-37c5-4cc2-806e-9fcc5859eb1e None None] MFA Rules not processed for user `57094b6c827c4f3e947bd1a2ae9d6c8f`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:52.931040 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4415fb59-37c5-4cc2-806e-9fcc5859eb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:52.952786 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2472/4903] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:52 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:52.956829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da57fc2-7c17-4435-8b7d-d6b802374c52 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:52.973642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da57fc2-7c17-4435-8b7d-d6b802374c52 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:52.978304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9874a552-2107-452a-b7fa-07d1085f55bf tempest-TrustsV3TestJSON-1670392584 tempest-user-1682230385] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57094b6c827c4f3e947bd1a2ae9d6c8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56a385c703fe444f81ab5c50a1a104fe', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1256140129', 'tempest-DelegatedRole-914302634'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:52.979086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874a552-2107-452a-b7fa-07d1085f55bf tempest-TrustsV3TestJSON-1670392584 tempest-user-1682230385] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:52.979469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874a552-2107-452a-b7fa-07d1085f55bf tempest-TrustsV3TestJSON-1670392584 tempest-user-1682230385] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:52.979847 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874a552-2107-452a-b7fa-07d1085f55bf tempest-TrustsV3TestJSON-1670392584 tempest-user-1682230385] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:52.981183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9874a552-2107-452a-b7fa-07d1085f55bf tempest-TrustsV3TestJSON-1670392584 tempest-user-1682230385] RBAC: Authorizing `identity:create_trust()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:52.982492 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9874a552-2107-452a-b7fa-07d1085f55bf tempest-TrustsV3TestJSON-1670392584 tempest-user-1682230385] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:53.001919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:53.102714 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2432/4904] 10.222.0.33 () {60 vars in 1174 bytes} [Sat Aug 6 21:10:52 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:53.106714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415fb59-37c5-4cc2-806e-9fcc5859eb1e None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:53.117422 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415fb59-37c5-4cc2-806e-9fcc5859eb1e None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:53.122170 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727dcee5-3e1d-4715-a6c2-5cf813d543b5 tempest-TrustsV3TestJSON-1670392584 tempest-user-1682230385] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57094b6c827c4f3e947bd1a2ae9d6c8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56a385c703fe444f81ab5c50a1a104fe', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1256140129', 'tempest-DelegatedRole-914302634'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:53.122941 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727dcee5-3e1d-4715-a6c2-5cf813d543b5 tempest-TrustsV3TestJSON-1670392584 tempest-user-1682230385] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:53.123321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727dcee5-3e1d-4715-a6c2-5cf813d543b5 tempest-TrustsV3TestJSON-1670392584 tempest-user-1682230385] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:53.123892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727dcee5-3e1d-4715-a6c2-5cf813d543b5 tempest-TrustsV3TestJSON-1670392584 tempest-user-1682230385] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:53.125208 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727dcee5-3e1d-4715-a6c2-5cf813d543b5 tempest-TrustsV3TestJSON-1670392584 tempest-user-1682230385] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:53.126390 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727dcee5-3e1d-4715-a6c2-5cf813d543b5 tempest-TrustsV3TestJSON-1670392584 tempest-user-1682230385] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:53.134923 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2473/4905] 10.222.0.33 () {58 vars in 1252 bytes} [Sat Aug 6 21:10:53 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=57094b6c827c4f3e947bd1a2ae9d6c8f => generated 611 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:53.139770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9874a552-2107-452a-b7fa-07d1085f55bf tempest-TrustsV3TestJSON-1670392584 tempest-user-1682230385] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:53.152840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9874a552-2107-452a-b7fa-07d1085f55bf tempest-TrustsV3TestJSON-1670392584 tempest-user-1682230385] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:53.161402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c57dea-d08a-4e33-b32e-4d55a766dec9 tempest-TrustsV3TestJSON-1670392584 tempest-user-1682230385] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57094b6c827c4f3e947bd1a2ae9d6c8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56a385c703fe444f81ab5c50a1a104fe', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1256140129', 'tempest-DelegatedRole-914302634'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:53.162352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c57dea-d08a-4e33-b32e-4d55a766dec9 tempest-TrustsV3TestJSON-1670392584 tempest-user-1682230385] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:53.162756 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c57dea-d08a-4e33-b32e-4d55a766dec9 tempest-TrustsV3TestJSON-1670392584 tempest-user-1682230385] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:53.163137 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c57dea-d08a-4e33-b32e-4d55a766dec9 tempest-TrustsV3TestJSON-1670392584 tempest-user-1682230385] PATH_INFO: `/v3/OS-TRUST/trusts/d37ed74990274fdab959aa54458be1d4` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:53.176611 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c57dea-d08a-4e33-b32e-4d55a766dec9 tempest-TrustsV3TestJSON-1670392584 tempest-user-1682230385] RBAC: Authorizing `identity:delete_trust(trust_id=d37ed74990274fdab959aa54458be1d4)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:53.178199 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c57dea-d08a-4e33-b32e-4d55a766dec9 tempest-TrustsV3TestJSON-1670392584 tempest-user-1682230385] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:53.204062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-89c57dea-d08a-4e33-b32e-4d55a766dec9 tempest-TrustsV3TestJSON-1670392584 tempest-user-1682230385] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'd37ed74990274fdab959aa54458be1d4', 'request_id': 'req-89c57dea-d08a-4e33-b32e-4d55a766dec9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:53.205409 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-89c57dea-d08a-4e33-b32e-4d55a766dec9 tempest-TrustsV3TestJSON-1670392584 tempest-user-1682230385] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'd37ed74990274fdab959aa54458be1d4', 'request_id': 'req-89c57dea-d08a-4e33-b32e-4d55a766dec9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:53.206264 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-89c57dea-d08a-4e33-b32e-4d55a766dec9 tempest-TrustsV3TestJSON-1670392584 tempest-user-1682230385] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'd37ed74990274fdab959aa54458be1d4', 'request_id': 'req-89c57dea-d08a-4e33-b32e-4d55a766dec9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:53.225702 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2433/4906] 10.222.0.33 () {58 vars in 1254 bytes} [Sat Aug 6 21:10:53 2022] DELETE /identity/v3/OS-TRUST/trusts/d37ed74990274fdab959aa54458be1d4 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:53.230315 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727dcee5-3e1d-4715-a6c2-5cf813d543b5 tempest-TrustsV3TestJSON-1670392584 tempest-user-1682230385] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:53.232298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-727dcee5-3e1d-4715-a6c2-5cf813d543b5 tempest-TrustsV3TestJSON-1670392584 tempest-user-1682230385] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:53.249555 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727dcee5-3e1d-4715-a6c2-5cf813d543b5 tempest-TrustsV3TestJSON-1670392584 tempest-user-1682230385] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:53.255393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368db196-94d5-41c3-889d-42b13174c918 tempest-TrustsV3TestJSON-1670392584 tempest-user-1682230385] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57094b6c827c4f3e947bd1a2ae9d6c8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56a385c703fe444f81ab5c50a1a104fe', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1256140129', 'tempest-DelegatedRole-914302634'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:53.256186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368db196-94d5-41c3-889d-42b13174c918 tempest-TrustsV3TestJSON-1670392584 tempest-user-1682230385] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:53.256595 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368db196-94d5-41c3-889d-42b13174c918 tempest-TrustsV3TestJSON-1670392584 tempest-user-1682230385] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:53.256969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368db196-94d5-41c3-889d-42b13174c918 tempest-TrustsV3TestJSON-1670392584 tempest-user-1682230385] PATH_INFO: `/v3/OS-TRUST/trusts/d37ed74990274fdab959aa54458be1d4` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:53.270036 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-368db196-94d5-41c3-889d-42b13174c918 tempest-TrustsV3TestJSON-1670392584 tempest-user-1682230385] Could not find trust: d37ed74990274fdab959aa54458be1d4.: keystone.exception.TrustNotFound: Could not find trust: d37ed74990274fdab959aa54458be1d4. Aug 06 21:10:53.270036 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:10:53.270036 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:10:53.270036 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:10:53.270036 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:10:53.270036 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:10:53.270036 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:10:53.270036 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:10:53.270036 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:10:53.270036 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:10:53.270036 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:10:53.270036 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:10:53.270036 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 06 21:10:53.270036 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 06 21:10:53.270036 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 06 21:10:53.271094 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 06 21:10:53.271094 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 06 21:10:53.271094 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 06 21:10:53.271094 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 06 21:10:53.271094 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 06 21:10:53.271094 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:10:53.271094 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:10:53.271094 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 06 21:10:53.271094 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 06 21:10:53.271094 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 06 21:10:53.271094 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 06 21:10:53.271094 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: d37ed74990274fdab959aa54458be1d4. Aug 06 21:10:53.271094 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:10:53.278036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c57dea-d08a-4e33-b32e-4d55a766dec9 tempest-TrustsV3TestJSON-1670392584 tempest-user-1682230385] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:53.279008 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2474/4907] 10.222.0.33 () {58 vars in 1251 bytes} [Sat Aug 6 21:10:53 2022] GET /identity/v3/OS-TRUST/trusts/d37ed74990274fdab959aa54458be1d4 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:10:53.279822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-89c57dea-d08a-4e33-b32e-4d55a766dec9 tempest-TrustsV3TestJSON-1670392584 tempest-user-1682230385] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:53.299086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c57dea-d08a-4e33-b32e-4d55a766dec9 tempest-TrustsV3TestJSON-1670392584 tempest-user-1682230385] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:53.305943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b01d98-9c28-44c7-959b-e3dae68419cb tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:53.306899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b01d98-9c28-44c7-959b-e3dae68419cb tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:53.307644 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b01d98-9c28-44c7-959b-e3dae68419cb tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:53.308039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b01d98-9c28-44c7-959b-e3dae68419cb tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/roles/5a535963b4ad44e4a41a9fc5462ca6f7` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:53.310627 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b01d98-9c28-44c7-959b-e3dae68419cb tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5a535963b4ad44e4a41a9fc5462ca6f7)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:53.315738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b01d98-9c28-44c7-959b-e3dae68419cb tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:53.329929 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368db196-94d5-41c3-889d-42b13174c918 tempest-TrustsV3TestJSON-1670392584 tempest-user-1682230385] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:53.331797 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-368db196-94d5-41c3-889d-42b13174c918 tempest-TrustsV3TestJSON-1670392584 tempest-user-1682230385] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:53.413147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b8b01d98-9c28-44c7-959b-e3dae68419cb tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invalidating the token cache because role 5a535963b4ad44e4a41a9fc5462ca6f7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:53.413445 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b8b01d98-9c28-44c7-959b-e3dae68419cb tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:53.414437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b8b01d98-9c28-44c7-959b-e3dae68419cb tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:53.416951 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2434/4908] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:53 2022] DELETE /identity/v3/roles/5a535963b4ad44e4a41a9fc5462ca6f7 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:53.421742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b01d98-9c28-44c7-959b-e3dae68419cb tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:53.423178 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b8b01d98-9c28-44c7-959b-e3dae68419cb tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:53.445527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368db196-94d5-41c3-889d-42b13174c918 tempest-TrustsV3TestJSON-1670392584 tempest-user-1682230385] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:53.508973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:53.564339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b01d98-9c28-44c7-959b-e3dae68419cb tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:53.571530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cdbd56-8289-4d54-8a0e-bf1c9f062961 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:53.572422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdbd56-8289-4d54-8a0e-bf1c9f062961 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:53.572714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdbd56-8289-4d54-8a0e-bf1c9f062961 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:53.573120 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdbd56-8289-4d54-8a0e-bf1c9f062961 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/roles/6faed82a743542e0b33fb0501e471c96` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:53.573767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb0aba-a291-4f3a-8bb2-76242c461fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:53.574429 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb0aba-a291-4f3a-8bb2-76242c461fc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:53.574598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cdbd56-8289-4d54-8a0e-bf1c9f062961 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6faed82a743542e0b33fb0501e471c96)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:53.574720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb0aba-a291-4f3a-8bb2-76242c461fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:53.575064 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb0aba-a291-4f3a-8bb2-76242c461fc9 admin admin] PATH_INFO: `/v3/users/8b7ac06540414930b1e7753de17a13da` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:53.576253 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb0aba-a291-4f3a-8bb2-76242c461fc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b7ac06540414930b1e7753de17a13da)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:53.576460 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cdbd56-8289-4d54-8a0e-bf1c9f062961 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:53.578854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb0aba-a291-4f3a-8bb2-76242c461fc9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:53.615498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:53.645835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-52cdbd56-8289-4d54-8a0e-bf1c9f062961 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invalidating the token cache because role 6faed82a743542e0b33fb0501e471c96 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:53.646226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-52cdbd56-8289-4d54-8a0e-bf1c9f062961 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:53.646936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-52cdbd56-8289-4d54-8a0e-bf1c9f062961 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:53.654341 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2435/4909] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:53 2022] DELETE /identity/v3/roles/6faed82a743542e0b33fb0501e471c96 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:10:53.654341 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cdbd56-8289-4d54-8a0e-bf1c9f062961 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:53.654341 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-52cdbd56-8289-4d54-8a0e-bf1c9f062961 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:53.662882 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-02cb0aba-a291-4f3a-8bb2-76242c461fc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b7ac06540414930b1e7753de17a13da'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:53.687752 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-02cb0aba-a291-4f3a-8bb2-76242c461fc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b7ac06540414930b1e7753de17a13da'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:53.689282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-02cb0aba-a291-4f3a-8bb2-76242c461fc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b7ac06540414930b1e7753de17a13da'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:53.690024 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-02cb0aba-a291-4f3a-8bb2-76242c461fc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b7ac06540414930b1e7753de17a13da'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:53.704095 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-02cb0aba-a291-4f3a-8bb2-76242c461fc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b7ac06540414930b1e7753de17a13da'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:53.733463 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2475/4910] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:53 2022] DELETE /identity/v3/users/8b7ac06540414930b1e7753de17a13da => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:53.733463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb0aba-a291-4f3a-8bb2-76242c461fc9 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:53.733463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-02cb0aba-a291-4f3a-8bb2-76242c461fc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:53.789368 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cdbd56-8289-4d54-8a0e-bf1c9f062961 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:53.817305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb0aba-a291-4f3a-8bb2-76242c461fc9 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:53.822536 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca8d6ab-1549-4469-874e-833f03e549bd tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:53.823237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8d6ab-1549-4469-874e-833f03e549bd tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:53.823522 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8d6ab-1549-4469-874e-833f03e549bd tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:53.823802 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8d6ab-1549-4469-874e-833f03e549bd tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/users/57094b6c827c4f3e947bd1a2ae9d6c8f` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:53.824948 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca8d6ab-1549-4469-874e-833f03e549bd tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:delete_user(user_id=57094b6c827c4f3e947bd1a2ae9d6c8f)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:53.826929 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca8d6ab-1549-4469-874e-833f03e549bd tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:53.869314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd5735-91dd-4a30-a33d-e37ad763ef08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:53.869837 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd5735-91dd-4a30-a33d-e37ad763ef08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:53.870118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd5735-91dd-4a30-a33d-e37ad763ef08 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:53.870401 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd5735-91dd-4a30-a33d-e37ad763ef08 admin admin] PATH_INFO: `/v3/projects/b2372e3caffc48689c7cf829f77d24ef` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:53.871601 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fd5735-91dd-4a30-a33d-e37ad763ef08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2372e3caffc48689c7cf829f77d24ef)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:53.873521 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fd5735-91dd-4a30-a33d-e37ad763ef08 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:53.883759 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cca8d6ab-1549-4469-874e-833f03e549bd tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57094b6c827c4f3e947bd1a2ae9d6c8f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:53.896342 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cca8d6ab-1549-4469-874e-833f03e549bd tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57094b6c827c4f3e947bd1a2ae9d6c8f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:53.897273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cca8d6ab-1549-4469-874e-833f03e549bd tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57094b6c827c4f3e947bd1a2ae9d6c8f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:53.898458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cca8d6ab-1549-4469-874e-833f03e549bd tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57094b6c827c4f3e947bd1a2ae9d6c8f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:53.902580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:53.910344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cca8d6ab-1549-4469-874e-833f03e549bd tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57094b6c827c4f3e947bd1a2ae9d6c8f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:53.945012 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2476/4911] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:53 2022] DELETE /identity/v3/users/57094b6c827c4f3e947bd1a2ae9d6c8f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:53.945012 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a10157-e452-4170-a6a5-f440ca45fe6c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:53.945331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a10157-e452-4170-a6a5-f440ca45fe6c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:53.946866 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a10157-e452-4170-a6a5-f440ca45fe6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:53.980403 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-94fd5735-91dd-4a30-a33d-e37ad763ef08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2372e3caffc48689c7cf829f77d24ef', 'request_id': 'req-94fd5735-91dd-4a30-a33d-e37ad763ef08'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:54.003285 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-94fd5735-91dd-4a30-a33d-e37ad763ef08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2372e3caffc48689c7cf829f77d24ef', 'request_id': 'req-94fd5735-91dd-4a30-a33d-e37ad763ef08'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:54.028554 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-40a10157-e452-4170-a6a5-f440ca45fe6c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:54.029735 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-94fd5735-91dd-4a30-a33d-e37ad763ef08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2372e3caffc48689c7cf829f77d24ef', 'request_id': 'req-94fd5735-91dd-4a30-a33d-e37ad763ef08'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:54.032935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-40a10157-e452-4170-a6a5-f440ca45fe6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:54.054855 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-94fd5735-91dd-4a30-a33d-e37ad763ef08 admin admin] The token cache is being invalidate because project b2372e3caffc48689c7cf829f77d24ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:54.055262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-94fd5735-91dd-4a30-a33d-e37ad763ef08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:54.056111 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-94fd5735-91dd-4a30-a33d-e37ad763ef08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:54.058122 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2436/4912] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:10:53 2022] DELETE /identity/v3/projects/b2372e3caffc48689c7cf829f77d24ef => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:54.059616 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd5735-91dd-4a30-a33d-e37ad763ef08 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:54.062446 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-94fd5735-91dd-4a30-a33d-e37ad763ef08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:54.102831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:54.169057 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2477/4913] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:54.170380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d7f37-0e85-4eed-8605-fb194e884ec6 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:54.171239 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d7f37-0e85-4eed-8605-fb194e884ec6 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:54.171507 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d7f37-0e85-4eed-8605-fb194e884ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:54.196233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd5735-91dd-4a30-a33d-e37ad763ef08 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:54.209846 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-1d2d7f37-0e85-4eed-8605-fb194e884ec6 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:54.211178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1d2d7f37-0e85-4eed-8605-fb194e884ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:54.228625 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2478/4914] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:54.230203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d7f37-0e85-4eed-8605-fb194e884ec6 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:54.231360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1d2d7f37-0e85-4eed-8605-fb194e884ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:54.282164 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56ac0b-b5e0-4e8d-a0b1-6e3bd7a246f1 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:54.282839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56ac0b-b5e0-4e8d-a0b1-6e3bd7a246f1 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:54.283239 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56ac0b-b5e0-4e8d-a0b1-6e3bd7a246f1 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:54.283393 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56ac0b-b5e0-4e8d-a0b1-6e3bd7a246f1 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/projects/56a385c703fe444f81ab5c50a1a104fe` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:54.284531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56ac0b-b5e0-4e8d-a0b1-6e3bd7a246f1 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:delete_project(project_id=56a385c703fe444f81ab5c50a1a104fe)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:54.286773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56ac0b-b5e0-4e8d-a0b1-6e3bd7a246f1 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:54.298952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d7f37-0e85-4eed-8605-fb194e884ec6 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:54.303062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2cd1df-46b5-41bb-90ab-ea2cc076d783 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:54.303673 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cd1df-46b5-41bb-90ab-ea2cc076d783 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:54.303957 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cd1df-46b5-41bb-90ab-ea2cc076d783 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:54.304229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cd1df-46b5-41bb-90ab-ea2cc076d783 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:54.316262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2cd1df-46b5-41bb-90ab-ea2cc076d783 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:54.317707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2cd1df-46b5-41bb-90ab-ea2cc076d783 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:54.353679 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2479/4915] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:10:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:10:54.355443 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6af695-e206-466d-afb5-9efd6e7f8a02 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:54.355728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6af695-e206-466d-afb5-9efd6e7f8a02 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:54.355993 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6af695-e206-466d-afb5-9efd6e7f8a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:54.379048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8a56ac0b-b5e0-4e8d-a0b1-6e3bd7a246f1 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56a385c703fe444f81ab5c50a1a104fe', 'request_id': 'req-8a56ac0b-b5e0-4e8d-a0b1-6e3bd7a246f1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:54.389081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8a56ac0b-b5e0-4e8d-a0b1-6e3bd7a246f1 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56a385c703fe444f81ab5c50a1a104fe', 'request_id': 'req-8a56ac0b-b5e0-4e8d-a0b1-6e3bd7a246f1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:54.389262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-1a6af695-e206-466d-afb5-9efd6e7f8a02 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:54.391283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1a6af695-e206-466d-afb5-9efd6e7f8a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:54.397733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8a56ac0b-b5e0-4e8d-a0b1-6e3bd7a246f1 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56a385c703fe444f81ab5c50a1a104fe', 'request_id': 'req-8a56ac0b-b5e0-4e8d-a0b1-6e3bd7a246f1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:54.420883 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8a56ac0b-b5e0-4e8d-a0b1-6e3bd7a246f1 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] The token cache is being invalidate because project 56a385c703fe444f81ab5c50a1a104fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:54.421269 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8a56ac0b-b5e0-4e8d-a0b1-6e3bd7a246f1 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:54.421893 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8a56ac0b-b5e0-4e8d-a0b1-6e3bd7a246f1 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:54.428732 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2437/4916] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:10:54 2022] DELETE /identity/v3/projects/56a385c703fe444f81ab5c50a1a104fe => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:54.431190 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56ac0b-b5e0-4e8d-a0b1-6e3bd7a246f1 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:54.432591 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8a56ac0b-b5e0-4e8d-a0b1-6e3bd7a246f1 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:54.521662 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2480/4917] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:54.524916 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6af695-e206-466d-afb5-9efd6e7f8a02 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:54.542783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6af695-e206-466d-afb5-9efd6e7f8a02 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:54.551498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56ac0b-b5e0-4e8d-a0b1-6e3bd7a246f1 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:54.556891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db00c92-dc3e-4da1-b3f2-1011f811ec85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:54.557785 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db00c92-dc3e-4da1-b3f2-1011f811ec85 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:54.558084 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db00c92-dc3e-4da1-b3f2-1011f811ec85 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:54.558398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db00c92-dc3e-4da1-b3f2-1011f811ec85 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:54.559230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db00c92-dc3e-4da1-b3f2-1011f811ec85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:10:54.559798 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db00c92-dc3e-4da1-b3f2-1011f811ec85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:54.561147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3031cb-38f9-4030-8a2f-6a6d0fd95606 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:54.561960 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db00c92-dc3e-4da1-b3f2-1011f811ec85 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:54.563036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3031cb-38f9-4030-8a2f-6a6d0fd95606 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:54.563528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3031cb-38f9-4030-8a2f-6a6d0fd95606 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:54.563977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3031cb-38f9-4030-8a2f-6a6d0fd95606 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:54.565098 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3031cb-38f9-4030-8a2f-6a6d0fd95606 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:54.568576 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3031cb-38f9-4030-8a2f-6a6d0fd95606 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:54.579232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:54.579805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:54.588162 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2481/4918] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:54.590562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db00c92-dc3e-4da1-b3f2-1011f811ec85 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:54.622214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db00c92-dc3e-4da1-b3f2-1011f811ec85 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:54.628510 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58a1a6-2665-432f-9fdc-a54236b954f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:54.628908 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2438/4919] 10.222.0.33 () {60 vars in 1152 bytes} [Sat Aug 6 21:10:54 2022] POST /identity/v3/projects => generated 329 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:54.631588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58a1a6-2665-432f-9fdc-a54236b954f4 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:54.632020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58a1a6-2665-432f-9fdc-a54236b954f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:54.632242 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58a1a6-2665-432f-9fdc-a54236b954f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:54.632800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58a1a6-2665-432f-9fdc-a54236b954f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:54.634140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3031cb-38f9-4030-8a2f-6a6d0fd95606 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:54.636943 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58a1a6-2665-432f-9fdc-a54236b954f4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:54.677616 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2482/4920] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:10:54 2022] POST /identity/v3/projects => generated 361 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:54.686109 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58a1a6-2665-432f-9fdc-a54236b954f4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:54.748109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3031cb-38f9-4030-8a2f-6a6d0fd95606 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:54.816860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58a1a6-2665-432f-9fdc-a54236b954f4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:54.824730 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e2d55-77b5-4835-9f40-6b25149759ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:54.825673 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e2d55-77b5-4835-9f40-6b25149759ea admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:54.826192 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e2d55-77b5-4835-9f40-6b25149759ea admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:54.826713 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e2d55-77b5-4835-9f40-6b25149759ea admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:54.827901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e2d55-77b5-4835-9f40-6b25149759ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:54.830485 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e2d55-77b5-4835-9f40-6b25149759ea admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:54.842355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b659631-8dfc-44ca-8438-5ac49637da80 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:54.843034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b659631-8dfc-44ca-8438-5ac49637da80 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:54.843319 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b659631-8dfc-44ca-8438-5ac49637da80 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:54.843682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b659631-8dfc-44ca-8438-5ac49637da80 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:54.844553 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b659631-8dfc-44ca-8438-5ac49637da80 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:54.848744 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b659631-8dfc-44ca-8438-5ac49637da80 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:54.862357 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2483/4921] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:10:54 2022] POST /identity/v3/users => generated 281 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:54.865979 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e2d55-77b5-4835-9f40-6b25149759ea admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:54.882812 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e2d55-77b5-4835-9f40-6b25149759ea admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:54.891105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ca812-999e-4e9d-ae2c-045cecfcfdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:54.892044 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ca812-999e-4e9d-ae2c-045cecfcfdb9 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:54.892522 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ca812-999e-4e9d-ae2c-045cecfcfdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:54.892694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ca812-999e-4e9d-ae2c-045cecfcfdb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:54.894161 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ca812-999e-4e9d-ae2c-045cecfcfdb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:54.896134 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ca812-999e-4e9d-ae2c-045cecfcfdb9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:54.899050 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2439/4922] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:10:54 2022] POST /identity/v3/users => generated 416 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:54.905985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b659631-8dfc-44ca-8438-5ac49637da80 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:54.912359 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2484/4923] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:10:54.916943 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ca812-999e-4e9d-ae2c-045cecfcfdb9 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:54.924908 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b659631-8dfc-44ca-8438-5ac49637da80 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:54.932430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c984c83-107c-4164-8d0e-1d9537dcfe98 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:54.933259 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c984c83-107c-4164-8d0e-1d9537dcfe98 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:54.933742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c984c83-107c-4164-8d0e-1d9537dcfe98 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:54.934207 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c984c83-107c-4164-8d0e-1d9537dcfe98 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:54.935172 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c984c83-107c-4164-8d0e-1d9537dcfe98 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:54.937740 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c984c83-107c-4164-8d0e-1d9537dcfe98 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:54.940929 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ca812-999e-4e9d-ae2c-045cecfcfdb9 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:54.950661 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d77b4-8371-4d7d-8cc6-97cf2c5f251d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:54.951298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d77b4-8371-4d7d-8cc6-97cf2c5f251d admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:54.951653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d77b4-8371-4d7d-8cc6-97cf2c5f251d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:54.951974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d77b4-8371-4d7d-8cc6-97cf2c5f251d admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:54.953794 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d77b4-8371-4d7d-8cc6-97cf2c5f251d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:54.955732 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d77b4-8371-4d7d-8cc6-97cf2c5f251d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:54.968629 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2440/4924] 10.222.0.33 () {60 vars in 1143 bytes} [Sat Aug 6 21:10:54 2022] POST /identity/v3/roles => generated 243 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:54.972584 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c984c83-107c-4164-8d0e-1d9537dcfe98 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:54.984024 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2485/4925] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:54 2022] GET /identity/v3/roles => generated 1654 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:54.987097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d77b4-8371-4d7d-8cc6-97cf2c5f251d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:54.987626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c984c83-107c-4164-8d0e-1d9537dcfe98 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:54.993723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fd063-28f3-4c57-9c60-96b74017faa1 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:54.994781 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fd063-28f3-4c57-9c60-96b74017faa1 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:54.995707 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fd063-28f3-4c57-9c60-96b74017faa1 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:54.996081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fd063-28f3-4c57-9c60-96b74017faa1 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:54.996911 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595fd063-28f3-4c57-9c60-96b74017faa1 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:54.998565 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d77b4-8371-4d7d-8cc6-97cf2c5f251d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:55.000234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595fd063-28f3-4c57-9c60-96b74017faa1 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:55.005761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423a858-9c66-44f6-854c-02d19899764e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:55.006560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423a858-9c66-44f6-854c-02d19899764e admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:55.006935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423a858-9c66-44f6-854c-02d19899764e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:55.007652 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423a858-9c66-44f6-854c-02d19899764e admin admin] PATH_INFO: `/v3/projects/beba9c837a8e4c4cabdf00b9fb907738/users/26822e8f172544e782ffc285443947b5/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:55.022719 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2441/4926] 10.222.0.33 () {60 vars in 1143 bytes} [Sat Aug 6 21:10:54 2022] POST /identity/v3/roles => generated 247 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:10:55.025573 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fd063-28f3-4c57-9c60-96b74017faa1 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:55.031972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423a858-9c66-44f6-854c-02d19899764e admin admin] RBAC: Authorizing `identity:create_grant(project_id=beba9c837a8e4c4cabdf00b9fb907738, user_id=26822e8f172544e782ffc285443947b5, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:55.036198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423a858-9c66-44f6-854c-02d19899764e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:55.039393 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fd063-28f3-4c57-9c60-96b74017faa1 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:55.046813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe492ef8-1ff6-4e42-9875-14a13501c37d tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:55.047797 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe492ef8-1ff6-4e42-9875-14a13501c37d tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:55.048056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe492ef8-1ff6-4e42-9875-14a13501c37d tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:55.048313 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe492ef8-1ff6-4e42-9875-14a13501c37d tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/projects/f2ffeebb1e8846e98073bf8d8befa335/users/aac4a5641ec84b20b57e865a6bc2056a/roles/2e34664624374c9b8a42e1e9e45cd55a` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:55.066013 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2486/4927] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:10:54 2022] PUT /identity/v3/projects/beba9c837a8e4c4cabdf00b9fb907738/users/26822e8f172544e782ffc285443947b5/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:55.077078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1f0f6-979e-453c-857a-ad617f117a4b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:55.077502 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1f0f6-979e-453c-857a-ad617f117a4b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:55.078003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1f0f6-979e-453c-857a-ad617f117a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:55.091738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe492ef8-1ff6-4e42-9875-14a13501c37d tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f2ffeebb1e8846e98073bf8d8befa335, user_id=aac4a5641ec84b20b57e865a6bc2056a, role_id=2e34664624374c9b8a42e1e9e45cd55a)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:55.096541 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe492ef8-1ff6-4e42-9875-14a13501c37d tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:55.109387 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a6b1f0f6-979e-453c-857a-ad617f117a4b None None] MFA Rules not processed for user `26822e8f172544e782ffc285443947b5`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:55.111701 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a6b1f0f6-979e-453c-857a-ad617f117a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:55.119449 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2442/4928] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:10:55 2022] PUT /identity/v3/projects/f2ffeebb1e8846e98073bf8d8befa335/users/aac4a5641ec84b20b57e865a6bc2056a/roles/2e34664624374c9b8a42e1e9e45cd55a => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:55.122338 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe492ef8-1ff6-4e42-9875-14a13501c37d tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:55.172675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:55.210031 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2487/4929] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:55.214644 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe492ef8-1ff6-4e42-9875-14a13501c37d tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:55.215098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e05fe-526d-4bad-963a-2947c39dbd21 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:55.215512 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e05fe-526d-4bad-963a-2947c39dbd21 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:55.215802 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e05fe-526d-4bad-963a-2947c39dbd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:55.220888 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac7d43-c12f-460c-aa8c-0dd4565f0a1d tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:55.221579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac7d43-c12f-460c-aa8c-0dd4565f0a1d tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:55.221859 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac7d43-c12f-460c-aa8c-0dd4565f0a1d tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:55.222132 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac7d43-c12f-460c-aa8c-0dd4565f0a1d tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/projects/f2ffeebb1e8846e98073bf8d8befa335/users/aac4a5641ec84b20b57e865a6bc2056a/roles/e6fa487815b84542a58facf4f9dc6c28` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:55.224562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac7d43-c12f-460c-aa8c-0dd4565f0a1d tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f2ffeebb1e8846e98073bf8d8befa335, user_id=aac4a5641ec84b20b57e865a6bc2056a, role_id=e6fa487815b84542a58facf4f9dc6c28)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:55.227474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac7d43-c12f-460c-aa8c-0dd4565f0a1d tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:55.249784 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2443/4930] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:10:55 2022] PUT /identity/v3/projects/f2ffeebb1e8846e98073bf8d8befa335/users/aac4a5641ec84b20b57e865a6bc2056a/roles/e6fa487815b84542a58facf4f9dc6c28 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:55.254318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac7d43-c12f-460c-aa8c-0dd4565f0a1d tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:55.272135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-869e05fe-526d-4bad-963a-2947c39dbd21 None None] MFA Rules not processed for user `26822e8f172544e782ffc285443947b5`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:55.273372 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-869e05fe-526d-4bad-963a-2947c39dbd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:55.280997 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2488/4931] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:55 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 21:10:55.298016 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e29b15-960b-4db0-9cbb-b3dcf7ecea7e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:55.298301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e29b15-960b-4db0-9cbb-b3dcf7ecea7e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:55.298621 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e29b15-960b-4db0-9cbb-b3dcf7ecea7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:55.310177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:55.324926 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d4e29b15-960b-4db0-9cbb-b3dcf7ecea7e None None] MFA Rules not processed for user `26822e8f172544e782ffc285443947b5`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:55.326753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d4e29b15-960b-4db0-9cbb-b3dcf7ecea7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:55.330974 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2489/4932] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:55 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 21:10:55.334736 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e29b15-960b-4db0-9cbb-b3dcf7ecea7e None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:55.354010 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac7d43-c12f-460c-aa8c-0dd4565f0a1d tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:55.361643 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d84e2d-fc68-4e5c-b5a6-0bc0a84b5eb2 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:55.362512 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d84e2d-fc68-4e5c-b5a6-0bc0a84b5eb2 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:55.363037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d84e2d-fc68-4e5c-b5a6-0bc0a84b5eb2 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:55.363513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d84e2d-fc68-4e5c-b5a6-0bc0a84b5eb2 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:55.364568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d84e2d-fc68-4e5c-b5a6-0bc0a84b5eb2 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:55.366477 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-d6d84e2d-fc68-4e5c-b5a6-0bc0a84b5eb2 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:10:55.366477 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:10:55.366477 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:10:55.368006 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d84e2d-fc68-4e5c-b5a6-0bc0a84b5eb2 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:55.415949 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e29b15-960b-4db0-9cbb-b3dcf7ecea7e None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:55.420799 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a3b84-2e30-493e-a1f1-741e988b3367 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26822e8f172544e782ffc285443947b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beba9c837a8e4c4cabdf00b9fb907738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:55.421724 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a3b84-2e30-493e-a1f1-741e988b3367 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] REQUEST_METHOD: `HEAD` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:55.422020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a3b84-2e30-493e-a1f1-741e988b3367 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:55.422418 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a3b84-2e30-493e-a1f1-741e988b3367 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:55.424706 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2444/4933] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:55 2022] GET /identity/v3/users => generated 8057 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:10:55.429313 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfce86d-ed7e-427b-b759-ab8773ef94bc None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:55.430238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfce86d-ed7e-427b-b759-ab8773ef94bc None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:55.431011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfce86d-ed7e-427b-b759-ab8773ef94bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:55.435800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a3b84-2e30-493e-a1f1-741e988b3367 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] RBAC: Authorizing `identity:check_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:55.438518 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a3b84-2e30-493e-a1f1-741e988b3367 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:55.449121 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2490/4934] 10.222.0.33 () {56 vars in 1264 bytes} [Sat Aug 6 21:10:55 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Aug 06 21:10:55.459610 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a3b84-2e30-493e-a1f1-741e988b3367 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:55.472318 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a3b84-2e30-493e-a1f1-741e988b3367 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:55.477929 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9b7d5-d985-43c5-8582-54f21146f2b0 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26822e8f172544e782ffc285443947b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beba9c837a8e4c4cabdf00b9fb907738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:55.478748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9b7d5-d985-43c5-8582-54f21146f2b0 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:55.479032 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9b7d5-d985-43c5-8582-54f21146f2b0 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:55.479694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9b7d5-d985-43c5-8582-54f21146f2b0 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:55.484067 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-dcfce86d-ed7e-427b-b759-ab8773ef94bc None None] MFA Rules not processed for user `aac4a5641ec84b20b57e865a6bc2056a`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:55.485359 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-dcfce86d-ed7e-427b-b759-ab8773ef94bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:55.487712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb9b7d5-d985-43c5-8582-54f21146f2b0 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:55.490128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb9b7d5-d985-43c5-8582-54f21146f2b0 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:55.498598 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2491/4935] 10.222.0.33 () {56 vars in 1263 bytes} [Sat Aug 6 21:10:55 2022] GET /identity/v3/auth/tokens => generated 346 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:55.502859 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9b7d5-d985-43c5-8582-54f21146f2b0 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:55.516882 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9b7d5-d985-43c5-8582-54f21146f2b0 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:55.524528 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847cf82f-417f-4e69-8ecd-b41063b596c9 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26822e8f172544e782ffc285443947b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beba9c837a8e4c4cabdf00b9fb907738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:55.526422 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847cf82f-417f-4e69-8ecd-b41063b596c9 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:55.527031 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847cf82f-417f-4e69-8ecd-b41063b596c9 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:55.527586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847cf82f-417f-4e69-8ecd-b41063b596c9 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:55.536785 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847cf82f-417f-4e69-8ecd-b41063b596c9 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:55.538888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847cf82f-417f-4e69-8ecd-b41063b596c9 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:55.570356 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2445/4937] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:55 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:55.570781 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2492/4937] 10.222.0.33 () {56 vars in 1266 bytes} [Sat Aug 6 21:10:55 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:55.570856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfce86d-ed7e-427b-b759-ab8773ef94bc None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:55.572561 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9a657-a924-4a84-9b35-33cfa9125153 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:55.572850 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9a657-a924-4a84-9b35-33cfa9125153 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:55.573124 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9a657-a924-4a84-9b35-33cfa9125153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:55.588169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfce86d-ed7e-427b-b759-ab8773ef94bc None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:55.595899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089428c5-0c47-4740-9e0e-a2007a105f49 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26822e8f172544e782ffc285443947b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beba9c837a8e4c4cabdf00b9fb907738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:55.596893 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089428c5-0c47-4740-9e0e-a2007a105f49 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] REQUEST_METHOD: `HEAD` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:55.597985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089428c5-0c47-4740-9e0e-a2007a105f49 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:55.598469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089428c5-0c47-4740-9e0e-a2007a105f49 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:55.602968 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-089428c5-0c47-4740-9e0e-a2007a105f49 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:55.605867 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-aad9a657-a924-4a84-9b35-33cfa9125153 None None] MFA Rules not processed for user `aac4a5641ec84b20b57e865a6bc2056a`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:55.607737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-aad9a657-a924-4a84-9b35-33cfa9125153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:55.622606 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2493/4938] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:55 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:55.626642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9a657-a924-4a84-9b35-33cfa9125153 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:55.634257 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-089428c5-0c47-4740-9e0e-a2007a105f49 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Aug 06 21:10:55.634257 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:10:55.634257 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:10:55.634257 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:10:55.634257 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:10:55.634257 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:10:55.634257 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:10:55.634257 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:10:55.634257 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:10:55.634257 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:10:55.634257 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:10:55.634257 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:10:55.634257 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Aug 06 21:10:55.634257 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Aug 06 21:10:55.634257 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Aug 06 21:10:55.635150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Aug 06 21:10:55.635150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Aug 06 21:10:55.635150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Aug 06 21:10:55.635150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:10:55.635150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:10:55.635150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Aug 06 21:10:55.635150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Aug 06 21:10:55.635150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Aug 06 21:10:55.635150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self.check_revocation(token) Aug 06 21:10:55.635150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:10:55.635150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:10:55.635150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Aug 06 21:10:55.635150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Aug 06 21:10:55.635150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:10:55.635150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:10:55.635150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Aug 06 21:10:55.635150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Aug 06 21:10:55.636106 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:10:55.636106 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:10:55.636106 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Aug 06 21:10:55.636106 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Aug 06 21:10:55.636106 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Aug 06 21:10:55.636106 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:10:55.640227 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2446/4939] 10.222.0.33 () {56 vars in 1264 bytes} [Sat Aug 6 21:10:55 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Aug 06 21:10:55.643197 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9a657-a924-4a84-9b35-33cfa9125153 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:55.648552 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768ef58-5868-4342-bf97-c3c95ddadc6d tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac4a5641ec84b20b57e865a6bc2056a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2ffeebb1e8846e98073bf8d8befa335', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1912238977', 'tempest-DelegatedRole-163833200'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:55.651943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98d260-11d8-42ec-9ca6-5b7a7c1bec31 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:55.652280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98d260-11d8-42ec-9ca6-5b7a7c1bec31 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:55.652561 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98d260-11d8-42ec-9ca6-5b7a7c1bec31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:55.666780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768ef58-5868-4342-bf97-c3c95ddadc6d tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:55.667172 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768ef58-5868-4342-bf97-c3c95ddadc6d tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:55.667442 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768ef58-5868-4342-bf97-c3c95ddadc6d tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:55.673092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768ef58-5868-4342-bf97-c3c95ddadc6d tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] RBAC: Authorizing `identity:create_trust()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:55.674294 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768ef58-5868-4342-bf97-c3c95ddadc6d tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:55.692235 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-9d98d260-11d8-42ec-9ca6-5b7a7c1bec31 None None] MFA Rules not processed for user `26822e8f172544e782ffc285443947b5`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:55.693718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9d98d260-11d8-42ec-9ca6-5b7a7c1bec31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:55.700357 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2447/4940] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:55 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 21:10:55.701630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98d260-11d8-42ec-9ca6-5b7a7c1bec31 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:55.716064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98d260-11d8-42ec-9ca6-5b7a7c1bec31 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:55.721820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5712d0-62c5-486d-ba06-e9d53bab7ce5 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26822e8f172544e782ffc285443947b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beba9c837a8e4c4cabdf00b9fb907738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:55.722710 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5712d0-62c5-486d-ba06-e9d53bab7ce5 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:55.723138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5712d0-62c5-486d-ba06-e9d53bab7ce5 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:55.723558 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5712d0-62c5-486d-ba06-e9d53bab7ce5 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:55.731837 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5712d0-62c5-486d-ba06-e9d53bab7ce5 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:55.734866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5712d0-62c5-486d-ba06-e9d53bab7ce5 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:55.747825 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2448/4941] 10.222.0.33 () {56 vars in 1263 bytes} [Sat Aug 6 21:10:55 2022] GET /identity/v3/auth/tokens => generated 346 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:55.749564 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5712d0-62c5-486d-ba06-e9d53bab7ce5 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:55.761688 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5712d0-62c5-486d-ba06-e9d53bab7ce5 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:55.769991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711c9ca-df35-4d49-9075-0f8ef743a666 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26822e8f172544e782ffc285443947b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beba9c837a8e4c4cabdf00b9fb907738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:55.772043 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711c9ca-df35-4d49-9075-0f8ef743a666 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:55.772579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711c9ca-df35-4d49-9075-0f8ef743a666 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:55.773000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711c9ca-df35-4d49-9075-0f8ef743a666 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:55.783174 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711c9ca-df35-4d49-9075-0f8ef743a666 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:55.786012 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711c9ca-df35-4d49-9075-0f8ef743a666 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:55.794698 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:55.797803 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2494/4942] 10.222.0.33 () {60 vars in 1174 bytes} [Sat Aug 6 21:10:55 2022] POST /identity/v3/OS-TRUST/trusts => generated 858 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:55.800398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768ef58-5868-4342-bf97-c3c95ddadc6d tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:55.809001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d768ef58-5868-4342-bf97-c3c95ddadc6d tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:55.815070 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2449/4943] 10.222.0.33 () {56 vars in 1266 bytes} [Sat Aug 6 21:10:55 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:55.817343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711c9ca-df35-4d49-9075-0f8ef743a666 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:55.850273 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711c9ca-df35-4d49-9075-0f8ef743a666 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:55.869448 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787af9b6-1518-4e27-87c7-3e2e2743d9c4 tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac4a5641ec84b20b57e865a6bc2056a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2ffeebb1e8846e98073bf8d8befa335', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1912238977', 'tempest-DelegatedRole-163833200'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:55.871396 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787af9b6-1518-4e27-87c7-3e2e2743d9c4 tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:55.871535 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787af9b6-1518-4e27-87c7-3e2e2743d9c4 tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:55.871769 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787af9b6-1518-4e27-87c7-3e2e2743d9c4 tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] PATH_INFO: `/v3/OS-TRUST/trusts/32232b8ce6804ffea287b35d8e24dae6` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:55.889656 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787af9b6-1518-4e27-87c7-3e2e2743d9c4 tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] RBAC: Authorizing `identity:get_trust(trust_id=32232b8ce6804ffea287b35d8e24dae6)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:55.894683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787af9b6-1518-4e27-87c7-3e2e2743d9c4 tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:55.922312 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2450/4944] 10.222.0.33 () {58 vars in 1251 bytes} [Sat Aug 6 21:10:55 2022] GET /identity/v3/OS-TRUST/trusts/32232b8ce6804ffea287b35d8e24dae6 => generated 858 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:55.922312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787af9b6-1518-4e27-87c7-3e2e2743d9c4 tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:55.946592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:55.951201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787af9b6-1518-4e27-87c7-3e2e2743d9c4 tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:55.958609 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da6a73-2d37-49a3-8e6d-597fead441c1 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26822e8f172544e782ffc285443947b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beba9c837a8e4c4cabdf00b9fb907738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:55.960060 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da6a73-2d37-49a3-8e6d-597fead441c1 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:55.960435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da6a73-2d37-49a3-8e6d-597fead441c1 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:55.960807 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da6a73-2d37-49a3-8e6d-597fead441c1 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:55.963008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c4da6a73-2d37-49a3-8e6d-597fead441c1 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:55.985555 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768ef58-5868-4342-bf97-c3c95ddadc6d tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:55.985768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-c4da6a73-2d37-49a3-8e6d-597fead441c1 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Aug 06 21:10:55.985768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:10:55.985768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:10:55.985768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:10:55.985768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:10:55.985768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:10:55.985768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:10:55.985768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:10:55.985768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:10:55.985768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:10:55.985768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:10:55.985768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:10:55.985768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Aug 06 21:10:55.985768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Aug 06 21:10:55.985768 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Aug 06 21:10:55.986767 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Aug 06 21:10:55.986767 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Aug 06 21:10:55.986767 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Aug 06 21:10:55.986767 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:10:55.986767 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:10:55.986767 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Aug 06 21:10:55.986767 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Aug 06 21:10:55.986767 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Aug 06 21:10:55.986767 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self.check_revocation(token) Aug 06 21:10:55.986767 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:10:55.986767 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:10:55.986767 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Aug 06 21:10:55.986767 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Aug 06 21:10:55.986767 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:10:55.986767 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:10:55.986767 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Aug 06 21:10:55.986767 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Aug 06 21:10:55.987793 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:10:55.987793 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:10:55.987793 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Aug 06 21:10:55.987793 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Aug 06 21:10:55.987793 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Aug 06 21:10:55.987793 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:10:55.993534 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2451/4945] 10.222.0.33 () {56 vars in 1263 bytes} [Sat Aug 6 21:10:55 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 21:10:55.993534 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da6a73-2d37-49a3-8e6d-597fead441c1 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:56.004192 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38769328-2f45-4995-8f1b-72d980552553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:56.004945 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38769328-2f45-4995-8f1b-72d980552553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:56.006270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38769328-2f45-4995-8f1b-72d980552553 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:56.006659 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38769328-2f45-4995-8f1b-72d980552553 admin admin] PATH_INFO: `/v3/projects/86ab008e18d34931ad32d7a2d9280c5b` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:56.018410 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38769328-2f45-4995-8f1b-72d980552553 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86ab008e18d34931ad32d7a2d9280c5b)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:56.020192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da6a73-2d37-49a3-8e6d-597fead441c1 tempest-TokensV3Test-1843955259 tempest-TokensV3Test-1843955259-project] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:56.020549 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38769328-2f45-4995-8f1b-72d980552553 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:56.033877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de73e9-d757-449b-9499-f7c871eb6fdc tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac4a5641ec84b20b57e865a6bc2056a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2ffeebb1e8846e98073bf8d8befa335', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1912238977', 'tempest-DelegatedRole-163833200'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:56.034654 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de73e9-d757-449b-9499-f7c871eb6fdc tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:56.035061 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de73e9-d757-449b-9499-f7c871eb6fdc tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:56.035401 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de73e9-d757-449b-9499-f7c871eb6fdc tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] PATH_INFO: `/v3/OS-TRUST/trusts/32232b8ce6804ffea287b35d8e24dae6/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:56.047399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de73e9-d757-449b-9499-f7c871eb6fdc tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=32232b8ce6804ffea287b35d8e24dae6)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:56.051923 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de73e9-d757-449b-9499-f7c871eb6fdc tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:56.069222 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2452/4946] 10.222.0.33 () {58 vars in 1269 bytes} [Sat Aug 6 21:10:55 2022] GET /identity/v3/OS-TRUST/trusts/32232b8ce6804ffea287b35d8e24dae6/roles => generated 370 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:56.071531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de73e9-d757-449b-9499-f7c871eb6fdc tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:56.096995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de73e9-d757-449b-9499-f7c871eb6fdc tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:56.113100 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-38769328-2f45-4995-8f1b-72d980552553 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86ab008e18d34931ad32d7a2d9280c5b', 'request_id': 'req-38769328-2f45-4995-8f1b-72d980552553'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:56.119800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-38769328-2f45-4995-8f1b-72d980552553 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86ab008e18d34931ad32d7a2d9280c5b', 'request_id': 'req-38769328-2f45-4995-8f1b-72d980552553'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:56.142370 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-38769328-2f45-4995-8f1b-72d980552553 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86ab008e18d34931ad32d7a2d9280c5b', 'request_id': 'req-38769328-2f45-4995-8f1b-72d980552553'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:56.164377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-38769328-2f45-4995-8f1b-72d980552553 admin admin] The token cache is being invalidate because project 86ab008e18d34931ad32d7a2d9280c5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:56.165192 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-38769328-2f45-4995-8f1b-72d980552553 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:56.173699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-38769328-2f45-4995-8f1b-72d980552553 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:56.178225 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2495/4947] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:10:55 2022] DELETE /identity/v3/projects/86ab008e18d34931ad32d7a2d9280c5b => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:10:56.178225 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38769328-2f45-4995-8f1b-72d980552553 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:56.178990 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-38769328-2f45-4995-8f1b-72d980552553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:56.212724 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79bdf2-e2fd-4979-b28a-4aa2451e6c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:56.213595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79bdf2-e2fd-4979-b28a-4aa2451e6c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:56.214057 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79bdf2-e2fd-4979-b28a-4aa2451e6c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:56.214515 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79bdf2-e2fd-4979-b28a-4aa2451e6c16 admin admin] PATH_INFO: `/v3/users/26822e8f172544e782ffc285443947b5` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:56.216410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a79bdf2-e2fd-4979-b28a-4aa2451e6c16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26822e8f172544e782ffc285443947b5)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:56.220005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a79bdf2-e2fd-4979-b28a-4aa2451e6c16 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:56.256231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38769328-2f45-4995-8f1b-72d980552553 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:56.262046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb949a-4ea8-4a27-8ac6-ff2520b23f84 tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac4a5641ec84b20b57e865a6bc2056a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2ffeebb1e8846e98073bf8d8befa335', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1912238977', 'tempest-DelegatedRole-163833200'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:56.262792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb949a-4ea8-4a27-8ac6-ff2520b23f84 tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:56.263261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb949a-4ea8-4a27-8ac6-ff2520b23f84 tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:56.263564 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb949a-4ea8-4a27-8ac6-ff2520b23f84 tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] PATH_INFO: `/v3/OS-TRUST/trusts/32232b8ce6804ffea287b35d8e24dae6/roles/2e34664624374c9b8a42e1e9e45cd55a` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:56.273992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb949a-4ea8-4a27-8ac6-ff2520b23f84 tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] RBAC: Authorizing `identity:get_role_for_trust(trust_id=32232b8ce6804ffea287b35d8e24dae6, role_id=2e34664624374c9b8a42e1e9e45cd55a)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:56.276450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb949a-4ea8-4a27-8ac6-ff2520b23f84 tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:56.285179 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2a79bdf2-e2fd-4979-b28a-4aa2451e6c16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26822e8f172544e782ffc285443947b5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:56.285935 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2a79bdf2-e2fd-4979-b28a-4aa2451e6c16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26822e8f172544e782ffc285443947b5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:56.286978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2a79bdf2-e2fd-4979-b28a-4aa2451e6c16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26822e8f172544e782ffc285443947b5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:56.290519 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2496/4948] 10.222.0.33 () {58 vars in 1368 bytes} [Sat Aug 6 21:10:56 2022] GET /identity/v3/OS-TRUST/trusts/32232b8ce6804ffea287b35d8e24dae6/roles/2e34664624374c9b8a42e1e9e45cd55a => generated 243 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:56.290519 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb949a-4ea8-4a27-8ac6-ff2520b23f84 tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:56.291844 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9afb949a-4ea8-4a27-8ac6-ff2520b23f84 tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:56.300822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2a79bdf2-e2fd-4979-b28a-4aa2451e6c16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26822e8f172544e782ffc285443947b5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:56.314746 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb949a-4ea8-4a27-8ac6-ff2520b23f84 tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:56.318582 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2a79bdf2-e2fd-4979-b28a-4aa2451e6c16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26822e8f172544e782ffc285443947b5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:56.321226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66060d81-2005-4eaf-acd2-c3076d410aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:56.322244 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66060d81-2005-4eaf-acd2-c3076d410aaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:56.322464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66060d81-2005-4eaf-acd2-c3076d410aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:56.322891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66060d81-2005-4eaf-acd2-c3076d410aaa admin admin] PATH_INFO: `/v3/users/cee713ee83054c3e8ef260c9acfaeb95` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:56.324207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66060d81-2005-4eaf-acd2-c3076d410aaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=cee713ee83054c3e8ef260c9acfaeb95)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:56.327136 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66060d81-2005-4eaf-acd2-c3076d410aaa admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:56.346155 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2453/4949] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:56 2022] DELETE /identity/v3/users/26822e8f172544e782ffc285443947b5 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:56.346155 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79bdf2-e2fd-4979-b28a-4aa2451e6c16 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:56.346155 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2a79bdf2-e2fd-4979-b28a-4aa2451e6c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:56.403873 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:56.406198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-66060d81-2005-4eaf-acd2-c3076d410aaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cee713ee83054c3e8ef260c9acfaeb95'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:56.424585 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-66060d81-2005-4eaf-acd2-c3076d410aaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cee713ee83054c3e8ef260c9acfaeb95'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:56.425484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-66060d81-2005-4eaf-acd2-c3076d410aaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cee713ee83054c3e8ef260c9acfaeb95'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:56.426648 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-66060d81-2005-4eaf-acd2-c3076d410aaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cee713ee83054c3e8ef260c9acfaeb95'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:56.439429 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-66060d81-2005-4eaf-acd2-c3076d410aaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cee713ee83054c3e8ef260c9acfaeb95'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:56.441901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:56.452522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79bdf2-e2fd-4979-b28a-4aa2451e6c16 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:56.460037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e1c15-bba2-44f5-82b5-11a9d65e0b99 tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac4a5641ec84b20b57e865a6bc2056a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2ffeebb1e8846e98073bf8d8befa335', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1912238977', 'tempest-DelegatedRole-163833200'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:56.460449 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e1c15-bba2-44f5-82b5-11a9d65e0b99 tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] REQUEST_METHOD: `HEAD` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:56.460839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e1c15-bba2-44f5-82b5-11a9d65e0b99 tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:56.461011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e1c15-bba2-44f5-82b5-11a9d65e0b99 tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] PATH_INFO: `/v3/OS-TRUST/trusts/32232b8ce6804ffea287b35d8e24dae6/roles/2e34664624374c9b8a42e1e9e45cd55a` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:56.482829 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2497/4950] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:56 2022] DELETE /identity/v3/users/cee713ee83054c3e8ef260c9acfaeb95 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:56.485848 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5408f-e971-4d4b-a2eb-4289d7fac20f None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:56.486354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5408f-e971-4d4b-a2eb-4289d7fac20f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:56.486966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5408f-e971-4d4b-a2eb-4289d7fac20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:56.506988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e1c15-bba2-44f5-82b5-11a9d65e0b99 tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] RBAC: Authorizing `identity:get_role_for_trust(trust_id=32232b8ce6804ffea287b35d8e24dae6, role_id=2e34664624374c9b8a42e1e9e45cd55a)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:56.508571 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e1c15-bba2-44f5-82b5-11a9d65e0b99 tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:56.537328 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2454/4951] 10.222.0.33 () {58 vars in 1369 bytes} [Sat Aug 6 21:10:56 2022] HEAD /identity/v3/OS-TRUST/trusts/32232b8ce6804ffea287b35d8e24dae6/roles/2e34664624374c9b8a42e1e9e45cd55a => generated 0 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 06 21:10:56.542057 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e1c15-bba2-44f5-82b5-11a9d65e0b99 tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:56.544217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-546e1c15-bba2-44f5-82b5-11a9d65e0b99 tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:56.547139 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-e1a5408f-e971-4d4b-a2eb-4289d7fac20f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:56.548515 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e1a5408f-e971-4d4b-a2eb-4289d7fac20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:56.595969 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e1c15-bba2-44f5-82b5-11a9d65e0b99 tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:56.658664 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2498/4952] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:56.675838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5408f-e971-4d4b-a2eb-4289d7fac20f None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:56.678806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e1a5408f-e971-4d4b-a2eb-4289d7fac20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:56.711342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33285e14-5b03-48d8-9496-c1e03e8c012c tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac4a5641ec84b20b57e865a6bc2056a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2ffeebb1e8846e98073bf8d8befa335', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1912238977', 'tempest-DelegatedRole-163833200'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:56.712014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33285e14-5b03-48d8-9496-c1e03e8c012c tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:56.712295 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33285e14-5b03-48d8-9496-c1e03e8c012c tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:56.712564 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33285e14-5b03-48d8-9496-c1e03e8c012c tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] PATH_INFO: `/v3/OS-TRUST/trusts/32232b8ce6804ffea287b35d8e24dae6/roles/e6fa487815b84542a58facf4f9dc6c28` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:56.726294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33285e14-5b03-48d8-9496-c1e03e8c012c tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] RBAC: Authorizing `identity:get_role_for_trust(trust_id=32232b8ce6804ffea287b35d8e24dae6, role_id=e6fa487815b84542a58facf4f9dc6c28)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:56.727799 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33285e14-5b03-48d8-9496-c1e03e8c012c tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:56.746895 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-33285e14-5b03-48d8-9496-c1e03e8c012c tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] Could not find role: e6fa487815b84542a58facf4f9dc6c28.: keystone.exception.RoleNotFound: Could not find role: e6fa487815b84542a58facf4f9dc6c28. Aug 06 21:10:56.746895 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:10:56.746895 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:10:56.746895 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:10:56.746895 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:10:56.746895 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:10:56.746895 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:10:56.746895 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:10:56.746895 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:10:56.746895 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:10:56.746895 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:10:56.746895 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:10:56.746895 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 06 21:10:56.746895 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 21:10:56.746895 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: e6fa487815b84542a58facf4f9dc6c28. Aug 06 21:10:56.747907 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:10:56.752228 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2455/4953] 10.222.0.33 () {58 vars in 1368 bytes} [Sat Aug 6 21:10:56 2022] GET /identity/v3/OS-TRUST/trusts/32232b8ce6804ffea287b35d8e24dae6/roles/e6fa487815b84542a58facf4f9dc6c28 => generated 110 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 06 21:10:56.753142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33285e14-5b03-48d8-9496-c1e03e8c012c tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:56.770851 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5408f-e971-4d4b-a2eb-4289d7fac20f None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:56.774954 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33285e14-5b03-48d8-9496-c1e03e8c012c tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:56.775476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24dea5-31a2-4dc5-a9a1-c3f4486b21c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:56.776396 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24dea5-31a2-4dc5-a9a1-c3f4486b21c1 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:56.776891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24dea5-31a2-4dc5-a9a1-c3f4486b21c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:56.777452 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24dea5-31a2-4dc5-a9a1-c3f4486b21c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:56.783937 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2c168-75aa-4001-9bb2-657c7881370d tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac4a5641ec84b20b57e865a6bc2056a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2ffeebb1e8846e98073bf8d8befa335', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1912238977', 'tempest-DelegatedRole-163833200'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:56.785247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2c168-75aa-4001-9bb2-657c7881370d tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] REQUEST_METHOD: `HEAD` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:56.785776 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2c168-75aa-4001-9bb2-657c7881370d tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:56.787112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2c168-75aa-4001-9bb2-657c7881370d tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] PATH_INFO: `/v3/OS-TRUST/trusts/32232b8ce6804ffea287b35d8e24dae6/roles/e6fa487815b84542a58facf4f9dc6c28` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:56.789311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea24dea5-31a2-4dc5-a9a1-c3f4486b21c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:56.791221 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea24dea5-31a2-4dc5-a9a1-c3f4486b21c1 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:56.797169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2c168-75aa-4001-9bb2-657c7881370d tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] RBAC: Authorizing `identity:get_role_for_trust(trust_id=32232b8ce6804ffea287b35d8e24dae6, role_id=e6fa487815b84542a58facf4f9dc6c28)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:56.800391 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2c168-75aa-4001-9bb2-657c7881370d tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:56.809646 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2499/4954] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:10:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:10:56.815788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-77b2c168-75aa-4001-9bb2-657c7881370d tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] Could not find role: e6fa487815b84542a58facf4f9dc6c28.: keystone.exception.RoleNotFound: Could not find role: e6fa487815b84542a58facf4f9dc6c28. Aug 06 21:10:56.815788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:10:56.815788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:10:56.815788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:10:56.815788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:10:56.815788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:10:56.815788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:10:56.815788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:10:56.815788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:10:56.815788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:10:56.815788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:10:56.815788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:10:56.815788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 06 21:10:56.815788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 21:10:56.815788 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: e6fa487815b84542a58facf4f9dc6c28. Aug 06 21:10:56.816654 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:10:56.817290 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2456/4955] 10.222.0.33 () {58 vars in 1369 bytes} [Sat Aug 6 21:10:56 2022] HEAD /identity/v3/OS-TRUST/trusts/32232b8ce6804ffea287b35d8e24dae6/roles/e6fa487815b84542a58facf4f9dc6c28 => generated 0 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Aug 06 21:10:56.822214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24dea5-31a2-4dc5-a9a1-c3f4486b21c1 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:56.840229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24dea5-31a2-4dc5-a9a1-c3f4486b21c1 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:56.847628 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18f9eb-252c-498d-b033-8617f0f1ea37 tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac4a5641ec84b20b57e865a6bc2056a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2ffeebb1e8846e98073bf8d8befa335', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1912238977', 'tempest-DelegatedRole-163833200'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:56.848487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18f9eb-252c-498d-b033-8617f0f1ea37 tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:56.848608 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18f9eb-252c-498d-b033-8617f0f1ea37 tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:56.848810 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18f9eb-252c-498d-b033-8617f0f1ea37 tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] PATH_INFO: `/v3/OS-TRUST/trusts/32232b8ce6804ffea287b35d8e24dae6` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:56.857896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18f9eb-252c-498d-b033-8617f0f1ea37 tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] RBAC: Authorizing `identity:delete_trust(trust_id=32232b8ce6804ffea287b35d8e24dae6)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:56.859833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18f9eb-252c-498d-b033-8617f0f1ea37 tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:56.879211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9d18f9eb-252c-498d-b033-8617f0f1ea37 tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '32232b8ce6804ffea287b35d8e24dae6', 'request_id': 'req-9d18f9eb-252c-498d-b033-8617f0f1ea37'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:56.880103 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9d18f9eb-252c-498d-b033-8617f0f1ea37 tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '32232b8ce6804ffea287b35d8e24dae6', 'request_id': 'req-9d18f9eb-252c-498d-b033-8617f0f1ea37'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:56.881060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9d18f9eb-252c-498d-b033-8617f0f1ea37 tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '32232b8ce6804ffea287b35d8e24dae6', 'request_id': 'req-9d18f9eb-252c-498d-b033-8617f0f1ea37'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:56.898972 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2500/4956] 10.222.0.33 () {58 vars in 1254 bytes} [Sat Aug 6 21:10:56 2022] DELETE /identity/v3/OS-TRUST/trusts/32232b8ce6804ffea287b35d8e24dae6 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:56.903172 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2c168-75aa-4001-9bb2-657c7881370d tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:56.908377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-77b2c168-75aa-4001-9bb2-657c7881370d tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:56.923638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2c168-75aa-4001-9bb2-657c7881370d tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:56.928309 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e70912-f146-470c-ad11-8dd0d550a9ef tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac4a5641ec84b20b57e865a6bc2056a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2ffeebb1e8846e98073bf8d8befa335', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1912238977', 'tempest-DelegatedRole-163833200'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:56.928963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e70912-f146-470c-ad11-8dd0d550a9ef tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:56.929313 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e70912-f146-470c-ad11-8dd0d550a9ef tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:56.930001 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e70912-f146-470c-ad11-8dd0d550a9ef tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] PATH_INFO: `/v3/OS-TRUST/trusts/32232b8ce6804ffea287b35d8e24dae6` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:56.941769 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-94e70912-f146-470c-ad11-8dd0d550a9ef tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] Could not find trust: 32232b8ce6804ffea287b35d8e24dae6.: keystone.exception.TrustNotFound: Could not find trust: 32232b8ce6804ffea287b35d8e24dae6. Aug 06 21:10:56.941769 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:10:56.941769 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:10:56.941769 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:10:56.941769 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:10:56.941769 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:10:56.941769 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:10:56.941769 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:10:56.941769 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:10:56.941769 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:10:56.941769 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:10:56.941769 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:10:56.941769 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 06 21:10:56.941769 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 06 21:10:56.941769 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 06 21:10:56.942904 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 06 21:10:56.942904 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 06 21:10:56.942904 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 06 21:10:56.942904 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 06 21:10:56.942904 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 06 21:10:56.942904 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:10:56.942904 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:10:56.942904 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 06 21:10:56.942904 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 06 21:10:56.942904 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 06 21:10:56.942904 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 06 21:10:56.942904 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 32232b8ce6804ffea287b35d8e24dae6. Aug 06 21:10:56.942904 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:10:56.945238 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2457/4957] 10.222.0.33 () {58 vars in 1251 bytes} [Sat Aug 6 21:10:56 2022] GET /identity/v3/OS-TRUST/trusts/32232b8ce6804ffea287b35d8e24dae6 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:10:56.949283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18f9eb-252c-498d-b033-8617f0f1ea37 tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:56.954951 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9d18f9eb-252c-498d-b033-8617f0f1ea37 tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:57.039293 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:57.070655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18f9eb-252c-498d-b033-8617f0f1ea37 tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:57.079831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017dc87-fcee-418c-ab2a-33254317be78 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:57.080681 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017dc87-fcee-418c-ab2a-33254317be78 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:57.081975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017dc87-fcee-418c-ab2a-33254317be78 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:57.082594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017dc87-fcee-418c-ab2a-33254317be78 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/roles/e6fa487815b84542a58facf4f9dc6c28` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:57.085511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017dc87-fcee-418c-ab2a-33254317be78 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e6fa487815b84542a58facf4f9dc6c28)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:57.087698 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017dc87-fcee-418c-ab2a-33254317be78 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:57.176262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4017dc87-fcee-418c-ab2a-33254317be78 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invalidating the token cache because role e6fa487815b84542a58facf4f9dc6c28 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:57.176605 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4017dc87-fcee-418c-ab2a-33254317be78 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:57.177188 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4017dc87-fcee-418c-ab2a-33254317be78 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:57.179813 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2501/4958] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:56 2022] DELETE /identity/v3/roles/e6fa487815b84542a58facf4f9dc6c28 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:57.184344 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e70912-f146-470c-ad11-8dd0d550a9ef tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:57.188017 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-94e70912-f146-470c-ad11-8dd0d550a9ef tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:57.208988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e70912-f146-470c-ad11-8dd0d550a9ef tempest-TrustsV3TestJSON-1769154586 tempest-user-1355862072] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:57.227112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017dc87-fcee-418c-ab2a-33254317be78 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:57.231280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4017dc87-fcee-418c-ab2a-33254317be78 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:57.384071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2367af1d-b882-4b66-88e5-253c040629e9 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:57.384418 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367af1d-b882-4b66-88e5-253c040629e9 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:57.384704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367af1d-b882-4b66-88e5-253c040629e9 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:57.384981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367af1d-b882-4b66-88e5-253c040629e9 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/roles/2e34664624374c9b8a42e1e9e45cd55a` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:57.387177 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2367af1d-b882-4b66-88e5-253c040629e9 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2e34664624374c9b8a42e1e9e45cd55a)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:57.388789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2367af1d-b882-4b66-88e5-253c040629e9 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:57.437651 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017dc87-fcee-418c-ab2a-33254317be78 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:57.444665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ff649-3bfe-456e-adef-170e7b45eff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:57.445311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ff649-3bfe-456e-adef-170e7b45eff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:57.445591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ff649-3bfe-456e-adef-170e7b45eff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:57.445865 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ff649-3bfe-456e-adef-170e7b45eff9 admin admin] PATH_INFO: `/v3/projects/c0959e877edd414396cc2583158e12cf` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:57.447447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ff649-3bfe-456e-adef-170e7b45eff9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0959e877edd414396cc2583158e12cf)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:57.449403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ff649-3bfe-456e-adef-170e7b45eff9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:57.454002 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:57.465153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2367af1d-b882-4b66-88e5-253c040629e9 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invalidating the token cache because role 2e34664624374c9b8a42e1e9e45cd55a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:57.465540 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2367af1d-b882-4b66-88e5-253c040629e9 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:57.467243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2367af1d-b882-4b66-88e5-253c040629e9 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:57.475011 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2458/4959] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:57 2022] DELETE /identity/v3/roles/2e34664624374c9b8a42e1e9e45cd55a => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:57.478687 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2367af1d-b882-4b66-88e5-253c040629e9 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:57.482766 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2367af1d-b882-4b66-88e5-253c040629e9 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:57.521067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c53ff649-3bfe-456e-adef-170e7b45eff9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0959e877edd414396cc2583158e12cf', 'request_id': 'req-c53ff649-3bfe-456e-adef-170e7b45eff9'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:57.528853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c53ff649-3bfe-456e-adef-170e7b45eff9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0959e877edd414396cc2583158e12cf', 'request_id': 'req-c53ff649-3bfe-456e-adef-170e7b45eff9'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:57.541258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c53ff649-3bfe-456e-adef-170e7b45eff9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0959e877edd414396cc2583158e12cf', 'request_id': 'req-c53ff649-3bfe-456e-adef-170e7b45eff9'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:57.556923 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c53ff649-3bfe-456e-adef-170e7b45eff9 admin admin] The token cache is being invalidate because project c0959e877edd414396cc2583158e12cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:57.557253 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c53ff649-3bfe-456e-adef-170e7b45eff9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:57.558345 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c53ff649-3bfe-456e-adef-170e7b45eff9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:57.560299 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2502/4960] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:10:57 2022] DELETE /identity/v3/projects/c0959e877edd414396cc2583158e12cf => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:57.562710 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ff649-3bfe-456e-adef-170e7b45eff9 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:57.565315 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c53ff649-3bfe-456e-adef-170e7b45eff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:57.593632 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2367af1d-b882-4b66-88e5-253c040629e9 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:57.666101 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:57.696557 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ff649-3bfe-456e-adef-170e7b45eff9 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:57.704107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f3ee1-aca3-48f7-bc8e-4f709f0e4dfe tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:57.704771 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f3ee1-aca3-48f7-bc8e-4f709f0e4dfe tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:57.705104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f3ee1-aca3-48f7-bc8e-4f709f0e4dfe tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:57.705377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153fc04e-c245-46c2-a04d-9cb42b825b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:57.705498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f3ee1-aca3-48f7-bc8e-4f709f0e4dfe tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/users/aac4a5641ec84b20b57e865a6bc2056a` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:57.706426 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fc04e-c245-46c2-a04d-9cb42b825b83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:57.706788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f3ee1-aca3-48f7-bc8e-4f709f0e4dfe tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:delete_user(user_id=aac4a5641ec84b20b57e865a6bc2056a)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:57.707139 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fc04e-c245-46c2-a04d-9cb42b825b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:57.707546 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fc04e-c245-46c2-a04d-9cb42b825b83 admin admin] PATH_INFO: `/v3/projects/beba9c837a8e4c4cabdf00b9fb907738` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:57.708933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153fc04e-c245-46c2-a04d-9cb42b825b83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=beba9c837a8e4c4cabdf00b9fb907738)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:57.709551 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f3ee1-aca3-48f7-bc8e-4f709f0e4dfe tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:57.711764 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153fc04e-c245-46c2-a04d-9cb42b825b83 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:57.774966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1b8f3ee1-aca3-48f7-bc8e-4f709f0e4dfe tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aac4a5641ec84b20b57e865a6bc2056a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:57.775889 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1b8f3ee1-aca3-48f7-bc8e-4f709f0e4dfe tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aac4a5641ec84b20b57e865a6bc2056a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:57.777687 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1b8f3ee1-aca3-48f7-bc8e-4f709f0e4dfe tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aac4a5641ec84b20b57e865a6bc2056a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:57.789342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1b8f3ee1-aca3-48f7-bc8e-4f709f0e4dfe tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aac4a5641ec84b20b57e865a6bc2056a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:57.802489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-153fc04e-c245-46c2-a04d-9cb42b825b83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beba9c837a8e4c4cabdf00b9fb907738', 'request_id': 'req-153fc04e-c245-46c2-a04d-9cb42b825b83'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:57.808791 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-153fc04e-c245-46c2-a04d-9cb42b825b83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beba9c837a8e4c4cabdf00b9fb907738', 'request_id': 'req-153fc04e-c245-46c2-a04d-9cb42b825b83'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:57.817830 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-153fc04e-c245-46c2-a04d-9cb42b825b83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beba9c837a8e4c4cabdf00b9fb907738', 'request_id': 'req-153fc04e-c245-46c2-a04d-9cb42b825b83'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:57.821827 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1b8f3ee1-aca3-48f7-bc8e-4f709f0e4dfe tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aac4a5641ec84b20b57e865a6bc2056a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:57.831118 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-153fc04e-c245-46c2-a04d-9cb42b825b83 admin admin] The token cache is being invalidate because project beba9c837a8e4c4cabdf00b9fb907738 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:57.831489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-153fc04e-c245-46c2-a04d-9cb42b825b83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:57.832235 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-153fc04e-c245-46c2-a04d-9cb42b825b83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:57.840926 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2503/4961] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:10:57 2022] DELETE /identity/v3/projects/beba9c837a8e4c4cabdf00b9fb907738 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:57.844948 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc12e11-7829-4aba-8f7f-f74e07d4acf2 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:57.845634 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2459/4962] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:10:57 2022] DELETE /identity/v3/users/aac4a5641ec84b20b57e865a6bc2056a => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:57.845910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc12e11-7829-4aba-8f7f-f74e07d4acf2 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:57.847782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc12e11-7829-4aba-8f7f-f74e07d4acf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:57.847903 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb340bbf-2775-4d8d-a03a-f0559134bf74 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:57.847903 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb340bbf-2775-4d8d-a03a-f0559134bf74 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:57.848159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb340bbf-2775-4d8d-a03a-f0559134bf74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:57.874998 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-afc12e11-7829-4aba-8f7f-f74e07d4acf2 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:57.876394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-afc12e11-7829-4aba-8f7f-f74e07d4acf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:57.876753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-fb340bbf-2775-4d8d-a03a-f0559134bf74 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:57.877959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-fb340bbf-2775-4d8d-a03a-f0559134bf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:57.907981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:57.961161 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2504/4963] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:57.961805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc12e11-7829-4aba-8f7f-f74e07d4acf2 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:57.963132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-afc12e11-7829-4aba-8f7f-f74e07d4acf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:57.968100 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2460/4964] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:57.969801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28dc61a-f09e-4d28-831c-a83f100776c7 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:57.970161 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28dc61a-f09e-4d28-831c-a83f100776c7 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:57.970617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28dc61a-f09e-4d28-831c-a83f100776c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:58.011752 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-c28dc61a-f09e-4d28-831c-a83f100776c7 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:58.013639 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c28dc61a-f09e-4d28-831c-a83f100776c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:58.039383 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2461/4965] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:58.040788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d25d24-88d4-4c1c-b080-1ed4c62e5feb None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:58.041079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d25d24-88d4-4c1c-b080-1ed4c62e5feb None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:58.041355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d25d24-88d4-4c1c-b080-1ed4c62e5feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:58.071487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-82d25d24-88d4-4c1c-b080-1ed4c62e5feb None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:58.071638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc12e11-7829-4aba-8f7f-f74e07d4acf2 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:58.072929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-82d25d24-88d4-4c1c-b080-1ed4c62e5feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:58.081687 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208750f-f481-4289-9e0c-b4e78196a455 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:58.082624 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208750f-f481-4289-9e0c-b4e78196a455 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:58.082914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208750f-f481-4289-9e0c-b4e78196a455 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:58.083187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208750f-f481-4289-9e0c-b4e78196a455 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/projects/f2ffeebb1e8846e98073bf8d8befa335` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:58.084524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208750f-f481-4289-9e0c-b4e78196a455 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f2ffeebb1e8846e98073bf8d8befa335)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:58.088470 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2462/4966] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:58.088470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d25d24-88d4-4c1c-b080-1ed4c62e5feb None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:58.088683 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208750f-f481-4289-9e0c-b4e78196a455 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:58.100554 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d25d24-88d4-4c1c-b080-1ed4c62e5feb None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:58.107430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa567cee-5b56-4e30-932a-75fa32291fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:58.108646 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa567cee-5b56-4e30-932a-75fa32291fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:58.108936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa567cee-5b56-4e30-932a-75fa32291fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:58.109213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa567cee-5b56-4e30-932a-75fa32291fb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:58.109872 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa567cee-5b56-4e30-932a-75fa32291fb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:10:58.110403 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa567cee-5b56-4e30-932a-75fa32291fb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:58.112694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa567cee-5b56-4e30-932a-75fa32291fb8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:58.120695 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:58.128095 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2463/4967] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:58.129289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa567cee-5b56-4e30-932a-75fa32291fb8 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:58.147363 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa567cee-5b56-4e30-932a-75fa32291fb8 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:58.156659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07a210-02ef-4903-b0ed-00abdc886e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:58.158801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07a210-02ef-4903-b0ed-00abdc886e97 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:58.159286 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07a210-02ef-4903-b0ed-00abdc886e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:58.161651 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07a210-02ef-4903-b0ed-00abdc886e97 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:58.163135 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07a210-02ef-4903-b0ed-00abdc886e97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:10:58.165106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07a210-02ef-4903-b0ed-00abdc886e97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:58.170736 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07a210-02ef-4903-b0ed-00abdc886e97 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:58.197259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2208750f-f481-4289-9e0c-b4e78196a455 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2ffeebb1e8846e98073bf8d8befa335', 'request_id': 'req-2208750f-f481-4289-9e0c-b4e78196a455'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:58.205347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2208750f-f481-4289-9e0c-b4e78196a455 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2ffeebb1e8846e98073bf8d8befa335', 'request_id': 'req-2208750f-f481-4289-9e0c-b4e78196a455'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:58.206515 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2464/4968] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:10:58.207438 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07a210-02ef-4903-b0ed-00abdc886e97 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:58.220360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2208750f-f481-4289-9e0c-b4e78196a455 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2ffeebb1e8846e98073bf8d8befa335', 'request_id': 'req-2208750f-f481-4289-9e0c-b4e78196a455'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:58.234591 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07a210-02ef-4903-b0ed-00abdc886e97 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:58.243418 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2208750f-f481-4289-9e0c-b4e78196a455 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] The token cache is being invalidate because project f2ffeebb1e8846e98073bf8d8befa335 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:10:58.245113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2208750f-f481-4289-9e0c-b4e78196a455 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:58.246015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2208750f-f481-4289-9e0c-b4e78196a455 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:10:58.248458 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2505/4969] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:10:57 2022] DELETE /identity/v3/projects/f2ffeebb1e8846e98073bf8d8befa335 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:58.249695 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208750f-f481-4289-9e0c-b4e78196a455 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:58.255589 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2208750f-f481-4289-9e0c-b4e78196a455 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:58.347892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520ca97-2fc7-4417-8451-dfaaebf59997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:58.348652 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520ca97-2fc7-4417-8451-dfaaebf59997 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:58.349024 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520ca97-2fc7-4417-8451-dfaaebf59997 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:58.349371 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520ca97-2fc7-4417-8451-dfaaebf59997 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:58.350071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520ca97-2fc7-4417-8451-dfaaebf59997 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:58.352639 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520ca97-2fc7-4417-8451-dfaaebf59997 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:58.387467 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2465/4970] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:10:58 2022] POST /identity/v3/projects => generated 369 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:58.392099 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520ca97-2fc7-4417-8451-dfaaebf59997 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:58.393985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8520ca97-2fc7-4417-8451-dfaaebf59997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:58.401702 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208750f-f481-4289-9e0c-b4e78196a455 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:58.480752 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520ca97-2fc7-4417-8451-dfaaebf59997 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:58.487251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0cc57-542a-409e-9f55-a9659c9c472d tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:58.488216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0cc57-542a-409e-9f55-a9659c9c472d tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:58.488772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0cc57-542a-409e-9f55-a9659c9c472d tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:58.489119 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0cc57-542a-409e-9f55-a9659c9c472d tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:58.489913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0cc57-542a-409e-9f55-a9659c9c472d tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:58.492486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0cc57-542a-409e-9f55-a9659c9c472d tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:58.508301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516baab-071b-4b90-9d6b-d5d3e8838537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:58.510615 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516baab-071b-4b90-9d6b-d5d3e8838537 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:58.510615 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516baab-071b-4b90-9d6b-d5d3e8838537 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:58.512567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516baab-071b-4b90-9d6b-d5d3e8838537 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:58.513572 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516baab-071b-4b90-9d6b-d5d3e8838537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:58.516504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516baab-071b-4b90-9d6b-d5d3e8838537 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:58.522279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:58.544303 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2466/4971] 10.222.0.33 () {60 vars in 1152 bytes} [Sat Aug 6 21:10:58 2022] POST /identity/v3/projects => generated 329 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:58.545315 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0cc57-542a-409e-9f55-a9659c9c472d tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:58.547727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e1e0cc57-542a-409e-9f55-a9659c9c472d tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:58.574685 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2506/4972] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:10:58 2022] POST /identity/v3/projects => generated 397 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:58.576225 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516baab-071b-4b90-9d6b-d5d3e8838537 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:58.580016 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c516baab-071b-4b90-9d6b-d5d3e8838537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:58.629407 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:58.658436 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0cc57-542a-409e-9f55-a9659c9c472d tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:58.685413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516baab-071b-4b90-9d6b-d5d3e8838537 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:58.691146 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f131f5-1cff-4ea4-87b4-037381e987fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:58.692375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f131f5-1cff-4ea4-87b4-037381e987fb admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:58.692919 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f131f5-1cff-4ea4-87b4-037381e987fb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:58.693198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f131f5-1cff-4ea4-87b4-037381e987fb admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:58.693926 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f131f5-1cff-4ea4-87b4-037381e987fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:58.696313 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f131f5-1cff-4ea4-87b4-037381e987fb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:58.736295 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2507/4973] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:10:58 2022] POST /identity/v3/users => generated 285 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:58.736295 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f131f5-1cff-4ea4-87b4-037381e987fb admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:58.768356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9bbdf2-452d-4255-9742-e3d67a2c29ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:58.768988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bbdf2-452d-4255-9742-e3d67a2c29ae service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:58.769268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bbdf2-452d-4255-9742-e3d67a2c29ae service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:58.769585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bbdf2-452d-4255-9742-e3d67a2c29ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:58.772225 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8c9bbdf2-452d-4255-9742-e3d67a2c29ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:58.852038 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f131f5-1cff-4ea4-87b4-037381e987fb admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:58.861869 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d206c-7175-4079-a5c5-bdc7a7ad37d6 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:58.861869 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d206c-7175-4079-a5c5-bdc7a7ad37d6 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:58.862198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d206c-7175-4079-a5c5-bdc7a7ad37d6 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:58.863675 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d206c-7175-4079-a5c5-bdc7a7ad37d6 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:58.866142 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d206c-7175-4079-a5c5-bdc7a7ad37d6 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:58.869506 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d206c-7175-4079-a5c5-bdc7a7ad37d6 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:58.919418 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9bbdf2-452d-4255-9742-e3d67a2c29ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:58.921742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9bbdf2-452d-4255-9742-e3d67a2c29ae service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:58.930491 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2508/4974] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:10:58 2022] POST /identity/v3/users => generated 416 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:58.931391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d206c-7175-4079-a5c5-bdc7a7ad37d6 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:58.954529 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2467/4975] 10.222.0.33 () {60 vars in 1396 bytes} [Sat Aug 6 21:10:58 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3256 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:10:58.956052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9bbdf2-452d-4255-9742-e3d67a2c29ae service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:58.961907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d206c-7175-4079-a5c5-bdc7a7ad37d6 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:58.974565 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d77069-5f43-467f-a7dc-43430e531e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:58.975185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d77069-5f43-467f-a7dc-43430e531e38 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:58.975462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d77069-5f43-467f-a7dc-43430e531e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:58.976671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d77069-5f43-467f-a7dc-43430e531e38 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:58.980825 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9bbdf2-452d-4255-9742-e3d67a2c29ae service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:58.981729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d77069-5f43-467f-a7dc-43430e531e38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:58.984490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d77069-5f43-467f-a7dc-43430e531e38 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:58.987122 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d02e5-fc37-44ce-8737-cc0337ab2190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:58.987695 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d02e5-fc37-44ce-8737-cc0337ab2190 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:58.987975 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d02e5-fc37-44ce-8737-cc0337ab2190 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:58.988252 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d02e5-fc37-44ce-8737-cc0337ab2190 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:58.989441 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36d02e5-fc37-44ce-8737-cc0337ab2190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:58.991468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36d02e5-fc37-44ce-8737-cc0337ab2190 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:59.004900 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2468/4976] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:59.009099 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d02e5-fc37-44ce-8737-cc0337ab2190 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:59.033212 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2509/4977] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:10:58 2022] POST /identity/v3/users => generated 305 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:59.033212 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d77069-5f43-467f-a7dc-43430e531e38 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:59.041166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d02e5-fc37-44ce-8737-cc0337ab2190 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:59.052489 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23967f21-5fdd-4035-820b-b15d2a3c177e tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:59.054785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23967f21-5fdd-4035-820b-b15d2a3c177e tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:59.055523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23967f21-5fdd-4035-820b-b15d2a3c177e tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:59.055523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23967f21-5fdd-4035-820b-b15d2a3c177e tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:59.055995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23967f21-5fdd-4035-820b-b15d2a3c177e tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:59.057622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23967f21-5fdd-4035-820b-b15d2a3c177e tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:59.060611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d77069-5f43-467f-a7dc-43430e531e38 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:59.073259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5f7a3-1574-43c8-8dbe-20720f53494d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:59.074073 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5f7a3-1574-43c8-8dbe-20720f53494d admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:59.074719 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5f7a3-1574-43c8-8dbe-20720f53494d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:59.075039 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5f7a3-1574-43c8-8dbe-20720f53494d admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:59.075877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5f7a3-1574-43c8-8dbe-20720f53494d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:59.080199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5f7a3-1574-43c8-8dbe-20720f53494d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:59.104940 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2469/4978] 10.222.0.33 () {60 vars in 1143 bytes} [Sat Aug 6 21:10:59 2022] POST /identity/v3/roles => generated 243 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:59.105947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23967f21-5fdd-4035-820b-b15d2a3c177e tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:59.122293 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2510/4979] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:59 2022] GET /identity/v3/roles => generated 1654 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:59.124105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5f7a3-1574-43c8-8dbe-20720f53494d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:59.144026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23967f21-5fdd-4035-820b-b15d2a3c177e tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:59.158630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5f7a3-1574-43c8-8dbe-20720f53494d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:59.160675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a61eef-7298-419f-aff0-5f1ebc604cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:59.161639 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a61eef-7298-419f-aff0-5f1ebc604cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:59.162104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a61eef-7298-419f-aff0-5f1ebc604cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:59.162428 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a61eef-7298-419f-aff0-5f1ebc604cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:59.163161 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a61eef-7298-419f-aff0-5f1ebc604cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:59.165289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a61eef-7298-419f-aff0-5f1ebc604cf1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:59.175324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d52d1-d0ff-4a7e-b7b2-509f71490cae tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:59.176216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d52d1-d0ff-4a7e-b7b2-509f71490cae tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:59.176500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d52d1-d0ff-4a7e-b7b2-509f71490cae tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:59.176777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d52d1-d0ff-4a7e-b7b2-509f71490cae tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:59.177445 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d52d1-d0ff-4a7e-b7b2-509f71490cae tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:59.179078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d52d1-d0ff-4a7e-b7b2-509f71490cae tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:59.195906 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2470/4980] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:59 2022] GET /identity/v3/roles => generated 1654 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:59.195906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a61eef-7298-419f-aff0-5f1ebc604cf1 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:59.218196 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2511/4981] 10.222.0.33 () {60 vars in 1143 bytes} [Sat Aug 6 21:10:59 2022] POST /identity/v3/roles => generated 247 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:59.219584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d52d1-d0ff-4a7e-b7b2-509f71490cae tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:59.236450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a61eef-7298-419f-aff0-5f1ebc604cf1 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:59.237332 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d52d1-d0ff-4a7e-b7b2-509f71490cae tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:59.245725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cfe41-319e-4b90-acac-432fa99e6068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:59.246514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cfe41-319e-4b90-acac-432fa99e6068 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:59.246832 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cfe41-319e-4b90-acac-432fa99e6068 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:59.247217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cfe41-319e-4b90-acac-432fa99e6068 admin admin] PATH_INFO: `/v3/projects/16ac6c0038fb47bca014618f94916605/users/8e87601370dc4dcfb462e44b7f49bc52/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:59.252421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829bccad-7993-4c17-aa95-94841a1773e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:59.253120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bccad-7993-4c17-aa95-94841a1773e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:59.253398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bccad-7993-4c17-aa95-94841a1773e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:59.254285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bccad-7993-4c17-aa95-94841a1773e2 admin admin] PATH_INFO: `/v3/projects/318092177998446d97e2f93f40eae5ec/users/4ec6df8a37fa4466a9452f5f22e8cfb2/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:59.283334 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071cfe41-319e-4b90-acac-432fa99e6068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16ac6c0038fb47bca014618f94916605, user_id=8e87601370dc4dcfb462e44b7f49bc52, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:59.286271 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071cfe41-319e-4b90-acac-432fa99e6068 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:59.318238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829bccad-7993-4c17-aa95-94841a1773e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=318092177998446d97e2f93f40eae5ec, user_id=4ec6df8a37fa4466a9452f5f22e8cfb2, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:59.321161 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829bccad-7993-4c17-aa95-94841a1773e2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:59.322814 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2471/4982] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:10:59 2022] PUT /identity/v3/projects/16ac6c0038fb47bca014618f94916605/users/8e87601370dc4dcfb462e44b7f49bc52/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:59.323864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cfe41-319e-4b90-acac-432fa99e6068 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:59.336471 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:59.365440 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2512/4983] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:10:59 2022] PUT /identity/v3/projects/318092177998446d97e2f93f40eae5ec/users/4ec6df8a37fa4466a9452f5f22e8cfb2/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:59.366538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d4983-ba8f-49e6-b896-10ea80788366 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:59.366848 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d4983-ba8f-49e6-b896-10ea80788366 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:59.367141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d4983-ba8f-49e6-b896-10ea80788366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:59.441927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-296d4983-ba8f-49e6-b896-10ea80788366 None None] MFA Rules not processed for user `8e87601370dc4dcfb462e44b7f49bc52`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:10:59.443178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-296d4983-ba8f-49e6-b896-10ea80788366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:10:59.518629 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cfe41-319e-4b90-acac-432fa99e6068 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:59.523259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:59.591692 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2513/4984] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:10:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:10:59.595743 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d4983-ba8f-49e6-b896-10ea80788366 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:59.654291 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c315ae-0f1f-4225-b499-dafcc5987e9e tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:59.655786 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c315ae-0f1f-4225-b499-dafcc5987e9e tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:59.658083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c315ae-0f1f-4225-b499-dafcc5987e9e tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:59.658710 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c315ae-0f1f-4225-b499-dafcc5987e9e tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/projects/dba0348da9fd4799918d8e2be3a2434d/users/432d16f0c14c42918eeccc9416089118/roles/1117886c325442909d8df7f96a538103` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:59.722522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c315ae-0f1f-4225-b499-dafcc5987e9e tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:create_grant(project_id=dba0348da9fd4799918d8e2be3a2434d, user_id=432d16f0c14c42918eeccc9416089118, role_id=1117886c325442909d8df7f96a538103)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:59.727895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c315ae-0f1f-4225-b499-dafcc5987e9e tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:59.747889 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2472/4985] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:10:59 2022] PUT /identity/v3/projects/dba0348da9fd4799918d8e2be3a2434d/users/432d16f0c14c42918eeccc9416089118/roles/1117886c325442909d8df7f96a538103 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:10:59.749332 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c315ae-0f1f-4225-b499-dafcc5987e9e tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:59.794502 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d4983-ba8f-49e6-b896-10ea80788366 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:59.875394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c315ae-0f1f-4225-b499-dafcc5987e9e tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:10:59.882478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc656e92-bce6-41c3-8c34-1ef2021f8401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:59.883280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc656e92-bce6-41c3-8c34-1ef2021f8401 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:59.883630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc656e92-bce6-41c3-8c34-1ef2021f8401 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:59.883858 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc656e92-bce6-41c3-8c34-1ef2021f8401 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:59.884484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc656e92-bce6-41c3-8c34-1ef2021f8401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:59.887304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc656e92-bce6-41c3-8c34-1ef2021f8401 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:59.935336 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2473/4986] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:10:59 2022] POST /identity/v3/projects => generated 369 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:10:59.941515 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc656e92-bce6-41c3-8c34-1ef2021f8401 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:10:59.951413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f9fa5-33e9-47f4-abc5-a859496504f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:10:59.953088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f9fa5-33e9-47f4-abc5-a859496504f9 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:10:59.953548 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f9fa5-33e9-47f4-abc5-a859496504f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:10:59.953963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f9fa5-33e9-47f4-abc5-a859496504f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:10:59.954907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f9fa5-33e9-47f4-abc5-a859496504f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:10:59.956825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f9fa5-33e9-47f4-abc5-a859496504f9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:10:59.995423 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2514/4987] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:10:59 2022] GET /identity/v3/roles => generated 1892 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:10:59.996185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f9fa5-33e9-47f4-abc5-a859496504f9 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:00.008604 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f9fa5-33e9-47f4-abc5-a859496504f9 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:00.011479 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:00.103377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc656e92-bce6-41c3-8c34-1ef2021f8401 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:00.114149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff69dc-350c-4cfb-941a-b33470c823ef tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:00.115075 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff69dc-350c-4cfb-941a-b33470c823ef tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:00.115449 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff69dc-350c-4cfb-941a-b33470c823ef tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:00.115821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff69dc-350c-4cfb-941a-b33470c823ef tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/projects/dba0348da9fd4799918d8e2be3a2434d/users/432d16f0c14c42918eeccc9416089118/roles/b70dc1f21068413d8ecbafb503634786` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:00.121823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff69dc-350c-4cfb-941a-b33470c823ef tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:create_grant(project_id=dba0348da9fd4799918d8e2be3a2434d, user_id=432d16f0c14c42918eeccc9416089118, role_id=b70dc1f21068413d8ecbafb503634786)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:00.128450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff69dc-350c-4cfb-941a-b33470c823ef tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:00.154609 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2474/4988] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:10:59 2022] PUT /identity/v3/projects/dba0348da9fd4799918d8e2be3a2434d/users/432d16f0c14c42918eeccc9416089118/roles/b70dc1f21068413d8ecbafb503634786 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:00.155083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff69dc-350c-4cfb-941a-b33470c823ef tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:00.222972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46788852-174b-4681-8981-53131b35e82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:00.226452 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46788852-174b-4681-8981-53131b35e82d admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:00.230968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46788852-174b-4681-8981-53131b35e82d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:00.234120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46788852-174b-4681-8981-53131b35e82d admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:00.236691 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46788852-174b-4681-8981-53131b35e82d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:00.244186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46788852-174b-4681-8981-53131b35e82d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:00.304299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff69dc-350c-4cfb-941a-b33470c823ef tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:00.310808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0dc1f3-8ab8-4cdc-81f4-d92b9b4698c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:00.312873 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0dc1f3-8ab8-4cdc-81f4-d92b9b4698c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:00.313307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0dc1f3-8ab8-4cdc-81f4-d92b9b4698c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:00.313795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0dc1f3-8ab8-4cdc-81f4-d92b9b4698c3 admin admin] PATH_INFO: `/v3/projects/318092177998446d97e2f93f40eae5ec/users/4ec6df8a37fa4466a9452f5f22e8cfb2/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:00.317412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0dc1f3-8ab8-4cdc-81f4-d92b9b4698c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=318092177998446d97e2f93f40eae5ec, user_id=4ec6df8a37fa4466a9452f5f22e8cfb2, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:00.321160 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0dc1f3-8ab8-4cdc-81f4-d92b9b4698c3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:00.338125 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2475/4989] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:11:00 2022] PUT /identity/v3/projects/318092177998446d97e2f93f40eae5ec/users/4ec6df8a37fa4466a9452f5f22e8cfb2/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:00.343983 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2515/4990] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:10:59 2022] POST /identity/v3/users => generated 291 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:00.348693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46788852-174b-4681-8981-53131b35e82d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:00.349518 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0dc1f3-8ab8-4cdc-81f4-d92b9b4698c3 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:00.362015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46788852-174b-4681-8981-53131b35e82d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:00.382099 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:00.449981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0dc1f3-8ab8-4cdc-81f4-d92b9b4698c3 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:00.466404 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f4b3e-8e39-4162-9e40-4e7bd9b602c8 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:00.467063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f4b3e-8e39-4162-9e40-4e7bd9b602c8 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:00.467882 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f4b3e-8e39-4162-9e40-4e7bd9b602c8 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:00.468154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f4b3e-8e39-4162-9e40-4e7bd9b602c8 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:00.468978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20f4b3e-8e39-4162-9e40-4e7bd9b602c8 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:00.471058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20f4b3e-8e39-4162-9e40-4e7bd9b602c8 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:00.490746 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142184c-09de-43dc-9cf6-780ee4c8e373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:00.491373 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142184c-09de-43dc-9cf6-780ee4c8e373 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:00.492340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142184c-09de-43dc-9cf6-780ee4c8e373 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:00.492340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142184c-09de-43dc-9cf6-780ee4c8e373 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:00.492563 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3142184c-09de-43dc-9cf6-780ee4c8e373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:00.494190 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3142184c-09de-43dc-9cf6-780ee4c8e373 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:00.513387 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2476/4991] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:00 2022] GET /identity/v3/users => generated 8353 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:00.515277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38397c35-cb53-4b20-8457-ebc8b0b715ea None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:00.515807 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38397c35-cb53-4b20-8457-ebc8b0b715ea None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:00.516284 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2516/4992] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:00 2022] GET /identity/v3/roles => generated 1892 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:11:00.516395 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38397c35-cb53-4b20-8457-ebc8b0b715ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:00.518309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b394106-aaa3-47b7-8efe-55bca2e0b117 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:00.518611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b394106-aaa3-47b7-8efe-55bca2e0b117 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:00.518888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b394106-aaa3-47b7-8efe-55bca2e0b117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:00.577401 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-38397c35-cb53-4b20-8457-ebc8b0b715ea None None] MFA Rules not processed for user `4ec6df8a37fa4466a9452f5f22e8cfb2`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:00.578439 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-2b394106-aaa3-47b7-8efe-55bca2e0b117 None None] MFA Rules not processed for user `432d16f0c14c42918eeccc9416089118`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:00.579566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-38397c35-cb53-4b20-8457-ebc8b0b715ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:00.579728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2b394106-aaa3-47b7-8efe-55bca2e0b117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:00.642013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:00.720011 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2477/4993] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:00 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:00.720203 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2517/4994] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:00 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:00.720285 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38397c35-cb53-4b20-8457-ebc8b0b715ea None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:00.723579 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b394106-aaa3-47b7-8efe-55bca2e0b117 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:00.730035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38397c35-cb53-4b20-8457-ebc8b0b715ea None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:00.737100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dad0a3-c7cf-4511-88c9-5959ac3d6cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:00.737878 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dad0a3-c7cf-4511-88c9-5959ac3d6cd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:00.738179 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dad0a3-c7cf-4511-88c9-5959ac3d6cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:00.738647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dad0a3-c7cf-4511-88c9-5959ac3d6cd3 admin admin] PATH_INFO: `/v3/projects/d76126ff5fe045da86c8b75db29af606/users/f2f7fec01bd943deb8b2ad0f16a8dd7d/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:00.739288 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b394106-aaa3-47b7-8efe-55bca2e0b117 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:00.752139 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16e22c-5170-47d4-8034-ab68ab9b62fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:00.753030 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16e22c-5170-47d4-8034-ab68ab9b62fb admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:00.753252 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16e22c-5170-47d4-8034-ab68ab9b62fb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:00.753529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16e22c-5170-47d4-8034-ab68ab9b62fb admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:00.754156 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a16e22c-5170-47d4-8034-ab68ab9b62fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:00.756177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a16e22c-5170-47d4-8034-ab68ab9b62fb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:00.766315 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dad0a3-c7cf-4511-88c9-5959ac3d6cd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d76126ff5fe045da86c8b75db29af606, user_id=f2f7fec01bd943deb8b2ad0f16a8dd7d, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:00.771439 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dad0a3-c7cf-4511-88c9-5959ac3d6cd3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:00.796141 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2478/4995] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:11:00 2022] PUT /identity/v3/projects/d76126ff5fe045da86c8b75db29af606/users/f2f7fec01bd943deb8b2ad0f16a8dd7d/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:00.799120 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e67ff1-7564-43b9-bdd6-6af266465e49 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:00.799787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e67ff1-7564-43b9-bdd6-6af266465e49 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:00.800679 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e67ff1-7564-43b9-bdd6-6af266465e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:00.810610 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2518/4996] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:11:00 2022] POST /identity/v3/projects => generated 395 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:00.811756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16e22c-5170-47d4-8034-ab68ab9b62fb admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:00.830446 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-95e67ff1-7564-43b9-bdd6-6af266465e49 None None] MFA Rules not processed for user `432d16f0c14c42918eeccc9416089118`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:00.831841 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-95e67ff1-7564-43b9-bdd6-6af266465e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:00.901678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16e22c-5170-47d4-8034-ab68ab9b62fb admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:00.908634 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf282c1-9da8-4d3f-8ed4-b9e35a43a996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:00.909512 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf282c1-9da8-4d3f-8ed4-b9e35a43a996 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:00.909903 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf282c1-9da8-4d3f-8ed4-b9e35a43a996 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:00.910717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf282c1-9da8-4d3f-8ed4-b9e35a43a996 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:00.911584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf282c1-9da8-4d3f-8ed4-b9e35a43a996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:00.913512 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf282c1-9da8-4d3f-8ed4-b9e35a43a996 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:00.914849 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2479/4997] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:00 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:00.916018 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e67ff1-7564-43b9-bdd6-6af266465e49 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:00.931432 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2519/4998] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:00 2022] GET /identity/v3/roles => generated 1892 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:00.932309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf282c1-9da8-4d3f-8ed4-b9e35a43a996 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:00.937421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e67ff1-7564-43b9-bdd6-6af266465e49 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:00.942349 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:00.944717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa0da4-92de-4717-bb52-3e9f1b712ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:00.945410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa0da4-92de-4717-bb52-3e9f1b712ddc admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:00.945816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa0da4-92de-4717-bb52-3e9f1b712ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:00.947068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa0da4-92de-4717-bb52-3e9f1b712ddc admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:00.947068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaa0da4-92de-4717-bb52-3e9f1b712ddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:00.949500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaa0da4-92de-4717-bb52-3e9f1b712ddc admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:00.950105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf282c1-9da8-4d3f-8ed4-b9e35a43a996 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:00.967042 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9294c-10be-4c3b-92af-eb8cb8260318 tempest-TrustsV3TestJSON-1717125356 tempest-user-1531200519] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432d16f0c14c42918eeccc9416089118', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dba0348da9fd4799918d8e2be3a2434d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-923024492', 'tempest-NotDelegatedRole-2119658081'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:00.967974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9294c-10be-4c3b-92af-eb8cb8260318 tempest-TrustsV3TestJSON-1717125356 tempest-user-1531200519] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:00.969396 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9294c-10be-4c3b-92af-eb8cb8260318 tempest-TrustsV3TestJSON-1717125356 tempest-user-1531200519] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:00.969790 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9294c-10be-4c3b-92af-eb8cb8260318 tempest-TrustsV3TestJSON-1717125356 tempest-user-1531200519] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:00.973413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f9294c-10be-4c3b-92af-eb8cb8260318 tempest-TrustsV3TestJSON-1717125356 tempest-user-1531200519] RBAC: Authorizing `identity:create_trust()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:00.977316 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f9294c-10be-4c3b-92af-eb8cb8260318 tempest-TrustsV3TestJSON-1717125356 tempest-user-1531200519] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:00.981961 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2480/4999] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:11:00 2022] POST /identity/v3/users => generated 298 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:00.983661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa0da4-92de-4717-bb52-3e9f1b712ddc admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:00.997076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa0da4-92de-4717-bb52-3e9f1b712ddc admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:01.004147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430116ce-fb6d-4565-8a57-d4aae6c04305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:01.005365 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430116ce-fb6d-4565-8a57-d4aae6c04305 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:01.005794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430116ce-fb6d-4565-8a57-d4aae6c04305 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:01.006275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430116ce-fb6d-4565-8a57-d4aae6c04305 admin admin] PATH_INFO: `/v3/projects/d76126ff5fe045da86c8b75db29af606/users/f2f7fec01bd943deb8b2ad0f16a8dd7d/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:01.009138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430116ce-fb6d-4565-8a57-d4aae6c04305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d76126ff5fe045da86c8b75db29af606, user_id=f2f7fec01bd943deb8b2ad0f16a8dd7d, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:01.012528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430116ce-fb6d-4565-8a57-d4aae6c04305 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:01.028873 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2481/5000] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:11:00 2022] PUT /identity/v3/projects/d76126ff5fe045da86c8b75db29af606/users/f2f7fec01bd943deb8b2ad0f16a8dd7d/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:01.030973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430116ce-fb6d-4565-8a57-d4aae6c04305 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:01.136291 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430116ce-fb6d-4565-8a57-d4aae6c04305 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:01.137784 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-98f9294c-10be-4c3b-92af-eb8cb8260318 tempest-TrustsV3TestJSON-1717125356 tempest-user-1531200519] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 06 21:11:01.137784 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:11:01.137784 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Aug 06 21:11:01.137784 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Aug 06 21:11:01.137784 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Aug 06 21:11:01.137784 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Aug 06 21:11:01.137784 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Aug 06 21:11:01.137784 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:11:01.137784 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 21:11:01.137784 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:11:01.137784 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:11:01.137784 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Aug 06 21:11:01.137784 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Aug 06 21:11:01.137784 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Aug 06 21:11:01.138791 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise ValueError(str(e)) Aug 06 21:11:01.138791 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Aug 06 21:11:01.138791 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:11:01.138791 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 21:11:01.138791 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:11:01.138791 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:11:01.138791 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:11:01.138791 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:11:01.138791 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:11:01.138791 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:11:01.138791 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:11:01.138791 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:11:01.138791 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:11:01.138791 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:11:01.138791 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:11:01.138791 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:11:01.138791 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Aug 06 21:11:01.138791 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Aug 06 21:11:01.140476 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Aug 06 21:11:01.140476 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Aug 06 21:11:01.140476 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Aug 06 21:11:01.140476 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Aug 06 21:11:01.140476 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 06 21:11:01.140476 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:11:01.140476 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2520/5001] 10.222.0.33 () {60 vars in 1174 bytes} [Sat Aug 6 21:11:00 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 207 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 06 21:11:01.144768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae506c1-3c6a-4cea-a765-58b2a4cc4bad None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:01.145051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae506c1-3c6a-4cea-a765-58b2a4cc4bad None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:01.145145 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b05a6-7534-469b-9e4e-12ca7ed65110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:01.145321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae506c1-3c6a-4cea-a765-58b2a4cc4bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:01.145726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b05a6-7534-469b-9e4e-12ca7ed65110 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:01.146009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b05a6-7534-469b-9e4e-12ca7ed65110 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:01.146285 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b05a6-7534-469b-9e4e-12ca7ed65110 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:01.147019 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b05a6-7534-469b-9e4e-12ca7ed65110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:01.148661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b05a6-7534-469b-9e4e-12ca7ed65110 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:01.161852 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2482/5002] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:01 2022] GET /identity/v3/roles => generated 1892 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:01.163135 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b05a6-7534-469b-9e4e-12ca7ed65110 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:01.181400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-8ae506c1-3c6a-4cea-a765-58b2a4cc4bad None None] MFA Rules not processed for user `f2f7fec01bd943deb8b2ad0f16a8dd7d`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:01.182681 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8ae506c1-3c6a-4cea-a765-58b2a4cc4bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:01.209840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:01.265668 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2521/5003] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:01 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:01.266693 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b05a6-7534-469b-9e4e-12ca7ed65110 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:01.272028 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9e88a-395a-4148-8e4b-57743aa49a67 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:01.272661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9e88a-395a-4148-8e4b-57743aa49a67 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:01.272942 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9e88a-395a-4148-8e4b-57743aa49a67 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:01.273212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9e88a-395a-4148-8e4b-57743aa49a67 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/roles/b70dc1f21068413d8ecbafb503634786` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:01.274641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd9e88a-395a-4148-8e4b-57743aa49a67 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b70dc1f21068413d8ecbafb503634786)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:01.276355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd9e88a-395a-4148-8e4b-57743aa49a67 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:01.276704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae506c1-3c6a-4cea-a765-58b2a4cc4bad None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:01.289441 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae506c1-3c6a-4cea-a765-58b2a4cc4bad None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:01.295336 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49380ba0-cf03-4125-a54d-edbc6005dd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:01.296166 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49380ba0-cf03-4125-a54d-edbc6005dd79 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:01.296557 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49380ba0-cf03-4125-a54d-edbc6005dd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:01.296840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49380ba0-cf03-4125-a54d-edbc6005dd79 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:01.297522 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49380ba0-cf03-4125-a54d-edbc6005dd79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:01.299171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49380ba0-cf03-4125-a54d-edbc6005dd79 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:01.314455 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2522/5004] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:01 2022] GET /identity/v3/roles => generated 1892 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:01.314455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49380ba0-cf03-4125-a54d-edbc6005dd79 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:01.314716 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-49380ba0-cf03-4125-a54d-edbc6005dd79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:01.330437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6dd9e88a-395a-4148-8e4b-57743aa49a67 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invalidating the token cache because role b70dc1f21068413d8ecbafb503634786 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:11:01.331075 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6dd9e88a-395a-4148-8e4b-57743aa49a67 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:01.332286 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6dd9e88a-395a-4148-8e4b-57743aa49a67 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:01.335571 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2483/5005] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:11:01 2022] DELETE /identity/v3/roles/b70dc1f21068413d8ecbafb503634786 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:01.339382 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9e88a-395a-4148-8e4b-57743aa49a67 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:01.339641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6dd9e88a-395a-4148-8e4b-57743aa49a67 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:01.394554 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49380ba0-cf03-4125-a54d-edbc6005dd79 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:01.427235 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:01.453205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f910a3-73a9-424e-bc18-d5f91b0d98b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:01.453918 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f910a3-73a9-424e-bc18-d5f91b0d98b5 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:01.454268 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f910a3-73a9-424e-bc18-d5f91b0d98b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:01.454655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f910a3-73a9-424e-bc18-d5f91b0d98b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:01.456813 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-01f910a3-73a9-424e-bc18-d5f91b0d98b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:01.475412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9e88a-395a-4148-8e4b-57743aa49a67 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:01.485515 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad630f-d04c-4644-9656-8688215df8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:01.486718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad630f-d04c-4644-9656-8688215df8ac admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:01.487263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad630f-d04c-4644-9656-8688215df8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:01.487934 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad630f-d04c-4644-9656-8688215df8ac admin admin] PATH_INFO: `/v3/projects/e9dbe93730c24567b581341ce46586bf/users/56faf6bfee6e4bd1bf4b31ad5e80906e/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:01.538999 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad630f-d04c-4644-9656-8688215df8ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9dbe93730c24567b581341ce46586bf, user_id=56faf6bfee6e4bd1bf4b31ad5e80906e, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:01.551930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad630f-d04c-4644-9656-8688215df8ac admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:01.595744 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2484/5006] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:11:01 2022] PUT /identity/v3/projects/e9dbe93730c24567b581341ce46586bf/users/56faf6bfee6e4bd1bf4b31ad5e80906e/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:01.596013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f910a3-73a9-424e-bc18-d5f91b0d98b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:01.599362 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f910a3-73a9-424e-bc18-d5f91b0d98b5 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:01.607777 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad630f-d04c-4644-9656-8688215df8ac admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:01.617098 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-13ad630f-d04c-4644-9656-8688215df8ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:01.635691 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2523/5007] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:11:01 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:11:01.636989 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f9fe3-4e7f-4c8b-a920-104973fb1cad None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:01.637274 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f9fe3-4e7f-4c8b-a920-104973fb1cad None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:01.641572 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f9fe3-4e7f-4c8b-a920-104973fb1cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:01.707234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-0d2f9fe3-4e7f-4c8b-a920-104973fb1cad None None] MFA Rules not processed for user `56faf6bfee6e4bd1bf4b31ad5e80906e`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:01.708994 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0d2f9fe3-4e7f-4c8b-a920-104973fb1cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:01.767077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad630f-d04c-4644-9656-8688215df8ac admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:01.775690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e66ee-63a6-423a-a3d2-53f5d2ef72ee tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:01.776410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e66ee-63a6-423a-a3d2-53f5d2ef72ee tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:01.776693 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e66ee-63a6-423a-a3d2-53f5d2ef72ee tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:01.776965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e66ee-63a6-423a-a3d2-53f5d2ef72ee tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/roles/1117886c325442909d8df7f96a538103` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:01.778500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e66ee-63a6-423a-a3d2-53f5d2ef72ee tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1117886c325442909d8df7f96a538103)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:01.780660 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e66ee-63a6-423a-a3d2-53f5d2ef72ee tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:01.789986 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:01.856490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-594e66ee-63a6-423a-a3d2-53f5d2ef72ee tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invalidating the token cache because role 1117886c325442909d8df7f96a538103 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:11:01.856744 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-594e66ee-63a6-423a-a3d2-53f5d2ef72ee tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:01.858767 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-594e66ee-63a6-423a-a3d2-53f5d2ef72ee tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:01.868623 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2485/5008] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:11:01 2022] DELETE /identity/v3/roles/1117886c325442909d8df7f96a538103 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:01.870907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e66ee-63a6-423a-a3d2-53f5d2ef72ee tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:01.880668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-594e66ee-63a6-423a-a3d2-53f5d2ef72ee tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:01.890036 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2524/5009] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:01 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:01.908028 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f9fe3-4e7f-4c8b-a920-104973fb1cad None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:01.909598 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0d2f9fe3-4e7f-4c8b-a920-104973fb1cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:02.065476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f9fe3-4e7f-4c8b-a920-104973fb1cad None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:02.066577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e66ee-63a6-423a-a3d2-53f5d2ef72ee tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:02.077348 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89cedf-9d50-4c8d-b27e-d190e92ca836 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:02.078125 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89cedf-9d50-4c8d-b27e-d190e92ca836 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:02.078421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89cedf-9d50-4c8d-b27e-d190e92ca836 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:02.078735 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89cedf-9d50-4c8d-b27e-d190e92ca836 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/users/432d16f0c14c42918eeccc9416089118` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:02.081688 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89cedf-9d50-4c8d-b27e-d190e92ca836 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:delete_user(user_id=432d16f0c14c42918eeccc9416089118)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:02.084875 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89cedf-9d50-4c8d-b27e-d190e92ca836 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:02.102241 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:02.175926 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d5d03-2cf6-43b5-8f52-a0e828fafced service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10759b2abd4cafacf338551327775e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:02.176894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d5d03-2cf6-43b5-8f52-a0e828fafced service glance] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:02.177272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d5d03-2cf6-43b5-8f52-a0e828fafced service glance] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:02.178321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d5d03-2cf6-43b5-8f52-a0e828fafced service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:02.182527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f57d5d03-2cf6-43b5-8f52-a0e828fafced service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:02.185021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ad89cedf-9d50-4c8d-b27e-d190e92ca836 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '432d16f0c14c42918eeccc9416089118'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:02.185860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ad89cedf-9d50-4c8d-b27e-d190e92ca836 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '432d16f0c14c42918eeccc9416089118'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:02.196736 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ad89cedf-9d50-4c8d-b27e-d190e92ca836 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '432d16f0c14c42918eeccc9416089118'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:02.214997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ad89cedf-9d50-4c8d-b27e-d190e92ca836 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '432d16f0c14c42918eeccc9416089118'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:02.236103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ad89cedf-9d50-4c8d-b27e-d190e92ca836 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '432d16f0c14c42918eeccc9416089118'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:02.268412 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2486/5010] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:11:01 2022] DELETE /identity/v3/users/432d16f0c14c42918eeccc9416089118 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:02.273326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89cedf-9d50-4c8d-b27e-d190e92ca836 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:02.276232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ad89cedf-9d50-4c8d-b27e-d190e92ca836 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:02.291065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d5d03-2cf6-43b5-8f52-a0e828fafced service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:02.292838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d5d03-2cf6-43b5-8f52-a0e828fafced service glance] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:02.319490 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2525/5011] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:11:01 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:11:02.360365 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:02.397489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d5d03-2cf6-43b5-8f52-a0e828fafced service glance] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:02.399677 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f57d5d03-2cf6-43b5-8f52-a0e828fafced service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:02.410289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89cedf-9d50-4c8d-b27e-d190e92ca836 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:02.435354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdba080-c093-49ee-8fce-c2e1541b1815 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:02.435354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdba080-c093-49ee-8fce-c2e1541b1815 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:02.435354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdba080-c093-49ee-8fce-c2e1541b1815 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:02.435704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdba080-c093-49ee-8fce-c2e1541b1815 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/projects/dba0348da9fd4799918d8e2be3a2434d` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:02.438172 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdba080-c093-49ee-8fce-c2e1541b1815 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dba0348da9fd4799918d8e2be3a2434d)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:02.441004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdba080-c093-49ee-8fce-c2e1541b1815 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:02.555513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d5d03-2cf6-43b5-8f52-a0e828fafced service glance] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:02.567920 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6bdba080-c093-49ee-8fce-c2e1541b1815 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dba0348da9fd4799918d8e2be3a2434d', 'request_id': 'req-6bdba080-c093-49ee-8fce-c2e1541b1815'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:02.582208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6bdba080-c093-49ee-8fce-c2e1541b1815 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dba0348da9fd4799918d8e2be3a2434d', 'request_id': 'req-6bdba080-c093-49ee-8fce-c2e1541b1815'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:02.597430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6bdba080-c093-49ee-8fce-c2e1541b1815 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dba0348da9fd4799918d8e2be3a2434d', 'request_id': 'req-6bdba080-c093-49ee-8fce-c2e1541b1815'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:02.622944 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6bdba080-c093-49ee-8fce-c2e1541b1815 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] The token cache is being invalidate because project dba0348da9fd4799918d8e2be3a2434d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:11:02.623335 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6bdba080-c093-49ee-8fce-c2e1541b1815 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:02.625770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6bdba080-c093-49ee-8fce-c2e1541b1815 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:02.632062 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2487/5012] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:11:02 2022] DELETE /identity/v3/projects/dba0348da9fd4799918d8e2be3a2434d => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:02.638124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdba080-c093-49ee-8fce-c2e1541b1815 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:02.641224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6bdba080-c093-49ee-8fce-c2e1541b1815 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:02.694975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99920281-ba43-4e64-b508-195f4952f55d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:02.695646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99920281-ba43-4e64-b508-195f4952f55d service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:02.695962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99920281-ba43-4e64-b508-195f4952f55d service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:02.696820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99920281-ba43-4e64-b508-195f4952f55d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:02.698936 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-99920281-ba43-4e64-b508-195f4952f55d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:02.773820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdba080-c093-49ee-8fce-c2e1541b1815 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:02.781367 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361c517-45c4-4f15-9483-bd386e568ea8 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:02.782331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361c517-45c4-4f15-9483-bd386e568ea8 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:02.782780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361c517-45c4-4f15-9483-bd386e568ea8 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:02.783129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361c517-45c4-4f15-9483-bd386e568ea8 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:02.784115 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e361c517-45c4-4f15-9483-bd386e568ea8 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:02.786805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e361c517-45c4-4f15-9483-bd386e568ea8 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:02.801670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:02.830655 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2488/5013] 10.222.0.33 () {60 vars in 1152 bytes} [Sat Aug 6 21:11:02 2022] POST /identity/v3/projects => generated 329 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:11:02.831927 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361c517-45c4-4f15-9483-bd386e568ea8 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:02.857005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99920281-ba43-4e64-b508-195f4952f55d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:02.858720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99920281-ba43-4e64-b508-195f4952f55d service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:02.885209 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2526/5014] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:11:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:11:02.951247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361c517-45c4-4f15-9483-bd386e568ea8 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:02.958615 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128179c-c7e6-4947-9958-60828f36b908 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:02.960026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128179c-c7e6-4947-9958-60828f36b908 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:02.960553 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128179c-c7e6-4947-9958-60828f36b908 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:02.961013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128179c-c7e6-4947-9958-60828f36b908 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:02.961859 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128179c-c7e6-4947-9958-60828f36b908 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:02.964320 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128179c-c7e6-4947-9958-60828f36b908 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:02.980477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:03.002530 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2489/5015] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:11:02 2022] POST /identity/v3/users => generated 416 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:11:03.006307 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99920281-ba43-4e64-b508-195f4952f55d service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:03.043735 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128179c-c7e6-4947-9958-60828f36b908 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:03.044958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99920281-ba43-4e64-b508-195f4952f55d service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:03.046354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6128179c-c7e6-4947-9958-60828f36b908 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:03.057587 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca46d17-b6bc-4e51-b294-466c10d243d7 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:03.061641 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca46d17-b6bc-4e51-b294-466c10d243d7 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:03.062336 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca46d17-b6bc-4e51-b294-466c10d243d7 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:03.063822 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca46d17-b6bc-4e51-b294-466c10d243d7 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:03.064713 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca46d17-b6bc-4e51-b294-466c10d243d7 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:03.070527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca46d17-b6bc-4e51-b294-466c10d243d7 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:03.130957 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2527/5016] 10.222.0.33 () {60 vars in 1143 bytes} [Sat Aug 6 21:11:03 2022] POST /identity/v3/roles => generated 243 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:11:03.135114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca46d17-b6bc-4e51-b294-466c10d243d7 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:03.150788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca46d17-b6bc-4e51-b294-466c10d243d7 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:03.158044 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa6c27-35cf-4e9c-9feb-e837cc22b640 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:03.158884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa6c27-35cf-4e9c-9feb-e837cc22b640 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:03.159260 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa6c27-35cf-4e9c-9feb-e837cc22b640 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:03.159611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa6c27-35cf-4e9c-9feb-e837cc22b640 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:03.161141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa6c27-35cf-4e9c-9feb-e837cc22b640 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:03.163137 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa6c27-35cf-4e9c-9feb-e837cc22b640 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:03.205030 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2528/5017] 10.222.0.33 () {60 vars in 1143 bytes} [Sat Aug 6 21:11:03 2022] POST /identity/v3/roles => generated 247 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:03.208684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa6c27-35cf-4e9c-9feb-e837cc22b640 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:03.215525 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128179c-c7e6-4947-9958-60828f36b908 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:03.222163 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc863674-d404-4d1e-ba36-12228a12f9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:03.222497 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc863674-d404-4d1e-ba36-12228a12f9ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:03.222812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc863674-d404-4d1e-ba36-12228a12f9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:03.223085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc863674-d404-4d1e-ba36-12228a12f9ce admin admin] PATH_INFO: `/v3/users/4ec6df8a37fa4466a9452f5f22e8cfb2` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:03.224719 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc863674-d404-4d1e-ba36-12228a12f9ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ec6df8a37fa4466a9452f5f22e8cfb2)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:03.226705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc863674-d404-4d1e-ba36-12228a12f9ce admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:03.247661 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa6c27-35cf-4e9c-9feb-e837cc22b640 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:03.261544 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedaea1-f4c7-4b66-b780-36443f700044 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:03.262499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedaea1-f4c7-4b66-b780-36443f700044 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:03.262499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedaea1-f4c7-4b66-b780-36443f700044 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:03.262767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedaea1-f4c7-4b66-b780-36443f700044 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/projects/3faba6887afe432fba9b9e4217a63424/users/f10b01ff43b240a1b1c6f29688086fc0/roles/345b8cd3a73646b2afb8b704713e94b7` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:03.303569 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aedaea1-f4c7-4b66-b780-36443f700044 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3faba6887afe432fba9b9e4217a63424, user_id=f10b01ff43b240a1b1c6f29688086fc0, role_id=345b8cd3a73646b2afb8b704713e94b7)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:03.306441 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aedaea1-f4c7-4b66-b780-36443f700044 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:03.312137 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bc863674-d404-4d1e-ba36-12228a12f9ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ec6df8a37fa4466a9452f5f22e8cfb2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:03.314861 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bc863674-d404-4d1e-ba36-12228a12f9ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ec6df8a37fa4466a9452f5f22e8cfb2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:03.315755 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bc863674-d404-4d1e-ba36-12228a12f9ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ec6df8a37fa4466a9452f5f22e8cfb2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:03.328810 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bc863674-d404-4d1e-ba36-12228a12f9ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ec6df8a37fa4466a9452f5f22e8cfb2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:03.334041 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2529/5018] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:11:03 2022] PUT /identity/v3/projects/3faba6887afe432fba9b9e4217a63424/users/f10b01ff43b240a1b1c6f29688086fc0/roles/345b8cd3a73646b2afb8b704713e94b7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:03.340590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedaea1-f4c7-4b66-b780-36443f700044 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:03.344768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8aedaea1-f4c7-4b66-b780-36443f700044 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:03.371774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bc863674-d404-4d1e-ba36-12228a12f9ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ec6df8a37fa4466a9452f5f22e8cfb2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:03.421593 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2490/5019] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:11:03 2022] DELETE /identity/v3/users/4ec6df8a37fa4466a9452f5f22e8cfb2 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:03.429968 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84fdfa-9cde-4e60-bd28-1651e7d8bc6b None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:03.430266 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84fdfa-9cde-4e60-bd28-1651e7d8bc6b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:03.430779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84fdfa-9cde-4e60-bd28-1651e7d8bc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:03.547725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-1f84fdfa-9cde-4e60-bd28-1651e7d8bc6b None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:03.554020 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1f84fdfa-9cde-4e60-bd28-1651e7d8bc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:03.630605 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedaea1-f4c7-4b66-b780-36443f700044 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:03.735752 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf172a6-8859-4581-8d2c-7b5d064b578f tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:03.736667 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf172a6-8859-4581-8d2c-7b5d064b578f tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:03.737009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf172a6-8859-4581-8d2c-7b5d064b578f tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:03.737756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf172a6-8859-4581-8d2c-7b5d064b578f tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/projects/3faba6887afe432fba9b9e4217a63424/users/f10b01ff43b240a1b1c6f29688086fc0/roles/002e5080addc4a4a9d1734d4e9eedfd7` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:03.740455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf172a6-8859-4581-8d2c-7b5d064b578f tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3faba6887afe432fba9b9e4217a63424, user_id=f10b01ff43b240a1b1c6f29688086fc0, role_id=002e5080addc4a4a9d1734d4e9eedfd7)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:03.745079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf172a6-8859-4581-8d2c-7b5d064b578f tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:03.769645 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2491/5020] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:03.773724 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2530/5021] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:11:03 2022] PUT /identity/v3/projects/3faba6887afe432fba9b9e4217a63424/users/f10b01ff43b240a1b1c6f29688086fc0/roles/002e5080addc4a4a9d1734d4e9eedfd7 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:03.777935 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84fdfa-9cde-4e60-bd28-1651e7d8bc6b None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:03.793537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf172a6-8859-4581-8d2c-7b5d064b578f tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:03.796231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4bf172a6-8859-4581-8d2c-7b5d064b578f tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:03.800562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84fdfa-9cde-4e60-bd28-1651e7d8bc6b None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:03.835681 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:03.838354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:03.907148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf172a6-8859-4581-8d2c-7b5d064b578f tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:03.911995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbeeb9d-468e-4671-b211-902995d31368 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:03.912966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbeeb9d-468e-4671-b211-902995d31368 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:03.913352 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbeeb9d-468e-4671-b211-902995d31368 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:03.914048 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbeeb9d-468e-4671-b211-902995d31368 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:03.946897 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c313fa5-8582-4f62-981a-36bc1a43ef28 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:03.948298 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c313fa5-8582-4f62-981a-36bc1a43ef28 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:03.948732 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c313fa5-8582-4f62-981a-36bc1a43ef28 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:03.949333 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c313fa5-8582-4f62-981a-36bc1a43ef28 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:03.950700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c313fa5-8582-4f62-981a-36bc1a43ef28 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:03.953283 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c313fa5-8582-4f62-981a-36bc1a43ef28 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:03.992637 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2492/5022] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:03 2022] GET /identity/v3/users => generated 8346 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:03.995083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42100a2-8712-4376-947e-a0eade57a0aa None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:03.995385 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42100a2-8712-4376-947e-a0eade57a0aa None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:03.995659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42100a2-8712-4376-947e-a0eade57a0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:04.003261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbeeb9d-468e-4671-b211-902995d31368 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:04.007834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbeeb9d-468e-4671-b211-902995d31368 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:04.023545 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2531/5023] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:11:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:11:04.044181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-c42100a2-8712-4376-947e-a0eade57a0aa None None] MFA Rules not processed for user `f10b01ff43b240a1b1c6f29688086fc0`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:04.046118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c42100a2-8712-4376-947e-a0eade57a0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:04.141403 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2493/5024] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:03 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:04.151643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392aff42-8c5d-41ac-b8f8-a76b2174cd26 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:04.152055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392aff42-8c5d-41ac-b8f8-a76b2174cd26 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:04.152584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392aff42-8c5d-41ac-b8f8-a76b2174cd26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:04.202211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-392aff42-8c5d-41ac-b8f8-a76b2174cd26 None None] MFA Rules not processed for user `f10b01ff43b240a1b1c6f29688086fc0`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:04.206797 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-392aff42-8c5d-41ac-b8f8-a76b2174cd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:04.227052 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2532/5025] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:04 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:04.231523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42100a2-8712-4376-947e-a0eade57a0aa None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:04.274488 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42100a2-8712-4376-947e-a0eade57a0aa None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:04.296429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee43a8d-2abd-4fb8-afa6-98c3a0c7f429 tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f10b01ff43b240a1b1c6f29688086fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3faba6887afe432fba9b9e4217a63424', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1326102830', 'tempest-DelegatedRole-476008353'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:04.297073 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee43a8d-2abd-4fb8-afa6-98c3a0c7f429 tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:04.298568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee43a8d-2abd-4fb8-afa6-98c3a0c7f429 tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:04.298775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee43a8d-2abd-4fb8-afa6-98c3a0c7f429 tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:04.300221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee43a8d-2abd-4fb8-afa6-98c3a0c7f429 tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] RBAC: Authorizing `identity:create_trust()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:04.303794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee43a8d-2abd-4fb8-afa6-98c3a0c7f429 tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:04.487033 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2494/5026] 10.222.0.33 () {60 vars in 1174 bytes} [Sat Aug 6 21:11:04 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:04.491458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392aff42-8c5d-41ac-b8f8-a76b2174cd26 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:04.505871 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392aff42-8c5d-41ac-b8f8-a76b2174cd26 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:04.513175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888365cd-8f62-4121-afa2-e367eb6e38e3 tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f10b01ff43b240a1b1c6f29688086fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3faba6887afe432fba9b9e4217a63424', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1326102830', 'tempest-DelegatedRole-476008353'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:04.514401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888365cd-8f62-4121-afa2-e367eb6e38e3 tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:04.514878 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888365cd-8f62-4121-afa2-e367eb6e38e3 tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:04.515241 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888365cd-8f62-4121-afa2-e367eb6e38e3 tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] PATH_INFO: `/v3/OS-TRUST/trusts/3ce8aba748a64140a808afd637a40873` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:04.520115 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee43a8d-2abd-4fb8-afa6-98c3a0c7f429 tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:04.523483 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888365cd-8f62-4121-afa2-e367eb6e38e3 tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] RBAC: Authorizing `identity:get_trust(trust_id=3ce8aba748a64140a808afd637a40873)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:04.525246 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888365cd-8f62-4121-afa2-e367eb6e38e3 tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:04.541543 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee43a8d-2abd-4fb8-afa6-98c3a0c7f429 tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:04.542611 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2533/5027] 10.222.0.33 () {58 vars in 1251 bytes} [Sat Aug 6 21:11:04 2022] GET /identity/v3/OS-TRUST/trusts/3ce8aba748a64140a808afd637a40873 => generated 833 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:11:04.543644 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888365cd-8f62-4121-afa2-e367eb6e38e3 tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:04.546331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88786b0-f681-440e-8942-a9a4b0693ad5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:04.547042 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88786b0-f681-440e-8942-a9a4b0693ad5 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:04.547326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88786b0-f681-440e-8942-a9a4b0693ad5 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:04.547600 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88786b0-f681-440e-8942-a9a4b0693ad5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:04.552793 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b88786b0-f681-440e-8942-a9a4b0693ad5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:04.569808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888365cd-8f62-4121-afa2-e367eb6e38e3 tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:04.594205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a4c31-d44e-44b9-871c-d153c16bd6cb tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f10b01ff43b240a1b1c6f29688086fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3faba6887afe432fba9b9e4217a63424', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1326102830', 'tempest-DelegatedRole-476008353'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:04.594901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a4c31-d44e-44b9-871c-d153c16bd6cb tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:04.595178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a4c31-d44e-44b9-871c-d153c16bd6cb tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:04.595450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a4c31-d44e-44b9-871c-d153c16bd6cb tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] PATH_INFO: `/v3/OS-TRUST/trusts/3ce8aba748a64140a808afd637a40873/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:04.599430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88786b0-f681-440e-8942-a9a4b0693ad5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:04.601930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88786b0-f681-440e-8942-a9a4b0693ad5 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:04.604614 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a4c31-d44e-44b9-871c-d153c16bd6cb tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=3ce8aba748a64140a808afd637a40873)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:04.606133 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a4c31-d44e-44b9-871c-d153c16bd6cb tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:04.616263 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2534/5028] 10.222.0.33 () {58 vars in 1269 bytes} [Sat Aug 6 21:11:04 2022] GET /identity/v3/OS-TRUST/trusts/3ce8aba748a64140a808afd637a40873/roles => generated 370 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:11:04.619753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a4c31-d44e-44b9-871c-d153c16bd6cb tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:04.624468 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2495/5029] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:11:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:11:04.632494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a4c31-d44e-44b9-871c-d153c16bd6cb tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:04.639633 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb13a53-0263-46bf-9c2b-9208362d3430 tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f10b01ff43b240a1b1c6f29688086fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3faba6887afe432fba9b9e4217a63424', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1326102830', 'tempest-DelegatedRole-476008353'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:04.640526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb13a53-0263-46bf-9c2b-9208362d3430 tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:04.640796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb13a53-0263-46bf-9c2b-9208362d3430 tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:04.641200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb13a53-0263-46bf-9c2b-9208362d3430 tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] PATH_INFO: `/v3/OS-TRUST/trusts/3ce8aba748a64140a808afd637a40873/roles/345b8cd3a73646b2afb8b704713e94b7` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:04.652081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb13a53-0263-46bf-9c2b-9208362d3430 tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] RBAC: Authorizing `identity:get_role_for_trust(trust_id=3ce8aba748a64140a808afd637a40873, role_id=345b8cd3a73646b2afb8b704713e94b7)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:04.653498 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb13a53-0263-46bf-9c2b-9208362d3430 tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:04.666088 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2535/5030] 10.222.0.33 () {58 vars in 1368 bytes} [Sat Aug 6 21:11:04 2022] GET /identity/v3/OS-TRUST/trusts/3ce8aba748a64140a808afd637a40873/roles/345b8cd3a73646b2afb8b704713e94b7 => generated 243 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:11:04.667053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88786b0-f681-440e-8942-a9a4b0693ad5 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:04.687267 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88786b0-f681-440e-8942-a9a4b0693ad5 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:04.692649 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc19f4-9c3d-4447-9d06-a947ea4a5b91 tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f10b01ff43b240a1b1c6f29688086fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3faba6887afe432fba9b9e4217a63424', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1326102830', 'tempest-DelegatedRole-476008353'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:04.693379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc19f4-9c3d-4447-9d06-a947ea4a5b91 tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] REQUEST_METHOD: `HEAD` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:04.693688 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc19f4-9c3d-4447-9d06-a947ea4a5b91 tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:04.694193 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc19f4-9c3d-4447-9d06-a947ea4a5b91 tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] PATH_INFO: `/v3/OS-TRUST/trusts/3ce8aba748a64140a808afd637a40873/roles/345b8cd3a73646b2afb8b704713e94b7` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:04.700216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:04.704089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc19f4-9c3d-4447-9d06-a947ea4a5b91 tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] RBAC: Authorizing `identity:get_role_for_trust(trust_id=3ce8aba748a64140a808afd637a40873, role_id=345b8cd3a73646b2afb8b704713e94b7)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:04.706471 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc19f4-9c3d-4447-9d06-a947ea4a5b91 tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:04.716796 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2496/5031] 10.222.0.33 () {58 vars in 1369 bytes} [Sat Aug 6 21:11:04 2022] HEAD /identity/v3/OS-TRUST/trusts/3ce8aba748a64140a808afd637a40873/roles/345b8cd3a73646b2afb8b704713e94b7 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 06 21:11:04.721837 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb13a53-0263-46bf-9c2b-9208362d3430 tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:04.734054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb13a53-0263-46bf-9c2b-9208362d3430 tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:04.739153 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fc9e0-4d90-42be-9efb-bffe560e284e tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f10b01ff43b240a1b1c6f29688086fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3faba6887afe432fba9b9e4217a63424', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1326102830', 'tempest-DelegatedRole-476008353'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:04.739728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fc9e0-4d90-42be-9efb-bffe560e284e tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:04.739728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fc9e0-4d90-42be-9efb-bffe560e284e tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:04.739901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fc9e0-4d90-42be-9efb-bffe560e284e tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] PATH_INFO: `/v3/OS-TRUST/trusts/3ce8aba748a64140a808afd637a40873/roles/002e5080addc4a4a9d1734d4e9eedfd7` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:04.747003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5fc9e0-4d90-42be-9efb-bffe560e284e tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] RBAC: Authorizing `identity:get_role_for_trust(trust_id=3ce8aba748a64140a808afd637a40873, role_id=002e5080addc4a4a9d1734d4e9eedfd7)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:04.748574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5fc9e0-4d90-42be-9efb-bffe560e284e tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:04.759303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-fd5fc9e0-4d90-42be-9efb-bffe560e284e tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] Could not find role: 002e5080addc4a4a9d1734d4e9eedfd7.: keystone.exception.RoleNotFound: Could not find role: 002e5080addc4a4a9d1734d4e9eedfd7. Aug 06 21:11:04.759303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:11:04.759303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:11:04.759303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:11:04.759303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:11:04.759303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:11:04.759303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:11:04.759303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:11:04.759303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:11:04.759303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:11:04.759303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:11:04.759303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:11:04.759303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 06 21:11:04.759303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 21:11:04.759303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 002e5080addc4a4a9d1734d4e9eedfd7. Aug 06 21:11:04.760172 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:11:04.762600 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2536/5032] 10.222.0.33 () {58 vars in 1368 bytes} [Sat Aug 6 21:11:04 2022] GET /identity/v3/OS-TRUST/trusts/3ce8aba748a64140a808afd637a40873/roles/002e5080addc4a4a9d1734d4e9eedfd7 => generated 110 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:11:04.765648 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc19f4-9c3d-4447-9d06-a947ea4a5b91 tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:04.778972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc19f4-9c3d-4447-9d06-a947ea4a5b91 tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:04.786885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc63e2-0ed0-4071-a6a6-3624bc539cea tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f10b01ff43b240a1b1c6f29688086fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3faba6887afe432fba9b9e4217a63424', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1326102830', 'tempest-DelegatedRole-476008353'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:04.788087 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc63e2-0ed0-4071-a6a6-3624bc539cea tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] REQUEST_METHOD: `HEAD` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:04.788397 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc63e2-0ed0-4071-a6a6-3624bc539cea tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:04.788813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc63e2-0ed0-4071-a6a6-3624bc539cea tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] PATH_INFO: `/v3/OS-TRUST/trusts/3ce8aba748a64140a808afd637a40873/roles/002e5080addc4a4a9d1734d4e9eedfd7` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:04.806643 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc63e2-0ed0-4071-a6a6-3624bc539cea tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] RBAC: Authorizing `identity:get_role_for_trust(trust_id=3ce8aba748a64140a808afd637a40873, role_id=002e5080addc4a4a9d1734d4e9eedfd7)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:04.808489 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc63e2-0ed0-4071-a6a6-3624bc539cea tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:04.822111 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-ccfc63e2-0ed0-4071-a6a6-3624bc539cea tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] Could not find role: 002e5080addc4a4a9d1734d4e9eedfd7.: keystone.exception.RoleNotFound: Could not find role: 002e5080addc4a4a9d1734d4e9eedfd7. Aug 06 21:11:04.822111 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:11:04.822111 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:11:04.822111 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:11:04.822111 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:11:04.822111 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:11:04.822111 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:11:04.822111 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:11:04.822111 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:11:04.822111 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:11:04.822111 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:11:04.822111 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:11:04.822111 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 06 21:11:04.822111 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 21:11:04.822111 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 002e5080addc4a4a9d1734d4e9eedfd7. Aug 06 21:11:04.823197 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:11:04.824631 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2497/5033] 10.222.0.33 () {58 vars in 1369 bytes} [Sat Aug 6 21:11:04 2022] HEAD /identity/v3/OS-TRUST/trusts/3ce8aba748a64140a808afd637a40873/roles/002e5080addc4a4a9d1734d4e9eedfd7 => generated 0 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Aug 06 21:11:04.829701 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fc9e0-4d90-42be-9efb-bffe560e284e tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:04.839992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fc9e0-4d90-42be-9efb-bffe560e284e tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:04.846585 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fff7f9-1aaa-40b1-919e-5440facf2ace tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f10b01ff43b240a1b1c6f29688086fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3faba6887afe432fba9b9e4217a63424', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1326102830', 'tempest-DelegatedRole-476008353'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:04.847709 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fff7f9-1aaa-40b1-919e-5440facf2ace tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:04.848246 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fff7f9-1aaa-40b1-919e-5440facf2ace tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:04.848744 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fff7f9-1aaa-40b1-919e-5440facf2ace tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] PATH_INFO: `/v3/OS-TRUST/trusts/3ce8aba748a64140a808afd637a40873` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:04.856098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fff7f9-1aaa-40b1-919e-5440facf2ace tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] RBAC: Authorizing `identity:delete_trust(trust_id=3ce8aba748a64140a808afd637a40873)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:04.858610 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fff7f9-1aaa-40b1-919e-5440facf2ace tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:04.882742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a8fff7f9-1aaa-40b1-919e-5440facf2ace tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '3ce8aba748a64140a808afd637a40873', 'request_id': 'req-a8fff7f9-1aaa-40b1-919e-5440facf2ace'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:04.888500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a8fff7f9-1aaa-40b1-919e-5440facf2ace tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '3ce8aba748a64140a808afd637a40873', 'request_id': 'req-a8fff7f9-1aaa-40b1-919e-5440facf2ace'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:04.888915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a8fff7f9-1aaa-40b1-919e-5440facf2ace tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '3ce8aba748a64140a808afd637a40873', 'request_id': 'req-a8fff7f9-1aaa-40b1-919e-5440facf2ace'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:04.911375 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2537/5034] 10.222.0.33 () {58 vars in 1254 bytes} [Sat Aug 6 21:11:04 2022] DELETE /identity/v3/OS-TRUST/trusts/3ce8aba748a64140a808afd637a40873 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:04.916363 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc63e2-0ed0-4071-a6a6-3624bc539cea tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:04.918997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ccfc63e2-0ed0-4071-a6a6-3624bc539cea tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:04.946119 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc63e2-0ed0-4071-a6a6-3624bc539cea tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:04.953707 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac54358-546e-4b60-8528-dbde67fe304a tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f10b01ff43b240a1b1c6f29688086fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3faba6887afe432fba9b9e4217a63424', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1326102830', 'tempest-DelegatedRole-476008353'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:04.956427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac54358-546e-4b60-8528-dbde67fe304a tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:04.956831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac54358-546e-4b60-8528-dbde67fe304a tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:04.957209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac54358-546e-4b60-8528-dbde67fe304a tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] PATH_INFO: `/v3/OS-TRUST/trusts/3ce8aba748a64140a808afd637a40873` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:04.973411 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-2ac54358-546e-4b60-8528-dbde67fe304a tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] Could not find trust: 3ce8aba748a64140a808afd637a40873.: keystone.exception.TrustNotFound: Could not find trust: 3ce8aba748a64140a808afd637a40873. Aug 06 21:11:04.973411 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:11:04.973411 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:11:04.973411 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:11:04.973411 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:11:04.973411 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:11:04.973411 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:11:04.973411 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:11:04.973411 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:11:04.973411 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:11:04.973411 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:11:04.973411 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:11:04.973411 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 06 21:11:04.973411 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 06 21:11:04.973411 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 06 21:11:04.974602 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 06 21:11:04.974602 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 06 21:11:04.974602 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 06 21:11:04.974602 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 06 21:11:04.974602 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 06 21:11:04.974602 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:11:04.974602 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:11:04.974602 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 06 21:11:04.974602 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 06 21:11:04.974602 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 06 21:11:04.974602 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 06 21:11:04.974602 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 3ce8aba748a64140a808afd637a40873. Aug 06 21:11:04.974602 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:11:04.979914 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2498/5035] 10.222.0.33 () {58 vars in 1251 bytes} [Sat Aug 6 21:11:04 2022] GET /identity/v3/OS-TRUST/trusts/3ce8aba748a64140a808afd637a40873 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:11:04.981706 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fff7f9-1aaa-40b1-919e-5440facf2ace tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:04.984828 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a8fff7f9-1aaa-40b1-919e-5440facf2ace tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:05.001987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fff7f9-1aaa-40b1-919e-5440facf2ace tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:05.010491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7da6f-9c4c-4afb-b619-a33b5f770ae0 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:05.011313 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7da6f-9c4c-4afb-b619-a33b5f770ae0 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:05.011690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7da6f-9c4c-4afb-b619-a33b5f770ae0 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:05.012062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7da6f-9c4c-4afb-b619-a33b5f770ae0 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/roles/002e5080addc4a4a9d1734d4e9eedfd7` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:05.013579 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab7da6f-9c4c-4afb-b619-a33b5f770ae0 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:delete_role(role_id=002e5080addc4a4a9d1734d4e9eedfd7)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:05.015325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab7da6f-9c4c-4afb-b619-a33b5f770ae0 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:05.036435 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:05.072334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3ab7da6f-9c4c-4afb-b619-a33b5f770ae0 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invalidating the token cache because role 002e5080addc4a4a9d1734d4e9eedfd7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:11:05.072882 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3ab7da6f-9c4c-4afb-b619-a33b5f770ae0 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:05.073666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3ab7da6f-9c4c-4afb-b619-a33b5f770ae0 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:05.075848 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2538/5036] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:11:04 2022] DELETE /identity/v3/roles/002e5080addc4a4a9d1734d4e9eedfd7 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:11:05.079806 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac54358-546e-4b60-8528-dbde67fe304a tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:05.081617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2ac54358-546e-4b60-8528-dbde67fe304a tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:05.098772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac54358-546e-4b60-8528-dbde67fe304a tempest-TrustsV3TestJSON-1994280483 tempest-user-1169188889] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:05.169761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060539e0-f090-44b2-8230-98995780f1b2 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:05.171237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060539e0-f090-44b2-8230-98995780f1b2 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:05.171696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060539e0-f090-44b2-8230-98995780f1b2 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:05.172075 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060539e0-f090-44b2-8230-98995780f1b2 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/roles/345b8cd3a73646b2afb8b704713e94b7` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:05.173728 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060539e0-f090-44b2-8230-98995780f1b2 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:delete_role(role_id=345b8cd3a73646b2afb8b704713e94b7)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:05.175536 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060539e0-f090-44b2-8230-98995780f1b2 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:05.227336 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-060539e0-f090-44b2-8230-98995780f1b2 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invalidating the token cache because role 345b8cd3a73646b2afb8b704713e94b7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:11:05.227785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-060539e0-f090-44b2-8230-98995780f1b2 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:05.228570 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-060539e0-f090-44b2-8230-98995780f1b2 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:05.232260 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2499/5037] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:11:05 2022] DELETE /identity/v3/roles/345b8cd3a73646b2afb8b704713e94b7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:05.236222 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7da6f-9c4c-4afb-b619-a33b5f770ae0 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:05.248276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7da6f-9c4c-4afb-b619-a33b5f770ae0 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:05.332743 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3aabfe-4f83-4716-81c6-80817d50c2b0 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:05.333416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3aabfe-4f83-4716-81c6-80817d50c2b0 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:05.337706 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3aabfe-4f83-4716-81c6-80817d50c2b0 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:05.338022 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3aabfe-4f83-4716-81c6-80817d50c2b0 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/users/f10b01ff43b240a1b1c6f29688086fc0` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:05.341882 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3aabfe-4f83-4716-81c6-80817d50c2b0 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f10b01ff43b240a1b1c6f29688086fc0)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:05.346962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3aabfe-4f83-4716-81c6-80817d50c2b0 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:05.432076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ff3aabfe-4f83-4716-81c6-80817d50c2b0 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f10b01ff43b240a1b1c6f29688086fc0'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:05.438783 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060539e0-f090-44b2-8230-98995780f1b2 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:05.441927 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-060539e0-f090-44b2-8230-98995780f1b2 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:05.442440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ff3aabfe-4f83-4716-81c6-80817d50c2b0 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f10b01ff43b240a1b1c6f29688086fc0'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:05.443407 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ff3aabfe-4f83-4716-81c6-80817d50c2b0 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f10b01ff43b240a1b1c6f29688086fc0'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:05.444122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ff3aabfe-4f83-4716-81c6-80817d50c2b0 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f10b01ff43b240a1b1c6f29688086fc0'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:05.456544 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ff3aabfe-4f83-4716-81c6-80817d50c2b0 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f10b01ff43b240a1b1c6f29688086fc0'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:05.508849 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2539/5038] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:11:05 2022] DELETE /identity/v3/users/f10b01ff43b240a1b1c6f29688086fc0 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:05.513624 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3aabfe-4f83-4716-81c6-80817d50c2b0 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:05.516784 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ff3aabfe-4f83-4716-81c6-80817d50c2b0 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:05.587415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060539e0-f090-44b2-8230-98995780f1b2 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:05.649183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:05.656141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3aabfe-4f83-4716-81c6-80817d50c2b0 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:05.661268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:05.664565 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83251a71-7da8-4ebb-b2de-5ddc6fa0eeb7 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:05.665871 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83251a71-7da8-4ebb-b2de-5ddc6fa0eeb7 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:05.666485 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83251a71-7da8-4ebb-b2de-5ddc6fa0eeb7 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:05.667072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83251a71-7da8-4ebb-b2de-5ddc6fa0eeb7 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/projects/3faba6887afe432fba9b9e4217a63424` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:05.668647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83251a71-7da8-4ebb-b2de-5ddc6fa0eeb7 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3faba6887afe432fba9b9e4217a63424)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:05.673246 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83251a71-7da8-4ebb-b2de-5ddc6fa0eeb7 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:05.706537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3312b87-07ea-4fff-b51a-34aec2d6b55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:05.707215 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3312b87-07ea-4fff-b51a-34aec2d6b55a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:05.707489 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3312b87-07ea-4fff-b51a-34aec2d6b55a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:05.707760 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3312b87-07ea-4fff-b51a-34aec2d6b55a admin admin] PATH_INFO: `/v3/projects/318092177998446d97e2f93f40eae5ec` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:05.708919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3312b87-07ea-4fff-b51a-34aec2d6b55a admin admin] RBAC: Authorizing `identity:delete_project(project_id=318092177998446d97e2f93f40eae5ec)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:05.711118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3312b87-07ea-4fff-b51a-34aec2d6b55a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:05.808235 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-83251a71-7da8-4ebb-b2de-5ddc6fa0eeb7 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3faba6887afe432fba9b9e4217a63424', 'request_id': 'req-83251a71-7da8-4ebb-b2de-5ddc6fa0eeb7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:05.823135 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a3312b87-07ea-4fff-b51a-34aec2d6b55a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '318092177998446d97e2f93f40eae5ec', 'request_id': 'req-a3312b87-07ea-4fff-b51a-34aec2d6b55a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:05.823357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-83251a71-7da8-4ebb-b2de-5ddc6fa0eeb7 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3faba6887afe432fba9b9e4217a63424', 'request_id': 'req-83251a71-7da8-4ebb-b2de-5ddc6fa0eeb7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:05.835220 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a3312b87-07ea-4fff-b51a-34aec2d6b55a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '318092177998446d97e2f93f40eae5ec', 'request_id': 'req-a3312b87-07ea-4fff-b51a-34aec2d6b55a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:05.835860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-83251a71-7da8-4ebb-b2de-5ddc6fa0eeb7 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3faba6887afe432fba9b9e4217a63424', 'request_id': 'req-83251a71-7da8-4ebb-b2de-5ddc6fa0eeb7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:05.856026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a3312b87-07ea-4fff-b51a-34aec2d6b55a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '318092177998446d97e2f93f40eae5ec', 'request_id': 'req-a3312b87-07ea-4fff-b51a-34aec2d6b55a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:05.865408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-83251a71-7da8-4ebb-b2de-5ddc6fa0eeb7 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] The token cache is being invalidate because project 3faba6887afe432fba9b9e4217a63424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:11:05.866038 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-83251a71-7da8-4ebb-b2de-5ddc6fa0eeb7 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:05.867318 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-83251a71-7da8-4ebb-b2de-5ddc6fa0eeb7 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:05.875926 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2540/5039] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:11:05 2022] DELETE /identity/v3/projects/3faba6887afe432fba9b9e4217a63424 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:05.878021 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83251a71-7da8-4ebb-b2de-5ddc6fa0eeb7 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:05.886240 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-83251a71-7da8-4ebb-b2de-5ddc6fa0eeb7 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:05.890293 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a3312b87-07ea-4fff-b51a-34aec2d6b55a admin admin] The token cache is being invalidate because project 318092177998446d97e2f93f40eae5ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:11:05.890711 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a3312b87-07ea-4fff-b51a-34aec2d6b55a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:05.892474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a3312b87-07ea-4fff-b51a-34aec2d6b55a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:05.897948 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2500/5040] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:11:05 2022] DELETE /identity/v3/projects/318092177998446d97e2f93f40eae5ec => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:05.898373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3312b87-07ea-4fff-b51a-34aec2d6b55a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:05.901564 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a3312b87-07ea-4fff-b51a-34aec2d6b55a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:06.039764 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83251a71-7da8-4ebb-b2de-5ddc6fa0eeb7 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:06.044860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3312b87-07ea-4fff-b51a-34aec2d6b55a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:06.052455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa6fcd-fc5e-4aff-8e47-b90a9ecf203a tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:06.053075 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa6fcd-fc5e-4aff-8e47-b90a9ecf203a tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:06.053476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa6fcd-fc5e-4aff-8e47-b90a9ecf203a tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:06.053916 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa6fcd-fc5e-4aff-8e47-b90a9ecf203a tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:06.054864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa6fcd-fc5e-4aff-8e47-b90a9ecf203a tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:06.057090 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa6fcd-fc5e-4aff-8e47-b90a9ecf203a tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:06.118837 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2501/5041] 10.222.0.33 () {60 vars in 1152 bytes} [Sat Aug 6 21:11:05 2022] POST /identity/v3/projects => generated 329 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:06.122368 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa6fcd-fc5e-4aff-8e47-b90a9ecf203a tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:06.125686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-50fa6fcd-fc5e-4aff-8e47-b90a9ecf203a tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:06.149043 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceaa122-0f45-4419-9478-fe51d9d10dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:06.149836 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceaa122-0f45-4419-9478-fe51d9d10dc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:06.150125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceaa122-0f45-4419-9478-fe51d9d10dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:06.150680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceaa122-0f45-4419-9478-fe51d9d10dc8 admin admin] PATH_INFO: `/v3/users/8e87601370dc4dcfb462e44b7f49bc52` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:06.154120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceaa122-0f45-4419-9478-fe51d9d10dc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e87601370dc4dcfb462e44b7f49bc52)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:06.169631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceaa122-0f45-4419-9478-fe51d9d10dc8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:06.229656 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:06.242196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa6fcd-fc5e-4aff-8e47-b90a9ecf203a tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:06.244544 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:06.257032 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39393c-c85f-436d-87af-c62034e6087d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:06.257910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39393c-c85f-436d-87af-c62034e6087d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:06.258532 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39393c-c85f-436d-87af-c62034e6087d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:06.259180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39393c-c85f-436d-87af-c62034e6087d admin admin] PATH_INFO: `/v3/users/56faf6bfee6e4bd1bf4b31ad5e80906e` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:06.261557 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39393c-c85f-436d-87af-c62034e6087d admin admin] RBAC: Authorizing `identity:delete_user(user_id=56faf6bfee6e4bd1bf4b31ad5e80906e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:06.267904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39393c-c85f-436d-87af-c62034e6087d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:06.271727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5ceaa122-0f45-4419-9478-fe51d9d10dc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e87601370dc4dcfb462e44b7f49bc52'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:06.289324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5ceaa122-0f45-4419-9478-fe51d9d10dc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e87601370dc4dcfb462e44b7f49bc52'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:06.291718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5ceaa122-0f45-4419-9478-fe51d9d10dc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e87601370dc4dcfb462e44b7f49bc52'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:06.296404 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5ceaa122-0f45-4419-9478-fe51d9d10dc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e87601370dc4dcfb462e44b7f49bc52'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:06.324452 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5ceaa122-0f45-4419-9478-fe51d9d10dc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e87601370dc4dcfb462e44b7f49bc52'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:06.367097 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2541/5042] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:11:05 2022] DELETE /identity/v3/users/8e87601370dc4dcfb462e44b7f49bc52 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:06.369699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceaa122-0f45-4419-9478-fe51d9d10dc8 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:06.372944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5ceaa122-0f45-4419-9478-fe51d9d10dc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:06.387311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3a39393c-c85f-436d-87af-c62034e6087d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56faf6bfee6e4bd1bf4b31ad5e80906e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:06.388151 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3a39393c-c85f-436d-87af-c62034e6087d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56faf6bfee6e4bd1bf4b31ad5e80906e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:06.389229 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3a39393c-c85f-436d-87af-c62034e6087d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56faf6bfee6e4bd1bf4b31ad5e80906e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:06.413699 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3a39393c-c85f-436d-87af-c62034e6087d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56faf6bfee6e4bd1bf4b31ad5e80906e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:06.448801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3a39393c-c85f-436d-87af-c62034e6087d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56faf6bfee6e4bd1bf4b31ad5e80906e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:06.488813 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2502/5043] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:11:06 2022] DELETE /identity/v3/users/56faf6bfee6e4bd1bf4b31ad5e80906e => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:06.490475 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6126fe-6ced-4570-8bf6-8cf2c06db4c4 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:06.490940 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6126fe-6ced-4570-8bf6-8cf2c06db4c4 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:06.491506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6126fe-6ced-4570-8bf6-8cf2c06db4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:06.530682 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceaa122-0f45-4419-9478-fe51d9d10dc8 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:06.573370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-de6126fe-6ced-4570-8bf6-8cf2c06db4c4 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:06.573370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-de6126fe-6ced-4570-8bf6-8cf2c06db4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:06.624705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c27bc-cba1-4758-bc45-40717f894c67 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:06.625452 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c27bc-cba1-4758-bc45-40717f894c67 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:06.625745 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c27bc-cba1-4758-bc45-40717f894c67 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:06.626154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c27bc-cba1-4758-bc45-40717f894c67 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:06.626872 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c27bc-cba1-4758-bc45-40717f894c67 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:06.629386 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c27bc-cba1-4758-bc45-40717f894c67 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:06.688014 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2542/5044] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:11:06 2022] POST /identity/v3/users => generated 416 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:06.694359 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c27bc-cba1-4758-bc45-40717f894c67 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:06.698642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e16c27bc-cba1-4758-bc45-40717f894c67 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:06.730274 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c27bc-cba1-4758-bc45-40717f894c67 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:06.740567 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2503/5045] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:06.745229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2e6e4-584c-47b5-99c8-3515fc502257 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:06.746046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2e6e4-584c-47b5-99c8-3515fc502257 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:06.746689 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2e6e4-584c-47b5-99c8-3515fc502257 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:06.746975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2e6e4-584c-47b5-99c8-3515fc502257 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:06.747791 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d2e6e4-584c-47b5-99c8-3515fc502257 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:06.750393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d2e6e4-584c-47b5-99c8-3515fc502257 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:06.760136 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6126fe-6ced-4570-8bf6-8cf2c06db4c4 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:06.761817 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-de6126fe-6ced-4570-8bf6-8cf2c06db4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:06.774875 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2543/5046] 10.222.0.33 () {60 vars in 1143 bytes} [Sat Aug 6 21:11:06 2022] POST /identity/v3/roles => generated 243 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:06.778164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2e6e4-584c-47b5-99c8-3515fc502257 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:06.793911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2e6e4-584c-47b5-99c8-3515fc502257 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:06.803090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd146fef-bced-4365-b370-f98f623cb5d8 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:06.803958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd146fef-bced-4365-b370-f98f623cb5d8 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:06.804634 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd146fef-bced-4365-b370-f98f623cb5d8 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:06.805562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd146fef-bced-4365-b370-f98f623cb5d8 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:06.806254 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd146fef-bced-4365-b370-f98f623cb5d8 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:06.809108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd146fef-bced-4365-b370-f98f623cb5d8 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:06.860637 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2544/5047] 10.222.0.33 () {60 vars in 1143 bytes} [Sat Aug 6 21:11:06 2022] POST /identity/v3/roles => generated 246 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:11:06.865113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd146fef-bced-4365-b370-f98f623cb5d8 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:06.890766 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd146fef-bced-4365-b370-f98f623cb5d8 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:06.906216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef6da2-4efe-456b-af5a-daaf98ed921c tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:06.906897 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef6da2-4efe-456b-af5a-daaf98ed921c tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:06.907181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef6da2-4efe-456b-af5a-daaf98ed921c tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:06.907456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef6da2-4efe-456b-af5a-daaf98ed921c tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/projects/9c9d6a0f436e4275a4c6d596f9ce64f4/users/71f5fcc82627455fb1acc7a441b1c0fe/roles/de97c6e0a76946b1a42281a1a39c7063` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:06.931708 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6126fe-6ced-4570-8bf6-8cf2c06db4c4 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:06.936152 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c1331-d7f8-4f7f-89fb-fada648567c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:06.937194 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c1331-d7f8-4f7f-89fb-fada648567c9 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:06.937661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c1331-d7f8-4f7f-89fb-fada648567c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:06.938149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c1331-d7f8-4f7f-89fb-fada648567c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:06.945991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef6da2-4efe-456b-af5a-daaf98ed921c tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9c9d6a0f436e4275a4c6d596f9ce64f4, user_id=71f5fcc82627455fb1acc7a441b1c0fe, role_id=de97c6e0a76946b1a42281a1a39c7063)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:06.949176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef6da2-4efe-456b-af5a-daaf98ed921c tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:06.952948 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c1331-d7f8-4f7f-89fb-fada648567c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:06.957425 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c1331-d7f8-4f7f-89fb-fada648567c9 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:06.959846 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=88,keystone:DELETE=5,keystone:INSERT=7 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:06.968629 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2545/5048] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:11:06 2022] PUT /identity/v3/projects/9c9d6a0f436e4275a4c6d596f9ce64f4/users/71f5fcc82627455fb1acc7a441b1c0fe/roles/de97c6e0a76946b1a42281a1a39c7063 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:06.972722 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef6da2-4efe-456b-af5a-daaf98ed921c tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:06.974379 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2504/5049] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:11:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:11:07.053811 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef6da2-4efe-456b-af5a-daaf98ed921c tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:07.059739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f8e9c-85f5-43d6-9dfb-67d4b5836c5d tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:07.060511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f8e9c-85f5-43d6-9dfb-67d4b5836c5d tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:07.061028 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f8e9c-85f5-43d6-9dfb-67d4b5836c5d tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:07.062289 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f8e9c-85f5-43d6-9dfb-67d4b5836c5d tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/projects/9c9d6a0f436e4275a4c6d596f9ce64f4/users/71f5fcc82627455fb1acc7a441b1c0fe/roles/e0d7082ff3164656a6c837132714322b` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:07.064886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f8e9c-85f5-43d6-9dfb-67d4b5836c5d tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9c9d6a0f436e4275a4c6d596f9ce64f4, user_id=71f5fcc82627455fb1acc7a441b1c0fe, role_id=e0d7082ff3164656a6c837132714322b)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:07.068078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f8e9c-85f5-43d6-9dfb-67d4b5836c5d tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:07.091842 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2546/5050] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:11:06 2022] PUT /identity/v3/projects/9c9d6a0f436e4275a4c6d596f9ce64f4/users/71f5fcc82627455fb1acc7a441b1c0fe/roles/e0d7082ff3164656a6c837132714322b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:07.093708 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c1331-d7f8-4f7f-89fb-fada648567c9 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:07.106251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c1331-d7f8-4f7f-89fb-fada648567c9 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:07.122579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:07.190644 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efca545-eaf5-4f95-a34d-cd7a03a9f737 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:07.191292 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efca545-eaf5-4f95-a34d-cd7a03a9f737 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:07.191588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efca545-eaf5-4f95-a34d-cd7a03a9f737 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:07.191867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efca545-eaf5-4f95-a34d-cd7a03a9f737 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:07.192692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efca545-eaf5-4f95-a34d-cd7a03a9f737 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:07.194753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efca545-eaf5-4f95-a34d-cd7a03a9f737 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:07.239354 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2505/5051] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:07 2022] GET /identity/v3/users => generated 7781 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:07.244204 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b7c8e-6ddc-4dd8-8db0-ab617065af0f None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:07.244576 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b7c8e-6ddc-4dd8-8db0-ab617065af0f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:07.245097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b7c8e-6ddc-4dd8-8db0-ab617065af0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:07.317186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-419b7c8e-6ddc-4dd8-8db0-ab617065af0f None None] MFA Rules not processed for user `71f5fcc82627455fb1acc7a441b1c0fe`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:07.318667 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-419b7c8e-6ddc-4dd8-8db0-ab617065af0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:07.481068 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2547/5052] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:07 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:07.482221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321d6b5-1e6e-4059-951d-10a575b35b36 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:07.482777 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321d6b5-1e6e-4059-951d-10a575b35b36 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:07.483027 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321d6b5-1e6e-4059-951d-10a575b35b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:07.517663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f321d6b5-1e6e-4059-951d-10a575b35b36 None None] MFA Rules not processed for user `71f5fcc82627455fb1acc7a441b1c0fe`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:07.522585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f321d6b5-1e6e-4059-951d-10a575b35b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:07.534579 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b7c8e-6ddc-4dd8-8db0-ab617065af0f None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:07.536305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-419b7c8e-6ddc-4dd8-8db0-ab617065af0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:07.543796 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2506/5053] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:07 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:07.549970 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321d6b5-1e6e-4059-951d-10a575b35b36 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:07.569988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321d6b5-1e6e-4059-951d-10a575b35b36 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:07.583477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d12e2-b6c7-46ac-aa89-f94777c78c4a tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f5fcc82627455fb1acc7a441b1c0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c9d6a0f436e4275a4c6d596f9ce64f4', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-745784101', 'tempest-NotDelegatedRole-959258680'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:07.585630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d12e2-b6c7-46ac-aa89-f94777c78c4a tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:07.586000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d12e2-b6c7-46ac-aa89-f94777c78c4a tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:07.587240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d12e2-b6c7-46ac-aa89-f94777c78c4a tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:07.590466 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d12e2-b6c7-46ac-aa89-f94777c78c4a tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] RBAC: Authorizing `identity:create_trust()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:07.593697 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d12e2-b6c7-46ac-aa89-f94777c78c4a tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:07.691408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b7c8e-6ddc-4dd8-8db0-ab617065af0f None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:07.706118 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f603c8f-237c-468c-bd6f-06b413ac6b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:07.706967 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f603c8f-237c-468c-bd6f-06b413ac6b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:07.707248 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f603c8f-237c-468c-bd6f-06b413ac6b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:07.707520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f603c8f-237c-468c-bd6f-06b413ac6b31 admin admin] PATH_INFO: `/v3/projects/e9dbe93730c24567b581341ce46586bf` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:07.708989 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f603c8f-237c-468c-bd6f-06b413ac6b31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9dbe93730c24567b581341ce46586bf)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:07.712304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f603c8f-237c-468c-bd6f-06b413ac6b31 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:07.750836 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2507/5054] 10.222.0.33 () {60 vars in 1174 bytes} [Sat Aug 6 21:11:07 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:07.754281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d12e2-b6c7-46ac-aa89-f94777c78c4a tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:07.756933 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2e4d12e2-b6c7-46ac-aa89-f94777c78c4a tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:07.768974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:07.776169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d12e2-b6c7-46ac-aa89-f94777c78c4a tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:07.782767 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3619ad-1519-4cd4-bdea-f0db1ca41199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:07.783622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3619ad-1519-4cd4-bdea-f0db1ca41199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:07.784085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3619ad-1519-4cd4-bdea-f0db1ca41199 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:07.784507 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3619ad-1519-4cd4-bdea-f0db1ca41199 admin admin] PATH_INFO: `/v3/projects/16ac6c0038fb47bca014618f94916605` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:07.786040 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3619ad-1519-4cd4-bdea-f0db1ca41199 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16ac6c0038fb47bca014618f94916605)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:07.789501 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3619ad-1519-4cd4-bdea-f0db1ca41199 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:07.835284 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7f603c8f-237c-468c-bd6f-06b413ac6b31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9dbe93730c24567b581341ce46586bf', 'request_id': 'req-7f603c8f-237c-468c-bd6f-06b413ac6b31'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:07.845826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7f603c8f-237c-468c-bd6f-06b413ac6b31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9dbe93730c24567b581341ce46586bf', 'request_id': 'req-7f603c8f-237c-468c-bd6f-06b413ac6b31'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:07.869144 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7f603c8f-237c-468c-bd6f-06b413ac6b31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9dbe93730c24567b581341ce46586bf', 'request_id': 'req-7f603c8f-237c-468c-bd6f-06b413ac6b31'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:07.878569 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8b3619ad-1519-4cd4-bdea-f0db1ca41199 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16ac6c0038fb47bca014618f94916605', 'request_id': 'req-8b3619ad-1519-4cd4-bdea-f0db1ca41199'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:07.886850 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7f603c8f-237c-468c-bd6f-06b413ac6b31 admin admin] The token cache is being invalidate because project e9dbe93730c24567b581341ce46586bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:11:07.887179 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7f603c8f-237c-468c-bd6f-06b413ac6b31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:07.888007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7f603c8f-237c-468c-bd6f-06b413ac6b31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:07.888222 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8b3619ad-1519-4cd4-bdea-f0db1ca41199 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16ac6c0038fb47bca014618f94916605', 'request_id': 'req-8b3619ad-1519-4cd4-bdea-f0db1ca41199'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:07.891630 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2548/5055] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:11:07 2022] DELETE /identity/v3/projects/e9dbe93730c24567b581341ce46586bf => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:07.891630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f603c8f-237c-468c-bd6f-06b413ac6b31 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:07.895174 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7f603c8f-237c-468c-bd6f-06b413ac6b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:07.898649 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8b3619ad-1519-4cd4-bdea-f0db1ca41199 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16ac6c0038fb47bca014618f94916605', 'request_id': 'req-8b3619ad-1519-4cd4-bdea-f0db1ca41199'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:07.918930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8b3619ad-1519-4cd4-bdea-f0db1ca41199 admin admin] The token cache is being invalidate because project 16ac6c0038fb47bca014618f94916605 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:11:07.919311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8b3619ad-1519-4cd4-bdea-f0db1ca41199 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:07.923237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8b3619ad-1519-4cd4-bdea-f0db1ca41199 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:07.925842 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2508/5056] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:11:07 2022] DELETE /identity/v3/projects/16ac6c0038fb47bca014618f94916605 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:11:07.927655 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be583dd4-7e57-4e37-a3f2-44caa9eec81e None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:07.928147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be583dd4-7e57-4e37-a3f2-44caa9eec81e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:07.928545 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be583dd4-7e57-4e37-a3f2-44caa9eec81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:07.960245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-be583dd4-7e57-4e37-a3f2-44caa9eec81e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:07.961482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-be583dd4-7e57-4e37-a3f2-44caa9eec81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:07.979761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:07.991676 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f603c8f-237c-468c-bd6f-06b413ac6b31 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:08.056598 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2509/5057] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:08.056598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be583dd4-7e57-4e37-a3f2-44caa9eec81e None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:08.056598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-be583dd4-7e57-4e37-a3f2-44caa9eec81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:08.076422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be583dd4-7e57-4e37-a3f2-44caa9eec81e None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:08.083010 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df40c3-38c1-4afb-bf6e-a1be448621f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:08.083877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df40c3-38c1-4afb-bf6e-a1be448621f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:08.084161 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df40c3-38c1-4afb-bf6e-a1be448621f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:08.084435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df40c3-38c1-4afb-bf6e-a1be448621f8 admin admin] PATH_INFO: `/v3/users/f2f7fec01bd943deb8b2ad0f16a8dd7d` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:08.086368 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df40c3-38c1-4afb-bf6e-a1be448621f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2f7fec01bd943deb8b2ad0f16a8dd7d)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:08.088639 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df40c3-38c1-4afb-bf6e-a1be448621f8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:08.102987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2f124-4309-464f-9ef1-62d94f632504 tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f5fcc82627455fb1acc7a441b1c0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c9d6a0f436e4275a4c6d596f9ce64f4', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-745784101', 'tempest-NotDelegatedRole-959258680'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:08.104283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2f124-4309-464f-9ef1-62d94f632504 tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:08.104727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2f124-4309-464f-9ef1-62d94f632504 tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:08.105337 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2f124-4309-464f-9ef1-62d94f632504 tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] PATH_INFO: `/v3/OS-TRUST/trusts/311eed1242bd46fcb39d2d3506029010` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:08.122276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc2f124-4309-464f-9ef1-62d94f632504 tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] RBAC: Authorizing `identity:get_trust(trust_id=311eed1242bd46fcb39d2d3506029010)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:08.124594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc2f124-4309-464f-9ef1-62d94f632504 tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:08.139498 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2549/5058] 10.222.0.33 () {58 vars in 1251 bytes} [Sat Aug 6 21:11:07 2022] GET /identity/v3/OS-TRUST/trusts/311eed1242bd46fcb39d2d3506029010 => generated 834 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:11:08.141394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897291c-9cea-4b15-8463-e149799322ed None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:08.141656 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897291c-9cea-4b15-8463-e149799322ed None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:08.142176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897291c-9cea-4b15-8463-e149799322ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:08.165415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-8897291c-9cea-4b15-8463-e149799322ed None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:08.166740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8897291c-9cea-4b15-8463-e149799322ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:08.168637 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-16df40c3-38c1-4afb-bf6e-a1be448621f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2f7fec01bd943deb8b2ad0f16a8dd7d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:08.169466 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-16df40c3-38c1-4afb-bf6e-a1be448621f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2f7fec01bd943deb8b2ad0f16a8dd7d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:08.170270 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-16df40c3-38c1-4afb-bf6e-a1be448621f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2f7fec01bd943deb8b2ad0f16a8dd7d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:08.177704 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2550/5059] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:08.178643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897291c-9cea-4b15-8463-e149799322ed None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:08.180433 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8897291c-9cea-4b15-8463-e149799322ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:08.196733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897291c-9cea-4b15-8463-e149799322ed None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:08.199638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-16df40c3-38c1-4afb-bf6e-a1be448621f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2f7fec01bd943deb8b2ad0f16a8dd7d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:08.202467 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e4d93-23c4-4ac7-a50c-b8873798df4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:08.203241 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e4d93-23c4-4ac7-a50c-b8873798df4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:08.203524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e4d93-23c4-4ac7-a50c-b8873798df4c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:08.203798 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e4d93-23c4-4ac7-a50c-b8873798df4c admin admin] PATH_INFO: `/v3/users/f7cf258df10248d0bdcf64fa075c132c` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:08.205069 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e4d93-23c4-4ac7-a50c-b8873798df4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7cf258df10248d0bdcf64fa075c132c)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:08.207201 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e4d93-23c4-4ac7-a50c-b8873798df4c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:08.224545 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-16df40c3-38c1-4afb-bf6e-a1be448621f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2f7fec01bd943deb8b2ad0f16a8dd7d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:08.241381 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2510/5060] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:11:08 2022] DELETE /identity/v3/users/f2f7fec01bd943deb8b2ad0f16a8dd7d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:08.244660 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df40c3-38c1-4afb-bf6e-a1be448621f8 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:08.246138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-16df40c3-38c1-4afb-bf6e-a1be448621f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:08.275003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:08.301389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-132e4d93-23c4-4ac7-a50c-b8873798df4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7cf258df10248d0bdcf64fa075c132c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:08.317255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-132e4d93-23c4-4ac7-a50c-b8873798df4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7cf258df10248d0bdcf64fa075c132c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:08.321254 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-132e4d93-23c4-4ac7-a50c-b8873798df4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7cf258df10248d0bdcf64fa075c132c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:08.322594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-132e4d93-23c4-4ac7-a50c-b8873798df4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7cf258df10248d0bdcf64fa075c132c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:08.340921 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-132e4d93-23c4-4ac7-a50c-b8873798df4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7cf258df10248d0bdcf64fa075c132c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:08.393940 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df40c3-38c1-4afb-bf6e-a1be448621f8 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:08.399454 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45380cd0-96b8-487b-8be9-bb340826681a tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f5fcc82627455fb1acc7a441b1c0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c9d6a0f436e4275a4c6d596f9ce64f4', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-745784101', 'tempest-NotDelegatedRole-959258680'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:08.400342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45380cd0-96b8-487b-8be9-bb340826681a tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:08.400592 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2551/5061] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:11:08 2022] DELETE /identity/v3/users/f7cf258df10248d0bdcf64fa075c132c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:08.401454 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e4d93-23c4-4ac7-a50c-b8873798df4c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:08.403340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-132e4d93-23c4-4ac7-a50c-b8873798df4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:08.405656 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45380cd0-96b8-487b-8be9-bb340826681a tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:08.406040 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45380cd0-96b8-487b-8be9-bb340826681a tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] PATH_INFO: `/v3/OS-TRUST/trusts/311eed1242bd46fcb39d2d3506029010/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:08.414858 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45380cd0-96b8-487b-8be9-bb340826681a tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=311eed1242bd46fcb39d2d3506029010)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:08.416663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45380cd0-96b8-487b-8be9-bb340826681a tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:08.434629 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2511/5062] 10.222.0.33 () {58 vars in 1269 bytes} [Sat Aug 6 21:11:08 2022] GET /identity/v3/OS-TRUST/trusts/311eed1242bd46fcb39d2d3506029010/roles => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:11:08.436897 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45380cd0-96b8-487b-8be9-bb340826681a tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:08.444376 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-45380cd0-96b8-487b-8be9-bb340826681a tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:08.472844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45380cd0-96b8-487b-8be9-bb340826681a tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:08.540323 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:08.575938 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e4d93-23c4-4ac7-a50c-b8873798df4c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:08.587435 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7dfff-c05d-43fb-9b7b-3538b0d48913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:08.587776 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7dfff-c05d-43fb-9b7b-3538b0d48913 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:08.588059 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7dfff-c05d-43fb-9b7b-3538b0d48913 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:08.588334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7dfff-c05d-43fb-9b7b-3538b0d48913 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:08.589000 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7dfff-c05d-43fb-9b7b-3538b0d48913 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:11:08.589309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7dfff-c05d-43fb-9b7b-3538b0d48913 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:08.592727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7dfff-c05d-43fb-9b7b-3538b0d48913 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:08.608723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f6db6-6ce0-4968-a0e4-5741a1777997 tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f5fcc82627455fb1acc7a441b1c0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c9d6a0f436e4275a4c6d596f9ce64f4', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-745784101', 'tempest-NotDelegatedRole-959258680'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:08.609492 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f6db6-6ce0-4968-a0e4-5741a1777997 tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:08.609779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f6db6-6ce0-4968-a0e4-5741a1777997 tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:08.610211 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f6db6-6ce0-4968-a0e4-5741a1777997 tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] PATH_INFO: `/v3/OS-TRUST/trusts/311eed1242bd46fcb39d2d3506029010/roles/de97c6e0a76946b1a42281a1a39c7063` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:08.621932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f6db6-6ce0-4968-a0e4-5741a1777997 tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] RBAC: Authorizing `identity:get_role_for_trust(trust_id=311eed1242bd46fcb39d2d3506029010, role_id=de97c6e0a76946b1a42281a1a39c7063)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:08.624144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f6db6-6ce0-4968-a0e4-5741a1777997 tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:08.627745 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2552/5063] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:11:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:11:08.630741 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7dfff-c05d-43fb-9b7b-3538b0d48913 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:08.642410 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2512/5064] 10.222.0.33 () {58 vars in 1368 bytes} [Sat Aug 6 21:11:08 2022] GET /identity/v3/OS-TRUST/trusts/311eed1242bd46fcb39d2d3506029010/roles/de97c6e0a76946b1a42281a1a39c7063 => generated 243 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:11:08.643508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f6db6-6ce0-4968-a0e4-5741a1777997 tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:08.647774 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7dfff-c05d-43fb-9b7b-3538b0d48913 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:08.658936 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779285ed-8d86-415c-a345-31064003da54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:08.660272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779285ed-8d86-415c-a345-31064003da54 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:08.660779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779285ed-8d86-415c-a345-31064003da54 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:08.661291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779285ed-8d86-415c-a345-31064003da54 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:08.663683 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779285ed-8d86-415c-a345-31064003da54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:08.672206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f6db6-6ce0-4968-a0e4-5741a1777997 tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:08.676072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779285ed-8d86-415c-a345-31064003da54 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:08.686117 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86ffcc-716a-4d19-a9bf-83c8ce3fdfb7 tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f5fcc82627455fb1acc7a441b1c0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c9d6a0f436e4275a4c6d596f9ce64f4', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-745784101', 'tempest-NotDelegatedRole-959258680'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:08.687045 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86ffcc-716a-4d19-a9bf-83c8ce3fdfb7 tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] REQUEST_METHOD: `HEAD` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:08.687341 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86ffcc-716a-4d19-a9bf-83c8ce3fdfb7 tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:08.687623 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86ffcc-716a-4d19-a9bf-83c8ce3fdfb7 tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] PATH_INFO: `/v3/OS-TRUST/trusts/311eed1242bd46fcb39d2d3506029010/roles/de97c6e0a76946b1a42281a1a39c7063` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:08.696689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe86ffcc-716a-4d19-a9bf-83c8ce3fdfb7 tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] RBAC: Authorizing `identity:get_role_for_trust(trust_id=311eed1242bd46fcb39d2d3506029010, role_id=de97c6e0a76946b1a42281a1a39c7063)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:08.707193 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe86ffcc-716a-4d19-a9bf-83c8ce3fdfb7 tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:08.737061 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2513/5065] 10.222.0.33 () {58 vars in 1369 bytes} [Sat Aug 6 21:11:08 2022] HEAD /identity/v3/OS-TRUST/trusts/311eed1242bd46fcb39d2d3506029010/roles/de97c6e0a76946b1a42281a1a39c7063 => generated 0 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 06 21:11:08.742093 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86ffcc-716a-4d19-a9bf-83c8ce3fdfb7 tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:08.769077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86ffcc-716a-4d19-a9bf-83c8ce3fdfb7 tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:08.771590 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2553/5066] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:11:08 2022] POST /identity/v3/projects => generated 371 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:08.775796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779285ed-8d86-415c-a345-31064003da54 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:08.776863 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811f583-8247-4e77-b73c-932e8bbd4f1c tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f5fcc82627455fb1acc7a441b1c0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c9d6a0f436e4275a4c6d596f9ce64f4', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-745784101', 'tempest-NotDelegatedRole-959258680'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:08.777830 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811f583-8247-4e77-b73c-932e8bbd4f1c tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:08.777830 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811f583-8247-4e77-b73c-932e8bbd4f1c tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:08.778082 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811f583-8247-4e77-b73c-932e8bbd4f1c tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] PATH_INFO: `/v3/OS-TRUST/trusts/311eed1242bd46fcb39d2d3506029010/roles/e0d7082ff3164656a6c837132714322b` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:08.786398 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811f583-8247-4e77-b73c-932e8bbd4f1c tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] RBAC: Authorizing `identity:get_role_for_trust(trust_id=311eed1242bd46fcb39d2d3506029010, role_id=e0d7082ff3164656a6c837132714322b)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:08.788587 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811f583-8247-4e77-b73c-932e8bbd4f1c tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:08.800660 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-c811f583-8247-4e77-b73c-932e8bbd4f1c tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] Could not find role: e0d7082ff3164656a6c837132714322b.: keystone.exception.RoleNotFound: Could not find role: e0d7082ff3164656a6c837132714322b. Aug 06 21:11:08.800660 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:11:08.800660 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:11:08.800660 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:11:08.800660 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:11:08.800660 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:11:08.800660 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:11:08.800660 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:11:08.800660 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:11:08.800660 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:11:08.800660 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:11:08.800660 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:11:08.800660 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 06 21:11:08.800660 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 21:11:08.800660 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: e0d7082ff3164656a6c837132714322b. Aug 06 21:11:08.801989 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:11:08.801989 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2514/5067] 10.222.0.33 () {58 vars in 1368 bytes} [Sat Aug 6 21:11:08 2022] GET /identity/v3/OS-TRUST/trusts/311eed1242bd46fcb39d2d3506029010/roles/e0d7082ff3164656a6c837132714322b => generated 110 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 06 21:11:08.806488 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811f583-8247-4e77-b73c-932e8bbd4f1c tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:08.827485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811f583-8247-4e77-b73c-932e8bbd4f1c tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:08.864828 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779285ed-8d86-415c-a345-31064003da54 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:08.870972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f1453-f126-4dfd-9e65-974cbd0515a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:08.871897 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f1453-f126-4dfd-9e65-974cbd0515a6 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:08.872176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f1453-f126-4dfd-9e65-974cbd0515a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:08.872449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f1453-f126-4dfd-9e65-974cbd0515a6 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:08.873689 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f1453-f126-4dfd-9e65-974cbd0515a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:08.876205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f1453-f126-4dfd-9e65-974cbd0515a6 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:08.905958 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2554/5068] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:11:08 2022] POST /identity/v3/users => generated 286 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:08.910984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f1453-f126-4dfd-9e65-974cbd0515a6 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:08.924663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f1453-f126-4dfd-9e65-974cbd0515a6 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:08.931688 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c8ccf-a674-46f0-9d0f-062499d3b0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:08.932823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c8ccf-a674-46f0-9d0f-062499d3b0ee admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:08.933109 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c8ccf-a674-46f0-9d0f-062499d3b0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:08.933457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c8ccf-a674-46f0-9d0f-062499d3b0ee admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:08.934223 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c8ccf-a674-46f0-9d0f-062499d3b0ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:08.937624 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c8ccf-a674-46f0-9d0f-062499d3b0ee admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:08.949690 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2555/5069] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:08 2022] GET /identity/v3/roles => generated 1891 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:08.953874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c8ccf-a674-46f0-9d0f-062499d3b0ee admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:08.964381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18363467-c4a7-4cb4-8ed1-d6b49a96115b tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f5fcc82627455fb1acc7a441b1c0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c9d6a0f436e4275a4c6d596f9ce64f4', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-745784101', 'tempest-NotDelegatedRole-959258680'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:08.965476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18363467-c4a7-4cb4-8ed1-d6b49a96115b tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] REQUEST_METHOD: `HEAD` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:08.965863 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18363467-c4a7-4cb4-8ed1-d6b49a96115b tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:08.966391 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18363467-c4a7-4cb4-8ed1-d6b49a96115b tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] PATH_INFO: `/v3/OS-TRUST/trusts/311eed1242bd46fcb39d2d3506029010/roles/e0d7082ff3164656a6c837132714322b` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:08.973814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18363467-c4a7-4cb4-8ed1-d6b49a96115b tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] RBAC: Authorizing `identity:get_role_for_trust(trust_id=311eed1242bd46fcb39d2d3506029010, role_id=e0d7082ff3164656a6c837132714322b)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:08.974479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c8ccf-a674-46f0-9d0f-062499d3b0ee admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:08.975602 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18363467-c4a7-4cb4-8ed1-d6b49a96115b tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:08.985765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30cf61-5c9c-4eca-a16f-6b115bc17db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:08.986723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30cf61-5c9c-4eca-a16f-6b115bc17db6 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:08.987125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30cf61-5c9c-4eca-a16f-6b115bc17db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:08.987508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30cf61-5c9c-4eca-a16f-6b115bc17db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:08.988257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30cf61-5c9c-4eca-a16f-6b115bc17db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:08.989955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30cf61-5c9c-4eca-a16f-6b115bc17db6 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:08.991872 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:08.995875 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-18363467-c4a7-4cb4-8ed1-d6b49a96115b tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] Could not find role: e0d7082ff3164656a6c837132714322b.: keystone.exception.RoleNotFound: Could not find role: e0d7082ff3164656a6c837132714322b. Aug 06 21:11:08.995875 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:11:08.995875 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:11:08.995875 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:11:08.995875 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:11:08.995875 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:11:08.995875 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:11:08.995875 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:11:08.995875 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:11:08.995875 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:11:08.995875 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:11:08.995875 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:11:08.995875 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 06 21:11:08.995875 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 21:11:08.995875 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: e0d7082ff3164656a6c837132714322b. Aug 06 21:11:08.997761 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:11:09.019159 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2556/5070] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:08 2022] GET /identity/v3/roles => generated 1891 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:11:09.019427 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2515/5071] 10.222.0.33 () {58 vars in 1369 bytes} [Sat Aug 6 21:11:08 2022] HEAD /identity/v3/OS-TRUST/trusts/311eed1242bd46fcb39d2d3506029010/roles/e0d7082ff3164656a6c837132714322b => generated 0 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Aug 06 21:11:09.020307 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30cf61-5c9c-4eca-a16f-6b115bc17db6 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:09.023669 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18363467-c4a7-4cb4-8ed1-d6b49a96115b tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:09.037995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18363467-c4a7-4cb4-8ed1-d6b49a96115b tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:09.042425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30cf61-5c9c-4eca-a16f-6b115bc17db6 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:09.046207 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1920bd8-c604-4887-896a-22fac10aef5f tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f5fcc82627455fb1acc7a441b1c0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c9d6a0f436e4275a4c6d596f9ce64f4', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-745784101', 'tempest-NotDelegatedRole-959258680'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:09.047006 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1920bd8-c604-4887-896a-22fac10aef5f tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:09.047328 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1920bd8-c604-4887-896a-22fac10aef5f tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:09.047604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1920bd8-c604-4887-896a-22fac10aef5f tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] PATH_INFO: `/v3/OS-TRUST/trusts/311eed1242bd46fcb39d2d3506029010` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:09.050589 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e825e-444f-464e-964c-afde5ed5ec32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:09.051669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e825e-444f-464e-964c-afde5ed5ec32 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:09.052396 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e825e-444f-464e-964c-afde5ed5ec32 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:09.053005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e825e-444f-464e-964c-afde5ed5ec32 admin admin] PATH_INFO: `/v3/projects/a4d509efced842b48b453404fc98ce1f/users/a9aba675d9aa402498a74180fe75c457/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:09.061427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1920bd8-c604-4887-896a-22fac10aef5f tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] RBAC: Authorizing `identity:delete_trust(trust_id=311eed1242bd46fcb39d2d3506029010)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:09.063916 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1920bd8-c604-4887-896a-22fac10aef5f tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:09.076907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e825e-444f-464e-964c-afde5ed5ec32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4d509efced842b48b453404fc98ce1f, user_id=a9aba675d9aa402498a74180fe75c457, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:09.080773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e825e-444f-464e-964c-afde5ed5ec32 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:09.094240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a1920bd8-c604-4887-896a-22fac10aef5f tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '311eed1242bd46fcb39d2d3506029010', 'request_id': 'req-a1920bd8-c604-4887-896a-22fac10aef5f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:09.095796 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a1920bd8-c604-4887-896a-22fac10aef5f tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '311eed1242bd46fcb39d2d3506029010', 'request_id': 'req-a1920bd8-c604-4887-896a-22fac10aef5f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:09.096535 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a1920bd8-c604-4887-896a-22fac10aef5f tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '311eed1242bd46fcb39d2d3506029010', 'request_id': 'req-a1920bd8-c604-4887-896a-22fac10aef5f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:09.102686 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2557/5072] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:11:09 2022] PUT /identity/v3/projects/a4d509efced842b48b453404fc98ce1f/users/a9aba675d9aa402498a74180fe75c457/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:09.112369 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230ceaa-9e30-4027-804e-62741f645d66 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:09.112689 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230ceaa-9e30-4027-804e-62741f645d66 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:09.112945 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230ceaa-9e30-4027-804e-62741f645d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:09.122143 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2516/5073] 10.222.0.33 () {58 vars in 1254 bytes} [Sat Aug 6 21:11:09 2022] DELETE /identity/v3/OS-TRUST/trusts/311eed1242bd46fcb39d2d3506029010 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:09.123049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1920bd8-c604-4887-896a-22fac10aef5f tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:09.125684 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a1920bd8-c604-4887-896a-22fac10aef5f tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:09.148626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1920bd8-c604-4887-896a-22fac10aef5f tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:09.153368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-f230ceaa-9e30-4027-804e-62741f645d66 None None] MFA Rules not processed for user `a9aba675d9aa402498a74180fe75c457`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:09.155438 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f230ceaa-9e30-4027-804e-62741f645d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:09.214014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:09.253502 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f077a14-14a3-41da-8e3b-5578127eb018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:09.254252 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f077a14-14a3-41da-8e3b-5578127eb018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:09.254526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f077a14-14a3-41da-8e3b-5578127eb018 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:09.254844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f077a14-14a3-41da-8e3b-5578127eb018 admin admin] PATH_INFO: `/v3/projects/8046f1ab9c004060965dced02db4b7c4` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:09.256262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f077a14-14a3-41da-8e3b-5578127eb018 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8046f1ab9c004060965dced02db4b7c4)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:09.258287 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f077a14-14a3-41da-8e3b-5578127eb018 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:09.269800 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2558/5074] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:09.269800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230ceaa-9e30-4027-804e-62741f645d66 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:09.269800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f230ceaa-9e30-4027-804e-62741f645d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:09.340224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8f077a14-14a3-41da-8e3b-5578127eb018 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8046f1ab9c004060965dced02db4b7c4', 'request_id': 'req-8f077a14-14a3-41da-8e3b-5578127eb018'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:09.347549 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8f077a14-14a3-41da-8e3b-5578127eb018 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8046f1ab9c004060965dced02db4b7c4', 'request_id': 'req-8f077a14-14a3-41da-8e3b-5578127eb018'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:09.356355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8f077a14-14a3-41da-8e3b-5578127eb018 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8046f1ab9c004060965dced02db4b7c4', 'request_id': 'req-8f077a14-14a3-41da-8e3b-5578127eb018'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:09.374536 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230ceaa-9e30-4027-804e-62741f645d66 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:09.376402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8f077a14-14a3-41da-8e3b-5578127eb018 admin admin] The token cache is being invalidate because project 8046f1ab9c004060965dced02db4b7c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:11:09.376700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8f077a14-14a3-41da-8e3b-5578127eb018 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:09.377360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8f077a14-14a3-41da-8e3b-5578127eb018 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:09.382622 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2517/5075] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:11:09 2022] DELETE /identity/v3/projects/8046f1ab9c004060965dced02db4b7c4 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:09.383854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f077a14-14a3-41da-8e3b-5578127eb018 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:09.386177 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8f077a14-14a3-41da-8e3b-5578127eb018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:09.446108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9f778-b9da-46e3-bbdf-952b503ccc48 tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f5fcc82627455fb1acc7a441b1c0fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c9d6a0f436e4275a4c6d596f9ce64f4', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-745784101', 'tempest-NotDelegatedRole-959258680'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:09.447075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9f778-b9da-46e3-bbdf-952b503ccc48 tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:09.447359 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9f778-b9da-46e3-bbdf-952b503ccc48 tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:09.447635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9f778-b9da-46e3-bbdf-952b503ccc48 tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] PATH_INFO: `/v3/OS-TRUST/trusts/311eed1242bd46fcb39d2d3506029010` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:09.457406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-f4e9f778-b9da-46e3-bbdf-952b503ccc48 tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] Could not find trust: 311eed1242bd46fcb39d2d3506029010.: keystone.exception.TrustNotFound: Could not find trust: 311eed1242bd46fcb39d2d3506029010. Aug 06 21:11:09.457406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:11:09.457406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:11:09.457406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:11:09.457406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:11:09.457406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:11:09.457406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:11:09.457406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:11:09.457406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:11:09.457406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:11:09.457406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:11:09.457406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:11:09.457406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 06 21:11:09.457406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 06 21:11:09.457406 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 06 21:11:09.458390 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 06 21:11:09.458390 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 06 21:11:09.458390 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 06 21:11:09.458390 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 06 21:11:09.458390 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 06 21:11:09.458390 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:11:09.458390 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:11:09.458390 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 06 21:11:09.458390 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 06 21:11:09.458390 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 06 21:11:09.458390 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 06 21:11:09.458390 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 311eed1242bd46fcb39d2d3506029010. Aug 06 21:11:09.458390 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:11:09.459448 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2559/5076] 10.222.0.33 () {58 vars in 1251 bytes} [Sat Aug 6 21:11:09 2022] GET /identity/v3/OS-TRUST/trusts/311eed1242bd46fcb39d2d3506029010 => generated 111 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:11:09.459868 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9f778-b9da-46e3-bbdf-952b503ccc48 tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:09.462443 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f4e9f778-b9da-46e3-bbdf-952b503ccc48 tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:09.465338 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f077a14-14a3-41da-8e3b-5578127eb018 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:09.470304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab3c3b-e2c3-4047-b52a-238786c54a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:09.471170 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab3c3b-e2c3-4047-b52a-238786c54a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:09.471448 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab3c3b-e2c3-4047-b52a-238786c54a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:09.471720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab3c3b-e2c3-4047-b52a-238786c54a0d admin admin] PATH_INFO: `/v3/projects/d76126ff5fe045da86c8b75db29af606` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:09.472889 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab3c3b-e2c3-4047-b52a-238786c54a0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d76126ff5fe045da86c8b75db29af606)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:09.475009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab3c3b-e2c3-4047-b52a-238786c54a0d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:09.491091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:09.530997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-afab3c3b-e2c3-4047-b52a-238786c54a0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd76126ff5fe045da86c8b75db29af606', 'request_id': 'req-afab3c3b-e2c3-4047-b52a-238786c54a0d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:09.538887 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-afab3c3b-e2c3-4047-b52a-238786c54a0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd76126ff5fe045da86c8b75db29af606', 'request_id': 'req-afab3c3b-e2c3-4047-b52a-238786c54a0d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:09.541133 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9f778-b9da-46e3-bbdf-952b503ccc48 tempest-TrustsV3TestJSON-1825922338 tempest-user-1601467841] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:09.549203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-afab3c3b-e2c3-4047-b52a-238786c54a0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd76126ff5fe045da86c8b75db29af606', 'request_id': 'req-afab3c3b-e2c3-4047-b52a-238786c54a0d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:09.565718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:09.569516 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-afab3c3b-e2c3-4047-b52a-238786c54a0d admin admin] The token cache is being invalidate because project d76126ff5fe045da86c8b75db29af606 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:11:09.569973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-afab3c3b-e2c3-4047-b52a-238786c54a0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:09.571225 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-afab3c3b-e2c3-4047-b52a-238786c54a0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:09.582726 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2518/5077] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:11:09 2022] DELETE /identity/v3/projects/d76126ff5fe045da86c8b75db29af606 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:09.596278 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b9d3e-9ded-4dad-8afd-ff2c28978054 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:09.597070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b9d3e-9ded-4dad-8afd-ff2c28978054 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:09.597870 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b9d3e-9ded-4dad-8afd-ff2c28978054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:09.601259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d47ed-280d-4f13-b339-145bc2caaa8a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10759b2abd4cafacf338551327775e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:09.602221 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d47ed-280d-4f13-b339-145bc2caaa8a service glance] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:09.602495 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d47ed-280d-4f13-b339-145bc2caaa8a service glance] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:09.602937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d47ed-280d-4f13-b339-145bc2caaa8a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:09.605135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-319d47ed-280d-4f13-b339-145bc2caaa8a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:09.641902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-fd6b9d3e-9ded-4dad-8afd-ff2c28978054 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:09.643148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-fd6b9d3e-9ded-4dad-8afd-ff2c28978054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:09.684223 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d47ed-280d-4f13-b339-145bc2caaa8a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:09.687546 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d47ed-280d-4f13-b339-145bc2caaa8a service glance] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:09.699047 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2560/5078] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:11:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:11:09.699755 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d47ed-280d-4f13-b339-145bc2caaa8a service glance] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:09.701133 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-319d47ed-280d-4f13-b339-145bc2caaa8a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:09.732113 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2519/5079] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:09.733906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ce3d4-f287-41a2-99f3-24905076f985 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:09.734260 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ce3d4-f287-41a2-99f3-24905076f985 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:09.734814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ce3d4-f287-41a2-99f3-24905076f985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:09.776430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-160ce3d4-f287-41a2-99f3-24905076f985 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:09.781495 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-160ce3d4-f287-41a2-99f3-24905076f985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:09.809751 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2520/5080] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:09.813217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31a212-b365-4a08-88a4-2bd0bb6ac4dd None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:09.813508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31a212-b365-4a08-88a4-2bd0bb6ac4dd None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:09.813784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31a212-b365-4a08-88a4-2bd0bb6ac4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:09.869917 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d47ed-280d-4f13-b339-145bc2caaa8a service glance] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:09.876844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-fa31a212-b365-4a08-88a4-2bd0bb6ac4dd None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:09.880883 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-fa31a212-b365-4a08-88a4-2bd0bb6ac4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:09.881354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff529791-0a93-49f4-94bb-ff1b5449e7c8 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:09.883146 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff529791-0a93-49f4-94bb-ff1b5449e7c8 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:09.883583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff529791-0a93-49f4-94bb-ff1b5449e7c8 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:09.884463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff529791-0a93-49f4-94bb-ff1b5449e7c8 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/roles/e0d7082ff3164656a6c837132714322b` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:09.886892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff529791-0a93-49f4-94bb-ff1b5449e7c8 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e0d7082ff3164656a6c837132714322b)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:09.889425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff529791-0a93-49f4-94bb-ff1b5449e7c8 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:09.891891 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2521/5081] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:09.898086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a818a2a-582d-41a0-b1c0-4727ca69a42f None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:09.898086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a818a2a-582d-41a0-b1c0-4727ca69a42f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:09.898086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a818a2a-582d-41a0-b1c0-4727ca69a42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:09.928450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-8a818a2a-582d-41a0-b1c0-4727ca69a42f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:09.930180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8a818a2a-582d-41a0-b1c0-4727ca69a42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:09.942790 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2522/5082] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:09.948065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a818a2a-582d-41a0-b1c0-4727ca69a42f None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:09.949726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8a818a2a-582d-41a0-b1c0-4727ca69a42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:09.959445 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:09.972856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a818a2a-582d-41a0-b1c0-4727ca69a42f None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:09.979950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653a0f9-7b7c-4417-9802-b7a6054ad242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:09.980752 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653a0f9-7b7c-4417-9802-b7a6054ad242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:09.981562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653a0f9-7b7c-4417-9802-b7a6054ad242 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:09.981562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653a0f9-7b7c-4417-9802-b7a6054ad242 admin admin] PATH_INFO: `/v3/users/a9aba675d9aa402498a74180fe75c457` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:09.983827 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a653a0f9-7b7c-4417-9802-b7a6054ad242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9aba675d9aa402498a74180fe75c457)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:09.986183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a653a0f9-7b7c-4417-9802-b7a6054ad242 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:09.997726 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ff529791-0a93-49f4-94bb-ff1b5449e7c8 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invalidating the token cache because role e0d7082ff3164656a6c837132714322b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:11:09.998215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ff529791-0a93-49f4-94bb-ff1b5449e7c8 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:09.999911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ff529791-0a93-49f4-94bb-ff1b5449e7c8 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:10.004706 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2561/5083] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:11:09 2022] DELETE /identity/v3/roles/e0d7082ff3164656a6c837132714322b => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:10.005981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff529791-0a93-49f4-94bb-ff1b5449e7c8 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:10.007954 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ff529791-0a93-49f4-94bb-ff1b5449e7c8 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:10.062070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a653a0f9-7b7c-4417-9802-b7a6054ad242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9aba675d9aa402498a74180fe75c457'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:10.062979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a653a0f9-7b7c-4417-9802-b7a6054ad242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9aba675d9aa402498a74180fe75c457'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:10.063619 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a653a0f9-7b7c-4417-9802-b7a6054ad242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9aba675d9aa402498a74180fe75c457'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:10.082298 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a653a0f9-7b7c-4417-9802-b7a6054ad242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9aba675d9aa402498a74180fe75c457'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:10.111995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a653a0f9-7b7c-4417-9802-b7a6054ad242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9aba675d9aa402498a74180fe75c457'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:10.130893 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2523/5084] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:11:09 2022] DELETE /identity/v3/users/a9aba675d9aa402498a74180fe75c457 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:10.136287 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653a0f9-7b7c-4417-9802-b7a6054ad242 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:10.138102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a653a0f9-7b7c-4417-9802-b7a6054ad242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:10.171404 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff529791-0a93-49f4-94bb-ff1b5449e7c8 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:10.274412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:10.298464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706470f-bb3f-4b4e-ac7f-ee31832775ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:10.299126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706470f-bb3f-4b4e-ac7f-ee31832775ae admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:10.299408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706470f-bb3f-4b4e-ac7f-ee31832775ae admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:10.300732 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706470f-bb3f-4b4e-ac7f-ee31832775ae admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:10.303276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706470f-bb3f-4b4e-ac7f-ee31832775ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:11:10.303570 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706470f-bb3f-4b4e-ac7f-ee31832775ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:10.310470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706470f-bb3f-4b4e-ac7f-ee31832775ae admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:10.311798 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653a0f9-7b7c-4417-9802-b7a6054ad242 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:10.326418 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546598c-abef-4092-94f3-dc0a5c7ca4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:10.327078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546598c-abef-4092-94f3-dc0a5c7ca4e1 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:10.327434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546598c-abef-4092-94f3-dc0a5c7ca4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:10.327882 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546598c-abef-4092-94f3-dc0a5c7ca4e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:10.328562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546598c-abef-4092-94f3-dc0a5c7ca4e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:11:10.328865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546598c-abef-4092-94f3-dc0a5c7ca4e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:10.330509 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546598c-abef-4092-94f3-dc0a5c7ca4e1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:10.346774 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2562/5085] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:11:10.348018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706470f-bb3f-4b4e-ac7f-ee31832775ae admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:10.350131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e706470f-bb3f-4b4e-ac7f-ee31832775ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:10.358471 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2524/5086] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:11:10.359873 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4115cf-92de-4224-9410-633b3dbde860 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:10.360162 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4115cf-92de-4224-9410-633b3dbde860 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:10.360512 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4115cf-92de-4224-9410-633b3dbde860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:10.410898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-9e4115cf-92de-4224-9410-633b3dbde860 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:10.412195 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9e4115cf-92de-4224-9410-633b3dbde860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:10.424950 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2525/5087] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:10.424950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4115cf-92de-4224-9410-633b3dbde860 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:10.425216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9e4115cf-92de-4224-9410-633b3dbde860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:10.442078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4115cf-92de-4224-9410-633b3dbde860 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:10.449239 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2cdc98-eb31-4c9d-98af-dda1e6421953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:10.450293 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cdc98-eb31-4c9d-98af-dda1e6421953 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:10.450707 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cdc98-eb31-4c9d-98af-dda1e6421953 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:10.451739 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cdc98-eb31-4c9d-98af-dda1e6421953 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:10.452488 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2cdc98-eb31-4c9d-98af-dda1e6421953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:10.454852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2cdc98-eb31-4c9d-98af-dda1e6421953 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:10.512449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706470f-bb3f-4b4e-ac7f-ee31832775ae admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:10.520960 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2526/5088] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:11:10 2022] POST /identity/v3/projects => generated 371 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:10.520960 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2cdc98-eb31-4c9d-98af-dda1e6421953 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:10.524903 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570f529-b9b7-4904-bc99-fff5928590e3 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:10.525617 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570f529-b9b7-4904-bc99-fff5928590e3 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:10.525903 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570f529-b9b7-4904-bc99-fff5928590e3 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:10.526424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570f529-b9b7-4904-bc99-fff5928590e3 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/roles/de97c6e0a76946b1a42281a1a39c7063` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:10.528952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570f529-b9b7-4904-bc99-fff5928590e3 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:delete_role(role_id=de97c6e0a76946b1a42281a1a39c7063)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:10.535174 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570f529-b9b7-4904-bc99-fff5928590e3 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:10.593596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:10.609265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3570f529-b9b7-4904-bc99-fff5928590e3 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invalidating the token cache because role de97c6e0a76946b1a42281a1a39c7063 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:11:10.609655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3570f529-b9b7-4904-bc99-fff5928590e3 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:10.610849 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3570f529-b9b7-4904-bc99-fff5928590e3 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:10.613530 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2563/5089] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:11:10 2022] DELETE /identity/v3/roles/de97c6e0a76946b1a42281a1a39c7063 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:10.614805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570f529-b9b7-4904-bc99-fff5928590e3 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:10.616407 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3570f529-b9b7-4904-bc99-fff5928590e3 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:10.641853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2cdc98-eb31-4c9d-98af-dda1e6421953 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:10.735018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570f529-b9b7-4904-bc99-fff5928590e3 tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:10.739546 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f8940-3975-4c47-a414-495d11d3511d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:10.740209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f8940-3975-4c47-a414-495d11d3511d service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:10.740442 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f8940-3975-4c47-a414-495d11d3511d service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:10.740719 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f8940-3975-4c47-a414-495d11d3511d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:10.741717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a9425-a3c2-4489-9f0f-11690caa6bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:10.742523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a9425-a3c2-4489-9f0f-11690caa6bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:10.742717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ea2f8940-3975-4c47-a414-495d11d3511d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:10.742958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a9425-a3c2-4489-9f0f-11690caa6bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:10.743301 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a9425-a3c2-4489-9f0f-11690caa6bc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:10.744097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a9425-a3c2-4489-9f0f-11690caa6bc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:10.746387 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a9425-a3c2-4489-9f0f-11690caa6bc8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:10.760224 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f8940-3975-4c47-a414-495d11d3511d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:10.761725 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f8940-3975-4c47-a414-495d11d3511d service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:10.773469 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2564/5090] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:11:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:11:10.774126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f8940-3975-4c47-a414-495d11d3511d service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:10.775654 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ea2f8940-3975-4c47-a414-495d11d3511d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:10.788769 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2527/5091] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:11:10 2022] POST /identity/v3/projects => generated 369 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:10.789860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a9425-a3c2-4489-9f0f-11690caa6bc8 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:10.797576 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-541a9425-a3c2-4489-9f0f-11690caa6bc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:10.806531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f8940-3975-4c47-a414-495d11d3511d service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:10.902177 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:10.923642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a9425-a3c2-4489-9f0f-11690caa6bc8 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:10.932683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd5b3e-7c69-40f8-b9ed-1b6479a8b9bf tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:10.933400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd5b3e-7c69-40f8-b9ed-1b6479a8b9bf tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:10.933649 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd5b3e-7c69-40f8-b9ed-1b6479a8b9bf tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:10.933933 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd5b3e-7c69-40f8-b9ed-1b6479a8b9bf tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/users/71f5fcc82627455fb1acc7a441b1c0fe` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:10.945735 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd5b3e-7c69-40f8-b9ed-1b6479a8b9bf tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:delete_user(user_id=71f5fcc82627455fb1acc7a441b1c0fe)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:10.948314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd5b3e-7c69-40f8-b9ed-1b6479a8b9bf tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:10.960063 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f1a2a-6130-47f6-9a51-a7322fe77f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:10.960630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f1a2a-6130-47f6-9a51-a7322fe77f27 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:10.960770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f1a2a-6130-47f6-9a51-a7322fe77f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:10.962409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f1a2a-6130-47f6-9a51-a7322fe77f27 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:10.963106 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f1a2a-6130-47f6-9a51-a7322fe77f27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:10.970294 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f1a2a-6130-47f6-9a51-a7322fe77f27 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:11.019201 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2565/5092] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:11:10 2022] POST /identity/v3/users => generated 286 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:11.020764 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f1a2a-6130-47f6-9a51-a7322fe77f27 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:11.024762 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f7fd5b3e-7c69-40f8-b9ed-1b6479a8b9bf tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71f5fcc82627455fb1acc7a441b1c0fe'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:11.026118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f7fd5b3e-7c69-40f8-b9ed-1b6479a8b9bf tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71f5fcc82627455fb1acc7a441b1c0fe'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:11.026921 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f7fd5b3e-7c69-40f8-b9ed-1b6479a8b9bf tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71f5fcc82627455fb1acc7a441b1c0fe'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:11.030838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-044f1a2a-6130-47f6-9a51-a7322fe77f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:11.041666 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f7fd5b3e-7c69-40f8-b9ed-1b6479a8b9bf tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71f5fcc82627455fb1acc7a441b1c0fe'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:11.063121 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f7fd5b3e-7c69-40f8-b9ed-1b6479a8b9bf tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71f5fcc82627455fb1acc7a441b1c0fe'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:11.073903 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f1a2a-6130-47f6-9a51-a7322fe77f27 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:11.088132 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2528/5093] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:11:10 2022] DELETE /identity/v3/users/71f5fcc82627455fb1acc7a441b1c0fe => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:11.089488 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd5b3e-7c69-40f8-b9ed-1b6479a8b9bf tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:11.092719 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f7fd5b3e-7c69-40f8-b9ed-1b6479a8b9bf tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:11.097642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d57b01-7055-4635-9fe0-94db0e5c7605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:11.104263 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d57b01-7055-4635-9fe0-94db0e5c7605 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:11.104784 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d57b01-7055-4635-9fe0-94db0e5c7605 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:11.107051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d57b01-7055-4635-9fe0-94db0e5c7605 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:11.113098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d57b01-7055-4635-9fe0-94db0e5c7605 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:11.116425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d57b01-7055-4635-9fe0-94db0e5c7605 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:11.187014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd5b3e-7c69-40f8-b9ed-1b6479a8b9bf tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:11.193425 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944eb892-96b7-4d56-b85d-623efc7a11af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:11.194209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944eb892-96b7-4d56-b85d-623efc7a11af admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:11.194666 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944eb892-96b7-4d56-b85d-623efc7a11af admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:11.195059 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944eb892-96b7-4d56-b85d-623efc7a11af admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:11.195810 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944eb892-96b7-4d56-b85d-623efc7a11af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:11.197599 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944eb892-96b7-4d56-b85d-623efc7a11af admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:11.213499 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2566/5094] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:11:11 2022] POST /identity/v3/users => generated 285 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:11.214575 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d57b01-7055-4635-9fe0-94db0e5c7605 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:11.217769 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2529/5095] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:11.219390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944eb892-96b7-4d56-b85d-623efc7a11af admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:11.222147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-944eb892-96b7-4d56-b85d-623efc7a11af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:11.225704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b8d57b01-7055-4635-9fe0-94db0e5c7605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:11.252129 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d57b01-7055-4635-9fe0-94db0e5c7605 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:11.252983 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944eb892-96b7-4d56-b85d-623efc7a11af admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:11.268151 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c79550-0469-4524-8f4f-1e740c1eb78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:11.268872 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c79550-0469-4524-8f4f-1e740c1eb78a admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:11.269240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c79550-0469-4524-8f4f-1e740c1eb78a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:11.269565 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c79550-0469-4524-8f4f-1e740c1eb78a admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:11.270265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c79550-0469-4524-8f4f-1e740c1eb78a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:11.271955 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c79550-0469-4524-8f4f-1e740c1eb78a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:11.299014 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2530/5096] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:11.299887 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c79550-0469-4524-8f4f-1e740c1eb78a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:11.322690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c79550-0469-4524-8f4f-1e740c1eb78a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:11.335440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46555e3c-f95f-42f6-91c9-b9bbd10da211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:11.336068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46555e3c-f95f-42f6-91c9-b9bbd10da211 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:11.336350 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46555e3c-f95f-42f6-91c9-b9bbd10da211 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:11.336606 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46555e3c-f95f-42f6-91c9-b9bbd10da211 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:11.337530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46555e3c-f95f-42f6-91c9-b9bbd10da211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:11.344135 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46555e3c-f95f-42f6-91c9-b9bbd10da211 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:11.370363 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2531/5097] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:11.371370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46555e3c-f95f-42f6-91c9-b9bbd10da211 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:11.389969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7bd265-c4d8-4455-bf11-5aeb3d92ac0f tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496ef01e6d6d4e45aa3889887ae7f380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a56c49c64bfb4772ac49de67b52412ef', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:11.391015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bd265-c4d8-4455-bf11-5aeb3d92ac0f tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:11.391407 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bd265-c4d8-4455-bf11-5aeb3d92ac0f tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:11.391788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bd265-c4d8-4455-bf11-5aeb3d92ac0f tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] PATH_INFO: `/v3/projects/9c9d6a0f436e4275a4c6d596f9ce64f4` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:11.394781 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46555e3c-f95f-42f6-91c9-b9bbd10da211 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:11.395075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7bd265-c4d8-4455-bf11-5aeb3d92ac0f tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9c9d6a0f436e4275a4c6d596f9ce64f4)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:11.397435 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7bd265-c4d8-4455-bf11-5aeb3d92ac0f tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:11.401421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b90f2f-77c0-4d00-8134-bee16a8a1b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:11.402390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b90f2f-77c0-4d00-8134-bee16a8a1b7d admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:11.402390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b90f2f-77c0-4d00-8134-bee16a8a1b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:11.402740 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b90f2f-77c0-4d00-8134-bee16a8a1b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:11.403382 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b90f2f-77c0-4d00-8134-bee16a8a1b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:11.406674 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b90f2f-77c0-4d00-8134-bee16a8a1b7d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:11.424541 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2532/5098] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:11.425995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b90f2f-77c0-4d00-8134-bee16a8a1b7d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:11.429235 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:11.443461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b90f2f-77c0-4d00-8134-bee16a8a1b7d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:11.451995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d588e4-0c9b-4e99-8325-759376609cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:11.453613 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d588e4-0c9b-4e99-8325-759376609cf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:11.454247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d588e4-0c9b-4e99-8325-759376609cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:11.454723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d588e4-0c9b-4e99-8325-759376609cf3 admin admin] PATH_INFO: `/v3/projects/227ed263d0044aa39b2bf3390d4c4dc9/users/2d050e7deab24698b6cb13d7a885606e/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:11.478749 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d588e4-0c9b-4e99-8325-759376609cf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=227ed263d0044aa39b2bf3390d4c4dc9, user_id=2d050e7deab24698b6cb13d7a885606e, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:11.484251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d588e4-0c9b-4e99-8325-759376609cf3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:11.503051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8e7bd265-c4d8-4455-bf11-5aeb3d92ac0f tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c9d6a0f436e4275a4c6d596f9ce64f4', 'request_id': 'req-8e7bd265-c4d8-4455-bf11-5aeb3d92ac0f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:11.510848 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8e7bd265-c4d8-4455-bf11-5aeb3d92ac0f tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c9d6a0f436e4275a4c6d596f9ce64f4', 'request_id': 'req-8e7bd265-c4d8-4455-bf11-5aeb3d92ac0f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:11.525252 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2533/5099] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:11:11 2022] PUT /identity/v3/projects/227ed263d0044aa39b2bf3390d4c4dc9/users/2d050e7deab24698b6cb13d7a885606e/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:11.528909 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d588e4-0c9b-4e99-8325-759376609cf3 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:11.531214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8e7bd265-c4d8-4455-bf11-5aeb3d92ac0f tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c9d6a0f436e4275a4c6d596f9ce64f4', 'request_id': 'req-8e7bd265-c4d8-4455-bf11-5aeb3d92ac0f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:11.542490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:11.553120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8e7bd265-c4d8-4455-bf11-5aeb3d92ac0f tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] The token cache is being invalidate because project 9c9d6a0f436e4275a4c6d596f9ce64f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:11:11.553412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8e7bd265-c4d8-4455-bf11-5aeb3d92ac0f tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:11.554142 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8e7bd265-c4d8-4455-bf11-5aeb3d92ac0f tempest-TrustsV3TestJSON-1255108363 tempest-TrustsV3TestJSON-1255108363-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:11.556349 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2567/5100] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:11:11 2022] DELETE /identity/v3/projects/9c9d6a0f436e4275a4c6d596f9ce64f4 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:11.557562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b7afd-a947-4350-8ca4-5975d8f90439 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:11.557841 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b7afd-a947-4350-8ca4-5975d8f90439 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:11.562820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b7afd-a947-4350-8ca4-5975d8f90439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:11.586821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-bc9b7afd-a947-4350-8ca4-5975d8f90439 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:11.588052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-bc9b7afd-a947-4350-8ca4-5975d8f90439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:11.647538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d588e4-0c9b-4e99-8325-759376609cf3 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:11.653739 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb524f7b-b3fd-44f3-954f-3559a345770f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:11.655159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb524f7b-b3fd-44f3-954f-3559a345770f admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:11.655441 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb524f7b-b3fd-44f3-954f-3559a345770f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:11.655718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb524f7b-b3fd-44f3-954f-3559a345770f admin admin] PATH_INFO: `/v3/projects/6d1fa862aef94743a6132234f0dc45f7/users/4055ba2766514a47a5d24798505dc4b3/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:11.681464 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2568/5101] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:11.682458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b7afd-a947-4350-8ca4-5975d8f90439 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:11.684769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-bc9b7afd-a947-4350-8ca4-5975d8f90439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:11.689402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb524f7b-b3fd-44f3-954f-3559a345770f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d1fa862aef94743a6132234f0dc45f7, user_id=4055ba2766514a47a5d24798505dc4b3, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:11.693980 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb524f7b-b3fd-44f3-954f-3559a345770f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:11.700589 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b7afd-a947-4350-8ca4-5975d8f90439 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:11.707325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86937167-46f8-4585-b58c-7b8e7bba8825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:11.709159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86937167-46f8-4585-b58c-7b8e7bba8825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:11.709159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86937167-46f8-4585-b58c-7b8e7bba8825 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:11.709159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86937167-46f8-4585-b58c-7b8e7bba8825 admin admin] PATH_INFO: `/v3/projects/a4d509efced842b48b453404fc98ce1f` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:11.711420 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86937167-46f8-4585-b58c-7b8e7bba8825 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4d509efced842b48b453404fc98ce1f)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:11.711839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86937167-46f8-4585-b58c-7b8e7bba8825 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:11.725186 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2534/5102] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:11:11 2022] PUT /identity/v3/projects/6d1fa862aef94743a6132234f0dc45f7/users/4055ba2766514a47a5d24798505dc4b3/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:11.727484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb524f7b-b3fd-44f3-954f-3559a345770f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:11.737181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-eb524f7b-b3fd-44f3-954f-3559a345770f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:11.771410 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-86937167-46f8-4585-b58c-7b8e7bba8825 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4d509efced842b48b453404fc98ce1f', 'request_id': 'req-86937167-46f8-4585-b58c-7b8e7bba8825'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:11.778677 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-86937167-46f8-4585-b58c-7b8e7bba8825 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4d509efced842b48b453404fc98ce1f', 'request_id': 'req-86937167-46f8-4585-b58c-7b8e7bba8825'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:11.792663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-86937167-46f8-4585-b58c-7b8e7bba8825 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4d509efced842b48b453404fc98ce1f', 'request_id': 'req-86937167-46f8-4585-b58c-7b8e7bba8825'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:11.809426 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-86937167-46f8-4585-b58c-7b8e7bba8825 admin admin] The token cache is being invalidate because project a4d509efced842b48b453404fc98ce1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:11:11.809730 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-86937167-46f8-4585-b58c-7b8e7bba8825 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:11.810425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-86937167-46f8-4585-b58c-7b8e7bba8825 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:11.816585 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2569/5103] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:11:11 2022] DELETE /identity/v3/projects/a4d509efced842b48b453404fc98ce1f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:11.816585 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86937167-46f8-4585-b58c-7b8e7bba8825 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:11.816585 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-86937167-46f8-4585-b58c-7b8e7bba8825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:11.849515 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb524f7b-b3fd-44f3-954f-3559a345770f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:11.862899 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:11.905405 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86937167-46f8-4585-b58c-7b8e7bba8825 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:11.910072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c9d8e-596e-4eb4-bedc-16d9ae3c68f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:11.910734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c9d8e-596e-4eb4-bedc-16d9ae3c68f2 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:11.911017 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c9d8e-596e-4eb4-bedc-16d9ae3c68f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:11.911393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c9d8e-596e-4eb4-bedc-16d9ae3c68f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:11.915042 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5f7c9d8e-596e-4eb4-bedc-16d9ae3c68f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:11.915997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9bd10-cf70-4aa9-a00e-8654f3862a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:11.916740 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9bd10-cf70-4aa9-a00e-8654f3862a20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:11.917111 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9bd10-cf70-4aa9-a00e-8654f3862a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:11.917504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9bd10-cf70-4aa9-a00e-8654f3862a20 admin admin] PATH_INFO: `/v3/users/35fc318b696c45a986823df52c1997a4` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:11.918775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9bd10-cf70-4aa9-a00e-8654f3862a20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35fc318b696c45a986823df52c1997a4)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:11.921280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9bd10-cf70-4aa9-a00e-8654f3862a20 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:11.927920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c9d8e-596e-4eb4-bedc-16d9ae3c68f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:11.929624 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c9d8e-596e-4eb4-bedc-16d9ae3c68f2 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:11.942409 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2570/5104] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:11:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:11:11.943845 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce33e8-4c39-4244-ac7c-c7c53b49717e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:11.944230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce33e8-4c39-4244-ac7c-c7c53b49717e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:11.944457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce33e8-4c39-4244-ac7c-c7c53b49717e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:11.978267 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-67ce33e8-4c39-4244-ac7c-c7c53b49717e None None] MFA Rules not processed for user `4055ba2766514a47a5d24798505dc4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:11.979784 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-67ce33e8-4c39-4244-ac7c-c7c53b49717e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:11.994132 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:12.001843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-39a9bd10-cf70-4aa9-a00e-8654f3862a20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35fc318b696c45a986823df52c1997a4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:12.002900 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-39a9bd10-cf70-4aa9-a00e-8654f3862a20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35fc318b696c45a986823df52c1997a4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:12.003747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-39a9bd10-cf70-4aa9-a00e-8654f3862a20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35fc318b696c45a986823df52c1997a4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:12.015163 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-39a9bd10-cf70-4aa9-a00e-8654f3862a20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35fc318b696c45a986823df52c1997a4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:12.034858 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-39a9bd10-cf70-4aa9-a00e-8654f3862a20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35fc318b696c45a986823df52c1997a4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:12.053233 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2535/5105] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:11:11 2022] DELETE /identity/v3/users/35fc318b696c45a986823df52c1997a4 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:12.055095 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ce124-de9a-478c-8efe-3c8ea6cbc31c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:12.055578 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ce124-de9a-478c-8efe-3c8ea6cbc31c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:12.056212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ce124-de9a-478c-8efe-3c8ea6cbc31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:12.074001 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2571/5106] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:12.075608 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b42d4-3f9d-439d-9286-49d4b7a1c067 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:12.076069 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b42d4-3f9d-439d-9286-49d4b7a1c067 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:12.076621 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b42d4-3f9d-439d-9286-49d4b7a1c067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:12.083828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-796ce124-de9a-478c-8efe-3c8ea6cbc31c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:12.085017 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-796ce124-de9a-478c-8efe-3c8ea6cbc31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:12.116144 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-ef1b42d4-3f9d-439d-9286-49d4b7a1c067 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:12.117644 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ef1b42d4-3f9d-439d-9286-49d4b7a1c067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:12.205554 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2536/5107] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:12.206957 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ce124-de9a-478c-8efe-3c8ea6cbc31c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:12.210020 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-796ce124-de9a-478c-8efe-3c8ea6cbc31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:12.225497 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ce124-de9a-478c-8efe-3c8ea6cbc31c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:12.231471 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af0bd7-32c2-44e8-995a-c3cc941d8d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:12.233829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af0bd7-32c2-44e8-995a-c3cc941d8d9b admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:12.234429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af0bd7-32c2-44e8-995a-c3cc941d8d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:12.234953 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af0bd7-32c2-44e8-995a-c3cc941d8d9b admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:12.235795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af0bd7-32c2-44e8-995a-c3cc941d8d9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:12.238752 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af0bd7-32c2-44e8-995a-c3cc941d8d9b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:12.281494 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2572/5108] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:12.281909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2680ded-882b-4901-b16d-2eee08b42793 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:12.282220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2680ded-882b-4901-b16d-2eee08b42793 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:12.282493 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2680ded-882b-4901-b16d-2eee08b42793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:12.286681 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2537/5109] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:11:12 2022] POST /identity/v3/projects => generated 367 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:12.288440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af0bd7-32c2-44e8-995a-c3cc941d8d9b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:12.319771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d2680ded-882b-4901-b16d-2eee08b42793 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:12.321285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d2680ded-882b-4901-b16d-2eee08b42793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:12.419054 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af0bd7-32c2-44e8-995a-c3cc941d8d9b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:12.421117 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:12.438792 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0eb69f-5077-4859-ac42-4365d507df43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:12.440276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0eb69f-5077-4859-ac42-4365d507df43 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:12.440561 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0eb69f-5077-4859-ac42-4365d507df43 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:12.441291 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0eb69f-5077-4859-ac42-4365d507df43 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:12.442178 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0eb69f-5077-4859-ac42-4365d507df43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:12.444212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0eb69f-5077-4859-ac42-4365d507df43 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:12.458719 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2573/5110] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:12.459492 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2680ded-882b-4901-b16d-2eee08b42793 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:12.462273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d2680ded-882b-4901-b16d-2eee08b42793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:12.480848 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2538/5111] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:11:12 2022] POST /identity/v3/users => generated 290 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:11:12.480848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0eb69f-5077-4859-ac42-4365d507df43 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:12.501878 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0eb69f-5077-4859-ac42-4365d507df43 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:12.513498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d42d9-0cc1-43dd-9347-fae084c05152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:12.514707 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d42d9-0cc1-43dd-9347-fae084c05152 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:12.515037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d42d9-0cc1-43dd-9347-fae084c05152 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:12.515245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d42d9-0cc1-43dd-9347-fae084c05152 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:12.515897 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d42d9-0cc1-43dd-9347-fae084c05152 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:11:12.516198 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d42d9-0cc1-43dd-9347-fae084c05152 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:12.518347 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d42d9-0cc1-43dd-9347-fae084c05152 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:12.552798 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2539/5112] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:11:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:11:12.552798 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d42d9-0cc1-43dd-9347-fae084c05152 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:12.566253 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d42d9-0cc1-43dd-9347-fae084c05152 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:12.575324 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb0850-f38d-4703-b720-a7ffd69bc4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:12.577776 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb0850-f38d-4703-b720-a7ffd69bc4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:12.578057 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb0850-f38d-4703-b720-a7ffd69bc4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:12.580501 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb0850-f38d-4703-b720-a7ffd69bc4e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:12.581225 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb0850-f38d-4703-b720-a7ffd69bc4e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:12.585287 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb0850-f38d-4703-b720-a7ffd69bc4e4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:12.611868 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2540/5113] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:12.616104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb0850-f38d-4703-b720-a7ffd69bc4e4 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:12.630478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:12.646625 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb0850-f38d-4703-b720-a7ffd69bc4e4 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:12.658838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1be01-59ca-4f12-bcbb-da7791baed9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:12.659506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1be01-59ca-4f12-bcbb-da7791baed9a admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:12.659709 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1be01-59ca-4f12-bcbb-da7791baed9a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:12.660326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1be01-59ca-4f12-bcbb-da7791baed9a admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:12.660663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1be01-59ca-4f12-bcbb-da7791baed9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:12.671638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1be01-59ca-4f12-bcbb-da7791baed9a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:12.686578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2680ded-882b-4901-b16d-2eee08b42793 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:12.695304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d04b6b-bd9e-45f9-a712-003552f85c71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:12.696349 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d04b6b-bd9e-45f9-a712-003552f85c71 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:12.696802 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d04b6b-bd9e-45f9-a712-003552f85c71 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:12.698885 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d04b6b-bd9e-45f9-a712-003552f85c71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:12.713702 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d04b6b-bd9e-45f9-a712-003552f85c71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:12.715297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d04b6b-bd9e-45f9-a712-003552f85c71 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:12.726207 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2541/5114] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:11:12 2022] POST /identity/v3/projects => generated 391 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:12.726874 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1be01-59ca-4f12-bcbb-da7791baed9a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:12.741138 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2574/5115] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:11:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:11:12.742014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d04b6b-bd9e-45f9-a712-003552f85c71 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:12.764620 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d04b6b-bd9e-45f9-a712-003552f85c71 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:12.835692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1be01-59ca-4f12-bcbb-da7791baed9a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:12.847401 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d21a1-9777-4045-8f2a-aca53064fb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:12.848271 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d21a1-9777-4045-8f2a-aca53064fb33 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:12.848703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d21a1-9777-4045-8f2a-aca53064fb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:12.849236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d21a1-9777-4045-8f2a-aca53064fb33 admin admin] PATH_INFO: `/v3/projects/689cf90bb8884392978aa37cda5202ed/users/dfaaf9ec38bc40708781519e58313140/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:12.850360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020014e8-4ac9-47a0-b586-b211f2008d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:12.851022 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020014e8-4ac9-47a0-b586-b211f2008d15 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:12.851270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020014e8-4ac9-47a0-b586-b211f2008d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:12.851544 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020014e8-4ac9-47a0-b586-b211f2008d15 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:12.852182 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020014e8-4ac9-47a0-b586-b211f2008d15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:12.854334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020014e8-4ac9-47a0-b586-b211f2008d15 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:12.879510 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d21a1-9777-4045-8f2a-aca53064fb33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=689cf90bb8884392978aa37cda5202ed, user_id=dfaaf9ec38bc40708781519e58313140, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:12.888724 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d21a1-9777-4045-8f2a-aca53064fb33 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:12.900318 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2575/5116] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:11:12 2022] POST /identity/v3/users => generated 296 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:12.904196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020014e8-4ac9-47a0-b586-b211f2008d15 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:12.926839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020014e8-4ac9-47a0-b586-b211f2008d15 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:12.928470 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2542/5117] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:11:12 2022] PUT /identity/v3/projects/689cf90bb8884392978aa37cda5202ed/users/dfaaf9ec38bc40708781519e58313140/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:12.929653 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d21a1-9777-4045-8f2a-aca53064fb33 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:13.058288 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492783ab-9aa9-4f52-a5e9-65979913cda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:13.058953 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492783ab-9aa9-4f52-a5e9-65979913cda4 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:13.059495 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492783ab-9aa9-4f52-a5e9-65979913cda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:13.059694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492783ab-9aa9-4f52-a5e9-65979913cda4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:13.060358 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492783ab-9aa9-4f52-a5e9-65979913cda4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:13.062931 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492783ab-9aa9-4f52-a5e9-65979913cda4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:13.064589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d21a1-9777-4045-8f2a-aca53064fb33 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:13.078382 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e388759-aa04-4772-ae1e-540d6ca65fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:13.079282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e388759-aa04-4772-ae1e-540d6ca65fde admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:13.079575 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e388759-aa04-4772-ae1e-540d6ca65fde admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:13.079900 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e388759-aa04-4772-ae1e-540d6ca65fde admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:13.080584 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e388759-aa04-4772-ae1e-540d6ca65fde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:13.083890 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e388759-aa04-4772-ae1e-540d6ca65fde admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:13.088560 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2576/5118] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:13.092187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492783ab-9aa9-4f52-a5e9-65979913cda4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:13.108990 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492783ab-9aa9-4f52-a5e9-65979913cda4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:13.113612 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2543/5119] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:13.118434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e388759-aa04-4772-ae1e-540d6ca65fde admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:13.120518 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b3107-33f5-444f-920a-656f4da877bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:13.121202 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b3107-33f5-444f-920a-656f4da877bf admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:13.121576 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b3107-33f5-444f-920a-656f4da877bf admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:13.121958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b3107-33f5-444f-920a-656f4da877bf admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:13.122693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b3107-33f5-444f-920a-656f4da877bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:13.125821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b3107-33f5-444f-920a-656f4da877bf admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:13.144424 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2577/5120] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:13.145860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b3107-33f5-444f-920a-656f4da877bf admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:13.156840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e388759-aa04-4772-ae1e-540d6ca65fde admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:13.165582 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b3107-33f5-444f-920a-656f4da877bf admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:13.167994 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4f4a4-6669-4c74-ae15-07b24a3ee399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:13.168875 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4f4a4-6669-4c74-ae15-07b24a3ee399 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:13.169318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4f4a4-6669-4c74-ae15-07b24a3ee399 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:13.169760 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4f4a4-6669-4c74-ae15-07b24a3ee399 admin admin] PATH_INFO: `/v3/projects/689cf90bb8884392978aa37cda5202ed/users/dfaaf9ec38bc40708781519e58313140/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:13.172362 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad47fc-e2bc-4fda-98bb-d5690a8e9106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:13.173004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad47fc-e2bc-4fda-98bb-d5690a8e9106 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:13.173424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad47fc-e2bc-4fda-98bb-d5690a8e9106 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:13.173768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad47fc-e2bc-4fda-98bb-d5690a8e9106 admin admin] PATH_INFO: `/v3/projects/3b3ef6a03a2f4fceaac35d6467222153/users/0aecca7d5c454fdb88c513156e0855e0/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:13.181538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4f4a4-6669-4c74-ae15-07b24a3ee399 admin admin] RBAC: Authorizing `identity:create_grant(project_id=689cf90bb8884392978aa37cda5202ed, user_id=dfaaf9ec38bc40708781519e58313140, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:13.186007 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4f4a4-6669-4c74-ae15-07b24a3ee399 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:13.191035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:13.195016 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad47fc-e2bc-4fda-98bb-d5690a8e9106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b3ef6a03a2f4fceaac35d6467222153, user_id=0aecca7d5c454fdb88c513156e0855e0, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:13.201672 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad47fc-e2bc-4fda-98bb-d5690a8e9106 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:13.220369 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2544/5121] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:11:13 2022] PUT /identity/v3/projects/689cf90bb8884392978aa37cda5202ed/users/dfaaf9ec38bc40708781519e58313140/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:13.233731 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2578/5122] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:11:13 2022] PUT /identity/v3/projects/3b3ef6a03a2f4fceaac35d6467222153/users/0aecca7d5c454fdb88c513156e0855e0/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:13.234068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa8f67-dac6-419a-aa0e-44de23a4ccda None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:13.234363 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa8f67-dac6-419a-aa0e-44de23a4ccda None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:13.234677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa8f67-dac6-419a-aa0e-44de23a4ccda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:13.278208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-29fa8f67-dac6-419a-aa0e-44de23a4ccda None None] MFA Rules not processed for user `dfaaf9ec38bc40708781519e58313140`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:13.281717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-29fa8f67-dac6-419a-aa0e-44de23a4ccda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:13.339588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b0838-ba9b-4042-b5cf-589eb073327a None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:13.339938 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b0838-ba9b-4042-b5cf-589eb073327a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:13.340140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b0838-ba9b-4042-b5cf-589eb073327a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:13.348989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:13.395517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-484b0838-ba9b-4042-b5cf-589eb073327a None None] MFA Rules not processed for user `0aecca7d5c454fdb88c513156e0855e0`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:13.396762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-484b0838-ba9b-4042-b5cf-589eb073327a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:13.452944 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2545/5123] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:13.466705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa8f67-dac6-419a-aa0e-44de23a4ccda None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:13.469289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-29fa8f67-dac6-419a-aa0e-44de23a4ccda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:13.582518 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa8f67-dac6-419a-aa0e-44de23a4ccda None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:13.586599 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70806a7-390b-4775-a440-e8157c493040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:13.587217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70806a7-390b-4775-a440-e8157c493040 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:13.587535 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70806a7-390b-4775-a440-e8157c493040 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:13.587819 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70806a7-390b-4775-a440-e8157c493040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:13.588849 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2579/5124] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:13 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:11:13.593892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b0838-ba9b-4042-b5cf-589eb073327a None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:13.603649 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70806a7-390b-4775-a440-e8157c493040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:13.605116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70806a7-390b-4775-a440-e8157c493040 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:13.633812 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2546/5125] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:11:13 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:11:13.705703 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b0838-ba9b-4042-b5cf-589eb073327a None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:13.711606 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62492c3d-d392-4bed-94b1-d7992bc348ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:13.712111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62492c3d-d392-4bed-94b1-d7992bc348ef admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:13.712393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62492c3d-d392-4bed-94b1-d7992bc348ef admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:13.713780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62492c3d-d392-4bed-94b1-d7992bc348ef admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:13.714733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62492c3d-d392-4bed-94b1-d7992bc348ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:13.716611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62492c3d-d392-4bed-94b1-d7992bc348ef admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:13.762687 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2580/5126] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:11:13 2022] POST /identity/v3/projects => generated 391 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:11:13.767332 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70806a7-390b-4775-a440-e8157c493040 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:13.786723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70806a7-390b-4775-a440-e8157c493040 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:13.914845 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0c22a-10ca-413a-9808-0c5ce53a3620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:13.916443 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0c22a-10ca-413a-9808-0c5ce53a3620 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:13.916945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0c22a-10ca-413a-9808-0c5ce53a3620 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:13.917447 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0c22a-10ca-413a-9808-0c5ce53a3620 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:13.918313 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca0c22a-10ca-413a-9808-0c5ce53a3620 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:13.925705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca0c22a-10ca-413a-9808-0c5ce53a3620 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:13.962782 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2547/5127] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:11:13 2022] POST /identity/v3/users => generated 302 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:13.967235 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62492c3d-d392-4bed-94b1-d7992bc348ef admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:13.981108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62492c3d-d392-4bed-94b1-d7992bc348ef admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:13.990035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1268f-52a3-42f1-9690-a8aa8c1652e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:13.993401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1268f-52a3-42f1-9690-a8aa8c1652e5 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:13.993401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1268f-52a3-42f1-9690-a8aa8c1652e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:13.993401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1268f-52a3-42f1-9690-a8aa8c1652e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:13.993401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1268f-52a3-42f1-9690-a8aa8c1652e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:13.995011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1268f-52a3-42f1-9690-a8aa8c1652e5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:14.015118 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2581/5128] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:14.016165 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0c22a-10ca-413a-9808-0c5ce53a3620 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:14.027399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0c22a-10ca-413a-9808-0c5ce53a3620 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:14.034522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf0f85-e98d-416f-a7b5-681e75d0b75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:14.035599 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf0f85-e98d-416f-a7b5-681e75d0b75b admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:14.036029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf0f85-e98d-416f-a7b5-681e75d0b75b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:14.036507 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf0f85-e98d-416f-a7b5-681e75d0b75b admin admin] PATH_INFO: `/v3/projects/f21076a6c0774be6a948d2e61e666110/users/dd08e27bfd644a71b4063754ccbcb460/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:14.059643 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf0f85-e98d-416f-a7b5-681e75d0b75b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f21076a6c0774be6a948d2e61e666110, user_id=dd08e27bfd644a71b4063754ccbcb460, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:14.062928 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf0f85-e98d-416f-a7b5-681e75d0b75b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:14.087811 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2548/5129] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:11:14 2022] PUT /identity/v3/projects/f21076a6c0774be6a948d2e61e666110/users/dd08e27bfd644a71b4063754ccbcb460/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:14.094126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1268f-52a3-42f1-9690-a8aa8c1652e5 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:14.109899 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1268f-52a3-42f1-9690-a8aa8c1652e5 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:14.181302 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:14.191652 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf439b8-4627-4102-b449-abd340d78557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:14.193128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf439b8-4627-4102-b449-abd340d78557 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:14.193553 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf439b8-4627-4102-b449-abd340d78557 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:14.194183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf439b8-4627-4102-b449-abd340d78557 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:14.195292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf439b8-4627-4102-b449-abd340d78557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:14.198087 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf439b8-4627-4102-b449-abd340d78557 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:14.212630 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2582/5130] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:14.218709 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf0f85-e98d-416f-a7b5-681e75d0b75b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:14.236717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf0f85-e98d-416f-a7b5-681e75d0b75b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:14.251640 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba8eb4-fb58-4227-b950-5b8088abf58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:14.252724 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba8eb4-fb58-4227-b950-5b8088abf58a admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:14.253138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba8eb4-fb58-4227-b950-5b8088abf58a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:14.253546 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba8eb4-fb58-4227-b950-5b8088abf58a admin admin] PATH_INFO: `/v3/projects/f21076a6c0774be6a948d2e61e666110/users/dd08e27bfd644a71b4063754ccbcb460/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:14.258374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba8eb4-fb58-4227-b950-5b8088abf58a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f21076a6c0774be6a948d2e61e666110, user_id=dd08e27bfd644a71b4063754ccbcb460, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:14.266620 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba8eb4-fb58-4227-b950-5b8088abf58a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:14.283406 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2549/5131] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:11:14 2022] PUT /identity/v3/projects/f21076a6c0774be6a948d2e61e666110/users/dd08e27bfd644a71b4063754ccbcb460/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:14.293617 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98015d-a2e1-4b65-9a34-9cf6e52a2766 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:14.293905 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98015d-a2e1-4b65-9a34-9cf6e52a2766 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:14.294186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98015d-a2e1-4b65-9a34-9cf6e52a2766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:14.340385 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-1e98015d-a2e1-4b65-9a34-9cf6e52a2766 None None] MFA Rules not processed for user `dd08e27bfd644a71b4063754ccbcb460`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:14.343606 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1e98015d-a2e1-4b65-9a34-9cf6e52a2766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:14.478689 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2583/5132] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:14 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:14.489226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba8eb4-fb58-4227-b950-5b8088abf58a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:14.541631 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:14.607720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba8eb4-fb58-4227-b950-5b8088abf58a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:14.616952 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949009e3-d264-4f2b-ac8d-a0656e76869c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:14.617934 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949009e3-d264-4f2b-ac8d-a0656e76869c service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:14.618471 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949009e3-d264-4f2b-ac8d-a0656e76869c service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:14.618962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949009e3-d264-4f2b-ac8d-a0656e76869c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:14.746001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98015d-a2e1-4b65-9a34-9cf6e52a2766 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:14.747461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1e98015d-a2e1-4b65-9a34-9cf6e52a2766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:14.791750 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949009e3-d264-4f2b-ac8d-a0656e76869c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:14.793228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949009e3-d264-4f2b-ac8d-a0656e76869c service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:14.829814 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2550/5133] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:11:14 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:11:14.941149 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98015d-a2e1-4b65-9a34-9cf6e52a2766 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:14.952684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde06ef-a59a-40b4-8440-070cca6fc537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:14.953328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde06ef-a59a-40b4-8440-070cca6fc537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:14.953612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde06ef-a59a-40b4-8440-070cca6fc537 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:14.953920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde06ef-a59a-40b4-8440-070cca6fc537 admin admin] PATH_INFO: `/v3/projects/28dcec975cfc435cbd4e776c59faaf9e` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:14.955107 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde06ef-a59a-40b4-8440-070cca6fc537 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28dcec975cfc435cbd4e776c59faaf9e)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:14.957072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde06ef-a59a-40b4-8440-070cca6fc537 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:15.040635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6cde06ef-a59a-40b4-8440-070cca6fc537 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28dcec975cfc435cbd4e776c59faaf9e', 'request_id': 'req-6cde06ef-a59a-40b4-8440-070cca6fc537'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:15.049086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6cde06ef-a59a-40b4-8440-070cca6fc537 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28dcec975cfc435cbd4e776c59faaf9e', 'request_id': 'req-6cde06ef-a59a-40b4-8440-070cca6fc537'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:15.060307 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6cde06ef-a59a-40b4-8440-070cca6fc537 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28dcec975cfc435cbd4e776c59faaf9e', 'request_id': 'req-6cde06ef-a59a-40b4-8440-070cca6fc537'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:15.079453 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6cde06ef-a59a-40b4-8440-070cca6fc537 admin admin] The token cache is being invalidate because project 28dcec975cfc435cbd4e776c59faaf9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:11:15.079918 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6cde06ef-a59a-40b4-8440-070cca6fc537 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:15.081454 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6cde06ef-a59a-40b4-8440-070cca6fc537 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:15.086804 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2584/5134] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:11:14 2022] DELETE /identity/v3/projects/28dcec975cfc435cbd4e776c59faaf9e => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:15.087867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949009e3-d264-4f2b-ac8d-a0656e76869c service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:15.110395 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949009e3-d264-4f2b-ac8d-a0656e76869c service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:15.227112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273913a-b6be-42bb-9699-96894d2cf92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:15.228145 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273913a-b6be-42bb-9699-96894d2cf92f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:15.229727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273913a-b6be-42bb-9699-96894d2cf92f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:15.230056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273913a-b6be-42bb-9699-96894d2cf92f admin admin] PATH_INFO: `/v3/users/496ef01e6d6d4e45aa3889887ae7f380` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:15.233206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273913a-b6be-42bb-9699-96894d2cf92f admin admin] RBAC: Authorizing `identity:delete_user(user_id=496ef01e6d6d4e45aa3889887ae7f380)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:15.239199 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273913a-b6be-42bb-9699-96894d2cf92f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:15.361987 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0273913a-b6be-42bb-9699-96894d2cf92f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '496ef01e6d6d4e45aa3889887ae7f380'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:15.362944 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0273913a-b6be-42bb-9699-96894d2cf92f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '496ef01e6d6d4e45aa3889887ae7f380'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:15.364087 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0273913a-b6be-42bb-9699-96894d2cf92f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '496ef01e6d6d4e45aa3889887ae7f380'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:15.377474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0273913a-b6be-42bb-9699-96894d2cf92f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '496ef01e6d6d4e45aa3889887ae7f380'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:15.415194 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0273913a-b6be-42bb-9699-96894d2cf92f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '496ef01e6d6d4e45aa3889887ae7f380'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:15.432230 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:15.447075 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2551/5135] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:11:15 2022] DELETE /identity/v3/users/496ef01e6d6d4e45aa3889887ae7f380 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:15.635683 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde06ef-a59a-40b4-8440-070cca6fc537 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:15.637408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6cde06ef-a59a-40b4-8440-070cca6fc537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:15.661240 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde06ef-a59a-40b4-8440-070cca6fc537 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:15.681728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:15.809672 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680366d-940f-46be-bce5-1a696b3ae894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:15.810411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680366d-940f-46be-bce5-1a696b3ae894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:15.810923 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680366d-940f-46be-bce5-1a696b3ae894 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:15.811269 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680366d-940f-46be-bce5-1a696b3ae894 admin admin] PATH_INFO: `/v3/users/bdf1b5180a814cf39234892c6c1f26df` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:15.812521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8680366d-940f-46be-bce5-1a696b3ae894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdf1b5180a814cf39234892c6c1f26df)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:15.814635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8680366d-940f-46be-bce5-1a696b3ae894 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:15.914413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8680366d-940f-46be-bce5-1a696b3ae894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdf1b5180a814cf39234892c6c1f26df'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:15.945814 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8680366d-940f-46be-bce5-1a696b3ae894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdf1b5180a814cf39234892c6c1f26df'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:15.946625 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8680366d-940f-46be-bce5-1a696b3ae894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdf1b5180a814cf39234892c6c1f26df'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:15.947271 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8680366d-940f-46be-bce5-1a696b3ae894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdf1b5180a814cf39234892c6c1f26df'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:15.968462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8680366d-940f-46be-bce5-1a696b3ae894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdf1b5180a814cf39234892c6c1f26df'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:15.993229 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2585/5136] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:11:15 2022] DELETE /identity/v3/users/bdf1b5180a814cf39234892c6c1f26df => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:16.700722 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273913a-b6be-42bb-9699-96894d2cf92f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:16.703846 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0273913a-b6be-42bb-9699-96894d2cf92f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:16.720987 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273913a-b6be-42bb-9699-96894d2cf92f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:16.807844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce9017-3d32-4c9c-ba2a-1e1429ef92e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:16.807844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce9017-3d32-4c9c-ba2a-1e1429ef92e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:16.807844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce9017-3d32-4c9c-ba2a-1e1429ef92e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:16.807844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce9017-3d32-4c9c-ba2a-1e1429ef92e1 admin admin] PATH_INFO: `/v3/projects/a56c49c64bfb4772ac49de67b52412ef` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:16.817204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce9017-3d32-4c9c-ba2a-1e1429ef92e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a56c49c64bfb4772ac49de67b52412ef)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:16.824581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce9017-3d32-4c9c-ba2a-1e1429ef92e1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:16.898952 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1bce9017-3d32-4c9c-ba2a-1e1429ef92e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a56c49c64bfb4772ac49de67b52412ef', 'request_id': 'req-1bce9017-3d32-4c9c-ba2a-1e1429ef92e1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:16.906428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680366d-940f-46be-bce5-1a696b3ae894 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:16.908456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1bce9017-3d32-4c9c-ba2a-1e1429ef92e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a56c49c64bfb4772ac49de67b52412ef', 'request_id': 'req-1bce9017-3d32-4c9c-ba2a-1e1429ef92e1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:16.908783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8680366d-940f-46be-bce5-1a696b3ae894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:16.916722 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1bce9017-3d32-4c9c-ba2a-1e1429ef92e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a56c49c64bfb4772ac49de67b52412ef', 'request_id': 'req-1bce9017-3d32-4c9c-ba2a-1e1429ef92e1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:16.933004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1bce9017-3d32-4c9c-ba2a-1e1429ef92e1 admin admin] The token cache is being invalidate because project a56c49c64bfb4772ac49de67b52412ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:11:16.933441 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1bce9017-3d32-4c9c-ba2a-1e1429ef92e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:16.934106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1bce9017-3d32-4c9c-ba2a-1e1429ef92e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:16.936215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680366d-940f-46be-bce5-1a696b3ae894 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:16.940558 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2552/5137] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:11:16 2022] DELETE /identity/v3/projects/a56c49c64bfb4772ac49de67b52412ef => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:16.942097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869dc9df-d18f-47b0-b3a2-77601b294fc1 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:16.942386 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869dc9df-d18f-47b0-b3a2-77601b294fc1 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:16.942717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869dc9df-d18f-47b0-b3a2-77601b294fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:16.970079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-869dc9df-d18f-47b0-b3a2-77601b294fc1 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:16.971876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-869dc9df-d18f-47b0-b3a2-77601b294fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:17.049755 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceea2d8-0073-49b6-b9b6-b91f4db46e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:17.050696 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2553/5138] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:17.050918 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceea2d8-0073-49b6-b9b6-b91f4db46e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:17.051218 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceea2d8-0073-49b6-b9b6-b91f4db46e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:17.051479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceea2d8-0073-49b6-b9b6-b91f4db46e60 admin admin] PATH_INFO: `/v3/projects/fe2ae1b1c16d4dedb2585dde7dab8113` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:17.057161 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceea2d8-0073-49b6-b9b6-b91f4db46e60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe2ae1b1c16d4dedb2585dde7dab8113)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:17.058084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce93639-1024-495e-a1d0-eab59ea46d86 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:17.058595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce93639-1024-495e-a1d0-eab59ea46d86 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:17.059128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce93639-1024-495e-a1d0-eab59ea46d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:17.059538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceea2d8-0073-49b6-b9b6-b91f4db46e60 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:17.090824 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-8ce93639-1024-495e-a1d0-eab59ea46d86 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:17.092243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8ce93639-1024-495e-a1d0-eab59ea46d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:17.105905 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:17.106071 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2554/5139] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:11:17.108185 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce93639-1024-495e-a1d0-eab59ea46d86 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:17.119903 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce93639-1024-495e-a1d0-eab59ea46d86 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:17.151127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:17.151522 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dceea2d8-0073-49b6-b9b6-b91f4db46e60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'request_id': 'req-dceea2d8-0073-49b6-b9b6-b91f4db46e60'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:17.167506 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dceea2d8-0073-49b6-b9b6-b91f4db46e60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'request_id': 'req-dceea2d8-0073-49b6-b9b6-b91f4db46e60'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:17.187171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dceea2d8-0073-49b6-b9b6-b91f4db46e60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'request_id': 'req-dceea2d8-0073-49b6-b9b6-b91f4db46e60'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:17.205613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dceea2d8-0073-49b6-b9b6-b91f4db46e60 admin admin] The token cache is being invalidate because project fe2ae1b1c16d4dedb2585dde7dab8113 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:11:17.205946 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dceea2d8-0073-49b6-b9b6-b91f4db46e60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:17.207247 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dceea2d8-0073-49b6-b9b6-b91f4db46e60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:17.208889 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2586/5140] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:11:16 2022] DELETE /identity/v3/projects/fe2ae1b1c16d4dedb2585dde7dab8113 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:11:17.214297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e253148-7f7e-4245-93d7-72dbe34539db None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:17.215106 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e253148-7f7e-4245-93d7-72dbe34539db None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:17.215362 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e253148-7f7e-4245-93d7-72dbe34539db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:17.223910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6bf6b7-351d-4889-b1a3-9fb092528e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:17.224538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bf6b7-351d-4889-b1a3-9fb092528e7d admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:17.224818 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bf6b7-351d-4889-b1a3-9fb092528e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:17.225088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bf6b7-351d-4889-b1a3-9fb092528e7d admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:17.225745 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6bf6b7-351d-4889-b1a3-9fb092528e7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:11:17.226045 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6bf6b7-351d-4889-b1a3-9fb092528e7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:17.227699 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6bf6b7-351d-4889-b1a3-9fb092528e7d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:17.252647 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2555/5141] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:11:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:11:17.259703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6bf6b7-351d-4889-b1a3-9fb092528e7d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:17.262198 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7b6bf6b7-351d-4889-b1a3-9fb092528e7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:17.264285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-9e253148-7f7e-4245-93d7-72dbe34539db None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:17.265509 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9e253148-7f7e-4245-93d7-72dbe34539db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:17.279016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6bf6b7-351d-4889-b1a3-9fb092528e7d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:17.287622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684fcf76-5269-4195-9cb6-b3027096a454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:17.288855 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fcf76-5269-4195-9cb6-b3027096a454 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:17.290534 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2587/5142] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:11:17.291854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fcf76-5269-4195-9cb6-b3027096a454 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:17.292224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fcf76-5269-4195-9cb6-b3027096a454 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:17.293665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f7461-8d00-4897-8a2a-46c308518486 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:17.294102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684fcf76-5269-4195-9cb6-b3027096a454 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:17.294429 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f7461-8d00-4897-8a2a-46c308518486 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:17.295794 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f7461-8d00-4897-8a2a-46c308518486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:17.297514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684fcf76-5269-4195-9cb6-b3027096a454 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:17.356905 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-799f7461-8d00-4897-8a2a-46c308518486 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:17.362929 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2556/5143] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:11:17 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:17.364964 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684fcf76-5269-4195-9cb6-b3027096a454 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:17.366161 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-799f7461-8d00-4897-8a2a-46c308518486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:17.586787 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2588/5144] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:11:17.591218 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f7461-8d00-4897-8a2a-46c308518486 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:17.604941 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684fcf76-5269-4195-9cb6-b3027096a454 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:17.611265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f7461-8d00-4897-8a2a-46c308518486 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:17.617339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50577f8a-a7e6-4d26-a54a-713935fd3917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:17.618355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50577f8a-a7e6-4d26-a54a-713935fd3917 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:17.620469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50577f8a-a7e6-4d26-a54a-713935fd3917 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:17.621112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50577f8a-a7e6-4d26-a54a-713935fd3917 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:17.622526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50577f8a-a7e6-4d26-a54a-713935fd3917 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:17.623887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830031bd-263a-4283-96d0-49d427adf4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:17.624487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830031bd-263a-4283-96d0-49d427adf4b4 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:17.624758 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830031bd-263a-4283-96d0-49d427adf4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:17.625025 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830031bd-263a-4283-96d0-49d427adf4b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:17.628481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50577f8a-a7e6-4d26-a54a-713935fd3917 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:17.630740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830031bd-263a-4283-96d0-49d427adf4b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:11:17.631094 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830031bd-263a-4283-96d0-49d427adf4b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:17.635347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830031bd-263a-4283-96d0-49d427adf4b4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:17.665165 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2589/5145] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:11:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:11:17.669151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830031bd-263a-4283-96d0-49d427adf4b4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:17.685743 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2557/5146] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:11:17 2022] POST /identity/v3/users => generated 299 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:17.689408 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50577f8a-a7e6-4d26-a54a-713935fd3917 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:17.695186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830031bd-263a-4283-96d0-49d427adf4b4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:17.705274 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50577f8a-a7e6-4d26-a54a-713935fd3917 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:17.708751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bfc860-4d97-4c42-95c3-67cfe34f5421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:17.709367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bfc860-4d97-4c42-95c3-67cfe34f5421 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:17.709644 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bfc860-4d97-4c42-95c3-67cfe34f5421 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:17.709913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bfc860-4d97-4c42-95c3-67cfe34f5421 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:17.710764 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bfc860-4d97-4c42-95c3-67cfe34f5421 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:17.714367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bfc860-4d97-4c42-95c3-67cfe34f5421 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:17.719346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58859c26-ec68-4608-b510-6fce47bd7e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:17.721607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58859c26-ec68-4608-b510-6fce47bd7e5e admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:17.721607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58859c26-ec68-4608-b510-6fce47bd7e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:17.722599 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58859c26-ec68-4608-b510-6fce47bd7e5e admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:17.724990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58859c26-ec68-4608-b510-6fce47bd7e5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:17.728282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58859c26-ec68-4608-b510-6fce47bd7e5e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:17.757605 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2558/5147] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:17.761919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58859c26-ec68-4608-b510-6fce47bd7e5e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:17.767354 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2590/5148] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:11:17 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:17.770490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bfc860-4d97-4c42-95c3-67cfe34f5421 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:17.790206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58859c26-ec68-4608-b510-6fce47bd7e5e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:17.878967 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bfc860-4d97-4c42-95c3-67cfe34f5421 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:17.884236 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73807c-64a0-458f-8f36-887f9493e6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:17.885057 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73807c-64a0-458f-8f36-887f9493e6b7 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:17.885523 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73807c-64a0-458f-8f36-887f9493e6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:17.885985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73807c-64a0-458f-8f36-887f9493e6b7 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:17.886702 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f73807c-64a0-458f-8f36-887f9493e6b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:17.888810 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f73807c-64a0-458f-8f36-887f9493e6b7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:17.927352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fb94e-6800-4497-8e20-13d63238b2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:17.928607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fb94e-6800-4497-8e20-13d63238b2f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:17.928959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fb94e-6800-4497-8e20-13d63238b2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:17.932420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fb94e-6800-4497-8e20-13d63238b2f7 admin admin] PATH_INFO: `/v3/projects/86396291e4484c85a13bcd0e5ee53e70/users/59da5bd8555c4855aafa13e4fb323976/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:17.932579 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2591/5149] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:11:17 2022] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:17.934746 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73807c-64a0-458f-8f36-887f9493e6b7 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:17.944682 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:17.953448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73807c-64a0-458f-8f36-887f9493e6b7 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:17.955576 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3fb94e-6800-4497-8e20-13d63238b2f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86396291e4484c85a13bcd0e5ee53e70, user_id=59da5bd8555c4855aafa13e4fb323976, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:17.959339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3fb94e-6800-4497-8e20-13d63238b2f7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:17.970379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df0fde-1e76-4730-ab38-ad1a4433d9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:17.971041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df0fde-1e76-4730-ab38-ad1a4433d9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:17.971318 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df0fde-1e76-4730-ab38-ad1a4433d9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:17.971588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df0fde-1e76-4730-ab38-ad1a4433d9b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:17.972230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df0fde-1e76-4730-ab38-ad1a4433d9b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:17.973683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:17.977254 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df0fde-1e76-4730-ab38-ad1a4433d9b5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:17.984738 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2559/5150] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:11:17 2022] PUT /identity/v3/projects/86396291e4484c85a13bcd0e5ee53e70/users/59da5bd8555c4855aafa13e4fb323976/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:17.987126 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fb94e-6800-4497-8e20-13d63238b2f7 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:17.999344 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2592/5151] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:11:18.004820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df0fde-1e76-4730-ab38-ad1a4433d9b5 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:18.029782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df0fde-1e76-4730-ab38-ad1a4433d9b5 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:18.081124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fb94e-6800-4497-8e20-13d63238b2f7 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:18.086285 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c8b49-f0a9-43a2-b8cc-bb7d38a0affc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:18.086998 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c8b49-f0a9-43a2-b8cc-bb7d38a0affc admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:18.087283 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c8b49-f0a9-43a2-b8cc-bb7d38a0affc admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:18.087556 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c8b49-f0a9-43a2-b8cc-bb7d38a0affc admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:18.088194 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c8b49-f0a9-43a2-b8cc-bb7d38a0affc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:18.089793 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c8b49-f0a9-43a2-b8cc-bb7d38a0affc admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:18.102211 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2560/5152] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:18.106658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c8b49-f0a9-43a2-b8cc-bb7d38a0affc admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:18.137092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c8b49-f0a9-43a2-b8cc-bb7d38a0affc admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:18.150507 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b41a2d-7098-4a08-bffb-355e14cb9320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:18.151284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b41a2d-7098-4a08-bffb-355e14cb9320 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:18.151567 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b41a2d-7098-4a08-bffb-355e14cb9320 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:18.151842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b41a2d-7098-4a08-bffb-355e14cb9320 admin admin] PATH_INFO: `/v3/projects/86396291e4484c85a13bcd0e5ee53e70/users/59da5bd8555c4855aafa13e4fb323976/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:18.156055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b41a2d-7098-4a08-bffb-355e14cb9320 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86396291e4484c85a13bcd0e5ee53e70, user_id=59da5bd8555c4855aafa13e4fb323976, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:18.162633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b41a2d-7098-4a08-bffb-355e14cb9320 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:18.173614 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a171835-a2d7-4dbc-8c66-2b2c85d460d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:18.174397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a171835-a2d7-4dbc-8c66-2b2c85d460d4 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:18.174843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a171835-a2d7-4dbc-8c66-2b2c85d460d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:18.175255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a171835-a2d7-4dbc-8c66-2b2c85d460d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:18.182775 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a171835-a2d7-4dbc-8c66-2b2c85d460d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:18.184534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a171835-a2d7-4dbc-8c66-2b2c85d460d4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:18.191248 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2561/5153] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:11:18 2022] PUT /identity/v3/projects/86396291e4484c85a13bcd0e5ee53e70/users/59da5bd8555c4855aafa13e4fb323976/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:11:18.202788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6eb7da-6f3e-42e7-8227-c1b119d15b28 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:18.203245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6eb7da-6f3e-42e7-8227-c1b119d15b28 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:18.203512 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6eb7da-6f3e-42e7-8227-c1b119d15b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:18.218003 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2593/5154] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:18.218972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a171835-a2d7-4dbc-8c66-2b2c85d460d4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:18.237642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a171835-a2d7-4dbc-8c66-2b2c85d460d4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:18.259619 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-de6eb7da-6f3e-42e7-8227-c1b119d15b28 None None] MFA Rules not processed for user `59da5bd8555c4855aafa13e4fb323976`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:18.260861 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-de6eb7da-6f3e-42e7-8227-c1b119d15b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:18.378430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd7215-830e-47e4-b600-954204b7e304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:18.379263 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd7215-830e-47e4-b600-954204b7e304 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:18.381341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd7215-830e-47e4-b600-954204b7e304 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:18.381712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd7215-830e-47e4-b600-954204b7e304 admin admin] PATH_INFO: `/v3/projects/b39a59bd658147feaa89b79ae9ebe3af/users/23f007a900b143c2ab6521003d025035/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:18.385693 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2562/5155] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:18 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:11:18.387183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6eb7da-6f3e-42e7-8227-c1b119d15b28 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:18.407671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6eb7da-6f3e-42e7-8227-c1b119d15b28 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:18.418316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7feab-6c0f-4401-ab2f-e5fd4d7ec639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:18.419064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7feab-6c0f-4401-ab2f-e5fd4d7ec639 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:18.419346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7feab-6c0f-4401-ab2f-e5fd4d7ec639 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:18.419647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7feab-6c0f-4401-ab2f-e5fd4d7ec639 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:18.420052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bd7215-830e-47e4-b600-954204b7e304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b39a59bd658147feaa89b79ae9ebe3af, user_id=23f007a900b143c2ab6521003d025035, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:18.420636 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7feab-6c0f-4401-ab2f-e5fd4d7ec639 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:18.424624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7feab-6c0f-4401-ab2f-e5fd4d7ec639 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:18.426888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bd7215-830e-47e4-b600-954204b7e304 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:18.457007 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2594/5156] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:11:18 2022] PUT /identity/v3/projects/b39a59bd658147feaa89b79ae9ebe3af/users/23f007a900b143c2ab6521003d025035/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:18.461835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4e8ad-87c2-4ee7-84d1-6ff2a2699a6b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:18.462280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4e8ad-87c2-4ee7-84d1-6ff2a2699a6b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:18.462670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4e8ad-87c2-4ee7-84d1-6ff2a2699a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:18.515018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-fee4e8ad-87c2-4ee7-84d1-6ff2a2699a6b None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:18.516524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-fee4e8ad-87c2-4ee7-84d1-6ff2a2699a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:18.519510 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2563/5157] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:11:18 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:18.523314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7feab-6c0f-4401-ab2f-e5fd4d7ec639 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:18.609805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:18.628214 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2595/5158] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:11:18.641459 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7feab-6c0f-4401-ab2f-e5fd4d7ec639 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:18.649108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a8883-5a1c-4d4b-a6a2-8bac06eecf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:18.649734 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a8883-5a1c-4d4b-a6a2-8bac06eecf3e admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:18.650013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a8883-5a1c-4d4b-a6a2-8bac06eecf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:18.650281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a8883-5a1c-4d4b-a6a2-8bac06eecf3e admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:18.650963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a8883-5a1c-4d4b-a6a2-8bac06eecf3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:18.653142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a8883-5a1c-4d4b-a6a2-8bac06eecf3e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:18.686150 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2564/5159] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:11:18 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:18.689618 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4e8ad-87c2-4ee7-84d1-6ff2a2699a6b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:18.696448 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a8883-5a1c-4d4b-a6a2-8bac06eecf3e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:18.698923 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d69a8883-5a1c-4d4b-a6a2-8bac06eecf3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:18.716087 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4e8ad-87c2-4ee7-84d1-6ff2a2699a6b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:18.742990 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58d588-c65c-4a81-8d88-19bc9adc17b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:18.743644 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58d588-c65c-4a81-8d88-19bc9adc17b8 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:18.743932 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58d588-c65c-4a81-8d88-19bc9adc17b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:18.744963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58d588-c65c-4a81-8d88-19bc9adc17b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:18.749490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58d588-c65c-4a81-8d88-19bc9adc17b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:18.769707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58d588-c65c-4a81-8d88-19bc9adc17b8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:18.784070 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2596/5160] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:18.787661 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58d588-c65c-4a81-8d88-19bc9adc17b8 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:18.794511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:18.804902 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58d588-c65c-4a81-8d88-19bc9adc17b8 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:18.812334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965134c-7f47-4854-a7b8-5b403c6ed782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:18.814279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965134c-7f47-4854-a7b8-5b403c6ed782 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:18.814597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965134c-7f47-4854-a7b8-5b403c6ed782 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:18.814924 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965134c-7f47-4854-a7b8-5b403c6ed782 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:18.815591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f965134c-7f47-4854-a7b8-5b403c6ed782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:18.819007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f965134c-7f47-4854-a7b8-5b403c6ed782 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:18.819191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a8883-5a1c-4d4b-a6a2-8bac06eecf3e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:18.823680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88335f41-0754-4c94-b686-f0b9e4616bf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:18.824404 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88335f41-0754-4c94-b686-f0b9e4616bf8 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:18.824690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88335f41-0754-4c94-b686-f0b9e4616bf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:18.824965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88335f41-0754-4c94-b686-f0b9e4616bf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:18.831750 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2597/5161] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:11:18.837769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965134c-7f47-4854-a7b8-5b403c6ed782 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:18.841766 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88335f41-0754-4c94-b686-f0b9e4616bf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:18.844022 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88335f41-0754-4c94-b686-f0b9e4616bf8 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:18.851231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965134c-7f47-4854-a7b8-5b403c6ed782 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:18.859340 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2565/5162] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:11:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:11:18.860763 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279661a6-0079-4457-97d7-7b968687a395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:18.861441 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279661a6-0079-4457-97d7-7b968687a395 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:18.861840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279661a6-0079-4457-97d7-7b968687a395 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:18.862173 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279661a6-0079-4457-97d7-7b968687a395 admin admin] PATH_INFO: `/v3/projects/ba9e529680804c899de7ed606931c402/users/1524ce651e51428da8d4e7266cb2a503/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:18.884367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279661a6-0079-4457-97d7-7b968687a395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba9e529680804c899de7ed606931c402, user_id=1524ce651e51428da8d4e7266cb2a503, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:18.887153 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279661a6-0079-4457-97d7-7b968687a395 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:18.922581 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2598/5163] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:11:18 2022] PUT /identity/v3/projects/ba9e529680804c899de7ed606931c402/users/1524ce651e51428da8d4e7266cb2a503/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:18.927539 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565efea2-38ec-425a-a4b2-5178a160f62c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:18.927838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565efea2-38ec-425a-a4b2-5178a160f62c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:18.928116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565efea2-38ec-425a-a4b2-5178a160f62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:18.979353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-565efea2-38ec-425a-a4b2-5178a160f62c None None] MFA Rules not processed for user `1524ce651e51428da8d4e7266cb2a503`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:18.980857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-565efea2-38ec-425a-a4b2-5178a160f62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:19.086493 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2566/5164] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:19.099370 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279661a6-0079-4457-97d7-7b968687a395 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:19.105387 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-279661a6-0079-4457-97d7-7b968687a395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:19.208793 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279661a6-0079-4457-97d7-7b968687a395 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:19.215464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52edeb2f-fd6d-47f9-8f18-7e0bae829f5d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10759b2abd4cafacf338551327775e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:19.216285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edeb2f-fd6d-47f9-8f18-7e0bae829f5d service glance] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:19.217111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edeb2f-fd6d-47f9-8f18-7e0bae829f5d service glance] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:19.217388 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edeb2f-fd6d-47f9-8f18-7e0bae829f5d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:19.295450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52edeb2f-fd6d-47f9-8f18-7e0bae829f5d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:19.297136 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52edeb2f-fd6d-47f9-8f18-7e0bae829f5d service glance] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:19.316684 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2599/5165] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:11:19 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:11:19.758999 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565efea2-38ec-425a-a4b2-5178a160f62c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:19.879508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565efea2-38ec-425a-a4b2-5178a160f62c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:19.886206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74eac2-b24b-4c9c-9747-dd281d4716af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:19.887004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74eac2-b24b-4c9c-9747-dd281d4716af admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:19.887281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74eac2-b24b-4c9c-9747-dd281d4716af admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:19.887554 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74eac2-b24b-4c9c-9747-dd281d4716af admin admin] PATH_INFO: `/v3/users/59da5bd8555c4855aafa13e4fb323976` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:19.889419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d74eac2-b24b-4c9c-9747-dd281d4716af admin admin] RBAC: Authorizing `identity:delete_user(user_id=59da5bd8555c4855aafa13e4fb323976)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:19.892654 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d74eac2-b24b-4c9c-9747-dd281d4716af admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:19.903721 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:20.006811 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4d74eac2-b24b-4c9c-9747-dd281d4716af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59da5bd8555c4855aafa13e4fb323976'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:20.008041 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4d74eac2-b24b-4c9c-9747-dd281d4716af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59da5bd8555c4855aafa13e4fb323976'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:20.009044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4d74eac2-b24b-4c9c-9747-dd281d4716af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59da5bd8555c4855aafa13e4fb323976'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:20.024712 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4d74eac2-b24b-4c9c-9747-dd281d4716af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59da5bd8555c4855aafa13e4fb323976'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:20.044859 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4d74eac2-b24b-4c9c-9747-dd281d4716af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59da5bd8555c4855aafa13e4fb323976'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:20.067875 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2567/5166] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:11:19 2022] DELETE /identity/v3/users/59da5bd8555c4855aafa13e4fb323976 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:20.074980 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c493b-70a1-4813-b8b8-161a8d6160d7 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:20.077216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c493b-70a1-4813-b8b8-161a8d6160d7 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:20.077745 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c493b-70a1-4813-b8b8-161a8d6160d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:20.121469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-749c493b-70a1-4813-b8b8-161a8d6160d7 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:20.127239 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-749c493b-70a1-4813-b8b8-161a8d6160d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:20.262388 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2600/5167] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:20.276025 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74eac2-b24b-4c9c-9747-dd281d4716af admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:20.277622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4d74eac2-b24b-4c9c-9747-dd281d4716af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:20.352843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74eac2-b24b-4c9c-9747-dd281d4716af admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:20.357873 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968b12b-ebd6-48c6-966e-0fbffbdf83af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:20.359431 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968b12b-ebd6-48c6-966e-0fbffbdf83af service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:20.359785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968b12b-ebd6-48c6-966e-0fbffbdf83af service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:20.361716 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968b12b-ebd6-48c6-966e-0fbffbdf83af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:20.375123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968b12b-ebd6-48c6-966e-0fbffbdf83af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:20.376782 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968b12b-ebd6-48c6-966e-0fbffbdf83af service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:20.389394 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2568/5168] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:11:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:11:21.016837 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c493b-70a1-4813-b8b8-161a8d6160d7 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:21.042306 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75a0b7-0da3-4f5e-99cb-a873323f2968 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:21.042789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75a0b7-0da3-4f5e-99cb-a873323f2968 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:21.042889 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75a0b7-0da3-4f5e-99cb-a873323f2968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:21.047033 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c493b-70a1-4813-b8b8-161a8d6160d7 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:21.069749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a7d3a-d2b8-48e8-9c33-fec1b30e3aa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:21.070451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a7d3a-d2b8-48e8-9c33-fec1b30e3aa6 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:21.070795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a7d3a-d2b8-48e8-9c33-fec1b30e3aa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:21.071222 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a7d3a-d2b8-48e8-9c33-fec1b30e3aa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:21.073394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f20a7d3a-d2b8-48e8-9c33-fec1b30e3aa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:21.098641 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:21.103254 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-ba75a0b7-0da3-4f5e-99cb-a873323f2968 None None] MFA Rules not processed for user `23f007a900b143c2ab6521003d025035`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:21.110361 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ba75a0b7-0da3-4f5e-99cb-a873323f2968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:21.303912 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2569/5169] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:21.306453 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9243d-73fd-4e9a-b9e4-a230935c1b68 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:21.307079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9243d-73fd-4e9a-b9e4-a230935c1b68 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:21.307204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9243d-73fd-4e9a-b9e4-a230935c1b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:21.351027 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a7d3a-d2b8-48e8-9c33-fec1b30e3aa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:21.356021 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a7d3a-d2b8-48e8-9c33-fec1b30e3aa6 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:21.401888 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a4e9243d-73fd-4e9a-b9e4-a230935c1b68 None None] MFA Rules not processed for user `23f007a900b143c2ab6521003d025035`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:21.404279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a4e9243d-73fd-4e9a-b9e4-a230935c1b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:21.407335 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2601/5170] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:11:21 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:11:21.439786 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2570/5171] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:21.449916 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8ea9c-0ee4-47ea-b044-254594a8ffcb None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:21.450197 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8ea9c-0ee4-47ea-b044-254594a8ffcb None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:21.450475 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8ea9c-0ee4-47ea-b044-254594a8ffcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:21.480710 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-c9c8ea9c-0ee4-47ea-b044-254594a8ffcb None None] MFA Rules not processed for user `23f007a900b143c2ab6521003d025035`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:21.481940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c9c8ea9c-0ee4-47ea-b044-254594a8ffcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:21.492578 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2602/5172] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:21.504695 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9243d-73fd-4e9a-b9e4-a230935c1b68 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:21.506138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a4e9243d-73fd-4e9a-b9e4-a230935c1b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:21.541967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:21.636936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9243d-73fd-4e9a-b9e4-a230935c1b68 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:21.644336 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49a00f-48a3-4334-a495-2905398b2699 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:21.645512 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49a00f-48a3-4334-a495-2905398b2699 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:21.645994 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49a00f-48a3-4334-a495-2905398b2699 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:21.646702 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49a00f-48a3-4334-a495-2905398b2699 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:21.657993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c49a00f-48a3-4334-a495-2905398b2699 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:21.677054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8ea9c-0ee4-47ea-b044-254594a8ffcb None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:21.679757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c9c8ea9c-0ee4-47ea-b044-254594a8ffcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:21.681244 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c49a00f-48a3-4334-a495-2905398b2699 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:21.694748 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2571/5173] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:11:21 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:11:21.706560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8ea9c-0ee4-47ea-b044-254594a8ffcb None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:21.720390 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71488994-8a4b-4fcb-86e6-5337c7f86592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:21.721141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71488994-8a4b-4fcb-86e6-5337c7f86592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:21.721490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71488994-8a4b-4fcb-86e6-5337c7f86592 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:21.721831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71488994-8a4b-4fcb-86e6-5337c7f86592 admin admin] PATH_INFO: `/v3/projects/86396291e4484c85a13bcd0e5ee53e70` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:21.723121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71488994-8a4b-4fcb-86e6-5337c7f86592 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86396291e4484c85a13bcd0e5ee53e70)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:21.728655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71488994-8a4b-4fcb-86e6-5337c7f86592 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:21.887092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-71488994-8a4b-4fcb-86e6-5337c7f86592 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86396291e4484c85a13bcd0e5ee53e70', 'request_id': 'req-71488994-8a4b-4fcb-86e6-5337c7f86592'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:21.898057 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-71488994-8a4b-4fcb-86e6-5337c7f86592 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86396291e4484c85a13bcd0e5ee53e70', 'request_id': 'req-71488994-8a4b-4fcb-86e6-5337c7f86592'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:21.915170 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-71488994-8a4b-4fcb-86e6-5337c7f86592 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86396291e4484c85a13bcd0e5ee53e70', 'request_id': 'req-71488994-8a4b-4fcb-86e6-5337c7f86592'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:21.934894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-71488994-8a4b-4fcb-86e6-5337c7f86592 admin admin] The token cache is being invalidate because project 86396291e4484c85a13bcd0e5ee53e70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:11:21.936879 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-71488994-8a4b-4fcb-86e6-5337c7f86592 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:21.937778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-71488994-8a4b-4fcb-86e6-5337c7f86592 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:21.940119 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2603/5174] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:11:21 2022] DELETE /identity/v3/projects/86396291e4484c85a13bcd0e5ee53e70 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:11:21.945763 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49a00f-48a3-4334-a495-2905398b2699 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:22.006364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49a00f-48a3-4334-a495-2905398b2699 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:22.120211 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd28e9-ab2f-4a1d-a99b-58fc29748c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:22.120898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd28e9-ab2f-4a1d-a99b-58fc29748c0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:22.121115 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd28e9-ab2f-4a1d-a99b-58fc29748c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:22.121370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd28e9-ab2f-4a1d-a99b-58fc29748c0f admin admin] PATH_INFO: `/v3/users/1524ce651e51428da8d4e7266cb2a503` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:22.126696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd28e9-ab2f-4a1d-a99b-58fc29748c0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1524ce651e51428da8d4e7266cb2a503)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:22.126696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd28e9-ab2f-4a1d-a99b-58fc29748c0f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:22.204660 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b3cd28e9-ab2f-4a1d-a99b-58fc29748c0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1524ce651e51428da8d4e7266cb2a503'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:22.205526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b3cd28e9-ab2f-4a1d-a99b-58fc29748c0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1524ce651e51428da8d4e7266cb2a503'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:22.206980 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b3cd28e9-ab2f-4a1d-a99b-58fc29748c0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1524ce651e51428da8d4e7266cb2a503'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:22.222999 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b3cd28e9-ab2f-4a1d-a99b-58fc29748c0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1524ce651e51428da8d4e7266cb2a503'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:22.246867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b3cd28e9-ab2f-4a1d-a99b-58fc29748c0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1524ce651e51428da8d4e7266cb2a503'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:22.269604 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2572/5175] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:11:21 2022] DELETE /identity/v3/users/1524ce651e51428da8d4e7266cb2a503 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:11:22.978235 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71488994-8a4b-4fcb-86e6-5337c7f86592 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:22.978952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-71488994-8a4b-4fcb-86e6-5337c7f86592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:22.992021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd28e9-ab2f-4a1d-a99b-58fc29748c0f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:22.994183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b3cd28e9-ab2f-4a1d-a99b-58fc29748c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:23.014518 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71488994-8a4b-4fcb-86e6-5337c7f86592 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:23.031586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:23.163001 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd28e9-ab2f-4a1d-a99b-58fc29748c0f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:23.168618 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d73bb7-494a-4442-912c-2730839cf822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:23.169377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d73bb7-494a-4442-912c-2730839cf822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:23.170449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d73bb7-494a-4442-912c-2730839cf822 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:23.170821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d73bb7-494a-4442-912c-2730839cf822 admin admin] PATH_INFO: `/v3/projects/ba9e529680804c899de7ed606931c402` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:23.173436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d73bb7-494a-4442-912c-2730839cf822 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba9e529680804c899de7ed606931c402)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:23.176440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d73bb7-494a-4442-912c-2730839cf822 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:23.178736 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49726f62-4e67-430c-9d27-8d723619d47a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:23.179640 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49726f62-4e67-430c-9d27-8d723619d47a service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:23.179895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49726f62-4e67-430c-9d27-8d723619d47a service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:23.180162 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49726f62-4e67-430c-9d27-8d723619d47a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:23.182012 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-49726f62-4e67-430c-9d27-8d723619d47a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:23.228416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49726f62-4e67-430c-9d27-8d723619d47a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:23.230587 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49726f62-4e67-430c-9d27-8d723619d47a service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:23.254827 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2573/5176] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:11:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:11:23.255702 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49726f62-4e67-430c-9d27-8d723619d47a service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:23.258534 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-49726f62-4e67-430c-9d27-8d723619d47a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:23.266997 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:23.293092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49726f62-4e67-430c-9d27-8d723619d47a service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:23.299335 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e4d73bb7-494a-4442-912c-2730839cf822 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba9e529680804c899de7ed606931c402', 'request_id': 'req-e4d73bb7-494a-4442-912c-2730839cf822'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:23.312938 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e4d73bb7-494a-4442-912c-2730839cf822 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba9e529680804c899de7ed606931c402', 'request_id': 'req-e4d73bb7-494a-4442-912c-2730839cf822'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:23.330978 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e4d73bb7-494a-4442-912c-2730839cf822 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba9e529680804c899de7ed606931c402', 'request_id': 'req-e4d73bb7-494a-4442-912c-2730839cf822'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:23.364279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e4d73bb7-494a-4442-912c-2730839cf822 admin admin] The token cache is being invalidate because project ba9e529680804c899de7ed606931c402 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:11:23.364577 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e4d73bb7-494a-4442-912c-2730839cf822 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:23.365342 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e4d73bb7-494a-4442-912c-2730839cf822 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:23.369161 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2604/5177] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:11:22 2022] DELETE /identity/v3/projects/ba9e529680804c899de7ed606931c402 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:23.376974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8ba06-e701-4715-bfc7-74c86eb430dd None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:23.377288 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8ba06-e701-4715-bfc7-74c86eb430dd None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:23.377482 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8ba06-e701-4715-bfc7-74c86eb430dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:23.414695 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321518b-d986-4b82-9603-d39a618d401f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:23.415569 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321518b-d986-4b82-9603-d39a618d401f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:23.416438 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321518b-d986-4b82-9603-d39a618d401f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:23.416892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321518b-d986-4b82-9603-d39a618d401f admin admin] PATH_INFO: `/v3/users/17004e771b6a47cb88e8aa31e197b25a` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:23.418473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c321518b-d986-4b82-9603-d39a618d401f admin admin] RBAC: Authorizing `identity:delete_user(user_id=17004e771b6a47cb88e8aa31e197b25a)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:23.434302 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c321518b-d986-4b82-9603-d39a618d401f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:23.437486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-10c8ba06-e701-4715-bfc7-74c86eb430dd None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:23.438768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-10c8ba06-e701-4715-bfc7-74c86eb430dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:23.472683 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2605/5178] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:23.474351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678981ed-7f8e-405c-acca-6b27e4f0d4bf None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:23.474676 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678981ed-7f8e-405c-acca-6b27e4f0d4bf None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:23.474955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678981ed-7f8e-405c-acca-6b27e4f0d4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:23.522523 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-678981ed-7f8e-405c-acca-6b27e4f0d4bf None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:23.523781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-678981ed-7f8e-405c-acca-6b27e4f0d4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:23.550663 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2606/5179] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:23.551821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678981ed-7f8e-405c-acca-6b27e4f0d4bf None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:23.586126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678981ed-7f8e-405c-acca-6b27e4f0d4bf None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:23.597078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c321518b-d986-4b82-9603-d39a618d401f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17004e771b6a47cb88e8aa31e197b25a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:23.600838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c321518b-d986-4b82-9603-d39a618d401f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17004e771b6a47cb88e8aa31e197b25a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:23.602148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c321518b-d986-4b82-9603-d39a618d401f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17004e771b6a47cb88e8aa31e197b25a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:23.605723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dce8fb-c3ff-481c-9b6c-c83c12972934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:23.608962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dce8fb-c3ff-481c-9b6c-c83c12972934 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:23.610591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dce8fb-c3ff-481c-9b6c-c83c12972934 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:23.610915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dce8fb-c3ff-481c-9b6c-c83c12972934 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:23.613005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dce8fb-c3ff-481c-9b6c-c83c12972934 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:11:23.614215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dce8fb-c3ff-481c-9b6c-c83c12972934 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:23.618477 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dce8fb-c3ff-481c-9b6c-c83c12972934 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:23.629098 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c321518b-d986-4b82-9603-d39a618d401f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17004e771b6a47cb88e8aa31e197b25a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:23.691007 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2607/5180] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:11:23.691902 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dce8fb-c3ff-481c-9b6c-c83c12972934 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:23.692484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c321518b-d986-4b82-9603-d39a618d401f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17004e771b6a47cb88e8aa31e197b25a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:23.697383 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-47dce8fb-c3ff-481c-9b6c-c83c12972934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:23.723334 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2574/5181] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:11:23 2022] DELETE /identity/v3/users/17004e771b6a47cb88e8aa31e197b25a => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:23.728013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dce8fb-c3ff-481c-9b6c-c83c12972934 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:23.814829 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f716b-ea39-420f-88b0-d5e6c4c80f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:23.815402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f716b-ea39-420f-88b0-d5e6c4c80f4b admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:23.815679 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f716b-ea39-420f-88b0-d5e6c4c80f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:23.819653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f716b-ea39-420f-88b0-d5e6c4c80f4b admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:23.819653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f716b-ea39-420f-88b0-d5e6c4c80f4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:23.821662 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f716b-ea39-420f-88b0-d5e6c4c80f4b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:23.890017 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2608/5182] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:11:23 2022] POST /identity/v3/projects => generated 361 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:23.894126 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321518b-d986-4b82-9603-d39a618d401f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:23.909020 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321518b-d986-4b82-9603-d39a618d401f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:23.969052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:24.085116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b3c7e-4a82-4d3e-8f68-7941129ee45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:24.086364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b3c7e-4a82-4d3e-8f68-7941129ee45d admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:24.086985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b3c7e-4a82-4d3e-8f68-7941129ee45d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:24.087688 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b3c7e-4a82-4d3e-8f68-7941129ee45d admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:24.091072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b3c7e-4a82-4d3e-8f68-7941129ee45d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:24.094193 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b3c7e-4a82-4d3e-8f68-7941129ee45d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:24.139169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53c0a1-bb29-488a-bb79-a57b99791428 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:24.139557 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53c0a1-bb29-488a-bb79-a57b99791428 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:24.139819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53c0a1-bb29-488a-bb79-a57b99791428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:24.224742 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2575/5183] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:11:23 2022] POST /identity/v3/users => generated 281 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:24.227702 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b3c7e-4a82-4d3e-8f68-7941129ee45d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:24.251529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-cc53c0a1-bb29-488a-bb79-a57b99791428 None None] MFA Rules not processed for user `23f007a900b143c2ab6521003d025035`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:24.253178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-cc53c0a1-bb29-488a-bb79-a57b99791428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:24.269165 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b3c7e-4a82-4d3e-8f68-7941129ee45d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:24.308207 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66f290-d03e-4f1a-b1ed-6d667b819c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:24.312846 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66f290-d03e-4f1a-b1ed-6d667b819c8d admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:24.313128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66f290-d03e-4f1a-b1ed-6d667b819c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:24.313407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66f290-d03e-4f1a-b1ed-6d667b819c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:24.314080 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66f290-d03e-4f1a-b1ed-6d667b819c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:24.322351 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66f290-d03e-4f1a-b1ed-6d667b819c8d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:24.354741 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2576/5184] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:24.358430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66f290-d03e-4f1a-b1ed-6d667b819c8d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:24.396787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66f290-d03e-4f1a-b1ed-6d667b819c8d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:24.416125 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409236c9-15be-4755-ab5a-b40c1118690e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:24.416764 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409236c9-15be-4755-ab5a-b40c1118690e admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:24.417048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409236c9-15be-4755-ab5a-b40c1118690e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:24.417324 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409236c9-15be-4755-ab5a-b40c1118690e admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:24.417976 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409236c9-15be-4755-ab5a-b40c1118690e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:24.419881 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409236c9-15be-4755-ab5a-b40c1118690e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:24.450247 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2609/5185] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:11:24.468221 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53c0a1-bb29-488a-bb79-a57b99791428 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:24.474295 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2577/5186] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:24.522121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53c0a1-bb29-488a-bb79-a57b99791428 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:24.570975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5380732-277a-44fd-9e45-e03aa093eeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:24.576241 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5380732-277a-44fd-9e45-e03aa093eeaf admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:24.577135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5380732-277a-44fd-9e45-e03aa093eeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:24.578529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5380732-277a-44fd-9e45-e03aa093eeaf admin admin] PATH_INFO: `/v3/projects/9297ca77ffab490b96114a5a4d6f6ca3/users/d27091bca57f4ec4af52054e894d463c/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:24.634577 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5380732-277a-44fd-9e45-e03aa093eeaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9297ca77ffab490b96114a5a4d6f6ca3, user_id=d27091bca57f4ec4af52054e894d463c, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:24.651349 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5380732-277a-44fd-9e45-e03aa093eeaf admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:24.713146 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:24.735764 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2610/5187] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:11:24 2022] PUT /identity/v3/projects/9297ca77ffab490b96114a5a4d6f6ca3/users/d27091bca57f4ec4af52054e894d463c/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:24.737225 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af4507-cf31-4527-80f0-56759027f901 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:24.737830 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af4507-cf31-4527-80f0-56759027f901 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:24.738481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af4507-cf31-4527-80f0-56759027f901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:24.803866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-b3af4507-cf31-4527-80f0-56759027f901 None None] MFA Rules not processed for user `d27091bca57f4ec4af52054e894d463c`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:24.805460 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b3af4507-cf31-4527-80f0-56759027f901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:24.963907 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2578/5188] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:24.975200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5380732-277a-44fd-9e45-e03aa093eeaf admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:25.163134 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5380732-277a-44fd-9e45-e03aa093eeaf admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:25.169392 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d297e-d5c7-4a14-9be8-3d806fec9c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:25.175446 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d297e-d5c7-4a14-9be8-3d806fec9c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:25.175722 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d297e-d5c7-4a14-9be8-3d806fec9c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:25.176197 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d297e-d5c7-4a14-9be8-3d806fec9c44 admin admin] PATH_INFO: `/v3/users/d27091bca57f4ec4af52054e894d463c` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:25.178416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d297e-d5c7-4a14-9be8-3d806fec9c44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d27091bca57f4ec4af52054e894d463c)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:25.180891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d297e-d5c7-4a14-9be8-3d806fec9c44 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:25.250536 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c05d297e-d5c7-4a14-9be8-3d806fec9c44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd27091bca57f4ec4af52054e894d463c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:25.261375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c05d297e-d5c7-4a14-9be8-3d806fec9c44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd27091bca57f4ec4af52054e894d463c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:25.262733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c05d297e-d5c7-4a14-9be8-3d806fec9c44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd27091bca57f4ec4af52054e894d463c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:25.264604 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c05d297e-d5c7-4a14-9be8-3d806fec9c44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd27091bca57f4ec4af52054e894d463c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:25.282665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c05d297e-d5c7-4a14-9be8-3d806fec9c44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd27091bca57f4ec4af52054e894d463c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:25.308607 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2611/5189] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:11:24 2022] DELETE /identity/v3/users/d27091bca57f4ec4af52054e894d463c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:25.313970 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae10e2-d3a2-465d-91d1-b980c043facc None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:25.314522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae10e2-d3a2-465d-91d1-b980c043facc None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:25.314844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae10e2-d3a2-465d-91d1-b980c043facc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:25.358294 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d297e-d5c7-4a14-9be8-3d806fec9c44 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:25.362108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c05d297e-d5c7-4a14-9be8-3d806fec9c44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:25.396690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-26ae10e2-d3a2-465d-91d1-b980c043facc None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:25.401625 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-26ae10e2-d3a2-465d-91d1-b980c043facc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:25.579919 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d297e-d5c7-4a14-9be8-3d806fec9c44 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:25.584792 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2579/5190] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:25.596292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0facd49b-92e1-4a3b-92f7-c5a595c02c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:25.597103 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facd49b-92e1-4a3b-92f7-c5a595c02c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:25.598705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facd49b-92e1-4a3b-92f7-c5a595c02c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:25.599257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facd49b-92e1-4a3b-92f7-c5a595c02c16 admin admin] PATH_INFO: `/v3/projects/734f4706c86040eba82cde45971d4c5b` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:25.601665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0facd49b-92e1-4a3b-92f7-c5a595c02c16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=734f4706c86040eba82cde45971d4c5b)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:25.609057 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0facd49b-92e1-4a3b-92f7-c5a595c02c16 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:25.658730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae10e2-d3a2-465d-91d1-b980c043facc None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:25.663344 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-26ae10e2-d3a2-465d-91d1-b980c043facc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:25.687478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:25.728628 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:25.743832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0facd49b-92e1-4a3b-92f7-c5a595c02c16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '734f4706c86040eba82cde45971d4c5b', 'request_id': 'req-0facd49b-92e1-4a3b-92f7-c5a595c02c16'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:25.753286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0facd49b-92e1-4a3b-92f7-c5a595c02c16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '734f4706c86040eba82cde45971d4c5b', 'request_id': 'req-0facd49b-92e1-4a3b-92f7-c5a595c02c16'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:25.767451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0facd49b-92e1-4a3b-92f7-c5a595c02c16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '734f4706c86040eba82cde45971d4c5b', 'request_id': 'req-0facd49b-92e1-4a3b-92f7-c5a595c02c16'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:25.787996 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0facd49b-92e1-4a3b-92f7-c5a595c02c16 admin admin] The token cache is being invalidate because project 734f4706c86040eba82cde45971d4c5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:11:25.788666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0facd49b-92e1-4a3b-92f7-c5a595c02c16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:25.789554 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0facd49b-92e1-4a3b-92f7-c5a595c02c16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:25.798482 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2612/5191] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:11:25 2022] DELETE /identity/v3/projects/734f4706c86040eba82cde45971d4c5b => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:25.802107 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74299e51-dabe-4c00-836c-d32cd15da526 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:25.803705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74299e51-dabe-4c00-836c-d32cd15da526 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:25.804517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74299e51-dabe-4c00-836c-d32cd15da526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:25.812902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae10e2-d3a2-465d-91d1-b980c043facc None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:25.835813 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-74299e51-dabe-4c00-836c-d32cd15da526 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:25.837433 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-74299e51-dabe-4c00-836c-d32cd15da526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:25.991181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d1b6a-1118-42eb-ab04-5ec27586bb50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:25.992215 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d1b6a-1118-42eb-ab04-5ec27586bb50 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:25.992813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d1b6a-1118-42eb-ab04-5ec27586bb50 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:25.993234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d1b6a-1118-42eb-ab04-5ec27586bb50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:25.998100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4d6d1b6a-1118-42eb-ab04-5ec27586bb50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:26.036439 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2613/5192] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:26.041469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f04480-6c3c-4c40-a07d-01a5764f11d2 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:26.042798 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f04480-6c3c-4c40-a07d-01a5764f11d2 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:26.044485 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f04480-6c3c-4c40-a07d-01a5764f11d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:26.072367 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d1b6a-1118-42eb-ab04-5ec27586bb50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:26.073945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d1b6a-1118-42eb-ab04-5ec27586bb50 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:26.084069 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-c6f04480-6c3c-4c40-a07d-01a5764f11d2 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:26.085633 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c6f04480-6c3c-4c40-a07d-01a5764f11d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:26.113431 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2580/5193] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:11:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:11:26.123105 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d1b6a-1118-42eb-ab04-5ec27586bb50 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:26.123296 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2614/5194] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:26.146622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d1b6a-1118-42eb-ab04-5ec27586bb50 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:26.158141 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2cb32-7e54-4814-bee2-6a9e36547ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:26.158922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2cb32-7e54-4814-bee2-6a9e36547ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:26.159281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2cb32-7e54-4814-bee2-6a9e36547ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:26.161708 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2cb32-7e54-4814-bee2-6a9e36547ee7 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:26.162940 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d2cb32-7e54-4814-bee2-6a9e36547ee7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:11:26.162940 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d2cb32-7e54-4814-bee2-6a9e36547ee7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:26.164645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d2cb32-7e54-4814-bee2-6a9e36547ee7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:26.184734 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2581/5195] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:11:26.189128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f04480-6c3c-4c40-a07d-01a5764f11d2 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:26.201667 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f04480-6c3c-4c40-a07d-01a5764f11d2 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:26.229414 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a82fb7-1176-4e5b-994b-9990e9b147a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:26.230059 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a82fb7-1176-4e5b-994b-9990e9b147a3 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:26.230348 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a82fb7-1176-4e5b-994b-9990e9b147a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:26.231835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a82fb7-1176-4e5b-994b-9990e9b147a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:26.232997 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a82fb7-1176-4e5b-994b-9990e9b147a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:26.235303 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a82fb7-1176-4e5b-994b-9990e9b147a3 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:26.382400 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2615/5196] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:11:26 2022] POST /identity/v3/projects => generated 397 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:26.383708 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2cb32-7e54-4814-bee2-6a9e36547ee7 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:26.403437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2cb32-7e54-4814-bee2-6a9e36547ee7 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:26.554778 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0196b-a228-463f-b355-dcd6ab007759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:26.555273 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0196b-a228-463f-b355-dcd6ab007759 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:26.555766 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0196b-a228-463f-b355-dcd6ab007759 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:26.556219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0196b-a228-463f-b355-dcd6ab007759 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:26.560153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0196b-a228-463f-b355-dcd6ab007759 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:26.562375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0196b-a228-463f-b355-dcd6ab007759 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:26.619834 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2582/5197] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:11:26 2022] POST /identity/v3/users => generated 299 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:11:26.621231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a82fb7-1176-4e5b-994b-9990e9b147a3 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:26.645456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a82fb7-1176-4e5b-994b-9990e9b147a3 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:26.650831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1af6fa-7a40-4521-ad25-d446f410e669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:26.651795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1af6fa-7a40-4521-ad25-d446f410e669 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:26.652288 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1af6fa-7a40-4521-ad25-d446f410e669 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:26.652765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1af6fa-7a40-4521-ad25-d446f410e669 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:26.654163 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1af6fa-7a40-4521-ad25-d446f410e669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:26.656326 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1af6fa-7a40-4521-ad25-d446f410e669 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:26.667686 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2616/5198] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:26.677748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0196b-a228-463f-b355-dcd6ab007759 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:26.700899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0196b-a228-463f-b355-dcd6ab007759 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:26.712850 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d9483-a574-49c6-9dd6-dd38669a58d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:26.713546 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d9483-a574-49c6-9dd6-dd38669a58d5 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:26.713884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d9483-a574-49c6-9dd6-dd38669a58d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:26.714226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d9483-a574-49c6-9dd6-dd38669a58d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:26.715114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d9483-a574-49c6-9dd6-dd38669a58d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:26.717203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d9483-a574-49c6-9dd6-dd38669a58d5 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:26.745295 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2583/5199] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:26.746819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1af6fa-7a40-4521-ad25-d446f410e669 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:26.762699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1af6fa-7a40-4521-ad25-d446f410e669 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:26.778384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f406b9-62f8-4199-a504-d218066c0303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:26.778384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f406b9-62f8-4199-a504-d218066c0303 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:26.779905 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f406b9-62f8-4199-a504-d218066c0303 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:26.781012 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f406b9-62f8-4199-a504-d218066c0303 admin admin] PATH_INFO: `/v3/projects/97a16c231f804b41bfd49fe5f4d96605/users/c1c8ba4023a444a4baa633b5c599213e/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:26.836231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f406b9-62f8-4199-a504-d218066c0303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97a16c231f804b41bfd49fe5f4d96605, user_id=c1c8ba4023a444a4baa633b5c599213e, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:26.840430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f406b9-62f8-4199-a504-d218066c0303 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:26.859538 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2617/5200] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:11:26 2022] PUT /identity/v3/projects/97a16c231f804b41bfd49fe5f4d96605/users/c1c8ba4023a444a4baa633b5c599213e/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:26.864710 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73cc94-ac9d-4559-84c5-38cbcd568907 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:26.865014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73cc94-ac9d-4559-84c5-38cbcd568907 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:26.865945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73cc94-ac9d-4559-84c5-38cbcd568907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:26.892120 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-2c73cc94-ac9d-4559-84c5-38cbcd568907 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:26.895560 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2c73cc94-ac9d-4559-84c5-38cbcd568907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:26.975958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:27.022425 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2584/5201] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:27.048238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f406b9-62f8-4199-a504-d218066c0303 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:27.050242 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c4f406b9-62f8-4199-a504-d218066c0303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:27.073100 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:27.178788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f406b9-62f8-4199-a504-d218066c0303 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:27.189529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127bddf5-c45a-4229-ad9d-ee2a596fed5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:27.190504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bddf5-c45a-4229-ad9d-ee2a596fed5c service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:27.190707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bddf5-c45a-4229-ad9d-ee2a596fed5c service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:27.191023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bddf5-c45a-4229-ad9d-ee2a596fed5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:27.205344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127bddf5-c45a-4229-ad9d-ee2a596fed5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:27.206417 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127bddf5-c45a-4229-ad9d-ee2a596fed5c service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:27.220341 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2618/5202] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:11:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:11:27.388977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0a18c-6b31-4a90-9935-c871fa531b1e None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:27.389869 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0a18c-6b31-4a90-9935-c871fa531b1e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:27.390370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0a18c-6b31-4a90-9935-c871fa531b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:27.441294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-fec0a18c-6b31-4a90-9935-c871fa531b1e None None] MFA Rules not processed for user `23f007a900b143c2ab6521003d025035`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:27.443068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-fec0a18c-6b31-4a90-9935-c871fa531b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:27.594320 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2585/5203] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:27.704044 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127bddf5-c45a-4229-ad9d-ee2a596fed5c service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:27.705701 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-127bddf5-c45a-4229-ad9d-ee2a596fed5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:27.743471 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127bddf5-c45a-4229-ad9d-ee2a596fed5c service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:27.759123 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdb240-48b7-4d94-af6e-ff479090c7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:27.760532 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdb240-48b7-4d94-af6e-ff479090c7a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:27.760794 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdb240-48b7-4d94-af6e-ff479090c7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:27.761064 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdb240-48b7-4d94-af6e-ff479090c7a1 admin admin] PATH_INFO: `/v3/projects/9297ca77ffab490b96114a5a4d6f6ca3` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:27.762219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbdb240-48b7-4d94-af6e-ff479090c7a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9297ca77ffab490b96114a5a4d6f6ca3)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:27.787419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbdb240-48b7-4d94-af6e-ff479090c7a1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:27.921974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bdbdb240-48b7-4d94-af6e-ff479090c7a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9297ca77ffab490b96114a5a4d6f6ca3', 'request_id': 'req-bdbdb240-48b7-4d94-af6e-ff479090c7a1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:27.936174 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bdbdb240-48b7-4d94-af6e-ff479090c7a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9297ca77ffab490b96114a5a4d6f6ca3', 'request_id': 'req-bdbdb240-48b7-4d94-af6e-ff479090c7a1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:27.953048 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bdbdb240-48b7-4d94-af6e-ff479090c7a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9297ca77ffab490b96114a5a4d6f6ca3', 'request_id': 'req-bdbdb240-48b7-4d94-af6e-ff479090c7a1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:28.006757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bdbdb240-48b7-4d94-af6e-ff479090c7a1 admin admin] The token cache is being invalidate because project 9297ca77ffab490b96114a5a4d6f6ca3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:11:28.007052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bdbdb240-48b7-4d94-af6e-ff479090c7a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:28.013781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bdbdb240-48b7-4d94-af6e-ff479090c7a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:28.022765 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327b140-56c4-443b-810b-268ade35f8ee None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:28.023260 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327b140-56c4-443b-810b-268ade35f8ee None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:28.023687 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327b140-56c4-443b-810b-268ade35f8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:28.034223 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2619/5204] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:11:27 2022] DELETE /identity/v3/projects/9297ca77ffab490b96114a5a4d6f6ca3 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:28.038994 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ac396-a48f-4f4e-a290-cbc12d72abf0 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:28.039281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ac396-a48f-4f4e-a290-cbc12d72abf0 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:28.040585 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ac396-a48f-4f4e-a290-cbc12d72abf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:28.089079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-5327b140-56c4-443b-810b-268ade35f8ee None None] MFA Rules not processed for user `2d050e7deab24698b6cb13d7a885606e`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:28.093398 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5327b140-56c4-443b-810b-268ade35f8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:28.132405 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-5f9ac396-a48f-4f4e-a290-cbc12d72abf0 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:28.133647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5f9ac396-a48f-4f4e-a290-cbc12d72abf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:28.222640 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2586/5205] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:11:28.232374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474c1eb-e49a-4aa0-aa18-b7da08d8152a None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:28.232726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474c1eb-e49a-4aa0-aa18-b7da08d8152a None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:28.233050 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474c1eb-e49a-4aa0-aa18-b7da08d8152a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:28.286498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-0474c1eb-e49a-4aa0-aa18-b7da08d8152a None None] MFA Rules not processed for user `2d050e7deab24698b6cb13d7a885606e`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:28.289792 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0474c1eb-e49a-4aa0-aa18-b7da08d8152a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:28.299314 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2620/5206] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:28.301960 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8f7c4-df2b-4084-aaf3-622e110180f8 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:28.302281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8f7c4-df2b-4084-aaf3-622e110180f8 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:28.302572 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8f7c4-df2b-4084-aaf3-622e110180f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:28.313414 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2587/5207] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:28.331655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-62e8f7c4-df2b-4084-aaf3-622e110180f8 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:28.333217 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-62e8f7c4-df2b-4084-aaf3-622e110180f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:28.343547 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2621/5208] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:11:28.347442 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474c1eb-e49a-4aa0-aa18-b7da08d8152a None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:28.365758 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474c1eb-e49a-4aa0-aa18-b7da08d8152a None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:28.379336 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c22198-c5b0-4f38-8354-373a520137ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:28.379976 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c22198-c5b0-4f38-8354-373a520137ed admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:28.380345 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c22198-c5b0-4f38-8354-373a520137ed admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:28.380611 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c22198-c5b0-4f38-8354-373a520137ed admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:28.381280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c22198-c5b0-4f38-8354-373a520137ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:11:28.382075 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c22198-c5b0-4f38-8354-373a520137ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:28.383777 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c22198-c5b0-4f38-8354-373a520137ed admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:28.433243 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2588/5209] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:11:28.438288 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8f7c4-df2b-4084-aaf3-622e110180f8 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:28.458502 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8f7c4-df2b-4084-aaf3-622e110180f8 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:28.466229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bec099-fc03-4c0b-9b61-c8eaed74889b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:28.467279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bec099-fc03-4c0b-9b61-c8eaed74889b admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:28.467871 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bec099-fc03-4c0b-9b61-c8eaed74889b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:28.468294 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bec099-fc03-4c0b-9b61-c8eaed74889b admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:28.469578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bec099-fc03-4c0b-9b61-c8eaed74889b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:28.488754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bec099-fc03-4c0b-9b61-c8eaed74889b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:28.579613 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c22198-c5b0-4f38-8354-373a520137ed admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:28.582739 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2622/5210] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:11:28 2022] POST /identity/v3/projects => generated 409 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:28.598860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c22198-c5b0-4f38-8354-373a520137ed admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:28.783586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:28.793496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084cc3b-029b-49e4-be0b-2137fca0e379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:28.794713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084cc3b-029b-49e4-be0b-2137fca0e379 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:28.795149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084cc3b-029b-49e4-be0b-2137fca0e379 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:28.795802 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084cc3b-029b-49e4-be0b-2137fca0e379 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:28.796772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084cc3b-029b-49e4-be0b-2137fca0e379 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:28.799166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084cc3b-029b-49e4-be0b-2137fca0e379 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:28.855254 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2589/5211] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:11:28 2022] POST /identity/v3/users => generated 305 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:28.856832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bec099-fc03-4c0b-9b61-c8eaed74889b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:28.865138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:28.876835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bec099-fc03-4c0b-9b61-c8eaed74889b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:28.886051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3647fbd-d9e3-4cc5-b841-e413703d05d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:28.889132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3647fbd-d9e3-4cc5-b841-e413703d05d7 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:28.889917 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3647fbd-d9e3-4cc5-b841-e413703d05d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:28.890627 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3647fbd-d9e3-4cc5-b841-e413703d05d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:28.891510 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3647fbd-d9e3-4cc5-b841-e413703d05d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:28.893544 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3647fbd-d9e3-4cc5-b841-e413703d05d7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:28.911850 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2623/5212] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:28.915803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084cc3b-029b-49e4-be0b-2137fca0e379 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:28.932111 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084cc3b-029b-49e4-be0b-2137fca0e379 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:28.938628 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f32f51-f568-4c14-b0e0-e40132b6ceae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:28.939420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f32f51-f568-4c14-b0e0-e40132b6ceae admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:28.939727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f32f51-f568-4c14-b0e0-e40132b6ceae admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:28.940058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f32f51-f568-4c14-b0e0-e40132b6ceae admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:28.940767 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f32f51-f568-4c14-b0e0-e40132b6ceae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:28.943152 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f32f51-f568-4c14-b0e0-e40132b6ceae admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:28.964499 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2590/5213] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:28.968636 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3647fbd-d9e3-4cc5-b841-e413703d05d7 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:28.986687 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3647fbd-d9e3-4cc5-b841-e413703d05d7 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:29.005578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2bd59-b5c8-4f64-a60b-70d1d57d66b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:29.006330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2bd59-b5c8-4f64-a60b-70d1d57d66b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:29.006689 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2bd59-b5c8-4f64-a60b-70d1d57d66b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:29.006911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2bd59-b5c8-4f64-a60b-70d1d57d66b0 admin admin] PATH_INFO: `/v3/projects/8999a799cb204cd58e247b4d3707bda1/users/fe66519e36a74b13ba70d0ac182e10da/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:29.067995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db2bd59-b5c8-4f64-a60b-70d1d57d66b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8999a799cb204cd58e247b4d3707bda1, user_id=fe66519e36a74b13ba70d0ac182e10da, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:29.074157 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db2bd59-b5c8-4f64-a60b-70d1d57d66b0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:29.081745 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f32f51-f568-4c14-b0e0-e40132b6ceae admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:29.083768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-16f32f51-f568-4c14-b0e0-e40132b6ceae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:29.111747 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2624/5214] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:11:28 2022] PUT /identity/v3/projects/8999a799cb204cd58e247b4d3707bda1/users/fe66519e36a74b13ba70d0ac182e10da/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:29.121899 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59347ac8-7e49-47cd-8fc5-a84c8e2f4cba None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:29.123182 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59347ac8-7e49-47cd-8fc5-a84c8e2f4cba None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:29.123993 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59347ac8-7e49-47cd-8fc5-a84c8e2f4cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:29.197379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-59347ac8-7e49-47cd-8fc5-a84c8e2f4cba None None] MFA Rules not processed for user `fe66519e36a74b13ba70d0ac182e10da`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:29.199382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-59347ac8-7e49-47cd-8fc5-a84c8e2f4cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:29.377734 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f32f51-f568-4c14-b0e0-e40132b6ceae admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:29.459074 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2625/5215] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:29 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:11:29.461536 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59347ac8-7e49-47cd-8fc5-a84c8e2f4cba None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:29.467638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-59347ac8-7e49-47cd-8fc5-a84c8e2f4cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:29.556929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b3b856-0e29-4373-8d63-a73fc10a250e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:29.559630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3b856-0e29-4373-8d63-a73fc10a250e service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:29.560098 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3b856-0e29-4373-8d63-a73fc10a250e service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:29.560633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3b856-0e29-4373-8d63-a73fc10a250e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:29.657514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59347ac8-7e49-47cd-8fc5-a84c8e2f4cba None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:29.667109 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c92104-adaa-4b12-9bab-b460e850c3ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:29.668427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c92104-adaa-4b12-9bab-b460e850c3ee service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:29.668893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c92104-adaa-4b12-9bab-b460e850c3ee service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:29.669279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c92104-adaa-4b12-9bab-b460e850c3ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:29.682525 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-10c92104-adaa-4b12-9bab-b460e850c3ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:29.717770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c92104-adaa-4b12-9bab-b460e850c3ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:29.727322 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c92104-adaa-4b12-9bab-b460e850c3ee service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:29.733486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:29.750221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b3b856-0e29-4373-8d63-a73fc10a250e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:29.752853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b3b856-0e29-4373-8d63-a73fc10a250e service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:29.755623 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2626/5216] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:11:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:11:29.758447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c92104-adaa-4b12-9bab-b460e850c3ee service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:29.775246 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2591/5217] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:11:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 694 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:11:29.900922 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c92104-adaa-4b12-9bab-b460e850c3ee service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:29.907937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354484f1-6d84-494e-ac29-19750c22177b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:29.908684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354484f1-6d84-494e-ac29-19750c22177b admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:29.909023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354484f1-6d84-494e-ac29-19750c22177b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:29.909725 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354484f1-6d84-494e-ac29-19750c22177b admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:29.920459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354484f1-6d84-494e-ac29-19750c22177b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:29.926963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354484f1-6d84-494e-ac29-19750c22177b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:29.944319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:30.003013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b3b856-0e29-4373-8d63-a73fc10a250e service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:30.009764 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2627/5218] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:11:29 2022] POST /identity/v3/projects => generated 411 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:30.016994 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b3b856-0e29-4373-8d63-a73fc10a250e service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:30.108152 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88363c-13ef-4bad-b26b-7b48ef9ad9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:30.108823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88363c-13ef-4bad-b26b-7b48ef9ad9a3 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:30.109126 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88363c-13ef-4bad-b26b-7b48ef9ad9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:30.109371 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88363c-13ef-4bad-b26b-7b48ef9ad9a3 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:30.110202 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88363c-13ef-4bad-b26b-7b48ef9ad9a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:30.112263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88363c-13ef-4bad-b26b-7b48ef9ad9a3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:30.162999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354484f1-6d84-494e-ac29-19750c22177b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:30.175593 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2592/5219] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:11:30 2022] POST /identity/v3/users => generated 312 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:30.178672 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354484f1-6d84-494e-ac29-19750c22177b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:30.193233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e10e3a-640f-4ec1-b66b-981c30633ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:30.193854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e10e3a-640f-4ec1-b66b-981c30633ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:30.194184 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e10e3a-640f-4ec1-b66b-981c30633ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:30.194469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e10e3a-640f-4ec1-b66b-981c30633ee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:30.195297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e10e3a-640f-4ec1-b66b-981c30633ee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:30.197058 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e10e3a-640f-4ec1-b66b-981c30633ee3 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:30.220021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88363c-13ef-4bad-b26b-7b48ef9ad9a3 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:30.220473 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2628/5220] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:30.237801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88363c-13ef-4bad-b26b-7b48ef9ad9a3 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:30.250393 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3509a-3f2f-4aec-9248-c0e392529d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:30.251174 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3509a-3f2f-4aec-9248-c0e392529d77 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:30.251503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3509a-3f2f-4aec-9248-c0e392529d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:30.251785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3509a-3f2f-4aec-9248-c0e392529d77 admin admin] PATH_INFO: `/v3/projects/3bda826face7492db867e9098c471dfc/users/289b7717513a4f01a96dac17f8727e37/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:30.276914 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3509a-3f2f-4aec-9248-c0e392529d77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bda826face7492db867e9098c471dfc, user_id=289b7717513a4f01a96dac17f8727e37, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:30.280319 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3509a-3f2f-4aec-9248-c0e392529d77 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:30.307436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e10e3a-640f-4ec1-b66b-981c30633ee3 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:30.307998 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2593/5221] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:11:30 2022] PUT /identity/v3/projects/3bda826face7492db867e9098c471dfc/users/289b7717513a4f01a96dac17f8727e37/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:30.322925 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e10e3a-640f-4ec1-b66b-981c30633ee3 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:30.446863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953f774-5809-4537-af9d-d7b16040083f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:30.447872 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953f774-5809-4537-af9d-d7b16040083f admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:30.448298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953f774-5809-4537-af9d-d7b16040083f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:30.448844 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953f774-5809-4537-af9d-d7b16040083f admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:30.449722 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f953f774-5809-4537-af9d-d7b16040083f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:30.454309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f953f774-5809-4537-af9d-d7b16040083f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:30.477609 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3509a-3f2f-4aec-9248-c0e392529d77 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:30.492132 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2629/5222] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:30.493831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3509a-3f2f-4aec-9248-c0e392529d77 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:30.500814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d142d6-abb5-46c4-bc25-04c097e590c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:30.502505 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d142d6-abb5-46c4-bc25-04c097e590c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:30.503272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d142d6-abb5-46c4-bc25-04c097e590c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:30.504685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d142d6-abb5-46c4-bc25-04c097e590c3 admin admin] PATH_INFO: `/v3/projects/3bda826face7492db867e9098c471dfc/users/289b7717513a4f01a96dac17f8727e37/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:30.522962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d142d6-abb5-46c4-bc25-04c097e590c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bda826face7492db867e9098c471dfc, user_id=289b7717513a4f01a96dac17f8727e37, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:30.526422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d142d6-abb5-46c4-bc25-04c097e590c3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:30.540545 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2594/5223] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:11:30 2022] PUT /identity/v3/projects/3bda826face7492db867e9098c471dfc/users/289b7717513a4f01a96dac17f8727e37/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:30.552576 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07aafa4-35d5-41bd-852a-d5722dd2bfa5 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:30.553354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07aafa4-35d5-41bd-852a-d5722dd2bfa5 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:30.553812 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07aafa4-35d5-41bd-852a-d5722dd2bfa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:30.585182 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a07aafa4-35d5-41bd-852a-d5722dd2bfa5 None None] MFA Rules not processed for user `289b7717513a4f01a96dac17f8727e37`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:30.586408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a07aafa4-35d5-41bd-852a-d5722dd2bfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:30.717137 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2630/5224] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:30 2022] POST /identity/v3/auth/tokens => generated 3355 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:30.775611 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d142d6-abb5-46c4-bc25-04c097e590c3 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:30.779783 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-98d142d6-abb5-46c4-bc25-04c097e590c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:30.891506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d142d6-abb5-46c4-bc25-04c097e590c3 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:30.898750 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed3f3d-61bb-4c9e-a529-9e9269fd1883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:30.899529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed3f3d-61bb-4c9e-a529-9e9269fd1883 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:30.900670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed3f3d-61bb-4c9e-a529-9e9269fd1883 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:30.901089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed3f3d-61bb-4c9e-a529-9e9269fd1883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:30.953038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed3f3d-61bb-4c9e-a529-9e9269fd1883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:30.958876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed3f3d-61bb-4c9e-a529-9e9269fd1883 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:31.004320 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2595/5225] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:11:30 2022] GET /identity/v3/auth/tokens => generated 3355 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:11:31.136162 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07aafa4-35d5-41bd-852a-d5722dd2bfa5 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:31.138319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a07aafa4-35d5-41bd-852a-d5722dd2bfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:31.299409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:31.311690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07aafa4-35d5-41bd-852a-d5722dd2bfa5 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:31.323374 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd661d0-d9c1-4fc0-a4db-7797ebd0a871 tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfaaf9ec38bc40708781519e58313140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689cf90bb8884392978aa37cda5202ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:31.324410 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd661d0-d9c1-4fc0-a4db-7797ebd0a871 tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:31.324919 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd661d0-d9c1-4fc0-a4db-7797ebd0a871 tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:31.326165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd661d0-d9c1-4fc0-a4db-7797ebd0a871 tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:31.327189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd661d0-d9c1-4fc0-a4db-7797ebd0a871 tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:11:31.327717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd661d0-d9c1-4fc0-a4db-7797ebd0a871 tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:31.330014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd661d0-d9c1-4fc0-a4db-7797ebd0a871 tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:31.345176 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2631/5226] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:11:31.349527 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed3f3d-61bb-4c9e-a529-9e9269fd1883 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:31.367436 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed3f3d-61bb-4c9e-a529-9e9269fd1883 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:31.380564 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82a097-c96c-4561-9300-7a1c9f4cae28 tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfaaf9ec38bc40708781519e58313140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689cf90bb8884392978aa37cda5202ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:31.381359 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82a097-c96c-4561-9300-7a1c9f4cae28 tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:31.381655 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82a097-c96c-4561-9300-7a1c9f4cae28 tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:31.381931 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82a097-c96c-4561-9300-7a1c9f4cae28 tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:31.382780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff82a097-c96c-4561-9300-7a1c9f4cae28 tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:31.384724 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff82a097-c96c-4561-9300-7a1c9f4cae28 tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:31.449093 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2596/5227] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:11:31 2022] POST /identity/v3/projects => generated 348 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:11:31.450915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd661d0-d9c1-4fc0-a4db-7797ebd0a871 tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:31.467420 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd661d0-d9c1-4fc0-a4db-7797ebd0a871 tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:31.618901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafdf981-4830-44c7-ad8a-ab30c176ca9b tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfaaf9ec38bc40708781519e58313140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689cf90bb8884392978aa37cda5202ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:31.619743 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdf981-4830-44c7-ad8a-ab30c176ca9b tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:31.621133 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdf981-4830-44c7-ad8a-ab30c176ca9b tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:31.622269 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdf981-4830-44c7-ad8a-ab30c176ca9b tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:31.624296 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafdf981-4830-44c7-ad8a-ab30c176ca9b tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:11:31.624605 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafdf981-4830-44c7-ad8a-ab30c176ca9b tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:31.629298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafdf981-4830-44c7-ad8a-ab30c176ca9b tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:31.661888 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2632/5228] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:11:33.307726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82a097-c96c-4561-9300-7a1c9f4cae28 tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:33.323318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82a097-c96c-4561-9300-7a1c9f4cae28 tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:33.331787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba0cfa-1439-400b-b02b-6ea667fa528f tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfaaf9ec38bc40708781519e58313140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689cf90bb8884392978aa37cda5202ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:33.332445 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba0cfa-1439-400b-b02b-6ea667fa528f tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:33.332796 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba0cfa-1439-400b-b02b-6ea667fa528f tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:33.332993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba0cfa-1439-400b-b02b-6ea667fa528f tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] PATH_INFO: `/v3/projects/20c0d3b50bd24de4b9f8e487c0ea4edf` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:33.334144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba0cfa-1439-400b-b02b-6ea667fa528f tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] RBAC: Authorizing `identity:delete_project(project_id=20c0d3b50bd24de4b9f8e487c0ea4edf)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:33.336556 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba0cfa-1439-400b-b02b-6ea667fa528f tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:33.367250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:33.401294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e4ba0cfa-1439-400b-b02b-6ea667fa528f tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20c0d3b50bd24de4b9f8e487c0ea4edf', 'request_id': 'req-e4ba0cfa-1439-400b-b02b-6ea667fa528f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:33.410388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e4ba0cfa-1439-400b-b02b-6ea667fa528f tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20c0d3b50bd24de4b9f8e487c0ea4edf', 'request_id': 'req-e4ba0cfa-1439-400b-b02b-6ea667fa528f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:33.420923 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e4ba0cfa-1439-400b-b02b-6ea667fa528f tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20c0d3b50bd24de4b9f8e487c0ea4edf', 'request_id': 'req-e4ba0cfa-1439-400b-b02b-6ea667fa528f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:33.446118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e4ba0cfa-1439-400b-b02b-6ea667fa528f tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] The token cache is being invalidate because project 20c0d3b50bd24de4b9f8e487c0ea4edf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:11:33.446485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e4ba0cfa-1439-400b-b02b-6ea667fa528f tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:33.447631 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e4ba0cfa-1439-400b-b02b-6ea667fa528f tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:33.466663 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2597/5229] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:11:33 2022] DELETE /identity/v3/projects/20c0d3b50bd24de4b9f8e487c0ea4edf => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:33.545543 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafdf981-4830-44c7-ad8a-ab30c176ca9b tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:33.548342 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-cafdf981-4830-44c7-ad8a-ab30c176ca9b tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:33.784030 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafdf981-4830-44c7-ad8a-ab30c176ca9b tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:33.937840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ef5da-cceb-4b7f-b6a1-b950a32efb4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:33.938681 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ef5da-cceb-4b7f-b6a1-b950a32efb4b service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:33.938969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ef5da-cceb-4b7f-b6a1-b950a32efb4b service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:33.939244 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ef5da-cceb-4b7f-b6a1-b950a32efb4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:33.942360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2a1ef5da-cceb-4b7f-b6a1-b950a32efb4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:34.117645 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:34.124061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ef5da-cceb-4b7f-b6a1-b950a32efb4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:34.126511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ef5da-cceb-4b7f-b6a1-b950a32efb4b service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:34.164780 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2633/5230] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:11:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:11:35.698812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba0cfa-1439-400b-b02b-6ea667fa528f tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:35.702501 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e4ba0cfa-1439-400b-b02b-6ea667fa528f tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:35.798153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba0cfa-1439-400b-b02b-6ea667fa528f tempest-RoutersAdminTest-910554717 tempest-RoutersAdminTest-910554717-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:35.804513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5852fc8-9dc9-4ccd-8cf8-3bdc901100b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:35.805502 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5852fc8-9dc9-4ccd-8cf8-3bdc901100b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:35.805977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5852fc8-9dc9-4ccd-8cf8-3bdc901100b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:35.806836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5852fc8-9dc9-4ccd-8cf8-3bdc901100b5 admin admin] PATH_INFO: `/v3/users/0aecca7d5c454fdb88c513156e0855e0` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:35.808837 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5852fc8-9dc9-4ccd-8cf8-3bdc901100b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aecca7d5c454fdb88c513156e0855e0)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:35.812713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5852fc8-9dc9-4ccd-8cf8-3bdc901100b5 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:35.901533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f5852fc8-9dc9-4ccd-8cf8-3bdc901100b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aecca7d5c454fdb88c513156e0855e0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:35.903247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f5852fc8-9dc9-4ccd-8cf8-3bdc901100b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aecca7d5c454fdb88c513156e0855e0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:35.914925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f5852fc8-9dc9-4ccd-8cf8-3bdc901100b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aecca7d5c454fdb88c513156e0855e0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:35.944600 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f5852fc8-9dc9-4ccd-8cf8-3bdc901100b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aecca7d5c454fdb88c513156e0855e0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:35.974288 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f5852fc8-9dc9-4ccd-8cf8-3bdc901100b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aecca7d5c454fdb88c513156e0855e0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:36.034449 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2598/5231] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:11:35 2022] DELETE /identity/v3/users/0aecca7d5c454fdb88c513156e0855e0 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:36.039228 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bc397-5a7a-4a7b-bd53-c3df36041205 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:36.039753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bc397-5a7a-4a7b-bd53-c3df36041205 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:36.039834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bc397-5a7a-4a7b-bd53-c3df36041205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:36.088760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a94bc397-5a7a-4a7b-bd53-c3df36041205 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:36.090307 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a94bc397-5a7a-4a7b-bd53-c3df36041205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:36.273235 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2634/5232] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:36.298034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5852fc8-9dc9-4ccd-8cf8-3bdc901100b5 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:36.299659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f5852fc8-9dc9-4ccd-8cf8-3bdc901100b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:36.378036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:36.422331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5852fc8-9dc9-4ccd-8cf8-3bdc901100b5 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:36.434362 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da9bddf-986b-4bc8-90ad-1d89fb9e0cc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:36.437092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9bddf-986b-4bc8-90ad-1d89fb9e0cc1 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:36.456529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9bddf-986b-4bc8-90ad-1d89fb9e0cc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:36.457617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9bddf-986b-4bc8-90ad-1d89fb9e0cc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:36.475514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da9bddf-986b-4bc8-90ad-1d89fb9e0cc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:36.477590 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da9bddf-986b-4bc8-90ad-1d89fb9e0cc1 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:36.495698 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2599/5233] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:11:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:11:37.365066 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bc397-5a7a-4a7b-bd53-c3df36041205 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:37.366805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a94bc397-5a7a-4a7b-bd53-c3df36041205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:37.380332 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bc397-5a7a-4a7b-bd53-c3df36041205 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:37.398162 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e416cbea-26f3-4396-b2b6-884e64cf132f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:37.399280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e416cbea-26f3-4396-b2b6-884e64cf132f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:37.400619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e416cbea-26f3-4396-b2b6-884e64cf132f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:37.412074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e416cbea-26f3-4396-b2b6-884e64cf132f admin admin] PATH_INFO: `/v3/projects/3b3ef6a03a2f4fceaac35d6467222153` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:37.425635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e416cbea-26f3-4396-b2b6-884e64cf132f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b3ef6a03a2f4fceaac35d6467222153)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:37.428731 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e416cbea-26f3-4396-b2b6-884e64cf132f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:37.498763 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e416cbea-26f3-4396-b2b6-884e64cf132f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b3ef6a03a2f4fceaac35d6467222153', 'request_id': 'req-e416cbea-26f3-4396-b2b6-884e64cf132f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:37.504991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e416cbea-26f3-4396-b2b6-884e64cf132f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b3ef6a03a2f4fceaac35d6467222153', 'request_id': 'req-e416cbea-26f3-4396-b2b6-884e64cf132f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:37.516329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e416cbea-26f3-4396-b2b6-884e64cf132f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b3ef6a03a2f4fceaac35d6467222153', 'request_id': 'req-e416cbea-26f3-4396-b2b6-884e64cf132f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:37.533693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e416cbea-26f3-4396-b2b6-884e64cf132f admin admin] The token cache is being invalidate because project 3b3ef6a03a2f4fceaac35d6467222153 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:11:37.534010 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e416cbea-26f3-4396-b2b6-884e64cf132f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:37.534781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e416cbea-26f3-4396-b2b6-884e64cf132f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:37.536307 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2635/5234] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:11:37 2022] DELETE /identity/v3/projects/3b3ef6a03a2f4fceaac35d6467222153 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:37.540659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da9bddf-986b-4bc8-90ad-1d89fb9e0cc1 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:37.553898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da9bddf-986b-4bc8-90ad-1d89fb9e0cc1 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:37.573937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e416cbea-26f3-4396-b2b6-884e64cf132f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:37.576152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e416cbea-26f3-4396-b2b6-884e64cf132f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:37.627303 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e887ae-85b6-416a-9b8a-050402836ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:37.628058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e887ae-85b6-416a-9b8a-050402836ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:37.628434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e887ae-85b6-416a-9b8a-050402836ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:37.628778 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e887ae-85b6-416a-9b8a-050402836ac4 admin admin] PATH_INFO: `/v3/users/dd08e27bfd644a71b4063754ccbcb460` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:37.630013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e887ae-85b6-416a-9b8a-050402836ac4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd08e27bfd644a71b4063754ccbcb460)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:37.631989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e887ae-85b6-416a-9b8a-050402836ac4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:37.660603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e416cbea-26f3-4396-b2b6-884e64cf132f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:37.668358 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a7fbc-fa57-4f21-b496-fe4cf3a5fcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:37.669567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a7fbc-fa57-4f21-b496-fe4cf3a5fcfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:37.669824 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a7fbc-fa57-4f21-b496-fe4cf3a5fcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:37.670786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a7fbc-fa57-4f21-b496-fe4cf3a5fcfa admin admin] PATH_INFO: `/v3/users/fe66519e36a74b13ba70d0ac182e10da` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:37.674304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a7fbc-fa57-4f21-b496-fe4cf3a5fcfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe66519e36a74b13ba70d0ac182e10da)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:37.691414 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a7fbc-fa57-4f21-b496-fe4cf3a5fcfa admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:37.739890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:37.746840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c4e887ae-85b6-416a-9b8a-050402836ac4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd08e27bfd644a71b4063754ccbcb460'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:37.748302 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c4e887ae-85b6-416a-9b8a-050402836ac4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd08e27bfd644a71b4063754ccbcb460'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:37.748994 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c4e887ae-85b6-416a-9b8a-050402836ac4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd08e27bfd644a71b4063754ccbcb460'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:37.761783 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c4e887ae-85b6-416a-9b8a-050402836ac4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd08e27bfd644a71b4063754ccbcb460'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:37.790858 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-259a7fbc-fa57-4f21-b496-fe4cf3a5fcfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe66519e36a74b13ba70d0ac182e10da'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:37.808039 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-259a7fbc-fa57-4f21-b496-fe4cf3a5fcfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe66519e36a74b13ba70d0ac182e10da'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:37.808940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-259a7fbc-fa57-4f21-b496-fe4cf3a5fcfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe66519e36a74b13ba70d0ac182e10da'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:37.810344 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c4e887ae-85b6-416a-9b8a-050402836ac4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd08e27bfd644a71b4063754ccbcb460'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:37.815075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-259a7fbc-fa57-4f21-b496-fe4cf3a5fcfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe66519e36a74b13ba70d0ac182e10da'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:37.830778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-259a7fbc-fa57-4f21-b496-fe4cf3a5fcfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe66519e36a74b13ba70d0ac182e10da'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:37.834611 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2600/5235] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:11:37 2022] DELETE /identity/v3/users/dd08e27bfd644a71b4063754ccbcb460 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:37.855517 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2636/5236] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:11:37 2022] DELETE /identity/v3/users/fe66519e36a74b13ba70d0ac182e10da => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:11:37.860640 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ffcd5-2521-4704-8147-fd8a1535c1ca None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:37.860930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ffcd5-2521-4704-8147-fd8a1535c1ca None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:37.861209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ffcd5-2521-4704-8147-fd8a1535c1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:37.884209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-9f8ffcd5-2521-4704-8147-fd8a1535c1ca None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:37.885822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9f8ffcd5-2521-4704-8147-fd8a1535c1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:37.955810 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:37.993984 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2601/5237] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:38.006309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a7fbc-fa57-4f21-b496-fe4cf3a5fcfa admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:38.008407 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-259a7fbc-fa57-4f21-b496-fe4cf3a5fcfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:38.118701 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a7fbc-fa57-4f21-b496-fe4cf3a5fcfa admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:38.124056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41344938-7985-45db-865c-703ea068d74e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:38.124934 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41344938-7985-45db-865c-703ea068d74e service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:38.125322 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41344938-7985-45db-865c-703ea068d74e service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:38.125697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41344938-7985-45db-865c-703ea068d74e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:38.141779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41344938-7985-45db-865c-703ea068d74e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:38.144656 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41344938-7985-45db-865c-703ea068d74e service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:38.173670 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2637/5238] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:11:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:11:38.358987 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ffcd5-2521-4704-8147-fd8a1535c1ca None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:38.360389 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9f8ffcd5-2521-4704-8147-fd8a1535c1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:38.384238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ffcd5-2521-4704-8147-fd8a1535c1ca None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:38.391353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94187c3-a111-4dce-937f-498be8ba9853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:38.392144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94187c3-a111-4dce-937f-498be8ba9853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:38.392425 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94187c3-a111-4dce-937f-498be8ba9853 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:38.392693 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94187c3-a111-4dce-937f-498be8ba9853 admin admin] PATH_INFO: `/v3/projects/f21076a6c0774be6a948d2e61e666110` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:38.404246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94187c3-a111-4dce-937f-498be8ba9853 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f21076a6c0774be6a948d2e61e666110)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:38.406361 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94187c3-a111-4dce-937f-498be8ba9853 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:38.501678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e94187c3-a111-4dce-937f-498be8ba9853 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f21076a6c0774be6a948d2e61e666110', 'request_id': 'req-e94187c3-a111-4dce-937f-498be8ba9853'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:38.516681 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e94187c3-a111-4dce-937f-498be8ba9853 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f21076a6c0774be6a948d2e61e666110', 'request_id': 'req-e94187c3-a111-4dce-937f-498be8ba9853'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:38.526805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e94187c3-a111-4dce-937f-498be8ba9853 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f21076a6c0774be6a948d2e61e666110', 'request_id': 'req-e94187c3-a111-4dce-937f-498be8ba9853'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:38.558863 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e94187c3-a111-4dce-937f-498be8ba9853 admin admin] The token cache is being invalidate because project f21076a6c0774be6a948d2e61e666110 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:11:38.558863 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e94187c3-a111-4dce-937f-498be8ba9853 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:38.559964 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e94187c3-a111-4dce-937f-498be8ba9853 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:38.564585 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2602/5239] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:11:38 2022] DELETE /identity/v3/projects/f21076a6c0774be6a948d2e61e666110 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:38.570431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76df0ce-1b89-47bb-aeff-c114e147a4aa None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:38.571042 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76df0ce-1b89-47bb-aeff-c114e147a4aa None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:38.571145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76df0ce-1b89-47bb-aeff-c114e147a4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:38.614377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-e76df0ce-1b89-47bb-aeff-c114e147a4aa None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:38.620707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e76df0ce-1b89-47bb-aeff-c114e147a4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:38.732310 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2638/5240] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:38.741406 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdcf45-c96e-4df9-8603-c1bbbd1ce171 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:38.741722 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdcf45-c96e-4df9-8603-c1bbbd1ce171 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:38.741949 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdcf45-c96e-4df9-8603-c1bbbd1ce171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:38.764978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-4dcdcf45-c96e-4df9-8603-c1bbbd1ce171 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:38.766224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4dcdcf45-c96e-4df9-8603-c1bbbd1ce171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:38.778396 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2603/5241] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:38.779854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76df0ce-1b89-47bb-aeff-c114e147a4aa None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:38.792994 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76df0ce-1b89-47bb-aeff-c114e147a4aa None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:38.800262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d60dc-4066-4144-8062-68958a303b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:38.801351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d60dc-4066-4144-8062-68958a303b8d admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:38.801431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d60dc-4066-4144-8062-68958a303b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:38.801675 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d60dc-4066-4144-8062-68958a303b8d admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:38.802579 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d60dc-4066-4144-8062-68958a303b8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:11:38.802704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d60dc-4066-4144-8062-68958a303b8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:38.804962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d60dc-4066-4144-8062-68958a303b8d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:38.826453 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2639/5242] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:11:38.827758 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcdcf45-c96e-4df9-8603-c1bbbd1ce171 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:38.842346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcdcf45-c96e-4df9-8603-c1bbbd1ce171 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:38.848008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d46e79-27b8-4e59-8798-726c5fa0c249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:38.848797 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d46e79-27b8-4e59-8798-726c5fa0c249 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:38.849143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d46e79-27b8-4e59-8798-726c5fa0c249 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:38.849516 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d46e79-27b8-4e59-8798-726c5fa0c249 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:38.850249 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d46e79-27b8-4e59-8798-726c5fa0c249 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:38.853100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d46e79-27b8-4e59-8798-726c5fa0c249 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:38.920309 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2604/5243] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:11:38 2022] POST /identity/v3/projects => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:38.923076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d60dc-4066-4144-8062-68958a303b8d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:38.957483 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d60dc-4066-4144-8062-68958a303b8d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:39.029754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:39.044399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d46e79-27b8-4e59-8798-726c5fa0c249 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:39.046238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-54d46e79-27b8-4e59-8798-726c5fa0c249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:39.103792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4c47e-b048-446a-bb2b-535908c62a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:39.104883 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4c47e-b048-446a-bb2b-535908c62a03 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:39.105186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4c47e-b048-446a-bb2b-535908c62a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:39.105515 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4c47e-b048-446a-bb2b-535908c62a03 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:39.106157 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4c47e-b048-446a-bb2b-535908c62a03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:39.109539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4c47e-b048-446a-bb2b-535908c62a03 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:39.174585 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2640/5244] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:11:38 2022] POST /identity/v3/users => generated 292 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:39.177772 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4c47e-b048-446a-bb2b-535908c62a03 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:39.216956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4c47e-b048-446a-bb2b-535908c62a03 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:39.233390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d46e79-27b8-4e59-8798-726c5fa0c249 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:39.238802 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12068bb-bfcc-4ab3-aa74-42d0e5ba0b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:39.239429 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12068bb-bfcc-4ab3-aa74-42d0e5ba0b58 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:39.239713 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12068bb-bfcc-4ab3-aa74-42d0e5ba0b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:39.239992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12068bb-bfcc-4ab3-aa74-42d0e5ba0b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:39.240654 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12068bb-bfcc-4ab3-aa74-42d0e5ba0b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:39.242371 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12068bb-bfcc-4ab3-aa74-42d0e5ba0b58 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:39.242854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574771c-cd15-4894-bf7a-3ba86743dfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:39.243503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574771c-cd15-4894-bf7a-3ba86743dfcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:39.244322 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574771c-cd15-4894-bf7a-3ba86743dfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:39.244762 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574771c-cd15-4894-bf7a-3ba86743dfcc admin admin] PATH_INFO: `/v3/projects/8999a799cb204cd58e247b4d3707bda1` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:39.245958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a574771c-cd15-4894-bf7a-3ba86743dfcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8999a799cb204cd58e247b4d3707bda1)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:39.248803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a574771c-cd15-4894-bf7a-3ba86743dfcc admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:39.264734 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2641/5245] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:39.269067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12068bb-bfcc-4ab3-aa74-42d0e5ba0b58 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:39.283471 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12068bb-bfcc-4ab3-aa74-42d0e5ba0b58 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:39.288493 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee00fa-f2c0-4953-b302-d0cd106794f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:39.289111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee00fa-f2c0-4953-b302-d0cd106794f1 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:39.289387 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee00fa-f2c0-4953-b302-d0cd106794f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:39.289664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee00fa-f2c0-4953-b302-d0cd106794f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:39.290363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee00fa-f2c0-4953-b302-d0cd106794f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:39.292285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee00fa-f2c0-4953-b302-d0cd106794f1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:39.308145 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2642/5246] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:11:39.309036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee00fa-f2c0-4953-b302-d0cd106794f1 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:39.322348 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee00fa-f2c0-4953-b302-d0cd106794f1 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:39.331888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cbe91f-c2c5-4f10-a5bb-222f4f902604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:39.333746 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cbe91f-c2c5-4f10-a5bb-222f4f902604 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:39.334034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cbe91f-c2c5-4f10-a5bb-222f4f902604 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:39.334313 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cbe91f-c2c5-4f10-a5bb-222f4f902604 admin admin] PATH_INFO: `/v3/projects/31c83019f0d740978cde1ca90ba5d680/users/5ce76917906b41138c4630376d69e37b/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:39.353417 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cbe91f-c2c5-4f10-a5bb-222f4f902604 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31c83019f0d740978cde1ca90ba5d680, user_id=5ce76917906b41138c4630376d69e37b, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:39.356117 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cbe91f-c2c5-4f10-a5bb-222f4f902604 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:39.368794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a574771c-cd15-4894-bf7a-3ba86743dfcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8999a799cb204cd58e247b4d3707bda1', 'request_id': 'req-a574771c-cd15-4894-bf7a-3ba86743dfcc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:39.371900 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:39.380319 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2643/5247] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:11:39 2022] PUT /identity/v3/projects/31c83019f0d740978cde1ca90ba5d680/users/5ce76917906b41138c4630376d69e37b/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:39.389085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a574771c-cd15-4894-bf7a-3ba86743dfcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8999a799cb204cd58e247b4d3707bda1', 'request_id': 'req-a574771c-cd15-4894-bf7a-3ba86743dfcc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:39.397781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88991f-3cfb-4d07-975c-c1b10bbe93ae None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:39.398142 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88991f-3cfb-4d07-975c-c1b10bbe93ae None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:39.398425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88991f-3cfb-4d07-975c-c1b10bbe93ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:39.407531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a574771c-cd15-4894-bf7a-3ba86743dfcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8999a799cb204cd58e247b4d3707bda1', 'request_id': 'req-a574771c-cd15-4894-bf7a-3ba86743dfcc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:39.433494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a574771c-cd15-4894-bf7a-3ba86743dfcc admin admin] The token cache is being invalidate because project 8999a799cb204cd58e247b4d3707bda1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:11:39.433837 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a574771c-cd15-4894-bf7a-3ba86743dfcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:39.435668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a574771c-cd15-4894-bf7a-3ba86743dfcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:39.437257 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2605/5248] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:11:39 2022] DELETE /identity/v3/projects/8999a799cb204cd58e247b4d3707bda1 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:39.441783 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574771c-cd15-4894-bf7a-3ba86743dfcc admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:39.443226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-db88991f-3cfb-4d07-975c-c1b10bbe93ae None None] MFA Rules not processed for user `5ce76917906b41138c4630376d69e37b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:39.444255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a574771c-cd15-4894-bf7a-3ba86743dfcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:39.444595 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-db88991f-3cfb-4d07-975c-c1b10bbe93ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:39.569616 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2644/5249] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:39.594142 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88991f-3cfb-4d07-975c-c1b10bbe93ae None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:39.596830 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-db88991f-3cfb-4d07-975c-c1b10bbe93ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:39.611295 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574771c-cd15-4894-bf7a-3ba86743dfcc admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:39.730873 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d8697-1c2b-46b8-96ba-71f90d86c4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:39.732161 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d8697-1c2b-46b8-96ba-71f90d86c4a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:39.732518 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d8697-1c2b-46b8-96ba-71f90d86c4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:39.732912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d8697-1c2b-46b8-96ba-71f90d86c4a4 admin admin] PATH_INFO: `/v3/users/289b7717513a4f01a96dac17f8727e37` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:39.734599 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d8697-1c2b-46b8-96ba-71f90d86c4a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=289b7717513a4f01a96dac17f8727e37)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:39.737461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d8697-1c2b-46b8-96ba-71f90d86c4a4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:39.795397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88991f-3cfb-4d07-975c-c1b10bbe93ae None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:39.801829 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f8dfa-e574-482d-81a7-689120c62412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:39.803393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f8dfa-e574-482d-81a7-689120c62412 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:39.803833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f8dfa-e574-482d-81a7-689120c62412 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:39.804466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f8dfa-e574-482d-81a7-689120c62412 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:39.805202 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f8dfa-e574-482d-81a7-689120c62412 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:39.807903 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f8dfa-e574-482d-81a7-689120c62412 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:39.828896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:39.839238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bc7d8697-1c2b-46b8-96ba-71f90d86c4a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '289b7717513a4f01a96dac17f8727e37'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:39.841821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bc7d8697-1c2b-46b8-96ba-71f90d86c4a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '289b7717513a4f01a96dac17f8727e37'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:39.843229 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bc7d8697-1c2b-46b8-96ba-71f90d86c4a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '289b7717513a4f01a96dac17f8727e37'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:39.860930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bc7d8697-1c2b-46b8-96ba-71f90d86c4a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '289b7717513a4f01a96dac17f8727e37'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:39.907222 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2645/5250] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:11:39 2022] POST /identity/v3/projects => generated 383 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:39.908609 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f8dfa-e574-482d-81a7-689120c62412 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:39.910697 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bc7d8697-1c2b-46b8-96ba-71f90d86c4a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '289b7717513a4f01a96dac17f8727e37'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:39.911823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a48f8dfa-e574-482d-81a7-689120c62412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:39.941433 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2606/5251] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:11:39 2022] DELETE /identity/v3/users/289b7717513a4f01a96dac17f8727e37 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:11:40.059626 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f8dfa-e574-482d-81a7-689120c62412 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:40.195682 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3ebea-6885-49fe-bc6c-9a5efa03e426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:40.196419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3ebea-6885-49fe-bc6c-9a5efa03e426 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:40.196816 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3ebea-6885-49fe-bc6c-9a5efa03e426 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:40.197192 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3ebea-6885-49fe-bc6c-9a5efa03e426 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:40.197984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3ebea-6885-49fe-bc6c-9a5efa03e426 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:40.201131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3ebea-6885-49fe-bc6c-9a5efa03e426 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:40.238272 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2646/5252] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:11:39 2022] POST /identity/v3/users => generated 298 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:40.242586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d8697-1c2b-46b8-96ba-71f90d86c4a4 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:40.254962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:40.258952 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d8697-1c2b-46b8-96ba-71f90d86c4a4 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:40.272140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde719f-2049-40da-9693-c7dd5a8536cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:40.272778 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde719f-2049-40da-9693-c7dd5a8536cb admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:40.273079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde719f-2049-40da-9693-c7dd5a8536cb admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:40.279763 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde719f-2049-40da-9693-c7dd5a8536cb admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:40.280476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde719f-2049-40da-9693-c7dd5a8536cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:40.282124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde719f-2049-40da-9693-c7dd5a8536cb admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:40.302877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3ebea-6885-49fe-bc6c-9a5efa03e426 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:40.306722 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-bce3ebea-6885-49fe-bc6c-9a5efa03e426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:40.329164 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2607/5253] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:40.329494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3ebea-6885-49fe-bc6c-9a5efa03e426 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:40.336033 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb31ab-7e16-4e03-8fca-e4d1b1f8ee75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:40.336988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb31ab-7e16-4e03-8fca-e4d1b1f8ee75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:40.337385 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb31ab-7e16-4e03-8fca-e4d1b1f8ee75 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:40.337765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb31ab-7e16-4e03-8fca-e4d1b1f8ee75 admin admin] PATH_INFO: `/v3/projects/3bda826face7492db867e9098c471dfc` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:40.339337 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb31ab-7e16-4e03-8fca-e4d1b1f8ee75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bda826face7492db867e9098c471dfc)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:40.340171 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde719f-2049-40da-9693-c7dd5a8536cb admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:40.342524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb31ab-7e16-4e03-8fca-e4d1b1f8ee75 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:40.366346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde719f-2049-40da-9693-c7dd5a8536cb admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:40.374124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90d5cf-c8e1-4b69-b042-e0515acdde93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:40.375146 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90d5cf-c8e1-4b69-b042-e0515acdde93 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:40.375593 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90d5cf-c8e1-4b69-b042-e0515acdde93 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:40.376013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90d5cf-c8e1-4b69-b042-e0515acdde93 admin admin] PATH_INFO: `/v3/projects/24fc62801f8540a9bca482ccc6bb35d3/users/56a43c894004417fa3557e5bc8dfff3d/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:40.411862 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe90d5cf-c8e1-4b69-b042-e0515acdde93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24fc62801f8540a9bca482ccc6bb35d3, user_id=56a43c894004417fa3557e5bc8dfff3d, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:40.417468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe90d5cf-c8e1-4b69-b042-e0515acdde93 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:40.446031 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2608/5254] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:11:40 2022] PUT /identity/v3/projects/24fc62801f8540a9bca482ccc6bb35d3/users/56a43c894004417fa3557e5bc8dfff3d/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:40.451428 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90d5cf-c8e1-4b69-b042-e0515acdde93 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:40.460664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8ddb31ab-7e16-4e03-8fca-e4d1b1f8ee75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bda826face7492db867e9098c471dfc', 'request_id': 'req-8ddb31ab-7e16-4e03-8fca-e4d1b1f8ee75'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:40.485420 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8ddb31ab-7e16-4e03-8fca-e4d1b1f8ee75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bda826face7492db867e9098c471dfc', 'request_id': 'req-8ddb31ab-7e16-4e03-8fca-e4d1b1f8ee75'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:40.504825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8ddb31ab-7e16-4e03-8fca-e4d1b1f8ee75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bda826face7492db867e9098c471dfc', 'request_id': 'req-8ddb31ab-7e16-4e03-8fca-e4d1b1f8ee75'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:40.521003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8ddb31ab-7e16-4e03-8fca-e4d1b1f8ee75 admin admin] The token cache is being invalidate because project 3bda826face7492db867e9098c471dfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:11:40.521563 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8ddb31ab-7e16-4e03-8fca-e4d1b1f8ee75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:40.523257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8ddb31ab-7e16-4e03-8fca-e4d1b1f8ee75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:40.531726 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2647/5255] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:11:40 2022] DELETE /identity/v3/projects/3bda826face7492db867e9098c471dfc => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:40.539669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27574da8-63f8-437c-98f0-d6780eeee0d7 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:40.539961 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27574da8-63f8-437c-98f0-d6780eeee0d7 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:40.540246 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27574da8-63f8-437c-98f0-d6780eeee0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:40.566365 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:40.573273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-27574da8-63f8-437c-98f0-d6780eeee0d7 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:40.576183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-27574da8-63f8-437c-98f0-d6780eeee0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:40.601722 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90d5cf-c8e1-4b69-b042-e0515acdde93 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:40.608881 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29461bf-639a-487b-853d-a7c55fc51520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:40.609679 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29461bf-639a-487b-853d-a7c55fc51520 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:40.610140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29461bf-639a-487b-853d-a7c55fc51520 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:40.610529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29461bf-639a-487b-853d-a7c55fc51520 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:40.611303 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29461bf-639a-487b-853d-a7c55fc51520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:40.615558 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29461bf-639a-487b-853d-a7c55fc51520 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:40.632818 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2609/5256] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:40.634865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ced09f-bf9f-4a87-a49a-58eb1ee150fc None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:40.635363 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ced09f-bf9f-4a87-a49a-58eb1ee150fc None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:40.635966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ced09f-bf9f-4a87-a49a-58eb1ee150fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:40.658935 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-16ced09f-bf9f-4a87-a49a-58eb1ee150fc None None] MFA Rules not processed for user `22318132bfd04aa0886eb9b14a983731`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:40.660573 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-16ced09f-bf9f-4a87-a49a-58eb1ee150fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:40.673849 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2648/5257] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:40.675996 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27574da8-63f8-437c-98f0-d6780eeee0d7 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:40.683443 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-27574da8-63f8-437c-98f0-d6780eeee0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:40.713148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27574da8-63f8-437c-98f0-d6780eeee0d7 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:40.729187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84837b5-5517-4768-a048-a6185a1094d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:40.729881 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84837b5-5517-4768-a048-a6185a1094d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:40.730165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84837b5-5517-4768-a048-a6185a1094d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:40.730436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84837b5-5517-4768-a048-a6185a1094d9 admin admin] PATH_INFO: `/v3/projects/24fc62801f8540a9bca482ccc6bb35d3/users/56a43c894004417fa3557e5bc8dfff3d/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:40.733023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84837b5-5517-4768-a048-a6185a1094d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24fc62801f8540a9bca482ccc6bb35d3, user_id=56a43c894004417fa3557e5bc8dfff3d, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:40.735729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84837b5-5517-4768-a048-a6185a1094d9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:40.768468 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2649/5258] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:11:40 2022] PUT /identity/v3/projects/24fc62801f8540a9bca482ccc6bb35d3/users/56a43c894004417fa3557e5bc8dfff3d/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:40.770469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ecf21-938c-4f8d-9cb2-9ba3640984a2 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:40.771723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ecf21-938c-4f8d-9cb2-9ba3640984a2 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:40.772419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ecf21-938c-4f8d-9cb2-9ba3640984a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:40.787669 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2610/5259] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:40.789571 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d31165-df89-4f4d-9cbe-1b5b5b2a1b35 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:40.789715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d31165-df89-4f4d-9cbe-1b5b5b2a1b35 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:40.789978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d31165-df89-4f4d-9cbe-1b5b5b2a1b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:40.832824 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-690ecf21-938c-4f8d-9cb2-9ba3640984a2 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:40.834072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-690ecf21-938c-4f8d-9cb2-9ba3640984a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:40.884080 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-53d31165-df89-4f4d-9cbe-1b5b5b2a1b35 None None] MFA Rules not processed for user `56a43c894004417fa3557e5bc8dfff3d`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:40.885446 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-53d31165-df89-4f4d-9cbe-1b5b5b2a1b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:40.961186 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2650/5260] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:40.967673 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ecf21-938c-4f8d-9cb2-9ba3640984a2 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:40.988359 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ecf21-938c-4f8d-9cb2-9ba3640984a2 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:41.002795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d214b-7fe8-4e29-a9b8-30e4f098850c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:41.003572 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d214b-7fe8-4e29-a9b8-30e4f098850c admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:41.004103 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d214b-7fe8-4e29-a9b8-30e4f098850c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:41.004650 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d214b-7fe8-4e29-a9b8-30e4f098850c admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:41.007040 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07d214b-7fe8-4e29-a9b8-30e4f098850c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:11:41.007939 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07d214b-7fe8-4e29-a9b8-30e4f098850c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:41.011854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07d214b-7fe8-4e29-a9b8-30e4f098850c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:41.033663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:41.041374 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2651/5261] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:11:41.047689 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d214b-7fe8-4e29-a9b8-30e4f098850c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:41.063295 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2611/5262] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:40 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:41.073292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d214b-7fe8-4e29-a9b8-30e4f098850c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:41.084005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe7526-1f55-46d1-be09-87c8115ebd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:41.085748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe7526-1f55-46d1-be09-87c8115ebd82 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:41.086251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe7526-1f55-46d1-be09-87c8115ebd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:41.086902 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe7526-1f55-46d1-be09-87c8115ebd82 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:41.087752 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe7526-1f55-46d1-be09-87c8115ebd82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:41.095821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d31165-df89-4f4d-9cbe-1b5b5b2a1b35 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:41.098136 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-53d31165-df89-4f4d-9cbe-1b5b5b2a1b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:41.099004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe7526-1f55-46d1-be09-87c8115ebd82 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:41.150592 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2652/5263] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:11:41 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:11:41.154867 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe7526-1f55-46d1-be09-87c8115ebd82 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:41.231866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d31165-df89-4f4d-9cbe-1b5b5b2a1b35 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:41.301628 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe7526-1f55-46d1-be09-87c8115ebd82 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:41.312786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc45f3-70de-4542-baa8-5fa8c31febb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:41.312786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc45f3-70de-4542-baa8-5fa8c31febb2 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:41.313123 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc45f3-70de-4542-baa8-5fa8c31febb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:41.313384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc45f3-70de-4542-baa8-5fa8c31febb2 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:41.314500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc45f3-70de-4542-baa8-5fa8c31febb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:41.321033 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc45f3-70de-4542-baa8-5fa8c31febb2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:41.350475 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:41.356966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a31f3-58e7-4821-aa11-5dd6ab6296e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:41.357890 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a31f3-58e7-4821-aa11-5dd6ab6296e5 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:41.358323 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a31f3-58e7-4821-aa11-5dd6ab6296e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:41.360848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a31f3-58e7-4821-aa11-5dd6ab6296e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:41.391444 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2653/5264] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:11:41 2022] POST /identity/v3/users => generated 286 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:41.394853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc45f3-70de-4542-baa8-5fa8c31febb2 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:41.435783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc45f3-70de-4542-baa8-5fa8c31febb2 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:41.447609 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ad005-52ed-47ee-af2a-851dcb834bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:41.448493 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ad005-52ed-47ee-af2a-851dcb834bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:41.448917 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ad005-52ed-47ee-af2a-851dcb834bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:41.449332 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ad005-52ed-47ee-af2a-851dcb834bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:41.450717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ad005-52ed-47ee-af2a-851dcb834bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:41.454139 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ad005-52ed-47ee-af2a-851dcb834bc7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:41.480183 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2654/5265] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:41.484477 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ad005-52ed-47ee-af2a-851dcb834bc7 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:41.491284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a31f3-58e7-4821-aa11-5dd6ab6296e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:41.492752 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a31f3-58e7-4821-aa11-5dd6ab6296e5 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:41.503155 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ad005-52ed-47ee-af2a-851dcb834bc7 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:41.514472 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2612/5266] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:11:41 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:11:41.517786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b4bd7-11f3-4482-886b-26573124c882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:41.518710 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b4bd7-11f3-4482-886b-26573124c882 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:41.519197 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b4bd7-11f3-4482-886b-26573124c882 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:41.519682 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b4bd7-11f3-4482-886b-26573124c882 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:41.520430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b4bd7-11f3-4482-886b-26573124c882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:41.522286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b4bd7-11f3-4482-886b-26573124c882 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:41.551627 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2655/5267] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:11:41.556032 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a31f3-58e7-4821-aa11-5dd6ab6296e5 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:41.571845 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a31f3-58e7-4821-aa11-5dd6ab6296e5 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:41.587182 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f2c49-1494-467c-a60f-0cbc3ff94615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:41.587878 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f2c49-1494-467c-a60f-0cbc3ff94615 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:41.588159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f2c49-1494-467c-a60f-0cbc3ff94615 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:41.588433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f2c49-1494-467c-a60f-0cbc3ff94615 admin admin] PATH_INFO: `/v3/projects/42a29744f49044b892a9c84345a44f7e/users/0d16dc01bd0d456d9059b6297a756d53/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:41.619308 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f2c49-1494-467c-a60f-0cbc3ff94615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42a29744f49044b892a9c84345a44f7e, user_id=0d16dc01bd0d456d9059b6297a756d53, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:41.624069 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f2c49-1494-467c-a60f-0cbc3ff94615 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:41.653917 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2613/5268] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:11:41 2022] PUT /identity/v3/projects/42a29744f49044b892a9c84345a44f7e/users/0d16dc01bd0d456d9059b6297a756d53/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:41.666184 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726bb34-28db-424e-bf83-d99e1a791bcc None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:41.666382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726bb34-28db-424e-bf83-d99e1a791bcc None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:41.666608 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726bb34-28db-424e-bf83-d99e1a791bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:41.733671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d726bb34-28db-424e-bf83-d99e1a791bcc None None] MFA Rules not processed for user `0d16dc01bd0d456d9059b6297a756d53`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:41.734951 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d726bb34-28db-424e-bf83-d99e1a791bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:41.936875 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2656/5269] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:41.941778 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f2c49-1494-467c-a60f-0cbc3ff94615 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:42.020881 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:42.059777 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f2c49-1494-467c-a60f-0cbc3ff94615 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:42.079610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a3f46-e026-403e-9d2f-9f578ed8dc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:42.082972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a3f46-e026-403e-9d2f-9f578ed8dc31 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:42.083436 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a3f46-e026-403e-9d2f-9f578ed8dc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:42.083719 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a3f46-e026-403e-9d2f-9f578ed8dc31 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:42.084790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a3f46-e026-403e-9d2f-9f578ed8dc31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:42.089248 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a3f46-e026-403e-9d2f-9f578ed8dc31 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:42.134771 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2614/5270] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:11:41 2022] POST /identity/v3/projects => generated 373 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:42.138415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726bb34-28db-424e-bf83-d99e1a791bcc None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:42.156788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726bb34-28db-424e-bf83-d99e1a791bcc None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:42.298519 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa439a5-6d24-49af-8932-b3dd9ec68b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:42.299192 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa439a5-6d24-49af-8932-b3dd9ec68b0f admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:42.300734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa439a5-6d24-49af-8932-b3dd9ec68b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:42.300734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa439a5-6d24-49af-8932-b3dd9ec68b0f admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:42.300734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa439a5-6d24-49af-8932-b3dd9ec68b0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:42.302343 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa439a5-6d24-49af-8932-b3dd9ec68b0f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:42.350086 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2657/5271] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:11:42 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:11:42.353645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a3f46-e026-403e-9d2f-9f578ed8dc31 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:42.369046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a3f46-e026-403e-9d2f-9f578ed8dc31 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:42.391716 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178f406-34fd-4998-a8ca-101d06ed7f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:42.392351 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178f406-34fd-4998-a8ca-101d06ed7f81 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:42.392636 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178f406-34fd-4998-a8ca-101d06ed7f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:42.392909 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178f406-34fd-4998-a8ca-101d06ed7f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:42.394187 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e178f406-34fd-4998-a8ca-101d06ed7f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:42.395930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e178f406-34fd-4998-a8ca-101d06ed7f81 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:42.418416 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2615/5272] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:42.422573 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa439a5-6d24-49af-8932-b3dd9ec68b0f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:42.444273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa439a5-6d24-49af-8932-b3dd9ec68b0f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:42.454096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbabf023-fda4-4105-a3d8-b568e03b465b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:42.454819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabf023-fda4-4105-a3d8-b568e03b465b admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:42.455108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabf023-fda4-4105-a3d8-b568e03b465b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:42.455394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabf023-fda4-4105-a3d8-b568e03b465b admin admin] PATH_INFO: `/v3/projects/eafb3e23ace14382abb5801635fe735a/users/95db4af2b1024170828e34efac41966e/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:42.497706 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbabf023-fda4-4105-a3d8-b568e03b465b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eafb3e23ace14382abb5801635fe735a, user_id=95db4af2b1024170828e34efac41966e, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:42.500509 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbabf023-fda4-4105-a3d8-b568e03b465b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:42.540062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178f406-34fd-4998-a8ca-101d06ed7f81 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:42.541908 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e178f406-34fd-4998-a8ca-101d06ed7f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:42.555523 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2658/5273] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:11:42 2022] PUT /identity/v3/projects/eafb3e23ace14382abb5801635fe735a/users/95db4af2b1024170828e34efac41966e/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:11:42.557521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbabf023-fda4-4105-a3d8-b568e03b465b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:42.664728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:42.737854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbabf023-fda4-4105-a3d8-b568e03b465b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:42.756747 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c8316-87d0-4eea-aebb-60ca50f6d9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:42.757538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c8316-87d0-4eea-aebb-60ca50f6d9b3 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:42.758039 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c8316-87d0-4eea-aebb-60ca50f6d9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:42.758408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c8316-87d0-4eea-aebb-60ca50f6d9b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:42.759215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c8316-87d0-4eea-aebb-60ca50f6d9b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:42.760911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c8316-87d0-4eea-aebb-60ca50f6d9b3 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:42.793370 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2659/5274] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:42.795581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c8316-87d0-4eea-aebb-60ca50f6d9b3 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:42.807048 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c8316-87d0-4eea-aebb-60ca50f6d9b3 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:42.815622 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0833f1-cf6e-4936-9448-79809a6d6ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:42.821023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0833f1-cf6e-4936-9448-79809a6d6ade admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:42.821461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0833f1-cf6e-4936-9448-79809a6d6ade admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:42.821883 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0833f1-cf6e-4936-9448-79809a6d6ade admin admin] PATH_INFO: `/v3/projects/eafb3e23ace14382abb5801635fe735a/users/95db4af2b1024170828e34efac41966e/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:42.824561 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0833f1-cf6e-4936-9448-79809a6d6ade admin admin] RBAC: Authorizing `identity:create_grant(project_id=eafb3e23ace14382abb5801635fe735a, user_id=95db4af2b1024170828e34efac41966e, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:42.828407 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0833f1-cf6e-4936-9448-79809a6d6ade admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:42.855144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178f406-34fd-4998-a8ca-101d06ed7f81 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:42.868509 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2660/5275] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:11:42 2022] PUT /identity/v3/projects/eafb3e23ace14382abb5801635fe735a/users/95db4af2b1024170828e34efac41966e/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:11:42.872955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a538c9b-304a-417e-8ae1-0feca2d8b8de None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:42.874760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a538c9b-304a-417e-8ae1-0feca2d8b8de None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:42.875304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a538c9b-304a-417e-8ae1-0feca2d8b8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:42.953157 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-0a538c9b-304a-417e-8ae1-0feca2d8b8de None None] MFA Rules not processed for user `95db4af2b1024170828e34efac41966e`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:42.955029 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0a538c9b-304a-417e-8ae1-0feca2d8b8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:43.069779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece2ccc-dbce-4c4b-aa97-9f351c0da00b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:43.071737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece2ccc-dbce-4c4b-aa97-9f351c0da00b service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:43.072105 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece2ccc-dbce-4c4b-aa97-9f351c0da00b service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:43.072898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece2ccc-dbce-4c4b-aa97-9f351c0da00b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:43.076134 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-fece2ccc-dbce-4c4b-aa97-9f351c0da00b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:43.096148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece2ccc-dbce-4c4b-aa97-9f351c0da00b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:43.098425 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece2ccc-dbce-4c4b-aa97-9f351c0da00b service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:43.151597 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2616/5276] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:11:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:11:43.173291 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2661/5277] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:11:43.189601 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece2ccc-dbce-4c4b-aa97-9f351c0da00b service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:43.209378 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece2ccc-dbce-4c4b-aa97-9f351c0da00b service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:43.224703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea4fca-affb-4460-a061-ea0e293c7eaf tempest-QuotasNegativeTest-1875628136 tempest-QuotasNegativeTest-1875628136-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95db4af2b1024170828e34efac41966e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eafb3e23ace14382abb5801635fe735a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:43.225638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea4fca-affb-4460-a061-ea0e293c7eaf tempest-QuotasNegativeTest-1875628136 tempest-QuotasNegativeTest-1875628136-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:43.226350 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea4fca-affb-4460-a061-ea0e293c7eaf tempest-QuotasNegativeTest-1875628136 tempest-QuotasNegativeTest-1875628136-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:43.227835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea4fca-affb-4460-a061-ea0e293c7eaf tempest-QuotasNegativeTest-1875628136 tempest-QuotasNegativeTest-1875628136-project-admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:43.232688 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea4fca-affb-4460-a061-ea0e293c7eaf tempest-QuotasNegativeTest-1875628136 tempest-QuotasNegativeTest-1875628136-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:11:43.233213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea4fca-affb-4460-a061-ea0e293c7eaf tempest-QuotasNegativeTest-1875628136 tempest-QuotasNegativeTest-1875628136-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:43.235475 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea4fca-affb-4460-a061-ea0e293c7eaf tempest-QuotasNegativeTest-1875628136 tempest-QuotasNegativeTest-1875628136-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:43.295560 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2617/5278] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:11:43.307917 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a538c9b-304a-417e-8ae1-0feca2d8b8de None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:43.332457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a538c9b-304a-417e-8ae1-0feca2d8b8de None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:43.344803 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce652d54-cbe2-4b5e-96f3-bba1cf5d62ce tempest-QuotasNegativeTest-1875628136 tempest-QuotasNegativeTest-1875628136-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95db4af2b1024170828e34efac41966e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eafb3e23ace14382abb5801635fe735a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:43.345593 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce652d54-cbe2-4b5e-96f3-bba1cf5d62ce tempest-QuotasNegativeTest-1875628136 tempest-QuotasNegativeTest-1875628136-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:43.345927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce652d54-cbe2-4b5e-96f3-bba1cf5d62ce tempest-QuotasNegativeTest-1875628136 tempest-QuotasNegativeTest-1875628136-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:43.346277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce652d54-cbe2-4b5e-96f3-bba1cf5d62ce tempest-QuotasNegativeTest-1875628136 tempest-QuotasNegativeTest-1875628136-project-admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:43.347307 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce652d54-cbe2-4b5e-96f3-bba1cf5d62ce tempest-QuotasNegativeTest-1875628136 tempest-QuotasNegativeTest-1875628136-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:43.349680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce652d54-cbe2-4b5e-96f3-bba1cf5d62ce tempest-QuotasNegativeTest-1875628136 tempest-QuotasNegativeTest-1875628136-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:43.409576 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2662/5279] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:11:43 2022] POST /identity/v3/projects => generated 349 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:43.414172 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea4fca-affb-4460-a061-ea0e293c7eaf tempest-QuotasNegativeTest-1875628136 tempest-QuotasNegativeTest-1875628136-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:43.432937 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea4fca-affb-4460-a061-ea0e293c7eaf tempest-QuotasNegativeTest-1875628136 tempest-QuotasNegativeTest-1875628136-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:43.460981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:43.534964 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3961d06-0482-4733-8482-a286dad15ba3 tempest-QuotasNegativeTest-1875628136 tempest-QuotasNegativeTest-1875628136-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95db4af2b1024170828e34efac41966e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eafb3e23ace14382abb5801635fe735a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:43.536848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3961d06-0482-4733-8482-a286dad15ba3 tempest-QuotasNegativeTest-1875628136 tempest-QuotasNegativeTest-1875628136-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:43.538013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3961d06-0482-4733-8482-a286dad15ba3 tempest-QuotasNegativeTest-1875628136 tempest-QuotasNegativeTest-1875628136-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:43.538910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3961d06-0482-4733-8482-a286dad15ba3 tempest-QuotasNegativeTest-1875628136 tempest-QuotasNegativeTest-1875628136-project-admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:43.539176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3961d06-0482-4733-8482-a286dad15ba3 tempest-QuotasNegativeTest-1875628136 tempest-QuotasNegativeTest-1875628136-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:11:43.539490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3961d06-0482-4733-8482-a286dad15ba3 tempest-QuotasNegativeTest-1875628136 tempest-QuotasNegativeTest-1875628136-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:43.545131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3961d06-0482-4733-8482-a286dad15ba3 tempest-QuotasNegativeTest-1875628136 tempest-QuotasNegativeTest-1875628136-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:43.584395 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2618/5280] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:11:43.631502 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce652d54-cbe2-4b5e-96f3-bba1cf5d62ce tempest-QuotasNegativeTest-1875628136 tempest-QuotasNegativeTest-1875628136-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:43.710000 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce652d54-cbe2-4b5e-96f3-bba1cf5d62ce tempest-QuotasNegativeTest-1875628136 tempest-QuotasNegativeTest-1875628136-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:43.720085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc841b86-b550-4f4d-9c0b-1737ce4b69a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:43.721113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc841b86-b550-4f4d-9c0b-1737ce4b69a9 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:43.721554 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc841b86-b550-4f4d-9c0b-1737ce4b69a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:43.722052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc841b86-b550-4f4d-9c0b-1737ce4b69a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:43.768319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc841b86-b550-4f4d-9c0b-1737ce4b69a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:43.773568 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc841b86-b550-4f4d-9c0b-1737ce4b69a9 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:43.801574 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2663/5281] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:11:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:11:43.802467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3961d06-0482-4733-8482-a286dad15ba3 tempest-QuotasNegativeTest-1875628136 tempest-QuotasNegativeTest-1875628136-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:43.805142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b3961d06-0482-4733-8482-a286dad15ba3 tempest-QuotasNegativeTest-1875628136 tempest-QuotasNegativeTest-1875628136-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:43.933117 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3961d06-0482-4733-8482-a286dad15ba3 tempest-QuotasNegativeTest-1875628136 tempest-QuotasNegativeTest-1875628136-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:43.945032 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729318ef-261f-4ccd-959a-253bacda328d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:43.945859 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729318ef-261f-4ccd-959a-253bacda328d service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:43.947142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729318ef-261f-4ccd-959a-253bacda328d service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:43.947677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729318ef-261f-4ccd-959a-253bacda328d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:43.950870 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-729318ef-261f-4ccd-959a-253bacda328d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:43.995551 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729318ef-261f-4ccd-959a-253bacda328d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:43.997947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729318ef-261f-4ccd-959a-253bacda328d service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:44.038828 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2619/5282] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:11:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:11:49.288554 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ba04f-9b14-4061-8d50-0ca60c5b2c23 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:49.289051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ba04f-9b14-4061-8d50-0ca60c5b2c23 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:49.289230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ba04f-9b14-4061-8d50-0ca60c5b2c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:49.319923 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:49.338539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-707ba04f-9b14-4061-8d50-0ca60c5b2c23 None None] MFA Rules not processed for user `c1c8ba4023a444a4baa633b5c599213e`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:49.343267 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-707ba04f-9b14-4061-8d50-0ca60c5b2c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:49.557970 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676f47f-f653-4814-bb80-6fc3b8b187da None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:49.558558 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676f47f-f653-4814-bb80-6fc3b8b187da None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:49.558797 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676f47f-f653-4814-bb80-6fc3b8b187da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:49.569925 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2664/5283] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:49 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:49.590278 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-1676f47f-f653-4814-bb80-6fc3b8b187da None None] MFA Rules not processed for user `c1c8ba4023a444a4baa633b5c599213e`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:49.591698 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1676f47f-f653-4814-bb80-6fc3b8b187da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:49.618570 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2620/5284] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:49 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:49.648052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ba04f-9b14-4061-8d50-0ca60c5b2c23 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:49.649779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-707ba04f-9b14-4061-8d50-0ca60c5b2c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:49.844091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ba04f-9b14-4061-8d50-0ca60c5b2c23 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:49.856806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c77fc4-8fbd-4769-beba-65cb9924a676 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:49.857480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c77fc4-8fbd-4769-beba-65cb9924a676 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:49.858231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c77fc4-8fbd-4769-beba-65cb9924a676 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:49.858511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c77fc4-8fbd-4769-beba-65cb9924a676 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:49.879390 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c77fc4-8fbd-4769-beba-65cb9924a676 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:49.881070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c77fc4-8fbd-4769-beba-65cb9924a676 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:49.920077 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2665/5285] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:11:49 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:11:50.150524 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676f47f-f653-4814-bb80-6fc3b8b187da None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:50.169842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676f47f-f653-4814-bb80-6fc3b8b187da None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:50.178057 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd7758-194f-45ef-83dd-4830cf9e5d2c tempest-QuotasNegativeTest-1875628136 tempest-QuotasNegativeTest-1875628136-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95db4af2b1024170828e34efac41966e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eafb3e23ace14382abb5801635fe735a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:50.189434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd7758-194f-45ef-83dd-4830cf9e5d2c tempest-QuotasNegativeTest-1875628136 tempest-QuotasNegativeTest-1875628136-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:50.191033 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd7758-194f-45ef-83dd-4830cf9e5d2c tempest-QuotasNegativeTest-1875628136 tempest-QuotasNegativeTest-1875628136-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:50.191538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd7758-194f-45ef-83dd-4830cf9e5d2c tempest-QuotasNegativeTest-1875628136 tempest-QuotasNegativeTest-1875628136-project-admin] PATH_INFO: `/v3/projects/8c73258e2b444b50922e4f3b75aee296` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:50.194020 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd7758-194f-45ef-83dd-4830cf9e5d2c tempest-QuotasNegativeTest-1875628136 tempest-QuotasNegativeTest-1875628136-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8c73258e2b444b50922e4f3b75aee296)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:50.197254 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd7758-194f-45ef-83dd-4830cf9e5d2c tempest-QuotasNegativeTest-1875628136 tempest-QuotasNegativeTest-1875628136-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:50.344661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-76bd7758-194f-45ef-83dd-4830cf9e5d2c tempest-QuotasNegativeTest-1875628136 tempest-QuotasNegativeTest-1875628136-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c73258e2b444b50922e4f3b75aee296', 'request_id': 'req-76bd7758-194f-45ef-83dd-4830cf9e5d2c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:50.369678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-76bd7758-194f-45ef-83dd-4830cf9e5d2c tempest-QuotasNegativeTest-1875628136 tempest-QuotasNegativeTest-1875628136-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c73258e2b444b50922e4f3b75aee296', 'request_id': 'req-76bd7758-194f-45ef-83dd-4830cf9e5d2c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:50.391506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-76bd7758-194f-45ef-83dd-4830cf9e5d2c tempest-QuotasNegativeTest-1875628136 tempest-QuotasNegativeTest-1875628136-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c73258e2b444b50922e4f3b75aee296', 'request_id': 'req-76bd7758-194f-45ef-83dd-4830cf9e5d2c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:50.431887 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-76bd7758-194f-45ef-83dd-4830cf9e5d2c tempest-QuotasNegativeTest-1875628136 tempest-QuotasNegativeTest-1875628136-project-admin] The token cache is being invalidate because project 8c73258e2b444b50922e4f3b75aee296 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:11:50.433410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-76bd7758-194f-45ef-83dd-4830cf9e5d2c tempest-QuotasNegativeTest-1875628136 tempest-QuotasNegativeTest-1875628136-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:50.435003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-76bd7758-194f-45ef-83dd-4830cf9e5d2c tempest-QuotasNegativeTest-1875628136 tempest-QuotasNegativeTest-1875628136-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:50.437348 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2621/5286] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:11:50 2022] DELETE /identity/v3/projects/8c73258e2b444b50922e4f3b75aee296 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:50.442240 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c77fc4-8fbd-4769-beba-65cb9924a676 service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:50.582660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c77fc4-8fbd-4769-beba-65cb9924a676 service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:50.652429 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:50.708448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb10cb0-d4ea-41d4-847a-8f70b22dbb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:50.709081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb10cb0-d4ea-41d4-847a-8f70b22dbb83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:50.709356 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb10cb0-d4ea-41d4-847a-8f70b22dbb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:50.709658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb10cb0-d4ea-41d4-847a-8f70b22dbb83 admin admin] PATH_INFO: `/v3/users/0d16dc01bd0d456d9059b6297a756d53` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:50.710873 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb10cb0-d4ea-41d4-847a-8f70b22dbb83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d16dc01bd0d456d9059b6297a756d53)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:50.714293 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb10cb0-d4ea-41d4-847a-8f70b22dbb83 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:50.795682 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-edb10cb0-d4ea-41d4-847a-8f70b22dbb83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d16dc01bd0d456d9059b6297a756d53'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:50.805530 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-edb10cb0-d4ea-41d4-847a-8f70b22dbb83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d16dc01bd0d456d9059b6297a756d53'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:50.806476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-edb10cb0-d4ea-41d4-847a-8f70b22dbb83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d16dc01bd0d456d9059b6297a756d53'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:50.807275 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-edb10cb0-d4ea-41d4-847a-8f70b22dbb83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d16dc01bd0d456d9059b6297a756d53'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:50.819720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-edb10cb0-d4ea-41d4-847a-8f70b22dbb83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d16dc01bd0d456d9059b6297a756d53'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:50.841306 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2666/5287] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:11:50 2022] DELETE /identity/v3/users/0d16dc01bd0d456d9059b6297a756d53 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:50.845574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc81e9-64a0-44d4-9670-df7d3a9a5dbe None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:50.846086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc81e9-64a0-44d4-9670-df7d3a9a5dbe None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:50.846368 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc81e9-64a0-44d4-9670-df7d3a9a5dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:50.880766 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-78bc81e9-64a0-44d4-9670-df7d3a9a5dbe None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:50.882662 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-78bc81e9-64a0-44d4-9670-df7d3a9a5dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:50.900821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:50.990575 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2622/5288] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:11:51.044283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb10cb0-d4ea-41d4-847a-8f70b22dbb83 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:51.047011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-edb10cb0-d4ea-41d4-847a-8f70b22dbb83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:51.151630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb10cb0-d4ea-41d4-847a-8f70b22dbb83 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:51.156634 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626eb2e1-4733-42c1-8b47-c5052abda464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:51.157277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626eb2e1-4733-42c1-8b47-c5052abda464 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:51.157561 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626eb2e1-4733-42c1-8b47-c5052abda464 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:51.157845 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626eb2e1-4733-42c1-8b47-c5052abda464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:51.171319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626eb2e1-4733-42c1-8b47-c5052abda464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:51.172805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626eb2e1-4733-42c1-8b47-c5052abda464 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:51.185953 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2667/5289] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:11:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:11:51.194947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc81e9-64a0-44d4-9670-df7d3a9a5dbe None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:51.196625 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-78bc81e9-64a0-44d4-9670-df7d3a9a5dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:51.235158 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc81e9-64a0-44d4-9670-df7d3a9a5dbe None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:51.242259 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4e2b1-0315-4310-b14f-e96d1d34ae58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:51.243299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4e2b1-0315-4310-b14f-e96d1d34ae58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:51.243733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4e2b1-0315-4310-b14f-e96d1d34ae58 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:51.244111 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4e2b1-0315-4310-b14f-e96d1d34ae58 admin admin] PATH_INFO: `/v3/users/5ce76917906b41138c4630376d69e37b` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:51.246071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4e2b1-0315-4310-b14f-e96d1d34ae58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ce76917906b41138c4630376d69e37b)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:51.251965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4e2b1-0315-4310-b14f-e96d1d34ae58 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:51.390139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3bc4e2b1-0315-4310-b14f-e96d1d34ae58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ce76917906b41138c4630376d69e37b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:51.392167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3bc4e2b1-0315-4310-b14f-e96d1d34ae58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ce76917906b41138c4630376d69e37b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:51.393542 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3bc4e2b1-0315-4310-b14f-e96d1d34ae58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ce76917906b41138c4630376d69e37b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:51.407987 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3bc4e2b1-0315-4310-b14f-e96d1d34ae58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ce76917906b41138c4630376d69e37b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:51.444604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3bc4e2b1-0315-4310-b14f-e96d1d34ae58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ce76917906b41138c4630376d69e37b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:51.490503 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2623/5290] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:11:51 2022] DELETE /identity/v3/users/5ce76917906b41138c4630376d69e37b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:51.495803 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33aef00-7fef-4889-9a93-cffa875b02d7 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:51.497278 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33aef00-7fef-4889-9a93-cffa875b02d7 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:51.498311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33aef00-7fef-4889-9a93-cffa875b02d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:51.536969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-f33aef00-7fef-4889-9a93-cffa875b02d7 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:51.538455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f33aef00-7fef-4889-9a93-cffa875b02d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:51.609858 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:51.632159 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2668/5291] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:51.654809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4e2b1-0315-4310-b14f-e96d1d34ae58 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:51.656304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3bc4e2b1-0315-4310-b14f-e96d1d34ae58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:51.785495 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4e2b1-0315-4310-b14f-e96d1d34ae58 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:51.793871 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1273f8e-9c1d-4fc3-9318-57ef79dbe9cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:51.795029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1273f8e-9c1d-4fc3-9318-57ef79dbe9cb service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:51.795166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1273f8e-9c1d-4fc3-9318-57ef79dbe9cb service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:51.796257 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1273f8e-9c1d-4fc3-9318-57ef79dbe9cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:51.834133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1273f8e-9c1d-4fc3-9318-57ef79dbe9cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:51.835989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1273f8e-9c1d-4fc3-9318-57ef79dbe9cb service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:51.876414 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2624/5292] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:11:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:11:53.117559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33aef00-7fef-4889-9a93-cffa875b02d7 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:53.122599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f33aef00-7fef-4889-9a93-cffa875b02d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:53.167018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33aef00-7fef-4889-9a93-cffa875b02d7 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:53.186446 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf365cf-8b62-481b-8efa-11c65c6c4ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:53.187389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf365cf-8b62-481b-8efa-11c65c6c4ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:53.187739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf365cf-8b62-481b-8efa-11c65c6c4ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:53.188022 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf365cf-8b62-481b-8efa-11c65c6c4ce4 admin admin] PATH_INFO: `/v3/projects/42a29744f49044b892a9c84345a44f7e` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:53.189259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf365cf-8b62-481b-8efa-11c65c6c4ce4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42a29744f49044b892a9c84345a44f7e)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:53.200454 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf365cf-8b62-481b-8efa-11c65c6c4ce4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:53.304894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5bf365cf-8b62-481b-8efa-11c65c6c4ce4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42a29744f49044b892a9c84345a44f7e', 'request_id': 'req-5bf365cf-8b62-481b-8efa-11c65c6c4ce4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:53.314574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5bf365cf-8b62-481b-8efa-11c65c6c4ce4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42a29744f49044b892a9c84345a44f7e', 'request_id': 'req-5bf365cf-8b62-481b-8efa-11c65c6c4ce4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:53.327092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5bf365cf-8b62-481b-8efa-11c65c6c4ce4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42a29744f49044b892a9c84345a44f7e', 'request_id': 'req-5bf365cf-8b62-481b-8efa-11c65c6c4ce4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:53.358442 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5bf365cf-8b62-481b-8efa-11c65c6c4ce4 admin admin] The token cache is being invalidate because project 42a29744f49044b892a9c84345a44f7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:11:53.358950 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5bf365cf-8b62-481b-8efa-11c65c6c4ce4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:53.359763 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5bf365cf-8b62-481b-8efa-11c65c6c4ce4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:53.365162 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2669/5293] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:11:53 2022] DELETE /identity/v3/projects/42a29744f49044b892a9c84345a44f7e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:53.366668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1273f8e-9c1d-4fc3-9318-57ef79dbe9cb service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:53.381408 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1273f8e-9c1d-4fc3-9318-57ef79dbe9cb service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:53.432579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:53.465000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea85e10-a378-416d-a9ed-cc2a224fa377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:53.465641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea85e10-a378-416d-a9ed-cc2a224fa377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:53.465964 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea85e10-a378-416d-a9ed-cc2a224fa377 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:53.466240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea85e10-a378-416d-a9ed-cc2a224fa377 admin admin] PATH_INFO: `/v3/users/95db4af2b1024170828e34efac41966e` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:53.467384 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea85e10-a378-416d-a9ed-cc2a224fa377 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95db4af2b1024170828e34efac41966e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:53.469620 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea85e10-a378-416d-a9ed-cc2a224fa377 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:53.523141 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dea85e10-a378-416d-a9ed-cc2a224fa377 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95db4af2b1024170828e34efac41966e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:53.524119 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dea85e10-a378-416d-a9ed-cc2a224fa377 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95db4af2b1024170828e34efac41966e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:53.524717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dea85e10-a378-416d-a9ed-cc2a224fa377 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95db4af2b1024170828e34efac41966e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:53.533648 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dea85e10-a378-416d-a9ed-cc2a224fa377 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95db4af2b1024170828e34efac41966e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:53.549024 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dea85e10-a378-416d-a9ed-cc2a224fa377 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95db4af2b1024170828e34efac41966e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:53.568889 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2625/5294] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:11:53 2022] DELETE /identity/v3/users/95db4af2b1024170828e34efac41966e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:53.769085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf365cf-8b62-481b-8efa-11c65c6c4ce4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:53.770821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5bf365cf-8b62-481b-8efa-11c65c6c4ce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:53.820280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf365cf-8b62-481b-8efa-11c65c6c4ce4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:53.984144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b3a66-def7-4b7c-96a1-193b37ecd8d4 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:53.984325 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b3a66-def7-4b7c-96a1-193b37ecd8d4 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:53.984763 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b3a66-def7-4b7c-96a1-193b37ecd8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:54.023397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d1e49-1871-43dd-8d8f-a7a56369ca12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:54.026081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d1e49-1871-43dd-8d8f-a7a56369ca12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:54.026236 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d1e49-1871-43dd-8d8f-a7a56369ca12 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:54.026706 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d1e49-1871-43dd-8d8f-a7a56369ca12 admin admin] PATH_INFO: `/v3/projects/31c83019f0d740978cde1ca90ba5d680` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:54.028668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d1e49-1871-43dd-8d8f-a7a56369ca12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31c83019f0d740978cde1ca90ba5d680)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:54.046059 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-9f0b3a66-def7-4b7c-96a1-193b37ecd8d4 None None] MFA Rules not processed for user `1d7b9e27983940dcaf0e92f62273c588`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:54.047252 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9f0b3a66-def7-4b7c-96a1-193b37ecd8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:54.049815 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d1e49-1871-43dd-8d8f-a7a56369ca12 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:54.159937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-af8d1e49-1871-43dd-8d8f-a7a56369ca12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31c83019f0d740978cde1ca90ba5d680', 'request_id': 'req-af8d1e49-1871-43dd-8d8f-a7a56369ca12'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:54.185581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-af8d1e49-1871-43dd-8d8f-a7a56369ca12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31c83019f0d740978cde1ca90ba5d680', 'request_id': 'req-af8d1e49-1871-43dd-8d8f-a7a56369ca12'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:54.198061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-af8d1e49-1871-43dd-8d8f-a7a56369ca12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31c83019f0d740978cde1ca90ba5d680', 'request_id': 'req-af8d1e49-1871-43dd-8d8f-a7a56369ca12'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:54.213405 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2626/5295] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:54.217369 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-af8d1e49-1871-43dd-8d8f-a7a56369ca12 admin admin] The token cache is being invalidate because project 31c83019f0d740978cde1ca90ba5d680 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:11:54.217862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-af8d1e49-1871-43dd-8d8f-a7a56369ca12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:54.218859 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-af8d1e49-1871-43dd-8d8f-a7a56369ca12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:54.221582 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2670/5296] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:11:53 2022] DELETE /identity/v3/projects/31c83019f0d740978cde1ca90ba5d680 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:54.225436 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b3a66-def7-4b7c-96a1-193b37ecd8d4 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:54.227859 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9f0b3a66-def7-4b7c-96a1-193b37ecd8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:54.244106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b3a66-def7-4b7c-96a1-193b37ecd8d4 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:54.394510 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aedeed8-d46a-4f39-8f5f-314ddc1f66e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:54.396998 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aedeed8-d46a-4f39-8f5f-314ddc1f66e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:54.397950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aedeed8-d46a-4f39-8f5f-314ddc1f66e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:54.398392 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aedeed8-d46a-4f39-8f5f-314ddc1f66e3 admin admin] PATH_INFO: `/v3/users/56a43c894004417fa3557e5bc8dfff3d` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:54.404913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aedeed8-d46a-4f39-8f5f-314ddc1f66e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56a43c894004417fa3557e5bc8dfff3d)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:54.406998 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aedeed8-d46a-4f39-8f5f-314ddc1f66e3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:54.412983 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:54.490963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d1e49-1871-43dd-8d8f-a7a56369ca12 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:54.492874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-af8d1e49-1871-43dd-8d8f-a7a56369ca12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:54.515466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d1e49-1871-43dd-8d8f-a7a56369ca12 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:54.523792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a021258-ee72-4601-b38d-631a49d4683a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:54.524585 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a021258-ee72-4601-b38d-631a49d4683a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:54.524974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a021258-ee72-4601-b38d-631a49d4683a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:54.525324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a021258-ee72-4601-b38d-631a49d4683a admin admin] PATH_INFO: `/v3/projects/eafb3e23ace14382abb5801635fe735a` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:54.527814 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a021258-ee72-4601-b38d-631a49d4683a admin admin] RBAC: Authorizing `identity:delete_project(project_id=eafb3e23ace14382abb5801635fe735a)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:54.529085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1aedeed8-d46a-4f39-8f5f-314ddc1f66e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56a43c894004417fa3557e5bc8dfff3d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:54.529959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1aedeed8-d46a-4f39-8f5f-314ddc1f66e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56a43c894004417fa3557e5bc8dfff3d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:54.530759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1aedeed8-d46a-4f39-8f5f-314ddc1f66e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56a43c894004417fa3557e5bc8dfff3d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:54.530886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a021258-ee72-4601-b38d-631a49d4683a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:54.540655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:54.552689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1aedeed8-d46a-4f39-8f5f-314ddc1f66e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56a43c894004417fa3557e5bc8dfff3d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:54.583644 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1aedeed8-d46a-4f39-8f5f-314ddc1f66e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56a43c894004417fa3557e5bc8dfff3d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:54.629817 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2627/5297] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:11:54 2022] DELETE /identity/v3/users/56a43c894004417fa3557e5bc8dfff3d => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:54.754152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2a021258-ee72-4601-b38d-631a49d4683a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eafb3e23ace14382abb5801635fe735a', 'request_id': 'req-2a021258-ee72-4601-b38d-631a49d4683a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:54.772361 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2a021258-ee72-4601-b38d-631a49d4683a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eafb3e23ace14382abb5801635fe735a', 'request_id': 'req-2a021258-ee72-4601-b38d-631a49d4683a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:54.783537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2a021258-ee72-4601-b38d-631a49d4683a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eafb3e23ace14382abb5801635fe735a', 'request_id': 'req-2a021258-ee72-4601-b38d-631a49d4683a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:54.805108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2a021258-ee72-4601-b38d-631a49d4683a admin admin] The token cache is being invalidate because project eafb3e23ace14382abb5801635fe735a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:11:54.805693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2a021258-ee72-4601-b38d-631a49d4683a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:54.806776 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2a021258-ee72-4601-b38d-631a49d4683a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:54.810504 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2671/5298] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:11:54 2022] DELETE /identity/v3/projects/eafb3e23ace14382abb5801635fe735a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:54.815199 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbdeea2-5c1e-42bc-9fe5-a3502f53ee40 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:54.815793 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbdeea2-5c1e-42bc-9fe5-a3502f53ee40 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:54.816265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbdeea2-5c1e-42bc-9fe5-a3502f53ee40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:54.847982 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-ccbdeea2-5c1e-42bc-9fe5-a3502f53ee40 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:54.852341 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ccbdeea2-5c1e-42bc-9fe5-a3502f53ee40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:54.972240 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2628/5299] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:11:54.981984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf221431-b6e4-41bc-874e-c1d26b32e633 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:54.982309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf221431-b6e4-41bc-874e-c1d26b32e633 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:54.982594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf221431-b6e4-41bc-874e-c1d26b32e633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:55.014112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-cf221431-b6e4-41bc-874e-c1d26b32e633 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:55.016478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-cf221431-b6e4-41bc-874e-c1d26b32e633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:55.052849 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2672/5300] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:55.055083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbdeea2-5c1e-42bc-9fe5-a3502f53ee40 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:55.074594 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbdeea2-5c1e-42bc-9fe5-a3502f53ee40 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:55.089476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bfe135-6bfd-4d40-96e5-e27e328a187d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:55.090958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfe135-6bfd-4d40-96e5-e27e328a187d admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:55.092765 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfe135-6bfd-4d40-96e5-e27e328a187d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:55.093822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfe135-6bfd-4d40-96e5-e27e328a187d admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:55.095696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bfe135-6bfd-4d40-96e5-e27e328a187d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:11:55.096088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bfe135-6bfd-4d40-96e5-e27e328a187d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:55.102586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bfe135-6bfd-4d40-96e5-e27e328a187d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:55.130596 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2629/5301] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:11:55.134149 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf221431-b6e4-41bc-874e-c1d26b32e633 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:55.146857 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf221431-b6e4-41bc-874e-c1d26b32e633 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:55.154455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa7f1d-4f87-4169-b8b2-8f6c57a6965b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:55.157078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa7f1d-4f87-4169-b8b2-8f6c57a6965b admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:55.157207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa7f1d-4f87-4169-b8b2-8f6c57a6965b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:55.157414 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa7f1d-4f87-4169-b8b2-8f6c57a6965b admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:55.158047 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa7f1d-4f87-4169-b8b2-8f6c57a6965b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:55.161080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa7f1d-4f87-4169-b8b2-8f6c57a6965b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:55.208637 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bfe135-6bfd-4d40-96e5-e27e328a187d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:55.222681 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2673/5302] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:11:55 2022] POST /identity/v3/projects => generated 391 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:55.230787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bfe135-6bfd-4d40-96e5-e27e328a187d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:55.273957 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa7f1d-4f87-4169-b8b2-8f6c57a6965b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:55.276028 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b0fa7f1d-4f87-4169-b8b2-8f6c57a6965b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:55.347817 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723722f7-b901-49fa-9979-8ff776381f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:55.348346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723722f7-b901-49fa-9979-8ff776381f1d admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:55.348671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723722f7-b901-49fa-9979-8ff776381f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:55.348895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723722f7-b901-49fa-9979-8ff776381f1d admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:55.349520 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723722f7-b901-49fa-9979-8ff776381f1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:55.351496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723722f7-b901-49fa-9979-8ff776381f1d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:55.366459 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:55.402244 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2630/5303] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:11:55 2022] POST /identity/v3/users => generated 296 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:55.404251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723722f7-b901-49fa-9979-8ff776381f1d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:55.418164 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723722f7-b901-49fa-9979-8ff776381f1d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:55.422096 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0bcf4-6b81-4a2f-8437-4653c0212fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:55.422801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0bcf4-6b81-4a2f-8437-4653c0212fcc admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:55.423088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0bcf4-6b81-4a2f-8437-4653c0212fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:55.423369 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0bcf4-6b81-4a2f-8437-4653c0212fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:55.424327 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0bcf4-6b81-4a2f-8437-4653c0212fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:55.426181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0bcf4-6b81-4a2f-8437-4653c0212fcc admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:55.434682 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa7f1d-4f87-4169-b8b2-8f6c57a6965b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:55.442787 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2631/5304] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:55.445009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0bcf4-6b81-4a2f-8437-4653c0212fcc admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:55.447295 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e3789-676f-48fa-a79a-a10712a0fb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:55.450904 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e3789-676f-48fa-a79a-a10712a0fb29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:55.451825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e3789-676f-48fa-a79a-a10712a0fb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:55.452244 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e3789-676f-48fa-a79a-a10712a0fb29 admin admin] PATH_INFO: `/v3/projects/24fc62801f8540a9bca482ccc6bb35d3` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:55.453679 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e3789-676f-48fa-a79a-a10712a0fb29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24fc62801f8540a9bca482ccc6bb35d3)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:55.456145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e3789-676f-48fa-a79a-a10712a0fb29 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:55.465880 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0bcf4-6b81-4a2f-8437-4653c0212fcc admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:55.473009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf8cd3-21e7-4505-bb89-a935bb5ddc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:55.473857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf8cd3-21e7-4505-bb89-a935bb5ddc02 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:55.474289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf8cd3-21e7-4505-bb89-a935bb5ddc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:55.474814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf8cd3-21e7-4505-bb89-a935bb5ddc02 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:55.477538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf8cd3-21e7-4505-bb89-a935bb5ddc02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:55.483500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf8cd3-21e7-4505-bb89-a935bb5ddc02 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:55.507231 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2632/5305] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:55.510957 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf8cd3-21e7-4505-bb89-a935bb5ddc02 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:55.545458 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf8cd3-21e7-4505-bb89-a935bb5ddc02 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:55.563711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-962e3789-676f-48fa-a79a-a10712a0fb29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24fc62801f8540a9bca482ccc6bb35d3', 'request_id': 'req-962e3789-676f-48fa-a79a-a10712a0fb29'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:55.590699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-962e3789-676f-48fa-a79a-a10712a0fb29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24fc62801f8540a9bca482ccc6bb35d3', 'request_id': 'req-962e3789-676f-48fa-a79a-a10712a0fb29'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:55.631843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-962e3789-676f-48fa-a79a-a10712a0fb29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24fc62801f8540a9bca482ccc6bb35d3', 'request_id': 'req-962e3789-676f-48fa-a79a-a10712a0fb29'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:55.633231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:55.658366 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-962e3789-676f-48fa-a79a-a10712a0fb29 admin admin] The token cache is being invalidate because project 24fc62801f8540a9bca482ccc6bb35d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:11:55.658750 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-962e3789-676f-48fa-a79a-a10712a0fb29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:55.659410 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-962e3789-676f-48fa-a79a-a10712a0fb29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:11:55.664878 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2674/5306] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:11:55 2022] DELETE /identity/v3/projects/24fc62801f8540a9bca482ccc6bb35d3 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:55.666491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41679e95-f737-4fac-9072-28810b309033 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:55.666917 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41679e95-f737-4fac-9072-28810b309033 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:55.667641 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41679e95-f737-4fac-9072-28810b309033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:55.682205 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77973f-bad0-4e77-b954-4ad32fa9ed3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:55.685597 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77973f-bad0-4e77-b954-4ad32fa9ed3e admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:55.687388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77973f-bad0-4e77-b954-4ad32fa9ed3e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:55.688074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77973f-bad0-4e77-b954-4ad32fa9ed3e admin admin] PATH_INFO: `/v3/projects/7a28563fd4f04c1eb50e1249d8874ee7/users/36cd9c1d9ccd4d7c8a0998af9b225b17/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:55.719660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-41679e95-f737-4fac-9072-28810b309033 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:55.721051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-41679e95-f737-4fac-9072-28810b309033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:55.725975 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d77973f-bad0-4e77-b954-4ad32fa9ed3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a28563fd4f04c1eb50e1249d8874ee7, user_id=36cd9c1d9ccd4d7c8a0998af9b225b17, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:55.731569 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d77973f-bad0-4e77-b954-4ad32fa9ed3e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:55.740155 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2675/5307] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:55.742159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed63676-071a-4a5a-9841-89c61c14d9e1 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:55.742450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed63676-071a-4a5a-9841-89c61c14d9e1 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:55.743062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed63676-071a-4a5a-9841-89c61c14d9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:55.759309 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2633/5308] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:11:55 2022] PUT /identity/v3/projects/7a28563fd4f04c1eb50e1249d8874ee7/users/36cd9c1d9ccd4d7c8a0998af9b225b17/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:55.772216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d81352-61b5-4ac2-8fc3-ac94ee0ea173 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:55.772503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d81352-61b5-4ac2-8fc3-ac94ee0ea173 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:55.772773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d81352-61b5-4ac2-8fc3-ac94ee0ea173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:55.779913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-1ed63676-071a-4a5a-9841-89c61c14d9e1 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:55.781551 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1ed63676-071a-4a5a-9841-89c61c14d9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:55.846216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-36d81352-61b5-4ac2-8fc3-ac94ee0ea173 None None] MFA Rules not processed for user `36cd9c1d9ccd4d7c8a0998af9b225b17`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:55.848902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-36d81352-61b5-4ac2-8fc3-ac94ee0ea173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:55.926413 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2676/5309] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:55.932252 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed63676-071a-4a5a-9841-89c61c14d9e1 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:55.951780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed63676-071a-4a5a-9841-89c61c14d9e1 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:55.967795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a47b8-b5dc-465f-a574-32c96d9afd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:55.968423 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a47b8-b5dc-465f-a574-32c96d9afd56 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:55.968705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a47b8-b5dc-465f-a574-32c96d9afd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:55.968978 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a47b8-b5dc-465f-a574-32c96d9afd56 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:55.969637 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a47b8-b5dc-465f-a574-32c96d9afd56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:11:55.969942 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a47b8-b5dc-465f-a574-32c96d9afd56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:55.974876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a47b8-b5dc-465f-a574-32c96d9afd56 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:56.010920 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2634/5310] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:56.015224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d81352-61b5-4ac2-8fc3-ac94ee0ea173 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:56.017231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-36d81352-61b5-4ac2-8fc3-ac94ee0ea173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:56.022363 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2677/5311] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:11:56.023457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a47b8-b5dc-465f-a574-32c96d9afd56 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:56.036315 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a47b8-b5dc-465f-a574-32c96d9afd56 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:56.041860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9763744-4398-466c-b306-8b361b88a442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:56.042796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9763744-4398-466c-b306-8b361b88a442 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:56.043254 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9763744-4398-466c-b306-8b361b88a442 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:56.043727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9763744-4398-466c-b306-8b361b88a442 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:56.045070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d81352-61b5-4ac2-8fc3-ac94ee0ea173 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:56.045220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9763744-4398-466c-b306-8b361b88a442 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:56.047667 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9763744-4398-466c-b306-8b361b88a442 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:56.062368 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac5fa7e-35d0-40a3-9170-4045ce1de31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:56.064882 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac5fa7e-35d0-40a3-9170-4045ce1de31d admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:56.066528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac5fa7e-35d0-40a3-9170-4045ce1de31d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:56.066841 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac5fa7e-35d0-40a3-9170-4045ce1de31d admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:56.070987 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac5fa7e-35d0-40a3-9170-4045ce1de31d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:56.079174 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac5fa7e-35d0-40a3-9170-4045ce1de31d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:56.126436 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2678/5312] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:11:56 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:56.131572 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9763744-4398-466c-b306-8b361b88a442 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:56.156004 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2635/5313] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:11:56 2022] POST /identity/v3/projects => generated 393 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:56.159977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac5fa7e-35d0-40a3-9170-4045ce1de31d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:56.240553 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9763744-4398-466c-b306-8b361b88a442 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:56.244697 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:56.314755 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac5fa7e-35d0-40a3-9170-4045ce1de31d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:56.354661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b6988-56e7-4307-a2cc-d20931f7fc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:56.355572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b6988-56e7-4307-a2cc-d20931f7fc68 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:56.355966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b6988-56e7-4307-a2cc-d20931f7fc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:56.356834 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b6988-56e7-4307-a2cc-d20931f7fc68 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:56.360180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41b6988-56e7-4307-a2cc-d20931f7fc68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:56.364629 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41b6988-56e7-4307-a2cc-d20931f7fc68 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:56.407720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58466e-5b8e-436a-bbf4-1f32f8a411ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:56.409155 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58466e-5b8e-436a-bbf4-1f32f8a411ee admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:56.409443 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58466e-5b8e-436a-bbf4-1f32f8a411ee admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:56.409742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58466e-5b8e-436a-bbf4-1f32f8a411ee admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:56.410409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58466e-5b8e-436a-bbf4-1f32f8a411ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:56.412601 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58466e-5b8e-436a-bbf4-1f32f8a411ee admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:56.415446 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2636/5314] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:11:56 2022] POST /identity/v3/users => generated 303 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:56.422316 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:56.423487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b6988-56e7-4307-a2cc-d20931f7fc68 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:56.451574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b6988-56e7-4307-a2cc-d20931f7fc68 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:56.462582 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2679/5315] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:11:56 2022] POST /identity/v3/users => generated 292 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:11:56.464114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58466e-5b8e-436a-bbf4-1f32f8a411ee admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:56.467751 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3789a5d-e8b0-4298-8238-ac32515e2236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:56.471904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3789a5d-e8b0-4298-8238-ac32515e2236 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:56.471904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3789a5d-e8b0-4298-8238-ac32515e2236 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:56.471904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3789a5d-e8b0-4298-8238-ac32515e2236 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:56.471904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3789a5d-e8b0-4298-8238-ac32515e2236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:56.471904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3789a5d-e8b0-4298-8238-ac32515e2236 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:56.487565 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58466e-5b8e-436a-bbf4-1f32f8a411ee admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:56.495151 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2637/5316] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:56.503872 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a0b3a-1960-4e65-a4d9-62aa446a6d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:56.504573 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a0b3a-1960-4e65-a4d9-62aa446a6d46 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:56.504809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a0b3a-1960-4e65-a4d9-62aa446a6d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:56.505085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a0b3a-1960-4e65-a4d9-62aa446a6d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:56.505787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a0b3a-1960-4e65-a4d9-62aa446a6d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:56.515125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a0b3a-1960-4e65-a4d9-62aa446a6d46 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:56.520031 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3789a5d-e8b0-4298-8238-ac32515e2236 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:56.532298 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3789a5d-e8b0-4298-8238-ac32515e2236 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:56.538364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfdb6e-2f6f-4689-8978-f92f192525c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:56.539374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfdb6e-2f6f-4689-8978-f92f192525c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:56.540188 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfdb6e-2f6f-4689-8978-f92f192525c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:56.540725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfdb6e-2f6f-4689-8978-f92f192525c8 admin admin] PATH_INFO: `/v3/projects/292f10c5fb0246af872b271cd4ae8e55/users/bb7ba1561a5a4464a3109413f025d98b/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:56.547030 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2680/5317] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:56.556952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a0b3a-1960-4e65-a4d9-62aa446a6d46 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:56.572583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cfdb6e-2f6f-4689-8978-f92f192525c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=292f10c5fb0246af872b271cd4ae8e55, user_id=bb7ba1561a5a4464a3109413f025d98b, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:56.577434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cfdb6e-2f6f-4689-8978-f92f192525c8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:56.581128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a0b3a-1960-4e65-a4d9-62aa446a6d46 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:56.594767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552d603-5208-490b-afba-1222d576ed33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:56.595540 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552d603-5208-490b-afba-1222d576ed33 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:56.595722 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552d603-5208-490b-afba-1222d576ed33 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:56.597553 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552d603-5208-490b-afba-1222d576ed33 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:56.599410 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552d603-5208-490b-afba-1222d576ed33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:56.606101 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2638/5318] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:11:56 2022] PUT /identity/v3/projects/292f10c5fb0246af872b271cd4ae8e55/users/bb7ba1561a5a4464a3109413f025d98b/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:56.607379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552d603-5208-490b-afba-1222d576ed33 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:56.612933 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfdb6e-2f6f-4689-8978-f92f192525c8 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:56.629803 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2681/5319] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:56.635600 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552d603-5208-490b-afba-1222d576ed33 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:56.662435 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552d603-5208-490b-afba-1222d576ed33 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:56.771853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfdb6e-2f6f-4689-8978-f92f192525c8 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:56.786251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c544a4-bba5-40ed-b703-fc865e49d04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:56.787046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c544a4-bba5-40ed-b703-fc865e49d04e admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:56.787431 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c544a4-bba5-40ed-b703-fc865e49d04e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:56.787974 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c544a4-bba5-40ed-b703-fc865e49d04e admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:56.788790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c544a4-bba5-40ed-b703-fc865e49d04e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:56.804176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c544a4-bba5-40ed-b703-fc865e49d04e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:56.847706 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2639/5320] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:11:56.847829 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756454d-d075-4a8f-b9de-3beb5945a6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:56.850991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756454d-d075-4a8f-b9de-3beb5945a6e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:56.851289 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756454d-d075-4a8f-b9de-3beb5945a6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:56.851571 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756454d-d075-4a8f-b9de-3beb5945a6e1 admin admin] PATH_INFO: `/v3/projects/f194ac597db54911a36b795d29c2032f/users/3bec04c3cb8d4299942b0bd624055b6b/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:56.852006 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c544a4-bba5-40ed-b703-fc865e49d04e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:56.889608 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c544a4-bba5-40ed-b703-fc865e49d04e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:56.905400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9756454d-d075-4a8f-b9de-3beb5945a6e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f194ac597db54911a36b795d29c2032f, user_id=3bec04c3cb8d4299942b0bd624055b6b, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:56.909098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9756454d-d075-4a8f-b9de-3beb5945a6e1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:56.926810 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc387de-36e1-4741-9672-d96497c209b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:56.929951 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc387de-36e1-4741-9672-d96497c209b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:56.930355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc387de-36e1-4741-9672-d96497c209b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:56.930791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc387de-36e1-4741-9672-d96497c209b0 admin admin] PATH_INFO: `/v3/projects/292f10c5fb0246af872b271cd4ae8e55/users/bb7ba1561a5a4464a3109413f025d98b/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:56.937585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc387de-36e1-4741-9672-d96497c209b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=292f10c5fb0246af872b271cd4ae8e55, user_id=bb7ba1561a5a4464a3109413f025d98b, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:56.944816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc387de-36e1-4741-9672-d96497c209b0 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:56.945995 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2682/5321] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:11:56 2022] PUT /identity/v3/projects/f194ac597db54911a36b795d29c2032f/users/3bec04c3cb8d4299942b0bd624055b6b/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:56.960823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46b963-2c0c-4446-ae8b-9d0cf7f4eeeb None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:56.961195 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46b963-2c0c-4446-ae8b-9d0cf7f4eeeb None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:56.961479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46b963-2c0c-4446-ae8b-9d0cf7f4eeeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:56.987113 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2640/5322] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:11:56 2022] PUT /identity/v3/projects/292f10c5fb0246af872b271cd4ae8e55/users/bb7ba1561a5a4464a3109413f025d98b/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:11:57.038148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-5b46b963-2c0c-4446-ae8b-9d0cf7f4eeeb None None] MFA Rules not processed for user `3bec04c3cb8d4299942b0bd624055b6b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:57.043353 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5b46b963-2c0c-4446-ae8b-9d0cf7f4eeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:57.107264 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e23e9e-ca77-409c-870b-32e095d88387 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:57.107778 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e23e9e-ca77-409c-870b-32e095d88387 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:57.108212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e23e9e-ca77-409c-870b-32e095d88387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:57.193405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-e7e23e9e-ca77-409c-870b-32e095d88387 None None] MFA Rules not processed for user `bb7ba1561a5a4464a3109413f025d98b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:11:57.196979 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2683/5323] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:11:57.201959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e7e23e9e-ca77-409c-870b-32e095d88387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:57.213832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46b963-2c0c-4446-ae8b-9d0cf7f4eeeb None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:57.216931 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5b46b963-2c0c-4446-ae8b-9d0cf7f4eeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:57.343000 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:57.348335 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:57.396779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46b963-2c0c-4446-ae8b-9d0cf7f4eeeb None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:57.396986 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2641/5324] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:11:57 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:11:57.418251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fcb3ed-1268-43fa-a166-3704b4562808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:57.419289 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcb3ed-1268-43fa-a166-3704b4562808 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:57.419573 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcb3ed-1268-43fa-a166-3704b4562808 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:57.419847 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcb3ed-1268-43fa-a166-3704b4562808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:57.437504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fcb3ed-1268-43fa-a166-3704b4562808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:57.447487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fcb3ed-1268-43fa-a166-3704b4562808 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:57.468270 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2684/5325] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:11:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:11:57.505407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e23e9e-ca77-409c-870b-32e095d88387 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:11:57.506913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e7e23e9e-ca77-409c-870b-32e095d88387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:11:57.543191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e23e9e-ca77-409c-870b-32e095d88387 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:11:57.558356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a2c27-e847-43a7-9cd2-6f91a2e01751 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:11:57.559891 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a2c27-e847-43a7-9cd2-6f91a2e01751 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:11:57.560330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a2c27-e847-43a7-9cd2-6f91a2e01751 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:11:57.560790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a2c27-e847-43a7-9cd2-6f91a2e01751 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:11:57.596103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a2c27-e847-43a7-9cd2-6f91a2e01751 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:11:57.598175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a2c27-e847-43a7-9cd2-6f91a2e01751 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:11:57.651973 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2642/5326] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:11:57 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:12:07.457477 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=8 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:07.617128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=12 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:07.965287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fcb3ed-1268-43fa-a166-3704b4562808 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:08.102720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fcb3ed-1268-43fa-a166-3704b4562808 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:08.109008 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f7d1a-0bf9-45e7-94c1-01e996f16e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:08.110377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f7d1a-0bf9-45e7-94c1-01e996f16e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:08.110869 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f7d1a-0bf9-45e7-94c1-01e996f16e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:08.111296 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f7d1a-0bf9-45e7-94c1-01e996f16e8c admin admin] PATH_INFO: `/v3/users/36cd9c1d9ccd4d7c8a0998af9b225b17` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:08.112789 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f7d1a-0bf9-45e7-94c1-01e996f16e8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=36cd9c1d9ccd4d7c8a0998af9b225b17)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:08.115148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f7d1a-0bf9-45e7-94c1-01e996f16e8c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:08.252802 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-989f7d1a-0bf9-45e7-94c1-01e996f16e8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36cd9c1d9ccd4d7c8a0998af9b225b17'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:08.283076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-989f7d1a-0bf9-45e7-94c1-01e996f16e8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36cd9c1d9ccd4d7c8a0998af9b225b17'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:08.283903 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-989f7d1a-0bf9-45e7-94c1-01e996f16e8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36cd9c1d9ccd4d7c8a0998af9b225b17'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:08.284580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-989f7d1a-0bf9-45e7-94c1-01e996f16e8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36cd9c1d9ccd4d7c8a0998af9b225b17'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:08.312756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-989f7d1a-0bf9-45e7-94c1-01e996f16e8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36cd9c1d9ccd4d7c8a0998af9b225b17'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:08.339082 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2685/5327] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:12:07 2022] DELETE /identity/v3/users/36cd9c1d9ccd4d7c8a0998af9b225b17 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:12:08.344476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb2643-9bd8-46af-9e68-d23c75e40834 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:08.344782 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb2643-9bd8-46af-9e68-d23c75e40834 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:08.345064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb2643-9bd8-46af-9e68-d23c75e40834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:08.444534 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a2cb2643-9bd8-46af-9e68-d23c75e40834 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:08.446034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a2cb2643-9bd8-46af-9e68-d23c75e40834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:08.594138 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2643/5328] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:12:08.611314 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f7d1a-0bf9-45e7-94c1-01e996f16e8c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:08.612853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-989f7d1a-0bf9-45e7-94c1-01e996f16e8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:08.759778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f7d1a-0bf9-45e7-94c1-01e996f16e8c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:08.766318 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27032563-21cf-4236-86af-8dece3acf57d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:08.767067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27032563-21cf-4236-86af-8dece3acf57d service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:08.767628 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27032563-21cf-4236-86af-8dece3acf57d service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:08.767733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27032563-21cf-4236-86af-8dece3acf57d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:08.790333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27032563-21cf-4236-86af-8dece3acf57d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:08.792143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27032563-21cf-4236-86af-8dece3acf57d service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:08.812179 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2686/5329] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:12:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:12:10.151401 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb2643-9bd8-46af-9e68-d23c75e40834 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:10.154185 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a2cb2643-9bd8-46af-9e68-d23c75e40834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:10.175255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb2643-9bd8-46af-9e68-d23c75e40834 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:10.186470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c04539-21cf-42c2-bb8d-b95cba55ef7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:10.187401 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c04539-21cf-42c2-bb8d-b95cba55ef7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:10.187838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c04539-21cf-42c2-bb8d-b95cba55ef7b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:10.188276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c04539-21cf-42c2-bb8d-b95cba55ef7b admin admin] PATH_INFO: `/v3/projects/7a28563fd4f04c1eb50e1249d8874ee7` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:10.191635 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c04539-21cf-42c2-bb8d-b95cba55ef7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a28563fd4f04c1eb50e1249d8874ee7)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:10.193933 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c04539-21cf-42c2-bb8d-b95cba55ef7b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:10.336754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c3c04539-21cf-42c2-bb8d-b95cba55ef7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a28563fd4f04c1eb50e1249d8874ee7', 'request_id': 'req-c3c04539-21cf-42c2-bb8d-b95cba55ef7b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:10.367824 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c3c04539-21cf-42c2-bb8d-b95cba55ef7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a28563fd4f04c1eb50e1249d8874ee7', 'request_id': 'req-c3c04539-21cf-42c2-bb8d-b95cba55ef7b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:10.386948 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c3c04539-21cf-42c2-bb8d-b95cba55ef7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a28563fd4f04c1eb50e1249d8874ee7', 'request_id': 'req-c3c04539-21cf-42c2-bb8d-b95cba55ef7b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:10.407405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c3c04539-21cf-42c2-bb8d-b95cba55ef7b admin admin] The token cache is being invalidate because project 7a28563fd4f04c1eb50e1249d8874ee7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:12:10.407947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c3c04539-21cf-42c2-bb8d-b95cba55ef7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:10.410155 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c3c04539-21cf-42c2-bb8d-b95cba55ef7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:10.413929 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2644/5330] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:12:10 2022] DELETE /identity/v3/projects/7a28563fd4f04c1eb50e1249d8874ee7 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:12:10.418169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27032563-21cf-4236-86af-8dece3acf57d service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:10.431108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27032563-21cf-4236-86af-8dece3acf57d service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:10.452261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:10.563145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfec887-b14e-454d-82fb-6d781e9c3ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:10.563827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfec887-b14e-454d-82fb-6d781e9c3ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:10.564113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfec887-b14e-454d-82fb-6d781e9c3ede admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:10.564391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfec887-b14e-454d-82fb-6d781e9c3ede admin admin] PATH_INFO: `/v3/users/bb7ba1561a5a4464a3109413f025d98b` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:10.565555 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfec887-b14e-454d-82fb-6d781e9c3ede admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb7ba1561a5a4464a3109413f025d98b)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:10.568439 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfec887-b14e-454d-82fb-6d781e9c3ede admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:10.640874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fbfec887-b14e-454d-82fb-6d781e9c3ede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb7ba1561a5a4464a3109413f025d98b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:10.653836 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fbfec887-b14e-454d-82fb-6d781e9c3ede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb7ba1561a5a4464a3109413f025d98b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:10.654881 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fbfec887-b14e-454d-82fb-6d781e9c3ede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb7ba1561a5a4464a3109413f025d98b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:10.655799 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fbfec887-b14e-454d-82fb-6d781e9c3ede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb7ba1561a5a4464a3109413f025d98b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:10.686634 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fbfec887-b14e-454d-82fb-6d781e9c3ede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb7ba1561a5a4464a3109413f025d98b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:10.723940 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2687/5331] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:12:10 2022] DELETE /identity/v3/users/bb7ba1561a5a4464a3109413f025d98b => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:12:10.948981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c04539-21cf-42c2-bb8d-b95cba55ef7b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:10.950903 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c3c04539-21cf-42c2-bb8d-b95cba55ef7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:10.990840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c04539-21cf-42c2-bb8d-b95cba55ef7b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:11.121867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fe68b-3505-4151-b2fd-b89e80ab343d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:11.123419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fe68b-3505-4151-b2fd-b89e80ab343d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:11.123713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fe68b-3505-4151-b2fd-b89e80ab343d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:11.124013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fe68b-3505-4151-b2fd-b89e80ab343d admin admin] PATH_INFO: `/v3/projects/292f10c5fb0246af872b271cd4ae8e55` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:11.127403 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fe68b-3505-4151-b2fd-b89e80ab343d admin admin] RBAC: Authorizing `identity:delete_project(project_id=292f10c5fb0246af872b271cd4ae8e55)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:11.130129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fe68b-3505-4151-b2fd-b89e80ab343d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:11.142372 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:11.216924 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a97fe68b-3505-4151-b2fd-b89e80ab343d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '292f10c5fb0246af872b271cd4ae8e55', 'request_id': 'req-a97fe68b-3505-4151-b2fd-b89e80ab343d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:11.231042 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a97fe68b-3505-4151-b2fd-b89e80ab343d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '292f10c5fb0246af872b271cd4ae8e55', 'request_id': 'req-a97fe68b-3505-4151-b2fd-b89e80ab343d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:11.243761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a97fe68b-3505-4151-b2fd-b89e80ab343d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '292f10c5fb0246af872b271cd4ae8e55', 'request_id': 'req-a97fe68b-3505-4151-b2fd-b89e80ab343d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:11.277665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a97fe68b-3505-4151-b2fd-b89e80ab343d admin admin] The token cache is being invalidate because project 292f10c5fb0246af872b271cd4ae8e55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:12:11.278451 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a97fe68b-3505-4151-b2fd-b89e80ab343d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:11.279585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a97fe68b-3505-4151-b2fd-b89e80ab343d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:11.281367 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2645/5332] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:12:10 2022] DELETE /identity/v3/projects/292f10c5fb0246af872b271cd4ae8e55 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:12:11.286220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbc91c-2e24-48b0-be66-339f51065a3f None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:11.286481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbc91c-2e24-48b0-be66-339f51065a3f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:11.286796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbc91c-2e24-48b0-be66-339f51065a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:11.352828 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-43bbc91c-2e24-48b0-be66-339f51065a3f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:11.354052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-43bbc91c-2e24-48b0-be66-339f51065a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:11.455756 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2688/5333] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:12:11.457354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65398b47-2cda-4c05-afab-6869b44fb4cf None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:11.457713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65398b47-2cda-4c05-afab-6869b44fb4cf None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:11.458063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65398b47-2cda-4c05-afab-6869b44fb4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:11.481736 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-65398b47-2cda-4c05-afab-6869b44fb4cf None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:11.487135 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-65398b47-2cda-4c05-afab-6869b44fb4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:11.502299 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbc91c-2e24-48b0-be66-339f51065a3f None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:11.508643 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2646/5334] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:12:11.513428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbc91c-2e24-48b0-be66-339f51065a3f None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:11.518609 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236fdebb-83fd-4af2-aaef-98db840536e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:11.519461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fdebb-83fd-4af2-aaef-98db840536e1 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:11.519869 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fdebb-83fd-4af2-aaef-98db840536e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:11.520244 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fdebb-83fd-4af2-aaef-98db840536e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:11.521000 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236fdebb-83fd-4af2-aaef-98db840536e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:12:11.521398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236fdebb-83fd-4af2-aaef-98db840536e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:11.523129 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236fdebb-83fd-4af2-aaef-98db840536e1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:11.541230 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65398b47-2cda-4c05-afab-6869b44fb4cf None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:11.547850 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2689/5335] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:12:11.552272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65398b47-2cda-4c05-afab-6869b44fb4cf None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:11.558458 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24b119-2345-4b45-8ac5-cad4cbd40afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:11.559234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24b119-2345-4b45-8ac5-cad4cbd40afd admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:11.559605 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24b119-2345-4b45-8ac5-cad4cbd40afd admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:11.560563 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24b119-2345-4b45-8ac5-cad4cbd40afd admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:11.561323 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff24b119-2345-4b45-8ac5-cad4cbd40afd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:11.563779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff24b119-2345-4b45-8ac5-cad4cbd40afd admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:11.615807 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236fdebb-83fd-4af2-aaef-98db840536e1 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:11.622055 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2647/5336] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:12:11 2022] POST /identity/v3/projects => generated 395 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:12:11.623820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:11.630589 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236fdebb-83fd-4af2-aaef-98db840536e1 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:11.718037 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d47b90-57e2-4c70-a7a2-a4eb72143b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:11.718700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d47b90-57e2-4c70-a7a2-a4eb72143b8d admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:11.718989 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d47b90-57e2-4c70-a7a2-a4eb72143b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:11.719266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d47b90-57e2-4c70-a7a2-a4eb72143b8d admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:11.719908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d47b90-57e2-4c70-a7a2-a4eb72143b8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:11.721857 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d47b90-57e2-4c70-a7a2-a4eb72143b8d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:11.753098 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2690/5337] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:12:11 2022] POST /identity/v3/users => generated 298 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:12:11.754347 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24b119-2345-4b45-8ac5-cad4cbd40afd admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:11.768360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24b119-2345-4b45-8ac5-cad4cbd40afd admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:11.773647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d3460-18df-4707-8f80-4ac4f6737293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:11.774348 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d3460-18df-4707-8f80-4ac4f6737293 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:11.774737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d3460-18df-4707-8f80-4ac4f6737293 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:11.775047 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d3460-18df-4707-8f80-4ac4f6737293 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:11.775758 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d3460-18df-4707-8f80-4ac4f6737293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:11.777929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d3460-18df-4707-8f80-4ac4f6737293 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:11.790009 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2648/5338] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:12:11.793815 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d47b90-57e2-4c70-a7a2-a4eb72143b8d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:11.805699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d47b90-57e2-4c70-a7a2-a4eb72143b8d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:11.811662 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1c664-cb72-4f0d-b159-220fce84be7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:11.812288 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1c664-cb72-4f0d-b159-220fce84be7e admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:11.812575 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1c664-cb72-4f0d-b159-220fce84be7e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:11.812853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1c664-cb72-4f0d-b159-220fce84be7e admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:11.813505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1c664-cb72-4f0d-b159-220fce84be7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:11.815183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1c664-cb72-4f0d-b159-220fce84be7e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:11.830341 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2691/5339] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:12:11.831428 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d3460-18df-4707-8f80-4ac4f6737293 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:11.842898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d3460-18df-4707-8f80-4ac4f6737293 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:11.847997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ca6de-12e9-43ac-b8cd-1c011f525534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:11.848665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ca6de-12e9-43ac-b8cd-1c011f525534 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:11.849512 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ca6de-12e9-43ac-b8cd-1c011f525534 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:11.849512 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ca6de-12e9-43ac-b8cd-1c011f525534 admin admin] PATH_INFO: `/v3/projects/e83b67cec08641328360d15a79f15de0/users/e1f3f46d19a6484da3622833d894963d/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:11.871574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ca6de-12e9-43ac-b8cd-1c011f525534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e83b67cec08641328360d15a79f15de0, user_id=e1f3f46d19a6484da3622833d894963d, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:11.877174 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ca6de-12e9-43ac-b8cd-1c011f525534 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:11.897511 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2649/5340] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:12:11 2022] PUT /identity/v3/projects/e83b67cec08641328360d15a79f15de0/users/e1f3f46d19a6484da3622833d894963d/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:12:11.908151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149665b-fd50-4517-8245-05f8f4fb0abf None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:11.908473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149665b-fd50-4517-8245-05f8f4fb0abf None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:11.908738 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149665b-fd50-4517-8245-05f8f4fb0abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:11.951086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-6149665b-fd50-4517-8245-05f8f4fb0abf None None] MFA Rules not processed for user `e1f3f46d19a6484da3622833d894963d`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:11.952336 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6149665b-fd50-4517-8245-05f8f4fb0abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:12.098799 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2692/5341] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:11 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:12:12.110928 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ca6de-12e9-43ac-b8cd-1c011f525534 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:12.113326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-984ca6de-12e9-43ac-b8cd-1c011f525534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:12.239332 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ca6de-12e9-43ac-b8cd-1c011f525534 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:12.244970 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb18094-f832-44ed-9e32-11ec16478c7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:12.245732 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb18094-f832-44ed-9e32-11ec16478c7b service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:12.246143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb18094-f832-44ed-9e32-11ec16478c7b service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:12.246473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb18094-f832-44ed-9e32-11ec16478c7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:12.263255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb18094-f832-44ed-9e32-11ec16478c7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:12.265437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb18094-f832-44ed-9e32-11ec16478c7b service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:12.276505 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2650/5342] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:12:12 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:12:22.095817 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=64,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:22.272407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=74,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:25.618113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149665b-fd50-4517-8245-05f8f4fb0abf None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:25.620671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6149665b-fd50-4517-8245-05f8f4fb0abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:25.746845 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149665b-fd50-4517-8245-05f8f4fb0abf None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:25.752880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3374102-fde1-4935-971e-ebb8114aaba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:25.753842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3374102-fde1-4935-971e-ebb8114aaba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:25.754122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3374102-fde1-4935-971e-ebb8114aaba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:25.754828 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3374102-fde1-4935-971e-ebb8114aaba8 admin admin] PATH_INFO: `/v3/users/22318132bfd04aa0886eb9b14a983731` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:25.755661 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3374102-fde1-4935-971e-ebb8114aaba8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22318132bfd04aa0886eb9b14a983731)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:25.757827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3374102-fde1-4935-971e-ebb8114aaba8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:25.837612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f3374102-fde1-4935-971e-ebb8114aaba8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22318132bfd04aa0886eb9b14a983731'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:25.858845 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f3374102-fde1-4935-971e-ebb8114aaba8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22318132bfd04aa0886eb9b14a983731'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:25.859556 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f3374102-fde1-4935-971e-ebb8114aaba8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22318132bfd04aa0886eb9b14a983731'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:25.861415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f3374102-fde1-4935-971e-ebb8114aaba8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22318132bfd04aa0886eb9b14a983731'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:25.877219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f3374102-fde1-4935-971e-ebb8114aaba8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22318132bfd04aa0886eb9b14a983731'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:25.912756 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2693/5343] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:12:25 2022] DELETE /identity/v3/users/22318132bfd04aa0886eb9b14a983731 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:12:26.152088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb18094-f832-44ed-9e32-11ec16478c7b service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:26.155151 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-fbb18094-f832-44ed-9e32-11ec16478c7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:26.176027 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb18094-f832-44ed-9e32-11ec16478c7b service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:26.271730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0942cb-6449-47db-8cc1-c8ebe988627b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:26.272415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0942cb-6449-47db-8cc1-c8ebe988627b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:26.272745 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0942cb-6449-47db-8cc1-c8ebe988627b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:26.273227 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0942cb-6449-47db-8cc1-c8ebe988627b admin admin] PATH_INFO: `/v3/users/2d050e7deab24698b6cb13d7a885606e` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:26.274656 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0942cb-6449-47db-8cc1-c8ebe988627b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d050e7deab24698b6cb13d7a885606e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:26.278079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0942cb-6449-47db-8cc1-c8ebe988627b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:26.395747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6e0942cb-6449-47db-8cc1-c8ebe988627b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d050e7deab24698b6cb13d7a885606e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:26.398467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6e0942cb-6449-47db-8cc1-c8ebe988627b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d050e7deab24698b6cb13d7a885606e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:26.399337 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6e0942cb-6449-47db-8cc1-c8ebe988627b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d050e7deab24698b6cb13d7a885606e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:26.413750 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6e0942cb-6449-47db-8cc1-c8ebe988627b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d050e7deab24698b6cb13d7a885606e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:26.435379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6e0942cb-6449-47db-8cc1-c8ebe988627b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d050e7deab24698b6cb13d7a885606e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:26.462203 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2651/5344] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:12:26 2022] DELETE /identity/v3/users/2d050e7deab24698b6cb13d7a885606e => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:12:26.843955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3374102-fde1-4935-971e-ebb8114aaba8 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:26.848565 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f3374102-fde1-4935-971e-ebb8114aaba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:26.890224 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3374102-fde1-4935-971e-ebb8114aaba8 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:27.037229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93196c80-1ece-465c-ba55-706ae15f9854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:27.037889 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93196c80-1ece-465c-ba55-706ae15f9854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:27.038176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93196c80-1ece-465c-ba55-706ae15f9854 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:27.038460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93196c80-1ece-465c-ba55-706ae15f9854 admin admin] PATH_INFO: `/v3/projects/591beac720d74a8889ad521c436e64c3` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:27.039712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93196c80-1ece-465c-ba55-706ae15f9854 admin admin] RBAC: Authorizing `identity:delete_project(project_id=591beac720d74a8889ad521c436e64c3)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:27.042224 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93196c80-1ece-465c-ba55-706ae15f9854 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:27.096958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:27.144059 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-93196c80-1ece-465c-ba55-706ae15f9854 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '591beac720d74a8889ad521c436e64c3', 'request_id': 'req-93196c80-1ece-465c-ba55-706ae15f9854'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:27.154511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-93196c80-1ece-465c-ba55-706ae15f9854 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '591beac720d74a8889ad521c436e64c3', 'request_id': 'req-93196c80-1ece-465c-ba55-706ae15f9854'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:27.164682 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-93196c80-1ece-465c-ba55-706ae15f9854 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '591beac720d74a8889ad521c436e64c3', 'request_id': 'req-93196c80-1ece-465c-ba55-706ae15f9854'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:27.180739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-93196c80-1ece-465c-ba55-706ae15f9854 admin admin] The token cache is being invalidate because project 591beac720d74a8889ad521c436e64c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:12:27.181047 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-93196c80-1ece-465c-ba55-706ae15f9854 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:27.181692 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-93196c80-1ece-465c-ba55-706ae15f9854 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:27.185240 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2694/5345] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:12:26 2022] DELETE /identity/v3/projects/591beac720d74a8889ad521c436e64c3 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:12:27.190865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3c549-fc6b-4bd9-bda0-31ad5f0751a3 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:27.191380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3c549-fc6b-4bd9-bda0-31ad5f0751a3 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:27.191488 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3c549-fc6b-4bd9-bda0-31ad5f0751a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:27.217325 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-2ae3c549-fc6b-4bd9-bda0-31ad5f0751a3 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:27.218774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2ae3c549-fc6b-4bd9-bda0-31ad5f0751a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:27.303003 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2652/5346] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:12:27.312078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa2188-6143-4d76-b420-8e464dbea6a8 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:27.312510 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa2188-6143-4d76-b420-8e464dbea6a8 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:27.312797 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa2188-6143-4d76-b420-8e464dbea6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:27.333854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-c5fa2188-6143-4d76-b420-8e464dbea6a8 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:27.335308 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c5fa2188-6143-4d76-b420-8e464dbea6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:27.348014 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2695/5347] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:12:27.358582 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3c549-fc6b-4bd9-bda0-31ad5f0751a3 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:27.379132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa2188-6143-4d76-b420-8e464dbea6a8 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:27.380953 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c5fa2188-6143-4d76-b420-8e464dbea6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:27.382760 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3c549-fc6b-4bd9-bda0-31ad5f0751a3 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:27.392118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1db02-d8f5-4d5e-8790-f08b13144e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:27.393519 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1db02-d8f5-4d5e-8790-f08b13144e83 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:27.394309 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1db02-d8f5-4d5e-8790-f08b13144e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:27.395394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1db02-d8f5-4d5e-8790-f08b13144e83 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:27.396324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa2188-6143-4d76-b420-8e464dbea6a8 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:27.396771 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1db02-d8f5-4d5e-8790-f08b13144e83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:12:27.397480 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1db02-d8f5-4d5e-8790-f08b13144e83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:27.405092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1db02-d8f5-4d5e-8790-f08b13144e83 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:27.449897 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2653/5348] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:12:27.451549 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7baf674-fe32-4940-a80b-e4cd0125234b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:27.455620 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1db02-d8f5-4d5e-8790-f08b13144e83 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:27.456687 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7baf674-fe32-4940-a80b-e4cd0125234b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:27.461684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7baf674-fe32-4940-a80b-e4cd0125234b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:27.462883 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7baf674-fe32-4940-a80b-e4cd0125234b admin admin] PATH_INFO: `/v3/projects/227ed263d0044aa39b2bf3390d4c4dc9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:27.468155 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7baf674-fe32-4940-a80b-e4cd0125234b admin admin] RBAC: Authorizing `identity:delete_project(project_id=227ed263d0044aa39b2bf3390d4c4dc9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:27.469342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1db02-d8f5-4d5e-8790-f08b13144e83 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:27.475016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe536e-4963-4a03-aaef-f27bb10b2ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:27.476135 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe536e-4963-4a03-aaef-f27bb10b2ba1 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:27.476489 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe536e-4963-4a03-aaef-f27bb10b2ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:27.476836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe536e-4963-4a03-aaef-f27bb10b2ba1 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:27.477557 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe536e-4963-4a03-aaef-f27bb10b2ba1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:27.479727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7baf674-fe32-4940-a80b-e4cd0125234b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:27.480817 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe536e-4963-4a03-aaef-f27bb10b2ba1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:27.491378 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:27.537908 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2654/5349] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:12:27 2022] POST /identity/v3/projects => generated 377 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:12:27.540105 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe536e-4963-4a03-aaef-f27bb10b2ba1 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:27.575524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b7baf674-fe32-4940-a80b-e4cd0125234b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '227ed263d0044aa39b2bf3390d4c4dc9', 'request_id': 'req-b7baf674-fe32-4940-a80b-e4cd0125234b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:27.582363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b7baf674-fe32-4940-a80b-e4cd0125234b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '227ed263d0044aa39b2bf3390d4c4dc9', 'request_id': 'req-b7baf674-fe32-4940-a80b-e4cd0125234b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:27.596753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b7baf674-fe32-4940-a80b-e4cd0125234b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '227ed263d0044aa39b2bf3390d4c4dc9', 'request_id': 'req-b7baf674-fe32-4940-a80b-e4cd0125234b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:27.616454 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b7baf674-fe32-4940-a80b-e4cd0125234b admin admin] The token cache is being invalidate because project 227ed263d0044aa39b2bf3390d4c4dc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:12:27.617224 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b7baf674-fe32-4940-a80b-e4cd0125234b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:27.618019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b7baf674-fe32-4940-a80b-e4cd0125234b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:27.622587 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2696/5350] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:12:27 2022] DELETE /identity/v3/projects/227ed263d0044aa39b2bf3390d4c4dc9 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:12:27.628028 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da29223-c715-48cc-88ba-097cbc761644 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:27.628357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da29223-c715-48cc-88ba-097cbc761644 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:27.628599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da29223-c715-48cc-88ba-097cbc761644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:27.684407 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-3da29223-c715-48cc-88ba-097cbc761644 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:27.686909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3da29223-c715-48cc-88ba-097cbc761644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:27.702507 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe536e-4963-4a03-aaef-f27bb10b2ba1 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:27.783352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b088a26-13ef-4385-9e21-a61adee65fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:27.784371 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b088a26-13ef-4385-9e21-a61adee65fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:27.784818 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b088a26-13ef-4385-9e21-a61adee65fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:27.785249 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b088a26-13ef-4385-9e21-a61adee65fb3 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:27.786099 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b088a26-13ef-4385-9e21-a61adee65fb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:27.788408 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b088a26-13ef-4385-9e21-a61adee65fb3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:27.799760 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2697/5351] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:12:27.809151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c66ad-dc06-4260-94f2-b80b071bc3c8 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:27.809515 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c66ad-dc06-4260-94f2-b80b071bc3c8 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:27.809832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c66ad-dc06-4260-94f2-b80b071bc3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:27.820735 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2655/5352] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:12:27 2022] POST /identity/v3/users => generated 289 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:12:27.821752 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b088a26-13ef-4385-9e21-a61adee65fb3 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:27.823764 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1b088a26-13ef-4385-9e21-a61adee65fb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:27.842054 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b088a26-13ef-4385-9e21-a61adee65fb3 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:27.848941 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500b799-b346-4c60-a180-e6a8a1e1c8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:27.849642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500b799-b346-4c60-a180-e6a8a1e1c8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:27.849857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500b799-b346-4c60-a180-e6a8a1e1c8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:27.850134 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500b799-b346-4c60-a180-e6a8a1e1c8e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:27.850943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e500b799-b346-4c60-a180-e6a8a1e1c8e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:27.852559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-228c66ad-dc06-4260-94f2-b80b071bc3c8 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:27.853020 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e500b799-b346-4c60-a180-e6a8a1e1c8e8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:27.855790 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-228c66ad-dc06-4260-94f2-b80b071bc3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:27.866527 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2698/5353] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:12:27.872238 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2656/5354] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:12:27.875788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c66ad-dc06-4260-94f2-b80b071bc3c8 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:27.877117 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500b799-b346-4c60-a180-e6a8a1e1c8e8 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:27.894756 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500b799-b346-4c60-a180-e6a8a1e1c8e8 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:27.899893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c66ad-dc06-4260-94f2-b80b071bc3c8 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:27.900446 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98fdda-3652-49c3-b8c2-564bef64e346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:27.901197 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98fdda-3652-49c3-b8c2-564bef64e346 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:27.901822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98fdda-3652-49c3-b8c2-564bef64e346 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:27.901945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98fdda-3652-49c3-b8c2-564bef64e346 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:27.903046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98fdda-3652-49c3-b8c2-564bef64e346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:27.904727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98fdda-3652-49c3-b8c2-564bef64e346 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:27.912114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee6587-5f50-4baa-bf14-58128f60060f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:27.912754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee6587-5f50-4baa-bf14-58128f60060f admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:27.913057 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee6587-5f50-4baa-bf14-58128f60060f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:27.913304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee6587-5f50-4baa-bf14-58128f60060f admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:27.913963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee6587-5f50-4baa-bf14-58128f60060f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:12:27.914270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee6587-5f50-4baa-bf14-58128f60060f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:27.915919 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee6587-5f50-4baa-bf14-58128f60060f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:27.925172 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2657/5355] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:12:27.926230 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98fdda-3652-49c3-b8c2-564bef64e346 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:27.939086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98fdda-3652-49c3-b8c2-564bef64e346 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:27.945976 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4e121-6d30-4e29-b9d4-b66863236259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:27.946842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4e121-6d30-4e29-b9d4-b66863236259 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:27.947192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4e121-6d30-4e29-b9d4-b66863236259 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:27.947532 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4e121-6d30-4e29-b9d4-b66863236259 admin admin] PATH_INFO: `/v3/projects/9feea686598e4a0d90d716e00e3e290a/users/9b8463a42f2642aaba586380391de6fd/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:27.956185 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2699/5356] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:12:27.962211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee6587-5f50-4baa-bf14-58128f60060f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:27.969369 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e4e121-6d30-4e29-b9d4-b66863236259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9feea686598e4a0d90d716e00e3e290a, user_id=9b8463a42f2642aaba586380391de6fd, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:27.973668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e4e121-6d30-4e29-b9d4-b66863236259 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:27.991861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee6587-5f50-4baa-bf14-58128f60060f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:28.000129 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2658/5357] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:12:27 2022] PUT /identity/v3/projects/9feea686598e4a0d90d716e00e3e290a/users/9b8463a42f2642aaba586380391de6fd/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:12:28.001680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b8a98-ca87-4a90-80cc-d78f55a65dc3 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:28.002149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b8a98-ca87-4a90-80cc-d78f55a65dc3 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:28.002430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b8a98-ca87-4a90-80cc-d78f55a65dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:28.003073 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:28.053182 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-5e7b8a98-ca87-4a90-80cc-d78f55a65dc3 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:28.054711 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5e7b8a98-ca87-4a90-80cc-d78f55a65dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:28.128789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:28.154749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb77611-8a57-4992-812b-837fec009f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:28.156285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb77611-8a57-4992-812b-837fec009f27 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:28.157360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb77611-8a57-4992-812b-837fec009f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:28.158210 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb77611-8a57-4992-812b-837fec009f27 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:28.159326 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb77611-8a57-4992-812b-837fec009f27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:28.166328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb77611-8a57-4992-812b-837fec009f27 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:28.186466 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2659/5358] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:12:28.201015 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b8a98-ca87-4a90-80cc-d78f55a65dc3 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:28.202582 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5e7b8a98-ca87-4a90-80cc-d78f55a65dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:28.235501 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2700/5359] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:12:27 2022] POST /identity/v3/projects => generated 381 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:12:28.241332 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb77611-8a57-4992-812b-837fec009f27 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:28.300130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b8a98-ca87-4a90-80cc-d78f55a65dc3 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:28.412282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb77611-8a57-4992-812b-837fec009f27 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:28.423211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f96247-e2f9-4b2f-873c-e8b6efd97104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:28.424087 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e2dd50-e41a-47a4-a224-42f814e7a5d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:28.424708 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2dd50-e41a-47a4-a224-42f814e7a5d0 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:28.425257 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2dd50-e41a-47a4-a224-42f814e7a5d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:28.425533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2dd50-e41a-47a4-a224-42f814e7a5d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:28.426181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f96247-e2f9-4b2f-873c-e8b6efd97104 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:28.426747 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f96247-e2f9-4b2f-873c-e8b6efd97104 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:28.427067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f96247-e2f9-4b2f-873c-e8b6efd97104 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:28.427698 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f96247-e2f9-4b2f-873c-e8b6efd97104 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:28.429915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f96247-e2f9-4b2f-873c-e8b6efd97104 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:28.449127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e2dd50-e41a-47a4-a224-42f814e7a5d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:28.452723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e2dd50-e41a-47a4-a224-42f814e7a5d0 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:28.482983 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2660/5360] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:12:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:12:28.483178 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2701/5361] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:12:28 2022] POST /identity/v3/users => generated 291 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:12:28.485938 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e2dd50-e41a-47a4-a224-42f814e7a5d0 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:28.498582 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e2dd50-e41a-47a4-a224-42f814e7a5d0 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:28.503943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629a66f-fa0d-498e-af00-eaae224251cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:28.504355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629a66f-fa0d-498e-af00-eaae224251cb admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:28.504636 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629a66f-fa0d-498e-af00-eaae224251cb admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:28.504908 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629a66f-fa0d-498e-af00-eaae224251cb admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:28.505713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629a66f-fa0d-498e-af00-eaae224251cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:28.508418 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629a66f-fa0d-498e-af00-eaae224251cb admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:28.523624 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2661/5362] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:12:28.525093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f96247-e2f9-4b2f-873c-e8b6efd97104 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:28.540882 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f96247-e2f9-4b2f-873c-e8b6efd97104 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:28.552645 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd1ec1-fe09-493a-9b6c-4c729b69dce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:28.553954 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd1ec1-fe09-493a-9b6c-4c729b69dce2 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:28.554499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd1ec1-fe09-493a-9b6c-4c729b69dce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:28.555017 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd1ec1-fe09-493a-9b6c-4c729b69dce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:28.556053 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd1ec1-fe09-493a-9b6c-4c729b69dce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:28.559429 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd1ec1-fe09-493a-9b6c-4c729b69dce2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:28.579068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629a66f-fa0d-498e-af00-eaae224251cb admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:28.580082 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2702/5363] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:12:28.595140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629a66f-fa0d-498e-af00-eaae224251cb admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:28.602179 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721debb8-9630-44e9-8058-52014c73fc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:28.603489 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721debb8-9630-44e9-8058-52014c73fc57 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:28.604711 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721debb8-9630-44e9-8058-52014c73fc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:28.605596 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721debb8-9630-44e9-8058-52014c73fc57 admin admin] PATH_INFO: `/v3/projects/da1a7d63a1a048df9cdf8e86a26b4086/users/a6c953ff2f774041a7d50f53033ee124/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:28.631592 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721debb8-9630-44e9-8058-52014c73fc57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da1a7d63a1a048df9cdf8e86a26b4086, user_id=a6c953ff2f774041a7d50f53033ee124, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:28.642735 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721debb8-9630-44e9-8058-52014c73fc57 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:28.668511 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2662/5364] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:12:28 2022] PUT /identity/v3/projects/da1a7d63a1a048df9cdf8e86a26b4086/users/a6c953ff2f774041a7d50f53033ee124/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:12:28.684017 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61065669-a6cf-4aac-82c5-ec8f220ed7f4 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:28.684757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61065669-a6cf-4aac-82c5-ec8f220ed7f4 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:28.685119 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61065669-a6cf-4aac-82c5-ec8f220ed7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:28.715436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-61065669-a6cf-4aac-82c5-ec8f220ed7f4 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:28.717894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-61065669-a6cf-4aac-82c5-ec8f220ed7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:28.809454 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2703/5365] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:12:28.822046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721debb8-9630-44e9-8058-52014c73fc57 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:28.897190 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:28.911473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721debb8-9630-44e9-8058-52014c73fc57 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:28.916084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d530b-f8be-4e5f-82a8-e0c2334bc2da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:28.917264 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d530b-f8be-4e5f-82a8-e0c2334bc2da service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:28.917544 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d530b-f8be-4e5f-82a8-e0c2334bc2da service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:28.917816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d530b-f8be-4e5f-82a8-e0c2334bc2da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:28.945309 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d530b-f8be-4e5f-82a8-e0c2334bc2da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:28.948130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d530b-f8be-4e5f-82a8-e0c2334bc2da service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:28.969929 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2663/5366] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:12:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:12:35.139454 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61065669-a6cf-4aac-82c5-ec8f220ed7f4 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:35.141525 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-61065669-a6cf-4aac-82c5-ec8f220ed7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:35.160869 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61065669-a6cf-4aac-82c5-ec8f220ed7f4 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:35.170780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e2f3d-a94a-47c9-9d26-73094f5179c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:35.173659 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e2f3d-a94a-47c9-9d26-73094f5179c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:35.175013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e2f3d-a94a-47c9-9d26-73094f5179c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:35.175448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e2f3d-a94a-47c9-9d26-73094f5179c7 admin admin] PATH_INFO: `/v3/users/c1c8ba4023a444a4baa633b5c599213e` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:35.177015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e2f3d-a94a-47c9-9d26-73094f5179c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1c8ba4023a444a4baa633b5c599213e)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:35.180478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e2f3d-a94a-47c9-9d26-73094f5179c7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:35.202738 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:35.293493 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-be9e2f3d-a94a-47c9-9d26-73094f5179c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1c8ba4023a444a4baa633b5c599213e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:35.305827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-be9e2f3d-a94a-47c9-9d26-73094f5179c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1c8ba4023a444a4baa633b5c599213e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:35.306899 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-be9e2f3d-a94a-47c9-9d26-73094f5179c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1c8ba4023a444a4baa633b5c599213e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:35.308173 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-be9e2f3d-a94a-47c9-9d26-73094f5179c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1c8ba4023a444a4baa633b5c599213e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:35.320095 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-be9e2f3d-a94a-47c9-9d26-73094f5179c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1c8ba4023a444a4baa633b5c599213e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:35.374659 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2704/5367] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:12:35 2022] DELETE /identity/v3/users/c1c8ba4023a444a4baa633b5c599213e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:12:36.292324 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d530b-f8be-4e5f-82a8-e0c2334bc2da service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:36.310860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d530b-f8be-4e5f-82a8-e0c2334bc2da service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:36.476519 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502c704-7d5e-4dc1-bfd9-c07aa5276971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:36.477202 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502c704-7d5e-4dc1-bfd9-c07aa5276971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:36.477492 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502c704-7d5e-4dc1-bfd9-c07aa5276971 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:36.477777 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502c704-7d5e-4dc1-bfd9-c07aa5276971 admin admin] PATH_INFO: `/v3/projects/97a16c231f804b41bfd49fe5f4d96605` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:36.481266 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0502c704-7d5e-4dc1-bfd9-c07aa5276971 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97a16c231f804b41bfd49fe5f4d96605)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:36.488823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0502c704-7d5e-4dc1-bfd9-c07aa5276971 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:36.609101 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0502c704-7d5e-4dc1-bfd9-c07aa5276971 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97a16c231f804b41bfd49fe5f4d96605', 'request_id': 'req-0502c704-7d5e-4dc1-bfd9-c07aa5276971'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:36.616380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0502c704-7d5e-4dc1-bfd9-c07aa5276971 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97a16c231f804b41bfd49fe5f4d96605', 'request_id': 'req-0502c704-7d5e-4dc1-bfd9-c07aa5276971'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:36.639005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0502c704-7d5e-4dc1-bfd9-c07aa5276971 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97a16c231f804b41bfd49fe5f4d96605', 'request_id': 'req-0502c704-7d5e-4dc1-bfd9-c07aa5276971'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:36.689294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0502c704-7d5e-4dc1-bfd9-c07aa5276971 admin admin] The token cache is being invalidate because project 97a16c231f804b41bfd49fe5f4d96605 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:12:36.689602 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0502c704-7d5e-4dc1-bfd9-c07aa5276971 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:36.690433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0502c704-7d5e-4dc1-bfd9-c07aa5276971 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:36.697298 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2664/5368] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:12:36 2022] DELETE /identity/v3/projects/97a16c231f804b41bfd49fe5f4d96605 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:12:36.700931 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac38c4-1fa0-4e0a-892c-591341ad3ec4 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:36.701487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac38c4-1fa0-4e0a-892c-591341ad3ec4 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:36.701812 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac38c4-1fa0-4e0a-892c-591341ad3ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:36.737205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-3bac38c4-1fa0-4e0a-892c-591341ad3ec4 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:36.738760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3bac38c4-1fa0-4e0a-892c-591341ad3ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:36.869776 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2705/5369] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:12:36.873385 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39eefc-9cff-4fa7-8404-bb390b7f8a58 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:36.873916 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39eefc-9cff-4fa7-8404-bb390b7f8a58 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:36.874400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39eefc-9cff-4fa7-8404-bb390b7f8a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:36.973901 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-0c39eefc-9cff-4fa7-8404-bb390b7f8a58 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:36.991496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0c39eefc-9cff-4fa7-8404-bb390b7f8a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:37.023160 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2665/5370] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:12:37.028346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac38c4-1fa0-4e0a-892c-591341ad3ec4 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:37.048049 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac38c4-1fa0-4e0a-892c-591341ad3ec4 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:37.091622 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419336d3-40d3-4110-a954-5feb164233cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:37.092537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419336d3-40d3-4110-a954-5feb164233cd admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:37.093009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419336d3-40d3-4110-a954-5feb164233cd admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:37.093478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419336d3-40d3-4110-a954-5feb164233cd admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:37.094301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419336d3-40d3-4110-a954-5feb164233cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:12:37.094860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419336d3-40d3-4110-a954-5feb164233cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:37.101561 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419336d3-40d3-4110-a954-5feb164233cd admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:37.134860 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2706/5371] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:12:37.140033 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39eefc-9cff-4fa7-8404-bb390b7f8a58 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:37.170288 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39eefc-9cff-4fa7-8404-bb390b7f8a58 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:37.180637 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26f421-a0d9-46b0-b5df-fe38af8d9726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:37.182148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26f421-a0d9-46b0-b5df-fe38af8d9726 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:37.182879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26f421-a0d9-46b0-b5df-fe38af8d9726 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:37.183349 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26f421-a0d9-46b0-b5df-fe38af8d9726 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:37.184416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d26f421-a0d9-46b0-b5df-fe38af8d9726 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:37.186819 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d26f421-a0d9-46b0-b5df-fe38af8d9726 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:37.305831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419336d3-40d3-4110-a954-5feb164233cd admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:37.307548 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2666/5372] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:12:37 2022] POST /identity/v3/projects => generated 403 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:12:37.331312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419336d3-40d3-4110-a954-5feb164233cd admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:37.486012 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ce475-cb55-42e7-b50e-1419da416f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:37.486741 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ce475-cb55-42e7-b50e-1419da416f29 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:37.487032 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ce475-cb55-42e7-b50e-1419da416f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:37.487324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ce475-cb55-42e7-b50e-1419da416f29 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:37.487949 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ce475-cb55-42e7-b50e-1419da416f29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:37.489967 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ce475-cb55-42e7-b50e-1419da416f29 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:37.543593 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:37.551036 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2707/5373] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:12:37 2022] POST /identity/v3/users => generated 302 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:12:37.554025 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26f421-a0d9-46b0-b5df-fe38af8d9726 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:37.568882 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26f421-a0d9-46b0-b5df-fe38af8d9726 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:37.574714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceec751-60a3-49f0-9beb-98cbe6c7c2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:37.575332 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceec751-60a3-49f0-9beb-98cbe6c7c2ee admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:37.575616 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceec751-60a3-49f0-9beb-98cbe6c7c2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:37.575891 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceec751-60a3-49f0-9beb-98cbe6c7c2ee admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:37.576534 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceec751-60a3-49f0-9beb-98cbe6c7c2ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:37.578143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceec751-60a3-49f0-9beb-98cbe6c7c2ee admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:37.595020 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2667/5374] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:12:37.595891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ce475-cb55-42e7-b50e-1419da416f29 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:37.615497 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ce475-cb55-42e7-b50e-1419da416f29 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:37.624005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84196e2-4c9e-4e2f-9b05-141023befff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:37.624609 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84196e2-4c9e-4e2f-9b05-141023befff9 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:37.625413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84196e2-4c9e-4e2f-9b05-141023befff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:37.625413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84196e2-4c9e-4e2f-9b05-141023befff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:37.626016 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84196e2-4c9e-4e2f-9b05-141023befff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:37.627911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84196e2-4c9e-4e2f-9b05-141023befff9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:37.641005 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2708/5375] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:12:37.647790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceec751-60a3-49f0-9beb-98cbe6c7c2ee admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:37.688300 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceec751-60a3-49f0-9beb-98cbe6c7c2ee admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:37.694224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535258cc-76a5-4c64-a5ab-50e5135833b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:37.694683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535258cc-76a5-4c64-a5ab-50e5135833b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:37.695040 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535258cc-76a5-4c64-a5ab-50e5135833b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:37.695388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535258cc-76a5-4c64-a5ab-50e5135833b4 admin admin] PATH_INFO: `/v3/projects/cc5a587498eb4c3d825e0e7e699dded5/users/f6df270cd08241ccab089450959e8d00/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:37.719663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535258cc-76a5-4c64-a5ab-50e5135833b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc5a587498eb4c3d825e0e7e699dded5, user_id=f6df270cd08241ccab089450959e8d00, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:37.723287 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535258cc-76a5-4c64-a5ab-50e5135833b4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:37.755416 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2668/5376] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:12:37 2022] PUT /identity/v3/projects/cc5a587498eb4c3d825e0e7e699dded5/users/f6df270cd08241ccab089450959e8d00/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:12:37.761013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c42029-a976-4a23-8be1-29d2c8ee199c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:37.761599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c42029-a976-4a23-8be1-29d2c8ee199c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:37.761599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c42029-a976-4a23-8be1-29d2c8ee199c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:37.811221 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-34c42029-a976-4a23-8be1-29d2c8ee199c None None] MFA Rules not processed for user `f6df270cd08241ccab089450959e8d00`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:37.812846 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-34c42029-a976-4a23-8be1-29d2c8ee199c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:37.933810 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2709/5377] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:37 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:12:37.949032 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535258cc-76a5-4c64-a5ab-50e5135833b4 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:37.989138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:38.049930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535258cc-76a5-4c64-a5ab-50e5135833b4 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:38.059089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79138e92-6241-46ce-86bc-b072a4c6ea3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:38.059415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79138e92-6241-46ce-86bc-b072a4c6ea3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:38.059796 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79138e92-6241-46ce-86bc-b072a4c6ea3b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:38.060174 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79138e92-6241-46ce-86bc-b072a4c6ea3b admin admin] PATH_INFO: `/v3/users/f6df270cd08241ccab089450959e8d00` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:38.061509 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79138e92-6241-46ce-86bc-b072a4c6ea3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6df270cd08241ccab089450959e8d00)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:38.064500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79138e92-6241-46ce-86bc-b072a4c6ea3b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:38.153752 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-79138e92-6241-46ce-86bc-b072a4c6ea3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6df270cd08241ccab089450959e8d00'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:38.154640 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-79138e92-6241-46ce-86bc-b072a4c6ea3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6df270cd08241ccab089450959e8d00'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:38.155763 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-79138e92-6241-46ce-86bc-b072a4c6ea3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6df270cd08241ccab089450959e8d00'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:38.168888 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-79138e92-6241-46ce-86bc-b072a4c6ea3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6df270cd08241ccab089450959e8d00'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:38.188364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-79138e92-6241-46ce-86bc-b072a4c6ea3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6df270cd08241ccab089450959e8d00'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:38.253991 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2669/5378] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:12:37 2022] DELETE /identity/v3/users/f6df270cd08241ccab089450959e8d00 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:12:38.255647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36de3b-090f-41d0-80f9-88e08aaeb424 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:38.255938 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36de3b-090f-41d0-80f9-88e08aaeb424 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:38.256214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36de3b-090f-41d0-80f9-88e08aaeb424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:38.280427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-8c36de3b-090f-41d0-80f9-88e08aaeb424 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:38.282491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8c36de3b-090f-41d0-80f9-88e08aaeb424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:38.372483 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2710/5379] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:12:38.410884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79138e92-6241-46ce-86bc-b072a4c6ea3b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:38.420061 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-79138e92-6241-46ce-86bc-b072a4c6ea3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:38.575592 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79138e92-6241-46ce-86bc-b072a4c6ea3b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:38.580194 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d02ed-9828-4586-8f06-78927dda0092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:38.580852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d02ed-9828-4586-8f06-78927dda0092 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:38.581095 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d02ed-9828-4586-8f06-78927dda0092 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:38.581372 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d02ed-9828-4586-8f06-78927dda0092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:38.599468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d02ed-9828-4586-8f06-78927dda0092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:38.602167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d02ed-9828-4586-8f06-78927dda0092 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:38.617233 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2670/5380] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:12:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:12:41.613736 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36de3b-090f-41d0-80f9-88e08aaeb424 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:41.615894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8c36de3b-090f-41d0-80f9-88e08aaeb424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:41.646411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36de3b-090f-41d0-80f9-88e08aaeb424 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:41.655547 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315fa25-1b25-4555-a677-03b306313990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:41.656508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315fa25-1b25-4555-a677-03b306313990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:41.656993 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315fa25-1b25-4555-a677-03b306313990 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:41.657467 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315fa25-1b25-4555-a677-03b306313990 admin admin] PATH_INFO: `/v3/projects/cc5a587498eb4c3d825e0e7e699dded5` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:41.659733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b315fa25-1b25-4555-a677-03b306313990 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc5a587498eb4c3d825e0e7e699dded5)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:41.669427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b315fa25-1b25-4555-a677-03b306313990 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:41.766529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b315fa25-1b25-4555-a677-03b306313990 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc5a587498eb4c3d825e0e7e699dded5', 'request_id': 'req-b315fa25-1b25-4555-a677-03b306313990'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:41.783385 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b315fa25-1b25-4555-a677-03b306313990 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc5a587498eb4c3d825e0e7e699dded5', 'request_id': 'req-b315fa25-1b25-4555-a677-03b306313990'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:41.803105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b315fa25-1b25-4555-a677-03b306313990 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc5a587498eb4c3d825e0e7e699dded5', 'request_id': 'req-b315fa25-1b25-4555-a677-03b306313990'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:41.823938 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b315fa25-1b25-4555-a677-03b306313990 admin admin] The token cache is being invalidate because project cc5a587498eb4c3d825e0e7e699dded5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:12:41.824233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b315fa25-1b25-4555-a677-03b306313990 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:41.824916 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b315fa25-1b25-4555-a677-03b306313990 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:41.827187 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2711/5381] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:12:41 2022] DELETE /identity/v3/projects/cc5a587498eb4c3d825e0e7e699dded5 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:12:41.832907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ececc4-012b-442f-87a7-72ef54e5f29d None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:41.839405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ececc4-012b-442f-87a7-72ef54e5f29d None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:41.839894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ececc4-012b-442f-87a7-72ef54e5f29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:41.880747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-82ececc4-012b-442f-87a7-72ef54e5f29d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:41.882197 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-82ececc4-012b-442f-87a7-72ef54e5f29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:41.972094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:42.035072 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2671/5382] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:12:42.036854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2911ed-5074-4c46-ba69-182f496e374f None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:42.037946 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2911ed-5074-4c46-ba69-182f496e374f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:42.038370 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2911ed-5074-4c46-ba69-182f496e374f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:42.054108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:42.084081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-2b2911ed-5074-4c46-ba69-182f496e374f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:42.085386 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2b2911ed-5074-4c46-ba69-182f496e374f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:42.106535 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2712/5383] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:12:42.114932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ececc4-012b-442f-87a7-72ef54e5f29d None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:42.136635 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ececc4-012b-442f-87a7-72ef54e5f29d None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:42.147941 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0242c-e5f6-42fe-b854-e53d36abdfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:42.151702 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0242c-e5f6-42fe-b854-e53d36abdfca admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:42.151991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0242c-e5f6-42fe-b854-e53d36abdfca admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:42.152265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0242c-e5f6-42fe-b854-e53d36abdfca admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:42.152948 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0242c-e5f6-42fe-b854-e53d36abdfca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:12:42.153253 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0242c-e5f6-42fe-b854-e53d36abdfca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:42.161623 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0242c-e5f6-42fe-b854-e53d36abdfca admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:42.186342 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2672/5384] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:12:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:12:42.191293 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2911ed-5074-4c46-ba69-182f496e374f None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:42.208468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2911ed-5074-4c46-ba69-182f496e374f None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:42.242503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee06a7e-185c-4ce4-b80d-b04530da93ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:42.244815 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee06a7e-185c-4ce4-b80d-b04530da93ac admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:42.245531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee06a7e-185c-4ce4-b80d-b04530da93ac admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:42.247451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee06a7e-185c-4ce4-b80d-b04530da93ac admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:42.249370 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee06a7e-185c-4ce4-b80d-b04530da93ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:42.253325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee06a7e-185c-4ce4-b80d-b04530da93ac admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:42.329772 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2713/5385] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:12:42 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:12:42.330410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0242c-e5f6-42fe-b854-e53d36abdfca admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:42.348485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0242c-e5f6-42fe-b854-e53d36abdfca admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:42.445099 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0e7e0-e353-4596-be8e-75049e262416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:42.445954 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0e7e0-e353-4596-be8e-75049e262416 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:42.446681 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0e7e0-e353-4596-be8e-75049e262416 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:42.447073 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0e7e0-e353-4596-be8e-75049e262416 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:42.447704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0e7e0-e353-4596-be8e-75049e262416 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:42.449973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0e7e0-e353-4596-be8e-75049e262416 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:42.484204 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2673/5386] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:12:42 2022] POST /identity/v3/users => generated 288 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:12:42.490506 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee06a7e-185c-4ce4-b80d-b04530da93ac admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:42.520359 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee06a7e-185c-4ce4-b80d-b04530da93ac admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:42.532186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8db6de-2bfa-43a8-9085-3e280bb7db7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:42.532928 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8db6de-2bfa-43a8-9085-3e280bb7db7d admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:42.533315 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8db6de-2bfa-43a8-9085-3e280bb7db7d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:42.533691 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8db6de-2bfa-43a8-9085-3e280bb7db7d admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:42.534527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8db6de-2bfa-43a8-9085-3e280bb7db7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:42.536342 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8db6de-2bfa-43a8-9085-3e280bb7db7d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:42.597299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0e7e0-e353-4596-be8e-75049e262416 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:42.608576 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2714/5387] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:12:42.613138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0e7e0-e353-4596-be8e-75049e262416 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:42.621849 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d386c6d-d081-4026-a954-8192c8f518fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:42.623977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d386c6d-d081-4026-a954-8192c8f518fe admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:42.625464 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d386c6d-d081-4026-a954-8192c8f518fe admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:42.626211 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d386c6d-d081-4026-a954-8192c8f518fe admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:42.627563 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d386c6d-d081-4026-a954-8192c8f518fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:42.629984 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d386c6d-d081-4026-a954-8192c8f518fe admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:42.652580 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2674/5388] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:12:42.654131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8db6de-2bfa-43a8-9085-3e280bb7db7d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:42.695928 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8db6de-2bfa-43a8-9085-3e280bb7db7d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:42.706010 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927be41d-993a-4bfd-ae39-0019f2c8db37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:42.707110 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927be41d-993a-4bfd-ae39-0019f2c8db37 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:42.707676 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927be41d-993a-4bfd-ae39-0019f2c8db37 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:42.708303 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927be41d-993a-4bfd-ae39-0019f2c8db37 admin admin] PATH_INFO: `/v3/projects/cc43f19f84f14dcfa679306a44a084a4/users/7f4428ffb7084beeae4b70be1356c332/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:42.757486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927be41d-993a-4bfd-ae39-0019f2c8db37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc43f19f84f14dcfa679306a44a084a4, user_id=7f4428ffb7084beeae4b70be1356c332, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:42.776409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927be41d-993a-4bfd-ae39-0019f2c8db37 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:42.823466 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2715/5389] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:12:42 2022] PUT /identity/v3/projects/cc43f19f84f14dcfa679306a44a084a4/users/7f4428ffb7084beeae4b70be1356c332/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:12:42.823671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6ebde-0258-4dc2-aa29-e3ccb883067e None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:42.823889 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6ebde-0258-4dc2-aa29-e3ccb883067e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:42.824451 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6ebde-0258-4dc2-aa29-e3ccb883067e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:42.882806 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-05e6ebde-0258-4dc2-aa29-e3ccb883067e None None] MFA Rules not processed for user `7f4428ffb7084beeae4b70be1356c332`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:42.885546 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-05e6ebde-0258-4dc2-aa29-e3ccb883067e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:42.978995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69459ab9-3e44-4910-b4d1-a72e4ec434d7 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:42.979626 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69459ab9-3e44-4910-b4d1-a72e4ec434d7 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:42.980090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69459ab9-3e44-4910-b4d1-a72e4ec434d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:42.996323 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2675/5390] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:12:43.004579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6ebde-0258-4dc2-aa29-e3ccb883067e None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:43.006057 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-05e6ebde-0258-4dc2-aa29-e3ccb883067e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:43.106468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-69459ab9-3e44-4910-b4d1-a72e4ec434d7 None None] MFA Rules not processed for user `9b8463a42f2642aaba586380391de6fd`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:43.112675 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-69459ab9-3e44-4910-b4d1-a72e4ec434d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:43.114110 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:43.270467 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2716/5391] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:12:43.273939 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6ebde-0258-4dc2-aa29-e3ccb883067e None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:43.288497 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735bf0c2-2506-490f-9e0f-c3186e41f044 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:43.291518 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735bf0c2-2506-490f-9e0f-c3186e41f044 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:43.295069 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735bf0c2-2506-490f-9e0f-c3186e41f044 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:43.295753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735bf0c2-2506-490f-9e0f-c3186e41f044 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:43.317756 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735bf0c2-2506-490f-9e0f-c3186e41f044 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:43.321229 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735bf0c2-2506-490f-9e0f-c3186e41f044 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:43.339271 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69459ab9-3e44-4910-b4d1-a72e4ec434d7 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:43.340801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-69459ab9-3e44-4910-b4d1-a72e4ec434d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:43.363326 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2676/5392] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:12:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:12:43.409828 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69459ab9-3e44-4910-b4d1-a72e4ec434d7 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:43.433405 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c37ef2-3957-400f-975b-79baea45d6d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:43.435720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c37ef2-3957-400f-975b-79baea45d6d2 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:43.436114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c37ef2-3957-400f-975b-79baea45d6d2 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:43.436692 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c37ef2-3957-400f-975b-79baea45d6d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:43.460352 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c37ef2-3957-400f-975b-79baea45d6d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:43.464087 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c37ef2-3957-400f-975b-79baea45d6d2 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:43.478963 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2717/5393] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:12:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:12:43.782729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735bf0c2-2506-490f-9e0f-c3186e41f044 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:43.969390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735bf0c2-2506-490f-9e0f-c3186e41f044 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:43.981310 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e8bdc-0d61-4cea-b3d6-928673fef1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:43.981970 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e8bdc-0d61-4cea-b3d6-928673fef1ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:43.982245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e8bdc-0d61-4cea-b3d6-928673fef1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:43.982810 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e8bdc-0d61-4cea-b3d6-928673fef1ca admin admin] PATH_INFO: `/v3/users/7f4428ffb7084beeae4b70be1356c332` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:43.985143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9e8bdc-0d61-4cea-b3d6-928673fef1ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f4428ffb7084beeae4b70be1356c332)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:43.998078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9e8bdc-0d61-4cea-b3d6-928673fef1ca admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:44.167612 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9f9e8bdc-0d61-4cea-b3d6-928673fef1ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f4428ffb7084beeae4b70be1356c332'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:44.168322 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9f9e8bdc-0d61-4cea-b3d6-928673fef1ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f4428ffb7084beeae4b70be1356c332'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:44.169743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9f9e8bdc-0d61-4cea-b3d6-928673fef1ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f4428ffb7084beeae4b70be1356c332'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:44.199760 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9f9e8bdc-0d61-4cea-b3d6-928673fef1ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f4428ffb7084beeae4b70be1356c332'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:44.222037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9f9e8bdc-0d61-4cea-b3d6-928673fef1ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f4428ffb7084beeae4b70be1356c332'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:44.255012 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2677/5394] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:12:43 2022] DELETE /identity/v3/users/7f4428ffb7084beeae4b70be1356c332 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:12:44.260099 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbe93b-b52e-486d-b131-6178b47bca69 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:44.260563 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbe93b-b52e-486d-b131-6178b47bca69 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:44.260683 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbe93b-b52e-486d-b131-6178b47bca69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:44.311202 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-aebbe93b-b52e-486d-b131-6178b47bca69 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:44.312430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-aebbe93b-b52e-486d-b131-6178b47bca69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:44.441953 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2718/5395] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:12:44.507753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e8bdc-0d61-4cea-b3d6-928673fef1ca admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:44.512025 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9f9e8bdc-0d61-4cea-b3d6-928673fef1ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:44.629588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:44.701279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e8bdc-0d61-4cea-b3d6-928673fef1ca admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:44.707606 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3e933-4f4a-405c-8bae-1d69e62158b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:44.708416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3e933-4f4a-405c-8bae-1d69e62158b8 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:44.708805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3e933-4f4a-405c-8bae-1d69e62158b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:44.709081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3e933-4f4a-405c-8bae-1d69e62158b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:44.725364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3e933-4f4a-405c-8bae-1d69e62158b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:44.727089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3e933-4f4a-405c-8bae-1d69e62158b8 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:44.748566 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2678/5396] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:12:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:12:46.921258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbe93b-b52e-486d-b131-6178b47bca69 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:46.923814 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-aebbe93b-b52e-486d-b131-6178b47bca69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:46.944092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbe93b-b52e-486d-b131-6178b47bca69 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:46.958932 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054c6cc-67c3-427f-8e72-0f49c7abe8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:46.959698 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054c6cc-67c3-427f-8e72-0f49c7abe8fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:46.960165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054c6cc-67c3-427f-8e72-0f49c7abe8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:46.960564 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054c6cc-67c3-427f-8e72-0f49c7abe8fa admin admin] PATH_INFO: `/v3/projects/cc43f19f84f14dcfa679306a44a084a4` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:46.961855 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9054c6cc-67c3-427f-8e72-0f49c7abe8fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc43f19f84f14dcfa679306a44a084a4)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:46.964883 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9054c6cc-67c3-427f-8e72-0f49c7abe8fa admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:46.981018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:47.053839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9054c6cc-67c3-427f-8e72-0f49c7abe8fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc43f19f84f14dcfa679306a44a084a4', 'request_id': 'req-9054c6cc-67c3-427f-8e72-0f49c7abe8fa'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:47.063279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9054c6cc-67c3-427f-8e72-0f49c7abe8fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc43f19f84f14dcfa679306a44a084a4', 'request_id': 'req-9054c6cc-67c3-427f-8e72-0f49c7abe8fa'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:47.074810 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9054c6cc-67c3-427f-8e72-0f49c7abe8fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc43f19f84f14dcfa679306a44a084a4', 'request_id': 'req-9054c6cc-67c3-427f-8e72-0f49c7abe8fa'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:47.092997 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9054c6cc-67c3-427f-8e72-0f49c7abe8fa admin admin] The token cache is being invalidate because project cc43f19f84f14dcfa679306a44a084a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:12:47.093395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9054c6cc-67c3-427f-8e72-0f49c7abe8fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:47.094199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9054c6cc-67c3-427f-8e72-0f49c7abe8fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:47.096299 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2719/5397] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:12:46 2022] DELETE /identity/v3/projects/cc43f19f84f14dcfa679306a44a084a4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:12:47.101701 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb18da-b403-454d-9d88-37a2ed3590ea None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:47.102687 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb18da-b403-454d-9d88-37a2ed3590ea None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:47.103838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb18da-b403-454d-9d88-37a2ed3590ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:47.132825 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-0efb18da-b403-454d-9d88-37a2ed3590ea None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:47.134520 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0efb18da-b403-454d-9d88-37a2ed3590ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:47.220744 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2679/5398] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:12:47.228512 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff9670-9ebd-4d55-8ab7-37f90950a24e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:47.228884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff9670-9ebd-4d55-8ab7-37f90950a24e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:47.229340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff9670-9ebd-4d55-8ab7-37f90950a24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:47.258472 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-01ff9670-9ebd-4d55-8ab7-37f90950a24e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:47.262168 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-01ff9670-9ebd-4d55-8ab7-37f90950a24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:47.279901 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2720/5399] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:12:47.284112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb18da-b403-454d-9d88-37a2ed3590ea None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:47.296831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb18da-b403-454d-9d88-37a2ed3590ea None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:47.304789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d81e5-fc71-4a2d-8a6d-34ffff9a73c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:47.307159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d81e5-fc71-4a2d-8a6d-34ffff9a73c6 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:47.307789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d81e5-fc71-4a2d-8a6d-34ffff9a73c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:47.308452 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d81e5-fc71-4a2d-8a6d-34ffff9a73c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:47.309383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d81e5-fc71-4a2d-8a6d-34ffff9a73c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:12:47.309795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d81e5-fc71-4a2d-8a6d-34ffff9a73c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:47.311627 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d81e5-fc71-4a2d-8a6d-34ffff9a73c6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:47.331854 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2680/5400] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:12:47.335913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff9670-9ebd-4d55-8ab7-37f90950a24e None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:47.347333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff9670-9ebd-4d55-8ab7-37f90950a24e None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:47.355093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18ade0-3414-4843-8c67-18a00017d666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:47.356137 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18ade0-3414-4843-8c67-18a00017d666 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:47.356660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18ade0-3414-4843-8c67-18a00017d666 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:47.357177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18ade0-3414-4843-8c67-18a00017d666 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:47.358065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18ade0-3414-4843-8c67-18a00017d666 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:47.361345 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18ade0-3414-4843-8c67-18a00017d666 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:47.397205 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2721/5401] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:12:47 2022] POST /identity/v3/projects => generated 367 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:12:47.402491 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d81e5-fc71-4a2d-8a6d-34ffff9a73c6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:47.417007 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d81e5-fc71-4a2d-8a6d-34ffff9a73c6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:47.509021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767f26b-1a49-4a45-9165-a2eaa8d13a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:47.510266 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767f26b-1a49-4a45-9165-a2eaa8d13a17 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:47.511007 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767f26b-1a49-4a45-9165-a2eaa8d13a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:47.511317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767f26b-1a49-4a45-9165-a2eaa8d13a17 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:47.514000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3767f26b-1a49-4a45-9165-a2eaa8d13a17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:47.516335 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3767f26b-1a49-4a45-9165-a2eaa8d13a17 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:47.548948 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2681/5402] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:12:47 2022] POST /identity/v3/users => generated 284 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:12:47.552731 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18ade0-3414-4843-8c67-18a00017d666 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:47.565746 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18ade0-3414-4843-8c67-18a00017d666 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:47.574773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff868f-53a0-43fc-b274-de5b35a4540b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:47.575391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff868f-53a0-43fc-b274-de5b35a4540b admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:47.576084 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff868f-53a0-43fc-b274-de5b35a4540b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:47.576693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff868f-53a0-43fc-b274-de5b35a4540b admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:47.577663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff868f-53a0-43fc-b274-de5b35a4540b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:47.581591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff868f-53a0-43fc-b274-de5b35a4540b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:47.596485 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2722/5403] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:12:47.600162 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767f26b-1a49-4a45-9165-a2eaa8d13a17 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:47.613018 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767f26b-1a49-4a45-9165-a2eaa8d13a17 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:47.618131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e111f3-4935-4db2-84f8-ba9e74e1f5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:47.619458 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e111f3-4935-4db2-84f8-ba9e74e1f5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:47.619756 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e111f3-4935-4db2-84f8-ba9e74e1f5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:47.620141 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e111f3-4935-4db2-84f8-ba9e74e1f5d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:47.621047 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e111f3-4935-4db2-84f8-ba9e74e1f5d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:47.622790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e111f3-4935-4db2-84f8-ba9e74e1f5d1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:47.642032 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2682/5404] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:12:47.645968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff868f-53a0-43fc-b274-de5b35a4540b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:47.664127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff868f-53a0-43fc-b274-de5b35a4540b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:47.678837 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e13a9-2ecc-4de9-b49f-fe53ab26de8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:47.679879 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e13a9-2ecc-4de9-b49f-fe53ab26de8d admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:47.680410 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e13a9-2ecc-4de9-b49f-fe53ab26de8d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:47.680868 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e13a9-2ecc-4de9-b49f-fe53ab26de8d admin admin] PATH_INFO: `/v3/projects/eb3eb23f429845a197717b61f8cf168b/users/cde4dd234a1a494da6a3e7444553979b/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:47.705246 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237e13a9-2ecc-4de9-b49f-fe53ab26de8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb3eb23f429845a197717b61f8cf168b, user_id=cde4dd234a1a494da6a3e7444553979b, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:47.708446 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237e13a9-2ecc-4de9-b49f-fe53ab26de8d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:47.730830 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2723/5405] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:12:47 2022] PUT /identity/v3/projects/eb3eb23f429845a197717b61f8cf168b/users/cde4dd234a1a494da6a3e7444553979b/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:12:47.744598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080de23-6709-4bda-a89d-3457c43f7b3a None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:47.745091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080de23-6709-4bda-a89d-3457c43f7b3a None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:47.745370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080de23-6709-4bda-a89d-3457c43f7b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:47.783595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-6080de23-6709-4bda-a89d-3457c43f7b3a None None] MFA Rules not processed for user `cde4dd234a1a494da6a3e7444553979b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:47.785079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6080de23-6709-4bda-a89d-3457c43f7b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:47.817596 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:47.834200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e91dd-ac88-494c-8740-ffd782009851 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:47.835464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e91dd-ac88-494c-8740-ffd782009851 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:47.835826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e91dd-ac88-494c-8740-ffd782009851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:47.910620 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-f99e91dd-ac88-494c-8740-ffd782009851 None None] MFA Rules not processed for user `a6c953ff2f774041a7d50f53033ee124`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:47.934285 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2683/5406] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:12:47.935223 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f99e91dd-ac88-494c-8740-ffd782009851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:47.937582 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6080de23-6709-4bda-a89d-3457c43f7b3a None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:48.106752 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6080de23-6709-4bda-a89d-3457c43f7b3a None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:48.122437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aff196-0749-46ce-ace9-fdac13c06ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:48.122437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aff196-0749-46ce-ace9-fdac13c06ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:48.122777 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aff196-0749-46ce-ace9-fdac13c06ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:48.122887 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2724/5407] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:12:48.123335 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aff196-0749-46ce-ace9-fdac13c06ee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:48.124139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aff196-0749-46ce-ace9-fdac13c06ee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:48.126221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aff196-0749-46ce-ace9-fdac13c06ee3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:48.130724 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10699fb7-30bd-4b17-af05-d4f5ccc0cd3a None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:48.131303 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10699fb7-30bd-4b17-af05-d4f5ccc0cd3a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:48.131790 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10699fb7-30bd-4b17-af05-d4f5ccc0cd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:48.172621 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-10699fb7-30bd-4b17-af05-d4f5ccc0cd3a None None] MFA Rules not processed for user `a6c953ff2f774041a7d50f53033ee124`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:48.174718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-10699fb7-30bd-4b17-af05-d4f5ccc0cd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:48.191241 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2684/5408] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:12:47 2022] POST /identity/v3/projects => generated 365 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:12:48.195266 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aff196-0749-46ce-ace9-fdac13c06ee3 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:48.199247 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2725/5409] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:12:48.212452 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10699fb7-30bd-4b17-af05-d4f5ccc0cd3a None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:48.214488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-10699fb7-30bd-4b17-af05-d4f5ccc0cd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:48.260030 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:48.348994 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aff196-0749-46ce-ace9-fdac13c06ee3 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:48.365512 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5f4ab-6475-4397-bccf-965569d2b9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:48.367352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5f4ab-6475-4397-bccf-965569d2b9fb admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:48.372133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5f4ab-6475-4397-bccf-965569d2b9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:48.372594 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5f4ab-6475-4397-bccf-965569d2b9fb admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:48.373501 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5f4ab-6475-4397-bccf-965569d2b9fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:48.380114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5f4ab-6475-4397-bccf-965569d2b9fb admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:48.397191 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10699fb7-30bd-4b17-af05-d4f5ccc0cd3a None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:48.423142 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2685/5410] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:12:48 2022] POST /identity/v3/users => generated 289 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:12:48.427886 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5f4ab-6475-4397-bccf-965569d2b9fb admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:48.452920 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5f4ab-6475-4397-bccf-965569d2b9fb admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:48.467271 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027978af-61ce-42a9-a6ee-f3fbd3c4406c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:48.468197 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027978af-61ce-42a9-a6ee-f3fbd3c4406c admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:48.468549 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027978af-61ce-42a9-a6ee-f3fbd3c4406c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:48.470058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027978af-61ce-42a9-a6ee-f3fbd3c4406c admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:48.470847 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027978af-61ce-42a9-a6ee-f3fbd3c4406c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:48.472575 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027978af-61ce-42a9-a6ee-f3fbd3c4406c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:48.496850 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2686/5411] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:12:48.497872 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027978af-61ce-42a9-a6ee-f3fbd3c4406c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:48.515771 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027978af-61ce-42a9-a6ee-f3fbd3c4406c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:48.529509 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d2cba-1c3f-4627-83e3-1002dea82102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:48.531069 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d2cba-1c3f-4627-83e3-1002dea82102 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:48.532505 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d2cba-1c3f-4627-83e3-1002dea82102 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:48.533041 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d2cba-1c3f-4627-83e3-1002dea82102 admin admin] PATH_INFO: `/v3/projects/d6d483b4f99b4091ab10cde94f64b055/users/a3e932c4020a4c3fb22652d4ddc87d89/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:48.557406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42798c-a77e-44a0-99b0-b32ca6392cc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:48.558253 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42798c-a77e-44a0-99b0-b32ca6392cc5 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:48.558648 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42798c-a77e-44a0-99b0-b32ca6392cc5 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:48.559056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42798c-a77e-44a0-99b0-b32ca6392cc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:48.568305 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d2cba-1c3f-4627-83e3-1002dea82102 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6d483b4f99b4091ab10cde94f64b055, user_id=a3e932c4020a4c3fb22652d4ddc87d89, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:48.572573 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d2cba-1c3f-4627-83e3-1002dea82102 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:48.593814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:48.604952 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2687/5412] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:12:48 2022] PUT /identity/v3/projects/d6d483b4f99b4091ab10cde94f64b055/users/a3e932c4020a4c3fb22652d4ddc87d89/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:12:48.609733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d2cba-1c3f-4627-83e3-1002dea82102 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:48.695196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42798c-a77e-44a0-99b0-b32ca6392cc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:48.697427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42798c-a77e-44a0-99b0-b32ca6392cc5 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:48.732670 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2726/5413] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:12:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:12:48.761343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d2cba-1c3f-4627-83e3-1002dea82102 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:48.776757 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db427d5f-096b-465c-b54e-e3c69b7c3342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:48.777533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db427d5f-096b-465c-b54e-e3c69b7c3342 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:48.777885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db427d5f-096b-465c-b54e-e3c69b7c3342 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:48.778231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db427d5f-096b-465c-b54e-e3c69b7c3342 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:48.778987 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db427d5f-096b-465c-b54e-e3c69b7c3342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:48.786588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db427d5f-096b-465c-b54e-e3c69b7c3342 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:48.801896 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2688/5414] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:12:48.806259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42798c-a77e-44a0-99b0-b32ca6392cc5 service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:48.819333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42798c-a77e-44a0-99b0-b32ca6392cc5 service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:48.825645 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88b936-e601-4c81-b929-8977088d7248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:48.827794 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88b936-e601-4c81-b929-8977088d7248 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:48.827968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88b936-e601-4c81-b929-8977088d7248 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:48.828426 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88b936-e601-4c81-b929-8977088d7248 admin admin] PATH_INFO: `/v3/projects/d6d483b4f99b4091ab10cde94f64b055/users/a3e932c4020a4c3fb22652d4ddc87d89/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:48.830449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca88b936-e601-4c81-b929-8977088d7248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6d483b4f99b4091ab10cde94f64b055, user_id=a3e932c4020a4c3fb22652d4ddc87d89, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:48.833670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca88b936-e601-4c81-b929-8977088d7248 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:48.861437 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2727/5415] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:12:48 2022] PUT /identity/v3/projects/d6d483b4f99b4091ab10cde94f64b055/users/a3e932c4020a4c3fb22652d4ddc87d89/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:12:48.863064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab89aec-587f-48a6-8289-bf47c0dbe2e5 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:48.863350 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab89aec-587f-48a6-8289-bf47c0dbe2e5 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:48.863625 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab89aec-587f-48a6-8289-bf47c0dbe2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:48.901924 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-eab89aec-587f-48a6-8289-bf47c0dbe2e5 None None] MFA Rules not processed for user `a3e932c4020a4c3fb22652d4ddc87d89`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:48.905144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-eab89aec-587f-48a6-8289-bf47c0dbe2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:49.083342 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2689/5416] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:48 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:12:49.089972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88b936-e601-4c81-b929-8977088d7248 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:49.109025 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88b936-e601-4c81-b929-8977088d7248 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:49.119614 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1408a-8bd8-4f42-a73d-692a6769f053 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3e932c4020a4c3fb22652d4ddc87d89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d483b4f99b4091ab10cde94f64b055', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:49.119614 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1408a-8bd8-4f42-a73d-692a6769f053 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:49.119614 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1408a-8bd8-4f42-a73d-692a6769f053 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:49.119877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1408a-8bd8-4f42-a73d-692a6769f053 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:49.119877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1408a-8bd8-4f42-a73d-692a6769f053 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:49.120265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1408a-8bd8-4f42-a73d-692a6769f053 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:49.157622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab89aec-587f-48a6-8289-bf47c0dbe2e5 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:49.158165 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2728/5417] 10.222.0.33 () {60 vars in 1149 bytes} [Sat Aug 6 21:12:49 2022] POST /identity/v3/domains => generated 275 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:12:49.169330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab89aec-587f-48a6-8289-bf47c0dbe2e5 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:49.307352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224ad1d-4d9b-4fcc-b007-1fd60b8ab542 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3e932c4020a4c3fb22652d4ddc87d89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d483b4f99b4091ab10cde94f64b055', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:49.307989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224ad1d-4d9b-4fcc-b007-1fd60b8ab542 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:49.308282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224ad1d-4d9b-4fcc-b007-1fd60b8ab542 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:49.308530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224ad1d-4d9b-4fcc-b007-1fd60b8ab542 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:49.309163 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6224ad1d-4d9b-4fcc-b007-1fd60b8ab542 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:49.311205 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6224ad1d-4d9b-4fcc-b007-1fd60b8ab542 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:49.393050 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2690/5418] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:12:49 2022] POST /identity/v3/users => generated 348 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:12:49.397987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1408a-8bd8-4f42-a73d-692a6769f053 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:49.425394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1408a-8bd8-4f42-a73d-692a6769f053 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:49.450803 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af59c13-6543-48d7-95be-3c983703d604 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3e932c4020a4c3fb22652d4ddc87d89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d483b4f99b4091ab10cde94f64b055', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:49.452230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af59c13-6543-48d7-95be-3c983703d604 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:49.452679 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af59c13-6543-48d7-95be-3c983703d604 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:49.453335 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af59c13-6543-48d7-95be-3c983703d604 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:49.454576 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af59c13-6543-48d7-95be-3c983703d604 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:49.463167 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af59c13-6543-48d7-95be-3c983703d604 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:49.548867 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2729/5419] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:12:49 2022] POST /identity/v3/users => generated 324 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:12:49.553956 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224ad1d-4d9b-4fcc-b007-1fd60b8ab542 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:49.565743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:49.577543 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224ad1d-4d9b-4fcc-b007-1fd60b8ab542 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:49.611129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adcc904-5853-4149-a381-c43051a029a5 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3e932c4020a4c3fb22652d4ddc87d89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d483b4f99b4091ab10cde94f64b055', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:49.611824 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcc904-5853-4149-a381-c43051a029a5 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:49.612106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcc904-5853-4149-a381-c43051a029a5 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:49.612384 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcc904-5853-4149-a381-c43051a029a5 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] PATH_INFO: `/v3/users/f47d1ef7e9b54c969e7e2b36040ae68b` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:49.680688 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adcc904-5853-4149-a381-c43051a029a5 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] RBAC: Authorizing `identity:get_user(user_id=f47d1ef7e9b54c969e7e2b36040ae68b)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:49.683408 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adcc904-5853-4149-a381-c43051a029a5 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:49.685355 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2691/5420] 10.222.0.33 () {58 vars in 1221 bytes} [Sat Aug 6 21:12:49 2022] GET /identity/v3/users/f47d1ef7e9b54c969e7e2b36040ae68b => generated 348 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:12:49.693594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af59c13-6543-48d7-95be-3c983703d604 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:49.722998 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af59c13-6543-48d7-95be-3c983703d604 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:49.739718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e5b0b-ff4f-4241-bbda-67812dea1a19 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3e932c4020a4c3fb22652d4ddc87d89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d483b4f99b4091ab10cde94f64b055', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:49.740357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e5b0b-ff4f-4241-bbda-67812dea1a19 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:49.740641 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e5b0b-ff4f-4241-bbda-67812dea1a19 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:49.740914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e5b0b-ff4f-4241-bbda-67812dea1a19 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:49.741627 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e5b0b-ff4f-4241-bbda-67812dea1a19 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] RBAC: Adding query filter params (domain_id=cb9aa1bfc1594c77872a85145d6f178a) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:12:49.741930 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e5b0b-ff4f-4241-bbda-67812dea1a19 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:49.752126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e5b0b-ff4f-4241-bbda-67812dea1a19 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:49.756826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:49.786044 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2730/5421] 10.222.0.33 () {58 vars in 1207 bytes} [Sat Aug 6 21:12:49 2022] GET /identity/v3/users?domain_id=cb9aa1bfc1594c77872a85145d6f178a => generated 485 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:12:49.787696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adcc904-5853-4149-a381-c43051a029a5 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:49.804445 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adcc904-5853-4149-a381-c43051a029a5 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:49.819103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba6c6b-61ad-46b3-b9f7-890c1d075327 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3e932c4020a4c3fb22652d4ddc87d89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d483b4f99b4091ab10cde94f64b055', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:49.823751 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba6c6b-61ad-46b3-b9f7-890c1d075327 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:49.823751 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba6c6b-61ad-46b3-b9f7-890c1d075327 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:49.823751 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba6c6b-61ad-46b3-b9f7-890c1d075327 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:49.823751 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ba6c6b-61ad-46b3-b9f7-890c1d075327 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:49.853474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ba6c6b-61ad-46b3-b9f7-890c1d075327 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:49.940404 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2692/5422] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:12:49 2022] GET /identity/v3/users => generated 8586 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:12:49.941476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e5b0b-ff4f-4241-bbda-67812dea1a19 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:49.952745 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e5b0b-ff4f-4241-bbda-67812dea1a19 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:49.971351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71d954-b2b2-480e-a93f-eb8313240463 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3e932c4020a4c3fb22652d4ddc87d89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d483b4f99b4091ab10cde94f64b055', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:49.972070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71d954-b2b2-480e-a93f-eb8313240463 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:49.972255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71d954-b2b2-480e-a93f-eb8313240463 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:49.972533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71d954-b2b2-480e-a93f-eb8313240463 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:49.973247 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71d954-b2b2-480e-a93f-eb8313240463 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] RBAC: Adding query filter params (name=tempest-test_user-1806990495) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:12:49.973560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71d954-b2b2-480e-a93f-eb8313240463 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:49.979292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71d954-b2b2-480e-a93f-eb8313240463 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:50.020970 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2731/5423] 10.222.0.33 () {58 vars in 1189 bytes} [Sat Aug 6 21:12:49 2022] GET /identity/v3/users?name=tempest-test_user-1806990495 => generated 476 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:12:50.022605 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba6c6b-61ad-46b3-b9f7-890c1d075327 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:50.037775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba6c6b-61ad-46b3-b9f7-890c1d075327 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:50.050973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554f94b-83ef-4e11-8ddf-de509ec1db6e tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3e932c4020a4c3fb22652d4ddc87d89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d483b4f99b4091ab10cde94f64b055', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:50.051739 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554f94b-83ef-4e11-8ddf-de509ec1db6e tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:50.052097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554f94b-83ef-4e11-8ddf-de509ec1db6e tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:50.052379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554f94b-83ef-4e11-8ddf-de509ec1db6e tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:50.053678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554f94b-83ef-4e11-8ddf-de509ec1db6e tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:12:50.053991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554f94b-83ef-4e11-8ddf-de509ec1db6e tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:50.058155 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554f94b-83ef-4e11-8ddf-de509ec1db6e tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:50.221746 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2693/5424] 10.222.0.33 () {58 vars in 1149 bytes} [Sat Aug 6 21:12:50 2022] GET /identity/v3/users?enabled=False => generated 432 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:12:50.223953 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71d954-b2b2-480e-a93f-eb8313240463 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:50.243153 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71d954-b2b2-480e-a93f-eb8313240463 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:50.263404 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4693aa2-199d-47bc-9df7-21c9d66aedd7 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3e932c4020a4c3fb22652d4ddc87d89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d483b4f99b4091ab10cde94f64b055', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:50.264071 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4693aa2-199d-47bc-9df7-21c9d66aedd7 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:50.264357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4693aa2-199d-47bc-9df7-21c9d66aedd7 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:50.264636 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4693aa2-199d-47bc-9df7-21c9d66aedd7 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] PATH_INFO: `/v3/users/e5a3d90f96324c81ab68054079d0f465` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:50.325881 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4693aa2-199d-47bc-9df7-21c9d66aedd7 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e5a3d90f96324c81ab68054079d0f465)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:50.327893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4693aa2-199d-47bc-9df7-21c9d66aedd7 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:50.437517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b4693aa2-199d-47bc-9df7-21c9d66aedd7 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5a3d90f96324c81ab68054079d0f465'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:50.446440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b4693aa2-199d-47bc-9df7-21c9d66aedd7 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5a3d90f96324c81ab68054079d0f465'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:50.450061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b4693aa2-199d-47bc-9df7-21c9d66aedd7 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5a3d90f96324c81ab68054079d0f465'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:50.457135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b4693aa2-199d-47bc-9df7-21c9d66aedd7 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5a3d90f96324c81ab68054079d0f465'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:50.472513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b4693aa2-199d-47bc-9df7-21c9d66aedd7 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5a3d90f96324c81ab68054079d0f465'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:50.507227 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2732/5425] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:12:50 2022] DELETE /identity/v3/users/e5a3d90f96324c81ab68054079d0f465 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:12:50.512233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554f94b-83ef-4e11-8ddf-de509ec1db6e tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:50.514640 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d554f94b-83ef-4e11-8ddf-de509ec1db6e tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:50.546729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554f94b-83ef-4e11-8ddf-de509ec1db6e tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:50.730669 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355cd112-f7df-4dd7-9988-b3012aa924b9 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3e932c4020a4c3fb22652d4ddc87d89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d483b4f99b4091ab10cde94f64b055', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:50.731852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cd112-f7df-4dd7-9988-b3012aa924b9 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:50.732400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cd112-f7df-4dd7-9988-b3012aa924b9 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:50.732936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cd112-f7df-4dd7-9988-b3012aa924b9 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] PATH_INFO: `/v3/users/f47d1ef7e9b54c969e7e2b36040ae68b` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:50.734523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355cd112-f7df-4dd7-9988-b3012aa924b9 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f47d1ef7e9b54c969e7e2b36040ae68b)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:50.740422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355cd112-f7df-4dd7-9988-b3012aa924b9 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:50.830143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-355cd112-f7df-4dd7-9988-b3012aa924b9 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f47d1ef7e9b54c969e7e2b36040ae68b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:50.832057 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-355cd112-f7df-4dd7-9988-b3012aa924b9 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f47d1ef7e9b54c969e7e2b36040ae68b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:50.832801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-355cd112-f7df-4dd7-9988-b3012aa924b9 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f47d1ef7e9b54c969e7e2b36040ae68b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:50.878621 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-355cd112-f7df-4dd7-9988-b3012aa924b9 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f47d1ef7e9b54c969e7e2b36040ae68b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:50.902076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-355cd112-f7df-4dd7-9988-b3012aa924b9 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f47d1ef7e9b54c969e7e2b36040ae68b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:50.921405 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2694/5426] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:12:50 2022] DELETE /identity/v3/users/f47d1ef7e9b54c969e7e2b36040ae68b => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:12:50.932220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4693aa2-199d-47bc-9df7-21c9d66aedd7 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:50.961886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4693aa2-199d-47bc-9df7-21c9d66aedd7 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:51.083108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a2393-d7bc-46e3-abd5-389f3d6fa41d tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3e932c4020a4c3fb22652d4ddc87d89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d483b4f99b4091ab10cde94f64b055', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:51.083765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a2393-d7bc-46e3-abd5-389f3d6fa41d tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:51.084049 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a2393-d7bc-46e3-abd5-389f3d6fa41d tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:51.084323 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a2393-d7bc-46e3-abd5-389f3d6fa41d tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] PATH_INFO: `/v3/domains/cb9aa1bfc1594c77872a85145d6f178a` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:51.085852 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a2393-d7bc-46e3-abd5-389f3d6fa41d tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=cb9aa1bfc1594c77872a85145d6f178a)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:51.087883 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a2393-d7bc-46e3-abd5-389f3d6fa41d tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:51.127030 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-452a2393-d7bc-46e3-abd5-389f3d6fa41d tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'cb9aa1bfc1594c77872a85145d6f178a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:51.128602 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-452a2393-d7bc-46e3-abd5-389f3d6fa41d tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'cb9aa1bfc1594c77872a85145d6f178a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:51.192352 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-452a2393-d7bc-46e3-abd5-389f3d6fa41d tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'cb9aa1bfc1594c77872a85145d6f178a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:51.193073 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-452a2393-d7bc-46e3-abd5-389f3d6fa41d tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'cb9aa1bfc1594c77872a85145d6f178a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:51.197065 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2733/5427] 10.222.0.33 () {60 vars in 1249 bytes} [Sat Aug 6 21:12:50 2022] PATCH /identity/v3/domains/cb9aa1bfc1594c77872a85145d6f178a => generated 276 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:12:51.200728 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355cd112-f7df-4dd7-9988-b3012aa924b9 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:51.203151 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-355cd112-f7df-4dd7-9988-b3012aa924b9 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:51.222590 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355cd112-f7df-4dd7-9988-b3012aa924b9 tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:51.368869 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:51.403270 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec5c0a-f45b-4301-a0cf-faabc009076e tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3e932c4020a4c3fb22652d4ddc87d89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d483b4f99b4091ab10cde94f64b055', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:51.403929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec5c0a-f45b-4301-a0cf-faabc009076e tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:51.404214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec5c0a-f45b-4301-a0cf-faabc009076e tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:51.404490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec5c0a-f45b-4301-a0cf-faabc009076e tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] PATH_INFO: `/v3/domains/cb9aa1bfc1594c77872a85145d6f178a` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:51.440340 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec5c0a-f45b-4301-a0cf-faabc009076e tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=cb9aa1bfc1594c77872a85145d6f178a)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:51.441415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec5c0a-f45b-4301-a0cf-faabc009076e tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:51.481409 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-93ec5c0a-f45b-4301-a0cf-faabc009076e tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'cb9aa1bfc1594c77872a85145d6f178a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:51.502784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-93ec5c0a-f45b-4301-a0cf-faabc009076e tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'cb9aa1bfc1594c77872a85145d6f178a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:51.560921 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-93ec5c0a-f45b-4301-a0cf-faabc009076e tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb9aa1bfc1594c77872a85145d6f178a', 'request_id': 'req-93ec5c0a-f45b-4301-a0cf-faabc009076e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:51.568461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-93ec5c0a-f45b-4301-a0cf-faabc009076e tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb9aa1bfc1594c77872a85145d6f178a', 'request_id': 'req-93ec5c0a-f45b-4301-a0cf-faabc009076e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:51.577323 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-93ec5c0a-f45b-4301-a0cf-faabc009076e tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb9aa1bfc1594c77872a85145d6f178a', 'request_id': 'req-93ec5c0a-f45b-4301-a0cf-faabc009076e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:51.622407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-93ec5c0a-f45b-4301-a0cf-faabc009076e tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] The token cache is being invalidate because project cb9aa1bfc1594c77872a85145d6f178a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:12:51.622943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-93ec5c0a-f45b-4301-a0cf-faabc009076e tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:51.625154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-93ec5c0a-f45b-4301-a0cf-faabc009076e tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:51.639895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-93ec5c0a-f45b-4301-a0cf-faabc009076e tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'cb9aa1bfc1594c77872a85145d6f178a', 'request_id': 'req-93ec5c0a-f45b-4301-a0cf-faabc009076e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:51.641735 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-93ec5c0a-f45b-4301-a0cf-faabc009076e tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'cb9aa1bfc1594c77872a85145d6f178a', 'request_id': 'req-93ec5c0a-f45b-4301-a0cf-faabc009076e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:51.643862 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-93ec5c0a-f45b-4301-a0cf-faabc009076e tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'cb9aa1bfc1594c77872a85145d6f178a', 'request_id': 'req-93ec5c0a-f45b-4301-a0cf-faabc009076e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:51.687962 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2695/5428] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:12:51 2022] DELETE /identity/v3/domains/cb9aa1bfc1594c77872a85145d6f178a => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:12:51.692025 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a2393-d7bc-46e3-abd5-389f3d6fa41d tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:51.694288 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-452a2393-d7bc-46e3-abd5-389f3d6fa41d tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:51.706466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:51.826093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a2393-d7bc-46e3-abd5-389f3d6fa41d tempest-UsersV3TestJSON-479474518 tempest-UsersV3TestJSON-479474518-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:51.943659 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b526320-4c75-4430-aac1-4767ae826bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:51.944496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b526320-4c75-4430-aac1-4767ae826bf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:51.944933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b526320-4c75-4430-aac1-4767ae826bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:51.945370 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b526320-4c75-4430-aac1-4767ae826bf9 admin admin] PATH_INFO: `/v3/users/cde4dd234a1a494da6a3e7444553979b` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:51.947500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b526320-4c75-4430-aac1-4767ae826bf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cde4dd234a1a494da6a3e7444553979b)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:51.950121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b526320-4c75-4430-aac1-4767ae826bf9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:52.091751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5b526320-4c75-4430-aac1-4767ae826bf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cde4dd234a1a494da6a3e7444553979b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:52.128426 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5b526320-4c75-4430-aac1-4767ae826bf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cde4dd234a1a494da6a3e7444553979b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:52.133282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5b526320-4c75-4430-aac1-4767ae826bf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cde4dd234a1a494da6a3e7444553979b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:52.138167 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5b526320-4c75-4430-aac1-4767ae826bf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cde4dd234a1a494da6a3e7444553979b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:52.171485 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5b526320-4c75-4430-aac1-4767ae826bf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cde4dd234a1a494da6a3e7444553979b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:52.232787 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2734/5429] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:12:51 2022] DELETE /identity/v3/users/cde4dd234a1a494da6a3e7444553979b => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:12:52.237319 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145926e-99f2-4645-85fc-55c99a407a58 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:52.238234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145926e-99f2-4645-85fc-55c99a407a58 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:52.238638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145926e-99f2-4645-85fc-55c99a407a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:52.271782 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-4145926e-99f2-4645-85fc-55c99a407a58 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:52.273163 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4145926e-99f2-4645-85fc-55c99a407a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:52.393347 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2696/5430] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:12:52.460727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b526320-4c75-4430-aac1-4767ae826bf9 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:52.462796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5b526320-4c75-4430-aac1-4767ae826bf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:52.560477 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:52.591650 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b526320-4c75-4430-aac1-4767ae826bf9 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:52.596512 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb400c8-00e9-41f7-8cc1-131aaac9338a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:52.597360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb400c8-00e9-41f7-8cc1-131aaac9338a service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:52.597790 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb400c8-00e9-41f7-8cc1-131aaac9338a service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:52.598218 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb400c8-00e9-41f7-8cc1-131aaac9338a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:52.612259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb400c8-00e9-41f7-8cc1-131aaac9338a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:52.613948 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb400c8-00e9-41f7-8cc1-131aaac9338a service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:52.628356 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2735/5431] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:12:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:12:52.924922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145926e-99f2-4645-85fc-55c99a407a58 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:52.926494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4145926e-99f2-4645-85fc-55c99a407a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:52.954636 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145926e-99f2-4645-85fc-55c99a407a58 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:52.960238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2daf020-dcb6-478e-9368-e1769465d70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:52.960883 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2daf020-dcb6-478e-9368-e1769465d70b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:52.961158 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2daf020-dcb6-478e-9368-e1769465d70b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:52.961429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2daf020-dcb6-478e-9368-e1769465d70b admin admin] PATH_INFO: `/v3/users/3bec04c3cb8d4299942b0bd624055b6b` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:52.972180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2daf020-dcb6-478e-9368-e1769465d70b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bec04c3cb8d4299942b0bd624055b6b)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:52.973450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2daf020-dcb6-478e-9368-e1769465d70b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:52.982579 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb400c8-00e9-41f7-8cc1-131aaac9338a service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:52.984192 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2fb400c8-00e9-41f7-8cc1-131aaac9338a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:53.011554 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:53.025298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb400c8-00e9-41f7-8cc1-131aaac9338a service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:53.033235 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29f8a5-7ab1-4587-aaad-b1d6ea1cce16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:53.034525 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29f8a5-7ab1-4587-aaad-b1d6ea1cce16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:53.035079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29f8a5-7ab1-4587-aaad-b1d6ea1cce16 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:53.035678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29f8a5-7ab1-4587-aaad-b1d6ea1cce16 admin admin] PATH_INFO: `/v3/users/e1f3f46d19a6484da3622833d894963d` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:53.037445 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d29f8a5-7ab1-4587-aaad-b1d6ea1cce16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1f3f46d19a6484da3622833d894963d)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:53.040834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d29f8a5-7ab1-4587-aaad-b1d6ea1cce16 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:53.099659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c2daf020-dcb6-478e-9368-e1769465d70b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bec04c3cb8d4299942b0bd624055b6b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:53.100382 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c2daf020-dcb6-478e-9368-e1769465d70b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bec04c3cb8d4299942b0bd624055b6b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:53.101314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c2daf020-dcb6-478e-9368-e1769465d70b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bec04c3cb8d4299942b0bd624055b6b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:53.117632 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c2daf020-dcb6-478e-9368-e1769465d70b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bec04c3cb8d4299942b0bd624055b6b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:53.155287 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c2daf020-dcb6-478e-9368-e1769465d70b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bec04c3cb8d4299942b0bd624055b6b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:53.205661 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2697/5432] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:12:52 2022] DELETE /identity/v3/users/3bec04c3cb8d4299942b0bd624055b6b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:12:53.209660 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6284fc-d0ca-4ba3-96cd-2ca8b2e6939b None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:53.209947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6284fc-d0ca-4ba3-96cd-2ca8b2e6939b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:53.210229 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6284fc-d0ca-4ba3-96cd-2ca8b2e6939b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:53.211344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9d29f8a5-7ab1-4587-aaad-b1d6ea1cce16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1f3f46d19a6484da3622833d894963d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:53.221727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9d29f8a5-7ab1-4587-aaad-b1d6ea1cce16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1f3f46d19a6484da3622833d894963d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:53.223314 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9d29f8a5-7ab1-4587-aaad-b1d6ea1cce16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1f3f46d19a6484da3622833d894963d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:53.224152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9d29f8a5-7ab1-4587-aaad-b1d6ea1cce16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1f3f46d19a6484da3622833d894963d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:53.238952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9d29f8a5-7ab1-4587-aaad-b1d6ea1cce16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1f3f46d19a6484da3622833d894963d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:53.253597 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-2e6284fc-d0ca-4ba3-96cd-2ca8b2e6939b None None] MFA Rules not processed for user `9b8463a42f2642aaba586380391de6fd`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:53.256138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2e6284fc-d0ca-4ba3-96cd-2ca8b2e6939b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:53.269082 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2736/5433] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:12:52 2022] DELETE /identity/v3/users/e1f3f46d19a6484da3622833d894963d => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:12:53.270780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050edf0-7d44-4660-b7e8-d11f13de9ffc None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:53.271238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050edf0-7d44-4660-b7e8-d11f13de9ffc None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:53.271644 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050edf0-7d44-4660-b7e8-d11f13de9ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:53.301448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-7050edf0-7d44-4660-b7e8-d11f13de9ffc None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:53.304001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7050edf0-7d44-4660-b7e8-d11f13de9ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:53.398596 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2737/5434] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:12:53.401167 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313b008-8638-4c47-98dc-8a239548e88d None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:53.401567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313b008-8638-4c47-98dc-8a239548e88d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:53.409596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313b008-8638-4c47-98dc-8a239548e88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:53.410431 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2698/5435] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:12:53.411376 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6284fc-d0ca-4ba3-96cd-2ca8b2e6939b None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:53.424066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2e6284fc-d0ca-4ba3-96cd-2ca8b2e6939b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:53.436394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b313b008-8638-4c47-98dc-8a239548e88d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:53.438042 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b313b008-8638-4c47-98dc-8a239548e88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:53.450882 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2738/5436] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:12:53.463243 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313b008-8638-4c47-98dc-8a239548e88d None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:53.467274 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b313b008-8638-4c47-98dc-8a239548e88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:53.568538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6284fc-d0ca-4ba3-96cd-2ca8b2e6939b None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:53.594990 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:53.624716 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313b008-8638-4c47-98dc-8a239548e88d None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:53.639742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082c46a-f6a9-4029-b93e-9c77f952bfea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:53.640416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082c46a-f6a9-4029-b93e-9c77f952bfea service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:53.642737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082c46a-f6a9-4029-b93e-9c77f952bfea service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:53.643164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082c46a-f6a9-4029-b93e-9c77f952bfea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:53.679989 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082c46a-f6a9-4029-b93e-9c77f952bfea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:53.681412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082c46a-f6a9-4029-b93e-9c77f952bfea service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:53.696126 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2739/5437] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:12:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:12:53.705364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce8793-a0fc-445f-83c2-cd7466dbd270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:53.706575 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce8793-a0fc-445f-83c2-cd7466dbd270 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:53.707058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce8793-a0fc-445f-83c2-cd7466dbd270 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:53.707421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce8793-a0fc-445f-83c2-cd7466dbd270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:53.720469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce8793-a0fc-445f-83c2-cd7466dbd270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:53.722719 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce8793-a0fc-445f-83c2-cd7466dbd270 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:53.730008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:53.746806 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2699/5438] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:12:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:12:54.308647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082c46a-f6a9-4029-b93e-9c77f952bfea service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:54.311865 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3082c46a-f6a9-4029-b93e-9c77f952bfea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:54.358409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082c46a-f6a9-4029-b93e-9c77f952bfea service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:54.373641 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e5a46-55d2-44d4-9cb1-93a77bde4faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:54.374466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e5a46-55d2-44d4-9cb1-93a77bde4faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:54.375033 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e5a46-55d2-44d4-9cb1-93a77bde4faa admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:54.375391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e5a46-55d2-44d4-9cb1-93a77bde4faa admin admin] PATH_INFO: `/v3/projects/eb3eb23f429845a197717b61f8cf168b` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:54.378829 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e5a46-55d2-44d4-9cb1-93a77bde4faa admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb3eb23f429845a197717b61f8cf168b)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:54.383800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e5a46-55d2-44d4-9cb1-93a77bde4faa admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:54.387890 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce8793-a0fc-445f-83c2-cd7466dbd270 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:54.390934 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-abce8793-a0fc-445f-83c2-cd7466dbd270 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:54.410786 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce8793-a0fc-445f-83c2-cd7466dbd270 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:54.425004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453011d-7554-4ba9-a141-a76572197559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:54.425648 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453011d-7554-4ba9-a141-a76572197559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:54.425925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453011d-7554-4ba9-a141-a76572197559 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:54.426200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453011d-7554-4ba9-a141-a76572197559 admin admin] PATH_INFO: `/v3/projects/e83b67cec08641328360d15a79f15de0` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:54.427351 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c453011d-7554-4ba9-a141-a76572197559 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e83b67cec08641328360d15a79f15de0)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:54.429724 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c453011d-7554-4ba9-a141-a76572197559 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:54.479192 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8d5e5a46-55d2-44d4-9cb1-93a77bde4faa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb3eb23f429845a197717b61f8cf168b', 'request_id': 'req-8d5e5a46-55d2-44d4-9cb1-93a77bde4faa'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:54.489424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8d5e5a46-55d2-44d4-9cb1-93a77bde4faa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb3eb23f429845a197717b61f8cf168b', 'request_id': 'req-8d5e5a46-55d2-44d4-9cb1-93a77bde4faa'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:54.509636 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8d5e5a46-55d2-44d4-9cb1-93a77bde4faa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb3eb23f429845a197717b61f8cf168b', 'request_id': 'req-8d5e5a46-55d2-44d4-9cb1-93a77bde4faa'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:54.537391 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c453011d-7554-4ba9-a141-a76572197559 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e83b67cec08641328360d15a79f15de0', 'request_id': 'req-c453011d-7554-4ba9-a141-a76572197559'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:54.556852 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8d5e5a46-55d2-44d4-9cb1-93a77bde4faa admin admin] The token cache is being invalidate because project eb3eb23f429845a197717b61f8cf168b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:12:54.557262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8d5e5a46-55d2-44d4-9cb1-93a77bde4faa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:54.558181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c453011d-7554-4ba9-a141-a76572197559 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e83b67cec08641328360d15a79f15de0', 'request_id': 'req-c453011d-7554-4ba9-a141-a76572197559'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:54.560748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8d5e5a46-55d2-44d4-9cb1-93a77bde4faa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:54.564648 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2740/5439] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:12:54 2022] DELETE /identity/v3/projects/eb3eb23f429845a197717b61f8cf168b => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:12:54.565634 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e5a46-55d2-44d4-9cb1-93a77bde4faa admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:54.567564 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8d5e5a46-55d2-44d4-9cb1-93a77bde4faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:54.571155 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c453011d-7554-4ba9-a141-a76572197559 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e83b67cec08641328360d15a79f15de0', 'request_id': 'req-c453011d-7554-4ba9-a141-a76572197559'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:54.593203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c453011d-7554-4ba9-a141-a76572197559 admin admin] The token cache is being invalidate because project e83b67cec08641328360d15a79f15de0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:12:54.594636 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c453011d-7554-4ba9-a141-a76572197559 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:54.596188 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c453011d-7554-4ba9-a141-a76572197559 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:54.599833 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2700/5440] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:12:54 2022] DELETE /identity/v3/projects/e83b67cec08641328360d15a79f15de0 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:12:54.600980 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453011d-7554-4ba9-a141-a76572197559 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:54.605217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c453011d-7554-4ba9-a141-a76572197559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:54.684727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e5a46-55d2-44d4-9cb1-93a77bde4faa admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:54.773685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453011d-7554-4ba9-a141-a76572197559 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:54.797086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd724806-123f-48df-975d-40fdc0f559c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:54.798094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd724806-123f-48df-975d-40fdc0f559c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:54.798616 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd724806-123f-48df-975d-40fdc0f559c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:54.800123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd724806-123f-48df-975d-40fdc0f559c1 admin admin] PATH_INFO: `/v3/users/a3e932c4020a4c3fb22652d4ddc87d89` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:54.805506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd724806-123f-48df-975d-40fdc0f559c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3e932c4020a4c3fb22652d4ddc87d89)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:54.810531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd724806-123f-48df-975d-40fdc0f559c1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:54.851468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622de6c-486f-4cd4-b991-bfd8d68471eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:54.852108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622de6c-486f-4cd4-b991-bfd8d68471eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:54.852387 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622de6c-486f-4cd4-b991-bfd8d68471eb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:54.853477 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622de6c-486f-4cd4-b991-bfd8d68471eb admin admin] PATH_INFO: `/v3/projects/f194ac597db54911a36b795d29c2032f` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:54.858513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e622de6c-486f-4cd4-b991-bfd8d68471eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f194ac597db54911a36b795d29c2032f)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:54.862737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e622de6c-486f-4cd4-b991-bfd8d68471eb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:54.903617 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:54.921663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-cd724806-123f-48df-975d-40fdc0f559c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3e932c4020a4c3fb22652d4ddc87d89'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:54.922883 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-cd724806-123f-48df-975d-40fdc0f559c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3e932c4020a4c3fb22652d4ddc87d89'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:54.923573 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-cd724806-123f-48df-975d-40fdc0f559c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3e932c4020a4c3fb22652d4ddc87d89'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:54.941918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-cd724806-123f-48df-975d-40fdc0f559c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3e932c4020a4c3fb22652d4ddc87d89'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:54.956959 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e622de6c-486f-4cd4-b991-bfd8d68471eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f194ac597db54911a36b795d29c2032f', 'request_id': 'req-e622de6c-486f-4cd4-b991-bfd8d68471eb'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:54.970218 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-cd724806-123f-48df-975d-40fdc0f559c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3e932c4020a4c3fb22652d4ddc87d89'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:54.970523 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e622de6c-486f-4cd4-b991-bfd8d68471eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f194ac597db54911a36b795d29c2032f', 'request_id': 'req-e622de6c-486f-4cd4-b991-bfd8d68471eb'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:54.982822 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e622de6c-486f-4cd4-b991-bfd8d68471eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f194ac597db54911a36b795d29c2032f', 'request_id': 'req-e622de6c-486f-4cd4-b991-bfd8d68471eb'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:54.983396 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:54.993597 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2701/5441] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:12:54 2022] DELETE /identity/v3/users/a3e932c4020a4c3fb22652d4ddc87d89 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:12:54.998138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634b520-afef-49ec-a45d-f654cc1eaa91 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:54.998424 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634b520-afef-49ec-a45d-f654cc1eaa91 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:54.998723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634b520-afef-49ec-a45d-f654cc1eaa91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:55.003082 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e622de6c-486f-4cd4-b991-bfd8d68471eb admin admin] The token cache is being invalidate because project f194ac597db54911a36b795d29c2032f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:12:55.003856 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e622de6c-486f-4cd4-b991-bfd8d68471eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:55.004750 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e622de6c-486f-4cd4-b991-bfd8d68471eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:55.006654 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2741/5442] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:12:54 2022] DELETE /identity/v3/projects/f194ac597db54911a36b795d29c2032f => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:12:55.016642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093a50a-9a84-4c46-8e3d-63d924bccbea None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:55.017663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093a50a-9a84-4c46-8e3d-63d924bccbea None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:55.018489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093a50a-9a84-4c46-8e3d-63d924bccbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:55.021915 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-2634b520-afef-49ec-a45d-f654cc1eaa91 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:55.023158 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2634b520-afef-49ec-a45d-f654cc1eaa91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:55.057073 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-0093a50a-9a84-4c46-8e3d-63d924bccbea None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:55.058588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0093a50a-9a84-4c46-8e3d-63d924bccbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:55.169032 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2702/5443] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:12:55.178055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3479371-e325-4a2d-85ee-2001dc9880d6 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:55.180494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3479371-e325-4a2d-85ee-2001dc9880d6 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:55.181447 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3479371-e325-4a2d-85ee-2001dc9880d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:55.229566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a3479371-e325-4a2d-85ee-2001dc9880d6 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:55.233363 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a3479371-e325-4a2d-85ee-2001dc9880d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:55.240898 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2742/5444] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:12:55.250668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df581a2-8c80-4d49-97b0-ca0d147776ff None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:55.251273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df581a2-8c80-4d49-97b0-ca0d147776ff None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:55.251800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df581a2-8c80-4d49-97b0-ca0d147776ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:55.258054 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2703/5445] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:12:55.267854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3479371-e325-4a2d-85ee-2001dc9880d6 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:55.283612 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3479371-e325-4a2d-85ee-2001dc9880d6 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:55.294215 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06284ef-6e01-47c8-878f-e1bb398ef932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:55.295207 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06284ef-6e01-47c8-878f-e1bb398ef932 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:55.296134 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06284ef-6e01-47c8-878f-e1bb398ef932 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:55.296602 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06284ef-6e01-47c8-878f-e1bb398ef932 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:55.297423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06284ef-6e01-47c8-878f-e1bb398ef932 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:12:55.297799 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06284ef-6e01-47c8-878f-e1bb398ef932 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:55.299861 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06284ef-6e01-47c8-878f-e1bb398ef932 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:55.305642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-3df581a2-8c80-4d49-97b0-ca0d147776ff None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:55.307535 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3df581a2-8c80-4d49-97b0-ca0d147776ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:55.325253 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2704/5446] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:12:55.330394 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2743/5447] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:12:55.336251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06284ef-6e01-47c8-878f-e1bb398ef932 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:55.337661 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df581a2-8c80-4d49-97b0-ca0d147776ff None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:55.351864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06284ef-6e01-47c8-878f-e1bb398ef932 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:55.352312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df581a2-8c80-4d49-97b0-ca0d147776ff None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:55.359481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60d10a-210c-4ed3-9960-c7b5b3f1d5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:55.360314 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60d10a-210c-4ed3-9960-c7b5b3f1d5d9 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:55.360620 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60d10a-210c-4ed3-9960-c7b5b3f1d5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:55.361053 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60d10a-210c-4ed3-9960-c7b5b3f1d5d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:55.361397 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d10ba6-e48a-4e16-a8d7-fa507f2c055c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:55.362275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d10ba6-e48a-4e16-a8d7-fa507f2c055c admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:55.362510 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60d10a-210c-4ed3-9960-c7b5b3f1d5d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:12:55.362723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d10ba6-e48a-4e16-a8d7-fa507f2c055c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:55.362831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60d10a-210c-4ed3-9960-c7b5b3f1d5d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:55.363170 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d10ba6-e48a-4e16-a8d7-fa507f2c055c admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:55.364247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d10ba6-e48a-4e16-a8d7-fa507f2c055c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:55.364483 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60d10a-210c-4ed3-9960-c7b5b3f1d5d9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:55.368052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d10ba6-e48a-4e16-a8d7-fa507f2c055c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:55.381993 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2744/5448] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:12:55.387169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60d10a-210c-4ed3-9960-c7b5b3f1d5d9 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:55.405934 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60d10a-210c-4ed3-9960-c7b5b3f1d5d9 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:55.411678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e380c-6a7d-41ce-b2e2-da9e2e24f2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:55.412694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e380c-6a7d-41ce-b2e2-da9e2e24f2a5 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:55.413221 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e380c-6a7d-41ce-b2e2-da9e2e24f2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:55.413706 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e380c-6a7d-41ce-b2e2-da9e2e24f2a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:55.414666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e380c-6a7d-41ce-b2e2-da9e2e24f2a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:55.418046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e380c-6a7d-41ce-b2e2-da9e2e24f2a5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:55.426869 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2705/5449] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:12:55 2022] POST /identity/v3/projects => generated 371 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:12:55.431902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d10ba6-e48a-4e16-a8d7-fa507f2c055c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:55.476856 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2745/5450] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:12:55 2022] POST /identity/v3/projects => generated 373 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:12:55.484906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e380c-6a7d-41ce-b2e2-da9e2e24f2a5 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:55.524326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d10ba6-e48a-4e16-a8d7-fa507f2c055c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:55.610447 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99783bf8-a3de-4402-9849-f6160e0deae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:55.611205 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99783bf8-a3de-4402-9849-f6160e0deae0 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:55.611673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99783bf8-a3de-4402-9849-f6160e0deae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:55.612129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99783bf8-a3de-4402-9849-f6160e0deae0 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:55.612860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99783bf8-a3de-4402-9849-f6160e0deae0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:55.615881 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99783bf8-a3de-4402-9849-f6160e0deae0 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:55.618833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e380c-6a7d-41ce-b2e2-da9e2e24f2a5 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:55.626096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fdd3d-10bc-482d-bd78-d24b96203f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:55.626420 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fdd3d-10bc-482d-bd78-d24b96203f24 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:55.626738 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fdd3d-10bc-482d-bd78-d24b96203f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:55.627216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fdd3d-10bc-482d-bd78-d24b96203f24 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:55.627968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0fdd3d-10bc-482d-bd78-d24b96203f24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:55.630069 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0fdd3d-10bc-482d-bd78-d24b96203f24 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:55.658906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:55.662321 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:55.682778 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2746/5451] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:12:55 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:12:55.683709 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fdd3d-10bc-482d-bd78-d24b96203f24 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:55.688580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2e0fdd3d-10bc-482d-bd78-d24b96203f24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:55.702696 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2706/5452] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:12:55 2022] POST /identity/v3/users => generated 286 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:12:55.705826 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99783bf8-a3de-4402-9849-f6160e0deae0 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:55.709875 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-99783bf8-a3de-4402-9849-f6160e0deae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:55.717758 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fdd3d-10bc-482d-bd78-d24b96203f24 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:55.740478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf4325-9d17-4a99-a341-6c660a232078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:55.742473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf4325-9d17-4a99-a341-6c660a232078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:55.742473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf4325-9d17-4a99-a341-6c660a232078 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:55.742473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf4325-9d17-4a99-a341-6c660a232078 admin admin] PATH_INFO: `/v3/projects/d6d483b4f99b4091ab10cde94f64b055` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:55.745062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf4325-9d17-4a99-a341-6c660a232078 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6d483b4f99b4091ab10cde94f64b055)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:55.747071 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf4325-9d17-4a99-a341-6c660a232078 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:55.757579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99783bf8-a3de-4402-9849-f6160e0deae0 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:55.771544 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c85df-d1a1-480a-973f-240945046b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:55.772702 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c85df-d1a1-480a-973f-240945046b0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:55.773169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c85df-d1a1-480a-973f-240945046b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:55.773618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c85df-d1a1-480a-973f-240945046b0a admin admin] PATH_INFO: `/v3/users/23f007a900b143c2ab6521003d025035` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:55.775582 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c85df-d1a1-480a-973f-240945046b0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=23f007a900b143c2ab6521003d025035)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:55.777831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c85df-d1a1-480a-973f-240945046b0a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:55.843203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2aaf4325-9d17-4a99-a341-6c660a232078 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6d483b4f99b4091ab10cde94f64b055', 'request_id': 'req-2aaf4325-9d17-4a99-a341-6c660a232078'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:55.856249 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2aaf4325-9d17-4a99-a341-6c660a232078 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6d483b4f99b4091ab10cde94f64b055', 'request_id': 'req-2aaf4325-9d17-4a99-a341-6c660a232078'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:55.871746 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2aaf4325-9d17-4a99-a341-6c660a232078 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6d483b4f99b4091ab10cde94f64b055', 'request_id': 'req-2aaf4325-9d17-4a99-a341-6c660a232078'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:55.889078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fa0c85df-d1a1-480a-973f-240945046b0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23f007a900b143c2ab6521003d025035'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:55.889839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fa0c85df-d1a1-480a-973f-240945046b0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23f007a900b143c2ab6521003d025035'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:55.890264 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2aaf4325-9d17-4a99-a341-6c660a232078 admin admin] The token cache is being invalidate because project d6d483b4f99b4091ab10cde94f64b055 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:12:55.890465 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fa0c85df-d1a1-480a-973f-240945046b0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23f007a900b143c2ab6521003d025035'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:55.890625 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2aaf4325-9d17-4a99-a341-6c660a232078 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:55.896675 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2aaf4325-9d17-4a99-a341-6c660a232078 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:55.898738 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2747/5453] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:12:55 2022] DELETE /identity/v3/projects/d6d483b4f99b4091ab10cde94f64b055 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:12:55.900268 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf4325-9d17-4a99-a341-6c660a232078 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:55.902820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2aaf4325-9d17-4a99-a341-6c660a232078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:55.904677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fa0c85df-d1a1-480a-973f-240945046b0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23f007a900b143c2ab6521003d025035'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:55.965944 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fa0c85df-d1a1-480a-973f-240945046b0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23f007a900b143c2ab6521003d025035'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:55.988485 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2707/5454] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:12:55 2022] DELETE /identity/v3/users/23f007a900b143c2ab6521003d025035 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:12:55.989489 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c85df-d1a1-480a-973f-240945046b0a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:55.991160 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-fa0c85df-d1a1-480a-973f-240945046b0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:56.003285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf4325-9d17-4a99-a341-6c660a232078 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:56.084487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c85df-d1a1-480a-973f-240945046b0a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:56.093972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832260d-93a8-4db0-b905-1b63d17575a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:56.094748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832260d-93a8-4db0-b905-1b63d17575a1 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:56.095096 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832260d-93a8-4db0-b905-1b63d17575a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:56.095895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832260d-93a8-4db0-b905-1b63d17575a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:56.096868 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832260d-93a8-4db0-b905-1b63d17575a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:56.098945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832260d-93a8-4db0-b905-1b63d17575a1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:56.108292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41366472-001c-4bfb-b5cd-445762e92937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:56.109013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41366472-001c-4bfb-b5cd-445762e92937 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:56.109373 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41366472-001c-4bfb-b5cd-445762e92937 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:56.109710 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41366472-001c-4bfb-b5cd-445762e92937 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:56.110940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41366472-001c-4bfb-b5cd-445762e92937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:56.114067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41366472-001c-4bfb-b5cd-445762e92937 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:56.114762 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2708/5455] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:12:56.116730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216403e2-8fc7-4e1e-aeb6-e65ed68e0734 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:56.117023 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216403e2-8fc7-4e1e-aeb6-e65ed68e0734 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:56.117304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216403e2-8fc7-4e1e-aeb6-e65ed68e0734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:56.125597 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2748/5456] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:12:56.126567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41366472-001c-4bfb-b5cd-445762e92937 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:56.129600 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-41366472-001c-4bfb-b5cd-445762e92937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:56.145985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-216403e2-8fc7-4e1e-aeb6-e65ed68e0734 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:56.147251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-216403e2-8fc7-4e1e-aeb6-e65ed68e0734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:56.157097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41366472-001c-4bfb-b5cd-445762e92937 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:56.159933 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2709/5457] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:12:56.166714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216403e2-8fc7-4e1e-aeb6-e65ed68e0734 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:56.180240 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f58692-3fbe-4623-a5ea-9e91dd6b071d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:56.182713 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f58692-3fbe-4623-a5ea-9e91dd6b071d admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:56.183972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f58692-3fbe-4623-a5ea-9e91dd6b071d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:56.184139 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f58692-3fbe-4623-a5ea-9e91dd6b071d admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:56.184817 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f58692-3fbe-4623-a5ea-9e91dd6b071d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:56.190192 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f58692-3fbe-4623-a5ea-9e91dd6b071d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:56.191176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216403e2-8fc7-4e1e-aeb6-e65ed68e0734 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:56.206399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95c22b-d86a-45ce-ba44-e2d1bc4f2a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:56.207179 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95c22b-d86a-45ce-ba44-e2d1bc4f2a9d admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:56.207466 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95c22b-d86a-45ce-ba44-e2d1bc4f2a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:56.207741 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95c22b-d86a-45ce-ba44-e2d1bc4f2a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:56.209024 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95c22b-d86a-45ce-ba44-e2d1bc4f2a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:56.210424 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95c22b-d86a-45ce-ba44-e2d1bc4f2a9d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:56.218583 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2749/5458] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:12:56.225899 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6405c-0637-41aa-888a-d03ec97f706c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:56.229098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6405c-0637-41aa-888a-d03ec97f706c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:56.229412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6405c-0637-41aa-888a-d03ec97f706c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:56.244315 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2710/5459] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:12:56.250770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95c22b-d86a-45ce-ba44-e2d1bc4f2a9d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:56.281131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95c22b-d86a-45ce-ba44-e2d1bc4f2a9d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:56.292722 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a2b72-769d-4bb8-bab3-7c86433e6e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:56.293501 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a2b72-769d-4bb8-bab3-7c86433e6e9b admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:56.293857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a2b72-769d-4bb8-bab3-7c86433e6e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:56.294203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a2b72-769d-4bb8-bab3-7c86433e6e9b admin admin] PATH_INFO: `/v3/projects/769ad1142bbf4919a98f3869e29707e8/users/267a4d7dbdc54b8ab7f35fe093300075/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:56.299991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-11a6405c-0637-41aa-888a-d03ec97f706c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:56.300905 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-11a6405c-0637-41aa-888a-d03ec97f706c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:56.316021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a2b72-769d-4bb8-bab3-7c86433e6e9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=769ad1142bbf4919a98f3869e29707e8, user_id=267a4d7dbdc54b8ab7f35fe093300075, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:56.318883 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a2b72-769d-4bb8-bab3-7c86433e6e9b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:56.346802 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2750/5461] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:12:56.347319 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2711/5461] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:12:56 2022] PUT /identity/v3/projects/769ad1142bbf4919a98f3869e29707e8/users/267a4d7dbdc54b8ab7f35fe093300075/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:12:56.356194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6405c-0637-41aa-888a-d03ec97f706c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:56.357696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a2b72-769d-4bb8-bab3-7c86433e6e9b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:56.370679 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:56.380981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6405c-0637-41aa-888a-d03ec97f706c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:56.452647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:56.549279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a2b72-769d-4bb8-bab3-7c86433e6e9b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:56.555072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff2fdb-0dfc-40dd-a0f2-1350c215eb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:56.559799 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff2fdb-0dfc-40dd-a0f2-1350c215eb04 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:56.560094 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff2fdb-0dfc-40dd-a0f2-1350c215eb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:56.560430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff2fdb-0dfc-40dd-a0f2-1350c215eb04 admin admin] PATH_INFO: `/v3/projects/25c11f2f07274b68ac781aeec6af3b19/users/7c8e09e73e8e47c78170f95b7b4ce0cc/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:56.562720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17514fe9-4423-479d-8763-ab26db1d5779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:56.563627 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17514fe9-4423-479d-8763-ab26db1d5779 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:56.565438 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17514fe9-4423-479d-8763-ab26db1d5779 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:56.565784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17514fe9-4423-479d-8763-ab26db1d5779 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:56.567102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17514fe9-4423-479d-8763-ab26db1d5779 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:12:56.568635 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17514fe9-4423-479d-8763-ab26db1d5779 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:56.578844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17514fe9-4423-479d-8763-ab26db1d5779 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:56.607391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff2fdb-0dfc-40dd-a0f2-1350c215eb04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25c11f2f07274b68ac781aeec6af3b19, user_id=7c8e09e73e8e47c78170f95b7b4ce0cc, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:56.615480 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2712/5462] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:12:56.615700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff2fdb-0dfc-40dd-a0f2-1350c215eb04 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:56.619140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c26aa-9001-4f73-92db-88d7bdb5ef9f None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:56.619829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c26aa-9001-4f73-92db-88d7bdb5ef9f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:56.620731 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c26aa-9001-4f73-92db-88d7bdb5ef9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:56.645387 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2751/5463] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:12:56 2022] PUT /identity/v3/projects/25c11f2f07274b68ac781aeec6af3b19/users/7c8e09e73e8e47c78170f95b7b4ce0cc/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:12:56.659006 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff2fdb-0dfc-40dd-a0f2-1350c215eb04 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:56.665120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6dff2fdb-0dfc-40dd-a0f2-1350c215eb04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:56.739346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d38c26aa-9001-4f73-92db-88d7bdb5ef9f None None] MFA Rules not processed for user `267a4d7dbdc54b8ab7f35fe093300075`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:56.741155 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d38c26aa-9001-4f73-92db-88d7bdb5ef9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:56.788332 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff2fdb-0dfc-40dd-a0f2-1350c215eb04 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:56.796448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266811f7-4c6f-4590-a7fe-3e9e5641dd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:56.797170 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266811f7-4c6f-4590-a7fe-3e9e5641dd40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:56.797523 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266811f7-4c6f-4590-a7fe-3e9e5641dd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:56.797782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266811f7-4c6f-4590-a7fe-3e9e5641dd40 admin admin] PATH_INFO: `/v3/projects/b39a59bd658147feaa89b79ae9ebe3af` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:56.799232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266811f7-4c6f-4590-a7fe-3e9e5641dd40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b39a59bd658147feaa89b79ae9ebe3af)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:56.803254 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266811f7-4c6f-4590-a7fe-3e9e5641dd40 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:56.919151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-266811f7-4c6f-4590-a7fe-3e9e5641dd40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b39a59bd658147feaa89b79ae9ebe3af', 'request_id': 'req-266811f7-4c6f-4590-a7fe-3e9e5641dd40'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:56.934250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-266811f7-4c6f-4590-a7fe-3e9e5641dd40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b39a59bd658147feaa89b79ae9ebe3af', 'request_id': 'req-266811f7-4c6f-4590-a7fe-3e9e5641dd40'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:56.940904 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2713/5464] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:12:56.942346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c26aa-9001-4f73-92db-88d7bdb5ef9f None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:56.954963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-266811f7-4c6f-4590-a7fe-3e9e5641dd40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b39a59bd658147feaa89b79ae9ebe3af', 'request_id': 'req-266811f7-4c6f-4590-a7fe-3e9e5641dd40'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:56.973046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-266811f7-4c6f-4590-a7fe-3e9e5641dd40 admin admin] The token cache is being invalidate because project b39a59bd658147feaa89b79ae9ebe3af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:12:56.973808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-266811f7-4c6f-4590-a7fe-3e9e5641dd40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:56.974890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-266811f7-4c6f-4590-a7fe-3e9e5641dd40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:56.976562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c26aa-9001-4f73-92db-88d7bdb5ef9f None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:56.978290 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2752/5465] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:12:56 2022] DELETE /identity/v3/projects/b39a59bd658147feaa89b79ae9ebe3af => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:12:56.980150 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc97a82-fce8-41b5-be41-e2c93a30392b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:56.980717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc97a82-fce8-41b5-be41-e2c93a30392b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:56.981273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc97a82-fce8-41b5-be41-e2c93a30392b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:57.023818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-cdc97a82-fce8-41b5-be41-e2c93a30392b None None] MFA Rules not processed for user `7c8e09e73e8e47c78170f95b7b4ce0cc`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:57.026329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-cdc97a82-fce8-41b5-be41-e2c93a30392b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:57.035118 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:57.091434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6928f31-72b6-4803-9db4-1c37ee4f9298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:57.092226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6928f31-72b6-4803-9db4-1c37ee4f9298 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:57.092516 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6928f31-72b6-4803-9db4-1c37ee4f9298 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:57.092792 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6928f31-72b6-4803-9db4-1c37ee4f9298 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:57.093601 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6928f31-72b6-4803-9db4-1c37ee4f9298 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:57.095955 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6928f31-72b6-4803-9db4-1c37ee4f9298 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:57.135669 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2714/5466] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:12:56 2022] POST /identity/v3/projects => generated 367 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:12:57.136323 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a706426-4207-49ee-99e3-1bf7b854e332 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:57.136611 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a706426-4207-49ee-99e3-1bf7b854e332 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:57.136958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a706426-4207-49ee-99e3-1bf7b854e332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:57.166470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-5a706426-4207-49ee-99e3-1bf7b854e332 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:57.167965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5a706426-4207-49ee-99e3-1bf7b854e332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:57.197561 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2753/5467] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:12:57.201874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc97a82-fce8-41b5-be41-e2c93a30392b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:57.204285 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:57.207500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-cdc97a82-fce8-41b5-be41-e2c93a30392b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:57.259525 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2715/5468] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:12:57.259525 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a706426-4207-49ee-99e3-1bf7b854e332 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:57.259525 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5a706426-4207-49ee-99e3-1bf7b854e332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:57.273490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a706426-4207-49ee-99e3-1bf7b854e332 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:57.279734 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d5513-7b60-4712-984a-c533ea7e9e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:57.281255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d5513-7b60-4712-984a-c533ea7e9e8a admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:57.281550 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d5513-7b60-4712-984a-c533ea7e9e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:57.281826 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d5513-7b60-4712-984a-c533ea7e9e8a admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:57.282583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d5513-7b60-4712-984a-c533ea7e9e8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:57.284747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d5513-7b60-4712-984a-c533ea7e9e8a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:57.322533 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2716/5469] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:12:57 2022] POST /identity/v3/users => generated 284 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:12:57.324503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd0b0f-54da-4d1c-912e-3c3ada3dcb72 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:57.324947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd0b0f-54da-4d1c-912e-3c3ada3dcb72 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:57.325465 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd0b0f-54da-4d1c-912e-3c3ada3dcb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:57.333380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc97a82-fce8-41b5-be41-e2c93a30392b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:57.352107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-77fd0b0f-54da-4d1c-912e-3c3ada3dcb72 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:57.355105 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-77fd0b0f-54da-4d1c-912e-3c3ada3dcb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:57.365567 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2717/5470] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:12:57.367437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd0b0f-54da-4d1c-912e-3c3ada3dcb72 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:57.445346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e71a3-5933-4d6d-94de-029a4bfbbc04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:57.446844 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e71a3-5933-4d6d-94de-029a4bfbbc04 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:57.447248 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e71a3-5933-4d6d-94de-029a4bfbbc04 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:57.447629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e71a3-5933-4d6d-94de-029a4bfbbc04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:57.451973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-418e71a3-5933-4d6d-94de-029a4bfbbc04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:57.463326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd0b0f-54da-4d1c-912e-3c3ada3dcb72 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:57.468917 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20b462-24c0-4d0c-880e-f4805bb0c974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:57.470473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20b462-24c0-4d0c-880e-f4805bb0c974 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:57.471094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20b462-24c0-4d0c-880e-f4805bb0c974 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:57.472566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20b462-24c0-4d0c-880e-f4805bb0c974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:57.554908 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20b462-24c0-4d0c-880e-f4805bb0c974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:57.557341 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20b462-24c0-4d0c-880e-f4805bb0c974 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:57.574777 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2718/5471] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:12:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:12:57.575967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20b462-24c0-4d0c-880e-f4805bb0c974 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:57.594397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e71a3-5933-4d6d-94de-029a4bfbbc04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:57.602233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e71a3-5933-4d6d-94de-029a4bfbbc04 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:57.606272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20b462-24c0-4d0c-880e-f4805bb0c974 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:57.613061 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4962aa9-9187-4bf4-9e00-f71c8bf781c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:57.613917 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4962aa9-9187-4bf4-9e00-f71c8bf781c6 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:57.614206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4962aa9-9187-4bf4-9e00-f71c8bf781c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:57.614481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4962aa9-9187-4bf4-9e00-f71c8bf781c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:57.615219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4962aa9-9187-4bf4-9e00-f71c8bf781c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:57.616898 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2754/5472] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:12:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:12:57.617866 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e71a3-5933-4d6d-94de-029a4bfbbc04 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:57.617988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4962aa9-9187-4bf4-9e00-f71c8bf781c6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:57.636471 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e71a3-5933-4d6d-94de-029a4bfbbc04 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:57.636663 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2719/5473] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:12:57.638477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4962aa9-9187-4bf4-9e00-f71c8bf781c6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:57.643182 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7aa119-6ed1-4426-b6f6-c25886507a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:57.643975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7aa119-6ed1-4426-b6f6-c25886507a55 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:57.644438 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7aa119-6ed1-4426-b6f6-c25886507a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:57.644818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7aa119-6ed1-4426-b6f6-c25886507a55 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:57.646746 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7aa119-6ed1-4426-b6f6-c25886507a55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:12:57.647109 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7aa119-6ed1-4426-b6f6-c25886507a55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:57.648849 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7aa119-6ed1-4426-b6f6-c25886507a55 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:57.651564 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4962aa9-9187-4bf4-9e00-f71c8bf781c6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:57.657520 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71736be-d62a-488c-9a28-9be7c369b3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:57.658416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71736be-d62a-488c-9a28-9be7c369b3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:57.659503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71736be-d62a-488c-9a28-9be7c369b3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:57.659962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71736be-d62a-488c-9a28-9be7c369b3d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:57.661270 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71736be-d62a-488c-9a28-9be7c369b3d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:57.663443 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71736be-d62a-488c-9a28-9be7c369b3d8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:57.675142 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2755/5474] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:12:57.676121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7aa119-6ed1-4426-b6f6-c25886507a55 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:57.688074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:57.690785 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2720/5475] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:12:57.693638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71736be-d62a-488c-9a28-9be7c369b3d8 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:57.701524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7aa119-6ed1-4426-b6f6-c25886507a55 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:57.704603 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71736be-d62a-488c-9a28-9be7c369b3d8 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:57.711678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef04088-8797-4d95-a361-0bde2e5d932b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:57.713008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef04088-8797-4d95-a361-0bde2e5d932b admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:57.713294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef04088-8797-4d95-a361-0bde2e5d932b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:57.713600 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef04088-8797-4d95-a361-0bde2e5d932b admin admin] PATH_INFO: `/v3/projects/0114b0c2766e4cdc94d9ac2d78729255/users/ced6496b9e124950bfdcd077623e2df2/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:57.715233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaacddc-cd5a-42bd-8a22-fc6ab86c0eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:57.715974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaacddc-cd5a-42bd-8a22-fc6ab86c0eac admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:57.716495 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaacddc-cd5a-42bd-8a22-fc6ab86c0eac admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:57.718178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaacddc-cd5a-42bd-8a22-fc6ab86c0eac admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:57.718178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaacddc-cd5a-42bd-8a22-fc6ab86c0eac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:57.722276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaacddc-cd5a-42bd-8a22-fc6ab86c0eac admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:57.731726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef04088-8797-4d95-a361-0bde2e5d932b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0114b0c2766e4cdc94d9ac2d78729255, user_id=ced6496b9e124950bfdcd077623e2df2, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:57.735643 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef04088-8797-4d95-a361-0bde2e5d932b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:57.771267 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2721/5476] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:12:57 2022] PUT /identity/v3/projects/0114b0c2766e4cdc94d9ac2d78729255/users/ced6496b9e124950bfdcd077623e2df2/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:12:57.772829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf6f5c-9add-4508-b20b-49df281adcde None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:57.773117 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf6f5c-9add-4508-b20b-49df281adcde None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:57.773408 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf6f5c-9add-4508-b20b-49df281adcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:57.792056 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2756/5477] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:12:57 2022] POST /identity/v3/projects => generated 391 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:12:57.796522 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaacddc-cd5a-42bd-8a22-fc6ab86c0eac admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:57.819725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-acbf6f5c-9add-4508-b20b-49df281adcde None None] MFA Rules not processed for user `ced6496b9e124950bfdcd077623e2df2`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:57.823813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-acbf6f5c-9add-4508-b20b-49df281adcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:57.834780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:57.933973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaacddc-cd5a-42bd-8a22-fc6ab86c0eac admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:57.945774 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ab29f-0890-4e3e-ab77-c2c45674914d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:57.947736 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ab29f-0890-4e3e-ab77-c2c45674914d admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:57.949206 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ab29f-0890-4e3e-ab77-c2c45674914d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:57.949647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ab29f-0890-4e3e-ab77-c2c45674914d admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:57.950998 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ab29f-0890-4e3e-ab77-c2c45674914d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:57.954526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ab29f-0890-4e3e-ab77-c2c45674914d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:57.983840 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2722/5478] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:12:57.985660 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf6f5c-9add-4508-b20b-49df281adcde None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:58.007298 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf6f5c-9add-4508-b20b-49df281adcde None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:58.007906 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2757/5479] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:12:57 2022] POST /identity/v3/users => generated 296 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:12:58.011215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ab29f-0890-4e3e-ab77-c2c45674914d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:58.023840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1cc4d-b875-4714-8389-838333e23962 tempest-TestApiDiscovery-997555599 tempest-TestApiDiscovery-997555599-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced6496b9e124950bfdcd077623e2df2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0114b0c2766e4cdc94d9ac2d78729255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:58.024964 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1cc4d-b875-4714-8389-838333e23962 tempest-TestApiDiscovery-997555599 tempest-TestApiDiscovery-997555599-project] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:58.025142 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ab29f-0890-4e3e-ab77-c2c45674914d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:58.027878 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1cc4d-b875-4714-8389-838333e23962 tempest-TestApiDiscovery-997555599 tempest-TestApiDiscovery-997555599-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:58.028686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1cc4d-b875-4714-8389-838333e23962 tempest-TestApiDiscovery-997555599 tempest-TestApiDiscovery-997555599-project] PATH_INFO: `/v3` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:58.031845 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2723/5480] 10.222.0.33 () {58 vars in 1104 bytes} [Sat Aug 6 21:12:57 2022] GET /identity/v3 => generated 255 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:12:58.036694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98305c75-dda0-4306-801d-b36180c5fcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:58.037476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98305c75-dda0-4306-801d-b36180c5fcd0 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:58.037863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98305c75-dda0-4306-801d-b36180c5fcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:58.038380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98305c75-dda0-4306-801d-b36180c5fcd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:58.039319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98305c75-dda0-4306-801d-b36180c5fcd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:58.039620 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1cc4d-b875-4714-8389-838333e23962 tempest-TestApiDiscovery-997555599 tempest-TestApiDiscovery-997555599-project] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:58.042448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98305c75-dda0-4306-801d-b36180c5fcd0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:58.062607 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2758/5481] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:12:58.067638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98305c75-dda0-4306-801d-b36180c5fcd0 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:58.067831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1cc4d-b875-4714-8389-838333e23962 tempest-TestApiDiscovery-997555599 tempest-TestApiDiscovery-997555599-project] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:58.073664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785f543-0a46-4215-a6f9-c5dac29e141b tempest-TestApiDiscovery-997555599 tempest-TestApiDiscovery-997555599-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced6496b9e124950bfdcd077623e2df2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0114b0c2766e4cdc94d9ac2d78729255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:58.074482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785f543-0a46-4215-a6f9-c5dac29e141b tempest-TestApiDiscovery-997555599 tempest-TestApiDiscovery-997555599-project] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:58.075347 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785f543-0a46-4215-a6f9-c5dac29e141b tempest-TestApiDiscovery-997555599 tempest-TestApiDiscovery-997555599-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:58.075787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785f543-0a46-4215-a6f9-c5dac29e141b tempest-TestApiDiscovery-997555599 tempest-TestApiDiscovery-997555599-project] PATH_INFO: `/v3` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:58.081323 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2724/5482] 10.222.0.33 () {58 vars in 1104 bytes} [Sat Aug 6 21:12:58 2022] GET /identity/v3 => generated 255 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:12:58.082614 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785f543-0a46-4215-a6f9-c5dac29e141b tempest-TestApiDiscovery-997555599 tempest-TestApiDiscovery-997555599-project] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:58.084223 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98305c75-dda0-4306-801d-b36180c5fcd0 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:58.092774 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ebc6c-a971-4bdc-beb1-bb2997108da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:58.093830 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ebc6c-a971-4bdc-beb1-bb2997108da1 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:58.096893 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785f543-0a46-4215-a6f9-c5dac29e141b tempest-TestApiDiscovery-997555599 tempest-TestApiDiscovery-997555599-project] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:58.097151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ebc6c-a971-4bdc-beb1-bb2997108da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:58.097735 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ebc6c-a971-4bdc-beb1-bb2997108da1 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:58.098505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ebc6c-a971-4bdc-beb1-bb2997108da1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:58.101962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ebc6c-a971-4bdc-beb1-bb2997108da1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:58.114049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d17ed1-5545-4fac-a95c-68711fcc9bb1 tempest-TestApiDiscovery-997555599 tempest-TestApiDiscovery-997555599-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced6496b9e124950bfdcd077623e2df2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0114b0c2766e4cdc94d9ac2d78729255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:58.115144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d17ed1-5545-4fac-a95c-68711fcc9bb1 tempest-TestApiDiscovery-997555599 tempest-TestApiDiscovery-997555599-project] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:58.115267 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d17ed1-5545-4fac-a95c-68711fcc9bb1 tempest-TestApiDiscovery-997555599 tempest-TestApiDiscovery-997555599-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:58.115685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d17ed1-5545-4fac-a95c-68711fcc9bb1 tempest-TestApiDiscovery-997555599 tempest-TestApiDiscovery-997555599-project] PATH_INFO: `/v3` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:58.117330 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2725/5483] 10.222.0.33 () {58 vars in 1104 bytes} [Sat Aug 6 21:12:58 2022] GET /identity/v3 => generated 255 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:12:58.125659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a22bd2-61dd-4c61-87da-5807c93826d0 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:58.126132 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a22bd2-61dd-4c61-87da-5807c93826d0 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:58.126799 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a22bd2-61dd-4c61-87da-5807c93826d0 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:58.129608 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2759/5484] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:12:58.135159 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2726/5485] 10.222.0.33 () {56 vars in 895 bytes} [Sat Aug 6 21:12:58 2022] GET /identity/ => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 21:12:58.140340 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a22bd2-61dd-4c61-87da-5807c93826d0 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:58.142047 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b135a-9d3f-4110-b3be-4492fe104b8a None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:58.142759 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b135a-9d3f-4110-b3be-4492fe104b8a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:58.143585 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b135a-9d3f-4110-b3be-4492fe104b8a None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:58.146336 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2760/5486] 10.222.0.33 () {56 vars in 895 bytes} [Sat Aug 6 21:12:58 2022] GET /identity/ => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 21:12:58.152461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b135a-9d3f-4110-b3be-4492fe104b8a None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:58.172785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a22bd2-61dd-4c61-87da-5807c93826d0 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:58.180118 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b135a-9d3f-4110-b3be-4492fe104b8a None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:58.183856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc655418-910d-4cd7-8a39-d4ae33a0b5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:58.185820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc655418-910d-4cd7-8a39-d4ae33a0b5c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:58.186977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc655418-910d-4cd7-8a39-d4ae33a0b5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:58.187791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc655418-910d-4cd7-8a39-d4ae33a0b5c3 admin admin] PATH_INFO: `/v3/projects/dbf6e27c08c84eb780aee25318136435/users/950a8bbfd820444b9f85976f6609c864/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:58.190490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d42d79-84dd-4cc7-9009-fd422130f800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:58.192248 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d42d79-84dd-4cc7-9009-fd422130f800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:58.193019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d42d79-84dd-4cc7-9009-fd422130f800 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:58.194977 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d42d79-84dd-4cc7-9009-fd422130f800 admin admin] PATH_INFO: `/v3/users/ced6496b9e124950bfdcd077623e2df2` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:58.196289 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d42d79-84dd-4cc7-9009-fd422130f800 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ced6496b9e124950bfdcd077623e2df2)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:58.204718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d42d79-84dd-4cc7-9009-fd422130f800 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:58.224251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc655418-910d-4cd7-8a39-d4ae33a0b5c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbf6e27c08c84eb780aee25318136435, user_id=950a8bbfd820444b9f85976f6609c864, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:58.241593 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc655418-910d-4cd7-8a39-d4ae33a0b5c3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:58.277876 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2727/5487] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:12:58 2022] PUT /identity/v3/projects/dbf6e27c08c84eb780aee25318136435/users/950a8bbfd820444b9f85976f6609c864/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:12:58.283531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a4dcd-1cf5-47b7-a476-e74644261a3c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:58.283815 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a4dcd-1cf5-47b7-a476-e74644261a3c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:58.284138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a4dcd-1cf5-47b7-a476-e74644261a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:58.333035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d4d42d79-84dd-4cc7-9009-fd422130f800 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ced6496b9e124950bfdcd077623e2df2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:58.340841 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f84a4dcd-1cf5-47b7-a476-e74644261a3c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:58.342082 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f84a4dcd-1cf5-47b7-a476-e74644261a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:58.352198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d4d42d79-84dd-4cc7-9009-fd422130f800 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ced6496b9e124950bfdcd077623e2df2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:58.353846 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d4d42d79-84dd-4cc7-9009-fd422130f800 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ced6496b9e124950bfdcd077623e2df2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:58.355273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d4d42d79-84dd-4cc7-9009-fd422130f800 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ced6496b9e124950bfdcd077623e2df2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:58.372357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d4d42d79-84dd-4cc7-9009-fd422130f800 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ced6496b9e124950bfdcd077623e2df2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:58.405760 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2761/5488] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:12:58 2022] DELETE /identity/v3/users/ced6496b9e124950bfdcd077623e2df2 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:12:58.410062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14db52-cd77-4aba-a083-68098f90643b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:58.410509 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14db52-cd77-4aba-a083-68098f90643b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:58.410823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14db52-cd77-4aba-a083-68098f90643b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:58.446265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-4d14db52-cd77-4aba-a083-68098f90643b None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:58.447814 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4d14db52-cd77-4aba-a083-68098f90643b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:58.449048 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2728/5489] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:12:58.474140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:58.487303 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a4dcd-1cf5-47b7-a476-e74644261a3c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:58.489041 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f84a4dcd-1cf5-47b7-a476-e74644261a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:58.580479 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2762/5490] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:12:58.596112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a4dcd-1cf5-47b7-a476-e74644261a3c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:58.630767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14db52-cd77-4aba-a083-68098f90643b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:58.641900 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:58.711601 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0821528-ad85-41a7-afb9-8fdb6e8a3d6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:58.712436 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0821528-ad85-41a7-afb9-8fdb6e8a3d6e service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:58.712826 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0821528-ad85-41a7-afb9-8fdb6e8a3d6e service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:58.713207 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0821528-ad85-41a7-afb9-8fdb6e8a3d6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:58.733531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0821528-ad85-41a7-afb9-8fdb6e8a3d6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:58.738272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0821528-ad85-41a7-afb9-8fdb6e8a3d6e service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:58.756805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14db52-cd77-4aba-a083-68098f90643b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:58.762468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768d752-c776-4db4-b5ad-8870b6025567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:58.763258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768d752-c776-4db4-b5ad-8870b6025567 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:58.763695 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768d752-c776-4db4-b5ad-8870b6025567 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:58.763976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768d752-c776-4db4-b5ad-8870b6025567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:58.770707 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2729/5491] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:12:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:12:58.775607 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768d752-c776-4db4-b5ad-8870b6025567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:58.777173 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768d752-c776-4db4-b5ad-8870b6025567 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:58.791685 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2763/5492] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:12:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:12:59.191176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0821528-ad85-41a7-afb9-8fdb6e8a3d6e service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:59.193579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c0821528-ad85-41a7-afb9-8fdb6e8a3d6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:59.213840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0821528-ad85-41a7-afb9-8fdb6e8a3d6e service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:59.219809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b7982-d443-478b-ae9a-d7d634a9fc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:59.221463 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b7982-d443-478b-ae9a-d7d634a9fc8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:59.222199 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b7982-d443-478b-ae9a-d7d634a9fc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:59.222745 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b7982-d443-478b-ae9a-d7d634a9fc8d admin admin] PATH_INFO: `/v3/users/4055ba2766514a47a5d24798505dc4b3` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:59.224217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594b7982-d443-478b-ae9a-d7d634a9fc8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4055ba2766514a47a5d24798505dc4b3)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:59.226484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594b7982-d443-478b-ae9a-d7d634a9fc8d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:59.298607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-594b7982-d443-478b-ae9a-d7d634a9fc8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4055ba2766514a47a5d24798505dc4b3'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:59.299836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-594b7982-d443-478b-ae9a-d7d634a9fc8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4055ba2766514a47a5d24798505dc4b3'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:59.300736 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-594b7982-d443-478b-ae9a-d7d634a9fc8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4055ba2766514a47a5d24798505dc4b3'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:59.312890 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-594b7982-d443-478b-ae9a-d7d634a9fc8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4055ba2766514a47a5d24798505dc4b3'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:59.331039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-594b7982-d443-478b-ae9a-d7d634a9fc8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4055ba2766514a47a5d24798505dc4b3'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:12:59.347349 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2730/5493] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:12:59 2022] DELETE /identity/v3/users/4055ba2766514a47a5d24798505dc4b3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:12:59.351686 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdaade5-21b0-4420-8b46-e283abab51d4 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:59.352803 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdaade5-21b0-4420-8b46-e283abab51d4 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:59.353120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdaade5-21b0-4420-8b46-e283abab51d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:59.374867 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-7bdaade5-21b0-4420-8b46-e283abab51d4 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:12:59.376091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7bdaade5-21b0-4420-8b46-e283abab51d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:59.455277 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2764/5494] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:12:59.490038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b7982-d443-478b-ae9a-d7d634a9fc8d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:59.492487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-594b7982-d443-478b-ae9a-d7d634a9fc8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:12:59.574091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b7982-d443-478b-ae9a-d7d634a9fc8d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:12:59.580946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a544a-2b9f-4d3a-8cb9-3999a2dbc4c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:12:59.581628 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a544a-2b9f-4d3a-8cb9-3999a2dbc4c2 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:12:59.581974 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a544a-2b9f-4d3a-8cb9-3999a2dbc4c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:12:59.582318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a544a-2b9f-4d3a-8cb9-3999a2dbc4c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:12:59.594672 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a544a-2b9f-4d3a-8cb9-3999a2dbc4c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:12:59.594672 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a544a-2b9f-4d3a-8cb9-3999a2dbc4c2 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:12:59.606248 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2731/5495] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:12:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:12:59.993379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdaade5-21b0-4420-8b46-e283abab51d4 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:12:59.996365 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7bdaade5-21b0-4420-8b46-e283abab51d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:00.019067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdaade5-21b0-4420-8b46-e283abab51d4 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:00.026339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebad301-bd34-4836-8a37-fad6d9f93576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:00.026839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebad301-bd34-4836-8a37-fad6d9f93576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:00.027199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebad301-bd34-4836-8a37-fad6d9f93576 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:00.035921 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebad301-bd34-4836-8a37-fad6d9f93576 admin admin] PATH_INFO: `/v3/projects/6d1fa862aef94743a6132234f0dc45f7` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:00.037960 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebad301-bd34-4836-8a37-fad6d9f93576 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d1fa862aef94743a6132234f0dc45f7)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:00.041198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebad301-bd34-4836-8a37-fad6d9f93576 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:00.113788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-aebad301-bd34-4836-8a37-fad6d9f93576 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d1fa862aef94743a6132234f0dc45f7', 'request_id': 'req-aebad301-bd34-4836-8a37-fad6d9f93576'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:00.124753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-aebad301-bd34-4836-8a37-fad6d9f93576 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d1fa862aef94743a6132234f0dc45f7', 'request_id': 'req-aebad301-bd34-4836-8a37-fad6d9f93576'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:00.129079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:00.146145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-aebad301-bd34-4836-8a37-fad6d9f93576 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d1fa862aef94743a6132234f0dc45f7', 'request_id': 'req-aebad301-bd34-4836-8a37-fad6d9f93576'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:00.171017 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-aebad301-bd34-4836-8a37-fad6d9f93576 admin admin] The token cache is being invalidate because project 6d1fa862aef94743a6132234f0dc45f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:13:00.171313 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-aebad301-bd34-4836-8a37-fad6d9f93576 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:00.174126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-aebad301-bd34-4836-8a37-fad6d9f93576 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:00.181793 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2765/5496] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:12:59 2022] DELETE /identity/v3/projects/6d1fa862aef94743a6132234f0dc45f7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:00.186031 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a544a-2b9f-4d3a-8cb9-3999a2dbc4c2 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:00.206091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a544a-2b9f-4d3a-8cb9-3999a2dbc4c2 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:00.288997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:00.320022 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f6170-ca6d-4419-abec-e2643da17109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:00.321759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f6170-ca6d-4419-abec-e2643da17109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:00.321759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f6170-ca6d-4419-abec-e2643da17109 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:00.322068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f6170-ca6d-4419-abec-e2643da17109 admin admin] PATH_INFO: `/v3/users/dfaaf9ec38bc40708781519e58313140` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:00.324194 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f6170-ca6d-4419-abec-e2643da17109 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfaaf9ec38bc40708781519e58313140)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:00.325185 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f6170-ca6d-4419-abec-e2643da17109 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:00.387478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-027f6170-ca6d-4419-abec-e2643da17109 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfaaf9ec38bc40708781519e58313140'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:00.388241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-027f6170-ca6d-4419-abec-e2643da17109 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfaaf9ec38bc40708781519e58313140'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:00.389005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-027f6170-ca6d-4419-abec-e2643da17109 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfaaf9ec38bc40708781519e58313140'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:00.398347 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-027f6170-ca6d-4419-abec-e2643da17109 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfaaf9ec38bc40708781519e58313140'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:00.418210 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-027f6170-ca6d-4419-abec-e2643da17109 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfaaf9ec38bc40708781519e58313140'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:00.438379 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2732/5497] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:13:00 2022] DELETE /identity/v3/users/dfaaf9ec38bc40708781519e58313140 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:00.785209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebad301-bd34-4836-8a37-fad6d9f93576 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:00.786847 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-aebad301-bd34-4836-8a37-fad6d9f93576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:00.819421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebad301-bd34-4836-8a37-fad6d9f93576 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:00.930608 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c3198-eebc-41b6-8fda-d23fa5269cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:00.931816 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c3198-eebc-41b6-8fda-d23fa5269cf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:00.932465 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c3198-eebc-41b6-8fda-d23fa5269cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:00.933173 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c3198-eebc-41b6-8fda-d23fa5269cf1 admin admin] PATH_INFO: `/v3/projects/0114b0c2766e4cdc94d9ac2d78729255` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:00.935005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c3198-eebc-41b6-8fda-d23fa5269cf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0114b0c2766e4cdc94d9ac2d78729255)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:00.940396 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c3198-eebc-41b6-8fda-d23fa5269cf1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:01.075967 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-695c3198-eebc-41b6-8fda-d23fa5269cf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0114b0c2766e4cdc94d9ac2d78729255', 'request_id': 'req-695c3198-eebc-41b6-8fda-d23fa5269cf1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:01.094041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-695c3198-eebc-41b6-8fda-d23fa5269cf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0114b0c2766e4cdc94d9ac2d78729255', 'request_id': 'req-695c3198-eebc-41b6-8fda-d23fa5269cf1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:01.124530 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-695c3198-eebc-41b6-8fda-d23fa5269cf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0114b0c2766e4cdc94d9ac2d78729255', 'request_id': 'req-695c3198-eebc-41b6-8fda-d23fa5269cf1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:01.161778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-695c3198-eebc-41b6-8fda-d23fa5269cf1 admin admin] The token cache is being invalidate because project 0114b0c2766e4cdc94d9ac2d78729255 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:13:01.163054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-695c3198-eebc-41b6-8fda-d23fa5269cf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:01.163876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-695c3198-eebc-41b6-8fda-d23fa5269cf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:01.173802 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2766/5498] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:13:00 2022] DELETE /identity/v3/projects/0114b0c2766e4cdc94d9ac2d78729255 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:01.174243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebeaf7-79eb-4587-a6dd-786bf5369bab None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:01.174243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebeaf7-79eb-4587-a6dd-786bf5369bab None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:01.174243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebeaf7-79eb-4587-a6dd-786bf5369bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:01.218777 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d4ebeaf7-79eb-4587-a6dd-786bf5369bab None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:01.238639 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c3198-eebc-41b6-8fda-d23fa5269cf1 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:01.240837 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-695c3198-eebc-41b6-8fda-d23fa5269cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:01.248265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d4ebeaf7-79eb-4587-a6dd-786bf5369bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:01.463640 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2733/5499] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:13:01.474735 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17222042-d94b-4815-b0d6-8f3e07f9370b None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:01.475022 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17222042-d94b-4815-b0d6-8f3e07f9370b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:01.475590 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17222042-d94b-4815-b0d6-8f3e07f9370b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:01.497746 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c3198-eebc-41b6-8fda-d23fa5269cf1 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:01.513285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526c443-feab-429c-b5c3-55c0b37b41d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:01.516168 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526c443-feab-429c-b5c3-55c0b37b41d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:01.518088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526c443-feab-429c-b5c3-55c0b37b41d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:01.518497 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526c443-feab-429c-b5c3-55c0b37b41d1 admin admin] PATH_INFO: `/v3/projects/689cf90bb8884392978aa37cda5202ed` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:01.522127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526c443-feab-429c-b5c3-55c0b37b41d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=689cf90bb8884392978aa37cda5202ed)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:01.527476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526c443-feab-429c-b5c3-55c0b37b41d1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:01.528999 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-17222042-d94b-4815-b0d6-8f3e07f9370b None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:01.530206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-17222042-d94b-4815-b0d6-8f3e07f9370b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:01.550974 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2734/5500] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:01.552558 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17222042-d94b-4815-b0d6-8f3e07f9370b None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:01.573210 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17222042-d94b-4815-b0d6-8f3e07f9370b None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:01.583245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425a599-e090-485b-9810-651aff81bc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:01.584062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425a599-e090-485b-9810-651aff81bc22 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:01.584350 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425a599-e090-485b-9810-651aff81bc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:01.584614 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425a599-e090-485b-9810-651aff81bc22 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:01.585307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425a599-e090-485b-9810-651aff81bc22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:13:01.585595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425a599-e090-485b-9810-651aff81bc22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:01.589400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425a599-e090-485b-9810-651aff81bc22 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:01.622081 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2735/5501] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:13:01.622827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:01.623709 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425a599-e090-485b-9810-651aff81bc22 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:01.643621 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425a599-e090-485b-9810-651aff81bc22 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:01.666884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280415d-6f1c-46ac-a4e2-6f3c98d9546e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:01.667726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280415d-6f1c-46ac-a4e2-6f3c98d9546e admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:01.668343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280415d-6f1c-46ac-a4e2-6f3c98d9546e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:01.668763 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280415d-6f1c-46ac-a4e2-6f3c98d9546e admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:01.669537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0280415d-6f1c-46ac-a4e2-6f3c98d9546e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:01.672924 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0280415d-6f1c-46ac-a4e2-6f3c98d9546e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:01.694106 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5526c443-feab-429c-b5c3-55c0b37b41d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '689cf90bb8884392978aa37cda5202ed', 'request_id': 'req-5526c443-feab-429c-b5c3-55c0b37b41d1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:01.705748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5526c443-feab-429c-b5c3-55c0b37b41d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '689cf90bb8884392978aa37cda5202ed', 'request_id': 'req-5526c443-feab-429c-b5c3-55c0b37b41d1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:01.732277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5526c443-feab-429c-b5c3-55c0b37b41d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '689cf90bb8884392978aa37cda5202ed', 'request_id': 'req-5526c443-feab-429c-b5c3-55c0b37b41d1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:01.751797 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5526c443-feab-429c-b5c3-55c0b37b41d1 admin admin] The token cache is being invalidate because project 689cf90bb8884392978aa37cda5202ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:13:01.752376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5526c443-feab-429c-b5c3-55c0b37b41d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:01.753095 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2736/5502] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:13:01 2022] POST /identity/v3/projects => generated 397 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:13:01.753250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5526c443-feab-429c-b5c3-55c0b37b41d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:01.754131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280415d-6f1c-46ac-a4e2-6f3c98d9546e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:01.756489 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0280415d-6f1c-46ac-a4e2-6f3c98d9546e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:01.761594 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2767/5503] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:13:01 2022] DELETE /identity/v3/projects/689cf90bb8884392978aa37cda5202ed => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:01.763304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b73f4c-9fdd-4a18-b85b-c7ce0b652c2e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:01.765068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b73f4c-9fdd-4a18-b85b-c7ce0b652c2e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:01.765360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b73f4c-9fdd-4a18-b85b-c7ce0b652c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:01.808564 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:01.812951 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-26b73f4c-9fdd-4a18-b85b-c7ce0b652c2e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:01.818796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-26b73f4c-9fdd-4a18-b85b-c7ce0b652c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:01.936049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280415d-6f1c-46ac-a4e2-6f3c98d9546e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:01.941973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94f79f-6a50-4a49-9f44-5acf12212fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:01.942756 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94f79f-6a50-4a49-9f44-5acf12212fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:01.943030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94f79f-6a50-4a49-9f44-5acf12212fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:01.943302 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94f79f-6a50-4a49-9f44-5acf12212fe8 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:01.944558 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94f79f-6a50-4a49-9f44-5acf12212fe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:01.947016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94f79f-6a50-4a49-9f44-5acf12212fe8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:01.978855 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2737/5504] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:13:01 2022] POST /identity/v3/users => generated 305 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:13:01.979977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94f79f-6a50-4a49-9f44-5acf12212fe8 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:02.001666 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94f79f-6a50-4a49-9f44-5acf12212fe8 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:02.012624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b7d31-4c39-4660-99f1-4a2b7e91a09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:02.012624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b7d31-4c39-4660-99f1-4a2b7e91a09e admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:02.012624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b7d31-4c39-4660-99f1-4a2b7e91a09e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:02.012624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b7d31-4c39-4660-99f1-4a2b7e91a09e admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:02.013299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b7d31-4c39-4660-99f1-4a2b7e91a09e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:02.014587 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b7d31-4c39-4660-99f1-4a2b7e91a09e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:02.014920 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2768/5505] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:02.016663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83e44a-05db-4401-a668-cdaf8fed48f8 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:02.017117 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83e44a-05db-4401-a668-cdaf8fed48f8 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:02.017547 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83e44a-05db-4401-a668-cdaf8fed48f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:02.027717 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2738/5506] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:13:02.035584 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b7d31-4c39-4660-99f1-4a2b7e91a09e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:02.050299 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-9f83e44a-05db-4401-a668-cdaf8fed48f8 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:02.052141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9f83e44a-05db-4401-a668-cdaf8fed48f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:02.057178 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b7d31-4c39-4660-99f1-4a2b7e91a09e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:02.062995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd666dd-5ffc-4485-bc11-3cf032ff011b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:02.063735 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd666dd-5ffc-4485-bc11-3cf032ff011b admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:02.064013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd666dd-5ffc-4485-bc11-3cf032ff011b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:02.064330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd666dd-5ffc-4485-bc11-3cf032ff011b admin admin] PATH_INFO: `/v3/projects/e2e45e60ad104748b8f68f6316dba99a/users/ac3e0fd9d6234bdaa939a5f0acbe44dd/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:02.076899 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2769/5507] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:02.082186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83e44a-05db-4401-a668-cdaf8fed48f8 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:02.085039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd666dd-5ffc-4485-bc11-3cf032ff011b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2e45e60ad104748b8f68f6316dba99a, user_id=ac3e0fd9d6234bdaa939a5f0acbe44dd, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:02.088919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd666dd-5ffc-4485-bc11-3cf032ff011b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:02.093591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83e44a-05db-4401-a668-cdaf8fed48f8 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:02.101415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d34d8-46ab-4104-aa1d-dbc1efa93adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:02.103014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d34d8-46ab-4104-aa1d-dbc1efa93adf admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:02.103464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d34d8-46ab-4104-aa1d-dbc1efa93adf admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:02.103752 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d34d8-46ab-4104-aa1d-dbc1efa93adf admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:02.104671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d34d8-46ab-4104-aa1d-dbc1efa93adf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:13:02.104988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d34d8-46ab-4104-aa1d-dbc1efa93adf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:02.106642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d34d8-46ab-4104-aa1d-dbc1efa93adf admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:02.116241 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2739/5508] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:13:02 2022] PUT /identity/v3/projects/e2e45e60ad104748b8f68f6316dba99a/users/ac3e0fd9d6234bdaa939a5f0acbe44dd/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:02.117405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd666dd-5ffc-4485-bc11-3cf032ff011b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:02.128028 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2770/5509] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:13:02.129489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d34d8-46ab-4104-aa1d-dbc1efa93adf admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:02.144695 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d34d8-46ab-4104-aa1d-dbc1efa93adf admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:02.231956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b4308-af42-4a09-bbc2-d2ebec2ebbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:02.232633 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b4308-af42-4a09-bbc2-d2ebec2ebbf2 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:02.232905 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b4308-af42-4a09-bbc2-d2ebec2ebbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:02.233176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b4308-af42-4a09-bbc2-d2ebec2ebbf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:02.233890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b4308-af42-4a09-bbc2-d2ebec2ebbf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:02.236819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b4308-af42-4a09-bbc2-d2ebec2ebbf2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:02.256329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd666dd-5ffc-4485-bc11-3cf032ff011b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:02.269055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ca19f-bf10-4c14-85f9-63341e5db8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:02.269569 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ca19f-bf10-4c14-85f9-63341e5db8ba admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:02.269830 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ca19f-bf10-4c14-85f9-63341e5db8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:02.270109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ca19f-bf10-4c14-85f9-63341e5db8ba admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:02.270781 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2ca19f-bf10-4c14-85f9-63341e5db8ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:02.272406 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2ca19f-bf10-4c14-85f9-63341e5db8ba admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:02.275269 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2771/5510] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:13:02 2022] POST /identity/v3/projects => generated 391 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:13:02.276359 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b4308-af42-4a09-bbc2-d2ebec2ebbf2 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:02.297482 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2740/5511] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:13:02.299326 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:02.301486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ca19f-bf10-4c14-85f9-63341e5db8ba admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:02.326339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ca19f-bf10-4c14-85f9-63341e5db8ba admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:02.362013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b4308-af42-4a09-bbc2-d2ebec2ebbf2 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:02.368668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41aa407-cdff-484e-bc13-da2401b306c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:02.369246 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41aa407-cdff-484e-bc13-da2401b306c4 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:02.369531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41aa407-cdff-484e-bc13-da2401b306c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:02.369805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41aa407-cdff-484e-bc13-da2401b306c4 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:02.370889 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41aa407-cdff-484e-bc13-da2401b306c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:02.372966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41aa407-cdff-484e-bc13-da2401b306c4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:02.416826 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2772/5512] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:13:02 2022] POST /identity/v3/users => generated 296 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:13:02.433799 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41aa407-cdff-484e-bc13-da2401b306c4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:02.447448 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1cc6ea-223d-4d2d-af27-f14276c95228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:02.448179 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1cc6ea-223d-4d2d-af27-f14276c95228 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:02.448462 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1cc6ea-223d-4d2d-af27-f14276c95228 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:02.448737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1cc6ea-223d-4d2d-af27-f14276c95228 admin admin] PATH_INFO: `/v3/projects/e2e45e60ad104748b8f68f6316dba99a/users/ac3e0fd9d6234bdaa939a5f0acbe44dd/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:02.450624 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41aa407-cdff-484e-bc13-da2401b306c4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:02.451053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1cc6ea-223d-4d2d-af27-f14276c95228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2e45e60ad104748b8f68f6316dba99a, user_id=ac3e0fd9d6234bdaa939a5f0acbe44dd, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:02.454265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1cc6ea-223d-4d2d-af27-f14276c95228 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:02.463144 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad9de5-4908-4f61-b68e-74bca01e102b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:02.463773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad9de5-4908-4f61-b68e-74bca01e102b admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:02.466142 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad9de5-4908-4f61-b68e-74bca01e102b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:02.466426 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad9de5-4908-4f61-b68e-74bca01e102b admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:02.467139 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad9de5-4908-4f61-b68e-74bca01e102b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:02.471475 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad9de5-4908-4f61-b68e-74bca01e102b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:02.478998 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2741/5513] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:13:02 2022] PUT /identity/v3/projects/e2e45e60ad104748b8f68f6316dba99a/users/ac3e0fd9d6234bdaa939a5f0acbe44dd/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:13:02.480570 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcdd886-8516-4149-b0f9-d168fba5b02d None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:02.480856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcdd886-8516-4149-b0f9-d168fba5b02d None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:02.481134 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcdd886-8516-4149-b0f9-d168fba5b02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:02.492051 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:02.504743 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2773/5514] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:13:02.506150 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad9de5-4908-4f61-b68e-74bca01e102b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:02.520470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad9de5-4908-4f61-b68e-74bca01e102b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:02.525501 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-2fcdd886-8516-4149-b0f9-d168fba5b02d None None] MFA Rules not processed for user `ac3e0fd9d6234bdaa939a5f0acbe44dd`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:02.528973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2fcdd886-8516-4149-b0f9-d168fba5b02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:02.599390 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491229ed-b856-473f-9d34-9333c9ca792e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:02.600017 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491229ed-b856-473f-9d34-9333c9ca792e admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:02.600907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491229ed-b856-473f-9d34-9333c9ca792e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:02.601191 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491229ed-b856-473f-9d34-9333c9ca792e admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:02.602801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491229ed-b856-473f-9d34-9333c9ca792e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:02.604538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491229ed-b856-473f-9d34-9333c9ca792e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:02.621148 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2774/5515] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:13:02.622965 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491229ed-b856-473f-9d34-9333c9ca792e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:02.643340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491229ed-b856-473f-9d34-9333c9ca792e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:02.650290 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f939e11-65e1-41e7-bd33-b73f06051e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:02.651793 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f939e11-65e1-41e7-bd33-b73f06051e90 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:02.652084 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f939e11-65e1-41e7-bd33-b73f06051e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:02.652368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f939e11-65e1-41e7-bd33-b73f06051e90 admin admin] PATH_INFO: `/v3/projects/1f1f80c2e3134b0a8511bc9508fc63a9/users/f540e02970a24fd79113714b463667c7/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:02.681438 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2742/5516] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:02 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:02.685303 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcdd886-8516-4149-b0f9-d168fba5b02d None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:02.690205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f939e11-65e1-41e7-bd33-b73f06051e90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f1f80c2e3134b0a8511bc9508fc63a9, user_id=f540e02970a24fd79113714b463667c7, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:02.693904 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f939e11-65e1-41e7-bd33-b73f06051e90 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:02.705979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcdd886-8516-4149-b0f9-d168fba5b02d None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:02.730256 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2775/5517] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:13:02 2022] PUT /identity/v3/projects/1f1f80c2e3134b0a8511bc9508fc63a9/users/f540e02970a24fd79113714b463667c7/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:02.731804 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69f45b-732d-4186-9121-dc10abcb0447 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:02.732091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69f45b-732d-4186-9121-dc10abcb0447 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:02.732372 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69f45b-732d-4186-9121-dc10abcb0447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:02.797810 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-1f69f45b-732d-4186-9121-dc10abcb0447 None None] MFA Rules not processed for user `f540e02970a24fd79113714b463667c7`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:02.800423 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1f69f45b-732d-4186-9121-dc10abcb0447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:02.860796 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc180d-a916-4a67-a339-413c596a0192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:02.861640 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc180d-a916-4a67-a339-413c596a0192 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:02.863360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc180d-a916-4a67-a339-413c596a0192 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:02.863667 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc180d-a916-4a67-a339-413c596a0192 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:02.864324 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc180d-a916-4a67-a339-413c596a0192 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:02.866299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc180d-a916-4a67-a339-413c596a0192 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:02.932354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:02.936293 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2743/5518] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:13:02 2022] POST /identity/v3/projects => generated 397 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:13:02.940211 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc180d-a916-4a67-a339-413c596a0192 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:02.947867 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2776/5519] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:02.975576 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69f45b-732d-4186-9121-dc10abcb0447 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:02.979282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1f69f45b-732d-4186-9121-dc10abcb0447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:03.055633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc180d-a916-4a67-a339-413c596a0192 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:03.063807 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881fe8cd-178c-479d-b88b-0dfb95b14acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:03.064822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fe8cd-178c-479d-b88b-0dfb95b14acb admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:03.065202 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fe8cd-178c-479d-b88b-0dfb95b14acb admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:03.065764 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fe8cd-178c-479d-b88b-0dfb95b14acb admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:03.067147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881fe8cd-178c-479d-b88b-0dfb95b14acb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:03.069498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881fe8cd-178c-479d-b88b-0dfb95b14acb admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:03.114198 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2744/5520] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:13:02 2022] POST /identity/v3/users => generated 299 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:13:03.119707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69f45b-732d-4186-9121-dc10abcb0447 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:03.120093 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881fe8cd-178c-479d-b88b-0dfb95b14acb admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:03.135064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:03.144986 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881fe8cd-178c-479d-b88b-0dfb95b14acb admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:03.153559 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ceb955-44a5-4d77-8478-4344f728a924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:03.155803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ceb955-44a5-4d77-8478-4344f728a924 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:03.156020 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ceb955-44a5-4d77-8478-4344f728a924 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:03.156413 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ceb955-44a5-4d77-8478-4344f728a924 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:03.157187 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ceb955-44a5-4d77-8478-4344f728a924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:03.160105 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ceb955-44a5-4d77-8478-4344f728a924 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:03.180412 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2745/5521] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:13:03.182715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ceb955-44a5-4d77-8478-4344f728a924 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:03.203077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ceb955-44a5-4d77-8478-4344f728a924 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:03.211627 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f44a50-0c37-4934-8400-d93a6648592d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:03.212433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f44a50-0c37-4934-8400-d93a6648592d admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:03.212831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f44a50-0c37-4934-8400-d93a6648592d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:03.213219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f44a50-0c37-4934-8400-d93a6648592d admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:03.214226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f44a50-0c37-4934-8400-d93a6648592d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:03.216277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f44a50-0c37-4934-8400-d93a6648592d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:03.261252 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2746/5522] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:13:03.263718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3aa4b-ed76-4774-908a-3e3707606809 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:03.264304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f44a50-0c37-4934-8400-d93a6648592d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:03.265113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3aa4b-ed76-4774-908a-3e3707606809 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:03.267876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3aa4b-ed76-4774-908a-3e3707606809 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:03.268229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3aa4b-ed76-4774-908a-3e3707606809 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:03.280324 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f44a50-0c37-4934-8400-d93a6648592d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:03.287352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b2f0e-dbdf-47d0-80cb-98582430bc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:03.288370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b2f0e-dbdf-47d0-80cb-98582430bc4c admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:03.288767 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b2f0e-dbdf-47d0-80cb-98582430bc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:03.289296 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b2f0e-dbdf-47d0-80cb-98582430bc4c admin admin] PATH_INFO: `/v3/projects/103fbc160453440fad31ba9ba0cae67b/users/a5acc7d69d554fa19c341a35fc7b8f79/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:03.327074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b2f0e-dbdf-47d0-80cb-98582430bc4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=103fbc160453440fad31ba9ba0cae67b, user_id=a5acc7d69d554fa19c341a35fc7b8f79, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:03.331116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b2f0e-dbdf-47d0-80cb-98582430bc4c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:03.370595 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2747/5523] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:13:03 2022] PUT /identity/v3/projects/103fbc160453440fad31ba9ba0cae67b/users/a5acc7d69d554fa19c341a35fc7b8f79/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:13:03.374694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac4b3e-3970-4e16-82e6-b632fc2f2465 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:03.374694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac4b3e-3970-4e16-82e6-b632fc2f2465 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:03.375061 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac4b3e-3970-4e16-82e6-b632fc2f2465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:03.393181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3aa4b-ed76-4774-908a-3e3707606809 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:03.398631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3aa4b-ed76-4774-908a-3e3707606809 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:03.427682 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2777/5524] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:13:02 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:13:03.448737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-9eac4b3e-3970-4e16-82e6-b632fc2f2465 None None] MFA Rules not processed for user `a5acc7d69d554fa19c341a35fc7b8f79`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:03.452663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9eac4b3e-3970-4e16-82e6-b632fc2f2465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:03.520704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3aa4b-ed76-4774-908a-3e3707606809 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:03.537464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3aa4b-ed76-4774-908a-3e3707606809 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:03.646315 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2748/5525] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:03 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:03.660246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac4b3e-3970-4e16-82e6-b632fc2f2465 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:03.662077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9eac4b3e-3970-4e16-82e6-b632fc2f2465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:03.760884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d296f5-fd47-40eb-9a69-a4bc73f8dfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:03.762396 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d296f5-fd47-40eb-9a69-a4bc73f8dfab admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:03.763662 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d296f5-fd47-40eb-9a69-a4bc73f8dfab admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:03.765067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d296f5-fd47-40eb-9a69-a4bc73f8dfab admin admin] PATH_INFO: `/v3/users/f540e02970a24fd79113714b463667c7` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:03.767703 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d296f5-fd47-40eb-9a69-a4bc73f8dfab admin admin] RBAC: Authorizing `identity:delete_user(user_id=f540e02970a24fd79113714b463667c7)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:03.771987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d296f5-fd47-40eb-9a69-a4bc73f8dfab admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:03.783218 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:03.807614 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac4b3e-3970-4e16-82e6-b632fc2f2465 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:03.816744 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48897f-399c-4d3f-89f6-3494731b6f57 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10759b2abd4cafacf338551327775e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:03.818985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48897f-399c-4d3f-89f6-3494731b6f57 service glance] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:03.819275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48897f-399c-4d3f-89f6-3494731b6f57 service glance] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:03.819551 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48897f-399c-4d3f-89f6-3494731b6f57 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:03.870815 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a8d296f5-fd47-40eb-9a69-a4bc73f8dfab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f540e02970a24fd79113714b463667c7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:03.887589 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a8d296f5-fd47-40eb-9a69-a4bc73f8dfab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f540e02970a24fd79113714b463667c7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:03.889664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a8d296f5-fd47-40eb-9a69-a4bc73f8dfab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f540e02970a24fd79113714b463667c7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:03.890337 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a8d296f5-fd47-40eb-9a69-a4bc73f8dfab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f540e02970a24fd79113714b463667c7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:03.914505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a8d296f5-fd47-40eb-9a69-a4bc73f8dfab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f540e02970a24fd79113714b463667c7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:03.972288 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2778/5526] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:13:03 2022] DELETE /identity/v3/users/f540e02970a24fd79113714b463667c7 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:13:03.982502 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d423bd-f7b1-47b8-a2ff-a22f417dacdc None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:03.983360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d423bd-f7b1-47b8-a2ff-a22f417dacdc None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:03.983648 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d423bd-f7b1-47b8-a2ff-a22f417dacdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:04.035181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48897f-399c-4d3f-89f6-3494731b6f57 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:04.045428 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48897f-399c-4d3f-89f6-3494731b6f57 service glance] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:04.068971 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:04.070345 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d0d423bd-f7b1-47b8-a2ff-a22f417dacdc None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:04.074136 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d0d423bd-f7b1-47b8-a2ff-a22f417dacdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:04.109377 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2749/5527] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:13:03 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:13:04.250274 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2779/5528] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:04.276247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48897f-399c-4d3f-89f6-3494731b6f57 service glance] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:04.467672 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48897f-399c-4d3f-89f6-3494731b6f57 service glance] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:04.629449 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb43fa2-ff5d-424c-87bf-29916d5f5c12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:04.631355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb43fa2-ff5d-424c-87bf-29916d5f5c12 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:04.631828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb43fa2-ff5d-424c-87bf-29916d5f5c12 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:04.632394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb43fa2-ff5d-424c-87bf-29916d5f5c12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:04.648377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb43fa2-ff5d-424c-87bf-29916d5f5c12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:04.651885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb43fa2-ff5d-424c-87bf-29916d5f5c12 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:04.667581 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2750/5529] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:13:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:13:05.078330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d423bd-f7b1-47b8-a2ff-a22f417dacdc None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:05.080027 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d0d423bd-f7b1-47b8-a2ff-a22f417dacdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:05.103803 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d423bd-f7b1-47b8-a2ff-a22f417dacdc None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:05.133073 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bede927-6b7f-4a4a-96ab-5d221348a0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:05.133969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bede927-6b7f-4a4a-96ab-5d221348a0c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:05.134355 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bede927-6b7f-4a4a-96ab-5d221348a0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:05.134775 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bede927-6b7f-4a4a-96ab-5d221348a0c6 admin admin] PATH_INFO: `/v3/users/ac3e0fd9d6234bdaa939a5f0acbe44dd` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:05.136096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bede927-6b7f-4a4a-96ab-5d221348a0c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac3e0fd9d6234bdaa939a5f0acbe44dd)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:05.165897 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bede927-6b7f-4a4a-96ab-5d221348a0c6 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:05.278398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9bede927-6b7f-4a4a-96ab-5d221348a0c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac3e0fd9d6234bdaa939a5f0acbe44dd'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:05.300956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9bede927-6b7f-4a4a-96ab-5d221348a0c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac3e0fd9d6234bdaa939a5f0acbe44dd'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:05.301720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9bede927-6b7f-4a4a-96ab-5d221348a0c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac3e0fd9d6234bdaa939a5f0acbe44dd'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:05.302335 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9bede927-6b7f-4a4a-96ab-5d221348a0c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac3e0fd9d6234bdaa939a5f0acbe44dd'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:05.325347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9bede927-6b7f-4a4a-96ab-5d221348a0c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac3e0fd9d6234bdaa939a5f0acbe44dd'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:05.342701 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:05.359606 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2780/5530] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:13:05 2022] DELETE /identity/v3/users/ac3e0fd9d6234bdaa939a5f0acbe44dd => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:05.361380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c47d1c-53f0-4c78-9c81-16424ccf9532 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:05.361853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c47d1c-53f0-4c78-9c81-16424ccf9532 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:05.361973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c47d1c-53f0-4c78-9c81-16424ccf9532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:05.392339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-c1c47d1c-53f0-4c78-9c81-16424ccf9532 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:05.394717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c1c47d1c-53f0-4c78-9c81-16424ccf9532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:05.504722 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2751/5531] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:05.566582 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bede927-6b7f-4a4a-96ab-5d221348a0c6 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:05.569020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9bede927-6b7f-4a4a-96ab-5d221348a0c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:05.609511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c47d1c-53f0-4c78-9c81-16424ccf9532 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:05.611440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c1c47d1c-53f0-4c78-9c81-16424ccf9532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:05.632144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c47d1c-53f0-4c78-9c81-16424ccf9532 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:05.644264 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11159c2b-3170-45f1-9ecc-ad7dd4dda161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:05.645009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11159c2b-3170-45f1-9ecc-ad7dd4dda161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:05.645377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11159c2b-3170-45f1-9ecc-ad7dd4dda161 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:05.645785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11159c2b-3170-45f1-9ecc-ad7dd4dda161 admin admin] PATH_INFO: `/v3/projects/1f1f80c2e3134b0a8511bc9508fc63a9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:05.647127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11159c2b-3170-45f1-9ecc-ad7dd4dda161 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f1f80c2e3134b0a8511bc9508fc63a9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:05.653920 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11159c2b-3170-45f1-9ecc-ad7dd4dda161 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:05.729113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bede927-6b7f-4a4a-96ab-5d221348a0c6 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:05.755187 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-11159c2b-3170-45f1-9ecc-ad7dd4dda161 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f1f80c2e3134b0a8511bc9508fc63a9', 'request_id': 'req-11159c2b-3170-45f1-9ecc-ad7dd4dda161'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:05.759249 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:05.768585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-11159c2b-3170-45f1-9ecc-ad7dd4dda161 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f1f80c2e3134b0a8511bc9508fc63a9', 'request_id': 'req-11159c2b-3170-45f1-9ecc-ad7dd4dda161'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:05.784815 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-11159c2b-3170-45f1-9ecc-ad7dd4dda161 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f1f80c2e3134b0a8511bc9508fc63a9', 'request_id': 'req-11159c2b-3170-45f1-9ecc-ad7dd4dda161'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:05.819035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-11159c2b-3170-45f1-9ecc-ad7dd4dda161 admin admin] The token cache is being invalidate because project 1f1f80c2e3134b0a8511bc9508fc63a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:13:05.819525 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-11159c2b-3170-45f1-9ecc-ad7dd4dda161 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:05.822053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-11159c2b-3170-45f1-9ecc-ad7dd4dda161 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:05.832712 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2752/5532] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:13:05 2022] DELETE /identity/v3/projects/1f1f80c2e3134b0a8511bc9508fc63a9 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:13:05.837867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad83ff6-f961-4f18-9294-0fce7fa37ef2 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:05.838404 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad83ff6-f961-4f18-9294-0fce7fa37ef2 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:05.838866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad83ff6-f961-4f18-9294-0fce7fa37ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:05.893936 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ec4d9-2d1d-4005-87e7-062b8aa4a9f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:05.896497 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ec4d9-2d1d-4005-87e7-062b8aa4a9f0 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:05.896497 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ec4d9-2d1d-4005-87e7-062b8aa4a9f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:05.897200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ec4d9-2d1d-4005-87e7-062b8aa4a9f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:05.900047 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-3ad83ff6-f961-4f18-9294-0fce7fa37ef2 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:05.903079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b48ec4d9-2d1d-4005-87e7-062b8aa4a9f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:05.905847 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3ad83ff6-f961-4f18-9294-0fce7fa37ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:06.069106 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2753/5533] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:13:06.081261 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb398a-6b47-426f-bbd5-71c8d905d83a None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:06.081725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb398a-6b47-426f-bbd5-71c8d905d83a None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:06.082314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb398a-6b47-426f-bbd5-71c8d905d83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:06.104167 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ec4d9-2d1d-4005-87e7-062b8aa4a9f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:06.105923 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ec4d9-2d1d-4005-87e7-062b8aa4a9f0 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:06.125532 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-8ccb398a-6b47-426f-bbd5-71c8d905d83a None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:06.126950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8ccb398a-6b47-426f-bbd5-71c8d905d83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:06.128179 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2781/5534] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:13:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:13:06.146275 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2754/5535] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:06.150952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ec4d9-2d1d-4005-87e7-062b8aa4a9f0 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:06.163029 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ec4d9-2d1d-4005-87e7-062b8aa4a9f0 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:06.179282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c122707-7a21-4ab3-8311-c299bf94aa03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:06.179980 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c122707-7a21-4ab3-8311-c299bf94aa03 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:06.180322 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c122707-7a21-4ab3-8311-c299bf94aa03 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:06.180599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c122707-7a21-4ab3-8311-c299bf94aa03 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:06.181489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c122707-7a21-4ab3-8311-c299bf94aa03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:13:06.181800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c122707-7a21-4ab3-8311-c299bf94aa03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:06.183704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c122707-7a21-4ab3-8311-c299bf94aa03 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:06.208336 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2782/5536] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:13:06.210087 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb398a-6b47-426f-bbd5-71c8d905d83a None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:06.225040 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb398a-6b47-426f-bbd5-71c8d905d83a None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:06.235729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ca927-298f-458a-974f-26f1a7de7f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:06.236117 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ca927-298f-458a-974f-26f1a7de7f95 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:06.236500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ca927-298f-458a-974f-26f1a7de7f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:06.237703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ca927-298f-458a-974f-26f1a7de7f95 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:06.239327 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ca927-298f-458a-974f-26f1a7de7f95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:06.241729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ca927-298f-458a-974f-26f1a7de7f95 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:06.332745 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2755/5537] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:13:06 2022] POST /identity/v3/projects => generated 387 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:13:06.337758 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c122707-7a21-4ab3-8311-c299bf94aa03 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:06.355906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c122707-7a21-4ab3-8311-c299bf94aa03 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:06.512342 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:06.550291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbcd4fd-cfc6-4dc8-8033-56a4978a2462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:06.563114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcd4fd-cfc6-4dc8-8033-56a4978a2462 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:06.564674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcd4fd-cfc6-4dc8-8033-56a4978a2462 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:06.565643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcd4fd-cfc6-4dc8-8033-56a4978a2462 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:06.567905 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbcd4fd-cfc6-4dc8-8033-56a4978a2462 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:06.569992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbcd4fd-cfc6-4dc8-8033-56a4978a2462 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:06.615249 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2783/5538] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:13:06 2022] POST /identity/v3/users => generated 294 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:13:06.619675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ca927-298f-458a-974f-26f1a7de7f95 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:06.642086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ca927-298f-458a-974f-26f1a7de7f95 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:06.662641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7eb997-5fc9-41e0-9536-ae83cf4c8fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:06.665311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7eb997-5fc9-41e0-9536-ae83cf4c8fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:06.665311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7eb997-5fc9-41e0-9536-ae83cf4c8fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:06.666928 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7eb997-5fc9-41e0-9536-ae83cf4c8fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:06.672042 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7eb997-5fc9-41e0-9536-ae83cf4c8fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:06.676299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7eb997-5fc9-41e0-9536-ae83cf4c8fa1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:06.734153 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2756/5539] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:13:06.738165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbcd4fd-cfc6-4dc8-8033-56a4978a2462 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:06.755767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbcd4fd-cfc6-4dc8-8033-56a4978a2462 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:06.770566 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28723623-5e1e-4517-ad5b-124e9cc6ebd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:06.771237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28723623-5e1e-4517-ad5b-124e9cc6ebd2 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:06.771480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28723623-5e1e-4517-ad5b-124e9cc6ebd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:06.771747 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28723623-5e1e-4517-ad5b-124e9cc6ebd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:06.772405 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28723623-5e1e-4517-ad5b-124e9cc6ebd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:06.774674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28723623-5e1e-4517-ad5b-124e9cc6ebd2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:06.809416 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2784/5540] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:13:06.810730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7eb997-5fc9-41e0-9536-ae83cf4c8fa1 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:06.825401 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7eb997-5fc9-41e0-9536-ae83cf4c8fa1 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:06.837721 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f2f85-efa7-414d-a376-5c0612b06a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:06.838415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f2f85-efa7-414d-a376-5c0612b06a03 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:06.838859 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f2f85-efa7-414d-a376-5c0612b06a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:06.839535 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f2f85-efa7-414d-a376-5c0612b06a03 admin admin] PATH_INFO: `/v3/projects/873358627fc649f99fb067524ba09439/users/d2681b0409c64aafbd941c30db6485e5/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:06.873920 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f2f85-efa7-414d-a376-5c0612b06a03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=873358627fc649f99fb067524ba09439, user_id=d2681b0409c64aafbd941c30db6485e5, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:06.877627 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f2f85-efa7-414d-a376-5c0612b06a03 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:06.906597 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2757/5541] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:13:06 2022] PUT /identity/v3/projects/873358627fc649f99fb067524ba09439/users/d2681b0409c64aafbd941c30db6485e5/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:06.915926 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d72d6b-c2fd-4b7c-ac9d-8299b7d29179 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:06.916137 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d72d6b-c2fd-4b7c-ac9d-8299b7d29179 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:06.916419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d72d6b-c2fd-4b7c-ac9d-8299b7d29179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:06.977714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-71d72d6b-c2fd-4b7c-ac9d-8299b7d29179 None None] MFA Rules not processed for user `d2681b0409c64aafbd941c30db6485e5`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:06.981712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-71d72d6b-c2fd-4b7c-ac9d-8299b7d29179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:07.092116 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2785/5542] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:07.144011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f2f85-efa7-414d-a376-5c0612b06a03 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:07.146450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d08f2f85-efa7-414d-a376-5c0612b06a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:07.310106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f2f85-efa7-414d-a376-5c0612b06a03 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:07.315353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb05b11-cfd9-4af5-961f-d29ed174a6b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:07.316155 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb05b11-cfd9-4af5-961f-d29ed174a6b9 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:07.317734 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb05b11-cfd9-4af5-961f-d29ed174a6b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:07.318425 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb05b11-cfd9-4af5-961f-d29ed174a6b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:07.333871 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb05b11-cfd9-4af5-961f-d29ed174a6b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:07.335654 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb05b11-cfd9-4af5-961f-d29ed174a6b9 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:07.349566 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2758/5543] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:13:07 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:13:08.346231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d72d6b-c2fd-4b7c-ac9d-8299b7d29179 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:08.348501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-71d72d6b-c2fd-4b7c-ac9d-8299b7d29179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:08.443275 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d72d6b-c2fd-4b7c-ac9d-8299b7d29179 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:08.449348 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20c828-798c-499f-9048-6ba4de5d6bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:08.450530 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20c828-798c-499f-9048-6ba4de5d6bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:08.451073 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20c828-798c-499f-9048-6ba4de5d6bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:08.451599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20c828-798c-499f-9048-6ba4de5d6bc6 admin admin] PATH_INFO: `/v3/projects/e2e45e60ad104748b8f68f6316dba99a` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:08.453220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20c828-798c-499f-9048-6ba4de5d6bc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2e45e60ad104748b8f68f6316dba99a)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:08.456114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20c828-798c-499f-9048-6ba4de5d6bc6 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:08.559022 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ab20c828-798c-499f-9048-6ba4de5d6bc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2e45e60ad104748b8f68f6316dba99a', 'request_id': 'req-ab20c828-798c-499f-9048-6ba4de5d6bc6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:08.571444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ab20c828-798c-499f-9048-6ba4de5d6bc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2e45e60ad104748b8f68f6316dba99a', 'request_id': 'req-ab20c828-798c-499f-9048-6ba4de5d6bc6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:08.577795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:08.591466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ab20c828-798c-499f-9048-6ba4de5d6bc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2e45e60ad104748b8f68f6316dba99a', 'request_id': 'req-ab20c828-798c-499f-9048-6ba4de5d6bc6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:08.617582 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ab20c828-798c-499f-9048-6ba4de5d6bc6 admin admin] The token cache is being invalidate because project e2e45e60ad104748b8f68f6316dba99a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:13:08.620721 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ab20c828-798c-499f-9048-6ba4de5d6bc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:08.622309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ab20c828-798c-499f-9048-6ba4de5d6bc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:08.628941 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2786/5544] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:13:08 2022] DELETE /identity/v3/projects/e2e45e60ad104748b8f68f6316dba99a => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:08.634359 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb05b11-cfd9-4af5-961f-d29ed174a6b9 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:08.659438 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb05b11-cfd9-4af5-961f-d29ed174a6b9 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:08.710579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:08.837809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400cf80-cba6-46e2-abdd-55e9451f896a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:08.839213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400cf80-cba6-46e2-abdd-55e9451f896a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:08.840095 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400cf80-cba6-46e2-abdd-55e9451f896a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:08.840382 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400cf80-cba6-46e2-abdd-55e9451f896a admin admin] PATH_INFO: `/v3/users/a5acc7d69d554fa19c341a35fc7b8f79` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:08.842891 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b400cf80-cba6-46e2-abdd-55e9451f896a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5acc7d69d554fa19c341a35fc7b8f79)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:08.845884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b400cf80-cba6-46e2-abdd-55e9451f896a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:08.956967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b400cf80-cba6-46e2-abdd-55e9451f896a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5acc7d69d554fa19c341a35fc7b8f79'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:08.958929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b400cf80-cba6-46e2-abdd-55e9451f896a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5acc7d69d554fa19c341a35fc7b8f79'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:08.959779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b400cf80-cba6-46e2-abdd-55e9451f896a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5acc7d69d554fa19c341a35fc7b8f79'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:08.977798 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b400cf80-cba6-46e2-abdd-55e9451f896a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5acc7d69d554fa19c341a35fc7b8f79'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:09.015556 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b400cf80-cba6-46e2-abdd-55e9451f896a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5acc7d69d554fa19c341a35fc7b8f79'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:09.062143 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2759/5545] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:13:08 2022] DELETE /identity/v3/users/a5acc7d69d554fa19c341a35fc7b8f79 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:10.791690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20c828-798c-499f-9048-6ba4de5d6bc6 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:10.794076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ab20c828-798c-499f-9048-6ba4de5d6bc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:10.831646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20c828-798c-499f-9048-6ba4de5d6bc6 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:10.970660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402c76e-de65-4471-9e4b-f23383e0e15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:10.971519 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402c76e-de65-4471-9e4b-f23383e0e15c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:10.971893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402c76e-de65-4471-9e4b-f23383e0e15c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:10.972273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402c76e-de65-4471-9e4b-f23383e0e15c admin admin] PATH_INFO: `/v3/projects/103fbc160453440fad31ba9ba0cae67b` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:10.973509 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402c76e-de65-4471-9e4b-f23383e0e15c admin admin] RBAC: Authorizing `identity:delete_project(project_id=103fbc160453440fad31ba9ba0cae67b)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:10.975693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402c76e-de65-4471-9e4b-f23383e0e15c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:11.045346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c402c76e-de65-4471-9e4b-f23383e0e15c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '103fbc160453440fad31ba9ba0cae67b', 'request_id': 'req-c402c76e-de65-4471-9e4b-f23383e0e15c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:11.057473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c402c76e-de65-4471-9e4b-f23383e0e15c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '103fbc160453440fad31ba9ba0cae67b', 'request_id': 'req-c402c76e-de65-4471-9e4b-f23383e0e15c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:11.068768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c402c76e-de65-4471-9e4b-f23383e0e15c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '103fbc160453440fad31ba9ba0cae67b', 'request_id': 'req-c402c76e-de65-4471-9e4b-f23383e0e15c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:11.097730 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c402c76e-de65-4471-9e4b-f23383e0e15c admin admin] The token cache is being invalidate because project 103fbc160453440fad31ba9ba0cae67b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:13:11.098083 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c402c76e-de65-4471-9e4b-f23383e0e15c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:11.098924 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c402c76e-de65-4471-9e4b-f23383e0e15c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:11.100869 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2787/5546] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:13:10 2022] DELETE /identity/v3/projects/103fbc160453440fad31ba9ba0cae67b => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:11.107962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed26694-e08d-4909-b901-b7b437ddedf3 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:11.108512 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed26694-e08d-4909-b901-b7b437ddedf3 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:11.108512 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed26694-e08d-4909-b901-b7b437ddedf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:11.158422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-3ed26694-e08d-4909-b901-b7b437ddedf3 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:11.159773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3ed26694-e08d-4909-b901-b7b437ddedf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:11.264881 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2760/5547] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:11.266691 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071175d-16a1-419f-81c5-4b1853f72fac None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:11.268459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071175d-16a1-419f-81c5-4b1853f72fac None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:11.268740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071175d-16a1-419f-81c5-4b1853f72fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:11.294859 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-4071175d-16a1-419f-81c5-4b1853f72fac None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:11.303546 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4071175d-16a1-419f-81c5-4b1853f72fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:11.314730 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2788/5548] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:11.319357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed26694-e08d-4909-b901-b7b437ddedf3 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:11.335585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed26694-e08d-4909-b901-b7b437ddedf3 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:11.348303 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3616b3-cd5e-4e44-b0ad-6c4f20fd8394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:11.349162 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3616b3-cd5e-4e44-b0ad-6c4f20fd8394 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:11.349365 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3616b3-cd5e-4e44-b0ad-6c4f20fd8394 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:11.349611 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3616b3-cd5e-4e44-b0ad-6c4f20fd8394 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:11.350277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3616b3-cd5e-4e44-b0ad-6c4f20fd8394 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:13:11.350602 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3616b3-cd5e-4e44-b0ad-6c4f20fd8394 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:11.352826 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3616b3-cd5e-4e44-b0ad-6c4f20fd8394 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:11.372197 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071175d-16a1-419f-81c5-4b1853f72fac None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:11.372421 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2761/5549] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:13:11.387927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071175d-16a1-419f-81c5-4b1853f72fac None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:11.401367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa218110-da0e-486e-95db-93931fda0b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:11.402110 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa218110-da0e-486e-95db-93931fda0b2e admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:11.402452 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa218110-da0e-486e-95db-93931fda0b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:11.402819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa218110-da0e-486e-95db-93931fda0b2e admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:11.403584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa218110-da0e-486e-95db-93931fda0b2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:11.425521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa218110-da0e-486e-95db-93931fda0b2e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:11.485426 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2789/5550] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:13:11 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:13:11.489584 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3616b3-cd5e-4e44-b0ad-6c4f20fd8394 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:11.502521 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3616b3-cd5e-4e44-b0ad-6c4f20fd8394 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:11.540379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:11.589937 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6cd322-25be-4a72-aa12-3999ccce0e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:11.590715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cd322-25be-4a72-aa12-3999ccce0e74 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:11.591103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cd322-25be-4a72-aa12-3999ccce0e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:11.591482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cd322-25be-4a72-aa12-3999ccce0e74 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:11.592277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6cd322-25be-4a72-aa12-3999ccce0e74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:11.595382 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6cd322-25be-4a72-aa12-3999ccce0e74 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:11.632396 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2762/5551] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:13:11 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:13:11.637437 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa218110-da0e-486e-95db-93931fda0b2e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:11.654269 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa218110-da0e-486e-95db-93931fda0b2e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:11.660107 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae29ae-f623-4072-8f4a-2142c17dfcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:11.661465 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae29ae-f623-4072-8f4a-2142c17dfcf5 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:11.661765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae29ae-f623-4072-8f4a-2142c17dfcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:11.662039 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae29ae-f623-4072-8f4a-2142c17dfcf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:11.663215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae29ae-f623-4072-8f4a-2142c17dfcf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:11.665719 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae29ae-f623-4072-8f4a-2142c17dfcf5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:11.695277 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2790/5552] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:13:11.695474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6cd322-25be-4a72-aa12-3999ccce0e74 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:11.707009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6cd322-25be-4a72-aa12-3999ccce0e74 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:11.712610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde576a-59b7-4a42-9d79-5756862e9531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:11.713221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde576a-59b7-4a42-9d79-5756862e9531 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:11.713503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde576a-59b7-4a42-9d79-5756862e9531 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:11.713778 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde576a-59b7-4a42-9d79-5756862e9531 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:11.714423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde576a-59b7-4a42-9d79-5756862e9531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:11.716275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde576a-59b7-4a42-9d79-5756862e9531 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:11.730614 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2763/5553] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:13:11.734095 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae29ae-f623-4072-8f4a-2142c17dfcf5 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:11.747762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae29ae-f623-4072-8f4a-2142c17dfcf5 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:11.763324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d8bc3-5a14-4fde-a04a-314596d7814c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:11.764023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d8bc3-5a14-4fde-a04a-314596d7814c admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:11.764937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d8bc3-5a14-4fde-a04a-314596d7814c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:11.765233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d8bc3-5a14-4fde-a04a-314596d7814c admin admin] PATH_INFO: `/v3/projects/8072c27c74cc43bfbf15b394a1b2a340/users/9fd542fd6bd34ea19e4420d4ad6ee387/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:11.813107 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d8bc3-5a14-4fde-a04a-314596d7814c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8072c27c74cc43bfbf15b394a1b2a340, user_id=9fd542fd6bd34ea19e4420d4ad6ee387, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:11.815605 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d8bc3-5a14-4fde-a04a-314596d7814c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:11.843372 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2791/5554] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:13:11 2022] PUT /identity/v3/projects/8072c27c74cc43bfbf15b394a1b2a340/users/9fd542fd6bd34ea19e4420d4ad6ee387/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:11.855310 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7f4df-064c-41a5-893e-65083f62c396 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:11.855774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7f4df-064c-41a5-893e-65083f62c396 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:11.856139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7f4df-064c-41a5-893e-65083f62c396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:11.969095 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-15d7f4df-064c-41a5-893e-65083f62c396 None None] MFA Rules not processed for user `9fd542fd6bd34ea19e4420d4ad6ee387`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:11.971480 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-15d7f4df-064c-41a5-893e-65083f62c396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:12.102426 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2764/5555] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:12.107455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d8bc3-5a14-4fde-a04a-314596d7814c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:12.162330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:12.286720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d8bc3-5a14-4fde-a04a-314596d7814c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:12.301846 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb122c70-364d-4723-90e3-7ea414dc5cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:12.303605 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb122c70-364d-4723-90e3-7ea414dc5cf6 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:12.303905 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb122c70-364d-4723-90e3-7ea414dc5cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:12.306796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb122c70-364d-4723-90e3-7ea414dc5cf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:12.307460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb122c70-364d-4723-90e3-7ea414dc5cf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:12.316730 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb122c70-364d-4723-90e3-7ea414dc5cf6 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:12.377862 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2792/5556] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:13:12 2022] POST /identity/v3/projects => generated 385 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:13:12.382670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7f4df-064c-41a5-893e-65083f62c396 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:12.401151 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7f4df-064c-41a5-893e-65083f62c396 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:12.506367 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c866351-41dd-4c50-83c9-b35887f422f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:12.507411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c866351-41dd-4c50-83c9-b35887f422f3 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:12.507873 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c866351-41dd-4c50-83c9-b35887f422f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:12.509405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c866351-41dd-4c50-83c9-b35887f422f3 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:12.510216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c866351-41dd-4c50-83c9-b35887f422f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:12.512705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c866351-41dd-4c50-83c9-b35887f422f3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:12.548694 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2765/5557] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:13:12 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:13:12.552467 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb122c70-364d-4723-90e3-7ea414dc5cf6 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:12.565287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb122c70-364d-4723-90e3-7ea414dc5cf6 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:12.571309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32075c3-ec24-4b4a-a8f7-3096f75a167a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:12.573227 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32075c3-ec24-4b4a-a8f7-3096f75a167a admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:12.573838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32075c3-ec24-4b4a-a8f7-3096f75a167a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:12.574302 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32075c3-ec24-4b4a-a8f7-3096f75a167a admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:12.575208 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32075c3-ec24-4b4a-a8f7-3096f75a167a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:12.577287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32075c3-ec24-4b4a-a8f7-3096f75a167a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:12.593738 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2793/5558] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:13:12.597554 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c866351-41dd-4c50-83c9-b35887f422f3 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:12.612287 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c866351-41dd-4c50-83c9-b35887f422f3 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:12.618391 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a6bc2-e236-4a99-b076-24ae9c2083c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:12.619612 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a6bc2-e236-4a99-b076-24ae9c2083c8 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:12.620113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a6bc2-e236-4a99-b076-24ae9c2083c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:12.620688 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a6bc2-e236-4a99-b076-24ae9c2083c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:12.621611 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a6bc2-e236-4a99-b076-24ae9c2083c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:12.624133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a6bc2-e236-4a99-b076-24ae9c2083c8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:12.639727 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2766/5559] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:13:12.646050 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32075c3-ec24-4b4a-a8f7-3096f75a167a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:12.662499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32075c3-ec24-4b4a-a8f7-3096f75a167a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:12.674019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0954475-3a2f-4651-971d-18b543e9c410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:12.675297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0954475-3a2f-4651-971d-18b543e9c410 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:12.676312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0954475-3a2f-4651-971d-18b543e9c410 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:12.676840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0954475-3a2f-4651-971d-18b543e9c410 admin admin] PATH_INFO: `/v3/projects/17a70352fb584cbd94d13d7ea978f2aa/users/1c98e7e5b2c14862af2a9f269617ec9d/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:12.705660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0954475-3a2f-4651-971d-18b543e9c410 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17a70352fb584cbd94d13d7ea978f2aa, user_id=1c98e7e5b2c14862af2a9f269617ec9d, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:12.709297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0954475-3a2f-4651-971d-18b543e9c410 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:12.733626 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2794/5560] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:13:12 2022] PUT /identity/v3/projects/17a70352fb584cbd94d13d7ea978f2aa/users/1c98e7e5b2c14862af2a9f269617ec9d/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:12.744247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f253b4-f9e9-4b9b-9b7e-25f28d45b219 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:12.744542 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f253b4-f9e9-4b9b-9b7e-25f28d45b219 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:12.744825 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f253b4-f9e9-4b9b-9b7e-25f28d45b219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:12.774323 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:12.779294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-b4f253b4-f9e9-4b9b-9b7e-25f28d45b219 None None] MFA Rules not processed for user `1c98e7e5b2c14862af2a9f269617ec9d`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:12.782740 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b4f253b4-f9e9-4b9b-9b7e-25f28d45b219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:12.897235 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2767/5561] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:12.898286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0954475-3a2f-4651-971d-18b543e9c410 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:12.901238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e0954475-3a2f-4651-971d-18b543e9c410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:13.014942 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0954475-3a2f-4651-971d-18b543e9c410 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:13.024960 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7b5eb-4fc2-4406-b5c9-fabb8b097a2d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10759b2abd4cafacf338551327775e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:13.025720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7b5eb-4fc2-4406-b5c9-fabb8b097a2d service glance] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:13.026597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7b5eb-4fc2-4406-b5c9-fabb8b097a2d service glance] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:13.026597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7b5eb-4fc2-4406-b5c9-fabb8b097a2d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:13.119320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7b5eb-4fc2-4406-b5c9-fabb8b097a2d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:13.121028 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7b5eb-4fc2-4406-b5c9-fabb8b097a2d service glance] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:13.133801 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2795/5562] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:13:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:13:13.474406 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f253b4-f9e9-4b9b-9b7e-25f28d45b219 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:13.494886 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f253b4-f9e9-4b9b-9b7e-25f28d45b219 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:13.504902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92830a-efc5-428c-9498-e72402c54ed8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10759b2abd4cafacf338551327775e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:13.505904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92830a-efc5-428c-9498-e72402c54ed8 service glance] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:13.506500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92830a-efc5-428c-9498-e72402c54ed8 service glance] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:13.506955 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92830a-efc5-428c-9498-e72402c54ed8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:13.532583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd92830a-efc5-428c-9498-e72402c54ed8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:13.534321 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd92830a-efc5-428c-9498-e72402c54ed8 service glance] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:13.573141 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2768/5563] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:13:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:13:13.988568 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6630b8-c6e4-42e5-ad09-056f60fdc53b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:13.989108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6630b8-c6e4-42e5-ad09-056f60fdc53b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:13.989108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6630b8-c6e4-42e5-ad09-056f60fdc53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:14.020201 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-9c6630b8-c6e4-42e5-ad09-056f60fdc53b None None] MFA Rules not processed for user `a6c953ff2f774041a7d50f53033ee124`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:14.023359 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9c6630b8-c6e4-42e5-ad09-056f60fdc53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:14.056735 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:14.096967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92830a-efc5-428c-9498-e72402c54ed8 service glance] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:14.187936 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2796/5564] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:14.273157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92830a-efc5-428c-9498-e72402c54ed8 service glance] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:14.280260 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c00cf-d89f-4951-bb25-ad4a92dda72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:14.282190 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c00cf-d89f-4951-bb25-ad4a92dda72f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:14.282874 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c00cf-d89f-4951-bb25-ad4a92dda72f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:14.283306 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c00cf-d89f-4951-bb25-ad4a92dda72f admin admin] PATH_INFO: `/v3/users/9fd542fd6bd34ea19e4420d4ad6ee387` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:14.285253 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c00cf-d89f-4951-bb25-ad4a92dda72f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fd542fd6bd34ea19e4420d4ad6ee387)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:14.291831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c00cf-d89f-4951-bb25-ad4a92dda72f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:14.384265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-957c00cf-d89f-4951-bb25-ad4a92dda72f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fd542fd6bd34ea19e4420d4ad6ee387'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:14.385023 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-957c00cf-d89f-4951-bb25-ad4a92dda72f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fd542fd6bd34ea19e4420d4ad6ee387'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:14.385739 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-957c00cf-d89f-4951-bb25-ad4a92dda72f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fd542fd6bd34ea19e4420d4ad6ee387'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:14.400327 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-957c00cf-d89f-4951-bb25-ad4a92dda72f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fd542fd6bd34ea19e4420d4ad6ee387'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:14.427507 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-957c00cf-d89f-4951-bb25-ad4a92dda72f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fd542fd6bd34ea19e4420d4ad6ee387'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:14.449254 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2769/5565] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:13:14 2022] DELETE /identity/v3/users/9fd542fd6bd34ea19e4420d4ad6ee387 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:14.451034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a103da2-732d-4cd8-a345-2b330153294f None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:14.451619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a103da2-732d-4cd8-a345-2b330153294f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:14.451983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a103da2-732d-4cd8-a345-2b330153294f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:14.485929 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-5a103da2-732d-4cd8-a345-2b330153294f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:14.487200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5a103da2-732d-4cd8-a345-2b330153294f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:14.635284 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2797/5566] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:14.708990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c00cf-d89f-4951-bb25-ad4a92dda72f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:14.713095 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-957c00cf-d89f-4951-bb25-ad4a92dda72f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:14.733931 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:14.858237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c00cf-d89f-4951-bb25-ad4a92dda72f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:14.869152 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e66b4c-6555-4e1b-9ea5-85f3c3782743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:14.870113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e66b4c-6555-4e1b-9ea5-85f3c3782743 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:14.870669 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e66b4c-6555-4e1b-9ea5-85f3c3782743 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:14.871162 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e66b4c-6555-4e1b-9ea5-85f3c3782743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:14.907428 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e66b4c-6555-4e1b-9ea5-85f3c3782743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:14.909261 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e66b4c-6555-4e1b-9ea5-85f3c3782743 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:14.937910 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2770/5567] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:13:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:13:16.500331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a103da2-732d-4cd8-a345-2b330153294f None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:16.501981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5a103da2-732d-4cd8-a345-2b330153294f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:16.522776 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a103da2-732d-4cd8-a345-2b330153294f None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:16.544654 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ef25b-c287-4a66-b111-52d53a9f8368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:16.546098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ef25b-c287-4a66-b111-52d53a9f8368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:16.546579 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ef25b-c287-4a66-b111-52d53a9f8368 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:16.547025 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ef25b-c287-4a66-b111-52d53a9f8368 admin admin] PATH_INFO: `/v3/projects/8072c27c74cc43bfbf15b394a1b2a340` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:16.551346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ef25b-c287-4a66-b111-52d53a9f8368 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8072c27c74cc43bfbf15b394a1b2a340)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:16.554026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ef25b-c287-4a66-b111-52d53a9f8368 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:16.767488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ac0ef25b-c287-4a66-b111-52d53a9f8368 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8072c27c74cc43bfbf15b394a1b2a340', 'request_id': 'req-ac0ef25b-c287-4a66-b111-52d53a9f8368'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:16.781010 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ac0ef25b-c287-4a66-b111-52d53a9f8368 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8072c27c74cc43bfbf15b394a1b2a340', 'request_id': 'req-ac0ef25b-c287-4a66-b111-52d53a9f8368'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:16.798429 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ac0ef25b-c287-4a66-b111-52d53a9f8368 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8072c27c74cc43bfbf15b394a1b2a340', 'request_id': 'req-ac0ef25b-c287-4a66-b111-52d53a9f8368'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:16.827176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ac0ef25b-c287-4a66-b111-52d53a9f8368 admin admin] The token cache is being invalidate because project 8072c27c74cc43bfbf15b394a1b2a340 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:13:16.828705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ac0ef25b-c287-4a66-b111-52d53a9f8368 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:16.829431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ac0ef25b-c287-4a66-b111-52d53a9f8368 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:16.832959 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2798/5568] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:13:16 2022] DELETE /identity/v3/projects/8072c27c74cc43bfbf15b394a1b2a340 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:16.837938 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e66b4c-6555-4e1b-9ea5-85f3c3782743 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:16.856890 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e66b4c-6555-4e1b-9ea5-85f3c3782743 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:16.985398 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80da5b-4007-4457-9758-956093fe890d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:16.986447 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80da5b-4007-4457-9758-956093fe890d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:16.986918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80da5b-4007-4457-9758-956093fe890d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:16.987389 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80da5b-4007-4457-9758-956093fe890d admin admin] PATH_INFO: `/v3/users/1c98e7e5b2c14862af2a9f269617ec9d` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:16.988809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc80da5b-4007-4457-9758-956093fe890d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c98e7e5b2c14862af2a9f269617ec9d)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:16.991746 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc80da5b-4007-4457-9758-956093fe890d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:17.088231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dc80da5b-4007-4457-9758-956093fe890d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c98e7e5b2c14862af2a9f269617ec9d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:17.090300 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dc80da5b-4007-4457-9758-956093fe890d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c98e7e5b2c14862af2a9f269617ec9d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:17.092984 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dc80da5b-4007-4457-9758-956093fe890d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c98e7e5b2c14862af2a9f269617ec9d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:17.112074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dc80da5b-4007-4457-9758-956093fe890d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c98e7e5b2c14862af2a9f269617ec9d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:17.154062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dc80da5b-4007-4457-9758-956093fe890d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c98e7e5b2c14862af2a9f269617ec9d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:17.211483 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2771/5569] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:13:16 2022] DELETE /identity/v3/users/1c98e7e5b2c14862af2a9f269617ec9d => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:19.156862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ef25b-c287-4a66-b111-52d53a9f8368 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:19.158309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ac0ef25b-c287-4a66-b111-52d53a9f8368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:19.184274 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ef25b-c287-4a66-b111-52d53a9f8368 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:19.352804 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:19.395225 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a77a5-d92f-4337-9722-d4b1a1250069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:19.396032 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a77a5-d92f-4337-9722-d4b1a1250069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:19.396331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a77a5-d92f-4337-9722-d4b1a1250069 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:19.396704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a77a5-d92f-4337-9722-d4b1a1250069 admin admin] PATH_INFO: `/v3/projects/17a70352fb584cbd94d13d7ea978f2aa` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:19.398084 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a77a5-d92f-4337-9722-d4b1a1250069 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17a70352fb584cbd94d13d7ea978f2aa)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:19.400592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a77a5-d92f-4337-9722-d4b1a1250069 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:19.510351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-639a77a5-d92f-4337-9722-d4b1a1250069 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17a70352fb584cbd94d13d7ea978f2aa', 'request_id': 'req-639a77a5-d92f-4337-9722-d4b1a1250069'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:19.519094 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-639a77a5-d92f-4337-9722-d4b1a1250069 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17a70352fb584cbd94d13d7ea978f2aa', 'request_id': 'req-639a77a5-d92f-4337-9722-d4b1a1250069'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:19.535943 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-639a77a5-d92f-4337-9722-d4b1a1250069 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17a70352fb584cbd94d13d7ea978f2aa', 'request_id': 'req-639a77a5-d92f-4337-9722-d4b1a1250069'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:19.553351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-639a77a5-d92f-4337-9722-d4b1a1250069 admin admin] The token cache is being invalidate because project 17a70352fb584cbd94d13d7ea978f2aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:13:19.553788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-639a77a5-d92f-4337-9722-d4b1a1250069 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:19.556252 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-639a77a5-d92f-4337-9722-d4b1a1250069 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:19.560575 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2799/5570] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:13:19 2022] DELETE /identity/v3/projects/17a70352fb584cbd94d13d7ea978f2aa => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:13:19.564200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66695d-44f4-44c2-97c6-9b0daa394eb6 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:19.564700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66695d-44f4-44c2-97c6-9b0daa394eb6 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:19.564965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66695d-44f4-44c2-97c6-9b0daa394eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:19.593315 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-8d66695d-44f4-44c2-97c6-9b0daa394eb6 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:19.596179 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8d66695d-44f4-44c2-97c6-9b0daa394eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:19.668340 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:19.738857 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9aae36-c1bf-411a-8dae-d7513d4cdcac None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:19.739507 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9aae36-c1bf-411a-8dae-d7513d4cdcac None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:19.739842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9aae36-c1bf-411a-8dae-d7513d4cdcac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:19.745328 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2772/5571] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:19.767104 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-8e9aae36-c1bf-411a-8dae-d7513d4cdcac None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:19.769160 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8e9aae36-c1bf-411a-8dae-d7513d4cdcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:19.785868 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66695d-44f4-44c2-97c6-9b0daa394eb6 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:19.792670 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2800/5572] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:19.800677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66695d-44f4-44c2-97c6-9b0daa394eb6 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:19.807398 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294587e-1dee-4a9c-8c17-ccac7f09c530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:19.808506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294587e-1dee-4a9c-8c17-ccac7f09c530 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:19.810261 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294587e-1dee-4a9c-8c17-ccac7f09c530 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:19.810774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294587e-1dee-4a9c-8c17-ccac7f09c530 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:19.811637 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5294587e-1dee-4a9c-8c17-ccac7f09c530 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:13:19.812094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5294587e-1dee-4a9c-8c17-ccac7f09c530 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:19.814008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5294587e-1dee-4a9c-8c17-ccac7f09c530 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:19.833358 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2773/5573] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:13:19.835451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9aae36-c1bf-411a-8dae-d7513d4cdcac None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:19.848443 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9aae36-c1bf-411a-8dae-d7513d4cdcac None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:19.855601 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548a18a-220c-442d-a0e0-8bee0064d38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:19.856587 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548a18a-220c-442d-a0e0-8bee0064d38e admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:19.857013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548a18a-220c-442d-a0e0-8bee0064d38e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:19.857419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548a18a-220c-442d-a0e0-8bee0064d38e admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:19.858424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548a18a-220c-442d-a0e0-8bee0064d38e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:19.860525 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548a18a-220c-442d-a0e0-8bee0064d38e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:19.903865 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2801/5574] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:13:19 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:13:19.907844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294587e-1dee-4a9c-8c17-ccac7f09c530 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:19.920540 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294587e-1dee-4a9c-8c17-ccac7f09c530 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:19.996833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419597f-7e6c-437d-8f55-e58e12ce7a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:19.997483 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419597f-7e6c-437d-8f55-e58e12ce7a2b admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:19.997818 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419597f-7e6c-437d-8f55-e58e12ce7a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:19.998106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419597f-7e6c-437d-8f55-e58e12ce7a2b admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:19.998824 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419597f-7e6c-437d-8f55-e58e12ce7a2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:20.001377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419597f-7e6c-437d-8f55-e58e12ce7a2b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:20.036619 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2774/5575] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:13:19 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:13:20.038413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548a18a-220c-442d-a0e0-8bee0064d38e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:20.059210 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548a18a-220c-442d-a0e0-8bee0064d38e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:20.064731 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02000c6d-1adb-493f-83a9-c71bcae1f87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:20.065495 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02000c6d-1adb-493f-83a9-c71bcae1f87d admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:20.066069 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02000c6d-1adb-493f-83a9-c71bcae1f87d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:20.066461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02000c6d-1adb-493f-83a9-c71bcae1f87d admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:20.067305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02000c6d-1adb-493f-83a9-c71bcae1f87d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:20.068972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02000c6d-1adb-493f-83a9-c71bcae1f87d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:20.084631 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2802/5576] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:13:20.086836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419597f-7e6c-437d-8f55-e58e12ce7a2b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:20.098193 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419597f-7e6c-437d-8f55-e58e12ce7a2b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:20.103173 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df06a8-1d3f-45a2-a145-a4252ab662ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:20.103788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df06a8-1d3f-45a2-a145-a4252ab662ad admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:20.104094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df06a8-1d3f-45a2-a145-a4252ab662ad admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:20.104426 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df06a8-1d3f-45a2-a145-a4252ab662ad admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:20.105071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df06a8-1d3f-45a2-a145-a4252ab662ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:20.106862 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df06a8-1d3f-45a2-a145-a4252ab662ad admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:20.120363 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2775/5577] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:13:20.124553 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02000c6d-1adb-493f-83a9-c71bcae1f87d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:20.137768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02000c6d-1adb-493f-83a9-c71bcae1f87d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:20.145709 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee94d6-933d-4557-8d58-6222a69293ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:20.146437 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee94d6-933d-4557-8d58-6222a69293ce admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:20.146738 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee94d6-933d-4557-8d58-6222a69293ce admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:20.147015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee94d6-933d-4557-8d58-6222a69293ce admin admin] PATH_INFO: `/v3/projects/05ab4198c8af409c8d3de6f8925dca3e/users/87831db38fc14ff980161f21a37215e4/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:20.164084 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee94d6-933d-4557-8d58-6222a69293ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=05ab4198c8af409c8d3de6f8925dca3e, user_id=87831db38fc14ff980161f21a37215e4, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:20.166872 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee94d6-933d-4557-8d58-6222a69293ce admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:20.190285 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2803/5578] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:13:20 2022] PUT /identity/v3/projects/05ab4198c8af409c8d3de6f8925dca3e/users/87831db38fc14ff980161f21a37215e4/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:20.204582 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f9f0a-2c30-45f2-ba0f-f34ef13a56b3 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:20.204921 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f9f0a-2c30-45f2-ba0f-f34ef13a56b3 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:20.205134 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f9f0a-2c30-45f2-ba0f-f34ef13a56b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:20.239475 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-870f9f0a-2c30-45f2-ba0f-f34ef13a56b3 None None] MFA Rules not processed for user `87831db38fc14ff980161f21a37215e4`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:20.241077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-870f9f0a-2c30-45f2-ba0f-f34ef13a56b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:20.389378 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2776/5579] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:20.393751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee94d6-933d-4557-8d58-6222a69293ce admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:20.466502 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee94d6-933d-4557-8d58-6222a69293ce admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:20.472901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e14d1-1fb9-48f6-92fd-03632661874d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:20.473512 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e14d1-1fb9-48f6-92fd-03632661874d admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:20.473840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e14d1-1fb9-48f6-92fd-03632661874d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:20.474114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e14d1-1fb9-48f6-92fd-03632661874d admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:20.475091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e14d1-1fb9-48f6-92fd-03632661874d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:20.477045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e14d1-1fb9-48f6-92fd-03632661874d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:20.503325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:20.518335 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f9f0a-2c30-45f2-ba0f-f34ef13a56b3 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:20.521217 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2804/5580] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:13:20 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:13:20.533151 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f9f0a-2c30-45f2-ba0f-f34ef13a56b3 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:20.575507 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:20.619472 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ea617-f7ce-4f38-98f4-9cab83867ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:20.620187 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ea617-f7ce-4f38-98f4-9cab83867ebf admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:20.620671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ea617-f7ce-4f38-98f4-9cab83867ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:20.621011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ea617-f7ce-4f38-98f4-9cab83867ebf admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:20.621705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ea617-f7ce-4f38-98f4-9cab83867ebf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:20.623719 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ea617-f7ce-4f38-98f4-9cab83867ebf admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:20.657168 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2777/5581] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:13:20 2022] POST /identity/v3/users => generated 299 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:13:20.658467 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e14d1-1fb9-48f6-92fd-03632661874d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:20.688344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e14d1-1fb9-48f6-92fd-03632661874d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:20.711098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870b906-bb0e-44cf-8331-a48f82edeb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:20.712348 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870b906-bb0e-44cf-8331-a48f82edeb13 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:20.712649 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870b906-bb0e-44cf-8331-a48f82edeb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:20.713007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870b906-bb0e-44cf-8331-a48f82edeb13 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:20.715354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870b906-bb0e-44cf-8331-a48f82edeb13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:20.721209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870b906-bb0e-44cf-8331-a48f82edeb13 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:20.741292 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ea617-f7ce-4f38-98f4-9cab83867ebf admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:20.748467 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2805/5582] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:13:20.754686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ea617-f7ce-4f38-98f4-9cab83867ebf admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:20.764697 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ad8bb-38ea-49d4-90b2-34d73db46579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:20.765427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ad8bb-38ea-49d4-90b2-34d73db46579 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:20.765641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ad8bb-38ea-49d4-90b2-34d73db46579 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:20.765920 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ad8bb-38ea-49d4-90b2-34d73db46579 admin admin] PATH_INFO: `/v3/projects/dc2b6e9943f54274b51351a71262a599/users/efb74772a93e4d1193fabc2cc49867a6/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:20.793052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ad8bb-38ea-49d4-90b2-34d73db46579 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc2b6e9943f54274b51351a71262a599, user_id=efb74772a93e4d1193fabc2cc49867a6, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:20.796869 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ad8bb-38ea-49d4-90b2-34d73db46579 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:20.822512 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870b906-bb0e-44cf-8331-a48f82edeb13 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:20.822783 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2778/5583] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:13:20 2022] PUT /identity/v3/projects/dc2b6e9943f54274b51351a71262a599/users/efb74772a93e4d1193fabc2cc49867a6/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:20.833816 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870b906-bb0e-44cf-8331-a48f82edeb13 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:20.937716 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38efad-9502-4637-becf-d22250eca621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:20.938461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38efad-9502-4637-becf-d22250eca621 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:20.938860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38efad-9502-4637-becf-d22250eca621 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:20.939232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38efad-9502-4637-becf-d22250eca621 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:20.940166 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38efad-9502-4637-becf-d22250eca621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:20.942262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38efad-9502-4637-becf-d22250eca621 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:20.963065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ad8bb-38ea-49d4-90b2-34d73db46579 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:20.970126 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2806/5584] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:13:20.977732 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ad8bb-38ea-49d4-90b2-34d73db46579 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:20.984293 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af54064-09d7-4124-b829-309b71b9ea7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:20.985076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af54064-09d7-4124-b829-309b71b9ea7d admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:20.985538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af54064-09d7-4124-b829-309b71b9ea7d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:20.985848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af54064-09d7-4124-b829-309b71b9ea7d admin admin] PATH_INFO: `/v3/projects/dc2b6e9943f54274b51351a71262a599/users/efb74772a93e4d1193fabc2cc49867a6/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:20.988097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af54064-09d7-4124-b829-309b71b9ea7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc2b6e9943f54274b51351a71262a599, user_id=efb74772a93e4d1193fabc2cc49867a6, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:20.991995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af54064-09d7-4124-b829-309b71b9ea7d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:21.026077 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2779/5585] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:13:20 2022] PUT /identity/v3/projects/dc2b6e9943f54274b51351a71262a599/users/efb74772a93e4d1193fabc2cc49867a6/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:21.030464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e16fb-7952-4e7c-b0bb-4e02c0d49cbc None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:21.031448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e16fb-7952-4e7c-b0bb-4e02c0d49cbc None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:21.031788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e16fb-7952-4e7c-b0bb-4e02c0d49cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:21.087628 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-212e16fb-7952-4e7c-b0bb-4e02c0d49cbc None None] MFA Rules not processed for user `efb74772a93e4d1193fabc2cc49867a6`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:21.088974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-212e16fb-7952-4e7c-b0bb-4e02c0d49cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:21.202607 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2807/5586] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:21 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:21.233268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af54064-09d7-4124-b829-309b71b9ea7d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:21.235856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8af54064-09d7-4124-b829-309b71b9ea7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:21.343960 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af54064-09d7-4124-b829-309b71b9ea7d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:21.352088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955325d8-2c5f-4e35-a210-1883fcf95378 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:21.356165 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955325d8-2c5f-4e35-a210-1883fcf95378 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:21.356785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955325d8-2c5f-4e35-a210-1883fcf95378 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:21.359291 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955325d8-2c5f-4e35-a210-1883fcf95378 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:21.458927 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955325d8-2c5f-4e35-a210-1883fcf95378 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:21.460283 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955325d8-2c5f-4e35-a210-1883fcf95378 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:21.475273 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2780/5587] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:13:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:13:22.174631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54baa588-3ebf-40d4-a47a-a9e5867b8f22 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:22.174923 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54baa588-3ebf-40d4-a47a-a9e5867b8f22 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:22.175204 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54baa588-3ebf-40d4-a47a-a9e5867b8f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:22.237897 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-54baa588-3ebf-40d4-a47a-a9e5867b8f22 None None] MFA Rules not processed for user `950a8bbfd820444b9f85976f6609c864`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:22.240753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-54baa588-3ebf-40d4-a47a-a9e5867b8f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:22.363137 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:22.382137 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ff1d3-071b-4146-b00e-43baca6f199f None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:22.383428 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ff1d3-071b-4146-b00e-43baca6f199f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:22.383994 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ff1d3-071b-4146-b00e-43baca6f199f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:22.404541 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2808/5588] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:22 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:22.431445 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-5b1ff1d3-071b-4146-b00e-43baca6f199f None None] MFA Rules not processed for user `950a8bbfd820444b9f85976f6609c864`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:22.432685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5b1ff1d3-071b-4146-b00e-43baca6f199f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:22.445643 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2781/5589] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:22 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:13:22.457788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54baa588-3ebf-40d4-a47a-a9e5867b8f22 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:22.460480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-54baa588-3ebf-40d4-a47a-a9e5867b8f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:22.646821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54baa588-3ebf-40d4-a47a-a9e5867b8f22 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:22.654164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb2343-3e41-4c18-997c-eb53c4f3b4ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:22.654829 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb2343-3e41-4c18-997c-eb53c4f3b4ae service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:22.655181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb2343-3e41-4c18-997c-eb53c4f3b4ae service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:22.655534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb2343-3e41-4c18-997c-eb53c4f3b4ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:22.672982 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb2343-3e41-4c18-997c-eb53c4f3b4ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:22.674445 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb2343-3e41-4c18-997c-eb53c4f3b4ae service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:22.716046 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2809/5590] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:13:22 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:13:22.945372 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f67975-2943-46ec-a293-e5ee3d826168 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:22.946420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f67975-2943-46ec-a293-e5ee3d826168 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:22.947267 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f67975-2943-46ec-a293-e5ee3d826168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:22.998461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-14f67975-2943-46ec-a293-e5ee3d826168 None None] MFA Rules not processed for user `1d7b9e27983940dcaf0e92f62273c588`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:23.000546 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-14f67975-2943-46ec-a293-e5ee3d826168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:23.072028 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:23.155025 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2782/5591] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:23.422186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb2343-3e41-4c18-997c-eb53c4f3b4ae service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:23.424529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-84bb2343-3e41-4c18-997c-eb53c4f3b4ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:23.451148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb2343-3e41-4c18-997c-eb53c4f3b4ae service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:23.456745 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f1802-edb8-4688-a438-d25452c44f39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:23.457503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f1802-edb8-4688-a438-d25452c44f39 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:23.457788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f1802-edb8-4688-a438-d25452c44f39 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:23.458163 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f1802-edb8-4688-a438-d25452c44f39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:23.480821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f1802-edb8-4688-a438-d25452c44f39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:23.495376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f1802-edb8-4688-a438-d25452c44f39 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:23.530657 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2810/5592] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:13:23 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:13:33.135666 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=13 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:33.505543 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=40 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:34.978082 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f67975-2943-46ec-a293-e5ee3d826168 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:34.980175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-14f67975-2943-46ec-a293-e5ee3d826168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:35.074329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f67975-2943-46ec-a293-e5ee3d826168 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:35.085882 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469dc1c8-f35b-45c9-8c1c-c8141294e768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:35.086558 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dc1c8-f35b-45c9-8c1c-c8141294e768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:35.087206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dc1c8-f35b-45c9-8c1c-c8141294e768 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:35.087570 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dc1c8-f35b-45c9-8c1c-c8141294e768 admin admin] PATH_INFO: `/v3/users/267a4d7dbdc54b8ab7f35fe093300075` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:35.088816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469dc1c8-f35b-45c9-8c1c-c8141294e768 admin admin] RBAC: Authorizing `identity:delete_user(user_id=267a4d7dbdc54b8ab7f35fe093300075)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:35.093639 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469dc1c8-f35b-45c9-8c1c-c8141294e768 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:35.168810 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-469dc1c8-f35b-45c9-8c1c-c8141294e768 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '267a4d7dbdc54b8ab7f35fe093300075'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:35.169606 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-469dc1c8-f35b-45c9-8c1c-c8141294e768 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '267a4d7dbdc54b8ab7f35fe093300075'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:35.170223 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-469dc1c8-f35b-45c9-8c1c-c8141294e768 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '267a4d7dbdc54b8ab7f35fe093300075'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:35.181659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-469dc1c8-f35b-45c9-8c1c-c8141294e768 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '267a4d7dbdc54b8ab7f35fe093300075'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:35.201481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-469dc1c8-f35b-45c9-8c1c-c8141294e768 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '267a4d7dbdc54b8ab7f35fe093300075'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:35.218978 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2783/5593] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:13:34 2022] DELETE /identity/v3/users/267a4d7dbdc54b8ab7f35fe093300075 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:13:35.223493 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02ee06-7928-42b3-9a74-368953f4140d None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:35.224031 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02ee06-7928-42b3-9a74-368953f4140d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:35.224151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02ee06-7928-42b3-9a74-368953f4140d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:35.250978 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-4b02ee06-7928-42b3-9a74-368953f4140d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:35.252303 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4b02ee06-7928-42b3-9a74-368953f4140d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:35.336883 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2811/5594] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:35.388177 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469dc1c8-f35b-45c9-8c1c-c8141294e768 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:35.392117 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-469dc1c8-f35b-45c9-8c1c-c8141294e768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:35.508558 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469dc1c8-f35b-45c9-8c1c-c8141294e768 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:35.513383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4ed71-4ba4-4f82-ad66-739e2154834c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:35.514523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4ed71-4ba4-4f82-ad66-739e2154834c service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:35.515282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4ed71-4ba4-4f82-ad66-739e2154834c service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:35.515661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4ed71-4ba4-4f82-ad66-739e2154834c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:35.530207 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f4ed71-4ba4-4f82-ad66-739e2154834c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:35.532015 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f4ed71-4ba4-4f82-ad66-739e2154834c service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:35.552047 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2784/5595] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:13:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:13:37.064797 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b02ee06-7928-42b3-9a74-368953f4140d None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:37.067457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4b02ee06-7928-42b3-9a74-368953f4140d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:37.087367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b02ee06-7928-42b3-9a74-368953f4140d None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:37.096164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf80c55-6da6-4729-a157-fed5f72d7e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:37.096921 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf80c55-6da6-4729-a157-fed5f72d7e66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:37.097341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf80c55-6da6-4729-a157-fed5f72d7e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:37.097714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf80c55-6da6-4729-a157-fed5f72d7e66 admin admin] PATH_INFO: `/v3/projects/769ad1142bbf4919a98f3869e29707e8` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:37.099106 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf80c55-6da6-4729-a157-fed5f72d7e66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=769ad1142bbf4919a98f3869e29707e8)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:37.102213 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf80c55-6da6-4729-a157-fed5f72d7e66 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:37.196205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-faf80c55-6da6-4729-a157-fed5f72d7e66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '769ad1142bbf4919a98f3869e29707e8', 'request_id': 'req-faf80c55-6da6-4729-a157-fed5f72d7e66'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:37.203779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-faf80c55-6da6-4729-a157-fed5f72d7e66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '769ad1142bbf4919a98f3869e29707e8', 'request_id': 'req-faf80c55-6da6-4729-a157-fed5f72d7e66'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:37.213900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-faf80c55-6da6-4729-a157-fed5f72d7e66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '769ad1142bbf4919a98f3869e29707e8', 'request_id': 'req-faf80c55-6da6-4729-a157-fed5f72d7e66'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:37.246962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-faf80c55-6da6-4729-a157-fed5f72d7e66 admin admin] The token cache is being invalidate because project 769ad1142bbf4919a98f3869e29707e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:13:37.247329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-faf80c55-6da6-4729-a157-fed5f72d7e66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:37.248023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-faf80c55-6da6-4729-a157-fed5f72d7e66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:37.253557 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2812/5596] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:13:37 2022] DELETE /identity/v3/projects/769ad1142bbf4919a98f3869e29707e8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:37.257190 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14af64-cc2c-4f01-82ec-c59426c74089 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:37.258145 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14af64-cc2c-4f01-82ec-c59426c74089 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:37.258262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14af64-cc2c-4f01-82ec-c59426c74089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:37.292534 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-5a14af64-cc2c-4f01-82ec-c59426c74089 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:37.294330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5a14af64-cc2c-4f01-82ec-c59426c74089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:37.321479 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:37.401074 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2785/5597] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:37.405546 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b7acc-2dc4-47d3-a010-69fc35a18b03 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:37.406058 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b7acc-2dc4-47d3-a010-69fc35a18b03 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:37.406442 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b7acc-2dc4-47d3-a010-69fc35a18b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:37.476435 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-424b7acc-2dc4-47d3-a010-69fc35a18b03 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:37.480563 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-424b7acc-2dc4-47d3-a010-69fc35a18b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:37.515434 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2813/5598] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:37.519335 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14af64-cc2c-4f01-82ec-c59426c74089 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:37.548609 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14af64-cc2c-4f01-82ec-c59426c74089 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:37.566277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b91867-5e0a-4329-acdd-e0144ff4ef58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:37.566899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b91867-5e0a-4329-acdd-e0144ff4ef58 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:37.567190 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b91867-5e0a-4329-acdd-e0144ff4ef58 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:37.567465 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b91867-5e0a-4329-acdd-e0144ff4ef58 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:37.568119 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b91867-5e0a-4329-acdd-e0144ff4ef58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:13:37.568429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b91867-5e0a-4329-acdd-e0144ff4ef58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:37.571488 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b91867-5e0a-4329-acdd-e0144ff4ef58 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:37.602621 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2786/5599] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:13:37.602948 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b7acc-2dc4-47d3-a010-69fc35a18b03 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:37.615140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b7acc-2dc4-47d3-a010-69fc35a18b03 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:37.622413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92ffd5-c788-42dc-8d0b-7e8caac3a738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:37.623018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92ffd5-c788-42dc-8d0b-7e8caac3a738 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:37.623800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92ffd5-c788-42dc-8d0b-7e8caac3a738 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:37.624230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92ffd5-c788-42dc-8d0b-7e8caac3a738 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:37.625023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92ffd5-c788-42dc-8d0b-7e8caac3a738 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:37.628526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92ffd5-c788-42dc-8d0b-7e8caac3a738 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:37.697366 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2814/5600] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:13:37 2022] POST /identity/v3/projects => generated 379 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:13:37.699902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b91867-5e0a-4329-acdd-e0144ff4ef58 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:37.713265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b91867-5e0a-4329-acdd-e0144ff4ef58 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:37.890191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145b4c8-9e53-4e20-834c-695cb13ff499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:37.890847 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145b4c8-9e53-4e20-834c-695cb13ff499 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:37.896141 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145b4c8-9e53-4e20-834c-695cb13ff499 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:37.896494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145b4c8-9e53-4e20-834c-695cb13ff499 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:37.897245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5145b4c8-9e53-4e20-834c-695cb13ff499 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:37.899326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5145b4c8-9e53-4e20-834c-695cb13ff499 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:37.949080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92ffd5-c788-42dc-8d0b-7e8caac3a738 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:37.949358 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2787/5601] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:13:37 2022] POST /identity/v3/users => generated 290 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:13:37.963986 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92ffd5-c788-42dc-8d0b-7e8caac3a738 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:37.971415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b9a92-8a0d-470d-9d7c-b3c3793eed90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:37.972232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b9a92-8a0d-470d-9d7c-b3c3793eed90 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:37.973729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b9a92-8a0d-470d-9d7c-b3c3793eed90 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:37.974184 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b9a92-8a0d-470d-9d7c-b3c3793eed90 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:37.975105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b9a92-8a0d-470d-9d7c-b3c3793eed90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:37.978045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b9a92-8a0d-470d-9d7c-b3c3793eed90 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:37.994887 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2815/5602] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:13:38.000459 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145b4c8-9e53-4e20-834c-695cb13ff499 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:38.024606 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145b4c8-9e53-4e20-834c-695cb13ff499 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:38.039128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781d08f-cd6a-4554-b64d-93179b806bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:38.039128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781d08f-cd6a-4554-b64d-93179b806bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:38.039128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781d08f-cd6a-4554-b64d-93179b806bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:38.039128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781d08f-cd6a-4554-b64d-93179b806bf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:38.039611 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0781d08f-cd6a-4554-b64d-93179b806bf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:38.039611 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0781d08f-cd6a-4554-b64d-93179b806bf7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:38.054785 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2788/5603] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:13:38.056191 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b9a92-8a0d-470d-9d7c-b3c3793eed90 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:38.080525 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b9a92-8a0d-470d-9d7c-b3c3793eed90 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:38.105360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eadcbc1-0eda-4d98-a072-e1244399a431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:38.106155 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadcbc1-0eda-4d98-a072-e1244399a431 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:38.106306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadcbc1-0eda-4d98-a072-e1244399a431 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:38.106816 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadcbc1-0eda-4d98-a072-e1244399a431 admin admin] PATH_INFO: `/v3/projects/e69cee4ca1a24417ae7c05d9e58a5933/users/58bfcb7788f34fb9962efd02143ee3ec/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:38.128325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eadcbc1-0eda-4d98-a072-e1244399a431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e69cee4ca1a24417ae7c05d9e58a5933, user_id=58bfcb7788f34fb9962efd02143ee3ec, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:38.134060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eadcbc1-0eda-4d98-a072-e1244399a431 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:38.159405 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2816/5604] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:13:38 2022] PUT /identity/v3/projects/e69cee4ca1a24417ae7c05d9e58a5933/users/58bfcb7788f34fb9962efd02143ee3ec/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:38.168983 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a062553-821d-418f-b886-c02c23a4a365 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:38.169789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a062553-821d-418f-b886-c02c23a4a365 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:38.171645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a062553-821d-418f-b886-c02c23a4a365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:38.214088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-2a062553-821d-418f-b886-c02c23a4a365 None None] MFA Rules not processed for user `58bfcb7788f34fb9962efd02143ee3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:38.215533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2a062553-821d-418f-b886-c02c23a4a365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:38.292155 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2789/5605] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:38.345321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eadcbc1-0eda-4d98-a072-e1244399a431 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:38.347721 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2eadcbc1-0eda-4d98-a072-e1244399a431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:38.373435 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:38.431152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eadcbc1-0eda-4d98-a072-e1244399a431 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:38.435461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8d317-406c-4bc8-92d3-25293d858473 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:38.436813 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8d317-406c-4bc8-92d3-25293d858473 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:38.436813 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8d317-406c-4bc8-92d3-25293d858473 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:38.436813 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8d317-406c-4bc8-92d3-25293d858473 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:38.447470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8d317-406c-4bc8-92d3-25293d858473 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:38.449481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8d317-406c-4bc8-92d3-25293d858473 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:38.460131 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2817/5606] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:13:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:13:43.001866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0ccca-b38e-483e-b121-6e04d0d89f8e None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:43.002469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0ccca-b38e-483e-b121-6e04d0d89f8e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:43.002469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0ccca-b38e-483e-b121-6e04d0d89f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:43.039628 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-fbb0ccca-b38e-483e-b121-6e04d0d89f8e None None] MFA Rules not processed for user `a6c953ff2f774041a7d50f53033ee124`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:43.041206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-fbb0ccca-b38e-483e-b121-6e04d0d89f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:43.098232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:43.169098 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2790/5607] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:46.127603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8d317-406c-4bc8-92d3-25293d858473 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:46.133014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a6d8d317-406c-4bc8-92d3-25293d858473 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:46.338266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8d317-406c-4bc8-92d3-25293d858473 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:46.354388 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1cf0e-30f8-46d0-a5d2-5b9b250ad500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:46.355084 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1cf0e-30f8-46d0-a5d2-5b9b250ad500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:46.355360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1cf0e-30f8-46d0-a5d2-5b9b250ad500 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:46.358045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1cf0e-30f8-46d0-a5d2-5b9b250ad500 admin admin] PATH_INFO: `/v3/users/d2681b0409c64aafbd941c30db6485e5` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:46.360351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab1cf0e-30f8-46d0-a5d2-5b9b250ad500 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2681b0409c64aafbd941c30db6485e5)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:46.379320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab1cf0e-30f8-46d0-a5d2-5b9b250ad500 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:46.508744 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4ab1cf0e-30f8-46d0-a5d2-5b9b250ad500 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2681b0409c64aafbd941c30db6485e5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:46.519399 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4ab1cf0e-30f8-46d0-a5d2-5b9b250ad500 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2681b0409c64aafbd941c30db6485e5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:46.520117 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4ab1cf0e-30f8-46d0-a5d2-5b9b250ad500 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2681b0409c64aafbd941c30db6485e5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:46.520732 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4ab1cf0e-30f8-46d0-a5d2-5b9b250ad500 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2681b0409c64aafbd941c30db6485e5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:46.533568 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4ab1cf0e-30f8-46d0-a5d2-5b9b250ad500 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2681b0409c64aafbd941c30db6485e5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:46.563296 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2818/5608] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:13:46 2022] DELETE /identity/v3/users/d2681b0409c64aafbd941c30db6485e5 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:46.568436 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20403ce7-a484-4690-9604-0e0225b6e540 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:46.570311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20403ce7-a484-4690-9604-0e0225b6e540 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:46.570685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20403ce7-a484-4690-9604-0e0225b6e540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:46.607654 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-20403ce7-a484-4690-9604-0e0225b6e540 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:46.610470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-20403ce7-a484-4690-9604-0e0225b6e540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:46.747336 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2791/5609] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:46.888452 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1cf0e-30f8-46d0-a5d2-5b9b250ad500 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:46.889959 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4ab1cf0e-30f8-46d0-a5d2-5b9b250ad500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:46.947105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:46.991808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1cf0e-30f8-46d0-a5d2-5b9b250ad500 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:47.033765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78d80a-7ddb-4ec6-b9b0-637f701a9e1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:47.037307 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78d80a-7ddb-4ec6-b9b0-637f701a9e1d service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:47.040642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78d80a-7ddb-4ec6-b9b0-637f701a9e1d service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:47.041151 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20403ce7-a484-4690-9604-0e0225b6e540 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:47.041312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78d80a-7ddb-4ec6-b9b0-637f701a9e1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:47.042980 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-20403ce7-a484-4690-9604-0e0225b6e540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:47.062934 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20403ce7-a484-4690-9604-0e0225b6e540 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:47.071122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78d80a-7ddb-4ec6-b9b0-637f701a9e1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:47.076697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78d80a-7ddb-4ec6-b9b0-637f701a9e1d service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:47.077750 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c57d29-7af6-443d-b800-ffc368a04385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:47.078803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c57d29-7af6-443d-b800-ffc368a04385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:47.078803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c57d29-7af6-443d-b800-ffc368a04385 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:47.079026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c57d29-7af6-443d-b800-ffc368a04385 admin admin] PATH_INFO: `/v3/users/7c8e09e73e8e47c78170f95b7b4ce0cc` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:47.083857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c57d29-7af6-443d-b800-ffc368a04385 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c8e09e73e8e47c78170f95b7b4ce0cc)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:47.088785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c57d29-7af6-443d-b800-ffc368a04385 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:47.115270 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2819/5610] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:13:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:13:47.204636 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-84c57d29-7af6-443d-b800-ffc368a04385 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c8e09e73e8e47c78170f95b7b4ce0cc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:47.206706 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-84c57d29-7af6-443d-b800-ffc368a04385 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c8e09e73e8e47c78170f95b7b4ce0cc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:47.208820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-84c57d29-7af6-443d-b800-ffc368a04385 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c8e09e73e8e47c78170f95b7b4ce0cc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:47.227322 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-84c57d29-7af6-443d-b800-ffc368a04385 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c8e09e73e8e47c78170f95b7b4ce0cc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:47.249223 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-84c57d29-7af6-443d-b800-ffc368a04385 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c8e09e73e8e47c78170f95b7b4ce0cc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:47.268394 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2792/5611] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:13:47 2022] DELETE /identity/v3/users/7c8e09e73e8e47c78170f95b7b4ce0cc => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:47.273120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c0613-75b6-4af5-9c9e-1c7716a95832 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:47.273736 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c0613-75b6-4af5-9c9e-1c7716a95832 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:47.274219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c0613-75b6-4af5-9c9e-1c7716a95832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:47.339821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-085c0613-75b6-4af5-9c9e-1c7716a95832 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:47.344655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-085c0613-75b6-4af5-9c9e-1c7716a95832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:47.470629 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2820/5612] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:47.521073 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c57d29-7af6-443d-b800-ffc368a04385 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:47.523023 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-84c57d29-7af6-443d-b800-ffc368a04385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:47.623858 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:47.633333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d7718-7e3b-4a9b-8975-1592160e69eb None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:47.633663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d7718-7e3b-4a9b-8975-1592160e69eb None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:47.633905 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d7718-7e3b-4a9b-8975-1592160e69eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:47.655968 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c57d29-7af6-443d-b800-ffc368a04385 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:47.661238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3527d-4565-40ab-93c0-e9898b2610bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:47.661916 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3527d-4565-40ab-93c0-e9898b2610bd service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:47.662190 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3527d-4565-40ab-93c0-e9898b2610bd service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:47.662465 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3527d-4565-40ab-93c0-e9898b2610bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:47.675522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3527d-4565-40ab-93c0-e9898b2610bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:47.676620 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3527d-4565-40ab-93c0-e9898b2610bd service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:47.689280 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2793/5613] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:13:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:13:47.690534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-677d7718-7e3b-4a9b-8975-1592160e69eb None None] MFA Rules not processed for user `a6c953ff2f774041a7d50f53033ee124`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:47.691824 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-677d7718-7e3b-4a9b-8975-1592160e69eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:47.837212 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2821/5614] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:47.842372 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3527d-4565-40ab-93c0-e9898b2610bd service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:47.845030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-16e3527d-4565-40ab-93c0-e9898b2610bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:47.867321 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3527d-4565-40ab-93c0-e9898b2610bd service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:47.876345 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc2f60-9f95-403e-80c7-178cbec0d265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:47.877572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc2f60-9f95-403e-80c7-178cbec0d265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:47.878184 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc2f60-9f95-403e-80c7-178cbec0d265 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:47.878695 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc2f60-9f95-403e-80c7-178cbec0d265 admin admin] PATH_INFO: `/v3/projects/873358627fc649f99fb067524ba09439` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:47.880801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc2f60-9f95-403e-80c7-178cbec0d265 admin admin] RBAC: Authorizing `identity:delete_project(project_id=873358627fc649f99fb067524ba09439)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:47.884214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc2f60-9f95-403e-80c7-178cbec0d265 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:47.962382 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-51cc2f60-9f95-403e-80c7-178cbec0d265 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '873358627fc649f99fb067524ba09439', 'request_id': 'req-51cc2f60-9f95-403e-80c7-178cbec0d265'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:47.973887 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-51cc2f60-9f95-403e-80c7-178cbec0d265 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '873358627fc649f99fb067524ba09439', 'request_id': 'req-51cc2f60-9f95-403e-80c7-178cbec0d265'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:48.002840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-51cc2f60-9f95-403e-80c7-178cbec0d265 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '873358627fc649f99fb067524ba09439', 'request_id': 'req-51cc2f60-9f95-403e-80c7-178cbec0d265'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:48.024321 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-51cc2f60-9f95-403e-80c7-178cbec0d265 admin admin] The token cache is being invalidate because project 873358627fc649f99fb067524ba09439 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:13:48.024625 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-51cc2f60-9f95-403e-80c7-178cbec0d265 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:48.026944 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-51cc2f60-9f95-403e-80c7-178cbec0d265 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:48.034245 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2794/5615] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:13:47 2022] DELETE /identity/v3/projects/873358627fc649f99fb067524ba09439 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:48.038414 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd5225-4c1a-463d-8c44-912092abe2f5 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:48.039759 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd5225-4c1a-463d-8c44-912092abe2f5 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:48.040164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd5225-4c1a-463d-8c44-912092abe2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:48.076931 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-68bd5225-4c1a-463d-8c44-912092abe2f5 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:48.079969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-68bd5225-4c1a-463d-8c44-912092abe2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:48.099127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc2f60-9f95-403e-80c7-178cbec0d265 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:48.102177 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-51cc2f60-9f95-403e-80c7-178cbec0d265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:48.208368 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc2f60-9f95-403e-80c7-178cbec0d265 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:48.212785 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2822/5616] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:48.219865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e79601-17b8-4639-9d74-3a9bd696c22a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:48.220653 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e79601-17b8-4639-9d74-3a9bd696c22a service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:48.221452 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e79601-17b8-4639-9d74-3a9bd696c22a service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:48.221827 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e79601-17b8-4639-9d74-3a9bd696c22a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:48.236602 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-20e79601-17b8-4639-9d74-3a9bd696c22a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:48.305588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd5225-4c1a-463d-8c44-912092abe2f5 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:48.308654 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-68bd5225-4c1a-463d-8c44-912092abe2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:48.329759 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd5225-4c1a-463d-8c44-912092abe2f5 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:48.366604 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4c1e5-1fcd-439f-9510-53e4224d02a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:48.371243 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4c1e5-1fcd-439f-9510-53e4224d02a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:48.372780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4c1e5-1fcd-439f-9510-53e4224d02a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:48.373062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4c1e5-1fcd-439f-9510-53e4224d02a3 admin admin] PATH_INFO: `/v3/projects/25c11f2f07274b68ac781aeec6af3b19` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:48.377629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4c1e5-1fcd-439f-9510-53e4224d02a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25c11f2f07274b68ac781aeec6af3b19)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:48.386023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4c1e5-1fcd-439f-9510-53e4224d02a3 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:48.408356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e79601-17b8-4639-9d74-3a9bd696c22a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:48.410142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e79601-17b8-4639-9d74-3a9bd696c22a service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:48.443522 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2795/5617] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:13:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:13:48.448254 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307e6ff-dc9f-4af1-a41f-a4ac2286a74f None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:48.448628 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307e6ff-dc9f-4af1-a41f-a4ac2286a74f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:48.449143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307e6ff-dc9f-4af1-a41f-a4ac2286a74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:48.456016 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:48.459030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:48.486859 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-91c4c1e5-1fcd-439f-9510-53e4224d02a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25c11f2f07274b68ac781aeec6af3b19', 'request_id': 'req-91c4c1e5-1fcd-439f-9510-53e4224d02a3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:48.487569 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d307e6ff-dc9f-4af1-a41f-a4ac2286a74f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:48.491635 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d307e6ff-dc9f-4af1-a41f-a4ac2286a74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:48.493531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-91c4c1e5-1fcd-439f-9510-53e4224d02a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25c11f2f07274b68ac781aeec6af3b19', 'request_id': 'req-91c4c1e5-1fcd-439f-9510-53e4224d02a3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:48.509837 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-91c4c1e5-1fcd-439f-9510-53e4224d02a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25c11f2f07274b68ac781aeec6af3b19', 'request_id': 'req-91c4c1e5-1fcd-439f-9510-53e4224d02a3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:48.533700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-91c4c1e5-1fcd-439f-9510-53e4224d02a3 admin admin] The token cache is being invalidate because project 25c11f2f07274b68ac781aeec6af3b19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:13:48.534716 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-91c4c1e5-1fcd-439f-9510-53e4224d02a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:48.535635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-91c4c1e5-1fcd-439f-9510-53e4224d02a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:48.539444 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2823/5618] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:13:48 2022] DELETE /identity/v3/projects/25c11f2f07274b68ac781aeec6af3b19 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:13:48.544307 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8c144-334a-48a8-84fc-7139e8a51836 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:48.545785 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8c144-334a-48a8-84fc-7139e8a51836 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:48.546279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8c144-334a-48a8-84fc-7139e8a51836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:48.581371 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-8fc8c144-334a-48a8-84fc-7139e8a51836 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:48.583620 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8fc8c144-334a-48a8-84fc-7139e8a51836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:48.682600 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2796/5619] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:48.683727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307e6ff-dc9f-4af1-a41f-a4ac2286a74f None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:48.689467 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2824/5620] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:48.691463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac3596-7d23-4b68-ac84-213161bf1df4 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:48.691463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac3596-7d23-4b68-ac84-213161bf1df4 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:48.691675 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac3596-7d23-4b68-ac84-213161bf1df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:48.710101 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307e6ff-dc9f-4af1-a41f-a4ac2286a74f None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:48.713911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a5ac3596-7d23-4b68-ac84-213161bf1df4 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:48.715280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a5ac3596-7d23-4b68-ac84-213161bf1df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:48.716722 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57883fb-65ff-40c1-acbe-48a2acd5a02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:48.717331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57883fb-65ff-40c1-acbe-48a2acd5a02c admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:48.717715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57883fb-65ff-40c1-acbe-48a2acd5a02c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:48.718000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57883fb-65ff-40c1-acbe-48a2acd5a02c admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:48.718862 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57883fb-65ff-40c1-acbe-48a2acd5a02c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:13:48.719168 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57883fb-65ff-40c1-acbe-48a2acd5a02c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:48.721450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57883fb-65ff-40c1-acbe-48a2acd5a02c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:48.724906 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2825/5621] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:48.729255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac3596-7d23-4b68-ac84-213161bf1df4 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:48.738982 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2797/5622] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:13:48.742397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac3596-7d23-4b68-ac84-213161bf1df4 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:48.744049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57883fb-65ff-40c1-acbe-48a2acd5a02c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:48.757761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57883fb-65ff-40c1-acbe-48a2acd5a02c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:48.759260 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80247c-16b9-4765-8b63-46267fb509b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:48.759895 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80247c-16b9-4765-8b63-46267fb509b2 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:48.760253 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80247c-16b9-4765-8b63-46267fb509b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:48.760529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80247c-16b9-4765-8b63-46267fb509b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:48.761191 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80247c-16b9-4765-8b63-46267fb509b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:13:48.761499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80247c-16b9-4765-8b63-46267fb509b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:48.763162 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80247c-16b9-4765-8b63-46267fb509b2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:48.771706 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0a1f4-3534-4e76-83d4-67c623eb608f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:48.774440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0a1f4-3534-4e76-83d4-67c623eb608f admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:48.775187 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0a1f4-3534-4e76-83d4-67c623eb608f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:48.775664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0a1f4-3534-4e76-83d4-67c623eb608f admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:48.777406 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0a1f4-3534-4e76-83d4-67c623eb608f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:48.784070 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2826/5623] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:13:48.784612 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0a1f4-3534-4e76-83d4-67c623eb608f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:48.785163 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80247c-16b9-4765-8b63-46267fb509b2 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:48.808582 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80247c-16b9-4765-8b63-46267fb509b2 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:48.832816 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b740a-147c-4fcd-8c7a-ce3565f778a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:48.833169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b740a-147c-4fcd-8c7a-ce3565f778a4 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:48.833401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b740a-147c-4fcd-8c7a-ce3565f778a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:48.833764 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b740a-147c-4fcd-8c7a-ce3565f778a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:48.834363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349b740a-147c-4fcd-8c7a-ce3565f778a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:48.838940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349b740a-147c-4fcd-8c7a-ce3565f778a4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:48.879494 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2798/5624] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:13:48 2022] POST /identity/v3/projects => generated 351 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:13:48.885349 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0a1f4-3534-4e76-83d4-67c623eb608f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:48.936005 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2827/5625] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:13:48 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:13:48.940482 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b740a-147c-4fcd-8c7a-ce3565f778a4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:49.026688 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0a1f4-3534-4e76-83d4-67c623eb608f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:49.070158 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b740a-147c-4fcd-8c7a-ce3565f778a4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:49.075289 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5f1df-d13d-4432-9e13-18ac87434ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:49.075962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5f1df-d13d-4432-9e13-18ac87434ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:49.076359 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5f1df-d13d-4432-9e13-18ac87434ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:49.076508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5f1df-d13d-4432-9e13-18ac87434ea4 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:49.077200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5f1df-d13d-4432-9e13-18ac87434ea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:49.089538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5f1df-d13d-4432-9e13-18ac87434ea4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:49.141528 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2828/5626] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:13:48 2022] POST /identity/v3/users => generated 287 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:13:49.144110 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5f1df-d13d-4432-9e13-18ac87434ea4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:49.153966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:49.161303 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b80402-dcce-40f3-a114-5d35c846304b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:49.161955 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b80402-dcce-40f3-a114-5d35c846304b admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:49.162236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b80402-dcce-40f3-a114-5d35c846304b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:49.163193 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b80402-dcce-40f3-a114-5d35c846304b admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:49.163958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b80402-dcce-40f3-a114-5d35c846304b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:49.167794 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5f1df-d13d-4432-9e13-18ac87434ea4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:49.169716 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b80402-dcce-40f3-a114-5d35c846304b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:49.174788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e77f3-4347-417e-b829-b5a9e5dacac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:49.175719 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e77f3-4347-417e-b829-b5a9e5dacac9 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:49.176216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e77f3-4347-417e-b829-b5a9e5dacac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:49.176701 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e77f3-4347-417e-b829-b5a9e5dacac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:49.177592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e77f3-4347-417e-b829-b5a9e5dacac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:49.180768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e77f3-4347-417e-b829-b5a9e5dacac9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:49.194695 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2829/5627] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:13:49.198772 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e77f3-4347-417e-b829-b5a9e5dacac9 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:49.199352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:49.216737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e77f3-4347-417e-b829-b5a9e5dacac9 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:49.221179 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2799/5628] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:13:48 2022] POST /identity/v3/users => generated 276 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:13:49.222197 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b80402-dcce-40f3-a114-5d35c846304b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:49.225896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b9bb5-13ae-46fc-8d9f-c8719d25f459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:49.226832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b9bb5-13ae-46fc-8d9f-c8719d25f459 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:49.227341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b9bb5-13ae-46fc-8d9f-c8719d25f459 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:49.227860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b9bb5-13ae-46fc-8d9f-c8719d25f459 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:49.228978 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b9bb5-13ae-46fc-8d9f-c8719d25f459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:49.231410 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b9bb5-13ae-46fc-8d9f-c8719d25f459 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:49.246904 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2830/5629] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:13:49.251632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b9bb5-13ae-46fc-8d9f-c8719d25f459 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:49.258525 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b80402-dcce-40f3-a114-5d35c846304b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:49.270782 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315e44f-fb0d-446a-992b-cf952905a003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:49.271409 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315e44f-fb0d-446a-992b-cf952905a003 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:49.271693 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315e44f-fb0d-446a-992b-cf952905a003 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:49.272600 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315e44f-fb0d-446a-992b-cf952905a003 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:49.273180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7315e44f-fb0d-446a-992b-cf952905a003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:49.274842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7315e44f-fb0d-446a-992b-cf952905a003 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:49.280424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b9bb5-13ae-46fc-8d9f-c8719d25f459 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:49.303717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853f86b-e696-4003-bbf0-4d4f2dcbc4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:49.304230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853f86b-e696-4003-bbf0-4d4f2dcbc4b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:49.304524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853f86b-e696-4003-bbf0-4d4f2dcbc4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:49.304808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853f86b-e696-4003-bbf0-4d4f2dcbc4b7 admin admin] PATH_INFO: `/v3/projects/5713116fb6eb41b887c562bb1bfc6f1c/users/e3edf022014b40faa8a29cbeec1ffe56/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:49.309565 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2800/5630] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:13:49.310594 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315e44f-fb0d-446a-992b-cf952905a003 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:49.337827 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315e44f-fb0d-446a-992b-cf952905a003 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:49.347335 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f58d6-b613-4511-a824-ae69dca73bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:49.347976 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f58d6-b613-4511-a824-ae69dca73bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:49.348355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f58d6-b613-4511-a824-ae69dca73bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:49.348702 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f58d6-b613-4511-a824-ae69dca73bb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:49.349635 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f58d6-b613-4511-a824-ae69dca73bb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:49.352931 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853f86b-e696-4003-bbf0-4d4f2dcbc4b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5713116fb6eb41b887c562bb1bfc6f1c, user_id=e3edf022014b40faa8a29cbeec1ffe56, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:49.357435 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853f86b-e696-4003-bbf0-4d4f2dcbc4b7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:49.360568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f58d6-b613-4511-a824-ae69dca73bb6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:49.391194 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2831/5631] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:13:49 2022] PUT /identity/v3/projects/5713116fb6eb41b887c562bb1bfc6f1c/users/e3edf022014b40faa8a29cbeec1ffe56/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:49.396705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d4f4f-ce14-4916-93b3-790f24c32470 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:49.397523 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d4f4f-ce14-4916-93b3-790f24c32470 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:49.397854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d4f4f-ce14-4916-93b3-790f24c32470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:49.399162 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2801/5632] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:13:49.400114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f58d6-b613-4511-a824-ae69dca73bb6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:49.435449 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f58d6-b613-4511-a824-ae69dca73bb6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:49.480704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-649d4f4f-ce14-4916-93b3-790f24c32470 None None] MFA Rules not processed for user `e3edf022014b40faa8a29cbeec1ffe56`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:49.484415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-649d4f4f-ce14-4916-93b3-790f24c32470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:49.576900 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c98ace-76ef-463c-b02a-b7e40602aaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:49.577671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c98ace-76ef-463c-b02a-b7e40602aaa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:49.578026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c98ace-76ef-463c-b02a-b7e40602aaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:49.578373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c98ace-76ef-463c-b02a-b7e40602aaa6 admin admin] PATH_INFO: `/v3/projects/14720f3f5b864b4e842408b4a63d4e36/users/2f2f0789535a4335bb96c70c49ec5641/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:49.614165 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c98ace-76ef-463c-b02a-b7e40602aaa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14720f3f5b864b4e842408b4a63d4e36, user_id=2f2f0789535a4335bb96c70c49ec5641, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:49.619289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c98ace-76ef-463c-b02a-b7e40602aaa6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:49.650824 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2832/5633] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:49.651335 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2802/5634] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:13:49 2022] PUT /identity/v3/projects/14720f3f5b864b4e842408b4a63d4e36/users/2f2f0789535a4335bb96c70c49ec5641/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:49.665332 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa2b09-ef27-4fd1-a332-f4caa6ef8cf6 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:49.665761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa2b09-ef27-4fd1-a332-f4caa6ef8cf6 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:49.666182 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa2b09-ef27-4fd1-a332-f4caa6ef8cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:49.690828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c98ace-76ef-463c-b02a-b7e40602aaa6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:49.694463 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a6c98ace-76ef-463c-b02a-b7e40602aaa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:49.710727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-edaa2b09-ef27-4fd1-a332-f4caa6ef8cf6 None None] MFA Rules not processed for user `2f2f0789535a4335bb96c70c49ec5641`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:49.712044 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-edaa2b09-ef27-4fd1-a332-f4caa6ef8cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:49.811072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c98ace-76ef-463c-b02a-b7e40602aaa6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:49.827222 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d4cef-5601-436a-b1a3-4d84927bf8ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:49.827874 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d4cef-5601-436a-b1a3-4d84927bf8ee service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:49.828154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d4cef-5601-436a-b1a3-4d84927bf8ee service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:49.828424 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d4cef-5601-436a-b1a3-4d84927bf8ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:49.979750 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d4cef-5601-436a-b1a3-4d84927bf8ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:49.981927 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d4cef-5601-436a-b1a3-4d84927bf8ee service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:50.017053 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2803/5635] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:13:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:13:50.156260 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2833/5636] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:49 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 493 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:50.182268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d4cef-5601-436a-b1a3-4d84927bf8ee service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:50.184268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ff0d4cef-5601-436a-b1a3-4d84927bf8ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:50.214311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d4cef-5601-436a-b1a3-4d84927bf8ee service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:50.223776 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a3250-b261-4aa2-862b-1e0e8c657596 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:50.225877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a3250-b261-4aa2-862b-1e0e8c657596 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:50.226185 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a3250-b261-4aa2-862b-1e0e8c657596 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:50.226694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a3250-b261-4aa2-862b-1e0e8c657596 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:50.256897 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a3250-b261-4aa2-862b-1e0e8c657596 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:50.262055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a3250-b261-4aa2-862b-1e0e8c657596 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:50.269384 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:50.289123 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2804/5637] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:13:50 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:13:50.359596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c8705-aeb1-4424-8e6f-1ffc297b7163 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:50.360604 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c8705-aeb1-4424-8e6f-1ffc297b7163 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:50.361061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c8705-aeb1-4424-8e6f-1ffc297b7163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:50.413756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b32c8705-aeb1-4424-8e6f-1ffc297b7163 None None] MFA Rules not processed for user `a6c953ff2f774041a7d50f53033ee124`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:50.422349 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b32c8705-aeb1-4424-8e6f-1ffc297b7163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:50.498964 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:50.534751 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2834/5638] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:50.682344 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a3250-b261-4aa2-862b-1e0e8c657596 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:50.697806 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a3250-b261-4aa2-862b-1e0e8c657596 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:50.706182 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a37f5-112e-40b3-bd55-3f3d8668caa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:50.707513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a37f5-112e-40b3-bd55-3f3d8668caa5 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:50.708363 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a37f5-112e-40b3-bd55-3f3d8668caa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:50.710462 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a37f5-112e-40b3-bd55-3f3d8668caa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:50.715562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e69a37f5-112e-40b3-bd55-3f3d8668caa5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:50.913844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a37f5-112e-40b3-bd55-3f3d8668caa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:50.916272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a37f5-112e-40b3-bd55-3f3d8668caa5 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:50.938782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c8705-aeb1-4424-8e6f-1ffc297b7163 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:50.940837 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b32c8705-aeb1-4424-8e6f-1ffc297b7163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:50.951920 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2805/5639] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:13:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:13:51.082279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c8705-aeb1-4424-8e6f-1ffc297b7163 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:51.090568 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6368f-50b7-4716-846e-47dadfe59336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:51.091236 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6368f-50b7-4716-846e-47dadfe59336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:51.091519 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6368f-50b7-4716-846e-47dadfe59336 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:51.091795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6368f-50b7-4716-846e-47dadfe59336 admin admin] PATH_INFO: `/v3/users/87831db38fc14ff980161f21a37215e4` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:51.103540 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6368f-50b7-4716-846e-47dadfe59336 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87831db38fc14ff980161f21a37215e4)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:51.106172 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6368f-50b7-4716-846e-47dadfe59336 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:51.201054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7cc6368f-50b7-4716-846e-47dadfe59336 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87831db38fc14ff980161f21a37215e4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:51.213618 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7cc6368f-50b7-4716-846e-47dadfe59336 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87831db38fc14ff980161f21a37215e4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:51.214379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7cc6368f-50b7-4716-846e-47dadfe59336 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87831db38fc14ff980161f21a37215e4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:51.215067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7cc6368f-50b7-4716-846e-47dadfe59336 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87831db38fc14ff980161f21a37215e4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:51.225501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7cc6368f-50b7-4716-846e-47dadfe59336 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87831db38fc14ff980161f21a37215e4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:51.261878 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2835/5640] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:13:50 2022] DELETE /identity/v3/users/87831db38fc14ff980161f21a37215e4 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:13:51.263793 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e67f6-9d56-432f-b50d-e5796e5fbd86 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:51.264588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e67f6-9d56-432f-b50d-e5796e5fbd86 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:51.265027 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e67f6-9d56-432f-b50d-e5796e5fbd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:51.298412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-478e67f6-9d56-432f-b50d-e5796e5fbd86 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:51.300921 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-478e67f6-9d56-432f-b50d-e5796e5fbd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:51.424452 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2806/5641] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:51.437623 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6368f-50b7-4716-846e-47dadfe59336 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:51.440038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e67f6-9d56-432f-b50d-e5796e5fbd86 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:51.446346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-478e67f6-9d56-432f-b50d-e5796e5fbd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:51.447134 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7cc6368f-50b7-4716-846e-47dadfe59336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:51.473197 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e67f6-9d56-432f-b50d-e5796e5fbd86 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:51.488143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753235b8-deed-45ae-ac39-80cc2a122fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:51.489310 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753235b8-deed-45ae-ac39-80cc2a122fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:51.489310 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753235b8-deed-45ae-ac39-80cc2a122fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:51.489513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753235b8-deed-45ae-ac39-80cc2a122fe2 admin admin] PATH_INFO: `/v3/users/e3edf022014b40faa8a29cbeec1ffe56` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:51.493042 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753235b8-deed-45ae-ac39-80cc2a122fe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3edf022014b40faa8a29cbeec1ffe56)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:51.494258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753235b8-deed-45ae-ac39-80cc2a122fe2 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:51.558100 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6368f-50b7-4716-846e-47dadfe59336 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:51.564891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8be574-a1f0-4c7d-ac77-900383cd879a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:51.565762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8be574-a1f0-4c7d-ac77-900383cd879a service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:51.566130 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8be574-a1f0-4c7d-ac77-900383cd879a service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:51.566504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8be574-a1f0-4c7d-ac77-900383cd879a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:51.583484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8be574-a1f0-4c7d-ac77-900383cd879a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:51.587940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8be574-a1f0-4c7d-ac77-900383cd879a service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:51.607197 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-753235b8-deed-45ae-ac39-80cc2a122fe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3edf022014b40faa8a29cbeec1ffe56'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:51.609233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-753235b8-deed-45ae-ac39-80cc2a122fe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3edf022014b40faa8a29cbeec1ffe56'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:51.610177 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-753235b8-deed-45ae-ac39-80cc2a122fe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3edf022014b40faa8a29cbeec1ffe56'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:51.612954 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2836/5642] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:13:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:13:51.622049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-753235b8-deed-45ae-ac39-80cc2a122fe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3edf022014b40faa8a29cbeec1ffe56'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:51.645407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-753235b8-deed-45ae-ac39-80cc2a122fe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3edf022014b40faa8a29cbeec1ffe56'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:51.655708 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:51.671736 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2807/5643] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:13:51 2022] DELETE /identity/v3/users/e3edf022014b40faa8a29cbeec1ffe56 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:51.673669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f7c42-957a-48d8-a143-66a762bf9f48 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:51.673934 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f7c42-957a-48d8-a143-66a762bf9f48 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:51.675650 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f7c42-957a-48d8-a143-66a762bf9f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:51.686211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:51.708445 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-dd1f7c42-957a-48d8-a143-66a762bf9f48 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:51.710699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-dd1f7c42-957a-48d8-a143-66a762bf9f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:51.799121 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2837/5644] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:51.808845 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753235b8-deed-45ae-ac39-80cc2a122fe2 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:51.813030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-753235b8-deed-45ae-ac39-80cc2a122fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:51.931629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4dd5c-a870-472e-b25c-da050aad30c7 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:51.932058 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4dd5c-a870-472e-b25c-da050aad30c7 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:51.932436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4dd5c-a870-472e-b25c-da050aad30c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:51.952235 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753235b8-deed-45ae-ac39-80cc2a122fe2 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:51.960825 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334cffb-0125-462d-8323-cf03740e2942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:51.962287 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334cffb-0125-462d-8323-cf03740e2942 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:51.962287 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334cffb-0125-462d-8323-cf03740e2942 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:51.962999 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334cffb-0125-462d-8323-cf03740e2942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:51.977128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-4af4dd5c-a870-472e-b25c-da050aad30c7 None None] MFA Rules not processed for user `a6c953ff2f774041a7d50f53033ee124`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:51.982413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4af4dd5c-a870-472e-b25c-da050aad30c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:52.002877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334cffb-0125-462d-8323-cf03740e2942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:52.006532 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334cffb-0125-462d-8323-cf03740e2942 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:52.042487 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2808/5645] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:13:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:13:52.108997 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2838/5646] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:52.175795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334cffb-0125-462d-8323-cf03740e2942 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:52.178899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6334cffb-0125-462d-8323-cf03740e2942 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:52.208405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334cffb-0125-462d-8323-cf03740e2942 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:52.247243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c337e-e617-4394-a3b2-0ab9ba4f6241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:52.248024 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c337e-e617-4394-a3b2-0ab9ba4f6241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:52.250531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c337e-e617-4394-a3b2-0ab9ba4f6241 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:52.250891 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c337e-e617-4394-a3b2-0ab9ba4f6241 admin admin] PATH_INFO: `/v3/projects/05ab4198c8af409c8d3de6f8925dca3e` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:52.255001 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c337e-e617-4394-a3b2-0ab9ba4f6241 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05ab4198c8af409c8d3de6f8925dca3e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:52.261924 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c337e-e617-4394-a3b2-0ab9ba4f6241 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:52.339853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a08c337e-e617-4394-a3b2-0ab9ba4f6241 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05ab4198c8af409c8d3de6f8925dca3e', 'request_id': 'req-a08c337e-e617-4394-a3b2-0ab9ba4f6241'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:52.347299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a08c337e-e617-4394-a3b2-0ab9ba4f6241 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05ab4198c8af409c8d3de6f8925dca3e', 'request_id': 'req-a08c337e-e617-4394-a3b2-0ab9ba4f6241'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:52.357766 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a08c337e-e617-4394-a3b2-0ab9ba4f6241 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05ab4198c8af409c8d3de6f8925dca3e', 'request_id': 'req-a08c337e-e617-4394-a3b2-0ab9ba4f6241'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:52.387146 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a08c337e-e617-4394-a3b2-0ab9ba4f6241 admin admin] The token cache is being invalidate because project 05ab4198c8af409c8d3de6f8925dca3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:13:52.387622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a08c337e-e617-4394-a3b2-0ab9ba4f6241 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:52.389051 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a08c337e-e617-4394-a3b2-0ab9ba4f6241 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:52.391318 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2809/5647] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:13:52 2022] DELETE /identity/v3/projects/05ab4198c8af409c8d3de6f8925dca3e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:52.397151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4dd5c-a870-472e-b25c-da050aad30c7 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:52.420000 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4dd5c-a870-472e-b25c-da050aad30c7 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:52.566995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cda4ae-52eb-4534-aa96-fdf5552bb03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:52.567671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cda4ae-52eb-4534-aa96-fdf5552bb03e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:52.567947 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cda4ae-52eb-4534-aa96-fdf5552bb03e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:52.568213 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cda4ae-52eb-4534-aa96-fdf5552bb03e admin admin] PATH_INFO: `/v3/users/efb74772a93e4d1193fabc2cc49867a6` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:52.572891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cda4ae-52eb-4534-aa96-fdf5552bb03e admin admin] RBAC: Authorizing `identity:delete_user(user_id=efb74772a93e4d1193fabc2cc49867a6)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:52.576390 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cda4ae-52eb-4534-aa96-fdf5552bb03e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:52.682708 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-93cda4ae-52eb-4534-aa96-fdf5552bb03e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efb74772a93e4d1193fabc2cc49867a6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:52.688779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:52.693214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-93cda4ae-52eb-4534-aa96-fdf5552bb03e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efb74772a93e4d1193fabc2cc49867a6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:52.696506 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-93cda4ae-52eb-4534-aa96-fdf5552bb03e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efb74772a93e4d1193fabc2cc49867a6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:52.696506 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-93cda4ae-52eb-4534-aa96-fdf5552bb03e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efb74772a93e4d1193fabc2cc49867a6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:52.711359 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-93cda4ae-52eb-4534-aa96-fdf5552bb03e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efb74772a93e4d1193fabc2cc49867a6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:52.759221 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2839/5648] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:13:52 2022] DELETE /identity/v3/users/efb74772a93e4d1193fabc2cc49867a6 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:52.791607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c337e-e617-4394-a3b2-0ab9ba4f6241 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:52.794060 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a08c337e-e617-4394-a3b2-0ab9ba4f6241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:52.828875 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c337e-e617-4394-a3b2-0ab9ba4f6241 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:52.926156 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add97600-d884-4ce0-bf6f-04922982d415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:52.926877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add97600-d884-4ce0-bf6f-04922982d415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:52.927161 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add97600-d884-4ce0-bf6f-04922982d415 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:52.927483 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add97600-d884-4ce0-bf6f-04922982d415 admin admin] PATH_INFO: `/v3/projects/5713116fb6eb41b887c562bb1bfc6f1c` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:52.930004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add97600-d884-4ce0-bf6f-04922982d415 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5713116fb6eb41b887c562bb1bfc6f1c)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:52.932319 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add97600-d884-4ce0-bf6f-04922982d415 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:52.977485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:53.021526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-add97600-d884-4ce0-bf6f-04922982d415 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5713116fb6eb41b887c562bb1bfc6f1c', 'request_id': 'req-add97600-d884-4ce0-bf6f-04922982d415'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:53.030911 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-add97600-d884-4ce0-bf6f-04922982d415 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5713116fb6eb41b887c562bb1bfc6f1c', 'request_id': 'req-add97600-d884-4ce0-bf6f-04922982d415'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:53.039739 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-add97600-d884-4ce0-bf6f-04922982d415 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5713116fb6eb41b887c562bb1bfc6f1c', 'request_id': 'req-add97600-d884-4ce0-bf6f-04922982d415'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:53.071313 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-add97600-d884-4ce0-bf6f-04922982d415 admin admin] The token cache is being invalidate because project 5713116fb6eb41b887c562bb1bfc6f1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:13:53.071959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-add97600-d884-4ce0-bf6f-04922982d415 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:53.079516 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-add97600-d884-4ce0-bf6f-04922982d415 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:53.088318 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2810/5649] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:13:52 2022] DELETE /identity/v3/projects/5713116fb6eb41b887c562bb1bfc6f1c => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:53.088530 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff9319-5651-453c-b4c4-d90d5b33a7af None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:53.088786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff9319-5651-453c-b4c4-d90d5b33a7af None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:53.089442 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff9319-5651-453c-b4c4-d90d5b33a7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:53.119560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-0eff9319-5651-453c-b4c4-d90d5b33a7af None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:53.121946 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0eff9319-5651-453c-b4c4-d90d5b33a7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:53.179876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d295d-5a3d-4818-80f4-502d99b893b4 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:53.180205 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d295d-5a3d-4818-80f4-502d99b893b4 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:53.180442 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d295d-5a3d-4818-80f4-502d99b893b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:53.224195 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-7c9d295d-5a3d-4818-80f4-502d99b893b4 None None] MFA Rules not processed for user `a6c953ff2f774041a7d50f53033ee124`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:53.226512 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7c9d295d-5a3d-4818-80f4-502d99b893b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:53.335801 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2811/5650] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:13:53.337093 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d295d-5a3d-4818-80f4-502d99b893b4 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:53.341522 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2840/5651] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:13:53.358610 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4764f5c-a1dd-4947-99d3-a27daa5368ec None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:53.358610 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4764f5c-a1dd-4947-99d3-a27daa5368ec None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:53.358610 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4764f5c-a1dd-4947-99d3-a27daa5368ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:53.362432 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7c9d295d-5a3d-4818-80f4-502d99b893b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:53.404669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d4764f5c-a1dd-4947-99d3-a27daa5368ec None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:53.405876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d4764f5c-a1dd-4947-99d3-a27daa5368ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:53.408950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d295d-5a3d-4818-80f4-502d99b893b4 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:53.425578 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c6cb97-26d7-486b-8c38-c37b8d405b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:53.426692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6cb97-26d7-486b-8c38-c37b8d405b79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:53.427184 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6cb97-26d7-486b-8c38-c37b8d405b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:53.428738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6cb97-26d7-486b-8c38-c37b8d405b79 admin admin] PATH_INFO: `/v3/projects/dc2b6e9943f54274b51351a71262a599` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:53.432028 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c6cb97-26d7-486b-8c38-c37b8d405b79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc2b6e9943f54274b51351a71262a599)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:53.436362 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c6cb97-26d7-486b-8c38-c37b8d405b79 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:53.443206 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2841/5652] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:53.444908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4764f5c-a1dd-4947-99d3-a27daa5368ec None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:53.472638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4764f5c-a1dd-4947-99d3-a27daa5368ec None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:53.485456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef829a-51d4-4fd4-a1cc-5f4f3c11eaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:53.487598 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef829a-51d4-4fd4-a1cc-5f4f3c11eaf9 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:53.487886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef829a-51d4-4fd4-a1cc-5f4f3c11eaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:53.488152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef829a-51d4-4fd4-a1cc-5f4f3c11eaf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:53.488818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef829a-51d4-4fd4-a1cc-5f4f3c11eaf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:13:53.489120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef829a-51d4-4fd4-a1cc-5f4f3c11eaf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:53.496096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef829a-51d4-4fd4-a1cc-5f4f3c11eaf9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:53.530060 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2842/5653] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:13:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:13:53.531138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef829a-51d4-4fd4-a1cc-5f4f3c11eaf9 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:53.569750 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef829a-51d4-4fd4-a1cc-5f4f3c11eaf9 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:53.571022 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d5c6cb97-26d7-486b-8c38-c37b8d405b79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc2b6e9943f54274b51351a71262a599', 'request_id': 'req-d5c6cb97-26d7-486b-8c38-c37b8d405b79'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:53.586689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d5c6cb97-26d7-486b-8c38-c37b8d405b79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc2b6e9943f54274b51351a71262a599', 'request_id': 'req-d5c6cb97-26d7-486b-8c38-c37b8d405b79'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:53.602859 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d5c6cb97-26d7-486b-8c38-c37b8d405b79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc2b6e9943f54274b51351a71262a599', 'request_id': 'req-d5c6cb97-26d7-486b-8c38-c37b8d405b79'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:53.628074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d5c6cb97-26d7-486b-8c38-c37b8d405b79 admin admin] The token cache is being invalidate because project dc2b6e9943f54274b51351a71262a599 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:13:53.628316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d5c6cb97-26d7-486b-8c38-c37b8d405b79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:53.630201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d5c6cb97-26d7-486b-8c38-c37b8d405b79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:53.635674 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2812/5654] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:13:53 2022] DELETE /identity/v3/projects/dc2b6e9943f54274b51351a71262a599 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:53.640901 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc11bc-6419-490b-ae32-23b236242828 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:53.643657 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc11bc-6419-490b-ae32-23b236242828 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:53.643958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc11bc-6419-490b-ae32-23b236242828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:53.697650 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-96cc11bc-6419-490b-ae32-23b236242828 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:53.702154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-96cc11bc-6419-490b-ae32-23b236242828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:53.764039 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff184c63-c2ee-4897-930a-e37213934204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:53.764898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff184c63-c2ee-4897-930a-e37213934204 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:53.765187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff184c63-c2ee-4897-930a-e37213934204 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:53.765574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff184c63-c2ee-4897-930a-e37213934204 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:53.766189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff184c63-c2ee-4897-930a-e37213934204 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:53.775052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff184c63-c2ee-4897-930a-e37213934204 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:53.842989 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2843/5655] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:13:53 2022] POST /identity/v3/projects => generated 355 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:13:53.843476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:53.845292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff184c63-c2ee-4897-930a-e37213934204 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:53.847863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ff184c63-c2ee-4897-930a-e37213934204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:53.910178 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2813/5656] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:53.912093 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3829d5a-f81c-456b-a0dc-cc7dfb49674f None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:53.912425 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3829d5a-f81c-456b-a0dc-cc7dfb49674f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:53.912706 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3829d5a-f81c-456b-a0dc-cc7dfb49674f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:53.930849 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:53.972696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d3829d5a-f81c-456b-a0dc-cc7dfb49674f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:53.976639 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d3829d5a-f81c-456b-a0dc-cc7dfb49674f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:54.000622 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff184c63-c2ee-4897-930a-e37213934204 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:54.008558 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110953d-43e4-4bed-ba39-08c53d756e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:54.009667 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110953d-43e4-4bed-ba39-08c53d756e2e admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:54.010294 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110953d-43e4-4bed-ba39-08c53d756e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:54.010757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110953d-43e4-4bed-ba39-08c53d756e2e admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:54.011498 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110953d-43e4-4bed-ba39-08c53d756e2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:54.014953 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110953d-43e4-4bed-ba39-08c53d756e2e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:54.095042 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2844/5657] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:13:53 2022] POST /identity/v3/users => generated 278 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:13:54.096066 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110953d-43e4-4bed-ba39-08c53d756e2e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:54.138209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110953d-43e4-4bed-ba39-08c53d756e2e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:54.151830 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed90b3-5b13-4ad5-94e9-c9b1869c73bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:54.152460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed90b3-5b13-4ad5-94e9-c9b1869c73bc admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:54.152746 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed90b3-5b13-4ad5-94e9-c9b1869c73bc admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:54.153779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed90b3-5b13-4ad5-94e9-c9b1869c73bc admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:54.154457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed90b3-5b13-4ad5-94e9-c9b1869c73bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:54.156170 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed90b3-5b13-4ad5-94e9-c9b1869c73bc admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:54.182378 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2814/5658] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:54.187599 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3829d5a-f81c-456b-a0dc-cc7dfb49674f None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:54.190457 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2845/5659] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:13:54.194979 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed90b3-5b13-4ad5-94e9-c9b1869c73bc admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:54.206232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3829d5a-f81c-456b-a0dc-cc7dfb49674f None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:54.214186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed90b3-5b13-4ad5-94e9-c9b1869c73bc admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:54.217081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007ce04-0a08-48f8-aeb7-3a81ee535faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:54.217994 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007ce04-0a08-48f8-aeb7-3a81ee535faf admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:54.218515 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007ce04-0a08-48f8-aeb7-3a81ee535faf admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:54.219129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007ce04-0a08-48f8-aeb7-3a81ee535faf admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:54.220845 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007ce04-0a08-48f8-aeb7-3a81ee535faf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:13:54.221358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007ce04-0a08-48f8-aeb7-3a81ee535faf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:54.224143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007ce04-0a08-48f8-aeb7-3a81ee535faf admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:54.231929 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238928e-e627-4b62-b618-8385b2f7f14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:54.235317 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238928e-e627-4b62-b618-8385b2f7f14a admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:54.236161 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238928e-e627-4b62-b618-8385b2f7f14a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:54.236672 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238928e-e627-4b62-b618-8385b2f7f14a admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:54.238606 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238928e-e627-4b62-b618-8385b2f7f14a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:54.243454 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238928e-e627-4b62-b618-8385b2f7f14a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:54.270405 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2815/5660] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:13:54.272921 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007ce04-0a08-48f8-aeb7-3a81ee535faf admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:54.282713 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2846/5661] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:13:54.286499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238928e-e627-4b62-b618-8385b2f7f14a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:54.293911 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007ce04-0a08-48f8-aeb7-3a81ee535faf admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:54.301126 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2d48b-b13b-4a15-90f6-046b485964d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:54.303175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2d48b-b13b-4a15-90f6-046b485964d5 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:54.304192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2d48b-b13b-4a15-90f6-046b485964d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:54.304856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2d48b-b13b-4a15-90f6-046b485964d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:54.305862 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc2d48b-b13b-4a15-90f6-046b485964d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:54.306948 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238928e-e627-4b62-b618-8385b2f7f14a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:54.308609 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc2d48b-b13b-4a15-90f6-046b485964d5 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:54.320877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf527f-f4ab-4adb-aad1-923eba0fff11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:54.321560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf527f-f4ab-4adb-aad1-923eba0fff11 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:54.322699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf527f-f4ab-4adb-aad1-923eba0fff11 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:54.323020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf527f-f4ab-4adb-aad1-923eba0fff11 admin admin] PATH_INFO: `/v3/projects/61dc126a193b46a293d46c21b28f4861/users/e969b90e30424b1795008ba4d1c99883/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:54.356492 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2816/5662] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:13:54 2022] POST /identity/v3/projects => generated 357 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:13:54.362203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2d48b-b13b-4a15-90f6-046b485964d5 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:54.364423 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf527f-f4ab-4adb-aad1-923eba0fff11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61dc126a193b46a293d46c21b28f4861, user_id=e969b90e30424b1795008ba4d1c99883, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:54.367844 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf527f-f4ab-4adb-aad1-923eba0fff11 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:54.392583 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2847/5663] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:13:54 2022] PUT /identity/v3/projects/61dc126a193b46a293d46c21b28f4861/users/e969b90e30424b1795008ba4d1c99883/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:54.410915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a67ed-47c3-4830-82af-1a5bf60ff14a None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:54.410915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a67ed-47c3-4830-82af-1a5bf60ff14a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:54.410915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a67ed-47c3-4830-82af-1a5bf60ff14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:54.470270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-2d3a67ed-47c3-4830-82af-1a5bf60ff14a None None] MFA Rules not processed for user `e969b90e30424b1795008ba4d1c99883`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:54.473195 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2d3a67ed-47c3-4830-82af-1a5bf60ff14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:54.486111 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2d48b-b13b-4a15-90f6-046b485964d5 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:54.575722 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:54.588894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37fc798-07a9-4056-88cb-5e466dfae29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:54.589575 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fc798-07a9-4056-88cb-5e466dfae29a admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:54.589865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fc798-07a9-4056-88cb-5e466dfae29a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:54.590142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fc798-07a9-4056-88cb-5e466dfae29a admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:54.590953 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37fc798-07a9-4056-88cb-5e466dfae29a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:54.592945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37fc798-07a9-4056-88cb-5e466dfae29a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:54.601192 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2848/5664] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:54 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:54.603486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4440dd-7a54-421b-be13-5aafe15ae576 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:54.604218 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4440dd-7a54-421b-be13-5aafe15ae576 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:54.604899 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4440dd-7a54-421b-be13-5aafe15ae576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:54.626649 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2817/5665] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:13:54 2022] POST /identity/v3/users => generated 279 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:13:54.627592 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37fc798-07a9-4056-88cb-5e466dfae29a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:54.628688 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-ec4440dd-7a54-421b-be13-5aafe15ae576 None None] MFA Rules not processed for user `a6c953ff2f774041a7d50f53033ee124`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:54.630279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ec4440dd-7a54-421b-be13-5aafe15ae576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:54.642943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37fc798-07a9-4056-88cb-5e466dfae29a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:54.650745 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e93e5-395d-411c-8494-22249bc667be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:54.651468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e93e5-395d-411c-8494-22249bc667be admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:54.651818 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e93e5-395d-411c-8494-22249bc667be admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:54.652161 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e93e5-395d-411c-8494-22249bc667be admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:54.652865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e93e5-395d-411c-8494-22249bc667be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:54.654921 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e93e5-395d-411c-8494-22249bc667be admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:54.701694 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2818/5666] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:13:54 2022] POST /identity/v3/projects => generated 357 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:13:54.717136 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2849/5667] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:54.718121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4440dd-7a54-421b-be13-5aafe15ae576 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:54.721102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e93e5-395d-411c-8494-22249bc667be admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:54.730736 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4440dd-7a54-421b-be13-5aafe15ae576 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:54.741189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:54.808281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a368f-b503-443f-86eb-4c4502196e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:54.808923 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a368f-b503-443f-86eb-4c4502196e68 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:54.809262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a368f-b503-443f-86eb-4c4502196e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:54.809485 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a368f-b503-443f-86eb-4c4502196e68 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:54.810295 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a368f-b503-443f-86eb-4c4502196e68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:54.816748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a368f-b503-443f-86eb-4c4502196e68 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:54.838811 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e93e5-395d-411c-8494-22249bc667be admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:54.852025 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5de6f-cba3-4102-9ba1-2c47773aa95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:54.852767 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5de6f-cba3-4102-9ba1-2c47773aa95c admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:54.853044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5de6f-cba3-4102-9ba1-2c47773aa95c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:54.853309 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5de6f-cba3-4102-9ba1-2c47773aa95c admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:54.854025 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d5de6f-cba3-4102-9ba1-2c47773aa95c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:54.857042 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d5de6f-cba3-4102-9ba1-2c47773aa95c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:54.862736 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2850/5668] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:13:54 2022] POST /identity/v3/users => generated 285 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:13:54.865040 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a368f-b503-443f-86eb-4c4502196e68 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:54.881473 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2819/5669] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:13:54.882856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5de6f-cba3-4102-9ba1-2c47773aa95c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:54.886705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a368f-b503-443f-86eb-4c4502196e68 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:54.897892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58bdb8-8526-4d54-9590-ad6a9446f8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:54.898521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58bdb8-8526-4d54-9590-ad6a9446f8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:54.898940 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5de6f-cba3-4102-9ba1-2c47773aa95c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:54.900080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58bdb8-8526-4d54-9590-ad6a9446f8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:54.900361 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58bdb8-8526-4d54-9590-ad6a9446f8e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:54.902169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58bdb8-8526-4d54-9590-ad6a9446f8e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:54.907526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58bdb8-8526-4d54-9590-ad6a9446f8e0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:54.915611 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badaa5a2-e71f-4da7-bd0e-d5fa8def588b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:54.916335 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badaa5a2-e71f-4da7-bd0e-d5fa8def588b admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:54.916703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badaa5a2-e71f-4da7-bd0e-d5fa8def588b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:54.917142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badaa5a2-e71f-4da7-bd0e-d5fa8def588b admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:54.918055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badaa5a2-e71f-4da7-bd0e-d5fa8def588b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:54.924341 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badaa5a2-e71f-4da7-bd0e-d5fa8def588b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:54.933436 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2851/5670] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:13:54.934531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58bdb8-8526-4d54-9590-ad6a9446f8e0 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:54.952039 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2820/5671] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:13:54.952974 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badaa5a2-e71f-4da7-bd0e-d5fa8def588b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:54.964537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58bdb8-8526-4d54-9590-ad6a9446f8e0 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:54.970491 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badaa5a2-e71f-4da7-bd0e-d5fa8def588b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:54.975446 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424634d-04ba-4469-82f2-d3e25b657a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:54.976323 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424634d-04ba-4469-82f2-d3e25b657a96 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:54.976604 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424634d-04ba-4469-82f2-d3e25b657a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:54.976879 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424634d-04ba-4469-82f2-d3e25b657a96 admin admin] PATH_INFO: `/v3/projects/1d3cbc84db244a21bf87ec5b31d1a9f3/users/a1002fa36ef147c49e6d489f2a4f8dba/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:54.983044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471b263-01cb-4518-9e35-00675fe1a756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:54.983712 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471b263-01cb-4518-9e35-00675fe1a756 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:54.983988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471b263-01cb-4518-9e35-00675fe1a756 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:54.984259 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471b263-01cb-4518-9e35-00675fe1a756 admin admin] PATH_INFO: `/v3/projects/4899e26849914450b0ffcceb2413f302/users/c3928625e2914cd8969b5b6e47a53af9/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:55.010949 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d424634d-04ba-4469-82f2-d3e25b657a96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3cbc84db244a21bf87ec5b31d1a9f3, user_id=a1002fa36ef147c49e6d489f2a4f8dba, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:55.015379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d424634d-04ba-4469-82f2-d3e25b657a96 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:55.017867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471b263-01cb-4518-9e35-00675fe1a756 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4899e26849914450b0ffcceb2413f302, user_id=c3928625e2914cd8969b5b6e47a53af9, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:55.020982 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471b263-01cb-4518-9e35-00675fe1a756 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:55.046275 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2852/5672] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:13:54 2022] PUT /identity/v3/projects/1d3cbc84db244a21bf87ec5b31d1a9f3/users/a1002fa36ef147c49e6d489f2a4f8dba/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:55.051911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424634d-04ba-4469-82f2-d3e25b657a96 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:55.064974 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2821/5673] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:13:54 2022] PUT /identity/v3/projects/4899e26849914450b0ffcceb2413f302/users/c3928625e2914cd8969b5b6e47a53af9/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:55.066505 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b45839-b3cb-4d2d-b451-44941f2e76bd None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:55.066820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b45839-b3cb-4d2d-b451-44941f2e76bd None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:55.067093 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b45839-b3cb-4d2d-b451-44941f2e76bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:55.098181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a5b45839-b3cb-4d2d-b451-44941f2e76bd None None] MFA Rules not processed for user `c3928625e2914cd8969b5b6e47a53af9`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:55.100693 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a5b45839-b3cb-4d2d-b451-44941f2e76bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:55.221544 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2822/5674] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:55 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:55.226924 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b45839-b3cb-4d2d-b451-44941f2e76bd None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:55.227604 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424634d-04ba-4469-82f2-d3e25b657a96 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:55.245583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:55.355526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b45839-b3cb-4d2d-b451-44941f2e76bd None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:55.360736 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187de1a-3882-4285-8bbe-936d84509a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:55.361374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187de1a-3882-4285-8bbe-936d84509a17 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:55.361658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187de1a-3882-4285-8bbe-936d84509a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:55.361935 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187de1a-3882-4285-8bbe-936d84509a17 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:55.362598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187de1a-3882-4285-8bbe-936d84509a17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:55.364733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187de1a-3882-4285-8bbe-936d84509a17 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:55.383590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f88ef-736c-48f7-a883-16b5f1b0a497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:55.384219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f88ef-736c-48f7-a883-16b5f1b0a497 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:55.384855 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f88ef-736c-48f7-a883-16b5f1b0a497 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:55.384855 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f88ef-736c-48f7-a883-16b5f1b0a497 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:55.385409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f88ef-736c-48f7-a883-16b5f1b0a497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:55.387180 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f88ef-736c-48f7-a883-16b5f1b0a497 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:55.402435 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2823/5675] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:13:55 2022] POST /identity/v3/projects => generated 355 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:13:55.406211 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187de1a-3882-4285-8bbe-936d84509a17 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:55.406892 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2853/5676] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:13:55.410923 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f88ef-736c-48f7-a883-16b5f1b0a497 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:55.421279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f88ef-736c-48f7-a883-16b5f1b0a497 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:55.427332 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:55.487849 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187de1a-3882-4285-8bbe-936d84509a17 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:55.494790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21947cd2-1c9b-4c54-9e5b-585e4045f344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:55.495780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21947cd2-1c9b-4c54-9e5b-585e4045f344 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:55.496275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21947cd2-1c9b-4c54-9e5b-585e4045f344 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:55.496911 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21947cd2-1c9b-4c54-9e5b-585e4045f344 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:55.497881 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21947cd2-1c9b-4c54-9e5b-585e4045f344 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:55.501099 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21947cd2-1c9b-4c54-9e5b-585e4045f344 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:55.514160 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98305047-cb6c-427c-981a-6c87c962aeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:55.514895 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98305047-cb6c-427c-981a-6c87c962aeb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:55.515174 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98305047-cb6c-427c-981a-6c87c962aeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:55.515417 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98305047-cb6c-427c-981a-6c87c962aeb7 admin admin] PATH_INFO: `/v3/projects/1d3cbc84db244a21bf87ec5b31d1a9f3/users/a1002fa36ef147c49e6d489f2a4f8dba/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:55.523589 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98305047-cb6c-427c-981a-6c87c962aeb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3cbc84db244a21bf87ec5b31d1a9f3, user_id=a1002fa36ef147c49e6d489f2a4f8dba, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:55.526769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98305047-cb6c-427c-981a-6c87c962aeb7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:55.527861 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2824/5677] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:13:55 2022] POST /identity/v3/users => generated 284 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:13:55.531648 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21947cd2-1c9b-4c54-9e5b-585e4045f344 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:55.552019 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2854/5678] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:13:55 2022] PUT /identity/v3/projects/1d3cbc84db244a21bf87ec5b31d1a9f3/users/a1002fa36ef147c49e6d489f2a4f8dba/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:55.552245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21947cd2-1c9b-4c54-9e5b-585e4045f344 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:55.563421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed32298-f7d5-410e-bc28-9712edb45647 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:55.563863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed32298-f7d5-410e-bc28-9712edb45647 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:55.564256 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed32298-f7d5-410e-bc28-9712edb45647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:55.600648 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-3ed32298-f7d5-410e-bc28-9712edb45647 None None] MFA Rules not processed for user `a1002fa36ef147c49e6d489f2a4f8dba`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:55.601812 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3ed32298-f7d5-410e-bc28-9712edb45647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:55.655513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994140ed-1ccc-4b37-a396-d860d333c606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:55.656473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994140ed-1ccc-4b37-a396-d860d333c606 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:55.657522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994140ed-1ccc-4b37-a396-d860d333c606 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:55.657951 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994140ed-1ccc-4b37-a396-d860d333c606 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:55.659316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994140ed-1ccc-4b37-a396-d860d333c606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:55.661850 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994140ed-1ccc-4b37-a396-d860d333c606 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:55.692170 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2825/5679] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:13:55.697177 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994140ed-1ccc-4b37-a396-d860d333c606 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:55.716057 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994140ed-1ccc-4b37-a396-d860d333c606 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:55.721872 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e4136-5a1b-482f-892c-f03ff008fe7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:55.722891 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e4136-5a1b-482f-892c-f03ff008fe7b admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:55.723449 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e4136-5a1b-482f-892c-f03ff008fe7b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:55.723902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e4136-5a1b-482f-892c-f03ff008fe7b admin admin] PATH_INFO: `/v3/projects/69aefa984e154207bb4b442b7a06ab6b/users/cd7a10fc0fcf4747a2313fc789a94991/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:55.747273 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51e4136-5a1b-482f-892c-f03ff008fe7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=69aefa984e154207bb4b442b7a06ab6b, user_id=cd7a10fc0fcf4747a2313fc789a94991, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:55.754593 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51e4136-5a1b-482f-892c-f03ff008fe7b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:55.756879 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2855/5680] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:55 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:55.758428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed32298-f7d5-410e-bc28-9712edb45647 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:55.761052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3ed32298-f7d5-410e-bc28-9712edb45647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:55.771646 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:55.783479 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2826/5681] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:13:55 2022] PUT /identity/v3/projects/69aefa984e154207bb4b442b7a06ab6b/users/cd7a10fc0fcf4747a2313fc789a94991/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:55.784753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e4136-5a1b-482f-892c-f03ff008fe7b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:55.786678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d51e4136-5a1b-482f-892c-f03ff008fe7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:55.788664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed32298-f7d5-410e-bc28-9712edb45647 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:55.961401 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e4136-5a1b-482f-892c-f03ff008fe7b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:55.965838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75673d9-39e4-4ba7-8980-c6056bdb01f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:55.966329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad6b2e-46d7-4941-af2d-b651f8421aa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:55.966471 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75673d9-39e4-4ba7-8980-c6056bdb01f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:55.966720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75673d9-39e4-4ba7-8980-c6056bdb01f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:55.966995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75673d9-39e4-4ba7-8980-c6056bdb01f5 admin admin] PATH_INFO: `/v3/users/2f2f0789535a4335bb96c70c49ec5641` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:55.967364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad6b2e-46d7-4941-af2d-b651f8421aa7 service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:55.967775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad6b2e-46d7-4941-af2d-b651f8421aa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:55.968149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad6b2e-46d7-4941-af2d-b651f8421aa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:55.970506 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75673d9-39e4-4ba7-8980-c6056bdb01f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f2f0789535a4335bb96c70c49ec5641)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:55.972562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75673d9-39e4-4ba7-8980-c6056bdb01f5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:56.043092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:56.066474 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b75673d9-39e4-4ba7-8980-c6056bdb01f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f2f0789535a4335bb96c70c49ec5641'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:56.078263 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b75673d9-39e4-4ba7-8980-c6056bdb01f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f2f0789535a4335bb96c70c49ec5641'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:56.078993 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b75673d9-39e4-4ba7-8980-c6056bdb01f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f2f0789535a4335bb96c70c49ec5641'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:56.079792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b75673d9-39e4-4ba7-8980-c6056bdb01f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f2f0789535a4335bb96c70c49ec5641'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:56.093171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b75673d9-39e4-4ba7-8980-c6056bdb01f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f2f0789535a4335bb96c70c49ec5641'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:56.129311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ad6b2e-46d7-4941-af2d-b651f8421aa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:56.130872 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ad6b2e-46d7-4941-af2d-b651f8421aa7 service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:56.139463 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2856/5682] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:13:55 2022] DELETE /identity/v3/users/2f2f0789535a4335bb96c70c49ec5641 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:56.140787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75673d9-39e4-4ba7-8980-c6056bdb01f5 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:56.143859 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b75673d9-39e4-4ba7-8980-c6056bdb01f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:56.162453 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2827/5683] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:13:55 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:13:56.165712 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d4be9-a1f9-49d5-84b2-f617503c8d6a None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:56.166002 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d4be9-a1f9-49d5-84b2-f617503c8d6a None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:56.166812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d4be9-a1f9-49d5-84b2-f617503c8d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:56.194934 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-9d3d4be9-a1f9-49d5-84b2-f617503c8d6a None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:56.196388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9d3d4be9-a1f9-49d5-84b2-f617503c8d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:56.350981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75673d9-39e4-4ba7-8980-c6056bdb01f5 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:56.362469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b4169-b43a-4ca2-8294-75a323bd428c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:56.362827 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2828/5684] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:56.365982 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b4169-b43a-4ca2-8294-75a323bd428c admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:56.365982 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b4169-b43a-4ca2-8294-75a323bd428c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:56.366518 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b4169-b43a-4ca2-8294-75a323bd428c admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:56.368686 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b4169-b43a-4ca2-8294-75a323bd428c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:56.373257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b4169-b43a-4ca2-8294-75a323bd428c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:56.386009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46cfd60-7b4a-48a0-afa2-175175f4236e None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:56.386315 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46cfd60-7b4a-48a0-afa2-175175f4236e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:56.387779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46cfd60-7b4a-48a0-afa2-175175f4236e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:56.400229 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2857/5685] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:13:56.404947 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b4169-b43a-4ca2-8294-75a323bd428c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:56.406814 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ef1b4169-b43a-4ca2-8294-75a323bd428c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:56.440515 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a46cfd60-7b4a-48a0-afa2-175175f4236e None None] MFA Rules not processed for user `a6c953ff2f774041a7d50f53033ee124`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:56.441268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a46cfd60-7b4a-48a0-afa2-175175f4236e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:56.517370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:56.556986 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b4169-b43a-4ca2-8294-75a323bd428c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:56.562626 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7420de-0d9c-4619-9bd4-fe5d3c83435d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:56.563305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7420de-0d9c-4619-9bd4-fe5d3c83435d service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:56.563588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7420de-0d9c-4619-9bd4-fe5d3c83435d service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:56.563862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7420de-0d9c-4619-9bd4-fe5d3c83435d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:56.566079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6a7420de-0d9c-4619-9bd4-fe5d3c83435d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:56.602003 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2829/5686] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:56.603555 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46cfd60-7b4a-48a0-afa2-175175f4236e None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:56.605903 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a46cfd60-7b4a-48a0-afa2-175175f4236e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:56.717242 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46cfd60-7b4a-48a0-afa2-175175f4236e None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:56.729088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d1e04-a58b-4f9f-9217-db1354ba1c1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:56.733827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7420de-0d9c-4619-9bd4-fe5d3c83435d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:56.734331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d1e04-a58b-4f9f-9217-db1354ba1c1b service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:56.734580 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d1e04-a58b-4f9f-9217-db1354ba1c1b service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:56.734867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d1e04-a58b-4f9f-9217-db1354ba1c1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:56.737252 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7420de-0d9c-4619-9bd4-fe5d3c83435d service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:56.749400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:56.759252 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d1e04-a58b-4f9f-9217-db1354ba1c1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:56.760579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d1e04-a58b-4f9f-9217-db1354ba1c1b service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:56.765586 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2858/5687] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:13:56 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:13:56.766795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7420de-0d9c-4619-9bd4-fe5d3c83435d service cinder] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:56.786613 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2830/5688] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:13:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:13:56.795920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7420de-0d9c-4619-9bd4-fe5d3c83435d service cinder] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:56.810873 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc38516-094a-4920-8970-c2c4e6825081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:56.811551 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc38516-094a-4920-8970-c2c4e6825081 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:56.812415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc38516-094a-4920-8970-c2c4e6825081 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:56.812707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc38516-094a-4920-8970-c2c4e6825081 admin admin] PATH_INFO: `/v3/projects/69aefa984e154207bb4b442b7a06ab6b/users/cd7a10fc0fcf4747a2313fc789a94991/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:56.825075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc38516-094a-4920-8970-c2c4e6825081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69aefa984e154207bb4b442b7a06ab6b, user_id=cd7a10fc0fcf4747a2313fc789a94991, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:56.827910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc38516-094a-4920-8970-c2c4e6825081 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:56.849010 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2859/5689] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:13:56 2022] PUT /identity/v3/projects/69aefa984e154207bb4b442b7a06ab6b/users/cd7a10fc0fcf4747a2313fc789a94991/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:56.860638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a41fe3-8308-40d8-88e9-14ef38ebe00d None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:56.860929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a41fe3-8308-40d8-88e9-14ef38ebe00d None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:56.861214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a41fe3-8308-40d8-88e9-14ef38ebe00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:56.964941 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-70a41fe3-8308-40d8-88e9-14ef38ebe00d None None] MFA Rules not processed for user `cd7a10fc0fcf4747a2313fc789a94991`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:56.966341 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-70a41fe3-8308-40d8-88e9-14ef38ebe00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:57.218172 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2831/5690] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:56 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:57.223988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc38516-094a-4920-8970-c2c4e6825081 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:57.242004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc38516-094a-4920-8970-c2c4e6825081 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:57.248904 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0977c00-f802-4151-b436-c3546e3532ed tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd7a10fc0fcf4747a2313fc789a94991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69aefa984e154207bb4b442b7a06ab6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:57.249536 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0977c00-f802-4151-b436-c3546e3532ed tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:57.249862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0977c00-f802-4151-b436-c3546e3532ed tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:57.251486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0977c00-f802-4151-b436-c3546e3532ed tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:57.252178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0977c00-f802-4151-b436-c3546e3532ed tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:13:57.253087 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0977c00-f802-4151-b436-c3546e3532ed tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:57.254923 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0977c00-f802-4151-b436-c3546e3532ed tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:57.278911 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2860/5691] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:13:57.283066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a41fe3-8308-40d8-88e9-14ef38ebe00d None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:57.300991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a41fe3-8308-40d8-88e9-14ef38ebe00d None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:57.309061 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10a286-5aea-48ce-9c92-5a85d1658bb9 tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd7a10fc0fcf4747a2313fc789a94991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69aefa984e154207bb4b442b7a06ab6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:57.309699 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10a286-5aea-48ce-9c92-5a85d1658bb9 tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:57.310029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10a286-5aea-48ce-9c92-5a85d1658bb9 tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:57.310900 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10a286-5aea-48ce-9c92-5a85d1658bb9 tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:57.311632 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10a286-5aea-48ce-9c92-5a85d1658bb9 tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:57.313845 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10a286-5aea-48ce-9c92-5a85d1658bb9 tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:57.368227 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2832/5692] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:13:57 2022] POST /identity/v3/projects => generated 350 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:13:57.371539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0977c00-f802-4151-b436-c3546e3532ed tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:57.398533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0977c00-f802-4151-b436-c3546e3532ed tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:57.559348 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10a286-5aea-48ce-9c92-5a85d1658bb9 tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:57.560465 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea35e8-5edf-472b-9518-1f07ad45329f tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd7a10fc0fcf4747a2313fc789a94991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69aefa984e154207bb4b442b7a06ab6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:57.562008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ba10a286-5aea-48ce-9c92-5a85d1658bb9 tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:57.571032 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea35e8-5edf-472b-9518-1f07ad45329f tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:57.572074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea35e8-5edf-472b-9518-1f07ad45329f tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:57.573357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea35e8-5edf-472b-9518-1f07ad45329f tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:57.574289 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea35e8-5edf-472b-9518-1f07ad45329f tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:13:57.576554 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea35e8-5edf-472b-9518-1f07ad45329f tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:57.581252 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea35e8-5edf-472b-9518-1f07ad45329f tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:57.611576 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2861/5693] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:13:57.621262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba7471-e610-4421-8cb0-00a7315bb5e8 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:57.621658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba7471-e610-4421-8cb0-00a7315bb5e8 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:57.622071 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba7471-e610-4421-8cb0-00a7315bb5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:57.680220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-14ba7471-e610-4421-8cb0-00a7315bb5e8 None None] MFA Rules not processed for user `a6c953ff2f774041a7d50f53033ee124`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:57.681193 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:57.685082 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-14ba7471-e610-4421-8cb0-00a7315bb5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:57.734511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10a286-5aea-48ce-9c92-5a85d1658bb9 tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:57.750184 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188cc67c-6404-4cf9-8d12-29e5571ff229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:57.752403 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188cc67c-6404-4cf9-8d12-29e5571ff229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:57.752704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188cc67c-6404-4cf9-8d12-29e5571ff229 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:57.753183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188cc67c-6404-4cf9-8d12-29e5571ff229 admin admin] PATH_INFO: `/v3/projects/14720f3f5b864b4e842408b4a63d4e36` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:57.757580 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188cc67c-6404-4cf9-8d12-29e5571ff229 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14720f3f5b864b4e842408b4a63d4e36)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:57.760101 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188cc67c-6404-4cf9-8d12-29e5571ff229 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:57.830235 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2862/5694] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:13:57.831428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba7471-e610-4421-8cb0-00a7315bb5e8 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:57.897481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-188cc67c-6404-4cf9-8d12-29e5571ff229 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14720f3f5b864b4e842408b4a63d4e36', 'request_id': 'req-188cc67c-6404-4cf9-8d12-29e5571ff229'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:57.915876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-188cc67c-6404-4cf9-8d12-29e5571ff229 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14720f3f5b864b4e842408b4a63d4e36', 'request_id': 'req-188cc67c-6404-4cf9-8d12-29e5571ff229'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:57.931450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-188cc67c-6404-4cf9-8d12-29e5571ff229 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14720f3f5b864b4e842408b4a63d4e36', 'request_id': 'req-188cc67c-6404-4cf9-8d12-29e5571ff229'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:57.962967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-188cc67c-6404-4cf9-8d12-29e5571ff229 admin admin] The token cache is being invalidate because project 14720f3f5b864b4e842408b4a63d4e36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:13:57.963267 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-188cc67c-6404-4cf9-8d12-29e5571ff229 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:57.966964 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-188cc67c-6404-4cf9-8d12-29e5571ff229 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:57.970334 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2833/5695] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:13:57 2022] DELETE /identity/v3/projects/14720f3f5b864b4e842408b4a63d4e36 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:13:57.980130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb4394-3138-4af6-a1c2-81919111bf71 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:57.980418 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb4394-3138-4af6-a1c2-81919111bf71 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:57.980704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb4394-3138-4af6-a1c2-81919111bf71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:58.023818 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-2beb4394-3138-4af6-a1c2-81919111bf71 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:58.027644 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2beb4394-3138-4af6-a1c2-81919111bf71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:58.047942 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba7471-e610-4421-8cb0-00a7315bb5e8 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:58.081747 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:58.116845 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90841e70-9788-425b-b4d4-ca3873c0fe09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:58.117539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90841e70-9788-425b-b4d4-ca3873c0fe09 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:58.117925 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90841e70-9788-425b-b4d4-ca3873c0fe09 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:58.118265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90841e70-9788-425b-b4d4-ca3873c0fe09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:58.124065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-90841e70-9788-425b-b4d4-ca3873c0fe09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:58.272512 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2834/5696] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:58.273360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33f874-483c-482c-a676-949fc4103299 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:58.273849 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33f874-483c-482c-a676-949fc4103299 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:58.274335 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33f874-483c-482c-a676-949fc4103299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:58.356077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-1f33f874-483c-482c-a676-949fc4103299 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:58.358078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1f33f874-483c-482c-a676-949fc4103299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:58.404990 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90841e70-9788-425b-b4d4-ca3873c0fe09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:58.406451 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2835/5697] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:58.408081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33f874-483c-482c-a676-949fc4103299 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:58.413072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90841e70-9788-425b-b4d4-ca3873c0fe09 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:58.419937 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33f874-483c-482c-a676-949fc4103299 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:58.425164 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3e568-15e1-4aa0-90a6-dc765eda4f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:58.425980 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3e568-15e1-4aa0-90a6-dc765eda4f74 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:58.426265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3e568-15e1-4aa0-90a6-dc765eda4f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:58.426813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3e568-15e1-4aa0-90a6-dc765eda4f74 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:58.428667 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3e568-15e1-4aa0-90a6-dc765eda4f74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:13:58.428829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3e568-15e1-4aa0-90a6-dc765eda4f74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:58.430817 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3e568-15e1-4aa0-90a6-dc765eda4f74 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:58.452650 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2836/5698] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:13:58.458195 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3e568-15e1-4aa0-90a6-dc765eda4f74 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:58.463103 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2863/5699] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:13:57 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:13:58.472286 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3e568-15e1-4aa0-90a6-dc765eda4f74 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:58.477668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77805f15-8b20-48b7-b2e5-e4e58dd5839c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:58.480383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77805f15-8b20-48b7-b2e5-e4e58dd5839c admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:58.480682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77805f15-8b20-48b7-b2e5-e4e58dd5839c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:58.480964 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77805f15-8b20-48b7-b2e5-e4e58dd5839c admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:58.481633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77805f15-8b20-48b7-b2e5-e4e58dd5839c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:58.483698 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77805f15-8b20-48b7-b2e5-e4e58dd5839c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:58.565043 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2837/5700] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:13:58 2022] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:13:58.565382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90841e70-9788-425b-b4d4-ca3873c0fe09 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:58.581034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90841e70-9788-425b-b4d4-ca3873c0fe09 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:58.688298 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77805f15-8b20-48b7-b2e5-e4e58dd5839c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:58.755276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:58.757539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a008cf17-1d48-4c9d-86ce-686277a3ab86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:58.758910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008cf17-1d48-4c9d-86ce-686277a3ab86 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:58.759527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008cf17-1d48-4c9d-86ce-686277a3ab86 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:58.759982 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008cf17-1d48-4c9d-86ce-686277a3ab86 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:58.761166 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a008cf17-1d48-4c9d-86ce-686277a3ab86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:58.765374 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a008cf17-1d48-4c9d-86ce-686277a3ab86 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:58.814095 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2864/5701] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:13:58 2022] POST /identity/v3/users => generated 294 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:13:58.814095 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a008cf17-1d48-4c9d-86ce-686277a3ab86 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:58.829384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a008cf17-1d48-4c9d-86ce-686277a3ab86 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:58.834486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fd6ce-2681-4bd5-95fc-1519d3df47e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:58.835308 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fd6ce-2681-4bd5-95fc-1519d3df47e5 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:58.835554 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fd6ce-2681-4bd5-95fc-1519d3df47e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:58.835805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fd6ce-2681-4bd5-95fc-1519d3df47e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:58.836971 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7fd6ce-2681-4bd5-95fc-1519d3df47e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:58.838536 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7fd6ce-2681-4bd5-95fc-1519d3df47e5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:58.852052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77805f15-8b20-48b7-b2e5-e4e58dd5839c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:58.853344 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2865/5702] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:13:58.854347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fd6ce-2681-4bd5-95fc-1519d3df47e5 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:58.871240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86df3bb-60d0-41d6-85d4-dd2bdea7cea2 tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd7a10fc0fcf4747a2313fc789a94991', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69aefa984e154207bb4b442b7a06ab6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:58.871896 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86df3bb-60d0-41d6-85d4-dd2bdea7cea2 tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:58.872288 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86df3bb-60d0-41d6-85d4-dd2bdea7cea2 tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:58.872404 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fd6ce-2681-4bd5-95fc-1519d3df47e5 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:58.872510 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86df3bb-60d0-41d6-85d4-dd2bdea7cea2 tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] PATH_INFO: `/v3/projects/fb97625794f440e99d41151188ac3bdc` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:58.881689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86df3bb-60d0-41d6-85d4-dd2bdea7cea2 tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fb97625794f440e99d41151188ac3bdc)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:58.881689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86df3bb-60d0-41d6-85d4-dd2bdea7cea2 tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:58.887739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08977e80-6c85-4aab-8aaf-0196d099e2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:58.888370 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08977e80-6c85-4aab-8aaf-0196d099e2ae admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:58.888646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08977e80-6c85-4aab-8aaf-0196d099e2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:58.888918 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08977e80-6c85-4aab-8aaf-0196d099e2ae admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:58.889570 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08977e80-6c85-4aab-8aaf-0196d099e2ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:58.891237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08977e80-6c85-4aab-8aaf-0196d099e2ae admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:58.906239 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2866/5703] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:13:58.908323 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacaa0e2-6097-40a1-9d73-36d1a7ba3c07 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:58.908686 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacaa0e2-6097-40a1-9d73-36d1a7ba3c07 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:58.908940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacaa0e2-6097-40a1-9d73-36d1a7ba3c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:58.929658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-bacaa0e2-6097-40a1-9d73-36d1a7ba3c07 None None] MFA Rules not processed for user `a6c953ff2f774041a7d50f53033ee124`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:58.931002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-bacaa0e2-6097-40a1-9d73-36d1a7ba3c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:58.942464 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b86df3bb-60d0-41d6-85d4-dd2bdea7cea2 tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb97625794f440e99d41151188ac3bdc', 'request_id': 'req-b86df3bb-60d0-41d6-85d4-dd2bdea7cea2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:58.971475 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b86df3bb-60d0-41d6-85d4-dd2bdea7cea2 tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb97625794f440e99d41151188ac3bdc', 'request_id': 'req-b86df3bb-60d0-41d6-85d4-dd2bdea7cea2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:58.988353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b86df3bb-60d0-41d6-85d4-dd2bdea7cea2 tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb97625794f440e99d41151188ac3bdc', 'request_id': 'req-b86df3bb-60d0-41d6-85d4-dd2bdea7cea2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:59.017398 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b86df3bb-60d0-41d6-85d4-dd2bdea7cea2 tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] The token cache is being invalidate because project fb97625794f440e99d41151188ac3bdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:13:59.019426 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:59.021233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b86df3bb-60d0-41d6-85d4-dd2bdea7cea2 tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:59.022870 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b86df3bb-60d0-41d6-85d4-dd2bdea7cea2 tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:59.030658 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2838/5704] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:13:58 2022] DELETE /identity/v3/projects/fb97625794f440e99d41151188ac3bdc => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:13:59.030658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86df3bb-60d0-41d6-85d4-dd2bdea7cea2 tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:59.040362 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b86df3bb-60d0-41d6-85d4-dd2bdea7cea2 tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:59.049531 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2867/5705] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:59.248262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86df3bb-60d0-41d6-85d4-dd2bdea7cea2 tempest-QuotasTest-429841673 tempest-QuotasTest-429841673-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:59.256857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05228f93-d07d-42f7-9388-c0081c4890f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:59.257880 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05228f93-d07d-42f7-9388-c0081c4890f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:59.258427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05228f93-d07d-42f7-9388-c0081c4890f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:59.258974 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05228f93-d07d-42f7-9388-c0081c4890f8 admin admin] PATH_INFO: `/v3/projects/8b330a8749614ea2b9b8b02369a0f97d/users/e317da86c85747e2a2cd33eaae316f35/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:59.293154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05228f93-d07d-42f7-9388-c0081c4890f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b330a8749614ea2b9b8b02369a0f97d, user_id=e317da86c85747e2a2cd33eaae316f35, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:59.296487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05228f93-d07d-42f7-9388-c0081c4890f8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:59.343653 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2839/5706] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:13:59 2022] PUT /identity/v3/projects/8b330a8749614ea2b9b8b02369a0f97d/users/e317da86c85747e2a2cd33eaae316f35/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:59.355037 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37753fd4-bf60-4184-addd-d084f55cdba7 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:59.355462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37753fd4-bf60-4184-addd-d084f55cdba7 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:59.355574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37753fd4-bf60-4184-addd-d084f55cdba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:59.437425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-37753fd4-bf60-4184-addd-d084f55cdba7 None None] MFA Rules not processed for user `e317da86c85747e2a2cd33eaae316f35`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:59.438511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05228f93-d07d-42f7-9388-c0081c4890f8 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:59.440297 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-05228f93-d07d-42f7-9388-c0081c4890f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:59.451441 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-37753fd4-bf60-4184-addd-d084f55cdba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:59.549237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:59.624909 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05228f93-d07d-42f7-9388-c0081c4890f8 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:59.637353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023274be-d2b2-4867-bbf3-b23cdc78e2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:59.638434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023274be-d2b2-4867-bbf3-b23cdc78e2e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:59.640576 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023274be-d2b2-4867-bbf3-b23cdc78e2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:59.641116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023274be-d2b2-4867-bbf3-b23cdc78e2e3 admin admin] PATH_INFO: `/v3/users/c3928625e2914cd8969b5b6e47a53af9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:59.642414 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2868/5707] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:13:59.644709 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023274be-d2b2-4867-bbf3-b23cdc78e2e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3928625e2914cd8969b5b6e47a53af9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:59.647425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37753fd4-bf60-4184-addd-d084f55cdba7 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:59.652496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023274be-d2b2-4867-bbf3-b23cdc78e2e3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:59.681723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37753fd4-bf60-4184-addd-d084f55cdba7 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:13:59.686992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3fd92-4ddf-4f64-91d2-e2b0e58589d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:13:59.689493 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3fd92-4ddf-4f64-91d2-e2b0e58589d4 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:59.696042 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3fd92-4ddf-4f64-91d2-e2b0e58589d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:59.696943 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3fd92-4ddf-4f64-91d2-e2b0e58589d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:59.698101 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb3fd92-4ddf-4f64-91d2-e2b0e58589d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:13:59.700772 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb3fd92-4ddf-4f64-91d2-e2b0e58589d4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:13:59.752797 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2869/5708] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:13:59 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:13:59.759559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3fd92-4ddf-4f64-91d2-e2b0e58589d4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:13:59.777895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-023274be-d2b2-4867-bbf3-b23cdc78e2e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3928625e2914cd8969b5b6e47a53af9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:59.779130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-023274be-d2b2-4867-bbf3-b23cdc78e2e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3928625e2914cd8969b5b6e47a53af9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:59.783775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-023274be-d2b2-4867-bbf3-b23cdc78e2e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3928625e2914cd8969b5b6e47a53af9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:59.801586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-023274be-d2b2-4867-bbf3-b23cdc78e2e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3928625e2914cd8969b5b6e47a53af9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:59.826075 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-023274be-d2b2-4867-bbf3-b23cdc78e2e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3928625e2914cd8969b5b6e47a53af9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:13:59.854474 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2840/5709] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:13:59 2022] DELETE /identity/v3/users/c3928625e2914cd8969b5b6e47a53af9 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:13:59.859204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0959f-d9e7-40b8-b93e-485618636ee0 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:13:59.859583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0959f-d9e7-40b8-b93e-485618636ee0 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:13:59.860304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0959f-d9e7-40b8-b93e-485618636ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:13:59.903591 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-50d0959f-d9e7-40b8-b93e-485618636ee0 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:13:59.904823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-50d0959f-d9e7-40b8-b93e-485618636ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:13:59.906575 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3fd92-4ddf-4f64-91d2-e2b0e58589d4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:00.028931 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce893dae-3317-40d3-862c-1a0bb596f09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:00.032131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce893dae-3317-40d3-862c-1a0bb596f09b admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:00.032635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce893dae-3317-40d3-862c-1a0bb596f09b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:00.033497 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce893dae-3317-40d3-862c-1a0bb596f09b admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:00.036138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce893dae-3317-40d3-862c-1a0bb596f09b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:00.039799 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce893dae-3317-40d3-862c-1a0bb596f09b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:00.074503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:00.084730 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2841/5710] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:00.109864 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2870/5711] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:13:59 2022] POST /identity/v3/users => generated 300 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:14:00.111185 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d0959f-d9e7-40b8-b93e-485618636ee0 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:00.112787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-50d0959f-d9e7-40b8-b93e-485618636ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:00.116283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce893dae-3317-40d3-862c-1a0bb596f09b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:00.123126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ce893dae-3317-40d3-862c-1a0bb596f09b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:00.135351 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d0959f-d9e7-40b8-b93e-485618636ee0 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:00.148615 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d681a9-90a5-47fa-b45f-3dfa31b96bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:00.149244 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d681a9-90a5-47fa-b45f-3dfa31b96bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:00.149526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d681a9-90a5-47fa-b45f-3dfa31b96bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:00.149795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d681a9-90a5-47fa-b45f-3dfa31b96bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:00.150442 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d681a9-90a5-47fa-b45f-3dfa31b96bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:00.152650 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d681a9-90a5-47fa-b45f-3dfa31b96bd1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:00.177366 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2842/5712] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:14:00.179566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d681a9-90a5-47fa-b45f-3dfa31b96bd1 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:00.192811 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d681a9-90a5-47fa-b45f-3dfa31b96bd1 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:00.204443 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba2426-a647-40a2-aca6-3eca7cfc2b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:00.205413 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba2426-a647-40a2-aca6-3eca7cfc2b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:00.206013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba2426-a647-40a2-aca6-3eca7cfc2b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:00.206379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba2426-a647-40a2-aca6-3eca7cfc2b4b admin admin] PATH_INFO: `/v3/projects/0b42131c30514ea895610191bb6df8af/users/61594c14183242aa8b3b156370547b3d/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:00.229191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba2426-a647-40a2-aca6-3eca7cfc2b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b42131c30514ea895610191bb6df8af, user_id=61594c14183242aa8b3b156370547b3d, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:00.232864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba2426-a647-40a2-aca6-3eca7cfc2b4b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:00.258594 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2843/5713] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:14:00 2022] PUT /identity/v3/projects/0b42131c30514ea895610191bb6df8af/users/61594c14183242aa8b3b156370547b3d/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:00.262298 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba2426-a647-40a2-aca6-3eca7cfc2b4b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:00.276903 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce893dae-3317-40d3-862c-1a0bb596f09b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:00.336024 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:00.416255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6807ad-fc58-4985-a6eb-cf4bd9c2a8e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:00.416532 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba2426-a647-40a2-aca6-3eca7cfc2b4b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:00.419104 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6807ad-fc58-4985-a6eb-cf4bd9c2a8e0 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:00.419764 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6807ad-fc58-4985-a6eb-cf4bd9c2a8e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:00.420683 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6807ad-fc58-4985-a6eb-cf4bd9c2a8e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:00.430895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f8bdb-c2f3-4ad5-b22e-d757fcb6a42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:00.431535 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f8bdb-c2f3-4ad5-b22e-d757fcb6a42f admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:00.431818 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f8bdb-c2f3-4ad5-b22e-d757fcb6a42f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:00.432091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f8bdb-c2f3-4ad5-b22e-d757fcb6a42f admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:00.432795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f8bdb-c2f3-4ad5-b22e-d757fcb6a42f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:00.436624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f8bdb-c2f3-4ad5-b22e-d757fcb6a42f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:00.444699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6807ad-fc58-4985-a6eb-cf4bd9c2a8e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:00.449093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6807ad-fc58-4985-a6eb-cf4bd9c2a8e0 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:00.469819 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2844/5714] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:14:00.471782 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f8bdb-c2f3-4ad5-b22e-d757fcb6a42f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:00.486137 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f8bdb-c2f3-4ad5-b22e-d757fcb6a42f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:00.490775 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2871/5715] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:14:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:14:00.496594 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101ac87-e1b1-46da-8b5f-c5c58c8df7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:00.497460 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101ac87-e1b1-46da-8b5f-c5c58c8df7a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:00.497915 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101ac87-e1b1-46da-8b5f-c5c58c8df7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:00.498429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101ac87-e1b1-46da-8b5f-c5c58c8df7a7 admin admin] PATH_INFO: `/v3/projects/0b42131c30514ea895610191bb6df8af/users/61594c14183242aa8b3b156370547b3d/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:00.501256 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101ac87-e1b1-46da-8b5f-c5c58c8df7a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b42131c30514ea895610191bb6df8af, user_id=61594c14183242aa8b3b156370547b3d, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:00.505120 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101ac87-e1b1-46da-8b5f-c5c58c8df7a7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:00.535765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db445d1e-490e-45a6-ab67-fbf36302925f None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:00.535765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db445d1e-490e-45a6-ab67-fbf36302925f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:00.535765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db445d1e-490e-45a6-ab67-fbf36302925f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:00.538847 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2845/5716] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:14:00 2022] PUT /identity/v3/projects/0b42131c30514ea895610191bb6df8af/users/61594c14183242aa8b3b156370547b3d/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:00.608489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-db445d1e-490e-45a6-ab67-fbf36302925f None None] MFA Rules not processed for user `61594c14183242aa8b3b156370547b3d`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:00.619634 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-db445d1e-490e-45a6-ab67-fbf36302925f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:00.766880 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924dfcb-1077-4458-a4a6-b75c031562bd None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:00.767090 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924dfcb-1077-4458-a4a6-b75c031562bd None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:00.767363 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924dfcb-1077-4458-a4a6-b75c031562bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:00.812151 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-4924dfcb-1077-4458-a4a6-b75c031562bd None None] MFA Rules not processed for user `a6c953ff2f774041a7d50f53033ee124`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:00.816634 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4924dfcb-1077-4458-a4a6-b75c031562bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:00.882852 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2872/5717] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:00 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:00.890779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db445d1e-490e-45a6-ab67-fbf36302925f None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:00.893089 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-db445d1e-490e-45a6-ab67-fbf36302925f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:00.954358 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2846/5718] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:00.996588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:01.061277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db445d1e-490e-45a6-ab67-fbf36302925f None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:01.067251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4888dd5c-375d-4053-add8-34a031777c8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:01.067976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888dd5c-375d-4053-add8-34a031777c8a service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:01.068334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888dd5c-375d-4053-add8-34a031777c8a service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:01.068702 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888dd5c-375d-4053-add8-34a031777c8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:01.081095 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4888dd5c-375d-4053-add8-34a031777c8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:01.083019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4888dd5c-375d-4053-add8-34a031777c8a service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:01.096416 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2873/5719] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:14:00 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:14:01.206310 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924dfcb-1077-4458-a4a6-b75c031562bd None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:01.336629 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924dfcb-1077-4458-a4a6-b75c031562bd None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:01.347535 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4398ce-05f8-475f-ab58-066292dad9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:01.348196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4398ce-05f8-475f-ab58-066292dad9d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:01.348688 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4398ce-05f8-475f-ab58-066292dad9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:01.349154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4398ce-05f8-475f-ab58-066292dad9d5 admin admin] PATH_INFO: `/v3/users/e317da86c85747e2a2cd33eaae316f35` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:01.355153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4398ce-05f8-475f-ab58-066292dad9d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e317da86c85747e2a2cd33eaae316f35)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:01.357477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4398ce-05f8-475f-ab58-066292dad9d5 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:01.489972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5f4398ce-05f8-475f-ab58-066292dad9d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e317da86c85747e2a2cd33eaae316f35'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:01.491311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5f4398ce-05f8-475f-ab58-066292dad9d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e317da86c85747e2a2cd33eaae316f35'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:01.492197 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5f4398ce-05f8-475f-ab58-066292dad9d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e317da86c85747e2a2cd33eaae316f35'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:01.508229 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5f4398ce-05f8-475f-ab58-066292dad9d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e317da86c85747e2a2cd33eaae316f35'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:01.511483 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:01.516034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4888dd5c-375d-4053-add8-34a031777c8a service cinder] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:01.520300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4888dd5c-375d-4053-add8-34a031777c8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:01.534135 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5f4398ce-05f8-475f-ab58-066292dad9d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e317da86c85747e2a2cd33eaae316f35'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:01.557788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4888dd5c-375d-4053-add8-34a031777c8a service cinder] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:01.565235 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2847/5720] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:14:01 2022] DELETE /identity/v3/users/e317da86c85747e2a2cd33eaae316f35 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:01.569320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f596d37b-3bd7-499d-b471-aee513cfb5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:01.570736 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b6f6e-fafe-43e9-955a-586dc141f289 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:01.571025 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b6f6e-fafe-43e9-955a-586dc141f289 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:01.571302 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b6f6e-fafe-43e9-955a-586dc141f289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:01.571440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596d37b-3bd7-499d-b471-aee513cfb5f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:01.571672 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596d37b-3bd7-499d-b471-aee513cfb5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:01.571922 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596d37b-3bd7-499d-b471-aee513cfb5f0 admin admin] PATH_INFO: `/v3/projects/4899e26849914450b0ffcceb2413f302` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:01.573253 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f596d37b-3bd7-499d-b471-aee513cfb5f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4899e26849914450b0ffcceb2413f302)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:01.575338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f596d37b-3bd7-499d-b471-aee513cfb5f0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:01.594320 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-ef5b6f6e-fafe-43e9-955a-586dc141f289 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:01.596621 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ef5b6f6e-fafe-43e9-955a-586dc141f289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:01.636534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f596d37b-3bd7-499d-b471-aee513cfb5f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4899e26849914450b0ffcceb2413f302', 'request_id': 'req-f596d37b-3bd7-499d-b471-aee513cfb5f0'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:01.645058 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f596d37b-3bd7-499d-b471-aee513cfb5f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4899e26849914450b0ffcceb2413f302', 'request_id': 'req-f596d37b-3bd7-499d-b471-aee513cfb5f0'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:01.669325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f596d37b-3bd7-499d-b471-aee513cfb5f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4899e26849914450b0ffcceb2413f302', 'request_id': 'req-f596d37b-3bd7-499d-b471-aee513cfb5f0'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:01.692466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f596d37b-3bd7-499d-b471-aee513cfb5f0 admin admin] The token cache is being invalidate because project 4899e26849914450b0ffcceb2413f302 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:14:01.692869 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f596d37b-3bd7-499d-b471-aee513cfb5f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:01.695286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f596d37b-3bd7-499d-b471-aee513cfb5f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:01.697864 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2874/5721] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:14:01 2022] DELETE /identity/v3/projects/4899e26849914450b0ffcceb2413f302 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:01.701941 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f596d37b-3bd7-499d-b471-aee513cfb5f0 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:01.704476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f596d37b-3bd7-499d-b471-aee513cfb5f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:01.760793 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2848/5722] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:14:01.803326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b6f6e-fafe-43e9-955a-586dc141f289 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:01.807781 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ef5b6f6e-fafe-43e9-955a-586dc141f289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:01.846117 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f596d37b-3bd7-499d-b471-aee513cfb5f0 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:01.867180 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980fa5d-ae6c-4e86-a8af-22d59c2e5f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:01.868133 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980fa5d-ae6c-4e86-a8af-22d59c2e5f7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:01.869367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980fa5d-ae6c-4e86-a8af-22d59c2e5f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:01.871765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980fa5d-ae6c-4e86-a8af-22d59c2e5f7a admin admin] PATH_INFO: `/v3/users/cd7a10fc0fcf4747a2313fc789a94991` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:01.874417 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980fa5d-ae6c-4e86-a8af-22d59c2e5f7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd7a10fc0fcf4747a2313fc789a94991)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:01.881071 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980fa5d-ae6c-4e86-a8af-22d59c2e5f7a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:01.974044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b6f6e-fafe-43e9-955a-586dc141f289 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:02.072113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9980fa5d-ae6c-4e86-a8af-22d59c2e5f7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd7a10fc0fcf4747a2313fc789a94991'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:02.081299 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9980fa5d-ae6c-4e86-a8af-22d59c2e5f7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd7a10fc0fcf4747a2313fc789a94991'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:02.082213 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9980fa5d-ae6c-4e86-a8af-22d59c2e5f7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd7a10fc0fcf4747a2313fc789a94991'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:02.083608 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9980fa5d-ae6c-4e86-a8af-22d59c2e5f7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd7a10fc0fcf4747a2313fc789a94991'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:02.096371 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b103907-6b3f-4f6c-975e-a269eb70b0b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:02.097073 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b103907-6b3f-4f6c-975e-a269eb70b0b3 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:02.097409 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b103907-6b3f-4f6c-975e-a269eb70b0b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:02.097741 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b103907-6b3f-4f6c-975e-a269eb70b0b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:02.100442 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9980fa5d-ae6c-4e86-a8af-22d59c2e5f7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd7a10fc0fcf4747a2313fc789a94991'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:02.102088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7b103907-6b3f-4f6c-975e-a269eb70b0b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:02.117099 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:02.119807 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b103907-6b3f-4f6c-975e-a269eb70b0b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:02.121348 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b103907-6b3f-4f6c-975e-a269eb70b0b3 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:02.134599 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2849/5723] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:14:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:14:02.197316 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2875/5724] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:14:01 2022] DELETE /identity/v3/users/cd7a10fc0fcf4747a2313fc789a94991 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:14:03.360279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b103907-6b3f-4f6c-975e-a269eb70b0b3 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:03.365473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7b103907-6b3f-4f6c-975e-a269eb70b0b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:03.420410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b103907-6b3f-4f6c-975e-a269eb70b0b3 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:03.473393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895d689-49db-4937-a90f-72a53ad9261b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:03.475112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895d689-49db-4937-a90f-72a53ad9261b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:03.475894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895d689-49db-4937-a90f-72a53ad9261b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:03.516798 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:03.538943 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-9895d689-49db-4937-a90f-72a53ad9261b None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:03.540784 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9895d689-49db-4937-a90f-72a53ad9261b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:03.594043 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2af25-f0e1-4427-ae0f-73f336733895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:03.594764 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2af25-f0e1-4427-ae0f-73f336733895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:03.595052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2af25-f0e1-4427-ae0f-73f336733895 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:03.595329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2af25-f0e1-4427-ae0f-73f336733895 admin admin] PATH_INFO: `/v3/projects/8b330a8749614ea2b9b8b02369a0f97d` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:03.597024 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2af25-f0e1-4427-ae0f-73f336733895 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b330a8749614ea2b9b8b02369a0f97d)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:03.599005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2af25-f0e1-4427-ae0f-73f336733895 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:03.710321 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2876/5725] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:14:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:03.711598 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895d689-49db-4937-a90f-72a53ad9261b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:03.716131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9895d689-49db-4937-a90f-72a53ad9261b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:03.759614 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895d689-49db-4937-a90f-72a53ad9261b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:03.767482 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b0c37-51ab-4fc7-b9dc-4999acf24026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:03.768281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b0c37-51ab-4fc7-b9dc-4999acf24026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:03.768657 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b0c37-51ab-4fc7-b9dc-4999acf24026 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:03.769030 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b0c37-51ab-4fc7-b9dc-4999acf24026 admin admin] PATH_INFO: `/v3/projects/69aefa984e154207bb4b442b7a06ab6b` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:03.770596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b0c37-51ab-4fc7-b9dc-4999acf24026 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69aefa984e154207bb4b442b7a06ab6b)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:03.773488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b0c37-51ab-4fc7-b9dc-4999acf24026 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:03.858014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c62b0c37-51ab-4fc7-b9dc-4999acf24026 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69aefa984e154207bb4b442b7a06ab6b', 'request_id': 'req-c62b0c37-51ab-4fc7-b9dc-4999acf24026'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:03.868713 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c62b0c37-51ab-4fc7-b9dc-4999acf24026 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69aefa984e154207bb4b442b7a06ab6b', 'request_id': 'req-c62b0c37-51ab-4fc7-b9dc-4999acf24026'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:03.872856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-94f2af25-f0e1-4427-ae0f-73f336733895 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b330a8749614ea2b9b8b02369a0f97d', 'request_id': 'req-94f2af25-f0e1-4427-ae0f-73f336733895'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:03.882107 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c62b0c37-51ab-4fc7-b9dc-4999acf24026 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69aefa984e154207bb4b442b7a06ab6b', 'request_id': 'req-c62b0c37-51ab-4fc7-b9dc-4999acf24026'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:03.908089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-94f2af25-f0e1-4427-ae0f-73f336733895 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b330a8749614ea2b9b8b02369a0f97d', 'request_id': 'req-94f2af25-f0e1-4427-ae0f-73f336733895'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:03.926928 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-94f2af25-f0e1-4427-ae0f-73f336733895 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b330a8749614ea2b9b8b02369a0f97d', 'request_id': 'req-94f2af25-f0e1-4427-ae0f-73f336733895'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:03.931785 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c62b0c37-51ab-4fc7-b9dc-4999acf24026 admin admin] The token cache is being invalidate because project 69aefa984e154207bb4b442b7a06ab6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:14:03.932173 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c62b0c37-51ab-4fc7-b9dc-4999acf24026 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:03.933855 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c62b0c37-51ab-4fc7-b9dc-4999acf24026 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:03.936859 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2877/5726] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:14:03 2022] DELETE /identity/v3/projects/69aefa984e154207bb4b442b7a06ab6b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:03.938200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b0c37-51ab-4fc7-b9dc-4999acf24026 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:03.942048 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c62b0c37-51ab-4fc7-b9dc-4999acf24026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:03.958909 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-94f2af25-f0e1-4427-ae0f-73f336733895 admin admin] The token cache is being invalidate because project 8b330a8749614ea2b9b8b02369a0f97d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:14:03.959363 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-94f2af25-f0e1-4427-ae0f-73f336733895 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:03.960208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-94f2af25-f0e1-4427-ae0f-73f336733895 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:03.962649 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2850/5727] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:14:03 2022] DELETE /identity/v3/projects/8b330a8749614ea2b9b8b02369a0f97d => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:03.973789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48945b-e9c6-4e83-ad0e-a4601d96fae0 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:03.975077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48945b-e9c6-4e83-ad0e-a4601d96fae0 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:03.978054 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48945b-e9c6-4e83-ad0e-a4601d96fae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:04.070356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-6e48945b-e9c6-4e83-ad0e-a4601d96fae0 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:04.073898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6e48945b-e9c6-4e83-ad0e-a4601d96fae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:04.135721 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:04.144608 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b0c37-51ab-4fc7-b9dc-4999acf24026 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:04.156470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3b302-8b78-4171-8be5-96e0e8507865 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:04.157628 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3b302-8b78-4171-8be5-96e0e8507865 service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:04.158267 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3b302-8b78-4171-8be5-96e0e8507865 service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:04.159139 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3b302-8b78-4171-8be5-96e0e8507865 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:04.161796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-74c3b302-8b78-4171-8be5-96e0e8507865 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:04.251777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c3b302-8b78-4171-8be5-96e0e8507865 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:04.254419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c3b302-8b78-4171-8be5-96e0e8507865 service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:04.259382 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2851/5728] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:04.262251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48945b-e9c6-4e83-ad0e-a4601d96fae0 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:04.268665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6e48945b-e9c6-4e83-ad0e-a4601d96fae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:04.272192 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2878/5729] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:14:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:14:04.275448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7e8a3-c3dd-4130-8f5d-a27c99ff34eb None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:04.275889 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7e8a3-c3dd-4130-8f5d-a27c99ff34eb None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:04.276207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7e8a3-c3dd-4130-8f5d-a27c99ff34eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:04.337062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48945b-e9c6-4e83-ad0e-a4601d96fae0 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:04.342843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-28e7e8a3-c3dd-4130-8f5d-a27c99ff34eb None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:04.346151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-28e7e8a3-c3dd-4130-8f5d-a27c99ff34eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:04.359672 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfc432-8844-4b93-860e-66b90c6d2870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:04.360619 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfc432-8844-4b93-860e-66b90c6d2870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:04.362355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfc432-8844-4b93-860e-66b90c6d2870 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:04.366747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfc432-8844-4b93-860e-66b90c6d2870 admin admin] PATH_INFO: `/v3/users/61594c14183242aa8b3b156370547b3d` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:04.371480 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2879/5730] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:04.372252 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bfc432-8844-4b93-860e-66b90c6d2870 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61594c14183242aa8b3b156370547b3d)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:04.377054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7e8a3-c3dd-4130-8f5d-a27c99ff34eb None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:04.394362 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bfc432-8844-4b93-860e-66b90c6d2870 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:04.414219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7e8a3-c3dd-4130-8f5d-a27c99ff34eb None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:04.442819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af595e09-178e-4713-996f-c7ca26079abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:04.455633 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af595e09-178e-4713-996f-c7ca26079abc admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:04.455633 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af595e09-178e-4713-996f-c7ca26079abc admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:04.455633 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af595e09-178e-4713-996f-c7ca26079abc admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:04.455633 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af595e09-178e-4713-996f-c7ca26079abc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:14:04.455633 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af595e09-178e-4713-996f-c7ca26079abc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:04.457008 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af595e09-178e-4713-996f-c7ca26079abc admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:04.546653 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2880/5731] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:14:04.551536 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af595e09-178e-4713-996f-c7ca26079abc admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:04.555597 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-08bfc432-8844-4b93-860e-66b90c6d2870 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61594c14183242aa8b3b156370547b3d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:04.556534 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-08bfc432-8844-4b93-860e-66b90c6d2870 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61594c14183242aa8b3b156370547b3d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:04.557212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-08bfc432-8844-4b93-860e-66b90c6d2870 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61594c14183242aa8b3b156370547b3d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:04.575778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af595e09-178e-4713-996f-c7ca26079abc admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:04.576867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-08bfc432-8844-4b93-860e-66b90c6d2870 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61594c14183242aa8b3b156370547b3d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:04.587138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:04.587492 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054147d-ab9c-4650-9258-80adf2ad45e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:04.590805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054147d-ab9c-4650-9258-80adf2ad45e1 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:04.591273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054147d-ab9c-4650-9258-80adf2ad45e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:04.591953 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054147d-ab9c-4650-9258-80adf2ad45e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:04.592753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8054147d-ab9c-4650-9258-80adf2ad45e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:04.595576 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8054147d-ab9c-4650-9258-80adf2ad45e1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:04.620848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-08bfc432-8844-4b93-860e-66b90c6d2870 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61594c14183242aa8b3b156370547b3d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:04.673067 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2881/5732] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:14:04 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:14:04.674055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054147d-ab9c-4650-9258-80adf2ad45e1 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:04.676514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8054147d-ab9c-4650-9258-80adf2ad45e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:04.681844 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2852/5733] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:14:04 2022] DELETE /identity/v3/users/61594c14183242aa8b3b156370547b3d => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:04.812704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054147d-ab9c-4650-9258-80adf2ad45e1 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:04.820619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f21048-cdd8-4484-8e27-1c23cbcf0d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:04.821254 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f21048-cdd8-4484-8e27-1c23cbcf0d0c admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:04.821537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f21048-cdd8-4484-8e27-1c23cbcf0d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:04.821884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f21048-cdd8-4484-8e27-1c23cbcf0d0c admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:04.822517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f21048-cdd8-4484-8e27-1c23cbcf0d0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:04.830320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f21048-cdd8-4484-8e27-1c23cbcf0d0c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:04.880152 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2882/5734] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:14:04 2022] POST /identity/v3/users => generated 289 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:14:04.881382 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfc432-8844-4b93-860e-66b90c6d2870 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:05.024238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfc432-8844-4b93-860e-66b90c6d2870 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:05.032379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382ca47-0966-410e-85fe-92c9bd82b5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:05.033142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382ca47-0966-410e-85fe-92c9bd82b5a0 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:05.035874 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382ca47-0966-410e-85fe-92c9bd82b5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:05.036313 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382ca47-0966-410e-85fe-92c9bd82b5a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:05.037281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382ca47-0966-410e-85fe-92c9bd82b5a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:05.040452 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382ca47-0966-410e-85fe-92c9bd82b5a0 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:05.082597 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2853/5735] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:14:05.084500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f21048-cdd8-4484-8e27-1c23cbcf0d0c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:05.101322 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f21048-cdd8-4484-8e27-1c23cbcf0d0c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:05.111888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec8b0d-73f0-4988-9714-ea67e7598dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:05.112517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec8b0d-73f0-4988-9714-ea67e7598dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:05.112791 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec8b0d-73f0-4988-9714-ea67e7598dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:05.113062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec8b0d-73f0-4988-9714-ea67e7598dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:05.113954 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec8b0d-73f0-4988-9714-ea67e7598dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:05.120211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec8b0d-73f0-4988-9714-ea67e7598dd9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:05.151866 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2883/5736] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:14:05.153463 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382ca47-0966-410e-85fe-92c9bd82b5a0 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:05.180077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382ca47-0966-410e-85fe-92c9bd82b5a0 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:05.188970 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eca7ef-f700-4423-ae04-2d2b22065c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:05.189445 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eca7ef-f700-4423-ae04-2d2b22065c54 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:05.189733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eca7ef-f700-4423-ae04-2d2b22065c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:05.190015 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eca7ef-f700-4423-ae04-2d2b22065c54 admin admin] PATH_INFO: `/v3/projects/a3646bb4452046c6abcd8a2f2972bd5b/users/b87adf6e088f444ba48deda976bfa497/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:05.197184 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec8b0d-73f0-4988-9714-ea67e7598dd9 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:05.199617 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0aec8b0d-73f0-4988-9714-ea67e7598dd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:05.222396 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec8b0d-73f0-4988-9714-ea67e7598dd9 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:05.234897 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eca7ef-f700-4423-ae04-2d2b22065c54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3646bb4452046c6abcd8a2f2972bd5b, user_id=b87adf6e088f444ba48deda976bfa497, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:05.236694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f001a-6136-4405-b843-ab5b063096ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:05.237347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f001a-6136-4405-b843-ab5b063096ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:05.237634 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f001a-6136-4405-b843-ab5b063096ba admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:05.237911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f001a-6136-4405-b843-ab5b063096ba admin admin] PATH_INFO: `/v3/projects/0b42131c30514ea895610191bb6df8af` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:05.244971 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f001a-6136-4405-b843-ab5b063096ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b42131c30514ea895610191bb6df8af)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:05.246052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eca7ef-f700-4423-ae04-2d2b22065c54 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:05.250881 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f001a-6136-4405-b843-ab5b063096ba admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:05.287137 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2854/5737] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:14:05 2022] PUT /identity/v3/projects/a3646bb4452046c6abcd8a2f2972bd5b/users/b87adf6e088f444ba48deda976bfa497/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:05.288937 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea668287-c8e2-4567-a168-d3f425545bd9 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:05.289281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea668287-c8e2-4567-a168-d3f425545bd9 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:05.289567 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea668287-c8e2-4567-a168-d3f425545bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:05.352052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:05.357997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-ea668287-c8e2-4567-a168-d3f425545bd9 None None] MFA Rules not processed for user `b87adf6e088f444ba48deda976bfa497`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:05.361029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ea668287-c8e2-4567-a168-d3f425545bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:05.375285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3c5f001a-6136-4405-b843-ab5b063096ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b42131c30514ea895610191bb6df8af', 'request_id': 'req-3c5f001a-6136-4405-b843-ab5b063096ba'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:05.388500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3c5f001a-6136-4405-b843-ab5b063096ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b42131c30514ea895610191bb6df8af', 'request_id': 'req-3c5f001a-6136-4405-b843-ab5b063096ba'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:05.403826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3c5f001a-6136-4405-b843-ab5b063096ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b42131c30514ea895610191bb6df8af', 'request_id': 'req-3c5f001a-6136-4405-b843-ab5b063096ba'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:05.435706 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3c5f001a-6136-4405-b843-ab5b063096ba admin admin] The token cache is being invalidate because project 0b42131c30514ea895610191bb6df8af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:14:05.436063 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3c5f001a-6136-4405-b843-ab5b063096ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:05.436808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3c5f001a-6136-4405-b843-ab5b063096ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:05.500564 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2884/5738] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:14:05 2022] DELETE /identity/v3/projects/0b42131c30514ea895610191bb6df8af => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:05.506172 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5fea6-e66d-4c4b-877b-f78ca6f83089 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:05.506172 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5fea6-e66d-4c4b-877b-f78ca6f83089 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:05.506490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5fea6-e66d-4c4b-877b-f78ca6f83089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:05.528784 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-03d5fea6-e66d-4c4b-877b-f78ca6f83089 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:05.544229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-03d5fea6-e66d-4c4b-877b-f78ca6f83089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:05.585927 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2855/5739] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:05.590527 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea668287-c8e2-4567-a168-d3f425545bd9 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:05.599913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ea668287-c8e2-4567-a168-d3f425545bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:05.753242 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2885/5740] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:05.762394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51751a7e-2337-429e-84b1-4bb6b80a48a7 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:05.763159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51751a7e-2337-429e-84b1-4bb6b80a48a7 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:05.763626 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51751a7e-2337-429e-84b1-4bb6b80a48a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:05.791026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:05.904629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-51751a7e-2337-429e-84b1-4bb6b80a48a7 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:05.911782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-51751a7e-2337-429e-84b1-4bb6b80a48a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:05.948723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea668287-c8e2-4567-a168-d3f425545bd9 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:05.959021 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2886/5741] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:05.960863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51751a7e-2337-429e-84b1-4bb6b80a48a7 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:05.978062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c206ed-acc1-4d3c-9796-f587c3dbfad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:05.978908 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c206ed-acc1-4d3c-9796-f587c3dbfad8 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:05.982610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c206ed-acc1-4d3c-9796-f587c3dbfad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:05.982783 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c206ed-acc1-4d3c-9796-f587c3dbfad8 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:05.983546 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c206ed-acc1-4d3c-9796-f587c3dbfad8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:05.995598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c206ed-acc1-4d3c-9796-f587c3dbfad8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:06.004617 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51751a7e-2337-429e-84b1-4bb6b80a48a7 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:06.028019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735c410-6040-451e-9674-b09da389d7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:06.038825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735c410-6040-451e-9674-b09da389d7d3 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:06.038825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735c410-6040-451e-9674-b09da389d7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:06.038825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735c410-6040-451e-9674-b09da389d7d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:06.038825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735c410-6040-451e-9674-b09da389d7d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:14:06.046886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735c410-6040-451e-9674-b09da389d7d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:06.051411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735c410-6040-451e-9674-b09da389d7d3 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:06.076974 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2887/5742] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:14:06.083490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735c410-6040-451e-9674-b09da389d7d3 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:06.097500 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2856/5743] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:14:05 2022] POST /identity/v3/projects => generated 375 bytes in 507 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:14:06.100049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c206ed-acc1-4d3c-9796-f587c3dbfad8 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:06.128910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735c410-6040-451e-9674-b09da389d7d3 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:06.304549 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef828cc9-b313-4901-bfd7-bd92dc2f77c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:06.307300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef828cc9-b313-4901-bfd7-bd92dc2f77c5 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:06.307737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef828cc9-b313-4901-bfd7-bd92dc2f77c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:06.308020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef828cc9-b313-4901-bfd7-bd92dc2f77c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:06.309901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef828cc9-b313-4901-bfd7-bd92dc2f77c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:06.312498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c206ed-acc1-4d3c-9796-f587c3dbfad8 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:06.313420 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef828cc9-b313-4901-bfd7-bd92dc2f77c5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:06.343627 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46ffab-ca71-4bf9-b654-2ff6ea9eb5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:06.350712 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46ffab-ca71-4bf9-b654-2ff6ea9eb5b7 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:06.351046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46ffab-ca71-4bf9-b654-2ff6ea9eb5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:06.351370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46ffab-ca71-4bf9-b654-2ff6ea9eb5b7 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:06.352081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46ffab-ca71-4bf9-b654-2ff6ea9eb5b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:06.367215 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46ffab-ca71-4bf9-b654-2ff6ea9eb5b7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:06.418425 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2888/5744] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:14:06 2022] POST /identity/v3/projects => generated 381 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:14:06.423796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef828cc9-b313-4901-bfd7-bd92dc2f77c5 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:06.468509 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2857/5745] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:14:06 2022] POST /identity/v3/users => generated 294 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:14:06.478619 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46ffab-ca71-4bf9-b654-2ff6ea9eb5b7 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:06.517367 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46ffab-ca71-4bf9-b654-2ff6ea9eb5b7 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:06.539605 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:06.674451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef828cc9-b313-4901-bfd7-bd92dc2f77c5 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:06.692432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148bfc9-c005-4724-8285-4f31161f96fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:06.693866 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148bfc9-c005-4724-8285-4f31161f96fa admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:06.694265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148bfc9-c005-4724-8285-4f31161f96fa admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:06.694673 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148bfc9-c005-4724-8285-4f31161f96fa admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:06.695413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148bfc9-c005-4724-8285-4f31161f96fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:06.699432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148bfc9-c005-4724-8285-4f31161f96fa admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:06.749734 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2889/5746] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:14:06 2022] POST /identity/v3/users => generated 291 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:14:06.753702 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148bfc9-c005-4724-8285-4f31161f96fa admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:06.774834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148bfc9-c005-4724-8285-4f31161f96fa admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:06.780574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254c50f-6966-4360-b772-27968d12b1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:06.783784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254c50f-6966-4360-b772-27968d12b1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:06.784083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254c50f-6966-4360-b772-27968d12b1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:06.788185 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254c50f-6966-4360-b772-27968d12b1c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:06.790297 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1254c50f-6966-4360-b772-27968d12b1c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:06.790716 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d4186-7767-4985-82d9-1566fd53531d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:06.791736 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d4186-7767-4985-82d9-1566fd53531d admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:06.792260 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d4186-7767-4985-82d9-1566fd53531d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:06.795266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d4186-7767-4985-82d9-1566fd53531d admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:06.796092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d4186-7767-4985-82d9-1566fd53531d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:06.797813 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d4186-7767-4985-82d9-1566fd53531d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:06.802065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1254c50f-6966-4360-b772-27968d12b1c1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:06.846211 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2858/5747] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:14:06.862737 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2890/5748] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:14:06.863886 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254c50f-6966-4360-b772-27968d12b1c1 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:06.866947 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d4186-7767-4985-82d9-1566fd53531d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:06.905938 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254c50f-6966-4360-b772-27968d12b1c1 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:06.908952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d4186-7767-4985-82d9-1566fd53531d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:06.928511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64f7a2-f81a-4abd-8d39-517799a0818f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:06.932469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64f7a2-f81a-4abd-8d39-517799a0818f admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:06.937592 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64f7a2-f81a-4abd-8d39-517799a0818f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:06.938445 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64f7a2-f81a-4abd-8d39-517799a0818f admin admin] PATH_INFO: `/v3/projects/76b3f8f9ac954ebaaaa15ec0cfb64232/users/1d7bf9695c0c4414a6a7e64e471b6fbb/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:06.943352 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171ffea-a6ea-4b24-9555-e05d3e2f26e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:06.943352 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171ffea-a6ea-4b24-9555-e05d3e2f26e3 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:06.943352 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171ffea-a6ea-4b24-9555-e05d3e2f26e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:06.943352 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171ffea-a6ea-4b24-9555-e05d3e2f26e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:06.943924 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8171ffea-a6ea-4b24-9555-e05d3e2f26e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:06.966496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8171ffea-a6ea-4b24-9555-e05d3e2f26e3 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:06.988022 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64f7a2-f81a-4abd-8d39-517799a0818f admin admin] RBAC: Authorizing `identity:create_grant(project_id=76b3f8f9ac954ebaaaa15ec0cfb64232, user_id=1d7bf9695c0c4414a6a7e64e471b6fbb, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:06.991839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64f7a2-f81a-4abd-8d39-517799a0818f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:06.993845 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2891/5749] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:14:06.995451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171ffea-a6ea-4b24-9555-e05d3e2f26e3 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:07.023398 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2859/5750] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:14:06 2022] PUT /identity/v3/projects/76b3f8f9ac954ebaaaa15ec0cfb64232/users/1d7bf9695c0c4414a6a7e64e471b6fbb/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:07.024718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64f7a2-f81a-4abd-8d39-517799a0818f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:07.027340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171ffea-a6ea-4b24-9555-e05d3e2f26e3 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:07.114950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:07.162707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66f877-0541-4e39-bb64-9c20588cccef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:07.164169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66f877-0541-4e39-bb64-9c20588cccef admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:07.165000 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66f877-0541-4e39-bb64-9c20588cccef admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:07.165396 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66f877-0541-4e39-bb64-9c20588cccef admin admin] PATH_INFO: `/v3/projects/02ad47787f3945178942cbe781b82021/users/c43b09f788b143ad91d1ffe2621daae7/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:07.188306 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64f7a2-f81a-4abd-8d39-517799a0818f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:07.196130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b79b5b-a7d3-40c6-92c4-2f3580725378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:07.197133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b79b5b-a7d3-40c6-92c4-2f3580725378 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:07.197723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b79b5b-a7d3-40c6-92c4-2f3580725378 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:07.198100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b79b5b-a7d3-40c6-92c4-2f3580725378 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:07.199281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b79b5b-a7d3-40c6-92c4-2f3580725378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:07.201618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b79b5b-a7d3-40c6-92c4-2f3580725378 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:07.223877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66f877-0541-4e39-bb64-9c20588cccef admin admin] RBAC: Authorizing `identity:create_grant(project_id=02ad47787f3945178942cbe781b82021, user_id=c43b09f788b143ad91d1ffe2621daae7, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:07.226353 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2860/5751] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:14:07.227526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b79b5b-a7d3-40c6-92c4-2f3580725378 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:07.229817 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-72b79b5b-a7d3-40c6-92c4-2f3580725378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:07.234006 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66f877-0541-4e39-bb64-9c20588cccef admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:07.268854 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2892/5752] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:14:06 2022] PUT /identity/v3/projects/02ad47787f3945178942cbe781b82021/users/c43b09f788b143ad91d1ffe2621daae7/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:07.268854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66f877-0541-4e39-bb64-9c20588cccef admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:07.384230 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b79b5b-a7d3-40c6-92c4-2f3580725378 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:07.462827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66f877-0541-4e39-bb64-9c20588cccef admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:07.467747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1576fb5-ed54-4e68-85c4-3ebee7bb9aa9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:07.468703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1576fb5-ed54-4e68-85c4-3ebee7bb9aa9 service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:07.468993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1576fb5-ed54-4e68-85c4-3ebee7bb9aa9 service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:07.469886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4189e-9e65-4291-ad47-db6e9faa904f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:07.470588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4189e-9e65-4291-ad47-db6e9faa904f admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:07.470876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4189e-9e65-4291-ad47-db6e9faa904f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:07.471266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4189e-9e65-4291-ad47-db6e9faa904f admin admin] PATH_INFO: `/v3/projects/76b3f8f9ac954ebaaaa15ec0cfb64232/users/1d7bf9695c0c4414a6a7e64e471b6fbb/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:07.471841 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1576fb5-ed54-4e68-85c4-3ebee7bb9aa9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:07.474126 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b1576fb5-ed54-4e68-85c4-3ebee7bb9aa9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:07.475852 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e4189e-9e65-4291-ad47-db6e9faa904f admin admin] RBAC: Authorizing `identity:create_grant(project_id=76b3f8f9ac954ebaaaa15ec0cfb64232, user_id=1d7bf9695c0c4414a6a7e64e471b6fbb, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:07.488953 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1576fb5-ed54-4e68-85c4-3ebee7bb9aa9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:07.491436 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1576fb5-ed54-4e68-85c4-3ebee7bb9aa9 service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:07.505321 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2861/5753] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:14:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:14:07.508067 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31306ed9-8a58-4732-9664-80c5810a2742 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:07.508353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31306ed9-8a58-4732-9664-80c5810a2742 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:07.508628 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31306ed9-8a58-4732-9664-80c5810a2742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:07.509013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e4189e-9e65-4291-ad47-db6e9faa904f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:07.546914 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-31306ed9-8a58-4732-9664-80c5810a2742 None None] MFA Rules not processed for user `c43b09f788b143ad91d1ffe2621daae7`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:07.555872 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2893/5754] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:14:07 2022] PUT /identity/v3/projects/76b3f8f9ac954ebaaaa15ec0cfb64232/users/1d7bf9695c0c4414a6a7e64e471b6fbb/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:07.572697 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-31306ed9-8a58-4732-9664-80c5810a2742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:07.573111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a397051-9c7f-4e71-b2a9-ed123a57ad62 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:07.573461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a397051-9c7f-4e71-b2a9-ed123a57ad62 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:07.573748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a397051-9c7f-4e71-b2a9-ed123a57ad62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:07.651611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:07.663893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-1a397051-9c7f-4e71-b2a9-ed123a57ad62 None None] MFA Rules not processed for user `1d7bf9695c0c4414a6a7e64e471b6fbb`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:07.667737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1a397051-9c7f-4e71-b2a9-ed123a57ad62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:07.726756 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:07.784211 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2862/5755] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:07.789293 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31306ed9-8a58-4732-9664-80c5810a2742 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:07.862366 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2894/5756] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:07.914325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a397051-9c7f-4e71-b2a9-ed123a57ad62 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:07.916488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1a397051-9c7f-4e71-b2a9-ed123a57ad62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:07.969597 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31306ed9-8a58-4732-9664-80c5810a2742 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:07.981312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f550d-2e59-4222-8b9f-42d2d009c0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:07.984750 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f550d-2e59-4222-8b9f-42d2d009c0bf admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:07.985541 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f550d-2e59-4222-8b9f-42d2d009c0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:07.986179 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f550d-2e59-4222-8b9f-42d2d009c0bf admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:07.987258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f550d-2e59-4222-8b9f-42d2d009c0bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:07.995174 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f550d-2e59-4222-8b9f-42d2d009c0bf admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:08.081910 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2863/5757] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:14:07 2022] POST /identity/v3/projects => generated 383 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:14:08.083242 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f550d-2e59-4222-8b9f-42d2d009c0bf admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:08.091895 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a397051-9c7f-4e71-b2a9-ed123a57ad62 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:08.340980 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669bc5e-8564-4398-a2d0-083f3feb3fef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:08.343583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669bc5e-8564-4398-a2d0-083f3feb3fef service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:08.344037 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669bc5e-8564-4398-a2d0-083f3feb3fef service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:08.344425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669bc5e-8564-4398-a2d0-083f3feb3fef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:08.361312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f550d-2e59-4222-8b9f-42d2d009c0bf admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:08.372287 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b64727-618b-413e-a9b3-8ade793f794f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:08.375859 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b64727-618b-413e-a9b3-8ade793f794f admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:08.376224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b64727-618b-413e-a9b3-8ade793f794f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:08.376904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b64727-618b-413e-a9b3-8ade793f794f admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:08.379072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b64727-618b-413e-a9b3-8ade793f794f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:08.381720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b64727-618b-413e-a9b3-8ade793f794f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:08.459277 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2864/5758] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:14:08 2022] POST /identity/v3/users => generated 298 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:14:08.464173 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b64727-618b-413e-a9b3-8ade793f794f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:08.509714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b64727-618b-413e-a9b3-8ade793f794f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:08.551266 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512cff61-0479-472b-9b76-bf64895b134a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:08.554120 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cff61-0479-472b-9b76-bf64895b134a admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:08.555530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cff61-0479-472b-9b76-bf64895b134a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:08.556073 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cff61-0479-472b-9b76-bf64895b134a admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:08.559121 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512cff61-0479-472b-9b76-bf64895b134a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:08.561814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512cff61-0479-472b-9b76-bf64895b134a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:08.579665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669bc5e-8564-4398-a2d0-083f3feb3fef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:08.585021 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669bc5e-8564-4398-a2d0-083f3feb3fef service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:08.607815 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2865/5759] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:14:08.612022 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512cff61-0479-472b-9b76-bf64895b134a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:08.631811 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2895/5760] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:14:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 718 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:14:08.641205 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512cff61-0479-472b-9b76-bf64895b134a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:08.677088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb52023-a8df-4dff-9cf9-926827baf8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:08.678160 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb52023-a8df-4dff-9cf9-926827baf8b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:08.678508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb52023-a8df-4dff-9cf9-926827baf8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:08.678955 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb52023-a8df-4dff-9cf9-926827baf8b1 admin admin] PATH_INFO: `/v3/projects/a2defa3de56148f7bb72d05cc2ae3c4b/users/0293996b7cc645e6aaac8e14451f680e/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:08.702592 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb52023-a8df-4dff-9cf9-926827baf8b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2defa3de56148f7bb72d05cc2ae3c4b, user_id=0293996b7cc645e6aaac8e14451f680e, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:08.705431 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb52023-a8df-4dff-9cf9-926827baf8b1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:08.735584 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2866/5761] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:14:08 2022] PUT /identity/v3/projects/a2defa3de56148f7bb72d05cc2ae3c4b/users/0293996b7cc645e6aaac8e14451f680e/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:08.736552 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669bc5e-8564-4398-a2d0-083f3feb3fef service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:08.745755 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:08.753427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669bc5e-8564-4398-a2d0-083f3feb3fef service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:08.882643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a9915-c625-4942-9d7d-f34684606075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:08.883884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a9915-c625-4942-9d7d-f34684606075 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:08.883884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a9915-c625-4942-9d7d-f34684606075 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:08.884091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a9915-c625-4942-9d7d-f34684606075 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:08.884666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a9915-c625-4942-9d7d-f34684606075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:08.886429 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a9915-c625-4942-9d7d-f34684606075 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:08.906200 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2896/5762] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:14:08.907858 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb52023-a8df-4dff-9cf9-926827baf8b1 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:08.920797 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb52023-a8df-4dff-9cf9-926827baf8b1 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:08.942372 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f269f48-70cf-4135-8bcc-0e6cee785003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:08.943546 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f269f48-70cf-4135-8bcc-0e6cee785003 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:08.943546 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f269f48-70cf-4135-8bcc-0e6cee785003 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:08.943776 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f269f48-70cf-4135-8bcc-0e6cee785003 admin admin] PATH_INFO: `/v3/projects/a2defa3de56148f7bb72d05cc2ae3c4b/users/0293996b7cc645e6aaac8e14451f680e/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:08.945845 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f269f48-70cf-4135-8bcc-0e6cee785003 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2defa3de56148f7bb72d05cc2ae3c4b, user_id=0293996b7cc645e6aaac8e14451f680e, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:08.948701 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f269f48-70cf-4135-8bcc-0e6cee785003 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:08.984974 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2867/5763] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:14:08 2022] PUT /identity/v3/projects/a2defa3de56148f7bb72d05cc2ae3c4b/users/0293996b7cc645e6aaac8e14451f680e/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:08.997303 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15499a3-922b-4e17-b16c-fc0c05301c16 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:08.997611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15499a3-922b-4e17-b16c-fc0c05301c16 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:08.997913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15499a3-922b-4e17-b16c-fc0c05301c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:09.068807 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-f15499a3-922b-4e17-b16c-fc0c05301c16 None None] MFA Rules not processed for user `0293996b7cc645e6aaac8e14451f680e`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:09.072781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f15499a3-922b-4e17-b16c-fc0c05301c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:09.241101 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2897/5764] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:08 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:09.259307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f269f48-70cf-4135-8bcc-0e6cee785003 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:09.261517 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8f269f48-70cf-4135-8bcc-0e6cee785003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:09.285616 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:09.389796 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f269f48-70cf-4135-8bcc-0e6cee785003 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:09.394742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd6ed5-e0e2-4194-a2e6-c44bfa7aac87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:09.395593 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd6ed5-e0e2-4194-a2e6-c44bfa7aac87 service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:09.396682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd6ed5-e0e2-4194-a2e6-c44bfa7aac87 service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:09.397117 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd6ed5-e0e2-4194-a2e6-c44bfa7aac87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:09.411568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd6ed5-e0e2-4194-a2e6-c44bfa7aac87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:09.413962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd6ed5-e0e2-4194-a2e6-c44bfa7aac87 service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:09.432054 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2868/5765] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:14:09 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:14:09.689882 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15499a3-922b-4e17-b16c-fc0c05301c16 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:09.732164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15499a3-922b-4e17-b16c-fc0c05301c16 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:09.740124 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92dec8e-e659-4f3c-b039-64b93e6fb4d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:09.741723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92dec8e-e659-4f3c-b039-64b93e6fb4d2 service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:09.742337 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92dec8e-e659-4f3c-b039-64b93e6fb4d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:09.743184 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92dec8e-e659-4f3c-b039-64b93e6fb4d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:09.836239 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92dec8e-e659-4f3c-b039-64b93e6fb4d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:09.838446 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92dec8e-e659-4f3c-b039-64b93e6fb4d2 service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:09.852689 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2898/5766] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:14:09 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:14:10.155912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeee028-f044-458a-be58-951c5e731a2c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:10.156516 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeee028-f044-458a-be58-951c5e731a2c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:10.156516 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeee028-f044-458a-be58-951c5e731a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:10.205660 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-faeee028-f044-458a-be58-951c5e731a2c None None] MFA Rules not processed for user `a6c953ff2f774041a7d50f53033ee124`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:10.208173 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-faeee028-f044-458a-be58-951c5e731a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:10.445346 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2869/5767] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:11.997070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5961d4-795b-4c6f-9119-3a9fc391b991 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:11.997628 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5961d4-795b-4c6f-9119-3a9fc391b991 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:11.997866 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5961d4-795b-4c6f-9119-3a9fc391b991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:12.039409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-bf5961d4-795b-4c6f-9119-3a9fc391b991 None None] MFA Rules not processed for user `a6c953ff2f774041a7d50f53033ee124`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:12.040351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-bf5961d4-795b-4c6f-9119-3a9fc391b991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:12.061104 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2899/5768] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:13.384284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeee028-f044-458a-be58-951c5e731a2c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:13.485798 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeee028-f044-458a-be58-951c5e731a2c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:13.500699 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90894680-5133-4a9e-942a-c64f9184edc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:13.501884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90894680-5133-4a9e-942a-c64f9184edc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:13.502423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90894680-5133-4a9e-942a-c64f9184edc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:13.504671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90894680-5133-4a9e-942a-c64f9184edc0 admin admin] PATH_INFO: `/v3/users/c43b09f788b143ad91d1ffe2621daae7` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:13.507873 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90894680-5133-4a9e-942a-c64f9184edc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c43b09f788b143ad91d1ffe2621daae7)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:13.511135 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90894680-5133-4a9e-942a-c64f9184edc0 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:13.688420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-90894680-5133-4a9e-942a-c64f9184edc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c43b09f788b143ad91d1ffe2621daae7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:13.695232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-90894680-5133-4a9e-942a-c64f9184edc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c43b09f788b143ad91d1ffe2621daae7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:13.699431 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-90894680-5133-4a9e-942a-c64f9184edc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c43b09f788b143ad91d1ffe2621daae7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:13.721286 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-90894680-5133-4a9e-942a-c64f9184edc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c43b09f788b143ad91d1ffe2621daae7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:13.745963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:13.783607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-90894680-5133-4a9e-942a-c64f9184edc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c43b09f788b143ad91d1ffe2621daae7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:13.830790 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2870/5769] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:14:13 2022] DELETE /identity/v3/users/c43b09f788b143ad91d1ffe2621daae7 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:13.834480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281214d-67ef-4b12-9c57-005fd2389c42 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:13.834977 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281214d-67ef-4b12-9c57-005fd2389c42 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:13.835344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281214d-67ef-4b12-9c57-005fd2389c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:13.878534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-5281214d-67ef-4b12-9c57-005fd2389c42 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:13.887154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5281214d-67ef-4b12-9c57-005fd2389c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:13.920306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:14.057715 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2900/5770] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:14.081742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90894680-5133-4a9e-942a-c64f9184edc0 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:14.084196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-90894680-5133-4a9e-942a-c64f9184edc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:14.277652 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90894680-5133-4a9e-942a-c64f9184edc0 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:14.297269 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287dc73d-ba6d-4c42-8bf1-9f7476f4a370 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:14.297961 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dc73d-ba6d-4c42-8bf1-9f7476f4a370 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:14.298247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dc73d-ba6d-4c42-8bf1-9f7476f4a370 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:14.298519 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dc73d-ba6d-4c42-8bf1-9f7476f4a370 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:14.325772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287dc73d-ba6d-4c42-8bf1-9f7476f4a370 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:14.327556 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287dc73d-ba6d-4c42-8bf1-9f7476f4a370 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:14.353417 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2871/5771] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:14:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:14:16.579699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281214d-67ef-4b12-9c57-005fd2389c42 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:16.583772 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5281214d-67ef-4b12-9c57-005fd2389c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:16.620168 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281214d-67ef-4b12-9c57-005fd2389c42 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:16.641821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0744c3-8b4e-4d08-a007-37a04aa8366f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:16.645282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0744c3-8b4e-4d08-a007-37a04aa8366f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:16.646342 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0744c3-8b4e-4d08-a007-37a04aa8366f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:16.647056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0744c3-8b4e-4d08-a007-37a04aa8366f admin admin] PATH_INFO: `/v3/projects/02ad47787f3945178942cbe781b82021` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:16.671203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0744c3-8b4e-4d08-a007-37a04aa8366f admin admin] RBAC: Authorizing `identity:delete_project(project_id=02ad47787f3945178942cbe781b82021)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:16.686522 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0744c3-8b4e-4d08-a007-37a04aa8366f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:16.840972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-da0744c3-8b4e-4d08-a007-37a04aa8366f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02ad47787f3945178942cbe781b82021', 'request_id': 'req-da0744c3-8b4e-4d08-a007-37a04aa8366f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:16.870847 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-da0744c3-8b4e-4d08-a007-37a04aa8366f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02ad47787f3945178942cbe781b82021', 'request_id': 'req-da0744c3-8b4e-4d08-a007-37a04aa8366f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:16.891014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-da0744c3-8b4e-4d08-a007-37a04aa8366f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02ad47787f3945178942cbe781b82021', 'request_id': 'req-da0744c3-8b4e-4d08-a007-37a04aa8366f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:16.940885 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-da0744c3-8b4e-4d08-a007-37a04aa8366f admin admin] The token cache is being invalidate because project 02ad47787f3945178942cbe781b82021 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:14:16.947962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-da0744c3-8b4e-4d08-a007-37a04aa8366f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:16.951713 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-da0744c3-8b4e-4d08-a007-37a04aa8366f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:16.956801 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2901/5772] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:14:16 2022] DELETE /identity/v3/projects/02ad47787f3945178942cbe781b82021 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:16.961220 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287dc73d-ba6d-4c42-8bf1-9f7476f4a370 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:16.972790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287dc73d-ba6d-4c42-8bf1-9f7476f4a370 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:17.164003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958d2d2-46bd-4358-9573-6d434bfd0eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:17.165101 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958d2d2-46bd-4358-9573-6d434bfd0eab admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:17.165601 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958d2d2-46bd-4358-9573-6d434bfd0eab admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:17.166130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958d2d2-46bd-4358-9573-6d434bfd0eab admin admin] PATH_INFO: `/v3/users/0293996b7cc645e6aaac8e14451f680e` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:17.168163 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1958d2d2-46bd-4358-9573-6d434bfd0eab admin admin] RBAC: Authorizing `identity:delete_user(user_id=0293996b7cc645e6aaac8e14451f680e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:17.174196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1958d2d2-46bd-4358-9573-6d434bfd0eab admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:17.282147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1958d2d2-46bd-4358-9573-6d434bfd0eab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0293996b7cc645e6aaac8e14451f680e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:17.286757 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1958d2d2-46bd-4358-9573-6d434bfd0eab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0293996b7cc645e6aaac8e14451f680e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:17.287989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1958d2d2-46bd-4358-9573-6d434bfd0eab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0293996b7cc645e6aaac8e14451f680e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:17.310890 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1958d2d2-46bd-4358-9573-6d434bfd0eab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0293996b7cc645e6aaac8e14451f680e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:17.333616 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1958d2d2-46bd-4358-9573-6d434bfd0eab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0293996b7cc645e6aaac8e14451f680e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:17.352745 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:17.364686 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2872/5773] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:14:16 2022] DELETE /identity/v3/users/0293996b7cc645e6aaac8e14451f680e => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:18.304076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0744c3-8b4e-4d08-a007-37a04aa8366f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:18.305894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-da0744c3-8b4e-4d08-a007-37a04aa8366f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:18.340852 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0744c3-8b4e-4d08-a007-37a04aa8366f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:18.518703 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fa1ee-ca96-42f4-964f-989389843b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:18.519653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fa1ee-ca96-42f4-964f-989389843b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:18.520006 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fa1ee-ca96-42f4-964f-989389843b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:18.520928 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fa1ee-ca96-42f4-964f-989389843b48 admin admin] PATH_INFO: `/v3/users/950a8bbfd820444b9f85976f6609c864` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:18.531485 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410fa1ee-ca96-42f4-964f-989389843b48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=950a8bbfd820444b9f85976f6609c864)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:18.533455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410fa1ee-ca96-42f4-964f-989389843b48 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:18.636249 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:18.644273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-410fa1ee-ca96-42f4-964f-989389843b48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '950a8bbfd820444b9f85976f6609c864'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:18.685951 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-410fa1ee-ca96-42f4-964f-989389843b48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '950a8bbfd820444b9f85976f6609c864'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:18.686961 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-410fa1ee-ca96-42f4-964f-989389843b48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '950a8bbfd820444b9f85976f6609c864'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:18.687757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-410fa1ee-ca96-42f4-964f-989389843b48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '950a8bbfd820444b9f85976f6609c864'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:18.709181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-410fa1ee-ca96-42f4-964f-989389843b48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '950a8bbfd820444b9f85976f6609c864'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:18.743246 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2902/5774] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:14:18 2022] DELETE /identity/v3/users/950a8bbfd820444b9f85976f6609c864 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:18.812499 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958d2d2-46bd-4358-9573-6d434bfd0eab admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:18.814110 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1958d2d2-46bd-4358-9573-6d434bfd0eab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:18.842534 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958d2d2-46bd-4358-9573-6d434bfd0eab admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:18.960492 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054dcd58-d0e6-4c73-a863-3c4c19b0a7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:18.961334 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dcd58-d0e6-4c73-a863-3c4c19b0a7cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:18.961743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dcd58-d0e6-4c73-a863-3c4c19b0a7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:18.962503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dcd58-d0e6-4c73-a863-3c4c19b0a7cf admin admin] PATH_INFO: `/v3/users/e969b90e30424b1795008ba4d1c99883` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:18.964142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054dcd58-d0e6-4c73-a863-3c4c19b0a7cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e969b90e30424b1795008ba4d1c99883)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:18.967125 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054dcd58-d0e6-4c73-a863-3c4c19b0a7cf admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:19.058720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-054dcd58-d0e6-4c73-a863-3c4c19b0a7cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e969b90e30424b1795008ba4d1c99883'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:19.059751 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-054dcd58-d0e6-4c73-a863-3c4c19b0a7cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e969b90e30424b1795008ba4d1c99883'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:19.060560 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-054dcd58-d0e6-4c73-a863-3c4c19b0a7cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e969b90e30424b1795008ba4d1c99883'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:19.075377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fa1ee-ca96-42f4-964f-989389843b48 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:19.076783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-410fa1ee-ca96-42f4-964f-989389843b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:19.079890 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-054dcd58-d0e6-4c73-a863-3c4c19b0a7cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e969b90e30424b1795008ba4d1c99883'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:19.099492 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fa1ee-ca96-42f4-964f-989389843b48 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:19.101964 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-054dcd58-d0e6-4c73-a863-3c4c19b0a7cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e969b90e30424b1795008ba4d1c99883'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:19.109339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375657c-7eb3-47bb-a36f-feb11de91006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:19.109985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375657c-7eb3-47bb-a36f-feb11de91006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:19.110261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375657c-7eb3-47bb-a36f-feb11de91006 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:19.110533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375657c-7eb3-47bb-a36f-feb11de91006 admin admin] PATH_INFO: `/v3/projects/a2defa3de56148f7bb72d05cc2ae3c4b` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:19.119457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375657c-7eb3-47bb-a36f-feb11de91006 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2defa3de56148f7bb72d05cc2ae3c4b)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:19.121388 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375657c-7eb3-47bb-a36f-feb11de91006 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:19.126293 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2873/5775] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:14:18 2022] DELETE /identity/v3/users/e969b90e30424b1795008ba4d1c99883 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:19.132855 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19b88b-52f7-4e8f-b539-5545c0508d2f None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:19.133404 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19b88b-52f7-4e8f-b539-5545c0508d2f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:19.133839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19b88b-52f7-4e8f-b539-5545c0508d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:19.165239 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-7b19b88b-52f7-4e8f-b539-5545c0508d2f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:19.167912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7b19b88b-52f7-4e8f-b539-5545c0508d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:19.227411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7375657c-7eb3-47bb-a36f-feb11de91006 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2defa3de56148f7bb72d05cc2ae3c4b', 'request_id': 'req-7375657c-7eb3-47bb-a36f-feb11de91006'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:19.233597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7375657c-7eb3-47bb-a36f-feb11de91006 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2defa3de56148f7bb72d05cc2ae3c4b', 'request_id': 'req-7375657c-7eb3-47bb-a36f-feb11de91006'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:19.245244 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7375657c-7eb3-47bb-a36f-feb11de91006 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2defa3de56148f7bb72d05cc2ae3c4b', 'request_id': 'req-7375657c-7eb3-47bb-a36f-feb11de91006'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:19.260079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7375657c-7eb3-47bb-a36f-feb11de91006 admin admin] The token cache is being invalidate because project a2defa3de56148f7bb72d05cc2ae3c4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:14:19.260380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7375657c-7eb3-47bb-a36f-feb11de91006 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:19.261912 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7375657c-7eb3-47bb-a36f-feb11de91006 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:19.265458 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2903/5776] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:14:19 2022] DELETE /identity/v3/projects/a2defa3de56148f7bb72d05cc2ae3c4b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:14:19.266482 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375657c-7eb3-47bb-a36f-feb11de91006 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:19.268140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7375657c-7eb3-47bb-a36f-feb11de91006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:19.324020 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2874/5777] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:19.326142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cb23a-b7be-4f4e-8bb3-6e19f86d2f86 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:19.326608 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cb23a-b7be-4f4e-8bb3-6e19f86d2f86 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:19.327049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cb23a-b7be-4f4e-8bb3-6e19f86d2f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:19.360559 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-1a1cb23a-b7be-4f4e-8bb3-6e19f86d2f86 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:19.361594 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1a1cb23a-b7be-4f4e-8bb3-6e19f86d2f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:19.381344 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:19.417339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375657c-7eb3-47bb-a36f-feb11de91006 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:19.426078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238c4c7-90c1-4d27-b545-9046c503d312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:19.428114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238c4c7-90c1-4d27-b545-9046c503d312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:19.429146 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238c4c7-90c1-4d27-b545-9046c503d312 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:19.429593 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238c4c7-90c1-4d27-b545-9046c503d312 admin admin] PATH_INFO: `/v3/projects/dbf6e27c08c84eb780aee25318136435` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:19.431511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c238c4c7-90c1-4d27-b545-9046c503d312 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbf6e27c08c84eb780aee25318136435)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:19.434382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c238c4c7-90c1-4d27-b545-9046c503d312 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:19.473038 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2875/5778] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:19.481741 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1cb23a-b7be-4f4e-8bb3-6e19f86d2f86 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:19.483666 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1a1cb23a-b7be-4f4e-8bb3-6e19f86d2f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:19.502443 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:19.513200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c238c4c7-90c1-4d27-b545-9046c503d312 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbf6e27c08c84eb780aee25318136435', 'request_id': 'req-c238c4c7-90c1-4d27-b545-9046c503d312'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:19.528452 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c238c4c7-90c1-4d27-b545-9046c503d312 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbf6e27c08c84eb780aee25318136435', 'request_id': 'req-c238c4c7-90c1-4d27-b545-9046c503d312'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:19.543603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c238c4c7-90c1-4d27-b545-9046c503d312 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbf6e27c08c84eb780aee25318136435', 'request_id': 'req-c238c4c7-90c1-4d27-b545-9046c503d312'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:19.558769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c238c4c7-90c1-4d27-b545-9046c503d312 admin admin] The token cache is being invalidate because project dbf6e27c08c84eb780aee25318136435 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:14:19.559464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c238c4c7-90c1-4d27-b545-9046c503d312 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:19.560487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c238c4c7-90c1-4d27-b545-9046c503d312 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:19.563427 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2904/5779] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:14:19 2022] DELETE /identity/v3/projects/dbf6e27c08c84eb780aee25318136435 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:19.564853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238c4c7-90c1-4d27-b545-9046c503d312 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:19.569060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c238c4c7-90c1-4d27-b545-9046c503d312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:19.582380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1cb23a-b7be-4f4e-8bb3-6e19f86d2f86 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:19.675591 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05e57b-a544-46ce-9194-237d94e3b0c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:19.678798 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05e57b-a544-46ce-9194-237d94e3b0c5 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:19.679140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05e57b-a544-46ce-9194-237d94e3b0c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:19.679887 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05e57b-a544-46ce-9194-237d94e3b0c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:19.682388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ff05e57b-a544-46ce-9194-237d94e3b0c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:19.699760 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff05e57b-a544-46ce-9194-237d94e3b0c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:19.701420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff05e57b-a544-46ce-9194-237d94e3b0c5 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:19.710727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238c4c7-90c1-4d27-b545-9046c503d312 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:19.720202 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e56178-a365-41d4-949f-595c9bc51278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:19.720752 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2876/5780] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:14:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:14:19.723032 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2587de3-72d5-4532-9f7b-0a773975b2d6 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:19.723703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2587de3-72d5-4532-9f7b-0a773975b2d6 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:19.724432 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2587de3-72d5-4532-9f7b-0a773975b2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:19.731256 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e56178-a365-41d4-949f-595c9bc51278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:19.731545 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e56178-a365-41d4-949f-595c9bc51278 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:19.731844 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e56178-a365-41d4-949f-595c9bc51278 admin admin] PATH_INFO: `/v3/users/58bfcb7788f34fb9962efd02143ee3ec` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:19.735544 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e56178-a365-41d4-949f-595c9bc51278 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58bfcb7788f34fb9962efd02143ee3ec)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:19.741234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e56178-a365-41d4-949f-595c9bc51278 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:19.757831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-c2587de3-72d5-4532-9f7b-0a773975b2d6 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:19.764922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c2587de3-72d5-4532-9f7b-0a773975b2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:19.792533 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2877/5781] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:19.797358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba029f-b3fe-49c6-a5f0-1b40af508f75 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:19.797651 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba029f-b3fe-49c6-a5f0-1b40af508f75 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:19.797963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba029f-b3fe-49c6-a5f0-1b40af508f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:19.872741 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f5ba029f-b3fe-49c6-a5f0-1b40af508f75 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:19.874411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f5ba029f-b3fe-49c6-a5f0-1b40af508f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:19.882386 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-47e56178-a365-41d4-949f-595c9bc51278 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58bfcb7788f34fb9962efd02143ee3ec'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:19.897537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-47e56178-a365-41d4-949f-595c9bc51278 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58bfcb7788f34fb9962efd02143ee3ec'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:19.897998 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2878/5782] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:19.899612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-47e56178-a365-41d4-949f-595c9bc51278 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58bfcb7788f34fb9962efd02143ee3ec'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:19.901757 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba029f-b3fe-49c6-a5f0-1b40af508f75 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:19.902186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-47e56178-a365-41d4-949f-595c9bc51278 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58bfcb7788f34fb9962efd02143ee3ec'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:19.915826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-47e56178-a365-41d4-949f-595c9bc51278 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58bfcb7788f34fb9962efd02143ee3ec'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:19.920951 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba029f-b3fe-49c6-a5f0-1b40af508f75 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:19.929317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99e1c4-9938-4119-8037-6e748b8cda8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:19.930097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99e1c4-9938-4119-8037-6e748b8cda8b admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:19.930833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99e1c4-9938-4119-8037-6e748b8cda8b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:19.931121 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99e1c4-9938-4119-8037-6e748b8cda8b admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:19.931829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99e1c4-9938-4119-8037-6e748b8cda8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:14:19.932143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99e1c4-9938-4119-8037-6e748b8cda8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:19.933785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99e1c4-9938-4119-8037-6e748b8cda8b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:19.964023 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2879/5783] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:14:19.965386 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e483a2-12b6-4881-9516-1be8f27c90f5 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:19.965677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e483a2-12b6-4881-9516-1be8f27c90f5 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:19.965954 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e483a2-12b6-4881-9516-1be8f27c90f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:19.970470 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2905/5784] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:14:19 2022] DELETE /identity/v3/users/58bfcb7788f34fb9962efd02143ee3ec => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:19.971457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e56178-a365-41d4-949f-595c9bc51278 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:19.972860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-47e56178-a365-41d4-949f-595c9bc51278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:20.036393 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d5e483a2-12b6-4881-9516-1be8f27c90f5 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:20.039844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d5e483a2-12b6-4881-9516-1be8f27c90f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:20.088212 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:20.105481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e56178-a365-41d4-949f-595c9bc51278 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:20.112670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ff1f3-94b4-494c-a46a-b91793d889d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:20.113310 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ff1f3-94b4-494c-a46a-b91793d889d7 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:20.113595 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ff1f3-94b4-494c-a46a-b91793d889d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:20.113898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ff1f3-94b4-494c-a46a-b91793d889d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:20.115144 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ff1f3-94b4-494c-a46a-b91793d889d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:20.119753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ff1f3-94b4-494c-a46a-b91793d889d7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:20.175240 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2906/5785] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:14:19 2022] POST /identity/v3/projects => generated 387 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:14:20.175240 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469eafd0-ddea-4d86-8410-9ee8e4435996 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:20.175240 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469eafd0-ddea-4d86-8410-9ee8e4435996 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:20.175240 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469eafd0-ddea-4d86-8410-9ee8e4435996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:20.205645 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-469eafd0-ddea-4d86-8410-9ee8e4435996 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:20.207474 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-469eafd0-ddea-4d86-8410-9ee8e4435996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:20.232982 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:20.300513 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2880/5786] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:20.302975 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e483a2-12b6-4881-9516-1be8f27c90f5 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:20.319485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e483a2-12b6-4881-9516-1be8f27c90f5 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:20.357163 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2907/5787] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:20.358239 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469eafd0-ddea-4d86-8410-9ee8e4435996 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:20.359916 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-469eafd0-ddea-4d86-8410-9ee8e4435996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:20.381897 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469eafd0-ddea-4d86-8410-9ee8e4435996 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:20.398592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc171e8-8892-4e54-9652-2a17f65fd2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:20.399654 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc171e8-8892-4e54-9652-2a17f65fd2d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:20.403147 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc171e8-8892-4e54-9652-2a17f65fd2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:20.404279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc171e8-8892-4e54-9652-2a17f65fd2d1 admin admin] PATH_INFO: `/v3/projects/61dc126a193b46a293d46c21b28f4861` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:20.406313 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc171e8-8892-4e54-9652-2a17f65fd2d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61dc126a193b46a293d46c21b28f4861)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:20.409135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc171e8-8892-4e54-9652-2a17f65fd2d1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:20.425873 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac93c20-83cf-4ad8-af3b-382a8437a57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:20.426788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac93c20-83cf-4ad8-af3b-382a8437a57c admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:20.427141 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac93c20-83cf-4ad8-af3b-382a8437a57c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:20.428258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac93c20-83cf-4ad8-af3b-382a8437a57c admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:20.429128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac93c20-83cf-4ad8-af3b-382a8437a57c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:20.432162 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac93c20-83cf-4ad8-af3b-382a8437a57c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:20.491490 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2881/5788] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:14:20 2022] POST /identity/v3/users => generated 294 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:14:20.493005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac93c20-83cf-4ad8-af3b-382a8437a57c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:20.510636 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac93c20-83cf-4ad8-af3b-382a8437a57c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:20.511235 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fbc171e8-8892-4e54-9652-2a17f65fd2d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61dc126a193b46a293d46c21b28f4861', 'request_id': 'req-fbc171e8-8892-4e54-9652-2a17f65fd2d1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:20.520158 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fbc171e8-8892-4e54-9652-2a17f65fd2d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61dc126a193b46a293d46c21b28f4861', 'request_id': 'req-fbc171e8-8892-4e54-9652-2a17f65fd2d1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:20.535705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fbc171e8-8892-4e54-9652-2a17f65fd2d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61dc126a193b46a293d46c21b28f4861', 'request_id': 'req-fbc171e8-8892-4e54-9652-2a17f65fd2d1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:20.560882 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fbc171e8-8892-4e54-9652-2a17f65fd2d1 admin admin] The token cache is being invalidate because project 61dc126a193b46a293d46c21b28f4861 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:14:20.561338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fbc171e8-8892-4e54-9652-2a17f65fd2d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:20.562029 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fbc171e8-8892-4e54-9652-2a17f65fd2d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:20.564406 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2908/5789] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:14:20 2022] DELETE /identity/v3/projects/61dc126a193b46a293d46c21b28f4861 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:20.569546 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc171e8-8892-4e54-9652-2a17f65fd2d1 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:20.571005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-fbc171e8-8892-4e54-9652-2a17f65fd2d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:20.632501 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd4c41-1661-46db-8df3-f03e910618be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:20.633037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd4c41-1661-46db-8df3-f03e910618be admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:20.634986 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd4c41-1661-46db-8df3-f03e910618be admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:20.635279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd4c41-1661-46db-8df3-f03e910618be admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:20.636598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd4c41-1661-46db-8df3-f03e910618be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:14:20.636598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd4c41-1661-46db-8df3-f03e910618be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:20.637891 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd4c41-1661-46db-8df3-f03e910618be admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:20.697250 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2882/5790] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:14:20.701675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd4c41-1661-46db-8df3-f03e910618be admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:20.709299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-79bd4c41-1661-46db-8df3-f03e910618be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:20.733177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc171e8-8892-4e54-9652-2a17f65fd2d1 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:20.738626 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba8f5a-161c-4f6b-9d32-931b43afa7f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:20.740472 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba8f5a-161c-4f6b-9d32-931b43afa7f7 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:20.740972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba8f5a-161c-4f6b-9d32-931b43afa7f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:20.741410 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba8f5a-161c-4f6b-9d32-931b43afa7f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:20.747176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-32ba8f5a-161c-4f6b-9d32-931b43afa7f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:20.748698 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd4c41-1661-46db-8df3-f03e910618be admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:20.763469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec739c5-5cfa-4f2f-a085-0a0582fa719b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:20.764121 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec739c5-5cfa-4f2f-a085-0a0582fa719b admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:20.764404 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec739c5-5cfa-4f2f-a085-0a0582fa719b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:20.764789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec739c5-5cfa-4f2f-a085-0a0582fa719b admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:20.769460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba8f5a-161c-4f6b-9d32-931b43afa7f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:20.772006 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec739c5-5cfa-4f2f-a085-0a0582fa719b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:20.774208 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba8f5a-161c-4f6b-9d32-931b43afa7f7 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:20.777247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec739c5-5cfa-4f2f-a085-0a0582fa719b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:20.803495 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2909/5791] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:14:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:14:20.804794 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba8f5a-161c-4f6b-9d32-931b43afa7f7 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:20.806060 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2883/5792] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:14:20.818933 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec739c5-5cfa-4f2f-a085-0a0582fa719b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:20.819084 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-32ba8f5a-161c-4f6b-9d32-931b43afa7f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:20.820333 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-dec739c5-5cfa-4f2f-a085-0a0582fa719b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:20.823006 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:20.832623 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba8f5a-161c-4f6b-9d32-931b43afa7f7 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:20.846092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec739c5-5cfa-4f2f-a085-0a0582fa719b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:20.863030 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75cb8b-50b0-42a9-819a-8d4056cc94ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:20.868045 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8790ba-ffcf-4e10-9ebc-d97dfeda86e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:20.868943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8790ba-ffcf-4e10-9ebc-d97dfeda86e0 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:20.869101 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75cb8b-50b0-42a9-819a-8d4056cc94ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:20.869288 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8790ba-ffcf-4e10-9ebc-d97dfeda86e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:20.869511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8790ba-ffcf-4e10-9ebc-d97dfeda86e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:20.870255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8790ba-ffcf-4e10-9ebc-d97dfeda86e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:20.870362 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75cb8b-50b0-42a9-819a-8d4056cc94ce admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:20.871969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75cb8b-50b0-42a9-819a-8d4056cc94ce admin admin] PATH_INFO: `/v3/users/a1002fa36ef147c49e6d489f2a4f8dba` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:20.883281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8790ba-ffcf-4e10-9ebc-d97dfeda86e0 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:20.890283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d75cb8b-50b0-42a9-819a-8d4056cc94ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1002fa36ef147c49e6d489f2a4f8dba)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:20.909244 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d75cb8b-50b0-42a9-819a-8d4056cc94ce admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:20.960448 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2884/5793] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:14:20 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:14:20.960448 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8790ba-ffcf-4e10-9ebc-d97dfeda86e0 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:21.035504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3d75cb8b-50b0-42a9-819a-8d4056cc94ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1002fa36ef147c49e6d489f2a4f8dba'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:21.055985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3d75cb8b-50b0-42a9-819a-8d4056cc94ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1002fa36ef147c49e6d489f2a4f8dba'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:21.056787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3d75cb8b-50b0-42a9-819a-8d4056cc94ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1002fa36ef147c49e6d489f2a4f8dba'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:21.066393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3d75cb8b-50b0-42a9-819a-8d4056cc94ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1002fa36ef147c49e6d489f2a4f8dba'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:21.086421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3d75cb8b-50b0-42a9-819a-8d4056cc94ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1002fa36ef147c49e6d489f2a4f8dba'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:21.107643 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:21.133901 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2910/5794] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:14:20 2022] DELETE /identity/v3/users/a1002fa36ef147c49e6d489f2a4f8dba => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:21.134829 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75cb8b-50b0-42a9-819a-8d4056cc94ce admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:21.137192 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3d75cb8b-50b0-42a9-819a-8d4056cc94ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:21.191555 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8790ba-ffcf-4e10-9ebc-d97dfeda86e0 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:21.291448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75cb8b-50b0-42a9-819a-8d4056cc94ce admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:21.313914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e8b2b-fe1e-4724-acb2-81b61257afd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:21.314803 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e8b2b-fe1e-4724-acb2-81b61257afd2 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:21.315752 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e8b2b-fe1e-4724-acb2-81b61257afd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:21.316132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e8b2b-fe1e-4724-acb2-81b61257afd2 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:21.316970 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e8b2b-fe1e-4724-acb2-81b61257afd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:21.319395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e8b2b-fe1e-4724-acb2-81b61257afd2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:21.333228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0ddc1-20e9-4879-a103-a57fdd1b4b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:21.333861 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0ddc1-20e9-4879-a103-a57fdd1b4b08 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:21.334138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0ddc1-20e9-4879-a103-a57fdd1b4b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:21.334407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0ddc1-20e9-4879-a103-a57fdd1b4b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:21.335338 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0ddc1-20e9-4879-a103-a57fdd1b4b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:21.337098 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0ddc1-20e9-4879-a103-a57fdd1b4b08 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:21.359330 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2911/5795] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:14:21 2022] POST /identity/v3/users => generated 289 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:14:21.359931 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e8b2b-fe1e-4724-acb2-81b61257afd2 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:21.361911 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2885/5796] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:14:21.363321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-146e8b2b-fe1e-4724-acb2-81b61257afd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:21.367174 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0ddc1-20e9-4879-a103-a57fdd1b4b08 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:21.386702 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e8b2b-fe1e-4724-acb2-81b61257afd2 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:21.390753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0ddc1-20e9-4879-a103-a57fdd1b4b08 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:21.398514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed24eb1-2d88-4fd7-bbdc-02c9f17d80b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:21.399679 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed24eb1-2d88-4fd7-bbdc-02c9f17d80b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:21.400057 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed24eb1-2d88-4fd7-bbdc-02c9f17d80b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:21.400201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c19393-cd9b-4eed-a9a3-aa76862cbbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:21.400936 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed24eb1-2d88-4fd7-bbdc-02c9f17d80b0 admin admin] PATH_INFO: `/v3/projects/e69cee4ca1a24417ae7c05d9e58a5933` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:21.401063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c19393-cd9b-4eed-a9a3-aa76862cbbb6 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:21.401063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c19393-cd9b-4eed-a9a3-aa76862cbbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:21.401397 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c19393-cd9b-4eed-a9a3-aa76862cbbb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:21.402279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c19393-cd9b-4eed-a9a3-aa76862cbbb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:21.402630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed24eb1-2d88-4fd7-bbdc-02c9f17d80b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e69cee4ca1a24417ae7c05d9e58a5933)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:21.404146 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c19393-cd9b-4eed-a9a3-aa76862cbbb6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:21.405188 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed24eb1-2d88-4fd7-bbdc-02c9f17d80b0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:21.430712 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2886/5797] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:14:21.432475 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c19393-cd9b-4eed-a9a3-aa76862cbbb6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:21.435592 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-69c19393-cd9b-4eed-a9a3-aa76862cbbb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:21.461261 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c19393-cd9b-4eed-a9a3-aa76862cbbb6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:21.465474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0509b3b-90f2-49e8-b8cb-aa0364d85534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:21.466194 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0509b3b-90f2-49e8-b8cb-aa0364d85534 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:21.466475 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0509b3b-90f2-49e8-b8cb-aa0364d85534 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:21.466779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0509b3b-90f2-49e8-b8cb-aa0364d85534 admin admin] PATH_INFO: `/v3/projects/83ab6c0e2dff4baeada7ebe11c347574/users/e7ffda9c337141399842822aa94d84f7/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:21.499784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0509b3b-90f2-49e8-b8cb-aa0364d85534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83ab6c0e2dff4baeada7ebe11c347574, user_id=e7ffda9c337141399842822aa94d84f7, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:21.507391 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0509b3b-90f2-49e8-b8cb-aa0364d85534 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:21.507681 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fed24eb1-2d88-4fd7-bbdc-02c9f17d80b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e69cee4ca1a24417ae7c05d9e58a5933', 'request_id': 'req-fed24eb1-2d88-4fd7-bbdc-02c9f17d80b0'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:21.516501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fed24eb1-2d88-4fd7-bbdc-02c9f17d80b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e69cee4ca1a24417ae7c05d9e58a5933', 'request_id': 'req-fed24eb1-2d88-4fd7-bbdc-02c9f17d80b0'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:21.519934 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=79,keystone:DELETE=16,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:21.528742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fed24eb1-2d88-4fd7-bbdc-02c9f17d80b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e69cee4ca1a24417ae7c05d9e58a5933', 'request_id': 'req-fed24eb1-2d88-4fd7-bbdc-02c9f17d80b0'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:21.547350 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2887/5798] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:14:21 2022] PUT /identity/v3/projects/83ab6c0e2dff4baeada7ebe11c347574/users/e7ffda9c337141399842822aa94d84f7/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:21.547930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0509b3b-90f2-49e8-b8cb-aa0364d85534 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:21.558920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fed24eb1-2d88-4fd7-bbdc-02c9f17d80b0 admin admin] The token cache is being invalidate because project e69cee4ca1a24417ae7c05d9e58a5933 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:14:21.559795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fed24eb1-2d88-4fd7-bbdc-02c9f17d80b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:21.560683 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fed24eb1-2d88-4fd7-bbdc-02c9f17d80b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:21.566727 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2912/5799] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:14:21 2022] DELETE /identity/v3/projects/e69cee4ca1a24417ae7c05d9e58a5933 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:21.569436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1d29d-406d-4e9c-9946-6b9e165202b7 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:21.570413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1d29d-406d-4e9c-9946-6b9e165202b7 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:21.570909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1d29d-406d-4e9c-9946-6b9e165202b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:21.608156 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-0af1d29d-406d-4e9c-9946-6b9e165202b7 None None] MFA Rules not processed for user `e7ffda9c337141399842822aa94d84f7`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:21.611844 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0af1d29d-406d-4e9c-9946-6b9e165202b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:21.654780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0509b3b-90f2-49e8-b8cb-aa0364d85534 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:21.679555 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85654069-71a3-4a20-9d07-e1df7429fbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:21.681282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85654069-71a3-4a20-9d07-e1df7429fbcd admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:21.683345 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85654069-71a3-4a20-9d07-e1df7429fbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:21.683739 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85654069-71a3-4a20-9d07-e1df7429fbcd admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:21.686487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85654069-71a3-4a20-9d07-e1df7429fbcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:21.690655 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85654069-71a3-4a20-9d07-e1df7429fbcd admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:21.705438 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2888/5800] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:14:21.706995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47750c7-d063-4aae-9960-64fa237b38c8 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:21.707377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47750c7-d063-4aae-9960-64fa237b38c8 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:21.707913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47750c7-d063-4aae-9960-64fa237b38c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:21.732120 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d47750c7-d063-4aae-9960-64fa237b38c8 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:21.734070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d47750c7-d063-4aae-9960-64fa237b38c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:21.736667 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2913/5801] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:21.737589 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1d29d-406d-4e9c-9946-6b9e165202b7 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:21.741424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0af1d29d-406d-4e9c-9946-6b9e165202b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:21.758962 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2889/5802] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:21.760428 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47750c7-d063-4aae-9960-64fa237b38c8 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:21.765524 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d47750c7-d063-4aae-9960-64fa237b38c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:21.775084 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1d29d-406d-4e9c-9946-6b9e165202b7 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:21.788377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff7179-9692-41ec-bf58-351f74236f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:21.789219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff7179-9692-41ec-bf58-351f74236f59 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:21.789599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff7179-9692-41ec-bf58-351f74236f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:21.790811 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47750c7-d063-4aae-9960-64fa237b38c8 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:21.793406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff7179-9692-41ec-bf58-351f74236f59 admin admin] PATH_INFO: `/v3/projects/b62ccbeb57bc4acebcba07ac1f82ae22/users/3597dc51e1ae4d80a4bd648fcf3e31bc/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:21.795677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb0b71-3fb7-48c4-bfb6-686bda8b585c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:21.796343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb0b71-3fb7-48c4-bfb6-686bda8b585c admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:21.796630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb0b71-3fb7-48c4-bfb6-686bda8b585c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:21.796956 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb0b71-3fb7-48c4-bfb6-686bda8b585c admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:21.797590 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb0b71-3fb7-48c4-bfb6-686bda8b585c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:21.799788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb0b71-3fb7-48c4-bfb6-686bda8b585c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:21.822196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff7179-9692-41ec-bf58-351f74236f59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b62ccbeb57bc4acebcba07ac1f82ae22, user_id=3597dc51e1ae4d80a4bd648fcf3e31bc, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:21.826280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff7179-9692-41ec-bf58-351f74236f59 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:21.842427 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2890/5803] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:14:21 2022] POST /identity/v3/projects => generated 387 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:14:21.844302 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9bad6-9bcd-4db3-9977-d7e785444974 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:21.844802 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9bad6-9bcd-4db3-9977-d7e785444974 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:21.845758 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9bad6-9bcd-4db3-9977-d7e785444974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:21.857722 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2914/5804] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:14:21 2022] PUT /identity/v3/projects/b62ccbeb57bc4acebcba07ac1f82ae22/users/3597dc51e1ae4d80a4bd648fcf3e31bc/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:21.859206 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff7179-9692-41ec-bf58-351f74236f59 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:21.922364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-cdf9bad6-9bcd-4db3-9977-d7e785444974 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:21.926617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-cdf9bad6-9bcd-4db3-9977-d7e785444974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:21.960108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:21.968188 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff7179-9692-41ec-bf58-351f74236f59 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:21.981594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a4a7b-a374-4aa9-b761-ce3e5f32d987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:21.981594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a4a7b-a374-4aa9-b761-ce3e5f32d987 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:21.981984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a4a7b-a374-4aa9-b761-ce3e5f32d987 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:21.982435 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a4a7b-a374-4aa9-b761-ce3e5f32d987 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:21.983176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a4a7b-a374-4aa9-b761-ce3e5f32d987 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:21.985598 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a4a7b-a374-4aa9-b761-ce3e5f32d987 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:22.021970 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2915/5805] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:14:21 2022] POST /identity/v3/users => generated 300 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:14:22.027296 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479f855-6229-40c0-b0ab-d0c89088c5dc None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:22.027296 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479f855-6229-40c0-b0ab-d0c89088c5dc None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:22.027578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479f855-6229-40c0-b0ab-d0c89088c5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:22.080979 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-c479f855-6229-40c0-b0ab-d0c89088c5dc None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:22.083481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c479f855-6229-40c0-b0ab-d0c89088c5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:22.101636 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2891/5806] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:22.104381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9bad6-9bcd-4db3-9977-d7e785444974 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:22.110603 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2916/5807] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:22.111498 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479f855-6229-40c0-b0ab-d0c89088c5dc None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:22.130968 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9bad6-9bcd-4db3-9977-d7e785444974 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:22.139157 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479f855-6229-40c0-b0ab-d0c89088c5dc None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:22.147297 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254eb47-32e0-4528-8d2f-e2bb08ccfe8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:22.148054 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254eb47-32e0-4528-8d2f-e2bb08ccfe8f admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:22.148618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254eb47-32e0-4528-8d2f-e2bb08ccfe8f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:22.148834 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254eb47-32e0-4528-8d2f-e2bb08ccfe8f admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:22.149372 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dbda7d-be95-44e6-94d1-67cfa5ee0098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:22.149512 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254eb47-32e0-4528-8d2f-e2bb08ccfe8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:22.150718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbda7d-be95-44e6-94d1-67cfa5ee0098 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:22.151003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbda7d-be95-44e6-94d1-67cfa5ee0098 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:22.151280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbda7d-be95-44e6-94d1-67cfa5ee0098 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:22.151948 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dbda7d-be95-44e6-94d1-67cfa5ee0098 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:14:22.153023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dbda7d-be95-44e6-94d1-67cfa5ee0098 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:22.153337 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254eb47-32e0-4528-8d2f-e2bb08ccfe8f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:22.155762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dbda7d-be95-44e6-94d1-67cfa5ee0098 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:22.171540 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2917/5808] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:14:22.173271 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dbda7d-be95-44e6-94d1-67cfa5ee0098 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:22.176223 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-84dbda7d-be95-44e6-94d1-67cfa5ee0098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:22.186406 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2892/5809] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:14:22.187329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254eb47-32e0-4528-8d2f-e2bb08ccfe8f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:22.210592 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254eb47-32e0-4528-8d2f-e2bb08ccfe8f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:22.231295 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806f86e-5f6c-4b63-9fdd-533c214c0281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:22.231972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806f86e-5f6c-4b63-9fdd-533c214c0281 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:22.232367 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806f86e-5f6c-4b63-9fdd-533c214c0281 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:22.232755 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806f86e-5f6c-4b63-9fdd-533c214c0281 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:22.233394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806f86e-5f6c-4b63-9fdd-533c214c0281 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:22.235859 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806f86e-5f6c-4b63-9fdd-533c214c0281 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:22.237990 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:22.303651 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dbda7d-be95-44e6-94d1-67cfa5ee0098 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:22.308969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74707ed1-1ffc-40f0-b54a-9186f6469387 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:22.309769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74707ed1-1ffc-40f0-b54a-9186f6469387 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:22.310117 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74707ed1-1ffc-40f0-b54a-9186f6469387 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:22.310363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74707ed1-1ffc-40f0-b54a-9186f6469387 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:22.324319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74707ed1-1ffc-40f0-b54a-9186f6469387 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:22.325915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74707ed1-1ffc-40f0-b54a-9186f6469387 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:22.338760 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2918/5810] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:14:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:14:22.339651 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74707ed1-1ffc-40f0-b54a-9186f6469387 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:22.344756 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2893/5811] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:14:22 2022] POST /identity/v3/projects => generated 367 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:14:22.345884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806f86e-5f6c-4b63-9fdd-533c214c0281 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:22.351086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e806f86e-5f6c-4b63-9fdd-533c214c0281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:22.352995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74707ed1-1ffc-40f0-b54a-9186f6469387 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:22.436824 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9652a45-64af-4c3e-ab1d-877d472bdc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:22.438390 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9652a45-64af-4c3e-ab1d-877d472bdc33 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:22.438522 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9652a45-64af-4c3e-ab1d-877d472bdc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:22.438981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9652a45-64af-4c3e-ab1d-877d472bdc33 admin admin] PATH_INFO: `/v3/projects/9235b5f684dc423db99cc88c3d3066b8/users/48f6c7507a184ed888980974c8bf3054/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:22.463812 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9652a45-64af-4c3e-ab1d-877d472bdc33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9235b5f684dc423db99cc88c3d3066b8, user_id=48f6c7507a184ed888980974c8bf3054, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:22.467168 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9652a45-64af-4c3e-ab1d-877d472bdc33 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:22.498296 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2919/5812] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:14:22 2022] PUT /identity/v3/projects/9235b5f684dc423db99cc88c3d3066b8/users/48f6c7507a184ed888980974c8bf3054/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:22.498296 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9652a45-64af-4c3e-ab1d-877d472bdc33 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:22.587767 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806f86e-5f6c-4b63-9fdd-533c214c0281 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:22.607571 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9652a45-64af-4c3e-ab1d-877d472bdc33 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:22.614623 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd324d-ee29-49e7-ad79-8f8db62d4aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:22.615379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd324d-ee29-49e7-ad79-8f8db62d4aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:22.615671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd324d-ee29-49e7-ad79-8f8db62d4aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:22.615980 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd324d-ee29-49e7-ad79-8f8db62d4aa2 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:22.617712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd324d-ee29-49e7-ad79-8f8db62d4aa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:22.618993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390606ec-f8e7-442b-9e39-ba074e944db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:22.619401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd324d-ee29-49e7-ad79-8f8db62d4aa2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:22.619645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390606ec-f8e7-442b-9e39-ba074e944db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:22.619927 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390606ec-f8e7-442b-9e39-ba074e944db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:22.620203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390606ec-f8e7-442b-9e39-ba074e944db8 admin admin] PATH_INFO: `/v3/projects/1d3cbc84db244a21bf87ec5b31d1a9f3` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:22.622028 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390606ec-f8e7-442b-9e39-ba074e944db8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d3cbc84db244a21bf87ec5b31d1a9f3)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:22.624021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390606ec-f8e7-442b-9e39-ba074e944db8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:22.657548 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2920/5813] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:14:22 2022] POST /identity/v3/users => generated 284 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:14:22.658422 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd324d-ee29-49e7-ad79-8f8db62d4aa2 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:22.678204 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd324d-ee29-49e7-ad79-8f8db62d4aa2 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:22.685942 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ec41c-9897-4df5-a709-1fcd7f7abcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:22.686801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ec41c-9897-4df5-a709-1fcd7f7abcab admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:22.687168 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ec41c-9897-4df5-a709-1fcd7f7abcab admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:22.687450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ec41c-9897-4df5-a709-1fcd7f7abcab admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:22.688168 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ec41c-9897-4df5-a709-1fcd7f7abcab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:22.690134 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ec41c-9897-4df5-a709-1fcd7f7abcab admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:22.707190 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2921/5814] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:14:22.709248 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ec41c-9897-4df5-a709-1fcd7f7abcab admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:22.722118 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ec41c-9897-4df5-a709-1fcd7f7abcab admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:22.729812 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d06aab-c52d-41d9-9f22-865a94a6cbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:22.732216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d06aab-c52d-41d9-9f22-865a94a6cbb9 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:22.732744 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d06aab-c52d-41d9-9f22-865a94a6cbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:22.733088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d06aab-c52d-41d9-9f22-865a94a6cbb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:22.734252 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d06aab-c52d-41d9-9f22-865a94a6cbb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:22.737855 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d06aab-c52d-41d9-9f22-865a94a6cbb9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:22.762786 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2922/5815] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:14:22.764627 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d06aab-c52d-41d9-9f22-865a94a6cbb9 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:22.803099 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d06aab-c52d-41d9-9f22-865a94a6cbb9 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:22.829979 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:22.831035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-390606ec-f8e7-442b-9e39-ba074e944db8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d3cbc84db244a21bf87ec5b31d1a9f3', 'request_id': 'req-390606ec-f8e7-442b-9e39-ba074e944db8'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:22.862842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-390606ec-f8e7-442b-9e39-ba074e944db8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d3cbc84db244a21bf87ec5b31d1a9f3', 'request_id': 'req-390606ec-f8e7-442b-9e39-ba074e944db8'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:22.870917 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-390606ec-f8e7-442b-9e39-ba074e944db8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d3cbc84db244a21bf87ec5b31d1a9f3', 'request_id': 'req-390606ec-f8e7-442b-9e39-ba074e944db8'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:22.900768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-390606ec-f8e7-442b-9e39-ba074e944db8 admin admin] The token cache is being invalidate because project 1d3cbc84db244a21bf87ec5b31d1a9f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:14:22.901072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-390606ec-f8e7-442b-9e39-ba074e944db8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:22.901960 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-390606ec-f8e7-442b-9e39-ba074e944db8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:22.903906 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2894/5816] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:14:22 2022] DELETE /identity/v3/projects/1d3cbc84db244a21bf87ec5b31d1a9f3 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:22.904697 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390606ec-f8e7-442b-9e39-ba074e944db8 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:22.912088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-390606ec-f8e7-442b-9e39-ba074e944db8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:22.923078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdd75c-8198-4c73-a02b-22e3c24acb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:22.924038 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdd75c-8198-4c73-a02b-22e3c24acb73 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:22.924330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdd75c-8198-4c73-a02b-22e3c24acb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:22.924608 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdd75c-8198-4c73-a02b-22e3c24acb73 admin admin] PATH_INFO: `/v3/projects/9235b5f684dc423db99cc88c3d3066b8/users/48f6c7507a184ed888980974c8bf3054/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:22.927639 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fdd75c-8198-4c73-a02b-22e3c24acb73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9235b5f684dc423db99cc88c3d3066b8, user_id=48f6c7507a184ed888980974c8bf3054, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:22.930448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fdd75c-8198-4c73-a02b-22e3c24acb73 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:22.954933 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390606ec-f8e7-442b-9e39-ba074e944db8 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:22.957655 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2923/5817] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:14:22 2022] PUT /identity/v3/projects/9235b5f684dc423db99cc88c3d3066b8/users/48f6c7507a184ed888980974c8bf3054/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:22.959244 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e864b-0013-4879-a0d0-05deaa76ffea None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:22.959533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e864b-0013-4879-a0d0-05deaa76ffea None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:22.960418 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e864b-0013-4879-a0d0-05deaa76ffea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:22.990156 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:23.008899 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-ea8e864b-0013-4879-a0d0-05deaa76ffea None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:23.011082 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ea8e864b-0013-4879-a0d0-05deaa76ffea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:23.116853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28734654-f95c-497f-bfc6-0322e27999fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:23.117489 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28734654-f95c-497f-bfc6-0322e27999fe admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:23.117776 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28734654-f95c-497f-bfc6-0322e27999fe admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:23.118058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28734654-f95c-497f-bfc6-0322e27999fe admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:23.118906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28734654-f95c-497f-bfc6-0322e27999fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:23.121325 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28734654-f95c-497f-bfc6-0322e27999fe admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:23.142123 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2895/5818] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:14:23.142123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd830371-b583-4ee2-b0fd-42e1aa8c3d5e None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:23.142123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd830371-b583-4ee2-b0fd-42e1aa8c3d5e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:23.142948 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd830371-b583-4ee2-b0fd-42e1aa8c3d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:23.237320 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-bd830371-b583-4ee2-b0fd-42e1aa8c3d5e None None] MFA Rules not processed for user `48f6c7507a184ed888980974c8bf3054`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:23.238592 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-bd830371-b583-4ee2-b0fd-42e1aa8c3d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:23.247999 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2924/5819] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:23.248891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e864b-0013-4879-a0d0-05deaa76ffea None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:23.293431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e864b-0013-4879-a0d0-05deaa76ffea None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:23.308986 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2591351-5902-48df-8ca2-7a685bae2a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:23.309680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2591351-5902-48df-8ca2-7a685bae2a85 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:23.310300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2591351-5902-48df-8ca2-7a685bae2a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:23.310741 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2591351-5902-48df-8ca2-7a685bae2a85 admin admin] PATH_INFO: `/v3/projects/d377913709df4f03852a61bfe4949870/users/258550683b604473a3a911a6d2dfa66b/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:23.352149 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2591351-5902-48df-8ca2-7a685bae2a85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d377913709df4f03852a61bfe4949870, user_id=258550683b604473a3a911a6d2dfa66b, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:23.357935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2591351-5902-48df-8ca2-7a685bae2a85 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:23.388715 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2925/5820] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:14:23 2022] PUT /identity/v3/projects/d377913709df4f03852a61bfe4949870/users/258550683b604473a3a911a6d2dfa66b/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:23.391466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9f68c-df55-4b14-8673-945c790b8691 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:23.391979 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9f68c-df55-4b14-8673-945c790b8691 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:23.392252 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9f68c-df55-4b14-8673-945c790b8691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:23.446847 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2896/5821] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:23 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:23.459434 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-69b9f68c-df55-4b14-8673-945c790b8691 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:23.459916 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0d913-9bc8-4173-8fac-b1554d312680 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:23.460361 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0d913-9bc8-4173-8fac-b1554d312680 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:23.462293 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0d913-9bc8-4173-8fac-b1554d312680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:23.465220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-69b9f68c-df55-4b14-8673-945c790b8691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:23.568410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-00c0d913-9bc8-4173-8fac-b1554d312680 None None] MFA Rules not processed for user `258550683b604473a3a911a6d2dfa66b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:23.569858 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-00c0d913-9bc8-4173-8fac-b1554d312680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:23.656863 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2926/5822] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:23.660460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9f68c-df55-4b14-8673-945c790b8691 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:23.661521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-69b9f68c-df55-4b14-8673-945c790b8691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:23.749919 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:23.780094 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2897/5823] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:23.780977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0d913-9bc8-4173-8fac-b1554d312680 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:23.797925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0d913-9bc8-4173-8fac-b1554d312680 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:23.806439 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3c138-4986-41f3-8da2-ead3229babf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:23.810381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3c138-4986-41f3-8da2-ead3229babf9 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:23.810381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3c138-4986-41f3-8da2-ead3229babf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:23.810910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3c138-4986-41f3-8da2-ead3229babf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:23.811662 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3c138-4986-41f3-8da2-ead3229babf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:14:23.812072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3c138-4986-41f3-8da2-ead3229babf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:23.814747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3c138-4986-41f3-8da2-ead3229babf9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:23.842177 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2898/5824] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:14:23.843492 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3c138-4986-41f3-8da2-ead3229babf9 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:23.846955 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-cef3c138-4986-41f3-8da2-ead3229babf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:23.877076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9f68c-df55-4b14-8673-945c790b8691 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:23.883029 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854ff7d-cebf-486d-b603-0f40abebb65b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:23.883656 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854ff7d-cebf-486d-b603-0f40abebb65b service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:23.884079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854ff7d-cebf-486d-b603-0f40abebb65b service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:23.884199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854ff7d-cebf-486d-b603-0f40abebb65b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:23.884832 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:24.033020 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3c138-4986-41f3-8da2-ead3229babf9 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:24.050256 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff53d8b-450b-4bcd-9740-af2846bebdbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:24.051709 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff53d8b-450b-4bcd-9740-af2846bebdbd service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:24.052766 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff53d8b-450b-4bcd-9740-af2846bebdbd service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:24.053164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f854ff7d-cebf-486d-b603-0f40abebb65b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:24.053469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff53d8b-450b-4bcd-9740-af2846bebdbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:24.057274 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f854ff7d-cebf-486d-b603-0f40abebb65b service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:24.098892 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2927/5825] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:14:23 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:14:24.100610 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854ff7d-cebf-486d-b603-0f40abebb65b service cinder] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:24.107848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff53d8b-450b-4bcd-9740-af2846bebdbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:24.113282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff53d8b-450b-4bcd-9740-af2846bebdbd service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:24.139588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854ff7d-cebf-486d-b603-0f40abebb65b service cinder] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:24.156129 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae769066-b592-486c-9253-23290b13ae65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:24.156947 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae769066-b592-486c-9253-23290b13ae65 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:24.157336 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae769066-b592-486c-9253-23290b13ae65 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:24.157721 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae769066-b592-486c-9253-23290b13ae65 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:24.158776 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae769066-b592-486c-9253-23290b13ae65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:24.159521 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2899/5826] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:14:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:14:24.161591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae769066-b592-486c-9253-23290b13ae65 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:24.267905 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2928/5827] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:14:24 2022] POST /identity/v3/projects => generated 369 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:14:24.271327 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff53d8b-450b-4bcd-9740-af2846bebdbd service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:24.291909 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff53d8b-450b-4bcd-9740-af2846bebdbd service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:24.440651 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0223d-dfea-45c1-b2f7-473d36673011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:24.441713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0223d-dfea-45c1-b2f7-473d36673011 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:24.442875 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0223d-dfea-45c1-b2f7-473d36673011 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:24.443390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0223d-dfea-45c1-b2f7-473d36673011 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:24.444343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0223d-dfea-45c1-b2f7-473d36673011 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:24.446885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0223d-dfea-45c1-b2f7-473d36673011 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:24.489382 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2900/5828] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:14:24 2022] POST /identity/v3/users => generated 285 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:14:24.493507 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae769066-b592-486c-9253-23290b13ae65 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:24.527389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae769066-b592-486c-9253-23290b13ae65 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:24.545184 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44d0d8-784e-4ff5-b881-b6b6dfbbe25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:24.545906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44d0d8-784e-4ff5-b881-b6b6dfbbe25d admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:24.546131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44d0d8-784e-4ff5-b881-b6b6dfbbe25d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:24.546409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44d0d8-784e-4ff5-b881-b6b6dfbbe25d admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:24.554908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e44d0d8-784e-4ff5-b881-b6b6dfbbe25d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:24.557627 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e44d0d8-784e-4ff5-b881-b6b6dfbbe25d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:24.635513 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2929/5829] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:14:24 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:14:24.643770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0223d-dfea-45c1-b2f7-473d36673011 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:24.672416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44d0d8-784e-4ff5-b881-b6b6dfbbe25d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:24.675304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6e44d0d8-784e-4ff5-b881-b6b6dfbbe25d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:24.696155 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0223d-dfea-45c1-b2f7-473d36673011 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:24.717764 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179007c-e65c-40a0-a14c-024f83e7cb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:24.719355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179007c-e65c-40a0-a14c-024f83e7cb2d admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:24.719668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179007c-e65c-40a0-a14c-024f83e7cb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:24.719988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179007c-e65c-40a0-a14c-024f83e7cb2d admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:24.734282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2179007c-e65c-40a0-a14c-024f83e7cb2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:24.750486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2179007c-e65c-40a0-a14c-024f83e7cb2d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:24.797054 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2901/5830] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:14:24 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:14:24.803959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179007c-e65c-40a0-a14c-024f83e7cb2d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:24.843451 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179007c-e65c-40a0-a14c-024f83e7cb2d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:24.865301 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0bdce-52ab-4e97-bc84-7f02ad02eab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:24.865995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0bdce-52ab-4e97-bc84-7f02ad02eab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:24.866280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0bdce-52ab-4e97-bc84-7f02ad02eab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:24.866580 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0bdce-52ab-4e97-bc84-7f02ad02eab4 admin admin] PATH_INFO: `/v3/projects/f4240b4cc4c84afeabcd61f40a14417f/users/d8d4acefff664579b1bf058a9cdd15c7/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:24.873175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44d0d8-784e-4ff5-b881-b6b6dfbbe25d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:24.898898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcbe77-8ab2-4acb-95cf-d039161ac1ed tempest-RoutersIpV6AdminTest-822536589 tempest-RoutersIpV6AdminTest-822536589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7bf9695c0c4414a6a7e64e471b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76b3f8f9ac954ebaaaa15ec0cfb64232', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:24.899539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcbe77-8ab2-4acb-95cf-d039161ac1ed tempest-RoutersIpV6AdminTest-822536589 tempest-RoutersIpV6AdminTest-822536589-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:24.899828 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcbe77-8ab2-4acb-95cf-d039161ac1ed tempest-RoutersIpV6AdminTest-822536589 tempest-RoutersIpV6AdminTest-822536589-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:24.900105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcbe77-8ab2-4acb-95cf-d039161ac1ed tempest-RoutersIpV6AdminTest-822536589 tempest-RoutersIpV6AdminTest-822536589-project-admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:24.903003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bcbe77-8ab2-4acb-95cf-d039161ac1ed tempest-RoutersIpV6AdminTest-822536589 tempest-RoutersIpV6AdminTest-822536589-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:14:24.903003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bcbe77-8ab2-4acb-95cf-d039161ac1ed tempest-RoutersIpV6AdminTest-822536589 tempest-RoutersIpV6AdminTest-822536589-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:24.903003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bcbe77-8ab2-4acb-95cf-d039161ac1ed tempest-RoutersIpV6AdminTest-822536589 tempest-RoutersIpV6AdminTest-822536589-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:24.917146 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed0bdce-52ab-4e97-bc84-7f02ad02eab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4240b4cc4c84afeabcd61f40a14417f, user_id=d8d4acefff664579b1bf058a9cdd15c7, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:24.919893 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed0bdce-52ab-4e97-bc84-7f02ad02eab4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:24.930621 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2930/5831] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:14:24.934070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcbe77-8ab2-4acb-95cf-d039161ac1ed tempest-RoutersIpV6AdminTest-822536589 tempest-RoutersIpV6AdminTest-822536589-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:24.954526 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2902/5832] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:14:24 2022] PUT /identity/v3/projects/f4240b4cc4c84afeabcd61f40a14417f/users/d8d4acefff664579b1bf058a9cdd15c7/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:24.969273 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81a386-9a3f-43d0-a13f-4793d996fb55 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:24.969462 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81a386-9a3f-43d0-a13f-4793d996fb55 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:24.969764 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81a386-9a3f-43d0-a13f-4793d996fb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:24.977894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcbe77-8ab2-4acb-95cf-d039161ac1ed tempest-RoutersIpV6AdminTest-822536589 tempest-RoutersIpV6AdminTest-822536589-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:25.041300 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-5a81a386-9a3f-43d0-a13f-4793d996fb55 None None] MFA Rules not processed for user `d8d4acefff664579b1bf058a9cdd15c7`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:25.048741 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5a81a386-9a3f-43d0-a13f-4793d996fb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:25.078875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:25.123997 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea5253-c86b-4390-99d7-22aa806d9f07 tempest-RoutersIpV6AdminTest-822536589 tempest-RoutersIpV6AdminTest-822536589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7bf9695c0c4414a6a7e64e471b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76b3f8f9ac954ebaaaa15ec0cfb64232', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:25.125152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea5253-c86b-4390-99d7-22aa806d9f07 tempest-RoutersIpV6AdminTest-822536589 tempest-RoutersIpV6AdminTest-822536589-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:25.125641 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea5253-c86b-4390-99d7-22aa806d9f07 tempest-RoutersIpV6AdminTest-822536589 tempest-RoutersIpV6AdminTest-822536589-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:25.126144 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea5253-c86b-4390-99d7-22aa806d9f07 tempest-RoutersIpV6AdminTest-822536589 tempest-RoutersIpV6AdminTest-822536589-project-admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:25.127038 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea5253-c86b-4390-99d7-22aa806d9f07 tempest-RoutersIpV6AdminTest-822536589 tempest-RoutersIpV6AdminTest-822536589-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:25.129139 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea5253-c86b-4390-99d7-22aa806d9f07 tempest-RoutersIpV6AdminTest-822536589 tempest-RoutersIpV6AdminTest-822536589-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:25.188314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:25.200354 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2903/5833] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:25.208585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81a386-9a3f-43d0-a13f-4793d996fb55 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:25.210189 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2931/5834] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:14:24 2022] POST /identity/v3/projects => generated 349 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:14:25.212050 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea5253-c86b-4390-99d7-22aa806d9f07 tempest-RoutersIpV6AdminTest-822536589 tempest-RoutersIpV6AdminTest-822536589-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:25.368374 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea5253-c86b-4390-99d7-22aa806d9f07 tempest-RoutersIpV6AdminTest-822536589 tempest-RoutersIpV6AdminTest-822536589-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:25.380759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81a386-9a3f-43d0-a13f-4793d996fb55 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:25.383668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c4c69-d6c6-492b-9ada-91657c3a67e2 tempest-RoutersIpV6AdminTest-822536589 tempest-RoutersIpV6AdminTest-822536589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7bf9695c0c4414a6a7e64e471b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76b3f8f9ac954ebaaaa15ec0cfb64232', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:25.384303 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c4c69-d6c6-492b-9ada-91657c3a67e2 tempest-RoutersIpV6AdminTest-822536589 tempest-RoutersIpV6AdminTest-822536589-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:25.384576 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c4c69-d6c6-492b-9ada-91657c3a67e2 tempest-RoutersIpV6AdminTest-822536589 tempest-RoutersIpV6AdminTest-822536589-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:25.385756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c4c69-d6c6-492b-9ada-91657c3a67e2 tempest-RoutersIpV6AdminTest-822536589 tempest-RoutersIpV6AdminTest-822536589-project-admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:25.386431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c4c69-d6c6-492b-9ada-91657c3a67e2 tempest-RoutersIpV6AdminTest-822536589 tempest-RoutersIpV6AdminTest-822536589-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:14:25.386768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c4c69-d6c6-492b-9ada-91657c3a67e2 tempest-RoutersIpV6AdminTest-822536589 tempest-RoutersIpV6AdminTest-822536589-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:25.388397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c4c69-d6c6-492b-9ada-91657c3a67e2 tempest-RoutersIpV6AdminTest-822536589 tempest-RoutersIpV6AdminTest-822536589-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:25.433994 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2932/5835] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:14:25.500988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c44da-2f51-42d8-a8c4-cc69d1631964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:25.502810 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c44da-2f51-42d8-a8c4-cc69d1631964 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:25.503100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c44da-2f51-42d8-a8c4-cc69d1631964 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:25.503379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c44da-2f51-42d8-a8c4-cc69d1631964 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:25.505757 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c44da-2f51-42d8-a8c4-cc69d1631964 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:25.511232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c44da-2f51-42d8-a8c4-cc69d1631964 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:25.574764 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2904/5836] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:14:25 2022] POST /identity/v3/projects => generated 369 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:14:25.578910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c4c69-d6c6-492b-9ada-91657c3a67e2 tempest-RoutersIpV6AdminTest-822536589 tempest-RoutersIpV6AdminTest-822536589-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:25.595552 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c4c69-d6c6-492b-9ada-91657c3a67e2 tempest-RoutersIpV6AdminTest-822536589 tempest-RoutersIpV6AdminTest-822536589-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:25.702162 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c44da-2f51-42d8-a8c4-cc69d1631964 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:25.703984 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9c0c44da-2f51-42d8-a8c4-cc69d1631964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:25.731627 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9388a5-68f3-43d9-a157-45fe312b4619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:25.733270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9388a5-68f3-43d9-a157-45fe312b4619 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:25.733736 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9388a5-68f3-43d9-a157-45fe312b4619 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:25.734172 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9388a5-68f3-43d9-a157-45fe312b4619 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:25.735020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9388a5-68f3-43d9-a157-45fe312b4619 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:25.737159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9388a5-68f3-43d9-a157-45fe312b4619 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:25.788980 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2933/5837] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:14:25 2022] POST /identity/v3/users => generated 291 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:14:25.793153 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9388a5-68f3-43d9-a157-45fe312b4619 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:25.853694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9388a5-68f3-43d9-a157-45fe312b4619 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:25.874520 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c44da-2f51-42d8-a8c4-cc69d1631964 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:25.893615 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ab3c2-06b2-4125-8934-348452d2f668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:25.898504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ab3c2-06b2-4125-8934-348452d2f668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:25.898710 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2264296-a236-4321-8167-c812a0cb9462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:25.899563 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ab3c2-06b2-4125-8934-348452d2f668 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:25.902761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ab3c2-06b2-4125-8934-348452d2f668 admin admin] PATH_INFO: `/v3/users/e7ffda9c337141399842822aa94d84f7` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:25.903560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2264296-a236-4321-8167-c812a0cb9462 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:25.905231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ab3c2-06b2-4125-8934-348452d2f668 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7ffda9c337141399842822aa94d84f7)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:25.906358 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2264296-a236-4321-8167-c812a0cb9462 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:25.910503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2264296-a236-4321-8167-c812a0cb9462 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:25.911562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ab3c2-06b2-4125-8934-348452d2f668 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:25.913908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2264296-a236-4321-8167-c812a0cb9462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:25.920957 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2264296-a236-4321-8167-c812a0cb9462 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:25.972705 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2934/5838] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:14:25.980306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2264296-a236-4321-8167-c812a0cb9462 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:26.009583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2264296-a236-4321-8167-c812a0cb9462 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:26.117039 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d34faf-b56c-4fc7-b7a3-9597363031f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:26.117747 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d34faf-b56c-4fc7-b7a3-9597363031f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:26.118032 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d34faf-b56c-4fc7-b7a3-9597363031f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:26.118312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d34faf-b56c-4fc7-b7a3-9597363031f3 admin admin] PATH_INFO: `/v3/projects/b37999f7725146e9bf60f64b15a54700/users/935f09c95cf3402bb354fad40f6e3fc9/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:26.118701 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:26.182038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1b4ab3c2-06b2-4125-8934-348452d2f668 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7ffda9c337141399842822aa94d84f7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:26.182865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1b4ab3c2-06b2-4125-8934-348452d2f668 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7ffda9c337141399842822aa94d84f7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:26.183507 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1b4ab3c2-06b2-4125-8934-348452d2f668 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7ffda9c337141399842822aa94d84f7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:26.230332 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1b4ab3c2-06b2-4125-8934-348452d2f668 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7ffda9c337141399842822aa94d84f7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:26.281836 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d34faf-b56c-4fc7-b7a3-9597363031f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b37999f7725146e9bf60f64b15a54700, user_id=935f09c95cf3402bb354fad40f6e3fc9, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:26.291019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d34faf-b56c-4fc7-b7a3-9597363031f3 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:26.294940 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1b4ab3c2-06b2-4125-8934-348452d2f668 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7ffda9c337141399842822aa94d84f7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:26.366854 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2905/5839] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:14:25 2022] DELETE /identity/v3/users/e7ffda9c337141399842822aa94d84f7 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:14:26.374936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa686b00-b3a6-4628-b6af-250f93ceb23e None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:26.375186 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa686b00-b3a6-4628-b6af-250f93ceb23e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:26.375294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa686b00-b3a6-4628-b6af-250f93ceb23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:26.387294 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2935/5840] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:14:25 2022] PUT /identity/v3/projects/b37999f7725146e9bf60f64b15a54700/users/935f09c95cf3402bb354fad40f6e3fc9/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:26.389643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d34faf-b56c-4fc7-b7a3-9597363031f3 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:26.391955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d2d34faf-b56c-4fc7-b7a3-9597363031f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:26.417306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:26.440137 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-aa686b00-b3a6-4628-b6af-250f93ceb23e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:26.444945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-aa686b00-b3a6-4628-b6af-250f93ceb23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:26.564043 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d34faf-b56c-4fc7-b7a3-9597363031f3 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:26.579631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685aa8cc-e170-483f-bd2b-ea94616f0ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:26.580464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685aa8cc-e170-483f-bd2b-ea94616f0ded admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:26.583158 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685aa8cc-e170-483f-bd2b-ea94616f0ded admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:26.583730 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685aa8cc-e170-483f-bd2b-ea94616f0ded admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:26.585465 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685aa8cc-e170-483f-bd2b-ea94616f0ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:26.592617 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2906/5841] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:26.594056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685aa8cc-e170-483f-bd2b-ea94616f0ded admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:26.602195 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa686b00-b3a6-4628-b6af-250f93ceb23e None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:26.605078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-aa686b00-b3a6-4628-b6af-250f93ceb23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:26.627303 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2936/5842] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:14:26.630831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685aa8cc-e170-483f-bd2b-ea94616f0ded admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:26.669207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685aa8cc-e170-483f-bd2b-ea94616f0ded admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:26.684990 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c114d-a248-449e-a5c6-6fda3bf69dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:26.685778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c114d-a248-449e-a5c6-6fda3bf69dad admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:26.686350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c114d-a248-449e-a5c6-6fda3bf69dad admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:26.686760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c114d-a248-449e-a5c6-6fda3bf69dad admin admin] PATH_INFO: `/v3/projects/b37999f7725146e9bf60f64b15a54700/users/935f09c95cf3402bb354fad40f6e3fc9/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:26.690816 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c114d-a248-449e-a5c6-6fda3bf69dad admin admin] RBAC: Authorizing `identity:create_grant(project_id=b37999f7725146e9bf60f64b15a54700, user_id=935f09c95cf3402bb354fad40f6e3fc9, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:26.704151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c114d-a248-449e-a5c6-6fda3bf69dad admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:26.724936 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2937/5843] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:14:26 2022] PUT /identity/v3/projects/b37999f7725146e9bf60f64b15a54700/users/935f09c95cf3402bb354fad40f6e3fc9/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:26.725964 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c114d-a248-449e-a5c6-6fda3bf69dad admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:26.731357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-421c114d-a248-449e-a5c6-6fda3bf69dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:26.749971 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa686b00-b3a6-4628-b6af-250f93ceb23e None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:26.883941 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c114d-a248-449e-a5c6-6fda3bf69dad admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:26.889441 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd2a45-2883-4615-a2ee-921d34cbfce8 tempest-RoutersIpV6AdminTest-822536589 tempest-RoutersIpV6AdminTest-822536589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7bf9695c0c4414a6a7e64e471b6fbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76b3f8f9ac954ebaaaa15ec0cfb64232', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:26.890195 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd2a45-2883-4615-a2ee-921d34cbfce8 tempest-RoutersIpV6AdminTest-822536589 tempest-RoutersIpV6AdminTest-822536589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:26.890484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd2a45-2883-4615-a2ee-921d34cbfce8 tempest-RoutersIpV6AdminTest-822536589 tempest-RoutersIpV6AdminTest-822536589-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:26.890787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd2a45-2883-4615-a2ee-921d34cbfce8 tempest-RoutersIpV6AdminTest-822536589 tempest-RoutersIpV6AdminTest-822536589-project-admin] PATH_INFO: `/v3/projects/27d3c681a4bc44a3b1fe54c925d867e9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:26.891986 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd2a45-2883-4615-a2ee-921d34cbfce8 tempest-RoutersIpV6AdminTest-822536589 tempest-RoutersIpV6AdminTest-822536589-project-admin] RBAC: Authorizing `identity:delete_project(project_id=27d3c681a4bc44a3b1fe54c925d867e9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:26.894013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd2a45-2883-4615-a2ee-921d34cbfce8 tempest-RoutersIpV6AdminTest-822536589 tempest-RoutersIpV6AdminTest-822536589-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:26.917168 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6e9d4-5da6-463c-a472-d9dcdfb7e575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:26.919886 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6e9d4-5da6-463c-a472-d9dcdfb7e575 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:26.920581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6e9d4-5da6-463c-a472-d9dcdfb7e575 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:26.922432 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6e9d4-5da6-463c-a472-d9dcdfb7e575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:26.979548 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:27.007378 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f6fd2a45-2883-4615-a2ee-921d34cbfce8 tempest-RoutersIpV6AdminTest-822536589 tempest-RoutersIpV6AdminTest-822536589-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27d3c681a4bc44a3b1fe54c925d867e9', 'request_id': 'req-f6fd2a45-2883-4615-a2ee-921d34cbfce8'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:27.016501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f6fd2a45-2883-4615-a2ee-921d34cbfce8 tempest-RoutersIpV6AdminTest-822536589 tempest-RoutersIpV6AdminTest-822536589-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27d3c681a4bc44a3b1fe54c925d867e9', 'request_id': 'req-f6fd2a45-2883-4615-a2ee-921d34cbfce8'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:27.025564 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f6fd2a45-2883-4615-a2ee-921d34cbfce8 tempest-RoutersIpV6AdminTest-822536589 tempest-RoutersIpV6AdminTest-822536589-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27d3c681a4bc44a3b1fe54c925d867e9', 'request_id': 'req-f6fd2a45-2883-4615-a2ee-921d34cbfce8'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:27.043996 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f6fd2a45-2883-4615-a2ee-921d34cbfce8 tempest-RoutersIpV6AdminTest-822536589 tempest-RoutersIpV6AdminTest-822536589-project-admin] The token cache is being invalidate because project 27d3c681a4bc44a3b1fe54c925d867e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:14:27.044501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f6fd2a45-2883-4615-a2ee-921d34cbfce8 tempest-RoutersIpV6AdminTest-822536589 tempest-RoutersIpV6AdminTest-822536589-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:27.045655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f6fd2a45-2883-4615-a2ee-921d34cbfce8 tempest-RoutersIpV6AdminTest-822536589 tempest-RoutersIpV6AdminTest-822536589-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:27.053356 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2938/5844] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:14:26 2022] DELETE /identity/v3/projects/27d3c681a4bc44a3b1fe54c925d867e9 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:27.055033 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6de56-a669-45c2-8333-e5a09efa4792 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:27.055326 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6de56-a669-45c2-8333-e5a09efa4792 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:27.055726 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6de56-a669-45c2-8333-e5a09efa4792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:27.091819 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c6e9d4-5da6-463c-a472-d9dcdfb7e575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:27.092856 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-baa6de56-a669-45c2-8333-e5a09efa4792 None None] MFA Rules not processed for user `935f09c95cf3402bb354fad40f6e3fc9`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:27.093322 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c6e9d4-5da6-463c-a472-d9dcdfb7e575 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:27.095211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-baa6de56-a669-45c2-8333-e5a09efa4792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:27.118022 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:27.149484 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2907/5845] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:14:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:14:27.154776 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6e9d4-5da6-463c-a472-d9dcdfb7e575 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:27.193068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6e9d4-5da6-463c-a472-d9dcdfb7e575 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:27.225050 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2939/5846] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:27.232546 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6de56-a669-45c2-8333-e5a09efa4792 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:27.234178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-baa6de56-a669-45c2-8333-e5a09efa4792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:27.324678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6de56-a669-45c2-8333-e5a09efa4792 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:27.332110 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c42422-2277-49e4-8d01-99a5628a42cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:27.334177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c42422-2277-49e4-8d01-99a5628a42cc service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:27.334587 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c42422-2277-49e4-8d01-99a5628a42cc service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:27.334961 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c42422-2277-49e4-8d01-99a5628a42cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:27.352195 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c42422-2277-49e4-8d01-99a5628a42cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:27.355131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c42422-2277-49e4-8d01-99a5628a42cc service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:27.361475 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704b37b-b08b-4626-9fcd-679f0049f142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:27.362120 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704b37b-b08b-4626-9fcd-679f0049f142 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:27.362403 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704b37b-b08b-4626-9fcd-679f0049f142 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:27.363140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704b37b-b08b-4626-9fcd-679f0049f142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:27.366436 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f704b37b-b08b-4626-9fcd-679f0049f142 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:27.376243 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2940/5847] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:14:27 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:14:27.472468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c42422-2277-49e4-8d01-99a5628a42cc service cinder] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:27.486467 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c42422-2277-49e4-8d01-99a5628a42cc service cinder] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:27.491230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4a550-1997-4ffd-949b-acad8189ef28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:27.492048 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4a550-1997-4ffd-949b-acad8189ef28 service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:27.492482 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4a550-1997-4ffd-949b-acad8189ef28 service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:27.492916 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4a550-1997-4ffd-949b-acad8189ef28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:27.497200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7fd4a550-1997-4ffd-949b-acad8189ef28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:27.559847 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704b37b-b08b-4626-9fcd-679f0049f142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:27.564448 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704b37b-b08b-4626-9fcd-679f0049f142 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:27.594249 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2908/5848] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:14:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:14:27.607572 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4a550-1997-4ffd-949b-acad8189ef28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:27.609454 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4a550-1997-4ffd-949b-acad8189ef28 service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:27.638081 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2941/5849] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:14:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:14:30.052711 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704b37b-b08b-4626-9fcd-679f0049f142 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:30.054426 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f704b37b-b08b-4626-9fcd-679f0049f142 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:30.257691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704b37b-b08b-4626-9fcd-679f0049f142 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:30.280013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a5031-898a-4f2b-9bee-2eb107615318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:30.282435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a5031-898a-4f2b-9bee-2eb107615318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:30.283161 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a5031-898a-4f2b-9bee-2eb107615318 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:30.283446 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a5031-898a-4f2b-9bee-2eb107615318 admin admin] PATH_INFO: `/v3/projects/83ab6c0e2dff4baeada7ebe11c347574` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:30.284782 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a5031-898a-4f2b-9bee-2eb107615318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83ab6c0e2dff4baeada7ebe11c347574)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:30.287186 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a5031-898a-4f2b-9bee-2eb107615318 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:30.312129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:30.397423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f10a5031-898a-4f2b-9bee-2eb107615318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83ab6c0e2dff4baeada7ebe11c347574', 'request_id': 'req-f10a5031-898a-4f2b-9bee-2eb107615318'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:30.414113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f10a5031-898a-4f2b-9bee-2eb107615318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83ab6c0e2dff4baeada7ebe11c347574', 'request_id': 'req-f10a5031-898a-4f2b-9bee-2eb107615318'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:30.432198 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f10a5031-898a-4f2b-9bee-2eb107615318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83ab6c0e2dff4baeada7ebe11c347574', 'request_id': 'req-f10a5031-898a-4f2b-9bee-2eb107615318'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:30.463441 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f10a5031-898a-4f2b-9bee-2eb107615318 admin admin] The token cache is being invalidate because project 83ab6c0e2dff4baeada7ebe11c347574 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:14:30.464261 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f10a5031-898a-4f2b-9bee-2eb107615318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:30.465206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f10a5031-898a-4f2b-9bee-2eb107615318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:30.471971 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2909/5850] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:14:30 2022] DELETE /identity/v3/projects/83ab6c0e2dff4baeada7ebe11c347574 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:30.475861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4a550-1997-4ffd-949b-acad8189ef28 service cinder] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:30.497653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4a550-1997-4ffd-949b-acad8189ef28 service cinder] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:30.600378 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:30.615789 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1ec80-1c32-4dca-9852-9551640de9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:30.616700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1ec80-1c32-4dca-9852-9551640de9e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:30.617169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1ec80-1c32-4dca-9852-9551640de9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:30.617602 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1ec80-1c32-4dca-9852-9551640de9e8 admin admin] PATH_INFO: `/v3/users/48f6c7507a184ed888980974c8bf3054` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:30.619629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b1ec80-1c32-4dca-9852-9551640de9e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48f6c7507a184ed888980974c8bf3054)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:30.621746 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b1ec80-1c32-4dca-9852-9551640de9e8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:30.696273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-39b1ec80-1c32-4dca-9852-9551640de9e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48f6c7507a184ed888980974c8bf3054'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:30.713228 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-39b1ec80-1c32-4dca-9852-9551640de9e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48f6c7507a184ed888980974c8bf3054'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:30.714406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-39b1ec80-1c32-4dca-9852-9551640de9e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48f6c7507a184ed888980974c8bf3054'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:30.715351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-39b1ec80-1c32-4dca-9852-9551640de9e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48f6c7507a184ed888980974c8bf3054'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:30.732492 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-39b1ec80-1c32-4dca-9852-9551640de9e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48f6c7507a184ed888980974c8bf3054'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:30.773893 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2942/5851] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:14:30 2022] DELETE /identity/v3/users/48f6c7507a184ed888980974c8bf3054 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:31.024292 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a5031-898a-4f2b-9bee-2eb107615318 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:31.027721 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f10a5031-898a-4f2b-9bee-2eb107615318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:31.050831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a5031-898a-4f2b-9bee-2eb107615318 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:31.149673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c30bf-0c9c-4504-b1ae-b24edb4a925b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:31.164572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c30bf-0c9c-4504-b1ae-b24edb4a925b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:31.166799 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c30bf-0c9c-4504-b1ae-b24edb4a925b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:31.168778 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c30bf-0c9c-4504-b1ae-b24edb4a925b admin admin] PATH_INFO: `/v3/users/d8d4acefff664579b1bf058a9cdd15c7` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:31.174322 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c30bf-0c9c-4504-b1ae-b24edb4a925b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8d4acefff664579b1bf058a9cdd15c7)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:31.179046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c30bf-0c9c-4504-b1ae-b24edb4a925b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:31.289502 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-378c30bf-0c9c-4504-b1ae-b24edb4a925b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8d4acefff664579b1bf058a9cdd15c7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:31.294136 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-378c30bf-0c9c-4504-b1ae-b24edb4a925b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8d4acefff664579b1bf058a9cdd15c7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:31.295206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-378c30bf-0c9c-4504-b1ae-b24edb4a925b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8d4acefff664579b1bf058a9cdd15c7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:31.317226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-378c30bf-0c9c-4504-b1ae-b24edb4a925b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8d4acefff664579b1bf058a9cdd15c7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:31.369453 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-378c30bf-0c9c-4504-b1ae-b24edb4a925b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8d4acefff664579b1bf058a9cdd15c7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:31.406648 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2910/5852] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:14:31 2022] DELETE /identity/v3/users/d8d4acefff664579b1bf058a9cdd15c7 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:31.408218 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d20d4-e66e-495c-8186-9a30ff0a4b2f None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:31.408529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d20d4-e66e-495c-8186-9a30ff0a4b2f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:31.408778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d20d4-e66e-495c-8186-9a30ff0a4b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:31.447510 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-8d4d20d4-e66e-495c-8186-9a30ff0a4b2f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:31.449714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8d4d20d4-e66e-495c-8186-9a30ff0a4b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:31.538521 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2943/5853] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:14:31.558415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c30bf-0c9c-4504-b1ae-b24edb4a925b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:31.560999 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-378c30bf-0c9c-4504-b1ae-b24edb4a925b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:31.642437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:31.749371 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c30bf-0c9c-4504-b1ae-b24edb4a925b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:31.757745 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894e609-9c4d-4d8d-8713-9df9455e2527 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:31.758891 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894e609-9c4d-4d8d-8713-9df9455e2527 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:31.759437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894e609-9c4d-4d8d-8713-9df9455e2527 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:31.760341 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894e609-9c4d-4d8d-8713-9df9455e2527 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:31.772827 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894e609-9c4d-4d8d-8713-9df9455e2527 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:31.775863 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894e609-9c4d-4d8d-8713-9df9455e2527 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:31.791545 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2911/5854] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:14:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:14:31.942193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d20d4-e66e-495c-8186-9a30ff0a4b2f None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:31.944092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8d4d20d4-e66e-495c-8186-9a30ff0a4b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:31.983293 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d20d4-e66e-495c-8186-9a30ff0a4b2f None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:31.990341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c194c9-0ea4-4785-a63c-1cfe401f6a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:31.991255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c194c9-0ea4-4785-a63c-1cfe401f6a17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:31.992823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c194c9-0ea4-4785-a63c-1cfe401f6a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:31.993271 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c194c9-0ea4-4785-a63c-1cfe401f6a17 admin admin] PATH_INFO: `/v3/projects/9235b5f684dc423db99cc88c3d3066b8` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:31.994768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c194c9-0ea4-4785-a63c-1cfe401f6a17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9235b5f684dc423db99cc88c3d3066b8)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:31.996853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c194c9-0ea4-4785-a63c-1cfe401f6a17 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:32.078233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b3c194c9-0ea4-4785-a63c-1cfe401f6a17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9235b5f684dc423db99cc88c3d3066b8', 'request_id': 'req-b3c194c9-0ea4-4785-a63c-1cfe401f6a17'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:32.092645 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b3c194c9-0ea4-4785-a63c-1cfe401f6a17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9235b5f684dc423db99cc88c3d3066b8', 'request_id': 'req-b3c194c9-0ea4-4785-a63c-1cfe401f6a17'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:32.107220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b3c194c9-0ea4-4785-a63c-1cfe401f6a17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9235b5f684dc423db99cc88c3d3066b8', 'request_id': 'req-b3c194c9-0ea4-4785-a63c-1cfe401f6a17'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:32.111572 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:32.127145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b3c194c9-0ea4-4785-a63c-1cfe401f6a17 admin admin] The token cache is being invalidate because project 9235b5f684dc423db99cc88c3d3066b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:14:32.127865 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b3c194c9-0ea4-4785-a63c-1cfe401f6a17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:32.128773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b3c194c9-0ea4-4785-a63c-1cfe401f6a17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:32.133526 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2944/5855] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:14:31 2022] DELETE /identity/v3/projects/9235b5f684dc423db99cc88c3d3066b8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:32.137546 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732dc9f-9116-4a6c-9ec0-43fe667acca0 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:32.138219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732dc9f-9116-4a6c-9ec0-43fe667acca0 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:32.139459 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732dc9f-9116-4a6c-9ec0-43fe667acca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:32.166802 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-4732dc9f-9116-4a6c-9ec0-43fe667acca0 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:32.169155 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4732dc9f-9116-4a6c-9ec0-43fe667acca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:32.288250 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2912/5856] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:32.297092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bdceea-43b5-47c6-98f5-a1a65d4ac140 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:32.297377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bdceea-43b5-47c6-98f5-a1a65d4ac140 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:32.297832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bdceea-43b5-47c6-98f5-a1a65d4ac140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:32.339859 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-32bdceea-43b5-47c6-98f5-a1a65d4ac140 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:32.345007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-32bdceea-43b5-47c6-98f5-a1a65d4ac140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:32.370740 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2945/5857] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:32.371476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732dc9f-9116-4a6c-9ec0-43fe667acca0 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:32.384093 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732dc9f-9116-4a6c-9ec0-43fe667acca0 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:32.401737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a97b79-28e6-456b-931c-66d2dc4c22c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:32.402310 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a97b79-28e6-456b-931c-66d2dc4c22c1 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:32.402604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a97b79-28e6-456b-931c-66d2dc4c22c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:32.402880 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a97b79-28e6-456b-931c-66d2dc4c22c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:32.403538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a97b79-28e6-456b-931c-66d2dc4c22c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:14:32.403978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a97b79-28e6-456b-931c-66d2dc4c22c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:32.408969 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a97b79-28e6-456b-931c-66d2dc4c22c1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:32.441093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bdceea-43b5-47c6-98f5-a1a65d4ac140 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:32.451270 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2913/5858] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:14:32.453135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bdceea-43b5-47c6-98f5-a1a65d4ac140 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:32.472461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8c024-f034-4961-91c4-33ff7bfc8206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:32.476061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8c024-f034-4961-91c4-33ff7bfc8206 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:32.476061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8c024-f034-4961-91c4-33ff7bfc8206 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:32.476287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8c024-f034-4961-91c4-33ff7bfc8206 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:32.476861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b8c024-f034-4961-91c4-33ff7bfc8206 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:32.478872 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b8c024-f034-4961-91c4-33ff7bfc8206 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:32.548432 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2946/5859] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:14:32 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:14:32.553102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a97b79-28e6-456b-931c-66d2dc4c22c1 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:32.569699 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a97b79-28e6-456b-931c-66d2dc4c22c1 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:32.702330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102386e-ace9-4c3b-94a5-593360edda63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:32.703570 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102386e-ace9-4c3b-94a5-593360edda63 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:32.703852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102386e-ace9-4c3b-94a5-593360edda63 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:32.704122 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102386e-ace9-4c3b-94a5-593360edda63 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:32.704805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102386e-ace9-4c3b-94a5-593360edda63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:32.706968 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102386e-ace9-4c3b-94a5-593360edda63 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:32.770590 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2914/5860] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:14:32 2022] POST /identity/v3/users => generated 292 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:14:32.778827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8c024-f034-4961-91c4-33ff7bfc8206 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:32.798191 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8c024-f034-4961-91c4-33ff7bfc8206 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:32.816028 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146eb476-c00a-4b98-a45a-704155b0df25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:32.819059 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146eb476-c00a-4b98-a45a-704155b0df25 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:32.820774 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146eb476-c00a-4b98-a45a-704155b0df25 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:32.821257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146eb476-c00a-4b98-a45a-704155b0df25 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:32.824935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146eb476-c00a-4b98-a45a-704155b0df25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:32.829232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146eb476-c00a-4b98-a45a-704155b0df25 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:32.873546 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102386e-ace9-4c3b-94a5-593360edda63 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:32.882316 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2947/5861] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:14:32.892360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102386e-ace9-4c3b-94a5-593360edda63 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:32.905804 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee0a1c-baa5-4f67-ac07-47f8fc54cb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:32.906814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee0a1c-baa5-4f67-ac07-47f8fc54cb2b admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:32.907149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee0a1c-baa5-4f67-ac07-47f8fc54cb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:32.907568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee0a1c-baa5-4f67-ac07-47f8fc54cb2b admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:32.908473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee0a1c-baa5-4f67-ac07-47f8fc54cb2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:32.913939 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee0a1c-baa5-4f67-ac07-47f8fc54cb2b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:32.944414 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2915/5862] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:14:32.948406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146eb476-c00a-4b98-a45a-704155b0df25 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:32.973538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146eb476-c00a-4b98-a45a-704155b0df25 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:32.987230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e433883-7d69-4644-b094-a6cb9caebfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:32.990358 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e433883-7d69-4644-b094-a6cb9caebfeb admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:32.990822 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e433883-7d69-4644-b094-a6cb9caebfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:32.991264 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e433883-7d69-4644-b094-a6cb9caebfeb admin admin] PATH_INFO: `/v3/projects/aaa1a2672fd144568d3b69d580990a19/users/c4004a0c84494079a3eeb9b732696bf4/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:32.994272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664aa78f-198c-4eb4-a220-51d27aa741d5 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:32.994750 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664aa78f-198c-4eb4-a220-51d27aa741d5 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:32.995169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664aa78f-198c-4eb4-a220-51d27aa741d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:33.039845 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e433883-7d69-4644-b094-a6cb9caebfeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaa1a2672fd144568d3b69d580990a19, user_id=c4004a0c84494079a3eeb9b732696bf4, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:33.043187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e433883-7d69-4644-b094-a6cb9caebfeb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:33.070300 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2948/5863] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:14:32 2022] PUT /identity/v3/projects/aaa1a2672fd144568d3b69d580990a19/users/c4004a0c84494079a3eeb9b732696bf4/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:14:33.080769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb69b80-afea-4d49-ac06-47e263b1cbef None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:33.081414 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb69b80-afea-4d49-ac06-47e263b1cbef None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:33.081822 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb69b80-afea-4d49-ac06-47e263b1cbef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:33.114953 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-664aa78f-198c-4eb4-a220-51d27aa741d5 None None] MFA Rules not processed for user `3597dc51e1ae4d80a4bd648fcf3e31bc`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:33.116181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-664aa78f-198c-4eb4-a220-51d27aa741d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:33.161552 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-dcb69b80-afea-4d49-ac06-47e263b1cbef None None] MFA Rules not processed for user `c4004a0c84494079a3eeb9b732696bf4`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:33.163786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-dcb69b80-afea-4d49-ac06-47e263b1cbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:33.174624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:33.379794 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2949/5864] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:14:33.386856 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb69b80-afea-4d49-ac06-47e263b1cbef None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:33.402685 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2916/5865] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:14:33.407250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19617801-2120-4f6c-9864-34b83c2e1de5 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:33.407531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19617801-2120-4f6c-9864-34b83c2e1de5 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:33.407812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19617801-2120-4f6c-9864-34b83c2e1de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:33.515436 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-19617801-2120-4f6c-9864-34b83c2e1de5 None None] MFA Rules not processed for user `a6c953ff2f774041a7d50f53033ee124`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:33.518886 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-19617801-2120-4f6c-9864-34b83c2e1de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:33.652082 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb69b80-afea-4d49-ac06-47e263b1cbef None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:33.663371 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1d926-8d16-4e58-abab-2b6d70bfd1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:33.664409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1d926-8d16-4e58-abab-2b6d70bfd1d4 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:33.664894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1d926-8d16-4e58-abab-2b6d70bfd1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:33.665458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1d926-8d16-4e58-abab-2b6d70bfd1d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:33.666377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f1d926-8d16-4e58-abab-2b6d70bfd1d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:33.668727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f1d926-8d16-4e58-abab-2b6d70bfd1d4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:33.675773 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2917/5866] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:33.678254 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d09f8-9fc9-4f7e-b928-7a6eafd215cc None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:33.678626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d09f8-9fc9-4f7e-b928-7a6eafd215cc None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:33.678913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d09f8-9fc9-4f7e-b928-7a6eafd215cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:33.757392 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-5e4d09f8-9fc9-4f7e-b928-7a6eafd215cc None None] MFA Rules not processed for user `3597dc51e1ae4d80a4bd648fcf3e31bc`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:33.758417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5e4d09f8-9fc9-4f7e-b928-7a6eafd215cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:33.761363 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2950/5867] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:14:33 2022] POST /identity/v3/projects => generated 383 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:14:33.762539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1d926-8d16-4e58-abab-2b6d70bfd1d4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:33.766517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-38f1d926-8d16-4e58-abab-2b6d70bfd1d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:33.792532 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:33.892290 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2918/5868] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:33.892952 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d09f8-9fc9-4f7e-b928-7a6eafd215cc None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:33.951060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1d926-8d16-4e58-abab-2b6d70bfd1d4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:33.965681 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9a1eb-3bb1-41de-b52f-86c8ba3fbfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:33.966652 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9a1eb-3bb1-41de-b52f-86c8ba3fbfc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:33.967165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9a1eb-3bb1-41de-b52f-86c8ba3fbfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:33.967716 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9a1eb-3bb1-41de-b52f-86c8ba3fbfc4 admin admin] PATH_INFO: `/v3/projects/f4240b4cc4c84afeabcd61f40a14417f` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:33.969932 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee9a1eb-3bb1-41de-b52f-86c8ba3fbfc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4240b4cc4c84afeabcd61f40a14417f)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:33.973497 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee9a1eb-3bb1-41de-b52f-86c8ba3fbfc4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:34.055863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2ee9a1eb-3bb1-41de-b52f-86c8ba3fbfc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4240b4cc4c84afeabcd61f40a14417f', 'request_id': 'req-2ee9a1eb-3bb1-41de-b52f-86c8ba3fbfc4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:34.067562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2ee9a1eb-3bb1-41de-b52f-86c8ba3fbfc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4240b4cc4c84afeabcd61f40a14417f', 'request_id': 'req-2ee9a1eb-3bb1-41de-b52f-86c8ba3fbfc4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:34.081407 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2ee9a1eb-3bb1-41de-b52f-86c8ba3fbfc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4240b4cc4c84afeabcd61f40a14417f', 'request_id': 'req-2ee9a1eb-3bb1-41de-b52f-86c8ba3fbfc4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:34.100793 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d09f8-9fc9-4f7e-b928-7a6eafd215cc None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:34.101753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2ee9a1eb-3bb1-41de-b52f-86c8ba3fbfc4 admin admin] The token cache is being invalidate because project f4240b4cc4c84afeabcd61f40a14417f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:14:34.102524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2ee9a1eb-3bb1-41de-b52f-86c8ba3fbfc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:34.103627 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2ee9a1eb-3bb1-41de-b52f-86c8ba3fbfc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:34.105966 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2951/5869] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:14:33 2022] DELETE /identity/v3/projects/f4240b4cc4c84afeabcd61f40a14417f => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:34.107360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9a1eb-3bb1-41de-b52f-86c8ba3fbfc4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:34.111001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2ee9a1eb-3bb1-41de-b52f-86c8ba3fbfc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:34.141423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:34.258397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9a1eb-3bb1-41de-b52f-86c8ba3fbfc4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:34.266269 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9bbc1b-a3c0-420b-b808-e28458cfd0c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:34.266943 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bbc1b-a3c0-420b-b808-e28458cfd0c3 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:34.267673 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bbc1b-a3c0-420b-b808-e28458cfd0c3 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:34.268411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bbc1b-a3c0-420b-b808-e28458cfd0c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:34.272475 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3f9bbc1b-a3c0-420b-b808-e28458cfd0c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:34.275559 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db834cce-fce3-4dc7-aee7-3071328fbc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:34.276291 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db834cce-fce3-4dc7-aee7-3071328fbc9c admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:34.276559 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db834cce-fce3-4dc7-aee7-3071328fbc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:34.276827 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db834cce-fce3-4dc7-aee7-3071328fbc9c admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:34.277459 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db834cce-fce3-4dc7-aee7-3071328fbc9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:34.280242 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db834cce-fce3-4dc7-aee7-3071328fbc9c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:34.343191 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2919/5870] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:14:33 2022] POST /identity/v3/users => generated 298 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:14:34.343191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db834cce-fce3-4dc7-aee7-3071328fbc9c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:34.346690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-db834cce-fce3-4dc7-aee7-3071328fbc9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:34.361788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db834cce-fce3-4dc7-aee7-3071328fbc9c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:34.364816 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:34.368295 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0d635-05a3-4f75-a059-2891a1a68243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:34.369111 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0d635-05a3-4f75-a059-2891a1a68243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:34.369461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0d635-05a3-4f75-a059-2891a1a68243 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:34.369828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0d635-05a3-4f75-a059-2891a1a68243 admin admin] PATH_INFO: `/v3/users/935f09c95cf3402bb354fad40f6e3fc9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:34.371932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0d635-05a3-4f75-a059-2891a1a68243 admin admin] RBAC: Authorizing `identity:delete_user(user_id=935f09c95cf3402bb354fad40f6e3fc9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:34.373971 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0d635-05a3-4f75-a059-2891a1a68243 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:34.412730 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9bbc1b-a3c0-420b-b808-e28458cfd0c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:34.414805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9bbc1b-a3c0-420b-b808-e28458cfd0c3 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:34.429225 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2952/5871] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:14:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:14:34.444138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8bb0d635-05a3-4f75-a059-2891a1a68243 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '935f09c95cf3402bb354fad40f6e3fc9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:34.444440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9bbc1b-a3c0-420b-b808-e28458cfd0c3 service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:34.444930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8bb0d635-05a3-4f75-a059-2891a1a68243 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '935f09c95cf3402bb354fad40f6e3fc9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:34.445626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8bb0d635-05a3-4f75-a059-2891a1a68243 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '935f09c95cf3402bb354fad40f6e3fc9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:34.447713 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3f9bbc1b-a3c0-420b-b808-e28458cfd0c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:34.461901 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8bb0d635-05a3-4f75-a059-2891a1a68243 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '935f09c95cf3402bb354fad40f6e3fc9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:34.480325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9bbc1b-a3c0-420b-b808-e28458cfd0c3 service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:34.485645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8bb0d635-05a3-4f75-a059-2891a1a68243 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '935f09c95cf3402bb354fad40f6e3fc9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:34.497962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c083a0-bfce-4400-a586-2b3d5a422f51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:34.498829 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c083a0-bfce-4400-a586-2b3d5a422f51 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:34.501627 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c083a0-bfce-4400-a586-2b3d5a422f51 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:34.502323 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c083a0-bfce-4400-a586-2b3d5a422f51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:34.511495 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-62c083a0-bfce-4400-a586-2b3d5a422f51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:34.538365 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2920/5872] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:14:34 2022] DELETE /identity/v3/users/935f09c95cf3402bb354fad40f6e3fc9 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:34.539625 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0d635-05a3-4f75-a059-2891a1a68243 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:34.545027 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8bb0d635-05a3-4f75-a059-2891a1a68243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:34.564777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c083a0-bfce-4400-a586-2b3d5a422f51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:34.571828 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c083a0-bfce-4400-a586-2b3d5a422f51 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:34.620383 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2953/5873] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:14:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:14:34.820741 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0d635-05a3-4f75-a059-2891a1a68243 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:34.845037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082c2f7-86ae-4d2b-b620-1060d18968e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:34.856894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082c2f7-86ae-4d2b-b620-1060d18968e7 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:34.857437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082c2f7-86ae-4d2b-b620-1060d18968e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:34.857814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082c2f7-86ae-4d2b-b620-1060d18968e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:34.858530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082c2f7-86ae-4d2b-b620-1060d18968e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:34.862720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082c2f7-86ae-4d2b-b620-1060d18968e7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:34.893017 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2921/5874] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:14:34.898279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c083a0-bfce-4400-a586-2b3d5a422f51 service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:34.916277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c083a0-bfce-4400-a586-2b3d5a422f51 service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:34.922716 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51605bb-68ac-45f5-9948-bfb0e8706c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:34.923537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51605bb-68ac-45f5-9948-bfb0e8706c0e admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:34.923918 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51605bb-68ac-45f5-9948-bfb0e8706c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:34.924295 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51605bb-68ac-45f5-9948-bfb0e8706c0e admin admin] PATH_INFO: `/v3/projects/a8176ab2858345958f543986ee5fabed/users/d977fc25b6fd4ec68a948135c4f1d4d9/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:34.955912 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51605bb-68ac-45f5-9948-bfb0e8706c0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8176ab2858345958f543986ee5fabed, user_id=d977fc25b6fd4ec68a948135c4f1d4d9, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:34.960185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51605bb-68ac-45f5-9948-bfb0e8706c0e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:35.002172 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2954/5875] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:14:34 2022] PUT /identity/v3/projects/a8176ab2858345958f543986ee5fabed/users/d977fc25b6fd4ec68a948135c4f1d4d9/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:35.003190 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082c2f7-86ae-4d2b-b620-1060d18968e7 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:35.021873 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082c2f7-86ae-4d2b-b620-1060d18968e7 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:35.064880 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:35.182003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160e46b-81fc-4d9d-ae75-bda9376fe32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:35.182684 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160e46b-81fc-4d9d-ae75-bda9376fe32d admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:35.182997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160e46b-81fc-4d9d-ae75-bda9376fe32d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:35.183887 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160e46b-81fc-4d9d-ae75-bda9376fe32d admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:35.184142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160e46b-81fc-4d9d-ae75-bda9376fe32d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:35.186235 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160e46b-81fc-4d9d-ae75-bda9376fe32d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:35.206661 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2922/5876] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:14:35.211045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51605bb-68ac-45f5-9948-bfb0e8706c0e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:35.234761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51605bb-68ac-45f5-9948-bfb0e8706c0e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:35.251767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a748b-8556-40c1-bf7a-19c3c48a9855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:35.263043 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a748b-8556-40c1-bf7a-19c3c48a9855 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:35.266534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a748b-8556-40c1-bf7a-19c3c48a9855 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:35.266850 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a748b-8556-40c1-bf7a-19c3c48a9855 admin admin] PATH_INFO: `/v3/projects/a8176ab2858345958f543986ee5fabed/users/d977fc25b6fd4ec68a948135c4f1d4d9/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:35.279203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0a748b-8556-40c1-bf7a-19c3c48a9855 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8176ab2858345958f543986ee5fabed, user_id=d977fc25b6fd4ec68a948135c4f1d4d9, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:35.281932 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0a748b-8556-40c1-bf7a-19c3c48a9855 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:35.318770 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2955/5877] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:14:35 2022] PUT /identity/v3/projects/a8176ab2858345958f543986ee5fabed/users/d977fc25b6fd4ec68a948135c4f1d4d9/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:35.324554 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814278d-d62e-45e9-a075-e962864de75b None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:35.325626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814278d-d62e-45e9-a075-e962864de75b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:35.326082 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814278d-d62e-45e9-a075-e962864de75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:35.411041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4dbcfa-26ad-4a03-ba0e-c4b447b96e06 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:35.411441 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4dbcfa-26ad-4a03-ba0e-c4b447b96e06 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:35.411618 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4dbcfa-26ad-4a03-ba0e-c4b447b96e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:35.416120 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f814278d-d62e-45e9-a075-e962864de75b None None] MFA Rules not processed for user `d977fc25b6fd4ec68a948135c4f1d4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:35.420667 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f814278d-d62e-45e9-a075-e962864de75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:35.452541 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-7a4dbcfa-26ad-4a03-ba0e-c4b447b96e06 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:35.453781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7a4dbcfa-26ad-4a03-ba0e-c4b447b96e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:35.581461 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2923/5878] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:35 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:35.584647 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2956/5879] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:14:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:14:35.599868 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4dbcfa-26ad-4a03-ba0e-c4b447b96e06 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:35.600059 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814278d-d62e-45e9-a075-e962864de75b None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:35.601405 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7a4dbcfa-26ad-4a03-ba0e-c4b447b96e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:35.604663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f814278d-d62e-45e9-a075-e962864de75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:35.764705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814278d-d62e-45e9-a075-e962864de75b None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:35.772395 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77188bd6-04ee-42e2-8dc2-8f49796e6d98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:35.776452 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77188bd6-04ee-42e2-8dc2-8f49796e6d98 service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:35.776829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77188bd6-04ee-42e2-8dc2-8f49796e6d98 service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:35.777540 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77188bd6-04ee-42e2-8dc2-8f49796e6d98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:35.781581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4dbcfa-26ad-4a03-ba0e-c4b447b96e06 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:35.795018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5370ac2-c8b4-4fdb-9ee9-0c65cb9b62a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:35.797067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5370ac2-c8b4-4fdb-9ee9-0c65cb9b62a1 service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:35.797976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5370ac2-c8b4-4fdb-9ee9-0c65cb9b62a1 service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:35.798830 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5370ac2-c8b4-4fdb-9ee9-0c65cb9b62a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:35.809166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77188bd6-04ee-42e2-8dc2-8f49796e6d98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:35.812571 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77188bd6-04ee-42e2-8dc2-8f49796e6d98 service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:35.827505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5370ac2-c8b4-4fdb-9ee9-0c65cb9b62a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:35.831513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5370ac2-c8b4-4fdb-9ee9-0c65cb9b62a1 service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:35.852663 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2924/5880] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:14:35 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:14:35.854236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77188bd6-04ee-42e2-8dc2-8f49796e6d98 service cinder] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:35.870023 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-77188bd6-04ee-42e2-8dc2-8f49796e6d98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:35.871800 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2957/5881] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:14:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 06 21:14:35.981772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:36.032748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77188bd6-04ee-42e2-8dc2-8f49796e6d98 service cinder] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:36.048538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7f375-e9c3-4bf3-9825-83a86e8335ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:36.048538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7f375-e9c3-4bf3-9825-83a86e8335ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:36.049153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7f375-e9c3-4bf3-9825-83a86e8335ad admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:36.049438 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7f375-e9c3-4bf3-9825-83a86e8335ad admin admin] PATH_INFO: `/v3/projects/b37999f7725146e9bf60f64b15a54700` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:36.052446 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c7f375-e9c3-4bf3-9825-83a86e8335ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=b37999f7725146e9bf60f64b15a54700)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:36.054421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c7f375-e9c3-4bf3-9825-83a86e8335ad admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:36.090937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5370ac2-c8b4-4fdb-9ee9-0c65cb9b62a1 service swift] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:36.109234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5370ac2-c8b4-4fdb-9ee9-0c65cb9b62a1 service swift] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:36.121784 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e1e7d-5c26-4fba-b596-3aca8b69f518 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:36.123111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e1e7d-5c26-4fba-b596-3aca8b69f518 service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:36.123496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e1e7d-5c26-4fba-b596-3aca8b69f518 service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:36.123874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e1e7d-5c26-4fba-b596-3aca8b69f518 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:36.126848 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-842e1e7d-5c26-4fba-b596-3aca8b69f518 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:36.158057 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:36.226199 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-49c7f375-e9c3-4bf3-9825-83a86e8335ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b37999f7725146e9bf60f64b15a54700', 'request_id': 'req-49c7f375-e9c3-4bf3-9825-83a86e8335ad'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:36.240566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-49c7f375-e9c3-4bf3-9825-83a86e8335ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b37999f7725146e9bf60f64b15a54700', 'request_id': 'req-49c7f375-e9c3-4bf3-9825-83a86e8335ad'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:36.257763 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-49c7f375-e9c3-4bf3-9825-83a86e8335ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b37999f7725146e9bf60f64b15a54700', 'request_id': 'req-49c7f375-e9c3-4bf3-9825-83a86e8335ad'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:36.314066 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e1e7d-5c26-4fba-b596-3aca8b69f518 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:36.315011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-49c7f375-e9c3-4bf3-9825-83a86e8335ad admin admin] The token cache is being invalidate because project b37999f7725146e9bf60f64b15a54700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:14:36.317183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e1e7d-5c26-4fba-b596-3aca8b69f518 service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:36.317659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-49c7f375-e9c3-4bf3-9825-83a86e8335ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:36.320419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-49c7f375-e9c3-4bf3-9825-83a86e8335ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:36.335038 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2925/5882] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:14:35 2022] DELETE /identity/v3/projects/b37999f7725146e9bf60f64b15a54700 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:36.341689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f47ae-f63c-4a93-ba84-fe918df2862d None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:36.342212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f47ae-f63c-4a93-ba84-fe918df2862d None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:36.342824 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f47ae-f63c-4a93-ba84-fe918df2862d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:36.352006 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2958/5883] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:14:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:14:36.411822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-7d3f47ae-f63c-4a93-ba84-fe918df2862d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:36.413126 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7d3f47ae-f63c-4a93-ba84-fe918df2862d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:36.546739 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2926/5884] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:36.552932 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057b0b5-c0eb-4c2b-8383-755c21c76419 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:36.553324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057b0b5-c0eb-4c2b-8383-755c21c76419 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:36.553719 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057b0b5-c0eb-4c2b-8383-755c21c76419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:36.593684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-f057b0b5-c0eb-4c2b-8383-755c21c76419 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:36.595647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f057b0b5-c0eb-4c2b-8383-755c21c76419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:36.626719 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2959/5885] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:36.633294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f47ae-f63c-4a93-ba84-fe918df2862d None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:36.648644 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f47ae-f63c-4a93-ba84-fe918df2862d None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:36.658338 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2abf1b-3d1f-450b-92f7-00d7fdbe906f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:36.659601 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2abf1b-3d1f-450b-92f7-00d7fdbe906f admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:36.662406 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2abf1b-3d1f-450b-92f7-00d7fdbe906f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:36.666583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2abf1b-3d1f-450b-92f7-00d7fdbe906f admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:36.666583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2abf1b-3d1f-450b-92f7-00d7fdbe906f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:14:36.666583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2abf1b-3d1f-450b-92f7-00d7fdbe906f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:36.669451 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2abf1b-3d1f-450b-92f7-00d7fdbe906f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:36.711786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057b0b5-c0eb-4c2b-8383-755c21c76419 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:36.713113 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2927/5886] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:14:36.725765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057b0b5-c0eb-4c2b-8383-755c21c76419 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:36.751900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7cec3a-e367-457a-9da8-a4489fd34784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:36.752769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cec3a-e367-457a-9da8-a4489fd34784 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:36.753612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cec3a-e367-457a-9da8-a4489fd34784 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:36.754102 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cec3a-e367-457a-9da8-a4489fd34784 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:36.754892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7cec3a-e367-457a-9da8-a4489fd34784 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:36.756968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7cec3a-e367-457a-9da8-a4489fd34784 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:36.818121 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2960/5887] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:14:36 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:14:36.822413 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2abf1b-3d1f-450b-92f7-00d7fdbe906f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:36.846972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2abf1b-3d1f-450b-92f7-00d7fdbe906f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:36.969265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7cec3a-e367-457a-9da8-a4489fd34784 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:36.971361 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1e7cec3a-e367-457a-9da8-a4489fd34784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:37.065992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:37.088319 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63b741-2740-49ea-9155-6b906cce1a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:37.090103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63b741-2740-49ea-9155-6b906cce1a22 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:37.090917 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63b741-2740-49ea-9155-6b906cce1a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:37.091583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63b741-2740-49ea-9155-6b906cce1a22 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:37.093763 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63b741-2740-49ea-9155-6b906cce1a22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:37.099880 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63b741-2740-49ea-9155-6b906cce1a22 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:37.176092 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2928/5888] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:14:36 2022] POST /identity/v3/users => generated 293 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:14:37.177798 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63b741-2740-49ea-9155-6b906cce1a22 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:37.178530 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7cec3a-e367-457a-9da8-a4489fd34784 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:37.189312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a950cf-9bd5-45b2-bc6d-220c3e09cfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:37.199399 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a950cf-9bd5-45b2-bc6d-220c3e09cfb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:37.204923 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a950cf-9bd5-45b2-bc6d-220c3e09cfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:37.206592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a950cf-9bd5-45b2-bc6d-220c3e09cfb0 admin admin] PATH_INFO: `/v3/users/c4004a0c84494079a3eeb9b732696bf4` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:37.212411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63b741-2740-49ea-9155-6b906cce1a22 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:37.213020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a950cf-9bd5-45b2-bc6d-220c3e09cfb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4004a0c84494079a3eeb9b732696bf4)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:37.232711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a950cf-9bd5-45b2-bc6d-220c3e09cfb0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:37.242942 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd4a57-0644-4750-87e3-083751ca8180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:37.244874 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd4a57-0644-4750-87e3-083751ca8180 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:37.245456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd4a57-0644-4750-87e3-083751ca8180 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:37.246873 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd4a57-0644-4750-87e3-083751ca8180 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:37.247736 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd4a57-0644-4750-87e3-083751ca8180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:37.249604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd4a57-0644-4750-87e3-083751ca8180 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:37.281629 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2929/5889] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:14:37.288296 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd4a57-0644-4750-87e3-083751ca8180 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:37.314195 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd4a57-0644-4750-87e3-083751ca8180 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:37.345552 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df8bf1-d2d0-4484-8377-5af813dfa277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:37.349683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df8bf1-d2d0-4484-8377-5af813dfa277 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:37.350186 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df8bf1-d2d0-4484-8377-5af813dfa277 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:37.350723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df8bf1-d2d0-4484-8377-5af813dfa277 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:37.351639 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df8bf1-d2d0-4484-8377-5af813dfa277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:37.354856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df8bf1-d2d0-4484-8377-5af813dfa277 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:37.369639 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-84a950cf-9bd5-45b2-bc6d-220c3e09cfb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4004a0c84494079a3eeb9b732696bf4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:37.375391 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2930/5890] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:14:37.381791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df8bf1-d2d0-4484-8377-5af813dfa277 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:37.383038 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-84a950cf-9bd5-45b2-bc6d-220c3e09cfb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4004a0c84494079a3eeb9b732696bf4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:37.385127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-84a950cf-9bd5-45b2-bc6d-220c3e09cfb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4004a0c84494079a3eeb9b732696bf4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:37.402748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-84a950cf-9bd5-45b2-bc6d-220c3e09cfb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4004a0c84494079a3eeb9b732696bf4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:37.403006 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df8bf1-d2d0-4484-8377-5af813dfa277 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:37.412219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da4d21-db9c-438a-9b6e-ecae83aaeefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:37.413123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da4d21-db9c-438a-9b6e-ecae83aaeefa admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:37.413504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da4d21-db9c-438a-9b6e-ecae83aaeefa admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:37.413864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da4d21-db9c-438a-9b6e-ecae83aaeefa admin admin] PATH_INFO: `/v3/projects/8f8e9314f6344143b71e436bc1d60fee/users/6610b2fb1c9d4f7db384ade4bc27df4a/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:37.420187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-84a950cf-9bd5-45b2-bc6d-220c3e09cfb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4004a0c84494079a3eeb9b732696bf4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:37.455952 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2961/5891] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:14:36 2022] DELETE /identity/v3/users/c4004a0c84494079a3eeb9b732696bf4 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:37.460420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da4d21-db9c-438a-9b6e-ecae83aaeefa admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f8e9314f6344143b71e436bc1d60fee, user_id=6610b2fb1c9d4f7db384ade4bc27df4a, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:37.461240 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465a8ca-01b9-44ee-8b82-4b621740799b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:37.462642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465a8ca-01b9-44ee-8b82-4b621740799b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:37.463020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465a8ca-01b9-44ee-8b82-4b621740799b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:37.468187 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da4d21-db9c-438a-9b6e-ecae83aaeefa admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:37.503320 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2931/5892] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:14:37 2022] PUT /identity/v3/projects/8f8e9314f6344143b71e436bc1d60fee/users/6610b2fb1c9d4f7db384ade4bc27df4a/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:37.504141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:37.510979 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-f465a8ca-01b9-44ee-8b82-4b621740799b None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:37.512732 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f465a8ca-01b9-44ee-8b82-4b621740799b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:37.518160 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df59058-4d3b-4471-b244-ae53fe568e45 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:37.518583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df59058-4d3b-4471-b244-ae53fe568e45 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:37.519051 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df59058-4d3b-4471-b244-ae53fe568e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:37.583758 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-0df59058-4d3b-4471-b244-ae53fe568e45 None None] MFA Rules not processed for user `6610b2fb1c9d4f7db384ade4bc27df4a`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:37.586519 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0df59058-4d3b-4471-b244-ae53fe568e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:37.687380 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2962/5893] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:37.695271 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465a8ca-01b9-44ee-8b82-4b621740799b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:37.697045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f465a8ca-01b9-44ee-8b82-4b621740799b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:37.762899 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2932/5894] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:14:37.766042 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df59058-4d3b-4471-b244-ae53fe568e45 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:37.768592 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0df59058-4d3b-4471-b244-ae53fe568e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:37.796226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df59058-4d3b-4471-b244-ae53fe568e45 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:37.807272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d8da5-3377-4d96-9533-60e33cd10e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:37.808045 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d8da5-3377-4d96-9533-60e33cd10e96 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:37.809260 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d8da5-3377-4d96-9533-60e33cd10e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:37.810168 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d8da5-3377-4d96-9533-60e33cd10e96 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:37.811238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d8da5-3377-4d96-9533-60e33cd10e96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:37.816090 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d8da5-3377-4d96-9533-60e33cd10e96 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:37.838995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465a8ca-01b9-44ee-8b82-4b621740799b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:37.849719 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70512223-d2f4-4b21-bf65-cb6646160faf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:37.850534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70512223-d2f4-4b21-bf65-cb6646160faf service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:37.851091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70512223-d2f4-4b21-bf65-cb6646160faf service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:37.851578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70512223-d2f4-4b21-bf65-cb6646160faf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:37.882051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70512223-d2f4-4b21-bf65-cb6646160faf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:37.885801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70512223-d2f4-4b21-bf65-cb6646160faf service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:37.893593 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2933/5895] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:14:37 2022] POST /identity/v3/projects => generated 387 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:14:37.897799 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d8da5-3377-4d96-9533-60e33cd10e96 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:37.926363 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2963/5896] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:14:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:14:38.116081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d8da5-3377-4d96-9533-60e33cd10e96 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:38.122825 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b659c71-acb5-4fd0-8948-c38f2e1af2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:38.123455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b659c71-acb5-4fd0-8948-c38f2e1af2cd admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:38.123741 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b659c71-acb5-4fd0-8948-c38f2e1af2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:38.124005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b659c71-acb5-4fd0-8948-c38f2e1af2cd admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:38.124671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b659c71-acb5-4fd0-8948-c38f2e1af2cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:38.126577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b659c71-acb5-4fd0-8948-c38f2e1af2cd admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:38.155973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:38.166886 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2934/5897] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:14:37 2022] POST /identity/v3/users => generated 294 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:14:38.167882 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70512223-d2f4-4b21-bf65-cb6646160faf service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:38.192628 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70512223-d2f4-4b21-bf65-cb6646160faf service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:38.224187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d08fb-3121-46e0-b896-a4807681a097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:38.225421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d08fb-3121-46e0-b896-a4807681a097 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:38.227237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d08fb-3121-46e0-b896-a4807681a097 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:38.229452 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d08fb-3121-46e0-b896-a4807681a097 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:38.230394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d08fb-3121-46e0-b896-a4807681a097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:38.233996 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d08fb-3121-46e0-b896-a4807681a097 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:38.276195 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b659c71-acb5-4fd0-8948-c38f2e1af2cd admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:38.290229 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2964/5898] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:14:38.310829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b659c71-acb5-4fd0-8948-c38f2e1af2cd admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:38.341942 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00c1d4-3b27-49f1-80e6-2f2c76355d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:38.342806 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00c1d4-3b27-49f1-80e6-2f2c76355d57 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:38.343165 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00c1d4-3b27-49f1-80e6-2f2c76355d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:38.343451 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00c1d4-3b27-49f1-80e6-2f2c76355d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:38.344152 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00c1d4-3b27-49f1-80e6-2f2c76355d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:38.347202 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00c1d4-3b27-49f1-80e6-2f2c76355d57 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:38.373763 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2935/5899] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:14:38.380001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d08fb-3121-46e0-b896-a4807681a097 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:38.401251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d08fb-3121-46e0-b896-a4807681a097 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:38.415330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cb6fa-205c-4a12-ac62-0451c8304f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:38.416629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cb6fa-205c-4a12-ac62-0451c8304f9b admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:38.417175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cb6fa-205c-4a12-ac62-0451c8304f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:38.417706 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cb6fa-205c-4a12-ac62-0451c8304f9b admin admin] PATH_INFO: `/v3/projects/6a6253085caf4cea82351ecc4997ea60/users/2c5401b7ffc842bd84b5b2ae285717de/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:38.456133 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40cb6fa-205c-4a12-ac62-0451c8304f9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a6253085caf4cea82351ecc4997ea60, user_id=2c5401b7ffc842bd84b5b2ae285717de, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:38.460123 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40cb6fa-205c-4a12-ac62-0451c8304f9b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:38.487156 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2965/5900] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:14:38 2022] PUT /identity/v3/projects/6a6253085caf4cea82351ecc4997ea60/users/2c5401b7ffc842bd84b5b2ae285717de/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:38.500460 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ba023-a217-442a-8b59-a760e5136b5a None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:38.500733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ba023-a217-442a-8b59-a760e5136b5a None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:38.501779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ba023-a217-442a-8b59-a760e5136b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:38.590243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-e83ba023-a217-442a-8b59-a760e5136b5a None None] MFA Rules not processed for user `2c5401b7ffc842bd84b5b2ae285717de`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:38.591873 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e83ba023-a217-442a-8b59-a760e5136b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:38.677207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cb6fa-205c-4a12-ac62-0451c8304f9b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:38.680648 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c40cb6fa-205c-4a12-ac62-0451c8304f9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:38.857190 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2936/5901] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:38.861377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ba023-a217-442a-8b59-a760e5136b5a None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:38.890599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cb6fa-205c-4a12-ac62-0451c8304f9b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:38.907379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d663c-972e-4194-bbfc-e5571b3c2706 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:38.908104 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d663c-972e-4194-bbfc-e5571b3c2706 service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:38.910133 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d663c-972e-4194-bbfc-e5571b3c2706 service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:38.910616 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d663c-972e-4194-bbfc-e5571b3c2706 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:38.915065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-041d663c-972e-4194-bbfc-e5571b3c2706 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:38.955942 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d663c-972e-4194-bbfc-e5571b3c2706 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:38.958145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d663c-972e-4194-bbfc-e5571b3c2706 service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:38.971695 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2966/5902] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:14:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:14:39.025339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ba023-a217-442a-8b59-a760e5136b5a None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:39.049019 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26309e9a-cfc3-425a-80f3-3b83d9df9a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:39.049698 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26309e9a-cfc3-425a-80f3-3b83d9df9a90 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:39.050029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26309e9a-cfc3-425a-80f3-3b83d9df9a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:39.050269 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26309e9a-cfc3-425a-80f3-3b83d9df9a90 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:39.057442 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26309e9a-cfc3-425a-80f3-3b83d9df9a90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:39.059888 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26309e9a-cfc3-425a-80f3-3b83d9df9a90 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:39.096521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d663c-972e-4194-bbfc-e5571b3c2706 service placement] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:39.100666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-041d663c-972e-4194-bbfc-e5571b3c2706 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:39.118533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:39.138869 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2937/5903] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:14:38 2022] POST /identity/v3/projects => generated 387 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:14:39.140852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26309e9a-cfc3-425a-80f3-3b83d9df9a90 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:39.143100 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d663c-972e-4194-bbfc-e5571b3c2706 service placement] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:39.302433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26309e9a-cfc3-425a-80f3-3b83d9df9a90 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:39.312991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce6fc5-2515-4402-9a56-c64f92dd5554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:39.314334 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce6fc5-2515-4402-9a56-c64f92dd5554 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:39.315265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce6fc5-2515-4402-9a56-c64f92dd5554 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:39.315870 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce6fc5-2515-4402-9a56-c64f92dd5554 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:39.318037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ce6fc5-2515-4402-9a56-c64f92dd5554 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:39.322136 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ce6fc5-2515-4402-9a56-c64f92dd5554 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:39.338894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:39.362803 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa52702-24ee-43e9-83c6-5169c80c1d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:39.363629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa52702-24ee-43e9-83c6-5169c80c1d0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:39.364820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa52702-24ee-43e9-83c6-5169c80c1d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:39.365219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa52702-24ee-43e9-83c6-5169c80c1d0d admin admin] PATH_INFO: `/v3/projects/aaa1a2672fd144568d3b69d580990a19` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:39.367362 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa52702-24ee-43e9-83c6-5169c80c1d0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaa1a2672fd144568d3b69d580990a19)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:39.370026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa52702-24ee-43e9-83c6-5169c80c1d0d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:39.383214 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2938/5904] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:14:39 2022] POST /identity/v3/users => generated 300 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:14:39.387536 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce6fc5-2515-4402-9a56-c64f92dd5554 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:39.407678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce6fc5-2515-4402-9a56-c64f92dd5554 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:39.434984 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb503b2b-c8f5-4fcb-90e3-2b9e5c49bea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:39.439829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb503b2b-c8f5-4fcb-90e3-2b9e5c49bea4 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:39.440196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb503b2b-c8f5-4fcb-90e3-2b9e5c49bea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:39.440544 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb503b2b-c8f5-4fcb-90e3-2b9e5c49bea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:39.443703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb503b2b-c8f5-4fcb-90e3-2b9e5c49bea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:39.448490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb503b2b-c8f5-4fcb-90e3-2b9e5c49bea4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:39.491906 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2939/5905] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:14:39.496551 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb503b2b-c8f5-4fcb-90e3-2b9e5c49bea4 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:39.532610 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-aaa52702-24ee-43e9-83c6-5169c80c1d0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaa1a2672fd144568d3b69d580990a19', 'request_id': 'req-aaa52702-24ee-43e9-83c6-5169c80c1d0d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:39.545099 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-aaa52702-24ee-43e9-83c6-5169c80c1d0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaa1a2672fd144568d3b69d580990a19', 'request_id': 'req-aaa52702-24ee-43e9-83c6-5169c80c1d0d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:39.560394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb503b2b-c8f5-4fcb-90e3-2b9e5c49bea4 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:39.565831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-aaa52702-24ee-43e9-83c6-5169c80c1d0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaa1a2672fd144568d3b69d580990a19', 'request_id': 'req-aaa52702-24ee-43e9-83c6-5169c80c1d0d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:39.601841 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-aaa52702-24ee-43e9-83c6-5169c80c1d0d admin admin] The token cache is being invalidate because project aaa1a2672fd144568d3b69d580990a19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:14:39.603441 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-aaa52702-24ee-43e9-83c6-5169c80c1d0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:39.604731 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-aaa52702-24ee-43e9-83c6-5169c80c1d0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:39.607969 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2967/5906] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:14:39 2022] DELETE /identity/v3/projects/aaa1a2672fd144568d3b69d580990a19 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:14:39.614950 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa52702-24ee-43e9-83c6-5169c80c1d0d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:39.619434 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-aaa52702-24ee-43e9-83c6-5169c80c1d0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:39.834095 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa52702-24ee-43e9-83c6-5169c80c1d0d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:39.866320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f40664-42b0-4a65-b4aa-8e2928f5380b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:39.867327 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f40664-42b0-4a65-b4aa-8e2928f5380b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:39.867943 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f40664-42b0-4a65-b4aa-8e2928f5380b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:39.868385 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f40664-42b0-4a65-b4aa-8e2928f5380b admin admin] PATH_INFO: `/v3/users/d977fc25b6fd4ec68a948135c4f1d4d9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:39.873406 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b02767-df5b-4853-9883-1172e36541dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:39.873406 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b02767-df5b-4853-9883-1172e36541dc admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:39.873700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b02767-df5b-4853-9883-1172e36541dc admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:39.873852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b02767-df5b-4853-9883-1172e36541dc admin admin] PATH_INFO: `/v3/projects/836a2a1c47d64f47910592988a5f1eec/users/aa6d5a8b242e4ac4a954e57a2c68ba83/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:39.875364 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f40664-42b0-4a65-b4aa-8e2928f5380b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d977fc25b6fd4ec68a948135c4f1d4d9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:39.877567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f40664-42b0-4a65-b4aa-8e2928f5380b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:39.964520 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b02767-df5b-4853-9883-1172e36541dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=836a2a1c47d64f47910592988a5f1eec, user_id=aa6d5a8b242e4ac4a954e57a2c68ba83, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:39.979598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b02767-df5b-4853-9883-1172e36541dc admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:40.011567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:40.041164 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2940/5907] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:14:39 2022] PUT /identity/v3/projects/836a2a1c47d64f47910592988a5f1eec/users/aa6d5a8b242e4ac4a954e57a2c68ba83/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:40.041414 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a5f40664-42b0-4a65-b4aa-8e2928f5380b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd977fc25b6fd4ec68a948135c4f1d4d9'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:40.041521 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b02767-df5b-4853-9883-1172e36541dc admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:40.046803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-19b02767-df5b-4853-9883-1172e36541dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:40.068631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a5f40664-42b0-4a65-b4aa-8e2928f5380b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd977fc25b6fd4ec68a948135c4f1d4d9'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:40.070171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a5f40664-42b0-4a65-b4aa-8e2928f5380b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd977fc25b6fd4ec68a948135c4f1d4d9'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:40.070975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a5f40664-42b0-4a65-b4aa-8e2928f5380b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd977fc25b6fd4ec68a948135c4f1d4d9'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:40.094568 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a5f40664-42b0-4a65-b4aa-8e2928f5380b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd977fc25b6fd4ec68a948135c4f1d4d9'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:40.166642 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2968/5908] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:14:39 2022] DELETE /identity/v3/users/d977fc25b6fd4ec68a948135c4f1d4d9 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:40.364130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b02767-df5b-4853-9883-1172e36541dc admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:40.491381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d537f-3092-4da8-8238-806fff39bc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:40.492148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d537f-3092-4da8-8238-806fff39bc6b admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:40.493014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d537f-3092-4da8-8238-806fff39bc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:40.493014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d537f-3092-4da8-8238-806fff39bc6b admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:40.493624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d537f-3092-4da8-8238-806fff39bc6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:40.496175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d537f-3092-4da8-8238-806fff39bc6b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:40.532013 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2941/5909] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 492 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:14:40.537289 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f40664-42b0-4a65-b4aa-8e2928f5380b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:40.540002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a5f40664-42b0-4a65-b4aa-8e2928f5380b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:40.573581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f40664-42b0-4a65-b4aa-8e2928f5380b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:40.595049 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd568e6-3ad0-42b2-977c-1839e5bde6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:40.598232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd568e6-3ad0-42b2-977c-1839e5bde6b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:40.608107 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd568e6-3ad0-42b2-977c-1839e5bde6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:40.608371 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd568e6-3ad0-42b2-977c-1839e5bde6b8 admin admin] PATH_INFO: `/v3/projects/836a2a1c47d64f47910592988a5f1eec/users/aa6d5a8b242e4ac4a954e57a2c68ba83/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:40.615828 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd568e6-3ad0-42b2-977c-1839e5bde6b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=836a2a1c47d64f47910592988a5f1eec, user_id=aa6d5a8b242e4ac4a954e57a2c68ba83, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:40.624581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd568e6-3ad0-42b2-977c-1839e5bde6b8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:40.665404 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2969/5910] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:14:40 2022] PUT /identity/v3/projects/836a2a1c47d64f47910592988a5f1eec/users/aa6d5a8b242e4ac4a954e57a2c68ba83/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:14:40.668276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ec603-b786-478b-9ca6-0198014b2a33 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:40.668681 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ec603-b786-478b-9ca6-0198014b2a33 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:40.669063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ec603-b786-478b-9ca6-0198014b2a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:40.705698 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:40.771150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-9b9ec603-b786-478b-9ca6-0198014b2a33 None None] MFA Rules not processed for user `aa6d5a8b242e4ac4a954e57a2c68ba83`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:40.775526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9b9ec603-b786-478b-9ca6-0198014b2a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:40.972405 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd568e6-3ad0-42b2-977c-1839e5bde6b8 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:40.975748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0cd568e6-3ad0-42b2-977c-1839e5bde6b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:40.997829 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2942/5911] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:40 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:41.011745 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ec603-b786-478b-9ca6-0198014b2a33 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:41.013515 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9b9ec603-b786-478b-9ca6-0198014b2a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:41.166512 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ec603-b786-478b-9ca6-0198014b2a33 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:41.171234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d15af7-26b2-48d5-bcb4-399144b09f6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:41.171860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d15af7-26b2-48d5-bcb4-399144b09f6d service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:41.172178 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d15af7-26b2-48d5-bcb4-399144b09f6d service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:41.172412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d15af7-26b2-48d5-bcb4-399144b09f6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:41.197618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d15af7-26b2-48d5-bcb4-399144b09f6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:41.201108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d15af7-26b2-48d5-bcb4-399144b09f6d service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:41.223089 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2943/5912] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:14:41 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:14:41.272033 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd568e6-3ad0-42b2-977c-1839e5bde6b8 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:41.279017 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331ad80-f5eb-442f-afe4-ad54c10ec023 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:41.279833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331ad80-f5eb-442f-afe4-ad54c10ec023 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:41.280396 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331ad80-f5eb-442f-afe4-ad54c10ec023 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:41.280673 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331ad80-f5eb-442f-afe4-ad54c10ec023 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:41.282863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4331ad80-f5eb-442f-afe4-ad54c10ec023 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:41.300239 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331ad80-f5eb-442f-afe4-ad54c10ec023 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:41.303738 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331ad80-f5eb-442f-afe4-ad54c10ec023 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:41.328796 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2970/5913] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:14:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:14:42.508140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d15af7-26b2-48d5-bcb4-399144b09f6d service cinder] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:42.509747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b7d15af7-26b2-48d5-bcb4-399144b09f6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:42.547965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d15af7-26b2-48d5-bcb4-399144b09f6d service cinder] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:42.568814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bcd17-ecd8-49d1-b7c7-13d76f662f69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:42.572011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bcd17-ecd8-49d1-b7c7-13d76f662f69 service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:42.574693 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bcd17-ecd8-49d1-b7c7-13d76f662f69 service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:42.575087 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bcd17-ecd8-49d1-b7c7-13d76f662f69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:42.582725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c48bcd17-ecd8-49d1-b7c7-13d76f662f69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:42.666153 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331ad80-f5eb-442f-afe4-ad54c10ec023 service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:42.668433 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4331ad80-f5eb-442f-afe4-ad54c10ec023 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:42.763801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48bcd17-ecd8-49d1-b7c7-13d76f662f69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:42.767972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48bcd17-ecd8-49d1-b7c7-13d76f662f69 service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:42.801750 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2944/5914] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:14:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:14:42.822577 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331ad80-f5eb-442f-afe4-ad54c10ec023 service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:42.869511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ffabe-fd9d-42d7-b9b5-0b1547427fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:42.870898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ffabe-fd9d-42d7-b9b5-0b1547427fb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:42.872915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ffabe-fd9d-42d7-b9b5-0b1547427fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:42.886819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ffabe-fd9d-42d7-b9b5-0b1547427fb7 admin admin] PATH_INFO: `/v3/projects/a8176ab2858345958f543986ee5fabed` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:42.889820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ffabe-fd9d-42d7-b9b5-0b1547427fb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8176ab2858345958f543986ee5fabed)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:42.898555 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ffabe-fd9d-42d7-b9b5-0b1547427fb7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:43.038314 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:43.079394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cb8ffabe-fd9d-42d7-b9b5-0b1547427fb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8176ab2858345958f543986ee5fabed', 'request_id': 'req-cb8ffabe-fd9d-42d7-b9b5-0b1547427fb7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:43.094811 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cb8ffabe-fd9d-42d7-b9b5-0b1547427fb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8176ab2858345958f543986ee5fabed', 'request_id': 'req-cb8ffabe-fd9d-42d7-b9b5-0b1547427fb7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:43.113901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cb8ffabe-fd9d-42d7-b9b5-0b1547427fb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8176ab2858345958f543986ee5fabed', 'request_id': 'req-cb8ffabe-fd9d-42d7-b9b5-0b1547427fb7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:43.147248 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cb8ffabe-fd9d-42d7-b9b5-0b1547427fb7 admin admin] The token cache is being invalidate because project a8176ab2858345958f543986ee5fabed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:14:43.147520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cb8ffabe-fd9d-42d7-b9b5-0b1547427fb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:43.148287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cb8ffabe-fd9d-42d7-b9b5-0b1547427fb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:43.154395 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2971/5915] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:14:42 2022] DELETE /identity/v3/projects/a8176ab2858345958f543986ee5fabed => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:43.155157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a50ab4-2b08-40a3-b862-e87d13d503de None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:43.155680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a50ab4-2b08-40a3-b862-e87d13d503de None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:43.156059 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a50ab4-2b08-40a3-b862-e87d13d503de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:43.211398 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-88a50ab4-2b08-40a3-b862-e87d13d503de None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:43.215916 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-88a50ab4-2b08-40a3-b862-e87d13d503de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:43.302489 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:43.399991 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2945/5916] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:43.414448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45332575-4e45-4b07-817c-c4596e941d1c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:43.415133 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45332575-4e45-4b07-817c-c4596e941d1c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:43.415579 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45332575-4e45-4b07-817c-c4596e941d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:43.439035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-45332575-4e45-4b07-817c-c4596e941d1c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:43.440632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-45332575-4e45-4b07-817c-c4596e941d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:43.454835 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2972/5917] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:43.455823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a50ab4-2b08-40a3-b862-e87d13d503de None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:43.483078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a50ab4-2b08-40a3-b862-e87d13d503de None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:43.511630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f13a35-1690-49ff-90b8-322bc2a645b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:43.512668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f13a35-1690-49ff-90b8-322bc2a645b2 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:43.512959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f13a35-1690-49ff-90b8-322bc2a645b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:43.513233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f13a35-1690-49ff-90b8-322bc2a645b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:43.513892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f13a35-1690-49ff-90b8-322bc2a645b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:14:43.514196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f13a35-1690-49ff-90b8-322bc2a645b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:43.516373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f13a35-1690-49ff-90b8-322bc2a645b2 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:43.545755 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2946/5918] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:14:43.547010 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45332575-4e45-4b07-817c-c4596e941d1c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:43.562788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45332575-4e45-4b07-817c-c4596e941d1c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:43.573541 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4741f2-9245-4f8f-b53d-5aeaa2ebf84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:43.574210 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4741f2-9245-4f8f-b53d-5aeaa2ebf84c admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:43.574498 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4741f2-9245-4f8f-b53d-5aeaa2ebf84c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:43.574849 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4741f2-9245-4f8f-b53d-5aeaa2ebf84c admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:43.575606 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4741f2-9245-4f8f-b53d-5aeaa2ebf84c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:43.577607 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4741f2-9245-4f8f-b53d-5aeaa2ebf84c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:43.651244 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2973/5919] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:14:43 2022] POST /identity/v3/projects => generated 391 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:14:43.655703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f13a35-1690-49ff-90b8-322bc2a645b2 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:43.670864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f13a35-1690-49ff-90b8-322bc2a645b2 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:43.837388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba69a85-8c3c-4920-bf63-c6a12766737b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:43.838224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba69a85-8c3c-4920-bf63-c6a12766737b admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:43.838678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba69a85-8c3c-4920-bf63-c6a12766737b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:43.839220 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba69a85-8c3c-4920-bf63-c6a12766737b admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:43.840318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba69a85-8c3c-4920-bf63-c6a12766737b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:43.843246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba69a85-8c3c-4920-bf63-c6a12766737b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:43.882015 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2947/5920] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:14:43 2022] POST /identity/v3/users => generated 296 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:14:43.885243 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4741f2-9245-4f8f-b53d-5aeaa2ebf84c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:43.899960 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4741f2-9245-4f8f-b53d-5aeaa2ebf84c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:43.915507 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043057ff-a156-4b62-8dd0-4809393aa574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:43.916833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043057ff-a156-4b62-8dd0-4809393aa574 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:43.917288 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043057ff-a156-4b62-8dd0-4809393aa574 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:43.917741 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043057ff-a156-4b62-8dd0-4809393aa574 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:43.918588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043057ff-a156-4b62-8dd0-4809393aa574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:43.920805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043057ff-a156-4b62-8dd0-4809393aa574 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:43.948721 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba69a85-8c3c-4920-bf63-c6a12766737b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:43.949426 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2974/5921] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:14:43.976463 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba69a85-8c3c-4920-bf63-c6a12766737b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:43.989114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35116a-729f-478d-b281-14d6c6940362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:43.992841 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35116a-729f-478d-b281-14d6c6940362 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:43.993467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35116a-729f-478d-b281-14d6c6940362 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:43.993994 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35116a-729f-478d-b281-14d6c6940362 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:43.995667 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35116a-729f-478d-b281-14d6c6940362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:44.000008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35116a-729f-478d-b281-14d6c6940362 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:44.039339 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2948/5922] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:14:44.043778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043057ff-a156-4b62-8dd0-4809393aa574 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:44.068329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043057ff-a156-4b62-8dd0-4809393aa574 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:44.095145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a984863-3e81-445b-93f1-decb02d00ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:44.096117 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a984863-3e81-445b-93f1-decb02d00ed3 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:44.096557 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a984863-3e81-445b-93f1-decb02d00ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:44.096994 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a984863-3e81-445b-93f1-decb02d00ed3 admin admin] PATH_INFO: `/v3/projects/e617708266ab45c4882ecc85ec96895a/users/5e6391f307af40ed935dcbb8fc1ac4c4/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:44.154056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a984863-3e81-445b-93f1-decb02d00ed3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e617708266ab45c4882ecc85ec96895a, user_id=5e6391f307af40ed935dcbb8fc1ac4c4, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:44.157542 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a984863-3e81-445b-93f1-decb02d00ed3 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:44.179062 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2975/5923] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:14:44 2022] PUT /identity/v3/projects/e617708266ab45c4882ecc85ec96895a/users/5e6391f307af40ed935dcbb8fc1ac4c4/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:44.192277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f60af-60a3-4bca-b186-595c958bc854 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:44.192772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f60af-60a3-4bca-b186-595c958bc854 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:44.193101 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f60af-60a3-4bca-b186-595c958bc854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:44.247968 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d15f60af-60a3-4bca-b186-595c958bc854 None None] MFA Rules not processed for user `5e6391f307af40ed935dcbb8fc1ac4c4`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:44.249602 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d15f60af-60a3-4bca-b186-595c958bc854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:44.412214 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2949/5924] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:44.437181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a984863-3e81-445b-93f1-decb02d00ed3 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:44.439663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4a984863-3e81-445b-93f1-decb02d00ed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:44.625581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a984863-3e81-445b-93f1-decb02d00ed3 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:44.635683 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e3533-0b34-4e0f-a009-25a74425231b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:44.636316 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e3533-0b34-4e0f-a009-25a74425231b service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:44.636647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e3533-0b34-4e0f-a009-25a74425231b service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:44.636922 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e3533-0b34-4e0f-a009-25a74425231b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:44.657715 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e3533-0b34-4e0f-a009-25a74425231b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:44.659210 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e3533-0b34-4e0f-a009-25a74425231b service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:44.688480 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2976/5925] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:14:44 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:14:45.553772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f60af-60a3-4bca-b186-595c958bc854 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:45.555485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d15f60af-60a3-4bca-b186-595c958bc854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:45.698236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:45.792357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f60af-60a3-4bca-b186-595c958bc854 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:45.803217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bacf1-a914-494d-a267-1b391a980b3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:45.803943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bacf1-a914-494d-a267-1b391a980b3e service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:45.804279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bacf1-a914-494d-a267-1b391a980b3e service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:45.804643 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bacf1-a914-494d-a267-1b391a980b3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:45.807706 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2a3bacf1-a914-494d-a267-1b391a980b3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:45.861462 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3bacf1-a914-494d-a267-1b391a980b3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:45.865223 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3bacf1-a914-494d-a267-1b391a980b3e service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:45.886472 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e3533-0b34-4e0f-a009-25a74425231b service cinder] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:45.889355 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-093e3533-0b34-4e0f-a009-25a74425231b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:45.906763 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2950/5926] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:14:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:14:45.918056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e3533-0b34-4e0f-a009-25a74425231b service cinder] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:45.933052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198fa87-9dc8-4969-a774-5cdaf85db053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:45.933949 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198fa87-9dc8-4969-a774-5cdaf85db053 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:45.934393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198fa87-9dc8-4969-a774-5cdaf85db053 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:45.934978 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198fa87-9dc8-4969-a774-5cdaf85db053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:45.975156 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198fa87-9dc8-4969-a774-5cdaf85db053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:45.976788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198fa87-9dc8-4969-a774-5cdaf85db053 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:46.048885 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2977/5927] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:14:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:14:48.705821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bacf1-a914-494d-a267-1b391a980b3e service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:48.724530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bacf1-a914-494d-a267-1b391a980b3e service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:48.739976 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177c536-486f-483b-8ad2-76694620c7d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:48.740598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177c536-486f-483b-8ad2-76694620c7d2 service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:48.741005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177c536-486f-483b-8ad2-76694620c7d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:48.741280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177c536-486f-483b-8ad2-76694620c7d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:48.743707 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e177c536-486f-483b-8ad2-76694620c7d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:48.780541 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198fa87-9dc8-4969-a774-5cdaf85db053 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:48.795776 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198fa87-9dc8-4969-a774-5cdaf85db053 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:48.813790 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510b65a-7b71-444c-ad35-f03a2718c932 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:48.814735 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510b65a-7b71-444c-ad35-f03a2718c932 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:48.815194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510b65a-7b71-444c-ad35-f03a2718c932 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:48.815661 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510b65a-7b71-444c-ad35-f03a2718c932 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:48.823330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c510b65a-7b71-444c-ad35-f03a2718c932 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:48.855394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c510b65a-7b71-444c-ad35-f03a2718c932 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:48.857166 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c510b65a-7b71-444c-ad35-f03a2718c932 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:48.889475 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2978/5928] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:14:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:14:48.896802 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177c536-486f-483b-8ad2-76694620c7d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:48.899418 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177c536-486f-483b-8ad2-76694620c7d2 service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:48.927247 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2951/5929] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:14:48 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:14:49.791073 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510b65a-7b71-444c-ad35-f03a2718c932 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:49.793566 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c510b65a-7b71-444c-ad35-f03a2718c932 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:49.875689 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:49.957832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510b65a-7b71-444c-ad35-f03a2718c932 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:49.968354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d22f76-cc4c-4364-8dc6-fcf0466fab0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:49.970010 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d22f76-cc4c-4364-8dc6-fcf0466fab0b service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:49.970701 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d22f76-cc4c-4364-8dc6-fcf0466fab0b service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:49.971221 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d22f76-cc4c-4364-8dc6-fcf0466fab0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:49.975354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f1d22f76-cc4c-4364-8dc6-fcf0466fab0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:50.014301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d22f76-cc4c-4364-8dc6-fcf0466fab0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:50.016440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d22f76-cc4c-4364-8dc6-fcf0466fab0b service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:50.045426 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2979/5930] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:14:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:14:52.560380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177c536-486f-483b-8ad2-76694620c7d2 service cinder] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:52.562213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e177c536-486f-483b-8ad2-76694620c7d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:52.707793 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177c536-486f-483b-8ad2-76694620c7d2 service cinder] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:52.723015 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76283ce-1801-4d23-8067-3c91e0a476f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:52.723713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76283ce-1801-4d23-8067-3c91e0a476f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:52.723994 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76283ce-1801-4d23-8067-3c91e0a476f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:52.724267 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76283ce-1801-4d23-8067-3c91e0a476f1 admin admin] PATH_INFO: `/v3/users/6610b2fb1c9d4f7db384ade4bc27df4a` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:52.735664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76283ce-1801-4d23-8067-3c91e0a476f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6610b2fb1c9d4f7db384ade4bc27df4a)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:52.737907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76283ce-1801-4d23-8067-3c91e0a476f1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:52.842993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b76283ce-1801-4d23-8067-3c91e0a476f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6610b2fb1c9d4f7db384ade4bc27df4a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:52.843672 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b76283ce-1801-4d23-8067-3c91e0a476f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6610b2fb1c9d4f7db384ade4bc27df4a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:52.844409 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b76283ce-1801-4d23-8067-3c91e0a476f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6610b2fb1c9d4f7db384ade4bc27df4a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:52.859638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b76283ce-1801-4d23-8067-3c91e0a476f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6610b2fb1c9d4f7db384ade4bc27df4a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:52.880546 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b76283ce-1801-4d23-8067-3c91e0a476f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6610b2fb1c9d4f7db384ade4bc27df4a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:52.882045 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:52.930872 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2952/5931] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:14:52 2022] DELETE /identity/v3/users/6610b2fb1c9d4f7db384ade4bc27df4a => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:52.937884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a9349-cea4-40dc-9a7d-bbe2f9a7a552 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:52.937884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a9349-cea4-40dc-9a7d-bbe2f9a7a552 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:52.937884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a9349-cea4-40dc-9a7d-bbe2f9a7a552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:52.974355 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a98a9349-cea4-40dc-9a7d-bbe2f9a7a552 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:52.975613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a98a9349-cea4-40dc-9a7d-bbe2f9a7a552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:53.102077 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2980/5932] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:53.222720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76283ce-1801-4d23-8067-3c91e0a476f1 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:53.226601 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b76283ce-1801-4d23-8067-3c91e0a476f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:53.463684 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76283ce-1801-4d23-8067-3c91e0a476f1 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:53.475527 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf08f6f-a7ba-4783-8d1a-8ae7e5507309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:53.482486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf08f6f-a7ba-4783-8d1a-8ae7e5507309 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:53.483711 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf08f6f-a7ba-4783-8d1a-8ae7e5507309 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:53.484166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf08f6f-a7ba-4783-8d1a-8ae7e5507309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:53.521967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf08f6f-a7ba-4783-8d1a-8ae7e5507309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:53.525238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf08f6f-a7ba-4783-8d1a-8ae7e5507309 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:53.556907 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2953/5933] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:14:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:14:54.783769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91caeb-e0bd-47bc-a85a-7b2c0a63d2c6 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:54.784963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91caeb-e0bd-47bc-a85a-7b2c0a63d2c6 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:54.785171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91caeb-e0bd-47bc-a85a-7b2c0a63d2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:54.829810 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-fb91caeb-e0bd-47bc-a85a-7b2c0a63d2c6 None None] MFA Rules not processed for user `1d7b9e27983940dcaf0e92f62273c588`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:54.833835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-fb91caeb-e0bd-47bc-a85a-7b2c0a63d2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:54.935964 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2981/5934] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:14:55.004635 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf08f6f-a7ba-4783-8d1a-8ae7e5507309 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:55.006256 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5cf08f6f-a7ba-4783-8d1a-8ae7e5507309 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:55.031744 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf08f6f-a7ba-4783-8d1a-8ae7e5507309 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:55.041263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d49c4-ac93-4927-baf7-b16e67dd14da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:55.042249 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d49c4-ac93-4927-baf7-b16e67dd14da admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:55.042637 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d49c4-ac93-4927-baf7-b16e67dd14da admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:55.043085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d49c4-ac93-4927-baf7-b16e67dd14da admin admin] PATH_INFO: `/v3/projects/8f8e9314f6344143b71e436bc1d60fee` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:55.044632 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d49c4-ac93-4927-baf7-b16e67dd14da admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f8e9314f6344143b71e436bc1d60fee)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:55.048134 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d49c4-ac93-4927-baf7-b16e67dd14da admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:55.166387 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-590d49c4-ac93-4927-baf7-b16e67dd14da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f8e9314f6344143b71e436bc1d60fee', 'request_id': 'req-590d49c4-ac93-4927-baf7-b16e67dd14da'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:55.183824 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-590d49c4-ac93-4927-baf7-b16e67dd14da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f8e9314f6344143b71e436bc1d60fee', 'request_id': 'req-590d49c4-ac93-4927-baf7-b16e67dd14da'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:55.221355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-590d49c4-ac93-4927-baf7-b16e67dd14da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f8e9314f6344143b71e436bc1d60fee', 'request_id': 'req-590d49c4-ac93-4927-baf7-b16e67dd14da'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:55.248237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-590d49c4-ac93-4927-baf7-b16e67dd14da admin admin] The token cache is being invalidate because project 8f8e9314f6344143b71e436bc1d60fee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:14:55.248577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-590d49c4-ac93-4927-baf7-b16e67dd14da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:55.249541 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-590d49c4-ac93-4927-baf7-b16e67dd14da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:55.251624 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2954/5935] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:14:55 2022] DELETE /identity/v3/projects/8f8e9314f6344143b71e436bc1d60fee => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:55.256203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91caeb-e0bd-47bc-a85a-7b2c0a63d2c6 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:55.274704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91caeb-e0bd-47bc-a85a-7b2c0a63d2c6 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:55.363957 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c37177-16aa-4e9d-b9e9-3616634e34bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:55.364883 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c37177-16aa-4e9d-b9e9-3616634e34bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:55.365447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c37177-16aa-4e9d-b9e9-3616634e34bb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:55.365919 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c37177-16aa-4e9d-b9e9-3616634e34bb admin admin] PATH_INFO: `/v3/users/2c5401b7ffc842bd84b5b2ae285717de` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:55.367529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c37177-16aa-4e9d-b9e9-3616634e34bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c5401b7ffc842bd84b5b2ae285717de)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:55.370148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c37177-16aa-4e9d-b9e9-3616634e34bb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:55.373871 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:55.478888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e0c37177-16aa-4e9d-b9e9-3616634e34bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c5401b7ffc842bd84b5b2ae285717de'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:55.489141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e0c37177-16aa-4e9d-b9e9-3616634e34bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c5401b7ffc842bd84b5b2ae285717de'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:55.490321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e0c37177-16aa-4e9d-b9e9-3616634e34bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c5401b7ffc842bd84b5b2ae285717de'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:55.491102 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e0c37177-16aa-4e9d-b9e9-3616634e34bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c5401b7ffc842bd84b5b2ae285717de'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:55.502831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e0c37177-16aa-4e9d-b9e9-3616634e34bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c5401b7ffc842bd84b5b2ae285717de'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:55.552070 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2982/5936] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:14:55 2022] DELETE /identity/v3/users/2c5401b7ffc842bd84b5b2ae285717de => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:56.420451 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d49c4-ac93-4927-baf7-b16e67dd14da admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:56.422471 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-590d49c4-ac93-4927-baf7-b16e67dd14da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:56.461306 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d49c4-ac93-4927-baf7-b16e67dd14da admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:56.687172 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc58212-d652-4025-b19e-240e566894bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:56.687921 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc58212-d652-4025-b19e-240e566894bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:56.688439 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc58212-d652-4025-b19e-240e566894bc admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:56.688784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc58212-d652-4025-b19e-240e566894bc admin admin] PATH_INFO: `/v3/projects/6a6253085caf4cea82351ecc4997ea60` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:56.692919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc58212-d652-4025-b19e-240e566894bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a6253085caf4cea82351ecc4997ea60)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:56.695587 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc58212-d652-4025-b19e-240e566894bc admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:56.729785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:56.879146 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8dc58212-d652-4025-b19e-240e566894bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a6253085caf4cea82351ecc4997ea60', 'request_id': 'req-8dc58212-d652-4025-b19e-240e566894bc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:56.908519 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8dc58212-d652-4025-b19e-240e566894bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a6253085caf4cea82351ecc4997ea60', 'request_id': 'req-8dc58212-d652-4025-b19e-240e566894bc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:56.939939 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8dc58212-d652-4025-b19e-240e566894bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a6253085caf4cea82351ecc4997ea60', 'request_id': 'req-8dc58212-d652-4025-b19e-240e566894bc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:57.016329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8dc58212-d652-4025-b19e-240e566894bc admin admin] The token cache is being invalidate because project 6a6253085caf4cea82351ecc4997ea60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:14:57.016626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8dc58212-d652-4025-b19e-240e566894bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:57.023789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8dc58212-d652-4025-b19e-240e566894bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:57.032292 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2955/5937] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:14:56 2022] DELETE /identity/v3/projects/6a6253085caf4cea82351ecc4997ea60 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:57.037979 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c37177-16aa-4e9d-b9e9-3616634e34bb admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:57.039882 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e0c37177-16aa-4e9d-b9e9-3616634e34bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:57.076868 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c37177-16aa-4e9d-b9e9-3616634e34bb admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:57.243163 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346838f-9cd7-4f93-bf12-b02b30e604ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:57.243839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346838f-9cd7-4f93-bf12-b02b30e604ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:57.244222 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346838f-9cd7-4f93-bf12-b02b30e604ee admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:57.244480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346838f-9cd7-4f93-bf12-b02b30e604ee admin admin] PATH_INFO: `/v3/users/aa6d5a8b242e4ac4a954e57a2c68ba83` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:57.248151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8346838f-9cd7-4f93-bf12-b02b30e604ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa6d5a8b242e4ac4a954e57a2c68ba83)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:57.252131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8346838f-9cd7-4f93-bf12-b02b30e604ee admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:57.455586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8346838f-9cd7-4f93-bf12-b02b30e604ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa6d5a8b242e4ac4a954e57a2c68ba83'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:57.513340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8346838f-9cd7-4f93-bf12-b02b30e604ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa6d5a8b242e4ac4a954e57a2c68ba83'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:57.520044 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8346838f-9cd7-4f93-bf12-b02b30e604ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa6d5a8b242e4ac4a954e57a2c68ba83'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:57.523112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8346838f-9cd7-4f93-bf12-b02b30e604ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa6d5a8b242e4ac4a954e57a2c68ba83'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:57.556059 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8346838f-9cd7-4f93-bf12-b02b30e604ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa6d5a8b242e4ac4a954e57a2c68ba83'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:57.622279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:57.658209 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2983/5938] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:14:57 2022] DELETE /identity/v3/users/aa6d5a8b242e4ac4a954e57a2c68ba83 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:59.444180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc58212-d652-4025-b19e-240e566894bc admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:14:59.445718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8dc58212-d652-4025-b19e-240e566894bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:14:59.483766 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc58212-d652-4025-b19e-240e566894bc admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:14:59.620426 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46f9f4-1a02-4c08-9279-d20dbe20cfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:14:59.621452 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46f9f4-1a02-4c08-9279-d20dbe20cfeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:59.621887 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46f9f4-1a02-4c08-9279-d20dbe20cfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:59.622264 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46f9f4-1a02-4c08-9279-d20dbe20cfeb admin admin] PATH_INFO: `/v3/projects/836a2a1c47d64f47910592988a5f1eec` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:59.625793 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46f9f4-1a02-4c08-9279-d20dbe20cfeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=836a2a1c47d64f47910592988a5f1eec)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:14:59.632263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46f9f4-1a02-4c08-9279-d20dbe20cfeb admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:14:59.758028 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0c46f9f4-1a02-4c08-9279-d20dbe20cfeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '836a2a1c47d64f47910592988a5f1eec', 'request_id': 'req-0c46f9f4-1a02-4c08-9279-d20dbe20cfeb'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:59.768493 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0c46f9f4-1a02-4c08-9279-d20dbe20cfeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '836a2a1c47d64f47910592988a5f1eec', 'request_id': 'req-0c46f9f4-1a02-4c08-9279-d20dbe20cfeb'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:59.777086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0c46f9f4-1a02-4c08-9279-d20dbe20cfeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '836a2a1c47d64f47910592988a5f1eec', 'request_id': 'req-0c46f9f4-1a02-4c08-9279-d20dbe20cfeb'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:59.844295 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0c46f9f4-1a02-4c08-9279-d20dbe20cfeb admin admin] The token cache is being invalidate because project 836a2a1c47d64f47910592988a5f1eec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:14:59.845203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0c46f9f4-1a02-4c08-9279-d20dbe20cfeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:59.846781 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0c46f9f4-1a02-4c08-9279-d20dbe20cfeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:14:59.851333 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2956/5939] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:14:59 2022] DELETE /identity/v3/projects/836a2a1c47d64f47910592988a5f1eec => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:14:59.860257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39461bac-7b0e-42bb-a06c-dcc5b17d46f4 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:14:59.860794 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39461bac-7b0e-42bb-a06c-dcc5b17d46f4 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:14:59.860908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39461bac-7b0e-42bb-a06c-dcc5b17d46f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:14:59.940930 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-39461bac-7b0e-42bb-a06c-dcc5b17d46f4 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:14:59.942630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-39461bac-7b0e-42bb-a06c-dcc5b17d46f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:00.098232 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2984/5940] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:14:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:15:00.107170 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a7be2-365f-4d85-81ac-b0fba2350a10 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:00.107620 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a7be2-365f-4d85-81ac-b0fba2350a10 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:00.107946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a7be2-365f-4d85-81ac-b0fba2350a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:00.172768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-382a7be2-365f-4d85-81ac-b0fba2350a10 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:15:00.177580 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-382a7be2-365f-4d85-81ac-b0fba2350a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:00.205119 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2957/5941] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:15:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:15:00.207851 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39461bac-7b0e-42bb-a06c-dcc5b17d46f4 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:00.229273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39461bac-7b0e-42bb-a06c-dcc5b17d46f4 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:00.251719 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3cb087-c6c8-442d-a6e8-344b40c0bbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:00.266227 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cb087-c6c8-442d-a6e8-344b40c0bbfe admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:00.266817 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cb087-c6c8-442d-a6e8-344b40c0bbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:00.267038 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cb087-c6c8-442d-a6e8-344b40c0bbfe admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:00.267849 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3cb087-c6c8-442d-a6e8-344b40c0bbfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:15:00.268219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3cb087-c6c8-442d-a6e8-344b40c0bbfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:00.272984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3cb087-c6c8-442d-a6e8-344b40c0bbfe admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:00.297820 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2985/5942] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:15:00.299684 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a7be2-365f-4d85-81ac-b0fba2350a10 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:00.313781 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a7be2-365f-4d85-81ac-b0fba2350a10 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:00.322881 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1a4c7-b7ca-4bd6-b836-5c1b42000d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:00.325374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1a4c7-b7ca-4bd6-b836-5c1b42000d2b admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:00.325943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1a4c7-b7ca-4bd6-b836-5c1b42000d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:00.326466 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1a4c7-b7ca-4bd6-b836-5c1b42000d2b admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:00.327386 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1a4c7-b7ca-4bd6-b836-5c1b42000d2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:00.330682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1a4c7-b7ca-4bd6-b836-5c1b42000d2b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:00.385830 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2958/5943] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:15:00 2022] POST /identity/v3/projects => generated 365 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:15:00.386015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3cb087-c6c8-442d-a6e8-344b40c0bbfe admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:00.397909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3cb087-c6c8-442d-a6e8-344b40c0bbfe admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:00.587839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b82ac-098a-4ff1-bdba-f1b794b38590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:00.588487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b82ac-098a-4ff1-bdba-f1b794b38590 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:00.588768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b82ac-098a-4ff1-bdba-f1b794b38590 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:00.589053 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b82ac-098a-4ff1-bdba-f1b794b38590 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:00.589681 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b82ac-098a-4ff1-bdba-f1b794b38590 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:00.591696 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b82ac-098a-4ff1-bdba-f1b794b38590 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:00.647163 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1a4c7-b7ca-4bd6-b836-5c1b42000d2b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:00.652069 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2986/5944] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:15:00 2022] POST /identity/v3/users => generated 283 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:15:00.683334 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1a4c7-b7ca-4bd6-b836-5c1b42000d2b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:00.689376 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc78ae3-a4fc-422d-9397-8a3e57ef3a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:00.690688 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc78ae3-a4fc-422d-9397-8a3e57ef3a2e admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:00.690959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc78ae3-a4fc-422d-9397-8a3e57ef3a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:00.691539 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc78ae3-a4fc-422d-9397-8a3e57ef3a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:00.692194 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc78ae3-a4fc-422d-9397-8a3e57ef3a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:00.698715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc78ae3-a4fc-422d-9397-8a3e57ef3a2e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:00.701479 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:00.725956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b82ac-098a-4ff1-bdba-f1b794b38590 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:00.741412 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2959/5945] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:15:00.743208 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b82ac-098a-4ff1-bdba-f1b794b38590 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:00.749788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e189c22-6a0c-498b-a17a-840c8593bbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:00.750413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e189c22-6a0c-498b-a17a-840c8593bbf0 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:00.750879 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e189c22-6a0c-498b-a17a-840c8593bbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:00.750983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e189c22-6a0c-498b-a17a-840c8593bbf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:00.754675 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e189c22-6a0c-498b-a17a-840c8593bbf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:00.758036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e189c22-6a0c-498b-a17a-840c8593bbf0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:00.793103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc78ae3-a4fc-422d-9397-8a3e57ef3a2e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:00.807801 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2987/5946] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:15:00.811210 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc78ae3-a4fc-422d-9397-8a3e57ef3a2e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:00.827150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1c878-935b-42a9-8ca3-ab21e16e17e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:00.830107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1c878-935b-42a9-8ca3-ab21e16e17e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:00.831534 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1c878-935b-42a9-8ca3-ab21e16e17e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:00.831877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1c878-935b-42a9-8ca3-ab21e16e17e9 admin admin] PATH_INFO: `/v3/projects/eac66fd39bd0418cbcb0c455490c8252/users/b5c980227a7e4cdc8059b40f8c4f2ca4/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:00.874593 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa1c878-935b-42a9-8ca3-ab21e16e17e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eac66fd39bd0418cbcb0c455490c8252, user_id=b5c980227a7e4cdc8059b40f8c4f2ca4, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:00.885992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa1c878-935b-42a9-8ca3-ab21e16e17e9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:00.945781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e0715-5700-4aa4-b163-0c3577d1c4dd None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:00.946427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e0715-5700-4aa4-b163-0c3577d1c4dd None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:00.946427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e0715-5700-4aa4-b163-0c3577d1c4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:00.950029 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2960/5947] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:15:00 2022] PUT /identity/v3/projects/eac66fd39bd0418cbcb0c455490c8252/users/b5c980227a7e4cdc8059b40f8c4f2ca4/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:15:00.975134 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1c878-935b-42a9-8ca3-ab21e16e17e9 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:00.977077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-bfa1c878-935b-42a9-8ca3-ab21e16e17e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:01.003125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-e74e0715-5700-4aa4-b163-0c3577d1c4dd None None] MFA Rules not processed for user `b5c980227a7e4cdc8059b40f8c4f2ca4`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:15:01.004600 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e74e0715-5700-4aa4-b163-0c3577d1c4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:01.094815 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:01.120659 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2988/5948] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:15:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:15:01.122130 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e0715-5700-4aa4-b163-0c3577d1c4dd None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:01.251622 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e0715-5700-4aa4-b163-0c3577d1c4dd None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:01.264436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33cac1-7443-4d95-95ad-698194f958eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:01.266376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33cac1-7443-4d95-95ad-698194f958eb admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:01.266687 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33cac1-7443-4d95-95ad-698194f958eb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:01.267251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33cac1-7443-4d95-95ad-698194f958eb admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:01.270765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d33cac1-7443-4d95-95ad-698194f958eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:01.279239 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d33cac1-7443-4d95-95ad-698194f958eb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:01.360322 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2989/5949] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:15:01 2022] POST /identity/v3/projects => generated 365 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:15:01.364900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33cac1-7443-4d95-95ad-698194f958eb admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:01.366070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1c878-935b-42a9-8ca3-ab21e16e17e9 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:01.589358 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33cac1-7443-4d95-95ad-698194f958eb admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:01.599190 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40258dd7-a688-4146-9013-02d735ccb331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:01.600086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40258dd7-a688-4146-9013-02d735ccb331 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:01.600516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40258dd7-a688-4146-9013-02d735ccb331 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:01.600965 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40258dd7-a688-4146-9013-02d735ccb331 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:01.602025 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40258dd7-a688-4146-9013-02d735ccb331 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:01.604166 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40258dd7-a688-4146-9013-02d735ccb331 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:01.638193 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2990/5950] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:15:01 2022] POST /identity/v3/users => generated 289 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:15:01.640457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40258dd7-a688-4146-9013-02d735ccb331 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:01.680051 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67180850-ffd7-452b-9955-145f14fc6a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:01.681364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67180850-ffd7-452b-9955-145f14fc6a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:01.684627 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67180850-ffd7-452b-9955-145f14fc6a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:01.685327 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67180850-ffd7-452b-9955-145f14fc6a55 admin admin] PATH_INFO: `/v3/users/5e6391f307af40ed935dcbb8fc1ac4c4` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:01.686929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67180850-ffd7-452b-9955-145f14fc6a55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e6391f307af40ed935dcbb8fc1ac4c4)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:01.689635 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67180850-ffd7-452b-9955-145f14fc6a55 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:01.714169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40258dd7-a688-4146-9013-02d735ccb331 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:01.723045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a762d-2c10-438e-935e-5a98005e7f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:01.723820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a762d-2c10-438e-935e-5a98005e7f27 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:01.724109 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a762d-2c10-438e-935e-5a98005e7f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:01.724382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a762d-2c10-438e-935e-5a98005e7f27 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:01.725545 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a762d-2c10-438e-935e-5a98005e7f27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:01.728634 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a762d-2c10-438e-935e-5a98005e7f27 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:01.748241 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2991/5951] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:15:01.755175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a762d-2c10-438e-935e-5a98005e7f27 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:01.767928 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a762d-2c10-438e-935e-5a98005e7f27 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:01.773751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c477f82-7061-4e6b-981c-eb27bbbd3252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:01.775105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c477f82-7061-4e6b-981c-eb27bbbd3252 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:01.775398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c477f82-7061-4e6b-981c-eb27bbbd3252 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:01.775677 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c477f82-7061-4e6b-981c-eb27bbbd3252 admin admin] PATH_INFO: `/v3/projects/50291cfc5a76463e8aa6ae2121da4581/users/948fe3de43b34a9cb47c997c83bf7870/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:01.796662 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c477f82-7061-4e6b-981c-eb27bbbd3252 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50291cfc5a76463e8aa6ae2121da4581, user_id=948fe3de43b34a9cb47c997c83bf7870, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:01.799897 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c477f82-7061-4e6b-981c-eb27bbbd3252 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:01.811998 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-67180850-ffd7-452b-9955-145f14fc6a55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e6391f307af40ed935dcbb8fc1ac4c4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:01.812739 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-67180850-ffd7-452b-9955-145f14fc6a55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e6391f307af40ed935dcbb8fc1ac4c4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:01.817790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-67180850-ffd7-452b-9955-145f14fc6a55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e6391f307af40ed935dcbb8fc1ac4c4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:01.826819 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2992/5952] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:15:01 2022] PUT /identity/v3/projects/50291cfc5a76463e8aa6ae2121da4581/users/948fe3de43b34a9cb47c997c83bf7870/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:15:01.831181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c477f82-7061-4e6b-981c-eb27bbbd3252 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:01.836719 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0c477f82-7061-4e6b-981c-eb27bbbd3252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:01.844209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-67180850-ffd7-452b-9955-145f14fc6a55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e6391f307af40ed935dcbb8fc1ac4c4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:01.878730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-67180850-ffd7-452b-9955-145f14fc6a55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e6391f307af40ed935dcbb8fc1ac4c4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:01.900152 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:01.928318 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2961/5953] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:15:00 2022] DELETE /identity/v3/users/5e6391f307af40ed935dcbb8fc1ac4c4 => generated 0 bytes in 954 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:15:01.932850 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bee79a-4f3f-4a7d-89d9-ca6e8b32fddd None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:01.934848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bee79a-4f3f-4a7d-89d9-ca6e8b32fddd None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:01.935524 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bee79a-4f3f-4a7d-89d9-ca6e8b32fddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:02.004214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:02.034299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-57bee79a-4f3f-4a7d-89d9-ca6e8b32fddd None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:15:02.036783 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-57bee79a-4f3f-4a7d-89d9-ca6e8b32fddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:02.142976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c477f82-7061-4e6b-981c-eb27bbbd3252 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:02.143858 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2962/5954] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:15:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:15:02.145760 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a281ad-6a01-4938-8865-a839b07abaa3 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:02.146568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a281ad-6a01-4938-8865-a839b07abaa3 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:02.146989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a281ad-6a01-4938-8865-a839b07abaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:02.152767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44f5fe-3379-409b-8c7e-4e095eb93ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:02.153622 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44f5fe-3379-409b-8c7e-4e095eb93ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:02.154099 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44f5fe-3379-409b-8c7e-4e095eb93ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:02.154630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44f5fe-3379-409b-8c7e-4e095eb93ee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:02.155603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44f5fe-3379-409b-8c7e-4e095eb93ee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:02.157614 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44f5fe-3379-409b-8c7e-4e095eb93ee9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:02.171204 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2993/5955] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:15:02.175424 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-75a281ad-6a01-4938-8865-a839b07abaa3 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:15:02.176434 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44f5fe-3379-409b-8c7e-4e095eb93ee9 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:02.177586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-75a281ad-6a01-4938-8865-a839b07abaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:02.191573 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44f5fe-3379-409b-8c7e-4e095eb93ee9 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:02.199830 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c749dd-9def-49be-8861-9b380fd048ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:02.201126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c749dd-9def-49be-8861-9b380fd048ae admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:02.201657 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c749dd-9def-49be-8861-9b380fd048ae admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:02.202041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c749dd-9def-49be-8861-9b380fd048ae admin admin] PATH_INFO: `/v3/projects/50291cfc5a76463e8aa6ae2121da4581/users/948fe3de43b34a9cb47c997c83bf7870/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:02.204271 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c749dd-9def-49be-8861-9b380fd048ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=50291cfc5a76463e8aa6ae2121da4581, user_id=948fe3de43b34a9cb47c997c83bf7870, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:02.208280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c749dd-9def-49be-8861-9b380fd048ae admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:02.221929 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2994/5956] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:15:02 2022] PUT /identity/v3/projects/50291cfc5a76463e8aa6ae2121da4581/users/948fe3de43b34a9cb47c997c83bf7870/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:15:02.223105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c749dd-9def-49be-8861-9b380fd048ae admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:02.233808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-61c749dd-9def-49be-8861-9b380fd048ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:02.372878 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c749dd-9def-49be-8861-9b380fd048ae admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:02.378874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68738f4d-4caf-4b17-b4cd-6bad145d70d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:02.379552 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68738f4d-4caf-4b17-b4cd-6bad145d70d9 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:02.379835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68738f4d-4caf-4b17-b4cd-6bad145d70d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:02.380267 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68738f4d-4caf-4b17-b4cd-6bad145d70d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:02.420029 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2963/5957] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:15:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:15:02.424567 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89b7e3-be7c-4e38-a190-637463c070fd None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:02.425008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89b7e3-be7c-4e38-a190-637463c070fd None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:02.425395 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89b7e3-be7c-4e38-a190-637463c070fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:02.540196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-ec89b7e3-be7c-4e38-a190-637463c070fd None None] MFA Rules not processed for user `948fe3de43b34a9cb47c997c83bf7870`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:15:02.541500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ec89b7e3-be7c-4e38-a190-637463c070fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:02.568367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68738f4d-4caf-4b17-b4cd-6bad145d70d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:02.573502 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68738f4d-4caf-4b17-b4cd-6bad145d70d9 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:02.596823 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2995/5958] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:15:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:15:02.598070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68738f4d-4caf-4b17-b4cd-6bad145d70d9 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:02.599608 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-68738f4d-4caf-4b17-b4cd-6bad145d70d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:02.761130 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68738f4d-4caf-4b17-b4cd-6bad145d70d9 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:02.766958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b551ed-a7ea-4557-bed1-5efedb56395a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:02.767592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b551ed-a7ea-4557-bed1-5efedb56395a service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:02.767872 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b551ed-a7ea-4557-bed1-5efedb56395a service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:02.768236 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b551ed-a7ea-4557-bed1-5efedb56395a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:02.774944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:02.807260 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2964/5959] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:15:02 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:15:02.825150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89b7e3-be7c-4e38-a190-637463c070fd None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:02.830003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ec89b7e3-be7c-4e38-a190-637463c070fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:02.905714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:02.943240 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b551ed-a7ea-4557-bed1-5efedb56395a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:02.949716 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b551ed-a7ea-4557-bed1-5efedb56395a service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:02.998587 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2996/5960] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:15:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:15:03.037183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89b7e3-be7c-4e38-a190-637463c070fd None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:03.054612 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75af9cc-544f-4d21-977c-b3f5667b9dc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:03.055514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75af9cc-544f-4d21-977c-b3f5667b9dc4 service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:03.057442 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75af9cc-544f-4d21-977c-b3f5667b9dc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:03.057747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75af9cc-544f-4d21-977c-b3f5667b9dc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:03.098854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75af9cc-544f-4d21-977c-b3f5667b9dc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:03.100344 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75af9cc-544f-4d21-977c-b3f5667b9dc4 service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:03.146344 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2965/5961] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:15:02 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:15:03.384732 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b551ed-a7ea-4557-bed1-5efedb56395a service swift] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:03.414185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b551ed-a7ea-4557-bed1-5efedb56395a service swift] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:03.441312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2596f-a86c-43ab-b587-df6230b7ecd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:03.442612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2596f-a86c-43ab-b587-df6230b7ecd8 service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:03.442612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2596f-a86c-43ab-b587-df6230b7ecd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:03.442612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2596f-a86c-43ab-b587-df6230b7ecd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:03.446456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-03c2596f-a86c-43ab-b587-df6230b7ecd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:03.749145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2596f-a86c-43ab-b587-df6230b7ecd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:03.757175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2596f-a86c-43ab-b587-df6230b7ecd8 service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:03.795779 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2997/5962] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:15:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:15:05.281943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75af9cc-544f-4d21-977c-b3f5667b9dc4 service cinder] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:05.285081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e75af9cc-544f-4d21-977c-b3f5667b9dc4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:05.334656 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75af9cc-544f-4d21-977c-b3f5667b9dc4 service cinder] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:05.362582 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad2bac-93dc-4c10-aa1f-be9665809720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:05.364860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad2bac-93dc-4c10-aa1f-be9665809720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:05.365660 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad2bac-93dc-4c10-aa1f-be9665809720 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:05.366468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad2bac-93dc-4c10-aa1f-be9665809720 admin admin] PATH_INFO: `/v3/projects/e617708266ab45c4882ecc85ec96895a` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:05.372878 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad2bac-93dc-4c10-aa1f-be9665809720 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e617708266ab45c4882ecc85ec96895a)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:05.378275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad2bac-93dc-4c10-aa1f-be9665809720 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:05.587359 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dfad2bac-93dc-4c10-aa1f-be9665809720 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e617708266ab45c4882ecc85ec96895a', 'request_id': 'req-dfad2bac-93dc-4c10-aa1f-be9665809720'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:05.626406 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dfad2bac-93dc-4c10-aa1f-be9665809720 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e617708266ab45c4882ecc85ec96895a', 'request_id': 'req-dfad2bac-93dc-4c10-aa1f-be9665809720'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:05.663899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dfad2bac-93dc-4c10-aa1f-be9665809720 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e617708266ab45c4882ecc85ec96895a', 'request_id': 'req-dfad2bac-93dc-4c10-aa1f-be9665809720'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:05.697279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dfad2bac-93dc-4c10-aa1f-be9665809720 admin admin] The token cache is being invalidate because project e617708266ab45c4882ecc85ec96895a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:15:05.697662 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dfad2bac-93dc-4c10-aa1f-be9665809720 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:05.698380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dfad2bac-93dc-4c10-aa1f-be9665809720 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:05.709192 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2966/5963] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:15:05 2022] DELETE /identity/v3/projects/e617708266ab45c4882ecc85ec96895a => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:15:05.711378 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92a306-3fb9-4107-901a-dad2ca58a31d None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:05.711853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92a306-3fb9-4107-901a-dad2ca58a31d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:05.711938 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92a306-3fb9-4107-901a-dad2ca58a31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:05.761877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-db92a306-3fb9-4107-901a-dad2ca58a31d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:15:05.763586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-db92a306-3fb9-4107-901a-dad2ca58a31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:05.908036 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2998/5964] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:15:05.915988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e53518-47ac-4a5f-a9d0-a541a46f3008 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:05.916246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e53518-47ac-4a5f-a9d0-a541a46f3008 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:05.916522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e53518-47ac-4a5f-a9d0-a541a46f3008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:05.981284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-c3e53518-47ac-4a5f-a9d0-a541a46f3008 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:15:05.982540 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c3e53518-47ac-4a5f-a9d0-a541a46f3008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:06.028094 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2967/5965] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:15:06.032426 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92a306-3fb9-4107-901a-dad2ca58a31d None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:06.045331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92a306-3fb9-4107-901a-dad2ca58a31d None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:06.063748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736d8ce-e3ad-4e82-a3c3-b9c65879bb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:06.064373 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736d8ce-e3ad-4e82-a3c3-b9c65879bb7c admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:06.067888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736d8ce-e3ad-4e82-a3c3-b9c65879bb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:06.070688 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736d8ce-e3ad-4e82-a3c3-b9c65879bb7c admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:06.071555 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8736d8ce-e3ad-4e82-a3c3-b9c65879bb7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:15:06.075040 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8736d8ce-e3ad-4e82-a3c3-b9c65879bb7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:06.079632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8736d8ce-e3ad-4e82-a3c3-b9c65879bb7c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:06.144482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e53518-47ac-4a5f-a9d0-a541a46f3008 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:06.151008 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 2999/5966] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:15:06.157483 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e53518-47ac-4a5f-a9d0-a541a46f3008 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:06.170992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931262b-db13-409a-b89b-704bdcf8a071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:06.171716 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931262b-db13-409a-b89b-704bdcf8a071 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:06.172769 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931262b-db13-409a-b89b-704bdcf8a071 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:06.173253 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931262b-db13-409a-b89b-704bdcf8a071 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:06.175625 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f931262b-db13-409a-b89b-704bdcf8a071 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:06.179959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f931262b-db13-409a-b89b-704bdcf8a071 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:06.243691 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2968/5967] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:15:06 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:15:06.245819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736d8ce-e3ad-4e82-a3c3-b9c65879bb7c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:06.257672 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736d8ce-e3ad-4e82-a3c3-b9c65879bb7c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:06.345091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:06.403106 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f0088-c3e1-4a9d-8e71-9327f416b77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:06.403751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f0088-c3e1-4a9d-8e71-9327f416b77b admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:06.404089 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f0088-c3e1-4a9d-8e71-9327f416b77b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:06.404702 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f0088-c3e1-4a9d-8e71-9327f416b77b admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:06.405359 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f0088-c3e1-4a9d-8e71-9327f416b77b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:06.407426 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f0088-c3e1-4a9d-8e71-9327f416b77b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:06.458496 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3000/5968] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:15:06 2022] POST /identity/v3/users => generated 283 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:15:06.464713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931262b-db13-409a-b89b-704bdcf8a071 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:06.478139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931262b-db13-409a-b89b-704bdcf8a071 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:06.509809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0682d-40ad-4088-94f0-936d798d4983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:06.513467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0682d-40ad-4088-94f0-936d798d4983 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:06.513740 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0682d-40ad-4088-94f0-936d798d4983 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:06.518871 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0682d-40ad-4088-94f0-936d798d4983 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:06.520800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e0682d-40ad-4088-94f0-936d798d4983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:06.532873 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e0682d-40ad-4088-94f0-936d798d4983 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:06.587226 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2969/5969] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:15:06.591313 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f0088-c3e1-4a9d-8e71-9327f416b77b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:06.605113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f0088-c3e1-4a9d-8e71-9327f416b77b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:06.625499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b24bd2-e8a5-4ecb-b1d5-3bdb96c0aa86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:06.626760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b24bd2-e8a5-4ecb-b1d5-3bdb96c0aa86 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:06.627916 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b24bd2-e8a5-4ecb-b1d5-3bdb96c0aa86 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:06.630381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b24bd2-e8a5-4ecb-b1d5-3bdb96c0aa86 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:06.636419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b24bd2-e8a5-4ecb-b1d5-3bdb96c0aa86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:06.639301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b24bd2-e8a5-4ecb-b1d5-3bdb96c0aa86 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:06.691349 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3001/5970] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:15:06.695567 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0682d-40ad-4088-94f0-936d798d4983 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:06.712376 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0682d-40ad-4088-94f0-936d798d4983 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:06.746686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a30f84-474f-418b-a89b-f2ff8377a316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:06.751027 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a30f84-474f-418b-a89b-f2ff8377a316 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:06.751671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a30f84-474f-418b-a89b-f2ff8377a316 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:06.754791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a30f84-474f-418b-a89b-f2ff8377a316 admin admin] PATH_INFO: `/v3/projects/2751afd62cb8451b87ffbf09df0d40f9/users/6beda876a6f747c49c17fe686df1fbcc/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:06.792158 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a30f84-474f-418b-a89b-f2ff8377a316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2751afd62cb8451b87ffbf09df0d40f9, user_id=6beda876a6f747c49c17fe686df1fbcc, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:06.798692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a30f84-474f-418b-a89b-f2ff8377a316 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:06.850387 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2970/5971] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:15:06 2022] PUT /identity/v3/projects/2751afd62cb8451b87ffbf09df0d40f9/users/6beda876a6f747c49c17fe686df1fbcc/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:15:06.852692 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058c839-70b9-44e8-83c2-d86cf7e967bd None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:06.853696 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058c839-70b9-44e8-83c2-d86cf7e967bd None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:06.854176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058c839-70b9-44e8-83c2-d86cf7e967bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:06.886593 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-f058c839-70b9-44e8-83c2-d86cf7e967bd None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:15:06.888994 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f058c839-70b9-44e8-83c2-d86cf7e967bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:07.017410 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3002/5972] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:15:07.058835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a30f84-474f-418b-a89b-f2ff8377a316 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:07.062362 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b5a30f84-474f-418b-a89b-f2ff8377a316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:07.218522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a30f84-474f-418b-a89b-f2ff8377a316 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:07.224086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81c709-f565-4833-9bc9-90422614cee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:07.224709 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81c709-f565-4833-9bc9-90422614cee7 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:07.224995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81c709-f565-4833-9bc9-90422614cee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:07.225268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81c709-f565-4833-9bc9-90422614cee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:07.234858 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:07.245578 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81c709-f565-4833-9bc9-90422614cee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:07.247764 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81c709-f565-4833-9bc9-90422614cee7 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:07.301883 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2971/5973] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:15:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:15:11.207893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058c839-70b9-44e8-83c2-d86cf7e967bd None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:11.212522 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f058c839-70b9-44e8-83c2-d86cf7e967bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:11.236061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058c839-70b9-44e8-83c2-d86cf7e967bd None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:11.253359 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457bf58-943c-4a0d-805b-cf84d3664c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:11.254160 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457bf58-943c-4a0d-805b-cf84d3664c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:11.254449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457bf58-943c-4a0d-805b-cf84d3664c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:11.254774 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457bf58-943c-4a0d-805b-cf84d3664c88 admin admin] PATH_INFO: `/v3/users/b5c980227a7e4cdc8059b40f8c4f2ca4` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:11.256080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457bf58-943c-4a0d-805b-cf84d3664c88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5c980227a7e4cdc8059b40f8c4f2ca4)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:11.258506 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457bf58-943c-4a0d-805b-cf84d3664c88 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:11.375212 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3457bf58-943c-4a0d-805b-cf84d3664c88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5c980227a7e4cdc8059b40f8c4f2ca4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:11.398455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3457bf58-943c-4a0d-805b-cf84d3664c88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5c980227a7e4cdc8059b40f8c4f2ca4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:11.401371 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3457bf58-943c-4a0d-805b-cf84d3664c88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5c980227a7e4cdc8059b40f8c4f2ca4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:11.402880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3457bf58-943c-4a0d-805b-cf84d3664c88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5c980227a7e4cdc8059b40f8c4f2ca4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:11.425708 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3457bf58-943c-4a0d-805b-cf84d3664c88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5c980227a7e4cdc8059b40f8c4f2ca4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:11.484009 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3003/5974] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:15:11 2022] DELETE /identity/v3/users/b5c980227a7e4cdc8059b40f8c4f2ca4 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:15:11.488776 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16316cb1-23d1-4729-bbf6-3c1cd1b72e6a None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:11.489353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16316cb1-23d1-4729-bbf6-3c1cd1b72e6a None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:11.489353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16316cb1-23d1-4729-bbf6-3c1cd1b72e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:11.522600 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-16316cb1-23d1-4729-bbf6-3c1cd1b72e6a None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:15:11.524050 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-16316cb1-23d1-4729-bbf6-3c1cd1b72e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:11.677428 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2972/5975] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:15:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:15:11.864531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457bf58-943c-4a0d-805b-cf84d3664c88 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:11.866293 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3457bf58-943c-4a0d-805b-cf84d3664c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:11.931690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:12.002522 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457bf58-943c-4a0d-805b-cf84d3664c88 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:12.015040 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1917be-cbdd-4142-997f-f9c39aa6b38d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:12.015674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1917be-cbdd-4142-997f-f9c39aa6b38d service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:12.015967 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1917be-cbdd-4142-997f-f9c39aa6b38d service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:12.016422 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1917be-cbdd-4142-997f-f9c39aa6b38d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:12.042142 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1917be-cbdd-4142-997f-f9c39aa6b38d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:12.043636 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1917be-cbdd-4142-997f-f9c39aa6b38d service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:12.069312 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3004/5976] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:15:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:15:13.059003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457131d9-135b-4741-8408-38f8b566eaf9 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:13.059937 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457131d9-135b-4741-8408-38f8b566eaf9 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:13.060360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457131d9-135b-4741-8408-38f8b566eaf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:13.118470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-457131d9-135b-4741-8408-38f8b566eaf9 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:15:13.119712 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-457131d9-135b-4741-8408-38f8b566eaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:13.311796 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2973/5977] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:15:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:15:13.331067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1917be-cbdd-4142-997f-f9c39aa6b38d service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:13.332855 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2e1917be-cbdd-4142-997f-f9c39aa6b38d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:13.507896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1917be-cbdd-4142-997f-f9c39aa6b38d service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:13.531250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d21f89-ce2a-4bff-8bf5-021358dff3b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:13.532385 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d21f89-ce2a-4bff-8bf5-021358dff3b4 service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:13.532923 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d21f89-ce2a-4bff-8bf5-021358dff3b4 service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:13.533481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d21f89-ce2a-4bff-8bf5-021358dff3b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:13.545199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d21f89-ce2a-4bff-8bf5-021358dff3b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:13.549311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d21f89-ce2a-4bff-8bf5-021358dff3b4 service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:13.573527 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3005/5978] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:15:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:15:14.639453 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457131d9-135b-4741-8408-38f8b566eaf9 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:14.641399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-457131d9-135b-4741-8408-38f8b566eaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:14.691631 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457131d9-135b-4741-8408-38f8b566eaf9 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:14.704440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76ec3e-a7af-4fb9-8313-4766f3337a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:14.705488 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76ec3e-a7af-4fb9-8313-4766f3337a43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:14.705977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76ec3e-a7af-4fb9-8313-4766f3337a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:14.706577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76ec3e-a7af-4fb9-8313-4766f3337a43 admin admin] PATH_INFO: `/v3/projects/eac66fd39bd0418cbcb0c455490c8252` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:14.708418 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76ec3e-a7af-4fb9-8313-4766f3337a43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eac66fd39bd0418cbcb0c455490c8252)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:14.710586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76ec3e-a7af-4fb9-8313-4766f3337a43 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:14.835703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8b76ec3e-a7af-4fb9-8313-4766f3337a43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eac66fd39bd0418cbcb0c455490c8252', 'request_id': 'req-8b76ec3e-a7af-4fb9-8313-4766f3337a43'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:14.852584 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8b76ec3e-a7af-4fb9-8313-4766f3337a43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eac66fd39bd0418cbcb0c455490c8252', 'request_id': 'req-8b76ec3e-a7af-4fb9-8313-4766f3337a43'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:14.863403 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8b76ec3e-a7af-4fb9-8313-4766f3337a43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eac66fd39bd0418cbcb0c455490c8252', 'request_id': 'req-8b76ec3e-a7af-4fb9-8313-4766f3337a43'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:14.889473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8b76ec3e-a7af-4fb9-8313-4766f3337a43 admin admin] The token cache is being invalidate because project eac66fd39bd0418cbcb0c455490c8252 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:15:14.890870 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8b76ec3e-a7af-4fb9-8313-4766f3337a43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:14.893442 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8b76ec3e-a7af-4fb9-8313-4766f3337a43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:14.897359 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2974/5979] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:15:14 2022] DELETE /identity/v3/projects/eac66fd39bd0418cbcb0c455490c8252 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:15:14.901548 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d21f89-ce2a-4bff-8bf5-021358dff3b4 service swift] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:14.927609 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d21f89-ce2a-4bff-8bf5-021358dff3b4 service swift] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:15.120699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ac9eb-d954-4bdb-8ede-13d79dc72301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:15.121376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ac9eb-d954-4bdb-8ede-13d79dc72301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:15.121658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ac9eb-d954-4bdb-8ede-13d79dc72301 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:15.121937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ac9eb-d954-4bdb-8ede-13d79dc72301 admin admin] PATH_INFO: `/v3/users/948fe3de43b34a9cb47c997c83bf7870` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:15.128496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ac9eb-d954-4bdb-8ede-13d79dc72301 admin admin] RBAC: Authorizing `identity:delete_user(user_id=948fe3de43b34a9cb47c997c83bf7870)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:15.132747 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ac9eb-d954-4bdb-8ede-13d79dc72301 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:15.281954 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e06ac9eb-d954-4bdb-8ede-13d79dc72301 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '948fe3de43b34a9cb47c997c83bf7870'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:15.314121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e06ac9eb-d954-4bdb-8ede-13d79dc72301 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '948fe3de43b34a9cb47c997c83bf7870'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:15.318939 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e06ac9eb-d954-4bdb-8ede-13d79dc72301 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '948fe3de43b34a9cb47c997c83bf7870'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:15.332232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e06ac9eb-d954-4bdb-8ede-13d79dc72301 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '948fe3de43b34a9cb47c997c83bf7870'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:15.337438 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:15.355660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e06ac9eb-d954-4bdb-8ede-13d79dc72301 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '948fe3de43b34a9cb47c997c83bf7870'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:15.433197 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3006/5980] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:15:14 2022] DELETE /identity/v3/users/948fe3de43b34a9cb47c997c83bf7870 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:15:20.966383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76ec3e-a7af-4fb9-8313-4766f3337a43 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:20.967912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8b76ec3e-a7af-4fb9-8313-4766f3337a43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:21.006861 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76ec3e-a7af-4fb9-8313-4766f3337a43 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:21.059075 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:21.221010 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96592814-a9e0-4e3d-8568-d506f631926d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:21.221678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96592814-a9e0-4e3d-8568-d506f631926d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:21.221957 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96592814-a9e0-4e3d-8568-d506f631926d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:21.222228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96592814-a9e0-4e3d-8568-d506f631926d admin admin] PATH_INFO: `/v3/projects/50291cfc5a76463e8aa6ae2121da4581` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:21.223615 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96592814-a9e0-4e3d-8568-d506f631926d admin admin] RBAC: Authorizing `identity:delete_project(project_id=50291cfc5a76463e8aa6ae2121da4581)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:21.239232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96592814-a9e0-4e3d-8568-d506f631926d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:21.435473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-96592814-a9e0-4e3d-8568-d506f631926d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50291cfc5a76463e8aa6ae2121da4581', 'request_id': 'req-96592814-a9e0-4e3d-8568-d506f631926d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:21.456109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-96592814-a9e0-4e3d-8568-d506f631926d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50291cfc5a76463e8aa6ae2121da4581', 'request_id': 'req-96592814-a9e0-4e3d-8568-d506f631926d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:21.484638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-96592814-a9e0-4e3d-8568-d506f631926d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50291cfc5a76463e8aa6ae2121da4581', 'request_id': 'req-96592814-a9e0-4e3d-8568-d506f631926d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:21.527698 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-96592814-a9e0-4e3d-8568-d506f631926d admin admin] The token cache is being invalidate because project 50291cfc5a76463e8aa6ae2121da4581 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:15:21.527998 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-96592814-a9e0-4e3d-8568-d506f631926d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:21.530100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-96592814-a9e0-4e3d-8568-d506f631926d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:21.532705 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2975/5981] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:15:20 2022] DELETE /identity/v3/projects/50291cfc5a76463e8aa6ae2121da4581 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:15:21.537836 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ecc07-0352-4b9b-9608-3e81caa079c8 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:21.538332 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ecc07-0352-4b9b-9608-3e81caa079c8 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:21.538418 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ecc07-0352-4b9b-9608-3e81caa079c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:21.584426 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-8a9ecc07-0352-4b9b-9608-3e81caa079c8 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:15:21.585846 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8a9ecc07-0352-4b9b-9608-3e81caa079c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:21.779590 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3007/5982] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:15:21.787889 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb70f07-ac2e-4bd2-a215-7ab5f497760e None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:21.790347 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb70f07-ac2e-4bd2-a215-7ab5f497760e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:21.790680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb70f07-ac2e-4bd2-a215-7ab5f497760e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:21.850676 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-4bb70f07-ac2e-4bd2-a215-7ab5f497760e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:15:21.851659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4bb70f07-ac2e-4bd2-a215-7ab5f497760e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:21.890872 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2976/5983] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:15:21.895108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ecc07-0352-4b9b-9608-3e81caa079c8 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:21.906513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ecc07-0352-4b9b-9608-3e81caa079c8 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:21.925406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648276ae-29d2-40b1-aa00-3794973836b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:21.926132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648276ae-29d2-40b1-aa00-3794973836b9 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:21.926763 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648276ae-29d2-40b1-aa00-3794973836b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:21.927272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648276ae-29d2-40b1-aa00-3794973836b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:21.928011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648276ae-29d2-40b1-aa00-3794973836b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:15:21.930954 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648276ae-29d2-40b1-aa00-3794973836b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:21.932704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648276ae-29d2-40b1-aa00-3794973836b9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:21.972472 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3008/5984] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:15:21.974832 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb70f07-ac2e-4bd2-a215-7ab5f497760e None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:21.989506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb70f07-ac2e-4bd2-a215-7ab5f497760e None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:22.005124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7842db-8c0b-4a2a-9510-5b0973967ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:22.005946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7842db-8c0b-4a2a-9510-5b0973967ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:22.006438 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7842db-8c0b-4a2a-9510-5b0973967ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:22.007108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7842db-8c0b-4a2a-9510-5b0973967ff5 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:22.007885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7842db-8c0b-4a2a-9510-5b0973967ff5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:22.010904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7842db-8c0b-4a2a-9510-5b0973967ff5 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:22.087993 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2977/5985] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:15:21 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:15:22.091802 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648276ae-29d2-40b1-aa00-3794973836b9 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:22.105971 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648276ae-29d2-40b1-aa00-3794973836b9 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:22.212966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292e970-2f38-4519-9a3b-fb36748b44c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:22.214177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292e970-2f38-4519-9a3b-fb36748b44c1 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:22.214759 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292e970-2f38-4519-9a3b-fb36748b44c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:22.215674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292e970-2f38-4519-9a3b-fb36748b44c1 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:22.216650 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292e970-2f38-4519-9a3b-fb36748b44c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:22.219114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292e970-2f38-4519-9a3b-fb36748b44c1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:22.285615 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3009/5986] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:15:22 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:15:22.289867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7842db-8c0b-4a2a-9510-5b0973967ff5 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:22.317773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7842db-8c0b-4a2a-9510-5b0973967ff5 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:22.344859 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9e391-642e-47f1-90fd-f2c95e230184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:22.349377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9e391-642e-47f1-90fd-f2c95e230184 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:22.358534 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9e391-642e-47f1-90fd-f2c95e230184 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:22.360604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9e391-642e-47f1-90fd-f2c95e230184 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:22.363003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9e391-642e-47f1-90fd-f2c95e230184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:22.364939 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9e391-642e-47f1-90fd-f2c95e230184 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:22.386369 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2978/5987] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:15:22.392922 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292e970-2f38-4519-9a3b-fb36748b44c1 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:22.409804 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292e970-2f38-4519-9a3b-fb36748b44c1 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:22.419538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43907f-57aa-4a5c-a599-9999e6e1d758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:22.421568 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43907f-57aa-4a5c-a599-9999e6e1d758 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:22.421568 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43907f-57aa-4a5c-a599-9999e6e1d758 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:22.421568 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43907f-57aa-4a5c-a599-9999e6e1d758 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:22.421568 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43907f-57aa-4a5c-a599-9999e6e1d758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:22.424800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43907f-57aa-4a5c-a599-9999e6e1d758 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:22.449972 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3010/5988] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:15:22.453749 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9e391-642e-47f1-90fd-f2c95e230184 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:22.469884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9e391-642e-47f1-90fd-f2c95e230184 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:22.482533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972831c-bfae-449b-b7f1-bec1782906b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:22.483247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972831c-bfae-449b-b7f1-bec1782906b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:22.483539 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972831c-bfae-449b-b7f1-bec1782906b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:22.483809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972831c-bfae-449b-b7f1-bec1782906b9 admin admin] PATH_INFO: `/v3/projects/4b628709b2234b528d9a9ea0c5ea04e6/users/5db75a2540d74e328aece156e6dda2d7/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:22.539786 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a972831c-bfae-449b-b7f1-bec1782906b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b628709b2234b528d9a9ea0c5ea04e6, user_id=5db75a2540d74e328aece156e6dda2d7, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:22.542718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a972831c-bfae-449b-b7f1-bec1782906b9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:22.588031 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2979/5989] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:15:22 2022] PUT /identity/v3/projects/4b628709b2234b528d9a9ea0c5ea04e6/users/5db75a2540d74e328aece156e6dda2d7/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:15:22.602842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8318146-3a59-4fc9-b464-f7acdd9dac0b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:22.603394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8318146-3a59-4fc9-b464-f7acdd9dac0b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:22.603394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8318146-3a59-4fc9-b464-f7acdd9dac0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:22.687303 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b8318146-3a59-4fc9-b464-f7acdd9dac0b None None] MFA Rules not processed for user `5db75a2540d74e328aece156e6dda2d7`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:15:22.694248 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b8318146-3a59-4fc9-b464-f7acdd9dac0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:22.795517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:22.903878 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3011/5990] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:15:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:15:22.911996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972831c-bfae-449b-b7f1-bec1782906b9 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:22.914068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a972831c-bfae-449b-b7f1-bec1782906b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:22.994601 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:23.009564 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972831c-bfae-449b-b7f1-bec1782906b9 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:23.020530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674a274-59e1-4483-9d56-a0404673259c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:23.021562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674a274-59e1-4483-9d56-a0404673259c service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:23.022247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674a274-59e1-4483-9d56-a0404673259c service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:23.022938 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674a274-59e1-4483-9d56-a0404673259c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:23.036936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674a274-59e1-4483-9d56-a0404673259c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:23.039786 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674a274-59e1-4483-9d56-a0404673259c service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:23.059661 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2980/5991] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:15:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:15:23.087188 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8318146-3a59-4fc9-b464-f7acdd9dac0b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:23.180456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8318146-3a59-4fc9-b464-f7acdd9dac0b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:23.185572 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75d170-eeac-4bc4-9e7f-814e5f098ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:23.186514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75d170-eeac-4bc4-9e7f-814e5f098ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:23.186827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75d170-eeac-4bc4-9e7f-814e5f098ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:23.187244 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75d170-eeac-4bc4-9e7f-814e5f098ab1 admin admin] PATH_INFO: `/v3/users/5db75a2540d74e328aece156e6dda2d7` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:23.188545 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75d170-eeac-4bc4-9e7f-814e5f098ab1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5db75a2540d74e328aece156e6dda2d7)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:23.191411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75d170-eeac-4bc4-9e7f-814e5f098ab1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:23.283873 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2b75d170-eeac-4bc4-9e7f-814e5f098ab1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5db75a2540d74e328aece156e6dda2d7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:23.316256 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2b75d170-eeac-4bc4-9e7f-814e5f098ab1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5db75a2540d74e328aece156e6dda2d7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:23.317332 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2b75d170-eeac-4bc4-9e7f-814e5f098ab1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5db75a2540d74e328aece156e6dda2d7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:23.318362 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2b75d170-eeac-4bc4-9e7f-814e5f098ab1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5db75a2540d74e328aece156e6dda2d7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:23.337018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2b75d170-eeac-4bc4-9e7f-814e5f098ab1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5db75a2540d74e328aece156e6dda2d7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:23.379146 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3012/5992] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:15:23 2022] DELETE /identity/v3/users/5db75a2540d74e328aece156e6dda2d7 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:15:23.383373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6e9d2-92b4-4b25-a614-eb23e63fd13e None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:23.385317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6e9d2-92b4-4b25-a614-eb23e63fd13e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:23.385826 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6e9d2-92b4-4b25-a614-eb23e63fd13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:23.418435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-c7b6e9d2-92b4-4b25-a614-eb23e63fd13e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:15:23.421105 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c7b6e9d2-92b4-4b25-a614-eb23e63fd13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:23.540674 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2981/5993] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:15:23.564796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75d170-eeac-4bc4-9e7f-814e5f098ab1 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:23.568184 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2b75d170-eeac-4bc4-9e7f-814e5f098ab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:23.772933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75d170-eeac-4bc4-9e7f-814e5f098ab1 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:23.779443 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6b089-5c16-4b93-8f70-32edb9cf919b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:23.780072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6b089-5c16-4b93-8f70-32edb9cf919b service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:23.780837 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6b089-5c16-4b93-8f70-32edb9cf919b service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:23.780837 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6b089-5c16-4b93-8f70-32edb9cf919b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:23.800761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:23.812308 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d6b089-5c16-4b93-8f70-32edb9cf919b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:23.817370 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d6b089-5c16-4b93-8f70-32edb9cf919b service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:23.850604 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3013/5994] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:15:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:15:25.147919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6e9d2-92b4-4b25-a614-eb23e63fd13e None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:25.149376 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c7b6e9d2-92b4-4b25-a614-eb23e63fd13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:25.175314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6e9d2-92b4-4b25-a614-eb23e63fd13e None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:25.187666 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16974e61-af83-42bb-9278-630e55ad8939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:25.190895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16974e61-af83-42bb-9278-630e55ad8939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:25.191518 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16974e61-af83-42bb-9278-630e55ad8939 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:25.192002 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16974e61-af83-42bb-9278-630e55ad8939 admin admin] PATH_INFO: `/v3/projects/4b628709b2234b528d9a9ea0c5ea04e6` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:25.201425 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16974e61-af83-42bb-9278-630e55ad8939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b628709b2234b528d9a9ea0c5ea04e6)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:25.207654 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16974e61-af83-42bb-9278-630e55ad8939 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:25.356024 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-16974e61-af83-42bb-9278-630e55ad8939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b628709b2234b528d9a9ea0c5ea04e6', 'request_id': 'req-16974e61-af83-42bb-9278-630e55ad8939'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:25.371964 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-16974e61-af83-42bb-9278-630e55ad8939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b628709b2234b528d9a9ea0c5ea04e6', 'request_id': 'req-16974e61-af83-42bb-9278-630e55ad8939'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:25.390695 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-16974e61-af83-42bb-9278-630e55ad8939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b628709b2234b528d9a9ea0c5ea04e6', 'request_id': 'req-16974e61-af83-42bb-9278-630e55ad8939'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:25.425092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-16974e61-af83-42bb-9278-630e55ad8939 admin admin] The token cache is being invalidate because project 4b628709b2234b528d9a9ea0c5ea04e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:15:25.425387 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-16974e61-af83-42bb-9278-630e55ad8939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:25.426057 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-16974e61-af83-42bb-9278-630e55ad8939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:25.428223 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2982/5995] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:15:25 2022] DELETE /identity/v3/projects/4b628709b2234b528d9a9ea0c5ea04e6 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:15:25.433247 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f90363-a23f-4fb4-ab73-ca456881d199 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:25.434280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f90363-a23f-4fb4-ab73-ca456881d199 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:25.434775 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f90363-a23f-4fb4-ab73-ca456881d199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:25.516744 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-30f90363-a23f-4fb4-ab73-ca456881d199 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:15:25.518996 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-30f90363-a23f-4fb4-ab73-ca456881d199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:25.643354 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3014/5996] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:15:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:15:25.644042 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01860517-c2b6-4f9d-854e-6dff34313bac None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:25.644500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01860517-c2b6-4f9d-854e-6dff34313bac None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:25.644774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01860517-c2b6-4f9d-854e-6dff34313bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:25.695886 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-01860517-c2b6-4f9d-854e-6dff34313bac None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:15:25.697426 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-01860517-c2b6-4f9d-854e-6dff34313bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:25.717242 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2983/5997] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:15:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:15:25.722674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f90363-a23f-4fb4-ab73-ca456881d199 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:25.745414 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f90363-a23f-4fb4-ab73-ca456881d199 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:25.772833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be6419-2cd3-429d-9b08-023b385a0b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:25.775165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be6419-2cd3-429d-9b08-023b385a0b3b admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:25.776132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be6419-2cd3-429d-9b08-023b385a0b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:25.776590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be6419-2cd3-429d-9b08-023b385a0b3b admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:25.777464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be6419-2cd3-429d-9b08-023b385a0b3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:15:25.777934 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be6419-2cd3-429d-9b08-023b385a0b3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:25.779746 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be6419-2cd3-429d-9b08-023b385a0b3b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:25.810435 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3015/5998] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:15:25.814127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01860517-c2b6-4f9d-854e-6dff34313bac None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:25.836444 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01860517-c2b6-4f9d-854e-6dff34313bac None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:25.849862 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a98edf-26b8-4c56-8e7b-17cac3ee9057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:25.851510 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a98edf-26b8-4c56-8e7b-17cac3ee9057 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:25.853411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a98edf-26b8-4c56-8e7b-17cac3ee9057 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:25.853693 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a98edf-26b8-4c56-8e7b-17cac3ee9057 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:25.854357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a98edf-26b8-4c56-8e7b-17cac3ee9057 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:25.856332 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a98edf-26b8-4c56-8e7b-17cac3ee9057 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:25.927606 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2984/5999] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:15:25 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:15:25.931485 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be6419-2cd3-429d-9b08-023b385a0b3b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:25.945883 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be6419-2cd3-429d-9b08-023b385a0b3b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:26.083154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71097b-a601-41d9-b9c3-2797cf3995c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:26.083781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71097b-a601-41d9-b9c3-2797cf3995c9 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:26.084089 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71097b-a601-41d9-b9c3-2797cf3995c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:26.084363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71097b-a601-41d9-b9c3-2797cf3995c9 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:26.085001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71097b-a601-41d9-b9c3-2797cf3995c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:26.086924 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71097b-a601-41d9-b9c3-2797cf3995c9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:26.175589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a98edf-26b8-4c56-8e7b-17cac3ee9057 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:26.176888 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3016/6000] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:15:25 2022] POST /identity/v3/users => generated 286 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:15:26.201130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a98edf-26b8-4c56-8e7b-17cac3ee9057 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:26.238486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4688ef5-592c-4886-98c0-44f240d82c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:26.239403 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4688ef5-592c-4886-98c0-44f240d82c8f admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:26.239878 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4688ef5-592c-4886-98c0-44f240d82c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:26.240304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4688ef5-592c-4886-98c0-44f240d82c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:26.241100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4688ef5-592c-4886-98c0-44f240d82c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:26.243005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4688ef5-592c-4886-98c0-44f240d82c8f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:26.286658 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2985/6001] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:15:26.288633 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71097b-a601-41d9-b9c3-2797cf3995c9 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:26.305421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71097b-a601-41d9-b9c3-2797cf3995c9 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:26.319327 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d0751-60c1-4d34-959d-c0316db9aab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:26.320259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d0751-60c1-4d34-959d-c0316db9aab2 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:26.320690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d0751-60c1-4d34-959d-c0316db9aab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:26.321142 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d0751-60c1-4d34-959d-c0316db9aab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:26.321952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d0751-60c1-4d34-959d-c0316db9aab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:26.323747 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d0751-60c1-4d34-959d-c0316db9aab2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:26.350688 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3017/6002] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:15:26.351524 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4688ef5-592c-4886-98c0-44f240d82c8f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:26.374300 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4688ef5-592c-4886-98c0-44f240d82c8f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:26.399524 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56e572-0040-4291-829d-4de97f892039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:26.400389 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56e572-0040-4291-829d-4de97f892039 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:26.405731 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56e572-0040-4291-829d-4de97f892039 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:26.406183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56e572-0040-4291-829d-4de97f892039 admin admin] PATH_INFO: `/v3/projects/15407d6e47c34f588e162af6a190fd99/users/c9a290f680dc4b5bbec2010d82ed7e27/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:26.449200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56e572-0040-4291-829d-4de97f892039 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15407d6e47c34f588e162af6a190fd99, user_id=c9a290f680dc4b5bbec2010d82ed7e27, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:26.474031 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56e572-0040-4291-829d-4de97f892039 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:26.540844 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2986/6003] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:15:26 2022] PUT /identity/v3/projects/15407d6e47c34f588e162af6a190fd99/users/c9a290f680dc4b5bbec2010d82ed7e27/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:15:26.545796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da93d4a-70a6-4dde-a5c0-3c2d72675cd0 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:26.547886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da93d4a-70a6-4dde-a5c0-3c2d72675cd0 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:26.547886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da93d4a-70a6-4dde-a5c0-3c2d72675cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:26.597746 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-9da93d4a-70a6-4dde-a5c0-3c2d72675cd0 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:15:26.598648 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9da93d4a-70a6-4dde-a5c0-3c2d72675cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:26.734164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:26.759950 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3018/6004] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:15:27.015008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56e572-0040-4291-829d-4de97f892039 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:27.016806 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0c56e572-0040-4291-829d-4de97f892039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:27.049964 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:27.149354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56e572-0040-4291-829d-4de97f892039 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:27.159892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f1b02-6849-4f2e-8de8-a3840c1dc24b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:27.160539 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f1b02-6849-4f2e-8de8-a3840c1dc24b service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:27.160821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f1b02-6849-4f2e-8de8-a3840c1dc24b service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:27.161095 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f1b02-6849-4f2e-8de8-a3840c1dc24b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:27.179685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f1b02-6849-4f2e-8de8-a3840c1dc24b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:27.181276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f1b02-6849-4f2e-8de8-a3840c1dc24b service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:27.208555 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2987/6005] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:15:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:15:28.841113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e6c2b-1ea7-4a30-8ec9-0f34d4148946 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:28.842180 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e6c2b-1ea7-4a30-8ec9-0f34d4148946 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:28.842949 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e6c2b-1ea7-4a30-8ec9-0f34d4148946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:28.951125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-416e6c2b-1ea7-4a30-8ec9-0f34d4148946 None None] MFA Rules not processed for user `6beda876a6f747c49c17fe686df1fbcc`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:15:28.953018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-416e6c2b-1ea7-4a30-8ec9-0f34d4148946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:29.161265 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3019/6006] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:15:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:15:29.166866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f1b02-6849-4f2e-8de8-a3840c1dc24b service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:29.168727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-417f1b02-6849-4f2e-8de8-a3840c1dc24b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:29.213800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f1b02-6849-4f2e-8de8-a3840c1dc24b service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:29.239972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863f19d-e70a-442b-a0bc-fd683af46c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:29.240929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863f19d-e70a-442b-a0bc-fd683af46c36 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:29.241398 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863f19d-e70a-442b-a0bc-fd683af46c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:29.241897 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863f19d-e70a-442b-a0bc-fd683af46c36 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:29.243763 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7863f19d-e70a-442b-a0bc-fd683af46c36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:29.248015 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7863f19d-e70a-442b-a0bc-fd683af46c36 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:29.279592 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2988/6007] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:15:29 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:15:29.287160 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e6c2b-1ea7-4a30-8ec9-0f34d4148946 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:29.305767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e6c2b-1ea7-4a30-8ec9-0f34d4148946 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:29.311449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17dbb92-5425-4d90-b9d5-3274c3a9e137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:29.312461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17dbb92-5425-4d90-b9d5-3274c3a9e137 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:29.312975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17dbb92-5425-4d90-b9d5-3274c3a9e137 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:29.314095 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17dbb92-5425-4d90-b9d5-3274c3a9e137 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:29.315663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17dbb92-5425-4d90-b9d5-3274c3a9e137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:29.317545 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17dbb92-5425-4d90-b9d5-3274c3a9e137 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:29.334890 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3020/6008] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:15:29.339213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863f19d-e70a-442b-a0bc-fd683af46c36 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:29.352753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863f19d-e70a-442b-a0bc-fd683af46c36 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:29.359397 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe9a39-cfe0-4b66-8dd3-4885077b2346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:29.360413 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe9a39-cfe0-4b66-8dd3-4885077b2346 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:29.360803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe9a39-cfe0-4b66-8dd3-4885077b2346 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:29.361420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe9a39-cfe0-4b66-8dd3-4885077b2346 admin admin] PATH_INFO: `/v3/system/users/0bd618910ba54fc18a0ff7f32bb362a6/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:29.382098 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe9a39-cfe0-4b66-8dd3-4885077b2346 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0bd618910ba54fc18a0ff7f32bb362a6, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:29.383965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe9a39-cfe0-4b66-8dd3-4885077b2346 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:29.396691 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2989/6009] 10.222.0.33 () {60 vars in 1378 bytes} [Sat Aug 6 21:15:29 2022] PUT /identity/v3/system/users/0bd618910ba54fc18a0ff7f32bb362a6/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:15:29.419969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836c080-45f8-4a3a-9bd1-c8302aff040c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:29.420160 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836c080-45f8-4a3a-9bd1-c8302aff040c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:29.421255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836c080-45f8-4a3a-9bd1-c8302aff040c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:29.492517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-7836c080-45f8-4a3a-9bd1-c8302aff040c None None] MFA Rules not processed for user `0bd618910ba54fc18a0ff7f32bb362a6`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:15:29.493890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7836c080-45f8-4a3a-9bd1-c8302aff040c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:29.716685 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3021/6010] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:15:29 2022] POST /identity/v3/auth/tokens => generated 2414 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 21:15:29.718018 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe9a39-cfe0-4b66-8dd3-4885077b2346 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:29.949548 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe9a39-cfe0-4b66-8dd3-4885077b2346 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:29.999638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:30.025066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b636fa-1539-4b4b-96b7-f03ee5a3d77e None tempest-ImageQuotaTest-194779760-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd618910ba54fc18a0ff7f32bb362a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:30.025688 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b636fa-1539-4b4b-96b7-f03ee5a3d77e None tempest-ImageQuotaTest-194779760-system-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:30.025972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b636fa-1539-4b4b-96b7-f03ee5a3d77e None tempest-ImageQuotaTest-194779760-system-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:30.026250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b636fa-1539-4b4b-96b7-f03ee5a3d77e None tempest-ImageQuotaTest-194779760-system-admin] PATH_INFO: `/v3/services` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:30.026893 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b636fa-1539-4b4b-96b7-f03ee5a3d77e None tempest-ImageQuotaTest-194779760-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:30.028269 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b636fa-1539-4b4b-96b7-f03ee5a3d77e None tempest-ImageQuotaTest-194779760-system-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:30.049670 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2990/6011] 10.222.0.33 () {58 vars in 1110 bytes} [Sat Aug 6 21:15:29 2022] GET /identity/v3/services => generated 2191 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:15:30.050991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836c080-45f8-4a3a-9bd1-c8302aff040c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:30.170703 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:30.310058 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836c080-45f8-4a3a-9bd1-c8302aff040c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:30.399096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072bd076-f60b-40ad-81c0-b4725e0d6a0b None tempest-ImageQuotaTest-194779760-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd618910ba54fc18a0ff7f32bb362a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:30.399724 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bd076-f60b-40ad-81c0-b4725e0d6a0b None tempest-ImageQuotaTest-194779760-system-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:30.400014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bd076-f60b-40ad-81c0-b4725e0d6a0b None tempest-ImageQuotaTest-194779760-system-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:30.400290 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bd076-f60b-40ad-81c0-b4725e0d6a0b None tempest-ImageQuotaTest-194779760-system-admin] PATH_INFO: `/v3/limits` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:30.401045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072bd076-f60b-40ad-81c0-b4725e0d6a0b None tempest-ImageQuotaTest-194779760-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:30.402344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072bd076-f60b-40ad-81c0-b4725e0d6a0b None tempest-ImageQuotaTest-194779760-system-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:30.520923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-072bd076-f60b-40ad-81c0-b4725e0d6a0b None tempest-ImageQuotaTest-194779760-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Aug 06 21:15:30.520923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:15:30.520923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:15:30.520923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:15:30.520923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:15:30.520923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:15:30.520923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:15:30.520923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:15:30.520923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:15:30.520923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:15:30.520923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:15:30.520923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:15:30.520923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Aug 06 21:15:30.520923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Aug 06 21:15:30.521923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:15:30.521923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:15:30.521923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Aug 06 21:15:30.521923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Aug 06 21:15:30.521923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 06 21:15:30.521923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 06 21:15:30.521923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Aug 06 21:15:30.521923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Aug 06 21:15:30.521923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Aug 06 21:15:30.521923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.NoLimitReference Aug 06 21:15:30.521923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Aug 06 21:15:30.521923 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:15:30.524544 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3022/6012] 10.222.0.33 () {60 vars in 1126 bytes} [Sat Aug 6 21:15:30 2022] POST /identity/v3/limits => generated 124 bytes in 474 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:15:30.528421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b618eb-cf8d-4db6-9cc3-7adf14c71f2d None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:30.528963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b618eb-cf8d-4db6-9cc3-7adf14c71f2d None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:30.529214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b618eb-cf8d-4db6-9cc3-7adf14c71f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:30.530220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072bd076-f60b-40ad-81c0-b4725e0d6a0b None tempest-ImageQuotaTest-194779760-system-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:30.585387 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-28b618eb-cf8d-4db6-9cc3-7adf14c71f2d None None] MFA Rules not processed for user `c9a290f680dc4b5bbec2010d82ed7e27`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:15:30.586991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-28b618eb-cf8d-4db6-9cc3-7adf14c71f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:30.712315 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2991/6013] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:15:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:15:30.724228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b618eb-cf8d-4db6-9cc3-7adf14c71f2d None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:30.726892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-28b618eb-cf8d-4db6-9cc3-7adf14c71f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:30.808907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072bd076-f60b-40ad-81c0-b4725e0d6a0b None tempest-ImageQuotaTest-194779760-system-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:30.811060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:30.890043 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca81f7-8663-44aa-962c-52d18546e689 None tempest-ImageQuotaTest-194779760-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd618910ba54fc18a0ff7f32bb362a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:30.891464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca81f7-8663-44aa-962c-52d18546e689 None tempest-ImageQuotaTest-194779760-system-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:30.892300 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b618eb-cf8d-4db6-9cc3-7adf14c71f2d None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:30.892538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca81f7-8663-44aa-962c-52d18546e689 None tempest-ImageQuotaTest-194779760-system-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:30.892919 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca81f7-8663-44aa-962c-52d18546e689 None tempest-ImageQuotaTest-194779760-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:30.893718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca81f7-8663-44aa-962c-52d18546e689 None tempest-ImageQuotaTest-194779760-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:30.894975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca81f7-8663-44aa-962c-52d18546e689 None tempest-ImageQuotaTest-194779760-system-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:30.906352 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3023/6014] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Aug 6 21:15:30 2022] GET /identity/v3/registered_limits => generated 129 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:15:30.908265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca81f7-8663-44aa-962c-52d18546e689 None tempest-ImageQuotaTest-194779760-system-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:30.908402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16469ce0-6728-4348-a6b0-3658bd8be9b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:30.909001 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16469ce0-6728-4348-a6b0-3658bd8be9b1 service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:30.909286 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16469ce0-6728-4348-a6b0-3658bd8be9b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:30.909561 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16469ce0-6728-4348-a6b0-3658bd8be9b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:30.928610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16469ce0-6728-4348-a6b0-3658bd8be9b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:30.930726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16469ce0-6728-4348-a6b0-3658bd8be9b1 service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:30.955742 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2992/6015] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:15:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:15:31.078113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca81f7-8663-44aa-962c-52d18546e689 None tempest-ImageQuotaTest-194779760-system-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:31.144486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e3321-5651-4538-a67f-d24c47dffb55 None tempest-ImageQuotaTest-194779760-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bd618910ba54fc18a0ff7f32bb362a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:31.145699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e3321-5651-4538-a67f-d24c47dffb55 None tempest-ImageQuotaTest-194779760-system-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:31.146281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e3321-5651-4538-a67f-d24c47dffb55 None tempest-ImageQuotaTest-194779760-system-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:31.146791 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e3321-5651-4538-a67f-d24c47dffb55 None tempest-ImageQuotaTest-194779760-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:31.148001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e3321-5651-4538-a67f-d24c47dffb55 None tempest-ImageQuotaTest-194779760-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:31.149328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e3321-5651-4538-a67f-d24c47dffb55 None tempest-ImageQuotaTest-194779760-system-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:31.155757 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3024/6016] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Aug 6 21:15:30 2022] GET /identity/v3/registered_limits => generated 129 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:15:32.949682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09503907-10ad-4b16-8d4c-cc9fa14c2d63 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:32.950237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09503907-10ad-4b16-8d4c-cc9fa14c2d63 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:32.950523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09503907-10ad-4b16-8d4c-cc9fa14c2d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:33.070328 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-09503907-10ad-4b16-8d4c-cc9fa14c2d63 None None] MFA Rules not processed for user `c9a290f680dc4b5bbec2010d82ed7e27`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:15:33.076843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-09503907-10ad-4b16-8d4c-cc9fa14c2d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:33.103925 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2993/6017] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:15:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:15:34.061525 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e3321-5651-4538-a67f-d24c47dffb55 None tempest-ImageQuotaTest-194779760-system-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:34.099194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e3321-5651-4538-a67f-d24c47dffb55 None tempest-ImageQuotaTest-194779760-system-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:34.112520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12858dc4-b737-4e1d-acd6-e21323a7a8f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:34.115055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12858dc4-b737-4e1d-acd6-e21323a7a8f9 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:34.117239 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12858dc4-b737-4e1d-acd6-e21323a7a8f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:34.118033 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12858dc4-b737-4e1d-acd6-e21323a7a8f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:34.120215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-12858dc4-b737-4e1d-acd6-e21323a7a8f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:34.158112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12858dc4-b737-4e1d-acd6-e21323a7a8f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:34.159967 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12858dc4-b737-4e1d-acd6-e21323a7a8f9 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:34.187996 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3025/6018] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:15:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:15:34.936040 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de07454-d5c2-4421-923d-3aab423f03aa None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:34.937326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de07454-d5c2-4421-923d-3aab423f03aa None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:34.937777 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de07454-d5c2-4421-923d-3aab423f03aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:34.997832 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-6de07454-d5c2-4421-923d-3aab423f03aa None None] MFA Rules not processed for user `3597dc51e1ae4d80a4bd648fcf3e31bc`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:15:34.999112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6de07454-d5c2-4421-923d-3aab423f03aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:35.137233 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2994/6019] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:15:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:15:36.718919 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12858dc4-b737-4e1d-acd6-e21323a7a8f9 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:36.720501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-12858dc4-b737-4e1d-acd6-e21323a7a8f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:36.748392 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:36.798679 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12858dc4-b737-4e1d-acd6-e21323a7a8f9 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:36.802515 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab898c5-fdfa-4099-8553-02a9a094852a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10759b2abd4cafacf338551327775e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:36.803162 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab898c5-fdfa-4099-8553-02a9a094852a service glance] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:36.803439 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab898c5-fdfa-4099-8553-02a9a094852a service glance] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:36.803709 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab898c5-fdfa-4099-8553-02a9a094852a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:36.806625 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1ab898c5-fdfa-4099-8553-02a9a094852a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:36.999084 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab898c5-fdfa-4099-8553-02a9a094852a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:37.000919 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab898c5-fdfa-4099-8553-02a9a094852a service glance] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:37.038398 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3026/6020] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:15:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:15:37.232366 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de07454-d5c2-4421-923d-3aab423f03aa None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:37.250269 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de07454-d5c2-4421-923d-3aab423f03aa None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:37.256010 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2573d7f-af55-4438-a03f-6a7a2bb4415e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:37.259189 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2573d7f-af55-4438-a03f-6a7a2bb4415e service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:37.259707 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2573d7f-af55-4438-a03f-6a7a2bb4415e service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:37.260156 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2573d7f-af55-4438-a03f-6a7a2bb4415e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:37.268261 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e2573d7f-af55-4438-a03f-6a7a2bb4415e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:37.298908 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2573d7f-af55-4438-a03f-6a7a2bb4415e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:37.301813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2573d7f-af55-4438-a03f-6a7a2bb4415e service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:37.314813 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6ddd8-dddc-4111-b60b-37f4f13ffee5 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:37.315428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6ddd8-dddc-4111-b60b-37f4f13ffee5 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:37.315941 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6ddd8-dddc-4111-b60b-37f4f13ffee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:37.322617 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2995/6021] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:15:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:15:37.345416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-60a6ddd8-dddc-4111-b60b-37f4f13ffee5 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:15:37.346844 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-60a6ddd8-dddc-4111-b60b-37f4f13ffee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:37.443579 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3027/6022] 10.222.0.33 () {58 vars in 967 bytes} [Sat Aug 6 21:15:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:15:37.467864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2573d7f-af55-4438-a03f-6a7a2bb4415e service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:37.469666 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e2573d7f-af55-4438-a03f-6a7a2bb4415e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:37.482479 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:37.633061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a6ddd8-dddc-4111-b60b-37f4f13ffee5 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:37.634256 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-60a6ddd8-dddc-4111-b60b-37f4f13ffee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:37.653277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a6ddd8-dddc-4111-b60b-37f4f13ffee5 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:37.661665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919dc39b-db51-4ee2-9103-5e82507327f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:37.663378 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919dc39b-db51-4ee2-9103-5e82507327f4 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:37.663839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919dc39b-db51-4ee2-9103-5e82507327f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:37.664823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919dc39b-db51-4ee2-9103-5e82507327f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:37.674487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2573d7f-af55-4438-a03f-6a7a2bb4415e service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:37.677924 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-919dc39b-db51-4ee2-9103-5e82507327f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:37.690413 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54deb2a2-3bb9-4222-8131-6623b762a4f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:37.691122 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54deb2a2-3bb9-4222-8131-6623b762a4f8 service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:37.691345 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54deb2a2-3bb9-4222-8131-6623b762a4f8 service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:37.691626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54deb2a2-3bb9-4222-8131-6623b762a4f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:37.729161 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54deb2a2-3bb9-4222-8131-6623b762a4f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:37.731326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54deb2a2-3bb9-4222-8131-6623b762a4f8 service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:37.756576 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919dc39b-db51-4ee2-9103-5e82507327f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:37.766047 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919dc39b-db51-4ee2-9103-5e82507327f4 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:37.777144 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2996/6023] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:15:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:15:37.840932 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3028/6024] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:15:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:15:39.400032 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3efd2c-d82c-4d42-85a1-ca2488c993ed None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:39.400904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3efd2c-d82c-4d42-85a1-ca2488c993ed None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:39.401773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3efd2c-d82c-4d42-85a1-ca2488c993ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:39.433159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-ce3efd2c-d82c-4d42-85a1-ca2488c993ed None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:15:39.439334 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ce3efd2c-d82c-4d42-85a1-ca2488c993ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:39.461620 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2997/6025] 10.222.0.33 () {58 vars in 967 bytes} [Sat Aug 6 21:15:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:15:39.476740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919dc39b-db51-4ee2-9103-5e82507327f4 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:39.503370 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919dc39b-db51-4ee2-9103-5e82507327f4 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:39.524693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5af60-8bbc-4651-b2bb-83776b51f648 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:39.527364 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5af60-8bbc-4651-b2bb-83776b51f648 service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:39.527870 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5af60-8bbc-4651-b2bb-83776b51f648 service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:39.529401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5af60-8bbc-4651-b2bb-83776b51f648 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:39.571694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a5af60-8bbc-4651-b2bb-83776b51f648 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:39.575549 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a5af60-8bbc-4651-b2bb-83776b51f648 service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:39.599001 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3029/6026] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:15:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:15:40.213653 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f3c64-c976-4011-8b38-6612a624a3ac None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:40.213936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f3c64-c976-4011-8b38-6612a624a3ac None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:40.214213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f3c64-c976-4011-8b38-6612a624a3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:40.243563 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-312f3c64-c976-4011-8b38-6612a624a3ac None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:15:40.245131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-312f3c64-c976-4011-8b38-6612a624a3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:40.258187 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2998/6027] 10.222.0.33 () {58 vars in 967 bytes} [Sat Aug 6 21:15:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:15:40.279009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5af60-8bbc-4651-b2bb-83776b51f648 service swift] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:40.292425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5af60-8bbc-4651-b2bb-83776b51f648 service swift] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:40.299756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4077f7-dd80-46d9-82bc-e0ae7389ec2d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:40.300620 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4077f7-dd80-46d9-82bc-e0ae7389ec2d service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:40.301348 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4077f7-dd80-46d9-82bc-e0ae7389ec2d service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:40.301761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4077f7-dd80-46d9-82bc-e0ae7389ec2d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:40.313148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4077f7-dd80-46d9-82bc-e0ae7389ec2d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:40.314977 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4077f7-dd80-46d9-82bc-e0ae7389ec2d service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:40.323803 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3030/6028] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:15:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:15:41.328182 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f3c64-c976-4011-8b38-6612a624a3ac None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:41.353048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f3c64-c976-4011-8b38-6612a624a3ac None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:41.360601 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0ba5a-dda5-4cb7-8598-80abaaac5a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:41.361304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0ba5a-dda5-4cb7-8598-80abaaac5a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:41.361583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0ba5a-dda5-4cb7-8598-80abaaac5a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:41.361853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0ba5a-dda5-4cb7-8598-80abaaac5a50 admin admin] PATH_INFO: `/v3/users/6beda876a6f747c49c17fe686df1fbcc` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:41.363076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0ba5a-dda5-4cb7-8598-80abaaac5a50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6beda876a6f747c49c17fe686df1fbcc)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:41.365196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0ba5a-dda5-4cb7-8598-80abaaac5a50 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:41.436088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-01b0ba5a-dda5-4cb7-8598-80abaaac5a50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6beda876a6f747c49c17fe686df1fbcc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:41.438837 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-01b0ba5a-dda5-4cb7-8598-80abaaac5a50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6beda876a6f747c49c17fe686df1fbcc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:41.441816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-01b0ba5a-dda5-4cb7-8598-80abaaac5a50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6beda876a6f747c49c17fe686df1fbcc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:41.455904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-01b0ba5a-dda5-4cb7-8598-80abaaac5a50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6beda876a6f747c49c17fe686df1fbcc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:41.490002 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-01b0ba5a-dda5-4cb7-8598-80abaaac5a50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6beda876a6f747c49c17fe686df1fbcc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:41.506788 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 2999/6029] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:15:41 2022] DELETE /identity/v3/users/6beda876a6f747c49c17fe686df1fbcc => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:15:42.827960 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4077f7-dd80-46d9-82bc-e0ae7389ec2d service swift] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:42.844471 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4077f7-dd80-46d9-82bc-e0ae7389ec2d service swift] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:42.890031 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:42.929934 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3f989-e5c5-4423-92a8-28b0579f99d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:42.930594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3f989-e5c5-4423-92a8-28b0579f99d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:42.930875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3f989-e5c5-4423-92a8-28b0579f99d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:42.931358 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3f989-e5c5-4423-92a8-28b0579f99d0 admin admin] PATH_INFO: `/v3/projects/2751afd62cb8451b87ffbf09df0d40f9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:42.932483 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb3f989-e5c5-4423-92a8-28b0579f99d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2751afd62cb8451b87ffbf09df0d40f9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:42.934389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb3f989-e5c5-4423-92a8-28b0579f99d0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:43.021946 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2bb3f989-e5c5-4423-92a8-28b0579f99d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2751afd62cb8451b87ffbf09df0d40f9', 'request_id': 'req-2bb3f989-e5c5-4423-92a8-28b0579f99d0'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:43.028553 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2bb3f989-e5c5-4423-92a8-28b0579f99d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2751afd62cb8451b87ffbf09df0d40f9', 'request_id': 'req-2bb3f989-e5c5-4423-92a8-28b0579f99d0'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:43.043348 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2bb3f989-e5c5-4423-92a8-28b0579f99d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2751afd62cb8451b87ffbf09df0d40f9', 'request_id': 'req-2bb3f989-e5c5-4423-92a8-28b0579f99d0'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:43.063480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2bb3f989-e5c5-4423-92a8-28b0579f99d0 admin admin] The token cache is being invalidate because project 2751afd62cb8451b87ffbf09df0d40f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:15:43.064311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2bb3f989-e5c5-4423-92a8-28b0579f99d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:43.065215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2bb3f989-e5c5-4423-92a8-28b0579f99d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:43.076747 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3031/6030] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:15:42 2022] DELETE /identity/v3/projects/2751afd62cb8451b87ffbf09df0d40f9 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:15:43.080536 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0ba5a-dda5-4cb7-8598-80abaaac5a50 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:43.082675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-01b0ba5a-dda5-4cb7-8598-80abaaac5a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:43.108477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0ba5a-dda5-4cb7-8598-80abaaac5a50 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:43.210151 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:43.230307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46aa9a-5503-45af-b873-b9c6b343cec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:43.257854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46aa9a-5503-45af-b873-b9c6b343cec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:43.258240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46aa9a-5503-45af-b873-b9c6b343cec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:43.258524 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46aa9a-5503-45af-b873-b9c6b343cec4 admin admin] PATH_INFO: `/v3/users/0bd618910ba54fc18a0ff7f32bb362a6` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:43.265790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46aa9a-5503-45af-b873-b9c6b343cec4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bd618910ba54fc18a0ff7f32bb362a6)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:43.268877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46aa9a-5503-45af-b873-b9c6b343cec4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:43.369810 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8a46aa9a-5503-45af-b873-b9c6b343cec4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bd618910ba54fc18a0ff7f32bb362a6'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:43.370760 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8a46aa9a-5503-45af-b873-b9c6b343cec4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bd618910ba54fc18a0ff7f32bb362a6'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:43.371441 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8a46aa9a-5503-45af-b873-b9c6b343cec4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bd618910ba54fc18a0ff7f32bb362a6'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:43.383911 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8a46aa9a-5503-45af-b873-b9c6b343cec4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bd618910ba54fc18a0ff7f32bb362a6'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:43.405572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8a46aa9a-5503-45af-b873-b9c6b343cec4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bd618910ba54fc18a0ff7f32bb362a6'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:43.451838 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3000/6031] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:15:43 2022] DELETE /identity/v3/users/0bd618910ba54fc18a0ff7f32bb362a6 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:15:44.790770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df76b0-78f9-41b0-a898-359e1449a272 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:44.791666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df76b0-78f9-41b0-a898-359e1449a272 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:44.792673 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df76b0-78f9-41b0-a898-359e1449a272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:44.816916 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-25df76b0-78f9-41b0-a898-359e1449a272 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:15:44.818242 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-25df76b0-78f9-41b0-a898-359e1449a272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:44.894962 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3032/6032] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:15:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:15:44.907678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46aa9a-5503-45af-b873-b9c6b343cec4 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:44.912164 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8a46aa9a-5503-45af-b873-b9c6b343cec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:45.106275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46aa9a-5503-45af-b873-b9c6b343cec4 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:45.112742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c3f2fb-ac3f-4662-9743-377aa5ca27d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:45.113440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3f2fb-ac3f-4662-9743-377aa5ca27d9 service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:45.113723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3f2fb-ac3f-4662-9743-377aa5ca27d9 service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:45.113997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3f2fb-ac3f-4662-9743-377aa5ca27d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:45.126795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c3f2fb-ac3f-4662-9743-377aa5ca27d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:45.129205 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c3f2fb-ac3f-4662-9743-377aa5ca27d9 service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:45.142688 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3001/6033] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:15:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:15:45.577279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df76b0-78f9-41b0-a898-359e1449a272 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:45.579695 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-25df76b0-78f9-41b0-a898-359e1449a272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:45.811730 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df76b0-78f9-41b0-a898-359e1449a272 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:45.821629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218aaae1-3335-4d8d-a059-04473cce1c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:45.823096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218aaae1-3335-4d8d-a059-04473cce1c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:45.823788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218aaae1-3335-4d8d-a059-04473cce1c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:45.824440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218aaae1-3335-4d8d-a059-04473cce1c9e admin admin] PATH_INFO: `/v3/projects/None` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:45.831954 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:45.857389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218aaae1-3335-4d8d-a059-04473cce1c9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=None)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:45.866070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218aaae1-3335-4d8d-a059-04473cce1c9e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:45.893431 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-218aaae1-3335-4d8d-a059-04473cce1c9e admin admin] Could not find project: None.: keystone.exception.ProjectNotFound: Could not find project: None. Aug 06 21:15:45.893431 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:15:45.893431 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:15:45.893431 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:15:45.893431 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:15:45.893431 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:15:45.893431 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:15:45.893431 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:15:45.893431 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:15:45.893431 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:15:45.893431 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:15:45.893431 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:15:45.893431 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Aug 06 21:15:45.893431 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Aug 06 21:15:45.893431 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:15:45.893431 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:15:45.895553 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Aug 06 21:15:45.895553 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Aug 06 21:15:45.895553 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 21:15:45.895553 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 21:15:45.895553 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 21:15:45.895553 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 21:15:45.895553 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: None. Aug 06 21:15:45.895553 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:15:45.898688 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3033/6034] 10.222.0.33 () {58 vars in 1149 bytes} [Sat Aug 6 21:15:45 2022] DELETE /identity/v3/projects/None => generated 85 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 21:15:51.633572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efb91a-3c9b-4869-b575-7a524d363895 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:51.634195 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efb91a-3c9b-4869-b575-7a524d363895 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:51.634391 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efb91a-3c9b-4869-b575-7a524d363895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:51.662484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-41efb91a-3c9b-4869-b575-7a524d363895 None None] MFA Rules not processed for user `9b8463a42f2642aaba586380391de6fd`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:15:51.663708 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-41efb91a-3c9b-4869-b575-7a524d363895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:51.738984 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:51.759602 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3002/6035] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:15:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:15:53.373307 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218aaae1-3335-4d8d-a059-04473cce1c9e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:53.377509 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-218aaae1-3335-4d8d-a059-04473cce1c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:53.571320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218aaae1-3335-4d8d-a059-04473cce1c9e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:53.578105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef0cba-86ff-449e-bc6d-9d6631afbe1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:53.578803 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef0cba-86ff-449e-bc6d-9d6631afbe1f service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:53.579065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef0cba-86ff-449e-bc6d-9d6631afbe1f service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:53.579339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef0cba-86ff-449e-bc6d-9d6631afbe1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:53.581261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3eef0cba-86ff-449e-bc6d-9d6631afbe1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:53.728570 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef0cba-86ff-449e-bc6d-9d6631afbe1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:53.734593 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef0cba-86ff-449e-bc6d-9d6631afbe1f service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:53.760875 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3034/6036] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:15:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:15:58.622089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efb91a-3c9b-4869-b575-7a524d363895 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:58.623580 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-41efb91a-3c9b-4869-b575-7a524d363895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:58.647723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efb91a-3c9b-4869-b575-7a524d363895 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:58.684179 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb475d3-3ac0-4666-9c8e-9fd365a86d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:58.685000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb475d3-3ac0-4666-9c8e-9fd365a86d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:58.685485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb475d3-3ac0-4666-9c8e-9fd365a86d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:58.685979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb475d3-3ac0-4666-9c8e-9fd365a86d01 admin admin] PATH_INFO: `/v3/users/b87adf6e088f444ba48deda976bfa497` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:58.688432 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb475d3-3ac0-4666-9c8e-9fd365a86d01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b87adf6e088f444ba48deda976bfa497)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:58.692312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb475d3-3ac0-4666-9c8e-9fd365a86d01 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:58.808058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bfb475d3-3ac0-4666-9c8e-9fd365a86d01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b87adf6e088f444ba48deda976bfa497'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:58.808683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bfb475d3-3ac0-4666-9c8e-9fd365a86d01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b87adf6e088f444ba48deda976bfa497'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:58.809503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bfb475d3-3ac0-4666-9c8e-9fd365a86d01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b87adf6e088f444ba48deda976bfa497'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:58.823181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bfb475d3-3ac0-4666-9c8e-9fd365a86d01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b87adf6e088f444ba48deda976bfa497'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:58.841775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bfb475d3-3ac0-4666-9c8e-9fd365a86d01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b87adf6e088f444ba48deda976bfa497'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:58.855588 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3003/6037] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:15:58 2022] DELETE /identity/v3/users/b87adf6e088f444ba48deda976bfa497 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:15:58.863182 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4cfb1-e0e3-4771-8d78-f689e47d6ec7 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:58.864260 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4cfb1-e0e3-4771-8d78-f689e47d6ec7 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:58.864689 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4cfb1-e0e3-4771-8d78-f689e47d6ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:58.884497 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b9b4cfb1-e0e3-4771-8d78-f689e47d6ec7 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:15:58.885733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b9b4cfb1-e0e3-4771-8d78-f689e47d6ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:58.973526 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3035/6038] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:15:58.984303 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb475d3-3ac0-4666-9c8e-9fd365a86d01 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:58.986014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-bfb475d3-3ac0-4666-9c8e-9fd365a86d01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:59.098927 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb475d3-3ac0-4666-9c8e-9fd365a86d01 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:59.109617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff241e-bb8d-4649-8db6-ed5bf689d9de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:59.110248 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff241e-bb8d-4649-8db6-ed5bf689d9de service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:59.110571 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff241e-bb8d-4649-8db6-ed5bf689d9de service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:59.110853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff241e-bb8d-4649-8db6-ed5bf689d9de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:59.135520 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff241e-bb8d-4649-8db6-ed5bf689d9de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:59.137319 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff241e-bb8d-4649-8db6-ed5bf689d9de service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:59.161712 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3004/6039] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:15:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:15:59.633790 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4cfb1-e0e3-4771-8d78-f689e47d6ec7 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:59.635666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b9b4cfb1-e0e3-4771-8d78-f689e47d6ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:15:59.664827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4cfb1-e0e3-4771-8d78-f689e47d6ec7 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:59.672229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5abe13-4b2c-4710-bad8-12eb5ecc65e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:59.673781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5abe13-4b2c-4710-bad8-12eb5ecc65e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:59.674930 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5abe13-4b2c-4710-bad8-12eb5ecc65e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:59.675413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5abe13-4b2c-4710-bad8-12eb5ecc65e8 admin admin] PATH_INFO: `/v3/projects/a3646bb4452046c6abcd8a2f2972bd5b` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:59.677882 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5abe13-4b2c-4710-bad8-12eb5ecc65e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3646bb4452046c6abcd8a2f2972bd5b)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:59.691654 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5abe13-4b2c-4710-bad8-12eb5ecc65e8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:59.733548 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:59.764015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ec5abe13-4b2c-4710-bad8-12eb5ecc65e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3646bb4452046c6abcd8a2f2972bd5b', 'request_id': 'req-ec5abe13-4b2c-4710-bad8-12eb5ecc65e8'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:59.772651 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ec5abe13-4b2c-4710-bad8-12eb5ecc65e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3646bb4452046c6abcd8a2f2972bd5b', 'request_id': 'req-ec5abe13-4b2c-4710-bad8-12eb5ecc65e8'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:59.782804 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ec5abe13-4b2c-4710-bad8-12eb5ecc65e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3646bb4452046c6abcd8a2f2972bd5b', 'request_id': 'req-ec5abe13-4b2c-4710-bad8-12eb5ecc65e8'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:59.799189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ec5abe13-4b2c-4710-bad8-12eb5ecc65e8 admin admin] The token cache is being invalidate because project a3646bb4452046c6abcd8a2f2972bd5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:15:59.799813 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ec5abe13-4b2c-4710-bad8-12eb5ecc65e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:59.800575 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ec5abe13-4b2c-4710-bad8-12eb5ecc65e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:15:59.804003 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3036/6040] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:15:59 2022] DELETE /identity/v3/projects/a3646bb4452046c6abcd8a2f2972bd5b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:15:59.810340 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff241e-bb8d-4649-8db6-ed5bf689d9de service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:15:59.822032 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff241e-bb8d-4649-8db6-ed5bf689d9de service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:15:59.904408 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198f52f-de7d-4c55-b0fa-a836bfbb950e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:15:59.905221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198f52f-de7d-4c55-b0fa-a836bfbb950e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:15:59.905668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198f52f-de7d-4c55-b0fa-a836bfbb950e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:15:59.906212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198f52f-de7d-4c55-b0fa-a836bfbb950e admin admin] PATH_INFO: `/v3/users/1d7bf9695c0c4414a6a7e64e471b6fbb` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:15:59.907875 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198f52f-de7d-4c55-b0fa-a836bfbb950e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d7bf9695c0c4414a6a7e64e471b6fbb)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:15:59.910528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198f52f-de7d-4c55-b0fa-a836bfbb950e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:15:59.930946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:00.059416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0198f52f-de7d-4c55-b0fa-a836bfbb950e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d7bf9695c0c4414a6a7e64e471b6fbb'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:00.060461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0198f52f-de7d-4c55-b0fa-a836bfbb950e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d7bf9695c0c4414a6a7e64e471b6fbb'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:00.061377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0198f52f-de7d-4c55-b0fa-a836bfbb950e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d7bf9695c0c4414a6a7e64e471b6fbb'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:00.080202 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0198f52f-de7d-4c55-b0fa-a836bfbb950e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d7bf9695c0c4414a6a7e64e471b6fbb'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:00.109421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0198f52f-de7d-4c55-b0fa-a836bfbb950e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d7bf9695c0c4414a6a7e64e471b6fbb'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:00.136887 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3005/6041] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:15:59 2022] DELETE /identity/v3/users/1d7bf9695c0c4414a6a7e64e471b6fbb => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:16:00.542720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92e24c-4509-4a9b-8732-7d4f7210fa16 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:00.543236 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92e24c-4509-4a9b-8732-7d4f7210fa16 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:00.543461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92e24c-4509-4a9b-8732-7d4f7210fa16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:00.573908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-5b92e24c-4509-4a9b-8732-7d4f7210fa16 None None] MFA Rules not processed for user `c9a290f680dc4b5bbec2010d82ed7e27`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:16:00.575502 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5b92e24c-4509-4a9b-8732-7d4f7210fa16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:00.669818 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3037/6042] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:16:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:16:00.753017 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198f52f-de7d-4c55-b0fa-a836bfbb950e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:00.754823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0198f52f-de7d-4c55-b0fa-a836bfbb950e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:00.866714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198f52f-de7d-4c55-b0fa-a836bfbb950e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:00.874894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ae2a9-e02b-46a0-b672-7ba7003f1d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:00.877145 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ae2a9-e02b-46a0-b672-7ba7003f1d19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:00.877731 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ae2a9-e02b-46a0-b672-7ba7003f1d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:00.878232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ae2a9-e02b-46a0-b672-7ba7003f1d19 admin admin] PATH_INFO: `/v3/projects/76b3f8f9ac954ebaaaa15ec0cfb64232` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:00.883345 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ae2a9-e02b-46a0-b672-7ba7003f1d19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76b3f8f9ac954ebaaaa15ec0cfb64232)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:00.888418 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ae2a9-e02b-46a0-b672-7ba7003f1d19 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:00.995724 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-069ae2a9-e02b-46a0-b672-7ba7003f1d19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76b3f8f9ac954ebaaaa15ec0cfb64232', 'request_id': 'req-069ae2a9-e02b-46a0-b672-7ba7003f1d19'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:01.006002 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-069ae2a9-e02b-46a0-b672-7ba7003f1d19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76b3f8f9ac954ebaaaa15ec0cfb64232', 'request_id': 'req-069ae2a9-e02b-46a0-b672-7ba7003f1d19'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:01.021662 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-069ae2a9-e02b-46a0-b672-7ba7003f1d19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76b3f8f9ac954ebaaaa15ec0cfb64232', 'request_id': 'req-069ae2a9-e02b-46a0-b672-7ba7003f1d19'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:01.038525 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-069ae2a9-e02b-46a0-b672-7ba7003f1d19 admin admin] The token cache is being invalidate because project 76b3f8f9ac954ebaaaa15ec0cfb64232 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:16:01.038935 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-069ae2a9-e02b-46a0-b672-7ba7003f1d19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:01.039706 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-069ae2a9-e02b-46a0-b672-7ba7003f1d19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:01.043878 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3006/6043] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:16:00 2022] DELETE /identity/v3/projects/76b3f8f9ac954ebaaaa15ec0cfb64232 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:16:01.048678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a139a-3221-442a-96b3-a4b58f057b11 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:01.048982 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a139a-3221-442a-96b3-a4b58f057b11 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:01.049262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a139a-3221-442a-96b3-a4b58f057b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:01.089293 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-8c8a139a-3221-442a-96b3-a4b58f057b11 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:16:01.090536 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8c8a139a-3221-442a-96b3-a4b58f057b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:01.197245 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3038/6044] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:16:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:16:01.288434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c748f-ceba-48c0-b567-86371dc476e1 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:01.288725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c748f-ceba-48c0-b567-86371dc476e1 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:01.289031 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c748f-ceba-48c0-b567-86371dc476e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:01.327865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-241c748f-ceba-48c0-b567-86371dc476e1 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:16:01.329145 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-241c748f-ceba-48c0-b567-86371dc476e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:01.341938 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3007/6045] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:16:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:16:01.343188 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a139a-3221-442a-96b3-a4b58f057b11 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:01.354197 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a139a-3221-442a-96b3-a4b58f057b11 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:01.360080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa978a-01ce-4115-b4c0-911f54092db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:01.360689 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa978a-01ce-4115-b4c0-911f54092db0 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:01.361190 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa978a-01ce-4115-b4c0-911f54092db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:01.361467 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa978a-01ce-4115-b4c0-911f54092db0 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:01.362116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa978a-01ce-4115-b4c0-911f54092db0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:16:01.362423 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa978a-01ce-4115-b4c0-911f54092db0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:01.364098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa978a-01ce-4115-b4c0-911f54092db0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:01.382368 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3039/6046] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:16:01.386984 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c748f-ceba-48c0-b567-86371dc476e1 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:01.398828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c748f-ceba-48c0-b567-86371dc476e1 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:01.405000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50edbf-a869-4e23-b22e-7dadd48b72e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:01.406873 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50edbf-a869-4e23-b22e-7dadd48b72e8 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:01.407123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50edbf-a869-4e23-b22e-7dadd48b72e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:01.407480 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50edbf-a869-4e23-b22e-7dadd48b72e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:01.408328 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50edbf-a869-4e23-b22e-7dadd48b72e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:01.410259 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50edbf-a869-4e23-b22e-7dadd48b72e8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:01.428024 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:01.461728 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3008/6047] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:16:01 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:16:01.465802 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa978a-01ce-4115-b4c0-911f54092db0 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:01.477505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa978a-01ce-4115-b4c0-911f54092db0 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:01.554240 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:01.581018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242a679-7e39-40b8-8d71-2a4e9bb8d5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:01.581648 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242a679-7e39-40b8-8d71-2a4e9bb8d5e8 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:01.582068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242a679-7e39-40b8-8d71-2a4e9bb8d5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:01.582347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242a679-7e39-40b8-8d71-2a4e9bb8d5e8 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:01.583017 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9242a679-7e39-40b8-8d71-2a4e9bb8d5e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:01.585498 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9242a679-7e39-40b8-8d71-2a4e9bb8d5e8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:01.633038 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3040/6048] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:16:01 2022] POST /identity/v3/users => generated 287 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:16:01.637405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50edbf-a869-4e23-b22e-7dadd48b72e8 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:01.660845 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50edbf-a869-4e23-b22e-7dadd48b72e8 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:01.680703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbffec4-6f6c-4003-98b5-2f780f91365f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:01.681328 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbffec4-6f6c-4003-98b5-2f780f91365f admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:01.681684 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbffec4-6f6c-4003-98b5-2f780f91365f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:01.682035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbffec4-6f6c-4003-98b5-2f780f91365f admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:01.682722 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbffec4-6f6c-4003-98b5-2f780f91365f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:01.684338 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbffec4-6f6c-4003-98b5-2f780f91365f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:01.708832 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3009/6049] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:16:01.710176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242a679-7e39-40b8-8d71-2a4e9bb8d5e8 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:01.727251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242a679-7e39-40b8-8d71-2a4e9bb8d5e8 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:01.752066 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8287ee-a2a9-4646-b419-49b36c4e8c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:01.758358 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8287ee-a2a9-4646-b419-49b36c4e8c19 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:01.758754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8287ee-a2a9-4646-b419-49b36c4e8c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:01.759037 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8287ee-a2a9-4646-b419-49b36c4e8c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:01.759874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8287ee-a2a9-4646-b419-49b36c4e8c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:01.761478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8287ee-a2a9-4646-b419-49b36c4e8c19 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:01.785567 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3041/6050] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:16:01.788343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbffec4-6f6c-4003-98b5-2f780f91365f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:01.802661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbffec4-6f6c-4003-98b5-2f780f91365f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:01.816971 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0371466-dc7e-4459-9b03-7835b1ebc894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:01.819782 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0371466-dc7e-4459-9b03-7835b1ebc894 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:01.820525 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0371466-dc7e-4459-9b03-7835b1ebc894 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:01.822357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0371466-dc7e-4459-9b03-7835b1ebc894 admin admin] PATH_INFO: `/v3/projects/5e42f1700ba74d0db6eda8c34e4fba2d/users/ab3d99652f7c4df985d50e62d60f4750/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:01.848241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0371466-dc7e-4459-9b03-7835b1ebc894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e42f1700ba74d0db6eda8c34e4fba2d, user_id=ab3d99652f7c4df985d50e62d60f4750, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:01.855595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0371466-dc7e-4459-9b03-7835b1ebc894 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:01.887302 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3010/6051] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:16:01 2022] PUT /identity/v3/projects/5e42f1700ba74d0db6eda8c34e4fba2d/users/ab3d99652f7c4df985d50e62d60f4750/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:16:01.898066 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe3df5-04a8-437d-9a36-1893d7160ded None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:01.898753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe3df5-04a8-437d-9a36-1893d7160ded None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:01.899269 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe3df5-04a8-437d-9a36-1893d7160ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:01.944355 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-eafe3df5-04a8-437d-9a36-1893d7160ded None None] MFA Rules not processed for user `ab3d99652f7c4df985d50e62d60f4750`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:16:01.947047 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-eafe3df5-04a8-437d-9a36-1893d7160ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:02.071768 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3042/6052] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:16:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:16:02.106346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0371466-dc7e-4459-9b03-7835b1ebc894 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:02.109596 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e0371466-dc7e-4459-9b03-7835b1ebc894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:02.270038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0371466-dc7e-4459-9b03-7835b1ebc894 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:02.282746 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80609ee1-e964-4a92-9329-b08914283abb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:02.284125 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80609ee1-e964-4a92-9329-b08914283abb service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:02.284422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80609ee1-e964-4a92-9329-b08914283abb service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:02.290111 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80609ee1-e964-4a92-9329-b08914283abb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:02.310154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80609ee1-e964-4a92-9329-b08914283abb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:02.312237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80609ee1-e964-4a92-9329-b08914283abb service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:02.323175 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3011/6053] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:16:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:16:05.047689 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cb530-49ea-4ff2-a0fb-4304043d91f0 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:05.048566 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cb530-49ea-4ff2-a0fb-4304043d91f0 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:05.049209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cb530-49ea-4ff2-a0fb-4304043d91f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:05.147625 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a77cb530-49ea-4ff2-a0fb-4304043d91f0 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:16:05.149538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a77cb530-49ea-4ff2-a0fb-4304043d91f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:05.223907 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3043/6054] 10.222.0.33 () {58 vars in 967 bytes} [Sat Aug 6 21:16:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:16:05.258405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80609ee1-e964-4a92-9329-b08914283abb service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:05.260060 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-80609ee1-e964-4a92-9329-b08914283abb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:05.403079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80609ee1-e964-4a92-9329-b08914283abb service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:05.411153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa6e78-1acb-459d-99a8-2252d9dc86dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:05.412071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa6e78-1acb-459d-99a8-2252d9dc86dc service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:05.412715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa6e78-1acb-459d-99a8-2252d9dc86dc service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:05.413913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa6e78-1acb-459d-99a8-2252d9dc86dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:05.427308 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa6e78-1acb-459d-99a8-2252d9dc86dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:05.429352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa6e78-1acb-459d-99a8-2252d9dc86dc service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:05.444403 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3012/6055] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:16:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:16:15.215033 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=80,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:15.440140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=81,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:17.398705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cb530-49ea-4ff2-a0fb-4304043d91f0 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:17.402291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a77cb530-49ea-4ff2-a0fb-4304043d91f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:17.426622 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cb530-49ea-4ff2-a0fb-4304043d91f0 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:17.431381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c86939-179e-4169-ba58-16dcd80a71e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:17.434722 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c86939-179e-4169-ba58-16dcd80a71e2 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:17.435212 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c86939-179e-4169-ba58-16dcd80a71e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:17.435693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c86939-179e-4169-ba58-16dcd80a71e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:17.439996 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-54c86939-179e-4169-ba58-16dcd80a71e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:17.590810 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c86939-179e-4169-ba58-16dcd80a71e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:17.594487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c86939-179e-4169-ba58-16dcd80a71e2 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:17.619118 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3044/6056] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:16:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:16:23.146795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa6e78-1acb-459d-99a8-2252d9dc86dc service swift] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:23.149289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-dcaa6e78-1acb-459d-99a8-2252d9dc86dc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:23.419326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa6e78-1acb-459d-99a8-2252d9dc86dc service swift] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:23.435410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f155a3-e4c3-47ad-b10a-4edd691f40c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:23.437838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f155a3-e4c3-47ad-b10a-4edd691f40c2 service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:23.446108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f155a3-e4c3-47ad-b10a-4edd691f40c2 service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:23.446690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f155a3-e4c3-47ad-b10a-4edd691f40c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:23.448803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-43f155a3-e4c3-47ad-b10a-4edd691f40c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:23.476148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f155a3-e4c3-47ad-b10a-4edd691f40c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:23.478794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f155a3-e4c3-47ad-b10a-4edd691f40c2 service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:23.510211 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3013/6057] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:16:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:16:27.251025 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b8af3-e5ec-49a9-b3c9-2f04795f8a73 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:27.251952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b8af3-e5ec-49a9-b3c9-2f04795f8a73 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:27.252398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b8af3-e5ec-49a9-b3c9-2f04795f8a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:27.284188 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-362b8af3-e5ec-49a9-b3c9-2f04795f8a73 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:16:27.286278 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-362b8af3-e5ec-49a9-b3c9-2f04795f8a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:27.307155 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3045/6058] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:16:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:16:27.316838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f155a3-e4c3-47ad-b10a-4edd691f40c2 service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:27.342253 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f155a3-e4c3-47ad-b10a-4edd691f40c2 service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:27.351579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6befb64-ca9a-41eb-86df-12be378b36bd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:27.352476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6befb64-ca9a-41eb-86df-12be378b36bd service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:27.352925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6befb64-ca9a-41eb-86df-12be378b36bd service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:27.353367 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6befb64-ca9a-41eb-86df-12be378b36bd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:27.366980 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6befb64-ca9a-41eb-86df-12be378b36bd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:27.368868 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6befb64-ca9a-41eb-86df-12be378b36bd service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:27.393418 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3014/6059] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:16:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:16:28.326987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b8af3-e5ec-49a9-b3c9-2f04795f8a73 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:28.336413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-362b8af3-e5ec-49a9-b3c9-2f04795f8a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:28.378526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b8af3-e5ec-49a9-b3c9-2f04795f8a73 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:28.391530 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce6509-2799-4710-9c1f-0294f342d68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:28.392397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce6509-2799-4710-9c1f-0294f342d68f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:28.395369 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce6509-2799-4710-9c1f-0294f342d68f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:28.395859 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce6509-2799-4710-9c1f-0294f342d68f admin admin] PATH_INFO: `/v3/users/1d7b9e27983940dcaf0e92f62273c588` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:28.397913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce6509-2799-4710-9c1f-0294f342d68f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d7b9e27983940dcaf0e92f62273c588)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:28.400679 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce6509-2799-4710-9c1f-0294f342d68f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:28.525597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-64ce6509-2799-4710-9c1f-0294f342d68f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d7b9e27983940dcaf0e92f62273c588'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:28.552648 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-64ce6509-2799-4710-9c1f-0294f342d68f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d7b9e27983940dcaf0e92f62273c588'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:28.555457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-64ce6509-2799-4710-9c1f-0294f342d68f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d7b9e27983940dcaf0e92f62273c588'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:28.557723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-64ce6509-2799-4710-9c1f-0294f342d68f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d7b9e27983940dcaf0e92f62273c588'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:28.579807 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-64ce6509-2799-4710-9c1f-0294f342d68f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d7b9e27983940dcaf0e92f62273c588'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:28.618903 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3046/6060] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:16:28 2022] DELETE /identity/v3/users/1d7b9e27983940dcaf0e92f62273c588 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:16:29.528898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6befb64-ca9a-41eb-86df-12be378b36bd service swift] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:29.561201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6befb64-ca9a-41eb-86df-12be378b36bd service swift] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:29.832504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ecb34b-7c5b-445d-a5ad-1fbc2a188ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:29.833237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecb34b-7c5b-445d-a5ad-1fbc2a188ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:29.833603 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecb34b-7c5b-445d-a5ad-1fbc2a188ace admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:29.833930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecb34b-7c5b-445d-a5ad-1fbc2a188ace admin admin] PATH_INFO: `/v3/projects/f4980bb21b59412ca004d8069525d3b9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:29.836514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ecb34b-7c5b-445d-a5ad-1fbc2a188ace admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4980bb21b59412ca004d8069525d3b9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:29.839357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ecb34b-7c5b-445d-a5ad-1fbc2a188ace admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:29.983029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-98ecb34b-7c5b-445d-a5ad-1fbc2a188ace admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4980bb21b59412ca004d8069525d3b9', 'request_id': 'req-98ecb34b-7c5b-445d-a5ad-1fbc2a188ace'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:30.005549 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-98ecb34b-7c5b-445d-a5ad-1fbc2a188ace admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4980bb21b59412ca004d8069525d3b9', 'request_id': 'req-98ecb34b-7c5b-445d-a5ad-1fbc2a188ace'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:30.025000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-98ecb34b-7c5b-445d-a5ad-1fbc2a188ace admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4980bb21b59412ca004d8069525d3b9', 'request_id': 'req-98ecb34b-7c5b-445d-a5ad-1fbc2a188ace'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:30.075487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-98ecb34b-7c5b-445d-a5ad-1fbc2a188ace admin admin] The token cache is being invalidate because project f4980bb21b59412ca004d8069525d3b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:16:30.075843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-98ecb34b-7c5b-445d-a5ad-1fbc2a188ace admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:30.078157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-98ecb34b-7c5b-445d-a5ad-1fbc2a188ace admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:30.086995 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3015/6061] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:16:29 2022] DELETE /identity/v3/projects/f4980bb21b59412ca004d8069525d3b9 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:16:30.095781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b7df9-473d-43d1-843b-692570d987b6 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:30.096709 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b7df9-473d-43d1-843b-692570d987b6 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:30.097168 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b7df9-473d-43d1-843b-692570d987b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:30.158197 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-4b1b7df9-473d-43d1-843b-692570d987b6 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:16:30.162149 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4b1b7df9-473d-43d1-843b-692570d987b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:30.301588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:30.329262 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3047/6062] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:16:30.330656 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabf93d-f5a9-47a0-84ce-756d90a5cc84 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:30.330950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabf93d-f5a9-47a0-84ce-756d90a5cc84 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:30.331228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabf93d-f5a9-47a0-84ce-756d90a5cc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:30.365023 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:30.382763 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-bdabf93d-f5a9-47a0-84ce-756d90a5cc84 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:16:30.384016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-bdabf93d-f5a9-47a0-84ce-756d90a5cc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:30.407549 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3016/6063] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:16:30.409816 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b7df9-473d-43d1-843b-692570d987b6 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:30.428201 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b7df9-473d-43d1-843b-692570d987b6 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:30.448684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da3127-c86f-4e95-9251-4b0e7e806a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:30.451930 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da3127-c86f-4e95-9251-4b0e7e806a46 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:30.452315 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da3127-c86f-4e95-9251-4b0e7e806a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:30.459458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da3127-c86f-4e95-9251-4b0e7e806a46 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:30.463383 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da3127-c86f-4e95-9251-4b0e7e806a46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:16:30.465545 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da3127-c86f-4e95-9251-4b0e7e806a46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:30.476419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da3127-c86f-4e95-9251-4b0e7e806a46 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:30.523812 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3048/6064] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:16:30.526504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabf93d-f5a9-47a0-84ce-756d90a5cc84 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:30.542965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabf93d-f5a9-47a0-84ce-756d90a5cc84 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:30.554185 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ffb525-7333-45c8-a8fc-b128be5436a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:30.555488 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffb525-7333-45c8-a8fc-b128be5436a9 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:30.556597 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffb525-7333-45c8-a8fc-b128be5436a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:30.558377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffb525-7333-45c8-a8fc-b128be5436a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:30.559228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ffb525-7333-45c8-a8fc-b128be5436a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:30.565236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ffb525-7333-45c8-a8fc-b128be5436a9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:30.678591 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3017/6065] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:16:30 2022] POST /identity/v3/projects => generated 403 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:16:30.683189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da3127-c86f-4e95-9251-4b0e7e806a46 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:30.708447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da3127-c86f-4e95-9251-4b0e7e806a46 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:30.845266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea30892b-2d31-415d-af73-e7dd1c758f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:30.846101 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30892b-2d31-415d-af73-e7dd1c758f31 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:30.846392 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30892b-2d31-415d-af73-e7dd1c758f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:30.846699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30892b-2d31-415d-af73-e7dd1c758f31 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:30.847332 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30892b-2d31-415d-af73-e7dd1c758f31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:30.850334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30892b-2d31-415d-af73-e7dd1c758f31 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:30.896787 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3049/6066] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:16:30 2022] POST /identity/v3/users => generated 302 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:16:30.900668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ffb525-7333-45c8-a8fc-b128be5436a9 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:30.912859 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ffb525-7333-45c8-a8fc-b128be5436a9 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:30.936269 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83030d73-4aad-49ed-8dd5-706f7ff5b90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:30.937093 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83030d73-4aad-49ed-8dd5-706f7ff5b90f admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:30.937380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83030d73-4aad-49ed-8dd5-706f7ff5b90f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:30.937725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83030d73-4aad-49ed-8dd5-706f7ff5b90f admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:30.938411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83030d73-4aad-49ed-8dd5-706f7ff5b90f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:30.940084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83030d73-4aad-49ed-8dd5-706f7ff5b90f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:30.979179 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea30892b-2d31-415d-af73-e7dd1c758f31 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:30.983447 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3018/6067] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:16:30.993026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea30892b-2d31-415d-af73-e7dd1c758f31 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:31.009749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a0fd9-916f-4a2c-829a-18f38f44d7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:31.010614 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a0fd9-916f-4a2c-829a-18f38f44d7db admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:31.011072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a0fd9-916f-4a2c-829a-18f38f44d7db admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:31.011504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a0fd9-916f-4a2c-829a-18f38f44d7db admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:31.012572 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a0fd9-916f-4a2c-829a-18f38f44d7db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:31.016406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a0fd9-916f-4a2c-829a-18f38f44d7db admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:31.045674 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3050/6068] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:16:31.048146 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83030d73-4aad-49ed-8dd5-706f7ff5b90f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:31.059686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83030d73-4aad-49ed-8dd5-706f7ff5b90f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:31.089179 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66ec9f-27db-4e3e-be42-d56d6ad8496d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:31.090612 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66ec9f-27db-4e3e-be42-d56d6ad8496d admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:31.090903 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66ec9f-27db-4e3e-be42-d56d6ad8496d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:31.091182 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66ec9f-27db-4e3e-be42-d56d6ad8496d admin admin] PATH_INFO: `/v3/projects/2a86c3603a7342ce9bbc729f5409fdd4/users/0d348e6e541d4a24ab7e659488d3c966/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:31.213816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b66ec9f-27db-4e3e-be42-d56d6ad8496d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a86c3603a7342ce9bbc729f5409fdd4, user_id=0d348e6e541d4a24ab7e659488d3c966, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:31.229771 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b66ec9f-27db-4e3e-be42-d56d6ad8496d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:31.279537 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3019/6069] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:16:31 2022] PUT /identity/v3/projects/2a86c3603a7342ce9bbc729f5409fdd4/users/0d348e6e541d4a24ab7e659488d3c966/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:16:31.292817 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ceaaa-2021-4e22-832c-375ba396287b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:31.293742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ceaaa-2021-4e22-832c-375ba396287b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:31.294700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ceaaa-2021-4e22-832c-375ba396287b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:31.387255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a77ceaaa-2021-4e22-832c-375ba396287b None None] MFA Rules not processed for user `0d348e6e541d4a24ab7e659488d3c966`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:16:31.389038 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a77ceaaa-2021-4e22-832c-375ba396287b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:31.649181 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3051/6070] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:16:31 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:16:31.656333 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66ec9f-27db-4e3e-be42-d56d6ad8496d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:31.913685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66ec9f-27db-4e3e-be42-d56d6ad8496d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:31.925918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de89a1-b339-4ff1-8858-188f1e276eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:31.933713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de89a1-b339-4ff1-8858-188f1e276eed admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:31.934094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de89a1-b339-4ff1-8858-188f1e276eed admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:31.936028 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de89a1-b339-4ff1-8858-188f1e276eed admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:31.938642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de89a1-b339-4ff1-8858-188f1e276eed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:31.943397 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de89a1-b339-4ff1-8858-188f1e276eed admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:32.079244 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ceaaa-2021-4e22-832c-375ba396287b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:32.080361 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3020/6071] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:16:31 2022] POST /identity/v3/projects => generated 403 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:16:32.095316 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ceaaa-2021-4e22-832c-375ba396287b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:32.228944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:32.242234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2a083-9b7f-44ba-b0b4-2ea6ebb87c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:32.244955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2a083-9b7f-44ba-b0b4-2ea6ebb87c76 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:32.245675 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2a083-9b7f-44ba-b0b4-2ea6ebb87c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:32.245974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2a083-9b7f-44ba-b0b4-2ea6ebb87c76 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:32.246640 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2a083-9b7f-44ba-b0b4-2ea6ebb87c76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:32.249295 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2a083-9b7f-44ba-b0b4-2ea6ebb87c76 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:32.307763 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3052/6072] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:16:32 2022] POST /identity/v3/users => generated 308 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:16:32.309848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de89a1-b339-4ff1-8858-188f1e276eed admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:32.323962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de89a1-b339-4ff1-8858-188f1e276eed admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:32.350683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be68364-d7d2-4bc1-965c-e9965fe7aac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:32.355567 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be68364-d7d2-4bc1-965c-e9965fe7aac7 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:32.355906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be68364-d7d2-4bc1-965c-e9965fe7aac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:32.356193 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be68364-d7d2-4bc1-965c-e9965fe7aac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:32.360146 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be68364-d7d2-4bc1-965c-e9965fe7aac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:32.371498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be68364-d7d2-4bc1-965c-e9965fe7aac7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:32.429242 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3021/6073] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:16:32.430003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2a083-9b7f-44ba-b0b4-2ea6ebb87c76 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:32.448924 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2a083-9b7f-44ba-b0b4-2ea6ebb87c76 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:32.463723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df54b6-c439-4be9-8086-19e03ee7548a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:32.464473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df54b6-c439-4be9-8086-19e03ee7548a admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:32.464943 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df54b6-c439-4be9-8086-19e03ee7548a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:32.465491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df54b6-c439-4be9-8086-19e03ee7548a admin admin] PATH_INFO: `/v3/projects/a27642b393f842b0bcd2934687f8324a/users/9c2d8f446745448d8a55850e43bc44c7/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:32.498669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35df54b6-c439-4be9-8086-19e03ee7548a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a27642b393f842b0bcd2934687f8324a, user_id=9c2d8f446745448d8a55850e43bc44c7, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:32.501657 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35df54b6-c439-4be9-8086-19e03ee7548a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:32.542047 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3053/6074] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:16:32 2022] PUT /identity/v3/projects/a27642b393f842b0bcd2934687f8324a/users/9c2d8f446745448d8a55850e43bc44c7/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:16:32.547100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be68364-d7d2-4bc1-965c-e9965fe7aac7 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:32.570639 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be68364-d7d2-4bc1-965c-e9965fe7aac7 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:32.721112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c37df-0782-4b40-9424-f2769a741d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:32.726211 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c37df-0782-4b40-9424-f2769a741d8f admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:32.726211 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c37df-0782-4b40-9424-f2769a741d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:32.728175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c37df-0782-4b40-9424-f2769a741d8f admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:32.728875 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c37df-0782-4b40-9424-f2769a741d8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:32.730534 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c37df-0782-4b40-9424-f2769a741d8f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:32.776700 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3022/6075] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:16:32.781120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df54b6-c439-4be9-8086-19e03ee7548a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:32.793429 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df54b6-c439-4be9-8086-19e03ee7548a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:32.842519 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502931e7-352d-443e-99c7-7af828a29b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:32.844453 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502931e7-352d-443e-99c7-7af828a29b37 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:32.846898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502931e7-352d-443e-99c7-7af828a29b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:32.851778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502931e7-352d-443e-99c7-7af828a29b37 admin admin] PATH_INFO: `/v3/projects/a27642b393f842b0bcd2934687f8324a/users/9c2d8f446745448d8a55850e43bc44c7/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:32.860005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502931e7-352d-443e-99c7-7af828a29b37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a27642b393f842b0bcd2934687f8324a, user_id=9c2d8f446745448d8a55850e43bc44c7, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:32.879095 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502931e7-352d-443e-99c7-7af828a29b37 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:32.918676 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3054/6076] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:16:32 2022] PUT /identity/v3/projects/a27642b393f842b0bcd2934687f8324a/users/9c2d8f446745448d8a55850e43bc44c7/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:16:32.922756 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975a6eb-dd28-4cfc-a5bd-509f1fe3579c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:32.923044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975a6eb-dd28-4cfc-a5bd-509f1fe3579c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:32.923317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975a6eb-dd28-4cfc-a5bd-509f1fe3579c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:32.973789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:32.985753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-7975a6eb-dd28-4cfc-a5bd-509f1fe3579c None None] MFA Rules not processed for user `9c2d8f446745448d8a55850e43bc44c7`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:16:32.987001 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7975a6eb-dd28-4cfc-a5bd-509f1fe3579c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:33.143506 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3023/6077] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:16:32 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:16:33.148470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502931e7-352d-443e-99c7-7af828a29b37 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:33.165769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502931e7-352d-443e-99c7-7af828a29b37 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:33.181569 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b09a23-49b0-4599-88ce-ce82dcdb41aa tempest-ApplicationCredentialsV3AdminTest-1869592676 tempest-ApplicationCredentialsV3AdminTest-1869592676-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c2d8f446745448d8a55850e43bc44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a27642b393f842b0bcd2934687f8324a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:33.182443 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b09a23-49b0-4599-88ce-ce82dcdb41aa tempest-ApplicationCredentialsV3AdminTest-1869592676 tempest-ApplicationCredentialsV3AdminTest-1869592676-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:33.182443 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b09a23-49b0-4599-88ce-ce82dcdb41aa tempest-ApplicationCredentialsV3AdminTest-1869592676 tempest-ApplicationCredentialsV3AdminTest-1869592676-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:33.182779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b09a23-49b0-4599-88ce-ce82dcdb41aa tempest-ApplicationCredentialsV3AdminTest-1869592676 tempest-ApplicationCredentialsV3AdminTest-1869592676-project-admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:33.183370 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b09a23-49b0-4599-88ce-ce82dcdb41aa tempest-ApplicationCredentialsV3AdminTest-1869592676 tempest-ApplicationCredentialsV3AdminTest-1869592676-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:33.185514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b09a23-49b0-4599-88ce-ce82dcdb41aa tempest-ApplicationCredentialsV3AdminTest-1869592676 tempest-ApplicationCredentialsV3AdminTest-1869592676-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:33.222167 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3055/6078] 10.222.0.33 () {60 vars in 1143 bytes} [Sat Aug 6 21:16:33 2022] POST /identity/v3/roles => generated 239 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:16:33.224078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975a6eb-dd28-4cfc-a5bd-509f1fe3579c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:33.236684 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975a6eb-dd28-4cfc-a5bd-509f1fe3579c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:33.256775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c2143-935d-4513-83ec-d72df2d7df2b tempest-ApplicationCredentialsV3AdminTest-1869592676 tempest-ApplicationCredentialsV3AdminTest-1869592676-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c2d8f446745448d8a55850e43bc44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a27642b393f842b0bcd2934687f8324a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:33.256775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c2143-935d-4513-83ec-d72df2d7df2b tempest-ApplicationCredentialsV3AdminTest-1869592676 tempest-ApplicationCredentialsV3AdminTest-1869592676-project-admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:33.256775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c2143-935d-4513-83ec-d72df2d7df2b tempest-ApplicationCredentialsV3AdminTest-1869592676 tempest-ApplicationCredentialsV3AdminTest-1869592676-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:33.257241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c2143-935d-4513-83ec-d72df2d7df2b tempest-ApplicationCredentialsV3AdminTest-1869592676 tempest-ApplicationCredentialsV3AdminTest-1869592676-project-admin] PATH_INFO: `/v3/projects/2a86c3603a7342ce9bbc729f5409fdd4/users/0d348e6e541d4a24ab7e659488d3c966/roles/af75ba8639234ca6880d1136ffecb232` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:33.264564 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c2143-935d-4513-83ec-d72df2d7df2b tempest-ApplicationCredentialsV3AdminTest-1869592676 tempest-ApplicationCredentialsV3AdminTest-1869592676-project-admin] RBAC: Authorizing `identity:create_grant(project_id=2a86c3603a7342ce9bbc729f5409fdd4, user_id=0d348e6e541d4a24ab7e659488d3c966, role_id=af75ba8639234ca6880d1136ffecb232)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:33.269928 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c2143-935d-4513-83ec-d72df2d7df2b tempest-ApplicationCredentialsV3AdminTest-1869592676 tempest-ApplicationCredentialsV3AdminTest-1869592676-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:33.300699 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3024/6079] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:16:33 2022] PUT /identity/v3/projects/2a86c3603a7342ce9bbc729f5409fdd4/users/0d348e6e541d4a24ab7e659488d3c966/roles/af75ba8639234ca6880d1136ffecb232 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:16:33.306124 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b09a23-49b0-4599-88ce-ce82dcdb41aa tempest-ApplicationCredentialsV3AdminTest-1869592676 tempest-ApplicationCredentialsV3AdminTest-1869592676-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:33.490085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b09a23-49b0-4599-88ce-ce82dcdb41aa tempest-ApplicationCredentialsV3AdminTest-1869592676 tempest-ApplicationCredentialsV3AdminTest-1869592676-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:33.633435 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed935a7b-d6aa-4d29-80da-2fb9b0772784 tempest-ApplicationCredentialsV3AdminTest-1883052283 tempest-ApplicationCredentialsV3AdminTest-1883052283-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d348e6e541d4a24ab7e659488d3c966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a86c3603a7342ce9bbc729f5409fdd4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'tempest-test_role-361360237'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:33.634275 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed935a7b-d6aa-4d29-80da-2fb9b0772784 tempest-ApplicationCredentialsV3AdminTest-1883052283 tempest-ApplicationCredentialsV3AdminTest-1883052283-project] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:33.634693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed935a7b-d6aa-4d29-80da-2fb9b0772784 tempest-ApplicationCredentialsV3AdminTest-1883052283 tempest-ApplicationCredentialsV3AdminTest-1883052283-project] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:33.635068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed935a7b-d6aa-4d29-80da-2fb9b0772784 tempest-ApplicationCredentialsV3AdminTest-1883052283 tempest-ApplicationCredentialsV3AdminTest-1883052283-project] PATH_INFO: `/v3/users/0d348e6e541d4a24ab7e659488d3c966/application_credentials` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:33.635982 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed935a7b-d6aa-4d29-80da-2fb9b0772784 tempest-ApplicationCredentialsV3AdminTest-1883052283 tempest-ApplicationCredentialsV3AdminTest-1883052283-project] RBAC: Authorizing `identity:create_application_credential(user_id=0d348e6e541d4a24ab7e659488d3c966)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:33.637724 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed935a7b-d6aa-4d29-80da-2fb9b0772784 tempest-ApplicationCredentialsV3AdminTest-1883052283 tempest-ApplicationCredentialsV3AdminTest-1883052283-project] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:33.783797 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:33.833280 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3056/6080] 10.222.0.33 () {60 vars in 1315 bytes} [Sat Aug 6 21:16:33 2022] POST /identity/v3/users/0d348e6e541d4a24ab7e659488d3c966/application_credentials => generated 658 bytes in 528 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:16:33.837897 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a3f32-d9a9-4387-b30c-6577f928f96c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:33.838407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a3f32-d9a9-4387-b30c-6577f928f96c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:33.838496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a3f32-d9a9-4387-b30c-6577f928f96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:33.931003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-c18a3f32-d9a9-4387-b30c-6577f928f96c None None] MFA Rules not processed for user `0d348e6e541d4a24ab7e659488d3c966`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:16:33.937795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c18a3f32-d9a9-4387-b30c-6577f928f96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:34.269212 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3025/6081] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:16:33 2022] POST /identity/v3/auth/tokens => generated 3395 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Aug 06 21:16:34.273844 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed935a7b-d6aa-4d29-80da-2fb9b0772784 tempest-ApplicationCredentialsV3AdminTest-1883052283 tempest-ApplicationCredentialsV3AdminTest-1883052283-project] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:34.289380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed935a7b-d6aa-4d29-80da-2fb9b0772784 tempest-ApplicationCredentialsV3AdminTest-1883052283 tempest-ApplicationCredentialsV3AdminTest-1883052283-project] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:34.298721 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93d520-7f04-41ee-8f0a-c5a0e38ac69d tempest-ApplicationCredentialsV3AdminTest-1883052283 tempest-ApplicationCredentialsV3AdminTest-1883052283-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d348e6e541d4a24ab7e659488d3c966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a86c3603a7342ce9bbc729f5409fdd4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'tempest-test_role-361360237'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:34.299383 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93d520-7f04-41ee-8f0a-c5a0e38ac69d tempest-ApplicationCredentialsV3AdminTest-1883052283 tempest-ApplicationCredentialsV3AdminTest-1883052283-project] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:34.299658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93d520-7f04-41ee-8f0a-c5a0e38ac69d tempest-ApplicationCredentialsV3AdminTest-1883052283 tempest-ApplicationCredentialsV3AdminTest-1883052283-project] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:34.299937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93d520-7f04-41ee-8f0a-c5a0e38ac69d tempest-ApplicationCredentialsV3AdminTest-1883052283 tempest-ApplicationCredentialsV3AdminTest-1883052283-project] PATH_INFO: `/v3/users/0d348e6e541d4a24ab7e659488d3c966/application_credentials/84469eb49d3d4a58bde334168b83e380` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:34.301431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa93d520-7f04-41ee-8f0a-c5a0e38ac69d tempest-ApplicationCredentialsV3AdminTest-1883052283 tempest-ApplicationCredentialsV3AdminTest-1883052283-project] RBAC: Authorizing `identity:delete_application_credential(user_id=0d348e6e541d4a24ab7e659488d3c966, application_credential_id=84469eb49d3d4a58bde334168b83e380)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:34.303085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa93d520-7f04-41ee-8f0a-c5a0e38ac69d tempest-ApplicationCredentialsV3AdminTest-1883052283 tempest-ApplicationCredentialsV3AdminTest-1883052283-project] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:34.402406 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3057/6082] 10.222.0.33 () {58 vars in 1395 bytes} [Sat Aug 6 21:16:34 2022] DELETE /identity/v3/users/0d348e6e541d4a24ab7e659488d3c966/application_credentials/84469eb49d3d4a58bde334168b83e380 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:16:34.407761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a3f32-d9a9-4387-b30c-6577f928f96c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:34.481521 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:34.677711 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a3f32-d9a9-4387-b30c-6577f928f96c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:34.708908 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee042516-0d72-4593-9079-48bae4853e21 tempest-ApplicationCredentialsV3AdminTest-1869592676 tempest-ApplicationCredentialsV3AdminTest-1869592676-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c2d8f446745448d8a55850e43bc44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a27642b393f842b0bcd2934687f8324a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:34.711041 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee042516-0d72-4593-9079-48bae4853e21 tempest-ApplicationCredentialsV3AdminTest-1869592676 tempest-ApplicationCredentialsV3AdminTest-1869592676-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:34.712775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee042516-0d72-4593-9079-48bae4853e21 tempest-ApplicationCredentialsV3AdminTest-1869592676 tempest-ApplicationCredentialsV3AdminTest-1869592676-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:34.714822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee042516-0d72-4593-9079-48bae4853e21 tempest-ApplicationCredentialsV3AdminTest-1869592676 tempest-ApplicationCredentialsV3AdminTest-1869592676-project-admin] PATH_INFO: `/v3/roles/af75ba8639234ca6880d1136ffecb232` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:34.737073 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee042516-0d72-4593-9079-48bae4853e21 tempest-ApplicationCredentialsV3AdminTest-1869592676 tempest-ApplicationCredentialsV3AdminTest-1869592676-project-admin] RBAC: Authorizing `identity:delete_role(role_id=af75ba8639234ca6880d1136ffecb232)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:34.741748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee042516-0d72-4593-9079-48bae4853e21 tempest-ApplicationCredentialsV3AdminTest-1869592676 tempest-ApplicationCredentialsV3AdminTest-1869592676-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:34.837735 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ee042516-0d72-4593-9079-48bae4853e21 tempest-ApplicationCredentialsV3AdminTest-1869592676 tempest-ApplicationCredentialsV3AdminTest-1869592676-project-admin] Invalidating the token cache because role af75ba8639234ca6880d1136ffecb232 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:16:34.838358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ee042516-0d72-4593-9079-48bae4853e21 tempest-ApplicationCredentialsV3AdminTest-1869592676 tempest-ApplicationCredentialsV3AdminTest-1869592676-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:34.840575 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ee042516-0d72-4593-9079-48bae4853e21 tempest-ApplicationCredentialsV3AdminTest-1869592676 tempest-ApplicationCredentialsV3AdminTest-1869592676-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:34.846378 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3026/6083] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:16:34 2022] DELETE /identity/v3/roles/af75ba8639234ca6880d1136ffecb232 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:16:34.851956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93d520-7f04-41ee-8f0a-c5a0e38ac69d tempest-ApplicationCredentialsV3AdminTest-1883052283 tempest-ApplicationCredentialsV3AdminTest-1883052283-project] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:34.854630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-aa93d520-7f04-41ee-8f0a-c5a0e38ac69d tempest-ApplicationCredentialsV3AdminTest-1883052283 tempest-ApplicationCredentialsV3AdminTest-1883052283-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:35.062488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93d520-7f04-41ee-8f0a-c5a0e38ac69d tempest-ApplicationCredentialsV3AdminTest-1883052283 tempest-ApplicationCredentialsV3AdminTest-1883052283-project] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:35.186413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1be052-e140-416f-a7a6-5b02c01a7a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:35.187345 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1be052-e140-416f-a7a6-5b02c01a7a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:35.187757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1be052-e140-416f-a7a6-5b02c01a7a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:35.188138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1be052-e140-416f-a7a6-5b02c01a7a2e admin admin] PATH_INFO: `/v3/users/0d348e6e541d4a24ab7e659488d3c966` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:35.189899 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1be052-e140-416f-a7a6-5b02c01a7a2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d348e6e541d4a24ab7e659488d3c966)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:35.197263 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1be052-e140-416f-a7a6-5b02c01a7a2e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:35.299312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0e1be052-e140-416f-a7a6-5b02c01a7a2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d348e6e541d4a24ab7e659488d3c966'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:35.309514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0e1be052-e140-416f-a7a6-5b02c01a7a2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d348e6e541d4a24ab7e659488d3c966'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:35.311488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0e1be052-e140-416f-a7a6-5b02c01a7a2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d348e6e541d4a24ab7e659488d3c966'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:35.312371 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0e1be052-e140-416f-a7a6-5b02c01a7a2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d348e6e541d4a24ab7e659488d3c966'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:35.354945 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0e1be052-e140-416f-a7a6-5b02c01a7a2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d348e6e541d4a24ab7e659488d3c966'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:35.402801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:35.469091 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3058/6084] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:16:34 2022] DELETE /identity/v3/users/0d348e6e541d4a24ab7e659488d3c966 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:16:35.488053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5093c-b00c-484d-b819-649bc57c764f None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:35.488471 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5093c-b00c-484d-b819-649bc57c764f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:35.488807 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5093c-b00c-484d-b819-649bc57c764f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:35.523133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f7b5093c-b00c-484d-b819-649bc57c764f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:16:35.525078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f7b5093c-b00c-484d-b819-649bc57c764f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:35.636191 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3027/6085] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:16:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:16:35.649338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1be052-e140-416f-a7a6-5b02c01a7a2e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:35.650835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0e1be052-e140-416f-a7a6-5b02c01a7a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:35.861316 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1be052-e140-416f-a7a6-5b02c01a7a2e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:35.879842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b2459-510e-4d5e-b2f0-3ab2f0c88986 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:35.880485 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b2459-510e-4d5e-b2f0-3ab2f0c88986 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:35.880768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b2459-510e-4d5e-b2f0-3ab2f0c88986 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:35.881046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b2459-510e-4d5e-b2f0-3ab2f0c88986 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:35.894238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b2459-510e-4d5e-b2f0-3ab2f0c88986 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:35.895866 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b2459-510e-4d5e-b2f0-3ab2f0c88986 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:35.912998 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3059/6086] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:16:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:16:36.558226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5093c-b00c-484d-b819-649bc57c764f None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:36.560990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f7b5093c-b00c-484d-b819-649bc57c764f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:36.590839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5093c-b00c-484d-b819-649bc57c764f None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:36.601837 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465ee04-153b-49fa-a972-4955906e5690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:36.603554 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465ee04-153b-49fa-a972-4955906e5690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:36.603840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465ee04-153b-49fa-a972-4955906e5690 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:36.608389 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465ee04-153b-49fa-a972-4955906e5690 admin admin] PATH_INFO: `/v3/projects/2a86c3603a7342ce9bbc729f5409fdd4` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:36.611131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465ee04-153b-49fa-a972-4955906e5690 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a86c3603a7342ce9bbc729f5409fdd4)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:36.617845 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465ee04-153b-49fa-a972-4955906e5690 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:36.823161 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a465ee04-153b-49fa-a972-4955906e5690 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a86c3603a7342ce9bbc729f5409fdd4', 'request_id': 'req-a465ee04-153b-49fa-a972-4955906e5690'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:36.839588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a465ee04-153b-49fa-a972-4955906e5690 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a86c3603a7342ce9bbc729f5409fdd4', 'request_id': 'req-a465ee04-153b-49fa-a972-4955906e5690'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:36.858785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a465ee04-153b-49fa-a972-4955906e5690 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a86c3603a7342ce9bbc729f5409fdd4', 'request_id': 'req-a465ee04-153b-49fa-a972-4955906e5690'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:36.909437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a465ee04-153b-49fa-a972-4955906e5690 admin admin] The token cache is being invalidate because project 2a86c3603a7342ce9bbc729f5409fdd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:16:36.911873 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a465ee04-153b-49fa-a972-4955906e5690 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:36.914834 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a465ee04-153b-49fa-a972-4955906e5690 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:36.920457 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3028/6087] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:16:36 2022] DELETE /identity/v3/projects/2a86c3603a7342ce9bbc729f5409fdd4 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:16:36.925339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b2459-510e-4d5e-b2f0-3ab2f0c88986 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:36.940733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b2459-510e-4d5e-b2f0-3ab2f0c88986 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:37.115184 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58303ef-b1f5-4013-ac84-da55e02578c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:37.119429 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58303ef-b1f5-4013-ac84-da55e02578c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:37.120116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58303ef-b1f5-4013-ac84-da55e02578c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:37.121250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58303ef-b1f5-4013-ac84-da55e02578c9 admin admin] PATH_INFO: `/v3/users/9c2d8f446745448d8a55850e43bc44c7` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:37.125767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58303ef-b1f5-4013-ac84-da55e02578c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c2d8f446745448d8a55850e43bc44c7)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:37.131996 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58303ef-b1f5-4013-ac84-da55e02578c9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:37.293658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b58303ef-b1f5-4013-ac84-da55e02578c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c2d8f446745448d8a55850e43bc44c7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:37.311907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b58303ef-b1f5-4013-ac84-da55e02578c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c2d8f446745448d8a55850e43bc44c7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:37.312832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b58303ef-b1f5-4013-ac84-da55e02578c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c2d8f446745448d8a55850e43bc44c7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:37.313575 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b58303ef-b1f5-4013-ac84-da55e02578c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c2d8f446745448d8a55850e43bc44c7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:37.333558 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b58303ef-b1f5-4013-ac84-da55e02578c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c2d8f446745448d8a55850e43bc44c7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:37.375385 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3060/6088] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:16:36 2022] DELETE /identity/v3/users/9c2d8f446745448d8a55850e43bc44c7 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:16:38.570092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465ee04-153b-49fa-a972-4955906e5690 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:38.572307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a465ee04-153b-49fa-a972-4955906e5690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:38.594053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465ee04-153b-49fa-a972-4955906e5690 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:38.619895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:38.795493 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b20218-3a54-497a-8311-1c918b1d760f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:38.796087 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b20218-3a54-497a-8311-1c918b1d760f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:38.796381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b20218-3a54-497a-8311-1c918b1d760f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:38.796651 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b20218-3a54-497a-8311-1c918b1d760f admin admin] PATH_INFO: `/v3/projects/a27642b393f842b0bcd2934687f8324a` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:38.800998 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b20218-3a54-497a-8311-1c918b1d760f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a27642b393f842b0bcd2934687f8324a)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:38.819080 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b20218-3a54-497a-8311-1c918b1d760f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:38.938095 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-21b20218-3a54-497a-8311-1c918b1d760f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a27642b393f842b0bcd2934687f8324a', 'request_id': 'req-21b20218-3a54-497a-8311-1c918b1d760f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:38.952791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-21b20218-3a54-497a-8311-1c918b1d760f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a27642b393f842b0bcd2934687f8324a', 'request_id': 'req-21b20218-3a54-497a-8311-1c918b1d760f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:38.981109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-21b20218-3a54-497a-8311-1c918b1d760f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a27642b393f842b0bcd2934687f8324a', 'request_id': 'req-21b20218-3a54-497a-8311-1c918b1d760f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:39.040832 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-21b20218-3a54-497a-8311-1c918b1d760f admin admin] The token cache is being invalidate because project a27642b393f842b0bcd2934687f8324a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:16:39.041413 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-21b20218-3a54-497a-8311-1c918b1d760f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:39.042270 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-21b20218-3a54-497a-8311-1c918b1d760f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:39.053161 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3029/6089] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:16:38 2022] DELETE /identity/v3/projects/a27642b393f842b0bcd2934687f8324a => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:16:39.058644 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec23a4-d9f8-40d5-8e0b-f37739d7fc6c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:39.059518 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec23a4-d9f8-40d5-8e0b-f37739d7fc6c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:39.060738 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec23a4-d9f8-40d5-8e0b-f37739d7fc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:39.087346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:39.112360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-8fec23a4-d9f8-40d5-8e0b-f37739d7fc6c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:16:39.113906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8fec23a4-d9f8-40d5-8e0b-f37739d7fc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:39.261008 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3061/6090] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:16:39.269246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00f015-75b3-48c6-9c1a-3d22650a9874 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:39.269588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00f015-75b3-48c6-9c1a-3d22650a9874 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:39.270109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00f015-75b3-48c6-9c1a-3d22650a9874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:39.324614 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-9e00f015-75b3-48c6-9c1a-3d22650a9874 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:16:39.330836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9e00f015-75b3-48c6-9c1a-3d22650a9874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:39.352021 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3030/6091] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:16:39.356144 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec23a4-d9f8-40d5-8e0b-f37739d7fc6c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:39.375736 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec23a4-d9f8-40d5-8e0b-f37739d7fc6c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:39.384777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ad666-9cec-41cf-af1e-31a2ccd841a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:39.386987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ad666-9cec-41cf-af1e-31a2ccd841a0 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:39.387313 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ad666-9cec-41cf-af1e-31a2ccd841a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:39.387596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ad666-9cec-41cf-af1e-31a2ccd841a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:39.388866 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ad666-9cec-41cf-af1e-31a2ccd841a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:16:39.389340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ad666-9cec-41cf-af1e-31a2ccd841a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:39.395490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ad666-9cec-41cf-af1e-31a2ccd841a0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:39.429605 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3062/6092] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:16:39.435089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00f015-75b3-48c6-9c1a-3d22650a9874 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:39.452179 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00f015-75b3-48c6-9c1a-3d22650a9874 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:39.467020 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da604341-df4c-4432-8d79-fd9a3b8756e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:39.467691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da604341-df4c-4432-8d79-fd9a3b8756e7 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:39.469501 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da604341-df4c-4432-8d79-fd9a3b8756e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:39.469788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da604341-df4c-4432-8d79-fd9a3b8756e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:39.471534 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da604341-df4c-4432-8d79-fd9a3b8756e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:39.484773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da604341-df4c-4432-8d79-fd9a3b8756e7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:39.536831 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3031/6093] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:16:39 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:16:39.541119 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ad666-9cec-41cf-af1e-31a2ccd841a0 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:39.558954 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ad666-9cec-41cf-af1e-31a2ccd841a0 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:39.729022 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9a43c-6673-42ae-b7ad-7e278a18088f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:39.730112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9a43c-6673-42ae-b7ad-7e278a18088f admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:39.730863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9a43c-6673-42ae-b7ad-7e278a18088f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:39.731373 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9a43c-6673-42ae-b7ad-7e278a18088f admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:39.733166 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a9a43c-6673-42ae-b7ad-7e278a18088f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:39.741242 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a9a43c-6673-42ae-b7ad-7e278a18088f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:39.791204 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3063/6094] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:16:39 2022] POST /identity/v3/users => generated 292 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:16:39.797398 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da604341-df4c-4432-8d79-fd9a3b8756e7 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:39.825169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da604341-df4c-4432-8d79-fd9a3b8756e7 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:39.839578 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96e172-114b-412d-9891-fae2a7aba010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:39.840461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96e172-114b-412d-9891-fae2a7aba010 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:39.841517 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96e172-114b-412d-9891-fae2a7aba010 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:39.842009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96e172-114b-412d-9891-fae2a7aba010 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:39.842773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96e172-114b-412d-9891-fae2a7aba010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:39.854616 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96e172-114b-412d-9891-fae2a7aba010 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:39.894107 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3032/6095] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:16:39.895431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9a43c-6673-42ae-b7ad-7e278a18088f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:39.910080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9a43c-6673-42ae-b7ad-7e278a18088f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:39.925767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b921eb-4430-4b41-b3e2-4fdbade2f2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:39.926806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b921eb-4430-4b41-b3e2-4fdbade2f2af admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:39.927301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b921eb-4430-4b41-b3e2-4fdbade2f2af admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:39.927818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b921eb-4430-4b41-b3e2-4fdbade2f2af admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:39.928677 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b921eb-4430-4b41-b3e2-4fdbade2f2af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:39.930516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b921eb-4430-4b41-b3e2-4fdbade2f2af admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:39.956295 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3064/6096] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:16:39.961529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96e172-114b-412d-9891-fae2a7aba010 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:39.990241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96e172-114b-412d-9891-fae2a7aba010 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:40.003884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87348fd2-d252-402b-857a-4c932066079d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:40.004855 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87348fd2-d252-402b-857a-4c932066079d admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:40.005217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87348fd2-d252-402b-857a-4c932066079d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:40.005501 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87348fd2-d252-402b-857a-4c932066079d admin admin] PATH_INFO: `/v3/projects/3ebad9452fac436191c8d5a6d6ee9f58/users/98a8c37152914375bf3f6b78c4aece20/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:40.082651 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87348fd2-d252-402b-857a-4c932066079d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ebad9452fac436191c8d5a6d6ee9f58, user_id=98a8c37152914375bf3f6b78c4aece20, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:40.087278 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87348fd2-d252-402b-857a-4c932066079d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:40.124408 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3033/6097] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:16:39 2022] PUT /identity/v3/projects/3ebad9452fac436191c8d5a6d6ee9f58/users/98a8c37152914375bf3f6b78c4aece20/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:16:40.137557 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bf1d9-27ce-4da5-91fc-9dae07c37b4c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:40.139504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bf1d9-27ce-4da5-91fc-9dae07c37b4c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:40.140057 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bf1d9-27ce-4da5-91fc-9dae07c37b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:40.227147 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d30bf1d9-27ce-4da5-91fc-9dae07c37b4c None None] MFA Rules not processed for user `98a8c37152914375bf3f6b78c4aece20`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:16:40.236498 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d30bf1d9-27ce-4da5-91fc-9dae07c37b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:40.470080 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3065/6098] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:16:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:16:40.473492 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87348fd2-d252-402b-857a-4c932066079d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:40.611040 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:40.672955 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87348fd2-d252-402b-857a-4c932066079d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:40.690066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f9e3e-462a-46d0-98ae-e5e39196ad31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:40.690480 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f9e3e-462a-46d0-98ae-e5e39196ad31 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:40.690790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f9e3e-462a-46d0-98ae-e5e39196ad31 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:40.691066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f9e3e-462a-46d0-98ae-e5e39196ad31 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:40.691705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f9e3e-462a-46d0-98ae-e5e39196ad31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:40.693798 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f9e3e-462a-46d0-98ae-e5e39196ad31 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:40.758467 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3034/6099] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:16:40 2022] POST /identity/v3/projects => generated 383 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:16:40.762778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30bf1d9-27ce-4da5-91fc-9dae07c37b4c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:40.770631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:40.784691 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30bf1d9-27ce-4da5-91fc-9dae07c37b4c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:40.917064 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268cf8d-b865-4d70-8262-1e0142e72952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:40.918279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268cf8d-b865-4d70-8262-1e0142e72952 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:40.918755 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268cf8d-b865-4d70-8262-1e0142e72952 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:40.919708 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268cf8d-b865-4d70-8262-1e0142e72952 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:40.921009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a268cf8d-b865-4d70-8262-1e0142e72952 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:40.923452 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a268cf8d-b865-4d70-8262-1e0142e72952 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:41.013554 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3066/6100] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:16:40 2022] POST /identity/v3/users => generated 298 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:16:41.014335 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f9e3e-462a-46d0-98ae-e5e39196ad31 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:41.036121 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f9e3e-462a-46d0-98ae-e5e39196ad31 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:41.065211 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0186f4-56b6-415c-bb4c-f93ccac0d65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:41.065845 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0186f4-56b6-415c-bb4c-f93ccac0d65e admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:41.066128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0186f4-56b6-415c-bb4c-f93ccac0d65e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:41.066450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0186f4-56b6-415c-bb4c-f93ccac0d65e admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:41.073422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0186f4-56b6-415c-bb4c-f93ccac0d65e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:41.084214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0186f4-56b6-415c-bb4c-f93ccac0d65e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:41.169600 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3035/6101] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:16:41.169761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268cf8d-b865-4d70-8262-1e0142e72952 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:41.183644 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268cf8d-b865-4d70-8262-1e0142e72952 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:41.209830 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303bb5b0-9a53-4ed3-b917-185c610801c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:41.210864 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303bb5b0-9a53-4ed3-b917-185c610801c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:41.212024 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303bb5b0-9a53-4ed3-b917-185c610801c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:41.212402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303bb5b0-9a53-4ed3-b917-185c610801c8 admin admin] PATH_INFO: `/v3/projects/edc9c13c9de64277bf641f4a2a8fe72f/users/e945a0b00d2d4fd78f335b2c06f3f416/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:41.266319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303bb5b0-9a53-4ed3-b917-185c610801c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edc9c13c9de64277bf641f4a2a8fe72f, user_id=e945a0b00d2d4fd78f335b2c06f3f416, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:41.270340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303bb5b0-9a53-4ed3-b917-185c610801c8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:41.311988 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3067/6102] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:16:41 2022] PUT /identity/v3/projects/edc9c13c9de64277bf641f4a2a8fe72f/users/e945a0b00d2d4fd78f335b2c06f3f416/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:16:41.318713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0186f4-56b6-415c-bb4c-f93ccac0d65e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:41.346491 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0186f4-56b6-415c-bb4c-f93ccac0d65e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:41.583531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddea123-1d13-48b1-a67a-39130ed0cd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:41.584176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddea123-1d13-48b1-a67a-39130ed0cd0e admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:41.584460 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddea123-1d13-48b1-a67a-39130ed0cd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:41.584743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddea123-1d13-48b1-a67a-39130ed0cd0e admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:41.585405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddea123-1d13-48b1-a67a-39130ed0cd0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:41.587106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddea123-1d13-48b1-a67a-39130ed0cd0e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:41.623719 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3036/6103] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:16:41.627708 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303bb5b0-9a53-4ed3-b917-185c610801c8 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:41.647609 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303bb5b0-9a53-4ed3-b917-185c610801c8 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:41.671451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5133ad3-2f1d-4f71-9e31-f1aebb2c26c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:41.672305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5133ad3-2f1d-4f71-9e31-f1aebb2c26c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:41.672689 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5133ad3-2f1d-4f71-9e31-f1aebb2c26c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:41.673064 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5133ad3-2f1d-4f71-9e31-f1aebb2c26c0 admin admin] PATH_INFO: `/v3/projects/edc9c13c9de64277bf641f4a2a8fe72f/users/e945a0b00d2d4fd78f335b2c06f3f416/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:41.677116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5133ad3-2f1d-4f71-9e31-f1aebb2c26c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edc9c13c9de64277bf641f4a2a8fe72f, user_id=e945a0b00d2d4fd78f335b2c06f3f416, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:41.683887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5133ad3-2f1d-4f71-9e31-f1aebb2c26c0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:41.763397 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3068/6104] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:16:41 2022] PUT /identity/v3/projects/edc9c13c9de64277bf641f4a2a8fe72f/users/e945a0b00d2d4fd78f335b2c06f3f416/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:16:41.764583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a9deb-12ad-4e6e-971d-6e4fc526f7c3 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:41.765039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a9deb-12ad-4e6e-971d-6e4fc526f7c3 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:41.765418 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a9deb-12ad-4e6e-971d-6e4fc526f7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:41.769412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc5bd6-28a4-4c75-aa15-c21333b64f9c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:41.769703 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc5bd6-28a4-4c75-aa15-c21333b64f9c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:41.769986 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc5bd6-28a4-4c75-aa15-c21333b64f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:41.849180 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-1ffc5bd6-28a4-4c75-aa15-c21333b64f9c None None] MFA Rules not processed for user `9b8463a42f2642aaba586380391de6fd`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:16:41.849180 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1ffc5bd6-28a4-4c75-aa15-c21333b64f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:41.877414 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-2c7a9deb-12ad-4e6e-971d-6e4fc526f7c3 None None] MFA Rules not processed for user `e945a0b00d2d4fd78f335b2c06f3f416`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:16:41.879963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2c7a9deb-12ad-4e6e-971d-6e4fc526f7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:42.150397 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3069/6105] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:16:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:16:42.255628 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3037/6106] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:16:41 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 489 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:16:42.257101 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc5bd6-28a4-4c75-aa15-c21333b64f9c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:42.279518 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc5bd6-28a4-4c75-aa15-c21333b64f9c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:42.297171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e92a9-080d-4e06-be08-c8175b1a2e5a tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e945a0b00d2d4fd78f335b2c06f3f416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edc9c13c9de64277bf641f4a2a8fe72f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:42.298277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e92a9-080d-4e06-be08-c8175b1a2e5a tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:42.298655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e92a9-080d-4e06-be08-c8175b1a2e5a tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:42.298946 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e92a9-080d-4e06-be08-c8175b1a2e5a tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:42.300659 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e92a9-080d-4e06-be08-c8175b1a2e5a tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:42.302504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e92a9-080d-4e06-be08-c8175b1a2e5a tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:42.326303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-389e92a9-080d-4e06-be08-c8175b1a2e5a tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Invalid input for field 'name': '' is too short Aug 06 21:16:42.326303 ncdv-master-1 devstack@keystone.service[102759]: Failed validating 'minLength' in schema['properties']['name']: Aug 06 21:16:42.326303 ncdv-master-1 devstack@keystone.service[102759]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 06 21:16:42.326303 ncdv-master-1 devstack@keystone.service[102759]: On instance['name']: Aug 06 21:16:42.326303 ncdv-master-1 devstack@keystone.service[102759]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 06 21:16:42.326303 ncdv-master-1 devstack@keystone.service[102759]: Failed validating 'minLength' in schema['properties']['name']: Aug 06 21:16:42.326303 ncdv-master-1 devstack@keystone.service[102759]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 06 21:16:42.326303 ncdv-master-1 devstack@keystone.service[102759]: On instance['name']: Aug 06 21:16:42.326303 ncdv-master-1 devstack@keystone.service[102759]: '' Aug 06 21:16:42.326303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:16:42.326303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 06 21:16:42.326303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 06 21:16:42.326303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 21:16:42.326303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise error Aug 06 21:16:42.326303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Aug 06 21:16:42.326303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:16:42.326303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 06 21:16:42.326303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 06 21:16:42.326303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:16:42.326303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application On instance['name']: Aug 06 21:16:42.326303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application '' Aug 06 21:16:42.326303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:16:42.326303 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 21:16:42.328148 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:16:42.328148 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:16:42.328148 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:16:42.328148 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:16:42.328148 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:16:42.328148 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:16:42.328148 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:16:42.328148 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:16:42.328148 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:16:42.328148 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:16:42.328148 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:16:42.328148 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:16:42.328148 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Aug 06 21:16:42.328148 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Aug 06 21:16:42.328148 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 06 21:16:42.328148 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 06 21:16:42.328148 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 06 21:16:42.329242 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 06 21:16:42.329242 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 06 21:16:42.329242 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:16:42.329242 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 06 21:16:42.329242 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 06 21:16:42.329242 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:16:42.329242 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application On instance['name']: Aug 06 21:16:42.329242 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application '' Aug 06 21:16:42.329242 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:16:42.336625 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3070/6107] 10.222.0.33 () {60 vars in 1149 bytes} [Sat Aug 6 21:16:42 2022] POST /identity/v3/domains => generated 283 bytes in 79 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 06 21:16:42.340874 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a9deb-12ad-4e6e-971d-6e4fc526f7c3 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:42.360375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a9deb-12ad-4e6e-971d-6e4fc526f7c3 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:42.381551 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f9c74-a9ea-4af8-a0c7-de32ecc12941 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e945a0b00d2d4fd78f335b2c06f3f416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edc9c13c9de64277bf641f4a2a8fe72f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:42.383900 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f9c74-a9ea-4af8-a0c7-de32ecc12941 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:42.388407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f9c74-a9ea-4af8-a0c7-de32ecc12941 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:42.395143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f9c74-a9ea-4af8-a0c7-de32ecc12941 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:42.396407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f9c74-a9ea-4af8-a0c7-de32ecc12941 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:42.408865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f9c74-a9ea-4af8-a0c7-de32ecc12941 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:42.445946 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-3c4f9c74-a9ea-4af8-a0c7-de32ecc12941 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 06 21:16:42.445946 ncdv-master-1 devstack@keystone.service[102758]: Failed validating 'maxLength' in schema['properties']['name']: Aug 06 21:16:42.445946 ncdv-master-1 devstack@keystone.service[102758]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 06 21:16:42.445946 ncdv-master-1 devstack@keystone.service[102758]: On instance['name']: Aug 06 21:16:42.445946 ncdv-master-1 devstack@keystone.service[102758]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 06 21:16:42.445946 ncdv-master-1 devstack@keystone.service[102758]: Failed validating 'maxLength' in schema['properties']['name']: Aug 06 21:16:42.445946 ncdv-master-1 devstack@keystone.service[102758]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 06 21:16:42.445946 ncdv-master-1 devstack@keystone.service[102758]: On instance['name']: Aug 06 21:16:42.445946 ncdv-master-1 devstack@keystone.service[102758]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 06 21:16:42.445946 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:16:42.445946 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 06 21:16:42.445946 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 06 21:16:42.445946 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 21:16:42.445946 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise error Aug 06 21:16:42.445946 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 06 21:16:42.445946 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:16:42.445946 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 06 21:16:42.445946 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 06 21:16:42.445946 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:16:42.447530 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application On instance['name']: Aug 06 21:16:42.447530 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 06 21:16:42.447530 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:16:42.447530 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 21:16:42.447530 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:16:42.447530 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:16:42.447530 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:16:42.447530 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:16:42.447530 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:16:42.447530 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:16:42.447530 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:16:42.447530 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:16:42.447530 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:16:42.447530 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:16:42.447530 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:16:42.447530 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:16:42.447530 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Aug 06 21:16:42.447530 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Aug 06 21:16:42.448690 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 06 21:16:42.448690 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 06 21:16:42.448690 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 06 21:16:42.448690 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 06 21:16:42.448690 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 06 21:16:42.448690 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:16:42.448690 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 06 21:16:42.448690 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 06 21:16:42.448690 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:16:42.448690 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application On instance['name']: Aug 06 21:16:42.448690 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 06 21:16:42.448690 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:16:42.457355 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3038/6108] 10.222.0.33 () {60 vars in 1149 bytes} [Sat Aug 6 21:16:42 2022] POST /identity/v3/domains => generated 412 bytes in 117 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 06 21:16:42.463250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e92a9-080d-4e06-be08-c8175b1a2e5a tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:42.486457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e92a9-080d-4e06-be08-c8175b1a2e5a tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:42.518096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909615f-1cab-48ad-8ea2-e918f163635d tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e945a0b00d2d4fd78f335b2c06f3f416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edc9c13c9de64277bf641f4a2a8fe72f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:42.519979 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909615f-1cab-48ad-8ea2-e918f163635d tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:42.520533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909615f-1cab-48ad-8ea2-e918f163635d tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:42.521062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909615f-1cab-48ad-8ea2-e918f163635d tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:42.522014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909615f-1cab-48ad-8ea2-e918f163635d tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:42.523968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909615f-1cab-48ad-8ea2-e918f163635d tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:42.584440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f9c74-a9ea-4af8-a0c7-de32ecc12941 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:42.590920 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3071/6109] 10.222.0.33 () {60 vars in 1149 bytes} [Sat Aug 6 21:16:42 2022] POST /identity/v3/domains => generated 276 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:16:42.602129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f9c74-a9ea-4af8-a0c7-de32ecc12941 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:42.709076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:42.823154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6e112-c64c-4632-ab70-ea836178650f tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e945a0b00d2d4fd78f335b2c06f3f416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edc9c13c9de64277bf641f4a2a8fe72f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:42.824060 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6e112-c64c-4632-ab70-ea836178650f tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:42.824529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6e112-c64c-4632-ab70-ea836178650f tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:42.825402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6e112-c64c-4632-ab70-ea836178650f tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] PATH_INFO: `/v3/domains/63f139aeda1a455c821fcc9adb6da657` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:42.863307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a6e112-c64c-4632-ab70-ea836178650f tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=63f139aeda1a455c821fcc9adb6da657)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:42.865500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a6e112-c64c-4632-ab70-ea836178650f tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:42.919623 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-f9a6e112-c64c-4632-ab70-ea836178650f tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Aug 06 21:16:42.919623 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:16:42.919623 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:16:42.919623 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:16:42.919623 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:16:42.919623 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:16:42.919623 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:16:42.919623 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:16:42.919623 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:16:42.919623 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:16:42.919623 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:16:42.919623 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:16:42.919623 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Aug 06 21:16:42.919623 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Aug 06 21:16:42.920911 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:16:42.920911 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:16:42.920911 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Aug 06 21:16:42.920911 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Aug 06 21:16:42.920911 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Aug 06 21:16:42.920911 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Aug 06 21:16:42.920911 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Aug 06 21:16:42.920911 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:16:42.936365 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909615f-1cab-48ad-8ea2-e918f163635d tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:42.946988 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3039/6110] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:16:42 2022] DELETE /identity/v3/domains/63f139aeda1a455c821fcc9adb6da657 => generated 120 bytes in 363 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:16:42.954059 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909615f-1cab-48ad-8ea2-e918f163635d tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:42.970451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2edece-fed1-444e-acf6-6b492d51b402 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e945a0b00d2d4fd78f335b2c06f3f416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edc9c13c9de64277bf641f4a2a8fe72f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:42.984912 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2edece-fed1-444e-acf6-6b492d51b402 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:42.985255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2edece-fed1-444e-acf6-6b492d51b402 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:42.988341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2edece-fed1-444e-acf6-6b492d51b402 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] PATH_INFO: `/v3/domains/63f139aeda1a455c821fcc9adb6da657` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:42.992555 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2edece-fed1-444e-acf6-6b492d51b402 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=63f139aeda1a455c821fcc9adb6da657)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:42.997460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2edece-fed1-444e-acf6-6b492d51b402 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:43.113100 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1c2edece-fed1-444e-acf6-6b492d51b402 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '63f139aeda1a455c821fcc9adb6da657'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:43.113882 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1c2edece-fed1-444e-acf6-6b492d51b402 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '63f139aeda1a455c821fcc9adb6da657'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:43.189729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:UPDATE=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:43.192756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1c2edece-fed1-444e-acf6-6b492d51b402 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '63f139aeda1a455c821fcc9adb6da657'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:43.193747 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1c2edece-fed1-444e-acf6-6b492d51b402 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '63f139aeda1a455c821fcc9adb6da657'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:43.196292 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3072/6111] 10.222.0.33 () {60 vars in 1249 bytes} [Sat Aug 6 21:16:42 2022] PATCH /identity/v3/domains/63f139aeda1a455c821fcc9adb6da657 => generated 277 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:16:43.200499 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6e112-c64c-4632-ab70-ea836178650f tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:43.202397 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f9a6e112-c64c-4632-ab70-ea836178650f tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:43.222398 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6e112-c64c-4632-ab70-ea836178650f tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:43.407522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9b8d6-1671-42e8-9417-aad3765c64c5 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e945a0b00d2d4fd78f335b2c06f3f416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edc9c13c9de64277bf641f4a2a8fe72f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:43.408983 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9b8d6-1671-42e8-9417-aad3765c64c5 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:43.410955 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9b8d6-1671-42e8-9417-aad3765c64c5 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:43.411368 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9b8d6-1671-42e8-9417-aad3765c64c5 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] PATH_INFO: `/v3/domains/63f139aeda1a455c821fcc9adb6da657` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:43.445943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf9b8d6-1671-42e8-9417-aad3765c64c5 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=63f139aeda1a455c821fcc9adb6da657)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:43.448412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf9b8d6-1671-42e8-9417-aad3765c64c5 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:43.542564 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5cf9b8d6-1671-42e8-9417-aad3765c64c5 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '63f139aeda1a455c821fcc9adb6da657'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:43.578942 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5cf9b8d6-1671-42e8-9417-aad3765c64c5 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '63f139aeda1a455c821fcc9adb6da657'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:43.709273 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5cf9b8d6-1671-42e8-9417-aad3765c64c5 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63f139aeda1a455c821fcc9adb6da657', 'request_id': 'req-5cf9b8d6-1671-42e8-9417-aad3765c64c5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:43.751633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5cf9b8d6-1671-42e8-9417-aad3765c64c5 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63f139aeda1a455c821fcc9adb6da657', 'request_id': 'req-5cf9b8d6-1671-42e8-9417-aad3765c64c5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:43.786573 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5cf9b8d6-1671-42e8-9417-aad3765c64c5 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63f139aeda1a455c821fcc9adb6da657', 'request_id': 'req-5cf9b8d6-1671-42e8-9417-aad3765c64c5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:43.810538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5cf9b8d6-1671-42e8-9417-aad3765c64c5 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] The token cache is being invalidate because project 63f139aeda1a455c821fcc9adb6da657 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:16:43.810538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5cf9b8d6-1671-42e8-9417-aad3765c64c5 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:43.811988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5cf9b8d6-1671-42e8-9417-aad3765c64c5 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:43.842965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:43.846497 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5cf9b8d6-1671-42e8-9417-aad3765c64c5 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '63f139aeda1a455c821fcc9adb6da657', 'request_id': 'req-5cf9b8d6-1671-42e8-9417-aad3765c64c5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:43.848352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5cf9b8d6-1671-42e8-9417-aad3765c64c5 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '63f139aeda1a455c821fcc9adb6da657', 'request_id': 'req-5cf9b8d6-1671-42e8-9417-aad3765c64c5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:43.849308 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5cf9b8d6-1671-42e8-9417-aad3765c64c5 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '63f139aeda1a455c821fcc9adb6da657', 'request_id': 'req-5cf9b8d6-1671-42e8-9417-aad3765c64c5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:43.876285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2edece-fed1-444e-acf6-6b492d51b402 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:43.878079 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3040/6112] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:16:43 2022] DELETE /identity/v3/domains/63f139aeda1a455c821fcc9adb6da657 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:16:43.896194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2edece-fed1-444e-acf6-6b492d51b402 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:44.039826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fe88b-0453-42b6-822b-59661f007071 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e945a0b00d2d4fd78f335b2c06f3f416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edc9c13c9de64277bf641f4a2a8fe72f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:44.040801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fe88b-0453-42b6-822b-59661f007071 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:44.041158 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fe88b-0453-42b6-822b-59661f007071 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:44.041555 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fe88b-0453-42b6-822b-59661f007071 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] PATH_INFO: `/v3/domains/ed4ddbee9c154fb3a318c5d91c9ac7dc` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:44.059170 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85fe88b-0453-42b6-822b-59661f007071 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 21:16:44.065480 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-f85fe88b-0453-42b6-822b-59661f007071 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Could not find domain: ed4ddbee9c154fb3a318c5d91c9ac7dc.: keystone.exception.DomainNotFound: Could not find domain: ed4ddbee9c154fb3a318c5d91c9ac7dc. Aug 06 21:16:44.065480 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:16:44.065480 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 06 21:16:44.065480 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 06 21:16:44.065480 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 21:16:44.065480 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 21:16:44.065480 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 21:16:44.065480 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 21:16:44.065480 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: ed4ddbee9c154fb3a318c5d91c9ac7dc. Aug 06 21:16:44.065480 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:16:44.065480 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 21:16:44.065480 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:16:44.065480 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:16:44.065480 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:16:44.065480 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:16:44.066634 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:16:44.066634 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:16:44.066634 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:16:44.066634 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:16:44.066634 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:16:44.066634 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:16:44.066634 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:16:44.066634 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:16:44.066634 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Aug 06 21:16:44.066634 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Aug 06 21:16:44.066634 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 21:16:44.066634 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 21:16:44.066634 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 21:16:44.066634 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 21:16:44.066634 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:16:44.066634 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:16:44.067680 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 21:16:44.067680 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 21:16:44.067680 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 21:16:44.067680 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 21:16:44.067680 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 21:16:44.067680 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 21:16:44.067680 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 21:16:44.067680 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 21:16:44.067680 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 21:16:44.067680 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 21:16:44.067680 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 21:16:44.067680 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 21:16:44.067680 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 21:16:44.067680 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 21:16:44.067680 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 06 21:16:44.067680 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 21:16:44.067680 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: ed4ddbee9c154fb3a318c5d91c9ac7dc. Aug 06 21:16:44.068860 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:16:44.082333 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3073/6113] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:16:43 2022] DELETE /identity/v3/domains/ed4ddbee9c154fb3a318c5d91c9ac7dc => generated 112 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:16:44.084770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9b8d6-1671-42e8-9417-aad3765c64c5 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:44.091643 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5cf9b8d6-1671-42e8-9417-aad3765c64c5 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:44.141002 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9b8d6-1671-42e8-9417-aad3765c64c5 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:44.171799 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf744d-c038-4741-9a62-bf608734e6bd tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e945a0b00d2d4fd78f335b2c06f3f416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edc9c13c9de64277bf641f4a2a8fe72f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:44.172595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf744d-c038-4741-9a62-bf608734e6bd tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:44.174500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf744d-c038-4741-9a62-bf608734e6bd tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:44.175629 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf744d-c038-4741-9a62-bf608734e6bd tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:44.177294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf744d-c038-4741-9a62-bf608734e6bd tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:44.180199 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf744d-c038-4741-9a62-bf608734e6bd tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:44.230576 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fe88b-0453-42b6-822b-59661f007071 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:44.246999 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3041/6114] 10.222.0.33 () {60 vars in 1149 bytes} [Sat Aug 6 21:16:44 2022] POST /identity/v3/domains => generated 252 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:16:44.261587 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fe88b-0453-42b6-822b-59661f007071 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:44.513756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f9d0a-3785-487f-8b4b-6ee30d76e40c tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e945a0b00d2d4fd78f335b2c06f3f416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edc9c13c9de64277bf641f4a2a8fe72f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:44.514459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f9d0a-3785-487f-8b4b-6ee30d76e40c tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:44.515755 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f9d0a-3785-487f-8b4b-6ee30d76e40c tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:44.516839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f9d0a-3785-487f-8b4b-6ee30d76e40c tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:44.518923 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f9d0a-3785-487f-8b4b-6ee30d76e40c tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:44.522065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f9d0a-3785-487f-8b4b-6ee30d76e40c tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:44.566261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.sql.core [None req-cf1f9d0a-3785-487f-8b4b-6ee30d76e40c tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-165789246' for key 'project.ixu_project_name_domain_id'") Aug 06 21:16:44.566261 ncdv-master-1 devstack@keystone.service[102759]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 06 21:16:44.566261 ncdv-master-1 devstack@keystone.service[102759]: [parameters: {'id': 'bce3a9293ac24e3f9d9efcef4c0283cd', 'name': 'tempest-domain-dup-165789246', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Aug 06 21:16:44.566261 ncdv-master-1 devstack@keystone.service[102759]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=102759) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 06 21:16:44.732147 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-cf1f9d0a-3785-487f-8b4b-6ee30d76e40c tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-165789246.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-165789246. Aug 06 21:16:44.732147 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:16:44.732147 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 06 21:16:44.732147 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 06 21:16:44.732147 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 06 21:16:44.732147 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 06 21:16:44.732147 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 06 21:16:44.732147 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application result = self._query(query) Aug 06 21:16:44.732147 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 06 21:16:44.732147 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application conn.query(q) Aug 06 21:16:44.732147 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 06 21:16:44.732147 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 06 21:16:44.732147 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 06 21:16:44.733291 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application result.read() Aug 06 21:16:44.733291 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 06 21:16:44.733291 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 06 21:16:44.733291 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 06 21:16:44.733291 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 06 21:16:44.733291 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 06 21:16:44.733291 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 06 21:16:44.733291 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 06 21:16:44.733291 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 06 21:16:44.733291 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-165789246' for key 'project.ixu_project_name_domain_id'") Aug 06 21:16:44.733291 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:16:44.733291 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 06 21:16:44.733291 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:16:44.733291 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:16:44.733291 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 06 21:16:44.733291 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 06 21:16:44.733291 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 06 21:16:44.733291 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 06 21:16:44.735086 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 06 21:16:44.735086 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application next(self.gen) Aug 06 21:16:44.735086 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 06 21:16:44.735086 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application yield resource Aug 06 21:16:44.735086 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 06 21:16:44.735086 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application next(self.gen) Aug 06 21:16:44.735086 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 06 21:16:44.735086 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application self.session.rollback() Aug 06 21:16:44.735086 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 21:16:44.735086 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application self.force_reraise() Aug 06 21:16:44.735086 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 21:16:44.735086 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise self.value Aug 06 21:16:44.735086 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 06 21:16:44.735086 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 06 21:16:44.735086 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 06 21:16:44.735086 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application session.commit() Aug 06 21:16:44.735086 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 06 21:16:44.736453 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 06 21:16:44.736453 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 06 21:16:44.736453 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application self._prepare_impl() Aug 06 21:16:44.736453 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 06 21:16:44.736453 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application self.session.flush() Aug 06 21:16:44.736453 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 06 21:16:44.736453 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application self._flush(objects) Aug 06 21:16:44.736453 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 06 21:16:44.736453 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 06 21:16:44.736453 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 06 21:16:44.736453 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application compat.raise_( Aug 06 21:16:44.736453 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 06 21:16:44.736453 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception Aug 06 21:16:44.736453 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 06 21:16:44.736453 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application flush_context.execute() Aug 06 21:16:44.736453 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 06 21:16:44.736453 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rec.execute(self) Aug 06 21:16:44.737832 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 06 21:16:44.737832 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 06 21:16:44.737832 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 06 21:16:44.737832 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 06 21:16:44.737832 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 06 21:16:44.737832 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 06 21:16:44.737832 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 06 21:16:44.737832 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 06 21:16:44.737832 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 06 21:16:44.737832 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 06 21:16:44.737832 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 06 21:16:44.737832 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 06 21:16:44.737832 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 06 21:16:44.737832 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 06 21:16:44.737832 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 06 21:16:44.739751 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 06 21:16:44.739751 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 06 21:16:44.739751 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception Aug 06 21:16:44.739751 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 06 21:16:44.739751 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 06 21:16:44.739751 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 06 21:16:44.739751 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 06 21:16:44.739751 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 06 21:16:44.739751 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application result = self._query(query) Aug 06 21:16:44.739751 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 06 21:16:44.739751 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application conn.query(q) Aug 06 21:16:44.739751 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 06 21:16:44.739751 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 06 21:16:44.739751 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 06 21:16:44.739751 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application result.read() Aug 06 21:16:44.739751 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 06 21:16:44.739751 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 06 21:16:44.742419 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 06 21:16:44.742419 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 06 21:16:44.742419 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 06 21:16:44.742419 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 06 21:16:44.742419 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 06 21:16:44.742419 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 06 21:16:44.742419 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-165789246' for key 'project.ixu_project_name_domain_id'") Aug 06 21:16:44.742419 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 06 21:16:44.742419 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [parameters: {'id': 'bce3a9293ac24e3f9d9efcef4c0283cd', 'name': 'tempest-domain-dup-165789246', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Aug 06 21:16:44.742419 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 06 21:16:44.742419 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:16:44.742419 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 21:16:44.742419 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:16:44.742419 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:16:44.745417 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 06 21:16:44.745417 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 06 21:16:44.745417 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 06 21:16:44.745417 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 06 21:16:44.745417 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-165789246. Aug 06 21:16:44.745417 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:16:44.745417 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 21:16:44.745417 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:16:44.745417 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:16:44.745417 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:16:44.745417 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:16:44.745417 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:16:44.745417 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:16:44.745417 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:16:44.745417 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:16:44.745417 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:16:44.745417 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:16:44.746825 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:16:44.746825 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:16:44.746825 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Aug 06 21:16:44.746825 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Aug 06 21:16:44.746825 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:16:44.746825 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:16:44.746825 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Aug 06 21:16:44.746825 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Aug 06 21:16:44.746825 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:16:44.746825 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:16:44.746825 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 06 21:16:44.746825 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 06 21:16:44.746825 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-165789246. Aug 06 21:16:44.746825 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:16:44.746825 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3074/6115] 10.222.0.33 () {60 vars in 1149 bytes} [Sat Aug 6 21:16:44 2022] POST /identity/v3/domains => generated 211 bytes in 514 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 06 21:16:44.752307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf744d-c038-4741-9a62-bf608734e6bd tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:44.785214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf744d-c038-4741-9a62-bf608734e6bd tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:44.802742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c8257-349d-4d81-8612-84a0bb12882f tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e945a0b00d2d4fd78f335b2c06f3f416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edc9c13c9de64277bf641f4a2a8fe72f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:44.805661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c8257-349d-4d81-8612-84a0bb12882f tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:44.807590 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c8257-349d-4d81-8612-84a0bb12882f tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:44.810315 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c8257-349d-4d81-8612-84a0bb12882f tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] PATH_INFO: `/v3/domains/8b80be4d79bf4e198c171707256005a3` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:44.841043 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c8257-349d-4d81-8612-84a0bb12882f tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8b80be4d79bf4e198c171707256005a3)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:44.844747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c8257-349d-4d81-8612-84a0bb12882f tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:44.926964 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d74c8257-349d-4d81-8612-84a0bb12882f tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8b80be4d79bf4e198c171707256005a3'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:44.928432 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d74c8257-349d-4d81-8612-84a0bb12882f tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8b80be4d79bf4e198c171707256005a3'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:45.020322 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d74c8257-349d-4d81-8612-84a0bb12882f tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8b80be4d79bf4e198c171707256005a3'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:45.021447 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d74c8257-349d-4d81-8612-84a0bb12882f tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8b80be4d79bf4e198c171707256005a3'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:45.030675 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3042/6116] 10.222.0.33 () {60 vars in 1249 bytes} [Sat Aug 6 21:16:44 2022] PATCH /identity/v3/domains/8b80be4d79bf4e198c171707256005a3 => generated 253 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:16:45.034648 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f9d0a-3785-487f-8b4b-6ee30d76e40c tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:45.036863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-cf1f9d0a-3785-487f-8b4b-6ee30d76e40c tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:45.065299 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f9d0a-3785-487f-8b4b-6ee30d76e40c tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:45.290708 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092a669-7085-43f0-b457-245e95973006 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e945a0b00d2d4fd78f335b2c06f3f416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edc9c13c9de64277bf641f4a2a8fe72f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:45.291901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092a669-7085-43f0-b457-245e95973006 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:45.292402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092a669-7085-43f0-b457-245e95973006 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:45.294469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092a669-7085-43f0-b457-245e95973006 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] PATH_INFO: `/v3/domains/8b80be4d79bf4e198c171707256005a3` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:45.332969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092a669-7085-43f0-b457-245e95973006 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8b80be4d79bf4e198c171707256005a3)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:45.336268 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092a669-7085-43f0-b457-245e95973006 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:45.399115 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f092a669-7085-43f0-b457-245e95973006 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8b80be4d79bf4e198c171707256005a3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:45.408341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f092a669-7085-43f0-b457-245e95973006 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8b80be4d79bf4e198c171707256005a3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:45.421581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:45.597911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f092a669-7085-43f0-b457-245e95973006 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b80be4d79bf4e198c171707256005a3', 'request_id': 'req-f092a669-7085-43f0-b457-245e95973006'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:45.626601 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f092a669-7085-43f0-b457-245e95973006 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b80be4d79bf4e198c171707256005a3', 'request_id': 'req-f092a669-7085-43f0-b457-245e95973006'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:45.642587 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f092a669-7085-43f0-b457-245e95973006 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b80be4d79bf4e198c171707256005a3', 'request_id': 'req-f092a669-7085-43f0-b457-245e95973006'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:45.658744 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f092a669-7085-43f0-b457-245e95973006 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] The token cache is being invalidate because project 8b80be4d79bf4e198c171707256005a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:16:45.659454 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f092a669-7085-43f0-b457-245e95973006 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:45.660957 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f092a669-7085-43f0-b457-245e95973006 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:45.706351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f092a669-7085-43f0-b457-245e95973006 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8b80be4d79bf4e198c171707256005a3', 'request_id': 'req-f092a669-7085-43f0-b457-245e95973006'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:45.713268 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f092a669-7085-43f0-b457-245e95973006 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8b80be4d79bf4e198c171707256005a3', 'request_id': 'req-f092a669-7085-43f0-b457-245e95973006'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:45.714035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f092a669-7085-43f0-b457-245e95973006 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8b80be4d79bf4e198c171707256005a3', 'request_id': 'req-f092a669-7085-43f0-b457-245e95973006'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:45.729990 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3075/6117] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:16:45 2022] DELETE /identity/v3/domains/8b80be4d79bf4e198c171707256005a3 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:16:45.732499 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c8257-349d-4d81-8612-84a0bb12882f tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:45.753927 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c8257-349d-4d81-8612-84a0bb12882f tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:45.884292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092a669-7085-43f0-b457-245e95973006 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:45.885853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f092a669-7085-43f0-b457-245e95973006 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:45.914911 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a37a5-4019-4ee8-a888-128f03b01ae6 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e945a0b00d2d4fd78f335b2c06f3f416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edc9c13c9de64277bf641f4a2a8fe72f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:45.917221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a37a5-4019-4ee8-a888-128f03b01ae6 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:45.917704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a37a5-4019-4ee8-a888-128f03b01ae6 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:45.918143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a37a5-4019-4ee8-a888-128f03b01ae6 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] PATH_INFO: `/v3/domains/63f139aeda1a455c821fcc9adb6da657` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:45.945675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539a37a5-4019-4ee8-a888-128f03b01ae6 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 21:16:45.978840 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-539a37a5-4019-4ee8-a888-128f03b01ae6 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Could not find domain: 63f139aeda1a455c821fcc9adb6da657.: keystone.exception.DomainNotFound: Could not find domain: 63f139aeda1a455c821fcc9adb6da657. Aug 06 21:16:45.978840 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:16:45.978840 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 06 21:16:45.978840 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 06 21:16:45.978840 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 21:16:45.978840 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 21:16:45.978840 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 21:16:45.978840 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 21:16:45.978840 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 63f139aeda1a455c821fcc9adb6da657. Aug 06 21:16:45.978840 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:16:45.978840 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 21:16:45.978840 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:16:45.978840 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:16:45.978840 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:16:45.978840 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:16:45.980104 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:16:45.980104 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:16:45.980104 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:16:45.980104 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:16:45.980104 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:16:45.980104 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:16:45.980104 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:16:45.980104 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:16:45.980104 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 06 21:16:45.980104 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 06 21:16:45.980104 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 21:16:45.980104 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 21:16:45.980104 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 21:16:45.980104 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 21:16:45.980104 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:16:45.980104 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:16:45.981378 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 21:16:45.981378 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 21:16:45.981378 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 21:16:45.981378 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 21:16:45.981378 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 21:16:45.981378 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 21:16:45.981378 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 21:16:45.981378 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 21:16:45.981378 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 21:16:45.981378 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 21:16:45.981378 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 21:16:45.981378 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 21:16:45.981378 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 21:16:45.981378 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 21:16:45.981378 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 06 21:16:45.981378 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 21:16:45.981378 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 63f139aeda1a455c821fcc9adb6da657. Aug 06 21:16:45.982703 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:16:45.994378 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3043/6118] 10.222.0.33 () {60 vars in 1249 bytes} [Sat Aug 6 21:16:45 2022] PATCH /identity/v3/domains/63f139aeda1a455c821fcc9adb6da657 => generated 112 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:16:45.996517 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a37a5-4019-4ee8-a888-128f03b01ae6 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:46.010872 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-539a37a5-4019-4ee8-a888-128f03b01ae6 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:46.216168 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092a669-7085-43f0-b457-245e95973006 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:46.255510 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30665a5-da10-4b0c-8524-463cd8fe2174 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:46.260733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30665a5-da10-4b0c-8524-463cd8fe2174 service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:46.264962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30665a5-da10-4b0c-8524-463cd8fe2174 service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:46.265944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30665a5-da10-4b0c-8524-463cd8fe2174 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:46.282903 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d30665a5-da10-4b0c-8524-463cd8fe2174 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:46.368363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30665a5-da10-4b0c-8524-463cd8fe2174 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:46.372684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30665a5-da10-4b0c-8524-463cd8fe2174 service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:46.463349 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a37a5-4019-4ee8-a888-128f03b01ae6 tempest-DomainsNegativeTestJSON-1024937377 tempest-DomainsNegativeTestJSON-1024937377-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:46.464784 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3076/6119] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:16:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:16:46.466494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30665a5-da10-4b0c-8524-463cd8fe2174 service placement] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:46.480283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d30665a5-da10-4b0c-8524-463cd8fe2174 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:46.492808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f2103-ba9d-441d-a3e3-73286ccbbbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:46.499407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f2103-ba9d-441d-a3e3-73286ccbbbaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:46.508446 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f2103-ba9d-441d-a3e3-73286ccbbbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:46.508836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f2103-ba9d-441d-a3e3-73286ccbbbaa admin admin] PATH_INFO: `/v3/users/98a8c37152914375bf3f6b78c4aece20` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:46.519899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f2103-ba9d-441d-a3e3-73286ccbbbaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=98a8c37152914375bf3f6b78c4aece20)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:46.531539 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f2103-ba9d-441d-a3e3-73286ccbbbaa admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:46.579408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30665a5-da10-4b0c-8524-463cd8fe2174 service placement] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:46.620256 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d39c4-7d16-4126-a3bc-85e369e62ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:46.625845 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d39c4-7d16-4126-a3bc-85e369e62ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:46.626129 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d39c4-7d16-4126-a3bc-85e369e62ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:46.626411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d39c4-7d16-4126-a3bc-85e369e62ae4 admin admin] PATH_INFO: `/v3/users/a6c953ff2f774041a7d50f53033ee124` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:46.638754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d39c4-7d16-4126-a3bc-85e369e62ae4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6c953ff2f774041a7d50f53033ee124)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:46.640718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d39c4-7d16-4126-a3bc-85e369e62ae4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:46.770694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:46.824420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7d3f2103-ba9d-441d-a3e3-73286ccbbbaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98a8c37152914375bf3f6b78c4aece20'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:46.843126 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7d3f2103-ba9d-441d-a3e3-73286ccbbbaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98a8c37152914375bf3f6b78c4aece20'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:46.845046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7d3f2103-ba9d-441d-a3e3-73286ccbbbaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98a8c37152914375bf3f6b78c4aece20'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:46.872354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7d3f2103-ba9d-441d-a3e3-73286ccbbbaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98a8c37152914375bf3f6b78c4aece20'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:46.875598 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9d4d39c4-7d16-4126-a3bc-85e369e62ae4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6c953ff2f774041a7d50f53033ee124'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:46.909380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9d4d39c4-7d16-4126-a3bc-85e369e62ae4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6c953ff2f774041a7d50f53033ee124'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:46.911810 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7d3f2103-ba9d-441d-a3e3-73286ccbbbaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98a8c37152914375bf3f6b78c4aece20'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:46.913056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9d4d39c4-7d16-4126-a3bc-85e369e62ae4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6c953ff2f774041a7d50f53033ee124'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:46.917226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9d4d39c4-7d16-4126-a3bc-85e369e62ae4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6c953ff2f774041a7d50f53033ee124'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:46.940878 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:46.961481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9d4d39c4-7d16-4126-a3bc-85e369e62ae4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6c953ff2f774041a7d50f53033ee124'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:46.972294 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3044/6120] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:16:45 2022] DELETE /identity/v3/users/98a8c37152914375bf3f6b78c4aece20 => generated 0 bytes in 977 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:16:46.980944 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f2103-ba9d-441d-a3e3-73286ccbbbaa admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:46.988583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7d3f2103-ba9d-441d-a3e3-73286ccbbbaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:47.024232 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3077/6121] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:16:46 2022] DELETE /identity/v3/users/a6c953ff2f774041a7d50f53033ee124 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:16:47.030174 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b07f1-66d9-40b7-9661-dea10c935b2e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:47.030780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b07f1-66d9-40b7-9661-dea10c935b2e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:47.032373 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b07f1-66d9-40b7-9661-dea10c935b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:47.102800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-929b07f1-66d9-40b7-9661-dea10c935b2e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:16:47.104015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-929b07f1-66d9-40b7-9661-dea10c935b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:47.240598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f2103-ba9d-441d-a3e3-73286ccbbbaa admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:47.300181 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3078/6122] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:16:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:16:47.331592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b07f1-66d9-40b7-9661-dea10c935b2e None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:47.333292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-929b07f1-66d9-40b7-9661-dea10c935b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:47.474289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bb43d-6057-4356-ad6e-1367cf70c47e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:47.474943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bb43d-6057-4356-ad6e-1367cf70c47e service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:47.475219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bb43d-6057-4356-ad6e-1367cf70c47e service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:47.475495 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bb43d-6057-4356-ad6e-1367cf70c47e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:47.478457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-157bb43d-6057-4356-ad6e-1367cf70c47e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:47.529838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157bb43d-6057-4356-ad6e-1367cf70c47e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:47.535572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157bb43d-6057-4356-ad6e-1367cf70c47e service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:47.552665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b07f1-66d9-40b7-9661-dea10c935b2e None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:47.560451 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3045/6123] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:16:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:16:47.561790 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ea382-3693-49ac-baa3-e688f0f29b0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:47.562408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ea382-3693-49ac-baa3-e688f0f29b0c service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:47.562714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ea382-3693-49ac-baa3-e688f0f29b0c service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:47.563167 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ea382-3693-49ac-baa3-e688f0f29b0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:47.589975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ea382-3693-49ac-baa3-e688f0f29b0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:47.590975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ea382-3693-49ac-baa3-e688f0f29b0c service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:47.623872 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3079/6124] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:16:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:16:48.519051 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bb43d-6057-4356-ad6e-1367cf70c47e service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:48.526346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-157bb43d-6057-4356-ad6e-1367cf70c47e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:48.553933 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bb43d-6057-4356-ad6e-1367cf70c47e service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:48.566621 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e97d2-a371-4664-a154-04bea36330a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:48.567577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e97d2-a371-4664-a154-04bea36330a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:48.568024 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e97d2-a371-4664-a154-04bea36330a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:48.568454 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e97d2-a371-4664-a154-04bea36330a0 admin admin] PATH_INFO: `/v3/projects/da1a7d63a1a048df9cdf8e86a26b4086` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:48.573409 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e97d2-a371-4664-a154-04bea36330a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da1a7d63a1a048df9cdf8e86a26b4086)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:48.576197 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e97d2-a371-4664-a154-04bea36330a0 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:48.658168 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:48.702048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d35e97d2-a371-4664-a154-04bea36330a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da1a7d63a1a048df9cdf8e86a26b4086', 'request_id': 'req-d35e97d2-a371-4664-a154-04bea36330a0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:48.739113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d35e97d2-a371-4664-a154-04bea36330a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da1a7d63a1a048df9cdf8e86a26b4086', 'request_id': 'req-d35e97d2-a371-4664-a154-04bea36330a0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:48.758228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d35e97d2-a371-4664-a154-04bea36330a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da1a7d63a1a048df9cdf8e86a26b4086', 'request_id': 'req-d35e97d2-a371-4664-a154-04bea36330a0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:48.791272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d35e97d2-a371-4664-a154-04bea36330a0 admin admin] The token cache is being invalidate because project da1a7d63a1a048df9cdf8e86a26b4086 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:16:48.791430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d35e97d2-a371-4664-a154-04bea36330a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:48.792325 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d35e97d2-a371-4664-a154-04bea36330a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:48.795354 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3046/6125] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:16:48 2022] DELETE /identity/v3/projects/da1a7d63a1a048df9cdf8e86a26b4086 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:16:48.801612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a545c-6989-4553-a976-b29c5fac7df3 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:48.802529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a545c-6989-4553-a976-b29c5fac7df3 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:48.803007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a545c-6989-4553-a976-b29c5fac7df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:48.900179 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-928a545c-6989-4553-a976-b29c5fac7df3 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:16:48.901841 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-928a545c-6989-4553-a976-b29c5fac7df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:49.046094 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3080/6126] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:16:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:16:49.054686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9dbaa-ee17-41d1-b713-9722bc8f2e13 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:49.058004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9dbaa-ee17-41d1-b713-9722bc8f2e13 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:49.058260 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9dbaa-ee17-41d1-b713-9722bc8f2e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:49.100314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a3c9dbaa-ee17-41d1-b713-9722bc8f2e13 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:16:49.103975 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a3c9dbaa-ee17-41d1-b713-9722bc8f2e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:49.133836 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3047/6127] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:16:49.137959 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a545c-6989-4553-a976-b29c5fac7df3 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:49.151425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a545c-6989-4553-a976-b29c5fac7df3 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:49.165688 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7654c-ec3c-4bac-829a-4335c97e28c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:49.166324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7654c-ec3c-4bac-829a-4335c97e28c5 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:49.167254 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7654c-ec3c-4bac-829a-4335c97e28c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:49.167545 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7654c-ec3c-4bac-829a-4335c97e28c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:49.168293 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d7654c-ec3c-4bac-829a-4335c97e28c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:16:49.169156 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d7654c-ec3c-4bac-829a-4335c97e28c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:49.172419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d7654c-ec3c-4bac-829a-4335c97e28c5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:49.200609 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3081/6128] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:16:49.205095 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9dbaa-ee17-41d1-b713-9722bc8f2e13 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:49.217813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9dbaa-ee17-41d1-b713-9722bc8f2e13 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:49.230171 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81680bfd-aa12-4425-8aea-d412377c0a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:49.230400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81680bfd-aa12-4425-8aea-d412377c0a0b admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:49.230710 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81680bfd-aa12-4425-8aea-d412377c0a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:49.232596 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81680bfd-aa12-4425-8aea-d412377c0a0b admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:49.234471 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81680bfd-aa12-4425-8aea-d412377c0a0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:49.239221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81680bfd-aa12-4425-8aea-d412377c0a0b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:49.302163 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3048/6129] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:16:49 2022] POST /identity/v3/projects => generated 389 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:16:49.306576 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7654c-ec3c-4bac-829a-4335c97e28c5 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:49.325891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7654c-ec3c-4bac-829a-4335c97e28c5 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:49.333921 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:49.557524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f4cc3-7d5f-4952-9308-f68d39c6c846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:49.558154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f4cc3-7d5f-4952-9308-f68d39c6c846 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:49.558441 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f4cc3-7d5f-4952-9308-f68d39c6c846 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:49.558825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f4cc3-7d5f-4952-9308-f68d39c6c846 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:49.565604 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f4cc3-7d5f-4952-9308-f68d39c6c846 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:49.567612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f4cc3-7d5f-4952-9308-f68d39c6c846 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:49.628807 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3082/6130] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:16:49 2022] POST /identity/v3/users => generated 295 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:16:49.633350 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81680bfd-aa12-4425-8aea-d412377c0a0b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:49.650353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81680bfd-aa12-4425-8aea-d412377c0a0b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:49.682282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742da9da-2e62-4cd3-9684-3e8e5dd5ce5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:49.683241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742da9da-2e62-4cd3-9684-3e8e5dd5ce5b admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:49.683519 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742da9da-2e62-4cd3-9684-3e8e5dd5ce5b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:49.683790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742da9da-2e62-4cd3-9684-3e8e5dd5ce5b admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:49.684991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742da9da-2e62-4cd3-9684-3e8e5dd5ce5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:49.686617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742da9da-2e62-4cd3-9684-3e8e5dd5ce5b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:49.704430 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3049/6131] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:16:49.708539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f4cc3-7d5f-4952-9308-f68d39c6c846 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:49.721354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f4cc3-7d5f-4952-9308-f68d39c6c846 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:49.735684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7359f2-932d-4838-856b-67392ee6c578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:49.736703 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7359f2-932d-4838-856b-67392ee6c578 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:49.737215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7359f2-932d-4838-856b-67392ee6c578 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:49.737707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7359f2-932d-4838-856b-67392ee6c578 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:49.738627 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7359f2-932d-4838-856b-67392ee6c578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:49.741430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7359f2-932d-4838-856b-67392ee6c578 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:49.767462 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3083/6132] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:16:49.771385 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742da9da-2e62-4cd3-9684-3e8e5dd5ce5b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:49.785908 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742da9da-2e62-4cd3-9684-3e8e5dd5ce5b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:49.796876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5dcf6-fe9c-413d-b2a5-44a58397f42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:49.799106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5dcf6-fe9c-413d-b2a5-44a58397f42e admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:49.800778 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5dcf6-fe9c-413d-b2a5-44a58397f42e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:49.801227 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5dcf6-fe9c-413d-b2a5-44a58397f42e admin admin] PATH_INFO: `/v3/projects/cfb3b91ed1294ea187812b7312601b27/users/65e64ff8f2b14f70b1b05327f691701e/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:49.857003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5dcf6-fe9c-413d-b2a5-44a58397f42e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfb3b91ed1294ea187812b7312601b27, user_id=65e64ff8f2b14f70b1b05327f691701e, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:49.861791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5dcf6-fe9c-413d-b2a5-44a58397f42e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:49.906067 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3050/6133] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:16:49 2022] PUT /identity/v3/projects/cfb3b91ed1294ea187812b7312601b27/users/65e64ff8f2b14f70b1b05327f691701e/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:16:49.911248 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4bfca-ace8-49ac-b1a0-0289dbe7ba15 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:49.912228 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4bfca-ace8-49ac-b1a0-0289dbe7ba15 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:49.912797 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4bfca-ace8-49ac-b1a0-0289dbe7ba15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:49.948411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a2f4bfca-ace8-49ac-b1a0-0289dbe7ba15 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:16:49.950216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a2f4bfca-ace8-49ac-b1a0-0289dbe7ba15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:50.110063 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3084/6134] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:16:50.245919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5dcf6-fe9c-413d-b2a5-44a58397f42e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:50.248279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-18a5dcf6-fe9c-413d-b2a5-44a58397f42e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:50.254041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4bfca-ace8-49ac-b1a0-0289dbe7ba15 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:50.255771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a2f4bfca-ace8-49ac-b1a0-0289dbe7ba15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:50.295565 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5dcf6-fe9c-413d-b2a5-44a58397f42e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:50.322494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183e9ca-5618-4655-9461-9e497248b08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:50.323183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183e9ca-5618-4655-9461-9e497248b08b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:50.323466 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183e9ca-5618-4655-9461-9e497248b08b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:50.323742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183e9ca-5618-4655-9461-9e497248b08b admin admin] PATH_INFO: `/v3/projects/3ebad9452fac436191c8d5a6d6ee9f58` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:50.327484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9183e9ca-5618-4655-9461-9e497248b08b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ebad9452fac436191c8d5a6d6ee9f58)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:50.358155 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9183e9ca-5618-4655-9461-9e497248b08b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:50.483661 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4bfca-ace8-49ac-b1a0-0289dbe7ba15 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:50.492809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef8ec8-5295-438c-b787-7b6addee1b95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:50.495014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef8ec8-5295-438c-b787-7b6addee1b95 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:50.495707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef8ec8-5295-438c-b787-7b6addee1b95 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:50.496096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef8ec8-5295-438c-b787-7b6addee1b95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:50.524775 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef8ec8-5295-438c-b787-7b6addee1b95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:50.533081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef8ec8-5295-438c-b787-7b6addee1b95 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:50.543702 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9183e9ca-5618-4655-9461-9e497248b08b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ebad9452fac436191c8d5a6d6ee9f58', 'request_id': 'req-9183e9ca-5618-4655-9461-9e497248b08b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:50.557193 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9183e9ca-5618-4655-9461-9e497248b08b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ebad9452fac436191c8d5a6d6ee9f58', 'request_id': 'req-9183e9ca-5618-4655-9461-9e497248b08b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:50.570168 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3085/6135] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:16:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:16:50.574086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9183e9ca-5618-4655-9461-9e497248b08b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ebad9452fac436191c8d5a6d6ee9f58', 'request_id': 'req-9183e9ca-5618-4655-9461-9e497248b08b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:50.606219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9183e9ca-5618-4655-9461-9e497248b08b admin admin] The token cache is being invalidate because project 3ebad9452fac436191c8d5a6d6ee9f58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:16:50.606471 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9183e9ca-5618-4655-9461-9e497248b08b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:50.607360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9183e9ca-5618-4655-9461-9e497248b08b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:50.612219 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3051/6136] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:16:50 2022] DELETE /identity/v3/projects/3ebad9452fac436191c8d5a6d6ee9f58 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:16:50.616160 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef8ec8-5295-438c-b787-7b6addee1b95 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:50.633114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef8ec8-5295-438c-b787-7b6addee1b95 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:50.753766 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:50.796161 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3ceae-e21f-4375-9521-d4c481d6bb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:50.797133 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3ceae-e21f-4375-9521-d4c481d6bb73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:50.797527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3ceae-e21f-4375-9521-d4c481d6bb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:50.798019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3ceae-e21f-4375-9521-d4c481d6bb73 admin admin] PATH_INFO: `/v3/users/e945a0b00d2d4fd78f335b2c06f3f416` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:50.799462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3ceae-e21f-4375-9521-d4c481d6bb73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e945a0b00d2d4fd78f335b2c06f3f416)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:50.802407 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3ceae-e21f-4375-9521-d4c481d6bb73 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:50.900017 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-40e3ceae-e21f-4375-9521-d4c481d6bb73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e945a0b00d2d4fd78f335b2c06f3f416'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:50.912049 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-40e3ceae-e21f-4375-9521-d4c481d6bb73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e945a0b00d2d4fd78f335b2c06f3f416'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:50.917535 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-40e3ceae-e21f-4375-9521-d4c481d6bb73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e945a0b00d2d4fd78f335b2c06f3f416'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:50.919114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-40e3ceae-e21f-4375-9521-d4c481d6bb73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e945a0b00d2d4fd78f335b2c06f3f416'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:50.949074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-40e3ceae-e21f-4375-9521-d4c481d6bb73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e945a0b00d2d4fd78f335b2c06f3f416'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:50.990406 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3086/6137] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:16:50 2022] DELETE /identity/v3/users/e945a0b00d2d4fd78f335b2c06f3f416 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:16:52.831527 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183e9ca-5618-4655-9461-9e497248b08b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:52.831527 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9183e9ca-5618-4655-9461-9e497248b08b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:52.872618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183e9ca-5618-4655-9461-9e497248b08b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:53.073670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:53.143508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a5b10-f06a-4d73-be26-9c30c1253555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:53.144650 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a5b10-f06a-4d73-be26-9c30c1253555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:53.145107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a5b10-f06a-4d73-be26-9c30c1253555 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:53.145551 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a5b10-f06a-4d73-be26-9c30c1253555 admin admin] PATH_INFO: `/v3/projects/edc9c13c9de64277bf641f4a2a8fe72f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:53.147058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a5b10-f06a-4d73-be26-9c30c1253555 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edc9c13c9de64277bf641f4a2a8fe72f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:53.149666 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a5b10-f06a-4d73-be26-9c30c1253555 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:53.267595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-108a5b10-f06a-4d73-be26-9c30c1253555 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edc9c13c9de64277bf641f4a2a8fe72f', 'request_id': 'req-108a5b10-f06a-4d73-be26-9c30c1253555'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:53.285405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-108a5b10-f06a-4d73-be26-9c30c1253555 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edc9c13c9de64277bf641f4a2a8fe72f', 'request_id': 'req-108a5b10-f06a-4d73-be26-9c30c1253555'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:53.301621 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-108a5b10-f06a-4d73-be26-9c30c1253555 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edc9c13c9de64277bf641f4a2a8fe72f', 'request_id': 'req-108a5b10-f06a-4d73-be26-9c30c1253555'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:53.332867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-108a5b10-f06a-4d73-be26-9c30c1253555 admin admin] The token cache is being invalidate because project edc9c13c9de64277bf641f4a2a8fe72f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:16:53.335063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-108a5b10-f06a-4d73-be26-9c30c1253555 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:53.337506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-108a5b10-f06a-4d73-be26-9c30c1253555 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:53.360636 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3052/6138] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:16:52 2022] DELETE /identity/v3/projects/edc9c13c9de64277bf641f4a2a8fe72f => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:16:53.365560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04347f62-4f26-4897-acfc-fc02e7f997eb None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:53.371178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04347f62-4f26-4897-acfc-fc02e7f997eb None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:53.372214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04347f62-4f26-4897-acfc-fc02e7f997eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:53.431471 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-04347f62-4f26-4897-acfc-fc02e7f997eb None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:16:53.435894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-04347f62-4f26-4897-acfc-fc02e7f997eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:53.725457 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3087/6139] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:16:53.735171 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a48c4-cd3f-4e45-b88e-b0eef47d8dc7 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:53.735460 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a48c4-cd3f-4e45-b88e-b0eef47d8dc7 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:53.735738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a48c4-cd3f-4e45-b88e-b0eef47d8dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:53.800581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-245a48c4-cd3f-4e45-b88e-b0eef47d8dc7 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:16:53.801824 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-245a48c4-cd3f-4e45-b88e-b0eef47d8dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:53.839164 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3053/6140] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:16:53.843599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04347f62-4f26-4897-acfc-fc02e7f997eb None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:53.866391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04347f62-4f26-4897-acfc-fc02e7f997eb None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:53.915277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b0d57-b5c1-4444-bd83-58563433676a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:53.917301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b0d57-b5c1-4444-bd83-58563433676a admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:53.931777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b0d57-b5c1-4444-bd83-58563433676a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:53.932399 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b0d57-b5c1-4444-bd83-58563433676a admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:53.933341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b0d57-b5c1-4444-bd83-58563433676a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:16:53.934896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b0d57-b5c1-4444-bd83-58563433676a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:53.937660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b0d57-b5c1-4444-bd83-58563433676a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:53.973464 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3088/6141] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:16:53.973950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a48c4-cd3f-4e45-b88e-b0eef47d8dc7 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:53.991572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a48c4-cd3f-4e45-b88e-b0eef47d8dc7 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:54.009395 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a666d-4a76-43c5-9aa0-6993e94e4e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:54.010071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a666d-4a76-43c5-9aa0-6993e94e4e54 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:54.010330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a666d-4a76-43c5-9aa0-6993e94e4e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:54.010660 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a666d-4a76-43c5-9aa0-6993e94e4e54 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:54.011306 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a666d-4a76-43c5-9aa0-6993e94e4e54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:54.013876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a666d-4a76-43c5-9aa0-6993e94e4e54 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:54.091086 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3054/6142] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:16:53 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:16:54.096765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b0d57-b5c1-4444-bd83-58563433676a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:54.112189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b0d57-b5c1-4444-bd83-58563433676a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:54.212484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:54.287991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c864a-a979-4a47-9070-3326119766fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:54.288624 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c864a-a979-4a47-9070-3326119766fd admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:54.289326 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c864a-a979-4a47-9070-3326119766fd admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:54.289326 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c864a-a979-4a47-9070-3326119766fd admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:54.289895 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c864a-a979-4a47-9070-3326119766fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:54.291779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c864a-a979-4a47-9070-3326119766fd admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:54.346143 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3089/6143] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:16:54 2022] POST /identity/v3/users => generated 286 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:16:54.348586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a666d-4a76-43c5-9aa0-6993e94e4e54 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:54.366260 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a666d-4a76-43c5-9aa0-6993e94e4e54 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:54.393378 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8860ea-d40a-4902-b7b5-1a94b9821863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:54.394729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8860ea-d40a-4902-b7b5-1a94b9821863 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:54.395223 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8860ea-d40a-4902-b7b5-1a94b9821863 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:54.395624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8860ea-d40a-4902-b7b5-1a94b9821863 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:54.397234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8860ea-d40a-4902-b7b5-1a94b9821863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:54.399695 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8860ea-d40a-4902-b7b5-1a94b9821863 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:54.448712 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3055/6144] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:16:54.453308 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c864a-a979-4a47-9070-3326119766fd admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:54.476944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c864a-a979-4a47-9070-3326119766fd admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:54.490700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d611ff9-52cf-4844-b476-241664849a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:54.491704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d611ff9-52cf-4844-b476-241664849a0b admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:54.493039 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d611ff9-52cf-4844-b476-241664849a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:54.493499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d611ff9-52cf-4844-b476-241664849a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:54.494331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d611ff9-52cf-4844-b476-241664849a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:54.499143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d611ff9-52cf-4844-b476-241664849a0b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:54.524496 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3090/6145] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:16:54.529834 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8860ea-d40a-4902-b7b5-1a94b9821863 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:54.546232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8860ea-d40a-4902-b7b5-1a94b9821863 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:54.559282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f0351-8bee-4fc0-9f89-923e6ca3ab6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:54.560176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f0351-8bee-4fc0-9f89-923e6ca3ab6b admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:54.562071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f0351-8bee-4fc0-9f89-923e6ca3ab6b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:54.562465 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f0351-8bee-4fc0-9f89-923e6ca3ab6b admin admin] PATH_INFO: `/v3/projects/ff51ff769e7940438149730698cc4dfe/users/f245602db308441e96b1b0d2a5fe5452/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:54.619218 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9f0351-8bee-4fc0-9f89-923e6ca3ab6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff51ff769e7940438149730698cc4dfe, user_id=f245602db308441e96b1b0d2a5fe5452, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:54.622962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9f0351-8bee-4fc0-9f89-923e6ca3ab6b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:54.649831 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3056/6146] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:16:54 2022] PUT /identity/v3/projects/ff51ff769e7940438149730698cc4dfe/users/f245602db308441e96b1b0d2a5fe5452/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:16:54.663529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76420eb6-bcae-4adf-b465-facdbe7f2c2f None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:54.664122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76420eb6-bcae-4adf-b465-facdbe7f2c2f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:54.664582 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76420eb6-bcae-4adf-b465-facdbe7f2c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:54.746525 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-76420eb6-bcae-4adf-b465-facdbe7f2c2f None None] MFA Rules not processed for user `f245602db308441e96b1b0d2a5fe5452`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:16:54.749904 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-76420eb6-bcae-4adf-b465-facdbe7f2c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:54.963991 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3091/6147] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:16:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:16:54.968396 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f0351-8bee-4fc0-9f89-923e6ca3ab6b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:55.104333 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f0351-8bee-4fc0-9f89-923e6ca3ab6b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:55.110831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01514995-2d58-4dfe-b785-42b1c01f6c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:55.111650 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01514995-2d58-4dfe-b785-42b1c01f6c27 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:55.112044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01514995-2d58-4dfe-b785-42b1c01f6c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:55.112427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01514995-2d58-4dfe-b785-42b1c01f6c27 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:55.113184 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01514995-2d58-4dfe-b785-42b1c01f6c27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:55.116210 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01514995-2d58-4dfe-b785-42b1c01f6c27 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:55.130977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:55.206910 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3057/6148] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:16:54 2022] POST /identity/v3/projects => generated 371 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:16:55.209553 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76420eb6-bcae-4adf-b465-facdbe7f2c2f None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:55.237758 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76420eb6-bcae-4adf-b465-facdbe7f2c2f None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:55.414181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575f977-2cc9-4f72-a1d2-1774251a82be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:55.415314 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575f977-2cc9-4f72-a1d2-1774251a82be admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:55.415883 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575f977-2cc9-4f72-a1d2-1774251a82be admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:55.416577 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575f977-2cc9-4f72-a1d2-1774251a82be admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:55.418482 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575f977-2cc9-4f72-a1d2-1774251a82be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:55.421448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575f977-2cc9-4f72-a1d2-1774251a82be admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:55.476524 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3092/6149] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:16:55 2022] POST /identity/v3/users => generated 292 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:16:55.480961 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01514995-2d58-4dfe-b785-42b1c01f6c27 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:55.498810 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01514995-2d58-4dfe-b785-42b1c01f6c27 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:55.517039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92477a06-f510-41b5-9d71-3ab9423d3a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:55.517039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92477a06-f510-41b5-9d71-3ab9423d3a0b admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:55.517388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92477a06-f510-41b5-9d71-3ab9423d3a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:55.517478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92477a06-f510-41b5-9d71-3ab9423d3a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:55.518118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92477a06-f510-41b5-9d71-3ab9423d3a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:55.522224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92477a06-f510-41b5-9d71-3ab9423d3a0b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:55.553091 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3058/6150] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:16:55.557212 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575f977-2cc9-4f72-a1d2-1774251a82be admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:55.573920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575f977-2cc9-4f72-a1d2-1774251a82be admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:55.586562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d4992-7daf-442f-804d-e9d9ea4e311d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:55.590651 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d4992-7daf-442f-804d-e9d9ea4e311d admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:55.591070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d4992-7daf-442f-804d-e9d9ea4e311d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:55.592553 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d4992-7daf-442f-804d-e9d9ea4e311d admin admin] PATH_INFO: `/v3/projects/6c341974561e4beaa17135c00d181b7c/users/206a9c409b6f4e40a0ae6e3436486529/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:55.672488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d4992-7daf-442f-804d-e9d9ea4e311d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c341974561e4beaa17135c00d181b7c, user_id=206a9c409b6f4e40a0ae6e3436486529, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:55.680455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d4992-7daf-442f-804d-e9d9ea4e311d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:55.728100 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3093/6151] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:16:55 2022] PUT /identity/v3/projects/6c341974561e4beaa17135c00d181b7c/users/206a9c409b6f4e40a0ae6e3436486529/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:16:55.732303 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92477a06-f510-41b5-9d71-3ab9423d3a0b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:55.745440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92477a06-f510-41b5-9d71-3ab9423d3a0b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:55.887935 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0dfc23-fe98-45d8-876f-38f06db5ad1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:55.891456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dfc23-fe98-45d8-876f-38f06db5ad1d admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:55.899957 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dfc23-fe98-45d8-876f-38f06db5ad1d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:55.903910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dfc23-fe98-45d8-876f-38f06db5ad1d admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:55.910037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0dfc23-fe98-45d8-876f-38f06db5ad1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:55.912413 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0dfc23-fe98-45d8-876f-38f06db5ad1d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:55.936728 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3059/6152] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:16:55.940339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d4992-7daf-442f-804d-e9d9ea4e311d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:55.987780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d4992-7daf-442f-804d-e9d9ea4e311d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:56.001045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd697d-793a-42de-8285-efebd1781c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:56.001919 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd697d-793a-42de-8285-efebd1781c5b admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:56.002748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd697d-793a-42de-8285-efebd1781c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:56.003003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd697d-793a-42de-8285-efebd1781c5b admin admin] PATH_INFO: `/v3/projects/6c341974561e4beaa17135c00d181b7c/users/206a9c409b6f4e40a0ae6e3436486529/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:56.006381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd697d-793a-42de-8285-efebd1781c5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c341974561e4beaa17135c00d181b7c, user_id=206a9c409b6f4e40a0ae6e3436486529, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:56.010762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd697d-793a-42de-8285-efebd1781c5b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:56.016192 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:56.045443 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3094/6153] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:16:55 2022] PUT /identity/v3/projects/6c341974561e4beaa17135c00d181b7c/users/206a9c409b6f4e40a0ae6e3436486529/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:16:56.056434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a1e6a-5b58-4995-8e1e-9b7be063e73c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:56.057028 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a1e6a-5b58-4995-8e1e-9b7be063e73c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:56.057367 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a1e6a-5b58-4995-8e1e-9b7be063e73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:56.131582 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-bf6a1e6a-5b58-4995-8e1e-9b7be063e73c None None] MFA Rules not processed for user `206a9c409b6f4e40a0ae6e3436486529`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:16:56.135665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-bf6a1e6a-5b58-4995-8e1e-9b7be063e73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:16:56.365705 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3060/6154] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:16:56 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:16:56.375500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd697d-793a-42de-8285-efebd1781c5b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:56.396551 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd697d-793a-42de-8285-efebd1781c5b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:56.414666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3e721-b7e8-4a85-8521-f577d8746227 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206a9c409b6f4e40a0ae6e3436486529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c341974561e4beaa17135c00d181b7c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:56.415416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3e721-b7e8-4a85-8521-f577d8746227 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:56.415815 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3e721-b7e8-4a85-8521-f577d8746227 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:56.416203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3e721-b7e8-4a85-8521-f577d8746227 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] PATH_INFO: `/v3/services` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:56.417064 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3e721-b7e8-4a85-8521-f577d8746227 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:56.420003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3e721-b7e8-4a85-8521-f577d8746227 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:56.449529 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3095/6155] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:16:56 2022] POST /identity/v3/services => generated 289 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:16:56.453831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a1e6a-5b58-4995-8e1e-9b7be063e73c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:56.465718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a1e6a-5b58-4995-8e1e-9b7be063e73c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:56.539011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7ea44-30c3-4ad5-8b8c-475c0b0abbb9 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206a9c409b6f4e40a0ae6e3436486529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c341974561e4beaa17135c00d181b7c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:56.540290 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7ea44-30c3-4ad5-8b8c-475c0b0abbb9 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:56.541463 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7ea44-30c3-4ad5-8b8c-475c0b0abbb9 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:56.542724 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7ea44-30c3-4ad5-8b8c-475c0b0abbb9 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:56.544318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7ea44-30c3-4ad5-8b8c-475c0b0abbb9 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:56.547385 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7ea44-30c3-4ad5-8b8c-475c0b0abbb9 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:56.580695 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-92c7ea44-30c3-4ad5-8b8c-475c0b0abbb9 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-811906834. To ensure interoperability, identifiers should be a valid uuid. Aug 06 21:16:56.580695 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 06 21:16:56.580695 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:16:56.652647 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3061/6156] 10.222.0.33 () {60 vars in 1156 bytes} [Sat Aug 6 21:16:56 2022] POST /identity/v3/endpoints => generated 359 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:16:56.653105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3e721-b7e8-4a85-8521-f577d8746227 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:56.682426 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3e721-b7e8-4a85-8521-f577d8746227 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:56.801893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2d33e-209c-48d7-bafd-1ed768c49e8e tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206a9c409b6f4e40a0ae6e3436486529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c341974561e4beaa17135c00d181b7c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:56.802640 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2d33e-209c-48d7-bafd-1ed768c49e8e tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:56.802875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2d33e-209c-48d7-bafd-1ed768c49e8e tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:56.803154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2d33e-209c-48d7-bafd-1ed768c49e8e tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] PATH_INFO: `/v3/regions/tempest-region-811906834` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:56.813299 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa2d33e-209c-48d7-bafd-1ed768c49e8e tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-811906834)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:56.821534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa2d33e-209c-48d7-bafd-1ed768c49e8e tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:56.839505 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3096/6157] 10.222.0.33 () {58 vars in 1203 bytes} [Sat Aug 6 21:16:56 2022] GET /identity/v3/regions/tempest-region-811906834 => generated 178 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:16:56.846366 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7ea44-30c3-4ad5-8b8c-475c0b0abbb9 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:56.919251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7ea44-30c3-4ad5-8b8c-475c0b0abbb9 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:56.948171 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac2522-b865-480d-a3af-8799eb2497cb tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206a9c409b6f4e40a0ae6e3436486529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c341974561e4beaa17135c00d181b7c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:56.948804 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac2522-b865-480d-a3af-8799eb2497cb tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:56.949085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac2522-b865-480d-a3af-8799eb2497cb tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:56.949394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac2522-b865-480d-a3af-8799eb2497cb tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] PATH_INFO: `/v3/services` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:56.950132 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac2522-b865-480d-a3af-8799eb2497cb tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:56.955477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac2522-b865-480d-a3af-8799eb2497cb tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:56.979898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:56.997774 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3062/6158] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:16:56 2022] POST /identity/v3/services => generated 288 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:16:56.999297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2d33e-209c-48d7-bafd-1ed768c49e8e tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:57.057995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2d33e-209c-48d7-bafd-1ed768c49e8e tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:57.132463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79291af-8c7d-40df-bd5e-4ec835e70ae8 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206a9c409b6f4e40a0ae6e3436486529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c341974561e4beaa17135c00d181b7c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:57.132463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79291af-8c7d-40df-bd5e-4ec835e70ae8 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:57.139955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79291af-8c7d-40df-bd5e-4ec835e70ae8 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:57.144058 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79291af-8c7d-40df-bd5e-4ec835e70ae8 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:57.144860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79291af-8c7d-40df-bd5e-4ec835e70ae8 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:57.153728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79291af-8c7d-40df-bd5e-4ec835e70ae8 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:57.218223 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-a79291af-8c7d-40df-bd5e-4ec835e70ae8 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1583649624. To ensure interoperability, identifiers should be a valid uuid. Aug 06 21:16:57.218223 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 06 21:16:57.218223 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:16:57.323427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac2522-b865-480d-a3af-8799eb2497cb tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:57.331003 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3097/6159] 10.222.0.33 () {60 vars in 1156 bytes} [Sat Aug 6 21:16:56 2022] POST /identity/v3/endpoints => generated 363 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:16:57.374496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac2522-b865-480d-a3af-8799eb2497cb tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:57.480095 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b716a-054a-4863-94c6-33d9727c8756 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206a9c409b6f4e40a0ae6e3436486529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c341974561e4beaa17135c00d181b7c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:57.482739 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b716a-054a-4863-94c6-33d9727c8756 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:57.488407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b716a-054a-4863-94c6-33d9727c8756 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:57.489058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b716a-054a-4863-94c6-33d9727c8756 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] PATH_INFO: `/v3/regions/tempest-region-1583649624` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:57.490259 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b716a-054a-4863-94c6-33d9727c8756 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1583649624)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:57.492598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b716a-054a-4863-94c6-33d9727c8756 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:57.498608 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3063/6160] 10.222.0.33 () {58 vars in 1206 bytes} [Sat Aug 6 21:16:57 2022] GET /identity/v3/regions/tempest-region-1583649624 => generated 180 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:16:57.502078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79291af-8c7d-40df-bd5e-4ec835e70ae8 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:57.518938 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79291af-8c7d-40df-bd5e-4ec835e70ae8 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:57.537155 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d453eb6-4dd8-4c4c-b022-c9b8365bc48c tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206a9c409b6f4e40a0ae6e3436486529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c341974561e4beaa17135c00d181b7c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:57.539644 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d453eb6-4dd8-4c4c-b022-c9b8365bc48c tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:57.544424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d453eb6-4dd8-4c4c-b022-c9b8365bc48c tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:57.545165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d453eb6-4dd8-4c4c-b022-c9b8365bc48c tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:57.546473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d453eb6-4dd8-4c4c-b022-c9b8365bc48c tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:57.553924 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d453eb6-4dd8-4c4c-b022-c9b8365bc48c tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:57.617800 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-5d453eb6-4dd8-4c4c-b022-c9b8365bc48c tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-941456340. To ensure interoperability, identifiers should be a valid uuid. Aug 06 21:16:57.617800 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 06 21:16:57.617800 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:16:57.703464 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3098/6161] 10.222.0.33 () {60 vars in 1156 bytes} [Sat Aug 6 21:16:57 2022] POST /identity/v3/endpoints => generated 358 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:16:57.710268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b716a-054a-4863-94c6-33d9727c8756 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:57.758452 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b716a-054a-4863-94c6-33d9727c8756 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:57.850679 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63353cfe-6a1d-4723-98b0-3c642a8b985b tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206a9c409b6f4e40a0ae6e3436486529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c341974561e4beaa17135c00d181b7c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:57.856616 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63353cfe-6a1d-4723-98b0-3c642a8b985b tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:57.859284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63353cfe-6a1d-4723-98b0-3c642a8b985b tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:57.866114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63353cfe-6a1d-4723-98b0-3c642a8b985b tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] PATH_INFO: `/v3/regions/tempest-region-941456340` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:57.866705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63353cfe-6a1d-4723-98b0-3c642a8b985b tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-941456340)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:57.868841 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63353cfe-6a1d-4723-98b0-3c642a8b985b tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:57.878002 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3064/6162] 10.222.0.33 () {58 vars in 1203 bytes} [Sat Aug 6 21:16:57 2022] GET /identity/v3/regions/tempest-region-941456340 => generated 178 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:16:57.879662 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d453eb6-4dd8-4c4c-b022-c9b8365bc48c tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:57.905661 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d453eb6-4dd8-4c4c-b022-c9b8365bc48c tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:57.916489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d1e63-e95f-40a2-99cf-c1b7346499c9 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206a9c409b6f4e40a0ae6e3436486529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c341974561e4beaa17135c00d181b7c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:57.920162 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d1e63-e95f-40a2-99cf-c1b7346499c9 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:57.924229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d1e63-e95f-40a2-99cf-c1b7346499c9 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:57.927306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d1e63-e95f-40a2-99cf-c1b7346499c9 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:57.928838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d1e63-e95f-40a2-99cf-c1b7346499c9 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:57.934496 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-1f9d1e63-e95f-40a2-99cf-c1b7346499c9 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:16:57.934496 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:16:57.934496 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:16:57.941875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d1e63-e95f-40a2-99cf-c1b7346499c9 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:57.994911 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3099/6163] 10.222.0.33 () {58 vars in 1134 bytes} [Sat Aug 6 21:16:57 2022] GET /identity/v3/endpoints => generated 4394 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:16:58.000721 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63353cfe-6a1d-4723-98b0-3c642a8b985b tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:58.041539 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63353cfe-6a1d-4723-98b0-3c642a8b985b tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:58.069931 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970aa33-9d3b-4d92-a77f-325ad122e2bb tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206a9c409b6f4e40a0ae6e3436486529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c341974561e4beaa17135c00d181b7c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:58.071181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970aa33-9d3b-4d92-a77f-325ad122e2bb tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:58.082461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970aa33-9d3b-4d92-a77f-325ad122e2bb tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:58.083198 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970aa33-9d3b-4d92-a77f-325ad122e2bb tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] PATH_INFO: `/v3/endpoints/80ce469f05694699bc922701c02112f7` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:58.117799 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970aa33-9d3b-4d92-a77f-325ad122e2bb tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=80ce469f05694699bc922701c02112f7)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:58.117799 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-9970aa33-9d3b-4d92-a77f-325ad122e2bb tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:16:58.117799 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:16:58.117799 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:16:58.130667 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970aa33-9d3b-4d92-a77f-325ad122e2bb tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:58.150056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d1e63-e95f-40a2-99cf-c1b7346499c9 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:58.161224 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3065/6164] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:16:57 2022] GET /identity/v3/endpoints/80ce469f05694699bc922701c02112f7 => generated 358 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:16:58.181932 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d1e63-e95f-40a2-99cf-c1b7346499c9 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:58.204993 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc4523-40fd-4ba5-bda3-b1346168829d tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206a9c409b6f4e40a0ae6e3436486529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c341974561e4beaa17135c00d181b7c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:58.209197 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc4523-40fd-4ba5-bda3-b1346168829d tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:58.209737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc4523-40fd-4ba5-bda3-b1346168829d tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:58.211500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc4523-40fd-4ba5-bda3-b1346168829d tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] PATH_INFO: `/v3/endpoints/80ce469f05694699bc922701c02112f7` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:58.215572 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc4523-40fd-4ba5-bda3-b1346168829d tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=80ce469f05694699bc922701c02112f7)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:58.224441 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc4523-40fd-4ba5-bda3-b1346168829d tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:58.260052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d2dc4523-40fd-4ba5-bda3-b1346168829d tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '80ce469f05694699bc922701c02112f7', 'request_id': 'req-d2dc4523-40fd-4ba5-bda3-b1346168829d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:58.288320 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3100/6165] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:58 2022] DELETE /identity/v3/endpoints/80ce469f05694699bc922701c02112f7 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:16:58.292852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970aa33-9d3b-4d92-a77f-325ad122e2bb tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:58.322375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970aa33-9d3b-4d92-a77f-325ad122e2bb tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:58.430813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d5545-47f2-49f2-a7c7-a73cb0e2ea01 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206a9c409b6f4e40a0ae6e3436486529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c341974561e4beaa17135c00d181b7c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:58.434738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d5545-47f2-49f2-a7c7-a73cb0e2ea01 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:58.435363 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d5545-47f2-49f2-a7c7-a73cb0e2ea01 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:58.435877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d5545-47f2-49f2-a7c7-a73cb0e2ea01 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:58.436595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d5545-47f2-49f2-a7c7-a73cb0e2ea01 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:58.437763 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-0e3d5545-47f2-49f2-a7c7-a73cb0e2ea01 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:16:58.437763 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:16:58.437763 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:16:58.439218 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d5545-47f2-49f2-a7c7-a73cb0e2ea01 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:58.482067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc4523-40fd-4ba5-bda3-b1346168829d tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:58.485109 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3066/6166] 10.222.0.33 () {58 vars in 1134 bytes} [Sat Aug 6 21:16:58 2022] GET /identity/v3/endpoints => generated 4049 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:16:58.507563 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc4523-40fd-4ba5-bda3-b1346168829d tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:58.539499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af31a96-8d4b-408b-9a83-6a4c634b54fe tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206a9c409b6f4e40a0ae6e3436486529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c341974561e4beaa17135c00d181b7c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:58.539499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af31a96-8d4b-408b-9a83-6a4c634b54fe tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:58.539499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af31a96-8d4b-408b-9a83-6a4c634b54fe tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:58.539966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af31a96-8d4b-408b-9a83-6a4c634b54fe tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] PATH_INFO: `/v3/endpoints/80ce469f05694699bc922701c02112f7` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:58.555430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af31a96-8d4b-408b-9a83-6a4c634b54fe tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 21:16:58.565860 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-0af31a96-8d4b-408b-9a83-6a4c634b54fe tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Could not find endpoint: 80ce469f05694699bc922701c02112f7.: keystone.exception.EndpointNotFound: Could not find endpoint: 80ce469f05694699bc922701c02112f7. Aug 06 21:16:58.565860 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:16:58.565860 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Aug 06 21:16:58.565860 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Aug 06 21:16:58.565860 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Aug 06 21:16:58.565860 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._iter().one() Aug 06 21:16:58.565860 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Aug 06 21:16:58.565860 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._only_one_row( Aug 06 21:16:58.565860 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 06 21:16:58.565860 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 06 21:16:58.565860 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 06 21:16:58.565860 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:16:58.565860 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 21:16:58.565860 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:16:58.565860 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:16:58.565860 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Aug 06 21:16:58.567412 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Aug 06 21:16:58.567412 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Aug 06 21:16:58.567412 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Aug 06 21:16:58.567412 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Aug 06 21:16:58.567412 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Aug 06 21:16:58.567412 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 80ce469f05694699bc922701c02112f7. Aug 06 21:16:58.567412 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:16:58.567412 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 21:16:58.567412 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:16:58.567412 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:16:58.567412 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:16:58.567412 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:16:58.567412 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:16:58.567412 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:16:58.567412 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:16:58.567412 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:16:58.567412 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:16:58.568716 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:16:58.568716 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:16:58.568716 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:16:58.568716 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Aug 06 21:16:58.568716 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Aug 06 21:16:58.568716 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 21:16:58.568716 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 21:16:58.568716 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 21:16:58.568716 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 21:16:58.568716 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:16:58.568716 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:16:58.568716 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 21:16:58.568716 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 21:16:58.568716 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 21:16:58.568716 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 21:16:58.568716 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 21:16:58.570012 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 21:16:58.570012 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 21:16:58.570012 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 21:16:58.570012 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 21:16:58.570012 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 21:16:58.570012 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 21:16:58.570012 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 21:16:58.570012 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 21:16:58.570012 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 21:16:58.570012 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Aug 06 21:16:58.570012 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Aug 06 21:16:58.570012 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 80ce469f05694699bc922701c02112f7. Aug 06 21:16:58.570012 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:16:58.576202 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3101/6167] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:58 2022] DELETE /identity/v3/endpoints/80ce469f05694699bc922701c02112f7 => generated 114 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:16:58.578228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d5545-47f2-49f2-a7c7-a73cb0e2ea01 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:58.595513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d5545-47f2-49f2-a7c7-a73cb0e2ea01 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:58.619832 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde7ad5-4402-4970-ab71-191a3b252c1e tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206a9c409b6f4e40a0ae6e3436486529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c341974561e4beaa17135c00d181b7c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:58.620852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde7ad5-4402-4970-ab71-191a3b252c1e tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:58.622108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde7ad5-4402-4970-ab71-191a3b252c1e tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:58.622406 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde7ad5-4402-4970-ab71-191a3b252c1e tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] PATH_INFO: `/v3/regions/tempest-region-941456340` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:58.623181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde7ad5-4402-4970-ab71-191a3b252c1e tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-941456340)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:58.624210 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-afde7ad5-4402-4970-ab71-191a3b252c1e tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:16:58.624210 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:16:58.624210 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:16:58.625116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde7ad5-4402-4970-ab71-191a3b252c1e tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:58.707822 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-afde7ad5-4402-4970-ab71-191a3b252c1e tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-941456340. To ensure interoperability, identifiers should be a valid uuid. Aug 06 21:16:58.707822 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 06 21:16:58.707822 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:16:58.752484 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3067/6168] 10.222.0.33 () {58 vars in 1206 bytes} [Sat Aug 6 21:16:58 2022] DELETE /identity/v3/regions/tempest-region-941456340 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:16:58.758587 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af31a96-8d4b-408b-9a83-6a4c634b54fe tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:58.783757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af31a96-8d4b-408b-9a83-6a4c634b54fe tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:58.842987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87dfd0-c2eb-4e69-81e0-9d33d03559ee tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206a9c409b6f4e40a0ae6e3436486529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c341974561e4beaa17135c00d181b7c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:58.846170 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87dfd0-c2eb-4e69-81e0-9d33d03559ee tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:58.846742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87dfd0-c2eb-4e69-81e0-9d33d03559ee tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:58.847203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87dfd0-c2eb-4e69-81e0-9d33d03559ee tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:58.848110 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b87dfd0-c2eb-4e69-81e0-9d33d03559ee tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:58.851067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b87dfd0-c2eb-4e69-81e0-9d33d03559ee tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:58.870078 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3102/6169] 10.222.0.33 () {58 vars in 1134 bytes} [Sat Aug 6 21:16:58 2022] GET /identity/v3/endpoints => generated 4049 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:16:58.874171 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde7ad5-4402-4970-ab71-191a3b252c1e tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:58.889635 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde7ad5-4402-4970-ab71-191a3b252c1e tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:58.896598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf6344-1605-44be-baf7-9475abe7aadc tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206a9c409b6f4e40a0ae6e3436486529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c341974561e4beaa17135c00d181b7c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:58.897662 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf6344-1605-44be-baf7-9475abe7aadc tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:58.898117 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf6344-1605-44be-baf7-9475abe7aadc tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:58.898613 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf6344-1605-44be-baf7-9475abe7aadc tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:58.899457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf6344-1605-44be-baf7-9475abe7aadc tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Adding query filter params (service_id=12465137be7c4c1d8631239557d41c72) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:16:58.899935 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf6344-1605-44be-baf7-9475abe7aadc tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:58.903315 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf6344-1605-44be-baf7-9475abe7aadc tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:58.911770 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3068/6170] 10.222.0.33 () {58 vars in 1221 bytes} [Sat Aug 6 21:16:58 2022] GET /identity/v3/endpoints?service_id=12465137be7c4c1d8631239557d41c72 => generated 501 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:16:58.915121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87dfd0-c2eb-4e69-81e0-9d33d03559ee tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:58.954218 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87dfd0-c2eb-4e69-81e0-9d33d03559ee tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:58.973604 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834b104-4302-4f2e-b811-4080e97c01af tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206a9c409b6f4e40a0ae6e3436486529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c341974561e4beaa17135c00d181b7c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:58.974769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834b104-4302-4f2e-b811-4080e97c01af tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:58.975237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834b104-4302-4f2e-b811-4080e97c01af tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:58.975743 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834b104-4302-4f2e-b811-4080e97c01af tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:58.976717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834b104-4302-4f2e-b811-4080e97c01af tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Adding query filter params (service_id=46da01a311b64a21b0a6341211d17948) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:16:58.977331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834b104-4302-4f2e-b811-4080e97c01af tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:58.983216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834b104-4302-4f2e-b811-4080e97c01af tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:58.997107 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3103/6171] 10.222.0.33 () {58 vars in 1221 bytes} [Sat Aug 6 21:16:58 2022] GET /identity/v3/endpoints?service_id=46da01a311b64a21b0a6341211d17948 => generated 505 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:16:59.001062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf6344-1605-44be-baf7-9475abe7aadc tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:59.024339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf6344-1605-44be-baf7-9475abe7aadc tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:59.032801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f8051-e258-4a1e-9dc0-4b6fa60187f5 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206a9c409b6f4e40a0ae6e3436486529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c341974561e4beaa17135c00d181b7c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:59.033854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f8051-e258-4a1e-9dc0-4b6fa60187f5 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:59.034977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f8051-e258-4a1e-9dc0-4b6fa60187f5 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:59.035549 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f8051-e258-4a1e-9dc0-4b6fa60187f5 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:59.036815 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f8051-e258-4a1e-9dc0-4b6fa60187f5 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:16:59.037676 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f8051-e258-4a1e-9dc0-4b6fa60187f5 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:59.040619 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f8051-e258-4a1e-9dc0-4b6fa60187f5 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:59.056104 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3069/6172] 10.222.0.33 () {58 vars in 1167 bytes} [Sat Aug 6 21:16:59 2022] GET /identity/v3/endpoints?interface=public => generated 3404 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:16:59.061179 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834b104-4302-4f2e-b811-4080e97c01af tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:59.080762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834b104-4302-4f2e-b811-4080e97c01af tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:59.089401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5b8d8-4e56-44de-bfb1-dbfe1b608a3b tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206a9c409b6f4e40a0ae6e3436486529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c341974561e4beaa17135c00d181b7c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:59.091075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5b8d8-4e56-44de-bfb1-dbfe1b608a3b tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:59.092365 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5b8d8-4e56-44de-bfb1-dbfe1b608a3b tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:59.092937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5b8d8-4e56-44de-bfb1-dbfe1b608a3b tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:59.094698 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5b8d8-4e56-44de-bfb1-dbfe1b608a3b tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:16:59.096112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5b8d8-4e56-44de-bfb1-dbfe1b608a3b tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:59.099675 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5b8d8-4e56-44de-bfb1-dbfe1b608a3b tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:59.113634 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3104/6173] 10.222.0.33 () {58 vars in 1171 bytes} [Sat Aug 6 21:16:59 2022] GET /identity/v3/endpoints?interface=internal => generated 480 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:16:59.122812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f8051-e258-4a1e-9dc0-4b6fa60187f5 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:59.136426 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f8051-e258-4a1e-9dc0-4b6fa60187f5 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:59.144351 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d52358-7b7d-42e3-9cce-6fd120adacdc tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206a9c409b6f4e40a0ae6e3436486529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c341974561e4beaa17135c00d181b7c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:59.145943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d52358-7b7d-42e3-9cce-6fd120adacdc tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:59.146637 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d52358-7b7d-42e3-9cce-6fd120adacdc tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:59.147112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d52358-7b7d-42e3-9cce-6fd120adacdc tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] PATH_INFO: `/v3/services` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:59.150592 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d52358-7b7d-42e3-9cce-6fd120adacdc tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:59.152773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d52358-7b7d-42e3-9cce-6fd120adacdc tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:59.181660 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3070/6174] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:16:59 2022] POST /identity/v3/services => generated 287 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:16:59.188938 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5b8d8-4e56-44de-bfb1-dbfe1b608a3b tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:59.204253 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5b8d8-4e56-44de-bfb1-dbfe1b608a3b tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:59.239439 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4e2b5-203b-4494-9f57-6d0ebc8af6f6 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206a9c409b6f4e40a0ae6e3436486529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c341974561e4beaa17135c00d181b7c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:59.240410 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4e2b5-203b-4494-9f57-6d0ebc8af6f6 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:59.240914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4e2b5-203b-4494-9f57-6d0ebc8af6f6 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:59.241907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4e2b5-203b-4494-9f57-6d0ebc8af6f6 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:59.242861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede4e2b5-203b-4494-9f57-6d0ebc8af6f6 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:59.245156 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede4e2b5-203b-4494-9f57-6d0ebc8af6f6 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:59.306998 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-ede4e2b5-203b-4494-9f57-6d0ebc8af6f6 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1874251615. To ensure interoperability, identifiers should be a valid uuid. Aug 06 21:16:59.306998 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 06 21:16:59.306998 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:16:59.325485 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:59.371194 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3105/6175] 10.222.0.33 () {60 vars in 1156 bytes} [Sat Aug 6 21:16:59 2022] POST /identity/v3/endpoints => generated 361 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:16:59.376841 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d52358-7b7d-42e3-9cce-6fd120adacdc tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:59.396682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d52358-7b7d-42e3-9cce-6fd120adacdc tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:59.438656 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0939a-0edc-46c6-8db3-5d7cf39ad92a tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206a9c409b6f4e40a0ae6e3436486529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c341974561e4beaa17135c00d181b7c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:59.440756 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0939a-0edc-46c6-8db3-5d7cf39ad92a tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:59.441293 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0939a-0edc-46c6-8db3-5d7cf39ad92a tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:59.442010 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0939a-0edc-46c6-8db3-5d7cf39ad92a tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] PATH_INFO: `/v3/regions/tempest-region-1874251615` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:59.443147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c0939a-0edc-46c6-8db3-5d7cf39ad92a tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1874251615)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:59.444582 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c0939a-0edc-46c6-8db3-5d7cf39ad92a tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:59.447319 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3071/6176] 10.222.0.33 () {58 vars in 1206 bytes} [Sat Aug 6 21:16:59 2022] GET /identity/v3/regions/tempest-region-1874251615 => generated 180 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:16:59.451896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4e2b5-203b-4494-9f57-6d0ebc8af6f6 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:59.469198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4e2b5-203b-4494-9f57-6d0ebc8af6f6 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:59.493062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eac07c-b55e-4fde-a019-a20c615319b8 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206a9c409b6f4e40a0ae6e3436486529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c341974561e4beaa17135c00d181b7c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:59.495045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eac07c-b55e-4fde-a019-a20c615319b8 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:59.495356 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eac07c-b55e-4fde-a019-a20c615319b8 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:59.496501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eac07c-b55e-4fde-a019-a20c615319b8 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] PATH_INFO: `/v3/endpoints/e9b86dc712f7477094bc2b8936db7f57` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:59.513527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eac07c-b55e-4fde-a019-a20c615319b8 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=e9b86dc712f7477094bc2b8936db7f57)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:59.517907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eac07c-b55e-4fde-a019-a20c615319b8 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:59.567091 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-81eac07c-b55e-4fde-a019-a20c615319b8 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-874616884. To ensure interoperability, identifiers should be a valid uuid. Aug 06 21:16:59.567091 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 06 21:16:59.567091 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:16:59.647021 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3106/6177] 10.222.0.33 () {60 vars in 1256 bytes} [Sat Aug 6 21:16:59 2022] PATCH /identity/v3/endpoints/e9b86dc712f7477094bc2b8936db7f57 => generated 362 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:16:59.654881 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0939a-0edc-46c6-8db3-5d7cf39ad92a tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:59.692797 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0939a-0edc-46c6-8db3-5d7cf39ad92a tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:59.770660 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc2024-e995-4d53-b4e7-64ab88a22a68 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206a9c409b6f4e40a0ae6e3436486529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c341974561e4beaa17135c00d181b7c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:59.771554 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc2024-e995-4d53-b4e7-64ab88a22a68 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:59.771978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc2024-e995-4d53-b4e7-64ab88a22a68 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:59.772371 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc2024-e995-4d53-b4e7-64ab88a22a68 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] PATH_INFO: `/v3/regions/tempest-region-874616884` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:59.773456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc2024-e995-4d53-b4e7-64ab88a22a68 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-874616884)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:59.775984 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc2024-e995-4d53-b4e7-64ab88a22a68 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:59.783668 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3072/6178] 10.222.0.33 () {58 vars in 1203 bytes} [Sat Aug 6 21:16:59 2022] GET /identity/v3/regions/tempest-region-874616884 => generated 178 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:16:59.787732 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eac07c-b55e-4fde-a019-a20c615319b8 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:59.808371 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eac07c-b55e-4fde-a019-a20c615319b8 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:59.831386 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae68e5-8369-47bd-b9b8-446a0329956b tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206a9c409b6f4e40a0ae6e3436486529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c341974561e4beaa17135c00d181b7c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:59.832326 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae68e5-8369-47bd-b9b8-446a0329956b tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:59.833457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae68e5-8369-47bd-b9b8-446a0329956b tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:59.833900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae68e5-8369-47bd-b9b8-446a0329956b tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] PATH_INFO: `/v3/endpoints/e9b86dc712f7477094bc2b8936db7f57` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:59.848267 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae68e5-8369-47bd-b9b8-446a0329956b tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=e9b86dc712f7477094bc2b8936db7f57)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:59.849918 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae68e5-8369-47bd-b9b8-446a0329956b tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:16:59.868285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-20ae68e5-8369-47bd-b9b8-446a0329956b tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'e9b86dc712f7477094bc2b8936db7f57', 'request_id': 'req-20ae68e5-8369-47bd-b9b8-446a0329956b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:16:59.903732 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3107/6179] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:59 2022] DELETE /identity/v3/endpoints/e9b86dc712f7477094bc2b8936db7f57 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:16:59.907862 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc2024-e995-4d53-b4e7-64ab88a22a68 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:16:59.932539 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc2024-e995-4d53-b4e7-64ab88a22a68 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:16:59.991522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013eb6be-acaa-4c1c-a6d5-2693efa1a727 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206a9c409b6f4e40a0ae6e3436486529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c341974561e4beaa17135c00d181b7c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:16:59.992649 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013eb6be-acaa-4c1c-a6d5-2693efa1a727 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:16:59.993166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013eb6be-acaa-4c1c-a6d5-2693efa1a727 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:16:59.993680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013eb6be-acaa-4c1c-a6d5-2693efa1a727 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] PATH_INFO: `/v3/regions/tempest-region-874616884` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:16:59.994513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013eb6be-acaa-4c1c-a6d5-2693efa1a727 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-874616884)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:16:59.996959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013eb6be-acaa-4c1c-a6d5-2693efa1a727 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:00.065274 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-013eb6be-acaa-4c1c-a6d5-2693efa1a727 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-874616884. To ensure interoperability, identifiers should be a valid uuid. Aug 06 21:17:00.065274 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 06 21:17:00.065274 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:17:00.089025 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3073/6180] 10.222.0.33 () {58 vars in 1206 bytes} [Sat Aug 6 21:16:59 2022] DELETE /identity/v3/regions/tempest-region-874616884 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:00.093632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae68e5-8369-47bd-b9b8-446a0329956b tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:00.106905 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae68e5-8369-47bd-b9b8-446a0329956b tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:00.156609 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32afba46-ed64-4c2e-8e81-ecdc09227a67 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206a9c409b6f4e40a0ae6e3436486529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c341974561e4beaa17135c00d181b7c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:00.157245 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32afba46-ed64-4c2e-8e81-ecdc09227a67 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:00.157872 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32afba46-ed64-4c2e-8e81-ecdc09227a67 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:00.157872 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32afba46-ed64-4c2e-8e81-ecdc09227a67 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] PATH_INFO: `/v3/regions/tempest-region-1874251615` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:00.158377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32afba46-ed64-4c2e-8e81-ecdc09227a67 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1874251615)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:00.160194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32afba46-ed64-4c2e-8e81-ecdc09227a67 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:00.258132 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3108/6181] 10.222.0.33 () {58 vars in 1209 bytes} [Sat Aug 6 21:17:00 2022] DELETE /identity/v3/regions/tempest-region-1874251615 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:00.262382 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013eb6be-acaa-4c1c-a6d5-2693efa1a727 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:00.300024 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013eb6be-acaa-4c1c-a6d5-2693efa1a727 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:00.390259 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d3343-3bf4-4ca5-aefd-2a7d21d35d0f tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206a9c409b6f4e40a0ae6e3436486529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c341974561e4beaa17135c00d181b7c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:00.391027 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d3343-3bf4-4ca5-aefd-2a7d21d35d0f tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:00.394226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d3343-3bf4-4ca5-aefd-2a7d21d35d0f tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:00.394375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d3343-3bf4-4ca5-aefd-2a7d21d35d0f tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] PATH_INFO: `/v3/services/1a302b3817364998a8bd8ba79928aa40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:00.412725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d3343-3bf4-4ca5-aefd-2a7d21d35d0f tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorizing `identity:delete_service(service_id=1a302b3817364998a8bd8ba79928aa40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:00.417107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d3343-3bf4-4ca5-aefd-2a7d21d35d0f tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:00.480092 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3074/6182] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:17:00 2022] DELETE /identity/v3/services/1a302b3817364998a8bd8ba79928aa40 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:00.484741 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32afba46-ed64-4c2e-8e81-ecdc09227a67 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:00.520315 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32afba46-ed64-4c2e-8e81-ecdc09227a67 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:00.619881 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f755433-315f-4f0b-a7cb-d93765363219 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206a9c409b6f4e40a0ae6e3436486529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c341974561e4beaa17135c00d181b7c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:00.620668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f755433-315f-4f0b-a7cb-d93765363219 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:00.644428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f755433-315f-4f0b-a7cb-d93765363219 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:00.649092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f755433-315f-4f0b-a7cb-d93765363219 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] PATH_INFO: `/v3/endpoints/2d720c8a5859497794932da4c7e76a1e` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:00.676906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f755433-315f-4f0b-a7cb-d93765363219 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=2d720c8a5859497794932da4c7e76a1e)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:00.680080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f755433-315f-4f0b-a7cb-d93765363219 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:00.714314 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6f755433-315f-4f0b-a7cb-d93765363219 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '2d720c8a5859497794932da4c7e76a1e', 'request_id': 'req-6f755433-315f-4f0b-a7cb-d93765363219'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:00.749105 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3109/6183] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:17:00 2022] DELETE /identity/v3/endpoints/2d720c8a5859497794932da4c7e76a1e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:00.753087 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d3343-3bf4-4ca5-aefd-2a7d21d35d0f tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:00.769433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d3343-3bf4-4ca5-aefd-2a7d21d35d0f tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:00.865617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9d775-6740-45a1-8ab7-d877dbcfc091 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206a9c409b6f4e40a0ae6e3436486529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c341974561e4beaa17135c00d181b7c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:00.867638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9d775-6740-45a1-8ab7-d877dbcfc091 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:00.868455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9d775-6740-45a1-8ab7-d877dbcfc091 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:00.869797 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9d775-6740-45a1-8ab7-d877dbcfc091 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] PATH_INFO: `/v3/regions/tempest-region-1583649624` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:00.875257 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9d775-6740-45a1-8ab7-d877dbcfc091 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1583649624)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:00.890766 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9d775-6740-45a1-8ab7-d877dbcfc091 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:00.924304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:00.936880 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-dae9d775-6740-45a1-8ab7-d877dbcfc091 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1583649624. To ensure interoperability, identifiers should be a valid uuid. Aug 06 21:17:00.936880 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 06 21:17:00.936880 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:17:00.951898 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3075/6184] 10.222.0.33 () {58 vars in 1209 bytes} [Sat Aug 6 21:17:00 2022] DELETE /identity/v3/regions/tempest-region-1583649624 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:00.955830 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f755433-315f-4f0b-a7cb-d93765363219 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:00.975511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f755433-315f-4f0b-a7cb-d93765363219 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:01.034625 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365611c-0ae9-4bec-a063-117abb8caba5 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206a9c409b6f4e40a0ae6e3436486529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c341974561e4beaa17135c00d181b7c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:01.035626 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365611c-0ae9-4bec-a063-117abb8caba5 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:01.036023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365611c-0ae9-4bec-a063-117abb8caba5 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:01.036415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365611c-0ae9-4bec-a063-117abb8caba5 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] PATH_INFO: `/v3/services/46da01a311b64a21b0a6341211d17948` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:01.037361 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365611c-0ae9-4bec-a063-117abb8caba5 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorizing `identity:delete_service(service_id=46da01a311b64a21b0a6341211d17948)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:01.046251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365611c-0ae9-4bec-a063-117abb8caba5 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:01.099625 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3110/6185] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:17:00 2022] DELETE /identity/v3/services/46da01a311b64a21b0a6341211d17948 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:01.103591 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9d775-6740-45a1-8ab7-d877dbcfc091 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:01.121296 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9d775-6740-45a1-8ab7-d877dbcfc091 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:01.174112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d33cc-c8ac-4cb4-bbdd-2c04562d2be8 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206a9c409b6f4e40a0ae6e3436486529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c341974561e4beaa17135c00d181b7c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:01.175456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d33cc-c8ac-4cb4-bbdd-2c04562d2be8 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:01.178217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d33cc-c8ac-4cb4-bbdd-2c04562d2be8 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:01.178646 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d33cc-c8ac-4cb4-bbdd-2c04562d2be8 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] PATH_INFO: `/v3/endpoints/c705e36ce6f5462182c69ac4c19167bb` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:01.185673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d33cc-c8ac-4cb4-bbdd-2c04562d2be8 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=c705e36ce6f5462182c69ac4c19167bb)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:01.188362 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d33cc-c8ac-4cb4-bbdd-2c04562d2be8 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:01.244412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ce2d33cc-c8ac-4cb4-bbdd-2c04562d2be8 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'c705e36ce6f5462182c69ac4c19167bb', 'request_id': 'req-ce2d33cc-c8ac-4cb4-bbdd-2c04562d2be8'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:01.301742 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3076/6186] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:17:01 2022] DELETE /identity/v3/endpoints/c705e36ce6f5462182c69ac4c19167bb => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:01.305647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365611c-0ae9-4bec-a063-117abb8caba5 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:01.332522 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365611c-0ae9-4bec-a063-117abb8caba5 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:01.364829 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3b00a-b55b-4d87-be3d-a20cfe80eeb4 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206a9c409b6f4e40a0ae6e3436486529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c341974561e4beaa17135c00d181b7c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:01.365570 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3b00a-b55b-4d87-be3d-a20cfe80eeb4 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:01.365928 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3b00a-b55b-4d87-be3d-a20cfe80eeb4 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:01.366326 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3b00a-b55b-4d87-be3d-a20cfe80eeb4 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] PATH_INFO: `/v3/regions/tempest-region-811906834` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:01.367279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3b00a-b55b-4d87-be3d-a20cfe80eeb4 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-811906834)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:01.370009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3b00a-b55b-4d87-be3d-a20cfe80eeb4 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:01.392577 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-70d3b00a-b55b-4d87-be3d-a20cfe80eeb4 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-811906834. To ensure interoperability, identifiers should be a valid uuid. Aug 06 21:17:01.392577 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 06 21:17:01.392577 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:17:01.412952 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3111/6187] 10.222.0.33 () {58 vars in 1206 bytes} [Sat Aug 6 21:17:01 2022] DELETE /identity/v3/regions/tempest-region-811906834 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:17:01.416567 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d33cc-c8ac-4cb4-bbdd-2c04562d2be8 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:01.453100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d33cc-c8ac-4cb4-bbdd-2c04562d2be8 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:01.515940 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7d30f-9c90-47de-a38e-91a461ec37ad tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '206a9c409b6f4e40a0ae6e3436486529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c341974561e4beaa17135c00d181b7c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:01.519309 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7d30f-9c90-47de-a38e-91a461ec37ad tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:01.521030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7d30f-9c90-47de-a38e-91a461ec37ad tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:01.522935 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7d30f-9c90-47de-a38e-91a461ec37ad tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] PATH_INFO: `/v3/services/12465137be7c4c1d8631239557d41c72` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:01.524039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7d30f-9c90-47de-a38e-91a461ec37ad tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorizing `identity:delete_service(service_id=12465137be7c4c1d8631239557d41c72)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:01.531000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7d30f-9c90-47de-a38e-91a461ec37ad tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:01.576968 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3077/6188] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:17:01 2022] DELETE /identity/v3/services/12465137be7c4c1d8631239557d41c72 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:17:01.581031 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3b00a-b55b-4d87-be3d-a20cfe80eeb4 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:01.621692 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:UPDATE=1,keystone:DELETE=8 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:01.850604 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3b00a-b55b-4d87-be3d-a20cfe80eeb4 tempest-EndPointsTestJSON-1910550704 tempest-EndPointsTestJSON-1910550704-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:01.879898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6c8a5-90cf-4c2c-8e24-a08487d5a33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:01.923088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6c8a5-90cf-4c2c-8e24-a08487d5a33f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:01.926135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6c8a5-90cf-4c2c-8e24-a08487d5a33f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:01.928529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6c8a5-90cf-4c2c-8e24-a08487d5a33f admin admin] PATH_INFO: `/v3/users/f245602db308441e96b1b0d2a5fe5452` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:01.944594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6c8a5-90cf-4c2c-8e24-a08487d5a33f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f245602db308441e96b1b0d2a5fe5452)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:01.955401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6c8a5-90cf-4c2c-8e24-a08487d5a33f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:02.122105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dbf6c8a5-90cf-4c2c-8e24-a08487d5a33f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f245602db308441e96b1b0d2a5fe5452'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:02.143686 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dbf6c8a5-90cf-4c2c-8e24-a08487d5a33f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f245602db308441e96b1b0d2a5fe5452'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:02.144632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dbf6c8a5-90cf-4c2c-8e24-a08487d5a33f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f245602db308441e96b1b0d2a5fe5452'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:02.146001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dbf6c8a5-90cf-4c2c-8e24-a08487d5a33f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f245602db308441e96b1b0d2a5fe5452'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:02.173623 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dbf6c8a5-90cf-4c2c-8e24-a08487d5a33f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f245602db308441e96b1b0d2a5fe5452'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:02.217424 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3112/6189] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:17:01 2022] DELETE /identity/v3/users/f245602db308441e96b1b0d2a5fe5452 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:02.222407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a168f3-7ebf-4e93-ae91-b542e753575e None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:02.223136 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a168f3-7ebf-4e93-ae91-b542e753575e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:02.223506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a168f3-7ebf-4e93-ae91-b542e753575e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:02.262017 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-55a168f3-7ebf-4e93-ae91-b542e753575e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:02.265907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-55a168f3-7ebf-4e93-ae91-b542e753575e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:02.485925 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3078/6190] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:17:03.055494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6c8a5-90cf-4c2c-8e24-a08487d5a33f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:03.057163 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-dbf6c8a5-90cf-4c2c-8e24-a08487d5a33f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:03.274029 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6c8a5-90cf-4c2c-8e24-a08487d5a33f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:03.292223 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7867d-4885-4987-bc9d-76554ca2608e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:03.292995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7867d-4885-4987-bc9d-76554ca2608e service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:03.293279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7867d-4885-4987-bc9d-76554ca2608e service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:03.293582 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7867d-4885-4987-bc9d-76554ca2608e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:03.316056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7867d-4885-4987-bc9d-76554ca2608e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:03.317517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7867d-4885-4987-bc9d-76554ca2608e service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:03.344894 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3113/6191] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:17:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:17:05.072479 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a168f3-7ebf-4e93-ae91-b542e753575e None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:05.074710 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-55a168f3-7ebf-4e93-ae91-b542e753575e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:05.099104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a168f3-7ebf-4e93-ae91-b542e753575e None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:05.120828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06300b-ff08-4406-9513-9a78871605da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:05.121529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06300b-ff08-4406-9513-9a78871605da admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:05.122380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06300b-ff08-4406-9513-9a78871605da admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:05.126963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06300b-ff08-4406-9513-9a78871605da admin admin] PATH_INFO: `/v3/projects/ff51ff769e7940438149730698cc4dfe` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:05.131695 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b06300b-ff08-4406-9513-9a78871605da admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff51ff769e7940438149730698cc4dfe)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:05.133809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b06300b-ff08-4406-9513-9a78871605da admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:05.254143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4b06300b-ff08-4406-9513-9a78871605da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff51ff769e7940438149730698cc4dfe', 'request_id': 'req-4b06300b-ff08-4406-9513-9a78871605da'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:05.269909 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4b06300b-ff08-4406-9513-9a78871605da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff51ff769e7940438149730698cc4dfe', 'request_id': 'req-4b06300b-ff08-4406-9513-9a78871605da'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:05.281233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4b06300b-ff08-4406-9513-9a78871605da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff51ff769e7940438149730698cc4dfe', 'request_id': 'req-4b06300b-ff08-4406-9513-9a78871605da'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:05.307840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4b06300b-ff08-4406-9513-9a78871605da admin admin] The token cache is being invalidate because project ff51ff769e7940438149730698cc4dfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:17:05.308148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4b06300b-ff08-4406-9513-9a78871605da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:05.309402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4b06300b-ff08-4406-9513-9a78871605da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:05.318257 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3079/6192] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:17:05 2022] DELETE /identity/v3/projects/ff51ff769e7940438149730698cc4dfe => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:05.319537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7867d-4885-4987-bc9d-76554ca2608e service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:05.351564 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7867d-4885-4987-bc9d-76554ca2608e service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:05.369077 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:05.550757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803a7ac-9742-467b-a721-fa46fab5684f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:05.555658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803a7ac-9742-467b-a721-fa46fab5684f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:05.557186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803a7ac-9742-467b-a721-fa46fab5684f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:05.557501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803a7ac-9742-467b-a721-fa46fab5684f admin admin] PATH_INFO: `/v3/users/206a9c409b6f4e40a0ae6e3436486529` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:05.561890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803a7ac-9742-467b-a721-fa46fab5684f admin admin] RBAC: Authorizing `identity:delete_user(user_id=206a9c409b6f4e40a0ae6e3436486529)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:05.571909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803a7ac-9742-467b-a721-fa46fab5684f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:05.752175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e803a7ac-9742-467b-a721-fa46fab5684f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '206a9c409b6f4e40a0ae6e3436486529'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:05.798838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e803a7ac-9742-467b-a721-fa46fab5684f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '206a9c409b6f4e40a0ae6e3436486529'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:05.802820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e803a7ac-9742-467b-a721-fa46fab5684f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '206a9c409b6f4e40a0ae6e3436486529'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:05.806479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e803a7ac-9742-467b-a721-fa46fab5684f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '206a9c409b6f4e40a0ae6e3436486529'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:05.845064 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e803a7ac-9742-467b-a721-fa46fab5684f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '206a9c409b6f4e40a0ae6e3436486529'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:05.982299 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3114/6193] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:17:05 2022] DELETE /identity/v3/users/206a9c409b6f4e40a0ae6e3436486529 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:10.367810 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06300b-ff08-4406-9513-9a78871605da admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:10.369585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4b06300b-ff08-4406-9513-9a78871605da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:10.411109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06300b-ff08-4406-9513-9a78871605da admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:10.443233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:10.624284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca922f-07c1-4076-b269-f58744a1f351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:10.625096 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca922f-07c1-4076-b269-f58744a1f351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:10.625384 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca922f-07c1-4076-b269-f58744a1f351 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:10.625657 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca922f-07c1-4076-b269-f58744a1f351 admin admin] PATH_INFO: `/v3/projects/6c341974561e4beaa17135c00d181b7c` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:10.629046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca922f-07c1-4076-b269-f58744a1f351 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c341974561e4beaa17135c00d181b7c)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:10.633158 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca922f-07c1-4076-b269-f58744a1f351 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:10.751964 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803a7ac-9742-467b-a721-fa46fab5684f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:10.754318 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e803a7ac-9742-467b-a721-fa46fab5684f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:10.789632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803a7ac-9742-467b-a721-fa46fab5684f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:10.798336 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1fca922f-07c1-4076-b269-f58744a1f351 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c341974561e4beaa17135c00d181b7c', 'request_id': 'req-1fca922f-07c1-4076-b269-f58744a1f351'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:10.822303 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1fca922f-07c1-4076-b269-f58744a1f351 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c341974561e4beaa17135c00d181b7c', 'request_id': 'req-1fca922f-07c1-4076-b269-f58744a1f351'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:10.833207 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1fca922f-07c1-4076-b269-f58744a1f351 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c341974561e4beaa17135c00d181b7c', 'request_id': 'req-1fca922f-07c1-4076-b269-f58744a1f351'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:10.882582 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1fca922f-07c1-4076-b269-f58744a1f351 admin admin] The token cache is being invalidate because project 6c341974561e4beaa17135c00d181b7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:17:10.884661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1fca922f-07c1-4076-b269-f58744a1f351 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:10.888251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1fca922f-07c1-4076-b269-f58744a1f351 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:10.893626 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3080/6194] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:17:10 2022] DELETE /identity/v3/projects/6c341974561e4beaa17135c00d181b7c => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:10.907148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac29a0-f48a-4fcf-a259-ad021a53914c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:10.907942 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac29a0-f48a-4fcf-a259-ad021a53914c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:10.907942 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac29a0-f48a-4fcf-a259-ad021a53914c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:10.970391 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-8fac29a0-f48a-4fcf-a259-ad021a53914c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:10.972904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8fac29a0-f48a-4fcf-a259-ad021a53914c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:10.975506 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698cae8-a2cf-4345-902f-63988f6d2c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:10.975506 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698cae8-a2cf-4345-902f-63988f6d2c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:10.975506 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698cae8-a2cf-4345-902f-63988f6d2c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:10.975506 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698cae8-a2cf-4345-902f-63988f6d2c08 admin admin] PATH_INFO: `/v3/users/3597dc51e1ae4d80a4bd648fcf3e31bc` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:10.988241 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d698cae8-a2cf-4345-902f-63988f6d2c08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3597dc51e1ae4d80a4bd648fcf3e31bc)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:10.990428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d698cae8-a2cf-4345-902f-63988f6d2c08 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:10.994856 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3081/6195] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:11.004040 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91043e0e-3a96-4938-9913-f8aee0f69800 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:11.004594 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91043e0e-3a96-4938-9913-f8aee0f69800 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:11.004882 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91043e0e-3a96-4938-9913-f8aee0f69800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:11.057319 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-91043e0e-3a96-4938-9913-f8aee0f69800 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:11.059305 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-91043e0e-3a96-4938-9913-f8aee0f69800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:11.068298 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3082/6196] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:11.072598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91043e0e-3a96-4938-9913-f8aee0f69800 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:11.093048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91043e0e-3a96-4938-9913-f8aee0f69800 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:11.093048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329823f-8e86-4f31-88ac-cf39184ebce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:11.093048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329823f-8e86-4f31-88ac-cf39184ebce7 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:11.093503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:11.093607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329823f-8e86-4f31-88ac-cf39184ebce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:11.093607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329823f-8e86-4f31-88ac-cf39184ebce7 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:11.093607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329823f-8e86-4f31-88ac-cf39184ebce7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:17:11.093607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329823f-8e86-4f31-88ac-cf39184ebce7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:11.095797 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329823f-8e86-4f31-88ac-cf39184ebce7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:11.123341 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3083/6197] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:17:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:17:11.125014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329823f-8e86-4f31-88ac-cf39184ebce7 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:11.153061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d698cae8-a2cf-4345-902f-63988f6d2c08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3597dc51e1ae4d80a4bd648fcf3e31bc'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:11.153843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329823f-8e86-4f31-88ac-cf39184ebce7 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:11.159189 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd7da8-eeb9-4313-951c-956395ee81f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:11.160341 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd7da8-eeb9-4313-951c-956395ee81f0 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:11.160859 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd7da8-eeb9-4313-951c-956395ee81f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:11.161341 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd7da8-eeb9-4313-951c-956395ee81f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:11.162174 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd7da8-eeb9-4313-951c-956395ee81f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:11.166074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd7da8-eeb9-4313-951c-956395ee81f0 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:11.184424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d698cae8-a2cf-4345-902f-63988f6d2c08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3597dc51e1ae4d80a4bd648fcf3e31bc'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:11.186034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d698cae8-a2cf-4345-902f-63988f6d2c08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3597dc51e1ae4d80a4bd648fcf3e31bc'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:11.187228 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d698cae8-a2cf-4345-902f-63988f6d2c08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3597dc51e1ae4d80a4bd648fcf3e31bc'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:11.205207 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3084/6198] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:17:11 2022] POST /identity/v3/projects => generated 369 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:11.210802 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd7da8-eeb9-4313-951c-956395ee81f0 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:11.213482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-cffd7da8-eeb9-4313-951c-956395ee81f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:11.217057 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d698cae8-a2cf-4345-902f-63988f6d2c08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3597dc51e1ae4d80a4bd648fcf3e31bc'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:11.264107 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3115/6199] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:17:10 2022] DELETE /identity/v3/users/3597dc51e1ae4d80a4bd648fcf3e31bc => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:11.298808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:11.498836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd7da8-eeb9-4313-951c-956395ee81f0 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:11.708613 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b750182-b70c-409f-b862-b5f19a11318a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:11.733357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b750182-b70c-409f-b862-b5f19a11318a admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:11.734932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b750182-b70c-409f-b862-b5f19a11318a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:11.736161 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b750182-b70c-409f-b862-b5f19a11318a admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:11.739400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b750182-b70c-409f-b862-b5f19a11318a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:11.747593 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b750182-b70c-409f-b862-b5f19a11318a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:11.810778 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3085/6200] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:17:11 2022] POST /identity/v3/users => generated 285 bytes in 598 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:11.812084 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698cae8-a2cf-4345-902f-63988f6d2c08 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:11.830317 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698cae8-a2cf-4345-902f-63988f6d2c08 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:11.864562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf95e73-6a55-4333-8d96-3779b65f2e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:11.867281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf95e73-6a55-4333-8d96-3779b65f2e33 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:11.868417 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf95e73-6a55-4333-8d96-3779b65f2e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:11.871060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf95e73-6a55-4333-8d96-3779b65f2e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:11.873387 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf95e73-6a55-4333-8d96-3779b65f2e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:11.883535 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf95e73-6a55-4333-8d96-3779b65f2e33 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:11.910412 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3116/6201] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:17:11.915661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b750182-b70c-409f-b862-b5f19a11318a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:11.935977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b750182-b70c-409f-b862-b5f19a11318a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:11.946759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74a469-0b41-49ba-82f8-532f5999f7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:11.947393 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74a469-0b41-49ba-82f8-532f5999f7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:11.947731 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74a469-0b41-49ba-82f8-532f5999f7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:11.947989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74a469-0b41-49ba-82f8-532f5999f7c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:11.949176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e74a469-0b41-49ba-82f8-532f5999f7c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:11.952141 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e74a469-0b41-49ba-82f8-532f5999f7c5 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:11.992515 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3086/6202] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:17:11.993542 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf95e73-6a55-4333-8d96-3779b65f2e33 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:12.020628 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf95e73-6a55-4333-8d96-3779b65f2e33 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:12.034377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20eacc2-af59-4b89-abd3-857e14853370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:12.037563 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20eacc2-af59-4b89-abd3-857e14853370 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:12.038233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20eacc2-af59-4b89-abd3-857e14853370 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:12.038985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20eacc2-af59-4b89-abd3-857e14853370 admin admin] PATH_INFO: `/v3/projects/c4fea9bb1b964740be2b1188187e4c36/users/bdaf427f152e4277baa20d02c38fd067/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:12.120777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20eacc2-af59-4b89-abd3-857e14853370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4fea9bb1b964740be2b1188187e4c36, user_id=bdaf427f152e4277baa20d02c38fd067, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:12.126496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20eacc2-af59-4b89-abd3-857e14853370 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:12.167844 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3117/6203] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:17:11 2022] PUT /identity/v3/projects/c4fea9bb1b964740be2b1188187e4c36/users/bdaf427f152e4277baa20d02c38fd067/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:17:12.177440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1699e5-aac9-4a55-adae-d69ff2faa5b8 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:12.177783 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1699e5-aac9-4a55-adae-d69ff2faa5b8 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:12.178067 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1699e5-aac9-4a55-adae-d69ff2faa5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:12.238914 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-fe1699e5-aac9-4a55-adae-d69ff2faa5b8 None None] MFA Rules not processed for user `bdaf427f152e4277baa20d02c38fd067`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:12.241164 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-fe1699e5-aac9-4a55-adae-d69ff2faa5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:12.439806 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3087/6204] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:12.446009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20eacc2-af59-4b89-abd3-857e14853370 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:12.562923 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20eacc2-af59-4b89-abd3-857e14853370 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:12.589966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b025e-31bd-459d-9615-e72d2b02d9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:12.592916 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b025e-31bd-459d-9615-e72d2b02d9d9 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:12.593213 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b025e-31bd-459d-9615-e72d2b02d9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:12.593513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b025e-31bd-459d-9615-e72d2b02d9d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:12.598007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b025e-31bd-459d-9615-e72d2b02d9d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:12.600299 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b025e-31bd-459d-9615-e72d2b02d9d9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:12.643111 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3118/6205] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:17:12 2022] POST /identity/v3/projects => generated 367 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:12.646109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1699e5-aac9-4a55-adae-d69ff2faa5b8 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:12.690691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1699e5-aac9-4a55-adae-d69ff2faa5b8 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:12.911480 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b4a19-e21d-45d2-84d2-ec12a440791c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:12.912796 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b4a19-e21d-45d2-84d2-ec12a440791c admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:12.916760 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b4a19-e21d-45d2-84d2-ec12a440791c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:12.917066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b4a19-e21d-45d2-84d2-ec12a440791c admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:12.918604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b4a19-e21d-45d2-84d2-ec12a440791c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:12.928026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b4a19-e21d-45d2-84d2-ec12a440791c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:12.991461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:13.017108 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3088/6206] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:17:12 2022] POST /identity/v3/users => generated 290 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:13.018230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b025e-31bd-459d-9615-e72d2b02d9d9 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:13.037474 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b025e-31bd-459d-9615-e72d2b02d9d9 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:13.056134 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a3665-9c3e-4629-b7a4-ae7e5192d061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:13.057260 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a3665-9c3e-4629-b7a4-ae7e5192d061 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:13.059698 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a3665-9c3e-4629-b7a4-ae7e5192d061 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:13.061770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a3665-9c3e-4629-b7a4-ae7e5192d061 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:13.078484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a3665-9c3e-4629-b7a4-ae7e5192d061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:13.090114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a3665-9c3e-4629-b7a4-ae7e5192d061 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:13.128993 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3119/6207] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:17:13.133143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b4a19-e21d-45d2-84d2-ec12a440791c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:13.164403 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b4a19-e21d-45d2-84d2-ec12a440791c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:13.182952 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e850e10-4b0d-47f8-867e-4d9c68f4eb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:13.184089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e850e10-4b0d-47f8-867e-4d9c68f4eb91 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:13.186603 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e850e10-4b0d-47f8-867e-4d9c68f4eb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:13.187623 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e850e10-4b0d-47f8-867e-4d9c68f4eb91 admin admin] PATH_INFO: `/v3/projects/2a4dd8349714403ba5fbae26633c5054/users/199690c2ec624f138cb5b23aa7fd3b3a/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:13.241588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e850e10-4b0d-47f8-867e-4d9c68f4eb91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a4dd8349714403ba5fbae26633c5054, user_id=199690c2ec624f138cb5b23aa7fd3b3a, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:13.251388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e850e10-4b0d-47f8-867e-4d9c68f4eb91 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:13.287694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a3665-9c3e-4629-b7a4-ae7e5192d061 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:13.289611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-026a3665-9c3e-4629-b7a4-ae7e5192d061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:13.310483 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3089/6208] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:17:13 2022] PUT /identity/v3/projects/2a4dd8349714403ba5fbae26633c5054/users/199690c2ec624f138cb5b23aa7fd3b3a/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:17:13.315482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e850e10-4b0d-47f8-867e-4d9c68f4eb91 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:13.327801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a3665-9c3e-4629-b7a4-ae7e5192d061 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:13.470896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:13.520802 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672f153-f80c-4bb3-9f4f-d8490406238a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:13.521890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672f153-f80c-4bb3-9f4f-d8490406238a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:13.522394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672f153-f80c-4bb3-9f4f-d8490406238a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:13.525207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672f153-f80c-4bb3-9f4f-d8490406238a admin admin] PATH_INFO: `/v3/projects/b62ccbeb57bc4acebcba07ac1f82ae22` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:13.527117 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672f153-f80c-4bb3-9f4f-d8490406238a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b62ccbeb57bc4acebcba07ac1f82ae22)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:13.530111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672f153-f80c-4bb3-9f4f-d8490406238a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:13.575971 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e850e10-4b0d-47f8-867e-4d9c68f4eb91 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:13.601667 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424b744-b85e-4211-a275-86518eb73782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:13.602302 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424b744-b85e-4211-a275-86518eb73782 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:13.604413 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424b744-b85e-4211-a275-86518eb73782 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:13.604671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424b744-b85e-4211-a275-86518eb73782 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:13.605850 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424b744-b85e-4211-a275-86518eb73782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:13.607511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424b744-b85e-4211-a275-86518eb73782 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:13.637370 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3090/6209] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:17:13.638536 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47553c07-a0e4-47d3-bb3c-b8ad79cd8532 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:13.638842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47553c07-a0e4-47d3-bb3c-b8ad79cd8532 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:13.639120 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47553c07-a0e4-47d3-bb3c-b8ad79cd8532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:13.671988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f672f153-f80c-4bb3-9f4f-d8490406238a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'request_id': 'req-f672f153-f80c-4bb3-9f4f-d8490406238a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:13.680847 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f672f153-f80c-4bb3-9f4f-d8490406238a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'request_id': 'req-f672f153-f80c-4bb3-9f4f-d8490406238a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:13.702347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f672f153-f80c-4bb3-9f4f-d8490406238a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'request_id': 'req-f672f153-f80c-4bb3-9f4f-d8490406238a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:13.736534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f672f153-f80c-4bb3-9f4f-d8490406238a admin admin] The token cache is being invalidate because project b62ccbeb57bc4acebcba07ac1f82ae22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:17:13.737221 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f672f153-f80c-4bb3-9f4f-d8490406238a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:13.738080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f672f153-f80c-4bb3-9f4f-d8490406238a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:13.747153 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3120/6210] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:17:13 2022] DELETE /identity/v3/projects/b62ccbeb57bc4acebcba07ac1f82ae22 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:17:13.749015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672f153-f80c-4bb3-9f4f-d8490406238a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:13.751135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f672f153-f80c-4bb3-9f4f-d8490406238a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:13.758417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-47553c07-a0e4-47d3-bb3c-b8ad79cd8532 None None] MFA Rules not processed for user `65e64ff8f2b14f70b1b05327f691701e`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:13.759671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-47553c07-a0e4-47d3-bb3c-b8ad79cd8532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:13.908026 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3091/6211] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:13.909194 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab3c7c-983c-4b11-a7a1-6e6a539279fa None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:13.909478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab3c7c-983c-4b11-a7a1-6e6a539279fa None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:13.909743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab3c7c-983c-4b11-a7a1-6e6a539279fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:13.963807 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-60ab3c7c-983c-4b11-a7a1-6e6a539279fa None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:13.965154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-60ab3c7c-983c-4b11-a7a1-6e6a539279fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:13.994866 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672f153-f80c-4bb3-9f4f-d8490406238a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:14.001618 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3092/6212] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:14.006902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab3c7c-983c-4b11-a7a1-6e6a539279fa None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:14.011528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-60ab3c7c-983c-4b11-a7a1-6e6a539279fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:14.018698 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191683a-e68f-49c6-82e4-1ff738a8f27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:14.019400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191683a-e68f-49c6-82e4-1ff738a8f27e admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:14.019681 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191683a-e68f-49c6-82e4-1ff738a8f27e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:14.019957 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191683a-e68f-49c6-82e4-1ff738a8f27e admin admin] PATH_INFO: `/v3/projects/2a4dd8349714403ba5fbae26633c5054/users/199690c2ec624f138cb5b23aa7fd3b3a/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:14.034640 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3191683a-e68f-49c6-82e4-1ff738a8f27e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a4dd8349714403ba5fbae26633c5054, user_id=199690c2ec624f138cb5b23aa7fd3b3a, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:14.037400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3191683a-e68f-49c6-82e4-1ff738a8f27e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:14.096445 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3121/6213] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:17:13 2022] PUT /identity/v3/projects/2a4dd8349714403ba5fbae26633c5054/users/199690c2ec624f138cb5b23aa7fd3b3a/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:14.112139 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f7979-69de-4424-9f97-e700b7fe69fe None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:14.112426 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f7979-69de-4424-9f97-e700b7fe69fe None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:14.112706 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f7979-69de-4424-9f97-e700b7fe69fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:14.128682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:14.147126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-857f7979-69de-4424-9f97-e700b7fe69fe None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:14.148254 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-857f7979-69de-4424-9f97-e700b7fe69fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:14.254174 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab3c7c-983c-4b11-a7a1-6e6a539279fa None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:14.344948 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3122/6214] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:14.347097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcbc5d-9052-4e93-83d3-3cda06cf80cc None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:14.347606 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcbc5d-9052-4e93-83d3-3cda06cf80cc None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:14.348306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcbc5d-9052-4e93-83d3-3cda06cf80cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:14.405314 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:14.410430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3c7e9-2663-4979-ab6d-8310694c1541 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:14.410984 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3c7e9-2663-4979-ab6d-8310694c1541 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:14.411530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3c7e9-2663-4979-ab6d-8310694c1541 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:14.411530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3c7e9-2663-4979-ab6d-8310694c1541 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:14.430832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-16dcbc5d-9052-4e93-83d3-3cda06cf80cc None None] MFA Rules not processed for user `199690c2ec624f138cb5b23aa7fd3b3a`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:14.439326 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-16dcbc5d-9052-4e93-83d3-3cda06cf80cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:14.529673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3c7e9-2663-4979-ab6d-8310694c1541 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:14.531397 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3c7e9-2663-4979-ab6d-8310694c1541 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:14.554262 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3093/6215] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:17:14 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:17:14.555551 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3c7e9-2663-4979-ab6d-8310694c1541 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:14.579538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3c7e9-2663-4979-ab6d-8310694c1541 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:14.592220 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978b820-026e-4cbd-96a5-7ab0e89f5910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:14.592854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978b820-026e-4cbd-96a5-7ab0e89f5910 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:14.593130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978b820-026e-4cbd-96a5-7ab0e89f5910 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:14.595590 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978b820-026e-4cbd-96a5-7ab0e89f5910 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:14.596105 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978b820-026e-4cbd-96a5-7ab0e89f5910 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:17:14.596415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978b820-026e-4cbd-96a5-7ab0e89f5910 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:14.599328 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978b820-026e-4cbd-96a5-7ab0e89f5910 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:14.661003 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3094/6216] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:17:14.678368 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3123/6217] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:14.680218 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978b820-026e-4cbd-96a5-7ab0e89f5910 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:14.681560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcbc5d-9052-4e93-83d3-3cda06cf80cc None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:14.696399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978b820-026e-4cbd-96a5-7ab0e89f5910 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:14.700900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcbc5d-9052-4e93-83d3-3cda06cf80cc None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:14.703659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182ca70-225f-4734-809d-ead9f5ba6d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:14.716142 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9f9a5-12df-4ec9-8407-42e061462dba tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:14.716771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9f9a5-12df-4ec9-8407-42e061462dba tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:14.717053 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9f9a5-12df-4ec9-8407-42e061462dba tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:14.717331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9f9a5-12df-4ec9-8407-42e061462dba tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:14.717954 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9f9a5-12df-4ec9-8407-42e061462dba tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:14.729524 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182ca70-225f-4734-809d-ead9f5ba6d00 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:14.730252 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9f9a5-12df-4ec9-8407-42e061462dba tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:14.730378 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182ca70-225f-4734-809d-ead9f5ba6d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:14.730378 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182ca70-225f-4734-809d-ead9f5ba6d00 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:14.730378 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e182ca70-225f-4734-809d-ead9f5ba6d00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:14.730378 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e182ca70-225f-4734-809d-ead9f5ba6d00 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:14.781656 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3124/6218] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:17:14 2022] POST /identity/v3/projects => generated 358 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:14.785583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9f9a5-12df-4ec9-8407-42e061462dba tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:14.796356 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3095/6219] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:17:14 2022] POST /identity/v3/projects => generated 391 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:14.801971 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182ca70-225f-4734-809d-ead9f5ba6d00 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:14.953549 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9f9a5-12df-4ec9-8407-42e061462dba tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:14.958671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:14.959735 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad31e7d-f7f7-4cbc-bacd-bfd58302b8ec tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:14.960361 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad31e7d-f7f7-4cbc-bacd-bfd58302b8ec tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:14.960643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad31e7d-f7f7-4cbc-bacd-bfd58302b8ec tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:14.960918 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad31e7d-f7f7-4cbc-bacd-bfd58302b8ec tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:14.961562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad31e7d-f7f7-4cbc-bacd-bfd58302b8ec tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:14.967328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad31e7d-f7f7-4cbc-bacd-bfd58302b8ec tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:15.007504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182ca70-225f-4734-809d-ead9f5ba6d00 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:15.023601 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3125/6220] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:17:14 2022] POST /identity/v3/users => generated 416 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:15.025319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad31e7d-f7f7-4cbc-bacd-bfd58302b8ec tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:15.050132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad31e7d-f7f7-4cbc-bacd-bfd58302b8ec tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:15.066301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c2ac2-8309-411d-a416-4b9c7e64c2f6 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:15.067624 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c2ac2-8309-411d-a416-4b9c7e64c2f6 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:15.068176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c2ac2-8309-411d-a416-4b9c7e64c2f6 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:15.068719 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c2ac2-8309-411d-a416-4b9c7e64c2f6 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/users/aead76475ff54f7892635a7271c2f116` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:15.095038 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c2ac2-8309-411d-a416-4b9c7e64c2f6 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:get_user(user_id=aead76475ff54f7892635a7271c2f116)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:15.098229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c2ac2-8309-411d-a416-4b9c7e64c2f6 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:15.100718 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3126/6221] 10.222.0.33 () {58 vars in 1221 bytes} [Sat Aug 6 21:17:15 2022] GET /identity/v3/users/aead76475ff54f7892635a7271c2f116 => generated 416 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:17:15.104378 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c2ac2-8309-411d-a416-4b9c7e64c2f6 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:15.130838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c2ac2-8309-411d-a416-4b9c7e64c2f6 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:15.156981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd22604-b3d8-4d1b-8c99-7c767acf5f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:15.157539 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd22604-b3d8-4d1b-8c99-7c767acf5f7f admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:15.157825 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd22604-b3d8-4d1b-8c99-7c767acf5f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:15.158081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd22604-b3d8-4d1b-8c99-7c767acf5f7f admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:15.158762 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd22604-b3d8-4d1b-8c99-7c767acf5f7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:15.163865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd22604-b3d8-4d1b-8c99-7c767acf5f7f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:15.176353 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e41cfa-aec1-4d8f-ab64-1e6f7d2b8bb4 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:15.177153 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e41cfa-aec1-4d8f-ab64-1e6f7d2b8bb4 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:15.177516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e41cfa-aec1-4d8f-ab64-1e6f7d2b8bb4 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:15.179789 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e41cfa-aec1-4d8f-ab64-1e6f7d2b8bb4 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/users/aead76475ff54f7892635a7271c2f116` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:15.182096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e41cfa-aec1-4d8f-ab64-1e6f7d2b8bb4 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:delete_user(user_id=aead76475ff54f7892635a7271c2f116)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:15.191045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e41cfa-aec1-4d8f-ab64-1e6f7d2b8bb4 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:15.227365 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3096/6222] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:17:14 2022] POST /identity/v3/users => generated 296 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:15.228773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd22604-b3d8-4d1b-8c99-7c767acf5f7f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:15.257568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd22604-b3d8-4d1b-8c99-7c767acf5f7f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:15.262786 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc69860-ace2-4965-aae1-61b4c818de35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:15.263595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc69860-ace2-4965-aae1-61b4c818de35 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:15.263874 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc69860-ace2-4965-aae1-61b4c818de35 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:15.264407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc69860-ace2-4965-aae1-61b4c818de35 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:15.265378 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc69860-ace2-4965-aae1-61b4c818de35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:15.267871 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc69860-ace2-4965-aae1-61b4c818de35 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:15.282531 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3097/6223] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:17:15.286312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc69860-ace2-4965-aae1-61b4c818de35 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:15.301644 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:15.312599 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc69860-ace2-4965-aae1-61b4c818de35 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:15.316383 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e7e41cfa-aec1-4d8f-ab64-1e6f7d2b8bb4 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aead76475ff54f7892635a7271c2f116'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:15.332156 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633ebbf-27c8-4c7a-8663-8cbf7f589173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:15.337058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633ebbf-27c8-4c7a-8663-8cbf7f589173 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:15.337737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633ebbf-27c8-4c7a-8663-8cbf7f589173 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:15.338318 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e7e41cfa-aec1-4d8f-ab64-1e6f7d2b8bb4 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aead76475ff54f7892635a7271c2f116'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:15.339741 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633ebbf-27c8-4c7a-8663-8cbf7f589173 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:15.340744 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633ebbf-27c8-4c7a-8663-8cbf7f589173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:15.343425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e7e41cfa-aec1-4d8f-ab64-1e6f7d2b8bb4 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aead76475ff54f7892635a7271c2f116'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:15.345166 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e7e41cfa-aec1-4d8f-ab64-1e6f7d2b8bb4 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aead76475ff54f7892635a7271c2f116'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:15.347616 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633ebbf-27c8-4c7a-8663-8cbf7f589173 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:15.371072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e7e41cfa-aec1-4d8f-ab64-1e6f7d2b8bb4 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aead76475ff54f7892635a7271c2f116'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:15.385032 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3098/6224] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:17:15.390835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633ebbf-27c8-4c7a-8663-8cbf7f589173 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:15.394904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a633ebbf-27c8-4c7a-8663-8cbf7f589173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:15.416620 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3127/6225] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:17:15 2022] DELETE /identity/v3/users/aead76475ff54f7892635a7271c2f116 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:15.420691 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e41cfa-aec1-4d8f-ab64-1e6f7d2b8bb4 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:15.422436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e7e41cfa-aec1-4d8f-ab64-1e6f7d2b8bb4 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:15.426079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633ebbf-27c8-4c7a-8663-8cbf7f589173 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:15.558759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d1415-b680-481b-b5d6-e8a9dc713f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:15.559370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d1415-b680-481b-b5d6-e8a9dc713f6f admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:15.559494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e41cfa-aec1-4d8f-ab64-1e6f7d2b8bb4 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:15.559685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d1415-b680-481b-b5d6-e8a9dc713f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:15.559927 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d1415-b680-481b-b5d6-e8a9dc713f6f admin admin] PATH_INFO: `/v3/projects/c6ce2c837b18401cb920cf7ec3f1846a/users/8a33f0cd51e14a6eb09cab1e91c5d2b7/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:15.576273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80633b52-d17e-4ffd-8856-c29c11a3f6ed tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:15.577039 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80633b52-d17e-4ffd-8856-c29c11a3f6ed tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:15.577327 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80633b52-d17e-4ffd-8856-c29c11a3f6ed tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:15.578075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80633b52-d17e-4ffd-8856-c29c11a3f6ed tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/projects/02c2e620c9d04d9f8ac79a083889ccb0` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:15.579166 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80633b52-d17e-4ffd-8856-c29c11a3f6ed tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:delete_project(project_id=02c2e620c9d04d9f8ac79a083889ccb0)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:15.585327 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80633b52-d17e-4ffd-8856-c29c11a3f6ed tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:15.592137 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d1415-b680-481b-b5d6-e8a9dc713f6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6ce2c837b18401cb920cf7ec3f1846a, user_id=8a33f0cd51e14a6eb09cab1e91c5d2b7, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:15.602476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d1415-b680-481b-b5d6-e8a9dc713f6f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:15.627621 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3099/6226] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:17:15 2022] PUT /identity/v3/projects/c6ce2c837b18401cb920cf7ec3f1846a/users/8a33f0cd51e14a6eb09cab1e91c5d2b7/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:15.639273 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5434134-a11d-49be-8341-7833543293a5 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:15.639642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5434134-a11d-49be-8341-7833543293a5 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:15.639821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5434134-a11d-49be-8341-7833543293a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:15.705911 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f5434134-a11d-49be-8341-7833543293a5 None None] MFA Rules not processed for user `8a33f0cd51e14a6eb09cab1e91c5d2b7`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:15.707109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f5434134-a11d-49be-8341-7833543293a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:15.708934 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-80633b52-d17e-4ffd-8856-c29c11a3f6ed tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02c2e620c9d04d9f8ac79a083889ccb0', 'request_id': 'req-80633b52-d17e-4ffd-8856-c29c11a3f6ed'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:15.724257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-80633b52-d17e-4ffd-8856-c29c11a3f6ed tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02c2e620c9d04d9f8ac79a083889ccb0', 'request_id': 'req-80633b52-d17e-4ffd-8856-c29c11a3f6ed'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:15.740409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-80633b52-d17e-4ffd-8856-c29c11a3f6ed tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02c2e620c9d04d9f8ac79a083889ccb0', 'request_id': 'req-80633b52-d17e-4ffd-8856-c29c11a3f6ed'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:15.760310 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-80633b52-d17e-4ffd-8856-c29c11a3f6ed tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] The token cache is being invalidate because project 02c2e620c9d04d9f8ac79a083889ccb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:17:15.760612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-80633b52-d17e-4ffd-8856-c29c11a3f6ed tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:15.765498 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-80633b52-d17e-4ffd-8856-c29c11a3f6ed tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:15.767356 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3128/6227] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:17:15 2022] DELETE /identity/v3/projects/02c2e620c9d04d9f8ac79a083889ccb0 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:15.772703 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80633b52-d17e-4ffd-8856-c29c11a3f6ed tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:15.773832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-80633b52-d17e-4ffd-8856-c29c11a3f6ed tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:15.786870 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:15.904262 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3100/6228] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:17:15.912773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5434134-a11d-49be-8341-7833543293a5 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:15.915716 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f5434134-a11d-49be-8341-7833543293a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:15.941021 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:15.993797 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80633b52-d17e-4ffd-8856-c29c11a3f6ed tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:15.999989 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f3c79-2654-4687-9608-4a2cff3e012b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:16.001886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f3c79-2654-4687-9608-4a2cff3e012b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:16.002328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f3c79-2654-4687-9608-4a2cff3e012b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:16.003431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f3c79-2654-4687-9608-4a2cff3e012b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:16.005863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f3c79-2654-4687-9608-4a2cff3e012b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:16.009727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f3c79-2654-4687-9608-4a2cff3e012b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:16.041347 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3129/6229] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:17:15 2022] POST /identity/v3/projects => generated 349 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:17:16.045246 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f3c79-2654-4687-9608-4a2cff3e012b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:16.115373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5434134-a11d-49be-8341-7833543293a5 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:16.179017 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f3c79-2654-4687-9608-4a2cff3e012b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:16.188931 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38869ed9-4580-4555-9c37-14dd3a98ef77 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:16.190925 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38869ed9-4580-4555-9c37-14dd3a98ef77 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:16.191694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38869ed9-4580-4555-9c37-14dd3a98ef77 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:16.192161 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38869ed9-4580-4555-9c37-14dd3a98ef77 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:16.193165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38869ed9-4580-4555-9c37-14dd3a98ef77 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:17:16.193666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38869ed9-4580-4555-9c37-14dd3a98ef77 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:16.195948 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38869ed9-4580-4555-9c37-14dd3a98ef77 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:16.213714 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3130/6230] 10.222.0.33 () {58 vars in 1160 bytes} [Sat Aug 6 21:17:16 2022] GET /identity/v3/projects?is_domain=True => generated 1021 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:17:16.216046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f69f61-b69f-4317-ae36-ce9ed29e5c2b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:16.216612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f69f61-b69f-4317-ae36-ce9ed29e5c2b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:16.217083 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f69f61-b69f-4317-ae36-ce9ed29e5c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:16.241340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d9f69f61-b69f-4317-ae36-ce9ed29e5c2b None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:16.243355 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d9f69f61-b69f-4317-ae36-ce9ed29e5c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:16.364806 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3131/6231] 10.222.0.33 () {58 vars in 967 bytes} [Sat Aug 6 21:17:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:16.366445 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f69f61-b69f-4317-ae36-ce9ed29e5c2b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:16.382501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f69f61-b69f-4317-ae36-ce9ed29e5c2b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:16.388616 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3abfee-50be-47bd-acc3-2b141801e057 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:16.389465 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3abfee-50be-47bd-acc3-2b141801e057 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:16.390498 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3abfee-50be-47bd-acc3-2b141801e057 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:16.390934 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3abfee-50be-47bd-acc3-2b141801e057 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:16.391793 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3abfee-50be-47bd-acc3-2b141801e057 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:16.393645 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3abfee-50be-47bd-acc3-2b141801e057 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:16.409509 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3132/6232] 10.222.0.33 () {58 vars in 1128 bytes} [Sat Aug 6 21:17:16 2022] GET /identity/v3/domains => generated 830 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:17:16.410532 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3abfee-50be-47bd-acc3-2b141801e057 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:16.412852 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0d3abfee-50be-47bd-acc3-2b141801e057 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:16.551537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:16.599574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3abfee-50be-47bd-acc3-2b141801e057 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:16.609001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b123d-bb5c-4034-b248-89bfceb30e61 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:16.610338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b123d-bb5c-4034-b248-89bfceb30e61 service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:16.610883 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b123d-bb5c-4034-b248-89bfceb30e61 service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:16.611266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b123d-bb5c-4034-b248-89bfceb30e61 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:16.623659 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b123d-bb5c-4034-b248-89bfceb30e61 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:16.626564 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b123d-bb5c-4034-b248-89bfceb30e61 service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:16.632207 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a5e9f-c223-4147-aba6-f03272b25b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:16.633239 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a5e9f-c223-4147-aba6-f03272b25b93 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:16.633690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a5e9f-c223-4147-aba6-f03272b25b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:16.634116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a5e9f-c223-4147-aba6-f03272b25b93 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:16.635063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a5e9f-c223-4147-aba6-f03272b25b93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:16.638537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a5e9f-c223-4147-aba6-f03272b25b93 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:16.648659 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3133/6233] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:17:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:17:16.649664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b123d-bb5c-4034-b248-89bfceb30e61 service swift] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:16.684985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b123d-bb5c-4034-b248-89bfceb30e61 service swift] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:16.697100 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb585b-a1df-49e4-b4ca-68db09abdf48 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:16.699368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb585b-a1df-49e4-b4ca-68db09abdf48 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:16.699736 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb585b-a1df-49e4-b4ca-68db09abdf48 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:16.700261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb585b-a1df-49e4-b4ca-68db09abdf48 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/projects/e38154eed4624e50ba60556612984bdd` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:16.704436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb585b-a1df-49e4-b4ca-68db09abdf48 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:update_project(project_id=e38154eed4624e50ba60556612984bdd)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:16.705633 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-bacb585b-a1df-49e4-b4ca-68db09abdf48 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:17:16.705633 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:17:16.705633 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:17:16.709998 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb585b-a1df-49e4-b4ca-68db09abdf48 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:16.725805 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3101/6234] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:17:15 2022] POST /identity/v3/projects => generated 391 bytes in 814 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:16.729785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a5e9f-c223-4147-aba6-f03272b25b93 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:16.752124 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bacb585b-a1df-49e4-b4ca-68db09abdf48 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e38154eed4624e50ba60556612984bdd'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:16.753666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bacb585b-a1df-49e4-b4ca-68db09abdf48 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e38154eed4624e50ba60556612984bdd'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:16.831455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bacb585b-a1df-49e4-b4ca-68db09abdf48 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e38154eed4624e50ba60556612984bdd'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:16.833710 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bacb585b-a1df-49e4-b4ca-68db09abdf48 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e38154eed4624e50ba60556612984bdd'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:16.848754 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3134/6235] 10.222.0.33 () {60 vars in 1252 bytes} [Sat Aug 6 21:17:16 2022] PATCH /identity/v3/projects/e38154eed4624e50ba60556612984bdd => generated 363 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:17:16.849925 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb585b-a1df-49e4-b4ca-68db09abdf48 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:16.852335 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-bacb585b-a1df-49e4-b4ca-68db09abdf48 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:16.951238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a5e9f-c223-4147-aba6-f03272b25b93 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:17.002064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:17.005123 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb585b-a1df-49e4-b4ca-68db09abdf48 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:17.023705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd202b0d-cec9-433e-8c2d-30c317d3fb83 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:17.024382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd202b0d-cec9-433e-8c2d-30c317d3fb83 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:17.024845 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd202b0d-cec9-433e-8c2d-30c317d3fb83 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:17.025073 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd202b0d-cec9-433e-8c2d-30c317d3fb83 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/projects/e38154eed4624e50ba60556612984bdd` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:17.052320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd202b0d-cec9-433e-8c2d-30c317d3fb83 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e38154eed4624e50ba60556612984bdd)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:17.054315 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd202b0d-cec9-433e-8c2d-30c317d3fb83 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:17.115403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fd202b0d-cec9-433e-8c2d-30c317d3fb83 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e38154eed4624e50ba60556612984bdd'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:17.133720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fd202b0d-cec9-433e-8c2d-30c317d3fb83 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e38154eed4624e50ba60556612984bdd'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:17.137152 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9862d409-c223-4a33-b5f4-0b25cff3dc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:17.137755 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862d409-c223-4a33-b5f4-0b25cff3dc35 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:17.138038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862d409-c223-4a33-b5f4-0b25cff3dc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:17.138721 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862d409-c223-4a33-b5f4-0b25cff3dc35 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:17.139352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9862d409-c223-4a33-b5f4-0b25cff3dc35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:17.144012 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9862d409-c223-4a33-b5f4-0b25cff3dc35 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:17.191171 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3102/6236] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:17:16 2022] POST /identity/v3/users => generated 302 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:17.195517 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9862d409-c223-4a33-b5f4-0b25cff3dc35 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:17.201534 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9862d409-c223-4a33-b5f4-0b25cff3dc35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:17.218491 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9862d409-c223-4a33-b5f4-0b25cff3dc35 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:17.220819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fd202b0d-cec9-433e-8c2d-30c317d3fb83 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e38154eed4624e50ba60556612984bdd', 'request_id': 'req-fd202b0d-cec9-433e-8c2d-30c317d3fb83'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:17.239514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fd202b0d-cec9-433e-8c2d-30c317d3fb83 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e38154eed4624e50ba60556612984bdd', 'request_id': 'req-fd202b0d-cec9-433e-8c2d-30c317d3fb83'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:17.260538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fd202b0d-cec9-433e-8c2d-30c317d3fb83 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e38154eed4624e50ba60556612984bdd', 'request_id': 'req-fd202b0d-cec9-433e-8c2d-30c317d3fb83'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:17.287912 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fd202b0d-cec9-433e-8c2d-30c317d3fb83 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] The token cache is being invalidate because project e38154eed4624e50ba60556612984bdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:17:17.289181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fd202b0d-cec9-433e-8c2d-30c317d3fb83 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:17.304154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fd202b0d-cec9-433e-8c2d-30c317d3fb83 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:17.311450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1148f-e9ed-4ec7-ac10-7309c4299389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:17.312648 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1148f-e9ed-4ec7-ac10-7309c4299389 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:17.313038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1148f-e9ed-4ec7-ac10-7309c4299389 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:17.313407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1148f-e9ed-4ec7-ac10-7309c4299389 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:17.314033 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:UPDATE=1,keystone:DELETE=8,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:17.314716 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1148f-e9ed-4ec7-ac10-7309c4299389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:17.320893 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1148f-e9ed-4ec7-ac10-7309c4299389 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:17.327979 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fd202b0d-cec9-433e-8c2d-30c317d3fb83 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e38154eed4624e50ba60556612984bdd', 'request_id': 'req-fd202b0d-cec9-433e-8c2d-30c317d3fb83'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:17.336480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fd202b0d-cec9-433e-8c2d-30c317d3fb83 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e38154eed4624e50ba60556612984bdd', 'request_id': 'req-fd202b0d-cec9-433e-8c2d-30c317d3fb83'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:17.339443 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fd202b0d-cec9-433e-8c2d-30c317d3fb83 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e38154eed4624e50ba60556612984bdd', 'request_id': 'req-fd202b0d-cec9-433e-8c2d-30c317d3fb83'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:17.359128 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3103/6237] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:17:17.359370 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3135/6238] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:17:16 2022] DELETE /identity/v3/projects/e38154eed4624e50ba60556612984bdd => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:17.359478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1148f-e9ed-4ec7-ac10-7309c4299389 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:17.359478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-26e1148f-e9ed-4ec7-ac10-7309c4299389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:17.360852 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd202b0d-cec9-433e-8c2d-30c317d3fb83 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:17.366318 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-fd202b0d-cec9-433e-8c2d-30c317d3fb83 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:17.423053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1148f-e9ed-4ec7-ac10-7309c4299389 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:17.459995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2d016-5c43-4d8a-8aa8-66fa7da570d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:17.462595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2d016-5c43-4d8a-8aa8-66fa7da570d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:17.462893 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2d016-5c43-4d8a-8aa8-66fa7da570d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:17.463175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2d016-5c43-4d8a-8aa8-66fa7da570d5 admin admin] PATH_INFO: `/v3/projects/d68af603729f48d98db32dad8ca70c9d/users/af48a7cc47854309979d1cc80d856957/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:17.531112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2d016-5c43-4d8a-8aa8-66fa7da570d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d68af603729f48d98db32dad8ca70c9d, user_id=af48a7cc47854309979d1cc80d856957, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:17.539959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2d016-5c43-4d8a-8aa8-66fa7da570d5 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:17.591530 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3104/6239] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:17:17 2022] PUT /identity/v3/projects/d68af603729f48d98db32dad8ca70c9d/users/af48a7cc47854309979d1cc80d856957/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:17.593437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2d016-5c43-4d8a-8aa8-66fa7da570d5 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:17.630713 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd202b0d-cec9-433e-8c2d-30c317d3fb83 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:17.780388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2d016-5c43-4d8a-8aa8-66fa7da570d5 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:17.794073 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa083d-c165-40c6-9a32-34f02422d74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:17.795589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa083d-c165-40c6-9a32-34f02422d74a admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:17.797950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa083d-c165-40c6-9a32-34f02422d74a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:17.798280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa083d-c165-40c6-9a32-34f02422d74a admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:17.801106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa083d-c165-40c6-9a32-34f02422d74a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:17.803471 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa083d-c165-40c6-9a32-34f02422d74a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:17.812394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e6b966-d70e-4c83-9f45-844d1febb7f7 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:17.813100 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6b966-d70e-4c83-9f45-844d1febb7f7 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:17.813442 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6b966-d70e-4c83-9f45-844d1febb7f7 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:17.813732 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6b966-d70e-4c83-9f45-844d1febb7f7 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:17.817036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e6b966-d70e-4c83-9f45-844d1febb7f7 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:17.819161 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e6b966-d70e-4c83-9f45-844d1febb7f7 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:17.837113 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3105/6240] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:17:17.841198 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa083d-c165-40c6-9a32-34f02422d74a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:17.871427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa083d-c165-40c6-9a32-34f02422d74a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:17.878138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3872a2-0cd8-4813-b640-a64744576b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:17.878860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3872a2-0cd8-4813-b640-a64744576b00 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:17.879141 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3872a2-0cd8-4813-b640-a64744576b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:17.879415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3872a2-0cd8-4813-b640-a64744576b00 admin admin] PATH_INFO: `/v3/projects/d68af603729f48d98db32dad8ca70c9d/users/af48a7cc47854309979d1cc80d856957/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:17.882748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3872a2-0cd8-4813-b640-a64744576b00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d68af603729f48d98db32dad8ca70c9d, user_id=af48a7cc47854309979d1cc80d856957, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:17.886768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3872a2-0cd8-4813-b640-a64744576b00 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:17.893106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:17.910060 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3106/6241] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:17:17 2022] PUT /identity/v3/projects/d68af603729f48d98db32dad8ca70c9d/users/af48a7cc47854309979d1cc80d856957/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:17.921048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2de142-edc6-4b90-be70-a25a9306b006 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:17.921857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2de142-edc6-4b90-be70-a25a9306b006 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:17.923086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2de142-edc6-4b90-be70-a25a9306b006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:17.933153 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3136/6242] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:17:17 2022] POST /identity/v3/projects => generated 359 bytes in 573 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:17.935226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e6b966-d70e-4c83-9f45-844d1febb7f7 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:17.997473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-cc2de142-edc6-4b90-be70-a25a9306b006 None None] MFA Rules not processed for user `af48a7cc47854309979d1cc80d856957`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:17.999888 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-cc2de142-edc6-4b90-be70-a25a9306b006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:18.082596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e6b966-d70e-4c83-9f45-844d1febb7f7 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:18.092474 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41933af-b8a4-4bea-94f2-06d01986ebb0 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:18.093233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41933af-b8a4-4bea-94f2-06d01986ebb0 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:18.093585 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41933af-b8a4-4bea-94f2-06d01986ebb0 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:18.094014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41933af-b8a4-4bea-94f2-06d01986ebb0 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/projects/bc61aeedb0164087a2f2e2858c24d6a5` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:18.096513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41933af-b8a4-4bea-94f2-06d01986ebb0 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:get_project(project_id=bc61aeedb0164087a2f2e2858c24d6a5)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:18.102827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41933af-b8a4-4bea-94f2-06d01986ebb0 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:18.111643 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3137/6243] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:17:17 2022] GET /identity/v3/projects/bc61aeedb0164087a2f2e2858c24d6a5 => generated 359 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:17:18.113724 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41933af-b8a4-4bea-94f2-06d01986ebb0 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:18.144154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41933af-b8a4-4bea-94f2-06d01986ebb0 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:18.158264 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be2593-2658-4fcd-853d-2899fa65ebf6 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:18.159465 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be2593-2658-4fcd-853d-2899fa65ebf6 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:18.161354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be2593-2658-4fcd-853d-2899fa65ebf6 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:18.161688 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be2593-2658-4fcd-853d-2899fa65ebf6 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/projects/bc61aeedb0164087a2f2e2858c24d6a5` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:18.173462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be2593-2658-4fcd-853d-2899fa65ebf6 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bc61aeedb0164087a2f2e2858c24d6a5)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:18.189394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be2593-2658-4fcd-853d-2899fa65ebf6 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:18.210603 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3107/6244] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:17 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:17:18.215472 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2de142-edc6-4b90-be70-a25a9306b006 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:18.234886 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2de142-edc6-4b90-be70-a25a9306b006 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:18.240314 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:18.250216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44c224-4bc2-48b4-8db7-2b57f98bba1b tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:18.250821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44c224-4bc2-48b4-8db7-2b57f98bba1b tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:18.254536 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44c224-4bc2-48b4-8db7-2b57f98bba1b tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:18.254864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44c224-4bc2-48b4-8db7-2b57f98bba1b tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:18.255549 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44c224-4bc2-48b4-8db7-2b57f98bba1b tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:18.274832 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44c224-4bc2-48b4-8db7-2b57f98bba1b tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:18.328898 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3108/6245] 10.222.0.33 () {60 vars in 1149 bytes} [Sat Aug 6 21:17:18 2022] POST /identity/v3/domains => generated 276 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:18.330593 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44c224-4bc2-48b4-8db7-2b57f98bba1b tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:18.343480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e4be2593-2658-4fcd-853d-2899fa65ebf6 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc61aeedb0164087a2f2e2858c24d6a5', 'request_id': 'req-e4be2593-2658-4fcd-853d-2899fa65ebf6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:18.352381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e4be2593-2658-4fcd-853d-2899fa65ebf6 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc61aeedb0164087a2f2e2858c24d6a5', 'request_id': 'req-e4be2593-2658-4fcd-853d-2899fa65ebf6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:18.368151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e4be2593-2658-4fcd-853d-2899fa65ebf6 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc61aeedb0164087a2f2e2858c24d6a5', 'request_id': 'req-e4be2593-2658-4fcd-853d-2899fa65ebf6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:18.434922 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e4be2593-2658-4fcd-853d-2899fa65ebf6 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] The token cache is being invalidate because project bc61aeedb0164087a2f2e2858c24d6a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:17:18.440843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e4be2593-2658-4fcd-853d-2899fa65ebf6 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:18.443518 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e4be2593-2658-4fcd-853d-2899fa65ebf6 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:18.447695 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3138/6246] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:17:18 2022] DELETE /identity/v3/projects/bc61aeedb0164087a2f2e2858c24d6a5 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:18.455070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be2593-2658-4fcd-853d-2899fa65ebf6 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:18.458331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e4be2593-2658-4fcd-853d-2899fa65ebf6 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:18.459840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44c224-4bc2-48b4-8db7-2b57f98bba1b tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:18.484101 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263fc5c0-b40a-4e6d-88f5-88da3fadcfc5 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:18.484956 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263fc5c0-b40a-4e6d-88f5-88da3fadcfc5 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:18.485248 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263fc5c0-b40a-4e6d-88f5-88da3fadcfc5 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:18.485529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263fc5c0-b40a-4e6d-88f5-88da3fadcfc5 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/d25c03eb63c24d65b207376607dab88e/config` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:18.489345 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263fc5c0-b40a-4e6d-88f5-88da3fadcfc5 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=d25c03eb63c24d65b207376607dab88e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:18.491811 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-263fc5c0-b40a-4e6d-88f5-88da3fadcfc5 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:17:18.491811 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:17:18.491811 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:17:18.494537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263fc5c0-b40a-4e6d-88f5-88da3fadcfc5 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:18.610973 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3109/6247] 10.222.0.33 () {60 vars in 1269 bytes} [Sat Aug 6 21:17:18 2022] PUT /identity/v3/domains/d25c03eb63c24d65b207376607dab88e/config => generated 138 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:18.612342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263fc5c0-b40a-4e6d-88f5-88da3fadcfc5 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:18.617524 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-263fc5c0-b40a-4e6d-88f5-88da3fadcfc5 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:18.681701 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be2593-2658-4fcd-853d-2899fa65ebf6 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:18.692695 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263fc5c0-b40a-4e6d-88f5-88da3fadcfc5 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:18.719190 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4f41a-bcdc-4c37-bf60-e862c25ed4e8 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:18.720181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4f41a-bcdc-4c37-bf60-e862c25ed4e8 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:18.720715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4f41a-bcdc-4c37-bf60-e862c25ed4e8 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:18.723016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4f41a-bcdc-4c37-bf60-e862c25ed4e8 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/d25c03eb63c24d65b207376607dab88e/config/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:18.726668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4f41a-bcdc-4c37-bf60-e862c25ed4e8 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=d25c03eb63c24d65b207376607dab88e, group=identity)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:18.727748 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-67f4f41a-bcdc-4c37-bf60-e862c25ed4e8 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:17:18.727748 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:17:18.727748 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:17:18.728650 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4f41a-bcdc-4c37-bf60-e862c25ed4e8 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:18.758947 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3110/6248] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Aug 6 21:17:18 2022] GET /identity/v3/domains/d25c03eb63c24d65b207376607dab88e/config/identity => generated 45 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:18.763843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4f41a-bcdc-4c37-bf60-e862c25ed4e8 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:18.783590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b73c2-ecd6-4bdf-8d75-bb3f1076160c tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:18.784725 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b73c2-ecd6-4bdf-8d75-bb3f1076160c tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:18.785523 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b73c2-ecd6-4bdf-8d75-bb3f1076160c tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:18.785999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b73c2-ecd6-4bdf-8d75-bb3f1076160c tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:18.786895 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b73c2-ecd6-4bdf-8d75-bb3f1076160c tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:18.788972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b73c2-ecd6-4bdf-8d75-bb3f1076160c tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:18.804697 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4f41a-bcdc-4c37-bf60-e862c25ed4e8 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:18.824508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24835952-a4f7-4c98-b2b9-78b2e30bc342 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:18.825084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24835952-a4f7-4c98-b2b9-78b2e30bc342 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:18.825362 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24835952-a4f7-4c98-b2b9-78b2e30bc342 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:18.825632 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24835952-a4f7-4c98-b2b9-78b2e30bc342 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/d25c03eb63c24d65b207376607dab88e/config/identity/driver` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:18.831076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24835952-a4f7-4c98-b2b9-78b2e30bc342 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=d25c03eb63c24d65b207376607dab88e, group=identity, option=driver)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:18.832953 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24835952-a4f7-4c98-b2b9-78b2e30bc342 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:18.852836 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3139/6249] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:17:18 2022] POST /identity/v3/projects => generated 359 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:18.863783 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3111/6250] 10.222.0.33 () {58 vars in 1296 bytes} [Sat Aug 6 21:17:18 2022] GET /identity/v3/domains/d25c03eb63c24d65b207376607dab88e/config/identity/driver => generated 31 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:18.869155 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24835952-a4f7-4c98-b2b9-78b2e30bc342 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:18.877611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b73c2-ecd6-4bdf-8d75-bb3f1076160c tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:18.895585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24835952-a4f7-4c98-b2b9-78b2e30bc342 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:18.949611 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:18.979103 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:19.018491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b73c2-ecd6-4bdf-8d75-bb3f1076160c tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:19.024881 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f3495-9bc8-4bc5-af1e-b5970b3803b5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:19.025784 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f3495-9bc8-4bc5-af1e-b5970b3803b5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:19.026197 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f3495-9bc8-4bc5-af1e-b5970b3803b5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:19.027533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f3495-9bc8-4bc5-af1e-b5970b3803b5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/projects/9bbee792766f4d75ba5427a2d7f7f151` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:19.028816 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f3495-9bc8-4bc5-af1e-b5970b3803b5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:get_project(project_id=9bbee792766f4d75ba5427a2d7f7f151)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:19.031650 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f3495-9bc8-4bc5-af1e-b5970b3803b5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:19.033845 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3140/6251] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:17:18 2022] GET /identity/v3/projects/9bbee792766f4d75ba5427a2d7f7f151 => generated 359 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:17:19.039150 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f3495-9bc8-4bc5-af1e-b5970b3803b5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:19.053703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f5030-ea94-4536-af2c-b20cac286994 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:19.054339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f3495-9bc8-4bc5-af1e-b5970b3803b5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:19.054468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f5030-ea94-4536-af2c-b20cac286994 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:19.054675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f5030-ea94-4536-af2c-b20cac286994 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:19.054952 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f5030-ea94-4536-af2c-b20cac286994 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/d25c03eb63c24d65b207376607dab88e/config/ldap` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:19.056125 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f5030-ea94-4536-af2c-b20cac286994 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=d25c03eb63c24d65b207376607dab88e, group=ldap)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:19.060234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfef856-0f90-4587-9045-e304e87fcf76 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:19.060976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfef856-0f90-4587-9045-e304e87fcf76 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:19.061488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfef856-0f90-4587-9045-e304e87fcf76 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:19.062362 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfef856-0f90-4587-9045-e304e87fcf76 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/projects/9bbee792766f4d75ba5427a2d7f7f151` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:19.062759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f5030-ea94-4536-af2c-b20cac286994 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:19.063927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfef856-0f90-4587-9045-e304e87fcf76 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9bbee792766f4d75ba5427a2d7f7f151)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:19.066913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfef856-0f90-4587-9045-e304e87fcf76 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:19.080596 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3112/6252] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Aug 6 21:17:18 2022] GET /identity/v3/domains/d25c03eb63c24d65b207376607dab88e/config/ldap => generated 106 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:17:19.081578 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f5030-ea94-4536-af2c-b20cac286994 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:19.094669 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f5030-ea94-4536-af2c-b20cac286994 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:19.100929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57252b1-f1b1-4dbe-b815-ff1a2982b7ce tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:19.101658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57252b1-f1b1-4dbe-b815-ff1a2982b7ce tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:19.102005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57252b1-f1b1-4dbe-b815-ff1a2982b7ce tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:19.102329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57252b1-f1b1-4dbe-b815-ff1a2982b7ce tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/d25c03eb63c24d65b207376607dab88e/config/ldap/url` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:19.103979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57252b1-f1b1-4dbe-b815-ff1a2982b7ce tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=d25c03eb63c24d65b207376607dab88e, group=ldap, option=url)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:19.107330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57252b1-f1b1-4dbe-b815-ff1a2982b7ce tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:19.125401 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3113/6253] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Aug 6 21:17:19 2022] GET /identity/v3/domains/d25c03eb63c24d65b207376607dab88e/config/ldap/url => generated 46 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:19.126445 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57252b1-f1b1-4dbe-b815-ff1a2982b7ce tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:19.139313 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57252b1-f1b1-4dbe-b815-ff1a2982b7ce tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:19.149835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7dfef856-0f90-4587-9045-e304e87fcf76 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bbee792766f4d75ba5427a2d7f7f151', 'request_id': 'req-7dfef856-0f90-4587-9045-e304e87fcf76'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:19.165031 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7dfef856-0f90-4587-9045-e304e87fcf76 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bbee792766f4d75ba5427a2d7f7f151', 'request_id': 'req-7dfef856-0f90-4587-9045-e304e87fcf76'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:19.184381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7dfef856-0f90-4587-9045-e304e87fcf76 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bbee792766f4d75ba5427a2d7f7f151', 'request_id': 'req-7dfef856-0f90-4587-9045-e304e87fcf76'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:19.211029 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7dfef856-0f90-4587-9045-e304e87fcf76 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] The token cache is being invalidate because project 9bbee792766f4d75ba5427a2d7f7f151 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:17:19.211395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7dfef856-0f90-4587-9045-e304e87fcf76 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:19.214720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7dfef856-0f90-4587-9045-e304e87fcf76 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:19.218654 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3141/6254] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:17:19 2022] DELETE /identity/v3/projects/9bbee792766f4d75ba5427a2d7f7f151 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:19.226562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfef856-0f90-4587-9045-e304e87fcf76 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:19.236357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7dfef856-0f90-4587-9045-e304e87fcf76 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:19.268509 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d473a01-d51f-4232-8e60-725adf823a57 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:19.269473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d473a01-d51f-4232-8e60-725adf823a57 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:19.269939 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d473a01-d51f-4232-8e60-725adf823a57 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:19.270384 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d473a01-d51f-4232-8e60-725adf823a57 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/d25c03eb63c24d65b207376607dab88e/config/ldap/user_tree_dn` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:19.273503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d473a01-d51f-4232-8e60-725adf823a57 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=d25c03eb63c24d65b207376607dab88e, group=ldap, option=user_tree_dn)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:19.275452 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d473a01-d51f-4232-8e60-725adf823a57 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:19.297619 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3114/6255] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Aug 6 21:17:19 2022] GET /identity/v3/domains/d25c03eb63c24d65b207376607dab88e/config/ldap/user_tree_dn => generated 63 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:19.300123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d473a01-d51f-4232-8e60-725adf823a57 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:19.307229 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4d473a01-d51f-4232-8e60-725adf823a57 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:19.339862 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d473a01-d51f-4232-8e60-725adf823a57 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:19.358451 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a2f35-0279-47c7-a845-ee1193e0b2c2 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:19.359711 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a2f35-0279-47c7-a845-ee1193e0b2c2 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:19.360318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a2f35-0279-47c7-a845-ee1193e0b2c2 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:19.360768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a2f35-0279-47c7-a845-ee1193e0b2c2 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/d25c03eb63c24d65b207376607dab88e/config` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:19.361742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a2f35-0279-47c7-a845-ee1193e0b2c2 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=d25c03eb63c24d65b207376607dab88e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:19.363254 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-fc0a2f35-0279-47c7-a845-ee1193e0b2c2 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:17:19.363254 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:17:19.363254 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:17:19.364606 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a2f35-0279-47c7-a845-ee1193e0b2c2 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:19.366391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfef856-0f90-4587-9045-e304e87fcf76 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:19.378668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3adf5-b797-4036-b90a-ebf98659eb5f tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:19.379310 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3adf5-b797-4036-b90a-ebf98659eb5f tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:19.379600 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3adf5-b797-4036-b90a-ebf98659eb5f tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:19.382426 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3115/6256] 10.222.0.33 () {58 vars in 1251 bytes} [Sat Aug 6 21:17:19 2022] DELETE /identity/v3/domains/d25c03eb63c24d65b207376607dab88e/config => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:19.385212 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3adf5-b797-4036-b90a-ebf98659eb5f tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:19.390597 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a2f35-0279-47c7-a845-ee1193e0b2c2 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:19.393246 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e3adf5-b797-4036-b90a-ebf98659eb5f tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:19.399416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e3adf5-b797-4036-b90a-ebf98659eb5f tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:19.410770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a2f35-0279-47c7-a845-ee1193e0b2c2 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:19.420332 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a763f18-2558-4c1b-b89e-a0948e5d5da7 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:19.420990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a763f18-2558-4c1b-b89e-a0948e5d5da7 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:19.421386 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a763f18-2558-4c1b-b89e-a0948e5d5da7 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:19.421674 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a763f18-2558-4c1b-b89e-a0948e5d5da7 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/d25c03eb63c24d65b207376607dab88e` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:19.423433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a763f18-2558-4c1b-b89e-a0948e5d5da7 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d25c03eb63c24d65b207376607dab88e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:19.426226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a763f18-2558-4c1b-b89e-a0948e5d5da7 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:19.457810 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4a763f18-2558-4c1b-b89e-a0948e5d5da7 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd25c03eb63c24d65b207376607dab88e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:19.458631 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4a763f18-2558-4c1b-b89e-a0948e5d5da7 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd25c03eb63c24d65b207376607dab88e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:19.470517 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3142/6257] 10.222.0.33 () {60 vars in 1152 bytes} [Sat Aug 6 21:17:19 2022] POST /identity/v3/projects => generated 345 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:19.478815 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3adf5-b797-4036-b90a-ebf98659eb5f tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:19.483272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a8e3adf5-b797-4036-b90a-ebf98659eb5f tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:19.510321 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4a763f18-2558-4c1b-b89e-a0948e5d5da7 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd25c03eb63c24d65b207376607dab88e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:19.511293 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4a763f18-2558-4c1b-b89e-a0948e5d5da7 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd25c03eb63c24d65b207376607dab88e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:19.517783 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3116/6258] 10.222.0.33 () {60 vars in 1249 bytes} [Sat Aug 6 21:17:19 2022] PATCH /identity/v3/domains/d25c03eb63c24d65b207376607dab88e => generated 277 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:17:19.518751 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a763f18-2558-4c1b-b89e-a0948e5d5da7 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:19.520216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4a763f18-2558-4c1b-b89e-a0948e5d5da7 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:19.623406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:19.682031 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3adf5-b797-4036-b90a-ebf98659eb5f tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:19.701790 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463bb835-046f-48ce-98af-96eacb4070a2 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:19.702476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bb835-046f-48ce-98af-96eacb4070a2 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:19.702847 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bb835-046f-48ce-98af-96eacb4070a2 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:19.703126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bb835-046f-48ce-98af-96eacb4070a2 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/projects/b832bfa85c1b4988bae406e89984eadf` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:19.706091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:19.711735 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463bb835-046f-48ce-98af-96eacb4070a2 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:get_project(project_id=b832bfa85c1b4988bae406e89984eadf)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:19.711926 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a763f18-2558-4c1b-b89e-a0948e5d5da7 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:19.717161 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463bb835-046f-48ce-98af-96eacb4070a2 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:19.722021 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3143/6259] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:17:19 2022] GET /identity/v3/projects/b832bfa85c1b4988bae406e89984eadf => generated 345 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:17:19.733553 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463bb835-046f-48ce-98af-96eacb4070a2 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:19.739353 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-463bb835-046f-48ce-98af-96eacb4070a2 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:19.785899 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463bb835-046f-48ce-98af-96eacb4070a2 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:19.801913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502476f9-7dc2-47cf-b83d-06ac7d08cfe5 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:19.803003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502476f9-7dc2-47cf-b83d-06ac7d08cfe5 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:19.803449 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502476f9-7dc2-47cf-b83d-06ac7d08cfe5 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:19.803912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502476f9-7dc2-47cf-b83d-06ac7d08cfe5 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/d25c03eb63c24d65b207376607dab88e` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:19.815684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f2526-90de-4d29-875a-5da252eaa29b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:19.816366 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f2526-90de-4d29-875a-5da252eaa29b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:19.816608 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f2526-90de-4d29-875a-5da252eaa29b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:19.816936 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f2526-90de-4d29-875a-5da252eaa29b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/projects/b832bfa85c1b4988bae406e89984eadf` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:19.819294 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f2526-90de-4d29-875a-5da252eaa29b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b832bfa85c1b4988bae406e89984eadf)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:19.822072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502476f9-7dc2-47cf-b83d-06ac7d08cfe5 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d25c03eb63c24d65b207376607dab88e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:19.824395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f2526-90de-4d29-875a-5da252eaa29b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:19.826272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502476f9-7dc2-47cf-b83d-06ac7d08cfe5 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:19.892670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-502476f9-7dc2-47cf-b83d-06ac7d08cfe5 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd25c03eb63c24d65b207376607dab88e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:19.922378 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-502476f9-7dc2-47cf-b83d-06ac7d08cfe5 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd25c03eb63c24d65b207376607dab88e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:19.951685 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-781f2526-90de-4d29-875a-5da252eaa29b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b832bfa85c1b4988bae406e89984eadf', 'request_id': 'req-781f2526-90de-4d29-875a-5da252eaa29b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:19.970707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-781f2526-90de-4d29-875a-5da252eaa29b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b832bfa85c1b4988bae406e89984eadf', 'request_id': 'req-781f2526-90de-4d29-875a-5da252eaa29b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:19.996862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-781f2526-90de-4d29-875a-5da252eaa29b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b832bfa85c1b4988bae406e89984eadf', 'request_id': 'req-781f2526-90de-4d29-875a-5da252eaa29b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:20.039693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-781f2526-90de-4d29-875a-5da252eaa29b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] The token cache is being invalidate because project b832bfa85c1b4988bae406e89984eadf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:17:20.040056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-781f2526-90de-4d29-875a-5da252eaa29b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:20.042737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-781f2526-90de-4d29-875a-5da252eaa29b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:20.043330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-502476f9-7dc2-47cf-b83d-06ac7d08cfe5 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd25c03eb63c24d65b207376607dab88e', 'request_id': 'req-502476f9-7dc2-47cf-b83d-06ac7d08cfe5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:20.045904 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3144/6260] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:17:19 2022] DELETE /identity/v3/projects/b832bfa85c1b4988bae406e89984eadf => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:20.055294 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f2526-90de-4d29-875a-5da252eaa29b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:20.058413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-781f2526-90de-4d29-875a-5da252eaa29b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:20.060886 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-502476f9-7dc2-47cf-b83d-06ac7d08cfe5 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd25c03eb63c24d65b207376607dab88e', 'request_id': 'req-502476f9-7dc2-47cf-b83d-06ac7d08cfe5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:20.073290 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-502476f9-7dc2-47cf-b83d-06ac7d08cfe5 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd25c03eb63c24d65b207376607dab88e', 'request_id': 'req-502476f9-7dc2-47cf-b83d-06ac7d08cfe5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:20.117308 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-502476f9-7dc2-47cf-b83d-06ac7d08cfe5 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] The token cache is being invalidate because project d25c03eb63c24d65b207376607dab88e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:17:20.117938 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-502476f9-7dc2-47cf-b83d-06ac7d08cfe5 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:20.118909 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-502476f9-7dc2-47cf-b83d-06ac7d08cfe5 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:20.139642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-502476f9-7dc2-47cf-b83d-06ac7d08cfe5 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd25c03eb63c24d65b207376607dab88e', 'request_id': 'req-502476f9-7dc2-47cf-b83d-06ac7d08cfe5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:20.141897 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-502476f9-7dc2-47cf-b83d-06ac7d08cfe5 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd25c03eb63c24d65b207376607dab88e', 'request_id': 'req-502476f9-7dc2-47cf-b83d-06ac7d08cfe5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:20.143237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-502476f9-7dc2-47cf-b83d-06ac7d08cfe5 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd25c03eb63c24d65b207376607dab88e', 'request_id': 'req-502476f9-7dc2-47cf-b83d-06ac7d08cfe5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:20.154030 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3117/6261] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:17:19 2022] DELETE /identity/v3/domains/d25c03eb63c24d65b207376607dab88e => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:17:20.162088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502476f9-7dc2-47cf-b83d-06ac7d08cfe5 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:20.163574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-502476f9-7dc2-47cf-b83d-06ac7d08cfe5 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:20.197058 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f2526-90de-4d29-875a-5da252eaa29b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:20.290140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:20.326170 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502476f9-7dc2-47cf-b83d-06ac7d08cfe5 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:20.340064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d09e2-62db-4934-bae6-50e2c41cdfd8 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:20.340871 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d09e2-62db-4934-bae6-50e2c41cdfd8 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:20.341257 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d09e2-62db-4934-bae6-50e2c41cdfd8 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:20.341636 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d09e2-62db-4934-bae6-50e2c41cdfd8 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:20.342409 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d09e2-62db-4934-bae6-50e2c41cdfd8 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:20.344155 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d09e2-62db-4934-bae6-50e2c41cdfd8 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:20.360589 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa96e7-234f-4d2b-bc35-92eaf19ee37b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:20.361227 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa96e7-234f-4d2b-bc35-92eaf19ee37b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:20.361513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa96e7-234f-4d2b-bc35-92eaf19ee37b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:20.361825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa96e7-234f-4d2b-bc35-92eaf19ee37b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:20.362738 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa96e7-234f-4d2b-bc35-92eaf19ee37b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:20.365674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa96e7-234f-4d2b-bc35-92eaf19ee37b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:20.387823 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3118/6262] 10.222.0.33 () {60 vars in 1149 bytes} [Sat Aug 6 21:17:20 2022] POST /identity/v3/domains => generated 277 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:17:20.392841 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d09e2-62db-4934-bae6-50e2c41cdfd8 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:20.411684 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3145/6263] 10.222.0.33 () {60 vars in 1149 bytes} [Sat Aug 6 21:17:20 2022] POST /identity/v3/domains => generated 276 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:20.415652 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa96e7-234f-4d2b-bc35-92eaf19ee37b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:20.418920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3aaa96e7-234f-4d2b-bc35-92eaf19ee37b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:20.459112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:20.537693 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d09e2-62db-4934-bae6-50e2c41cdfd8 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:20.607369 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa96e7-234f-4d2b-bc35-92eaf19ee37b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:20.624154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e6f80-0b47-4b78-bf2e-4f53484ab672 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:20.624627 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e6f80-0b47-4b78-bf2e-4f53484ab672 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:20.626577 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e6f80-0b47-4b78-bf2e-4f53484ab672 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:20.626577 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e6f80-0b47-4b78-bf2e-4f53484ab672 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:20.627596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e6f80-0b47-4b78-bf2e-4f53484ab672 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:20.629651 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e6f80-0b47-4b78-bf2e-4f53484ab672 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:20.659288 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26fb63-6027-4289-9de0-7a5f647dda34 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:20.659872 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26fb63-6027-4289-9de0-7a5f647dda34 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:20.660158 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26fb63-6027-4289-9de0-7a5f647dda34 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:20.660503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26fb63-6027-4289-9de0-7a5f647dda34 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/7a572cfb08bc45d0b45f27d6460b0d6e/config` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:20.661089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26fb63-6027-4289-9de0-7a5f647dda34 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=7a572cfb08bc45d0b45f27d6460b0d6e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:20.662827 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26fb63-6027-4289-9de0-7a5f647dda34 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:20.780101 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3146/6264] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:17:20 2022] POST /identity/v3/projects => generated 404 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:20.784687 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e6f80-0b47-4b78-bf2e-4f53484ab672 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:20.789333 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3119/6265] 10.222.0.33 () {60 vars in 1269 bytes} [Sat Aug 6 21:17:20 2022] PUT /identity/v3/domains/7a572cfb08bc45d0b45f27d6460b0d6e/config => generated 138 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:20.791654 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26fb63-6027-4289-9de0-7a5f647dda34 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:20.827440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26fb63-6027-4289-9de0-7a5f647dda34 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:21.020177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e6f80-0b47-4b78-bf2e-4f53484ab672 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:21.031322 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a3a5d-b8b8-4314-b46d-572dcb9085b0 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:21.032392 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a3a5d-b8b8-4314-b46d-572dcb9085b0 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:21.033047 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a3a5d-b8b8-4314-b46d-572dcb9085b0 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:21.033567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a3a5d-b8b8-4314-b46d-572dcb9085b0 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/projects/19d1248d3a8a41f6a47b84b40e36aac2` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:21.035226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a3a5d-b8b8-4314-b46d-572dcb9085b0 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:get_project(project_id=19d1248d3a8a41f6a47b84b40e36aac2)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:21.037539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a3a5d-b8b8-4314-b46d-572dcb9085b0 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:21.044613 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3147/6266] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:17:20 2022] GET /identity/v3/projects/19d1248d3a8a41f6a47b84b40e36aac2 => generated 404 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:17:21.048528 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a3a5d-b8b8-4314-b46d-572dcb9085b0 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:21.054537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:21.072316 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a3a5d-b8b8-4314-b46d-572dcb9085b0 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:21.075387 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fef864-b25c-46ec-8f9c-1ef24584c8c4 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:21.076161 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fef864-b25c-46ec-8f9c-1ef24584c8c4 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:21.076822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fef864-b25c-46ec-8f9c-1ef24584c8c4 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:21.081139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fef864-b25c-46ec-8f9c-1ef24584c8c4 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/7a572cfb08bc45d0b45f27d6460b0d6e/config` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:21.081912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fef864-b25c-46ec-8f9c-1ef24584c8c4 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=7a572cfb08bc45d0b45f27d6460b0d6e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:21.083701 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-d2fef864-b25c-46ec-8f9c-1ef24584c8c4 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:17:21.083701 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:17:21.083701 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:17:21.084798 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fef864-b25c-46ec-8f9c-1ef24584c8c4 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:21.088404 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c825af0-4bcd-4e3a-896b-8ccea49ba1ae tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:21.090010 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c825af0-4bcd-4e3a-896b-8ccea49ba1ae tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:21.090535 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c825af0-4bcd-4e3a-896b-8ccea49ba1ae tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:21.091076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c825af0-4bcd-4e3a-896b-8ccea49ba1ae tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/projects/19d1248d3a8a41f6a47b84b40e36aac2` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:21.092749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c825af0-4bcd-4e3a-896b-8ccea49ba1ae tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:delete_project(project_id=19d1248d3a8a41f6a47b84b40e36aac2)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:21.095297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c825af0-4bcd-4e3a-896b-8ccea49ba1ae tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:21.135039 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3120/6267] 10.222.0.33 () {60 vars in 1271 bytes} [Sat Aug 6 21:17:20 2022] PATCH /identity/v3/domains/7a572cfb08bc45d0b45f27d6460b0d6e/config => generated 141 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:17:21.137850 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fef864-b25c-46ec-8f9c-1ef24584c8c4 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:21.163637 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fef864-b25c-46ec-8f9c-1ef24584c8c4 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:21.184801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07022c02-35dc-40fe-b3b2-0f04815b3ae2 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:21.186694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07022c02-35dc-40fe-b3b2-0f04815b3ae2 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:21.188343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07022c02-35dc-40fe-b3b2-0f04815b3ae2 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:21.188642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07022c02-35dc-40fe-b3b2-0f04815b3ae2 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/7a572cfb08bc45d0b45f27d6460b0d6e/config` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:21.192124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07022c02-35dc-40fe-b3b2-0f04815b3ae2 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=7a572cfb08bc45d0b45f27d6460b0d6e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:21.194049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07022c02-35dc-40fe-b3b2-0f04815b3ae2 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:21.196636 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0c825af0-4bcd-4e3a-896b-8ccea49ba1ae tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19d1248d3a8a41f6a47b84b40e36aac2', 'request_id': 'req-0c825af0-4bcd-4e3a-896b-8ccea49ba1ae'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:21.203837 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0c825af0-4bcd-4e3a-896b-8ccea49ba1ae tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19d1248d3a8a41f6a47b84b40e36aac2', 'request_id': 'req-0c825af0-4bcd-4e3a-896b-8ccea49ba1ae'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:21.206138 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3121/6268] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Aug 6 21:17:21 2022] GET /identity/v3/domains/7a572cfb08bc45d0b45f27d6460b0d6e/config => generated 141 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:17:21.207216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07022c02-35dc-40fe-b3b2-0f04815b3ae2 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:21.217485 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0c825af0-4bcd-4e3a-896b-8ccea49ba1ae tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19d1248d3a8a41f6a47b84b40e36aac2', 'request_id': 'req-0c825af0-4bcd-4e3a-896b-8ccea49ba1ae'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:21.221996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07022c02-35dc-40fe-b3b2-0f04815b3ae2 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:21.241146 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0c825af0-4bcd-4e3a-896b-8ccea49ba1ae tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] The token cache is being invalidate because project 19d1248d3a8a41f6a47b84b40e36aac2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:17:21.241478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0c825af0-4bcd-4e3a-896b-8ccea49ba1ae tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:21.247272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0c825af0-4bcd-4e3a-896b-8ccea49ba1ae tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:21.252364 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3148/6269] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:17:21 2022] DELETE /identity/v3/projects/19d1248d3a8a41f6a47b84b40e36aac2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:17:21.256820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c825af0-4bcd-4e3a-896b-8ccea49ba1ae tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:21.259244 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0c825af0-4bcd-4e3a-896b-8ccea49ba1ae tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:21.306851 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750d8b6-0011-4253-b991-2c2f12ce69fe tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:21.308116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750d8b6-0011-4253-b991-2c2f12ce69fe tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:21.308825 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750d8b6-0011-4253-b991-2c2f12ce69fe tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:21.309158 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750d8b6-0011-4253-b991-2c2f12ce69fe tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/7a572cfb08bc45d0b45f27d6460b0d6e/config` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:21.309838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750d8b6-0011-4253-b991-2c2f12ce69fe tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=7a572cfb08bc45d0b45f27d6460b0d6e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:21.310836 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:21.314423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750d8b6-0011-4253-b991-2c2f12ce69fe tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:21.345460 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3122/6270] 10.222.0.33 () {58 vars in 1251 bytes} [Sat Aug 6 21:17:21 2022] DELETE /identity/v3/domains/7a572cfb08bc45d0b45f27d6460b0d6e/config => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:21.349969 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750d8b6-0011-4253-b991-2c2f12ce69fe tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:21.352699 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3750d8b6-0011-4253-b991-2c2f12ce69fe tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:21.388360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750d8b6-0011-4253-b991-2c2f12ce69fe tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:21.398034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37051d2-4e22-477a-9b78-f585f9186dc0 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:21.400213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37051d2-4e22-477a-9b78-f585f9186dc0 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:21.401585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37051d2-4e22-477a-9b78-f585f9186dc0 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:21.402074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37051d2-4e22-477a-9b78-f585f9186dc0 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/7a572cfb08bc45d0b45f27d6460b0d6e/config` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:21.404312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37051d2-4e22-477a-9b78-f585f9186dc0 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=7a572cfb08bc45d0b45f27d6460b0d6e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:21.407414 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37051d2-4e22-477a-9b78-f585f9186dc0 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:21.428159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c825af0-4bcd-4e3a-896b-8ccea49ba1ae tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:21.446696 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-c37051d2-4e22-477a-9b78-f585f9186dc0 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Could not find any options in domain configuration for domain 7a572cfb08bc45d0b45f27d6460b0d6e.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 7a572cfb08bc45d0b45f27d6460b0d6e. Aug 06 21:17:21.446696 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:17:21.446696 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:17:21.446696 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:17:21.446696 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:17:21.446696 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:17:21.446696 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:17:21.446696 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:17:21.446696 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:17:21.446696 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:17:21.446696 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:17:21.446696 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:17:21.446696 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Aug 06 21:17:21.447845 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Aug 06 21:17:21.447845 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Aug 06 21:17:21.447845 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Aug 06 21:17:21.447845 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:17:21.447845 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:17:21.447845 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Aug 06 21:17:21.447845 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Aug 06 21:17:21.447845 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 7a572cfb08bc45d0b45f27d6460b0d6e. Aug 06 21:17:21.447845 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:17:21.449075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2bb67a-73af-4297-8046-dabfae13e9e8 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:21.450319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bb67a-73af-4297-8046-dabfae13e9e8 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:21.450319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bb67a-73af-4297-8046-dabfae13e9e8 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:21.450319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bb67a-73af-4297-8046-dabfae13e9e8 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/domains/ceaa33ed310e4e49aa6c8ba7e048b3e5` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:21.451908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2bb67a-73af-4297-8046-dabfae13e9e8 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ceaa33ed310e4e49aa6c8ba7e048b3e5)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:21.453264 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3123/6271] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Aug 6 21:17:21 2022] GET /identity/v3/domains/7a572cfb08bc45d0b45f27d6460b0d6e/config => generated 151 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:17:21.453540 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2bb67a-73af-4297-8046-dabfae13e9e8 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:21.455206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d8fe0-d8e4-423b-af56-7c80d2ce9fee None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:21.456066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d8fe0-d8e4-423b-af56-7c80d2ce9fee None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:21.456754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d8fe0-d8e4-423b-af56-7c80d2ce9fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:21.495992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-973d8fe0-d8e4-423b-af56-7c80d2ce9fee None None] MFA Rules not processed for user `65e64ff8f2b14f70b1b05327f691701e`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:21.498079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-973d8fe0-d8e4-423b-af56-7c80d2ce9fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:21.511909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8b2bb67a-73af-4297-8046-dabfae13e9e8 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ceaa33ed310e4e49aa6c8ba7e048b3e5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:21.512689 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8b2bb67a-73af-4297-8046-dabfae13e9e8 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ceaa33ed310e4e49aa6c8ba7e048b3e5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:21.562179 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8b2bb67a-73af-4297-8046-dabfae13e9e8 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ceaa33ed310e4e49aa6c8ba7e048b3e5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:21.562869 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8b2bb67a-73af-4297-8046-dabfae13e9e8 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ceaa33ed310e4e49aa6c8ba7e048b3e5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:21.567580 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3149/6272] 10.222.0.33 () {60 vars in 1249 bytes} [Sat Aug 6 21:17:21 2022] PATCH /identity/v3/domains/ceaa33ed310e4e49aa6c8ba7e048b3e5 => generated 277 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:17:21.568569 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2bb67a-73af-4297-8046-dabfae13e9e8 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:21.571191 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8b2bb67a-73af-4297-8046-dabfae13e9e8 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:21.645097 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3124/6273] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:21.646577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d8fe0-d8e4-423b-af56-7c80d2ce9fee None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:21.648513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-973d8fe0-d8e4-423b-af56-7c80d2ce9fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:21.696856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d8fe0-d8e4-423b-af56-7c80d2ce9fee None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:21.731228 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2bb67a-73af-4297-8046-dabfae13e9e8 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:21.739579 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1a163-6aab-4b2f-9dc4-f63141f7af2d tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:21.740574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1a163-6aab-4b2f-9dc4-f63141f7af2d tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:21.741026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1a163-6aab-4b2f-9dc4-f63141f7af2d tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:21.741499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1a163-6aab-4b2f-9dc4-f63141f7af2d tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/7a572cfb08bc45d0b45f27d6460b0d6e/config` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:21.742364 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1a163-6aab-4b2f-9dc4-f63141f7af2d tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=7a572cfb08bc45d0b45f27d6460b0d6e)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:21.743596 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-18b1a163-6aab-4b2f-9dc4-f63141f7af2d tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:17:21.743596 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:17:21.743596 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:17:21.745286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1a163-6aab-4b2f-9dc4-f63141f7af2d tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:21.774370 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3150/6274] 10.222.0.33 () {58 vars in 1251 bytes} [Sat Aug 6 21:17:21 2022] DELETE /identity/v3/domains/7a572cfb08bc45d0b45f27d6460b0d6e/config => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:21.779352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:21.781030 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1a163-6aab-4b2f-9dc4-f63141f7af2d tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:21.795508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d7e2f-955a-4662-a091-ed9c40592ef9 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:21.796497 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d7e2f-955a-4662-a091-ed9c40592ef9 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:21.796790 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1a163-6aab-4b2f-9dc4-f63141f7af2d tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:21.797289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d7e2f-955a-4662-a091-ed9c40592ef9 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:21.797652 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d7e2f-955a-4662-a091-ed9c40592ef9 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/domains/ceaa33ed310e4e49aa6c8ba7e048b3e5` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:21.803834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6fa7f7-612b-41db-a522-e625b8f8d722 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:21.806005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fa7f7-612b-41db-a522-e625b8f8d722 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:21.806680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fa7f7-612b-41db-a522-e625b8f8d722 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:21.807127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fa7f7-612b-41db-a522-e625b8f8d722 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/7a572cfb08bc45d0b45f27d6460b0d6e` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:21.809680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6fa7f7-612b-41db-a522-e625b8f8d722 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=7a572cfb08bc45d0b45f27d6460b0d6e)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:21.812075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6fa7f7-612b-41db-a522-e625b8f8d722 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:21.816607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d7e2f-955a-4662-a091-ed9c40592ef9 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ceaa33ed310e4e49aa6c8ba7e048b3e5)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:21.819299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d7e2f-955a-4662-a091-ed9c40592ef9 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:21.845761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3a6fa7f7-612b-41db-a522-e625b8f8d722 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7a572cfb08bc45d0b45f27d6460b0d6e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:21.846850 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3a6fa7f7-612b-41db-a522-e625b8f8d722 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7a572cfb08bc45d0b45f27d6460b0d6e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:21.851066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-272d7e2f-955a-4662-a091-ed9c40592ef9 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ceaa33ed310e4e49aa6c8ba7e048b3e5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:21.864359 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-272d7e2f-955a-4662-a091-ed9c40592ef9 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ceaa33ed310e4e49aa6c8ba7e048b3e5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:21.908374 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3a6fa7f7-612b-41db-a522-e625b8f8d722 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7a572cfb08bc45d0b45f27d6460b0d6e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:21.909228 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3a6fa7f7-612b-41db-a522-e625b8f8d722 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7a572cfb08bc45d0b45f27d6460b0d6e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:21.912488 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3151/6275] 10.222.0.33 () {60 vars in 1249 bytes} [Sat Aug 6 21:17:21 2022] PATCH /identity/v3/domains/7a572cfb08bc45d0b45f27d6460b0d6e => generated 278 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:17:21.917815 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6fa7f7-612b-41db-a522-e625b8f8d722 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:21.920113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3a6fa7f7-612b-41db-a522-e625b8f8d722 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:21.971010 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-272d7e2f-955a-4662-a091-ed9c40592ef9 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceaa33ed310e4e49aa6c8ba7e048b3e5', 'request_id': 'req-272d7e2f-955a-4662-a091-ed9c40592ef9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:21.981465 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-272d7e2f-955a-4662-a091-ed9c40592ef9 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceaa33ed310e4e49aa6c8ba7e048b3e5', 'request_id': 'req-272d7e2f-955a-4662-a091-ed9c40592ef9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:21.984088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:UPDATE=2,keystone:DELETE=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:22.017079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-272d7e2f-955a-4662-a091-ed9c40592ef9 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceaa33ed310e4e49aa6c8ba7e048b3e5', 'request_id': 'req-272d7e2f-955a-4662-a091-ed9c40592ef9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:22.046005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-272d7e2f-955a-4662-a091-ed9c40592ef9 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] The token cache is being invalidate because project ceaa33ed310e4e49aa6c8ba7e048b3e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:17:22.046427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-272d7e2f-955a-4662-a091-ed9c40592ef9 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:22.047503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6fa7f7-612b-41db-a522-e625b8f8d722 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:22.048122 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-272d7e2f-955a-4662-a091-ed9c40592ef9 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:22.059485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-272d7e2f-955a-4662-a091-ed9c40592ef9 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ceaa33ed310e4e49aa6c8ba7e048b3e5', 'request_id': 'req-272d7e2f-955a-4662-a091-ed9c40592ef9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:22.060519 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-272d7e2f-955a-4662-a091-ed9c40592ef9 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ceaa33ed310e4e49aa6c8ba7e048b3e5', 'request_id': 'req-272d7e2f-955a-4662-a091-ed9c40592ef9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:22.061543 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-272d7e2f-955a-4662-a091-ed9c40592ef9 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ceaa33ed310e4e49aa6c8ba7e048b3e5', 'request_id': 'req-272d7e2f-955a-4662-a091-ed9c40592ef9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:22.077213 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3125/6276] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:17:21 2022] DELETE /identity/v3/domains/ceaa33ed310e4e49aa6c8ba7e048b3e5 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:22.094916 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d7e2f-955a-4662-a091-ed9c40592ef9 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:22.117792 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-272d7e2f-955a-4662-a091-ed9c40592ef9 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:22.205591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933a9a2-697c-4c50-9416-e9e6c0bd9a36 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:22.207226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933a9a2-697c-4c50-9416-e9e6c0bd9a36 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:22.209234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933a9a2-697c-4c50-9416-e9e6c0bd9a36 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:22.209600 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933a9a2-697c-4c50-9416-e9e6c0bd9a36 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/7a572cfb08bc45d0b45f27d6460b0d6e` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:22.232713 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933a9a2-697c-4c50-9416-e9e6c0bd9a36 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7a572cfb08bc45d0b45f27d6460b0d6e)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:22.234834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933a9a2-697c-4c50-9416-e9e6c0bd9a36 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:22.312554 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d7e2f-955a-4662-a091-ed9c40592ef9 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:22.332648 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5933a9a2-697c-4c50-9416-e9e6c0bd9a36 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7a572cfb08bc45d0b45f27d6460b0d6e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:22.349652 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c19085-f034-42ef-8c17-76f077969b42 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:22.350496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c19085-f034-42ef-8c17-76f077969b42 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:22.351046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5933a9a2-697c-4c50-9416-e9e6c0bd9a36 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7a572cfb08bc45d0b45f27d6460b0d6e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:22.353383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c19085-f034-42ef-8c17-76f077969b42 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:22.354298 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c19085-f034-42ef-8c17-76f077969b42 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:22.356342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c19085-f034-42ef-8c17-76f077969b42 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:22.358101 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c19085-f034-42ef-8c17-76f077969b42 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:22.409957 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3126/6277] 10.222.0.33 () {60 vars in 1149 bytes} [Sat Aug 6 21:17:22 2022] POST /identity/v3/domains => generated 277 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:22.410867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c19085-f034-42ef-8c17-76f077969b42 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:22.412576 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-21c19085-f034-42ef-8c17-76f077969b42 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:22.472127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5933a9a2-697c-4c50-9416-e9e6c0bd9a36 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a572cfb08bc45d0b45f27d6460b0d6e', 'request_id': 'req-5933a9a2-697c-4c50-9416-e9e6c0bd9a36'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:22.479148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:22.483247 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5933a9a2-697c-4c50-9416-e9e6c0bd9a36 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a572cfb08bc45d0b45f27d6460b0d6e', 'request_id': 'req-5933a9a2-697c-4c50-9416-e9e6c0bd9a36'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:22.501636 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5933a9a2-697c-4c50-9416-e9e6c0bd9a36 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a572cfb08bc45d0b45f27d6460b0d6e', 'request_id': 'req-5933a9a2-697c-4c50-9416-e9e6c0bd9a36'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:22.538574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5933a9a2-697c-4c50-9416-e9e6c0bd9a36 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] The token cache is being invalidate because project 7a572cfb08bc45d0b45f27d6460b0d6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:17:22.538883 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5933a9a2-697c-4c50-9416-e9e6c0bd9a36 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:22.540449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5933a9a2-697c-4c50-9416-e9e6c0bd9a36 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:22.547715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c19085-f034-42ef-8c17-76f077969b42 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:22.552977 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5933a9a2-697c-4c50-9416-e9e6c0bd9a36 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7a572cfb08bc45d0b45f27d6460b0d6e', 'request_id': 'req-5933a9a2-697c-4c50-9416-e9e6c0bd9a36'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:22.560322 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5933a9a2-697c-4c50-9416-e9e6c0bd9a36 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7a572cfb08bc45d0b45f27d6460b0d6e', 'request_id': 'req-5933a9a2-697c-4c50-9416-e9e6c0bd9a36'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:22.561540 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5933a9a2-697c-4c50-9416-e9e6c0bd9a36 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7a572cfb08bc45d0b45f27d6460b0d6e', 'request_id': 'req-5933a9a2-697c-4c50-9416-e9e6c0bd9a36'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:22.575810 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3152/6278] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:17:21 2022] DELETE /identity/v3/domains/7a572cfb08bc45d0b45f27d6460b0d6e => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:22.577202 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933a9a2-697c-4c50-9416-e9e6c0bd9a36 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:22.581778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5933a9a2-697c-4c50-9416-e9e6c0bd9a36 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:22.617586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:22.665400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138183e1-7b77-429a-9f01-a9e6ed69162e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:22.667589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138183e1-7b77-429a-9f01-a9e6ed69162e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:22.668155 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138183e1-7b77-429a-9f01-a9e6ed69162e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:22.668666 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138183e1-7b77-429a-9f01-a9e6ed69162e admin admin] PATH_INFO: `/v3/users/c9a290f680dc4b5bbec2010d82ed7e27` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:22.670262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138183e1-7b77-429a-9f01-a9e6ed69162e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9a290f680dc4b5bbec2010d82ed7e27)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:22.673726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138183e1-7b77-429a-9f01-a9e6ed69162e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:22.737480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933a9a2-697c-4c50-9416-e9e6c0bd9a36 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:22.743649 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ebe489-cf0b-4dcd-ae2b-6f516a5d4754 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:22.744879 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ebe489-cf0b-4dcd-ae2b-6f516a5d4754 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:22.745389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ebe489-cf0b-4dcd-ae2b-6f516a5d4754 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:22.747126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ebe489-cf0b-4dcd-ae2b-6f516a5d4754 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:22.747126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ebe489-cf0b-4dcd-ae2b-6f516a5d4754 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:22.748795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ebe489-cf0b-4dcd-ae2b-6f516a5d4754 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:22.786022 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-138183e1-7b77-429a-9f01-a9e6ed69162e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9a290f680dc4b5bbec2010d82ed7e27'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:22.792557 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-138183e1-7b77-429a-9f01-a9e6ed69162e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9a290f680dc4b5bbec2010d82ed7e27'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:22.793978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-138183e1-7b77-429a-9f01-a9e6ed69162e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9a290f680dc4b5bbec2010d82ed7e27'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:22.809926 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-138183e1-7b77-429a-9f01-a9e6ed69162e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9a290f680dc4b5bbec2010d82ed7e27'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:22.816695 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3153/6279] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:17:22 2022] POST /identity/v3/projects => generated 409 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:22.816695 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ebe489-cf0b-4dcd-ae2b-6f516a5d4754 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:22.822384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b2ebe489-cf0b-4dcd-ae2b-6f516a5d4754 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:22.838262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-138183e1-7b77-429a-9f01-a9e6ed69162e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9a290f680dc4b5bbec2010d82ed7e27'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:22.865055 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3127/6280] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:17:22 2022] DELETE /identity/v3/users/c9a290f680dc4b5bbec2010d82ed7e27 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:22.868548 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138183e1-7b77-429a-9f01-a9e6ed69162e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:22.870231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-138183e1-7b77-429a-9f01-a9e6ed69162e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:22.951463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ebe489-cf0b-4dcd-ae2b-6f516a5d4754 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:22.959721 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:22.986009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138183e1-7b77-429a-9f01-a9e6ed69162e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:22.992048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d520414-4599-41ca-99af-ae3549c13a48 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:22.992678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d520414-4599-41ca-99af-ae3549c13a48 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:22.992963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d520414-4599-41ca-99af-ae3549c13a48 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:22.993247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d520414-4599-41ca-99af-ae3549c13a48 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:22.994113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d520414-4599-41ca-99af-ae3549c13a48 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:22.997097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d520414-4599-41ca-99af-ae3549c13a48 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:23.075596 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3128/6281] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:17:22 2022] POST /identity/v3/projects => generated 404 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:23.081963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d520414-4599-41ca-99af-ae3549c13a48 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:23.154859 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bcd31b-c458-4900-a37a-1fd5a5e658bd tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:23.170821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcd31b-c458-4900-a37a-1fd5a5e658bd tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:23.171160 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcd31b-c458-4900-a37a-1fd5a5e658bd tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:23.171423 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcd31b-c458-4900-a37a-1fd5a5e658bd tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:23.173232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bcd31b-c458-4900-a37a-1fd5a5e658bd tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:23.185219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bcd31b-c458-4900-a37a-1fd5a5e658bd tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:23.241634 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3154/6282] 10.222.0.33 () {60 vars in 1149 bytes} [Sat Aug 6 21:17:22 2022] POST /identity/v3/domains => generated 274 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:23.247549 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bcd31b-c458-4900-a37a-1fd5a5e658bd tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:23.390492 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:23.395127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d520414-4599-41ca-99af-ae3549c13a48 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:23.422490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bcd31b-c458-4900-a37a-1fd5a5e658bd tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:23.435108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234e8e7-4089-4d42-a0a7-4858cc8b084e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:23.436875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234e8e7-4089-4d42-a0a7-4858cc8b084e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:23.438350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234e8e7-4089-4d42-a0a7-4858cc8b084e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:23.439343 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234e8e7-4089-4d42-a0a7-4858cc8b084e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/68236a8dd51645ebb39198656dace466/config` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:23.440663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5234e8e7-4089-4d42-a0a7-4858cc8b084e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=68236a8dd51645ebb39198656dace466)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:23.442839 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-5234e8e7-4089-4d42-a0a7-4858cc8b084e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:17:23.442839 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:17:23.442839 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:17:23.446364 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5234e8e7-4089-4d42-a0a7-4858cc8b084e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:23.521980 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3155/6283] 10.222.0.33 () {60 vars in 1269 bytes} [Sat Aug 6 21:17:23 2022] PUT /identity/v3/domains/68236a8dd51645ebb39198656dace466/config => generated 138 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:23.522984 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ed731-db86-450e-9a40-932719e31289 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:23.523139 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234e8e7-4089-4d42-a0a7-4858cc8b084e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:23.524430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ed731-db86-450e-9a40-932719e31289 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:23.524869 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ed731-db86-450e-9a40-932719e31289 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:23.525375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ed731-db86-450e-9a40-932719e31289 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/projects/e98c52a7cfcd459899adb93afd681bae` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:23.531975 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ed731-db86-450e-9a40-932719e31289 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e98c52a7cfcd459899adb93afd681bae)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:23.535186 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ed731-db86-450e-9a40-932719e31289 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:23.559488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234e8e7-4089-4d42-a0a7-4858cc8b084e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:23.567649 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6d668-4585-478d-b19d-159f79adf1f1 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:23.573629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6d668-4585-478d-b19d-159f79adf1f1 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:23.574041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6d668-4585-478d-b19d-159f79adf1f1 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:23.575427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6d668-4585-478d-b19d-159f79adf1f1 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/68236a8dd51645ebb39198656dace466/config/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:23.576690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6d668-4585-478d-b19d-159f79adf1f1 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=68236a8dd51645ebb39198656dace466, group=identity)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:23.579590 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-13a6d668-4585-478d-b19d-159f79adf1f1 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:17:23.579590 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:17:23.579590 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:17:23.580941 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6d668-4585-478d-b19d-159f79adf1f1 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:23.634203 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3156/6284] 10.222.0.33 () {60 vars in 1297 bytes} [Sat Aug 6 21:17:23 2022] PATCH /identity/v3/domains/68236a8dd51645ebb39198656dace466/config/identity => generated 177 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:17:23.639481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6d668-4585-478d-b19d-159f79adf1f1 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:23.651599 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1d5ed731-db86-450e-9a40-932719e31289 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e98c52a7cfcd459899adb93afd681bae', 'request_id': 'req-1d5ed731-db86-450e-9a40-932719e31289'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:23.655310 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6d668-4585-478d-b19d-159f79adf1f1 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:23.666281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1d5ed731-db86-450e-9a40-932719e31289 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e98c52a7cfcd459899adb93afd681bae', 'request_id': 'req-1d5ed731-db86-450e-9a40-932719e31289'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:23.686708 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1d5ed731-db86-450e-9a40-932719e31289 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e98c52a7cfcd459899adb93afd681bae', 'request_id': 'req-1d5ed731-db86-450e-9a40-932719e31289'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:23.716784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1d5ed731-db86-450e-9a40-932719e31289 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] The token cache is being invalidate because project e98c52a7cfcd459899adb93afd681bae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:17:23.716784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1d5ed731-db86-450e-9a40-932719e31289 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:23.717410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1d5ed731-db86-450e-9a40-932719e31289 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:23.719540 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3129/6285] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:17:23 2022] DELETE /identity/v3/projects/e98c52a7cfcd459899adb93afd681bae => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:23.727996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ed731-db86-450e-9a40-932719e31289 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:23.731404 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1d5ed731-db86-450e-9a40-932719e31289 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:23.768722 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:23.811259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285bd3f-5e64-4dfa-9e78-c661f99f2c6a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:23.812114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285bd3f-5e64-4dfa-9e78-c661f99f2c6a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:23.812510 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285bd3f-5e64-4dfa-9e78-c661f99f2c6a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:23.813077 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285bd3f-5e64-4dfa-9e78-c661f99f2c6a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/68236a8dd51645ebb39198656dace466/config/identity/driver` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:23.814193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a285bd3f-5e64-4dfa-9e78-c661f99f2c6a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=68236a8dd51645ebb39198656dace466, group=identity, option=driver)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:23.816681 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a285bd3f-5e64-4dfa-9e78-c661f99f2c6a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:23.877801 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3157/6286] 10.222.0.33 () {60 vars in 1318 bytes} [Sat Aug 6 21:17:23 2022] PATCH /identity/v3/domains/68236a8dd51645ebb39198656dace466/config/identity/driver => generated 176 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:17:23.879025 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285bd3f-5e64-4dfa-9e78-c661f99f2c6a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:23.881326 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a285bd3f-5e64-4dfa-9e78-c661f99f2c6a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:23.940609 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ed731-db86-450e-9a40-932719e31289 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:23.958963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf2d63-267f-4256-bc07-d30377fa9e4d tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:23.959910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf2d63-267f-4256-bc07-d30377fa9e4d tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:23.960416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf2d63-267f-4256-bc07-d30377fa9e4d tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:23.960925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf2d63-267f-4256-bc07-d30377fa9e4d tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/projects/26321fca826f48ca97820c13f660249e` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:23.962725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf2d63-267f-4256-bc07-d30377fa9e4d tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:delete_project(project_id=26321fca826f48ca97820c13f660249e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:23.965032 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf2d63-267f-4256-bc07-d30377fa9e4d tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:24.014321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:24.022142 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285bd3f-5e64-4dfa-9e78-c661f99f2c6a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:24.033237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a0ae6-a66d-498c-a61d-b8c2120b6ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:24.035559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a0ae6-a66d-498c-a61d-b8c2120b6ba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:24.035856 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a0ae6-a66d-498c-a61d-b8c2120b6ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:24.040269 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a0ae6-a66d-498c-a61d-b8c2120b6ba9 admin admin] PATH_INFO: `/v3/projects/15407d6e47c34f588e162af6a190fd99` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:24.044191 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a0ae6-a66d-498c-a61d-b8c2120b6ba9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15407d6e47c34f588e162af6a190fd99)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:24.051787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a0ae6-a66d-498c-a61d-b8c2120b6ba9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:24.075225 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4eaf2d63-267f-4256-bc07-d30377fa9e4d tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26321fca826f48ca97820c13f660249e', 'request_id': 'req-4eaf2d63-267f-4256-bc07-d30377fa9e4d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:24.084084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4eaf2d63-267f-4256-bc07-d30377fa9e4d tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26321fca826f48ca97820c13f660249e', 'request_id': 'req-4eaf2d63-267f-4256-bc07-d30377fa9e4d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:24.092103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4eaf2d63-267f-4256-bc07-d30377fa9e4d tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26321fca826f48ca97820c13f660249e', 'request_id': 'req-4eaf2d63-267f-4256-bc07-d30377fa9e4d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:24.124014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4eaf2d63-267f-4256-bc07-d30377fa9e4d tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] The token cache is being invalidate because project 26321fca826f48ca97820c13f660249e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:17:24.124245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4eaf2d63-267f-4256-bc07-d30377fa9e4d tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:24.126829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4eaf2d63-267f-4256-bc07-d30377fa9e4d tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:24.134223 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3130/6287] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:17:23 2022] DELETE /identity/v3/projects/26321fca826f48ca97820c13f660249e => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:24.135796 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf2d63-267f-4256-bc07-d30377fa9e4d tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:24.137042 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4eaf2d63-267f-4256-bc07-d30377fa9e4d tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:24.259205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e46a0ae6-a66d-498c-a61d-b8c2120b6ba9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15407d6e47c34f588e162af6a190fd99', 'request_id': 'req-e46a0ae6-a66d-498c-a61d-b8c2120b6ba9'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:24.286800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e46a0ae6-a66d-498c-a61d-b8c2120b6ba9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15407d6e47c34f588e162af6a190fd99', 'request_id': 'req-e46a0ae6-a66d-498c-a61d-b8c2120b6ba9'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:24.314426 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf2d63-267f-4256-bc07-d30377fa9e4d tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:24.316101 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e46a0ae6-a66d-498c-a61d-b8c2120b6ba9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15407d6e47c34f588e162af6a190fd99', 'request_id': 'req-e46a0ae6-a66d-498c-a61d-b8c2120b6ba9'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:24.349649 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e46a0ae6-a66d-498c-a61d-b8c2120b6ba9 admin admin] The token cache is being invalidate because project 15407d6e47c34f588e162af6a190fd99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:17:24.350100 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e46a0ae6-a66d-498c-a61d-b8c2120b6ba9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:24.350927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e46a0ae6-a66d-498c-a61d-b8c2120b6ba9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:24.357057 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3158/6288] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:17:23 2022] DELETE /identity/v3/projects/15407d6e47c34f588e162af6a190fd99 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:24.358001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a0ae6-a66d-498c-a61d-b8c2120b6ba9 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:24.366090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e46a0ae6-a66d-498c-a61d-b8c2120b6ba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:24.502218 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:24.550004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a662a24-abec-4ad9-9d54-877cb2b0bc6c tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:24.550315 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a662a24-abec-4ad9-9d54-877cb2b0bc6c tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:24.550593 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a662a24-abec-4ad9-9d54-877cb2b0bc6c tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:24.550887 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a662a24-abec-4ad9-9d54-877cb2b0bc6c tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/68236a8dd51645ebb39198656dace466/config/identity/driver` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:24.551499 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a662a24-abec-4ad9-9d54-877cb2b0bc6c tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=68236a8dd51645ebb39198656dace466, group=identity, option=driver)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:24.554770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a662a24-abec-4ad9-9d54-877cb2b0bc6c tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:24.587324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a0ae6-a66d-498c-a61d-b8c2120b6ba9 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:24.592158 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3131/6289] 10.222.0.33 () {58 vars in 1299 bytes} [Sat Aug 6 21:17:24 2022] DELETE /identity/v3/domains/68236a8dd51645ebb39198656dace466/config/identity/driver => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:24.595409 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd768c79-8074-4f03-a6f0-1ccc4e521255 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:24.595409 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd768c79-8074-4f03-a6f0-1ccc4e521255 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:24.596853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacd024-4cf6-4d39-a732-8eae291989f4 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:24.597246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd768c79-8074-4f03-a6f0-1ccc4e521255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:24.597381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacd024-4cf6-4d39-a732-8eae291989f4 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:24.597381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacd024-4cf6-4d39-a732-8eae291989f4 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:24.597381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacd024-4cf6-4d39-a732-8eae291989f4 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/domains/030fcc583d434621816bbd8272442e30` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:24.597884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bacd024-4cf6-4d39-a732-8eae291989f4 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=030fcc583d434621816bbd8272442e30)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:24.599957 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bacd024-4cf6-4d39-a732-8eae291989f4 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:24.621939 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-dd768c79-8074-4f03-a6f0-1ccc4e521255 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:24.625352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-dd768c79-8074-4f03-a6f0-1ccc4e521255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:24.648861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4bacd024-4cf6-4d39-a732-8eae291989f4 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '030fcc583d434621816bbd8272442e30'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:24.649953 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4bacd024-4cf6-4d39-a732-8eae291989f4 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '030fcc583d434621816bbd8272442e30'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:24.735098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4bacd024-4cf6-4d39-a732-8eae291989f4 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '030fcc583d434621816bbd8272442e30'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:24.738739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4bacd024-4cf6-4d39-a732-8eae291989f4 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '030fcc583d434621816bbd8272442e30'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:24.744414 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3159/6290] 10.222.0.33 () {60 vars in 1249 bytes} [Sat Aug 6 21:17:24 2022] PATCH /identity/v3/domains/030fcc583d434621816bbd8272442e30 => generated 278 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:17:24.745428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacd024-4cf6-4d39-a732-8eae291989f4 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:24.749312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4bacd024-4cf6-4d39-a732-8eae291989f4 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:24.765399 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3132/6291] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:24.765399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd768c79-8074-4f03-a6f0-1ccc4e521255 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:24.768171 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-dd768c79-8074-4f03-a6f0-1ccc4e521255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:24.803678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd768c79-8074-4f03-a6f0-1ccc4e521255 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:24.946777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:24.990988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacd024-4cf6-4d39-a732-8eae291989f4 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:25.029690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4aa7c-080d-48db-8988-2a818ae5fbab tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:25.032277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4aa7c-080d-48db-8988-2a818ae5fbab tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:25.032821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb711ae-6504-45c6-ba41-be77a865c0e5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:25.033196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4aa7c-080d-48db-8988-2a818ae5fbab tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:25.034088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4aa7c-080d-48db-8988-2a818ae5fbab tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/68236a8dd51645ebb39198656dace466/config/identity/driver` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:25.034479 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb711ae-6504-45c6-ba41-be77a865c0e5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:25.035366 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb711ae-6504-45c6-ba41-be77a865c0e5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:25.036185 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb711ae-6504-45c6-ba41-be77a865c0e5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/domains/030fcc583d434621816bbd8272442e30` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:25.039798 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4aa7c-080d-48db-8988-2a818ae5fbab tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=68236a8dd51645ebb39198656dace466, group=identity, option=driver)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:25.047848 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-14b4aa7c-080d-48db-8988-2a818ae5fbab tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:17:25.047848 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:17:25.047848 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:17:25.050901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4aa7c-080d-48db-8988-2a818ae5fbab tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:25.092596 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-14b4aa7c-080d-48db-8988-2a818ae5fbab tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Could not find option driver in group identity in domain configuration for domain 68236a8dd51645ebb39198656dace466.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 68236a8dd51645ebb39198656dace466. Aug 06 21:17:25.092596 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:17:25.092596 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:17:25.092596 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:17:25.092596 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:17:25.092596 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:17:25.092596 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:17:25.092596 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:17:25.092596 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:17:25.092596 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:17:25.092596 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:17:25.092596 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:17:25.092596 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Aug 06 21:17:25.093779 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Aug 06 21:17:25.093779 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Aug 06 21:17:25.093779 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Aug 06 21:17:25.093779 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:17:25.093779 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:17:25.093779 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Aug 06 21:17:25.093779 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Aug 06 21:17:25.093779 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 68236a8dd51645ebb39198656dace466. Aug 06 21:17:25.093779 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:17:25.104057 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb711ae-6504-45c6-ba41-be77a865c0e5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=030fcc583d434621816bbd8272442e30)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:25.107243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb711ae-6504-45c6-ba41-be77a865c0e5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:25.113680 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3160/6292] 10.222.0.33 () {58 vars in 1296 bytes} [Sat Aug 6 21:17:24 2022] GET /identity/v3/domains/68236a8dd51645ebb39198656dace466/config/identity/driver => generated 171 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:17:25.116822 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494fd4c-28b6-462e-b152-d827c9a52081 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:25.118894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494fd4c-28b6-462e-b152-d827c9a52081 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:25.120576 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494fd4c-28b6-462e-b152-d827c9a52081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:25.148382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-7494fd4c-28b6-462e-b152-d827c9a52081 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:25.149968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7494fd4c-28b6-462e-b152-d827c9a52081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:25.167970 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4cb711ae-6504-45c6-ba41-be77a865c0e5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '030fcc583d434621816bbd8272442e30'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:25.203074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4cb711ae-6504-45c6-ba41-be77a865c0e5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '030fcc583d434621816bbd8272442e30'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:25.270182 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3161/6293] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:25.270182 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494fd4c-28b6-462e-b152-d827c9a52081 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:25.286234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494fd4c-28b6-462e-b152-d827c9a52081 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:25.294176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:25.301914 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4cb711ae-6504-45c6-ba41-be77a865c0e5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '030fcc583d434621816bbd8272442e30', 'request_id': 'req-4cb711ae-6504-45c6-ba41-be77a865c0e5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:25.310073 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4cb711ae-6504-45c6-ba41-be77a865c0e5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '030fcc583d434621816bbd8272442e30', 'request_id': 'req-4cb711ae-6504-45c6-ba41-be77a865c0e5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:25.318314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4cb711ae-6504-45c6-ba41-be77a865c0e5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '030fcc583d434621816bbd8272442e30', 'request_id': 'req-4cb711ae-6504-45c6-ba41-be77a865c0e5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:25.347543 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4cb711ae-6504-45c6-ba41-be77a865c0e5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] The token cache is being invalidate because project 030fcc583d434621816bbd8272442e30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:17:25.348350 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4cb711ae-6504-45c6-ba41-be77a865c0e5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:25.349481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4cb711ae-6504-45c6-ba41-be77a865c0e5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:25.370702 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4cb711ae-6504-45c6-ba41-be77a865c0e5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '030fcc583d434621816bbd8272442e30', 'request_id': 'req-4cb711ae-6504-45c6-ba41-be77a865c0e5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:25.371891 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4cb711ae-6504-45c6-ba41-be77a865c0e5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '030fcc583d434621816bbd8272442e30', 'request_id': 'req-4cb711ae-6504-45c6-ba41-be77a865c0e5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:25.373420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4cb711ae-6504-45c6-ba41-be77a865c0e5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '030fcc583d434621816bbd8272442e30', 'request_id': 'req-4cb711ae-6504-45c6-ba41-be77a865c0e5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:25.411761 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3133/6294] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:17:24 2022] DELETE /identity/v3/domains/030fcc583d434621816bbd8272442e30 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:25.412642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb711ae-6504-45c6-ba41-be77a865c0e5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:25.422837 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4cb711ae-6504-45c6-ba41-be77a865c0e5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:25.481931 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d5c0b-085d-4fea-a4d5-11be503ca882 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:25.482639 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d5c0b-085d-4fea-a4d5-11be503ca882 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:25.483010 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d5c0b-085d-4fea-a4d5-11be503ca882 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:25.483221 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d5c0b-085d-4fea-a4d5-11be503ca882 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/68236a8dd51645ebb39198656dace466/config/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:25.484744 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d5c0b-085d-4fea-a4d5-11be503ca882 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=68236a8dd51645ebb39198656dace466, group=identity)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:25.493275 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d5c0b-085d-4fea-a4d5-11be503ca882 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:25.530159 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3162/6295] 10.222.0.33 () {58 vars in 1278 bytes} [Sat Aug 6 21:17:25 2022] DELETE /identity/v3/domains/68236a8dd51645ebb39198656dace466/config/identity => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:25.531124 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d5c0b-085d-4fea-a4d5-11be503ca882 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:25.533710 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-432d5c0b-085d-4fea-a4d5-11be503ca882 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:25.613035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb711ae-6504-45c6-ba41-be77a865c0e5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:25.618241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901a30e-865d-4411-a301-2a9a9594e86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:25.619149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901a30e-865d-4411-a301-2a9a9594e86e admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:25.620378 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901a30e-865d-4411-a301-2a9a9594e86e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:25.620823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901a30e-865d-4411-a301-2a9a9594e86e admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:25.621700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901a30e-865d-4411-a301-2a9a9594e86e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:17:25.622419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901a30e-865d-4411-a301-2a9a9594e86e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:25.624245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901a30e-865d-4411-a301-2a9a9594e86e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:25.645058 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3134/6296] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:17:25.646921 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901a30e-865d-4411-a301-2a9a9594e86e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:25.648952 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7901a30e-865d-4411-a301-2a9a9594e86e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:25.703627 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901a30e-865d-4411-a301-2a9a9594e86e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:25.709173 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f71642-3453-4c6f-b26f-3489dd09a7e9 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:25.712392 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f71642-3453-4c6f-b26f-3489dd09a7e9 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:25.713375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f71642-3453-4c6f-b26f-3489dd09a7e9 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:25.713375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f71642-3453-4c6f-b26f-3489dd09a7e9 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/68236a8dd51645ebb39198656dace466/config/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:25.715061 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f71642-3453-4c6f-b26f-3489dd09a7e9 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=68236a8dd51645ebb39198656dace466, group=identity)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:25.716939 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f71642-3453-4c6f-b26f-3489dd09a7e9 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:25.735506 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d5c0b-085d-4fea-a4d5-11be503ca882 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:25.745511 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-17f71642-3453-4c6f-b26f-3489dd09a7e9 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Could not find group identity in domain configuration for domain 68236a8dd51645ebb39198656dace466.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 68236a8dd51645ebb39198656dace466. Aug 06 21:17:25.745511 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:17:25.745511 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:17:25.745511 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:17:25.745511 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:17:25.745511 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:17:25.745511 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:17:25.745511 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:17:25.745511 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:17:25.745511 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:17:25.745511 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:17:25.745511 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:17:25.745511 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Aug 06 21:17:25.746855 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Aug 06 21:17:25.746855 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Aug 06 21:17:25.746855 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Aug 06 21:17:25.746855 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:17:25.746855 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:17:25.746855 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Aug 06 21:17:25.746855 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Aug 06 21:17:25.746855 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 68236a8dd51645ebb39198656dace466. Aug 06 21:17:25.746855 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:17:25.749830 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3135/6297] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Aug 6 21:17:25 2022] GET /identity/v3/domains/68236a8dd51645ebb39198656dace466/config/identity => generated 154 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:17:25.751052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f71642-3453-4c6f-b26f-3489dd09a7e9 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:25.756736 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78608d-f3f6-4897-ab3a-8b14840d82b5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:25.757140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78608d-f3f6-4897-ab3a-8b14840d82b5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:25.757430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78608d-f3f6-4897-ab3a-8b14840d82b5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:25.758132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78608d-f3f6-4897-ab3a-8b14840d82b5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:25.758815 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd78608d-f3f6-4897-ab3a-8b14840d82b5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:25.760780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd78608d-f3f6-4897-ab3a-8b14840d82b5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:25.773469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f71642-3453-4c6f-b26f-3489dd09a7e9 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:25.781896 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de693590-ef7a-4238-910e-a2461236c037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:25.784548 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de693590-ef7a-4238-910e-a2461236c037 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:25.785159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de693590-ef7a-4238-910e-a2461236c037 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:25.786045 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de693590-ef7a-4238-910e-a2461236c037 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:25.787083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de693590-ef7a-4238-910e-a2461236c037 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:25.791683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de693590-ef7a-4238-910e-a2461236c037 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:25.862614 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3163/6298] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:17:25 2022] POST /identity/v3/projects => generated 377 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:25.862614 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78608d-f3f6-4897-ab3a-8b14840d82b5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:25.874501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:25.944181 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3136/6299] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:17:25 2022] POST /identity/v3/projects => generated 373 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:25.945194 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de693590-ef7a-4238-910e-a2461236c037 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:26.074292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78608d-f3f6-4897-ab3a-8b14840d82b5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:26.147907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de693590-ef7a-4238-910e-a2461236c037 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:26.169509 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66c064-120a-45fd-94c6-957abd60622b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:26.170450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66c064-120a-45fd-94c6-957abd60622b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:26.173657 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66c064-120a-45fd-94c6-957abd60622b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:26.174570 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66c064-120a-45fd-94c6-957abd60622b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/projects/076304b1e5ec474bb89e233955e3dec7` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:26.182714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d66c064-120a-45fd-94c6-957abd60622b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:get_project(project_id=076304b1e5ec474bb89e233955e3dec7)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:26.186177 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d66c064-120a-45fd-94c6-957abd60622b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:26.190572 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3137/6300] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:17:25 2022] GET /identity/v3/projects/076304b1e5ec474bb89e233955e3dec7 => generated 377 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:17:26.191651 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66c064-120a-45fd-94c6-957abd60622b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:26.227681 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99366d7-f05f-4221-84b4-220039bb1d70 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:26.227955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99366d7-f05f-4221-84b4-220039bb1d70 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:26.228156 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99366d7-f05f-4221-84b4-220039bb1d70 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:26.228568 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99366d7-f05f-4221-84b4-220039bb1d70 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/68236a8dd51645ebb39198656dace466/config` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:26.229652 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99366d7-f05f-4221-84b4-220039bb1d70 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=68236a8dd51645ebb39198656dace466)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:26.234717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99366d7-f05f-4221-84b4-220039bb1d70 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:26.244594 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:26.254590 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3164/6301] 10.222.0.33 () {58 vars in 1251 bytes} [Sat Aug 6 21:17:25 2022] DELETE /identity/v3/domains/68236a8dd51645ebb39198656dace466/config => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:26.254590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99366d7-f05f-4221-84b4-220039bb1d70 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:26.270061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99366d7-f05f-4221-84b4-220039bb1d70 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:26.277322 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90bdcf-76ae-4465-81dc-225a35738de0 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:26.278183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90bdcf-76ae-4465-81dc-225a35738de0 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:26.279107 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90bdcf-76ae-4465-81dc-225a35738de0 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:26.279462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90bdcf-76ae-4465-81dc-225a35738de0 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:26.280444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c90bdcf-76ae-4465-81dc-225a35738de0 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:26.283501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c90bdcf-76ae-4465-81dc-225a35738de0 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:26.308977 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3165/6302] 10.222.0.33 () {58 vars in 1131 bytes} [Sat Aug 6 21:17:26 2022] GET /identity/v3/projects => generated 6207 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:17:26.313875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90bdcf-76ae-4465-81dc-225a35738de0 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:26.327566 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90bdcf-76ae-4465-81dc-225a35738de0 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:26.333271 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e51c3-3e29-41ee-8839-1d97c8a6cb55 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:26.334444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e51c3-3e29-41ee-8839-1d97c8a6cb55 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:26.334444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e51c3-3e29-41ee-8839-1d97c8a6cb55 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:26.334678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e51c3-3e29-41ee-8839-1d97c8a6cb55 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/68236a8dd51645ebb39198656dace466` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:26.337176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e51c3-3e29-41ee-8839-1d97c8a6cb55 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=68236a8dd51645ebb39198656dace466)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:26.339588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e51c3-3e29-41ee-8839-1d97c8a6cb55 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:26.346272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66c064-120a-45fd-94c6-957abd60622b tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:26.359400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c25235-7777-4923-a781-08abe7ac769b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:26.360247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c25235-7777-4923-a781-08abe7ac769b admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:26.360686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c25235-7777-4923-a781-08abe7ac769b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:26.361978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c25235-7777-4923-a781-08abe7ac769b admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:26.364585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c25235-7777-4923-a781-08abe7ac769b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:26.368401 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c25235-7777-4923-a781-08abe7ac769b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:26.394281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-df3e51c3-3e29-41ee-8839-1d97c8a6cb55 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '68236a8dd51645ebb39198656dace466'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:26.395839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-df3e51c3-3e29-41ee-8839-1d97c8a6cb55 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '68236a8dd51645ebb39198656dace466'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:26.428589 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3138/6303] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:17:26 2022] POST /identity/v3/users => generated 287 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:26.429667 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c25235-7777-4923-a781-08abe7ac769b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:26.432690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-15c25235-7777-4923-a781-08abe7ac769b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:26.449675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c25235-7777-4923-a781-08abe7ac769b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:26.452160 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-df3e51c3-3e29-41ee-8839-1d97c8a6cb55 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '68236a8dd51645ebb39198656dace466'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:26.455675 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-df3e51c3-3e29-41ee-8839-1d97c8a6cb55 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '68236a8dd51645ebb39198656dace466'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:26.462947 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3166/6304] 10.222.0.33 () {60 vars in 1249 bytes} [Sat Aug 6 21:17:26 2022] PATCH /identity/v3/domains/68236a8dd51645ebb39198656dace466 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:17:26.465185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e51c3-3e29-41ee-8839-1d97c8a6cb55 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:26.468995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-df3e51c3-3e29-41ee-8839-1d97c8a6cb55 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:26.574292 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716fa176-d7fc-408f-a815-dd947ac418db tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:26.576278 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fa176-d7fc-408f-a815-dd947ac418db tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:26.576836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fa176-d7fc-408f-a815-dd947ac418db tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:26.577790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fa176-d7fc-408f-a815-dd947ac418db tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/projects/076304b1e5ec474bb89e233955e3dec7` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:26.583125 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716fa176-d7fc-408f-a815-dd947ac418db tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:delete_project(project_id=076304b1e5ec474bb89e233955e3dec7)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:26.585441 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:26.590212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716fa176-d7fc-408f-a815-dd947ac418db tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:26.601666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e51c3-3e29-41ee-8839-1d97c8a6cb55 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:26.608517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c7244-ede2-40b1-81f8-66558bee9233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:26.609191 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c7244-ede2-40b1-81f8-66558bee9233 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:26.609478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c7244-ede2-40b1-81f8-66558bee9233 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:26.609745 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c7244-ede2-40b1-81f8-66558bee9233 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:26.611653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c7244-ede2-40b1-81f8-66558bee9233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:26.614502 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c7244-ede2-40b1-81f8-66558bee9233 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:26.627413 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3167/6305] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:17:26.628494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c7244-ede2-40b1-81f8-66558bee9233 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:26.630839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a05c7244-ede2-40b1-81f8-66558bee9233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:26.737748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c7244-ede2-40b1-81f8-66558bee9233 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:26.752940 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-716fa176-d7fc-408f-a815-dd947ac418db tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '076304b1e5ec474bb89e233955e3dec7', 'request_id': 'req-716fa176-d7fc-408f-a815-dd947ac418db'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:26.768344 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-716fa176-d7fc-408f-a815-dd947ac418db tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '076304b1e5ec474bb89e233955e3dec7', 'request_id': 'req-716fa176-d7fc-408f-a815-dd947ac418db'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:26.786085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-716fa176-d7fc-408f-a815-dd947ac418db tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '076304b1e5ec474bb89e233955e3dec7', 'request_id': 'req-716fa176-d7fc-408f-a815-dd947ac418db'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:26.815013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-716fa176-d7fc-408f-a815-dd947ac418db tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] The token cache is being invalidate because project 076304b1e5ec474bb89e233955e3dec7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:17:26.815385 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-716fa176-d7fc-408f-a815-dd947ac418db tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:26.816116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-716fa176-d7fc-408f-a815-dd947ac418db tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:26.817771 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3139/6306] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:17:26 2022] DELETE /identity/v3/projects/076304b1e5ec474bb89e233955e3dec7 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:26.823348 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716fa176-d7fc-408f-a815-dd947ac418db tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:26.830010 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-716fa176-d7fc-408f-a815-dd947ac418db tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:26.895297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6d4b0-1a1d-4942-92b4-dd9c8e3b5ffa tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:26.895955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6d4b0-1a1d-4942-92b4-dd9c8e3b5ffa tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:26.896241 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6d4b0-1a1d-4942-92b4-dd9c8e3b5ffa tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:26.896527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6d4b0-1a1d-4942-92b4-dd9c8e3b5ffa tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/68236a8dd51645ebb39198656dace466` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:26.924910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6d4b0-1a1d-4942-92b4-dd9c8e3b5ffa tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=68236a8dd51645ebb39198656dace466)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:26.927853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6d4b0-1a1d-4942-92b4-dd9c8e3b5ffa tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:26.952578 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:27.000496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8bb6d4b0-1a1d-4942-92b4-dd9c8e3b5ffa tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '68236a8dd51645ebb39198656dace466'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:27.014237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716fa176-d7fc-408f-a815-dd947ac418db tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:27.014589 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8bb6d4b0-1a1d-4942-92b4-dd9c8e3b5ffa tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '68236a8dd51645ebb39198656dace466'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:27.024327 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94fd58-6779-427b-aa95-daa039a7196b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:27.024980 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94fd58-6779-427b-aa95-daa039a7196b admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:27.025234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94fd58-6779-427b-aa95-daa039a7196b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:27.025509 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94fd58-6779-427b-aa95-daa039a7196b admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:27.026855 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94fd58-6779-427b-aa95-daa039a7196b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:27.037758 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94fd58-6779-427b-aa95-daa039a7196b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:27.059424 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3140/6307] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:17:27.060369 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94fd58-6779-427b-aa95-daa039a7196b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:27.066275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6a94fd58-6779-427b-aa95-daa039a7196b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:27.165318 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8bb6d4b0-1a1d-4942-92b4-dd9c8e3b5ffa tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68236a8dd51645ebb39198656dace466', 'request_id': 'req-8bb6d4b0-1a1d-4942-92b4-dd9c8e3b5ffa'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:27.185397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8bb6d4b0-1a1d-4942-92b4-dd9c8e3b5ffa tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68236a8dd51645ebb39198656dace466', 'request_id': 'req-8bb6d4b0-1a1d-4942-92b4-dd9c8e3b5ffa'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:27.199773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:27.211517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8bb6d4b0-1a1d-4942-92b4-dd9c8e3b5ffa tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68236a8dd51645ebb39198656dace466', 'request_id': 'req-8bb6d4b0-1a1d-4942-92b4-dd9c8e3b5ffa'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:27.223748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94fd58-6779-427b-aa95-daa039a7196b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:27.242738 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8bb6d4b0-1a1d-4942-92b4-dd9c8e3b5ffa tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] The token cache is being invalidate because project 68236a8dd51645ebb39198656dace466 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:17:27.243221 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8bb6d4b0-1a1d-4942-92b4-dd9c8e3b5ffa tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:27.250980 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8bb6d4b0-1a1d-4942-92b4-dd9c8e3b5ffa tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:27.282603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8bb6d4b0-1a1d-4942-92b4-dd9c8e3b5ffa tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '68236a8dd51645ebb39198656dace466', 'request_id': 'req-8bb6d4b0-1a1d-4942-92b4-dd9c8e3b5ffa'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:27.290057 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8bb6d4b0-1a1d-4942-92b4-dd9c8e3b5ffa tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '68236a8dd51645ebb39198656dace466', 'request_id': 'req-8bb6d4b0-1a1d-4942-92b4-dd9c8e3b5ffa'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:27.292669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8bb6d4b0-1a1d-4942-92b4-dd9c8e3b5ffa tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '68236a8dd51645ebb39198656dace466', 'request_id': 'req-8bb6d4b0-1a1d-4942-92b4-dd9c8e3b5ffa'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:27.313310 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3168/6308] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:17:26 2022] DELETE /identity/v3/domains/68236a8dd51645ebb39198656dace466 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:27.314658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6d4b0-1a1d-4942-92b4-dd9c8e3b5ffa tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:27.319987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8bb6d4b0-1a1d-4942-92b4-dd9c8e3b5ffa tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:27.394995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d2bfb-e275-4c8c-8339-2ab680aeb559 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:27.399397 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d2bfb-e275-4c8c-8339-2ab680aeb559 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:27.399768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d2bfb-e275-4c8c-8339-2ab680aeb559 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:27.400083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d2bfb-e275-4c8c-8339-2ab680aeb559 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:27.401559 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d2bfb-e275-4c8c-8339-2ab680aeb559 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:27.409732 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d2bfb-e275-4c8c-8339-2ab680aeb559 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:27.428745 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6d4b0-1a1d-4942-92b4-dd9c8e3b5ffa tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:27.454284 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76587c42-edb7-4087-a814-56ea898a3817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:27.455758 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76587c42-edb7-4087-a814-56ea898a3817 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:27.456844 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76587c42-edb7-4087-a814-56ea898a3817 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:27.457389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76587c42-edb7-4087-a814-56ea898a3817 admin admin] PATH_INFO: `/v3/projects/1f57cc6855ef4b98ad703de9bdc1e094/users/7cd539be9e3b426d9eb5bdba4697f849/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:27.489466 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3141/6309] 10.222.0.33 () {60 vars in 1152 bytes} [Sat Aug 6 21:17:27 2022] POST /identity/v3/projects => generated 347 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:27.494336 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76587c42-edb7-4087-a814-56ea898a3817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f57cc6855ef4b98ad703de9bdc1e094, user_id=7cd539be9e3b426d9eb5bdba4697f849, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:27.497565 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76587c42-edb7-4087-a814-56ea898a3817 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:27.499771 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d2bfb-e275-4c8c-8339-2ab680aeb559 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:27.501310 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e08d2bfb-e275-4c8c-8339-2ab680aeb559 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:27.520992 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3169/6310] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:17:27 2022] PUT /identity/v3/projects/1f57cc6855ef4b98ad703de9bdc1e094/users/7cd539be9e3b426d9eb5bdba4697f849/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:27.525338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76587c42-edb7-4087-a814-56ea898a3817 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:27.525565 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-76587c42-edb7-4087-a814-56ea898a3817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:27.643796 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d2bfb-e275-4c8c-8339-2ab680aeb559 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:27.670751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76587c42-edb7-4087-a814-56ea898a3817 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:27.675143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:27.680786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff9423-23e5-4283-9ee4-330e7e746233 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:27.681670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff9423-23e5-4283-9ee4-330e7e746233 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:27.681670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff9423-23e5-4283-9ee4-330e7e746233 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:27.681670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff9423-23e5-4283-9ee4-330e7e746233 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/projects/d699ebf1e0144e74b85eee6ef55116b2` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:27.686640 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff9423-23e5-4283-9ee4-330e7e746233 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:update_project(project_id=d699ebf1e0144e74b85eee6ef55116b2)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:27.688696 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff9423-23e5-4283-9ee4-330e7e746233 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:27.779618 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3170/6311] 10.222.0.33 () {60 vars in 1252 bytes} [Sat Aug 6 21:17:27 2022] PATCH /identity/v3/projects/d699ebf1e0144e74b85eee6ef55116b2 => generated 362 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:17:27.781188 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089156c9-2bab-4301-96e2-e1f52e43e6d1 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:27.786337 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089156c9-2bab-4301-96e2-e1f52e43e6d1 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:27.786903 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089156c9-2bab-4301-96e2-e1f52e43e6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:27.811026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e170de4-c159-4373-85cd-71b0ee1fd14b tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:27.811657 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e170de4-c159-4373-85cd-71b0ee1fd14b tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:27.811937 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e170de4-c159-4373-85cd-71b0ee1fd14b tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:27.812206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e170de4-c159-4373-85cd-71b0ee1fd14b tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:27.812771 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e170de4-c159-4373-85cd-71b0ee1fd14b tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:27.819979 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-9e170de4-c159-4373-85cd-71b0ee1fd14b tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:17:27.819979 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:17:27.819979 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:17:27.820339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e170de4-c159-4373-85cd-71b0ee1fd14b tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:27.830658 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3142/6312] 10.222.0.33 () {58 vars in 1173 bytes} [Sat Aug 6 21:17:27 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:17:27.831743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e170de4-c159-4373-85cd-71b0ee1fd14b tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:27.836269 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-089156c9-2bab-4301-96e2-e1f52e43e6d1 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:27.837613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-089156c9-2bab-4301-96e2-e1f52e43e6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:27.872161 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e170de4-c159-4373-85cd-71b0ee1fd14b tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:27.888891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:27.889850 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9236925-227f-4c03-8ee8-6a88cb444e6a tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:27.890792 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9236925-227f-4c03-8ee8-6a88cb444e6a tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:27.890792 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9236925-227f-4c03-8ee8-6a88cb444e6a tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:27.891081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9236925-227f-4c03-8ee8-6a88cb444e6a tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/projects/d699ebf1e0144e74b85eee6ef55116b2` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:27.908581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9236925-227f-4c03-8ee8-6a88cb444e6a tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:get_project(project_id=d699ebf1e0144e74b85eee6ef55116b2)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:27.912374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9236925-227f-4c03-8ee8-6a88cb444e6a tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:27.920828 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3143/6313] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:17:27 2022] GET /identity/v3/projects/d699ebf1e0144e74b85eee6ef55116b2 => generated 349 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:17:27.922054 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9236925-227f-4c03-8ee8-6a88cb444e6a tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:27.939962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9236925-227f-4c03-8ee8-6a88cb444e6a tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:27.947256 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198897ef-d5ab-4d7c-a385-e6f234deb7dd tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:27.947256 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198897ef-d5ab-4d7c-a385-e6f234deb7dd tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:27.947256 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198897ef-d5ab-4d7c-a385-e6f234deb7dd tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:27.948485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198897ef-d5ab-4d7c-a385-e6f234deb7dd tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:27.948485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198897ef-d5ab-4d7c-a385-e6f234deb7dd tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:27.949894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198897ef-d5ab-4d7c-a385-e6f234deb7dd tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:27.951523 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3144/6314] 10.222.0.33 () {58 vars in 1200 bytes} [Sat Aug 6 21:17:27 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:27.954668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198897ef-d5ab-4d7c-a385-e6f234deb7dd tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:27.954830 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3171/6315] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:27.955969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089156c9-2bab-4301-96e2-e1f52e43e6d1 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:27.968367 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198897ef-d5ab-4d7c-a385-e6f234deb7dd tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:27.979124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b990cf-0d63-4298-8627-6dc61099f91a tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:27.980139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b990cf-0d63-4298-8627-6dc61099f91a tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:27.980614 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b990cf-0d63-4298-8627-6dc61099f91a tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:27.981093 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b990cf-0d63-4298-8627-6dc61099f91a tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/projects/d699ebf1e0144e74b85eee6ef55116b2` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:27.982741 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b990cf-0d63-4298-8627-6dc61099f91a tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d699ebf1e0144e74b85eee6ef55116b2)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:27.983476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089156c9-2bab-4301-96e2-e1f52e43e6d1 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:27.985310 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b990cf-0d63-4298-8627-6dc61099f91a tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:28.004693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57233e47-1a6e-466a-ac79-2d41092f9aca tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:28.005485 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57233e47-1a6e-466a-ac79-2d41092f9aca tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:28.005810 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57233e47-1a6e-466a-ac79-2d41092f9aca tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:28.006146 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57233e47-1a6e-466a-ac79-2d41092f9aca tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:28.006892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57233e47-1a6e-466a-ac79-2d41092f9aca tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:28.007981 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-57233e47-1a6e-466a-ac79-2d41092f9aca tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:17:28.007981 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:17:28.007981 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:17:28.008968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57233e47-1a6e-466a-ac79-2d41092f9aca tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:28.010736 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3172/6316] 10.222.0.33 () {58 vars in 1221 bytes} [Sat Aug 6 21:17:27 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:28.011401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57233e47-1a6e-466a-ac79-2d41092f9aca tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:28.016062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-57233e47-1a6e-466a-ac79-2d41092f9aca tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:28.048864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-78b990cf-0d63-4298-8627-6dc61099f91a tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd699ebf1e0144e74b85eee6ef55116b2', 'request_id': 'req-78b990cf-0d63-4298-8627-6dc61099f91a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:28.070418 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-78b990cf-0d63-4298-8627-6dc61099f91a tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd699ebf1e0144e74b85eee6ef55116b2', 'request_id': 'req-78b990cf-0d63-4298-8627-6dc61099f91a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:28.091207 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-78b990cf-0d63-4298-8627-6dc61099f91a tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd699ebf1e0144e74b85eee6ef55116b2', 'request_id': 'req-78b990cf-0d63-4298-8627-6dc61099f91a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:28.163211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57233e47-1a6e-466a-ac79-2d41092f9aca tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:28.168044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-78b990cf-0d63-4298-8627-6dc61099f91a tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] The token cache is being invalidate because project d699ebf1e0144e74b85eee6ef55116b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:17:28.168337 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-78b990cf-0d63-4298-8627-6dc61099f91a tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:28.172636 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-78b990cf-0d63-4298-8627-6dc61099f91a tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:28.183939 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3145/6317] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:17:27 2022] DELETE /identity/v3/projects/d699ebf1e0144e74b85eee6ef55116b2 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:28.183939 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b990cf-0d63-4298-8627-6dc61099f91a tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:28.186575 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-78b990cf-0d63-4298-8627-6dc61099f91a tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:28.300639 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8c0e4-7416-4525-bf5f-5d24ce8ac58c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:28.302419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8c0e4-7416-4525-bf5f-5d24ce8ac58c service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:28.302902 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8c0e4-7416-4525-bf5f-5d24ce8ac58c service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:28.303340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8c0e4-7416-4525-bf5f-5d24ce8ac58c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:28.315016 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a6c8c0e4-7416-4525-bf5f-5d24ce8ac58c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:28.396407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b990cf-0d63-4298-8627-6dc61099f91a tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:28.408113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc280d2-de09-436f-84b3-494be3564d35 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:28.409038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc280d2-de09-436f-84b3-494be3564d35 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:28.409414 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc280d2-de09-436f-84b3-494be3564d35 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:28.411172 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc280d2-de09-436f-84b3-494be3564d35 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:28.411950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc280d2-de09-436f-84b3-494be3564d35 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:28.413704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc280d2-de09-436f-84b3-494be3564d35 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:28.418711 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3146/6318] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:17:28 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:28.420664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc280d2-de09-436f-84b3-494be3564d35 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:28.424785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4fc280d2-de09-436f-84b3-494be3564d35 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:28.466991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8c0e4-7416-4525-bf5f-5d24ce8ac58c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:28.471403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8c0e4-7416-4525-bf5f-5d24ce8ac58c service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:28.495350 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3173/6319] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:17:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:17:28.497808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:28.498269 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8c0e4-7416-4525-bf5f-5d24ce8ac58c service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:28.531843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8c0e4-7416-4525-bf5f-5d24ce8ac58c service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:28.545082 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a171d82-9ed7-4ab6-9141-f8b378c71d04 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:28.545842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a171d82-9ed7-4ab6-9141-f8b378c71d04 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:28.546578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a171d82-9ed7-4ab6-9141-f8b378c71d04 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:28.546578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a171d82-9ed7-4ab6-9141-f8b378c71d04 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:28.547911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a171d82-9ed7-4ab6-9141-f8b378c71d04 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:28.551927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a171d82-9ed7-4ab6-9141-f8b378c71d04 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:28.561396 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3174/6320] 10.222.0.33 () {58 vars in 1188 bytes} [Sat Aug 6 21:17:28 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:17:28.568226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a171d82-9ed7-4ab6-9141-f8b378c71d04 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:28.593128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a171d82-9ed7-4ab6-9141-f8b378c71d04 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:28.598085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc280d2-de09-436f-84b3-494be3564d35 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:28.602889 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222b596-8f82-4ac0-b8d1-9a8fd40cc62a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:28.604010 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222b596-8f82-4ac0-b8d1-9a8fd40cc62a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:28.604831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222b596-8f82-4ac0-b8d1-9a8fd40cc62a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:28.605692 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222b596-8f82-4ac0-b8d1-9a8fd40cc62a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:28.606891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222b596-8f82-4ac0-b8d1-9a8fd40cc62a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:28.609591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222b596-8f82-4ac0-b8d1-9a8fd40cc62a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:28.610529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df96950-f85f-4660-8e99-501478736030 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:28.611298 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df96950-f85f-4660-8e99-501478736030 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:28.612963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df96950-f85f-4660-8e99-501478736030 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:28.613662 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df96950-f85f-4660-8e99-501478736030 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:28.616876 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3175/6321] 10.222.0.33 () {58 vars in 1200 bytes} [Sat Aug 6 21:17:28 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:28.617071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df96950-f85f-4660-8e99-501478736030 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:28.621352 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222b596-8f82-4ac0-b8d1-9a8fd40cc62a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:28.623738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df96950-f85f-4660-8e99-501478736030 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:28.645925 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222b596-8f82-4ac0-b8d1-9a8fd40cc62a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:28.654956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30151cfd-e211-4041-a8bf-0b63b1cdb1c2 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:28.655741 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30151cfd-e211-4041-a8bf-0b63b1cdb1c2 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:28.658367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30151cfd-e211-4041-a8bf-0b63b1cdb1c2 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:28.658786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30151cfd-e211-4041-a8bf-0b63b1cdb1c2 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:28.659504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30151cfd-e211-4041-a8bf-0b63b1cdb1c2 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:28.661194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30151cfd-e211-4041-a8bf-0b63b1cdb1c2 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:28.665715 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3176/6322] 10.222.0.33 () {58 vars in 1203 bytes} [Sat Aug 6 21:17:28 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:28.669486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30151cfd-e211-4041-a8bf-0b63b1cdb1c2 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:28.704006 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30151cfd-e211-4041-a8bf-0b63b1cdb1c2 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:28.714278 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3147/6323] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:17:28 2022] POST /identity/v3/projects => generated 360 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:28.716560 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df96950-f85f-4660-8e99-501478736030 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:28.737753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:28.797599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d9d8d2-c639-4d33-91e3-aa73485b70ab tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:28.798407 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9d8d2-c639-4d33-91e3-aa73485b70ab tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:28.799362 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9d8d2-c639-4d33-91e3-aa73485b70ab tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:28.800366 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9d8d2-c639-4d33-91e3-aa73485b70ab tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:28.801230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d9d8d2-c639-4d33-91e3-aa73485b70ab tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:28.808187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d9d8d2-c639-4d33-91e3-aa73485b70ab tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:28.812190 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3177/6324] 10.222.0.33 () {58 vars in 1209 bytes} [Sat Aug 6 21:17:28 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:28.816723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d9d8d2-c639-4d33-91e3-aa73485b70ab tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:28.842819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d9d8d2-c639-4d33-91e3-aa73485b70ab tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:28.846035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df96950-f85f-4660-8e99-501478736030 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:28.854983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41097e1b-9bfb-4d4a-b8ce-8b3861c3648a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:28.855746 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41097e1b-9bfb-4d4a-b8ce-8b3861c3648a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:28.856050 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41097e1b-9bfb-4d4a-b8ce-8b3861c3648a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:28.856330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41097e1b-9bfb-4d4a-b8ce-8b3861c3648a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:28.856927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41097e1b-9bfb-4d4a-b8ce-8b3861c3648a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:28.861962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1316d-4c7c-4185-b6df-646686ae3843 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:28.862683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1316d-4c7c-4185-b6df-646686ae3843 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:28.862966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1316d-4c7c-4185-b6df-646686ae3843 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:28.863691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1316d-4c7c-4185-b6df-646686ae3843 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/projects/607cd33269274ca59a38c86c2bb30d97` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:28.864109 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41097e1b-9bfb-4d4a-b8ce-8b3861c3648a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:28.865548 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3178/6325] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:17:28 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:28.866195 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1316d-4c7c-4185-b6df-646686ae3843 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:update_project(project_id=607cd33269274ca59a38c86c2bb30d97)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:28.868274 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-d1b1316d-4c7c-4185-b6df-646686ae3843 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:17:28.868274 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:17:28.868274 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:17:28.871286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41097e1b-9bfb-4d4a-b8ce-8b3861c3648a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:28.872250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1316d-4c7c-4185-b6df-646686ae3843 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:28.897518 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41097e1b-9bfb-4d4a-b8ce-8b3861c3648a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:28.908535 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafcb442-cab7-438f-b98d-44b6f6bdd5f6 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:28.909199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafcb442-cab7-438f-b98d-44b6f6bdd5f6 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:28.909478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafcb442-cab7-438f-b98d-44b6f6bdd5f6 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:28.909749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafcb442-cab7-438f-b98d-44b6f6bdd5f6 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:28.910339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafcb442-cab7-438f-b98d-44b6f6bdd5f6 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:28.915455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafcb442-cab7-438f-b98d-44b6f6bdd5f6 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:28.916919 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3179/6326] 10.222.0.33 () {58 vars in 1218 bytes} [Sat Aug 6 21:17:28 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:28.920580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafcb442-cab7-438f-b98d-44b6f6bdd5f6 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:28.939170 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafcb442-cab7-438f-b98d-44b6f6bdd5f6 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:28.954436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df6c9b-1063-42f4-a489-80675bc8c48c tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:28.955467 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df6c9b-1063-42f4-a489-80675bc8c48c tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:28.955467 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df6c9b-1063-42f4-a489-80675bc8c48c tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:28.955691 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df6c9b-1063-42f4-a489-80675bc8c48c tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:28.956136 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df6c9b-1063-42f4-a489-80675bc8c48c tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:28.957726 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df6c9b-1063-42f4-a489-80675bc8c48c tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:28.959841 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3180/6327] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Aug 6 21:17:28 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:28.962835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df6c9b-1063-42f4-a489-80675bc8c48c tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:28.983896 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3148/6328] 10.222.0.33 () {60 vars in 1252 bytes} [Sat Aug 6 21:17:28 2022] PATCH /identity/v3/projects/607cd33269274ca59a38c86c2bb30d97 => generated 372 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:17:28.984999 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1316d-4c7c-4185-b6df-646686ae3843 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:28.993021 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df6c9b-1063-42f4-a489-80675bc8c48c tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:29.003194 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1316d-4c7c-4185-b6df-646686ae3843 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:29.005742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef773816-ab7c-46f2-9a7c-57d3f185ecce tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:29.006642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef773816-ab7c-46f2-9a7c-57d3f185ecce tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:29.007083 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef773816-ab7c-46f2-9a7c-57d3f185ecce tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:29.007604 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef773816-ab7c-46f2-9a7c-57d3f185ecce tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:29.009415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b1b24-7c55-4c28-94b3-4d8149eb4d4e tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:29.010731 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b1b24-7c55-4c28-94b3-4d8149eb4d4e tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:29.011026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef773816-ab7c-46f2-9a7c-57d3f185ecce tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:29.011180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b1b24-7c55-4c28-94b3-4d8149eb4d4e tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:29.011574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b1b24-7c55-4c28-94b3-4d8149eb4d4e tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/projects/607cd33269274ca59a38c86c2bb30d97` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:29.015625 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef773816-ab7c-46f2-9a7c-57d3f185ecce tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:29.019623 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3181/6329] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:17:28 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 06 21:17:29.020891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef773816-ab7c-46f2-9a7c-57d3f185ecce tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:29.028407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b1b24-7c55-4c28-94b3-4d8149eb4d4e tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:get_project(project_id=607cd33269274ca59a38c86c2bb30d97)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:29.030768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b1b24-7c55-4c28-94b3-4d8149eb4d4e tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:29.035711 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3149/6330] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:17:28 2022] GET /identity/v3/projects/607cd33269274ca59a38c86c2bb30d97 => generated 359 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:17:29.036867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b1b24-7c55-4c28-94b3-4d8149eb4d4e tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:29.046880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef773816-ab7c-46f2-9a7c-57d3f185ecce tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:29.052958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb146540-e3de-45c8-8948-fae87dd7320e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:29.053609 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb146540-e3de-45c8-8948-fae87dd7320e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:29.053888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb146540-e3de-45c8-8948-fae87dd7320e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:29.054161 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb146540-e3de-45c8-8948-fae87dd7320e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:29.054783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb146540-e3de-45c8-8948-fae87dd7320e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:29.055688 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b1b24-7c55-4c28-94b3-4d8149eb4d4e tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:29.056475 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb146540-e3de-45c8-8948-fae87dd7320e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:29.061354 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3182/6331] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:17:29 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 06 21:17:29.062493 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb146540-e3de-45c8-8948-fae87dd7320e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:29.073357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb146540-e3de-45c8-8948-fae87dd7320e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:29.075509 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59e63a-0874-46da-9847-b12b52f5ecb5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:29.076180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59e63a-0874-46da-9847-b12b52f5ecb5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:29.076464 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59e63a-0874-46da-9847-b12b52f5ecb5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:29.076891 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59e63a-0874-46da-9847-b12b52f5ecb5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/projects/607cd33269274ca59a38c86c2bb30d97` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:29.078107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59e63a-0874-46da-9847-b12b52f5ecb5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:delete_project(project_id=607cd33269274ca59a38c86c2bb30d97)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:29.079132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef3549-0c29-4aae-9969-c40dcd231941 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:29.080007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef3549-0c29-4aae-9969-c40dcd231941 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:29.080167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59e63a-0874-46da-9847-b12b52f5ecb5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:29.080468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef3549-0c29-4aae-9969-c40dcd231941 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:29.080835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef3549-0c29-4aae-9969-c40dcd231941 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:29.081525 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef3549-0c29-4aae-9969-c40dcd231941 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:29.083226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef3549-0c29-4aae-9969-c40dcd231941 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:29.087221 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3183/6332] 10.222.0.33 () {58 vars in 1227 bytes} [Sat Aug 6 21:17:29 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:29.091088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef3549-0c29-4aae-9969-c40dcd231941 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:29.105163 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef3549-0c29-4aae-9969-c40dcd231941 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:29.113387 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a793c-a669-4109-a852-0bf8c27b6d3d tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:29.114799 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a793c-a669-4109-a852-0bf8c27b6d3d tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:29.115308 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a793c-a669-4109-a852-0bf8c27b6d3d tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:29.115839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a793c-a669-4109-a852-0bf8c27b6d3d tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:29.116884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418a793c-a669-4109-a852-0bf8c27b6d3d tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:29.118694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418a793c-a669-4109-a852-0bf8c27b6d3d tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:29.125137 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3184/6333] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:17:29 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:29.126311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a793c-a669-4109-a852-0bf8c27b6d3d tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:29.139220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a793c-a669-4109-a852-0bf8c27b6d3d tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:29.148668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f752c3-88d2-4809-83e5-2b75a50effb4 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:29.149792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f752c3-88d2-4809-83e5-2b75a50effb4 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:29.150294 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f752c3-88d2-4809-83e5-2b75a50effb4 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:29.151117 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f752c3-88d2-4809-83e5-2b75a50effb4 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:29.152312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f752c3-88d2-4809-83e5-2b75a50effb4 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:29.154276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f752c3-88d2-4809-83e5-2b75a50effb4 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:29.160725 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3185/6334] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:17:29 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:29.162054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f752c3-88d2-4809-83e5-2b75a50effb4 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:29.179047 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0a59e63a-0874-46da-9847-b12b52f5ecb5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '607cd33269274ca59a38c86c2bb30d97', 'request_id': 'req-0a59e63a-0874-46da-9847-b12b52f5ecb5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:29.180131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f752c3-88d2-4809-83e5-2b75a50effb4 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:29.186532 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:UPDATE=1,keystone:DELETE=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:29.196081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0a59e63a-0874-46da-9847-b12b52f5ecb5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '607cd33269274ca59a38c86c2bb30d97', 'request_id': 'req-0a59e63a-0874-46da-9847-b12b52f5ecb5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:29.215177 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0a59e63a-0874-46da-9847-b12b52f5ecb5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '607cd33269274ca59a38c86c2bb30d97', 'request_id': 'req-0a59e63a-0874-46da-9847-b12b52f5ecb5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:29.247860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0a59e63a-0874-46da-9847-b12b52f5ecb5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] The token cache is being invalidate because project 607cd33269274ca59a38c86c2bb30d97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:17:29.248437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0a59e63a-0874-46da-9847-b12b52f5ecb5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:29.250593 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0a59e63a-0874-46da-9847-b12b52f5ecb5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:29.254701 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3150/6335] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:17:29 2022] DELETE /identity/v3/projects/607cd33269274ca59a38c86c2bb30d97 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:29.262779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59e63a-0874-46da-9847-b12b52f5ecb5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:29.264701 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0a59e63a-0874-46da-9847-b12b52f5ecb5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:29.295710 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960370ec-57d9-4394-ae38-127dde7f9a92 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:29.296434 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960370ec-57d9-4394-ae38-127dde7f9a92 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:29.296725 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960370ec-57d9-4394-ae38-127dde7f9a92 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:29.297004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960370ec-57d9-4394-ae38-127dde7f9a92 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:29.297607 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960370ec-57d9-4394-ae38-127dde7f9a92 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:29.300102 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960370ec-57d9-4394-ae38-127dde7f9a92 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:29.301176 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3186/6336] 10.222.0.33 () {58 vars in 1242 bytes} [Sat Aug 6 21:17:29 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:29.305895 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960370ec-57d9-4394-ae38-127dde7f9a92 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:29.308583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-960370ec-57d9-4394-ae38-127dde7f9a92 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:29.324040 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960370ec-57d9-4394-ae38-127dde7f9a92 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:29.331144 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb86da72-8870-44de-8f01-f541cba6a005 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:29.331804 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb86da72-8870-44de-8f01-f541cba6a005 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:29.332093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb86da72-8870-44de-8f01-f541cba6a005 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:29.332375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb86da72-8870-44de-8f01-f541cba6a005 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:29.332976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb86da72-8870-44de-8f01-f541cba6a005 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:29.334684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb86da72-8870-44de-8f01-f541cba6a005 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:29.336004 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3187/6337] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Aug 6 21:17:29 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 06 21:17:29.341468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb86da72-8870-44de-8f01-f541cba6a005 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:29.353143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb86da72-8870-44de-8f01-f541cba6a005 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:29.358562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f9d21-e082-428d-826b-be3ecd8ffe42 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:29.359234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f9d21-e082-428d-826b-be3ecd8ffe42 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:29.359522 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f9d21-e082-428d-826b-be3ecd8ffe42 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:29.359801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f9d21-e082-428d-826b-be3ecd8ffe42 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:29.360397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f9d21-e082-428d-826b-be3ecd8ffe42 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:29.362233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f9d21-e082-428d-826b-be3ecd8ffe42 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:29.366779 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3188/6338] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Aug 6 21:17:29 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:29.367646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f9d21-e082-428d-826b-be3ecd8ffe42 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:29.378288 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59e63a-0874-46da-9847-b12b52f5ecb5 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:29.380797 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f9d21-e082-428d-826b-be3ecd8ffe42 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:29.383905 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0774f05-a514-4ebb-85eb-32a43cbd0dfe tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:29.385921 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0774f05-a514-4ebb-85eb-32a43cbd0dfe tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:29.386354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0774f05-a514-4ebb-85eb-32a43cbd0dfe tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:29.386697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0830c4-e374-462b-888d-776f04a03b5e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:29.386842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0774f05-a514-4ebb-85eb-32a43cbd0dfe tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:29.387485 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0830c4-e374-462b-888d-776f04a03b5e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:29.387675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0774f05-a514-4ebb-85eb-32a43cbd0dfe tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:29.387806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0830c4-e374-462b-888d-776f04a03b5e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:29.388044 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0830c4-e374-462b-888d-776f04a03b5e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:29.388653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0830c4-e374-462b-888d-776f04a03b5e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:29.390250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0830c4-e374-462b-888d-776f04a03b5e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:29.391002 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0774f05-a514-4ebb-85eb-32a43cbd0dfe tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:29.395184 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3189/6339] 10.222.0.33 () {58 vars in 1269 bytes} [Sat Aug 6 21:17:29 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:29.396365 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0830c4-e374-462b-888d-776f04a03b5e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:29.408232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0830c4-e374-462b-888d-776f04a03b5e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:29.413739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349e293-cda4-4fa9-b85d-e1ff14d95765 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:29.415006 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349e293-cda4-4fa9-b85d-e1ff14d95765 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:29.415501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349e293-cda4-4fa9-b85d-e1ff14d95765 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:29.415838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349e293-cda4-4fa9-b85d-e1ff14d95765 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:29.416504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3349e293-cda4-4fa9-b85d-e1ff14d95765 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:29.419573 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3349e293-cda4-4fa9-b85d-e1ff14d95765 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:29.424771 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3190/6340] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Aug 6 21:17:29 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:29.425830 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349e293-cda4-4fa9-b85d-e1ff14d95765 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:29.437829 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349e293-cda4-4fa9-b85d-e1ff14d95765 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:29.443513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee912ba-1f6b-4904-acee-f86124112ec5 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:29.444271 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee912ba-1f6b-4904-acee-f86124112ec5 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:29.444647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee912ba-1f6b-4904-acee-f86124112ec5 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:29.445121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee912ba-1f6b-4904-acee-f86124112ec5 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:29.445813 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee912ba-1f6b-4904-acee-f86124112ec5 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:29.447549 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee912ba-1f6b-4904-acee-f86124112ec5 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:29.452715 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3191/6341] 10.222.0.33 () {58 vars in 1257 bytes} [Sat Aug 6 21:17:29 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:29.453709 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee912ba-1f6b-4904-acee-f86124112ec5 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:29.468189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee912ba-1f6b-4904-acee-f86124112ec5 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:29.475006 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3151/6342] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:17:29 2022] POST /identity/v3/projects => generated 354 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:29.485230 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0774f05-a514-4ebb-85eb-32a43cbd0dfe tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:29.539330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c5a62-84b9-4f60-981c-cad858379b01 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:29.540102 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c5a62-84b9-4f60-981c-cad858379b01 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:29.540443 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c5a62-84b9-4f60-981c-cad858379b01 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:29.540806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c5a62-84b9-4f60-981c-cad858379b01 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:29.542276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c5a62-84b9-4f60-981c-cad858379b01 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:29.544595 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c5a62-84b9-4f60-981c-cad858379b01 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:29.550656 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3192/6343] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Aug 6 21:17:29 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:29.551672 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c5a62-84b9-4f60-981c-cad858379b01 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:29.567274 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c5a62-84b9-4f60-981c-cad858379b01 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:29.573759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0774f05-a514-4ebb-85eb-32a43cbd0dfe tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:29.574537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051b9e5-c926-4960-bd7f-421bbf810c87 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:29.575250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051b9e5-c926-4960-bd7f-421bbf810c87 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:29.575609 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051b9e5-c926-4960-bd7f-421bbf810c87 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:29.575894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051b9e5-c926-4960-bd7f-421bbf810c87 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:29.576585 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a051b9e5-c926-4960-bd7f-421bbf810c87 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:29.578407 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a051b9e5-c926-4960-bd7f-421bbf810c87 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:29.582208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c239dd-d862-45d7-ab61-01ab92c07066 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:29.583019 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3193/6344] 10.222.0.33 () {58 vars in 1242 bytes} [Sat Aug 6 21:17:29 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:29.583759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c239dd-d862-45d7-ab61-01ab92c07066 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:29.584142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c239dd-d862-45d7-ab61-01ab92c07066 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:29.584512 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c239dd-d862-45d7-ab61-01ab92c07066 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/projects/fe1a78f672ae456da094fec2d9e34062` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:29.584650 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051b9e5-c926-4960-bd7f-421bbf810c87 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:29.586913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c239dd-d862-45d7-ab61-01ab92c07066 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:update_project(project_id=fe1a78f672ae456da094fec2d9e34062)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:29.594386 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c239dd-d862-45d7-ab61-01ab92c07066 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:29.613532 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051b9e5-c926-4960-bd7f-421bbf810c87 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:29.628353 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cc1f8-9510-4e9f-ae3a-0d1db7300149 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:29.629499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cc1f8-9510-4e9f-ae3a-0d1db7300149 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:29.629789 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cc1f8-9510-4e9f-ae3a-0d1db7300149 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:29.630069 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cc1f8-9510-4e9f-ae3a-0d1db7300149 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:29.631161 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44cc1f8-9510-4e9f-ae3a-0d1db7300149 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:29.632352 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44cc1f8-9510-4e9f-ae3a-0d1db7300149 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:29.643203 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3194/6345] 10.222.0.33 () {58 vars in 1251 bytes} [Sat Aug 6 21:17:29 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:29.645574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cc1f8-9510-4e9f-ae3a-0d1db7300149 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:29.653998 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:29.681571 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cc1f8-9510-4e9f-ae3a-0d1db7300149 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:29.699400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96b78a-0cb5-4443-8322-f7502ebba984 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:29.706432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96b78a-0cb5-4443-8322-f7502ebba984 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:29.706856 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96b78a-0cb5-4443-8322-f7502ebba984 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:29.707157 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96b78a-0cb5-4443-8322-f7502ebba984 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:29.709975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96b78a-0cb5-4443-8322-f7502ebba984 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:29.713476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96b78a-0cb5-4443-8322-f7502ebba984 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:29.716572 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3195/6346] 10.222.0.33 () {58 vars in 1254 bytes} [Sat Aug 6 21:17:29 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:29.722414 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96b78a-0cb5-4443-8322-f7502ebba984 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:29.733622 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3152/6347] 10.222.0.33 () {60 vars in 1252 bytes} [Sat Aug 6 21:17:29 2022] PATCH /identity/v3/projects/fe1a78f672ae456da094fec2d9e34062 => generated 368 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:17:29.739873 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c239dd-d862-45d7-ab61-01ab92c07066 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:29.755415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96b78a-0cb5-4443-8322-f7502ebba984 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:29.765285 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c239dd-d862-45d7-ab61-01ab92c07066 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:29.769080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0f0d9-c3a8-4152-88fa-a1b44a6077b9 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:29.770622 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0f0d9-c3a8-4152-88fa-a1b44a6077b9 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:29.771847 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0f0d9-c3a8-4152-88fa-a1b44a6077b9 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:29.772269 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92b59f-4f73-4685-b329-9d87bab73610 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:29.772925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92b59f-4f73-4685-b329-9d87bab73610 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:29.773268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92b59f-4f73-4685-b329-9d87bab73610 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:29.773909 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92b59f-4f73-4685-b329-9d87bab73610 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/projects/fe1a78f672ae456da094fec2d9e34062` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:29.788819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0f0d9-c3a8-4152-88fa-a1b44a6077b9 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:29.790520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0f0d9-c3a8-4152-88fa-a1b44a6077b9 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:29.792723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0f0d9-c3a8-4152-88fa-a1b44a6077b9 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:29.801237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92b59f-4f73-4685-b329-9d87bab73610 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:get_project(project_id=fe1a78f672ae456da094fec2d9e34062)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:29.809168 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92b59f-4f73-4685-b329-9d87bab73610 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:29.810170 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3196/6348] 10.222.0.33 () {58 vars in 1290 bytes} [Sat Aug 6 21:17:29 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:29.813903 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3153/6349] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:17:29 2022] GET /identity/v3/projects/fe1a78f672ae456da094fec2d9e34062 => generated 355 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:17:29.817418 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0f0d9-c3a8-4152-88fa-a1b44a6077b9 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:29.818686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92b59f-4f73-4685-b329-9d87bab73610 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:29.833120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0f0d9-c3a8-4152-88fa-a1b44a6077b9 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:29.846820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f6d81-026b-49d5-bcbb-b8af722fa08f tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:29.847581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92b59f-4f73-4685-b329-9d87bab73610 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:29.847743 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f6d81-026b-49d5-bcbb-b8af722fa08f tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:29.847914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f6d81-026b-49d5-bcbb-b8af722fa08f tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:29.848201 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f6d81-026b-49d5-bcbb-b8af722fa08f tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:29.848801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f6d81-026b-49d5-bcbb-b8af722fa08f tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:29.852258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f6d81-026b-49d5-bcbb-b8af722fa08f tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:29.854433 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3197/6350] 10.222.0.33 () {58 vars in 1257 bytes} [Sat Aug 6 21:17:29 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:29.858678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f6d81-026b-49d5-bcbb-b8af722fa08f tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:29.860387 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f0fb2-7b89-4f1c-adf2-3c97c1144b75 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:29.863179 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f0fb2-7b89-4f1c-adf2-3c97c1144b75 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:29.863675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f0fb2-7b89-4f1c-adf2-3c97c1144b75 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:29.866417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f0fb2-7b89-4f1c-adf2-3c97c1144b75 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/projects/fe1a78f672ae456da094fec2d9e34062` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:29.871220 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f0fb2-7b89-4f1c-adf2-3c97c1144b75 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fe1a78f672ae456da094fec2d9e34062)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:29.877691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f0fb2-7b89-4f1c-adf2-3c97c1144b75 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:29.883398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f6d81-026b-49d5-bcbb-b8af722fa08f tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:29.895774 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ac869-1392-43a4-8c4c-617682dbdbfc tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:29.899212 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ac869-1392-43a4-8c4c-617682dbdbfc tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:29.899588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ac869-1392-43a4-8c4c-617682dbdbfc tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:29.899946 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ac869-1392-43a4-8c4c-617682dbdbfc tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:29.900859 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ac869-1392-43a4-8c4c-617682dbdbfc tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:29.905892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ac869-1392-43a4-8c4c-617682dbdbfc tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:29.908941 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3198/6351] 10.222.0.33 () {58 vars in 1266 bytes} [Sat Aug 6 21:17:29 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:29.911618 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ac869-1392-43a4-8c4c-617682dbdbfc tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:29.935918 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ac869-1392-43a4-8c4c-617682dbdbfc tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:29.949822 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d59c64a-8aca-4d5d-807f-e28edf261c78 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:29.950485 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59c64a-8aca-4d5d-807f-e28edf261c78 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:29.950835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59c64a-8aca-4d5d-807f-e28edf261c78 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:29.951288 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59c64a-8aca-4d5d-807f-e28edf261c78 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:29.951993 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d59c64a-8aca-4d5d-807f-e28edf261c78 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:29.953753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d59c64a-8aca-4d5d-807f-e28edf261c78 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:29.955381 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3199/6352] 10.222.0.33 () {58 vars in 1308 bytes} [Sat Aug 6 21:17:29 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:29.959558 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d59c64a-8aca-4d5d-807f-e28edf261c78 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:29.962823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:29.973815 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d59c64a-8aca-4d5d-807f-e28edf261c78 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:30.029457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2d5f0fb2-7b89-4f1c-adf2-3c97c1144b75 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe1a78f672ae456da094fec2d9e34062', 'request_id': 'req-2d5f0fb2-7b89-4f1c-adf2-3c97c1144b75'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:30.039011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2d5f0fb2-7b89-4f1c-adf2-3c97c1144b75 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe1a78f672ae456da094fec2d9e34062', 'request_id': 'req-2d5f0fb2-7b89-4f1c-adf2-3c97c1144b75'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:30.049430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2d5f0fb2-7b89-4f1c-adf2-3c97c1144b75 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe1a78f672ae456da094fec2d9e34062', 'request_id': 'req-2d5f0fb2-7b89-4f1c-adf2-3c97c1144b75'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:30.072157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2d5f0fb2-7b89-4f1c-adf2-3c97c1144b75 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] The token cache is being invalidate because project fe1a78f672ae456da094fec2d9e34062 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:17:30.072784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2d5f0fb2-7b89-4f1c-adf2-3c97c1144b75 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:30.074166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2d5f0fb2-7b89-4f1c-adf2-3c97c1144b75 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:30.081014 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3154/6353] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:17:29 2022] DELETE /identity/v3/projects/fe1a78f672ae456da094fec2d9e34062 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:30.082626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f0fb2-7b89-4f1c-adf2-3c97c1144b75 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:30.085824 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2d5f0fb2-7b89-4f1c-adf2-3c97c1144b75 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:30.106491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7511fa-3cff-4406-a5bc-4c6badf81250 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:30.107529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7511fa-3cff-4406-a5bc-4c6badf81250 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:30.108021 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7511fa-3cff-4406-a5bc-4c6badf81250 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:30.108487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7511fa-3cff-4406-a5bc-4c6badf81250 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:30.109389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7511fa-3cff-4406-a5bc-4c6badf81250 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:30.111869 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7511fa-3cff-4406-a5bc-4c6badf81250 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:30.113701 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3200/6354] 10.222.0.33 () {58 vars in 1290 bytes} [Sat Aug 6 21:17:29 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 06 21:17:30.117908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7511fa-3cff-4406-a5bc-4c6badf81250 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:30.121291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9f7511fa-3cff-4406-a5bc-4c6badf81250 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:30.148729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7511fa-3cff-4406-a5bc-4c6badf81250 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:30.162128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc40efe-4979-4fd1-8707-980e7255aa70 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:30.163027 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc40efe-4979-4fd1-8707-980e7255aa70 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:30.163874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc40efe-4979-4fd1-8707-980e7255aa70 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:30.164263 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc40efe-4979-4fd1-8707-980e7255aa70 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:30.167697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc40efe-4979-4fd1-8707-980e7255aa70 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:30.171443 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc40efe-4979-4fd1-8707-980e7255aa70 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:30.175652 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3201/6355] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:17:30 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:30.179700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc40efe-4979-4fd1-8707-980e7255aa70 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:30.191402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f0fb2-7b89-4f1c-adf2-3c97c1144b75 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:30.196977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56492b-a528-4b0c-808b-3154a8903452 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:30.198892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56492b-a528-4b0c-808b-3154a8903452 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:30.199287 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56492b-a528-4b0c-808b-3154a8903452 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:30.199741 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56492b-a528-4b0c-808b-3154a8903452 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/domains/030fcc583d434621816bbd8272442e30` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:30.201377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc40efe-4979-4fd1-8707-980e7255aa70 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:30.208879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a56492b-a528-4b0c-808b-3154a8903452 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 21:17:30.216630 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-3a56492b-a528-4b0c-808b-3154a8903452 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Could not find domain: 030fcc583d434621816bbd8272442e30.: keystone.exception.DomainNotFound: Could not find domain: 030fcc583d434621816bbd8272442e30. Aug 06 21:17:30.216630 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:17:30.216630 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 06 21:17:30.216630 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 06 21:17:30.216630 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 21:17:30.216630 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 21:17:30.216630 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 21:17:30.216630 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 21:17:30.216630 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 030fcc583d434621816bbd8272442e30. Aug 06 21:17:30.216630 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:17:30.216630 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 21:17:30.216630 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:17:30.216630 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:17:30.216630 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:17:30.216630 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:17:30.216630 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:17:30.218144 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:17:30.218144 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:17:30.218144 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:17:30.218144 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:17:30.218144 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:17:30.218144 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:17:30.218144 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:17:30.218144 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 06 21:17:30.218144 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 06 21:17:30.218144 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 21:17:30.218144 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 21:17:30.218144 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 21:17:30.218144 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 21:17:30.218144 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:17:30.218144 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:17:30.218144 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 21:17:30.219469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 21:17:30.219469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 21:17:30.219469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 21:17:30.219469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 21:17:30.219469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 21:17:30.219469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 21:17:30.219469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 21:17:30.219469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 21:17:30.219469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 21:17:30.219469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 21:17:30.219469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 21:17:30.219469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 21:17:30.219469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 21:17:30.219469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 06 21:17:30.219469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 21:17:30.219469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 030fcc583d434621816bbd8272442e30. Aug 06 21:17:30.219469 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:17:30.224600 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3155/6356] 10.222.0.33 () {60 vars in 1249 bytes} [Sat Aug 6 21:17:30 2022] PATCH /identity/v3/domains/030fcc583d434621816bbd8272442e30 => generated 112 bytes in 140 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:17:30.227598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56492b-a528-4b0c-808b-3154a8903452 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:30.231305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8df875-d90b-4000-834f-c52e3c13ee3c tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:30.232857 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8df875-d90b-4000-834f-c52e3c13ee3c tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:30.233247 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8df875-d90b-4000-834f-c52e3c13ee3c tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:30.233630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8df875-d90b-4000-834f-c52e3c13ee3c tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:30.234338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8df875-d90b-4000-834f-c52e3c13ee3c tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:30.236808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8df875-d90b-4000-834f-c52e3c13ee3c tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:30.237863 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3202/6357] 10.222.0.33 () {58 vars in 1227 bytes} [Sat Aug 6 21:17:30 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:30.246079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8df875-d90b-4000-834f-c52e3c13ee3c tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:30.246927 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56492b-a528-4b0c-808b-3154a8903452 tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:30.251962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6186b156-fb74-4d8a-926d-93e886311a1a tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '199690c2ec624f138cb5b23aa7fd3b3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a4dd8349714403ba5fbae26633c5054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:30.253033 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186b156-fb74-4d8a-926d-93e886311a1a tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:30.253324 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186b156-fb74-4d8a-926d-93e886311a1a tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:30.254920 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186b156-fb74-4d8a-926d-93e886311a1a tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] PATH_INFO: `/v3/domains/ceaa33ed310e4e49aa6c8ba7e048b3e5` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:30.262862 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6186b156-fb74-4d8a-926d-93e886311a1a tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 21:17:30.268330 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-6186b156-fb74-4d8a-926d-93e886311a1a tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Could not find domain: ceaa33ed310e4e49aa6c8ba7e048b3e5.: keystone.exception.DomainNotFound: Could not find domain: ceaa33ed310e4e49aa6c8ba7e048b3e5. Aug 06 21:17:30.268330 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:17:30.268330 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 06 21:17:30.268330 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 06 21:17:30.268330 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 21:17:30.268330 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 21:17:30.268330 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 21:17:30.268330 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 21:17:30.268330 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: ceaa33ed310e4e49aa6c8ba7e048b3e5. Aug 06 21:17:30.268330 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:17:30.268330 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 21:17:30.268330 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:17:30.268330 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:17:30.268330 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:17:30.268330 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:17:30.268330 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:17:30.269683 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:17:30.269683 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:17:30.269683 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:17:30.269683 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:17:30.269683 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:17:30.269683 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:17:30.269683 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:17:30.269683 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 06 21:17:30.269683 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 06 21:17:30.269683 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 21:17:30.269683 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 21:17:30.269683 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 21:17:30.269683 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 21:17:30.269683 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:17:30.269683 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:17:30.269683 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 21:17:30.270993 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 21:17:30.270993 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 21:17:30.270993 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 21:17:30.270993 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 21:17:30.270993 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 21:17:30.270993 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 21:17:30.270993 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 21:17:30.270993 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 21:17:30.270993 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 21:17:30.270993 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 21:17:30.270993 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 21:17:30.270993 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 21:17:30.270993 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 21:17:30.270993 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 06 21:17:30.270993 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 21:17:30.270993 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: ceaa33ed310e4e49aa6c8ba7e048b3e5. Aug 06 21:17:30.270993 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:17:30.272962 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3156/6358] 10.222.0.33 () {60 vars in 1249 bytes} [Sat Aug 6 21:17:30 2022] PATCH /identity/v3/domains/ceaa33ed310e4e49aa6c8ba7e048b3e5 => generated 112 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:17:30.274199 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6186b156-fb74-4d8a-926d-93e886311a1a tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:30.276476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6186b156-fb74-4d8a-926d-93e886311a1a tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:30.294307 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8df875-d90b-4000-834f-c52e3c13ee3c tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:30.305736 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d0053-abcd-4b7c-ac3b-0f6d3f6dc1f3 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:30.306437 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d0053-abcd-4b7c-ac3b-0f6d3f6dc1f3 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:30.306713 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d0053-abcd-4b7c-ac3b-0f6d3f6dc1f3 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:30.307720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d0053-abcd-4b7c-ac3b-0f6d3f6dc1f3 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:30.308371 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692d0053-abcd-4b7c-ac3b-0f6d3f6dc1f3 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:30.309964 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692d0053-abcd-4b7c-ac3b-0f6d3f6dc1f3 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:30.323768 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3203/6359] 10.222.0.33 () {58 vars in 1242 bytes} [Sat Aug 6 21:17:30 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:30.327985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d0053-abcd-4b7c-ac3b-0f6d3f6dc1f3 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:30.341175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d0053-abcd-4b7c-ac3b-0f6d3f6dc1f3 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:30.355728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8930e-7ad8-44e6-be39-c39a464d16a1 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:30.356490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8930e-7ad8-44e6-be39-c39a464d16a1 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:30.356842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8930e-7ad8-44e6-be39-c39a464d16a1 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:30.357212 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8930e-7ad8-44e6-be39-c39a464d16a1 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:30.357895 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8930e-7ad8-44e6-be39-c39a464d16a1 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:30.359700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8930e-7ad8-44e6-be39-c39a464d16a1 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:30.366773 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3204/6360] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:17:30 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 06 21:17:30.366773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8930e-7ad8-44e6-be39-c39a464d16a1 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:30.388984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8930e-7ad8-44e6-be39-c39a464d16a1 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:30.396211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6d214-dc79-458a-9572-83a11810a0c6 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:30.397146 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6d214-dc79-458a-9572-83a11810a0c6 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:30.397629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6d214-dc79-458a-9572-83a11810a0c6 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:30.398101 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6d214-dc79-458a-9572-83a11810a0c6 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:30.399566 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6d214-dc79-458a-9572-83a11810a0c6 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:30.403409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6d214-dc79-458a-9572-83a11810a0c6 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:30.405833 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3205/6361] 10.222.0.33 () {58 vars in 1251 bytes} [Sat Aug 6 21:17:30 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:30.409361 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6186b156-fb74-4d8a-926d-93e886311a1a tempest-ProjectsTestJSON-414293321 tempest-ProjectsTestJSON-414293321-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:30.410611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6d214-dc79-458a-9572-83a11810a0c6 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:30.419476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3fc9a-bbaf-47d2-b2c7-c18a4bdd4213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:30.420964 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3fc9a-bbaf-47d2-b2c7-c18a4bdd4213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:30.421454 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3fc9a-bbaf-47d2-b2c7-c18a4bdd4213 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:30.421946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3fc9a-bbaf-47d2-b2c7-c18a4bdd4213 admin admin] PATH_INFO: `/v3/users/bdaf427f152e4277baa20d02c38fd067` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:30.423159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6d214-dc79-458a-9572-83a11810a0c6 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:30.423579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3fc9a-bbaf-47d2-b2c7-c18a4bdd4213 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdaf427f152e4277baa20d02c38fd067)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:30.426471 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3fc9a-bbaf-47d2-b2c7-c18a4bdd4213 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:30.429254 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afe93e-5f9c-4e4b-8408-09030a46f15f tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:30.430479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afe93e-5f9c-4e4b-8408-09030a46f15f tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:30.430892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afe93e-5f9c-4e4b-8408-09030a46f15f tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:30.431272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afe93e-5f9c-4e4b-8408-09030a46f15f tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:30.432173 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75afe93e-5f9c-4e4b-8408-09030a46f15f tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:30.439890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75afe93e-5f9c-4e4b-8408-09030a46f15f tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:30.444095 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3206/6362] 10.222.0.33 () {58 vars in 1254 bytes} [Sat Aug 6 21:17:30 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:30.445199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afe93e-5f9c-4e4b-8408-09030a46f15f tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:30.466176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afe93e-5f9c-4e4b-8408-09030a46f15f tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:30.493704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f4e97-03ae-4d80-a9bc-e4c631b1080a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:30.495433 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f4e97-03ae-4d80-a9bc-e4c631b1080a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:30.495905 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f4e97-03ae-4d80-a9bc-e4c631b1080a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:30.496338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f4e97-03ae-4d80-a9bc-e4c631b1080a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:30.497210 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f4e97-03ae-4d80-a9bc-e4c631b1080a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:30.499518 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f4e97-03ae-4d80-a9bc-e4c631b1080a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:30.502669 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3207/6363] 10.222.0.33 () {58 vars in 1257 bytes} [Sat Aug 6 21:17:30 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:30.505955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f4e97-03ae-4d80-a9bc-e4c631b1080a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:30.518092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f4e97-03ae-4d80-a9bc-e4c631b1080a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:30.523305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c6e36-6bae-432f-afa5-a8d5de01c0d9 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:30.524395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c6e36-6bae-432f-afa5-a8d5de01c0d9 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:30.524618 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c6e36-6bae-432f-afa5-a8d5de01c0d9 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:30.524902 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c6e36-6bae-432f-afa5-a8d5de01c0d9 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:30.526052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c6e36-6bae-432f-afa5-a8d5de01c0d9 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:30.528272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c6e36-6bae-432f-afa5-a8d5de01c0d9 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:30.529493 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3208/6364] 10.222.0.33 () {58 vars in 1251 bytes} [Sat Aug 6 21:17:30 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:30.533863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c6e36-6bae-432f-afa5-a8d5de01c0d9 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:30.542988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:30.545698 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-edf3fc9a-bbaf-47d2-b2c7-c18a4bdd4213 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdaf427f152e4277baa20d02c38fd067'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:30.547709 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-edf3fc9a-bbaf-47d2-b2c7-c18a4bdd4213 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdaf427f152e4277baa20d02c38fd067'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:30.548006 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c6e36-6bae-432f-afa5-a8d5de01c0d9 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:30.549672 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-edf3fc9a-bbaf-47d2-b2c7-c18a4bdd4213 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdaf427f152e4277baa20d02c38fd067'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:30.555122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade5111-7831-4256-b87c-490e2deb2744 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:30.556323 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade5111-7831-4256-b87c-490e2deb2744 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:30.556856 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade5111-7831-4256-b87c-490e2deb2744 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:30.557976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade5111-7831-4256-b87c-490e2deb2744 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:30.559018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade5111-7831-4256-b87c-490e2deb2744 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:30.561517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade5111-7831-4256-b87c-490e2deb2744 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:30.564861 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-edf3fc9a-bbaf-47d2-b2c7-c18a4bdd4213 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdaf427f152e4277baa20d02c38fd067'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:30.568078 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3209/6365] 10.222.0.33 () {58 vars in 1257 bytes} [Sat Aug 6 21:17:30 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:30.569396 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade5111-7831-4256-b87c-490e2deb2744 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:30.571406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-dade5111-7831-4256-b87c-490e2deb2744 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:30.591383 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade5111-7831-4256-b87c-490e2deb2744 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:30.597836 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39372a00-7120-4f8d-af40-d120e1c7d782 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:30.599575 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39372a00-7120-4f8d-af40-d120e1c7d782 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:30.600098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39372a00-7120-4f8d-af40-d120e1c7d782 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:30.600492 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39372a00-7120-4f8d-af40-d120e1c7d782 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:30.600980 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-edf3fc9a-bbaf-47d2-b2c7-c18a4bdd4213 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdaf427f152e4277baa20d02c38fd067'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:30.601337 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39372a00-7120-4f8d-af40-d120e1c7d782 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:30.604957 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39372a00-7120-4f8d-af40-d120e1c7d782 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:30.606851 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3210/6366] 10.222.0.33 () {58 vars in 1293 bytes} [Sat Aug 6 21:17:30 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:30.611425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39372a00-7120-4f8d-af40-d120e1c7d782 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:30.620479 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3157/6367] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:17:30 2022] DELETE /identity/v3/users/bdaf427f152e4277baa20d02c38fd067 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:30.624729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39372a00-7120-4f8d-af40-d120e1c7d782 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:30.625627 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f28327-fa95-480a-a37d-4d4070f12eb1 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:30.625938 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f28327-fa95-480a-a37d-4d4070f12eb1 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:30.626201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f28327-fa95-480a-a37d-4d4070f12eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:30.651186 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-07f28327-fa95-480a-a37d-4d4070f12eb1 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:30.652571 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-07f28327-fa95-480a-a37d-4d4070f12eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:30.716439 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e873668-2048-44ff-abe6-bd51b0874c1a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:30.717731 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e873668-2048-44ff-abe6-bd51b0874c1a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:30.718238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e873668-2048-44ff-abe6-bd51b0874c1a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:30.718835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e873668-2048-44ff-abe6-bd51b0874c1a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:30.720053 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e873668-2048-44ff-abe6-bd51b0874c1a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:30.721920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e873668-2048-44ff-abe6-bd51b0874c1a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:30.727094 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3211/6368] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:17:30 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:30.728074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e873668-2048-44ff-abe6-bd51b0874c1a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:30.745140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e873668-2048-44ff-abe6-bd51b0874c1a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:30.753406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f09bb-c828-4cac-ac2e-a8f4fa25a59e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:30.754479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f09bb-c828-4cac-ac2e-a8f4fa25a59e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:30.754621 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f09bb-c828-4cac-ac2e-a8f4fa25a59e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:30.754861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f09bb-c828-4cac-ac2e-a8f4fa25a59e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:30.756128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f09bb-c828-4cac-ac2e-a8f4fa25a59e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:30.758436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f09bb-c828-4cac-ac2e-a8f4fa25a59e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:30.766651 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3212/6369] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:17:30 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:30.770136 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f09bb-c828-4cac-ac2e-a8f4fa25a59e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:30.775348 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3158/6370] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:30.786244 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f09bb-c828-4cac-ac2e-a8f4fa25a59e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:30.792547 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f28327-fa95-480a-a37d-4d4070f12eb1 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:30.797813 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea5742-4722-4cbd-8b40-20c1d25f0f37 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:30.798633 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea5742-4722-4cbd-8b40-20c1d25f0f37 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:30.799350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea5742-4722-4cbd-8b40-20c1d25f0f37 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:30.799484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-07f28327-fa95-480a-a37d-4d4070f12eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:30.799654 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea5742-4722-4cbd-8b40-20c1d25f0f37 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:30.800251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea5742-4722-4cbd-8b40-20c1d25f0f37 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:30.803331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea5742-4722-4cbd-8b40-20c1d25f0f37 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:30.804602 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3213/6371] 10.222.0.33 () {58 vars in 1212 bytes} [Sat Aug 6 21:17:30 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:30.810690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea5742-4722-4cbd-8b40-20c1d25f0f37 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:30.827601 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea5742-4722-4cbd-8b40-20c1d25f0f37 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:30.834591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b92b09-7ac8-49f3-8a2f-9464b577c4d9 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:30.835558 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b92b09-7ac8-49f3-8a2f-9464b577c4d9 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:30.835558 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b92b09-7ac8-49f3-8a2f-9464b577c4d9 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:30.835788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b92b09-7ac8-49f3-8a2f-9464b577c4d9 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:30.836736 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b92b09-7ac8-49f3-8a2f-9464b577c4d9 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:30.839060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b92b09-7ac8-49f3-8a2f-9464b577c4d9 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:30.843101 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3214/6372] 10.222.0.33 () {58 vars in 1227 bytes} [Sat Aug 6 21:17:30 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:30.845878 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b92b09-7ac8-49f3-8a2f-9464b577c4d9 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:30.857555 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b92b09-7ac8-49f3-8a2f-9464b577c4d9 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:30.864524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f34efb-8c7e-48d7-b151-445638d3ad1a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:30.865460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f34efb-8c7e-48d7-b151-445638d3ad1a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:30.865827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f34efb-8c7e-48d7-b151-445638d3ad1a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:30.866248 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f34efb-8c7e-48d7-b151-445638d3ad1a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:30.867008 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f34efb-8c7e-48d7-b151-445638d3ad1a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:30.868771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f34efb-8c7e-48d7-b151-445638d3ad1a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:30.873636 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3215/6373] 10.222.0.33 () {58 vars in 1215 bytes} [Sat Aug 6 21:17:30 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:30.874968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f34efb-8c7e-48d7-b151-445638d3ad1a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:30.890080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f34efb-8c7e-48d7-b151-445638d3ad1a tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:30.896590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b852821-64e3-477d-81bd-fc509f0bea5b tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:30.897488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b852821-64e3-477d-81bd-fc509f0bea5b tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:30.897833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b852821-64e3-477d-81bd-fc509f0bea5b tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:30.898195 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b852821-64e3-477d-81bd-fc509f0bea5b tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:30.898907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b852821-64e3-477d-81bd-fc509f0bea5b tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:30.900684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b852821-64e3-477d-81bd-fc509f0bea5b tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:30.904988 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3216/6374] 10.222.0.33 () {58 vars in 1218 bytes} [Sat Aug 6 21:17:30 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:30.906733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b852821-64e3-477d-81bd-fc509f0bea5b tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:30.924393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b852821-64e3-477d-81bd-fc509f0bea5b tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:30.931417 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7140eb-0b20-4ee4-b8a6-1aa3a5376ee8 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:30.933527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7140eb-0b20-4ee4-b8a6-1aa3a5376ee8 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:30.934103 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7140eb-0b20-4ee4-b8a6-1aa3a5376ee8 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:30.934446 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7140eb-0b20-4ee4-b8a6-1aa3a5376ee8 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:30.935412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7140eb-0b20-4ee4-b8a6-1aa3a5376ee8 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:30.937248 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7140eb-0b20-4ee4-b8a6-1aa3a5376ee8 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:30.941549 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3217/6375] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:17:30 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:30.943372 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7140eb-0b20-4ee4-b8a6-1aa3a5376ee8 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:30.956350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7140eb-0b20-4ee4-b8a6-1aa3a5376ee8 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:30.962896 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f28327-fa95-480a-a37d-4d4070f12eb1 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:30.964432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c8ca2-6522-4521-8ee0-1eab3c4bbe61 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:30.966008 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c8ca2-6522-4521-8ee0-1eab3c4bbe61 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:30.966008 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c8ca2-6522-4521-8ee0-1eab3c4bbe61 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:30.967914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c8ca2-6522-4521-8ee0-1eab3c4bbe61 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:30.969280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c8ca2-6522-4521-8ee0-1eab3c4bbe61 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:30.969820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0882f8-66ce-4b47-a625-312aca5768ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:30.970882 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0882f8-66ce-4b47-a625-312aca5768ae service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:30.971170 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0882f8-66ce-4b47-a625-312aca5768ae service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:30.971451 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0882f8-66ce-4b47-a625-312aca5768ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:30.974759 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c8ca2-6522-4521-8ee0-1eab3c4bbe61 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:30.981045 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3218/6376] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:17:30 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:30.982269 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c8ca2-6522-4521-8ee0-1eab3c4bbe61 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:30.989185 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0882f8-66ce-4b47-a625-312aca5768ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:30.991677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0882f8-66ce-4b47-a625-312aca5768ae service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:31.005812 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c8ca2-6522-4521-8ee0-1eab3c4bbe61 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:31.017887 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3159/6377] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:17:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:17:31.019980 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367d632-e3ed-42a9-81f4-b947ccf06501 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:31.020726 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367d632-e3ed-42a9-81f4-b947ccf06501 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:31.021069 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367d632-e3ed-42a9-81f4-b947ccf06501 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:31.021354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367d632-e3ed-42a9-81f4-b947ccf06501 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:31.021999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367d632-e3ed-42a9-81f4-b947ccf06501 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:31.025779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367d632-e3ed-42a9-81f4-b947ccf06501 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:31.030477 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3219/6378] 10.222.0.33 () {58 vars in 1260 bytes} [Sat Aug 6 21:17:30 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:31.031011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0882f8-66ce-4b47-a625-312aca5768ae service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:31.047430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0882f8-66ce-4b47-a625-312aca5768ae service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:31.063133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcde5ec-17c5-49a2-9832-02568d8bfa3e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:31.063800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcde5ec-17c5-49a2-9832-02568d8bfa3e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:31.064082 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcde5ec-17c5-49a2-9832-02568d8bfa3e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:31.064359 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcde5ec-17c5-49a2-9832-02568d8bfa3e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:31.064955 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcde5ec-17c5-49a2-9832-02568d8bfa3e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:31.066591 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcde5ec-17c5-49a2-9832-02568d8bfa3e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:31.070808 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3160/6379] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Aug 6 21:17:31 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 06 21:17:31.073975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367d632-e3ed-42a9-81f4-b947ccf06501 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:31.089664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367d632-e3ed-42a9-81f4-b947ccf06501 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:31.102376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e390bf9-825f-494b-b029-7d287da17243 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:31.106623 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e390bf9-825f-494b-b029-7d287da17243 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:31.106920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e390bf9-825f-494b-b029-7d287da17243 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:31.107211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e390bf9-825f-494b-b029-7d287da17243 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:31.107825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e390bf9-825f-494b-b029-7d287da17243 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:31.112068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e390bf9-825f-494b-b029-7d287da17243 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:31.118609 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3220/6380] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:17:31 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:31.121070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcde5ec-17c5-49a2-9832-02568d8bfa3e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:31.144713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcde5ec-17c5-49a2-9832-02568d8bfa3e tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:31.159316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75e194-16c9-44fd-bb05-b2fa5abb96b6 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:31.159985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75e194-16c9-44fd-bb05-b2fa5abb96b6 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:31.160262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75e194-16c9-44fd-bb05-b2fa5abb96b6 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:31.160538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75e194-16c9-44fd-bb05-b2fa5abb96b6 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:31.161122 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75e194-16c9-44fd-bb05-b2fa5abb96b6 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:31.163369 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75e194-16c9-44fd-bb05-b2fa5abb96b6 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:31.168145 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3161/6381] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:17:31 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:31.171851 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e390bf9-825f-494b-b029-7d287da17243 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:31.180886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:31.184986 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e390bf9-825f-494b-b029-7d287da17243 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:31.196282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0094e7-dd16-4cc6-bcf0-61e918358c93 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:31.199501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0094e7-dd16-4cc6-bcf0-61e918358c93 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:31.199815 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0094e7-dd16-4cc6-bcf0-61e918358c93 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:31.200200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0094e7-dd16-4cc6-bcf0-61e918358c93 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:31.201971 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0094e7-dd16-4cc6-bcf0-61e918358c93 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:31.203867 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0094e7-dd16-4cc6-bcf0-61e918358c93 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:31.215672 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3221/6382] 10.222.0.33 () {58 vars in 1278 bytes} [Sat Aug 6 21:17:31 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 06 21:17:31.218632 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75e194-16c9-44fd-bb05-b2fa5abb96b6 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:31.232774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75e194-16c9-44fd-bb05-b2fa5abb96b6 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:31.241052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee2fc3-bb4d-4247-bc6b-de4cd66e8462 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:31.242147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee2fc3-bb4d-4247-bc6b-de4cd66e8462 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:31.242677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee2fc3-bb4d-4247-bc6b-de4cd66e8462 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:31.243192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee2fc3-bb4d-4247-bc6b-de4cd66e8462 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/68236a8dd51645ebb39198656dace466` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:31.252409 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee2fc3-bb4d-4247-bc6b-de4cd66e8462 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 21:17:31.257934 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-d8ee2fc3-bb4d-4247-bc6b-de4cd66e8462 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Could not find domain: 68236a8dd51645ebb39198656dace466.: keystone.exception.DomainNotFound: Could not find domain: 68236a8dd51645ebb39198656dace466. Aug 06 21:17:31.257934 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:17:31.257934 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 06 21:17:31.257934 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 06 21:17:31.257934 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 21:17:31.257934 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 21:17:31.257934 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 21:17:31.257934 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 21:17:31.257934 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 68236a8dd51645ebb39198656dace466. Aug 06 21:17:31.257934 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:17:31.257934 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 21:17:31.257934 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:17:31.257934 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:17:31.257934 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:17:31.257934 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:17:31.259150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:17:31.259150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:17:31.259150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:17:31.259150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:17:31.259150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:17:31.259150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:17:31.259150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:17:31.259150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:17:31.259150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 06 21:17:31.259150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 06 21:17:31.259150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 21:17:31.259150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 21:17:31.259150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 21:17:31.259150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 21:17:31.259150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:17:31.259150 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:17:31.260478 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 21:17:31.260478 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 21:17:31.260478 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 21:17:31.260478 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 21:17:31.260478 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 21:17:31.260478 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 21:17:31.260478 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 21:17:31.260478 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 21:17:31.260478 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 21:17:31.260478 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 21:17:31.260478 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 21:17:31.260478 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 21:17:31.260478 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 21:17:31.260478 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 21:17:31.260478 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 06 21:17:31.260478 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 21:17:31.260478 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 68236a8dd51645ebb39198656dace466. Aug 06 21:17:31.261598 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:17:31.268766 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0094e7-dd16-4cc6-bcf0-61e918358c93 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:31.283406 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3162/6383] 10.222.0.33 () {60 vars in 1249 bytes} [Sat Aug 6 21:17:31 2022] PATCH /identity/v3/domains/68236a8dd51645ebb39198656dace466 => generated 112 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:17:31.287643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0094e7-dd16-4cc6-bcf0-61e918358c93 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:31.294215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab8646-7130-407f-8e3e-043f00206957 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:31.295289 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab8646-7130-407f-8e3e-043f00206957 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:31.295636 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab8646-7130-407f-8e3e-043f00206957 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:31.295982 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab8646-7130-407f-8e3e-043f00206957 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/7a572cfb08bc45d0b45f27d6460b0d6e` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:31.310373 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab8646-7130-407f-8e3e-043f00206957 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 21:17:31.321100 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-63ab8646-7130-407f-8e3e-043f00206957 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Could not find domain: 7a572cfb08bc45d0b45f27d6460b0d6e.: keystone.exception.DomainNotFound: Could not find domain: 7a572cfb08bc45d0b45f27d6460b0d6e. Aug 06 21:17:31.321100 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:17:31.321100 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 06 21:17:31.321100 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 06 21:17:31.321100 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 21:17:31.321100 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 21:17:31.321100 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 21:17:31.321100 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 21:17:31.321100 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 7a572cfb08bc45d0b45f27d6460b0d6e. Aug 06 21:17:31.321100 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:17:31.321100 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 21:17:31.321100 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:17:31.321100 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:17:31.321100 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:17:31.321100 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:17:31.322309 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:17:31.322309 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:17:31.322309 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:17:31.322309 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:17:31.322309 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:17:31.322309 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:17:31.322309 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:17:31.322309 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:17:31.322309 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 06 21:17:31.322309 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 06 21:17:31.322309 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 21:17:31.322309 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 21:17:31.322309 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 21:17:31.322309 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 21:17:31.322309 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:17:31.322309 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:17:31.324229 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 21:17:31.324229 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 21:17:31.324229 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 21:17:31.324229 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 21:17:31.324229 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 21:17:31.324229 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application with Lock( Aug 06 21:17:31.324229 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 21:17:31.324229 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._enter() Aug 06 21:17:31.324229 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 21:17:31.324229 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 21:17:31.324229 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 21:17:31.324229 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.creator() Aug 06 21:17:31.324229 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 21:17:31.324229 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application created_value = creator( Aug 06 21:17:31.324229 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 06 21:17:31.324229 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 21:17:31.324229 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 7a572cfb08bc45d0b45f27d6460b0d6e. Aug 06 21:17:31.326040 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:17:31.327374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee2fc3-bb4d-4247-bc6b-de4cd66e8462 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:31.336819 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3222/6384] 10.222.0.33 () {60 vars in 1249 bytes} [Sat Aug 6 21:17:31 2022] PATCH /identity/v3/domains/7a572cfb08bc45d0b45f27d6460b0d6e => generated 112 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 06 21:17:31.341986 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee2fc3-bb4d-4247-bc6b-de4cd66e8462 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:31.347166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae6662-f9b2-4b0f-8959-a5f0c28d3ed0 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af48a7cc47854309979d1cc80d856957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68af603729f48d98db32dad8ca70c9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:31.347911 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae6662-f9b2-4b0f-8959-a5f0c28d3ed0 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:31.348258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae6662-f9b2-4b0f-8959-a5f0c28d3ed0 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:31.348602 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae6662-f9b2-4b0f-8959-a5f0c28d3ed0 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] PATH_INFO: `/v3/domains/d25c03eb63c24d65b207376607dab88e` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:31.358633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ae6662-f9b2-4b0f-8959-a5f0c28d3ed0 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 21:17:31.365320 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-80ae6662-f9b2-4b0f-8959-a5f0c28d3ed0 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Could not find domain: d25c03eb63c24d65b207376607dab88e.: keystone.exception.DomainNotFound: Could not find domain: d25c03eb63c24d65b207376607dab88e. Aug 06 21:17:31.365320 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:17:31.365320 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 06 21:17:31.365320 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 06 21:17:31.365320 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 21:17:31.365320 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 21:17:31.365320 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 21:17:31.365320 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 21:17:31.365320 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d25c03eb63c24d65b207376607dab88e. Aug 06 21:17:31.365320 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:17:31.365320 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 21:17:31.365320 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:17:31.365320 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:17:31.365320 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:17:31.365320 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:17:31.366524 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:17:31.366524 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:17:31.366524 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:17:31.366524 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:17:31.366524 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:17:31.366524 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:17:31.366524 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:17:31.366524 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:17:31.366524 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 06 21:17:31.366524 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 06 21:17:31.366524 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 21:17:31.366524 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 21:17:31.366524 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 21:17:31.366524 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 21:17:31.366524 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:17:31.366524 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:17:31.367671 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 21:17:31.367671 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 21:17:31.367671 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 21:17:31.367671 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 21:17:31.367671 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 21:17:31.367671 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 21:17:31.367671 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 21:17:31.367671 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 21:17:31.367671 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 21:17:31.367671 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 21:17:31.367671 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 21:17:31.367671 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 21:17:31.367671 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 21:17:31.367671 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 21:17:31.367671 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 06 21:17:31.367671 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 21:17:31.367671 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: d25c03eb63c24d65b207376607dab88e. Aug 06 21:17:31.368819 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:17:31.372176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab8646-7130-407f-8e3e-043f00206957 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:31.374019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-63ab8646-7130-407f-8e3e-043f00206957 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:31.374761 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3163/6385] 10.222.0.33 () {60 vars in 1249 bytes} [Sat Aug 6 21:17:31 2022] PATCH /identity/v3/domains/d25c03eb63c24d65b207376607dab88e => generated 112 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:17:31.396432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab8646-7130-407f-8e3e-043f00206957 tempest-DomainConfigurationTestJSON-1249508033 tempest-DomainConfigurationTestJSON-1249508033-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:31.405040 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905ca09-e593-4eea-a376-0a58b2f29f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:31.405873 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905ca09-e593-4eea-a376-0a58b2f29f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:31.406163 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905ca09-e593-4eea-a376-0a58b2f29f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:31.406443 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905ca09-e593-4eea-a376-0a58b2f29f3a admin admin] PATH_INFO: `/v3/users/8a33f0cd51e14a6eb09cab1e91c5d2b7` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:31.413516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905ca09-e593-4eea-a376-0a58b2f29f3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a33f0cd51e14a6eb09cab1e91c5d2b7)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:31.416534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905ca09-e593-4eea-a376-0a58b2f29f3a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:31.533326 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9905ca09-e593-4eea-a376-0a58b2f29f3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a33f0cd51e14a6eb09cab1e91c5d2b7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:31.549299 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9905ca09-e593-4eea-a376-0a58b2f29f3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a33f0cd51e14a6eb09cab1e91c5d2b7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:31.550203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9905ca09-e593-4eea-a376-0a58b2f29f3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a33f0cd51e14a6eb09cab1e91c5d2b7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:31.550852 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9905ca09-e593-4eea-a376-0a58b2f29f3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a33f0cd51e14a6eb09cab1e91c5d2b7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:31.565553 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9905ca09-e593-4eea-a376-0a58b2f29f3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a33f0cd51e14a6eb09cab1e91c5d2b7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:31.602946 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3223/6386] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:17:31 2022] DELETE /identity/v3/users/8a33f0cd51e14a6eb09cab1e91c5d2b7 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:31.604930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e160d4-201a-425c-8b62-70e929144e24 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:31.605444 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e160d4-201a-425c-8b62-70e929144e24 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:31.605596 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e160d4-201a-425c-8b62-70e929144e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:31.641946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f4e160d4-201a-425c-8b62-70e929144e24 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:31.644738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f4e160d4-201a-425c-8b62-70e929144e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:31.699323 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:31.737357 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3164/6387] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:17:31.808123 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905ca09-e593-4eea-a376-0a58b2f29f3a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:31.812744 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9905ca09-e593-4eea-a376-0a58b2f29f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:31.912853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905ca09-e593-4eea-a376-0a58b2f29f3a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:31.921024 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120c29b-65ce-431f-8b46-31ca6c94733a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:31.921464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120c29b-65ce-431f-8b46-31ca6c94733a service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:31.922235 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120c29b-65ce-431f-8b46-31ca6c94733a service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:31.922926 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120c29b-65ce-431f-8b46-31ca6c94733a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:31.938195 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120c29b-65ce-431f-8b46-31ca6c94733a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:31.939845 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120c29b-65ce-431f-8b46-31ca6c94733a service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:31.958510 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3224/6388] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:17:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:17:32.227274 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e160d4-201a-425c-8b62-70e929144e24 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:32.229065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f4e160d4-201a-425c-8b62-70e929144e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:32.245391 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e160d4-201a-425c-8b62-70e929144e24 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:32.266658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958c9bd-e40c-413b-bb72-cae37d386be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:32.269833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958c9bd-e40c-413b-bb72-cae37d386be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:32.270171 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958c9bd-e40c-413b-bb72-cae37d386be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:32.271573 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958c9bd-e40c-413b-bb72-cae37d386be7 admin admin] PATH_INFO: `/v3/projects/c4fea9bb1b964740be2b1188187e4c36` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:32.273217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b958c9bd-e40c-413b-bb72-cae37d386be7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4fea9bb1b964740be2b1188187e4c36)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:32.276487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b958c9bd-e40c-413b-bb72-cae37d386be7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:32.377112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b958c9bd-e40c-413b-bb72-cae37d386be7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4fea9bb1b964740be2b1188187e4c36', 'request_id': 'req-b958c9bd-e40c-413b-bb72-cae37d386be7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:32.383450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b958c9bd-e40c-413b-bb72-cae37d386be7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4fea9bb1b964740be2b1188187e4c36', 'request_id': 'req-b958c9bd-e40c-413b-bb72-cae37d386be7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:32.390710 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b958c9bd-e40c-413b-bb72-cae37d386be7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4fea9bb1b964740be2b1188187e4c36', 'request_id': 'req-b958c9bd-e40c-413b-bb72-cae37d386be7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:32.407894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b958c9bd-e40c-413b-bb72-cae37d386be7 admin admin] The token cache is being invalidate because project c4fea9bb1b964740be2b1188187e4c36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:17:32.408202 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b958c9bd-e40c-413b-bb72-cae37d386be7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:32.409016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b958c9bd-e40c-413b-bb72-cae37d386be7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:32.412103 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3165/6389] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:17:32 2022] DELETE /identity/v3/projects/c4fea9bb1b964740be2b1188187e4c36 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:32.415806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120c29b-65ce-431f-8b46-31ca6c94733a service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:32.429620 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120c29b-65ce-431f-8b46-31ca6c94733a service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:32.458080 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958c9bd-e40c-413b-bb72-cae37d386be7 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:32.458707 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b958c9bd-e40c-413b-bb72-cae37d386be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:32.625723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e17feb-57bc-42fd-a052-8d56b075aad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:32.626381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e17feb-57bc-42fd-a052-8d56b075aad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:32.626691 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e17feb-57bc-42fd-a052-8d56b075aad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:32.626973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e17feb-57bc-42fd-a052-8d56b075aad4 admin admin] PATH_INFO: `/v3/users/199690c2ec624f138cb5b23aa7fd3b3a` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:32.629270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e17feb-57bc-42fd-a052-8d56b075aad4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=199690c2ec624f138cb5b23aa7fd3b3a)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:32.633511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e17feb-57bc-42fd-a052-8d56b075aad4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:32.642139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958c9bd-e40c-413b-bb72-cae37d386be7 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:32.645949 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:32.655317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18a47f-f93e-440a-b57d-63a2b020e9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:32.655955 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18a47f-f93e-440a-b57d-63a2b020e9e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:32.656241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18a47f-f93e-440a-b57d-63a2b020e9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:32.656737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18a47f-f93e-440a-b57d-63a2b020e9e7 admin admin] PATH_INFO: `/v3/projects/c6ce2c837b18401cb920cf7ec3f1846a` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:32.657867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be18a47f-f93e-440a-b57d-63a2b020e9e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6ce2c837b18401cb920cf7ec3f1846a)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:32.659947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be18a47f-f93e-440a-b57d-63a2b020e9e7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:32.751667 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-88e17feb-57bc-42fd-a052-8d56b075aad4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '199690c2ec624f138cb5b23aa7fd3b3a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:32.753904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-be18a47f-f93e-440a-b57d-63a2b020e9e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6ce2c837b18401cb920cf7ec3f1846a', 'request_id': 'req-be18a47f-f93e-440a-b57d-63a2b020e9e7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:32.761895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-be18a47f-f93e-440a-b57d-63a2b020e9e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6ce2c837b18401cb920cf7ec3f1846a', 'request_id': 'req-be18a47f-f93e-440a-b57d-63a2b020e9e7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:32.768881 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-88e17feb-57bc-42fd-a052-8d56b075aad4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '199690c2ec624f138cb5b23aa7fd3b3a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:32.769774 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-88e17feb-57bc-42fd-a052-8d56b075aad4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '199690c2ec624f138cb5b23aa7fd3b3a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:32.771525 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-88e17feb-57bc-42fd-a052-8d56b075aad4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '199690c2ec624f138cb5b23aa7fd3b3a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:32.771823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-be18a47f-f93e-440a-b57d-63a2b020e9e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6ce2c837b18401cb920cf7ec3f1846a', 'request_id': 'req-be18a47f-f93e-440a-b57d-63a2b020e9e7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:32.782060 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:32.789424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-88e17feb-57bc-42fd-a052-8d56b075aad4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '199690c2ec624f138cb5b23aa7fd3b3a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:32.811560 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-be18a47f-f93e-440a-b57d-63a2b020e9e7 admin admin] The token cache is being invalidate because project c6ce2c837b18401cb920cf7ec3f1846a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:17:32.811856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-be18a47f-f93e-440a-b57d-63a2b020e9e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:32.812577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-be18a47f-f93e-440a-b57d-63a2b020e9e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:32.817270 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3166/6390] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:17:32 2022] DELETE /identity/v3/projects/c6ce2c837b18401cb920cf7ec3f1846a => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:32.818708 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18a47f-f93e-440a-b57d-63a2b020e9e7 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:32.820260 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-be18a47f-f93e-440a-b57d-63a2b020e9e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:32.841105 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3225/6391] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:17:32 2022] DELETE /identity/v3/users/199690c2ec624f138cb5b23aa7fd3b3a => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:17:32.959847 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18a47f-f93e-440a-b57d-63a2b020e9e7 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:33.081798 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d24c8-f314-4f68-9628-d4d9068dec92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:33.083754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d24c8-f314-4f68-9628-d4d9068dec92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:33.084458 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d24c8-f314-4f68-9628-d4d9068dec92 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:33.084996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d24c8-f314-4f68-9628-d4d9068dec92 admin admin] PATH_INFO: `/v3/users/af48a7cc47854309979d1cc80d856957` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:33.086422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49d24c8-f314-4f68-9628-d4d9068dec92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af48a7cc47854309979d1cc80d856957)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:33.090592 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49d24c8-f314-4f68-9628-d4d9068dec92 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:33.216234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b49d24c8-f314-4f68-9628-d4d9068dec92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af48a7cc47854309979d1cc80d856957'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:33.219088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b49d24c8-f314-4f68-9628-d4d9068dec92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af48a7cc47854309979d1cc80d856957'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:33.219750 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b49d24c8-f314-4f68-9628-d4d9068dec92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af48a7cc47854309979d1cc80d856957'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:33.233510 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b49d24c8-f314-4f68-9628-d4d9068dec92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af48a7cc47854309979d1cc80d856957'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:33.287434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b49d24c8-f314-4f68-9628-d4d9068dec92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af48a7cc47854309979d1cc80d856957'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:33.306333 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3167/6392] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:17:32 2022] DELETE /identity/v3/users/af48a7cc47854309979d1cc80d856957 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:33.897920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e17feb-57bc-42fd-a052-8d56b075aad4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:33.900277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-88e17feb-57bc-42fd-a052-8d56b075aad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:33.917635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e17feb-57bc-42fd-a052-8d56b075aad4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:34.003333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d0c0eb-01f4-436d-917c-2e3cfafea9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:34.004062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0c0eb-01f4-436d-917c-2e3cfafea9d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:34.004412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0c0eb-01f4-436d-917c-2e3cfafea9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:34.004767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0c0eb-01f4-436d-917c-2e3cfafea9d1 admin admin] PATH_INFO: `/v3/projects/2a4dd8349714403ba5fbae26633c5054` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:34.006091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d0c0eb-01f4-436d-917c-2e3cfafea9d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a4dd8349714403ba5fbae26633c5054)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:34.008255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d0c0eb-01f4-436d-917c-2e3cfafea9d1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:34.080592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c7d0c0eb-01f4-436d-917c-2e3cfafea9d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a4dd8349714403ba5fbae26633c5054', 'request_id': 'req-c7d0c0eb-01f4-436d-917c-2e3cfafea9d1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:34.093828 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c7d0c0eb-01f4-436d-917c-2e3cfafea9d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a4dd8349714403ba5fbae26633c5054', 'request_id': 'req-c7d0c0eb-01f4-436d-917c-2e3cfafea9d1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:34.105264 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c7d0c0eb-01f4-436d-917c-2e3cfafea9d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a4dd8349714403ba5fbae26633c5054', 'request_id': 'req-c7d0c0eb-01f4-436d-917c-2e3cfafea9d1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:34.140049 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c7d0c0eb-01f4-436d-917c-2e3cfafea9d1 admin admin] The token cache is being invalidate because project 2a4dd8349714403ba5fbae26633c5054 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:17:34.140413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c7d0c0eb-01f4-436d-917c-2e3cfafea9d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:34.141869 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c7d0c0eb-01f4-436d-917c-2e3cfafea9d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:34.159935 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3226/6393] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:17:33 2022] DELETE /identity/v3/projects/2a4dd8349714403ba5fbae26633c5054 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:34.164591 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104dd95e-0122-4d43-bf4a-1bd681898f09 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:34.165095 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104dd95e-0122-4d43-bf4a-1bd681898f09 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:34.165353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104dd95e-0122-4d43-bf4a-1bd681898f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:34.211953 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-104dd95e-0122-4d43-bf4a-1bd681898f09 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:34.213385 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-104dd95e-0122-4d43-bf4a-1bd681898f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:34.252647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:34.340271 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3168/6394] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:34.350003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d95e4-0047-4e26-80c8-25ff052a9c5e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:34.350296 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d95e4-0047-4e26-80c8-25ff052a9c5e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:34.350597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d95e4-0047-4e26-80c8-25ff052a9c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:34.405770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-894d95e4-0047-4e26-80c8-25ff052a9c5e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:34.408435 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-894d95e4-0047-4e26-80c8-25ff052a9c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:34.430440 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3227/6395] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:34.433247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104dd95e-0122-4d43-bf4a-1bd681898f09 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:34.447925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104dd95e-0122-4d43-bf4a-1bd681898f09 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:34.464173 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891609bd-67fc-4fad-9a05-837647f5b838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:34.464449 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891609bd-67fc-4fad-9a05-837647f5b838 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:34.464546 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891609bd-67fc-4fad-9a05-837647f5b838 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:34.464816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891609bd-67fc-4fad-9a05-837647f5b838 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:34.465500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891609bd-67fc-4fad-9a05-837647f5b838 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:17:34.465782 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891609bd-67fc-4fad-9a05-837647f5b838 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:34.470758 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891609bd-67fc-4fad-9a05-837647f5b838 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:34.508067 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3169/6396] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:17:34.511918 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d95e4-0047-4e26-80c8-25ff052a9c5e None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:34.538381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d95e4-0047-4e26-80c8-25ff052a9c5e None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:34.545266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906cc96-cb86-4600-b582-026f65bd6df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:34.545897 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906cc96-cb86-4600-b582-026f65bd6df1 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:34.546176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906cc96-cb86-4600-b582-026f65bd6df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:34.546445 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906cc96-cb86-4600-b582-026f65bd6df1 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:34.547141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906cc96-cb86-4600-b582-026f65bd6df1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:34.549408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906cc96-cb86-4600-b582-026f65bd6df1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:34.555780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:34.595989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891609bd-67fc-4fad-9a05-837647f5b838 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:34.596733 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3228/6397] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:17:34 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:34.612629 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891609bd-67fc-4fad-9a05-837647f5b838 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:34.693871 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906cc96-cb86-4600-b582-026f65bd6df1 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:34.697101 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1906cc96-cb86-4600-b582-026f65bd6df1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:34.800535 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb41f39-c63d-4f23-9ea6-988764efc3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:34.801161 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb41f39-c63d-4f23-9ea6-988764efc3da admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:34.801430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb41f39-c63d-4f23-9ea6-988764efc3da admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:34.801701 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb41f39-c63d-4f23-9ea6-988764efc3da admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:34.802531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb41f39-c63d-4f23-9ea6-988764efc3da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:34.804659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb41f39-c63d-4f23-9ea6-988764efc3da admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:34.846889 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3170/6398] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:17:34 2022] POST /identity/v3/users => generated 293 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:34.850677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb41f39-c63d-4f23-9ea6-988764efc3da admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:34.857813 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906cc96-cb86-4600-b582-026f65bd6df1 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:34.870637 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb41f39-c63d-4f23-9ea6-988764efc3da admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:34.874105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35786d66-647f-4614-afc8-ee2729c0966e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:34.874816 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35786d66-647f-4614-afc8-ee2729c0966e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:34.875089 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35786d66-647f-4614-afc8-ee2729c0966e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:34.875359 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35786d66-647f-4614-afc8-ee2729c0966e admin admin] PATH_INFO: `/v3/projects/d68af603729f48d98db32dad8ca70c9d` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:34.878850 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35786d66-647f-4614-afc8-ee2729c0966e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d68af603729f48d98db32dad8ca70c9d)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:34.887394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35786d66-647f-4614-afc8-ee2729c0966e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:34.898595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b101393-42fd-43bf-ba73-bcd351e26592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:34.899292 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b101393-42fd-43bf-ba73-bcd351e26592 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:34.899571 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b101393-42fd-43bf-ba73-bcd351e26592 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:34.900008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b101393-42fd-43bf-ba73-bcd351e26592 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:34.901232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b101393-42fd-43bf-ba73-bcd351e26592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:34.909100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b101393-42fd-43bf-ba73-bcd351e26592 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:34.958807 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3171/6399] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:17:34.963915 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b101393-42fd-43bf-ba73-bcd351e26592 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:34.993377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b101393-42fd-43bf-ba73-bcd351e26592 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:35.002292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-35786d66-647f-4614-afc8-ee2729c0966e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd68af603729f48d98db32dad8ca70c9d', 'request_id': 'req-35786d66-647f-4614-afc8-ee2729c0966e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:35.028254 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-35786d66-647f-4614-afc8-ee2729c0966e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd68af603729f48d98db32dad8ca70c9d', 'request_id': 'req-35786d66-647f-4614-afc8-ee2729c0966e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:35.048886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-35786d66-647f-4614-afc8-ee2729c0966e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd68af603729f48d98db32dad8ca70c9d', 'request_id': 'req-35786d66-647f-4614-afc8-ee2729c0966e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:35.079610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924d3cd-89e8-4176-919f-8a89f60134bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:35.080244 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924d3cd-89e8-4176-919f-8a89f60134bd admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:35.080527 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924d3cd-89e8-4176-919f-8a89f60134bd admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:35.080801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924d3cd-89e8-4176-919f-8a89f60134bd admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:35.081517 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924d3cd-89e8-4176-919f-8a89f60134bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:35.083462 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924d3cd-89e8-4176-919f-8a89f60134bd admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:35.085135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-35786d66-647f-4614-afc8-ee2729c0966e admin admin] The token cache is being invalidate because project d68af603729f48d98db32dad8ca70c9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:17:35.085985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-35786d66-647f-4614-afc8-ee2729c0966e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:35.090069 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-35786d66-647f-4614-afc8-ee2729c0966e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:35.095199 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3229/6400] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:17:34 2022] DELETE /identity/v3/projects/d68af603729f48d98db32dad8ca70c9d => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:35.099712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7605329-4cf7-49b2-b935-e6a5bf8d9541 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:35.099988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7605329-4cf7-49b2-b935-e6a5bf8d9541 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:35.100973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7605329-4cf7-49b2-b935-e6a5bf8d9541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:35.104761 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3172/6401] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:17:35.108644 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924d3cd-89e8-4176-919f-8a89f60134bd admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:35.111245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0924d3cd-89e8-4176-919f-8a89f60134bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:35.127258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924d3cd-89e8-4176-919f-8a89f60134bd admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:35.133231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32030c1-ba98-4bb0-8a82-7e4120e34929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:35.134193 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32030c1-ba98-4bb0-8a82-7e4120e34929 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:35.135345 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32030c1-ba98-4bb0-8a82-7e4120e34929 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:35.135625 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32030c1-ba98-4bb0-8a82-7e4120e34929 admin admin] PATH_INFO: `/v3/projects/7396ebd1d4564ab9b24b019d28ec486d/users/c86d0c7b21ad4b0b88eb7e19570fb113/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:35.160128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32030c1-ba98-4bb0-8a82-7e4120e34929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7396ebd1d4564ab9b24b019d28ec486d, user_id=c86d0c7b21ad4b0b88eb7e19570fb113, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:35.163487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32030c1-ba98-4bb0-8a82-7e4120e34929 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:35.170599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b7605329-4cf7-49b2-b935-e6a5bf8d9541 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:35.174181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b7605329-4cf7-49b2-b935-e6a5bf8d9541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:35.176883 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:35.185757 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3173/6402] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:17:35 2022] PUT /identity/v3/projects/7396ebd1d4564ab9b24b019d28ec486d/users/c86d0c7b21ad4b0b88eb7e19570fb113/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:35.196582 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6f465-071b-4eac-aaa9-7a2115126ef0 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:35.196951 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6f465-071b-4eac-aaa9-7a2115126ef0 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:35.197899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6f465-071b-4eac-aaa9-7a2115126ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:35.278430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f8e6f465-071b-4eac-aaa9-7a2115126ef0 None None] MFA Rules not processed for user `c86d0c7b21ad4b0b88eb7e19570fb113`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:35.280424 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f8e6f465-071b-4eac-aaa9-7a2115126ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:35.408948 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3174/6403] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:17:35.413456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6f465-071b-4eac-aaa9-7a2115126ef0 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:35.423313 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3230/6404] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:35.433675 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a32309-e0b6-4a1f-9d30-168f6bb8b547 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:35.434418 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a32309-e0b6-4a1f-9d30-168f6bb8b547 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:35.435032 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a32309-e0b6-4a1f-9d30-168f6bb8b547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:35.473628 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6f465-071b-4eac-aaa9-7a2115126ef0 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:35.474633 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b1a32309-e0b6-4a1f-9d30-168f6bb8b547 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:35.475958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b1a32309-e0b6-4a1f-9d30-168f6bb8b547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:35.478824 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879da4bf-0aa1-42c3-855b-1bd329326c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:35.479508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879da4bf-0aa1-42c3-855b-1bd329326c99 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:35.479828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879da4bf-0aa1-42c3-855b-1bd329326c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:35.480102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879da4bf-0aa1-42c3-855b-1bd329326c99 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:35.480720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879da4bf-0aa1-42c3-855b-1bd329326c99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:35.482699 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879da4bf-0aa1-42c3-855b-1bd329326c99 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:35.486935 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3231/6405] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:35.492277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a32309-e0b6-4a1f-9d30-168f6bb8b547 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:35.527571 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3175/6406] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:17:35 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:17:35.531845 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879da4bf-0aa1-42c3-855b-1bd329326c99 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:35.543297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a32309-e0b6-4a1f-9d30-168f6bb8b547 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:35.574124 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:35.670406 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879da4bf-0aa1-42c3-855b-1bd329326c99 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:35.677462 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b4186-443f-4a56-acf8-14306b842cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:35.678098 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b4186-443f-4a56-acf8-14306b842cd5 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:35.678774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b4186-443f-4a56-acf8-14306b842cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:35.679050 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b4186-443f-4a56-acf8-14306b842cd5 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:35.679677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b4186-443f-4a56-acf8-14306b842cd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:35.682224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b4186-443f-4a56-acf8-14306b842cd5 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:35.689792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2659aca-32f2-4230-bafc-4c3e3a06235f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:35.690718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2659aca-32f2-4230-bafc-4c3e3a06235f admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:35.691068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2659aca-32f2-4230-bafc-4c3e3a06235f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:35.691414 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2659aca-32f2-4230-bafc-4c3e3a06235f admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:35.692203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2659aca-32f2-4230-bafc-4c3e3a06235f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:17:35.692575 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2659aca-32f2-4230-bafc-4c3e3a06235f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:35.694881 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2659aca-32f2-4230-bafc-4c3e3a06235f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:35.723991 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3232/6407] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:17:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:17:35.730447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2659aca-32f2-4230-bafc-4c3e3a06235f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:35.733242 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3176/6408] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:17:35 2022] POST /identity/v3/users => generated 299 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:17:35.737081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b4186-443f-4a56-acf8-14306b842cd5 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:35.760888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2659aca-32f2-4230-bafc-4c3e3a06235f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:35.762892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b4186-443f-4a56-acf8-14306b842cd5 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:35.769997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ce213-a7ae-45c4-aac6-0a19e81c5b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:35.771674 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ce213-a7ae-45c4-aac6-0a19e81c5b6d admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:35.771674 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ce213-a7ae-45c4-aac6-0a19e81c5b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:35.771984 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ce213-a7ae-45c4-aac6-0a19e81c5b6d admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:35.772766 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ce213-a7ae-45c4-aac6-0a19e81c5b6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:35.773556 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e80769-b7f0-4d28-88e7-5c6f7cb91248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:35.776087 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e80769-b7f0-4d28-88e7-5c6f7cb91248 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:35.777694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e80769-b7f0-4d28-88e7-5c6f7cb91248 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:35.778697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e80769-b7f0-4d28-88e7-5c6f7cb91248 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:35.778936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ce213-a7ae-45c4-aac6-0a19e81c5b6d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:35.779911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e80769-b7f0-4d28-88e7-5c6f7cb91248 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:35.786915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e80769-b7f0-4d28-88e7-5c6f7cb91248 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:35.824759 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3177/6409] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:17:35.827454 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ce213-a7ae-45c4-aac6-0a19e81c5b6d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:35.849372 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ce213-a7ae-45c4-aac6-0a19e81c5b6d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:35.857231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568367f4-6b33-4396-b46b-e3764b19b94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:35.857990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568367f4-6b33-4396-b46b-e3764b19b94b admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:35.858368 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568367f4-6b33-4396-b46b-e3764b19b94b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:35.858683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568367f4-6b33-4396-b46b-e3764b19b94b admin admin] PATH_INFO: `/v3/projects/713828c70ae64552b6702bd77d3de0bb/users/3ac7953232974ac985d9e30ff77e9cc0/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:35.863971 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3233/6410] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:17:35 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:35.868557 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e80769-b7f0-4d28-88e7-5c6f7cb91248 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:35.881286 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568367f4-6b33-4396-b46b-e3764b19b94b admin admin] RBAC: Authorizing `identity:create_grant(project_id=713828c70ae64552b6702bd77d3de0bb, user_id=3ac7953232974ac985d9e30ff77e9cc0, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:35.886483 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568367f4-6b33-4396-b46b-e3764b19b94b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:35.908064 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3178/6411] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:17:35 2022] PUT /identity/v3/projects/713828c70ae64552b6702bd77d3de0bb/users/3ac7953232974ac985d9e30ff77e9cc0/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:35.912832 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568367f4-6b33-4396-b46b-e3764b19b94b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:35.955367 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:36.012978 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e80769-b7f0-4d28-88e7-5c6f7cb91248 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:36.023562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae1be9-7af6-4389-b7a4-b244f7d36b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:36.024190 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae1be9-7af6-4389-b7a4-b244f7d36b55 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:36.024646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae1be9-7af6-4389-b7a4-b244f7d36b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:36.026007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae1be9-7af6-4389-b7a4-b244f7d36b55 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:36.026686 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae1be9-7af6-4389-b7a4-b244f7d36b55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:36.027104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568367f4-6b33-4396-b46b-e3764b19b94b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:36.028646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae1be9-7af6-4389-b7a4-b244f7d36b55 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:36.036929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694f3f1-ee49-4071-b95a-c4b164bcb94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:36.039259 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694f3f1-ee49-4071-b95a-c4b164bcb94b admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:36.039580 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694f3f1-ee49-4071-b95a-c4b164bcb94b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:36.039862 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694f3f1-ee49-4071-b95a-c4b164bcb94b admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:36.042304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694f3f1-ee49-4071-b95a-c4b164bcb94b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:36.046203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694f3f1-ee49-4071-b95a-c4b164bcb94b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:36.079222 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3234/6412] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:17:35 2022] POST /identity/v3/users => generated 287 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:36.079758 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3179/6413] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:17:36.084550 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae1be9-7af6-4389-b7a4-b244f7d36b55 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:36.084831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694f3f1-ee49-4071-b95a-c4b164bcb94b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:36.105081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694f3f1-ee49-4071-b95a-c4b164bcb94b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:36.111090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae1be9-7af6-4389-b7a4-b244f7d36b55 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:36.116679 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe1acb-2e75-47d8-8bc9-7b32f16ad53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:36.119729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe1acb-2e75-47d8-8bc9-7b32f16ad53b admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:36.120259 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe1acb-2e75-47d8-8bc9-7b32f16ad53b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:36.120713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe1acb-2e75-47d8-8bc9-7b32f16ad53b admin admin] PATH_INFO: `/v3/projects/713828c70ae64552b6702bd77d3de0bb/users/3ac7953232974ac985d9e30ff77e9cc0/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:36.123337 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe1acb-2e75-47d8-8bc9-7b32f16ad53b admin admin] RBAC: Authorizing `identity:create_grant(project_id=713828c70ae64552b6702bd77d3de0bb, user_id=3ac7953232974ac985d9e30ff77e9cc0, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:36.125701 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff28fd8-c13e-4270-abf6-ff7669965a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:36.126501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff28fd8-c13e-4270-abf6-ff7669965a2c admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:36.126829 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff28fd8-c13e-4270-abf6-ff7669965a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:36.127102 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff28fd8-c13e-4270-abf6-ff7669965a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:36.127748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff28fd8-c13e-4270-abf6-ff7669965a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:36.129320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff28fd8-c13e-4270-abf6-ff7669965a2c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:36.131869 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe1acb-2e75-47d8-8bc9-7b32f16ad53b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:36.165220 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3180/6414] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:17:36 2022] PUT /identity/v3/projects/713828c70ae64552b6702bd77d3de0bb/users/3ac7953232974ac985d9e30ff77e9cc0/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:36.165560 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3235/6415] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:17:36.165666 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe1acb-2e75-47d8-8bc9-7b32f16ad53b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:36.166934 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d044c98-4701-4cd5-9b29-d04f9c477f79 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:36.167223 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d044c98-4701-4cd5-9b29-d04f9c477f79 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:36.167500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d044c98-4701-4cd5-9b29-d04f9c477f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:36.227734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-3d044c98-4701-4cd5-9b29-d04f9c477f79 None None] MFA Rules not processed for user `3ac7953232974ac985d9e30ff77e9cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:36.229664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3d044c98-4701-4cd5-9b29-d04f9c477f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:36.286212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe1acb-2e75-47d8-8bc9-7b32f16ad53b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:36.300000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03b595-9052-4a24-8498-7cfffefa657f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:36.301111 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03b595-9052-4a24-8498-7cfffefa657f admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:36.301408 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03b595-9052-4a24-8498-7cfffefa657f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:36.301768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03b595-9052-4a24-8498-7cfffefa657f admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:36.302508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03b595-9052-4a24-8498-7cfffefa657f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:36.305610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03b595-9052-4a24-8498-7cfffefa657f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:36.351449 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3181/6416] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:17:36.355150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03b595-9052-4a24-8498-7cfffefa657f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:36.380493 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03b595-9052-4a24-8498-7cfffefa657f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:36.387639 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61190324-5e67-47a4-b282-41274229c920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:36.388454 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61190324-5e67-47a4-b282-41274229c920 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:36.388834 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61190324-5e67-47a4-b282-41274229c920 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:36.389208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61190324-5e67-47a4-b282-41274229c920 admin admin] PATH_INFO: `/v3/projects/de1ea624626443efb0fa8990882b939e/users/c73be0493dca43f9bba6cac271330ce7/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:36.402496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:36.417159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61190324-5e67-47a4-b282-41274229c920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de1ea624626443efb0fa8990882b939e, user_id=c73be0493dca43f9bba6cac271330ce7, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:36.420427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61190324-5e67-47a4-b282-41274229c920 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:36.438334 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3236/6417] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:36 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:36.439551 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d044c98-4701-4cd5-9b29-d04f9c477f79 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:36.442023 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3182/6418] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:17:36 2022] PUT /identity/v3/projects/de1ea624626443efb0fa8990882b939e/users/c73be0493dca43f9bba6cac271330ce7/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:36.454565 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66032f-f05d-4676-a352-1d96f37c87f3 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:36.454901 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66032f-f05d-4676-a352-1d96f37c87f3 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:36.455176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66032f-f05d-4676-a352-1d96f37c87f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:36.467714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d044c98-4701-4cd5-9b29-d04f9c477f79 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:36.555027 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-3f66032f-f05d-4676-a352-1d96f37c87f3 None None] MFA Rules not processed for user `c73be0493dca43f9bba6cac271330ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:36.564840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3f66032f-f05d-4676-a352-1d96f37c87f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:36.630785 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccb1e8-2a9d-4c0e-966b-b3de664bce95 tempest-ProjectsNegativeTestJSON-1032068173 tempest-ProjectsNegativeTestJSON-1032068173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ac7953232974ac985d9e30ff77e9cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713828c70ae64552b6702bd77d3de0bb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:36.631419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccb1e8-2a9d-4c0e-966b-b3de664bce95 tempest-ProjectsNegativeTestJSON-1032068173 tempest-ProjectsNegativeTestJSON-1032068173-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:36.631702 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccb1e8-2a9d-4c0e-966b-b3de664bce95 tempest-ProjectsNegativeTestJSON-1032068173 tempest-ProjectsNegativeTestJSON-1032068173-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:36.632029 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccb1e8-2a9d-4c0e-966b-b3de664bce95 tempest-ProjectsNegativeTestJSON-1032068173 tempest-ProjectsNegativeTestJSON-1032068173-project-admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:36.632658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ccb1e8-2a9d-4c0e-966b-b3de664bce95 tempest-ProjectsNegativeTestJSON-1032068173 tempest-ProjectsNegativeTestJSON-1032068173-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:36.638073 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ccb1e8-2a9d-4c0e-966b-b3de664bce95 tempest-ProjectsNegativeTestJSON-1032068173 tempest-ProjectsNegativeTestJSON-1032068173-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:36.720961 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3237/6419] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:17:36 2022] POST /identity/v3/projects => generated 359 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:36.727128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccb1e8-2a9d-4c0e-966b-b3de664bce95 tempest-ProjectsNegativeTestJSON-1032068173 tempest-ProjectsNegativeTestJSON-1032068173-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:36.797081 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3183/6420] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:36.798196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f66032f-f05d-4676-a352-1d96f37c87f3 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:36.810637 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:36.819411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f66032f-f05d-4676-a352-1d96f37c87f3 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:36.843193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccb1e8-2a9d-4c0e-966b-b3de664bce95 tempest-ProjectsNegativeTestJSON-1032068173 tempest-ProjectsNegativeTestJSON-1032068173-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:36.851262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0963f55-b0e0-46e8-8029-2ca4f72b5c30 tempest-ProjectsNegativeTestJSON-1706489275 tempest-ProjectsNegativeTestJSON-1706489275-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c86d0c7b21ad4b0b88eb7e19570fb113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7396ebd1d4564ab9b24b019d28ec486d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:36.858327 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0963f55-b0e0-46e8-8029-2ca4f72b5c30 tempest-ProjectsNegativeTestJSON-1706489275 tempest-ProjectsNegativeTestJSON-1706489275-project] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:36.859393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0963f55-b0e0-46e8-8029-2ca4f72b5c30 tempest-ProjectsNegativeTestJSON-1706489275 tempest-ProjectsNegativeTestJSON-1706489275-project] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:36.860081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0963f55-b0e0-46e8-8029-2ca4f72b5c30 tempest-ProjectsNegativeTestJSON-1706489275 tempest-ProjectsNegativeTestJSON-1706489275-project] PATH_INFO: `/v3/projects/6704b1fc570f4efb9fab0b0584af7608` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:36.861596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0963f55-b0e0-46e8-8029-2ca4f72b5c30 tempest-ProjectsNegativeTestJSON-1706489275 tempest-ProjectsNegativeTestJSON-1706489275-project] RBAC: Authorizing `identity:delete_project(project_id=6704b1fc570f4efb9fab0b0584af7608)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:36.869665 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-b0963f55-b0e0-46e8-8029-2ca4f72b5c30 tempest-ProjectsNegativeTestJSON-1706489275 tempest-ProjectsNegativeTestJSON-1706489275-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Aug 06 21:17:36.869665 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:17:36.869665 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:17:36.869665 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:17:36.869665 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:17:36.869665 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:17:36.869665 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:17:36.869665 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:17:36.869665 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:17:36.869665 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:17:36.869665 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:17:36.869665 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:17:36.869665 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Aug 06 21:17:36.869665 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Aug 06 21:17:36.871195 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Aug 06 21:17:36.871195 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application enforcer_obj._enforce( Aug 06 21:17:36.871195 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Aug 06 21:17:36.871195 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Aug 06 21:17:36.871195 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 06 21:17:36.871195 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Aug 06 21:17:36.871195 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Aug 06 21:17:36.871195 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:17:36.873897 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3238/6421] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:17:36 2022] DELETE /identity/v3/projects/6704b1fc570f4efb9fab0b0584af7608 => generated 136 bytes in 149 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:17:36.879907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0963f55-b0e0-46e8-8029-2ca4f72b5c30 tempest-ProjectsNegativeTestJSON-1706489275 tempest-ProjectsNegativeTestJSON-1706489275-project] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:37.038920 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc02050-1364-43cf-8ccd-45f541b861d0 tempest-IdentityCatalogTest-177592627 tempest-IdentityCatalogTest-177592627-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c73be0493dca43f9bba6cac271330ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de1ea624626443efb0fa8990882b939e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:37.039543 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc02050-1364-43cf-8ccd-45f541b861d0 tempest-IdentityCatalogTest-177592627 tempest-IdentityCatalogTest-177592627-project] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:37.039857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc02050-1364-43cf-8ccd-45f541b861d0 tempest-IdentityCatalogTest-177592627 tempest-IdentityCatalogTest-177592627-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:37.040086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc02050-1364-43cf-8ccd-45f541b861d0 tempest-IdentityCatalogTest-177592627 tempest-IdentityCatalogTest-177592627-project] PATH_INFO: `/v3/auth/catalog` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:37.040672 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc02050-1364-43cf-8ccd-45f541b861d0 tempest-IdentityCatalogTest-177592627 tempest-IdentityCatalogTest-177592627-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:37.041826 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc02050-1364-43cf-8ccd-45f541b861d0 tempest-IdentityCatalogTest-177592627 tempest-IdentityCatalogTest-177592627-project] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:37.049918 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3184/6422] 10.222.0.33 () {58 vars in 1143 bytes} [Sat Aug 6 21:17:36 2022] GET /identity/v3/auth/catalog => generated 2658 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:17:37.050911 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc02050-1364-43cf-8ccd-45f541b861d0 tempest-IdentityCatalogTest-177592627 tempest-IdentityCatalogTest-177592627-project] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:37.059826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0963f55-b0e0-46e8-8029-2ca4f72b5c30 tempest-ProjectsNegativeTestJSON-1706489275 tempest-ProjectsNegativeTestJSON-1706489275-project] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:37.072163 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378ea05-172a-43d5-b450-77632124e559 tempest-ProjectsNegativeTestJSON-1032068173 tempest-ProjectsNegativeTestJSON-1032068173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ac7953232974ac985d9e30ff77e9cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713828c70ae64552b6702bd77d3de0bb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:37.072893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378ea05-172a-43d5-b450-77632124e559 tempest-ProjectsNegativeTestJSON-1032068173 tempest-ProjectsNegativeTestJSON-1032068173-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:37.073355 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378ea05-172a-43d5-b450-77632124e559 tempest-ProjectsNegativeTestJSON-1032068173 tempest-ProjectsNegativeTestJSON-1032068173-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:37.073635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378ea05-172a-43d5-b450-77632124e559 tempest-ProjectsNegativeTestJSON-1032068173 tempest-ProjectsNegativeTestJSON-1032068173-project-admin] PATH_INFO: `/v3/projects/6704b1fc570f4efb9fab0b0584af7608` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:37.079589 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378ea05-172a-43d5-b450-77632124e559 tempest-ProjectsNegativeTestJSON-1032068173 tempest-ProjectsNegativeTestJSON-1032068173-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6704b1fc570f4efb9fab0b0584af7608)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:37.081697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378ea05-172a-43d5-b450-77632124e559 tempest-ProjectsNegativeTestJSON-1032068173 tempest-ProjectsNegativeTestJSON-1032068173-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:37.156964 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:37.233022 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc02050-1364-43cf-8ccd-45f541b861d0 tempest-IdentityCatalogTest-177592627 tempest-IdentityCatalogTest-177592627-project] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:37.242724 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2378ea05-172a-43d5-b450-77632124e559 tempest-ProjectsNegativeTestJSON-1032068173 tempest-ProjectsNegativeTestJSON-1032068173-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6704b1fc570f4efb9fab0b0584af7608', 'request_id': 'req-2378ea05-172a-43d5-b450-77632124e559'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:37.273407 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2378ea05-172a-43d5-b450-77632124e559 tempest-ProjectsNegativeTestJSON-1032068173 tempest-ProjectsNegativeTestJSON-1032068173-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6704b1fc570f4efb9fab0b0584af7608', 'request_id': 'req-2378ea05-172a-43d5-b450-77632124e559'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:37.312220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2378ea05-172a-43d5-b450-77632124e559 tempest-ProjectsNegativeTestJSON-1032068173 tempest-ProjectsNegativeTestJSON-1032068173-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6704b1fc570f4efb9fab0b0584af7608', 'request_id': 'req-2378ea05-172a-43d5-b450-77632124e559'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:37.339214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2378ea05-172a-43d5-b450-77632124e559 tempest-ProjectsNegativeTestJSON-1032068173 tempest-ProjectsNegativeTestJSON-1032068173-project-admin] The token cache is being invalidate because project 6704b1fc570f4efb9fab0b0584af7608 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:17:37.341423 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2378ea05-172a-43d5-b450-77632124e559 tempest-ProjectsNegativeTestJSON-1032068173 tempest-ProjectsNegativeTestJSON-1032068173-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:37.344789 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2378ea05-172a-43d5-b450-77632124e559 tempest-ProjectsNegativeTestJSON-1032068173 tempest-ProjectsNegativeTestJSON-1032068173-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:37.350335 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d18cdb-a292-4296-ad5e-a8a98b133932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:37.351450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d18cdb-a292-4296-ad5e-a8a98b133932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:37.351810 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d18cdb-a292-4296-ad5e-a8a98b133932 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:37.352214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d18cdb-a292-4296-ad5e-a8a98b133932 admin admin] PATH_INFO: `/v3/users/c73be0493dca43f9bba6cac271330ce7` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:37.353749 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d18cdb-a292-4296-ad5e-a8a98b133932 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c73be0493dca43f9bba6cac271330ce7)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:37.358783 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3239/6423] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:17:36 2022] DELETE /identity/v3/projects/6704b1fc570f4efb9fab0b0584af7608 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:37.360097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378ea05-172a-43d5-b450-77632124e559 tempest-ProjectsNegativeTestJSON-1032068173 tempest-ProjectsNegativeTestJSON-1032068173-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:37.362002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2378ea05-172a-43d5-b450-77632124e559 tempest-ProjectsNegativeTestJSON-1032068173 tempest-ProjectsNegativeTestJSON-1032068173-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:37.365664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d18cdb-a292-4296-ad5e-a8a98b133932 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:37.383992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378ea05-172a-43d5-b450-77632124e559 tempest-ProjectsNegativeTestJSON-1032068173 tempest-ProjectsNegativeTestJSON-1032068173-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:37.390946 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab59768-8455-4de2-9dc9-db848196bae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:37.392138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab59768-8455-4de2-9dc9-db848196bae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:37.392657 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab59768-8455-4de2-9dc9-db848196bae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:37.393929 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab59768-8455-4de2-9dc9-db848196bae3 admin admin] PATH_INFO: `/v3/users/c86d0c7b21ad4b0b88eb7e19570fb113` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:37.395644 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab59768-8455-4de2-9dc9-db848196bae3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c86d0c7b21ad4b0b88eb7e19570fb113)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:37.398135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab59768-8455-4de2-9dc9-db848196bae3 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:37.497751 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a3d18cdb-a292-4296-ad5e-a8a98b133932 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c73be0493dca43f9bba6cac271330ce7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:37.499866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a3d18cdb-a292-4296-ad5e-a8a98b133932 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c73be0493dca43f9bba6cac271330ce7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:37.500823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a3d18cdb-a292-4296-ad5e-a8a98b133932 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c73be0493dca43f9bba6cac271330ce7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:37.503366 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0ab59768-8455-4de2-9dc9-db848196bae3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c86d0c7b21ad4b0b88eb7e19570fb113'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:37.520238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0ab59768-8455-4de2-9dc9-db848196bae3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c86d0c7b21ad4b0b88eb7e19570fb113'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:37.521344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0ab59768-8455-4de2-9dc9-db848196bae3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c86d0c7b21ad4b0b88eb7e19570fb113'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:37.523257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0ab59768-8455-4de2-9dc9-db848196bae3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c86d0c7b21ad4b0b88eb7e19570fb113'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:37.533590 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a3d18cdb-a292-4296-ad5e-a8a98b133932 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c73be0493dca43f9bba6cac271330ce7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:37.544986 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0ab59768-8455-4de2-9dc9-db848196bae3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c86d0c7b21ad4b0b88eb7e19570fb113'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:37.555374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:37.581837 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a3d18cdb-a292-4296-ad5e-a8a98b133932 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c73be0493dca43f9bba6cac271330ce7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:37.612585 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3240/6424] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:17:37 2022] DELETE /identity/v3/users/c86d0c7b21ad4b0b88eb7e19570fb113 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:37.618271 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc9879-d357-4a87-88b9-5ac67dad89ad None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:37.618627 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc9879-d357-4a87-88b9-5ac67dad89ad None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:37.620400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc9879-d357-4a87-88b9-5ac67dad89ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:37.620667 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3185/6425] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:17:37 2022] DELETE /identity/v3/users/c73be0493dca43f9bba6cac271330ce7 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:37.622489 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b293ad-b59f-49ef-8c25-31e18eb8cc78 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:37.623071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b293ad-b59f-49ef-8c25-31e18eb8cc78 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:37.623686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b293ad-b59f-49ef-8c25-31e18eb8cc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:37.657197 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d1b293ad-b59f-49ef-8c25-31e18eb8cc78 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:37.659266 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d1b293ad-b59f-49ef-8c25-31e18eb8cc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:37.677006 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-17cc9879-d357-4a87-88b9-5ac67dad89ad None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:37.679983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-17cc9879-d357-4a87-88b9-5ac67dad89ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:37.832220 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3186/6426] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:37.875910 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3241/6427] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:37.896288 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b293ad-b59f-49ef-8c25-31e18eb8cc78 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:37.897794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d1b293ad-b59f-49ef-8c25-31e18eb8cc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:37.915578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc9879-d357-4a87-88b9-5ac67dad89ad None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:37.918057 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-17cc9879-d357-4a87-88b9-5ac67dad89ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:37.975274 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:38.045743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b293ad-b59f-49ef-8c25-31e18eb8cc78 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:38.054885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44712346-818e-4812-8760-63fb7c1b0b48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:38.055505 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44712346-818e-4812-8760-63fb7c1b0b48 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:38.055790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44712346-818e-4812-8760-63fb7c1b0b48 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:38.056068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44712346-818e-4812-8760-63fb7c1b0b48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:38.058009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc9879-d357-4a87-88b9-5ac67dad89ad None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:38.065102 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d14d31-703c-492f-bb40-4fbe67973113 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:38.065928 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d14d31-703c-492f-bb40-4fbe67973113 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:38.066184 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d14d31-703c-492f-bb40-4fbe67973113 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:38.066287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d14d31-703c-492f-bb40-4fbe67973113 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:38.085124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44712346-818e-4812-8760-63fb7c1b0b48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:38.086755 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44712346-818e-4812-8760-63fb7c1b0b48 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:38.095153 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d14d31-703c-492f-bb40-4fbe67973113 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:38.098985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d14d31-703c-492f-bb40-4fbe67973113 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:38.114496 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3187/6428] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:17:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:17:38.117962 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3242/6429] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:17:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:17:39.385212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44712346-818e-4812-8760-63fb7c1b0b48 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:39.387655 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-44712346-818e-4812-8760-63fb7c1b0b48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:39.419586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44712346-818e-4812-8760-63fb7c1b0b48 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:39.432899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849acce7-80b6-4b83-8a9d-98f18dc38f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:39.433600 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849acce7-80b6-4b83-8a9d-98f18dc38f7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:39.433926 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849acce7-80b6-4b83-8a9d-98f18dc38f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:39.434208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849acce7-80b6-4b83-8a9d-98f18dc38f7a admin admin] PATH_INFO: `/v3/projects/de1ea624626443efb0fa8990882b939e` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:39.438280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849acce7-80b6-4b83-8a9d-98f18dc38f7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=de1ea624626443efb0fa8990882b939e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:39.443711 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849acce7-80b6-4b83-8a9d-98f18dc38f7a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:39.549627 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-849acce7-80b6-4b83-8a9d-98f18dc38f7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de1ea624626443efb0fa8990882b939e', 'request_id': 'req-849acce7-80b6-4b83-8a9d-98f18dc38f7a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:39.560826 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-849acce7-80b6-4b83-8a9d-98f18dc38f7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de1ea624626443efb0fa8990882b939e', 'request_id': 'req-849acce7-80b6-4b83-8a9d-98f18dc38f7a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:39.569871 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-849acce7-80b6-4b83-8a9d-98f18dc38f7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de1ea624626443efb0fa8990882b939e', 'request_id': 'req-849acce7-80b6-4b83-8a9d-98f18dc38f7a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:39.597498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-849acce7-80b6-4b83-8a9d-98f18dc38f7a admin admin] The token cache is being invalidate because project de1ea624626443efb0fa8990882b939e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:17:39.598089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-849acce7-80b6-4b83-8a9d-98f18dc38f7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:39.600973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-849acce7-80b6-4b83-8a9d-98f18dc38f7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:39.610435 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3188/6430] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:17:39 2022] DELETE /identity/v3/projects/de1ea624626443efb0fa8990882b939e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:39.611102 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339efe3-6cfc-4e36-bf69-76520f440f38 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:39.611586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339efe3-6cfc-4e36-bf69-76520f440f38 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:39.611894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339efe3-6cfc-4e36-bf69-76520f440f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:39.651338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-9339efe3-6cfc-4e36-bf69-76520f440f38 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:39.654165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9339efe3-6cfc-4e36-bf69-76520f440f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:39.753733 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3243/6431] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:39.761808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558837f7-878d-451a-a02f-c5424e011689 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:39.762182 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558837f7-878d-451a-a02f-c5424e011689 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:39.762372 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558837f7-878d-451a-a02f-c5424e011689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:39.789006 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:39.817633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-558837f7-878d-451a-a02f-c5424e011689 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:39.820191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-558837f7-878d-451a-a02f-c5424e011689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:39.829876 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3189/6432] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:39.834102 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339efe3-6cfc-4e36-bf69-76520f440f38 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:39.850417 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339efe3-6cfc-4e36-bf69-76520f440f38 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:39.857086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694acf47-d135-4e7d-9552-5d1a0b15b208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:39.858440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694acf47-d135-4e7d-9552-5d1a0b15b208 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:39.858862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694acf47-d135-4e7d-9552-5d1a0b15b208 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:39.859349 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694acf47-d135-4e7d-9552-5d1a0b15b208 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:39.860115 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694acf47-d135-4e7d-9552-5d1a0b15b208 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:17:39.860519 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694acf47-d135-4e7d-9552-5d1a0b15b208 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:39.862940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694acf47-d135-4e7d-9552-5d1a0b15b208 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:39.888675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558837f7-878d-451a-a02f-c5424e011689 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:39.902427 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3244/6433] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:17:39.906618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558837f7-878d-451a-a02f-c5424e011689 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:39.918450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66942a-eb04-487b-a91d-c980f83950f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:39.920190 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66942a-eb04-487b-a91d-c980f83950f3 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:39.921335 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66942a-eb04-487b-a91d-c980f83950f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:39.922136 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66942a-eb04-487b-a91d-c980f83950f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:39.923015 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac66942a-eb04-487b-a91d-c980f83950f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:39.927430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac66942a-eb04-487b-a91d-c980f83950f3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:39.982583 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3190/6434] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:17:39 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:39.984618 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694acf47-d135-4e7d-9552-5d1a0b15b208 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:40.028385 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694acf47-d135-4e7d-9552-5d1a0b15b208 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:40.174070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375b732-0180-4b9f-bef4-64cfa2c4bad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:40.174512 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375b732-0180-4b9f-bef4-64cfa2c4bad0 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:40.174820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375b732-0180-4b9f-bef4-64cfa2c4bad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:40.175113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375b732-0180-4b9f-bef4-64cfa2c4bad0 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:40.175814 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f375b732-0180-4b9f-bef4-64cfa2c4bad0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:40.179830 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f375b732-0180-4b9f-bef4-64cfa2c4bad0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:40.231713 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3245/6435] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:17:39 2022] POST /identity/v3/users => generated 300 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:17:40.235886 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66942a-eb04-487b-a91d-c980f83950f3 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:40.249468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66942a-eb04-487b-a91d-c980f83950f3 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:40.263135 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a33fd3-09e9-4bd1-bbe9-404beb9cd4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:40.264722 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a33fd3-09e9-4bd1-bbe9-404beb9cd4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:40.265003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a33fd3-09e9-4bd1-bbe9-404beb9cd4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:40.265273 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a33fd3-09e9-4bd1-bbe9-404beb9cd4c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:40.265926 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a33fd3-09e9-4bd1-bbe9-404beb9cd4c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:40.271443 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a33fd3-09e9-4bd1-bbe9-404beb9cd4c8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:40.309112 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3191/6436] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:17:40.314707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375b732-0180-4b9f-bef4-64cfa2c4bad0 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:40.331895 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375b732-0180-4b9f-bef4-64cfa2c4bad0 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:40.342995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d67ab-8753-4d42-a6c0-9b77bd70ba34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:40.343849 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d67ab-8753-4d42-a6c0-9b77bd70ba34 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:40.344333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d67ab-8753-4d42-a6c0-9b77bd70ba34 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:40.344578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d67ab-8753-4d42-a6c0-9b77bd70ba34 admin admin] PATH_INFO: `/v3/projects/144510a42b5d45fbb1fc201c3cf91788/users/826b956d4c1e490f9ee1e90067cfb3bf/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:40.386768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d67ab-8753-4d42-a6c0-9b77bd70ba34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=144510a42b5d45fbb1fc201c3cf91788, user_id=826b956d4c1e490f9ee1e90067cfb3bf, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:40.395138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d67ab-8753-4d42-a6c0-9b77bd70ba34 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:40.411206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a33fd3-09e9-4bd1-bbe9-404beb9cd4c8 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:40.413010 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-94a33fd3-09e9-4bd1-bbe9-404beb9cd4c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:40.439522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a33fd3-09e9-4bd1-bbe9-404beb9cd4c8 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:40.447980 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3246/6437] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:17:40 2022] PUT /identity/v3/projects/144510a42b5d45fbb1fc201c3cf91788/users/826b956d4c1e490f9ee1e90067cfb3bf/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:40.449389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d67ab-8753-4d42-a6c0-9b77bd70ba34 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:40.497002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:40.617957 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b803ab-740e-4176-8a4c-7e8bb7d16480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:40.621421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b803ab-740e-4176-8a4c-7e8bb7d16480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:40.621752 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b803ab-740e-4176-8a4c-7e8bb7d16480 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:40.622099 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b803ab-740e-4176-8a4c-7e8bb7d16480 admin admin] PATH_INFO: `/v3/projects/7396ebd1d4564ab9b24b019d28ec486d` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:40.626106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b803ab-740e-4176-8a4c-7e8bb7d16480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7396ebd1d4564ab9b24b019d28ec486d)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:40.630954 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b803ab-740e-4176-8a4c-7e8bb7d16480 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:40.646293 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d67ab-8753-4d42-a6c0-9b77bd70ba34 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:40.658232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ba046-b517-4427-a8f8-5cf8898dd3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:40.658891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ba046-b517-4427-a8f8-5cf8898dd3a6 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:40.659169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ba046-b517-4427-a8f8-5cf8898dd3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:40.659441 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ba046-b517-4427-a8f8-5cf8898dd3a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:40.660098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ba046-b517-4427-a8f8-5cf8898dd3a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:40.663608 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ba046-b517-4427-a8f8-5cf8898dd3a6 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:40.689056 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3247/6438] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:17:40.693929 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ba046-b517-4427-a8f8-5cf8898dd3a6 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:40.736601 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ba046-b517-4427-a8f8-5cf8898dd3a6 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:40.770243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-11b803ab-740e-4176-8a4c-7e8bb7d16480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7396ebd1d4564ab9b24b019d28ec486d', 'request_id': 'req-11b803ab-740e-4176-8a4c-7e8bb7d16480'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:40.788107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-11b803ab-740e-4176-8a4c-7e8bb7d16480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7396ebd1d4564ab9b24b019d28ec486d', 'request_id': 'req-11b803ab-740e-4176-8a4c-7e8bb7d16480'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:40.799208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-11b803ab-740e-4176-8a4c-7e8bb7d16480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7396ebd1d4564ab9b24b019d28ec486d', 'request_id': 'req-11b803ab-740e-4176-8a4c-7e8bb7d16480'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:40.828565 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-11b803ab-740e-4176-8a4c-7e8bb7d16480 admin admin] The token cache is being invalidate because project 7396ebd1d4564ab9b24b019d28ec486d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:17:40.828862 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-11b803ab-740e-4176-8a4c-7e8bb7d16480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:40.829618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-11b803ab-740e-4176-8a4c-7e8bb7d16480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:40.836264 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3192/6439] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:17:40 2022] DELETE /identity/v3/projects/7396ebd1d4564ab9b24b019d28ec486d => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:40.839528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b803ab-740e-4176-8a4c-7e8bb7d16480 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:40.842935 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-11b803ab-740e-4176-8a4c-7e8bb7d16480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:40.896556 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9757ad-9c82-40ba-87c3-c3943ce65dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:40.897236 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9757ad-9c82-40ba-87c3-c3943ce65dd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:40.897511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9757ad-9c82-40ba-87c3-c3943ce65dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:40.897790 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9757ad-9c82-40ba-87c3-c3943ce65dd3 admin admin] PATH_INFO: `/v3/projects/144510a42b5d45fbb1fc201c3cf91788/users/826b956d4c1e490f9ee1e90067cfb3bf/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:40.903407 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9757ad-9c82-40ba-87c3-c3943ce65dd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=144510a42b5d45fbb1fc201c3cf91788, user_id=826b956d4c1e490f9ee1e90067cfb3bf, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:40.906275 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9757ad-9c82-40ba-87c3-c3943ce65dd3 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:40.947486 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3248/6440] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:17:40 2022] PUT /identity/v3/projects/144510a42b5d45fbb1fc201c3cf91788/users/826b956d4c1e490f9ee1e90067cfb3bf/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:40.949083 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26996289-7faf-4982-aa76-c422e858c187 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:40.949371 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26996289-7faf-4982-aa76-c422e858c187 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:40.949644 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26996289-7faf-4982-aa76-c422e858c187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:40.996400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:41.000624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b803ab-740e-4176-8a4c-7e8bb7d16480 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:41.053130 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-26996289-7faf-4982-aa76-c422e858c187 None None] MFA Rules not processed for user `826b956d4c1e490f9ee1e90067cfb3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:41.054384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-26996289-7faf-4982-aa76-c422e858c187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:41.080390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6057b-3c3f-4c10-9cb3-7f788dd9b6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:41.082665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6057b-3c3f-4c10-9cb3-7f788dd9b6d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:41.082991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6057b-3c3f-4c10-9cb3-7f788dd9b6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:41.092022 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6057b-3c3f-4c10-9cb3-7f788dd9b6d1 admin admin] PATH_INFO: `/v3/users/3ac7953232974ac985d9e30ff77e9cc0` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:41.094515 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae6057b-3c3f-4c10-9cb3-7f788dd9b6d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ac7953232974ac985d9e30ff77e9cc0)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:41.111135 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae6057b-3c3f-4c10-9cb3-7f788dd9b6d1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:41.220724 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6ae6057b-3c3f-4c10-9cb3-7f788dd9b6d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ac7953232974ac985d9e30ff77e9cc0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:41.221470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6ae6057b-3c3f-4c10-9cb3-7f788dd9b6d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ac7953232974ac985d9e30ff77e9cc0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:41.222201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6ae6057b-3c3f-4c10-9cb3-7f788dd9b6d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ac7953232974ac985d9e30ff77e9cc0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:41.242838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6ae6057b-3c3f-4c10-9cb3-7f788dd9b6d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ac7953232974ac985d9e30ff77e9cc0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:41.255772 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3249/6441] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:40 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:41.257956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26996289-7faf-4982-aa76-c422e858c187 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:41.264535 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-26996289-7faf-4982-aa76-c422e858c187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:41.276524 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6ae6057b-3c3f-4c10-9cb3-7f788dd9b6d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ac7953232974ac985d9e30ff77e9cc0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:41.291732 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26996289-7faf-4982-aa76-c422e858c187 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:41.303378 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f62573-dc02-47b2-afc3-4df20f1296ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:41.303982 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f62573-dc02-47b2-afc3-4df20f1296ae admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:41.305411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f62573-dc02-47b2-afc3-4df20f1296ae admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:41.305558 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f62573-dc02-47b2-afc3-4df20f1296ae admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:41.307508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f62573-dc02-47b2-afc3-4df20f1296ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:41.311447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f62573-dc02-47b2-afc3-4df20f1296ae admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:41.311775 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3193/6442] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:17:40 2022] DELETE /identity/v3/users/3ac7953232974ac985d9e30ff77e9cc0 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:41.425207 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3250/6443] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:17:41 2022] POST /identity/v3/projects => generated 385 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:41.429641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6057b-3c3f-4c10-9cb3-7f788dd9b6d1 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:41.432012 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6ae6057b-3c3f-4c10-9cb3-7f788dd9b6d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:41.558219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6057b-3c3f-4c10-9cb3-7f788dd9b6d1 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:41.613297 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:41.720144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f5ac8-756d-483c-af7a-eabe2b5e945d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:41.722068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f5ac8-756d-483c-af7a-eabe2b5e945d admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:41.723280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f5ac8-756d-483c-af7a-eabe2b5e945d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:41.723890 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f5ac8-756d-483c-af7a-eabe2b5e945d admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:41.726371 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f5ac8-756d-483c-af7a-eabe2b5e945d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:41.729406 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f5ac8-756d-483c-af7a-eabe2b5e945d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:41.787035 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3194/6444] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:17:41 2022] POST /identity/v3/users => generated 293 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:41.790242 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f62573-dc02-47b2-afc3-4df20f1296ae admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:41.814484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f62573-dc02-47b2-afc3-4df20f1296ae admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:41.828750 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3a0ce-dca9-4d18-888a-b8eca5dd7ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:41.829394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3a0ce-dca9-4d18-888a-b8eca5dd7ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:41.829673 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3a0ce-dca9-4d18-888a-b8eca5dd7ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:41.829944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3a0ce-dca9-4d18-888a-b8eca5dd7ea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:41.834668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e3a0ce-dca9-4d18-888a-b8eca5dd7ea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:41.836229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e3a0ce-dca9-4d18-888a-b8eca5dd7ea8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:41.858381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:41.876622 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3251/6445] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:17:41.878197 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f5ac8-756d-483c-af7a-eabe2b5e945d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:41.889879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f5ac8-756d-483c-af7a-eabe2b5e945d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:41.916553 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a3897-82fc-409e-9a6a-6021738e1b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:41.917203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a3897-82fc-409e-9a6a-6021738e1b8b admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:41.917480 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a3897-82fc-409e-9a6a-6021738e1b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:41.917758 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a3897-82fc-409e-9a6a-6021738e1b8b admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:41.918417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a3897-82fc-409e-9a6a-6021738e1b8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:41.928389 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a3897-82fc-409e-9a6a-6021738e1b8b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:41.956366 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3195/6446] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:17:41.960653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3a0ce-dca9-4d18-888a-b8eca5dd7ea8 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:41.974388 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3a0ce-dca9-4d18-888a-b8eca5dd7ea8 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:41.984232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfa0d8-13c9-41d4-a9d7-a0856229f0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:41.989250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfa0d8-13c9-41d4-a9d7-a0856229f0e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:41.989706 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfa0d8-13c9-41d4-a9d7-a0856229f0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:41.990099 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfa0d8-13c9-41d4-a9d7-a0856229f0e6 admin admin] PATH_INFO: `/v3/projects/344a626ee5734b65a5f3d8113e7e2cc5/users/5c6d9f2321864d788f1394069fb8ac43/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:42.017644 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dfa0d8-13c9-41d4-a9d7-a0856229f0e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=344a626ee5734b65a5f3d8113e7e2cc5, user_id=5c6d9f2321864d788f1394069fb8ac43, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:42.021093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dfa0d8-13c9-41d4-a9d7-a0856229f0e6 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:42.074627 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3252/6447] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:17:41 2022] PUT /identity/v3/projects/344a626ee5734b65a5f3d8113e7e2cc5/users/5c6d9f2321864d788f1394069fb8ac43/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:42.080313 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04655a5c-a795-4962-9b6e-51398a525aa8 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:42.080601 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04655a5c-a795-4962-9b6e-51398a525aa8 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:42.080878 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04655a5c-a795-4962-9b6e-51398a525aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:42.136752 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-04655a5c-a795-4962-9b6e-51398a525aa8 None None] MFA Rules not processed for user `5c6d9f2321864d788f1394069fb8ac43`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:42.138303 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-04655a5c-a795-4962-9b6e-51398a525aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:42.257818 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3196/6448] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:42.272143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfa0d8-13c9-41d4-a9d7-a0856229f0e6 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:42.274132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-69dfa0d8-13c9-41d4-a9d7-a0856229f0e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:42.415219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfa0d8-13c9-41d4-a9d7-a0856229f0e6 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:42.419422 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515615e-e679-4bd0-811f-007eff794ac8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10759b2abd4cafacf338551327775e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:42.420116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515615e-e679-4bd0-811f-007eff794ac8 service glance] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:42.420396 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515615e-e679-4bd0-811f-007eff794ac8 service glance] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:42.420668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515615e-e679-4bd0-811f-007eff794ac8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:42.422458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1515615e-e679-4bd0-811f-007eff794ac8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:42.554997 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515615e-e679-4bd0-811f-007eff794ac8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:42.560940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515615e-e679-4bd0-811f-007eff794ac8 service glance] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:42.593669 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3253/6449] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:17:42 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:17:42.875605 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04655a5c-a795-4962-9b6e-51398a525aa8 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:42.878321 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-04655a5c-a795-4962-9b6e-51398a525aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:43.033669 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04655a5c-a795-4962-9b6e-51398a525aa8 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:43.040005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6914c34-38f0-4248-9e49-2d7f7a3c124b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:43.046163 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6914c34-38f0-4248-9e49-2d7f7a3c124b service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:43.046574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6914c34-38f0-4248-9e49-2d7f7a3c124b service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:43.047455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6914c34-38f0-4248-9e49-2d7f7a3c124b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:43.058864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d6914c34-38f0-4248-9e49-2d7f7a3c124b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:43.174933 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:43.213558 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6914c34-38f0-4248-9e49-2d7f7a3c124b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:43.216851 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6914c34-38f0-4248-9e49-2d7f7a3c124b service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:43.254164 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3197/6450] 10.222.0.33 () {60 vars in 1396 bytes} [Sat Aug 6 21:17:42 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3254 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:17:43.584201 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515615e-e679-4bd0-811f-007eff794ac8 service glance] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:43.586879 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1515615e-e679-4bd0-811f-007eff794ac8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:43.831399 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515615e-e679-4bd0-811f-007eff794ac8 service glance] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:43.843827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241b31d-1851-4e93-a9ba-52ff9d9738ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:43.844635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241b31d-1851-4e93-a9ba-52ff9d9738ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:43.844925 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241b31d-1851-4e93-a9ba-52ff9d9738ac admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:43.845198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241b31d-1851-4e93-a9ba-52ff9d9738ac admin admin] PATH_INFO: `/v3/projects/713828c70ae64552b6702bd77d3de0bb` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:43.848190 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241b31d-1851-4e93-a9ba-52ff9d9738ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=713828c70ae64552b6702bd77d3de0bb)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:43.852259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241b31d-1851-4e93-a9ba-52ff9d9738ac admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:43.880029 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:43.930448 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6914c34-38f0-4248-9e49-2d7f7a3c124b service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:43.953240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6914c34-38f0-4248-9e49-2d7f7a3c124b service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:43.968880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e241b31d-1851-4e93-a9ba-52ff9d9738ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '713828c70ae64552b6702bd77d3de0bb', 'request_id': 'req-e241b31d-1851-4e93-a9ba-52ff9d9738ac'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:43.975987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e241b31d-1851-4e93-a9ba-52ff9d9738ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '713828c70ae64552b6702bd77d3de0bb', 'request_id': 'req-e241b31d-1851-4e93-a9ba-52ff9d9738ac'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:43.995970 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e241b31d-1851-4e93-a9ba-52ff9d9738ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '713828c70ae64552b6702bd77d3de0bb', 'request_id': 'req-e241b31d-1851-4e93-a9ba-52ff9d9738ac'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:44.012721 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e241b31d-1851-4e93-a9ba-52ff9d9738ac admin admin] The token cache is being invalidate because project 713828c70ae64552b6702bd77d3de0bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:17:44.013014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e241b31d-1851-4e93-a9ba-52ff9d9738ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:44.016820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e241b31d-1851-4e93-a9ba-52ff9d9738ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:44.025057 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3254/6451] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:17:43 2022] DELETE /identity/v3/projects/713828c70ae64552b6702bd77d3de0bb => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:44.027331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0319e-cef0-4883-bcc9-62d450953a22 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:44.027618 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0319e-cef0-4883-bcc9-62d450953a22 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:44.027892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0319e-cef0-4883-bcc9-62d450953a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:44.088396 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-e1d0319e-cef0-4883-bcc9-62d450953a22 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:44.094484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e1d0319e-cef0-4883-bcc9-62d450953a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:44.104661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3e258-ab19-44a6-918d-9e0a5f3feeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:44.105284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3e258-ab19-44a6-918d-9e0a5f3feeb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:44.105568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3e258-ab19-44a6-918d-9e0a5f3feeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:44.105842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3e258-ab19-44a6-918d-9e0a5f3feeb6 admin admin] PATH_INFO: `/v3/users/826b956d4c1e490f9ee1e90067cfb3bf` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:44.109205 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3e258-ab19-44a6-918d-9e0a5f3feeb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=826b956d4c1e490f9ee1e90067cfb3bf)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:44.113630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3e258-ab19-44a6-918d-9e0a5f3feeb6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:44.117785 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3255/6452] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:44.126686 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f4a7a-4da2-4684-a29a-688a5730acfb None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:44.127053 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f4a7a-4da2-4684-a29a-688a5730acfb None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:44.127306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f4a7a-4da2-4684-a29a-688a5730acfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:44.183620 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-2e4f4a7a-4da2-4684-a29a-688a5730acfb None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:44.188023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2e4f4a7a-4da2-4684-a29a-688a5730acfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:44.206902 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3256/6453] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:17:44.222772 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f4a7a-4da2-4684-a29a-688a5730acfb None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:44.247841 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-40e3e258-ab19-44a6-918d-9e0a5f3feeb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '826b956d4c1e490f9ee1e90067cfb3bf'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:44.250647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-40e3e258-ab19-44a6-918d-9e0a5f3feeb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '826b956d4c1e490f9ee1e90067cfb3bf'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:44.251260 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f4a7a-4da2-4684-a29a-688a5730acfb None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:44.252207 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-40e3e258-ab19-44a6-918d-9e0a5f3feeb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '826b956d4c1e490f9ee1e90067cfb3bf'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:44.264707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a47ef5-1d3a-41a8-9db3-ae52f5c0cd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:44.265343 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a47ef5-1d3a-41a8-9db3-ae52f5c0cd83 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:44.265866 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a47ef5-1d3a-41a8-9db3-ae52f5c0cd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:44.266150 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a47ef5-1d3a-41a8-9db3-ae52f5c0cd83 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:44.267021 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a47ef5-1d3a-41a8-9db3-ae52f5c0cd83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:17:44.267333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a47ef5-1d3a-41a8-9db3-ae52f5c0cd83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:44.269332 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a47ef5-1d3a-41a8-9db3-ae52f5c0cd83 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:44.272261 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-40e3e258-ab19-44a6-918d-9e0a5f3feeb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '826b956d4c1e490f9ee1e90067cfb3bf'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:44.306894 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3257/6454] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:17:44.311169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-40e3e258-ab19-44a6-918d-9e0a5f3feeb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '826b956d4c1e490f9ee1e90067cfb3bf'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:44.311920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a47ef5-1d3a-41a8-9db3-ae52f5c0cd83 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:44.315525 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-55a47ef5-1d3a-41a8-9db3-ae52f5c0cd83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:44.343877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a47ef5-1d3a-41a8-9db3-ae52f5c0cd83 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:44.344109 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3198/6455] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:17:43 2022] DELETE /identity/v3/users/826b956d4c1e490f9ee1e90067cfb3bf => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:44.348689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198f0c6-c91a-4a1c-8810-8efef1db0694 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:44.348977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198f0c6-c91a-4a1c-8810-8efef1db0694 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:44.349256 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198f0c6-c91a-4a1c-8810-8efef1db0694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:44.393180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-1198f0c6-c91a-4a1c-8810-8efef1db0694 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:44.394860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1198f0c6-c91a-4a1c-8810-8efef1db0694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:44.498329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c0ad4-554b-4e5d-b0a0-6b9776e233d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:44.499150 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c0ad4-554b-4e5d-b0a0-6b9776e233d7 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:44.499543 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c0ad4-554b-4e5d-b0a0-6b9776e233d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:44.499952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c0ad4-554b-4e5d-b0a0-6b9776e233d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:44.500993 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c0ad4-554b-4e5d-b0a0-6b9776e233d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:44.503525 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c0ad4-554b-4e5d-b0a0-6b9776e233d7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:44.543227 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3199/6456] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:44.581977 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3258/6457] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:17:44 2022] POST /identity/v3/projects => generated 365 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:44.582227 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198f0c6-c91a-4a1c-8810-8efef1db0694 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:44.582835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1198f0c6-c91a-4a1c-8810-8efef1db0694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:44.583676 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c0ad4-554b-4e5d-b0a0-6b9776e233d7 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:44.589372 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:44.789651 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198f0c6-c91a-4a1c-8810-8efef1db0694 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:44.794512 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:44.811496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c0ad4-554b-4e5d-b0a0-6b9776e233d7 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:44.828879 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba21a6-476a-46c6-8768-7c2bec059043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:44.829513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba21a6-476a-46c6-8768-7c2bec059043 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:44.829796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba21a6-476a-46c6-8768-7c2bec059043 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:44.830087 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba21a6-476a-46c6-8768-7c2bec059043 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:44.830744 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba21a6-476a-46c6-8768-7c2bec059043 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:44.832781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba21a6-476a-46c6-8768-7c2bec059043 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:44.874611 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3259/6458] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:17:44 2022] POST /identity/v3/users => generated 283 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:17:44.877058 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba21a6-476a-46c6-8768-7c2bec059043 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:44.897438 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba21a6-476a-46c6-8768-7c2bec059043 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:44.906437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85260709-5dda-448f-9ffa-90d363c56ca2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:44.907112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85260709-5dda-448f-9ffa-90d363c56ca2 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:44.907388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85260709-5dda-448f-9ffa-90d363c56ca2 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:44.907660 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85260709-5dda-448f-9ffa-90d363c56ca2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:44.911291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e04c8c-90be-4fba-bcdf-de5a6b7b110b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:44.911932 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e04c8c-90be-4fba-bcdf-de5a6b7b110b admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:44.912215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e04c8c-90be-4fba-bcdf-de5a6b7b110b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:44.912493 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e04c8c-90be-4fba-bcdf-de5a6b7b110b admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:44.913149 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e04c8c-90be-4fba-bcdf-de5a6b7b110b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:44.914788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e04c8c-90be-4fba-bcdf-de5a6b7b110b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:44.921965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85260709-5dda-448f-9ffa-90d363c56ca2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:44.931732 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85260709-5dda-448f-9ffa-90d363c56ca2 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:44.943961 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3200/6459] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:17:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:17:44.954826 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3260/6460] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:17:44.955610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85260709-5dda-448f-9ffa-90d363c56ca2 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:44.966141 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85260709-5dda-448f-9ffa-90d363c56ca2 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:44.971534 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4621797-849a-406e-b46f-ff12336d701a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:44.972310 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4621797-849a-406e-b46f-ff12336d701a admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:44.972455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4621797-849a-406e-b46f-ff12336d701a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:44.972694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4621797-849a-406e-b46f-ff12336d701a admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:44.973339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4621797-849a-406e-b46f-ff12336d701a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:44.975368 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4621797-849a-406e-b46f-ff12336d701a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:44.990850 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3201/6461] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:17:44.994989 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e04c8c-90be-4fba-bcdf-de5a6b7b110b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:45.011081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e04c8c-90be-4fba-bcdf-de5a6b7b110b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:45.019579 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5aa5c2-2eff-477c-a050-646d542e010c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:45.020705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5aa5c2-2eff-477c-a050-646d542e010c admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:45.021256 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5aa5c2-2eff-477c-a050-646d542e010c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:45.022008 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5aa5c2-2eff-477c-a050-646d542e010c admin admin] PATH_INFO: `/v3/projects/a95d6e1a16664f7985d31059056c80bf/users/474d049780774a1bb88897fb1b910f72/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:45.047764 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5aa5c2-2eff-477c-a050-646d542e010c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a95d6e1a16664f7985d31059056c80bf, user_id=474d049780774a1bb88897fb1b910f72, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:45.060534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5aa5c2-2eff-477c-a050-646d542e010c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:45.107870 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3261/6462] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:17:44 2022] PUT /identity/v3/projects/a95d6e1a16664f7985d31059056c80bf/users/474d049780774a1bb88897fb1b910f72/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:45.121041 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a15d51-6fed-4318-9327-45f9dd7e77ae None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:45.121478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a15d51-6fed-4318-9327-45f9dd7e77ae None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:45.122282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a15d51-6fed-4318-9327-45f9dd7e77ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:45.195825 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-e8a15d51-6fed-4318-9327-45f9dd7e77ae None None] MFA Rules not processed for user `474d049780774a1bb88897fb1b910f72`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:45.198347 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e8a15d51-6fed-4318-9327-45f9dd7e77ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:45.336917 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3202/6463] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:45.339580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5aa5c2-2eff-477c-a050-646d542e010c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:45.498068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5aa5c2-2eff-477c-a050-646d542e010c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:45.504143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d7391-3b3c-49a4-83a1-cd2b3b571aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:45.504894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d7391-3b3c-49a4-83a1-cd2b3b571aba admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:45.505280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d7391-3b3c-49a4-83a1-cd2b3b571aba admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:45.505991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d7391-3b3c-49a4-83a1-cd2b3b571aba admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:45.506917 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d7391-3b3c-49a4-83a1-cd2b3b571aba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:45.530888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d7391-3b3c-49a4-83a1-cd2b3b571aba admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:45.607906 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3262/6464] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:17:45 2022] POST /identity/v3/projects => generated 365 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:45.610961 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a15d51-6fed-4318-9327-45f9dd7e77ae None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:45.646736 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a15d51-6fed-4318-9327-45f9dd7e77ae None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:45.780973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:45.820818 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a501d2-01b5-4750-99dc-acd7244c1735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:45.821921 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a501d2-01b5-4750-99dc-acd7244c1735 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:45.822911 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a501d2-01b5-4750-99dc-acd7244c1735 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:45.823200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a501d2-01b5-4750-99dc-acd7244c1735 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:45.824797 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a501d2-01b5-4750-99dc-acd7244c1735 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:45.828179 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a501d2-01b5-4750-99dc-acd7244c1735 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:45.878529 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3203/6465] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:17:45 2022] POST /identity/v3/users => generated 289 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:45.882282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d7391-3b3c-49a4-83a1-cd2b3b571aba admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:45.894923 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d7391-3b3c-49a4-83a1-cd2b3b571aba admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:45.916401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7da94-6e36-49ad-bfb6-816f9393f735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:45.917339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7da94-6e36-49ad-bfb6-816f9393f735 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:45.917765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7da94-6e36-49ad-bfb6-816f9393f735 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:45.918275 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7da94-6e36-49ad-bfb6-816f9393f735 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:45.919209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b7da94-6e36-49ad-bfb6-816f9393f735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:45.921190 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b7da94-6e36-49ad-bfb6-816f9393f735 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:45.939473 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3263/6466] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:17:45.943860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a501d2-01b5-4750-99dc-acd7244c1735 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:45.957805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a501d2-01b5-4750-99dc-acd7244c1735 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:45.970336 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf8910-c527-4443-8724-6e94bf7260b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:45.971211 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf8910-c527-4443-8724-6e94bf7260b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:45.971834 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf8910-c527-4443-8724-6e94bf7260b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:45.988056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f124a-f7f3-4122-875e-cce957c138a6 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:45.988360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f124a-f7f3-4122-875e-cce957c138a6 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:45.988617 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f124a-f7f3-4122-875e-cce957c138a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:45.997343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf8910-c527-4443-8724-6e94bf7260b3 admin admin] PATH_INFO: `/v3/projects/7496a6e2067c429288cd9c8dccf2c2fb/users/0f6681eeafe7422b95e850ba9cd39bef/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:46.032503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf8910-c527-4443-8724-6e94bf7260b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7496a6e2067c429288cd9c8dccf2c2fb, user_id=0f6681eeafe7422b95e850ba9cd39bef, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:46.036114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf8910-c527-4443-8724-6e94bf7260b3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:46.038079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-ff5f124a-f7f3-4122-875e-cce957c138a6 None None] MFA Rules not processed for user `7cd539be9e3b426d9eb5bdba4697f849`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:46.039573 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ff5f124a-f7f3-4122-875e-cce957c138a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:46.082583 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3204/6467] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:17:45 2022] PUT /identity/v3/projects/7496a6e2067c429288cd9c8dccf2c2fb/users/0f6681eeafe7422b95e850ba9cd39bef/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:46.084349 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf8910-c527-4443-8724-6e94bf7260b3 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:46.169890 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3264/6468] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:46.175035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f124a-f7f3-4122-875e-cce957c138a6 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:46.179267 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ff5f124a-f7f3-4122-875e-cce957c138a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:46.229224 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f124a-f7f3-4122-875e-cce957c138a6 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:46.252392 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:46.274233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf8910-c527-4443-8724-6e94bf7260b3 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:46.288173 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7223ab-9c2d-4a8e-8d89-c7de9bbf9d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:46.288940 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7223ab-9c2d-4a8e-8d89-c7de9bbf9d5c admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:46.289077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7223ab-9c2d-4a8e-8d89-c7de9bbf9d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:46.289335 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7223ab-9c2d-4a8e-8d89-c7de9bbf9d5c admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:46.292319 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7223ab-9c2d-4a8e-8d89-c7de9bbf9d5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:46.295855 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7223ab-9c2d-4a8e-8d89-c7de9bbf9d5c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:46.320555 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3205/6469] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:17:46.325331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7223ab-9c2d-4a8e-8d89-c7de9bbf9d5c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:46.340290 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7223ab-9c2d-4a8e-8d89-c7de9bbf9d5c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:46.350923 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd714a40-de56-4688-82bf-fa0b4338bd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:46.351961 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd714a40-de56-4688-82bf-fa0b4338bd02 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:46.352240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd714a40-de56-4688-82bf-fa0b4338bd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:46.352510 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd714a40-de56-4688-82bf-fa0b4338bd02 admin admin] PATH_INFO: `/v3/projects/7496a6e2067c429288cd9c8dccf2c2fb/users/0f6681eeafe7422b95e850ba9cd39bef/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:46.356011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd714a40-de56-4688-82bf-fa0b4338bd02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7496a6e2067c429288cd9c8dccf2c2fb, user_id=0f6681eeafe7422b95e850ba9cd39bef, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:46.360697 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd714a40-de56-4688-82bf-fa0b4338bd02 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:46.368151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b05c3-7a25-41a6-81d5-cd4701d78374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:46.369542 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b05c3-7a25-41a6-81d5-cd4701d78374 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:46.370128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b05c3-7a25-41a6-81d5-cd4701d78374 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:46.370514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b05c3-7a25-41a6-81d5-cd4701d78374 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:46.371182 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b05c3-7a25-41a6-81d5-cd4701d78374 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:46.373090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b05c3-7a25-41a6-81d5-cd4701d78374 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:46.391634 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3206/6470] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:17:46 2022] PUT /identity/v3/projects/7496a6e2067c429288cd9c8dccf2c2fb/users/0f6681eeafe7422b95e850ba9cd39bef/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:46.419456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7a87f-2d67-428e-8583-2975ecc67950 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:46.419950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7a87f-2d67-428e-8583-2975ecc67950 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:46.420386 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7a87f-2d67-428e-8583-2975ecc67950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:46.457441 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-dec7a87f-2d67-428e-8583-2975ecc67950 None None] MFA Rules not processed for user `0f6681eeafe7422b95e850ba9cd39bef`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:46.459086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-dec7a87f-2d67-428e-8583-2975ecc67950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:46.462155 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3265/6471] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:17:46 2022] POST /identity/v3/projects => generated 371 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:46.463295 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b05c3-7a25-41a6-81d5-cd4701d78374 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:46.562596 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3207/6472] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:46 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:46.566025 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7a87f-2d67-428e-8583-2975ecc67950 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:46.584162 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7a87f-2d67-428e-8583-2975ecc67950 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:46.587996 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b05c3-7a25-41a6-81d5-cd4701d78374 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:46.593920 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7caba-5112-4bc7-9cb8-e4568e543e22 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f6681eeafe7422b95e850ba9cd39bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7496a6e2067c429288cd9c8dccf2c2fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:46.594992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7caba-5112-4bc7-9cb8-e4568e543e22 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:46.596065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7caba-5112-4bc7-9cb8-e4568e543e22 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:46.596631 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7caba-5112-4bc7-9cb8-e4568e543e22 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] PATH_INFO: `/v3/regions` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:46.598145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c1136-2491-414e-aacf-2837fc9b552c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:46.598590 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7caba-5112-4bc7-9cb8-e4568e543e22 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:46.600133 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-3ff7caba-5112-4bc7-9cb8-e4568e543e22 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:17:46.600133 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:17:46.600133 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:17:46.601103 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c1136-2491-414e-aacf-2837fc9b552c admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:46.601521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c1136-2491-414e-aacf-2837fc9b552c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:46.601912 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c1136-2491-414e-aacf-2837fc9b552c admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:46.602344 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7caba-5112-4bc7-9cb8-e4568e543e22 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:46.605025 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c1136-2491-414e-aacf-2837fc9b552c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:46.607722 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c1136-2491-414e-aacf-2837fc9b552c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:46.616253 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:46.647581 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3208/6473] 10.222.0.33 () {60 vars in 1149 bytes} [Sat Aug 6 21:17:46 2022] POST /identity/v3/regions => generated 224 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:46.651235 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7caba-5112-4bc7-9cb8-e4568e543e22 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:46.662121 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3266/6474] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:17:46 2022] POST /identity/v3/users => generated 292 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:46.663375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c1136-2491-414e-aacf-2837fc9b552c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:46.686450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c1136-2491-414e-aacf-2837fc9b552c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:46.691390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7caba-5112-4bc7-9cb8-e4568e543e22 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:46.696849 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6a5fc-7f89-4464-8abd-d8476e47a56c tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f6681eeafe7422b95e850ba9cd39bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7496a6e2067c429288cd9c8dccf2c2fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:46.697514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6a5fc-7f89-4464-8abd-d8476e47a56c tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:46.697853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6a5fc-7f89-4464-8abd-d8476e47a56c tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:46.698133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6a5fc-7f89-4464-8abd-d8476e47a56c tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] PATH_INFO: `/v3/regions` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:46.699205 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f6a5fc-7f89-4464-8abd-d8476e47a56c tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:46.700557 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f6a5fc-7f89-4464-8abd-d8476e47a56c tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:46.718787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ca505-4283-4e9b-b8a8-1174c11dac3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:46.738925 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ca505-4283-4e9b-b8a8-1174c11dac3d admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:46.741356 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ca505-4283-4e9b-b8a8-1174c11dac3d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:46.742051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ca505-4283-4e9b-b8a8-1174c11dac3d admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:46.742877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ca505-4283-4e9b-b8a8-1174c11dac3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:46.744579 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ca505-4283-4e9b-b8a8-1174c11dac3d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:46.755817 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3209/6475] 10.222.0.33 () {60 vars in 1149 bytes} [Sat Aug 6 21:17:46 2022] POST /identity/v3/regions => generated 223 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:46.757255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6a5fc-7f89-4464-8abd-d8476e47a56c tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:46.791986 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3267/6476] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:17:46.792782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ca505-4283-4e9b-b8a8-1174c11dac3d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:46.810792 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6a5fc-7f89-4464-8abd-d8476e47a56c tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:46.811965 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ca505-4283-4e9b-b8a8-1174c11dac3d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:46.817929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94f267-90d9-4deb-ad69-b6ff4edbb354 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f6681eeafe7422b95e850ba9cd39bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7496a6e2067c429288cd9c8dccf2c2fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:46.817929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94f267-90d9-4deb-ad69-b6ff4edbb354 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:46.817929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94f267-90d9-4deb-ad69-b6ff4edbb354 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:46.818375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94f267-90d9-4deb-ad69-b6ff4edbb354 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] PATH_INFO: `/v3/regions/83bd705b-6449-417b-988f-d53c72baa561` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:46.818515 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94f267-90d9-4deb-ad69-b6ff4edbb354 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: Authorizing `identity:create_region(region_id=83bd705b-6449-417b-988f-d53c72baa561)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:46.820491 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94f267-90d9-4deb-ad69-b6ff4edbb354 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:46.846889 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3210/6477] 10.222.0.33 () {60 vars in 1259 bytes} [Sat Aug 6 21:17:46 2022] PUT /identity/v3/regions/83bd705b-6449-417b-988f-d53c72baa561 => generated 232 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:46.847885 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3134506-3a59-4848-8b3a-1e2182822d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:46.848640 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3134506-3a59-4848-8b3a-1e2182822d1d admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:46.848995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3134506-3a59-4848-8b3a-1e2182822d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:46.849562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3134506-3a59-4848-8b3a-1e2182822d1d admin admin] PATH_INFO: `/v3/projects/bf0a320c180344daaed438931e4d377b/users/adc1e4e45bcb4169a52153375140977d/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:46.852235 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94f267-90d9-4deb-ad69-b6ff4edbb354 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:46.882690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3134506-3a59-4848-8b3a-1e2182822d1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf0a320c180344daaed438931e4d377b, user_id=adc1e4e45bcb4169a52153375140977d, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:46.885791 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3134506-3a59-4848-8b3a-1e2182822d1d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:46.914580 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3268/6478] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:17:46 2022] PUT /identity/v3/projects/bf0a320c180344daaed438931e4d377b/users/adc1e4e45bcb4169a52153375140977d/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:46.916714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3134506-3a59-4848-8b3a-1e2182822d1d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:46.927273 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94f267-90d9-4deb-ad69-b6ff4edbb354 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:47.010608 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:47.033093 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3da2b-d6ef-478b-86d0-3c107503f967 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f6681eeafe7422b95e850ba9cd39bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7496a6e2067c429288cd9c8dccf2c2fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:47.034568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3da2b-d6ef-478b-86d0-3c107503f967 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:47.035249 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3da2b-d6ef-478b-86d0-3c107503f967 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:47.036001 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3da2b-d6ef-478b-86d0-3c107503f967 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] PATH_INFO: `/v3/regions/83bd705b-6449-417b-988f-d53c72baa561` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:47.036813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3da2b-d6ef-478b-86d0-3c107503f967 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: Authorizing `identity:delete_region(region_id=83bd705b-6449-417b-988f-d53c72baa561)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:47.039271 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3da2b-d6ef-478b-86d0-3c107503f967 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:47.073309 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3211/6479] 10.222.0.33 () {58 vars in 1242 bytes} [Sat Aug 6 21:17:46 2022] DELETE /identity/v3/regions/83bd705b-6449-417b-988f-d53c72baa561 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:47.075097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3134506-3a59-4848-8b3a-1e2182822d1d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:47.079725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3da2b-d6ef-478b-86d0-3c107503f967 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:47.097237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53554c-4d1e-48a2-a6d5-ee9f4408ddb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:47.097897 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53554c-4d1e-48a2-a6d5-ee9f4408ddb0 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:47.098230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53554c-4d1e-48a2-a6d5-ee9f4408ddb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:47.098579 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53554c-4d1e-48a2-a6d5-ee9f4408ddb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:47.099283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f53554c-4d1e-48a2-a6d5-ee9f4408ddb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:47.101067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f53554c-4d1e-48a2-a6d5-ee9f4408ddb0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:47.115735 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3269/6480] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:17:47.129528 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53554c-4d1e-48a2-a6d5-ee9f4408ddb0 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:47.133323 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3da2b-d6ef-478b-86d0-3c107503f967 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:47.153793 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea8e75-b3ca-4e53-a36b-18bf18d7ded6 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f6681eeafe7422b95e850ba9cd39bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7496a6e2067c429288cd9c8dccf2c2fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:47.154422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea8e75-b3ca-4e53-a36b-18bf18d7ded6 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:47.154728 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea8e75-b3ca-4e53-a36b-18bf18d7ded6 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:47.154999 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea8e75-b3ca-4e53-a36b-18bf18d7ded6 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] PATH_INFO: `/v3/regions` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:47.155646 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea8e75-b3ca-4e53-a36b-18bf18d7ded6 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:47.157443 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea8e75-b3ca-4e53-a36b-18bf18d7ded6 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:47.159878 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53554c-4d1e-48a2-a6d5-ee9f4408ddb0 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:47.171677 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0aabf9-f8ea-493b-a2b7-e2687167eeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:47.172360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0aabf9-f8ea-493b-a2b7-e2687167eeaf admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:47.172638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0aabf9-f8ea-493b-a2b7-e2687167eeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:47.173015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0aabf9-f8ea-493b-a2b7-e2687167eeaf admin admin] PATH_INFO: `/v3/projects/bf0a320c180344daaed438931e4d377b/users/adc1e4e45bcb4169a52153375140977d/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:47.178632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0aabf9-f8ea-493b-a2b7-e2687167eeaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf0a320c180344daaed438931e4d377b, user_id=adc1e4e45bcb4169a52153375140977d, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:47.182218 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0aabf9-f8ea-493b-a2b7-e2687167eeaf admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:47.203420 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3212/6481] 10.222.0.33 () {60 vars in 1150 bytes} [Sat Aug 6 21:17:47 2022] POST /identity/v3/regions => generated 253 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:47.206716 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea8e75-b3ca-4e53-a36b-18bf18d7ded6 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:47.209458 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3270/6482] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:17:47 2022] PUT /identity/v3/projects/bf0a320c180344daaed438931e4d377b/users/adc1e4e45bcb4169a52153375140977d/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:47.236861 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea8e75-b3ca-4e53-a36b-18bf18d7ded6 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:47.310591 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:47.340158 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3982e-8e0b-42f3-8a5b-a987455cf2c3 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f6681eeafe7422b95e850ba9cd39bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7496a6e2067c429288cd9c8dccf2c2fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:47.340916 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3982e-8e0b-42f3-8a5b-a987455cf2c3 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:47.342883 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3982e-8e0b-42f3-8a5b-a987455cf2c3 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:47.343508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3982e-8e0b-42f3-8a5b-a987455cf2c3 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] PATH_INFO: `/v3/regions/418cefa924dc455b8e6f3cd2a6a9d800` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:47.344356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad3982e-8e0b-42f3-8a5b-a987455cf2c3 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: Authorizing `identity:update_region(region_id=418cefa924dc455b8e6f3cd2a6a9d800)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:47.345483 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-8ad3982e-8e0b-42f3-8a5b-a987455cf2c3 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:17:47.345483 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:17:47.345483 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:17:47.346532 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad3982e-8e0b-42f3-8a5b-a987455cf2c3 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:47.384611 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3213/6483] 10.222.0.33 () {60 vars in 1250 bytes} [Sat Aug 6 21:17:47 2022] PATCH /identity/v3/regions/418cefa924dc455b8e6f3cd2a6a9d800 => generated 253 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:17:47.388782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0aabf9-f8ea-493b-a2b7-e2687167eeaf admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:47.402813 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0aabf9-f8ea-493b-a2b7-e2687167eeaf admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:47.448670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa50d8-db2d-4652-a966-843cffd07674 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f6681eeafe7422b95e850ba9cd39bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7496a6e2067c429288cd9c8dccf2c2fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:47.450077 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa50d8-db2d-4652-a966-843cffd07674 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:47.450477 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa50d8-db2d-4652-a966-843cffd07674 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:47.450900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa50d8-db2d-4652-a966-843cffd07674 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] PATH_INFO: `/v3/regions/418cefa924dc455b8e6f3cd2a6a9d800` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:47.455312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa50d8-db2d-4652-a966-843cffd07674 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: Authorizing `identity:get_region(region_id=418cefa924dc455b8e6f3cd2a6a9d800)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:47.456566 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa50d8-db2d-4652-a966-843cffd07674 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:47.472363 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3271/6484] 10.222.0.33 () {58 vars in 1227 bytes} [Sat Aug 6 21:17:47 2022] GET /identity/v3/regions/418cefa924dc455b8e6f3cd2a6a9d800 => generated 253 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:17:47.475771 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3982e-8e0b-42f3-8a5b-a987455cf2c3 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:47.493214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3982e-8e0b-42f3-8a5b-a987455cf2c3 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:47.500287 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a24f9-6648-4207-a1d5-4d3cbc1fe47d tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f6681eeafe7422b95e850ba9cd39bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7496a6e2067c429288cd9c8dccf2c2fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:47.501030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a24f9-6648-4207-a1d5-4d3cbc1fe47d tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:47.501303 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a24f9-6648-4207-a1d5-4d3cbc1fe47d tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:47.501611 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a24f9-6648-4207-a1d5-4d3cbc1fe47d tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] PATH_INFO: `/v3/regions/418cefa924dc455b8e6f3cd2a6a9d800` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:47.502965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a24f9-6648-4207-a1d5-4d3cbc1fe47d tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: Authorizing `identity:delete_region(region_id=418cefa924dc455b8e6f3cd2a6a9d800)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:47.503985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a24f9-6648-4207-a1d5-4d3cbc1fe47d tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:47.536398 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3214/6485] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:17:47 2022] DELETE /identity/v3/regions/418cefa924dc455b8e6f3cd2a6a9d800 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:47.538750 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa50d8-db2d-4652-a966-843cffd07674 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:47.553516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa50d8-db2d-4652-a966-843cffd07674 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:47.561273 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a24f9-6648-4207-a1d5-4d3cbc1fe47d tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:47.563667 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-919a24f9-6648-4207-a1d5-4d3cbc1fe47d tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:47.578344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0a0d4-46b9-452d-a672-fc1e9f0452fd tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f6681eeafe7422b95e850ba9cd39bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7496a6e2067c429288cd9c8dccf2c2fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:47.579384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0a0d4-46b9-452d-a672-fc1e9f0452fd tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:47.580095 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0a0d4-46b9-452d-a672-fc1e9f0452fd tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:47.580766 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0a0d4-46b9-452d-a672-fc1e9f0452fd tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] PATH_INFO: `/v3/regions` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:47.581703 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0a0d4-46b9-452d-a672-fc1e9f0452fd tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:47.583746 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0a0d4-46b9-452d-a672-fc1e9f0452fd tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:47.606523 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3272/6486] 10.222.0.33 () {58 vars in 1128 bytes} [Sat Aug 6 21:17:47 2022] GET /identity/v3/regions => generated 669 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:17:47.610462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0a0d4-46b9-452d-a672-fc1e9f0452fd tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:47.630606 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0a0d4-46b9-452d-a672-fc1e9f0452fd tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:47.643436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188bda02-9f9d-4dad-a1b9-ab71cdb912fe tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f6681eeafe7422b95e850ba9cd39bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7496a6e2067c429288cd9c8dccf2c2fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:47.644347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bda02-9f9d-4dad-a1b9-ab71cdb912fe tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:47.644758 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bda02-9f9d-4dad-a1b9-ab71cdb912fe tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:47.645141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bda02-9f9d-4dad-a1b9-ab71cdb912fe tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] PATH_INFO: `/v3/regions/418cefa924dc455b8e6f3cd2a6a9d800` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:47.645842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188bda02-9f9d-4dad-a1b9-ab71cdb912fe tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: Authorizing `identity:delete_region(region_id=418cefa924dc455b8e6f3cd2a6a9d800)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:47.647856 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188bda02-9f9d-4dad-a1b9-ab71cdb912fe tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:47.667738 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-188bda02-9f9d-4dad-a1b9-ab71cdb912fe tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] Could not find region: 418cefa924dc455b8e6f3cd2a6a9d800.: keystone.exception.RegionNotFound: Could not find region: 418cefa924dc455b8e6f3cd2a6a9d800. Aug 06 21:17:47.667738 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:17:47.667738 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Aug 06 21:17:47.667738 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Aug 06 21:17:47.667738 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Aug 06 21:17:47.667738 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Aug 06 21:17:47.667738 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Aug 06 21:17:47.667738 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Aug 06 21:17:47.667738 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 418cefa924dc455b8e6f3cd2a6a9d800. Aug 06 21:17:47.667738 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:17:47.667738 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 21:17:47.667738 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:17:47.667738 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:17:47.667738 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:17:47.667738 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:17:47.667738 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:17:47.669310 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:17:47.669310 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:17:47.669310 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:17:47.669310 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:17:47.669310 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:17:47.669310 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:17:47.669310 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:17:47.669310 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Aug 06 21:17:47.669310 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Aug 06 21:17:47.669310 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:17:47.669310 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:17:47.669310 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Aug 06 21:17:47.669310 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Aug 06 21:17:47.669310 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 418cefa924dc455b8e6f3cd2a6a9d800. Aug 06 21:17:47.669310 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:17:47.669310 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3273/6487] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:17:47 2022] DELETE /identity/v3/regions/418cefa924dc455b8e6f3cd2a6a9d800 => generated 112 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:17:47.674730 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188bda02-9f9d-4dad-a1b9-ab71cdb912fe tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:47.695237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188bda02-9f9d-4dad-a1b9-ab71cdb912fe tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:47.711903 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e85393-0265-498e-9164-e56cccc3a332 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f6681eeafe7422b95e850ba9cd39bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7496a6e2067c429288cd9c8dccf2c2fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:47.712749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e85393-0265-498e-9164-e56cccc3a332 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:47.714896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e85393-0265-498e-9164-e56cccc3a332 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:47.715831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e85393-0265-498e-9164-e56cccc3a332 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] PATH_INFO: `/v3/regions` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:47.717268 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e85393-0265-498e-9164-e56cccc3a332 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:47.720061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e85393-0265-498e-9164-e56cccc3a332 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:47.737788 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3274/6488] 10.222.0.33 () {58 vars in 1128 bytes} [Sat Aug 6 21:17:47 2022] GET /identity/v3/regions => generated 669 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:17:47.742337 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e85393-0265-498e-9164-e56cccc3a332 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:47.744519 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a24f9-6648-4207-a1d5-4d3cbc1fe47d tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:47.756368 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801b07d-002b-45a1-ae3d-c309bc69b29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:47.758640 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801b07d-002b-45a1-ae3d-c309bc69b29f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:47.761774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801b07d-002b-45a1-ae3d-c309bc69b29f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:47.762288 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801b07d-002b-45a1-ae3d-c309bc69b29f admin admin] PATH_INFO: `/v3/projects/144510a42b5d45fbb1fc201c3cf91788` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:47.763250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e85393-0265-498e-9164-e56cccc3a332 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:47.764112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e801b07d-002b-45a1-ae3d-c309bc69b29f admin admin] RBAC: Authorizing `identity:delete_project(project_id=144510a42b5d45fbb1fc201c3cf91788)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:47.767329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e801b07d-002b-45a1-ae3d-c309bc69b29f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:47.780624 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380dce05-2620-4402-abe6-6c0af75c59c9 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f6681eeafe7422b95e850ba9cd39bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7496a6e2067c429288cd9c8dccf2c2fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:47.781530 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380dce05-2620-4402-abe6-6c0af75c59c9 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:47.782163 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380dce05-2620-4402-abe6-6c0af75c59c9 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:47.783386 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380dce05-2620-4402-abe6-6c0af75c59c9 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] PATH_INFO: `/v3/regions` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:47.784327 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380dce05-2620-4402-abe6-6c0af75c59c9 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:47.785565 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-380dce05-2620-4402-abe6-6c0af75c59c9 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:17:47.785565 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:17:47.785565 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:17:47.786893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380dce05-2620-4402-abe6-6c0af75c59c9 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:47.833523 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3275/6489] 10.222.0.33 () {60 vars in 1150 bytes} [Sat Aug 6 21:17:47 2022] POST /identity/v3/regions => generated 254 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:17:47.837608 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380dce05-2620-4402-abe6-6c0af75c59c9 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:47.890195 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380dce05-2620-4402-abe6-6c0af75c59c9 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:47.897547 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e801b07d-002b-45a1-ae3d-c309bc69b29f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '144510a42b5d45fbb1fc201c3cf91788', 'request_id': 'req-e801b07d-002b-45a1-ae3d-c309bc69b29f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:47.911973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e801b07d-002b-45a1-ae3d-c309bc69b29f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '144510a42b5d45fbb1fc201c3cf91788', 'request_id': 'req-e801b07d-002b-45a1-ae3d-c309bc69b29f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:47.927637 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e801b07d-002b-45a1-ae3d-c309bc69b29f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '144510a42b5d45fbb1fc201c3cf91788', 'request_id': 'req-e801b07d-002b-45a1-ae3d-c309bc69b29f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:47.955943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e801b07d-002b-45a1-ae3d-c309bc69b29f admin admin] The token cache is being invalidate because project 144510a42b5d45fbb1fc201c3cf91788 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:17:47.956244 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e801b07d-002b-45a1-ae3d-c309bc69b29f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:47.958942 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e801b07d-002b-45a1-ae3d-c309bc69b29f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:47.960841 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3215/6490] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:17:47 2022] DELETE /identity/v3/projects/144510a42b5d45fbb1fc201c3cf91788 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:47.965417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801b07d-002b-45a1-ae3d-c309bc69b29f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:47.966884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e801b07d-002b-45a1-ae3d-c309bc69b29f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:48.025230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7102a1-2d87-497e-a4d6-a67a6ff62205 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f6681eeafe7422b95e850ba9cd39bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7496a6e2067c429288cd9c8dccf2c2fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:48.026066 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7102a1-2d87-497e-a4d6-a67a6ff62205 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:48.026663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7102a1-2d87-497e-a4d6-a67a6ff62205 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:48.027036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7102a1-2d87-497e-a4d6-a67a6ff62205 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] PATH_INFO: `/v3/regions` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:48.027791 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7102a1-2d87-497e-a4d6-a67a6ff62205 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: Adding query filter params (parent_region_id=fac802b2e80c4894aacb8c41b56ebddc) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:17:48.028315 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7102a1-2d87-497e-a4d6-a67a6ff62205 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:48.029443 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7102a1-2d87-497e-a4d6-a67a6ff62205 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:48.039710 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3276/6491] 10.222.0.33 () {58 vars in 1227 bytes} [Sat Aug 6 21:17:47 2022] GET /identity/v3/regions?parent_region_id=fac802b2e80c4894aacb8c41b56ebddc => generated 400 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:17:48.041526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7102a1-2d87-497e-a4d6-a67a6ff62205 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:48.041695 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:UPDATE=1,keystone:DELETE=8,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:48.045935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2e7102a1-2d87-497e-a4d6-a67a6ff62205 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:48.080683 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7102a1-2d87-497e-a4d6-a67a6ff62205 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:48.088341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95401d-30f9-403c-9008-4beab1ed0059 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f6681eeafe7422b95e850ba9cd39bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7496a6e2067c429288cd9c8dccf2c2fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:48.089076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95401d-30f9-403c-9008-4beab1ed0059 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:48.089365 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95401d-30f9-403c-9008-4beab1ed0059 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:48.089669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95401d-30f9-403c-9008-4beab1ed0059 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] PATH_INFO: `/v3/regions/a66ed225deb14db795caffdd827a3b1d` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:48.090507 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95401d-30f9-403c-9008-4beab1ed0059 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: Authorizing `identity:delete_region(region_id=a66ed225deb14db795caffdd827a3b1d)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:48.092418 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95401d-30f9-403c-9008-4beab1ed0059 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:48.117645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801b07d-002b-45a1-ae3d-c309bc69b29f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:48.140201 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3277/6492] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:17:48 2022] DELETE /identity/v3/regions/a66ed225deb14db795caffdd827a3b1d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:48.145224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d994667-c0da-4617-974e-0cc44d7d18df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:48.145934 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d994667-c0da-4617-974e-0cc44d7d18df admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:48.146232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d994667-c0da-4617-974e-0cc44d7d18df admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:48.146601 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d994667-c0da-4617-974e-0cc44d7d18df admin admin] PATH_INFO: `/v3/users/5c6d9f2321864d788f1394069fb8ac43` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:48.147011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95401d-30f9-403c-9008-4beab1ed0059 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:48.148038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d994667-c0da-4617-974e-0cc44d7d18df admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c6d9f2321864d788f1394069fb8ac43)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:48.150280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d994667-c0da-4617-974e-0cc44d7d18df admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:48.155975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:48.187166 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95401d-30f9-403c-9008-4beab1ed0059 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:48.194887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4e4cf-c778-40fa-8bba-b15f2f85a65c tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f6681eeafe7422b95e850ba9cd39bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7496a6e2067c429288cd9c8dccf2c2fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:48.196169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4e4cf-c778-40fa-8bba-b15f2f85a65c tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:48.219279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4e4cf-c778-40fa-8bba-b15f2f85a65c tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:48.219616 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4e4cf-c778-40fa-8bba-b15f2f85a65c tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] PATH_INFO: `/v3/regions/f047541959c045c3a969a8ac94cd685c` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:48.220373 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4e4cf-c778-40fa-8bba-b15f2f85a65c tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: Authorizing `identity:delete_region(region_id=f047541959c045c3a969a8ac94cd685c)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:48.228377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4e4cf-c778-40fa-8bba-b15f2f85a65c tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:48.233105 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8d994667-c0da-4617-974e-0cc44d7d18df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c6d9f2321864d788f1394069fb8ac43'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:48.234414 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8d994667-c0da-4617-974e-0cc44d7d18df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c6d9f2321864d788f1394069fb8ac43'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:48.239416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8d994667-c0da-4617-974e-0cc44d7d18df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c6d9f2321864d788f1394069fb8ac43'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:48.251046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8d994667-c0da-4617-974e-0cc44d7d18df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c6d9f2321864d788f1394069fb8ac43'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:48.271155 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8d994667-c0da-4617-974e-0cc44d7d18df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c6d9f2321864d788f1394069fb8ac43'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:48.293457 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3278/6494] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:17:48 2022] DELETE /identity/v3/regions/f047541959c045c3a969a8ac94cd685c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:48.294466 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3216/6494] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:17:47 2022] DELETE /identity/v3/users/5c6d9f2321864d788f1394069fb8ac43 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:17:48.297239 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4e4cf-c778-40fa-8bba-b15f2f85a65c tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:48.306582 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d2c4e4cf-c778-40fa-8bba-b15f2f85a65c tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:48.346345 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4e4cf-c778-40fa-8bba-b15f2f85a65c tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:48.432397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3700d40-654d-4607-8386-e1ac1a826d76 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f6681eeafe7422b95e850ba9cd39bef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7496a6e2067c429288cd9c8dccf2c2fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:48.432397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3700d40-654d-4607-8386-e1ac1a826d76 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:48.432844 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3700d40-654d-4607-8386-e1ac1a826d76 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:48.432944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3700d40-654d-4607-8386-e1ac1a826d76 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] PATH_INFO: `/v3/regions/fac802b2e80c4894aacb8c41b56ebddc` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:48.433542 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3700d40-654d-4607-8386-e1ac1a826d76 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: Authorizing `identity:delete_region(region_id=fac802b2e80c4894aacb8c41b56ebddc)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:48.435198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3700d40-654d-4607-8386-e1ac1a826d76 tempest-RegionsTestJSON-857458819 tempest-RegionsTestJSON-857458819-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:48.462340 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3279/6495] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:17:48 2022] DELETE /identity/v3/regions/fac802b2e80c4894aacb8c41b56ebddc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:48.466470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d994667-c0da-4617-974e-0cc44d7d18df admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:48.468682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8d994667-c0da-4617-974e-0cc44d7d18df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:48.624113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d994667-c0da-4617-974e-0cc44d7d18df admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:48.657663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b4277-c3c0-4f2e-b84b-fcf4a9c7f934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:48.658464 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b4277-c3c0-4f2e-b84b-fcf4a9c7f934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:48.658668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b4277-c3c0-4f2e-b84b-fcf4a9c7f934 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:48.658906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b4277-c3c0-4f2e-b84b-fcf4a9c7f934 admin admin] PATH_INFO: `/v3/users/474d049780774a1bb88897fb1b910f72` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:48.663102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b4277-c3c0-4f2e-b84b-fcf4a9c7f934 admin admin] RBAC: Authorizing `identity:delete_user(user_id=474d049780774a1bb88897fb1b910f72)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:48.667736 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b4277-c3c0-4f2e-b84b-fcf4a9c7f934 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:48.762869 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:48.797332 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d55b4277-c3c0-4f2e-b84b-fcf4a9c7f934 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '474d049780774a1bb88897fb1b910f72'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:48.797332 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d55b4277-c3c0-4f2e-b84b-fcf4a9c7f934 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '474d049780774a1bb88897fb1b910f72'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:48.797770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d55b4277-c3c0-4f2e-b84b-fcf4a9c7f934 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '474d049780774a1bb88897fb1b910f72'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:48.816881 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d55b4277-c3c0-4f2e-b84b-fcf4a9c7f934 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '474d049780774a1bb88897fb1b910f72'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:48.838265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d55b4277-c3c0-4f2e-b84b-fcf4a9c7f934 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '474d049780774a1bb88897fb1b910f72'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:48.855841 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3217/6496] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:17:48 2022] DELETE /identity/v3/users/474d049780774a1bb88897fb1b910f72 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:48.860417 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43dc0ba-cbfd-4e06-88f2-63263ceae960 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:48.860716 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43dc0ba-cbfd-4e06-88f2-63263ceae960 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:48.861061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43dc0ba-cbfd-4e06-88f2-63263ceae960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:48.892084 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-e43dc0ba-cbfd-4e06-88f2-63263ceae960 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:48.893840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e43dc0ba-cbfd-4e06-88f2-63263ceae960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:48.991803 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3280/6497] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:49.090032 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b4277-c3c0-4f2e-b84b-fcf4a9c7f934 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:49.092572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d55b4277-c3c0-4f2e-b84b-fcf4a9c7f934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:49.359711 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b4277-c3c0-4f2e-b84b-fcf4a9c7f934 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:49.366149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e572c2-8bf7-427f-aa1a-8e62b3808630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:49.367124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e572c2-8bf7-427f-aa1a-8e62b3808630 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:49.369749 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e572c2-8bf7-427f-aa1a-8e62b3808630 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:49.370535 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e572c2-8bf7-427f-aa1a-8e62b3808630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:49.393960 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e572c2-8bf7-427f-aa1a-8e62b3808630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:49.395929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e572c2-8bf7-427f-aa1a-8e62b3808630 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:49.424512 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3218/6498] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:17:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:17:50.355064 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43dc0ba-cbfd-4e06-88f2-63263ceae960 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:50.357242 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e43dc0ba-cbfd-4e06-88f2-63263ceae960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:50.383004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43dc0ba-cbfd-4e06-88f2-63263ceae960 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:50.411846 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1fe68-5585-45c8-a17f-216d480c6f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:50.412713 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1fe68-5585-45c8-a17f-216d480c6f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:50.413193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1fe68-5585-45c8-a17f-216d480c6f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:50.413633 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1fe68-5585-45c8-a17f-216d480c6f90 admin admin] PATH_INFO: `/v3/projects/344a626ee5734b65a5f3d8113e7e2cc5` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:50.415135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f1fe68-5585-45c8-a17f-216d480c6f90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=344a626ee5734b65a5f3d8113e7e2cc5)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:50.417794 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f1fe68-5585-45c8-a17f-216d480c6f90 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:50.543968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:50.550987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-67f1fe68-5585-45c8-a17f-216d480c6f90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '344a626ee5734b65a5f3d8113e7e2cc5', 'request_id': 'req-67f1fe68-5585-45c8-a17f-216d480c6f90'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:50.564499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-67f1fe68-5585-45c8-a17f-216d480c6f90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '344a626ee5734b65a5f3d8113e7e2cc5', 'request_id': 'req-67f1fe68-5585-45c8-a17f-216d480c6f90'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:50.584760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-67f1fe68-5585-45c8-a17f-216d480c6f90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '344a626ee5734b65a5f3d8113e7e2cc5', 'request_id': 'req-67f1fe68-5585-45c8-a17f-216d480c6f90'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:50.607605 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-67f1fe68-5585-45c8-a17f-216d480c6f90 admin admin] The token cache is being invalidate because project 344a626ee5734b65a5f3d8113e7e2cc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:17:50.607839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-67f1fe68-5585-45c8-a17f-216d480c6f90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:50.608623 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-67f1fe68-5585-45c8-a17f-216d480c6f90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:50.610708 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3281/6499] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:17:50 2022] DELETE /identity/v3/projects/344a626ee5734b65a5f3d8113e7e2cc5 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:50.615358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72b0b9-ad07-43c7-843a-9315bfbeb65c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:50.615876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72b0b9-ad07-43c7-843a-9315bfbeb65c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:50.615876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72b0b9-ad07-43c7-843a-9315bfbeb65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:50.655117 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-ea72b0b9-ad07-43c7-843a-9315bfbeb65c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:50.656357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ea72b0b9-ad07-43c7-843a-9315bfbeb65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:50.834387 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3219/6500] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:50.841774 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3b51e-8bc0-42bc-aaf3-bea6c64d9988 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:50.842061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3b51e-8bc0-42bc-aaf3-bea6c64d9988 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:50.842340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3b51e-8bc0-42bc-aaf3-bea6c64d9988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:50.879661 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-7ba3b51e-8bc0-42bc-aaf3-bea6c64d9988 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:50.881141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7ba3b51e-8bc0-42bc-aaf3-bea6c64d9988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:50.896007 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3282/6501] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:50.900145 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72b0b9-ad07-43c7-843a-9315bfbeb65c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:50.934748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72b0b9-ad07-43c7-843a-9315bfbeb65c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:50.942791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb3b5c-ffae-4f87-9243-d04092655e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:50.943789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb3b5c-ffae-4f87-9243-d04092655e6f admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:50.944529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb3b5c-ffae-4f87-9243-d04092655e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:50.945809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb3b5c-ffae-4f87-9243-d04092655e6f admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:50.947096 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb3b5c-ffae-4f87-9243-d04092655e6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:17:50.947830 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb3b5c-ffae-4f87-9243-d04092655e6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:50.952267 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb3b5c-ffae-4f87-9243-d04092655e6f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:50.970685 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3220/6502] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:17:50.974305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3b51e-8bc0-42bc-aaf3-bea6c64d9988 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:50.989658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3b51e-8bc0-42bc-aaf3-bea6c64d9988 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:50.996257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40040224-005b-43ce-867d-ab725cfe99e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:50.997098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40040224-005b-43ce-867d-ab725cfe99e1 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:50.997487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40040224-005b-43ce-867d-ab725cfe99e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:50.997870 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40040224-005b-43ce-867d-ab725cfe99e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:50.998752 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40040224-005b-43ce-867d-ab725cfe99e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:51.002072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40040224-005b-43ce-867d-ab725cfe99e1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:51.040482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb3b5c-ffae-4f87-9243-d04092655e6f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:51.043939 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-34fb3b5c-ffae-4f87-9243-d04092655e6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:51.056256 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3283/6503] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:17:50 2022] POST /identity/v3/projects => generated 379 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:51.059288 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40040224-005b-43ce-867d-ab725cfe99e1 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:51.074213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb3b5c-ffae-4f87-9243-d04092655e6f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:51.166628 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:51.230827 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a59f8-3a32-4021-8bb2-a8d0fadc76c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:51.231707 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a59f8-3a32-4021-8bb2-a8d0fadc76c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:51.232214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a59f8-3a32-4021-8bb2-a8d0fadc76c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:51.232605 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a59f8-3a32-4021-8bb2-a8d0fadc76c5 admin admin] PATH_INFO: `/v3/projects/a95d6e1a16664f7985d31059056c80bf` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:51.234675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a59f8-3a32-4021-8bb2-a8d0fadc76c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a95d6e1a16664f7985d31059056c80bf)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:51.237166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a59f8-3a32-4021-8bb2-a8d0fadc76c5 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:51.255379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40040224-005b-43ce-867d-ab725cfe99e1 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:51.269400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7fa6e7-49b7-4699-bb2e-c9cd299ec9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:51.270054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fa6e7-49b7-4699-bb2e-c9cd299ec9b4 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:51.270294 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fa6e7-49b7-4699-bb2e-c9cd299ec9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:51.270587 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fa6e7-49b7-4699-bb2e-c9cd299ec9b4 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:51.271860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7fa6e7-49b7-4699-bb2e-c9cd299ec9b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:51.284120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7fa6e7-49b7-4699-bb2e-c9cd299ec9b4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:51.345622 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3284/6504] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:17:51 2022] POST /identity/v3/users => generated 290 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:51.346745 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7fa6e7-49b7-4699-bb2e-c9cd299ec9b4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:51.356911 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7f2a59f8-3a32-4021-8bb2-a8d0fadc76c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a95d6e1a16664f7985d31059056c80bf', 'request_id': 'req-7f2a59f8-3a32-4021-8bb2-a8d0fadc76c5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:51.360630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7fa6e7-49b7-4699-bb2e-c9cd299ec9b4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:51.364745 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7f2a59f8-3a32-4021-8bb2-a8d0fadc76c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a95d6e1a16664f7985d31059056c80bf', 'request_id': 'req-7f2a59f8-3a32-4021-8bb2-a8d0fadc76c5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:51.373486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7f2a59f8-3a32-4021-8bb2-a8d0fadc76c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a95d6e1a16664f7985d31059056c80bf', 'request_id': 'req-7f2a59f8-3a32-4021-8bb2-a8d0fadc76c5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:51.396568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7f2a59f8-3a32-4021-8bb2-a8d0fadc76c5 admin admin] The token cache is being invalidate because project a95d6e1a16664f7985d31059056c80bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:17:51.396913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7f2a59f8-3a32-4021-8bb2-a8d0fadc76c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:51.398611 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7f2a59f8-3a32-4021-8bb2-a8d0fadc76c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:51.402080 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3221/6505] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:17:51 2022] DELETE /identity/v3/projects/a95d6e1a16664f7985d31059056c80bf => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:17:51.406094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a59f8-3a32-4021-8bb2-a8d0fadc76c5 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:51.409195 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7f2a59f8-3a32-4021-8bb2-a8d0fadc76c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:51.455333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f815e50-7f55-4f78-b2a1-bd13f2c62b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:51.456726 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f815e50-7f55-4f78-b2a1-bd13f2c62b49 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:51.457183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f815e50-7f55-4f78-b2a1-bd13f2c62b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:51.457647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f815e50-7f55-4f78-b2a1-bd13f2c62b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:51.458480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f815e50-7f55-4f78-b2a1-bd13f2c62b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:51.461261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f815e50-7f55-4f78-b2a1-bd13f2c62b49 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:51.476537 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3285/6506] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:17:51.482409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f815e50-7f55-4f78-b2a1-bd13f2c62b49 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:51.485884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4f815e50-7f55-4f78-b2a1-bd13f2c62b49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:51.510177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f815e50-7f55-4f78-b2a1-bd13f2c62b49 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:51.517874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d39ac8-78ef-40db-bdfd-5c497072c326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:51.519329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d39ac8-78ef-40db-bdfd-5c497072c326 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:51.520460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d39ac8-78ef-40db-bdfd-5c497072c326 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:51.521828 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d39ac8-78ef-40db-bdfd-5c497072c326 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:51.522802 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d39ac8-78ef-40db-bdfd-5c497072c326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:51.527562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d39ac8-78ef-40db-bdfd-5c497072c326 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:51.547892 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3286/6507] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:17:51.551634 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a59f8-3a32-4021-8bb2-a8d0fadc76c5 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:51.552296 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d39ac8-78ef-40db-bdfd-5c497072c326 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:51.566012 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d39ac8-78ef-40db-bdfd-5c497072c326 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:51.573488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f5eee-0934-4c96-ba0c-010b76897f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:51.574752 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f5eee-0934-4c96-ba0c-010b76897f56 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:51.575466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f5eee-0934-4c96-ba0c-010b76897f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:51.576014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f5eee-0934-4c96-ba0c-010b76897f56 admin admin] PATH_INFO: `/v3/projects/8bf5b46848de4dc6b03ddbb9ff727885/users/7e67155b603248eaa94138dc9dcb1ea3/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:51.576809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac0425-6e4b-491b-99c7-6a01909b1f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:51.577542 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac0425-6e4b-491b-99c7-6a01909b1f91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:51.577895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac0425-6e4b-491b-99c7-6a01909b1f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:51.578289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac0425-6e4b-491b-99c7-6a01909b1f91 admin admin] PATH_INFO: `/v3/users/0f6681eeafe7422b95e850ba9cd39bef` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:51.583499 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac0425-6e4b-491b-99c7-6a01909b1f91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f6681eeafe7422b95e850ba9cd39bef)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:51.585579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac0425-6e4b-491b-99c7-6a01909b1f91 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:51.609700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f5eee-0934-4c96-ba0c-010b76897f56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bf5b46848de4dc6b03ddbb9ff727885, user_id=7e67155b603248eaa94138dc9dcb1ea3, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:51.612701 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f5eee-0934-4c96-ba0c-010b76897f56 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:51.624360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=4,keystone:SELECT=90,keystone:INSERT=6 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:51.645729 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3287/6508] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:17:51 2022] PUT /identity/v3/projects/8bf5b46848de4dc6b03ddbb9ff727885/users/7e67155b603248eaa94138dc9dcb1ea3/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:17:51.658191 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809cb05-ff24-4a16-ae55-c05279c587f8 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:51.658588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809cb05-ff24-4a16-ae55-c05279c587f8 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:51.658944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809cb05-ff24-4a16-ae55-c05279c587f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:51.687770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-cbac0425-6e4b-491b-99c7-6a01909b1f91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f6681eeafe7422b95e850ba9cd39bef'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:51.695964 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-cbac0425-6e4b-491b-99c7-6a01909b1f91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f6681eeafe7422b95e850ba9cd39bef'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:51.697216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-cbac0425-6e4b-491b-99c7-6a01909b1f91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f6681eeafe7422b95e850ba9cd39bef'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:51.711393 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-cbac0425-6e4b-491b-99c7-6a01909b1f91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f6681eeafe7422b95e850ba9cd39bef'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:51.712891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-0809cb05-ff24-4a16-ae55-c05279c587f8 None None] MFA Rules not processed for user `7e67155b603248eaa94138dc9dcb1ea3`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:51.717945 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0809cb05-ff24-4a16-ae55-c05279c587f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:51.745443 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:51.758213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-cbac0425-6e4b-491b-99c7-6a01909b1f91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f6681eeafe7422b95e850ba9cd39bef'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:51.786996 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3222/6509] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:17:51 2022] DELETE /identity/v3/users/0f6681eeafe7422b95e850ba9cd39bef => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:17:51.844504 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3288/6510] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:17:51.854100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac0425-6e4b-491b-99c7-6a01909b1f91 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:51.855395 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-cbac0425-6e4b-491b-99c7-6a01909b1f91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:51.986226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac0425-6e4b-491b-99c7-6a01909b1f91 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:51.992454 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513391f-d823-41e1-afc6-9a64e7ea803f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10759b2abd4cafacf338551327775e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:51.995132 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513391f-d823-41e1-afc6-9a64e7ea803f service glance] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:51.995726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513391f-d823-41e1-afc6-9a64e7ea803f service glance] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:51.996414 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513391f-d823-41e1-afc6-9a64e7ea803f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:52.097490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8513391f-d823-41e1-afc6-9a64e7ea803f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:52.105030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8513391f-d823-41e1-afc6-9a64e7ea803f service glance] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:52.126434 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3223/6511] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:17:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:17:52.538809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809cb05-ff24-4a16-ae55-c05279c587f8 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:52.542028 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0809cb05-ff24-4a16-ae55-c05279c587f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:52.705525 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809cb05-ff24-4a16-ae55-c05279c587f8 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:52.817327 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b05b1-4d25-4196-8d9d-c61c933fa6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:52.817847 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b05b1-4d25-4196-8d9d-c61c933fa6f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:52.818321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b05b1-4d25-4196-8d9d-c61c933fa6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:52.818705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b05b1-4d25-4196-8d9d-c61c933fa6f1 admin admin] PATH_INFO: `/v3/users/7e67155b603248eaa94138dc9dcb1ea3` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:52.819938 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b05b1-4d25-4196-8d9d-c61c933fa6f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e67155b603248eaa94138dc9dcb1ea3)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:52.822719 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b05b1-4d25-4196-8d9d-c61c933fa6f1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:52.901233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:52.927588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-665b05b1-4d25-4196-8d9d-c61c933fa6f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e67155b603248eaa94138dc9dcb1ea3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:52.943986 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-665b05b1-4d25-4196-8d9d-c61c933fa6f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e67155b603248eaa94138dc9dcb1ea3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:52.947504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-665b05b1-4d25-4196-8d9d-c61c933fa6f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e67155b603248eaa94138dc9dcb1ea3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:52.948232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-665b05b1-4d25-4196-8d9d-c61c933fa6f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e67155b603248eaa94138dc9dcb1ea3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:52.969348 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-665b05b1-4d25-4196-8d9d-c61c933fa6f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e67155b603248eaa94138dc9dcb1ea3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:52.999701 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3289/6512] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:17:52 2022] DELETE /identity/v3/users/7e67155b603248eaa94138dc9dcb1ea3 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:53.001743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f45eaf-fb40-4317-8e15-a4e82318dd84 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:53.003509 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f45eaf-fb40-4317-8e15-a4e82318dd84 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:53.004586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f45eaf-fb40-4317-8e15-a4e82318dd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:53.063053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a6f45eaf-fb40-4317-8e15-a4e82318dd84 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:53.064824 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a6f45eaf-fb40-4317-8e15-a4e82318dd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:53.227911 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3224/6513] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:53.307143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b05b1-4d25-4196-8d9d-c61c933fa6f1 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:53.308703 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-665b05b1-4d25-4196-8d9d-c61c933fa6f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:53.406319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b05b1-4d25-4196-8d9d-c61c933fa6f1 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:53.411541 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112a78c-d370-4bfd-8d8f-c176d74332df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:53.412448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112a78c-d370-4bfd-8d8f-c176d74332df service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:53.412864 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112a78c-d370-4bfd-8d8f-c176d74332df service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:53.413081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112a78c-d370-4bfd-8d8f-c176d74332df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:53.424735 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7112a78c-d370-4bfd-8d8f-c176d74332df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:53.426392 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7112a78c-d370-4bfd-8d8f-c176d74332df service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:53.445982 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3290/6514] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:17:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:17:54.733150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f45eaf-fb40-4317-8e15-a4e82318dd84 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:54.734811 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a6f45eaf-fb40-4317-8e15-a4e82318dd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:54.750864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f45eaf-fb40-4317-8e15-a4e82318dd84 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:54.772283 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c7b2c-18a8-4c96-b474-cf631c5ec0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:54.773027 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c7b2c-18a8-4c96-b474-cf631c5ec0a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:54.773370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c7b2c-18a8-4c96-b474-cf631c5ec0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:54.773727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c7b2c-18a8-4c96-b474-cf631c5ec0a5 admin admin] PATH_INFO: `/v3/projects/7496a6e2067c429288cd9c8dccf2c2fb` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:54.776500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c7b2c-18a8-4c96-b474-cf631c5ec0a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7496a6e2067c429288cd9c8dccf2c2fb)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:54.778808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c7b2c-18a8-4c96-b474-cf631c5ec0a5 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:54.821611 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:54.902049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d01c7b2c-18a8-4c96-b474-cf631c5ec0a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7496a6e2067c429288cd9c8dccf2c2fb', 'request_id': 'req-d01c7b2c-18a8-4c96-b474-cf631c5ec0a5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:54.911253 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d01c7b2c-18a8-4c96-b474-cf631c5ec0a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7496a6e2067c429288cd9c8dccf2c2fb', 'request_id': 'req-d01c7b2c-18a8-4c96-b474-cf631c5ec0a5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:54.946429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d01c7b2c-18a8-4c96-b474-cf631c5ec0a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7496a6e2067c429288cd9c8dccf2c2fb', 'request_id': 'req-d01c7b2c-18a8-4c96-b474-cf631c5ec0a5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:54.977218 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d01c7b2c-18a8-4c96-b474-cf631c5ec0a5 admin admin] The token cache is being invalidate because project 7496a6e2067c429288cd9c8dccf2c2fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:17:54.978181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d01c7b2c-18a8-4c96-b474-cf631c5ec0a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:54.980541 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d01c7b2c-18a8-4c96-b474-cf631c5ec0a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:54.989513 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3225/6515] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:17:54 2022] DELETE /identity/v3/projects/7496a6e2067c429288cd9c8dccf2c2fb => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:54.991070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca26bc-96dc-4c1c-9f91-58f15165f2de None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:54.991564 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca26bc-96dc-4c1c-9f91-58f15165f2de None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:54.991564 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca26bc-96dc-4c1c-9f91-58f15165f2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:55.054816 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-65ca26bc-96dc-4c1c-9f91-58f15165f2de None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:55.061267 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-65ca26bc-96dc-4c1c-9f91-58f15165f2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:55.262863 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3291/6516] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:55.270919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c46b4-709a-4311-bf30-4805a9b0f5da None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:55.271215 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c46b4-709a-4311-bf30-4805a9b0f5da None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:55.271485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c46b4-709a-4311-bf30-4805a9b0f5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:55.316651 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-525c46b4-709a-4311-bf30-4805a9b0f5da None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:55.317903 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-525c46b4-709a-4311-bf30-4805a9b0f5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:55.367268 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3226/6517] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:55.371428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca26bc-96dc-4c1c-9f91-58f15165f2de None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:55.389963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca26bc-96dc-4c1c-9f91-58f15165f2de None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:55.412639 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27295e10-7f95-4df3-94cb-b3ecfa41104b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:55.413432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27295e10-7f95-4df3-94cb-b3ecfa41104b admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:55.413710 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27295e10-7f95-4df3-94cb-b3ecfa41104b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:55.413979 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27295e10-7f95-4df3-94cb-b3ecfa41104b admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:55.414668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27295e10-7f95-4df3-94cb-b3ecfa41104b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:17:55.415545 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27295e10-7f95-4df3-94cb-b3ecfa41104b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:55.423486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27295e10-7f95-4df3-94cb-b3ecfa41104b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:55.463108 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3292/6518] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:17:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:17:55.467199 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c46b4-709a-4311-bf30-4805a9b0f5da None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:55.477956 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c46b4-709a-4311-bf30-4805a9b0f5da None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:55.485021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb20cf-8afd-4c37-b627-bd13f3d8f8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:55.485648 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb20cf-8afd-4c37-b627-bd13f3d8f8ab admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:55.485924 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb20cf-8afd-4c37-b627-bd13f3d8f8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:55.486352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb20cf-8afd-4c37-b627-bd13f3d8f8ab admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:55.496832 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb20cf-8afd-4c37-b627-bd13f3d8f8ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:55.498980 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb20cf-8afd-4c37-b627-bd13f3d8f8ab admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:55.561237 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3227/6519] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:17:55 2022] POST /identity/v3/projects => generated 379 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:55.565479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27295e10-7f95-4df3-94cb-b3ecfa41104b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:55.577743 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27295e10-7f95-4df3-94cb-b3ecfa41104b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:55.714312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:55.758272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92901790-b973-4d6a-b530-d6252a98f469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:55.759206 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92901790-b973-4d6a-b530-d6252a98f469 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:55.759486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92901790-b973-4d6a-b530-d6252a98f469 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:55.759758 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92901790-b973-4d6a-b530-d6252a98f469 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:55.760404 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92901790-b973-4d6a-b530-d6252a98f469 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:55.765119 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92901790-b973-4d6a-b530-d6252a98f469 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:55.801538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb20cf-8afd-4c37-b627-bd13f3d8f8ab admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:55.803437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-44eb20cf-8afd-4c37-b627-bd13f3d8f8ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:55.816954 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3293/6520] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:17:55 2022] POST /identity/v3/users => generated 296 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:55.818623 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92901790-b973-4d6a-b530-d6252a98f469 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:55.826151 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb20cf-8afd-4c37-b627-bd13f3d8f8ab admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:55.839083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6fa43-0da4-4c0f-a917-a6e12ccbc921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:55.839787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6fa43-0da4-4c0f-a917-a6e12ccbc921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:55.840072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6fa43-0da4-4c0f-a917-a6e12ccbc921 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:55.840479 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6fa43-0da4-4c0f-a917-a6e12ccbc921 admin admin] PATH_INFO: `/v3/projects/8bf5b46848de4dc6b03ddbb9ff727885` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:55.840612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92901790-b973-4d6a-b530-d6252a98f469 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:55.842820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6fa43-0da4-4c0f-a917-a6e12ccbc921 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bf5b46848de4dc6b03ddbb9ff727885)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:55.844771 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6fa43-0da4-4c0f-a917-a6e12ccbc921 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:55.855158 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e05be-ce2b-4e48-a24e-43661ccd2a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:55.855784 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e05be-ce2b-4e48-a24e-43661ccd2a97 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:55.856069 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e05be-ce2b-4e48-a24e-43661ccd2a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:55.856340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e05be-ce2b-4e48-a24e-43661ccd2a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:55.856988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e05be-ce2b-4e48-a24e-43661ccd2a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:55.858609 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e05be-ce2b-4e48-a24e-43661ccd2a97 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:55.891487 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3294/6521] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:17:55.893835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e05be-ce2b-4e48-a24e-43661ccd2a97 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:55.922385 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e05be-ce2b-4e48-a24e-43661ccd2a97 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:55.932856 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65989d54-17fb-4058-890d-4eb85b179d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:55.933849 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65989d54-17fb-4058-890d-4eb85b179d92 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:55.934305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65989d54-17fb-4058-890d-4eb85b179d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:55.934758 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65989d54-17fb-4058-890d-4eb85b179d92 admin admin] PATH_INFO: `/v3/projects/8c21c83fedd84cb28bdf229001436006/users/1c88704f18494e0f9a844646fa5db497/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:55.954718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-74a6fa43-0da4-4c0f-a917-a6e12ccbc921 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bf5b46848de4dc6b03ddbb9ff727885', 'request_id': 'req-74a6fa43-0da4-4c0f-a917-a6e12ccbc921'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:55.968992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-74a6fa43-0da4-4c0f-a917-a6e12ccbc921 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bf5b46848de4dc6b03ddbb9ff727885', 'request_id': 'req-74a6fa43-0da4-4c0f-a917-a6e12ccbc921'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:55.970906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65989d54-17fb-4058-890d-4eb85b179d92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c21c83fedd84cb28bdf229001436006, user_id=1c88704f18494e0f9a844646fa5db497, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:55.975905 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65989d54-17fb-4058-890d-4eb85b179d92 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:55.980875 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-74a6fa43-0da4-4c0f-a917-a6e12ccbc921 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bf5b46848de4dc6b03ddbb9ff727885', 'request_id': 'req-74a6fa43-0da4-4c0f-a917-a6e12ccbc921'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:56.019675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-74a6fa43-0da4-4c0f-a917-a6e12ccbc921 admin admin] The token cache is being invalidate because project 8bf5b46848de4dc6b03ddbb9ff727885 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:17:56.019970 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-74a6fa43-0da4-4c0f-a917-a6e12ccbc921 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:56.020819 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-74a6fa43-0da4-4c0f-a917-a6e12ccbc921 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:56.027813 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3228/6523] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:17:55 2022] DELETE /identity/v3/projects/8bf5b46848de4dc6b03ddbb9ff727885 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:56.032917 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6fa43-0da4-4c0f-a917-a6e12ccbc921 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:56.035213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-74a6fa43-0da4-4c0f-a917-a6e12ccbc921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:56.035564 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3295/6523] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:17:55 2022] PUT /identity/v3/projects/8c21c83fedd84cb28bdf229001436006/users/1c88704f18494e0f9a844646fa5db497/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:56.037679 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b31a0-ea2a-4988-b3a1-931a7a97424a None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:56.038428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b31a0-ea2a-4988-b3a1-931a7a97424a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:56.038755 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b31a0-ea2a-4988-b3a1-931a7a97424a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:56.082751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-938b31a0-ea2a-4988-b3a1-931a7a97424a None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:56.084893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-938b31a0-ea2a-4988-b3a1-931a7a97424a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:56.189794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6fa43-0da4-4c0f-a917-a6e12ccbc921 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:56.195858 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9cf47d-94af-43ed-a84a-39973f8af500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:56.196817 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cf47d-94af-43ed-a84a-39973f8af500 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:56.197610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cf47d-94af-43ed-a84a-39973f8af500 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:56.198112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cf47d-94af-43ed-a84a-39973f8af500 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:56.199048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9cf47d-94af-43ed-a84a-39973f8af500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:56.201686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9cf47d-94af-43ed-a84a-39973f8af500 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:56.206722 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3296/6524] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:56.207738 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b31a0-ea2a-4988-b3a1-931a7a97424a None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:56.209783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-938b31a0-ea2a-4988-b3a1-931a7a97424a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:56.212728 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:56.228026 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3229/6525] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:17:56.229871 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1877f-f8b5-4b4e-a0a0-ff724adb5b23 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:56.230357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1877f-f8b5-4b4e-a0a0-ff724adb5b23 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:56.231065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1877f-f8b5-4b4e-a0a0-ff724adb5b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:56.232223 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b31a0-ea2a-4988-b3a1-931a7a97424a None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:56.237394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a203b66-7c99-43f8-bc38-cdf3e35e2226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:56.238037 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a203b66-7c99-43f8-bc38-cdf3e35e2226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:56.238478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a203b66-7c99-43f8-bc38-cdf3e35e2226 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:56.238792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a203b66-7c99-43f8-bc38-cdf3e35e2226 admin admin] PATH_INFO: `/v3/users/258550683b604473a3a911a6d2dfa66b` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:56.239952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a203b66-7c99-43f8-bc38-cdf3e35e2226 admin admin] RBAC: Authorizing `identity:delete_user(user_id=258550683b604473a3a911a6d2dfa66b)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:56.241867 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a203b66-7c99-43f8-bc38-cdf3e35e2226 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:56.254375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-58e1877f-f8b5-4b4e-a0a0-ff724adb5b23 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:56.255909 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-58e1877f-f8b5-4b4e-a0a0-ff724adb5b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:56.268976 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3230/6526] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:56.269896 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1877f-f8b5-4b4e-a0a0-ff724adb5b23 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:56.287071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1877f-f8b5-4b4e-a0a0-ff724adb5b23 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:56.293241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596f2bb-d235-4dcb-b78e-7eb4ef8b5b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:56.294688 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596f2bb-d235-4dcb-b78e-7eb4ef8b5b2b admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:56.295152 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596f2bb-d235-4dcb-b78e-7eb4ef8b5b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:56.295708 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596f2bb-d235-4dcb-b78e-7eb4ef8b5b2b admin admin] PATH_INFO: `/v3/projects/8c21c83fedd84cb28bdf229001436006/users/1c88704f18494e0f9a844646fa5db497/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:56.297833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596f2bb-d235-4dcb-b78e-7eb4ef8b5b2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c21c83fedd84cb28bdf229001436006, user_id=1c88704f18494e0f9a844646fa5db497, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:56.304305 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596f2bb-d235-4dcb-b78e-7eb4ef8b5b2b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:56.304583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0a203b66-7c99-43f8-bc38-cdf3e35e2226 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '258550683b604473a3a911a6d2dfa66b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:56.316398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0a203b66-7c99-43f8-bc38-cdf3e35e2226 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '258550683b604473a3a911a6d2dfa66b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:56.317123 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0a203b66-7c99-43f8-bc38-cdf3e35e2226 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '258550683b604473a3a911a6d2dfa66b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:56.317998 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0a203b66-7c99-43f8-bc38-cdf3e35e2226 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '258550683b604473a3a911a6d2dfa66b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:56.323393 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3231/6527] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:17:56 2022] PUT /identity/v3/projects/8c21c83fedd84cb28bdf229001436006/users/1c88704f18494e0f9a844646fa5db497/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:56.326987 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596f2bb-d235-4dcb-b78e-7eb4ef8b5b2b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:56.332122 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7596f2bb-d235-4dcb-b78e-7eb4ef8b5b2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:56.340407 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0a203b66-7c99-43f8-bc38-cdf3e35e2226 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '258550683b604473a3a911a6d2dfa66b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:56.373374 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3297/6528] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:17:56 2022] DELETE /identity/v3/users/258550683b604473a3a911a6d2dfa66b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:56.373374 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fc187-2961-4560-b39c-af993006466f None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:56.373374 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fc187-2961-4560-b39c-af993006466f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:56.373374 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fc187-2961-4560-b39c-af993006466f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:56.402898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:56.417331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-2f9fc187-2961-4560-b39c-af993006466f None None] MFA Rules not processed for user `1c88704f18494e0f9a844646fa5db497`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:56.418716 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2f9fc187-2961-4560-b39c-af993006466f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:56.435049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596f2bb-d235-4dcb-b78e-7eb4ef8b5b2b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:56.511011 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3298/6529] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:56 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:56.511011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29384d90-2c9c-4ffb-a6ca-89cc793db585 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:56.511011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29384d90-2c9c-4ffb-a6ca-89cc793db585 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:56.511011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29384d90-2c9c-4ffb-a6ca-89cc793db585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:56.512175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09394a87-3592-4d26-8fdf-26b8279e432e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:56.514930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09394a87-3592-4d26-8fdf-26b8279e432e admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:56.514930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09394a87-3592-4d26-8fdf-26b8279e432e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:56.514930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09394a87-3592-4d26-8fdf-26b8279e432e admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:56.514930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09394a87-3592-4d26-8fdf-26b8279e432e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:17:56.514930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09394a87-3592-4d26-8fdf-26b8279e432e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:56.518578 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09394a87-3592-4d26-8fdf-26b8279e432e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:56.529525 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-29384d90-2c9c-4ffb-a6ca-89cc793db585 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:56.531148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-29384d90-2c9c-4ffb-a6ca-89cc793db585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:56.539604 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3232/6530] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:17:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:17:56.539604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09394a87-3592-4d26-8fdf-26b8279e432e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:56.541226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-09394a87-3592-4d26-8fdf-26b8279e432e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:56.549302 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3299/6531] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:56.549302 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29384d90-2c9c-4ffb-a6ca-89cc793db585 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:56.565140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09394a87-3592-4d26-8fdf-26b8279e432e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:56.570455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10172a38-804b-4645-8e70-ef9a30bb68c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:56.570976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29384d90-2c9c-4ffb-a6ca-89cc793db585 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:56.572378 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10172a38-804b-4645-8e70-ef9a30bb68c3 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:56.572728 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10172a38-804b-4645-8e70-ef9a30bb68c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:56.573255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10172a38-804b-4645-8e70-ef9a30bb68c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:56.574029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10172a38-804b-4645-8e70-ef9a30bb68c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:56.576118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10172a38-804b-4645-8e70-ef9a30bb68c3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:56.577956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc936da9-3859-454d-a508-e23e6758875e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:56.578809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc936da9-3859-454d-a508-e23e6758875e admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:56.579105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc936da9-3859-454d-a508-e23e6758875e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:56.579448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc936da9-3859-454d-a508-e23e6758875e admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:56.580256 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc936da9-3859-454d-a508-e23e6758875e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:56.582725 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc936da9-3859-454d-a508-e23e6758875e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:56.621396 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3233/6532] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:17:56 2022] POST /identity/v3/projects => generated 379 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:56.622631 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10172a38-804b-4645-8e70-ef9a30bb68c3 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:56.628035 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3300/6533] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:17:56 2022] POST /identity/v3/projects => generated 383 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:56.628220 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-10172a38-804b-4645-8e70-ef9a30bb68c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:56.628475 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc936da9-3859-454d-a508-e23e6758875e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:56.709194 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10172a38-804b-4645-8e70-ef9a30bb68c3 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:56.741912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:56.746281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc936da9-3859-454d-a508-e23e6758875e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:56.753343 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df6990-5711-4cd6-8b21-b3f03925a35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:56.754501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df6990-5711-4cd6-8b21-b3f03925a35c admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:56.754928 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df6990-5711-4cd6-8b21-b3f03925a35c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:56.756391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df6990-5711-4cd6-8b21-b3f03925a35c admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:56.757237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df6990-5711-4cd6-8b21-b3f03925a35c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:56.759808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df6990-5711-4cd6-8b21-b3f03925a35c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:56.775170 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ff6c5-78ea-4964-b0a5-0cdd8fdb9e1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:56.775898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ff6c5-78ea-4964-b0a5-0cdd8fdb9e1f service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:56.776273 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ff6c5-78ea-4964-b0a5-0cdd8fdb9e1f service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:56.777385 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ff6c5-78ea-4964-b0a5-0cdd8fdb9e1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:56.801088 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3301/6534] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:17:56 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:56.802049 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df6990-5711-4cd6-8b21-b3f03925a35c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:56.807526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ff6c5-78ea-4964-b0a5-0cdd8fdb9e1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:56.809023 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ff6c5-78ea-4964-b0a5-0cdd8fdb9e1f service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:56.832272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df6990-5711-4cd6-8b21-b3f03925a35c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:56.834826 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3234/6535] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:17:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:17:56.835797 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ff6c5-78ea-4964-b0a5-0cdd8fdb9e1f service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:56.850437 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ce5de-eea4-4736-94e9-498fe482a333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:56.851523 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ce5de-eea4-4736-94e9-498fe482a333 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:56.852052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ce5de-eea4-4736-94e9-498fe482a333 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:56.853434 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ce5de-eea4-4736-94e9-498fe482a333 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:56.857966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ce5de-eea4-4736-94e9-498fe482a333 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:56.860019 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ff6c5-78ea-4964-b0a5-0cdd8fdb9e1f service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:56.862809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ce5de-eea4-4736-94e9-498fe482a333 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:56.869329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e706d4-ca71-4559-a81b-9c713bec554d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:56.869945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e706d4-ca71-4559-a81b-9c713bec554d admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:56.870223 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e706d4-ca71-4559-a81b-9c713bec554d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:56.870492 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e706d4-ca71-4559-a81b-9c713bec554d admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:56.871158 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e706d4-ca71-4559-a81b-9c713bec554d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:56.872765 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e706d4-ca71-4559-a81b-9c713bec554d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:56.894941 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3302/6536] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:17:56 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:56.904780 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3235/6537] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:17:56.907492 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ce5de-eea4-4736-94e9-498fe482a333 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:56.925896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ce5de-eea4-4736-94e9-498fe482a333 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:56.936346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e706d4-ca71-4559-a81b-9c713bec554d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:56.942476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d5252-7e85-4ea4-aa9c-7c6d8522684a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:56.943345 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d5252-7e85-4ea4-aa9c-7c6d8522684a admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:56.943728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d5252-7e85-4ea4-aa9c-7c6d8522684a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:56.944175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d5252-7e85-4ea4-aa9c-7c6d8522684a admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:56.945083 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204d5252-7e85-4ea4-aa9c-7c6d8522684a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:56.948154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204d5252-7e85-4ea4-aa9c-7c6d8522684a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:56.952646 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e706d4-ca71-4559-a81b-9c713bec554d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:56.969856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891648a-8a48-40b2-a062-84ac2e4dbcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:56.970815 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891648a-8a48-40b2-a062-84ac2e4dbcf1 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:56.971281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891648a-8a48-40b2-a062-84ac2e4dbcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:56.971737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891648a-8a48-40b2-a062-84ac2e4dbcf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:56.972563 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f891648a-8a48-40b2-a062-84ac2e4dbcf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:56.975157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f891648a-8a48-40b2-a062-84ac2e4dbcf1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:56.981566 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3303/6538] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:17:56.985927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d5252-7e85-4ea4-aa9c-7c6d8522684a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:56.999969 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3236/6539] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:17:57.000983 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891648a-8a48-40b2-a062-84ac2e4dbcf1 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:57.002594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d5252-7e85-4ea4-aa9c-7c6d8522684a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:57.009184 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f68750-2b49-455b-ba3c-3e5498a6cedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:57.009946 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f68750-2b49-455b-ba3c-3e5498a6cedf admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:57.010627 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f68750-2b49-455b-ba3c-3e5498a6cedf admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:57.010765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f68750-2b49-455b-ba3c-3e5498a6cedf admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:57.011673 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f68750-2b49-455b-ba3c-3e5498a6cedf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:57.013499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f68750-2b49-455b-ba3c-3e5498a6cedf admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:57.019879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891648a-8a48-40b2-a062-84ac2e4dbcf1 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:57.025891 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20116d5-54e3-4796-93fe-82c608f43255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:57.026851 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20116d5-54e3-4796-93fe-82c608f43255 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:57.027150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20116d5-54e3-4796-93fe-82c608f43255 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:57.027466 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20116d5-54e3-4796-93fe-82c608f43255 admin admin] PATH_INFO: `/v3/projects/1fcd49305a9044c78659b1c3b649d742/users/23fb161d2deb415fb52a187f2005953f/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:57.040466 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3304/6540] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:17:57.051073 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f68750-2b49-455b-ba3c-3e5498a6cedf admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:57.071396 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f68750-2b49-455b-ba3c-3e5498a6cedf admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:57.079490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20116d5-54e3-4796-93fe-82c608f43255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fcd49305a9044c78659b1c3b649d742, user_id=23fb161d2deb415fb52a187f2005953f, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:57.082633 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f601d-9038-4c4f-bae2-8c453f70fbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:57.083317 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f601d-9038-4c4f-bae2-8c453f70fbb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:57.083567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f601d-9038-4c4f-bae2-8c453f70fbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:57.083853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f601d-9038-4c4f-bae2-8c453f70fbb4 admin admin] PATH_INFO: `/v3/projects/1d5621f54e6b42d199b5c2a936e1d4a9/users/833d0a7e5ac44cc7b004c2b67b9dca01/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:57.090686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20116d5-54e3-4796-93fe-82c608f43255 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:57.110531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:57.117343 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f601d-9038-4c4f-bae2-8c453f70fbb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d5621f54e6b42d199b5c2a936e1d4a9, user_id=833d0a7e5ac44cc7b004c2b67b9dca01, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:57.122942 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f601d-9038-4c4f-bae2-8c453f70fbb4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:57.136644 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3237/6541] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:17:56 2022] PUT /identity/v3/projects/1fcd49305a9044c78659b1c3b649d742/users/23fb161d2deb415fb52a187f2005953f/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:57.140042 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bb9bf-6014-401b-9ea6-e1c7104d017a None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:57.141409 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bb9bf-6014-401b-9ea6-e1c7104d017a None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:57.141700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bb9bf-6014-401b-9ea6-e1c7104d017a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:57.148962 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3305/6542] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:17:57 2022] PUT /identity/v3/projects/1d5621f54e6b42d199b5c2a936e1d4a9/users/833d0a7e5ac44cc7b004c2b67b9dca01/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:57.161393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c13e1-988d-44a5-9738-f2ededd0d8df None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:57.161730 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c13e1-988d-44a5-9738-f2ededd0d8df None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:57.162003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c13e1-988d-44a5-9738-f2ededd0d8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:57.202788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-b05bb9bf-6014-401b-9ea6-e1c7104d017a None None] MFA Rules not processed for user `23fb161d2deb415fb52a187f2005953f`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:57.204354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b05bb9bf-6014-401b-9ea6-e1c7104d017a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:57.223625 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-ed5c13e1-988d-44a5-9738-f2ededd0d8df None None] MFA Rules not processed for user `833d0a7e5ac44cc7b004c2b67b9dca01`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:57.224883 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ed5c13e1-988d-44a5-9738-f2ededd0d8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:57.299650 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3306/6543] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:17:57.300615 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c13e1-988d-44a5-9738-f2ededd0d8df None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:57.302034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ed5c13e1-988d-44a5-9738-f2ededd0d8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:57.330748 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3238/6544] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:57.336481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bb9bf-6014-401b-9ea6-e1c7104d017a None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:57.385577 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c13e1-988d-44a5-9738-f2ededd0d8df None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:57.390471 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac44c9-24ee-4634-b459-94d3e41a6206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:57.391321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac44c9-24ee-4634-b459-94d3e41a6206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:57.391611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac44c9-24ee-4634-b459-94d3e41a6206 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:57.391888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac44c9-24ee-4634-b459-94d3e41a6206 admin admin] PATH_INFO: `/v3/projects/d377913709df4f03852a61bfe4949870` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:57.393621 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac44c9-24ee-4634-b459-94d3e41a6206 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d377913709df4f03852a61bfe4949870)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:57.395594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac44c9-24ee-4634-b459-94d3e41a6206 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:57.412421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bb9bf-6014-401b-9ea6-e1c7104d017a None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:57.416937 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4f742-38be-485e-8289-a9f9c10029be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:57.417555 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4f742-38be-485e-8289-a9f9c10029be service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:57.418308 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4f742-38be-485e-8289-a9f9c10029be service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:57.418821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4f742-38be-485e-8289-a9f9c10029be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:57.431351 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4f742-38be-485e-8289-a9f9c10029be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:57.433977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4f742-38be-485e-8289-a9f9c10029be service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:57.448164 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3239/6545] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:17:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:17:57.449213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4f742-38be-485e-8289-a9f9c10029be service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:57.451054 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e1c4f742-38be-485e-8289-a9f9c10029be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:57.458219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:57.495699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9fac44c9-24ee-4634-b459-94d3e41a6206 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd377913709df4f03852a61bfe4949870', 'request_id': 'req-9fac44c9-24ee-4634-b459-94d3e41a6206'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:57.507617 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9fac44c9-24ee-4634-b459-94d3e41a6206 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd377913709df4f03852a61bfe4949870', 'request_id': 'req-9fac44c9-24ee-4634-b459-94d3e41a6206'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:57.524298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9fac44c9-24ee-4634-b459-94d3e41a6206 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd377913709df4f03852a61bfe4949870', 'request_id': 'req-9fac44c9-24ee-4634-b459-94d3e41a6206'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:57.545272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9fac44c9-24ee-4634-b459-94d3e41a6206 admin admin] The token cache is being invalidate because project d377913709df4f03852a61bfe4949870 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:17:57.545548 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9fac44c9-24ee-4634-b459-94d3e41a6206 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:57.546383 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9fac44c9-24ee-4634-b459-94d3e41a6206 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:57.551853 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3307/6546] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:17:57 2022] DELETE /identity/v3/projects/d377913709df4f03852a61bfe4949870 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:57.557962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d376cd4-282c-430f-8fe7-3e7e89bd4bd6 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:57.558357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d376cd4-282c-430f-8fe7-3e7e89bd4bd6 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:57.558889 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d376cd4-282c-430f-8fe7-3e7e89bd4bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:57.564183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4f742-38be-485e-8289-a9f9c10029be service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:57.607731 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-3d376cd4-282c-430f-8fe7-3e7e89bd4bd6 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:57.609007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3d376cd4-282c-430f-8fe7-3e7e89bd4bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:57.626639 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:57.696805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844b0d0-09ad-4189-be44-585e9768824f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10759b2abd4cafacf338551327775e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:57.697281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844b0d0-09ad-4189-be44-585e9768824f service glance] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:57.697627 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844b0d0-09ad-4189-be44-585e9768824f service glance] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:57.697907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844b0d0-09ad-4189-be44-585e9768824f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:57.702465 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2844b0d0-09ad-4189-be44-585e9768824f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:57.740133 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3308/6547] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:17:57.748704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fadc9-a42c-41a2-b32f-8a048bbc6ec7 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:57.749020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fadc9-a42c-41a2-b32f-8a048bbc6ec7 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:57.749276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fadc9-a42c-41a2-b32f-8a048bbc6ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:57.773898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-9a3fadc9-a42c-41a2-b32f-8a048bbc6ec7 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:57.775542 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9a3fadc9-a42c-41a2-b32f-8a048bbc6ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:57.791827 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3309/6548] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:57.796988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3fadc9-a42c-41a2-b32f-8a048bbc6ec7 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:57.809017 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3fadc9-a42c-41a2-b32f-8a048bbc6ec7 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:57.814501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f82f2-901d-4349-8ccc-3d71487ed205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:57.815528 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f82f2-901d-4349-8ccc-3d71487ed205 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:57.816040 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f82f2-901d-4349-8ccc-3d71487ed205 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:57.818272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f82f2-901d-4349-8ccc-3d71487ed205 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:57.819287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f82f2-901d-4349-8ccc-3d71487ed205 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:17:57.819832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f82f2-901d-4349-8ccc-3d71487ed205 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:57.822916 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f82f2-901d-4349-8ccc-3d71487ed205 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:57.842506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844b0d0-09ad-4189-be44-585e9768824f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:57.843984 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844b0d0-09ad-4189-be44-585e9768824f service glance] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:57.848660 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3310/6549] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:17:57.850044 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f82f2-901d-4349-8ccc-3d71487ed205 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:57.862956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f82f2-901d-4349-8ccc-3d71487ed205 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:57.865230 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3240/6550] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:17:57 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:17:57.889646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f2d98-7eed-4602-9995-f9ae446973a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:57.891363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f2d98-7eed-4602-9995-f9ae446973a1 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:57.891763 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f2d98-7eed-4602-9995-f9ae446973a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:57.893017 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f2d98-7eed-4602-9995-f9ae446973a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:57.893799 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f2d98-7eed-4602-9995-f9ae446973a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:57.895886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f2d98-7eed-4602-9995-f9ae446973a1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:57.954348 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3311/6551] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:17:57 2022] POST /identity/v3/projects => generated 357 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:17:57.958380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844b0d0-09ad-4189-be44-585e9768824f service glance] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:57.975822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844b0d0-09ad-4189-be44-585e9768824f service glance] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:58.094875 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91b78d-6b57-4629-89b3-7d2e823231aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:58.097459 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91b78d-6b57-4629-89b3-7d2e823231aa admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:58.098475 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91b78d-6b57-4629-89b3-7d2e823231aa admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:58.098944 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91b78d-6b57-4629-89b3-7d2e823231aa admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:58.099719 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91b78d-6b57-4629-89b3-7d2e823231aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:58.101940 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91b78d-6b57-4629-89b3-7d2e823231aa admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:58.129649 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:58.145353 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f2d98-7eed-4602-9995-f9ae446973a1 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:58.148812 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3241/6552] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:17:57 2022] POST /identity/v3/users => generated 279 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:17:58.168805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f2d98-7eed-4602-9995-f9ae446973a1 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:58.178722 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6b606-942d-4083-b6d7-07dba6af5b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:58.180181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6b606-942d-4083-b6d7-07dba6af5b65 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:58.181157 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6b606-942d-4083-b6d7-07dba6af5b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:58.181476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6b606-942d-4083-b6d7-07dba6af5b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:58.182140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe6b606-942d-4083-b6d7-07dba6af5b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:58.184126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe6b606-942d-4083-b6d7-07dba6af5b65 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:58.205976 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3312/6553] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:17:58.212532 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91b78d-6b57-4629-89b3-7d2e823231aa admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:58.230294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91b78d-6b57-4629-89b3-7d2e823231aa admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:58.240238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001f766-5ade-49db-a303-c1afc28c7936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:58.242051 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001f766-5ade-49db-a303-c1afc28c7936 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:58.242423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001f766-5ade-49db-a303-c1afc28c7936 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:58.242990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001f766-5ade-49db-a303-c1afc28c7936 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:58.244507 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001f766-5ade-49db-a303-c1afc28c7936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:58.247265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001f766-5ade-49db-a303-c1afc28c7936 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:58.266405 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3242/6554] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:17:58.267522 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6b606-942d-4083-b6d7-07dba6af5b65 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:58.282617 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6b606-942d-4083-b6d7-07dba6af5b65 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:58.296780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f73d8e-e6f0-4592-859c-bde2c4e225a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:58.299716 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f73d8e-e6f0-4592-859c-bde2c4e225a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:58.300743 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f73d8e-e6f0-4592-859c-bde2c4e225a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:58.301615 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f73d8e-e6f0-4592-859c-bde2c4e225a0 admin admin] PATH_INFO: `/v3/projects/8fb828e5b2ed45e2ae83bab910cf7c32/users/0df4535c62984c0eb8958c6e02ba7528/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:58.332185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f73d8e-e6f0-4592-859c-bde2c4e225a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fb828e5b2ed45e2ae83bab910cf7c32, user_id=0df4535c62984c0eb8958c6e02ba7528, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:58.335867 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f73d8e-e6f0-4592-859c-bde2c4e225a0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:58.370586 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3313/6555] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:17:58 2022] PUT /identity/v3/projects/8fb828e5b2ed45e2ae83bab910cf7c32/users/0df4535c62984c0eb8958c6e02ba7528/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:58.374930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd6b05-d18a-4623-a736-22f9103e7e07 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:58.375292 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd6b05-d18a-4623-a736-22f9103e7e07 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:58.375488 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd6b05-d18a-4623-a736-22f9103e7e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:58.434362 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-b6fd6b05-d18a-4623-a736-22f9103e7e07 None None] MFA Rules not processed for user `0df4535c62984c0eb8958c6e02ba7528`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:58.435615 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b6fd6b05-d18a-4623-a736-22f9103e7e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:58.569138 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3243/6556] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:58 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:58.584958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f73d8e-e6f0-4592-859c-bde2c4e225a0 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:58.587875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-20f73d8e-e6f0-4592-859c-bde2c4e225a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:58.733761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f73d8e-e6f0-4592-859c-bde2c4e225a0 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:58.741999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac18731-52be-4ac3-aa85-9ed1724e1098 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:58.743781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac18731-52be-4ac3-aa85-9ed1724e1098 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:58.744541 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac18731-52be-4ac3-aa85-9ed1724e1098 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:58.744833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac18731-52be-4ac3-aa85-9ed1724e1098 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:58.756809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac18731-52be-4ac3-aa85-9ed1724e1098 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:58.758943 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac18731-52be-4ac3-aa85-9ed1724e1098 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:58.771022 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3314/6557] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:17:58 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:17:58.787307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd6b05-d18a-4623-a736-22f9103e7e07 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:58.789070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b6fd6b05-d18a-4623-a736-22f9103e7e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:58.912328 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd6b05-d18a-4623-a736-22f9103e7e07 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:58.924280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759217e3-d4c5-408a-ab83-1231028edaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:58.925343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759217e3-d4c5-408a-ab83-1231028edaf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:58.925871 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759217e3-d4c5-408a-ab83-1231028edaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:58.926374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759217e3-d4c5-408a-ab83-1231028edaf1 admin admin] PATH_INFO: `/v3/users/1c88704f18494e0f9a844646fa5db497` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:58.928008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759217e3-d4c5-408a-ab83-1231028edaf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c88704f18494e0f9a844646fa5db497)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:58.931853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759217e3-d4c5-408a-ab83-1231028edaf1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:59.017144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-759217e3-d4c5-408a-ab83-1231028edaf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c88704f18494e0f9a844646fa5db497'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:59.018708 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-759217e3-d4c5-408a-ab83-1231028edaf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c88704f18494e0f9a844646fa5db497'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:59.019422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-759217e3-d4c5-408a-ab83-1231028edaf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c88704f18494e0f9a844646fa5db497'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:59.041827 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-759217e3-d4c5-408a-ab83-1231028edaf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c88704f18494e0f9a844646fa5db497'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:59.067995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-759217e3-d4c5-408a-ab83-1231028edaf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c88704f18494e0f9a844646fa5db497'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:17:59.080525 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:59.088724 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3244/6558] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:17:58 2022] DELETE /identity/v3/users/1c88704f18494e0f9a844646fa5db497 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:17:59.093511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb21a47-b61b-4327-b6a5-55c3c270d891 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:59.093825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb21a47-b61b-4327-b6a5-55c3c270d891 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:59.094104 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb21a47-b61b-4327-b6a5-55c3c270d891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:59.131581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-4fb21a47-b61b-4327-b6a5-55c3c270d891 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:17:59.132831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4fb21a47-b61b-4327-b6a5-55c3c270d891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:59.221493 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:59.288472 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3315/6559] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:17:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:17:59.314409 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759217e3-d4c5-408a-ab83-1231028edaf1 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:17:59.316036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-759217e3-d4c5-408a-ab83-1231028edaf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:17:59.428243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759217e3-d4c5-408a-ab83-1231028edaf1 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:17:59.432718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd255f5-8465-4b19-a793-cdc5a109c838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:17:59.433555 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd255f5-8465-4b19-a793-cdc5a109c838 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:17:59.434619 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd255f5-8465-4b19-a793-cdc5a109c838 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:17:59.434968 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd255f5-8465-4b19-a793-cdc5a109c838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:17:59.448997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd255f5-8465-4b19-a793-cdc5a109c838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:17:59.451711 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd255f5-8465-4b19-a793-cdc5a109c838 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:17:59.467988 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3245/6560] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:17:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:18:00.980972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb21a47-b61b-4327-b6a5-55c3c270d891 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:00.984468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4fb21a47-b61b-4327-b6a5-55c3c270d891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:01.012287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb21a47-b61b-4327-b6a5-55c3c270d891 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:01.022372 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde05cce-8442-4a4f-8f49-5a8114e44db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:01.023421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde05cce-8442-4a4f-8f49-5a8114e44db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:01.024862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde05cce-8442-4a4f-8f49-5a8114e44db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:01.025343 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde05cce-8442-4a4f-8f49-5a8114e44db8 admin admin] PATH_INFO: `/v3/projects/8c21c83fedd84cb28bdf229001436006` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:01.031372 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde05cce-8442-4a4f-8f49-5a8114e44db8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c21c83fedd84cb28bdf229001436006)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:01.033653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde05cce-8442-4a4f-8f49-5a8114e44db8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:01.160193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bde05cce-8442-4a4f-8f49-5a8114e44db8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c21c83fedd84cb28bdf229001436006', 'request_id': 'req-bde05cce-8442-4a4f-8f49-5a8114e44db8'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:01.169109 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bde05cce-8442-4a4f-8f49-5a8114e44db8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c21c83fedd84cb28bdf229001436006', 'request_id': 'req-bde05cce-8442-4a4f-8f49-5a8114e44db8'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:01.188624 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bde05cce-8442-4a4f-8f49-5a8114e44db8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c21c83fedd84cb28bdf229001436006', 'request_id': 'req-bde05cce-8442-4a4f-8f49-5a8114e44db8'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:01.226031 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bde05cce-8442-4a4f-8f49-5a8114e44db8 admin admin] The token cache is being invalidate because project 8c21c83fedd84cb28bdf229001436006 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:18:01.226341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bde05cce-8442-4a4f-8f49-5a8114e44db8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:01.232147 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bde05cce-8442-4a4f-8f49-5a8114e44db8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:01.234769 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3316/6561] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:18:00 2022] DELETE /identity/v3/projects/8c21c83fedd84cb28bdf229001436006 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:18:01.238518 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd255f5-8465-4b19-a793-cdc5a109c838 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:01.253378 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd255f5-8465-4b19-a793-cdc5a109c838 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:01.432018 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cd8cf-b099-4be8-9441-19f1662ef946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:01.432707 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cd8cf-b099-4be8-9441-19f1662ef946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:01.437399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cd8cf-b099-4be8-9441-19f1662ef946 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:01.437671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cd8cf-b099-4be8-9441-19f1662ef946 admin admin] PATH_INFO: `/v3/users/23fb161d2deb415fb52a187f2005953f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:01.439187 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44cd8cf-b099-4be8-9441-19f1662ef946 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23fb161d2deb415fb52a187f2005953f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:01.441184 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44cd8cf-b099-4be8-9441-19f1662ef946 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:01.567396 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d44cd8cf-b099-4be8-9441-19f1662ef946 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23fb161d2deb415fb52a187f2005953f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:01.568663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d44cd8cf-b099-4be8-9441-19f1662ef946 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23fb161d2deb415fb52a187f2005953f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:01.569378 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d44cd8cf-b099-4be8-9441-19f1662ef946 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23fb161d2deb415fb52a187f2005953f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:01.588682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d44cd8cf-b099-4be8-9441-19f1662ef946 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23fb161d2deb415fb52a187f2005953f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:01.608508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d44cd8cf-b099-4be8-9441-19f1662ef946 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23fb161d2deb415fb52a187f2005953f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:01.641525 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3246/6562] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:18:01 2022] DELETE /identity/v3/users/23fb161d2deb415fb52a187f2005953f => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:18:01.961009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ef298-99c7-4c25-8d64-e75c4342cd55 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:01.961421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ef298-99c7-4c25-8d64-e75c4342cd55 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:01.961855 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ef298-99c7-4c25-8d64-e75c4342cd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:02.013779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d23ef298-99c7-4c25-8d64-e75c4342cd55 None None] MFA Rules not processed for user `adc1e4e45bcb4169a52153375140977d`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:02.016983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d23ef298-99c7-4c25-8d64-e75c4342cd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:02.192781 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3317/6563] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:18:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:18:02.208493 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cd8cf-b099-4be8-9441-19f1662ef946 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:02.210011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d44cd8cf-b099-4be8-9441-19f1662ef946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:02.265128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:02.402275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cd8cf-b099-4be8-9441-19f1662ef946 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:02.415588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1b075-cb2d-4b85-8323-e98bfd3407d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:02.416869 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1b075-cb2d-4b85-8323-e98bfd3407d7 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:02.417384 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1b075-cb2d-4b85-8323-e98bfd3407d7 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:02.419453 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1b075-cb2d-4b85-8323-e98bfd3407d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:02.422209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-76a1b075-cb2d-4b85-8323-e98bfd3407d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:02.567334 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1b075-cb2d-4b85-8323-e98bfd3407d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:02.568969 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1b075-cb2d-4b85-8323-e98bfd3407d7 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:02.610042 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3247/6564] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:18:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:18:02.878694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ef298-99c7-4c25-8d64-e75c4342cd55 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:02.881887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d23ef298-99c7-4c25-8d64-e75c4342cd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:02.978000 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:03.011307 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ef298-99c7-4c25-8d64-e75c4342cd55 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:03.023933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3298442-0b13-4fdb-9180-4fc254fafbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:03.025472 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3298442-0b13-4fdb-9180-4fc254fafbd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:03.026145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3298442-0b13-4fdb-9180-4fc254fafbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:03.026806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3298442-0b13-4fdb-9180-4fc254fafbd8 admin admin] PATH_INFO: `/v3/projects/1fcd49305a9044c78659b1c3b649d742` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:03.030621 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3298442-0b13-4fdb-9180-4fc254fafbd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fcd49305a9044c78659b1c3b649d742)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:03.032741 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3298442-0b13-4fdb-9180-4fc254fafbd8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:03.151740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f3298442-0b13-4fdb-9180-4fc254fafbd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fcd49305a9044c78659b1c3b649d742', 'request_id': 'req-f3298442-0b13-4fdb-9180-4fc254fafbd8'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:03.165055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f3298442-0b13-4fdb-9180-4fc254fafbd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fcd49305a9044c78659b1c3b649d742', 'request_id': 'req-f3298442-0b13-4fdb-9180-4fc254fafbd8'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:03.185944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f3298442-0b13-4fdb-9180-4fc254fafbd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fcd49305a9044c78659b1c3b649d742', 'request_id': 'req-f3298442-0b13-4fdb-9180-4fc254fafbd8'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:03.209965 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f3298442-0b13-4fdb-9180-4fc254fafbd8 admin admin] The token cache is being invalidate because project 1fcd49305a9044c78659b1c3b649d742 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:18:03.210502 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f3298442-0b13-4fdb-9180-4fc254fafbd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:03.212495 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f3298442-0b13-4fdb-9180-4fc254fafbd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:03.219149 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3318/6565] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:18:02 2022] DELETE /identity/v3/projects/1fcd49305a9044c78659b1c3b649d742 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:18:03.224391 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9b0e5-ae03-489f-a1af-cd7568947eed None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:03.224679 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9b0e5-ae03-489f-a1af-cd7568947eed None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:03.224959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9b0e5-ae03-489f-a1af-cd7568947eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:03.271647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-4ff9b0e5-ae03-489f-a1af-cd7568947eed None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:03.272911 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4ff9b0e5-ae03-489f-a1af-cd7568947eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:03.439156 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3248/6566] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:18:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:18:03.441470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a53d5-615f-480c-8cb2-ca11bf7bd3ed None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:03.441859 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a53d5-615f-480c-8cb2-ca11bf7bd3ed None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:03.442025 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a53d5-615f-480c-8cb2-ca11bf7bd3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:03.483774 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b64a53d5-615f-480c-8cb2-ca11bf7bd3ed None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:03.485658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b64a53d5-615f-480c-8cb2-ca11bf7bd3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:03.513518 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3319/6567] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:18:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:18:03.518902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9b0e5-ae03-489f-a1af-cd7568947eed None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:03.529519 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9b0e5-ae03-489f-a1af-cd7568947eed None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:03.552146 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e43223-dd5e-46e6-9daf-7bbb6ee12243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:03.552787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e43223-dd5e-46e6-9daf-7bbb6ee12243 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:03.553083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e43223-dd5e-46e6-9daf-7bbb6ee12243 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:03.553346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e43223-dd5e-46e6-9daf-7bbb6ee12243 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:03.554000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e43223-dd5e-46e6-9daf-7bbb6ee12243 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:18:03.554317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e43223-dd5e-46e6-9daf-7bbb6ee12243 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:03.556754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e43223-dd5e-46e6-9daf-7bbb6ee12243 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:03.585852 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3249/6568] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:18:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:18:03.591069 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a53d5-615f-480c-8cb2-ca11bf7bd3ed None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:03.603912 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a53d5-615f-480c-8cb2-ca11bf7bd3ed None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:03.619162 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c88cd4-824d-4891-9129-7138ae3091a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:03.620121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c88cd4-824d-4891-9129-7138ae3091a2 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:03.620577 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c88cd4-824d-4891-9129-7138ae3091a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:03.621212 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c88cd4-824d-4891-9129-7138ae3091a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:03.622086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c88cd4-824d-4891-9129-7138ae3091a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:03.624277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c88cd4-824d-4891-9129-7138ae3091a2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:03.696467 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3320/6569] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:18:03 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:18:03.701060 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e43223-dd5e-46e6-9daf-7bbb6ee12243 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:03.721270 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e43223-dd5e-46e6-9daf-7bbb6ee12243 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:03.771056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:03.852631 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bb50f-7e87-42b5-ab65-eae6001c3ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:03.853221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bb50f-7e87-42b5-ab65-eae6001c3ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:03.853562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bb50f-7e87-42b5-ab65-eae6001c3ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:03.854505 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bb50f-7e87-42b5-ab65-eae6001c3ca0 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:03.855174 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0bb50f-7e87-42b5-ab65-eae6001c3ca0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:03.857121 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0bb50f-7e87-42b5-ab65-eae6001c3ca0 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:03.906211 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3250/6570] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:18:03 2022] POST /identity/v3/users => generated 289 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:18:03.907508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c88cd4-824d-4891-9129-7138ae3091a2 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:03.920279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c88cd4-824d-4891-9129-7138ae3091a2 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:03.938631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1ef4c-32fc-4186-bb38-ddbb2310ac6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:03.939684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1ef4c-32fc-4186-bb38-ddbb2310ac6e admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:03.939684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1ef4c-32fc-4186-bb38-ddbb2310ac6e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:03.939887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1ef4c-32fc-4186-bb38-ddbb2310ac6e admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:03.940541 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c1ef4c-32fc-4186-bb38-ddbb2310ac6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:03.942233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c1ef4c-32fc-4186-bb38-ddbb2310ac6e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:03.966725 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3321/6571] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:18:03.966884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bb50f-7e87-42b5-ab65-eae6001c3ca0 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:03.982301 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bb50f-7e87-42b5-ab65-eae6001c3ca0 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:03.991247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1280a-28ab-4d9c-93b8-69cb9befbf7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:03.993510 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1280a-28ab-4d9c-93b8-69cb9befbf7c admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:03.993930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1280a-28ab-4d9c-93b8-69cb9befbf7c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:03.994273 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1280a-28ab-4d9c-93b8-69cb9befbf7c admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:03.998668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe1280a-28ab-4d9c-93b8-69cb9befbf7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:04.000415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe1280a-28ab-4d9c-93b8-69cb9befbf7c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:04.033659 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3251/6572] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:18:04.037259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1ef4c-32fc-4186-bb38-ddbb2310ac6e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:04.052862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1ef4c-32fc-4186-bb38-ddbb2310ac6e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:04.069547 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b88025-b84d-4651-993d-56736492ee16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:04.070631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b88025-b84d-4651-993d-56736492ee16 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:04.071127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b88025-b84d-4651-993d-56736492ee16 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:04.071590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b88025-b84d-4651-993d-56736492ee16 admin admin] PATH_INFO: `/v3/projects/417c6dc471674dac8e6ca40fdd53e573/users/6a98b74633ce4ebfa915dad9b379845c/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:04.108123 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b88025-b84d-4651-993d-56736492ee16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=417c6dc471674dac8e6ca40fdd53e573, user_id=6a98b74633ce4ebfa915dad9b379845c, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:04.113354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b88025-b84d-4651-993d-56736492ee16 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:04.146787 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3322/6573] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:18:04 2022] PUT /identity/v3/projects/417c6dc471674dac8e6ca40fdd53e573/users/6a98b74633ce4ebfa915dad9b379845c/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:18:04.159748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7e2a6-4bb0-450e-8e10-71bfbc810d8c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:04.160035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7e2a6-4bb0-450e-8e10-71bfbc810d8c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:04.160316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7e2a6-4bb0-450e-8e10-71bfbc810d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:04.229863 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-0ae7e2a6-4bb0-450e-8e10-71bfbc810d8c None None] MFA Rules not processed for user `6a98b74633ce4ebfa915dad9b379845c`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:04.231279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0ae7e2a6-4bb0-450e-8e10-71bfbc810d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:04.411689 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3252/6574] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:18:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:18:04.413786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b88025-b84d-4651-993d-56736492ee16 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:04.610712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b88025-b84d-4651-993d-56736492ee16 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:04.626776 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07c668-3142-489b-8386-a925e2636c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:04.627745 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07c668-3142-489b-8386-a925e2636c5b admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:04.628203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07c668-3142-489b-8386-a925e2636c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:04.628684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07c668-3142-489b-8386-a925e2636c5b admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:04.629520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07c668-3142-489b-8386-a925e2636c5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:04.631735 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07c668-3142-489b-8386-a925e2636c5b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:04.689224 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:04.700494 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3323/6575] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:18:04 2022] POST /identity/v3/projects => generated 377 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:18:04.704337 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7e2a6-4bb0-450e-8e10-71bfbc810d8c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:04.723328 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7e2a6-4bb0-450e-8e10-71bfbc810d8c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:04.848272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610db52-f59d-4536-8073-2bf3159e63dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:04.848607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610db52-f59d-4536-8073-2bf3159e63dd admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:04.848891 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610db52-f59d-4536-8073-2bf3159e63dd admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:04.849168 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610db52-f59d-4536-8073-2bf3159e63dd admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:04.849793 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610db52-f59d-4536-8073-2bf3159e63dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:04.851836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610db52-f59d-4536-8073-2bf3159e63dd admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:04.899403 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3253/6576] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:18:04 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:18:04.903282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07c668-3142-489b-8386-a925e2636c5b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:04.918901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07c668-3142-489b-8386-a925e2636c5b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:04.941159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f72c5d-d626-4f02-aa42-4d8dde8bdffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:04.941777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f72c5d-d626-4f02-aa42-4d8dde8bdffd admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:04.942078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f72c5d-d626-4f02-aa42-4d8dde8bdffd admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:04.942339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f72c5d-d626-4f02-aa42-4d8dde8bdffd admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:04.943026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f72c5d-d626-4f02-aa42-4d8dde8bdffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:04.944652 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f72c5d-d626-4f02-aa42-4d8dde8bdffd admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:04.971839 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3324/6577] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:18:04.976120 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610db52-f59d-4536-8073-2bf3159e63dd admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:04.996866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610db52-f59d-4536-8073-2bf3159e63dd admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:05.015355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4b0a7-4ce2-4729-a2ce-da06f3bcc871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:05.019166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4b0a7-4ce2-4729-a2ce-da06f3bcc871 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:05.019547 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4b0a7-4ce2-4729-a2ce-da06f3bcc871 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:05.021409 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4b0a7-4ce2-4729-a2ce-da06f3bcc871 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:05.022136 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f4b0a7-4ce2-4729-a2ce-da06f3bcc871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:05.027526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f4b0a7-4ce2-4729-a2ce-da06f3bcc871 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:05.075477 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f72c5d-d626-4f02-aa42-4d8dde8bdffd admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:05.078595 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3254/6578] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:18:05.092995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f72c5d-d626-4f02-aa42-4d8dde8bdffd admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:05.100033 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8737e-f031-49fa-a1fb-b50cdb817a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:05.101056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8737e-f031-49fa-a1fb-b50cdb817a05 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:05.101514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8737e-f031-49fa-a1fb-b50cdb817a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:05.102727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8737e-f031-49fa-a1fb-b50cdb817a05 admin admin] PATH_INFO: `/v3/projects/01cc7c8741734798a7c1929eb2fbe7cc/users/367c97f561014d71945cd69a9da54ee9/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:05.150334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f8737e-f031-49fa-a1fb-b50cdb817a05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01cc7c8741734798a7c1929eb2fbe7cc, user_id=367c97f561014d71945cd69a9da54ee9, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:05.154968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f8737e-f031-49fa-a1fb-b50cdb817a05 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:05.242585 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3325/6579] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:18:05 2022] PUT /identity/v3/projects/01cc7c8741734798a7c1929eb2fbe7cc/users/367c97f561014d71945cd69a9da54ee9/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:18:05.335609 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be907e28-394d-43bc-bb94-291b63555df5 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:05.336262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be907e28-394d-43bc-bb94-291b63555df5 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:05.336737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be907e28-394d-43bc-bb94-291b63555df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:05.370502 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:05.374814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-be907e28-394d-43bc-bb94-291b63555df5 None None] MFA Rules not processed for user `367c97f561014d71945cd69a9da54ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:05.377494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-be907e28-394d-43bc-bb94-291b63555df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:05.612158 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3255/6580] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:18:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:18:05.639327 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8737e-f031-49fa-a1fb-b50cdb817a05 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:05.641592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-30f8737e-f031-49fa-a1fb-b50cdb817a05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:05.834314 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8737e-f031-49fa-a1fb-b50cdb817a05 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:05.838944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1ccbe-fe3f-402f-b466-90fb21166df9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10759b2abd4cafacf338551327775e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:05.839767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1ccbe-fe3f-402f-b466-90fb21166df9 service glance] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:05.840206 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1ccbe-fe3f-402f-b466-90fb21166df9 service glance] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:05.841281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1ccbe-fe3f-402f-b466-90fb21166df9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:05.986258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1ccbe-fe3f-402f-b466-90fb21166df9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:05.987972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1ccbe-fe3f-402f-b466-90fb21166df9 service glance] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:06.003232 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3326/6581] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:18:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:18:06.307186 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d8082-51ec-459b-b44e-eca7113294c0 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:06.307803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d8082-51ec-459b-b44e-eca7113294c0 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:06.308258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d8082-51ec-459b-b44e-eca7113294c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:06.364833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-144d8082-51ec-459b-b44e-eca7113294c0 None None] MFA Rules not processed for user `7cd539be9e3b426d9eb5bdba4697f849`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:06.366063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-144d8082-51ec-459b-b44e-eca7113294c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:06.376970 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bf13c-252e-4a2f-a0b3-a29afa4a13b5 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:06.377552 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bf13c-252e-4a2f-a0b3-a29afa4a13b5 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:06.377552 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bf13c-252e-4a2f-a0b3-a29afa4a13b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:06.422935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-fc7bf13c-252e-4a2f-a0b3-a29afa4a13b5 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:06.424553 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-fc7bf13c-252e-4a2f-a0b3-a29afa4a13b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:06.581971 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3256/6582] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:18:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:18:06.597369 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3327/6583] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:18:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:18:06.621620 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d8082-51ec-459b-b44e-eca7113294c0 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:06.624056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-144d8082-51ec-459b-b44e-eca7113294c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:06.833136 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d8082-51ec-459b-b44e-eca7113294c0 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:06.839870 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2b0a3-1fcc-494c-a1a0-0f89b20f818b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:06.840947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2b0a3-1fcc-494c-a1a0-0f89b20f818b service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:06.841392 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2b0a3-1fcc-494c-a1a0-0f89b20f818b service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:06.842175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2b0a3-1fcc-494c-a1a0-0f89b20f818b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:06.857049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2b0a3-1fcc-494c-a1a0-0f89b20f818b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:06.859435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2b0a3-1fcc-494c-a1a0-0f89b20f818b service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:06.870745 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3257/6584] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:18:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:18:07.204854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7bf13c-252e-4a2f-a0b3-a29afa4a13b5 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:07.206349 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-fc7bf13c-252e-4a2f-a0b3-a29afa4a13b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:07.231005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7bf13c-252e-4a2f-a0b3-a29afa4a13b5 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:07.241160 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1865fb-770d-442e-978f-5a0eb01ad34f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10759b2abd4cafacf338551327775e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:07.241800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1865fb-770d-442e-978f-5a0eb01ad34f service glance] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:07.242081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1865fb-770d-442e-978f-5a0eb01ad34f service glance] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:07.242973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1865fb-770d-442e-978f-5a0eb01ad34f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:07.265194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1865fb-770d-442e-978f-5a0eb01ad34f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:07.266739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1865fb-770d-442e-978f-5a0eb01ad34f service glance] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:07.272693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:07.283348 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3328/6585] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:18:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:18:07.406713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d45d1-a921-4ba5-9bf0-8b7da9048ef7 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:07.406713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d45d1-a921-4ba5-9bf0-8b7da9048ef7 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:07.406713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d45d1-a921-4ba5-9bf0-8b7da9048ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:07.470120 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-ac0d45d1-a921-4ba5-9bf0-8b7da9048ef7 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:07.474890 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ac0d45d1-a921-4ba5-9bf0-8b7da9048ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:07.494060 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3258/6586] 10.222.0.33 () {58 vars in 967 bytes} [Sat Aug 6 21:18:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:18:07.507452 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1865fb-770d-442e-978f-5a0eb01ad34f service glance] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:07.539261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1865fb-770d-442e-978f-5a0eb01ad34f service glance] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:07.550038 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22a408-f540-46e8-96e3-1751da5cb330 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:07.551368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22a408-f540-46e8-96e3-1751da5cb330 service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:07.551881 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22a408-f540-46e8-96e3-1751da5cb330 service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:07.552381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22a408-f540-46e8-96e3-1751da5cb330 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:07.583997 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22a408-f540-46e8-96e3-1751da5cb330 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:07.589690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22a408-f540-46e8-96e3-1751da5cb330 service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:07.625838 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3329/6587] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:18:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:18:07.836938 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d45d1-a921-4ba5-9bf0-8b7da9048ef7 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:07.906952 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:08.012495 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d45d1-a921-4ba5-9bf0-8b7da9048ef7 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:08.028112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4243cf-cde4-4bc2-99c9-59315ffaf77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:08.029308 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4243cf-cde4-4bc2-99c9-59315ffaf77e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:08.029983 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4243cf-cde4-4bc2-99c9-59315ffaf77e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:08.032993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4243cf-cde4-4bc2-99c9-59315ffaf77e admin admin] PATH_INFO: `/v3/users/6a98b74633ce4ebfa915dad9b379845c` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:08.034942 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4243cf-cde4-4bc2-99c9-59315ffaf77e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a98b74633ce4ebfa915dad9b379845c)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:08.037144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4243cf-cde4-4bc2-99c9-59315ffaf77e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:08.155640 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8d4243cf-cde4-4bc2-99c9-59315ffaf77e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a98b74633ce4ebfa915dad9b379845c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:08.156768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8d4243cf-cde4-4bc2-99c9-59315ffaf77e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a98b74633ce4ebfa915dad9b379845c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:08.157464 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8d4243cf-cde4-4bc2-99c9-59315ffaf77e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a98b74633ce4ebfa915dad9b379845c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:08.180212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8d4243cf-cde4-4bc2-99c9-59315ffaf77e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a98b74633ce4ebfa915dad9b379845c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:08.207212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8d4243cf-cde4-4bc2-99c9-59315ffaf77e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a98b74633ce4ebfa915dad9b379845c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:08.244469 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3259/6588] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:18:07 2022] DELETE /identity/v3/users/6a98b74633ce4ebfa915dad9b379845c => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:18:08.246180 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa78240-e36b-4671-914c-4a21d00f7993 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:08.246466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa78240-e36b-4671-914c-4a21d00f7993 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:08.246801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa78240-e36b-4671-914c-4a21d00f7993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:08.273258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-9fa78240-e36b-4671-914c-4a21d00f7993 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:08.275991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9fa78240-e36b-4671-914c-4a21d00f7993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:08.424456 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3330/6589] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:18:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:18:08.444908 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4243cf-cde4-4bc2-99c9-59315ffaf77e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:08.449063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8d4243cf-cde4-4bc2-99c9-59315ffaf77e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:08.621383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4243cf-cde4-4bc2-99c9-59315ffaf77e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:08.626918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f68c8-3787-416e-95b5-51b69bca0788 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:08.628046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f68c8-3787-416e-95b5-51b69bca0788 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:08.628798 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f68c8-3787-416e-95b5-51b69bca0788 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:08.630084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f68c8-3787-416e-95b5-51b69bca0788 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:08.652485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f68c8-3787-416e-95b5-51b69bca0788 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:08.656458 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f68c8-3787-416e-95b5-51b69bca0788 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:08.690568 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3260/6590] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:18:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:18:10.055966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa78240-e36b-4671-914c-4a21d00f7993 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:10.058622 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9fa78240-e36b-4671-914c-4a21d00f7993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:10.081553 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa78240-e36b-4671-914c-4a21d00f7993 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:10.113179 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8575d-b871-4abd-98cf-8e9ccab92c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:10.114711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8575d-b871-4abd-98cf-8e9ccab92c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:10.124464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8575d-b871-4abd-98cf-8e9ccab92c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:10.124840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8575d-b871-4abd-98cf-8e9ccab92c03 admin admin] PATH_INFO: `/v3/projects/417c6dc471674dac8e6ca40fdd53e573` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:10.126521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f8575d-b871-4abd-98cf-8e9ccab92c03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=417c6dc471674dac8e6ca40fdd53e573)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:10.128519 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f8575d-b871-4abd-98cf-8e9ccab92c03 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:10.204320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-23f8575d-b871-4abd-98cf-8e9ccab92c03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '417c6dc471674dac8e6ca40fdd53e573', 'request_id': 'req-23f8575d-b871-4abd-98cf-8e9ccab92c03'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:10.211244 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-23f8575d-b871-4abd-98cf-8e9ccab92c03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '417c6dc471674dac8e6ca40fdd53e573', 'request_id': 'req-23f8575d-b871-4abd-98cf-8e9ccab92c03'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:10.222569 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-23f8575d-b871-4abd-98cf-8e9ccab92c03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '417c6dc471674dac8e6ca40fdd53e573', 'request_id': 'req-23f8575d-b871-4abd-98cf-8e9ccab92c03'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:10.240417 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-23f8575d-b871-4abd-98cf-8e9ccab92c03 admin admin] The token cache is being invalidate because project 417c6dc471674dac8e6ca40fdd53e573 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:18:10.241005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-23f8575d-b871-4abd-98cf-8e9ccab92c03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:10.241886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-23f8575d-b871-4abd-98cf-8e9ccab92c03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:10.244760 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3331/6591] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:18:10 2022] DELETE /identity/v3/projects/417c6dc471674dac8e6ca40fdd53e573 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:18:10.249012 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f68c8-3787-416e-95b5-51b69bca0788 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:10.260973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f68c8-3787-416e-95b5-51b69bca0788 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:10.326913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:10.358681 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa4b35-6904-46ac-b1b5-c3b63d41e1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:10.360054 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa4b35-6904-46ac-b1b5-c3b63d41e1c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:10.360461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa4b35-6904-46ac-b1b5-c3b63d41e1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:10.360962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa4b35-6904-46ac-b1b5-c3b63d41e1c9 admin admin] PATH_INFO: `/v3/users/367c97f561014d71945cd69a9da54ee9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:10.362249 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa4b35-6904-46ac-b1b5-c3b63d41e1c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=367c97f561014d71945cd69a9da54ee9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:10.364544 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa4b35-6904-46ac-b1b5-c3b63d41e1c9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:10.431345 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-97fa4b35-6904-46ac-b1b5-c3b63d41e1c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '367c97f561014d71945cd69a9da54ee9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:10.432990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-97fa4b35-6904-46ac-b1b5-c3b63d41e1c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '367c97f561014d71945cd69a9da54ee9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:10.434358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-97fa4b35-6904-46ac-b1b5-c3b63d41e1c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '367c97f561014d71945cd69a9da54ee9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:10.446173 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-97fa4b35-6904-46ac-b1b5-c3b63d41e1c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '367c97f561014d71945cd69a9da54ee9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:10.516272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-97fa4b35-6904-46ac-b1b5-c3b63d41e1c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '367c97f561014d71945cd69a9da54ee9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:10.533569 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3261/6592] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:18:10 2022] DELETE /identity/v3/users/367c97f561014d71945cd69a9da54ee9 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:18:10.883953 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8575d-b871-4abd-98cf-8e9ccab92c03 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:10.886090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-23f8575d-b871-4abd-98cf-8e9ccab92c03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:10.914754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8575d-b871-4abd-98cf-8e9ccab92c03 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:11.074002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf20555-16a6-450f-a0fa-6ed5711fa9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:11.074703 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf20555-16a6-450f-a0fa-6ed5711fa9b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:11.075269 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf20555-16a6-450f-a0fa-6ed5711fa9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:11.075773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf20555-16a6-450f-a0fa-6ed5711fa9b3 admin admin] PATH_INFO: `/v3/users/833d0a7e5ac44cc7b004c2b67b9dca01` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:11.077696 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf20555-16a6-450f-a0fa-6ed5711fa9b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=833d0a7e5ac44cc7b004c2b67b9dca01)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:11.079691 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf20555-16a6-450f-a0fa-6ed5711fa9b3 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:11.110799 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:11.170525 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cbf20555-16a6-450f-a0fa-6ed5711fa9b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '833d0a7e5ac44cc7b004c2b67b9dca01'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:11.183862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cbf20555-16a6-450f-a0fa-6ed5711fa9b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '833d0a7e5ac44cc7b004c2b67b9dca01'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:11.184803 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cbf20555-16a6-450f-a0fa-6ed5711fa9b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '833d0a7e5ac44cc7b004c2b67b9dca01'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:11.185437 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cbf20555-16a6-450f-a0fa-6ed5711fa9b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '833d0a7e5ac44cc7b004c2b67b9dca01'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:11.200724 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cbf20555-16a6-450f-a0fa-6ed5711fa9b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '833d0a7e5ac44cc7b004c2b67b9dca01'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:11.261213 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3332/6593] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:18:10 2022] DELETE /identity/v3/users/833d0a7e5ac44cc7b004c2b67b9dca01 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:18:11.261529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87b9cd-df33-482e-8139-a1679bcfd1d0 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:11.262217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87b9cd-df33-482e-8139-a1679bcfd1d0 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:11.262217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87b9cd-df33-482e-8139-a1679bcfd1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:11.300067 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-4f87b9cd-df33-482e-8139-a1679bcfd1d0 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:11.301556 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4f87b9cd-df33-482e-8139-a1679bcfd1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:11.440643 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3262/6594] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:18:11.458053 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf20555-16a6-450f-a0fa-6ed5711fa9b3 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:11.460206 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-cbf20555-16a6-450f-a0fa-6ed5711fa9b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:11.589083 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf20555-16a6-450f-a0fa-6ed5711fa9b3 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:11.598146 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b16b8b-8e58-4b99-af04-118b428c8250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:11.599293 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b16b8b-8e58-4b99-af04-118b428c8250 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:11.600916 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b16b8b-8e58-4b99-af04-118b428c8250 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:11.602403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b16b8b-8e58-4b99-af04-118b428c8250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:11.626853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b16b8b-8e58-4b99-af04-118b428c8250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:11.628313 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b16b8b-8e58-4b99-af04-118b428c8250 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:11.645416 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3333/6595] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:18:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:18:11.872532 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87b9cd-df33-482e-8139-a1679bcfd1d0 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:11.874455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4f87b9cd-df33-482e-8139-a1679bcfd1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:11.888348 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87b9cd-df33-482e-8139-a1679bcfd1d0 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:11.897731 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc3169-e2d1-4b95-b2d0-8a8470148d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:11.898905 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc3169-e2d1-4b95-b2d0-8a8470148d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:11.899351 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc3169-e2d1-4b95-b2d0-8a8470148d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:11.899793 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc3169-e2d1-4b95-b2d0-8a8470148d8e admin admin] PATH_INFO: `/v3/projects/01cc7c8741734798a7c1929eb2fbe7cc` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:11.901259 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc3169-e2d1-4b95-b2d0-8a8470148d8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=01cc7c8741734798a7c1929eb2fbe7cc)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:11.903415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc3169-e2d1-4b95-b2d0-8a8470148d8e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:12.008866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c1bc3169-e2d1-4b95-b2d0-8a8470148d8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01cc7c8741734798a7c1929eb2fbe7cc', 'request_id': 'req-c1bc3169-e2d1-4b95-b2d0-8a8470148d8e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:12.015904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c1bc3169-e2d1-4b95-b2d0-8a8470148d8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01cc7c8741734798a7c1929eb2fbe7cc', 'request_id': 'req-c1bc3169-e2d1-4b95-b2d0-8a8470148d8e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:12.017247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:12.027927 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c1bc3169-e2d1-4b95-b2d0-8a8470148d8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01cc7c8741734798a7c1929eb2fbe7cc', 'request_id': 'req-c1bc3169-e2d1-4b95-b2d0-8a8470148d8e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:12.049679 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c1bc3169-e2d1-4b95-b2d0-8a8470148d8e admin admin] The token cache is being invalidate because project 01cc7c8741734798a7c1929eb2fbe7cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:18:12.050130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c1bc3169-e2d1-4b95-b2d0-8a8470148d8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:12.050909 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c1bc3169-e2d1-4b95-b2d0-8a8470148d8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:12.058441 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3263/6596] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:18:11 2022] DELETE /identity/v3/projects/01cc7c8741734798a7c1929eb2fbe7cc => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:18:12.059427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace4e08-e611-456a-81db-c9230b5ce58b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:12.059900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace4e08-e611-456a-81db-c9230b5ce58b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:12.060266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace4e08-e611-456a-81db-c9230b5ce58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:12.100832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-6ace4e08-e611-456a-81db-c9230b5ce58b None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:12.106873 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6ace4e08-e611-456a-81db-c9230b5ce58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:12.353946 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3334/6597] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:18:12.356256 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd86ac-b384-448a-a613-79a10d502a92 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:12.357218 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd86ac-b384-448a-a613-79a10d502a92 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:12.357707 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd86ac-b384-448a-a613-79a10d502a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:12.394257 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a7cd86ac-b384-448a-a613-79a10d502a92 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:12.399024 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a7cd86ac-b384-448a-a613-79a10d502a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:12.426377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace4e08-e611-456a-81db-c9230b5ce58b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:12.426761 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3264/6598] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:18:12.428097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6ace4e08-e611-456a-81db-c9230b5ce58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:12.431346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd86ac-b384-448a-a613-79a10d502a92 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:12.441905 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd86ac-b384-448a-a613-79a10d502a92 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:12.447942 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6890bc-93eb-4da9-9a6b-ee43ed9c6e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:12.448576 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6890bc-93eb-4da9-9a6b-ee43ed9c6e8c admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:12.448859 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6890bc-93eb-4da9-9a6b-ee43ed9c6e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:12.449231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6890bc-93eb-4da9-9a6b-ee43ed9c6e8c admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:12.449956 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6890bc-93eb-4da9-9a6b-ee43ed9c6e8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:18:12.450269 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6890bc-93eb-4da9-9a6b-ee43ed9c6e8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:12.450671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace4e08-e611-456a-81db-c9230b5ce58b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:12.452686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6890bc-93eb-4da9-9a6b-ee43ed9c6e8c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:12.473759 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6724bd-a9d1-466f-8c59-145e7bbf2b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:12.474417 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6724bd-a9d1-466f-8c59-145e7bbf2b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:12.474824 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6724bd-a9d1-466f-8c59-145e7bbf2b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:12.475319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6724bd-a9d1-466f-8c59-145e7bbf2b28 admin admin] PATH_INFO: `/v3/projects/1d5621f54e6b42d199b5c2a936e1d4a9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:12.478045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6724bd-a9d1-466f-8c59-145e7bbf2b28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d5621f54e6b42d199b5c2a936e1d4a9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:12.483263 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6724bd-a9d1-466f-8c59-145e7bbf2b28 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:12.486974 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3265/6599] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:18:12.490352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6890bc-93eb-4da9-9a6b-ee43ed9c6e8c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:12.513173 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6890bc-93eb-4da9-9a6b-ee43ed9c6e8c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:12.527155 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ede12f-0604-4188-a3ae-55a3db9463a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:12.527785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ede12f-0604-4188-a3ae-55a3db9463a7 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:12.528068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ede12f-0604-4188-a3ae-55a3db9463a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:12.528346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ede12f-0604-4188-a3ae-55a3db9463a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:12.528976 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ede12f-0604-4188-a3ae-55a3db9463a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:12.530970 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ede12f-0604-4188-a3ae-55a3db9463a7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:12.562131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:12.605762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cc6724bd-a9d1-466f-8c59-145e7bbf2b28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d5621f54e6b42d199b5c2a936e1d4a9', 'request_id': 'req-cc6724bd-a9d1-466f-8c59-145e7bbf2b28'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:12.615994 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3266/6600] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:18:12 2022] POST /identity/v3/projects => generated 369 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:18:12.620478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cc6724bd-a9d1-466f-8c59-145e7bbf2b28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d5621f54e6b42d199b5c2a936e1d4a9', 'request_id': 'req-cc6724bd-a9d1-466f-8c59-145e7bbf2b28'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:12.621190 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ede12f-0604-4188-a3ae-55a3db9463a7 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:12.634078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cc6724bd-a9d1-466f-8c59-145e7bbf2b28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d5621f54e6b42d199b5c2a936e1d4a9', 'request_id': 'req-cc6724bd-a9d1-466f-8c59-145e7bbf2b28'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:12.655340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cc6724bd-a9d1-466f-8c59-145e7bbf2b28 admin admin] The token cache is being invalidate because project 1d5621f54e6b42d199b5c2a936e1d4a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:18:12.655784 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cc6724bd-a9d1-466f-8c59-145e7bbf2b28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:12.656555 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cc6724bd-a9d1-466f-8c59-145e7bbf2b28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:12.662501 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3335/6601] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:18:12 2022] DELETE /identity/v3/projects/1d5621f54e6b42d199b5c2a936e1d4a9 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:18:12.666823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52664ad-09ff-4f46-9366-5609a3e16104 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:12.667428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52664ad-09ff-4f46-9366-5609a3e16104 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:12.668019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52664ad-09ff-4f46-9366-5609a3e16104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:12.718348 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d52664ad-09ff-4f46-9366-5609a3e16104 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:12.723322 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d52664ad-09ff-4f46-9366-5609a3e16104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:12.776330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ede12f-0604-4188-a3ae-55a3db9463a7 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:12.792887 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959e5da-deee-41b2-b311-df02310d28ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:12.793532 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959e5da-deee-41b2-b311-df02310d28ec admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:12.793820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959e5da-deee-41b2-b311-df02310d28ec admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:12.794103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959e5da-deee-41b2-b311-df02310d28ec admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:12.794780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959e5da-deee-41b2-b311-df02310d28ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:12.796819 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959e5da-deee-41b2-b311-df02310d28ec admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:12.843634 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3267/6602] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:18:12 2022] POST /identity/v3/users => generated 285 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:18:12.849097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959e5da-deee-41b2-b311-df02310d28ec admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:12.854770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9959e5da-deee-41b2-b311-df02310d28ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:12.889169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959e5da-deee-41b2-b311-df02310d28ec admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:12.909866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f2eb5-f5bf-4aa0-a2f8-0ae5b68b70aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:12.910492 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f2eb5-f5bf-4aa0-a2f8-0ae5b68b70aa admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:12.910807 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f2eb5-f5bf-4aa0-a2f8-0ae5b68b70aa admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:12.911097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f2eb5-f5bf-4aa0-a2f8-0ae5b68b70aa admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:12.911748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f2eb5-f5bf-4aa0-a2f8-0ae5b68b70aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:12.915842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f2eb5-f5bf-4aa0-a2f8-0ae5b68b70aa admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:12.922417 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3336/6603] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:18:12.934003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc60c3-9555-4b8c-a382-ba574b2391d0 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:12.934378 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc60c3-9555-4b8c-a382-ba574b2391d0 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:12.934761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc60c3-9555-4b8c-a382-ba574b2391d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:12.937636 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3268/6604] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:18:12.938626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f2eb5-f5bf-4aa0-a2f8-0ae5b68b70aa admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:12.952463 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f2eb5-f5bf-4aa0-a2f8-0ae5b68b70aa admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:12.957406 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f574c-590e-4718-a828-61258947a0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:12.958075 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f574c-590e-4718-a828-61258947a0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:12.958362 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f574c-590e-4718-a828-61258947a0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:12.958686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f574c-590e-4718-a828-61258947a0a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:12.959337 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f574c-590e-4718-a828-61258947a0a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:12.961872 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f574c-590e-4718-a828-61258947a0a7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:12.986780 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3269/6605] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:18:12.990970 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f574c-590e-4718-a828-61258947a0a7 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:13.009580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-f4dc60c3-9555-4b8c-a382-ba574b2391d0 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:13.010876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f4dc60c3-9555-4b8c-a382-ba574b2391d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:13.011913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f574c-590e-4718-a828-61258947a0a7 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:13.028012 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677aef00-7e73-4fc0-a999-792d03b58659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:13.029243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677aef00-7e73-4fc0-a999-792d03b58659 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:13.029733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677aef00-7e73-4fc0-a999-792d03b58659 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:13.030194 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677aef00-7e73-4fc0-a999-792d03b58659 admin admin] PATH_INFO: `/v3/projects/5c1dcd07d5a54ae7bf80e0db67853fcf/users/a926d6d59f86498bb2d1569dd28387f6/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:13.048043 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3337/6606] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:18:13.052984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc60c3-9555-4b8c-a382-ba574b2391d0 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:13.069327 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677aef00-7e73-4fc0-a999-792d03b58659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c1dcd07d5a54ae7bf80e0db67853fcf, user_id=a926d6d59f86498bb2d1569dd28387f6, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:13.075536 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc60c3-9555-4b8c-a382-ba574b2391d0 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:13.076312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677aef00-7e73-4fc0-a999-792d03b58659 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:13.087143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638c098-7c6e-45cd-ba22-f6d6e311e745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:13.087987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638c098-7c6e-45cd-ba22-f6d6e311e745 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:13.088515 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638c098-7c6e-45cd-ba22-f6d6e311e745 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:13.088953 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638c098-7c6e-45cd-ba22-f6d6e311e745 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:13.089923 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638c098-7c6e-45cd-ba22-f6d6e311e745 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:18:13.090444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638c098-7c6e-45cd-ba22-f6d6e311e745 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:13.092645 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638c098-7c6e-45cd-ba22-f6d6e311e745 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:13.118712 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3270/6607] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:18:12 2022] PUT /identity/v3/projects/5c1dcd07d5a54ae7bf80e0db67853fcf/users/a926d6d59f86498bb2d1569dd28387f6/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:18:13.124937 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983e8cd-89bb-4e12-bccb-5da9fc0859e9 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:13.125720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983e8cd-89bb-4e12-bccb-5da9fc0859e9 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:13.126122 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983e8cd-89bb-4e12-bccb-5da9fc0859e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:13.136332 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3338/6608] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:18:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:18:13.140883 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638c098-7c6e-45cd-ba22-f6d6e311e745 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:13.168082 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638c098-7c6e-45cd-ba22-f6d6e311e745 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:13.187200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-c983e8cd-89bb-4e12-bccb-5da9fc0859e9 None None] MFA Rules not processed for user `a926d6d59f86498bb2d1569dd28387f6`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:13.192252 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c983e8cd-89bb-4e12-bccb-5da9fc0859e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:13.285235 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e073f9-b383-4649-91b9-3709fb6a70d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:13.285235 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e073f9-b383-4649-91b9-3709fb6a70d7 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:13.285582 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e073f9-b383-4649-91b9-3709fb6a70d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:13.285689 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e073f9-b383-4649-91b9-3709fb6a70d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:13.286326 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e073f9-b383-4649-91b9-3709fb6a70d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:13.290403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e073f9-b383-4649-91b9-3709fb6a70d7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:13.298833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:13.370374 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3271/6609] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:18:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:18:13.375193 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3339/6610] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:18:13 2022] POST /identity/v3/projects => generated 377 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:18:13.376660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e073f9-b383-4649-91b9-3709fb6a70d7 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:13.376975 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983e8cd-89bb-4e12-bccb-5da9fc0859e9 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:13.390289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983e8cd-89bb-4e12-bccb-5da9fc0859e9 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:13.414294 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:13.470834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e073f9-b383-4649-91b9-3709fb6a70d7 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:13.486900 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa33d2-987a-4c5b-a597-b3215cbcb63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:13.487545 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa33d2-987a-4c5b-a597-b3215cbcb63b admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:13.487828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa33d2-987a-4c5b-a597-b3215cbcb63b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:13.488101 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa33d2-987a-4c5b-a597-b3215cbcb63b admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:13.488991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa33d2-987a-4c5b-a597-b3215cbcb63b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:13.489780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b8c49-c7b1-4b2d-8246-bec8181533df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:13.490414 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b8c49-c7b1-4b2d-8246-bec8181533df admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:13.490736 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b8c49-c7b1-4b2d-8246-bec8181533df admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:13.491104 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b8c49-c7b1-4b2d-8246-bec8181533df admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:13.491568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa33d2-987a-4c5b-a597-b3215cbcb63b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:13.491728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b8c49-c7b1-4b2d-8246-bec8181533df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:13.494583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b8c49-c7b1-4b2d-8246-bec8181533df admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:13.529971 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3272/6611] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:18:13 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:18:13.533494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa33d2-987a-4c5b-a597-b3215cbcb63b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:13.545711 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa33d2-987a-4c5b-a597-b3215cbcb63b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:13.551412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04f4cd-5430-41a6-a1ed-c90909593f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:13.552154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04f4cd-5430-41a6-a1ed-c90909593f6c admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:13.552586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04f4cd-5430-41a6-a1ed-c90909593f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:13.552964 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04f4cd-5430-41a6-a1ed-c90909593f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:13.553725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04f4cd-5430-41a6-a1ed-c90909593f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:13.557538 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3340/6612] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:18:13 2022] POST /identity/v3/projects => generated 367 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:18:13.557738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04f4cd-5430-41a6-a1ed-c90909593f6c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:13.560853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b8c49-c7b1-4b2d-8246-bec8181533df admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:13.582694 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3273/6613] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:18:13.590705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04f4cd-5430-41a6-a1ed-c90909593f6c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:13.614484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04f4cd-5430-41a6-a1ed-c90909593f6c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:13.697645 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b8c49-c7b1-4b2d-8246-bec8181533df admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:13.709147 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf459ca-6649-48b6-8f0d-206714a7a466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:13.710108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf459ca-6649-48b6-8f0d-206714a7a466 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:13.710404 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf459ca-6649-48b6-8f0d-206714a7a466 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:13.713614 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf459ca-6649-48b6-8f0d-206714a7a466 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:13.714361 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf459ca-6649-48b6-8f0d-206714a7a466 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:13.716421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf459ca-6649-48b6-8f0d-206714a7a466 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:13.723252 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79742300-9867-49df-b5b8-79d34ace53fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:13.724028 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79742300-9867-49df-b5b8-79d34ace53fa admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:13.724427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79742300-9867-49df-b5b8-79d34ace53fa admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:13.724809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79742300-9867-49df-b5b8-79d34ace53fa admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:13.725712 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79742300-9867-49df-b5b8-79d34ace53fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:13.729012 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79742300-9867-49df-b5b8-79d34ace53fa admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:13.752881 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3274/6614] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:18:13.757433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79742300-9867-49df-b5b8-79d34ace53fa admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:13.781363 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3341/6615] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:18:13 2022] POST /identity/v3/users => generated 284 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:18:13.784271 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79742300-9867-49df-b5b8-79d34ace53fa admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:13.785862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf459ca-6649-48b6-8f0d-206714a7a466 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:13.797039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030fa90d-38a3-4b76-a270-4eb9bfe3f925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:13.797721 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fa90d-38a3-4b76-a270-4eb9bfe3f925 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:13.798001 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fa90d-38a3-4b76-a270-4eb9bfe3f925 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:13.798692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fa90d-38a3-4b76-a270-4eb9bfe3f925 admin admin] PATH_INFO: `/v3/projects/44c722bb3a594abdba24dbd607aa5d1d/users/1fcfa7615ba1440bba1819edb5593b1a/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:13.800999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf459ca-6649-48b6-8f0d-206714a7a466 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:13.809801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ee2f1-19d0-4116-82fe-66125e2bc498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:13.810329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ee2f1-19d0-4116-82fe-66125e2bc498 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:13.810835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ee2f1-19d0-4116-82fe-66125e2bc498 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:13.811155 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ee2f1-19d0-4116-82fe-66125e2bc498 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:13.812044 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ee2f1-19d0-4116-82fe-66125e2bc498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:13.816043 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ee2f1-19d0-4116-82fe-66125e2bc498 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:13.818245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030fa90d-38a3-4b76-a270-4eb9bfe3f925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44c722bb3a594abdba24dbd607aa5d1d, user_id=1fcfa7615ba1440bba1819edb5593b1a, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:13.823415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030fa90d-38a3-4b76-a270-4eb9bfe3f925 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:13.841172 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3342/6616] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:18:13.842258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ee2f1-19d0-4116-82fe-66125e2bc498 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:13.851845 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3275/6617] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:18:13 2022] PUT /identity/v3/projects/44c722bb3a594abdba24dbd607aa5d1d/users/1fcfa7615ba1440bba1819edb5593b1a/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:18:13.863105 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f62e3-9194-4dec-8793-af3cc5b70ee2 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:13.863608 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f62e3-9194-4dec-8793-af3cc5b70ee2 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:13.863857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f62e3-9194-4dec-8793-af3cc5b70ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:13.871074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ee2f1-19d0-4116-82fe-66125e2bc498 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:13.900511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-ab8f62e3-9194-4dec-8793-af3cc5b70ee2 None None] MFA Rules not processed for user `1fcfa7615ba1440bba1819edb5593b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:13.901994 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ab8f62e3-9194-4dec-8793-af3cc5b70ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:13.926765 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:14.022529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ca2da-876f-4db2-a56b-40e6d44b3358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:14.023319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ca2da-876f-4db2-a56b-40e6d44b3358 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:14.023727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ca2da-876f-4db2-a56b-40e6d44b3358 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:14.024988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ca2da-876f-4db2-a56b-40e6d44b3358 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:14.025736 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ca2da-876f-4db2-a56b-40e6d44b3358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:14.027458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ca2da-876f-4db2-a56b-40e6d44b3358 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:14.052475 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3343/6618] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:18:14.054752 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ca2da-876f-4db2-a56b-40e6d44b3358 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:14.059010 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3276/6619] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:18:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:18:14.071966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f62e3-9194-4dec-8793-af3cc5b70ee2 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:14.074010 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ab8f62e3-9194-4dec-8793-af3cc5b70ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:14.079257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ca2da-876f-4db2-a56b-40e6d44b3358 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:14.095767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3ae49-74e3-427d-b5d5-4cfacb0e0fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:14.096752 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3ae49-74e3-427d-b5d5-4cfacb0e0fcb admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:14.097009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3ae49-74e3-427d-b5d5-4cfacb0e0fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:14.097355 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3ae49-74e3-427d-b5d5-4cfacb0e0fcb admin admin] PATH_INFO: `/v3/projects/d94dcc07ebb94d38ba826d4801b597b2/users/0db8a068d949412a8dac1c7561b1dce6/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:14.121663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3ae49-74e3-427d-b5d5-4cfacb0e0fcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d94dcc07ebb94d38ba826d4801b597b2, user_id=0db8a068d949412a8dac1c7561b1dce6, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:14.125094 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3ae49-74e3-427d-b5d5-4cfacb0e0fcb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:14.146720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:14.163298 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3344/6620] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:18:14 2022] PUT /identity/v3/projects/d94dcc07ebb94d38ba826d4801b597b2/users/0db8a068d949412a8dac1c7561b1dce6/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:18:14.180792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c6e51-33ae-4b6a-8c5c-a82171635ebe None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:14.181182 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c6e51-33ae-4b6a-8c5c-a82171635ebe None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:14.181529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c6e51-33ae-4b6a-8c5c-a82171635ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:14.231548 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-572c6e51-33ae-4b6a-8c5c-a82171635ebe None None] MFA Rules not processed for user `0db8a068d949412a8dac1c7561b1dce6`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:14.232890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-572c6e51-33ae-4b6a-8c5c-a82171635ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:14.242624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f62e3-9194-4dec-8793-af3cc5b70ee2 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:14.329067 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0bfcc-4adb-4bb9-b6b4-569f54c92e7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:14.330346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0bfcc-4adb-4bb9-b6b4-569f54c92e7f service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:14.330654 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0bfcc-4adb-4bb9-b6b4-569f54c92e7f service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:14.332320 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0bfcc-4adb-4bb9-b6b4-569f54c92e7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:14.364705 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3345/6621] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:18:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:18:14.380221 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c6e51-33ae-4b6a-8c5c-a82171635ebe None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:14.382158 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-572c6e51-33ae-4b6a-8c5c-a82171635ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:14.428745 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0bfcc-4adb-4bb9-b6b4-569f54c92e7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:14.431204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0bfcc-4adb-4bb9-b6b4-569f54c92e7f service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:14.443541 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3277/6622] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:18:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:18:14.484916 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c6e51-33ae-4b6a-8c5c-a82171635ebe None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:14.489570 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44aaeb-dd6d-43c0-b2cb-fb82767b8e5c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10759b2abd4cafacf338551327775e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:14.490007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44aaeb-dd6d-43c0-b2cb-fb82767b8e5c service glance] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:14.490294 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44aaeb-dd6d-43c0-b2cb-fb82767b8e5c service glance] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:14.490588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44aaeb-dd6d-43c0-b2cb-fb82767b8e5c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:14.572282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c44aaeb-dd6d-43c0-b2cb-fb82767b8e5c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:14.573663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c44aaeb-dd6d-43c0-b2cb-fb82767b8e5c service glance] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:14.586507 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3346/6623] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:18:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:18:14.820892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0bfcc-4adb-4bb9-b6b4-569f54c92e7f service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:14.835929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0bfcc-4adb-4bb9-b6b4-569f54c92e7f service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:14.846788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6523b3-348e-4db9-9cab-fdec72b232b0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10759b2abd4cafacf338551327775e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:14.847564 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6523b3-348e-4db9-9cab-fdec72b232b0 service glance] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:14.847965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6523b3-348e-4db9-9cab-fdec72b232b0 service glance] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:14.848339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6523b3-348e-4db9-9cab-fdec72b232b0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:14.858886 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6523b3-348e-4db9-9cab-fdec72b232b0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:14.860473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6523b3-348e-4db9-9cab-fdec72b232b0 service glance] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:14.872430 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3278/6624] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:18:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:18:16.785757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44aaeb-dd6d-43c0-b2cb-fb82767b8e5c service glance] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:16.911487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:16.964551 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44aaeb-dd6d-43c0-b2cb-fb82767b8e5c service glance] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:16.981587 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164aec9-6be6-4524-b9da-ea201eaab919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:16.982597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164aec9-6be6-4524-b9da-ea201eaab919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:16.983047 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164aec9-6be6-4524-b9da-ea201eaab919 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:16.983766 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164aec9-6be6-4524-b9da-ea201eaab919 admin admin] PATH_INFO: `/v3/users/a926d6d59f86498bb2d1569dd28387f6` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:16.986860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164aec9-6be6-4524-b9da-ea201eaab919 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a926d6d59f86498bb2d1569dd28387f6)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:16.993979 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164aec9-6be6-4524-b9da-ea201eaab919 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:17.108747 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2164aec9-6be6-4524-b9da-ea201eaab919 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a926d6d59f86498bb2d1569dd28387f6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:17.117068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2164aec9-6be6-4524-b9da-ea201eaab919 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a926d6d59f86498bb2d1569dd28387f6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:17.118474 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2164aec9-6be6-4524-b9da-ea201eaab919 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a926d6d59f86498bb2d1569dd28387f6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:17.119229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2164aec9-6be6-4524-b9da-ea201eaab919 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a926d6d59f86498bb2d1569dd28387f6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:17.134516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2164aec9-6be6-4524-b9da-ea201eaab919 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a926d6d59f86498bb2d1569dd28387f6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:17.174403 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb9b6e-a72c-4db5-9d37-2bb2cc641625 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:17.175002 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb9b6e-a72c-4db5-9d37-2bb2cc641625 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:17.175224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb9b6e-a72c-4db5-9d37-2bb2cc641625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:17.178175 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3347/6625] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:18:16 2022] DELETE /identity/v3/users/a926d6d59f86498bb2d1569dd28387f6 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:18:17.197335 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-e8eb9b6e-a72c-4db5-9d37-2bb2cc641625 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:17.198780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e8eb9b6e-a72c-4db5-9d37-2bb2cc641625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:17.209576 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:17.272047 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3279/6626] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:18:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:18:17.307943 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164aec9-6be6-4524-b9da-ea201eaab919 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:17.309460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2164aec9-6be6-4524-b9da-ea201eaab919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:17.442132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164aec9-6be6-4524-b9da-ea201eaab919 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:17.456226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af544870-0f55-42f6-9575-7cbdb77954f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:17.457103 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af544870-0f55-42f6-9575-7cbdb77954f3 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:17.458000 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af544870-0f55-42f6-9575-7cbdb77954f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:17.458000 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af544870-0f55-42f6-9575-7cbdb77954f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:17.473736 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af544870-0f55-42f6-9575-7cbdb77954f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:17.475633 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af544870-0f55-42f6-9575-7cbdb77954f3 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:17.499373 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3348/6627] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:18:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:18:19.199479 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb9b6e-a72c-4db5-9d37-2bb2cc641625 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:19.201563 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e8eb9b6e-a72c-4db5-9d37-2bb2cc641625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:19.227173 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb9b6e-a72c-4db5-9d37-2bb2cc641625 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:19.240306 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d629315-efdd-4255-a676-f6f4b3bc48ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:19.241075 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d629315-efdd-4255-a676-f6f4b3bc48ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:19.241378 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d629315-efdd-4255-a676-f6f4b3bc48ac admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:19.241724 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d629315-efdd-4255-a676-f6f4b3bc48ac admin admin] PATH_INFO: `/v3/projects/5c1dcd07d5a54ae7bf80e0db67853fcf` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:19.242940 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d629315-efdd-4255-a676-f6f4b3bc48ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c1dcd07d5a54ae7bf80e0db67853fcf)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:19.244915 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d629315-efdd-4255-a676-f6f4b3bc48ac admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:19.375945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1d629315-efdd-4255-a676-f6f4b3bc48ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c1dcd07d5a54ae7bf80e0db67853fcf', 'request_id': 'req-1d629315-efdd-4255-a676-f6f4b3bc48ac'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:19.391518 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1d629315-efdd-4255-a676-f6f4b3bc48ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c1dcd07d5a54ae7bf80e0db67853fcf', 'request_id': 'req-1d629315-efdd-4255-a676-f6f4b3bc48ac'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:19.400694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1d629315-efdd-4255-a676-f6f4b3bc48ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c1dcd07d5a54ae7bf80e0db67853fcf', 'request_id': 'req-1d629315-efdd-4255-a676-f6f4b3bc48ac'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:19.435857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1d629315-efdd-4255-a676-f6f4b3bc48ac admin admin] The token cache is being invalidate because project 5c1dcd07d5a54ae7bf80e0db67853fcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:18:19.436157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1d629315-efdd-4255-a676-f6f4b3bc48ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:19.437076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1d629315-efdd-4255-a676-f6f4b3bc48ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:19.439929 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3280/6628] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:18:19 2022] DELETE /identity/v3/projects/5c1dcd07d5a54ae7bf80e0db67853fcf => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:18:19.443806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af544870-0f55-42f6-9575-7cbdb77954f3 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:19.454536 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af544870-0f55-42f6-9575-7cbdb77954f3 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:19.546725 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f47edf-b01d-4c56-800f-01c7c9ef5d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:19.548540 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f47edf-b01d-4c56-800f-01c7c9ef5d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:19.548540 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f47edf-b01d-4c56-800f-01c7c9ef5d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:19.548540 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f47edf-b01d-4c56-800f-01c7c9ef5d3d admin admin] PATH_INFO: `/v3/users/0db8a068d949412a8dac1c7561b1dce6` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:19.550310 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f47edf-b01d-4c56-800f-01c7c9ef5d3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0db8a068d949412a8dac1c7561b1dce6)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:19.552153 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f47edf-b01d-4c56-800f-01c7c9ef5d3d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:19.558910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:19.616652 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e0f47edf-b01d-4c56-800f-01c7c9ef5d3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0db8a068d949412a8dac1c7561b1dce6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:19.626410 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e0f47edf-b01d-4c56-800f-01c7c9ef5d3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0db8a068d949412a8dac1c7561b1dce6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:19.627367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e0f47edf-b01d-4c56-800f-01c7c9ef5d3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0db8a068d949412a8dac1c7561b1dce6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:19.628089 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e0f47edf-b01d-4c56-800f-01c7c9ef5d3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0db8a068d949412a8dac1c7561b1dce6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:19.639506 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e0f47edf-b01d-4c56-800f-01c7c9ef5d3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0db8a068d949412a8dac1c7561b1dce6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:19.664391 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3349/6629] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:18:19 2022] DELETE /identity/v3/users/0db8a068d949412a8dac1c7561b1dce6 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:18:20.478492 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d629315-efdd-4255-a676-f6f4b3bc48ac admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:20.481034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1d629315-efdd-4255-a676-f6f4b3bc48ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:20.500973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d629315-efdd-4255-a676-f6f4b3bc48ac admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:20.626533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26611c-a3ca-4ef5-9512-23e8a8e04cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:20.627663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26611c-a3ca-4ef5-9512-23e8a8e04cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:20.628106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26611c-a3ca-4ef5-9512-23e8a8e04cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:20.629282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26611c-a3ca-4ef5-9512-23e8a8e04cc8 admin admin] PATH_INFO: `/v3/projects/d94dcc07ebb94d38ba826d4801b597b2` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:20.631061 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26611c-a3ca-4ef5-9512-23e8a8e04cc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d94dcc07ebb94d38ba826d4801b597b2)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:20.634619 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26611c-a3ca-4ef5-9512-23e8a8e04cc8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:20.732428 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:20.751329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fa26611c-a3ca-4ef5-9512-23e8a8e04cc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd94dcc07ebb94d38ba826d4801b597b2', 'request_id': 'req-fa26611c-a3ca-4ef5-9512-23e8a8e04cc8'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:20.769882 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fa26611c-a3ca-4ef5-9512-23e8a8e04cc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd94dcc07ebb94d38ba826d4801b597b2', 'request_id': 'req-fa26611c-a3ca-4ef5-9512-23e8a8e04cc8'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:20.780689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fa26611c-a3ca-4ef5-9512-23e8a8e04cc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd94dcc07ebb94d38ba826d4801b597b2', 'request_id': 'req-fa26611c-a3ca-4ef5-9512-23e8a8e04cc8'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:20.804932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fa26611c-a3ca-4ef5-9512-23e8a8e04cc8 admin admin] The token cache is being invalidate because project d94dcc07ebb94d38ba826d4801b597b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:18:20.805396 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fa26611c-a3ca-4ef5-9512-23e8a8e04cc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:20.806330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fa26611c-a3ca-4ef5-9512-23e8a8e04cc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:20.812812 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3281/6630] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:18:20 2022] DELETE /identity/v3/projects/d94dcc07ebb94d38ba826d4801b597b2 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:18:20.815369 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b96131-c130-44fe-8e73-36681113aea8 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:20.816249 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b96131-c130-44fe-8e73-36681113aea8 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:20.817243 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b96131-c130-44fe-8e73-36681113aea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:20.846939 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-55b96131-c130-44fe-8e73-36681113aea8 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:20.849212 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-55b96131-c130-44fe-8e73-36681113aea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:20.985312 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3350/6631] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:18:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:18:20.993697 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210d05a-757c-4ce7-8286-853ad7bae6aa None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:20.994430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210d05a-757c-4ce7-8286-853ad7bae6aa None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:20.994974 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210d05a-757c-4ce7-8286-853ad7bae6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:21.036221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-b210d05a-757c-4ce7-8286-853ad7bae6aa None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:21.038223 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b210d05a-757c-4ce7-8286-853ad7bae6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:21.058672 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3282/6632] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:18:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:18:21.062136 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b96131-c130-44fe-8e73-36681113aea8 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:21.076961 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b96131-c130-44fe-8e73-36681113aea8 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:21.082043 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519710de-d500-47ba-baef-66525379b834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:21.082824 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519710de-d500-47ba-baef-66525379b834 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:21.083010 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519710de-d500-47ba-baef-66525379b834 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:21.083282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519710de-d500-47ba-baef-66525379b834 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:21.083934 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519710de-d500-47ba-baef-66525379b834 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:18:21.087425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519710de-d500-47ba-baef-66525379b834 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:21.087425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519710de-d500-47ba-baef-66525379b834 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:21.102874 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3351/6633] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:18:21.104226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b210d05a-757c-4ce7-8286-853ad7bae6aa None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:21.114665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b210d05a-757c-4ce7-8286-853ad7bae6aa None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:21.120814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c5e4e-a3d3-4259-9bae-92dd071667b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:21.121232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c5e4e-a3d3-4259-9bae-92dd071667b7 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:21.121668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c5e4e-a3d3-4259-9bae-92dd071667b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:21.122052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c5e4e-a3d3-4259-9bae-92dd071667b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:21.122820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c5e4e-a3d3-4259-9bae-92dd071667b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:21.124838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c5e4e-a3d3-4259-9bae-92dd071667b7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:21.162590 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3283/6634] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:18:21 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:18:21.166856 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519710de-d500-47ba-baef-66525379b834 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:21.183897 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519710de-d500-47ba-baef-66525379b834 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:21.362932 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a863e05-5aee-42d4-b903-283aa31ddf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:21.365604 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a863e05-5aee-42d4-b903-283aa31ddf75 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:21.365963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a863e05-5aee-42d4-b903-283aa31ddf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:21.368611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a863e05-5aee-42d4-b903-283aa31ddf75 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:21.369369 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a863e05-5aee-42d4-b903-283aa31ddf75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:21.371531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a863e05-5aee-42d4-b903-283aa31ddf75 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:21.411737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:21.420506 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3352/6635] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:18:21 2022] POST /identity/v3/users => generated 286 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:18:21.425057 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c5e4e-a3d3-4259-9bae-92dd071667b7 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:21.439558 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c5e4e-a3d3-4259-9bae-92dd071667b7 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:21.463522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab9be3-c35d-4295-b417-80a102d0ad80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:21.464738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab9be3-c35d-4295-b417-80a102d0ad80 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:21.469705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab9be3-c35d-4295-b417-80a102d0ad80 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:21.470066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab9be3-c35d-4295-b417-80a102d0ad80 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:21.473366 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab9be3-c35d-4295-b417-80a102d0ad80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:21.477353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab9be3-c35d-4295-b417-80a102d0ad80 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:21.517383 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3284/6636] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:18:21.518537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a863e05-5aee-42d4-b903-283aa31ddf75 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:21.539320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a863e05-5aee-42d4-b903-283aa31ddf75 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:21.548663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7232913-bf38-4001-8203-ad4ac3d9cdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:21.555335 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7232913-bf38-4001-8203-ad4ac3d9cdd9 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:21.556141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7232913-bf38-4001-8203-ad4ac3d9cdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:21.556433 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7232913-bf38-4001-8203-ad4ac3d9cdd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:21.557178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7232913-bf38-4001-8203-ad4ac3d9cdd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:21.560282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7232913-bf38-4001-8203-ad4ac3d9cdd9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:21.592173 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3353/6637] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:18:21.597870 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab9be3-c35d-4295-b417-80a102d0ad80 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:21.623109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab9be3-c35d-4295-b417-80a102d0ad80 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:21.642976 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b306b0-5bb9-488c-9db0-fd3ffdbd64af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:21.650749 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b306b0-5bb9-488c-9db0-fd3ffdbd64af admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:21.652470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b306b0-5bb9-488c-9db0-fd3ffdbd64af admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:21.653008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b306b0-5bb9-488c-9db0-fd3ffdbd64af admin admin] PATH_INFO: `/v3/projects/efa3ae9254154934be992586b3971251/users/8ca79504e3754ff99637bd5aa3fce3ee/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:21.739661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b306b0-5bb9-488c-9db0-fd3ffdbd64af admin admin] RBAC: Authorizing `identity:create_grant(project_id=efa3ae9254154934be992586b3971251, user_id=8ca79504e3754ff99637bd5aa3fce3ee, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:21.746318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b306b0-5bb9-488c-9db0-fd3ffdbd64af admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:21.792059 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3285/6638] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:18:21 2022] PUT /identity/v3/projects/efa3ae9254154934be992586b3971251/users/8ca79504e3754ff99637bd5aa3fce3ee/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:18:21.793797 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8818097-cc85-4141-9043-22767acc3ecf None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:21.794084 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8818097-cc85-4141-9043-22767acc3ecf None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:21.794384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8818097-cc85-4141-9043-22767acc3ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:21.836663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-f8818097-cc85-4141-9043-22767acc3ecf None None] MFA Rules not processed for user `8ca79504e3754ff99637bd5aa3fce3ee`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:21.839650 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f8818097-cc85-4141-9043-22767acc3ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:21.963638 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3354/6639] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:18:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:18:21.971795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b306b0-5bb9-488c-9db0-fd3ffdbd64af admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:21.973614 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-04b306b0-5bb9-488c-9db0-fd3ffdbd64af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:22.047044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b306b0-5bb9-488c-9db0-fd3ffdbd64af admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:22.051429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb96b47-0ce6-4a75-b882-515c1ff3fdf9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10759b2abd4cafacf338551327775e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:22.052060 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb96b47-0ce6-4a75-b882-515c1ff3fdf9 service glance] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:22.052344 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb96b47-0ce6-4a75-b882-515c1ff3fdf9 service glance] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:22.052623 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb96b47-0ce6-4a75-b882-515c1ff3fdf9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:22.064418 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb96b47-0ce6-4a75-b882-515c1ff3fdf9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:22.066153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb96b47-0ce6-4a75-b882-515c1ff3fdf9 service glance] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:22.076990 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3286/6640] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:18:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:18:23.206207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8818097-cc85-4141-9043-22767acc3ecf None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:23.372050 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8818097-cc85-4141-9043-22767acc3ecf None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:23.391146 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59260bfe-79cd-40e8-bcae-9f15bd1d2415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:23.392173 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59260bfe-79cd-40e8-bcae-9f15bd1d2415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:23.392679 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59260bfe-79cd-40e8-bcae-9f15bd1d2415 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:23.393120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59260bfe-79cd-40e8-bcae-9f15bd1d2415 admin admin] PATH_INFO: `/v3/users/8ca79504e3754ff99637bd5aa3fce3ee` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:23.396209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59260bfe-79cd-40e8-bcae-9f15bd1d2415 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ca79504e3754ff99637bd5aa3fce3ee)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:23.401187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59260bfe-79cd-40e8-bcae-9f15bd1d2415 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:23.490982 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-59260bfe-79cd-40e8-bcae-9f15bd1d2415 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ca79504e3754ff99637bd5aa3fce3ee'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:23.502770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-59260bfe-79cd-40e8-bcae-9f15bd1d2415 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ca79504e3754ff99637bd5aa3fce3ee'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:23.503818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-59260bfe-79cd-40e8-bcae-9f15bd1d2415 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ca79504e3754ff99637bd5aa3fce3ee'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:23.504607 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-59260bfe-79cd-40e8-bcae-9f15bd1d2415 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ca79504e3754ff99637bd5aa3fce3ee'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:23.516767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-59260bfe-79cd-40e8-bcae-9f15bd1d2415 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ca79504e3754ff99637bd5aa3fce3ee'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:23.540064 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:23.556645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2b71d-2fba-449a-b7e4-0c028483a898 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:23.557169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2b71d-2fba-449a-b7e4-0c028483a898 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:23.557169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2b71d-2fba-449a-b7e4-0c028483a898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:23.562845 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3355/6641] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:18:23 2022] DELETE /identity/v3/users/8ca79504e3754ff99637bd5aa3fce3ee => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:18:23.583568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-aed2b71d-2fba-449a-b7e4-0c028483a898 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:23.584824 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-aed2b71d-2fba-449a-b7e4-0c028483a898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:23.675136 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3287/6642] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:18:23.685383 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59260bfe-79cd-40e8-bcae-9f15bd1d2415 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:23.687540 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-59260bfe-79cd-40e8-bcae-9f15bd1d2415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:23.801582 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59260bfe-79cd-40e8-bcae-9f15bd1d2415 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:23.806188 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5cff6-8e79-44e5-8360-e561a72a0850 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:23.807032 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5cff6-8e79-44e5-8360-e561a72a0850 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:23.807468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5cff6-8e79-44e5-8360-e561a72a0850 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:23.807844 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5cff6-8e79-44e5-8360-e561a72a0850 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:23.820830 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5cff6-8e79-44e5-8360-e561a72a0850 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:23.824372 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5cff6-8e79-44e5-8360-e561a72a0850 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:23.850885 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3356/6643] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:18:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:18:24.688376 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2b71d-2fba-449a-b7e4-0c028483a898 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:24.709412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2b71d-2fba-449a-b7e4-0c028483a898 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:24.724026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b03fa-ae5f-4338-9927-5fb0803a9ea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:24.725031 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b03fa-ae5f-4338-9927-5fb0803a9ea2 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:24.725878 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b03fa-ae5f-4338-9927-5fb0803a9ea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:24.726629 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b03fa-ae5f-4338-9927-5fb0803a9ea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:24.728816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-201b03fa-ae5f-4338-9927-5fb0803a9ea2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:24.742153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:24.899871 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b03fa-ae5f-4338-9927-5fb0803a9ea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:24.902187 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b03fa-ae5f-4338-9927-5fb0803a9ea2 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:24.923333 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3288/6644] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:18:24 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:18:25.050150 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5cff6-8e79-44e5-8360-e561a72a0850 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:25.053064 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-aba5cff6-8e79-44e5-8360-e561a72a0850 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:25.084382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5cff6-8e79-44e5-8360-e561a72a0850 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:25.093787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c50919-3dc5-4785-8202-4f7e1cbad21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:25.094937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c50919-3dc5-4785-8202-4f7e1cbad21b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:25.095575 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c50919-3dc5-4785-8202-4f7e1cbad21b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:25.096206 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c50919-3dc5-4785-8202-4f7e1cbad21b admin admin] PATH_INFO: `/v3/projects/efa3ae9254154934be992586b3971251` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:25.098230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c50919-3dc5-4785-8202-4f7e1cbad21b admin admin] RBAC: Authorizing `identity:delete_project(project_id=efa3ae9254154934be992586b3971251)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:25.103129 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c50919-3dc5-4785-8202-4f7e1cbad21b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:25.266720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c4c50919-3dc5-4785-8202-4f7e1cbad21b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efa3ae9254154934be992586b3971251', 'request_id': 'req-c4c50919-3dc5-4785-8202-4f7e1cbad21b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:25.273478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c4c50919-3dc5-4785-8202-4f7e1cbad21b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efa3ae9254154934be992586b3971251', 'request_id': 'req-c4c50919-3dc5-4785-8202-4f7e1cbad21b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:25.285511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c4c50919-3dc5-4785-8202-4f7e1cbad21b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efa3ae9254154934be992586b3971251', 'request_id': 'req-c4c50919-3dc5-4785-8202-4f7e1cbad21b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:25.303085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c4c50919-3dc5-4785-8202-4f7e1cbad21b admin admin] The token cache is being invalidate because project efa3ae9254154934be992586b3971251 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:18:25.303424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c4c50919-3dc5-4785-8202-4f7e1cbad21b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:25.304805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c4c50919-3dc5-4785-8202-4f7e1cbad21b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:25.310723 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3357/6645] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:18:25 2022] DELETE /identity/v3/projects/efa3ae9254154934be992586b3971251 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:18:25.312441 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b91339-761f-4215-87b5-aea018db2655 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:25.312736 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b91339-761f-4215-87b5-aea018db2655 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:25.313016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b91339-761f-4215-87b5-aea018db2655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:25.344119 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-37b91339-761f-4215-87b5-aea018db2655 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:25.345649 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-37b91339-761f-4215-87b5-aea018db2655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:25.433117 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3289/6646] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:18:25.441730 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b052e8-1892-49ba-acd6-a882299e4754 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:25.445012 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b052e8-1892-49ba-acd6-a882299e4754 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:25.451831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b052e8-1892-49ba-acd6-a882299e4754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:25.483263 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-36b052e8-1892-49ba-acd6-a882299e4754 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:25.485114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-36b052e8-1892-49ba-acd6-a882299e4754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:25.500496 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3358/6647] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:18:25.508006 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b91339-761f-4215-87b5-aea018db2655 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:25.526398 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b91339-761f-4215-87b5-aea018db2655 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:25.532109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9f816-9fd3-405c-87c5-a04bd7658aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:25.533036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9f816-9fd3-405c-87c5-a04bd7658aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:25.534103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9f816-9fd3-405c-87c5-a04bd7658aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:25.534854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9f816-9fd3-405c-87c5-a04bd7658aa6 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:25.535771 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d9f816-9fd3-405c-87c5-a04bd7658aa6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:18:25.536238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d9f816-9fd3-405c-87c5-a04bd7658aa6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:25.539125 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d9f816-9fd3-405c-87c5-a04bd7658aa6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:25.559861 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3290/6648] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:18:25.563969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b052e8-1892-49ba-acd6-a882299e4754 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:25.581030 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b052e8-1892-49ba-acd6-a882299e4754 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:25.589432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce439c-f157-4459-89c0-2cea813f038f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:25.591222 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce439c-f157-4459-89c0-2cea813f038f admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:25.591723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce439c-f157-4459-89c0-2cea813f038f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:25.592212 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce439c-f157-4459-89c0-2cea813f038f admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:25.593014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce439c-f157-4459-89c0-2cea813f038f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:25.595352 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce439c-f157-4459-89c0-2cea813f038f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:25.671909 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3359/6649] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:18:25 2022] POST /identity/v3/projects => generated 399 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:18:25.676640 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9f816-9fd3-405c-87c5-a04bd7658aa6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:25.700735 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9f816-9fd3-405c-87c5-a04bd7658aa6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:25.822799 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da8971-b7dc-40da-ba95-6d0e232b7d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:25.823805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da8971-b7dc-40da-ba95-6d0e232b7d3f admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:25.824339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da8971-b7dc-40da-ba95-6d0e232b7d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:25.824731 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da8971-b7dc-40da-ba95-6d0e232b7d3f admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:25.825428 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da8971-b7dc-40da-ba95-6d0e232b7d3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:25.827596 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da8971-b7dc-40da-ba95-6d0e232b7d3f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:25.863685 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3291/6650] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:18:25 2022] POST /identity/v3/users => generated 300 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:18:25.873033 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce439c-f157-4459-89c0-2cea813f038f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:25.889480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce439c-f157-4459-89c0-2cea813f038f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:25.895193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477cdcbe-1b7b-497b-a69e-696b8a8d8b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:25.896082 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477cdcbe-1b7b-497b-a69e-696b8a8d8b89 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:25.898012 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477cdcbe-1b7b-497b-a69e-696b8a8d8b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:25.898647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477cdcbe-1b7b-497b-a69e-696b8a8d8b89 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:25.899692 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477cdcbe-1b7b-497b-a69e-696b8a8d8b89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:25.901960 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477cdcbe-1b7b-497b-a69e-696b8a8d8b89 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:25.918742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da8971-b7dc-40da-ba95-6d0e232b7d3f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:25.925613 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3360/6651] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:18:25.932054 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da8971-b7dc-40da-ba95-6d0e232b7d3f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:25.937178 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71497d-4135-4392-bcc6-726fb61f42d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:25.937971 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71497d-4135-4392-bcc6-726fb61f42d7 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:25.938482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71497d-4135-4392-bcc6-726fb61f42d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:25.939077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71497d-4135-4392-bcc6-726fb61f42d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:25.939988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b71497d-4135-4392-bcc6-726fb61f42d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:25.941880 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b71497d-4135-4392-bcc6-726fb61f42d7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:25.962966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477cdcbe-1b7b-497b-a69e-696b8a8d8b89 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:25.969990 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3292/6652] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:18:25.974208 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477cdcbe-1b7b-497b-a69e-696b8a8d8b89 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:25.979760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363082b-af3b-48b8-b82c-b223360dc982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:25.980781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363082b-af3b-48b8-b82c-b223360dc982 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:25.981262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363082b-af3b-48b8-b82c-b223360dc982 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:25.982045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363082b-af3b-48b8-b82c-b223360dc982 admin admin] PATH_INFO: `/v3/projects/b755005cd9414d11b443612d8afc75e5/users/33f195c4e1ea4252b4911210ded2e8a4/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:26.004889 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0363082b-af3b-48b8-b82c-b223360dc982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b755005cd9414d11b443612d8afc75e5, user_id=33f195c4e1ea4252b4911210ded2e8a4, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:26.009595 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0363082b-af3b-48b8-b82c-b223360dc982 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:26.032864 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3361/6653] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:18:25 2022] PUT /identity/v3/projects/b755005cd9414d11b443612d8afc75e5/users/33f195c4e1ea4252b4911210ded2e8a4/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:18:26.045201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c8da3-c9ab-4ab1-9510-4a2c34a08941 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:26.045823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c8da3-c9ab-4ab1-9510-4a2c34a08941 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:26.046405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c8da3-c9ab-4ab1-9510-4a2c34a08941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:26.070752 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:26.082693 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-882c8da3-c9ab-4ab1-9510-4a2c34a08941 None None] MFA Rules not processed for user `33f195c4e1ea4252b4911210ded2e8a4`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:26.084517 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-882c8da3-c9ab-4ab1-9510-4a2c34a08941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:26.178187 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3293/6654] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:18:26 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:18:26.179912 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363082b-af3b-48b8-b82c-b223360dc982 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:26.207966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:26.289625 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363082b-af3b-48b8-b82c-b223360dc982 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:26.296801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd39c5a-9304-4ece-a18c-d8dcd9e4a434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:26.296965 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd39c5a-9304-4ece-a18c-d8dcd9e4a434 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:26.297226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd39c5a-9304-4ece-a18c-d8dcd9e4a434 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:26.297472 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd39c5a-9304-4ece-a18c-d8dcd9e4a434 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:26.298379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd39c5a-9304-4ece-a18c-d8dcd9e4a434 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:26.300388 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd39c5a-9304-4ece-a18c-d8dcd9e4a434 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:26.346410 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3362/6655] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:18:26 2022] POST /identity/v3/projects => generated 399 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:18:26.348077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c8da3-c9ab-4ab1-9510-4a2c34a08941 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:26.362601 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c8da3-c9ab-4ab1-9510-4a2c34a08941 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:26.446315 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434015bc-3a53-418b-acf7-3dd95981f907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:26.446749 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434015bc-3a53-418b-acf7-3dd95981f907 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:26.447444 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434015bc-3a53-418b-acf7-3dd95981f907 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:26.448000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434015bc-3a53-418b-acf7-3dd95981f907 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:26.448782 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434015bc-3a53-418b-acf7-3dd95981f907 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:26.451327 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434015bc-3a53-418b-acf7-3dd95981f907 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:26.493371 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3294/6656] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:18:26 2022] POST /identity/v3/users => generated 306 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:18:26.497496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd39c5a-9304-4ece-a18c-d8dcd9e4a434 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:26.512940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd39c5a-9304-4ece-a18c-d8dcd9e4a434 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:26.520877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8d3bd-1897-4c1c-bac2-56c43a9abfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:26.521689 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8d3bd-1897-4c1c-bac2-56c43a9abfea admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:26.522080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8d3bd-1897-4c1c-bac2-56c43a9abfea admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:26.523260 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8d3bd-1897-4c1c-bac2-56c43a9abfea admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:26.524665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe8d3bd-1897-4c1c-bac2-56c43a9abfea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:26.526567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe8d3bd-1897-4c1c-bac2-56c43a9abfea admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:26.551428 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3363/6657] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:18:26.555816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434015bc-3a53-418b-acf7-3dd95981f907 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:26.566198 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434015bc-3a53-418b-acf7-3dd95981f907 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:26.573552 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8f857-14da-4e3a-b2b9-b21ec1419846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:26.574670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8f857-14da-4e3a-b2b9-b21ec1419846 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:26.574670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8f857-14da-4e3a-b2b9-b21ec1419846 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:26.574907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8f857-14da-4e3a-b2b9-b21ec1419846 admin admin] PATH_INFO: `/v3/projects/648dc0de53c74b9486efaddccce59ce7/users/e07287de949547e7b9d9ccbd6e7c6073/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:26.594645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd8f857-14da-4e3a-b2b9-b21ec1419846 admin admin] RBAC: Authorizing `identity:create_grant(project_id=648dc0de53c74b9486efaddccce59ce7, user_id=e07287de949547e7b9d9ccbd6e7c6073, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:26.597676 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd8f857-14da-4e3a-b2b9-b21ec1419846 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:26.617756 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3295/6658] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:18:26 2022] PUT /identity/v3/projects/648dc0de53c74b9486efaddccce59ce7/users/e07287de949547e7b9d9ccbd6e7c6073/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:18:26.622103 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8d3bd-1897-4c1c-bac2-56c43a9abfea admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:26.640366 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8d3bd-1897-4c1c-bac2-56c43a9abfea admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:26.747696 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696667cf-e5af-4a36-8b93-f6e88d3440f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:26.749606 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696667cf-e5af-4a36-8b93-f6e88d3440f0 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:26.749606 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696667cf-e5af-4a36-8b93-f6e88d3440f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:26.749606 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696667cf-e5af-4a36-8b93-f6e88d3440f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:26.750107 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696667cf-e5af-4a36-8b93-f6e88d3440f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:26.751968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696667cf-e5af-4a36-8b93-f6e88d3440f0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:26.767428 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3364/6659] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:18:26.771441 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8f857-14da-4e3a-b2b9-b21ec1419846 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:26.786124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8f857-14da-4e3a-b2b9-b21ec1419846 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:26.800702 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6e136-750b-4901-878e-3a3a0ae2e745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:26.801454 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6e136-750b-4901-878e-3a3a0ae2e745 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:26.802417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6e136-750b-4901-878e-3a3a0ae2e745 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:26.802756 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6e136-750b-4901-878e-3a3a0ae2e745 admin admin] PATH_INFO: `/v3/projects/648dc0de53c74b9486efaddccce59ce7/users/e07287de949547e7b9d9ccbd6e7c6073/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:26.806316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6e136-750b-4901-878e-3a3a0ae2e745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=648dc0de53c74b9486efaddccce59ce7, user_id=e07287de949547e7b9d9ccbd6e7c6073, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:26.809773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6e136-750b-4901-878e-3a3a0ae2e745 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:26.821850 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3296/6660] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:18:26 2022] PUT /identity/v3/projects/648dc0de53c74b9486efaddccce59ce7/users/e07287de949547e7b9d9ccbd6e7c6073/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:18:26.833375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a26573-ffd6-4a0a-9c64-da770c441666 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:26.833664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a26573-ffd6-4a0a-9c64-da770c441666 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:26.833952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a26573-ffd6-4a0a-9c64-da770c441666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:26.864122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-c7a26573-ffd6-4a0a-9c64-da770c441666 None None] MFA Rules not processed for user `e07287de949547e7b9d9ccbd6e7c6073`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:26.865507 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c7a26573-ffd6-4a0a-9c64-da770c441666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:26.956713 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3365/6661] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:18:26 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:18:26.965766 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6e136-750b-4901-878e-3a3a0ae2e745 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:26.967621 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-98c6e136-750b-4901-878e-3a3a0ae2e745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:27.041818 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6e136-750b-4901-878e-3a3a0ae2e745 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:27.046110 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad435b-e640-4473-b219-692d26f85a42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:27.046885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad435b-e640-4473-b219-692d26f85a42 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:27.047233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad435b-e640-4473-b219-692d26f85a42 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:27.047573 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad435b-e640-4473-b219-692d26f85a42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:27.053154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:27.126034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad435b-e640-4473-b219-692d26f85a42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:27.127747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad435b-e640-4473-b219-692d26f85a42 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:27.138868 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3297/6662] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:18:26 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:18:28.174324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a26573-ffd6-4a0a-9c64-da770c441666 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:28.176662 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c7a26573-ffd6-4a0a-9c64-da770c441666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:28.228571 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:28.383804 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a26573-ffd6-4a0a-9c64-da770c441666 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:28.394190 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668e35d-ae92-4015-97f5-8740210e05e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:28.394853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668e35d-ae92-4015-97f5-8740210e05e5 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:28.395135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668e35d-ae92-4015-97f5-8740210e05e5 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:28.395411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668e35d-ae92-4015-97f5-8740210e05e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:28.424010 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668e35d-ae92-4015-97f5-8740210e05e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:28.425639 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668e35d-ae92-4015-97f5-8740210e05e5 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:28.462945 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3366/6663] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:18:28 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:18:37.134032 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=25 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:38.436494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=27 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:39.981128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad435b-e640-4473-b219-692d26f85a42 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:40.101610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad435b-e640-4473-b219-692d26f85a42 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:40.107368 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21a0c5-f7c4-4e24-85a3-3ce69c37eb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:40.108035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21a0c5-f7c4-4e24-85a3-3ce69c37eb9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:40.108316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21a0c5-f7c4-4e24-85a3-3ce69c37eb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:40.108594 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21a0c5-f7c4-4e24-85a3-3ce69c37eb9e admin admin] PATH_INFO: `/v3/users/33f195c4e1ea4252b4911210ded2e8a4` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:40.111425 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21a0c5-f7c4-4e24-85a3-3ce69c37eb9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=33f195c4e1ea4252b4911210ded2e8a4)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:40.114094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21a0c5-f7c4-4e24-85a3-3ce69c37eb9e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:40.206361 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6a21a0c5-f7c4-4e24-85a3-3ce69c37eb9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33f195c4e1ea4252b4911210ded2e8a4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:40.207383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6a21a0c5-f7c4-4e24-85a3-3ce69c37eb9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33f195c4e1ea4252b4911210ded2e8a4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:40.209308 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6a21a0c5-f7c4-4e24-85a3-3ce69c37eb9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33f195c4e1ea4252b4911210ded2e8a4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:40.224204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6a21a0c5-f7c4-4e24-85a3-3ce69c37eb9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33f195c4e1ea4252b4911210ded2e8a4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:40.257952 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6a21a0c5-f7c4-4e24-85a3-3ce69c37eb9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33f195c4e1ea4252b4911210ded2e8a4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:40.275521 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3298/6664] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:18:39 2022] DELETE /identity/v3/users/33f195c4e1ea4252b4911210ded2e8a4 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:18:40.280119 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e06d9f-02db-427a-ac19-f3b4d58df5b4 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:40.281134 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e06d9f-02db-427a-ac19-f3b4d58df5b4 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:40.282797 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e06d9f-02db-427a-ac19-f3b4d58df5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:40.330284 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a6e06d9f-02db-427a-ac19-f3b4d58df5b4 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:40.332672 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a6e06d9f-02db-427a-ac19-f3b4d58df5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:40.463947 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3367/6665] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:18:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:18:40.476495 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21a0c5-f7c4-4e24-85a3-3ce69c37eb9e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:40.478287 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6a21a0c5-f7c4-4e24-85a3-3ce69c37eb9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:40.590162 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21a0c5-f7c4-4e24-85a3-3ce69c37eb9e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:40.594576 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f49591-6b37-450d-b6bd-ac4a68cc0ef6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:40.595607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f49591-6b37-450d-b6bd-ac4a68cc0ef6 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:40.596084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f49591-6b37-450d-b6bd-ac4a68cc0ef6 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:40.602295 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f49591-6b37-450d-b6bd-ac4a68cc0ef6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:40.633615 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f49591-6b37-450d-b6bd-ac4a68cc0ef6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:40.635823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f49591-6b37-450d-b6bd-ac4a68cc0ef6 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:40.661460 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3299/6666] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:18:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:18:41.483944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e06d9f-02db-427a-ac19-f3b4d58df5b4 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:41.486112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a6e06d9f-02db-427a-ac19-f3b4d58df5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:41.502266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e06d9f-02db-427a-ac19-f3b4d58df5b4 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:41.508962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c6f64-f0cb-4a3c-afe4-bcf5df1b9931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:41.509619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c6f64-f0cb-4a3c-afe4-bcf5df1b9931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:41.509906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c6f64-f0cb-4a3c-afe4-bcf5df1b9931 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:41.510716 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c6f64-f0cb-4a3c-afe4-bcf5df1b9931 admin admin] PATH_INFO: `/v3/projects/b755005cd9414d11b443612d8afc75e5` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:41.511889 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c6f64-f0cb-4a3c-afe4-bcf5df1b9931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b755005cd9414d11b443612d8afc75e5)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:41.515541 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c6f64-f0cb-4a3c-afe4-bcf5df1b9931 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:41.596993 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a67c6f64-f0cb-4a3c-afe4-bcf5df1b9931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b755005cd9414d11b443612d8afc75e5', 'request_id': 'req-a67c6f64-f0cb-4a3c-afe4-bcf5df1b9931'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:41.612624 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a67c6f64-f0cb-4a3c-afe4-bcf5df1b9931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b755005cd9414d11b443612d8afc75e5', 'request_id': 'req-a67c6f64-f0cb-4a3c-afe4-bcf5df1b9931'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:41.625700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a67c6f64-f0cb-4a3c-afe4-bcf5df1b9931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b755005cd9414d11b443612d8afc75e5', 'request_id': 'req-a67c6f64-f0cb-4a3c-afe4-bcf5df1b9931'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:41.657410 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a67c6f64-f0cb-4a3c-afe4-bcf5df1b9931 admin admin] The token cache is being invalidate because project b755005cd9414d11b443612d8afc75e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:18:41.658019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a67c6f64-f0cb-4a3c-afe4-bcf5df1b9931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:41.659096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a67c6f64-f0cb-4a3c-afe4-bcf5df1b9931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:41.665522 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3368/6667] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:18:41 2022] DELETE /identity/v3/projects/b755005cd9414d11b443612d8afc75e5 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:18:41.667037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f49591-6b37-450d-b6bd-ac4a68cc0ef6 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:41.683017 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f49591-6b37-450d-b6bd-ac4a68cc0ef6 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:41.719715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:41.841788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2537f57-21b0-41f2-be2b-ef5bd373fc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:41.842453 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2537f57-21b0-41f2-be2b-ef5bd373fc38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:41.842760 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2537f57-21b0-41f2-be2b-ef5bd373fc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:41.843044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2537f57-21b0-41f2-be2b-ef5bd373fc38 admin admin] PATH_INFO: `/v3/users/e07287de949547e7b9d9ccbd6e7c6073` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:41.844248 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2537f57-21b0-41f2-be2b-ef5bd373fc38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e07287de949547e7b9d9ccbd6e7c6073)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:41.849872 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2537f57-21b0-41f2-be2b-ef5bd373fc38 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:41.947917 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e2537f57-21b0-41f2-be2b-ef5bd373fc38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e07287de949547e7b9d9ccbd6e7c6073'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:41.949204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e2537f57-21b0-41f2-be2b-ef5bd373fc38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e07287de949547e7b9d9ccbd6e7c6073'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:41.950946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e2537f57-21b0-41f2-be2b-ef5bd373fc38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e07287de949547e7b9d9ccbd6e7c6073'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:41.969149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e2537f57-21b0-41f2-be2b-ef5bd373fc38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e07287de949547e7b9d9ccbd6e7c6073'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:41.998231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e2537f57-21b0-41f2-be2b-ef5bd373fc38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e07287de949547e7b9d9ccbd6e7c6073'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:42.023136 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3300/6668] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:18:41 2022] DELETE /identity/v3/users/e07287de949547e7b9d9ccbd6e7c6073 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:18:42.202612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a42f8a-607c-4632-9766-4f2114f2b202 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:42.203261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a42f8a-607c-4632-9766-4f2114f2b202 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:42.203769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a42f8a-607c-4632-9766-4f2114f2b202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:42.265714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-36a42f8a-607c-4632-9766-4f2114f2b202 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:42.272046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-36a42f8a-607c-4632-9766-4f2114f2b202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:42.430684 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3369/6669] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:18:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:18:42.465736 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2537f57-21b0-41f2-be2b-ef5bd373fc38 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:42.469640 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e2537f57-21b0-41f2-be2b-ef5bd373fc38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:42.688459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a42f8a-607c-4632-9766-4f2114f2b202 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:42.707780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-36a42f8a-607c-4632-9766-4f2114f2b202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:42.764602 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2537f57-21b0-41f2-be2b-ef5bd373fc38 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:42.770796 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdc7c1-5bf7-4407-9e2c-b979cb80ccec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:42.771476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdc7c1-5bf7-4407-9e2c-b979cb80ccec service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:42.772269 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdc7c1-5bf7-4407-9e2c-b979cb80ccec service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:42.772570 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdc7c1-5bf7-4407-9e2c-b979cb80ccec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:42.785175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cdc7c1-5bf7-4407-9e2c-b979cb80ccec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:42.787224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cdc7c1-5bf7-4407-9e2c-b979cb80ccec service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:42.801290 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3301/6670] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:18:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:18:42.810924 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:42.872063 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a42f8a-607c-4632-9766-4f2114f2b202 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:42.886944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f2619-93a0-4121-8582-362b5613ad1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:42.887987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f2619-93a0-4121-8582-362b5613ad1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:42.889022 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f2619-93a0-4121-8582-362b5613ad1b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:42.889532 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f2619-93a0-4121-8582-362b5613ad1b admin admin] PATH_INFO: `/v3/projects/648dc0de53c74b9486efaddccce59ce7` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:42.891763 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f2619-93a0-4121-8582-362b5613ad1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=648dc0de53c74b9486efaddccce59ce7)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:42.895845 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f2619-93a0-4121-8582-362b5613ad1b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:42.994692 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c39f2619-93a0-4121-8582-362b5613ad1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '648dc0de53c74b9486efaddccce59ce7', 'request_id': 'req-c39f2619-93a0-4121-8582-362b5613ad1b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:43.001669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c39f2619-93a0-4121-8582-362b5613ad1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '648dc0de53c74b9486efaddccce59ce7', 'request_id': 'req-c39f2619-93a0-4121-8582-362b5613ad1b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:43.015733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c39f2619-93a0-4121-8582-362b5613ad1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '648dc0de53c74b9486efaddccce59ce7', 'request_id': 'req-c39f2619-93a0-4121-8582-362b5613ad1b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:43.041307 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c39f2619-93a0-4121-8582-362b5613ad1b admin admin] The token cache is being invalidate because project 648dc0de53c74b9486efaddccce59ce7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:18:43.041902 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c39f2619-93a0-4121-8582-362b5613ad1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:43.042808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c39f2619-93a0-4121-8582-362b5613ad1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:43.045099 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3370/6671] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:18:42 2022] DELETE /identity/v3/projects/648dc0de53c74b9486efaddccce59ce7 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:18:43.051633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f929fa-e65a-427d-9fb2-99679803e1ba None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:43.052185 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f929fa-e65a-427d-9fb2-99679803e1ba None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:43.052700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f929fa-e65a-427d-9fb2-99679803e1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:43.102704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a0f929fa-e65a-427d-9fb2-99679803e1ba None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:43.104250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a0f929fa-e65a-427d-9fb2-99679803e1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:43.175456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:43.294015 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3302/6672] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:18:43.295541 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4e3a1-fe3a-4654-8ba9-bd8b24520095 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:43.299065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4e3a1-fe3a-4654-8ba9-bd8b24520095 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:43.299348 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4e3a1-fe3a-4654-8ba9-bd8b24520095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:43.363744 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a5d4e3a1-fe3a-4654-8ba9-bd8b24520095 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:43.365349 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a5d4e3a1-fe3a-4654-8ba9-bd8b24520095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:43.389862 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f929fa-e65a-427d-9fb2-99679803e1ba None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:43.406825 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3371/6673] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:18:43.407000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f929fa-e65a-427d-9fb2-99679803e1ba None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:43.421665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e35fb-ab4f-474e-bb84-1f9eeb1c2516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:43.422330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e35fb-ab4f-474e-bb84-1f9eeb1c2516 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:43.422947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e35fb-ab4f-474e-bb84-1f9eeb1c2516 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:43.423228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e35fb-ab4f-474e-bb84-1f9eeb1c2516 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:43.424038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e35fb-ab4f-474e-bb84-1f9eeb1c2516 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:18:43.424408 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e35fb-ab4f-474e-bb84-1f9eeb1c2516 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:43.426103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e35fb-ab4f-474e-bb84-1f9eeb1c2516 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:43.462485 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4e3a1-fe3a-4654-8ba9-bd8b24520095 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:43.472900 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3303/6674] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:18:43.476175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4e3a1-fe3a-4654-8ba9-bd8b24520095 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:43.497577 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d3183-2c10-4d76-9e11-e8538694da7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:43.505563 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d3183-2c10-4d76-9e11-e8538694da7d admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:43.506954 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d3183-2c10-4d76-9e11-e8538694da7d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:43.507527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d3183-2c10-4d76-9e11-e8538694da7d admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:43.509992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d3183-2c10-4d76-9e11-e8538694da7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:43.512668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d3183-2c10-4d76-9e11-e8538694da7d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:43.584796 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3372/6675] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:18:43 2022] POST /identity/v3/projects => generated 361 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:18:43.589678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e35fb-ab4f-474e-bb84-1f9eeb1c2516 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:43.601048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e35fb-ab4f-474e-bb84-1f9eeb1c2516 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:43.733468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7018598-34ca-4e35-be18-275972a29d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:43.734107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7018598-34ca-4e35-be18-275972a29d3a admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:43.734390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7018598-34ca-4e35-be18-275972a29d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:43.734717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7018598-34ca-4e35-be18-275972a29d3a admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:43.735415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7018598-34ca-4e35-be18-275972a29d3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:43.738308 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7018598-34ca-4e35-be18-275972a29d3a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:43.773593 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3304/6676] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:18:43 2022] POST /identity/v3/users => generated 281 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:18:43.774431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d3183-2c10-4d76-9e11-e8538694da7d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:43.793477 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d3183-2c10-4d76-9e11-e8538694da7d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:43.809313 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836f156-db1f-4b5d-b14e-3c4d1b5fbc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:43.810040 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836f156-db1f-4b5d-b14e-3c4d1b5fbc10 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:43.810391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836f156-db1f-4b5d-b14e-3c4d1b5fbc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:43.810910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836f156-db1f-4b5d-b14e-3c4d1b5fbc10 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:43.811782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836f156-db1f-4b5d-b14e-3c4d1b5fbc10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:43.813638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836f156-db1f-4b5d-b14e-3c4d1b5fbc10 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:43.839777 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3373/6677] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:18:43.847211 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7018598-34ca-4e35-be18-275972a29d3a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:43.864692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7018598-34ca-4e35-be18-275972a29d3a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:43.880285 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db5c30-5b7d-4f81-94d5-fe75c8a72c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:43.881306 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db5c30-5b7d-4f81-94d5-fe75c8a72c75 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:43.881697 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db5c30-5b7d-4f81-94d5-fe75c8a72c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:43.882068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db5c30-5b7d-4f81-94d5-fe75c8a72c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:43.882948 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db5c30-5b7d-4f81-94d5-fe75c8a72c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:43.885394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db5c30-5b7d-4f81-94d5-fe75c8a72c75 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:43.926684 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3305/6678] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:18:43.930082 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836f156-db1f-4b5d-b14e-3c4d1b5fbc10 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:43.948799 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836f156-db1f-4b5d-b14e-3c4d1b5fbc10 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:43.958000 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd80f14-1d82-4c5b-ad6d-f9e3904341ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:43.961972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd80f14-1d82-4c5b-ad6d-f9e3904341ae admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:43.962733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd80f14-1d82-4c5b-ad6d-f9e3904341ae admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:43.963273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd80f14-1d82-4c5b-ad6d-f9e3904341ae admin admin] PATH_INFO: `/v3/projects/b262a66c9a1a4c06ab427fdbc64e386d/users/1abfee594043453a9a5762d94ba46065/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:44.006880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd80f14-1d82-4c5b-ad6d-f9e3904341ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=b262a66c9a1a4c06ab427fdbc64e386d, user_id=1abfee594043453a9a5762d94ba46065, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:44.013304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd80f14-1d82-4c5b-ad6d-f9e3904341ae admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:44.059005 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3374/6679] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:18:43 2022] PUT /identity/v3/projects/b262a66c9a1a4c06ab427fdbc64e386d/users/1abfee594043453a9a5762d94ba46065/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:18:44.060785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a046a46-1b7a-4db1-ad58-0f3db36b9aef None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:44.061178 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a046a46-1b7a-4db1-ad58-0f3db36b9aef None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:44.061697 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a046a46-1b7a-4db1-ad58-0f3db36b9aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:44.118842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-0a046a46-1b7a-4db1-ad58-0f3db36b9aef None None] MFA Rules not processed for user `1abfee594043453a9a5762d94ba46065`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:44.120992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0a046a46-1b7a-4db1-ad58-0f3db36b9aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:44.246949 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3306/6680] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:18:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:18:44.264314 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd80f14-1d82-4c5b-ad6d-f9e3904341ae admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:44.266129 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2cd80f14-1d82-4c5b-ad6d-f9e3904341ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:44.333741 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a046a46-1b7a-4db1-ad58-0f3db36b9aef None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:44.336082 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0a046a46-1b7a-4db1-ad58-0f3db36b9aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:44.415486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:44.466181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a046a46-1b7a-4db1-ad58-0f3db36b9aef None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:44.474159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:44.482441 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2997ada-ba0b-482e-8c09-bd0332a8e7b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:44.482932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2997ada-ba0b-482e-8c09-bd0332a8e7b5 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:44.483084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2997ada-ba0b-482e-8c09-bd0332a8e7b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:44.483844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2997ada-ba0b-482e-8c09-bd0332a8e7b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:44.493571 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd80f14-1d82-4c5b-ad6d-f9e3904341ae admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:44.502999 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2997ada-ba0b-482e-8c09-bd0332a8e7b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:44.504838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2997ada-ba0b-482e-8c09-bd0332a8e7b5 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:44.508006 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1671e-1628-48b6-a384-436beb355a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:44.508652 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1671e-1628-48b6-a384-436beb355a32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:44.509064 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1671e-1628-48b6-a384-436beb355a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:44.509423 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1671e-1628-48b6-a384-436beb355a32 admin admin] PATH_INFO: `/v3/users/1fcfa7615ba1440bba1819edb5593b1a` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:44.511986 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a1671e-1628-48b6-a384-436beb355a32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fcfa7615ba1440bba1819edb5593b1a)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:44.516318 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a1671e-1628-48b6-a384-436beb355a32 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:44.527349 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3307/6681] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:18:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:18:44.661596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a6a1671e-1628-48b6-a384-436beb355a32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fcfa7615ba1440bba1819edb5593b1a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:44.702335 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a6a1671e-1628-48b6-a384-436beb355a32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fcfa7615ba1440bba1819edb5593b1a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:44.703843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a6a1671e-1628-48b6-a384-436beb355a32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fcfa7615ba1440bba1819edb5593b1a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:44.704654 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a6a1671e-1628-48b6-a384-436beb355a32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fcfa7615ba1440bba1819edb5593b1a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:44.726611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a6a1671e-1628-48b6-a384-436beb355a32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fcfa7615ba1440bba1819edb5593b1a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:44.787832 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3375/6682] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:18:44 2022] DELETE /identity/v3/users/1fcfa7615ba1440bba1819edb5593b1a => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:18:44.793630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb917d5-7262-4ca7-bc2e-da14032e4640 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:44.793630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb917d5-7262-4ca7-bc2e-da14032e4640 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:44.794835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb917d5-7262-4ca7-bc2e-da14032e4640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:44.837138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-afb917d5-7262-4ca7-bc2e-da14032e4640 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:44.840025 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-afb917d5-7262-4ca7-bc2e-da14032e4640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:44.983829 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3308/6683] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:18:45.014297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1671e-1628-48b6-a384-436beb355a32 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:45.015867 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a6a1671e-1628-48b6-a384-436beb355a32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:45.095402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1671e-1628-48b6-a384-436beb355a32 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:45.100709 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f8ffb-3006-4021-95c1-d6ba33a1abf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:45.102481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f8ffb-3006-4021-95c1-d6ba33a1abf4 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:45.103007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f8ffb-3006-4021-95c1-d6ba33a1abf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:45.117264 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f8ffb-3006-4021-95c1-d6ba33a1abf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:45.146025 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f8ffb-3006-4021-95c1-d6ba33a1abf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:45.150582 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f8ffb-3006-4021-95c1-d6ba33a1abf4 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:45.183697 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3376/6684] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:18:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:18:45.870196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb917d5-7262-4ca7-bc2e-da14032e4640 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:45.871700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-afb917d5-7262-4ca7-bc2e-da14032e4640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:45.894597 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb917d5-7262-4ca7-bc2e-da14032e4640 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:45.913824 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b46b7-ec4e-495b-b7b2-2504ca132ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:45.914486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b46b7-ec4e-495b-b7b2-2504ca132ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:45.917256 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b46b7-ec4e-495b-b7b2-2504ca132ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:45.917545 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b46b7-ec4e-495b-b7b2-2504ca132ba6 admin admin] PATH_INFO: `/v3/projects/44c722bb3a594abdba24dbd607aa5d1d` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:45.918814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b46b7-ec4e-495b-b7b2-2504ca132ba6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44c722bb3a594abdba24dbd607aa5d1d)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:45.921434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b46b7-ec4e-495b-b7b2-2504ca132ba6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:46.031863 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b78b46b7-ec4e-495b-b7b2-2504ca132ba6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44c722bb3a594abdba24dbd607aa5d1d', 'request_id': 'req-b78b46b7-ec4e-495b-b7b2-2504ca132ba6'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:46.047887 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b78b46b7-ec4e-495b-b7b2-2504ca132ba6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44c722bb3a594abdba24dbd607aa5d1d', 'request_id': 'req-b78b46b7-ec4e-495b-b7b2-2504ca132ba6'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:46.059698 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b78b46b7-ec4e-495b-b7b2-2504ca132ba6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44c722bb3a594abdba24dbd607aa5d1d', 'request_id': 'req-b78b46b7-ec4e-495b-b7b2-2504ca132ba6'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:46.095945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b78b46b7-ec4e-495b-b7b2-2504ca132ba6 admin admin] The token cache is being invalidate because project 44c722bb3a594abdba24dbd607aa5d1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:18:46.095945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b78b46b7-ec4e-495b-b7b2-2504ca132ba6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:46.096560 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b78b46b7-ec4e-495b-b7b2-2504ca132ba6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:46.098660 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3309/6685] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:18:45 2022] DELETE /identity/v3/projects/44c722bb3a594abdba24dbd607aa5d1d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:18:46.103860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4381ba2-9f02-468a-9940-c073cfe09abe None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:46.104805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4381ba2-9f02-468a-9940-c073cfe09abe None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:46.105454 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4381ba2-9f02-468a-9940-c073cfe09abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:46.179283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-e4381ba2-9f02-468a-9940-c073cfe09abe None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:46.185472 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e4381ba2-9f02-468a-9940-c073cfe09abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:46.345167 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3377/6686] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:18:46.353334 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffba40d-e603-444e-8b5c-8fd0b8724778 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:46.353853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffba40d-e603-444e-8b5c-8fd0b8724778 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:46.354326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffba40d-e603-444e-8b5c-8fd0b8724778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:46.418978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-8ffba40d-e603-444e-8b5c-8fd0b8724778 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:46.430041 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8ffba40d-e603-444e-8b5c-8fd0b8724778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:46.468062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4381ba2-9f02-468a-9940-c073cfe09abe None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:46.481645 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3310/6687] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:18:46.483982 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4381ba2-9f02-468a-9940-c073cfe09abe None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:46.507623 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854cd61-e514-4466-a454-ed4d6a231bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:46.509288 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854cd61-e514-4466-a454-ed4d6a231bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:46.509886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854cd61-e514-4466-a454-ed4d6a231bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:46.510569 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854cd61-e514-4466-a454-ed4d6a231bc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:46.511582 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854cd61-e514-4466-a454-ed4d6a231bc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:18:46.513097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854cd61-e514-4466-a454-ed4d6a231bc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:46.519084 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854cd61-e514-4466-a454-ed4d6a231bc1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:46.573708 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3378/6688] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:18:46.576334 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffba40d-e603-444e-8b5c-8fd0b8724778 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:46.593434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffba40d-e603-444e-8b5c-8fd0b8724778 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:46.604914 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf1a03-9326-4f55-8dd4-af7b0d657205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:46.605750 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf1a03-9326-4f55-8dd4-af7b0d657205 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:46.606216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf1a03-9326-4f55-8dd4-af7b0d657205 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:46.606725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf1a03-9326-4f55-8dd4-af7b0d657205 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:46.608237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf1a03-9326-4f55-8dd4-af7b0d657205 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:46.618185 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf1a03-9326-4f55-8dd4-af7b0d657205 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:46.681496 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3311/6689] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:18:46 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:18:46.682128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854cd61-e514-4466-a454-ed4d6a231bc1 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:46.690849 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:46.727199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854cd61-e514-4466-a454-ed4d6a231bc1 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:46.855186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f472609-e09b-4c88-a28e-b562bbfc97bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:46.855834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f472609-e09b-4c88-a28e-b562bbfc97bf admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:46.856113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f472609-e09b-4c88-a28e-b562bbfc97bf admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:46.856436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f472609-e09b-4c88-a28e-b562bbfc97bf admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:46.857175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f472609-e09b-4c88-a28e-b562bbfc97bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:46.859597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f472609-e09b-4c88-a28e-b562bbfc97bf admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:46.971493 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3379/6690] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:18:46 2022] POST /identity/v3/users => generated 291 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:18:46.975995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf1a03-9326-4f55-8dd4-af7b0d657205 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:46.997749 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf1a03-9326-4f55-8dd4-af7b0d657205 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:47.016545 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2baa11c-03ce-447c-8b52-eb17a21a335c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:47.017374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2baa11c-03ce-447c-8b52-eb17a21a335c admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:47.018893 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2baa11c-03ce-447c-8b52-eb17a21a335c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:47.018893 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2baa11c-03ce-447c-8b52-eb17a21a335c admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:47.023686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2baa11c-03ce-447c-8b52-eb17a21a335c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:47.027207 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2baa11c-03ce-447c-8b52-eb17a21a335c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:47.059872 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f472609-e09b-4c88-a28e-b562bbfc97bf admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:47.069906 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3312/6691] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:18:47.076900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f472609-e09b-4c88-a28e-b562bbfc97bf admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:47.090221 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d2d4c-347d-4280-af40-8f15edd6e537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:47.091350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d2d4c-347d-4280-af40-8f15edd6e537 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:47.091935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d2d4c-347d-4280-af40-8f15edd6e537 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:47.092314 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d2d4c-347d-4280-af40-8f15edd6e537 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:47.093071 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d2d4c-347d-4280-af40-8f15edd6e537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:47.094962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d2d4c-347d-4280-af40-8f15edd6e537 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:47.124574 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3380/6692] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:18:47.128838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2baa11c-03ce-447c-8b52-eb17a21a335c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:47.145979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2baa11c-03ce-447c-8b52-eb17a21a335c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:47.159954 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9dcaf-b340-475a-a8d1-16fce536edea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:47.160683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9dcaf-b340-475a-a8d1-16fce536edea admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:47.161063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9dcaf-b340-475a-a8d1-16fce536edea admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:47.161437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9dcaf-b340-475a-a8d1-16fce536edea admin admin] PATH_INFO: `/v3/projects/fbe310b1a03c4b909caa9214e9be1a95/users/1bb3d4cd6cc2459bba026c4dedca85d1/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:47.196769 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:47.210954 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9dcaf-b340-475a-a8d1-16fce536edea admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbe310b1a03c4b909caa9214e9be1a95, user_id=1bb3d4cd6cc2459bba026c4dedca85d1, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:47.216703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9dcaf-b340-475a-a8d1-16fce536edea admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:47.247557 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3313/6693] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:18:47 2022] PUT /identity/v3/projects/fbe310b1a03c4b909caa9214e9be1a95/users/1bb3d4cd6cc2459bba026c4dedca85d1/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:18:47.258809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03471730-c1ab-4f0c-ae6d-03f2327c0632 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:47.259463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03471730-c1ab-4f0c-ae6d-03f2327c0632 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:47.259965 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03471730-c1ab-4f0c-ae6d-03f2327c0632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:47.320078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-03471730-c1ab-4f0c-ae6d-03f2327c0632 None None] MFA Rules not processed for user `1bb3d4cd6cc2459bba026c4dedca85d1`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:47.321481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-03471730-c1ab-4f0c-ae6d-03f2327c0632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:47.483553 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3381/6694] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:18:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:18:47.504125 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9dcaf-b340-475a-a8d1-16fce536edea admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:47.508355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-73f9dcaf-b340-475a-a8d1-16fce536edea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:47.634644 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9dcaf-b340-475a-a8d1-16fce536edea admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:47.651447 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b3feb-e055-4417-ba10-6fd4b7136059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:47.652433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b3feb-e055-4417-ba10-6fd4b7136059 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:47.652973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b3feb-e055-4417-ba10-6fd4b7136059 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:47.653499 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b3feb-e055-4417-ba10-6fd4b7136059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:47.669986 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b3feb-e055-4417-ba10-6fd4b7136059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:47.671899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b3feb-e055-4417-ba10-6fd4b7136059 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:47.695337 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3314/6695] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:18:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:18:47.745059 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03471730-c1ab-4f0c-ae6d-03f2327c0632 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:47.955745 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03471730-c1ab-4f0c-ae6d-03f2327c0632 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:47.973542 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c5dd5-2b1f-45b6-b165-5f9afcf9f62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:47.973810 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c5dd5-2b1f-45b6-b165-5f9afcf9f62e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:47.974271 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c5dd5-2b1f-45b6-b165-5f9afcf9f62e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:47.974421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c5dd5-2b1f-45b6-b165-5f9afcf9f62e admin admin] PATH_INFO: `/v3/users/1bb3d4cd6cc2459bba026c4dedca85d1` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:47.979324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c5dd5-2b1f-45b6-b165-5f9afcf9f62e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bb3d4cd6cc2459bba026c4dedca85d1)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:47.982283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c5dd5-2b1f-45b6-b165-5f9afcf9f62e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:48.011876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:48.093367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-666c5dd5-2b1f-45b6-b165-5f9afcf9f62e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bb3d4cd6cc2459bba026c4dedca85d1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:48.107839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-666c5dd5-2b1f-45b6-b165-5f9afcf9f62e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bb3d4cd6cc2459bba026c4dedca85d1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:48.110994 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-666c5dd5-2b1f-45b6-b165-5f9afcf9f62e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bb3d4cd6cc2459bba026c4dedca85d1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:48.112318 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-666c5dd5-2b1f-45b6-b165-5f9afcf9f62e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bb3d4cd6cc2459bba026c4dedca85d1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:48.133290 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-666c5dd5-2b1f-45b6-b165-5f9afcf9f62e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bb3d4cd6cc2459bba026c4dedca85d1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:48.174214 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3382/6696] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:18:47 2022] DELETE /identity/v3/users/1bb3d4cd6cc2459bba026c4dedca85d1 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:18:48.179339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b0847-8a08-41b2-bb75-4a9778a859f9 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:48.179886 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b0847-8a08-41b2-bb75-4a9778a859f9 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:48.180130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b0847-8a08-41b2-bb75-4a9778a859f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:48.255071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-6f6b0847-8a08-41b2-bb75-4a9778a859f9 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:48.260333 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6f6b0847-8a08-41b2-bb75-4a9778a859f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:48.515895 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3315/6697] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:18:48.529092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c5dd5-2b1f-45b6-b165-5f9afcf9f62e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:48.531081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-666c5dd5-2b1f-45b6-b165-5f9afcf9f62e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:48.743144 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c5dd5-2b1f-45b6-b165-5f9afcf9f62e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:48.760135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a967aa-f5e5-45d8-b149-3c4bee177103 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:48.765935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a967aa-f5e5-45d8-b149-3c4bee177103 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:48.766222 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a967aa-f5e5-45d8-b149-3c4bee177103 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:48.766504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a967aa-f5e5-45d8-b149-3c4bee177103 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:48.798018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a967aa-f5e5-45d8-b149-3c4bee177103 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:48.799890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a967aa-f5e5-45d8-b149-3c4bee177103 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:48.830133 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3383/6698] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:18:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:18:50.386421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b0847-8a08-41b2-bb75-4a9778a859f9 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:50.387963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6f6b0847-8a08-41b2-bb75-4a9778a859f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:50.413237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b0847-8a08-41b2-bb75-4a9778a859f9 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:50.424275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220662a-d14e-4274-a9ad-d5f510e1c240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:50.425239 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220662a-d14e-4274-a9ad-d5f510e1c240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:50.425754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220662a-d14e-4274-a9ad-d5f510e1c240 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:50.426217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220662a-d14e-4274-a9ad-d5f510e1c240 admin admin] PATH_INFO: `/v3/projects/fbe310b1a03c4b909caa9214e9be1a95` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:50.427967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3220662a-d14e-4274-a9ad-d5f510e1c240 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbe310b1a03c4b909caa9214e9be1a95)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:50.432242 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3220662a-d14e-4274-a9ad-d5f510e1c240 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:50.552077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3220662a-d14e-4274-a9ad-d5f510e1c240 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbe310b1a03c4b909caa9214e9be1a95', 'request_id': 'req-3220662a-d14e-4274-a9ad-d5f510e1c240'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:50.646289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3220662a-d14e-4274-a9ad-d5f510e1c240 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbe310b1a03c4b909caa9214e9be1a95', 'request_id': 'req-3220662a-d14e-4274-a9ad-d5f510e1c240'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:50.706947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3220662a-d14e-4274-a9ad-d5f510e1c240 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbe310b1a03c4b909caa9214e9be1a95', 'request_id': 'req-3220662a-d14e-4274-a9ad-d5f510e1c240'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:50.771000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3220662a-d14e-4274-a9ad-d5f510e1c240 admin admin] The token cache is being invalidate because project fbe310b1a03c4b909caa9214e9be1a95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:18:50.774300 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3220662a-d14e-4274-a9ad-d5f510e1c240 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:50.783449 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3220662a-d14e-4274-a9ad-d5f510e1c240 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:18:50.799681 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3316/6699] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:18:50 2022] DELETE /identity/v3/projects/fbe310b1a03c4b909caa9214e9be1a95 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:18:50.805216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f4f2d-f491-4163-9b8e-5b09dd56345a None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:50.806258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f4f2d-f491-4163-9b8e-5b09dd56345a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:50.806751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f4f2d-f491-4163-9b8e-5b09dd56345a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:50.871507 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b70f4f2d-f491-4163-9b8e-5b09dd56345a None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:50.872742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b70f4f2d-f491-4163-9b8e-5b09dd56345a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:50.997160 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3384/6700] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:18:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:18:51.006936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f977f-524b-44a0-9095-c6964286e160 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:51.007997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f977f-524b-44a0-9095-c6964286e160 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:51.008510 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f977f-524b-44a0-9095-c6964286e160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:51.098218 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-c39f977f-524b-44a0-9095-c6964286e160 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:51.102350 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c39f977f-524b-44a0-9095-c6964286e160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:51.122892 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3317/6701] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:18:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:18:51.126995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f4f2d-f491-4163-9b8e-5b09dd56345a None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:51.148328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f4f2d-f491-4163-9b8e-5b09dd56345a None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:51.157975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f426ed-2cb1-4368-b3b1-8f71148a0de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:51.159723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f426ed-2cb1-4368-b3b1-8f71148a0de1 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:51.160315 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f426ed-2cb1-4368-b3b1-8f71148a0de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:51.161263 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f426ed-2cb1-4368-b3b1-8f71148a0de1 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:51.163391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f426ed-2cb1-4368-b3b1-8f71148a0de1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:18:51.163920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f426ed-2cb1-4368-b3b1-8f71148a0de1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:51.174755 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f426ed-2cb1-4368-b3b1-8f71148a0de1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:51.196525 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3385/6702] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:18:51.200394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f977f-524b-44a0-9095-c6964286e160 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:51.217297 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f977f-524b-44a0-9095-c6964286e160 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:51.225664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b265cd-9ae4-4125-a0cb-a4bf6a611676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:51.226650 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b265cd-9ae4-4125-a0cb-a4bf6a611676 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:51.234072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b265cd-9ae4-4125-a0cb-a4bf6a611676 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:51.241868 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b265cd-9ae4-4125-a0cb-a4bf6a611676 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:51.243040 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b265cd-9ae4-4125-a0cb-a4bf6a611676 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:51.245893 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b265cd-9ae4-4125-a0cb-a4bf6a611676 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:51.268527 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:51.311399 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f426ed-2cb1-4368-b3b1-8f71148a0de1 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:51.313338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a3f426ed-2cb1-4368-b3b1-8f71148a0de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:51.361222 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3318/6703] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:18:51 2022] POST /identity/v3/projects => generated 385 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:18:51.371241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b265cd-9ae4-4125-a0cb-a4bf6a611676 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:51.375284 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:51.484783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f426ed-2cb1-4368-b3b1-8f71148a0de1 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:51.562803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b265cd-9ae4-4125-a0cb-a4bf6a611676 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:51.586304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44269d8d-38e2-4103-898d-332433743694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:51.587470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44269d8d-38e2-4103-898d-332433743694 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:51.588215 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44269d8d-38e2-4103-898d-332433743694 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:51.589164 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44269d8d-38e2-4103-898d-332433743694 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:51.590030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44269d8d-38e2-4103-898d-332433743694 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:51.592875 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44269d8d-38e2-4103-898d-332433743694 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:51.647255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd1e12-528f-42ff-bd63-42e4abdd93bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:51.648280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd1e12-528f-42ff-bd63-42e4abdd93bb service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:51.648472 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd1e12-528f-42ff-bd63-42e4abdd93bb service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:51.648756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd1e12-528f-42ff-bd63-42e4abdd93bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:51.650937 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3319/6704] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:18:51 2022] POST /identity/v3/users => generated 293 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:18:51.651756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-78dd1e12-528f-42ff-bd63-42e4abdd93bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:51.655104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44269d8d-38e2-4103-898d-332433743694 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:51.698634 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44269d8d-38e2-4103-898d-332433743694 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:51.713989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf89da-a5d0-4219-ac14-53aaa7171a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:51.716278 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf89da-a5d0-4219-ac14-53aaa7171a29 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:51.716278 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf89da-a5d0-4219-ac14-53aaa7171a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:51.716278 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf89da-a5d0-4219-ac14-53aaa7171a29 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:51.717319 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf89da-a5d0-4219-ac14-53aaa7171a29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:51.722830 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf89da-a5d0-4219-ac14-53aaa7171a29 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:51.751644 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3320/6705] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:18:51.758780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf89da-a5d0-4219-ac14-53aaa7171a29 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:51.785892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf89da-a5d0-4219-ac14-53aaa7171a29 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:51.806927 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ac0ac-7ddd-4409-bcd2-fcbf6efebe01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:51.807861 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ac0ac-7ddd-4409-bcd2-fcbf6efebe01 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:51.808333 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ac0ac-7ddd-4409-bcd2-fcbf6efebe01 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:51.808860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ac0ac-7ddd-4409-bcd2-fcbf6efebe01 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:51.811698 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ac0ac-7ddd-4409-bcd2-fcbf6efebe01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:51.815035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ac0ac-7ddd-4409-bcd2-fcbf6efebe01 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:51.846234 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3321/6706] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:18:51.847467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ac0ac-7ddd-4409-bcd2-fcbf6efebe01 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:51.873889 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ac0ac-7ddd-4409-bcd2-fcbf6efebe01 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:51.877232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd1e12-528f-42ff-bd63-42e4abdd93bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:51.885907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd1e12-528f-42ff-bd63-42e4abdd93bb service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:51.888649 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b73e8-b301-462e-a809-2acc1ada04f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:51.889556 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b73e8-b301-462e-a809-2acc1ada04f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:51.890009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b73e8-b301-462e-a809-2acc1ada04f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:51.890665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b73e8-b301-462e-a809-2acc1ada04f7 admin admin] PATH_INFO: `/v3/projects/f29be37b96c94893be0ca011e8ac2c2f/users/6b7cea478c90434ca9221b860b44a66e/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:51.932656 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3386/6707] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:18:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:18:51.938932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b73e8-b301-462e-a809-2acc1ada04f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f29be37b96c94893be0ca011e8ac2c2f, user_id=6b7cea478c90434ca9221b860b44a66e, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:51.943530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b73e8-b301-462e-a809-2acc1ada04f7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:51.973851 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3322/6708] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:18:51 2022] PUT /identity/v3/projects/f29be37b96c94893be0ca011e8ac2c2f/users/6b7cea478c90434ca9221b860b44a66e/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:18:51.985458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07372d0c-0379-4838-aade-090785314f38 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:51.985867 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07372d0c-0379-4838-aade-090785314f38 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:51.986105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07372d0c-0379-4838-aade-090785314f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:52.059332 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-07372d0c-0379-4838-aade-090785314f38 None None] MFA Rules not processed for user `6b7cea478c90434ca9221b860b44a66e`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:52.061962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-07372d0c-0379-4838-aade-090785314f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:52.174724 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3387/6709] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:18:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:18:52.229114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b73e8-b301-462e-a809-2acc1ada04f7 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:52.377093 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b73e8-b301-462e-a809-2acc1ada04f7 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:52.387893 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39bf0c-c76c-40ef-a730-515243153de7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:52.389608 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39bf0c-c76c-40ef-a730-515243153de7 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:52.389902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39bf0c-c76c-40ef-a730-515243153de7 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:52.390180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39bf0c-c76c-40ef-a730-515243153de7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:52.416077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39bf0c-c76c-40ef-a730-515243153de7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:52.418204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39bf0c-c76c-40ef-a730-515243153de7 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:52.444497 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3323/6710] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:18:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:18:53.075479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07372d0c-0379-4838-aade-090785314f38 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:53.077951 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-07372d0c-0379-4838-aade-090785314f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:53.116216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07372d0c-0379-4838-aade-090785314f38 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:53.139662 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8633b-77a8-40b2-866e-b9473754009a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:53.140623 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8633b-77a8-40b2-866e-b9473754009a service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:53.141092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8633b-77a8-40b2-866e-b9473754009a service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:53.141557 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8633b-77a8-40b2-866e-b9473754009a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:53.145964 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-84c8633b-77a8-40b2-866e-b9473754009a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:53.168781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:53.409605 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c8633b-77a8-40b2-866e-b9473754009a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:53.415298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c8633b-77a8-40b2-866e-b9473754009a service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:53.479402 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3388/6711] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:18:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:18:56.554413 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c53ab3-36f1-4e71-bcf8-7b3b4bdb146e None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:56.554888 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c53ab3-36f1-4e71-bcf8-7b3b4bdb146e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:56.554888 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c53ab3-36f1-4e71-bcf8-7b3b4bdb146e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:56.584159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-74c53ab3-36f1-4e71-bcf8-7b3b4bdb146e None None] MFA Rules not processed for user `9b8463a42f2642aaba586380391de6fd`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:18:56.586106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-74c53ab3-36f1-4e71-bcf8-7b3b4bdb146e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:56.647320 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:56.766533 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3324/6712] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:18:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:18:57.928156 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8633b-77a8-40b2-866e-b9473754009a service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:18:57.941820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8633b-77a8-40b2-866e-b9473754009a service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:18:57.951165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf68f34-aeb8-406a-bc28-44f0c22d8fee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:18:57.951747 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf68f34-aeb8-406a-bc28-44f0c22d8fee service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:18:57.952234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf68f34-aeb8-406a-bc28-44f0c22d8fee service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:18:57.954972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf68f34-aeb8-406a-bc28-44f0c22d8fee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:18:57.957175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7bf68f34-aeb8-406a-bc28-44f0c22d8fee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:18:57.990758 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf68f34-aeb8-406a-bc28-44f0c22d8fee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:18:57.993296 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf68f34-aeb8-406a-bc28-44f0c22d8fee service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:18:58.013939 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3389/6713] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:18:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:19:01.962533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c53ab3-36f1-4e71-bcf8-7b3b4bdb146e None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:01.989434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c53ab3-36f1-4e71-bcf8-7b3b4bdb146e None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:01.994039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01dde59-6046-4558-8831-4476819cf906 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:01.994692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01dde59-6046-4558-8831-4476819cf906 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:01.995270 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01dde59-6046-4558-8831-4476819cf906 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:01.995714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01dde59-6046-4558-8831-4476819cf906 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:01.998370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a01dde59-6046-4558-8831-4476819cf906 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:02.048396 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01dde59-6046-4558-8831-4476819cf906 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:02.055262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01dde59-6046-4558-8831-4476819cf906 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:02.087034 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3325/6714] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:19:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:19:06.824635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf68f34-aeb8-406a-bc28-44f0c22d8fee service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:06.826744 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7bf68f34-aeb8-406a-bc28-44f0c22d8fee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:07.010934 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf68f34-aeb8-406a-bc28-44f0c22d8fee service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:07.017132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc94d9-bee2-41fe-9e6b-48e8dc3ef831 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:07.017985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc94d9-bee2-41fe-9e6b-48e8dc3ef831 service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:07.018427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc94d9-bee2-41fe-9e6b-48e8dc3ef831 service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:07.018887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc94d9-bee2-41fe-9e6b-48e8dc3ef831 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:07.021454 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e6bc94d9-bee2-41fe-9e6b-48e8dc3ef831 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:07.041122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc94d9-bee2-41fe-9e6b-48e8dc3ef831 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:07.043185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc94d9-bee2-41fe-9e6b-48e8dc3ef831 service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:07.073328 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3390/6715] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:19:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:19:12.074412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=20 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:12.434093 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01dde59-6046-4558-8831-4476819cf906 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:12.549062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01dde59-6046-4558-8831-4476819cf906 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:12.556127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e5271-1dd9-4888-8922-c29c2a542289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:12.556923 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e5271-1dd9-4888-8922-c29c2a542289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:12.557369 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e5271-1dd9-4888-8922-c29c2a542289 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:12.557781 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e5271-1dd9-4888-8922-c29c2a542289 admin admin] PATH_INFO: `/v3/users/6b7cea478c90434ca9221b860b44a66e` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:12.560672 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e5271-1dd9-4888-8922-c29c2a542289 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b7cea478c90434ca9221b860b44a66e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:12.574259 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e5271-1dd9-4888-8922-c29c2a542289 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:12.678857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3c5e5271-1dd9-4888-8922-c29c2a542289 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b7cea478c90434ca9221b860b44a66e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:12.679887 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3c5e5271-1dd9-4888-8922-c29c2a542289 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b7cea478c90434ca9221b860b44a66e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:12.684014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3c5e5271-1dd9-4888-8922-c29c2a542289 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b7cea478c90434ca9221b860b44a66e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:12.696058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3c5e5271-1dd9-4888-8922-c29c2a542289 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b7cea478c90434ca9221b860b44a66e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:12.730743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3c5e5271-1dd9-4888-8922-c29c2a542289 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b7cea478c90434ca9221b860b44a66e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:12.762520 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3326/6716] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:19:12 2022] DELETE /identity/v3/users/6b7cea478c90434ca9221b860b44a66e => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:19:12.767638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6bbf6-2a72-49df-be79-49d27e081be0 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:12.768577 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6bbf6-2a72-49df-be79-49d27e081be0 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:12.769121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6bbf6-2a72-49df-be79-49d27e081be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:12.804755 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-faa6bbf6-2a72-49df-be79-49d27e081be0 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:19:12.807602 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-faa6bbf6-2a72-49df-be79-49d27e081be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:12.923572 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3391/6717] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:19:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:19:12.937585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e5271-1dd9-4888-8922-c29c2a542289 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:12.939662 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3c5e5271-1dd9-4888-8922-c29c2a542289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:13.015270 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e5271-1dd9-4888-8922-c29c2a542289 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:13.020783 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea6f32-8541-4a79-a186-03d43b825c5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:13.022061 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea6f32-8541-4a79-a186-03d43b825c5b service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:13.022699 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea6f32-8541-4a79-a186-03d43b825c5b service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:13.023272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea6f32-8541-4a79-a186-03d43b825c5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:13.040377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea6f32-8541-4a79-a186-03d43b825c5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:13.041937 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea6f32-8541-4a79-a186-03d43b825c5b service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:13.054990 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3327/6718] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:19:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:19:14.276526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6bbf6-2a72-49df-be79-49d27e081be0 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:14.281783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-faa6bbf6-2a72-49df-be79-49d27e081be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:14.289952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:14.296297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6bbf6-2a72-49df-be79-49d27e081be0 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:14.303336 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be865ce-5446-45a1-a8d7-ca08bb94496c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:14.304200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be865ce-5446-45a1-a8d7-ca08bb94496c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:14.304739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be865ce-5446-45a1-a8d7-ca08bb94496c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:14.305087 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be865ce-5446-45a1-a8d7-ca08bb94496c admin admin] PATH_INFO: `/v3/projects/f29be37b96c94893be0ca011e8ac2c2f` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:14.306428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be865ce-5446-45a1-a8d7-ca08bb94496c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f29be37b96c94893be0ca011e8ac2c2f)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:14.308880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be865ce-5446-45a1-a8d7-ca08bb94496c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:14.394480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7be865ce-5446-45a1-a8d7-ca08bb94496c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f29be37b96c94893be0ca011e8ac2c2f', 'request_id': 'req-7be865ce-5446-45a1-a8d7-ca08bb94496c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:14.400907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7be865ce-5446-45a1-a8d7-ca08bb94496c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f29be37b96c94893be0ca011e8ac2c2f', 'request_id': 'req-7be865ce-5446-45a1-a8d7-ca08bb94496c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:14.410046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7be865ce-5446-45a1-a8d7-ca08bb94496c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f29be37b96c94893be0ca011e8ac2c2f', 'request_id': 'req-7be865ce-5446-45a1-a8d7-ca08bb94496c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:14.432249 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7be865ce-5446-45a1-a8d7-ca08bb94496c admin admin] The token cache is being invalidate because project f29be37b96c94893be0ca011e8ac2c2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:19:14.432684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7be865ce-5446-45a1-a8d7-ca08bb94496c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:14.433386 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7be865ce-5446-45a1-a8d7-ca08bb94496c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:14.436197 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3392/6719] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:19:14 2022] DELETE /identity/v3/projects/f29be37b96c94893be0ca011e8ac2c2f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:19:14.443222 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e151b-4a6e-40e3-9908-6883621bf623 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:14.443805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e151b-4a6e-40e3-9908-6883621bf623 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:14.444134 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e151b-4a6e-40e3-9908-6883621bf623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:14.484359 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-c87e151b-4a6e-40e3-9908-6883621bf623 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:19:14.492242 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c87e151b-4a6e-40e3-9908-6883621bf623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:14.557881 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:14.668926 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3328/6720] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:19:14.685909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f94cf-3f7d-43f9-b2fc-22be3e9bed49 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:14.687868 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f94cf-3f7d-43f9-b2fc-22be3e9bed49 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:14.688158 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f94cf-3f7d-43f9-b2fc-22be3e9bed49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:14.712954 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-172f94cf-3f7d-43f9-b2fc-22be3e9bed49 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:19:14.714369 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-172f94cf-3f7d-43f9-b2fc-22be3e9bed49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:14.737268 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3393/6721] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:19:14.741944 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e151b-4a6e-40e3-9908-6883621bf623 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:14.761455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e151b-4a6e-40e3-9908-6883621bf623 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:14.776514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cda5e-6993-4880-907d-867ab34b2ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:14.777792 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cda5e-6993-4880-907d-867ab34b2ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:14.778249 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cda5e-6993-4880-907d-867ab34b2ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:14.778718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cda5e-6993-4880-907d-867ab34b2ec9 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:14.780564 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78cda5e-6993-4880-907d-867ab34b2ec9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:19:14.781037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78cda5e-6993-4880-907d-867ab34b2ec9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:14.783192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78cda5e-6993-4880-907d-867ab34b2ec9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:14.809009 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3329/6722] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:19:14.813804 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f94cf-3f7d-43f9-b2fc-22be3e9bed49 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:14.828597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f94cf-3f7d-43f9-b2fc-22be3e9bed49 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:14.835817 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a135f2-2fb7-4aab-bccc-f375aa541cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:14.836796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a135f2-2fb7-4aab-bccc-f375aa541cd0 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:14.837539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a135f2-2fb7-4aab-bccc-f375aa541cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:14.838137 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a135f2-2fb7-4aab-bccc-f375aa541cd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:14.839283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a135f2-2fb7-4aab-bccc-f375aa541cd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:14.841816 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a135f2-2fb7-4aab-bccc-f375aa541cd0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:14.899155 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3394/6723] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:19:14 2022] POST /identity/v3/projects => generated 375 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:19:14.903101 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cda5e-6993-4880-907d-867ab34b2ec9 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:14.914988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cda5e-6993-4880-907d-867ab34b2ec9 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:14.992957 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db2cdd-8465-474c-b1ff-1eb562711606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:14.993933 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db2cdd-8465-474c-b1ff-1eb562711606 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:14.994236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db2cdd-8465-474c-b1ff-1eb562711606 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:14.994518 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db2cdd-8465-474c-b1ff-1eb562711606 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:14.995373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5db2cdd-8465-474c-b1ff-1eb562711606 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:14.997906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5db2cdd-8465-474c-b1ff-1eb562711606 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:15.027632 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3330/6724] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:19:14 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:19:15.031867 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a135f2-2fb7-4aab-bccc-f375aa541cd0 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:15.044174 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a135f2-2fb7-4aab-bccc-f375aa541cd0 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:15.051734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847f7bd-ef35-472a-94da-4935d9637bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:15.052694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847f7bd-ef35-472a-94da-4935d9637bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:15.053150 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847f7bd-ef35-472a-94da-4935d9637bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:15.053581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847f7bd-ef35-472a-94da-4935d9637bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:15.054388 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847f7bd-ef35-472a-94da-4935d9637bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:15.059393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847f7bd-ef35-472a-94da-4935d9637bd4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:15.074132 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3395/6725] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:19:15.078214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db2cdd-8465-474c-b1ff-1eb562711606 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:15.095671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db2cdd-8465-474c-b1ff-1eb562711606 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:15.103600 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbdbdb2-32dc-4f23-9a25-df0e59146337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:15.104442 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdbdb2-32dc-4f23-9a25-df0e59146337 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:15.104820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdbdb2-32dc-4f23-9a25-df0e59146337 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:15.105813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdbdb2-32dc-4f23-9a25-df0e59146337 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:15.106673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbdbdb2-32dc-4f23-9a25-df0e59146337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:15.109160 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbdbdb2-32dc-4f23-9a25-df0e59146337 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:15.126573 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3331/6726] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:19:15.127887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847f7bd-ef35-472a-94da-4935d9637bd4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:15.153054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847f7bd-ef35-472a-94da-4935d9637bd4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:15.173882 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4a47b-5c07-4a1d-808e-e8d3c54d91c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:15.174594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4a47b-5c07-4a1d-808e-e8d3c54d91c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:15.174879 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4a47b-5c07-4a1d-808e-e8d3c54d91c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:15.175154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4a47b-5c07-4a1d-808e-e8d3c54d91c9 admin admin] PATH_INFO: `/v3/projects/8e561a9886e4465893b19455e80ae693/users/c9ed3f12b7b54bafb3fa059611564463/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:15.212157 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b4a47b-5c07-4a1d-808e-e8d3c54d91c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e561a9886e4465893b19455e80ae693, user_id=c9ed3f12b7b54bafb3fa059611564463, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:15.214874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b4a47b-5c07-4a1d-808e-e8d3c54d91c9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:15.253144 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3396/6727] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:19:15 2022] PUT /identity/v3/projects/8e561a9886e4465893b19455e80ae693/users/c9ed3f12b7b54bafb3fa059611564463/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:19:15.263853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603f421-f78e-4b16-ad47-e3aefb9cf828 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:15.264705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603f421-f78e-4b16-ad47-e3aefb9cf828 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:15.264988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603f421-f78e-4b16-ad47-e3aefb9cf828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:15.328857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d603f421-f78e-4b16-ad47-e3aefb9cf828 None None] MFA Rules not processed for user `c9ed3f12b7b54bafb3fa059611564463`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:19:15.330245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d603f421-f78e-4b16-ad47-e3aefb9cf828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:15.475023 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3332/6728] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:19:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:19:15.487682 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4a47b-5c07-4a1d-808e-e8d3c54d91c9 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:15.490245 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-51b4a47b-5c07-4a1d-808e-e8d3c54d91c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:15.606097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4a47b-5c07-4a1d-808e-e8d3c54d91c9 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:15.615767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338d695-e524-498a-a01a-087c1e787c33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:15.616434 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338d695-e524-498a-a01a-087c1e787c33 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:15.616684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338d695-e524-498a-a01a-087c1e787c33 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:15.616973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338d695-e524-498a-a01a-087c1e787c33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:15.672180 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c338d695-e524-498a-a01a-087c1e787c33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:15.674048 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c338d695-e524-498a-a01a-087c1e787c33 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:15.698115 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3397/6729] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:19:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:19:15.727367 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603f421-f78e-4b16-ad47-e3aefb9cf828 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:15.771686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:15.855365 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603f421-f78e-4b16-ad47-e3aefb9cf828 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:15.868854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05558cc-4c56-453d-8028-7a392cdee638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:15.868854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05558cc-4c56-453d-8028-7a392cdee638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:15.868854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05558cc-4c56-453d-8028-7a392cdee638 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:15.868854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05558cc-4c56-453d-8028-7a392cdee638 admin admin] PATH_INFO: `/v3/users/c9ed3f12b7b54bafb3fa059611564463` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:15.877884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05558cc-4c56-453d-8028-7a392cdee638 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9ed3f12b7b54bafb3fa059611564463)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:15.889867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05558cc-4c56-453d-8028-7a392cdee638 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:15.998682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d05558cc-4c56-453d-8028-7a392cdee638 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9ed3f12b7b54bafb3fa059611564463'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:15.999627 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d05558cc-4c56-453d-8028-7a392cdee638 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9ed3f12b7b54bafb3fa059611564463'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:16.000683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d05558cc-4c56-453d-8028-7a392cdee638 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9ed3f12b7b54bafb3fa059611564463'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:16.015678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d05558cc-4c56-453d-8028-7a392cdee638 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9ed3f12b7b54bafb3fa059611564463'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:16.038727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d05558cc-4c56-453d-8028-7a392cdee638 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9ed3f12b7b54bafb3fa059611564463'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:16.058467 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3333/6730] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:19:15 2022] DELETE /identity/v3/users/c9ed3f12b7b54bafb3fa059611564463 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:19:16.062908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae295b-cd94-41f7-b023-c4bbad32d345 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:16.063396 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae295b-cd94-41f7-b023-c4bbad32d345 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:16.063745 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae295b-cd94-41f7-b023-c4bbad32d345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:16.099774 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-22ae295b-cd94-41f7-b023-c4bbad32d345 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:19:16.101114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-22ae295b-cd94-41f7-b023-c4bbad32d345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:16.134982 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:16.206295 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3398/6731] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:19:16.233499 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05558cc-4c56-453d-8028-7a392cdee638 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:16.234996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d05558cc-4c56-453d-8028-7a392cdee638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:16.351328 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05558cc-4c56-453d-8028-7a392cdee638 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:16.355451 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86345c96-5960-4cb7-a461-d35db845bbab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:16.356281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86345c96-5960-4cb7-a461-d35db845bbab service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:16.356781 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86345c96-5960-4cb7-a461-d35db845bbab service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:16.357220 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86345c96-5960-4cb7-a461-d35db845bbab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:16.399693 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86345c96-5960-4cb7-a461-d35db845bbab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:16.402731 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86345c96-5960-4cb7-a461-d35db845bbab service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:16.448790 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3334/6732] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:19:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:19:18.368140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae295b-cd94-41f7-b023-c4bbad32d345 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:18.369869 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-22ae295b-cd94-41f7-b023-c4bbad32d345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:18.388887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae295b-cd94-41f7-b023-c4bbad32d345 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:18.395594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80d6ca-9be6-4c25-adf1-1f999192ba12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:18.396635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80d6ca-9be6-4c25-adf1-1f999192ba12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:18.397093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80d6ca-9be6-4c25-adf1-1f999192ba12 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:18.397985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80d6ca-9be6-4c25-adf1-1f999192ba12 admin admin] PATH_INFO: `/v3/projects/8e561a9886e4465893b19455e80ae693` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:18.399402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80d6ca-9be6-4c25-adf1-1f999192ba12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e561a9886e4465893b19455e80ae693)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:18.402396 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80d6ca-9be6-4c25-adf1-1f999192ba12 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:18.520059 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3b80d6ca-9be6-4c25-adf1-1f999192ba12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e561a9886e4465893b19455e80ae693', 'request_id': 'req-3b80d6ca-9be6-4c25-adf1-1f999192ba12'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:18.528680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3b80d6ca-9be6-4c25-adf1-1f999192ba12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e561a9886e4465893b19455e80ae693', 'request_id': 'req-3b80d6ca-9be6-4c25-adf1-1f999192ba12'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:18.542199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3b80d6ca-9be6-4c25-adf1-1f999192ba12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e561a9886e4465893b19455e80ae693', 'request_id': 'req-3b80d6ca-9be6-4c25-adf1-1f999192ba12'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:18.565763 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3b80d6ca-9be6-4c25-adf1-1f999192ba12 admin admin] The token cache is being invalidate because project 8e561a9886e4465893b19455e80ae693 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:19:18.565763 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3b80d6ca-9be6-4c25-adf1-1f999192ba12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:18.578386 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3b80d6ca-9be6-4c25-adf1-1f999192ba12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:18.588204 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3399/6733] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:19:18 2022] DELETE /identity/v3/projects/8e561a9886e4465893b19455e80ae693 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:19:18.593411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4bf96-7ddd-4701-8f12-58350920d6f1 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:18.593969 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4bf96-7ddd-4701-8f12-58350920d6f1 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:18.593969 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4bf96-7ddd-4701-8f12-58350920d6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:18.637283 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-ecf4bf96-7ddd-4701-8f12-58350920d6f1 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:19:18.640206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ecf4bf96-7ddd-4701-8f12-58350920d6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:18.744134 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:18.852438 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbb939-1466-4a08-8c6e-3126d6d85bab None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:18.852924 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3335/6734] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:19:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:19:18.853085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbb939-1466-4a08-8c6e-3126d6d85bab None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:18.853267 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbb939-1466-4a08-8c6e-3126d6d85bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:18.891193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-43fbb939-1466-4a08-8c6e-3126d6d85bab None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:19:18.893000 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-43fbb939-1466-4a08-8c6e-3126d6d85bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:18.928670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4bf96-7ddd-4701-8f12-58350920d6f1 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:18.935884 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3400/6735] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:19:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:19:18.945024 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4bf96-7ddd-4701-8f12-58350920d6f1 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:18.958163 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a67b9-c671-4a92-ad1b-7914695d23e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:18.959123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a67b9-c671-4a92-ad1b-7914695d23e0 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:18.959643 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a67b9-c671-4a92-ad1b-7914695d23e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:18.960232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a67b9-c671-4a92-ad1b-7914695d23e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:18.961127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a67b9-c671-4a92-ad1b-7914695d23e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:19:18.961994 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a67b9-c671-4a92-ad1b-7914695d23e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:18.964160 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a67b9-c671-4a92-ad1b-7914695d23e0 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:19.002317 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbb939-1466-4a08-8c6e-3126d6d85bab None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:19.013575 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3336/6736] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:19:19.018152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbb939-1466-4a08-8c6e-3126d6d85bab None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:19.025319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3511e-29b7-4850-9dda-c0713d984ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:19.026104 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3511e-29b7-4850-9dda-c0713d984ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:19.026493 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3511e-29b7-4850-9dda-c0713d984ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:19.026904 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3511e-29b7-4850-9dda-c0713d984ec0 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:19.027723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b3511e-29b7-4850-9dda-c0713d984ec0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:19.029763 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b3511e-29b7-4850-9dda-c0713d984ec0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:19.076939 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3401/6737] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:19:19 2022] POST /identity/v3/projects => generated 379 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:19:19.082884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a67b9-c671-4a92-ad1b-7914695d23e0 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:19.097187 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a67b9-c671-4a92-ad1b-7914695d23e0 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:19.243347 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720f48f-b279-4b1c-b9bc-50891f5c9ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:19.244272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720f48f-b279-4b1c-b9bc-50891f5c9ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:19.244865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720f48f-b279-4b1c-b9bc-50891f5c9ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:19.245340 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720f48f-b279-4b1c-b9bc-50891f5c9ca7 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:19.246144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6720f48f-b279-4b1c-b9bc-50891f5c9ca7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:19.250499 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6720f48f-b279-4b1c-b9bc-50891f5c9ca7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:19.291015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3511e-29b7-4850-9dda-c0713d984ec0 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:19.301566 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3337/6738] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:19:19 2022] POST /identity/v3/users => generated 290 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:19:19.307981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3511e-29b7-4850-9dda-c0713d984ec0 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:19.316065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a6850-1d76-421c-804e-061d0108b40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:19.317684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a6850-1d76-421c-804e-061d0108b40c admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:19.318173 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a6850-1d76-421c-804e-061d0108b40c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:19.318665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a6850-1d76-421c-804e-061d0108b40c admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:19.319642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a6850-1d76-421c-804e-061d0108b40c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:19.324811 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a6850-1d76-421c-804e-061d0108b40c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:19.353583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720f48f-b279-4b1c-b9bc-50891f5c9ca7 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:19.354377 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3402/6739] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:19:19.366229 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720f48f-b279-4b1c-b9bc-50891f5c9ca7 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:19.373311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af2723-cf1c-4893-a2df-501488c5c769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:19.374161 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af2723-cf1c-4893-a2df-501488c5c769 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:19.374508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af2723-cf1c-4893-a2df-501488c5c769 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:19.374907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af2723-cf1c-4893-a2df-501488c5c769 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:19.375619 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af2723-cf1c-4893-a2df-501488c5c769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:19.377308 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af2723-cf1c-4893-a2df-501488c5c769 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:19.395640 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a6850-1d76-421c-804e-061d0108b40c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:19.402069 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3338/6740] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:19:19.409461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a6850-1d76-421c-804e-061d0108b40c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:19.415526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a23389-9902-45d1-a7a8-2724b9d92b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:19.416513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a23389-9902-45d1-a7a8-2724b9d92b67 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:19.417261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a23389-9902-45d1-a7a8-2724b9d92b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:19.417714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a23389-9902-45d1-a7a8-2724b9d92b67 admin admin] PATH_INFO: `/v3/projects/0931d8d3e6b8472d9bc52f8e51612b7b/users/c70635d7cb6a4e28b8ba7a1c0efc5521/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:19.450130 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a23389-9902-45d1-a7a8-2724b9d92b67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0931d8d3e6b8472d9bc52f8e51612b7b, user_id=c70635d7cb6a4e28b8ba7a1c0efc5521, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:19.453340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a23389-9902-45d1-a7a8-2724b9d92b67 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:19.496588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9130624-4b80-4492-968f-8c737777e896 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:19.496867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9130624-4b80-4492-968f-8c737777e896 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:19.497138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9130624-4b80-4492-968f-8c737777e896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:19.498881 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3403/6741] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:19:19 2022] PUT /identity/v3/projects/0931d8d3e6b8472d9bc52f8e51612b7b/users/c70635d7cb6a4e28b8ba7a1c0efc5521/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:19:19.534934 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-e9130624-4b80-4492-968f-8c737777e896 None None] MFA Rules not processed for user `c70635d7cb6a4e28b8ba7a1c0efc5521`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:19:19.538907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e9130624-4b80-4492-968f-8c737777e896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:19.700270 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3339/6742] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:19:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:19:19.701488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a23389-9902-45d1-a7a8-2724b9d92b67 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:19.772878 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:19.810031 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a23389-9902-45d1-a7a8-2724b9d92b67 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:19.829310 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ddc318-2b04-443e-b05c-7785ec162922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:19.833088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ddc318-2b04-443e-b05c-7785ec162922 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:19.833727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ddc318-2b04-443e-b05c-7785ec162922 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:19.834249 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ddc318-2b04-443e-b05c-7785ec162922 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:19.835391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ddc318-2b04-443e-b05c-7785ec162922 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:19.839027 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ddc318-2b04-443e-b05c-7785ec162922 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:19.904701 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3404/6743] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:19:19 2022] POST /identity/v3/projects => generated 381 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:19:19.908207 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9130624-4b80-4492-968f-8c737777e896 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:19.927157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9130624-4b80-4492-968f-8c737777e896 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:20.029780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:20.115858 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89b72b-2967-4d9e-9093-821a2f17d33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:20.116497 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89b72b-2967-4d9e-9093-821a2f17d33f admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:20.116827 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89b72b-2967-4d9e-9093-821a2f17d33f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:20.117240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89b72b-2967-4d9e-9093-821a2f17d33f admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:20.117965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa89b72b-2967-4d9e-9093-821a2f17d33f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:20.121512 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa89b72b-2967-4d9e-9093-821a2f17d33f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:20.168876 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3340/6744] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:19:19 2022] POST /identity/v3/users => generated 297 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:19:20.178876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ddc318-2b04-443e-b05c-7785ec162922 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:20.200143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ddc318-2b04-443e-b05c-7785ec162922 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:20.214706 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39dc530-a247-48c8-9388-ce66c0ddf71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:20.217020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39dc530-a247-48c8-9388-ce66c0ddf71a admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:20.217294 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39dc530-a247-48c8-9388-ce66c0ddf71a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:20.218733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39dc530-a247-48c8-9388-ce66c0ddf71a admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:20.220787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39dc530-a247-48c8-9388-ce66c0ddf71a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:20.223480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39dc530-a247-48c8-9388-ce66c0ddf71a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:20.256424 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3405/6745] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:19:20.260762 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89b72b-2967-4d9e-9093-821a2f17d33f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:20.285236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89b72b-2967-4d9e-9093-821a2f17d33f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:20.290804 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1343fa-2a1c-4a93-b9c0-be197ba467a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:20.291499 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1343fa-2a1c-4a93-b9c0-be197ba467a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:20.291781 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1343fa-2a1c-4a93-b9c0-be197ba467a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:20.292061 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1343fa-2a1c-4a93-b9c0-be197ba467a7 admin admin] PATH_INFO: `/v3/projects/a978ec4fdca64b128cd3406914d9ae8b/users/ea6242589a8b47aeb32313646bef1a56/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:20.319219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1343fa-2a1c-4a93-b9c0-be197ba467a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a978ec4fdca64b128cd3406914d9ae8b, user_id=ea6242589a8b47aeb32313646bef1a56, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:20.324145 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1343fa-2a1c-4a93-b9c0-be197ba467a7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:20.359402 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3341/6746] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:19:20 2022] PUT /identity/v3/projects/a978ec4fdca64b128cd3406914d9ae8b/users/ea6242589a8b47aeb32313646bef1a56/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:19:20.365342 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39dc530-a247-48c8-9388-ce66c0ddf71a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:20.384278 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39dc530-a247-48c8-9388-ce66c0ddf71a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:20.469293 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b165e3-3053-47e6-b147-28805388257b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:20.470032 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b165e3-3053-47e6-b147-28805388257b admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:20.470248 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b165e3-3053-47e6-b147-28805388257b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:20.470976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b165e3-3053-47e6-b147-28805388257b admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:20.471882 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b165e3-3053-47e6-b147-28805388257b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:20.473729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b165e3-3053-47e6-b147-28805388257b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:20.486069 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3406/6747] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:19:20.490657 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1343fa-2a1c-4a93-b9c0-be197ba467a7 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:20.506636 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1343fa-2a1c-4a93-b9c0-be197ba467a7 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:20.523104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33048ac7-9f85-477c-951c-15942c69eccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:20.523798 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33048ac7-9f85-477c-951c-15942c69eccc admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:20.524089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33048ac7-9f85-477c-951c-15942c69eccc admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:20.524366 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33048ac7-9f85-477c-951c-15942c69eccc admin admin] PATH_INFO: `/v3/projects/a978ec4fdca64b128cd3406914d9ae8b/users/ea6242589a8b47aeb32313646bef1a56/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:20.536331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33048ac7-9f85-477c-951c-15942c69eccc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a978ec4fdca64b128cd3406914d9ae8b, user_id=ea6242589a8b47aeb32313646bef1a56, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:20.539153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33048ac7-9f85-477c-951c-15942c69eccc admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:20.560715 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3342/6748] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:19:20 2022] PUT /identity/v3/projects/a978ec4fdca64b128cd3406914d9ae8b/users/ea6242589a8b47aeb32313646bef1a56/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:19:20.572530 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb3342-3270-4f2b-9fc8-efae68a7f469 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:20.572826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb3342-3270-4f2b-9fc8-efae68a7f469 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:20.573098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb3342-3270-4f2b-9fc8-efae68a7f469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:20.651209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-7ccb3342-3270-4f2b-9fc8-efae68a7f469 None None] MFA Rules not processed for user `ea6242589a8b47aeb32313646bef1a56`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:19:20.651914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7ccb3342-3270-4f2b-9fc8-efae68a7f469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:20.844692 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3407/6749] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:19:20 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:19:20.865766 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33048ac7-9f85-477c-951c-15942c69eccc admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:20.867572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-33048ac7-9f85-477c-951c-15942c69eccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:20.990233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33048ac7-9f85-477c-951c-15942c69eccc admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:20.995540 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23914fcb-d759-42e6-9ebf-912f4e714de5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:20.996513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23914fcb-d759-42e6-9ebf-912f4e714de5 service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:20.997045 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23914fcb-d759-42e6-9ebf-912f4e714de5 service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:20.997567 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23914fcb-d759-42e6-9ebf-912f4e714de5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:21.021445 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23914fcb-d759-42e6-9ebf-912f4e714de5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:21.024456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23914fcb-d759-42e6-9ebf-912f4e714de5 service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:21.054858 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3343/6750] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:19:20 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:19:21.188787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb3342-3270-4f2b-9fc8-efae68a7f469 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:21.204985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb3342-3270-4f2b-9fc8-efae68a7f469 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:21.218898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97253d7-29b3-400d-aea2-77584910e74e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:21.219735 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97253d7-29b3-400d-aea2-77584910e74e service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:21.219735 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97253d7-29b3-400d-aea2-77584910e74e service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:21.221632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97253d7-29b3-400d-aea2-77584910e74e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:21.294748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:21.355817 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97253d7-29b3-400d-aea2-77584910e74e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:21.358235 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97253d7-29b3-400d-aea2-77584910e74e service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:21.388373 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3408/6751] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:19:21 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:19:22.342186 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3a166-7273-4c1b-9a68-3ff0ae38e5db None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:22.342735 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3a166-7273-4c1b-9a68-3ff0ae38e5db None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:22.342735 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3a166-7273-4c1b-9a68-3ff0ae38e5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:22.368333 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-c2a3a166-7273-4c1b-9a68-3ff0ae38e5db None None] MFA Rules not processed for user `9b8463a42f2642aaba586380391de6fd`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:19:22.369870 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c2a3a166-7273-4c1b-9a68-3ff0ae38e5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:22.493434 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3344/6752] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:19:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:19:24.103915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c96ca7-21c8-44a8-8cdd-67990b0cf6b4 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:24.107066 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c96ca7-21c8-44a8-8cdd-67990b0cf6b4 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:24.108249 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c96ca7-21c8-44a8-8cdd-67990b0cf6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:24.144799 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-91c96ca7-21c8-44a8-8cdd-67990b0cf6b4 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:19:24.146405 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-91c96ca7-21c8-44a8-8cdd-67990b0cf6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:24.237233 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3409/6753] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:19:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:19:24.264183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3a166-7273-4c1b-9a68-3ff0ae38e5db None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:24.265908 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c2a3a166-7273-4c1b-9a68-3ff0ae38e5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:24.330780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:24.412162 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3a166-7273-4c1b-9a68-3ff0ae38e5db None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:24.419161 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72cbdf9-5c92-4cd6-9b74-e08e354e2bc8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:24.423865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cbdf9-5c92-4cd6-9b74-e08e354e2bc8 service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:24.424465 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cbdf9-5c92-4cd6-9b74-e08e354e2bc8 service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:24.425362 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cbdf9-5c92-4cd6-9b74-e08e354e2bc8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:24.448602 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72cbdf9-5c92-4cd6-9b74-e08e354e2bc8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:24.451297 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72cbdf9-5c92-4cd6-9b74-e08e354e2bc8 service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:24.474888 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3345/6754] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:19:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:19:32.701250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c96ca7-21c8-44a8-8cdd-67990b0cf6b4 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:32.842296 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c96ca7-21c8-44a8-8cdd-67990b0cf6b4 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:32.850478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483364a-c0a3-467a-8c51-87bcb4374ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:32.851500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483364a-c0a3-467a-8c51-87bcb4374ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:32.852007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483364a-c0a3-467a-8c51-87bcb4374ced admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:32.852427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483364a-c0a3-467a-8c51-87bcb4374ced admin admin] PATH_INFO: `/v3/users/c70635d7cb6a4e28b8ba7a1c0efc5521` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:32.854354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483364a-c0a3-467a-8c51-87bcb4374ced admin admin] RBAC: Authorizing `identity:delete_user(user_id=c70635d7cb6a4e28b8ba7a1c0efc5521)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:32.864833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483364a-c0a3-467a-8c51-87bcb4374ced admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:32.958352 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0483364a-c0a3-467a-8c51-87bcb4374ced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c70635d7cb6a4e28b8ba7a1c0efc5521'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:32.968014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0483364a-c0a3-467a-8c51-87bcb4374ced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c70635d7cb6a4e28b8ba7a1c0efc5521'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:32.969566 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0483364a-c0a3-467a-8c51-87bcb4374ced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c70635d7cb6a4e28b8ba7a1c0efc5521'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:32.970325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0483364a-c0a3-467a-8c51-87bcb4374ced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c70635d7cb6a4e28b8ba7a1c0efc5521'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:32.983251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0483364a-c0a3-467a-8c51-87bcb4374ced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c70635d7cb6a4e28b8ba7a1c0efc5521'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:33.023177 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3410/6755] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:19:32 2022] DELETE /identity/v3/users/c70635d7cb6a4e28b8ba7a1c0efc5521 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:19:33.027784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788ee6f-90c8-40ba-9add-c9841590b3ac None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:33.028174 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788ee6f-90c8-40ba-9add-c9841590b3ac None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:33.028174 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788ee6f-90c8-40ba-9add-c9841590b3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:33.067089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-4788ee6f-90c8-40ba-9add-c9841590b3ac None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:19:33.068325 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4788ee6f-90c8-40ba-9add-c9841590b3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:33.236686 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3346/6756] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:19:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:19:33.291661 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483364a-c0a3-467a-8c51-87bcb4374ced admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:33.293198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0483364a-c0a3-467a-8c51-87bcb4374ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:33.300811 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:33.438807 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483364a-c0a3-467a-8c51-87bcb4374ced admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:33.447619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c650f0-2c80-4e20-9a31-994003196871 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:33.448258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c650f0-2c80-4e20-9a31-994003196871 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:33.448540 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c650f0-2c80-4e20-9a31-994003196871 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:33.448818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c650f0-2c80-4e20-9a31-994003196871 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:33.474678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c650f0-2c80-4e20-9a31-994003196871 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:33.478880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c650f0-2c80-4e20-9a31-994003196871 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:33.513002 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3411/6757] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:19:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:19:35.580063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788ee6f-90c8-40ba-9add-c9841590b3ac None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:35.581553 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4788ee6f-90c8-40ba-9add-c9841590b3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:35.605292 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788ee6f-90c8-40ba-9add-c9841590b3ac None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:35.624613 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60849c2-f10b-4012-a6fb-067585356760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:35.626208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60849c2-f10b-4012-a6fb-067585356760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:35.626831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60849c2-f10b-4012-a6fb-067585356760 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:35.627260 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60849c2-f10b-4012-a6fb-067585356760 admin admin] PATH_INFO: `/v3/projects/0931d8d3e6b8472d9bc52f8e51612b7b` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:35.629677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60849c2-f10b-4012-a6fb-067585356760 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0931d8d3e6b8472d9bc52f8e51612b7b)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:35.631810 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60849c2-f10b-4012-a6fb-067585356760 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:35.748257 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d60849c2-f10b-4012-a6fb-067585356760 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0931d8d3e6b8472d9bc52f8e51612b7b', 'request_id': 'req-d60849c2-f10b-4012-a6fb-067585356760'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:35.764383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d60849c2-f10b-4012-a6fb-067585356760 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0931d8d3e6b8472d9bc52f8e51612b7b', 'request_id': 'req-d60849c2-f10b-4012-a6fb-067585356760'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:35.772967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d60849c2-f10b-4012-a6fb-067585356760 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0931d8d3e6b8472d9bc52f8e51612b7b', 'request_id': 'req-d60849c2-f10b-4012-a6fb-067585356760'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:35.801936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d60849c2-f10b-4012-a6fb-067585356760 admin admin] The token cache is being invalidate because project 0931d8d3e6b8472d9bc52f8e51612b7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:19:35.805112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d60849c2-f10b-4012-a6fb-067585356760 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:35.808595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d60849c2-f10b-4012-a6fb-067585356760 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:35.813111 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3347/6758] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:19:35 2022] DELETE /identity/v3/projects/0931d8d3e6b8472d9bc52f8e51612b7b => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:19:35.817416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c650f0-2c80-4e20-9a31-994003196871 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:35.840608 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c650f0-2c80-4e20-9a31-994003196871 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:35.977344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74b142-eede-4a84-abdb-4291bf7c7086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:35.978178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74b142-eede-4a84-abdb-4291bf7c7086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:35.978940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74b142-eede-4a84-abdb-4291bf7c7086 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:35.978940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74b142-eede-4a84-abdb-4291bf7c7086 admin admin] PATH_INFO: `/v3/users/ea6242589a8b47aeb32313646bef1a56` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:35.980259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74b142-eede-4a84-abdb-4291bf7c7086 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea6242589a8b47aeb32313646bef1a56)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:35.982722 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74b142-eede-4a84-abdb-4291bf7c7086 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:36.132880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8c74b142-eede-4a84-abdb-4291bf7c7086 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea6242589a8b47aeb32313646bef1a56'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:36.150980 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8c74b142-eede-4a84-abdb-4291bf7c7086 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea6242589a8b47aeb32313646bef1a56'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:36.151739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8c74b142-eede-4a84-abdb-4291bf7c7086 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea6242589a8b47aeb32313646bef1a56'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:36.152481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8c74b142-eede-4a84-abdb-4291bf7c7086 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea6242589a8b47aeb32313646bef1a56'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:36.165995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8c74b142-eede-4a84-abdb-4291bf7c7086 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea6242589a8b47aeb32313646bef1a56'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:36.194647 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3412/6759] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:19:35 2022] DELETE /identity/v3/users/ea6242589a8b47aeb32313646bef1a56 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:19:37.501423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60849c2-f10b-4012-a6fb-067585356760 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:37.504180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d60849c2-f10b-4012-a6fb-067585356760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:37.517619 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60849c2-f10b-4012-a6fb-067585356760 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:37.603392 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:37.638169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3823f9-12fa-4086-b39d-eaf8be576e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:37.639015 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3823f9-12fa-4086-b39d-eaf8be576e71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:37.639307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3823f9-12fa-4086-b39d-eaf8be576e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:37.640870 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3823f9-12fa-4086-b39d-eaf8be576e71 admin admin] PATH_INFO: `/v3/projects/a978ec4fdca64b128cd3406914d9ae8b` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:37.642302 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3823f9-12fa-4086-b39d-eaf8be576e71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a978ec4fdca64b128cd3406914d9ae8b)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:37.646657 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3823f9-12fa-4086-b39d-eaf8be576e71 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:37.728009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8d3823f9-12fa-4086-b39d-eaf8be576e71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a978ec4fdca64b128cd3406914d9ae8b', 'request_id': 'req-8d3823f9-12fa-4086-b39d-eaf8be576e71'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:37.740343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8d3823f9-12fa-4086-b39d-eaf8be576e71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a978ec4fdca64b128cd3406914d9ae8b', 'request_id': 'req-8d3823f9-12fa-4086-b39d-eaf8be576e71'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:37.749079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8d3823f9-12fa-4086-b39d-eaf8be576e71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a978ec4fdca64b128cd3406914d9ae8b', 'request_id': 'req-8d3823f9-12fa-4086-b39d-eaf8be576e71'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:37.777327 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8d3823f9-12fa-4086-b39d-eaf8be576e71 admin admin] The token cache is being invalidate because project a978ec4fdca64b128cd3406914d9ae8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:19:37.778057 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8d3823f9-12fa-4086-b39d-eaf8be576e71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:37.780018 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8d3823f9-12fa-4086-b39d-eaf8be576e71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:37.782931 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3348/6760] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:19:37 2022] DELETE /identity/v3/projects/a978ec4fdca64b128cd3406914d9ae8b => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:19:37.788926 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a0371-0644-49b2-a101-3ef80fa95c78 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:37.790007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a0371-0644-49b2-a101-3ef80fa95c78 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:37.790725 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a0371-0644-49b2-a101-3ef80fa95c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:37.824259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-6e3a0371-0644-49b2-a101-3ef80fa95c78 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:19:37.825726 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6e3a0371-0644-49b2-a101-3ef80fa95c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:37.860105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:37.991558 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3413/6761] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:19:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:19:38.000465 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71dd5c-66e8-4b7c-9522-9a6754405fca None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:38.004176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71dd5c-66e8-4b7c-9522-9a6754405fca None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:38.004771 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71dd5c-66e8-4b7c-9522-9a6754405fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:38.051052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-1d71dd5c-66e8-4b7c-9522-9a6754405fca None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:19:38.052317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1d71dd5c-66e8-4b7c-9522-9a6754405fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:38.070730 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3349/6762] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:19:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:19:38.075639 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a0371-0644-49b2-a101-3ef80fa95c78 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:38.088924 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a0371-0644-49b2-a101-3ef80fa95c78 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:38.095035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d27a30-ca9b-4aaa-9cc0-c340832f33ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:38.096185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d27a30-ca9b-4aaa-9cc0-c340832f33ca admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:38.097848 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d27a30-ca9b-4aaa-9cc0-c340832f33ca admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:38.099636 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d27a30-ca9b-4aaa-9cc0-c340832f33ca admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:38.101496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d27a30-ca9b-4aaa-9cc0-c340832f33ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:19:38.102066 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d27a30-ca9b-4aaa-9cc0-c340832f33ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:38.104473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d27a30-ca9b-4aaa-9cc0-c340832f33ca admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:38.129205 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3414/6763] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:19:38.133610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71dd5c-66e8-4b7c-9522-9a6754405fca None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:38.146033 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71dd5c-66e8-4b7c-9522-9a6754405fca None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:38.152383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a37435-f981-4715-9190-b4aeb6c8856c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:38.153510 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a37435-f981-4715-9190-b4aeb6c8856c admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:38.153923 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a37435-f981-4715-9190-b4aeb6c8856c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:38.154823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a37435-f981-4715-9190-b4aeb6c8856c admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:38.155628 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a37435-f981-4715-9190-b4aeb6c8856c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:38.161240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a37435-f981-4715-9190-b4aeb6c8856c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:38.209666 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3350/6764] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:19:38 2022] POST /identity/v3/projects => generated 365 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:19:38.210914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d27a30-ca9b-4aaa-9cc0-c340832f33ca admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:38.224924 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d27a30-ca9b-4aaa-9cc0-c340832f33ca admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:38.320228 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b3138-eba5-4e49-a219-a0657b5b7a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:38.321009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b3138-eba5-4e49-a219-a0657b5b7a7f admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:38.321400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b3138-eba5-4e49-a219-a0657b5b7a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:38.321791 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b3138-eba5-4e49-a219-a0657b5b7a7f admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:38.322665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b3138-eba5-4e49-a219-a0657b5b7a7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:38.339457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b3138-eba5-4e49-a219-a0657b5b7a7f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:38.386933 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3415/6765] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:19:38 2022] POST /identity/v3/users => generated 283 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:19:38.387277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a37435-f981-4715-9190-b4aeb6c8856c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:38.399522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a37435-f981-4715-9190-b4aeb6c8856c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:38.405793 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd776763-d5b2-4b5b-a795-34217de2ff33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:38.407440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd776763-d5b2-4b5b-a795-34217de2ff33 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:38.407938 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd776763-d5b2-4b5b-a795-34217de2ff33 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:38.408414 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd776763-d5b2-4b5b-a795-34217de2ff33 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:38.409326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd776763-d5b2-4b5b-a795-34217de2ff33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:38.412106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd776763-d5b2-4b5b-a795-34217de2ff33 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:38.430427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b3138-eba5-4e49-a219-a0657b5b7a7f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:38.442269 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3351/6766] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:19:38.445708 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b3138-eba5-4e49-a219-a0657b5b7a7f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:38.454481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb857cb-991d-41b2-9917-12c4f692fb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:38.456095 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb857cb-991d-41b2-9917-12c4f692fb85 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:38.456591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb857cb-991d-41b2-9917-12c4f692fb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:38.457643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb857cb-991d-41b2-9917-12c4f692fb85 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:38.458601 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb857cb-991d-41b2-9917-12c4f692fb85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:38.460836 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb857cb-991d-41b2-9917-12c4f692fb85 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:38.477775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd776763-d5b2-4b5b-a795-34217de2ff33 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:38.484510 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3416/6767] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:19:38.490826 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd776763-d5b2-4b5b-a795-34217de2ff33 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:38.496839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d90a2-7b2c-4fbe-8add-221900f6c24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:38.498090 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d90a2-7b2c-4fbe-8add-221900f6c24b admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:38.498931 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d90a2-7b2c-4fbe-8add-221900f6c24b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:38.499437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d90a2-7b2c-4fbe-8add-221900f6c24b admin admin] PATH_INFO: `/v3/projects/9c6a6b0e990f418da9aee54df33ecaff/users/441aaeeca86e477bb2af07655ad77a4b/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:38.530079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d90a2-7b2c-4fbe-8add-221900f6c24b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c6a6b0e990f418da9aee54df33ecaff, user_id=441aaeeca86e477bb2af07655ad77a4b, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:38.542907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d90a2-7b2c-4fbe-8add-221900f6c24b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:38.569906 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3352/6768] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:19:38 2022] PUT /identity/v3/projects/9c6a6b0e990f418da9aee54df33ecaff/users/441aaeeca86e477bb2af07655ad77a4b/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:19:38.581324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea60667-7969-4a05-88a6-8058fb811da4 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:38.581996 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea60667-7969-4a05-88a6-8058fb811da4 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:38.581996 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea60667-7969-4a05-88a6-8058fb811da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:38.631198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-dea60667-7969-4a05-88a6-8058fb811da4 None None] MFA Rules not processed for user `441aaeeca86e477bb2af07655ad77a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:19:38.632945 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-dea60667-7969-4a05-88a6-8058fb811da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:38.768526 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3417/6769] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:19:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:19:38.773156 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d90a2-7b2c-4fbe-8add-221900f6c24b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:38.853848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d90a2-7b2c-4fbe-8add-221900f6c24b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:38.859878 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8b6cc-1d81-46cb-b579-d4f1f090a461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:38.860972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8b6cc-1d81-46cb-b579-d4f1f090a461 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:38.861817 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8b6cc-1d81-46cb-b579-d4f1f090a461 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:38.861817 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8b6cc-1d81-46cb-b579-d4f1f090a461 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:38.862480 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8b6cc-1d81-46cb-b579-d4f1f090a461 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:38.864960 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8b6cc-1d81-46cb-b579-d4f1f090a461 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:38.879380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:38.906038 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3353/6770] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:19:38 2022] POST /identity/v3/projects => generated 363 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:19:38.907820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea60667-7969-4a05-88a6-8058fb811da4 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:38.923884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea60667-7969-4a05-88a6-8058fb811da4 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:38.954675 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:39.028613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054bdf32-7e82-401a-ac84-f1362c32c5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:39.028613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bdf32-7e82-401a-ac84-f1362c32c5a2 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:39.028951 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bdf32-7e82-401a-ac84-f1362c32c5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:39.029151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bdf32-7e82-401a-ac84-f1362c32c5a2 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:39.030490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054bdf32-7e82-401a-ac84-f1362c32c5a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:39.033174 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054bdf32-7e82-401a-ac84-f1362c32c5a2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:39.068698 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3418/6771] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:19:38 2022] POST /identity/v3/users => generated 288 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:19:39.072323 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8b6cc-1d81-46cb-b579-d4f1f090a461 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:39.087290 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8b6cc-1d81-46cb-b579-d4f1f090a461 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:39.101035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfeeaf6-4c10-4042-aedd-d833def47d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:39.101846 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfeeaf6-4c10-4042-aedd-d833def47d03 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:39.104983 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfeeaf6-4c10-4042-aedd-d833def47d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:39.104983 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfeeaf6-4c10-4042-aedd-d833def47d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:39.104983 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfeeaf6-4c10-4042-aedd-d833def47d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:39.106927 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfeeaf6-4c10-4042-aedd-d833def47d03 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:39.126642 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3354/6772] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:19:39.130501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054bdf32-7e82-401a-ac84-f1362c32c5a2 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:39.145934 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054bdf32-7e82-401a-ac84-f1362c32c5a2 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:39.158049 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e9063-0ac7-4c12-843e-1aaa13ef92b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:39.159014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e9063-0ac7-4c12-843e-1aaa13ef92b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:39.159394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e9063-0ac7-4c12-843e-1aaa13ef92b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:39.159779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e9063-0ac7-4c12-843e-1aaa13ef92b2 admin admin] PATH_INFO: `/v3/projects/343e9a84357642fbb081a12cccc76426/users/7cdc527a87174d419ba3d4c22be568b0/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:39.198617 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e9063-0ac7-4c12-843e-1aaa13ef92b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=343e9a84357642fbb081a12cccc76426, user_id=7cdc527a87174d419ba3d4c22be568b0, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:39.202318 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e9063-0ac7-4c12-843e-1aaa13ef92b2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:39.240278 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3419/6773] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:19:39 2022] PUT /identity/v3/projects/343e9a84357642fbb081a12cccc76426/users/7cdc527a87174d419ba3d4c22be568b0/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:19:39.242126 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfeeaf6-4c10-4042-aedd-d833def47d03 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:39.259417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfeeaf6-4c10-4042-aedd-d833def47d03 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:39.370982 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282197b-8f18-442d-ade4-7e1635eeb4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:39.373541 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282197b-8f18-442d-ade4-7e1635eeb4cf admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:39.374497 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282197b-8f18-442d-ade4-7e1635eeb4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:39.374858 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282197b-8f18-442d-ade4-7e1635eeb4cf admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:39.385732 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282197b-8f18-442d-ade4-7e1635eeb4cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:39.387566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282197b-8f18-442d-ade4-7e1635eeb4cf admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:39.404126 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3355/6774] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:19:39.408331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e9063-0ac7-4c12-843e-1aaa13ef92b2 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:39.426189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e9063-0ac7-4c12-843e-1aaa13ef92b2 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:39.441042 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f187fb-e834-4e6e-805c-af94019e3619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:39.441737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f187fb-e834-4e6e-805c-af94019e3619 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:39.442019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f187fb-e834-4e6e-805c-af94019e3619 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:39.442297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f187fb-e834-4e6e-805c-af94019e3619 admin admin] PATH_INFO: `/v3/projects/343e9a84357642fbb081a12cccc76426/users/7cdc527a87174d419ba3d4c22be568b0/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:39.447400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f187fb-e834-4e6e-805c-af94019e3619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=343e9a84357642fbb081a12cccc76426, user_id=7cdc527a87174d419ba3d4c22be568b0, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:39.452641 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f187fb-e834-4e6e-805c-af94019e3619 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:39.492315 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3420/6775] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:19:39 2022] PUT /identity/v3/projects/343e9a84357642fbb081a12cccc76426/users/7cdc527a87174d419ba3d4c22be568b0/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:19:39.493352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa8a2b-a8dd-4e42-b9bf-2a10ddb7fa96 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:39.493642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa8a2b-a8dd-4e42-b9bf-2a10ddb7fa96 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:39.493966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa8a2b-a8dd-4e42-b9bf-2a10ddb7fa96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:39.551339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-12aa8a2b-a8dd-4e42-b9bf-2a10ddb7fa96 None None] MFA Rules not processed for user `7cdc527a87174d419ba3d4c22be568b0`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:19:39.554227 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-12aa8a2b-a8dd-4e42-b9bf-2a10ddb7fa96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:39.748144 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3356/6776] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:19:39 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:19:39.766211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f187fb-e834-4e6e-805c-af94019e3619 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:39.768009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-00f187fb-e834-4e6e-805c-af94019e3619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:39.900813 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f187fb-e834-4e6e-805c-af94019e3619 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:39.918995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5789119-3e79-4e56-89d5-8fc2a11690df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:39.919724 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5789119-3e79-4e56-89d5-8fc2a11690df service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:39.919896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5789119-3e79-4e56-89d5-8fc2a11690df service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:39.920173 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5789119-3e79-4e56-89d5-8fc2a11690df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:39.954935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5789119-3e79-4e56-89d5-8fc2a11690df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:39.967626 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5789119-3e79-4e56-89d5-8fc2a11690df service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:40.019259 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3421/6777] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:19:39 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:19:40.154209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa8a2b-a8dd-4e42-b9bf-2a10ddb7fa96 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:40.168222 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa8a2b-a8dd-4e42-b9bf-2a10ddb7fa96 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:40.180493 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2dd9ca-e52a-49a7-be86-469be9da4556 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:40.181321 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2dd9ca-e52a-49a7-be86-469be9da4556 service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:40.182316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2dd9ca-e52a-49a7-be86-469be9da4556 service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:40.182728 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2dd9ca-e52a-49a7-be86-469be9da4556 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:40.298508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2dd9ca-e52a-49a7-be86-469be9da4556 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:40.300766 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2dd9ca-e52a-49a7-be86-469be9da4556 service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:40.307702 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:40.326821 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3357/6778] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:19:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:19:42.657362 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5789119-3e79-4e56-89d5-8fc2a11690df service cinder] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:42.659701 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c5789119-3e79-4e56-89d5-8fc2a11690df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:42.811154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5789119-3e79-4e56-89d5-8fc2a11690df service cinder] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:42.817535 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5ea32-bfe1-413f-a81f-ad915952520b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:42.818636 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5ea32-bfe1-413f-a81f-ad915952520b service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:42.819108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5ea32-bfe1-413f-a81f-ad915952520b service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:42.819548 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5ea32-bfe1-413f-a81f-ad915952520b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:42.822403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-fad5ea32-bfe1-413f-a81f-ad915952520b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:42.844432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5ea32-bfe1-413f-a81f-ad915952520b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:42.846940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5ea32-bfe1-413f-a81f-ad915952520b service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:42.853455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:42.862153 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3422/6779] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:19:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:19:43.536094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2dd9ca-e52a-49a7-be86-469be9da4556 service cinder] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:43.680139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2dd9ca-e52a-49a7-be86-469be9da4556 service cinder] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:43.688065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a2d51-8959-4450-b047-586dfbfffca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:43.693018 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a2d51-8959-4450-b047-586dfbfffca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:43.693428 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a2d51-8959-4450-b047-586dfbfffca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:43.693899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a2d51-8959-4450-b047-586dfbfffca9 admin admin] PATH_INFO: `/v3/users/441aaeeca86e477bb2af07655ad77a4b` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:43.695536 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a2d51-8959-4450-b047-586dfbfffca9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=441aaeeca86e477bb2af07655ad77a4b)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:43.698021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a2d51-8959-4450-b047-586dfbfffca9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:43.750997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d51a2d51-8959-4450-b047-586dfbfffca9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '441aaeeca86e477bb2af07655ad77a4b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:43.751850 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d51a2d51-8959-4450-b047-586dfbfffca9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '441aaeeca86e477bb2af07655ad77a4b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:43.753195 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d51a2d51-8959-4450-b047-586dfbfffca9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '441aaeeca86e477bb2af07655ad77a4b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:43.772994 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d51a2d51-8959-4450-b047-586dfbfffca9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '441aaeeca86e477bb2af07655ad77a4b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:43.791403 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d51a2d51-8959-4450-b047-586dfbfffca9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '441aaeeca86e477bb2af07655ad77a4b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:43.807054 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3358/6780] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:19:43 2022] DELETE /identity/v3/users/441aaeeca86e477bb2af07655ad77a4b => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:19:43.811749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85fc74-82fa-43bf-b70d-478fa08d3c82 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:43.812300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85fc74-82fa-43bf-b70d-478fa08d3c82 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:43.812388 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85fc74-82fa-43bf-b70d-478fa08d3c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:43.855355 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-9d85fc74-82fa-43bf-b70d-478fa08d3c82 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:19:43.857657 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9d85fc74-82fa-43bf-b70d-478fa08d3c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:43.937930 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3423/6781] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:19:43.952015 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a2d51-8959-4450-b047-586dfbfffca9 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:43.954087 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d51a2d51-8959-4450-b047-586dfbfffca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:44.048394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a2d51-8959-4450-b047-586dfbfffca9 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:44.055024 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bc6aa-a537-43a9-87d2-fbfe90c20f0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:44.055740 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bc6aa-a537-43a9-87d2-fbfe90c20f0a service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:44.056112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bc6aa-a537-43a9-87d2-fbfe90c20f0a service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:44.056471 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bc6aa-a537-43a9-87d2-fbfe90c20f0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:44.069189 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8bc6aa-a537-43a9-87d2-fbfe90c20f0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:44.070778 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8bc6aa-a537-43a9-87d2-fbfe90c20f0a service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:44.082955 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3359/6782] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:19:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:19:44.547372 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85fc74-82fa-43bf-b70d-478fa08d3c82 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:44.548906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9d85fc74-82fa-43bf-b70d-478fa08d3c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:44.566626 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85fc74-82fa-43bf-b70d-478fa08d3c82 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:44.573778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eab714-9394-4d1b-9d45-1f5e5141f030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:44.575121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eab714-9394-4d1b-9d45-1f5e5141f030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:44.575546 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eab714-9394-4d1b-9d45-1f5e5141f030 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:44.576030 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eab714-9394-4d1b-9d45-1f5e5141f030 admin admin] PATH_INFO: `/v3/projects/9c6a6b0e990f418da9aee54df33ecaff` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:44.577911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eab714-9394-4d1b-9d45-1f5e5141f030 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c6a6b0e990f418da9aee54df33ecaff)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:44.583456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eab714-9394-4d1b-9d45-1f5e5141f030 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:44.682025 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b1eab714-9394-4d1b-9d45-1f5e5141f030 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c6a6b0e990f418da9aee54df33ecaff', 'request_id': 'req-b1eab714-9394-4d1b-9d45-1f5e5141f030'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:44.698693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b1eab714-9394-4d1b-9d45-1f5e5141f030 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c6a6b0e990f418da9aee54df33ecaff', 'request_id': 'req-b1eab714-9394-4d1b-9d45-1f5e5141f030'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:44.757356 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b1eab714-9394-4d1b-9d45-1f5e5141f030 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c6a6b0e990f418da9aee54df33ecaff', 'request_id': 'req-b1eab714-9394-4d1b-9d45-1f5e5141f030'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:44.834173 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b1eab714-9394-4d1b-9d45-1f5e5141f030 admin admin] The token cache is being invalidate because project 9c6a6b0e990f418da9aee54df33ecaff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:19:44.836659 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b1eab714-9394-4d1b-9d45-1f5e5141f030 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:44.839911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b1eab714-9394-4d1b-9d45-1f5e5141f030 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:44.843615 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3424/6783] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:19:44 2022] DELETE /identity/v3/projects/9c6a6b0e990f418da9aee54df33ecaff => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:19:44.849299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bc6aa-a537-43a9-87d2-fbfe90c20f0a service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:44.869843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bc6aa-a537-43a9-87d2-fbfe90c20f0a service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:44.905706 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:45.033070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2861e55-11b2-43ad-a647-4bc036d1c0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:45.034721 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2861e55-11b2-43ad-a647-4bc036d1c0d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:45.035230 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2861e55-11b2-43ad-a647-4bc036d1c0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:45.035641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2861e55-11b2-43ad-a647-4bc036d1c0d9 admin admin] PATH_INFO: `/v3/users/7cdc527a87174d419ba3d4c22be568b0` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:45.037100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2861e55-11b2-43ad-a647-4bc036d1c0d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cdc527a87174d419ba3d4c22be568b0)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:45.039479 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2861e55-11b2-43ad-a647-4bc036d1c0d9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:45.105330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a2861e55-11b2-43ad-a647-4bc036d1c0d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cdc527a87174d419ba3d4c22be568b0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:45.106347 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a2861e55-11b2-43ad-a647-4bc036d1c0d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cdc527a87174d419ba3d4c22be568b0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:45.108304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a2861e55-11b2-43ad-a647-4bc036d1c0d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cdc527a87174d419ba3d4c22be568b0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:45.119792 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a2861e55-11b2-43ad-a647-4bc036d1c0d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cdc527a87174d419ba3d4c22be568b0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:45.136858 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a2861e55-11b2-43ad-a647-4bc036d1c0d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cdc527a87174d419ba3d4c22be568b0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:45.154257 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3360/6784] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:19:44 2022] DELETE /identity/v3/users/7cdc527a87174d419ba3d4c22be568b0 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:19:45.647672 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eab714-9394-4d1b-9d45-1f5e5141f030 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:45.649127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b1eab714-9394-4d1b-9d45-1f5e5141f030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:45.797947 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eab714-9394-4d1b-9d45-1f5e5141f030 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:45.904322 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:45.929727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231ff43-9f14-491f-a9d1-04488a72b687 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:45.930810 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231ff43-9f14-491f-a9d1-04488a72b687 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:45.933795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231ff43-9f14-491f-a9d1-04488a72b687 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:45.934416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231ff43-9f14-491f-a9d1-04488a72b687 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:45.938964 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6231ff43-9f14-491f-a9d1-04488a72b687 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:45.963887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231ff43-9f14-491f-a9d1-04488a72b687 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:45.965351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231ff43-9f14-491f-a9d1-04488a72b687 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:45.991878 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3425/6785] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:19:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:19:46.531248 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2861e55-11b2-43ad-a647-4bc036d1c0d9 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:46.533557 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a2861e55-11b2-43ad-a647-4bc036d1c0d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:46.715958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2861e55-11b2-43ad-a647-4bc036d1c0d9 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:46.728395 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34544348-15cf-4287-b76a-11b6d86f33dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:46.730006 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34544348-15cf-4287-b76a-11b6d86f33dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:46.730334 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34544348-15cf-4287-b76a-11b6d86f33dc admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:46.730709 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34544348-15cf-4287-b76a-11b6d86f33dc admin admin] PATH_INFO: `/v3/projects/343e9a84357642fbb081a12cccc76426` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:46.734038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34544348-15cf-4287-b76a-11b6d86f33dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=343e9a84357642fbb081a12cccc76426)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:46.736223 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34544348-15cf-4287-b76a-11b6d86f33dc admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:46.806648 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:46.816825 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-34544348-15cf-4287-b76a-11b6d86f33dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '343e9a84357642fbb081a12cccc76426', 'request_id': 'req-34544348-15cf-4287-b76a-11b6d86f33dc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:46.826486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-34544348-15cf-4287-b76a-11b6d86f33dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '343e9a84357642fbb081a12cccc76426', 'request_id': 'req-34544348-15cf-4287-b76a-11b6d86f33dc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:46.838597 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-34544348-15cf-4287-b76a-11b6d86f33dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '343e9a84357642fbb081a12cccc76426', 'request_id': 'req-34544348-15cf-4287-b76a-11b6d86f33dc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:46.863366 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-34544348-15cf-4287-b76a-11b6d86f33dc admin admin] The token cache is being invalidate because project 343e9a84357642fbb081a12cccc76426 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:19:46.864064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-34544348-15cf-4287-b76a-11b6d86f33dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:46.865399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-34544348-15cf-4287-b76a-11b6d86f33dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:46.877824 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3361/6786] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:19:46 2022] DELETE /identity/v3/projects/343e9a84357642fbb081a12cccc76426 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:19:46.884231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7c90f-1330-43d1-b90f-13fd5973258c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:46.884516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7c90f-1330-43d1-b90f-13fd5973258c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:46.884958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7c90f-1330-43d1-b90f-13fd5973258c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:46.922790 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a3b7c90f-1330-43d1-b90f-13fd5973258c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:19:46.930470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a3b7c90f-1330-43d1-b90f-13fd5973258c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:47.065531 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3426/6787] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:19:47.074426 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b407931-b000-4872-bfd4-f6122204febc None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:47.075079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b407931-b000-4872-bfd4-f6122204febc None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:47.075563 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b407931-b000-4872-bfd4-f6122204febc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:47.103263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-2b407931-b000-4872-bfd4-f6122204febc None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:19:47.105008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2b407931-b000-4872-bfd4-f6122204febc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:47.117102 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3362/6788] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:19:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:19:47.121100 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7c90f-1330-43d1-b90f-13fd5973258c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:47.133901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7c90f-1330-43d1-b90f-13fd5973258c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:47.140822 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70caf42b-03d0-4537-b10f-a263279ad2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:47.141862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70caf42b-03d0-4537-b10f-a263279ad2cd admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:47.142450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70caf42b-03d0-4537-b10f-a263279ad2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:47.143328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70caf42b-03d0-4537-b10f-a263279ad2cd admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:47.145324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70caf42b-03d0-4537-b10f-a263279ad2cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:19:47.145954 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70caf42b-03d0-4537-b10f-a263279ad2cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:47.149277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70caf42b-03d0-4537-b10f-a263279ad2cd admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:47.175815 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b407931-b000-4872-bfd4-f6122204febc None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:47.177178 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3427/6789] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:19:47.190405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b407931-b000-4872-bfd4-f6122204febc None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:47.203411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d70877-d3a4-494d-9b57-411e52816ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:47.204590 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d70877-d3a4-494d-9b57-411e52816ef5 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:47.205206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d70877-d3a4-494d-9b57-411e52816ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:47.206683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d70877-d3a4-494d-9b57-411e52816ef5 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:47.207572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d70877-d3a4-494d-9b57-411e52816ef5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:47.211891 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d70877-d3a4-494d-9b57-411e52816ef5 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:47.292942 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3363/6790] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:19:47 2022] POST /identity/v3/projects => generated 375 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:19:47.297913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70caf42b-03d0-4537-b10f-a263279ad2cd admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:47.334462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70caf42b-03d0-4537-b10f-a263279ad2cd admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:47.383038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b8b4f-59b8-4176-9ce8-1fd55049dab4 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:47.383601 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b8b4f-59b8-4176-9ce8-1fd55049dab4 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:47.384018 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b8b4f-59b8-4176-9ce8-1fd55049dab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:47.446596 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-6d3b8b4f-59b8-4176-9ce8-1fd55049dab4 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:19:47.451160 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6d3b8b4f-59b8-4176-9ce8-1fd55049dab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:47.520331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25612859-9478-4a3a-b979-326ed8496af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:47.521251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25612859-9478-4a3a-b979-326ed8496af2 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:47.521635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25612859-9478-4a3a-b979-326ed8496af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:47.522012 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25612859-9478-4a3a-b979-326ed8496af2 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:47.523637 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25612859-9478-4a3a-b979-326ed8496af2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:47.527044 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25612859-9478-4a3a-b979-326ed8496af2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:47.594293 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3428/6791] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:19:47 2022] POST /identity/v3/users => generated 288 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:19:47.595575 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25612859-9478-4a3a-b979-326ed8496af2 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:47.617556 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3364/6792] 10.222.0.33 () {58 vars in 967 bytes} [Sat Aug 6 21:19:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:19:47.656967 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25612859-9478-4a3a-b979-326ed8496af2 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:47.657668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b8b4f-59b8-4176-9ce8-1fd55049dab4 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:47.659892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6d3b8b4f-59b8-4176-9ce8-1fd55049dab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:47.667421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b807c-6d95-4417-afbd-496815af6f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:47.670936 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b807c-6d95-4417-afbd-496815af6f7a admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:47.672092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b807c-6d95-4417-afbd-496815af6f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:47.672475 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b807c-6d95-4417-afbd-496815af6f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:47.681767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b807c-6d95-4417-afbd-496815af6f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:47.686466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b807c-6d95-4417-afbd-496815af6f7a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:47.714592 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3429/6793] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:19:47.717918 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b807c-6d95-4417-afbd-496815af6f7a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:47.747837 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b807c-6d95-4417-afbd-496815af6f7a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:47.762470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084f176-57ad-4e97-8a39-6d692894f6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:47.764649 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084f176-57ad-4e97-8a39-6d692894f6ea admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:47.764785 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084f176-57ad-4e97-8a39-6d692894f6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:47.765042 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084f176-57ad-4e97-8a39-6d692894f6ea admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:47.765694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084f176-57ad-4e97-8a39-6d692894f6ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:47.767347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084f176-57ad-4e97-8a39-6d692894f6ea admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:47.826535 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3430/6794] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:19:47.839203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084f176-57ad-4e97-8a39-6d692894f6ea admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:47.871539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084f176-57ad-4e97-8a39-6d692894f6ea admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:47.879288 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b8b4f-59b8-4176-9ce8-1fd55049dab4 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:47.883398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acec90e-ae62-4f69-b6dd-e4c112c032b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:47.888380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acec90e-ae62-4f69-b6dd-e4c112c032b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:47.888380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acec90e-ae62-4f69-b6dd-e4c112c032b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:47.888380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acec90e-ae62-4f69-b6dd-e4c112c032b4 admin admin] PATH_INFO: `/v3/projects/ef6b2f97416146d1ae71892d00336d16/users/9146957461994361b98305f75a4a06d5/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:47.897382 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7540b-6123-49c4-bf24-5443f9cc37a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:47.899013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7540b-6123-49c4-bf24-5443f9cc37a9 service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:47.899300 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7540b-6123-49c4-bf24-5443f9cc37a9 service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:47.900608 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7540b-6123-49c4-bf24-5443f9cc37a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:47.947901 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7540b-6123-49c4-bf24-5443f9cc37a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:47.952375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7540b-6123-49c4-bf24-5443f9cc37a9 service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:47.966968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acec90e-ae62-4f69-b6dd-e4c112c032b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef6b2f97416146d1ae71892d00336d16, user_id=9146957461994361b98305f75a4a06d5, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:47.974453 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acec90e-ae62-4f69-b6dd-e4c112c032b4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:48.001410 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3365/6795] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:19:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 06 21:19:48.015570 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3431/6796] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:19:47 2022] PUT /identity/v3/projects/ef6b2f97416146d1ae71892d00336d16/users/9146957461994361b98305f75a4a06d5/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:19:48.025946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1c06f-9224-4626-a172-bde1a02a1856 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:48.026573 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1c06f-9224-4626-a172-bde1a02a1856 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:48.026881 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1c06f-9224-4626-a172-bde1a02a1856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:48.118887 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-8bf1c06f-9224-4626-a172-bde1a02a1856 None None] MFA Rules not processed for user `9146957461994361b98305f75a4a06d5`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:19:48.125932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8bf1c06f-9224-4626-a172-bde1a02a1856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:48.215889 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:48.304433 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acec90e-ae62-4f69-b6dd-e4c112c032b4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:48.309611 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3366/6797] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:19:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:19:48.337430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:48.448887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acec90e-ae62-4f69-b6dd-e4c112c032b4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:48.464701 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314c084-ea01-4305-bdeb-afdcd2435b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:48.465490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314c084-ea01-4305-bdeb-afdcd2435b62 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:48.465826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314c084-ea01-4305-bdeb-afdcd2435b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:48.466106 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314c084-ea01-4305-bdeb-afdcd2435b62 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:48.466919 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314c084-ea01-4305-bdeb-afdcd2435b62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:48.473052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314c084-ea01-4305-bdeb-afdcd2435b62 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:48.546929 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3432/6798] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:19:48 2022] POST /identity/v3/projects => generated 377 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:19:48.551909 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1c06f-9224-4626-a172-bde1a02a1856 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:48.571899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1c06f-9224-4626-a172-bde1a02a1856 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:48.729641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df7a912-ae25-47c2-afce-6896da9de029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:48.731011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7a912-ae25-47c2-afce-6896da9de029 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:48.731868 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7a912-ae25-47c2-afce-6896da9de029 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:48.732315 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7a912-ae25-47c2-afce-6896da9de029 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:48.733133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df7a912-ae25-47c2-afce-6896da9de029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:48.735905 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df7a912-ae25-47c2-afce-6896da9de029 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:48.789570 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3367/6799] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:19:48 2022] POST /identity/v3/users => generated 295 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:19:48.793667 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314c084-ea01-4305-bdeb-afdcd2435b62 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:48.810750 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314c084-ea01-4305-bdeb-afdcd2435b62 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:48.831356 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40d2b0-d7df-4f77-8b91-1fec3b615b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:48.833828 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40d2b0-d7df-4f77-8b91-1fec3b615b04 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:48.834121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40d2b0-d7df-4f77-8b91-1fec3b615b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:48.834401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40d2b0-d7df-4f77-8b91-1fec3b615b04 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:48.837379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b40d2b0-d7df-4f77-8b91-1fec3b615b04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:48.840271 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b40d2b0-d7df-4f77-8b91-1fec3b615b04 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:48.871656 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3433/6800] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:19:48.873885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df7a912-ae25-47c2-afce-6896da9de029 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:48.895412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df7a912-ae25-47c2-afce-6896da9de029 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:48.903877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e4aa3-daf9-4f0d-b90d-2af000ea0fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:48.905954 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e4aa3-daf9-4f0d-b90d-2af000ea0fa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:48.907729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e4aa3-daf9-4f0d-b90d-2af000ea0fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:48.908431 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e4aa3-daf9-4f0d-b90d-2af000ea0fa7 admin admin] PATH_INFO: `/v3/projects/ed8d4e989ced4f918e2812ec41f14ccb/users/a13a9656f3c742aaa7950d6dd755df79/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:48.943030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e4aa3-daf9-4f0d-b90d-2af000ea0fa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed8d4e989ced4f918e2812ec41f14ccb, user_id=a13a9656f3c742aaa7950d6dd755df79, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:48.948265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e4aa3-daf9-4f0d-b90d-2af000ea0fa7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:48.978223 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3368/6801] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:19:48 2022] PUT /identity/v3/projects/ed8d4e989ced4f918e2812ec41f14ccb/users/a13a9656f3c742aaa7950d6dd755df79/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:19:48.981795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40d2b0-d7df-4f77-8b91-1fec3b615b04 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:48.995283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40d2b0-d7df-4f77-8b91-1fec3b615b04 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:49.160053 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff37f51-0fc4-421e-9285-686a3d65bcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:49.161133 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff37f51-0fc4-421e-9285-686a3d65bcb3 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:49.161620 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff37f51-0fc4-421e-9285-686a3d65bcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:49.162464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff37f51-0fc4-421e-9285-686a3d65bcb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:49.163563 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff37f51-0fc4-421e-9285-686a3d65bcb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:49.165432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff37f51-0fc4-421e-9285-686a3d65bcb3 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:49.185861 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3434/6802] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:19:49.190587 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e4aa3-daf9-4f0d-b90d-2af000ea0fa7 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:49.212838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e4aa3-daf9-4f0d-b90d-2af000ea0fa7 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:49.223559 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06c8b4-da95-402a-bdd6-7c212869f1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:49.224322 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06c8b4-da95-402a-bdd6-7c212869f1c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:49.224732 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06c8b4-da95-402a-bdd6-7c212869f1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:49.225113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06c8b4-da95-402a-bdd6-7c212869f1c3 admin admin] PATH_INFO: `/v3/projects/ed8d4e989ced4f918e2812ec41f14ccb/users/a13a9656f3c742aaa7950d6dd755df79/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:49.227673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b06c8b4-da95-402a-bdd6-7c212869f1c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed8d4e989ced4f918e2812ec41f14ccb, user_id=a13a9656f3c742aaa7950d6dd755df79, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:49.231402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b06c8b4-da95-402a-bdd6-7c212869f1c3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:49.246434 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3369/6803] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:19:49 2022] PUT /identity/v3/projects/ed8d4e989ced4f918e2812ec41f14ccb/users/a13a9656f3c742aaa7950d6dd755df79/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:19:49.256712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00cd0b0-01ac-4cbe-aebe-0f81930ca692 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:49.257391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00cd0b0-01ac-4cbe-aebe-0f81930ca692 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:49.257820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00cd0b0-01ac-4cbe-aebe-0f81930ca692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:49.294863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-f00cd0b0-01ac-4cbe-aebe-0f81930ca692 None None] MFA Rules not processed for user `a13a9656f3c742aaa7950d6dd755df79`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:19:49.296978 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f00cd0b0-01ac-4cbe-aebe-0f81930ca692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:49.406209 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3435/6804] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:19:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:19:49.418083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06c8b4-da95-402a-bdd6-7c212869f1c3 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:49.420262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0b06c8b4-da95-402a-bdd6-7c212869f1c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:49.558383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06c8b4-da95-402a-bdd6-7c212869f1c3 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:49.564066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf91bdb-bf84-46b6-84ed-1605127f8afe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:49.565195 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf91bdb-bf84-46b6-84ed-1605127f8afe service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:49.565793 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf91bdb-bf84-46b6-84ed-1605127f8afe service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:49.566489 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf91bdb-bf84-46b6-84ed-1605127f8afe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:49.619727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:49.700615 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf91bdb-bf84-46b6-84ed-1605127f8afe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:49.702835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf91bdb-bf84-46b6-84ed-1605127f8afe service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:49.718478 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3370/6805] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:19:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:19:51.060721 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00cd0b0-01ac-4cbe-aebe-0f81930ca692 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:51.065381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f00cd0b0-01ac-4cbe-aebe-0f81930ca692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:51.083190 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:51.170510 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00cd0b0-01ac-4cbe-aebe-0f81930ca692 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:51.176632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1e7ab-d4d7-4436-bdb7-362a600cb9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:51.177381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1e7ab-d4d7-4436-bdb7-362a600cb9d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:51.177760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1e7ab-d4d7-4436-bdb7-362a600cb9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:51.178131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1e7ab-d4d7-4436-bdb7-362a600cb9d8 admin admin] PATH_INFO: `/v3/users/ab3d99652f7c4df985d50e62d60f4750` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:51.179419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e1e7ab-d4d7-4436-bdb7-362a600cb9d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab3d99652f7c4df985d50e62d60f4750)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:51.181792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e1e7ab-d4d7-4436-bdb7-362a600cb9d8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:51.242806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c6e1e7ab-d4d7-4436-bdb7-362a600cb9d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab3d99652f7c4df985d50e62d60f4750'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:51.252473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c6e1e7ab-d4d7-4436-bdb7-362a600cb9d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab3d99652f7c4df985d50e62d60f4750'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:51.253193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c6e1e7ab-d4d7-4436-bdb7-362a600cb9d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab3d99652f7c4df985d50e62d60f4750'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:51.255276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c6e1e7ab-d4d7-4436-bdb7-362a600cb9d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab3d99652f7c4df985d50e62d60f4750'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:51.272228 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c6e1e7ab-d4d7-4436-bdb7-362a600cb9d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab3d99652f7c4df985d50e62d60f4750'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:51.297811 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3436/6806] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:19:51 2022] DELETE /identity/v3/users/ab3d99652f7c4df985d50e62d60f4750 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:19:51.302482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c76e3d-9a1f-45d6-8d57-d8fec5001c15 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:51.303000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c76e3d-9a1f-45d6-8d57-d8fec5001c15 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:51.303082 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c76e3d-9a1f-45d6-8d57-d8fec5001c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:51.340735 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-23c76e3d-9a1f-45d6-8d57-d8fec5001c15 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:19:51.343315 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-23c76e3d-9a1f-45d6-8d57-d8fec5001c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:51.444472 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3371/6807] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:19:51.456116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1e7ab-d4d7-4436-bdb7-362a600cb9d8 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:51.465090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c6e1e7ab-d4d7-4436-bdb7-362a600cb9d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:51.552284 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1e7ab-d4d7-4436-bdb7-362a600cb9d8 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:51.556947 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c05be0-c591-4684-8322-74b016dfb27e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:51.558476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c05be0-c591-4684-8322-74b016dfb27e service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:51.559021 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c05be0-c591-4684-8322-74b016dfb27e service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:51.559122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c05be0-c591-4684-8322-74b016dfb27e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:51.578722 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c05be0-c591-4684-8322-74b016dfb27e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:51.580853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c05be0-c591-4684-8322-74b016dfb27e service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:51.597872 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3437/6808] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:19:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:19:52.007220 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c76e3d-9a1f-45d6-8d57-d8fec5001c15 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:52.010237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-23c76e3d-9a1f-45d6-8d57-d8fec5001c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:52.047042 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c76e3d-9a1f-45d6-8d57-d8fec5001c15 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:52.064922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cecb908-b73a-4d60-9245-d1bb70b041b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:52.065912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecb908-b73a-4d60-9245-d1bb70b041b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:52.066265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecb908-b73a-4d60-9245-d1bb70b041b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:52.068914 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecb908-b73a-4d60-9245-d1bb70b041b7 admin admin] PATH_INFO: `/v3/projects/5e42f1700ba74d0db6eda8c34e4fba2d` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:52.070533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cecb908-b73a-4d60-9245-d1bb70b041b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e42f1700ba74d0db6eda8c34e4fba2d)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:52.072899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cecb908-b73a-4d60-9245-d1bb70b041b7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:52.213102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9cecb908-b73a-4d60-9245-d1bb70b041b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e42f1700ba74d0db6eda8c34e4fba2d', 'request_id': 'req-9cecb908-b73a-4d60-9245-d1bb70b041b7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:52.223193 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9cecb908-b73a-4d60-9245-d1bb70b041b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e42f1700ba74d0db6eda8c34e4fba2d', 'request_id': 'req-9cecb908-b73a-4d60-9245-d1bb70b041b7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:52.230986 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9cecb908-b73a-4d60-9245-d1bb70b041b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e42f1700ba74d0db6eda8c34e4fba2d', 'request_id': 'req-9cecb908-b73a-4d60-9245-d1bb70b041b7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:52.266172 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9cecb908-b73a-4d60-9245-d1bb70b041b7 admin admin] The token cache is being invalidate because project 5e42f1700ba74d0db6eda8c34e4fba2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:19:52.268764 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9cecb908-b73a-4d60-9245-d1bb70b041b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:52.269930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9cecb908-b73a-4d60-9245-d1bb70b041b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:52.276543 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3372/6809] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:19:52 2022] DELETE /identity/v3/projects/5e42f1700ba74d0db6eda8c34e4fba2d => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:19:52.277842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2179393-f2ef-4fc7-870e-b6c73334ed04 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:52.278911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2179393-f2ef-4fc7-870e-b6c73334ed04 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:52.279578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2179393-f2ef-4fc7-870e-b6c73334ed04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:52.337559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a2179393-f2ef-4fc7-870e-b6c73334ed04 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:19:52.339260 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a2179393-f2ef-4fc7-870e-b6c73334ed04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:52.383135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:52.435214 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3438/6810] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:19:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:19:52.444261 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7b123-2e7d-40c3-8101-dc4e08c6f2a4 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:52.444261 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7b123-2e7d-40c3-8101-dc4e08c6f2a4 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:52.444261 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7b123-2e7d-40c3-8101-dc4e08c6f2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:52.495776 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-17b7b123-2e7d-40c3-8101-dc4e08c6f2a4 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:19:52.500453 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-17b7b123-2e7d-40c3-8101-dc4e08c6f2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:52.522948 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3373/6811] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:19:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:19:52.527877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2179393-f2ef-4fc7-870e-b6c73334ed04 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:52.545405 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2179393-f2ef-4fc7-870e-b6c73334ed04 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:52.556708 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd3032-3076-40cd-9273-bfb4d22698cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:52.557602 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd3032-3076-40cd-9273-bfb4d22698cf admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:52.558138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd3032-3076-40cd-9273-bfb4d22698cf admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:52.558302 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd3032-3076-40cd-9273-bfb4d22698cf admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:52.561839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd3032-3076-40cd-9273-bfb4d22698cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:19:52.562318 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd3032-3076-40cd-9273-bfb4d22698cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:52.568919 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd3032-3076-40cd-9273-bfb4d22698cf admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:52.600881 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3439/6812] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:19:52.605374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7b123-2e7d-40c3-8101-dc4e08c6f2a4 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:52.628631 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7b123-2e7d-40c3-8101-dc4e08c6f2a4 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:52.637490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d85f18-24c3-4f56-9e91-1fa08f37c034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:52.638313 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d85f18-24c3-4f56-9e91-1fa08f37c034 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:52.638837 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d85f18-24c3-4f56-9e91-1fa08f37c034 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:52.639428 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d85f18-24c3-4f56-9e91-1fa08f37c034 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:52.640212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d85f18-24c3-4f56-9e91-1fa08f37c034 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:52.642692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d85f18-24c3-4f56-9e91-1fa08f37c034 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:52.737049 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3374/6813] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:19:52 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:19:52.739892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd3032-3076-40cd-9273-bfb4d22698cf admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:52.762701 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd3032-3076-40cd-9273-bfb4d22698cf admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:52.938890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36732ba6-fa35-4ac9-a2ba-6ff7be8c5558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:52.940563 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36732ba6-fa35-4ac9-a2ba-6ff7be8c5558 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:52.940863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36732ba6-fa35-4ac9-a2ba-6ff7be8c5558 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:52.941271 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36732ba6-fa35-4ac9-a2ba-6ff7be8c5558 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:52.957829 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36732ba6-fa35-4ac9-a2ba-6ff7be8c5558 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:52.959869 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36732ba6-fa35-4ac9-a2ba-6ff7be8c5558 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:53.005812 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3440/6814] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:19:52 2022] POST /identity/v3/users => generated 287 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:19:53.010139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d85f18-24c3-4f56-9e91-1fa08f37c034 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:53.054413 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d85f18-24c3-4f56-9e91-1fa08f37c034 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:53.078108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02105760-b571-4313-b0ba-bc2fdaa91e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:53.082859 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02105760-b571-4313-b0ba-bc2fdaa91e98 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:53.084278 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02105760-b571-4313-b0ba-bc2fdaa91e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:53.085645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02105760-b571-4313-b0ba-bc2fdaa91e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:53.087539 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02105760-b571-4313-b0ba-bc2fdaa91e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:53.091583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02105760-b571-4313-b0ba-bc2fdaa91e98 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:53.126957 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3375/6815] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:19:53.136396 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36732ba6-fa35-4ac9-a2ba-6ff7be8c5558 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:53.167646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36732ba6-fa35-4ac9-a2ba-6ff7be8c5558 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:53.184156 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afacda-9e0f-459f-a713-ae7f95ce62c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:53.185567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afacda-9e0f-459f-a713-ae7f95ce62c7 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:53.186852 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afacda-9e0f-459f-a713-ae7f95ce62c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:53.187246 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afacda-9e0f-459f-a713-ae7f95ce62c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:53.190163 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79afacda-9e0f-459f-a713-ae7f95ce62c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:53.194622 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79afacda-9e0f-459f-a713-ae7f95ce62c7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:53.213102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba07d4-9701-4259-83f8-71b84f0e8c2d None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:53.213729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba07d4-9701-4259-83f8-71b84f0e8c2d None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:53.214102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba07d4-9701-4259-83f8-71b84f0e8c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:53.226540 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3441/6816] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:19:53.236504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afacda-9e0f-459f-a713-ae7f95ce62c7 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:53.237349 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-edba07d4-9701-4259-83f8-71b84f0e8c2d None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:19:53.239482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-edba07d4-9701-4259-83f8-71b84f0e8c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:53.251311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afacda-9e0f-459f-a713-ae7f95ce62c7 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:53.259204 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58baea-305f-4fc8-b42e-c811788a7b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:53.262251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58baea-305f-4fc8-b42e-c811788a7b03 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:53.262898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58baea-305f-4fc8-b42e-c811788a7b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:53.263789 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58baea-305f-4fc8-b42e-c811788a7b03 admin admin] PATH_INFO: `/v3/projects/ac01ba34c7b74cc89691bf812c4055c6/users/697093c57ea14ee3bba5d0347150fa34/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:53.266707 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:53.304712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58baea-305f-4fc8-b42e-c811788a7b03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac01ba34c7b74cc89691bf812c4055c6, user_id=697093c57ea14ee3bba5d0347150fa34, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:53.308594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58baea-305f-4fc8-b42e-c811788a7b03 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:53.334349 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3442/6817] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:19:53 2022] PUT /identity/v3/projects/ac01ba34c7b74cc89691bf812c4055c6/users/697093c57ea14ee3bba5d0347150fa34/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:19:53.354010 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9281fa8-148d-4620-aa7b-b9facb282481 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:53.354646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9281fa8-148d-4620-aa7b-b9facb282481 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:53.355074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9281fa8-148d-4620-aa7b-b9facb282481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:53.405547 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3376/6818] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:19:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:19:53.408505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b9281fa8-148d-4620-aa7b-b9facb282481 None None] MFA Rules not processed for user `697093c57ea14ee3bba5d0347150fa34`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:19:53.410342 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b9281fa8-148d-4620-aa7b-b9facb282481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:53.418844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba07d4-9701-4259-83f8-71b84f0e8c2d None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:53.420455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-edba07d4-9701-4259-83f8-71b84f0e8c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:53.598781 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3443/6819] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:19:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:19:53.639473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba07d4-9701-4259-83f8-71b84f0e8c2d None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:53.722146 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9281fa8-148d-4620-aa7b-b9facb282481 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:53.723830 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b9281fa8-148d-4620-aa7b-b9facb282481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:53.729373 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:53.747154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c21159-5550-4700-b0ad-c3ffbc10dc31 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:53.752700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c21159-5550-4700-b0ad-c3ffbc10dc31 service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:53.753226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c21159-5550-4700-b0ad-c3ffbc10dc31 service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:53.753713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c21159-5550-4700-b0ad-c3ffbc10dc31 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:53.846994 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9281fa8-148d-4620-aa7b-b9facb282481 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:53.856563 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46298e6b-53dd-4c88-aa58-aa25ee2b2223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:53.857335 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46298e6b-53dd-4c88-aa58-aa25ee2b2223 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:53.857714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46298e6b-53dd-4c88-aa58-aa25ee2b2223 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:53.858156 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46298e6b-53dd-4c88-aa58-aa25ee2b2223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:53.883853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46298e6b-53dd-4c88-aa58-aa25ee2b2223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:53.885392 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46298e6b-53dd-4c88-aa58-aa25ee2b2223 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:53.903751 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3444/6820] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:19:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:19:53.904778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46298e6b-53dd-4c88-aa58-aa25ee2b2223 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:53.906237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-46298e6b-53dd-4c88-aa58-aa25ee2b2223 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:53.923195 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c21159-5550-4700-b0ad-c3ffbc10dc31 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:53.928318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c21159-5550-4700-b0ad-c3ffbc10dc31 service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:53.959751 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3377/6821] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:19:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 06 21:19:54.040100 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46298e6b-53dd-4c88-aa58-aa25ee2b2223 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:54.048781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02da1f-e00c-47d8-80bc-467f3d52b9a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:54.049015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02da1f-e00c-47d8-80bc-467f3d52b9a2 service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:54.049390 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02da1f-e00c-47d8-80bc-467f3d52b9a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:54.049773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02da1f-e00c-47d8-80bc-467f3d52b9a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:54.061315 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1c02da1f-e00c-47d8-80bc-467f3d52b9a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:54.270731 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02da1f-e00c-47d8-80bc-467f3d52b9a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:54.283952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02da1f-e00c-47d8-80bc-467f3d52b9a2 service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:54.335081 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3445/6822] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:19:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:19:56.091134 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c21159-5550-4700-b0ad-c3ffbc10dc31 service swift] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:56.105774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:56.228176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c21159-5550-4700-b0ad-c3ffbc10dc31 service swift] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:56.258331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d099b-0cd6-49c9-8092-3d4cb230bc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:56.259027 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d099b-0cd6-49c9-8092-3d4cb230bc3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:56.259307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d099b-0cd6-49c9-8092-3d4cb230bc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:56.259584 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d099b-0cd6-49c9-8092-3d4cb230bc3e admin admin] PATH_INFO: `/v3/users/697093c57ea14ee3bba5d0347150fa34` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:56.263332 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d099b-0cd6-49c9-8092-3d4cb230bc3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=697093c57ea14ee3bba5d0347150fa34)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:56.265283 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d099b-0cd6-49c9-8092-3d4cb230bc3e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:56.435938 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-095d099b-0cd6-49c9-8092-3d4cb230bc3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '697093c57ea14ee3bba5d0347150fa34'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:56.437093 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-095d099b-0cd6-49c9-8092-3d4cb230bc3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '697093c57ea14ee3bba5d0347150fa34'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:56.438412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-095d099b-0cd6-49c9-8092-3d4cb230bc3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '697093c57ea14ee3bba5d0347150fa34'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:56.482578 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-095d099b-0cd6-49c9-8092-3d4cb230bc3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '697093c57ea14ee3bba5d0347150fa34'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:56.578063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-095d099b-0cd6-49c9-8092-3d4cb230bc3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '697093c57ea14ee3bba5d0347150fa34'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:56.619993 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b5681-6642-4c7b-b854-aa65bc852350 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:56.620402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b5681-6642-4c7b-b854-aa65bc852350 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:56.620502 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b5681-6642-4c7b-b854-aa65bc852350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:56.623490 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3378/6823] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:19:56 2022] DELETE /identity/v3/users/697093c57ea14ee3bba5d0347150fa34 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:19:56.656649 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-209b5681-6642-4c7b-b854-aa65bc852350 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:19:56.659455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-209b5681-6642-4c7b-b854-aa65bc852350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:56.833002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:56.870159 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3446/6824] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:19:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:19:56.902935 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d099b-0cd6-49c9-8092-3d4cb230bc3e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:56.909965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-095d099b-0cd6-49c9-8092-3d4cb230bc3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:57.096102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d099b-0cd6-49c9-8092-3d4cb230bc3e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:57.105746 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0bcee-39fa-489d-ad26-418d86e087fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:57.106334 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0bcee-39fa-489d-ad26-418d86e087fa service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:57.106657 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0bcee-39fa-489d-ad26-418d86e087fa service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:57.106937 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0bcee-39fa-489d-ad26-418d86e087fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:57.131984 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0bcee-39fa-489d-ad26-418d86e087fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:57.133466 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0bcee-39fa-489d-ad26-418d86e087fa service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:57.155239 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3379/6825] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:19:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:19:58.311078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b5681-6642-4c7b-b854-aa65bc852350 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:58.315040 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-209b5681-6642-4c7b-b854-aa65bc852350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:58.371539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b5681-6642-4c7b-b854-aa65bc852350 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:58.386314 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca76eb-09c0-4645-97e9-7f63f848b5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:58.387272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca76eb-09c0-4645-97e9-7f63f848b5c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:58.387879 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca76eb-09c0-4645-97e9-7f63f848b5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:58.388514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca76eb-09c0-4645-97e9-7f63f848b5c2 admin admin] PATH_INFO: `/v3/projects/ac01ba34c7b74cc89691bf812c4055c6` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:58.389995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca76eb-09c0-4645-97e9-7f63f848b5c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac01ba34c7b74cc89691bf812c4055c6)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:58.393753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca76eb-09c0-4645-97e9-7f63f848b5c2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:58.515154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8fca76eb-09c0-4645-97e9-7f63f848b5c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac01ba34c7b74cc89691bf812c4055c6', 'request_id': 'req-8fca76eb-09c0-4645-97e9-7f63f848b5c2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:58.525337 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8fca76eb-09c0-4645-97e9-7f63f848b5c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac01ba34c7b74cc89691bf812c4055c6', 'request_id': 'req-8fca76eb-09c0-4645-97e9-7f63f848b5c2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:58.542447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8fca76eb-09c0-4645-97e9-7f63f848b5c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac01ba34c7b74cc89691bf812c4055c6', 'request_id': 'req-8fca76eb-09c0-4645-97e9-7f63f848b5c2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:58.563291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8fca76eb-09c0-4645-97e9-7f63f848b5c2 admin admin] The token cache is being invalidate because project ac01ba34c7b74cc89691bf812c4055c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:19:58.564551 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8fca76eb-09c0-4645-97e9-7f63f848b5c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:58.567523 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8fca76eb-09c0-4645-97e9-7f63f848b5c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:19:58.576196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24373f9d-f967-48eb-8dae-f1488b4c8f28 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:58.577020 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24373f9d-f967-48eb-8dae-f1488b4c8f28 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:58.577684 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24373f9d-f967-48eb-8dae-f1488b4c8f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:58.599106 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3447/6826] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:19:58 2022] DELETE /identity/v3/projects/ac01ba34c7b74cc89691bf812c4055c6 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:19:58.621819 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-24373f9d-f967-48eb-8dae-f1488b4c8f28 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:19:58.623592 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-24373f9d-f967-48eb-8dae-f1488b4c8f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:58.708695 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:58.835390 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3380/6827] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:19:58.844305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6329f26-9992-4a12-bd3e-261739ce3b40 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:58.845176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6329f26-9992-4a12-bd3e-261739ce3b40 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:58.846500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6329f26-9992-4a12-bd3e-261739ce3b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:58.898424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-f6329f26-9992-4a12-bd3e-261739ce3b40 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:19:58.900323 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f6329f26-9992-4a12-bd3e-261739ce3b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:58.912238 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3448/6828] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:19:58.916979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24373f9d-f967-48eb-8dae-f1488b4c8f28 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:58.936482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24373f9d-f967-48eb-8dae-f1488b4c8f28 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:58.943247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40174b4-e02e-4d4c-89ef-4de46c0dd1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:58.944559 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40174b4-e02e-4d4c-89ef-4de46c0dd1ae admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:58.945057 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40174b4-e02e-4d4c-89ef-4de46c0dd1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:58.945529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40174b4-e02e-4d4c-89ef-4de46c0dd1ae admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:58.946398 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40174b4-e02e-4d4c-89ef-4de46c0dd1ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:19:58.946931 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40174b4-e02e-4d4c-89ef-4de46c0dd1ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:58.949191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40174b4-e02e-4d4c-89ef-4de46c0dd1ae admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:58.981705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6329f26-9992-4a12-bd3e-261739ce3b40 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:58.992929 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3381/6829] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:19:58.994660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6329f26-9992-4a12-bd3e-261739ce3b40 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:59.011071 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01713e68-a6dc-4b7e-b9cb-b5af62abe97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:59.012296 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01713e68-a6dc-4b7e-b9cb-b5af62abe97b admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:59.013602 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01713e68-a6dc-4b7e-b9cb-b5af62abe97b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:59.016947 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01713e68-a6dc-4b7e-b9cb-b5af62abe97b admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:59.018354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01713e68-a6dc-4b7e-b9cb-b5af62abe97b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:59.020760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01713e68-a6dc-4b7e-b9cb-b5af62abe97b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:59.084066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40174b4-e02e-4d4c-89ef-4de46c0dd1ae admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:59.114366 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3449/6830] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:19:58 2022] POST /identity/v3/projects => generated 369 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:19:59.117016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40174b4-e02e-4d4c-89ef-4de46c0dd1ae admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:59.299031 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239986c-aebb-4c15-8031-ec60e6ef0fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:59.299826 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239986c-aebb-4c15-8031-ec60e6ef0fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:59.300813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239986c-aebb-4c15-8031-ec60e6ef0fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:59.301197 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239986c-aebb-4c15-8031-ec60e6ef0fd1 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:59.302447 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239986c-aebb-4c15-8031-ec60e6ef0fd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:59.305602 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239986c-aebb-4c15-8031-ec60e6ef0fd1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:59.342445 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3382/6831] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:19:59 2022] POST /identity/v3/users => generated 285 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:19:59.347041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01713e68-a6dc-4b7e-b9cb-b5af62abe97b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:59.381767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01713e68-a6dc-4b7e-b9cb-b5af62abe97b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:59.388962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df93d16-fc85-4c19-81a5-865ca914ebaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:59.389790 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df93d16-fc85-4c19-81a5-865ca914ebaa admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:59.390171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df93d16-fc85-4c19-81a5-865ca914ebaa admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:59.390783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df93d16-fc85-4c19-81a5-865ca914ebaa admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:59.391556 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df93d16-fc85-4c19-81a5-865ca914ebaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:59.397025 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df93d16-fc85-4c19-81a5-865ca914ebaa admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:59.432619 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3450/6832] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:19:59.437772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239986c-aebb-4c15-8031-ec60e6ef0fd1 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:59.452291 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239986c-aebb-4c15-8031-ec60e6ef0fd1 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:59.464931 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cd557-1799-4eeb-b39e-7afff4ef4639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:59.465925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cd557-1799-4eeb-b39e-7afff4ef4639 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:59.466606 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cd557-1799-4eeb-b39e-7afff4ef4639 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:59.467092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cd557-1799-4eeb-b39e-7afff4ef4639 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:59.468176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625cd557-1799-4eeb-b39e-7afff4ef4639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:59.474941 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625cd557-1799-4eeb-b39e-7afff4ef4639 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:59.516889 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df93d16-fc85-4c19-81a5-865ca914ebaa admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:19:59.519410 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3383/6833] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:19:59.556194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df93d16-fc85-4c19-81a5-865ca914ebaa admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:19:59.575894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f760fef-0974-4a84-ba62-cdd6ce856251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:19:59.577216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f760fef-0974-4a84-ba62-cdd6ce856251 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:59.577609 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f760fef-0974-4a84-ba62-cdd6ce856251 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:59.578753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f760fef-0974-4a84-ba62-cdd6ce856251 admin admin] PATH_INFO: `/v3/projects/4f97a82605a54f88ae4dbdda90c5a52d/users/ad95e1edd84d49ada9f06b1feb0e0d87/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:59.613672 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f760fef-0974-4a84-ba62-cdd6ce856251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f97a82605a54f88ae4dbdda90c5a52d, user_id=ad95e1edd84d49ada9f06b1feb0e0d87, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:19:59.617121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f760fef-0974-4a84-ba62-cdd6ce856251 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:19:59.666120 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3451/6834] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:19:59 2022] PUT /identity/v3/projects/4f97a82605a54f88ae4dbdda90c5a52d/users/ad95e1edd84d49ada9f06b1feb0e0d87/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:19:59.683689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c767887-16af-4e5e-b823-9509f4ff5c92 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:19:59.685412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c767887-16af-4e5e-b823-9509f4ff5c92 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:19:59.688995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c767887-16af-4e5e-b823-9509f4ff5c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:19:59.765663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-6c767887-16af-4e5e-b823-9509f4ff5c92 None None] MFA Rules not processed for user `ad95e1edd84d49ada9f06b1feb0e0d87`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:19:59.767003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6c767887-16af-4e5e-b823-9509f4ff5c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:19:59.972799 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3384/6835] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:19:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:20:00.000509 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f760fef-0974-4a84-ba62-cdd6ce856251 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:00.003343 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8f760fef-0974-4a84-ba62-cdd6ce856251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:00.125895 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f760fef-0974-4a84-ba62-cdd6ce856251 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:00.134463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b109f34-8dd9-4f70-a219-8ce9e38e4858 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:00.135157 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b109f34-8dd9-4f70-a219-8ce9e38e4858 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:00.136568 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b109f34-8dd9-4f70-a219-8ce9e38e4858 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:00.136862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b109f34-8dd9-4f70-a219-8ce9e38e4858 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:00.159200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b109f34-8dd9-4f70-a219-8ce9e38e4858 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:00.165199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b109f34-8dd9-4f70-a219-8ce9e38e4858 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:00.207029 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3452/6836] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:19:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:20:09.500390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c767887-16af-4e5e-b823-9509f4ff5c92 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:09.503153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6c767887-16af-4e5e-b823-9509f4ff5c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:09.560094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:09.708052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c767887-16af-4e5e-b823-9509f4ff5c92 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:09.720904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91f794-dcd7-40bf-8395-2ea848db0cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:09.725667 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91f794-dcd7-40bf-8395-2ea848db0cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:09.726209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91f794-dcd7-40bf-8395-2ea848db0cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:09.726755 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91f794-dcd7-40bf-8395-2ea848db0cc8 admin admin] PATH_INFO: `/v3/users/1abfee594043453a9a5762d94ba46065` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:09.731006 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b91f794-dcd7-40bf-8395-2ea848db0cc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1abfee594043453a9a5762d94ba46065)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:09.739439 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b91f794-dcd7-40bf-8395-2ea848db0cc8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:09.872498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9b91f794-dcd7-40bf-8395-2ea848db0cc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1abfee594043453a9a5762d94ba46065'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:09.876311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9b91f794-dcd7-40bf-8395-2ea848db0cc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1abfee594043453a9a5762d94ba46065'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:09.878981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9b91f794-dcd7-40bf-8395-2ea848db0cc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1abfee594043453a9a5762d94ba46065'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:09.899980 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9b91f794-dcd7-40bf-8395-2ea848db0cc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1abfee594043453a9a5762d94ba46065'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:09.932127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9b91f794-dcd7-40bf-8395-2ea848db0cc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1abfee594043453a9a5762d94ba46065'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:09.966809 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3385/6837] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:20:09 2022] DELETE /identity/v3/users/1abfee594043453a9a5762d94ba46065 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:20:09.971993 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4a559-bc68-4119-bf52-84643814e761 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:09.977249 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4a559-bc68-4119-bf52-84643814e761 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:09.977693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4a559-bc68-4119-bf52-84643814e761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:10.033466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-42d4a559-bc68-4119-bf52-84643814e761 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:10.035789 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-42d4a559-bc68-4119-bf52-84643814e761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:10.087439 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:10.343107 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3453/6838] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:20:10.583135 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91f794-dcd7-40bf-8395-2ea848db0cc8 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:10.585468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9b91f794-dcd7-40bf-8395-2ea848db0cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:10.728457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91f794-dcd7-40bf-8395-2ea848db0cc8 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:10.738008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b47e23-cd1f-4879-8f4a-bd1602dc6bf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:10.738941 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b47e23-cd1f-4879-8f4a-bd1602dc6bf5 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:10.739383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b47e23-cd1f-4879-8f4a-bd1602dc6bf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:10.739811 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b47e23-cd1f-4879-8f4a-bd1602dc6bf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:10.779471 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b47e23-cd1f-4879-8f4a-bd1602dc6bf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:10.782076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b47e23-cd1f-4879-8f4a-bd1602dc6bf5 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:10.817079 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3386/6839] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:20:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:20:11.556663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d4a559-bc68-4119-bf52-84643814e761 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:11.558205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-42d4a559-bc68-4119-bf52-84643814e761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:11.585488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d4a559-bc68-4119-bf52-84643814e761 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:11.602432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa4cc9-702b-4f49-9a52-17d398d6b673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:11.603214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa4cc9-702b-4f49-9a52-17d398d6b673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:11.604710 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa4cc9-702b-4f49-9a52-17d398d6b673 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:11.605067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa4cc9-702b-4f49-9a52-17d398d6b673 admin admin] PATH_INFO: `/v3/projects/b262a66c9a1a4c06ab427fdbc64e386d` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:11.608470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fa4cc9-702b-4f49-9a52-17d398d6b673 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b262a66c9a1a4c06ab427fdbc64e386d)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:11.613196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fa4cc9-702b-4f49-9a52-17d398d6b673 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:11.790612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c8fa4cc9-702b-4f49-9a52-17d398d6b673 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b262a66c9a1a4c06ab427fdbc64e386d', 'request_id': 'req-c8fa4cc9-702b-4f49-9a52-17d398d6b673'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:11.815616 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c8fa4cc9-702b-4f49-9a52-17d398d6b673 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b262a66c9a1a4c06ab427fdbc64e386d', 'request_id': 'req-c8fa4cc9-702b-4f49-9a52-17d398d6b673'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:11.830330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c8fa4cc9-702b-4f49-9a52-17d398d6b673 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b262a66c9a1a4c06ab427fdbc64e386d', 'request_id': 'req-c8fa4cc9-702b-4f49-9a52-17d398d6b673'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:11.856514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c8fa4cc9-702b-4f49-9a52-17d398d6b673 admin admin] The token cache is being invalidate because project b262a66c9a1a4c06ab427fdbc64e386d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:20:11.857033 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c8fa4cc9-702b-4f49-9a52-17d398d6b673 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:11.858079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c8fa4cc9-702b-4f49-9a52-17d398d6b673 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:11.864542 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3454/6840] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:20:11 2022] DELETE /identity/v3/projects/b262a66c9a1a4c06ab427fdbc64e386d => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:20:11.869346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853b6e8-1526-46d6-8a13-c835a62ef20a None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:11.870823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853b6e8-1526-46d6-8a13-c835a62ef20a None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:11.871304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853b6e8-1526-46d6-8a13-c835a62ef20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:11.914503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-6853b6e8-1526-46d6-8a13-c835a62ef20a None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:11.918896 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6853b6e8-1526-46d6-8a13-c835a62ef20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:12.033370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:12.108707 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3387/6841] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:20:12.111260 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706c6cd-2237-4099-90fd-ddb933d5ba0d None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:12.111774 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706c6cd-2237-4099-90fd-ddb933d5ba0d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:12.112204 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706c6cd-2237-4099-90fd-ddb933d5ba0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:12.161046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-e706c6cd-2237-4099-90fd-ddb933d5ba0d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:12.162438 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e706c6cd-2237-4099-90fd-ddb933d5ba0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:12.198847 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3455/6842] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:20:12.200358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853b6e8-1526-46d6-8a13-c835a62ef20a None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:12.211569 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853b6e8-1526-46d6-8a13-c835a62ef20a None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:12.220349 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32678737-f551-4449-b5cf-b80f7e9a3804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:12.221382 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32678737-f551-4449-b5cf-b80f7e9a3804 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:12.221872 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32678737-f551-4449-b5cf-b80f7e9a3804 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:12.222346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32678737-f551-4449-b5cf-b80f7e9a3804 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:12.223291 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32678737-f551-4449-b5cf-b80f7e9a3804 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:20:12.223823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32678737-f551-4449-b5cf-b80f7e9a3804 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:12.226002 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32678737-f551-4449-b5cf-b80f7e9a3804 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:12.253055 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3388/6843] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:20:12.254210 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706c6cd-2237-4099-90fd-ddb933d5ba0d None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:12.265626 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706c6cd-2237-4099-90fd-ddb933d5ba0d None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:12.296108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d140b6-959a-4e07-81f8-f981dddfddaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:12.301860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d140b6-959a-4e07-81f8-f981dddfddaa admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:12.302231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d140b6-959a-4e07-81f8-f981dddfddaa admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:12.302519 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d140b6-959a-4e07-81f8-f981dddfddaa admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:12.303228 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d140b6-959a-4e07-81f8-f981dddfddaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:12.316434 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d140b6-959a-4e07-81f8-f981dddfddaa admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:12.444804 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3456/6844] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:20:12 2022] POST /identity/v3/projects => generated 383 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:20:12.448735 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32678737-f551-4449-b5cf-b80f7e9a3804 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:12.476889 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32678737-f551-4449-b5cf-b80f7e9a3804 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:12.762607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46c803-e3df-44cf-8f6f-1ec83e380b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:12.765715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46c803-e3df-44cf-8f6f-1ec83e380b4b admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:12.792290 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46c803-e3df-44cf-8f6f-1ec83e380b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:12.797346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46c803-e3df-44cf-8f6f-1ec83e380b4b admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:12.799457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46c803-e3df-44cf-8f6f-1ec83e380b4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:12.820961 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46c803-e3df-44cf-8f6f-1ec83e380b4b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:12.890638 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3389/6845] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:20:12 2022] POST /identity/v3/users => generated 292 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:20:12.893229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d140b6-959a-4e07-81f8-f981dddfddaa admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:12.909207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d140b6-959a-4e07-81f8-f981dddfddaa admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:12.957573 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edb938-1457-4ca2-b308-f6c37594c9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:12.959060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edb938-1457-4ca2-b308-f6c37594c9ea admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:12.959819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edb938-1457-4ca2-b308-f6c37594c9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:12.960763 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edb938-1457-4ca2-b308-f6c37594c9ea admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:12.961742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41edb938-1457-4ca2-b308-f6c37594c9ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:12.966443 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41edb938-1457-4ca2-b308-f6c37594c9ea admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:13.008390 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3457/6846] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:20:13.015021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46c803-e3df-44cf-8f6f-1ec83e380b4b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:13.033843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46c803-e3df-44cf-8f6f-1ec83e380b4b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:13.048957 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852fc24-ce2a-4669-9ed1-1a73853630a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:13.055087 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852fc24-ce2a-4669-9ed1-1a73853630a2 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:13.058341 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852fc24-ce2a-4669-9ed1-1a73853630a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:13.059850 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852fc24-ce2a-4669-9ed1-1a73853630a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:13.073548 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852fc24-ce2a-4669-9ed1-1a73853630a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:13.078421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852fc24-ce2a-4669-9ed1-1a73853630a2 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:13.126903 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3390/6847] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:20:13.128036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edb938-1457-4ca2-b308-f6c37594c9ea admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:13.146844 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edb938-1457-4ca2-b308-f6c37594c9ea admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:13.160755 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a089e31-bc1d-4034-a034-9381e8505aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:13.162833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a089e31-bc1d-4034-a034-9381e8505aea admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:13.163218 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a089e31-bc1d-4034-a034-9381e8505aea admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:13.163602 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a089e31-bc1d-4034-a034-9381e8505aea admin admin] PATH_INFO: `/v3/projects/cf64a63a34734bf398cd1a0280084476/users/1c2298153a364f8a9a05a6a448bf9491/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:13.195384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a089e31-bc1d-4034-a034-9381e8505aea admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf64a63a34734bf398cd1a0280084476, user_id=1c2298153a364f8a9a05a6a448bf9491, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:13.198535 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a089e31-bc1d-4034-a034-9381e8505aea admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:13.226279 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3458/6848] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:20:13 2022] PUT /identity/v3/projects/cf64a63a34734bf398cd1a0280084476/users/1c2298153a364f8a9a05a6a448bf9491/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:20:13.237937 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d48c1-0811-4bef-ba62-1daeb0437d9e None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:13.238246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d48c1-0811-4bef-ba62-1daeb0437d9e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:13.238528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d48c1-0811-4bef-ba62-1daeb0437d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:13.346661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-c84d48c1-0811-4bef-ba62-1daeb0437d9e None None] MFA Rules not processed for user `1c2298153a364f8a9a05a6a448bf9491`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:13.350259 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c84d48c1-0811-4bef-ba62-1daeb0437d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:13.569486 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3391/6849] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:20:13.583705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a089e31-bc1d-4034-a034-9381e8505aea admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:13.585537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0a089e31-bc1d-4034-a034-9381e8505aea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:13.740898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d48c1-0811-4bef-ba62-1daeb0437d9e None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:13.743957 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c84d48c1-0811-4bef-ba62-1daeb0437d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:13.832317 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:13.891464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a089e31-bc1d-4034-a034-9381e8505aea admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:13.899070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a608a5-f054-4f09-88a8-ceac2d4a23e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:13.901403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a608a5-f054-4f09-88a8-ceac2d4a23e1 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:13.902601 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a608a5-f054-4f09-88a8-ceac2d4a23e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:13.903225 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a608a5-f054-4f09-88a8-ceac2d4a23e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:13.928020 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:13.929935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a608a5-f054-4f09-88a8-ceac2d4a23e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:13.932038 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a608a5-f054-4f09-88a8-ceac2d4a23e1 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:13.953526 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3459/6850] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:20:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:20:13.955529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d48c1-0811-4bef-ba62-1daeb0437d9e None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:13.960633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8ab1a-bb69-4b05-bd23-be5102fe8856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:13.961509 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8ab1a-bb69-4b05-bd23-be5102fe8856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:13.961940 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8ab1a-bb69-4b05-bd23-be5102fe8856 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:13.962500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8ab1a-bb69-4b05-bd23-be5102fe8856 admin admin] PATH_INFO: `/v3/users/9146957461994361b98305f75a4a06d5` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:13.964508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8ab1a-bb69-4b05-bd23-be5102fe8856 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9146957461994361b98305f75a4a06d5)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:13.966705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8ab1a-bb69-4b05-bd23-be5102fe8856 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:14.088145 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bab8ab1a-bb69-4b05-bd23-be5102fe8856 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9146957461994361b98305f75a4a06d5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:14.089450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bab8ab1a-bb69-4b05-bd23-be5102fe8856 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9146957461994361b98305f75a4a06d5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:14.093492 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bab8ab1a-bb69-4b05-bd23-be5102fe8856 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9146957461994361b98305f75a4a06d5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:14.127790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bab8ab1a-bb69-4b05-bd23-be5102fe8856 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9146957461994361b98305f75a4a06d5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:14.162065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bab8ab1a-bb69-4b05-bd23-be5102fe8856 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9146957461994361b98305f75a4a06d5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:14.210989 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3392/6851] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:20:13 2022] DELETE /identity/v3/users/9146957461994361b98305f75a4a06d5 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:20:14.212761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbae6f-e5b7-473e-be1d-bf00793cabcb None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:14.213051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbae6f-e5b7-473e-be1d-bf00793cabcb None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:14.213337 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbae6f-e5b7-473e-be1d-bf00793cabcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:14.252478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-edfbae6f-e5b7-473e-be1d-bf00793cabcb None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:14.255888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-edfbae6f-e5b7-473e-be1d-bf00793cabcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:14.422804 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3460/6852] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:20:14.490685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8ab1a-bb69-4b05-bd23-be5102fe8856 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:14.492153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-bab8ab1a-bb69-4b05-bd23-be5102fe8856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:14.639722 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8ab1a-bb69-4b05-bd23-be5102fe8856 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:14.666433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03096b17-42d3-4906-8f47-60dfc281f030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:14.666808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03096b17-42d3-4906-8f47-60dfc281f030 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:14.674454 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03096b17-42d3-4906-8f47-60dfc281f030 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:14.674454 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03096b17-42d3-4906-8f47-60dfc281f030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:14.711163 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03096b17-42d3-4906-8f47-60dfc281f030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:14.718470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03096b17-42d3-4906-8f47-60dfc281f030 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:14.758921 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3393/6853] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:20:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:20:14.826920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfbae6f-e5b7-473e-be1d-bf00793cabcb None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:14.829516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-edfbae6f-e5b7-473e-be1d-bf00793cabcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:14.847567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfbae6f-e5b7-473e-be1d-bf00793cabcb None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:14.854670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a693cda-7ca6-48b6-a3ec-8fb914ebee08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:14.855602 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a693cda-7ca6-48b6-a3ec-8fb914ebee08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:14.856016 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a693cda-7ca6-48b6-a3ec-8fb914ebee08 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:14.856487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a693cda-7ca6-48b6-a3ec-8fb914ebee08 admin admin] PATH_INFO: `/v3/users/1c2298153a364f8a9a05a6a448bf9491` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:14.857784 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a693cda-7ca6-48b6-a3ec-8fb914ebee08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c2298153a364f8a9a05a6a448bf9491)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:14.860181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a693cda-7ca6-48b6-a3ec-8fb914ebee08 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:14.934960 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1a693cda-7ca6-48b6-a3ec-8fb914ebee08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c2298153a364f8a9a05a6a448bf9491'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:14.952207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1a693cda-7ca6-48b6-a3ec-8fb914ebee08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c2298153a364f8a9a05a6a448bf9491'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:14.954377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1a693cda-7ca6-48b6-a3ec-8fb914ebee08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c2298153a364f8a9a05a6a448bf9491'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:14.955762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1a693cda-7ca6-48b6-a3ec-8fb914ebee08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c2298153a364f8a9a05a6a448bf9491'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:14.972365 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1a693cda-7ca6-48b6-a3ec-8fb914ebee08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c2298153a364f8a9a05a6a448bf9491'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:14.999372 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3461/6854] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:20:14 2022] DELETE /identity/v3/users/1c2298153a364f8a9a05a6a448bf9491 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:20:15.004547 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae57ec3-c7c7-4738-b212-acaba78c2497 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:15.005680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae57ec3-c7c7-4738-b212-acaba78c2497 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:15.006156 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae57ec3-c7c7-4738-b212-acaba78c2497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:15.033883 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-1ae57ec3-c7c7-4738-b212-acaba78c2497 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:15.035562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1ae57ec3-c7c7-4738-b212-acaba78c2497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:15.144321 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3394/6855] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:20:15.153652 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a693cda-7ca6-48b6-a3ec-8fb914ebee08 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:15.155350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1a693cda-7ca6-48b6-a3ec-8fb914ebee08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:15.343823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a693cda-7ca6-48b6-a3ec-8fb914ebee08 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:15.356381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75379f-5606-444c-8bca-60ae24de57ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:15.357206 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75379f-5606-444c-8bca-60ae24de57ff service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:15.357595 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75379f-5606-444c-8bca-60ae24de57ff service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:15.357973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75379f-5606-444c-8bca-60ae24de57ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:15.372311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:15.386865 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75379f-5606-444c-8bca-60ae24de57ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:15.388377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75379f-5606-444c-8bca-60ae24de57ff service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:15.411278 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3462/6856] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:20:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:20:15.900441 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae57ec3-c7c7-4738-b212-acaba78c2497 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:15.902467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1ae57ec3-c7c7-4738-b212-acaba78c2497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:15.914968 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:15.938608 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae57ec3-c7c7-4738-b212-acaba78c2497 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:15.973669 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e76aa33-070c-482b-86a8-dfc887bb2773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:15.974819 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76aa33-070c-482b-86a8-dfc887bb2773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:15.975253 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76aa33-070c-482b-86a8-dfc887bb2773 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:15.976309 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76aa33-070c-482b-86a8-dfc887bb2773 admin admin] PATH_INFO: `/v3/projects/cf64a63a34734bf398cd1a0280084476` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:15.977726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e76aa33-070c-482b-86a8-dfc887bb2773 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf64a63a34734bf398cd1a0280084476)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:15.980352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e76aa33-070c-482b-86a8-dfc887bb2773 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:16.079069 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4e76aa33-070c-482b-86a8-dfc887bb2773 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf64a63a34734bf398cd1a0280084476', 'request_id': 'req-4e76aa33-070c-482b-86a8-dfc887bb2773'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:16.089064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4e76aa33-070c-482b-86a8-dfc887bb2773 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf64a63a34734bf398cd1a0280084476', 'request_id': 'req-4e76aa33-070c-482b-86a8-dfc887bb2773'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:16.103591 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4e76aa33-070c-482b-86a8-dfc887bb2773 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf64a63a34734bf398cd1a0280084476', 'request_id': 'req-4e76aa33-070c-482b-86a8-dfc887bb2773'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:16.123584 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4e76aa33-070c-482b-86a8-dfc887bb2773 admin admin] The token cache is being invalidate because project cf64a63a34734bf398cd1a0280084476 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:20:16.124155 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4e76aa33-070c-482b-86a8-dfc887bb2773 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:16.124996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4e76aa33-070c-482b-86a8-dfc887bb2773 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:16.128539 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3395/6857] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:20:15 2022] DELETE /identity/v3/projects/cf64a63a34734bf398cd1a0280084476 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:20:16.133353 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbc8bd-5aa9-4ab7-aedb-b136e6f46386 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:16.134227 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbc8bd-5aa9-4ab7-aedb-b136e6f46386 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:16.134689 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbc8bd-5aa9-4ab7-aedb-b136e6f46386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:16.160242 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b6fbc8bd-5aa9-4ab7-aedb-b136e6f46386 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:16.163206 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b6fbc8bd-5aa9-4ab7-aedb-b136e6f46386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:16.282778 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3463/6858] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:20:16.287361 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fa1cb-8daa-4e53-88e3-479f0f262cb5 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:16.287361 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fa1cb-8daa-4e53-88e3-479f0f262cb5 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:16.287560 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fa1cb-8daa-4e53-88e3-479f0f262cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:16.331390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-8e5fa1cb-8daa-4e53-88e3-479f0f262cb5 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:16.332714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8e5fa1cb-8daa-4e53-88e3-479f0f262cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:16.350903 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3396/6859] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:20:16.355046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbc8bd-5aa9-4ab7-aedb-b136e6f46386 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:16.380096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbc8bd-5aa9-4ab7-aedb-b136e6f46386 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:16.401596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371bbc2f-1f4a-403b-b5c6-68827b9e5252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:16.402233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371bbc2f-1f4a-403b-b5c6-68827b9e5252 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:16.402518 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371bbc2f-1f4a-403b-b5c6-68827b9e5252 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:16.403366 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371bbc2f-1f4a-403b-b5c6-68827b9e5252 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:16.403655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371bbc2f-1f4a-403b-b5c6-68827b9e5252 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:20:16.404093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371bbc2f-1f4a-403b-b5c6-68827b9e5252 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:16.405728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371bbc2f-1f4a-403b-b5c6-68827b9e5252 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:16.432874 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3464/6860] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:20:16.436913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5fa1cb-8daa-4e53-88e3-479f0f262cb5 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:16.447264 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5fa1cb-8daa-4e53-88e3-479f0f262cb5 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:16.463852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe24f6-805a-48cb-bdcb-ceb3d34e8fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:16.464490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe24f6-805a-48cb-bdcb-ceb3d34e8fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:16.465130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe24f6-805a-48cb-bdcb-ceb3d34e8fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:16.465130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe24f6-805a-48cb-bdcb-ceb3d34e8fa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:16.465659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe24f6-805a-48cb-bdcb-ceb3d34e8fa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:16.467860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe24f6-805a-48cb-bdcb-ceb3d34e8fa2 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:16.555943 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371bbc2f-1f4a-403b-b5c6-68827b9e5252 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:16.558837 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-371bbc2f-1f4a-403b-b5c6-68827b9e5252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:16.569220 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3397/6861] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:20:16 2022] POST /identity/v3/projects => generated 377 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:20:16.570744 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe24f6-805a-48cb-bdcb-ceb3d34e8fa2 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:16.587620 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371bbc2f-1f4a-403b-b5c6-68827b9e5252 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:16.737760 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe24f6-805a-48cb-bdcb-ceb3d34e8fa2 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:16.752936 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356de69-6ea9-49e2-80d8-9aea5ecedfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:16.753268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1dd4f5-655e-477a-8263-536e73519944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:16.753906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dd4f5-655e-477a-8263-536e73519944 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:16.754213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dd4f5-655e-477a-8263-536e73519944 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:16.754493 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dd4f5-655e-477a-8263-536e73519944 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:16.755161 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1dd4f5-655e-477a-8263-536e73519944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:16.756029 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356de69-6ea9-49e2-80d8-9aea5ecedfe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:16.756559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356de69-6ea9-49e2-80d8-9aea5ecedfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:16.757104 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356de69-6ea9-49e2-80d8-9aea5ecedfe1 admin admin] PATH_INFO: `/v3/projects/ef6b2f97416146d1ae71892d00336d16` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:16.757312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1dd4f5-655e-477a-8263-536e73519944 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:16.760437 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356de69-6ea9-49e2-80d8-9aea5ecedfe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef6b2f97416146d1ae71892d00336d16)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:16.763359 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356de69-6ea9-49e2-80d8-9aea5ecedfe1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:16.800970 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3398/6862] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:20:16 2022] POST /identity/v3/users => generated 289 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:20:16.805055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1dd4f5-655e-477a-8263-536e73519944 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:16.820543 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1dd4f5-655e-477a-8263-536e73519944 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:16.832876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf64a2-7d70-4787-9fcf-7919bd75392e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:16.833690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf64a2-7d70-4787-9fcf-7919bd75392e admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:16.833971 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf64a2-7d70-4787-9fcf-7919bd75392e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:16.834246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf64a2-7d70-4787-9fcf-7919bd75392e admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:16.835118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf64a2-7d70-4787-9fcf-7919bd75392e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:16.836752 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf64a2-7d70-4787-9fcf-7919bd75392e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:16.871574 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3399/6863] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:20:16.875915 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf64a2-7d70-4787-9fcf-7919bd75392e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:16.893973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c356de69-6ea9-49e2-80d8-9aea5ecedfe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef6b2f97416146d1ae71892d00336d16', 'request_id': 'req-c356de69-6ea9-49e2-80d8-9aea5ecedfe1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:16.922199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c356de69-6ea9-49e2-80d8-9aea5ecedfe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef6b2f97416146d1ae71892d00336d16', 'request_id': 'req-c356de69-6ea9-49e2-80d8-9aea5ecedfe1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:16.925502 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf64a2-7d70-4787-9fcf-7919bd75392e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:16.949758 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c356de69-6ea9-49e2-80d8-9aea5ecedfe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef6b2f97416146d1ae71892d00336d16', 'request_id': 'req-c356de69-6ea9-49e2-80d8-9aea5ecedfe1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:16.971417 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c356de69-6ea9-49e2-80d8-9aea5ecedfe1 admin admin] The token cache is being invalidate because project ef6b2f97416146d1ae71892d00336d16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:20:16.971715 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c356de69-6ea9-49e2-80d8-9aea5ecedfe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:16.973213 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c356de69-6ea9-49e2-80d8-9aea5ecedfe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:16.977671 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3465/6864] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:20:16 2022] DELETE /identity/v3/projects/ef6b2f97416146d1ae71892d00336d16 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:20:16.979017 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356de69-6ea9-49e2-80d8-9aea5ecedfe1 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:16.983631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c356de69-6ea9-49e2-80d8-9aea5ecedfe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:17.041125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:17.064753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:17.121780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519e86f-790a-4eb1-ae7a-8f0536d78c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:17.122420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519e86f-790a-4eb1-ae7a-8f0536d78c9a admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:17.122748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519e86f-790a-4eb1-ae7a-8f0536d78c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:17.123030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519e86f-790a-4eb1-ae7a-8f0536d78c9a admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:17.123959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e519e86f-790a-4eb1-ae7a-8f0536d78c9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:17.125608 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e519e86f-790a-4eb1-ae7a-8f0536d78c9a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:17.165600 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3400/6865] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:20:17.167547 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519e86f-790a-4eb1-ae7a-8f0536d78c9a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:17.173895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e519e86f-790a-4eb1-ae7a-8f0536d78c9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:17.202118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519e86f-790a-4eb1-ae7a-8f0536d78c9a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:17.215121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356de69-6ea9-49e2-80d8-9aea5ecedfe1 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:17.216497 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b64090-8ac1-4746-82ca-b3d86b889874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:17.217193 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b64090-8ac1-4746-82ca-b3d86b889874 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:17.217470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b64090-8ac1-4746-82ca-b3d86b889874 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:17.217757 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b64090-8ac1-4746-82ca-b3d86b889874 admin admin] PATH_INFO: `/v3/projects/40a2417403a240d99ac13773e48a25ed/users/ed381c6b7448490c9f3979d38d9d2551/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:17.228449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f57f4c-62f9-4321-98e1-82d1975f6709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:17.229114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f57f4c-62f9-4321-98e1-82d1975f6709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:17.229396 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f57f4c-62f9-4321-98e1-82d1975f6709 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:17.229673 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f57f4c-62f9-4321-98e1-82d1975f6709 admin admin] PATH_INFO: `/v3/users/a13a9656f3c742aaa7950d6dd755df79` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:17.232562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f57f4c-62f9-4321-98e1-82d1975f6709 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a13a9656f3c742aaa7950d6dd755df79)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:17.233889 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f57f4c-62f9-4321-98e1-82d1975f6709 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:17.288830 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b64090-8ac1-4746-82ca-b3d86b889874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40a2417403a240d99ac13773e48a25ed, user_id=ed381c6b7448490c9f3979d38d9d2551, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:17.303311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b64090-8ac1-4746-82ca-b3d86b889874 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:17.342594 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3401/6866] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:20:17 2022] PUT /identity/v3/projects/40a2417403a240d99ac13773e48a25ed/users/ed381c6b7448490c9f3979d38d9d2551/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:20:17.345822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15046d-60e3-48db-91fa-d70e9e3c0714 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:17.346111 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15046d-60e3-48db-91fa-d70e9e3c0714 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:17.346390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15046d-60e3-48db-91fa-d70e9e3c0714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:17.375117 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e5f57f4c-62f9-4321-98e1-82d1975f6709 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a13a9656f3c742aaa7950d6dd755df79'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:17.401291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e5f57f4c-62f9-4321-98e1-82d1975f6709 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a13a9656f3c742aaa7950d6dd755df79'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:17.401291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e5f57f4c-62f9-4321-98e1-82d1975f6709 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a13a9656f3c742aaa7950d6dd755df79'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:17.401907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e5f57f4c-62f9-4321-98e1-82d1975f6709 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a13a9656f3c742aaa7950d6dd755df79'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:17.415656 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-7e15046d-60e3-48db-91fa-d70e9e3c0714 None None] MFA Rules not processed for user `ed381c6b7448490c9f3979d38d9d2551`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:17.418400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7e15046d-60e3-48db-91fa-d70e9e3c0714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:17.419423 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e5f57f4c-62f9-4321-98e1-82d1975f6709 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a13a9656f3c742aaa7950d6dd755df79'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:17.461813 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3466/6867] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:20:16 2022] DELETE /identity/v3/users/a13a9656f3c742aaa7950d6dd755df79 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:20:17.614414 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3402/6868] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:20:17.743681 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f57f4c-62f9-4321-98e1-82d1975f6709 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:17.745316 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e5f57f4c-62f9-4321-98e1-82d1975f6709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:17.913551 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f57f4c-62f9-4321-98e1-82d1975f6709 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:17.924927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0dd77c-23fc-4bd7-8db0-5d2e89cf5af3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:17.925560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0dd77c-23fc-4bd7-8db0-5d2e89cf5af3 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:17.925842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0dd77c-23fc-4bd7-8db0-5d2e89cf5af3 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:17.926119 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0dd77c-23fc-4bd7-8db0-5d2e89cf5af3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:18.072770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:18.112177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0dd77c-23fc-4bd7-8db0-5d2e89cf5af3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:18.113649 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0dd77c-23fc-4bd7-8db0-5d2e89cf5af3 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:18.137272 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3467/6869] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:20:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:20:19.323677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15046d-60e3-48db-91fa-d70e9e3c0714 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:19.325667 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7e15046d-60e3-48db-91fa-d70e9e3c0714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:19.554374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15046d-60e3-48db-91fa-d70e9e3c0714 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:19.704329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:19.735518 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc86ed-ffa0-46e9-ae95-f852ae11074b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:19.736193 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc86ed-ffa0-46e9-ae95-f852ae11074b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:19.736504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc86ed-ffa0-46e9-ae95-f852ae11074b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:19.736795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc86ed-ffa0-46e9-ae95-f852ae11074b admin admin] PATH_INFO: `/v3/projects/ed8d4e989ced4f918e2812ec41f14ccb` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:19.739062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc86ed-ffa0-46e9-ae95-f852ae11074b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed8d4e989ced4f918e2812ec41f14ccb)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:19.741110 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc86ed-ffa0-46e9-ae95-f852ae11074b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:19.939738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8edc86ed-ffa0-46e9-ae95-f852ae11074b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed8d4e989ced4f918e2812ec41f14ccb', 'request_id': 'req-8edc86ed-ffa0-46e9-ae95-f852ae11074b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:19.957463 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8edc86ed-ffa0-46e9-ae95-f852ae11074b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed8d4e989ced4f918e2812ec41f14ccb', 'request_id': 'req-8edc86ed-ffa0-46e9-ae95-f852ae11074b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:19.976494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8edc86ed-ffa0-46e9-ae95-f852ae11074b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed8d4e989ced4f918e2812ec41f14ccb', 'request_id': 'req-8edc86ed-ffa0-46e9-ae95-f852ae11074b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:20.035679 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8edc86ed-ffa0-46e9-ae95-f852ae11074b admin admin] The token cache is being invalidate because project ed8d4e989ced4f918e2812ec41f14ccb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:20:20.036003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8edc86ed-ffa0-46e9-ae95-f852ae11074b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:20.038729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8edc86ed-ffa0-46e9-ae95-f852ae11074b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:20.048795 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3403/6870] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:20:19 2022] DELETE /identity/v3/projects/ed8d4e989ced4f918e2812ec41f14ccb => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:20:20.055045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd0690-4b77-44b5-ab54-3501fc2af57d None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:20.055951 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd0690-4b77-44b5-ab54-3501fc2af57d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:20.056400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd0690-4b77-44b5-ab54-3501fc2af57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:20.095262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-30cd0690-4b77-44b5-ab54-3501fc2af57d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:20.096523 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-30cd0690-4b77-44b5-ab54-3501fc2af57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:20.250013 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3468/6871] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:20:20.259387 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4905b4-b484-4575-99e7-319d6cef29d0 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:20.259679 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4905b4-b484-4575-99e7-319d6cef29d0 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:20.259961 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4905b4-b484-4575-99e7-319d6cef29d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:20.296666 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-8a4905b4-b484-4575-99e7-319d6cef29d0 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:20.298413 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8a4905b4-b484-4575-99e7-319d6cef29d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:20.340274 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3404/6872] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:20:20.341534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd0690-4b77-44b5-ab54-3501fc2af57d None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:20.354995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd0690-4b77-44b5-ab54-3501fc2af57d None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:20.370120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995d54b-c7e1-4d1a-ad5c-eea8c066fe30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:20.370796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995d54b-c7e1-4d1a-ad5c-eea8c066fe30 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:20.371079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995d54b-c7e1-4d1a-ad5c-eea8c066fe30 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:20.371353 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995d54b-c7e1-4d1a-ad5c-eea8c066fe30 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:20.372079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995d54b-c7e1-4d1a-ad5c-eea8c066fe30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:20:20.372390 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995d54b-c7e1-4d1a-ad5c-eea8c066fe30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:20.374098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995d54b-c7e1-4d1a-ad5c-eea8c066fe30 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:20.387753 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3469/6873] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:20:20.394363 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4905b4-b484-4575-99e7-319d6cef29d0 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:20.405819 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4905b4-b484-4575-99e7-319d6cef29d0 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:20.420878 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b884ac-c72f-4e83-b5c4-a5b491fbd66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:20.422579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b884ac-c72f-4e83-b5c4-a5b491fbd66a admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:20.422579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b884ac-c72f-4e83-b5c4-a5b491fbd66a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:20.422979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b884ac-c72f-4e83-b5c4-a5b491fbd66a admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:20.423779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b884ac-c72f-4e83-b5c4-a5b491fbd66a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:20.431993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b884ac-c72f-4e83-b5c4-a5b491fbd66a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:20.489657 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3405/6874] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:20:20 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:20:20.493421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995d54b-c7e1-4d1a-ad5c-eea8c066fe30 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:20.514415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995d54b-c7e1-4d1a-ad5c-eea8c066fe30 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:20.611903 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab2df2-7c0e-473d-8af5-ce8787461f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:20.617171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab2df2-7c0e-473d-8af5-ce8787461f9b admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:20.619411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab2df2-7c0e-473d-8af5-ce8787461f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:20.620008 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab2df2-7c0e-473d-8af5-ce8787461f9b admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:20.623328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ab2df2-7c0e-473d-8af5-ce8787461f9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:20.626245 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ab2df2-7c0e-473d-8af5-ce8787461f9b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:20.679349 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3470/6875] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:20:20 2022] POST /identity/v3/users => generated 291 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:20:20.683169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b884ac-c72f-4e83-b5c4-a5b491fbd66a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:20.707113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b884ac-c72f-4e83-b5c4-a5b491fbd66a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:20.718248 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8c740-c01f-46bc-b9a2-fcd857c4e928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:20.722296 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8c740-c01f-46bc-b9a2-fcd857c4e928 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:20.722751 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8c740-c01f-46bc-b9a2-fcd857c4e928 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:20.723148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8c740-c01f-46bc-b9a2-fcd857c4e928 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:20.723951 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8c740-c01f-46bc-b9a2-fcd857c4e928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:20.727554 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8c740-c01f-46bc-b9a2-fcd857c4e928 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:20.760032 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3406/6876] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:20:20.761398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab2df2-7c0e-473d-8af5-ce8787461f9b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:20.775683 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab2df2-7c0e-473d-8af5-ce8787461f9b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:20.803309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a867c-08b9-41a2-a336-7bc51f9a00c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:20.804482 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a867c-08b9-41a2-a336-7bc51f9a00c3 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:20.804877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a867c-08b9-41a2-a336-7bc51f9a00c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:20.805267 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a867c-08b9-41a2-a336-7bc51f9a00c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:20.806058 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a867c-08b9-41a2-a336-7bc51f9a00c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:20.815792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a867c-08b9-41a2-a336-7bc51f9a00c3 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:20.847093 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3471/6877] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:20:20.848338 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8c740-c01f-46bc-b9a2-fcd857c4e928 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:20.862368 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8c740-c01f-46bc-b9a2-fcd857c4e928 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:20.873904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057a673-e4df-4b8b-b045-0a919ee5a5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:20.877110 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057a673-e4df-4b8b-b045-0a919ee5a5eb admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:20.877571 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057a673-e4df-4b8b-b045-0a919ee5a5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:20.878569 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057a673-e4df-4b8b-b045-0a919ee5a5eb admin admin] PATH_INFO: `/v3/projects/92773208ca8844d9b32b6c4e2be2b0ce/users/ad9361a4a0c94034b5010bd2ab6d613d/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:20.938746 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057a673-e4df-4b8b-b045-0a919ee5a5eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=92773208ca8844d9b32b6c4e2be2b0ce, user_id=ad9361a4a0c94034b5010bd2ab6d613d, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:20.954950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057a673-e4df-4b8b-b045-0a919ee5a5eb admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:20.999114 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3407/6878] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:20:20 2022] PUT /identity/v3/projects/92773208ca8844d9b32b6c4e2be2b0ce/users/ad9361a4a0c94034b5010bd2ab6d613d/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:20:21.011931 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d411586-3781-4a3a-b6f4-cb91b73d9a91 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:21.017911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d411586-3781-4a3a-b6f4-cb91b73d9a91 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:21.017911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d411586-3781-4a3a-b6f4-cb91b73d9a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:21.077702 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-7d411586-3781-4a3a-b6f4-cb91b73d9a91 None None] MFA Rules not processed for user `ad9361a4a0c94034b5010bd2ab6d613d`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:21.079945 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7d411586-3781-4a3a-b6f4-cb91b73d9a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:21.183773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:21.243712 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3472/6879] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:20:21.245680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057a673-e4df-4b8b-b045-0a919ee5a5eb admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:21.370700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057a673-e4df-4b8b-b045-0a919ee5a5eb admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:21.385324 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba1d39-234d-40ea-b6be-c29cab933ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:21.386063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba1d39-234d-40ea-b6be-c29cab933ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:21.386416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba1d39-234d-40ea-b6be-c29cab933ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:21.386794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba1d39-234d-40ea-b6be-c29cab933ac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:21.387508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba1d39-234d-40ea-b6be-c29cab933ac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:21.389725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba1d39-234d-40ea-b6be-c29cab933ac1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:21.463913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:21.491322 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d411586-3781-4a3a-b6f4-cb91b73d9a91 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:21.491528 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3408/6880] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:20:21 2022] POST /identity/v3/projects => generated 383 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:20:21.514814 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d411586-3781-4a3a-b6f4-cb91b73d9a91 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:21.658851 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0757a4-c7bd-4deb-9a58-2c58fef0217d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:21.659704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0757a4-c7bd-4deb-9a58-2c58fef0217d admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:21.660055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0757a4-c7bd-4deb-9a58-2c58fef0217d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:21.660487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0757a4-c7bd-4deb-9a58-2c58fef0217d admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:21.661129 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0757a4-c7bd-4deb-9a58-2c58fef0217d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:21.682874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0757a4-c7bd-4deb-9a58-2c58fef0217d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:21.728346 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3473/6881] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:20:21 2022] POST /identity/v3/users => generated 298 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:20:21.731804 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba1d39-234d-40ea-b6be-c29cab933ac1 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:21.752180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba1d39-234d-40ea-b6be-c29cab933ac1 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:21.769652 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f801f-ec59-4311-9bdc-e36f2b3da451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:21.771518 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f801f-ec59-4311-9bdc-e36f2b3da451 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:21.771951 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f801f-ec59-4311-9bdc-e36f2b3da451 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:21.772391 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f801f-ec59-4311-9bdc-e36f2b3da451 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:21.773253 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f801f-ec59-4311-9bdc-e36f2b3da451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:21.774980 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f801f-ec59-4311-9bdc-e36f2b3da451 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:21.792155 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3409/6882] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:20:21.796778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0757a4-c7bd-4deb-9a58-2c58fef0217d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:21.813560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0757a4-c7bd-4deb-9a58-2c58fef0217d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:21.825911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1ef03-3e7f-49c3-b393-7902c4fb4a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:21.826699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1ef03-3e7f-49c3-b393-7902c4fb4a8a admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:21.827050 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1ef03-3e7f-49c3-b393-7902c4fb4a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:21.827420 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1ef03-3e7f-49c3-b393-7902c4fb4a8a admin admin] PATH_INFO: `/v3/projects/0e8149021087412a9bd359344ed72911/users/b415b9ddf80b4f30a8df0a74f5e4b1d9/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:21.874591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1ef03-3e7f-49c3-b393-7902c4fb4a8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e8149021087412a9bd359344ed72911, user_id=b415b9ddf80b4f30a8df0a74f5e4b1d9, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:21.884533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1ef03-3e7f-49c3-b393-7902c4fb4a8a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:21.934302 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3474/6883] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:20:21 2022] PUT /identity/v3/projects/0e8149021087412a9bd359344ed72911/users/b415b9ddf80b4f30a8df0a74f5e4b1d9/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:20:21.936608 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f801f-ec59-4311-9bdc-e36f2b3da451 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:21.956390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f801f-ec59-4311-9bdc-e36f2b3da451 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:22.139238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a466c-ffac-472f-b778-9c9f46814953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:22.139921 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a466c-ffac-472f-b778-9c9f46814953 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:22.140208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a466c-ffac-472f-b778-9c9f46814953 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:22.140528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a466c-ffac-472f-b778-9c9f46814953 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:22.141596 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a466c-ffac-472f-b778-9c9f46814953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:22.143375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a466c-ffac-472f-b778-9c9f46814953 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:22.162253 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1ef03-3e7f-49c3-b393-7902c4fb4a8a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:22.191188 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3410/6884] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:20:22.200196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1ef03-3e7f-49c3-b393-7902c4fb4a8a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:22.226206 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084d2bd-c3db-4a0f-af0d-cdd17b9424b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:22.239078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084d2bd-c3db-4a0f-af0d-cdd17b9424b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:22.239941 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084d2bd-c3db-4a0f-af0d-cdd17b9424b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:22.240329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084d2bd-c3db-4a0f-af0d-cdd17b9424b4 admin admin] PATH_INFO: `/v3/projects/0e8149021087412a9bd359344ed72911/users/b415b9ddf80b4f30a8df0a74f5e4b1d9/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:22.243686 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084d2bd-c3db-4a0f-af0d-cdd17b9424b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e8149021087412a9bd359344ed72911, user_id=b415b9ddf80b4f30a8df0a74f5e4b1d9, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:22.246733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084d2bd-c3db-4a0f-af0d-cdd17b9424b4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:22.270403 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3475/6885] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:20:22 2022] PUT /identity/v3/projects/0e8149021087412a9bd359344ed72911/users/b415b9ddf80b4f30a8df0a74f5e4b1d9/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:20:22.272758 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95967af-d620-4414-ab54-a0996f6f7dd1 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:22.272758 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95967af-d620-4414-ab54-a0996f6f7dd1 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:22.273145 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95967af-d620-4414-ab54-a0996f6f7dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:22.316184 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-c95967af-d620-4414-ab54-a0996f6f7dd1 None None] MFA Rules not processed for user `b415b9ddf80b4f30a8df0a74f5e4b1d9`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:22.318365 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c95967af-d620-4414-ab54-a0996f6f7dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:22.434440 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3411/6886] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:22 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:20:22.448261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084d2bd-c3db-4a0f-af0d-cdd17b9424b4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:22.450084 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d084d2bd-c3db-4a0f-af0d-cdd17b9424b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:22.553774 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084d2bd-c3db-4a0f-af0d-cdd17b9424b4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:22.560091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8f41a-7c75-46b3-96df-2ff6210f15e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:22.560910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8f41a-7c75-46b3-96df-2ff6210f15e5 service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:22.561288 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8f41a-7c75-46b3-96df-2ff6210f15e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:22.561941 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8f41a-7c75-46b3-96df-2ff6210f15e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:22.696766 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:22.714328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f8f41a-7c75-46b3-96df-2ff6210f15e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:22.716042 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f8f41a-7c75-46b3-96df-2ff6210f15e5 service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:22.740607 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3476/6887] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:20:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:20:32.265881 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95967af-d620-4414-ab54-a0996f6f7dd1 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:32.269368 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c95967af-d620-4414-ab54-a0996f6f7dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:32.532430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95967af-d620-4414-ab54-a0996f6f7dd1 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:32.565723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d999d3-1eda-4c70-a738-9f25b4a6cf2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:32.567201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d999d3-1eda-4c70-a738-9f25b4a6cf2c service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:32.569066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d999d3-1eda-4c70-a738-9f25b4a6cf2c service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:32.571024 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d999d3-1eda-4c70-a738-9f25b4a6cf2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:32.579423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e6d999d3-1eda-4c70-a738-9f25b4a6cf2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:32.591539 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:32.603448 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d999d3-1eda-4c70-a738-9f25b4a6cf2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:32.605094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d999d3-1eda-4c70-a738-9f25b4a6cf2c service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:32.634169 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3412/6888] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:20:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:20:32.729047 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:33.164210 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8f41a-7c75-46b3-96df-2ff6210f15e5 service cinder] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:33.166614 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-34f8f41a-7c75-46b3-96df-2ff6210f15e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:33.280057 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8f41a-7c75-46b3-96df-2ff6210f15e5 service cinder] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:33.287562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838ce35-107b-410e-8354-f1c6c3c639c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:33.289385 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838ce35-107b-410e-8354-f1c6c3c639c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:33.289672 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838ce35-107b-410e-8354-f1c6c3c639c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:33.289952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838ce35-107b-410e-8354-f1c6c3c639c7 admin admin] PATH_INFO: `/v3/users/ed381c6b7448490c9f3979d38d9d2551` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:33.292411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838ce35-107b-410e-8354-f1c6c3c639c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed381c6b7448490c9f3979d38d9d2551)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:33.294848 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838ce35-107b-410e-8354-f1c6c3c639c7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:33.384012 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6838ce35-107b-410e-8354-f1c6c3c639c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed381c6b7448490c9f3979d38d9d2551'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:33.405610 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6838ce35-107b-410e-8354-f1c6c3c639c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed381c6b7448490c9f3979d38d9d2551'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:33.406776 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6838ce35-107b-410e-8354-f1c6c3c639c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed381c6b7448490c9f3979d38d9d2551'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:33.407850 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6838ce35-107b-410e-8354-f1c6c3c639c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed381c6b7448490c9f3979d38d9d2551'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:33.419931 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6838ce35-107b-410e-8354-f1c6c3c639c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed381c6b7448490c9f3979d38d9d2551'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:33.518111 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3477/6889] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:20:33 2022] DELETE /identity/v3/users/ed381c6b7448490c9f3979d38d9d2551 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:20:33.522885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c3754-9b67-43da-9863-46e8a53e785c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:33.523355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c3754-9b67-43da-9863-46e8a53e785c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:33.523653 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c3754-9b67-43da-9863-46e8a53e785c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:33.576130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-594c3754-9b67-43da-9863-46e8a53e785c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:33.577722 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-594c3754-9b67-43da-9863-46e8a53e785c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:33.728599 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3413/6890] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:20:33.745515 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838ce35-107b-410e-8354-f1c6c3c639c7 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:33.747233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6838ce35-107b-410e-8354-f1c6c3c639c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:33.872930 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838ce35-107b-410e-8354-f1c6c3c639c7 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:33.879045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb548a3-c08c-4c23-92e0-f850e247f0d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:33.879816 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb548a3-c08c-4c23-92e0-f850e247f0d9 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:33.880207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb548a3-c08c-4c23-92e0-f850e247f0d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:33.880601 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb548a3-c08c-4c23-92e0-f850e247f0d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:33.891646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb548a3-c08c-4c23-92e0-f850e247f0d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:33.893215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb548a3-c08c-4c23-92e0-f850e247f0d9 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:33.917502 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3478/6891] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:20:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:20:34.916331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c3754-9b67-43da-9863-46e8a53e785c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:34.918795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-594c3754-9b67-43da-9863-46e8a53e785c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:34.950873 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c3754-9b67-43da-9863-46e8a53e785c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:34.962789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ee806-5127-44db-ac27-6a8e2de06e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:34.963539 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ee806-5127-44db-ac27-6a8e2de06e20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:34.965136 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ee806-5127-44db-ac27-6a8e2de06e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:34.965451 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ee806-5127-44db-ac27-6a8e2de06e20 admin admin] PATH_INFO: `/v3/projects/40a2417403a240d99ac13773e48a25ed` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:34.971345 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ee806-5127-44db-ac27-6a8e2de06e20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40a2417403a240d99ac13773e48a25ed)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:34.974258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ee806-5127-44db-ac27-6a8e2de06e20 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:35.088715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2d2ee806-5127-44db-ac27-6a8e2de06e20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40a2417403a240d99ac13773e48a25ed', 'request_id': 'req-2d2ee806-5127-44db-ac27-6a8e2de06e20'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:35.114199 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2d2ee806-5127-44db-ac27-6a8e2de06e20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40a2417403a240d99ac13773e48a25ed', 'request_id': 'req-2d2ee806-5127-44db-ac27-6a8e2de06e20'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:35.126442 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2d2ee806-5127-44db-ac27-6a8e2de06e20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40a2417403a240d99ac13773e48a25ed', 'request_id': 'req-2d2ee806-5127-44db-ac27-6a8e2de06e20'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:35.160127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2d2ee806-5127-44db-ac27-6a8e2de06e20 admin admin] The token cache is being invalidate because project 40a2417403a240d99ac13773e48a25ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:20:35.160284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2d2ee806-5127-44db-ac27-6a8e2de06e20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:35.164334 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2d2ee806-5127-44db-ac27-6a8e2de06e20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:35.165970 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3414/6892] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:20:34 2022] DELETE /identity/v3/projects/40a2417403a240d99ac13773e48a25ed => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:20:35.173521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3d491-c532-4e08-9a48-e9f96ef41b83 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:35.174890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3d491-c532-4e08-9a48-e9f96ef41b83 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:35.174890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3d491-c532-4e08-9a48-e9f96ef41b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:35.235749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-c2b3d491-c532-4e08-9a48-e9f96ef41b83 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:35.241968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c2b3d491-c532-4e08-9a48-e9f96ef41b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:35.264043 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:35.395217 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3479/6893] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:20:35.403593 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db8b2c-0ea6-4e15-ad48-1089248462fe None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:35.403883 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db8b2c-0ea6-4e15-ad48-1089248462fe None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:35.404157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db8b2c-0ea6-4e15-ad48-1089248462fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:35.443772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-66db8b2c-0ea6-4e15-ad48-1089248462fe None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:35.445559 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-66db8b2c-0ea6-4e15-ad48-1089248462fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:35.464774 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3415/6894] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:20:35.471826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b3d491-c532-4e08-9a48-e9f96ef41b83 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:35.496176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b3d491-c532-4e08-9a48-e9f96ef41b83 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:35.504138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f7321-6fdb-4f6e-9631-e4c96cd19677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:35.504937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f7321-6fdb-4f6e-9631-e4c96cd19677 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:35.505350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f7321-6fdb-4f6e-9631-e4c96cd19677 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:35.505636 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f7321-6fdb-4f6e-9631-e4c96cd19677 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:35.506273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f7321-6fdb-4f6e-9631-e4c96cd19677 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:20:35.506605 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f7321-6fdb-4f6e-9631-e4c96cd19677 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:35.508194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f7321-6fdb-4f6e-9631-e4c96cd19677 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:35.525589 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3480/6895] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:20:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:20:35.527112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db8b2c-0ea6-4e15-ad48-1089248462fe None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:35.537560 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db8b2c-0ea6-4e15-ad48-1089248462fe None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:35.545554 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25da0e-3ff9-49b0-bbed-9bb1ab7a6037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:35.547945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25da0e-3ff9-49b0-bbed-9bb1ab7a6037 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:35.548227 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25da0e-3ff9-49b0-bbed-9bb1ab7a6037 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:35.548500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25da0e-3ff9-49b0-bbed-9bb1ab7a6037 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:35.549143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25da0e-3ff9-49b0-bbed-9bb1ab7a6037 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:35.553196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25da0e-3ff9-49b0-bbed-9bb1ab7a6037 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:35.617244 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3416/6896] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:20:35 2022] POST /identity/v3/projects => generated 403 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:20:35.621247 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f7321-6fdb-4f6e-9631-e4c96cd19677 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:35.634863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f7321-6fdb-4f6e-9631-e4c96cd19677 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:35.727470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5bc3fe-befb-41a5-87f8-9ba99f063d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:35.728290 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5bc3fe-befb-41a5-87f8-9ba99f063d0d admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:35.728731 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5bc3fe-befb-41a5-87f8-9ba99f063d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:35.729010 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5bc3fe-befb-41a5-87f8-9ba99f063d0d admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:35.729646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5bc3fe-befb-41a5-87f8-9ba99f063d0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:35.731659 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5bc3fe-befb-41a5-87f8-9ba99f063d0d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:35.758104 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3481/6897] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:20:35 2022] POST /identity/v3/users => generated 302 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:20:35.762468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25da0e-3ff9-49b0-bbed-9bb1ab7a6037 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:35.774952 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25da0e-3ff9-49b0-bbed-9bb1ab7a6037 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:35.780814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8a8d7-ca34-4fd4-b942-ad7700e268b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:35.781844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8a8d7-ca34-4fd4-b942-ad7700e268b5 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:35.782248 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8a8d7-ca34-4fd4-b942-ad7700e268b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:35.782824 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8a8d7-ca34-4fd4-b942-ad7700e268b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:35.783503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8a8d7-ca34-4fd4-b942-ad7700e268b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:35.785324 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8a8d7-ca34-4fd4-b942-ad7700e268b5 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:35.809828 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3417/6898] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:20:35.810094 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5bc3fe-befb-41a5-87f8-9ba99f063d0d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:35.822306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5bc3fe-befb-41a5-87f8-9ba99f063d0d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:35.829350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25804773-1a76-4e8d-aa2b-38cc5498c3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:35.830222 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25804773-1a76-4e8d-aa2b-38cc5498c3db admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:35.830626 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25804773-1a76-4e8d-aa2b-38cc5498c3db admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:35.831011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25804773-1a76-4e8d-aa2b-38cc5498c3db admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:35.832228 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25804773-1a76-4e8d-aa2b-38cc5498c3db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:35.834217 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25804773-1a76-4e8d-aa2b-38cc5498c3db admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:35.849649 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3482/6899] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:20:35.850827 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8a8d7-ca34-4fd4-b942-ad7700e268b5 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:35.868100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8a8d7-ca34-4fd4-b942-ad7700e268b5 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:35.877053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e043195-a7da-4dd6-a1b1-1e45962a4d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:35.878225 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e043195-a7da-4dd6-a1b1-1e45962a4d4c admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:35.878225 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e043195-a7da-4dd6-a1b1-1e45962a4d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:35.878439 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e043195-a7da-4dd6-a1b1-1e45962a4d4c admin admin] PATH_INFO: `/v3/projects/85933e4fc7ec4923b4d91bd68a22635c/users/068efb6f475a418bb5ee9da888b271de/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:35.897879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e043195-a7da-4dd6-a1b1-1e45962a4d4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=85933e4fc7ec4923b4d91bd68a22635c, user_id=068efb6f475a418bb5ee9da888b271de, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:35.900844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e043195-a7da-4dd6-a1b1-1e45962a4d4c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:35.919213 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3418/6900] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:20:35 2022] PUT /identity/v3/projects/85933e4fc7ec4923b4d91bd68a22635c/users/068efb6f475a418bb5ee9da888b271de/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:20:35.930962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814fb44-a7c0-48f5-8742-01dc9b8847fe None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:35.931392 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814fb44-a7c0-48f5-8742-01dc9b8847fe None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:35.931730 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814fb44-a7c0-48f5-8742-01dc9b8847fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:35.964055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-5814fb44-a7c0-48f5-8742-01dc9b8847fe None None] MFA Rules not processed for user `068efb6f475a418bb5ee9da888b271de`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:35.965291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5814fb44-a7c0-48f5-8742-01dc9b8847fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:36.040085 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3483/6901] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:35 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:20:36.045575 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e043195-a7da-4dd6-a1b1-1e45962a4d4c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:36.064157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:36.118443 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e043195-a7da-4dd6-a1b1-1e45962a4d4c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:36.123114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ec021-083f-4248-ac10-09ba74e9e078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:36.123727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ec021-083f-4248-ac10-09ba74e9e078 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:36.124009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ec021-083f-4248-ac10-09ba74e9e078 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:36.124365 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ec021-083f-4248-ac10-09ba74e9e078 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:36.124986 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ec021-083f-4248-ac10-09ba74e9e078 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:36.127110 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ec021-083f-4248-ac10-09ba74e9e078 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:36.162579 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3419/6902] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:20:36 2022] POST /identity/v3/projects => generated 405 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:20:36.163954 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814fb44-a7c0-48f5-8742-01dc9b8847fe None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:36.175860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814fb44-a7c0-48f5-8742-01dc9b8847fe None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:36.190272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:36.240558 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add25673-2590-4140-a119-21e8c0610d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:36.241992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add25673-2590-4140-a119-21e8c0610d29 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:36.241992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add25673-2590-4140-a119-21e8c0610d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:36.241992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add25673-2590-4140-a119-21e8c0610d29 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:36.242726 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add25673-2590-4140-a119-21e8c0610d29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:36.245019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add25673-2590-4140-a119-21e8c0610d29 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:36.269156 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3484/6903] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:20:36 2022] POST /identity/v3/users => generated 309 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:20:36.273136 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ec021-083f-4248-ac10-09ba74e9e078 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:36.284321 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ec021-083f-4248-ac10-09ba74e9e078 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:36.290340 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33313d49-dffe-4ba8-944d-210ac0fca52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:36.291122 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33313d49-dffe-4ba8-944d-210ac0fca52d admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:36.291419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33313d49-dffe-4ba8-944d-210ac0fca52d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:36.291725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33313d49-dffe-4ba8-944d-210ac0fca52d admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:36.292377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33313d49-dffe-4ba8-944d-210ac0fca52d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:36.294018 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33313d49-dffe-4ba8-944d-210ac0fca52d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:36.314970 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3420/6904] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:20:36.319214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add25673-2590-4140-a119-21e8c0610d29 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:36.330171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add25673-2590-4140-a119-21e8c0610d29 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:36.335413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae73763-2504-460b-ba44-246b088c3897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:36.336094 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae73763-2504-460b-ba44-246b088c3897 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:36.336374 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae73763-2504-460b-ba44-246b088c3897 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:36.336649 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae73763-2504-460b-ba44-246b088c3897 admin admin] PATH_INFO: `/v3/projects/04ebd2bad9ab49bdaa7d636d55fb6279/users/073f599b07144172ac972f228133c024/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:36.366965 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae73763-2504-460b-ba44-246b088c3897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04ebd2bad9ab49bdaa7d636d55fb6279, user_id=073f599b07144172ac972f228133c024, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:36.370116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae73763-2504-460b-ba44-246b088c3897 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:36.387537 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3485/6905] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:20:36 2022] PUT /identity/v3/projects/04ebd2bad9ab49bdaa7d636d55fb6279/users/073f599b07144172ac972f228133c024/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:20:36.392416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33313d49-dffe-4ba8-944d-210ac0fca52d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:36.404748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33313d49-dffe-4ba8-944d-210ac0fca52d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:36.490825 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4858e-826d-45ac-ba39-5c3e68d0305e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:36.491678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4858e-826d-45ac-ba39-5c3e68d0305e admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:36.491986 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4858e-826d-45ac-ba39-5c3e68d0305e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:36.492246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4858e-826d-45ac-ba39-5c3e68d0305e admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:36.492896 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa4858e-826d-45ac-ba39-5c3e68d0305e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:36.495265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa4858e-826d-45ac-ba39-5c3e68d0305e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:36.510197 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3421/6906] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:20:36.514635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae73763-2504-460b-ba44-246b088c3897 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:36.533877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae73763-2504-460b-ba44-246b088c3897 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:36.541026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd978c47-4056-4e0a-98f6-5d3ae66ff7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:36.542175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd978c47-4056-4e0a-98f6-5d3ae66ff7c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:36.542572 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd978c47-4056-4e0a-98f6-5d3ae66ff7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:36.542974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd978c47-4056-4e0a-98f6-5d3ae66ff7c8 admin admin] PATH_INFO: `/v3/projects/04ebd2bad9ab49bdaa7d636d55fb6279/users/073f599b07144172ac972f228133c024/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:36.545510 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd978c47-4056-4e0a-98f6-5d3ae66ff7c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04ebd2bad9ab49bdaa7d636d55fb6279, user_id=073f599b07144172ac972f228133c024, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:36.549446 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd978c47-4056-4e0a-98f6-5d3ae66ff7c8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:36.566583 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3486/6907] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:20:36 2022] PUT /identity/v3/projects/04ebd2bad9ab49bdaa7d636d55fb6279/users/073f599b07144172ac972f228133c024/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:20:36.578602 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf92ded-6dd8-4a84-8125-51493c72222b None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:36.578911 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf92ded-6dd8-4a84-8125-51493c72222b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:36.579228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf92ded-6dd8-4a84-8125-51493c72222b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:36.609181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-6bf92ded-6dd8-4a84-8125-51493c72222b None None] MFA Rules not processed for user `073f599b07144172ac972f228133c024`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:36.610405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6bf92ded-6dd8-4a84-8125-51493c72222b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:36.727595 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3422/6908] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:36 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:20:36.743088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd978c47-4056-4e0a-98f6-5d3ae66ff7c8 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:36.750426 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-bd978c47-4056-4e0a-98f6-5d3ae66ff7c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:36.900840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd978c47-4056-4e0a-98f6-5d3ae66ff7c8 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:36.911469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d130ef-8843-4551-868a-388d499a9dac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:36.912384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d130ef-8843-4551-868a-388d499a9dac service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:36.912826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d130ef-8843-4551-868a-388d499a9dac service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:36.913380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d130ef-8843-4551-868a-388d499a9dac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:36.926671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d130ef-8843-4551-868a-388d499a9dac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:36.929122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d130ef-8843-4551-868a-388d499a9dac service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:36.956589 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3487/6909] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:20:36 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:20:37.133493 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf92ded-6dd8-4a84-8125-51493c72222b None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:37.158841 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:37.230945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf92ded-6dd8-4a84-8125-51493c72222b None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:37.238036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45732a0e-bb89-4162-a4ac-14dc6c1084e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:37.239322 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45732a0e-bb89-4162-a4ac-14dc6c1084e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:37.239562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45732a0e-bb89-4162-a4ac-14dc6c1084e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:37.239939 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45732a0e-bb89-4162-a4ac-14dc6c1084e6 admin admin] PATH_INFO: `/v3/users/068efb6f475a418bb5ee9da888b271de` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:37.241234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45732a0e-bb89-4162-a4ac-14dc6c1084e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=068efb6f475a418bb5ee9da888b271de)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:37.243529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45732a0e-bb89-4162-a4ac-14dc6c1084e6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:37.305714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-45732a0e-bb89-4162-a4ac-14dc6c1084e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '068efb6f475a418bb5ee9da888b271de'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:37.307636 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-45732a0e-bb89-4162-a4ac-14dc6c1084e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '068efb6f475a418bb5ee9da888b271de'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:37.308419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-45732a0e-bb89-4162-a4ac-14dc6c1084e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '068efb6f475a418bb5ee9da888b271de'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:37.319697 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-45732a0e-bb89-4162-a4ac-14dc6c1084e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '068efb6f475a418bb5ee9da888b271de'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:37.352060 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-45732a0e-bb89-4162-a4ac-14dc6c1084e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '068efb6f475a418bb5ee9da888b271de'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:37.371061 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3423/6910] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:20:37 2022] DELETE /identity/v3/users/068efb6f475a418bb5ee9da888b271de => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:20:37.378238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334cc44-f5cf-4454-a5ef-a95f94d9c6b3 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:37.378238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334cc44-f5cf-4454-a5ef-a95f94d9c6b3 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:37.379042 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334cc44-f5cf-4454-a5ef-a95f94d9c6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:37.408598 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d334cc44-f5cf-4454-a5ef-a95f94d9c6b3 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:37.409731 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d334cc44-f5cf-4454-a5ef-a95f94d9c6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:37.490588 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3488/6911] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:20:37.505728 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45732a0e-bb89-4162-a4ac-14dc6c1084e6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:37.507190 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-45732a0e-bb89-4162-a4ac-14dc6c1084e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:37.596397 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45732a0e-bb89-4162-a4ac-14dc6c1084e6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:37.604615 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a57cb-28fd-4d88-b3e1-6817334c6485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:37.606809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a57cb-28fd-4d88-b3e1-6817334c6485 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:37.607951 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a57cb-28fd-4d88-b3e1-6817334c6485 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:37.609484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a57cb-28fd-4d88-b3e1-6817334c6485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:37.624839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a57cb-28fd-4d88-b3e1-6817334c6485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:37.627090 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a57cb-28fd-4d88-b3e1-6817334c6485 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:37.644011 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3424/6912] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:20:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:20:38.147061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334cc44-f5cf-4454-a5ef-a95f94d9c6b3 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:38.149492 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d334cc44-f5cf-4454-a5ef-a95f94d9c6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:38.176448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334cc44-f5cf-4454-a5ef-a95f94d9c6b3 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:38.187732 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c1c9d-978d-4032-8431-949a3d31325c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:38.188400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c1c9d-978d-4032-8431-949a3d31325c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:38.188749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c1c9d-978d-4032-8431-949a3d31325c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:38.189396 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c1c9d-978d-4032-8431-949a3d31325c admin admin] PATH_INFO: `/v3/projects/85933e4fc7ec4923b4d91bd68a22635c` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:38.190702 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c1c9d-978d-4032-8431-949a3d31325c admin admin] RBAC: Authorizing `identity:delete_project(project_id=85933e4fc7ec4923b4d91bd68a22635c)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:38.192929 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c1c9d-978d-4032-8431-949a3d31325c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:38.206911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:38.269852 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-da0c1c9d-978d-4032-8431-949a3d31325c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85933e4fc7ec4923b4d91bd68a22635c', 'request_id': 'req-da0c1c9d-978d-4032-8431-949a3d31325c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:38.277211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-da0c1c9d-978d-4032-8431-949a3d31325c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85933e4fc7ec4923b4d91bd68a22635c', 'request_id': 'req-da0c1c9d-978d-4032-8431-949a3d31325c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:38.286223 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-da0c1c9d-978d-4032-8431-949a3d31325c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85933e4fc7ec4923b4d91bd68a22635c', 'request_id': 'req-da0c1c9d-978d-4032-8431-949a3d31325c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:38.301678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-da0c1c9d-978d-4032-8431-949a3d31325c admin admin] The token cache is being invalidate because project 85933e4fc7ec4923b4d91bd68a22635c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:20:38.302046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-da0c1c9d-978d-4032-8431-949a3d31325c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:38.302844 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-da0c1c9d-978d-4032-8431-949a3d31325c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:38.307503 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3489/6913] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:20:38 2022] DELETE /identity/v3/projects/85933e4fc7ec4923b4d91bd68a22635c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:20:38.309265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a57cb-28fd-4d88-b3e1-6817334c6485 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:38.326745 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a57cb-28fd-4d88-b3e1-6817334c6485 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:38.379879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:38.459026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476182c1-34c2-40e5-8907-39395b81895f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:38.459798 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476182c1-34c2-40e5-8907-39395b81895f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:38.460129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476182c1-34c2-40e5-8907-39395b81895f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:38.461997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476182c1-34c2-40e5-8907-39395b81895f admin admin] PATH_INFO: `/v3/users/073f599b07144172ac972f228133c024` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:38.463422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476182c1-34c2-40e5-8907-39395b81895f admin admin] RBAC: Authorizing `identity:delete_user(user_id=073f599b07144172ac972f228133c024)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:38.465971 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476182c1-34c2-40e5-8907-39395b81895f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:38.577054 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-476182c1-34c2-40e5-8907-39395b81895f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '073f599b07144172ac972f228133c024'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:38.579082 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-476182c1-34c2-40e5-8907-39395b81895f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '073f599b07144172ac972f228133c024'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:38.579991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-476182c1-34c2-40e5-8907-39395b81895f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '073f599b07144172ac972f228133c024'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:38.598418 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-476182c1-34c2-40e5-8907-39395b81895f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '073f599b07144172ac972f228133c024'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:38.646990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-476182c1-34c2-40e5-8907-39395b81895f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '073f599b07144172ac972f228133c024'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:38.674994 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3425/6914] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:20:38 2022] DELETE /identity/v3/users/073f599b07144172ac972f228133c024 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:20:39.605261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c1c9d-978d-4032-8431-949a3d31325c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:39.607049 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-da0c1c9d-978d-4032-8431-949a3d31325c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:39.621844 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c1c9d-978d-4032-8431-949a3d31325c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:39.648367 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476182c1-34c2-40e5-8907-39395b81895f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:39.650412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-476182c1-34c2-40e5-8907-39395b81895f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:39.781565 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0495bfcf-3d51-4033-baf6-6681ce607409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:39.782370 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495bfcf-3d51-4033-baf6-6681ce607409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:39.782611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495bfcf-3d51-4033-baf6-6681ce607409 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:39.784516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495bfcf-3d51-4033-baf6-6681ce607409 admin admin] PATH_INFO: `/v3/projects/04ebd2bad9ab49bdaa7d636d55fb6279` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:39.786411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0495bfcf-3d51-4033-baf6-6681ce607409 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04ebd2bad9ab49bdaa7d636d55fb6279)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:39.792234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0495bfcf-3d51-4033-baf6-6681ce607409 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:39.845868 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476182c1-34c2-40e5-8907-39395b81895f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:39.851855 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7a6a5-cc25-4e33-b6c3-d8d40b791cc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:39.852800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7a6a5-cc25-4e33-b6c3-d8d40b791cc5 service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:39.853361 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7a6a5-cc25-4e33-b6c3-d8d40b791cc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:39.853826 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7a6a5-cc25-4e33-b6c3-d8d40b791cc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:39.856131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-31f7a6a5-cc25-4e33-b6c3-d8d40b791cc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:39.897544 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0495bfcf-3d51-4033-baf6-6681ce607409 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04ebd2bad9ab49bdaa7d636d55fb6279', 'request_id': 'req-0495bfcf-3d51-4033-baf6-6681ce607409'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:39.908228 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0495bfcf-3d51-4033-baf6-6681ce607409 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04ebd2bad9ab49bdaa7d636d55fb6279', 'request_id': 'req-0495bfcf-3d51-4033-baf6-6681ce607409'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:39.919602 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0495bfcf-3d51-4033-baf6-6681ce607409 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04ebd2bad9ab49bdaa7d636d55fb6279', 'request_id': 'req-0495bfcf-3d51-4033-baf6-6681ce607409'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:39.938649 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0495bfcf-3d51-4033-baf6-6681ce607409 admin admin] The token cache is being invalidate because project 04ebd2bad9ab49bdaa7d636d55fb6279 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:20:39.939596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0495bfcf-3d51-4033-baf6-6681ce607409 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:39.940498 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0495bfcf-3d51-4033-baf6-6681ce607409 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:39.944399 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3490/6915] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:20:39 2022] DELETE /identity/v3/projects/04ebd2bad9ab49bdaa7d636d55fb6279 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:20:39.953294 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f18d07-10e6-44d9-8f17-588c57059fde None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:39.953691 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f18d07-10e6-44d9-8f17-588c57059fde None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:39.954039 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f18d07-10e6-44d9-8f17-588c57059fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:39.960656 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7a6a5-cc25-4e33-b6c3-d8d40b791cc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:39.962068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7a6a5-cc25-4e33-b6c3-d8d40b791cc5 service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:39.971719 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:39.985090 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3426/6916] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:20:39 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:20:39.996678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-90f18d07-10e6-44d9-8f17-588c57059fde None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:39.998187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-90f18d07-10e6-44d9-8f17-588c57059fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:40.047123 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:40.146846 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3491/6917] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:20:40.156592 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3cb0e4-8b47-4ea3-96f2-946ff610914a None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:40.156855 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3cb0e4-8b47-4ea3-96f2-946ff610914a None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:40.157141 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3cb0e4-8b47-4ea3-96f2-946ff610914a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:40.194473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-bc3cb0e4-8b47-4ea3-96f2-946ff610914a None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:40.196445 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-bc3cb0e4-8b47-4ea3-96f2-946ff610914a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:40.213905 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3427/6918] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:20:40.220899 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f18d07-10e6-44d9-8f17-588c57059fde None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:40.237758 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f18d07-10e6-44d9-8f17-588c57059fde None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:40.250909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf57c7-9c91-4bac-8653-cdd91f46c6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:40.251716 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf57c7-9c91-4bac-8653-cdd91f46c6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:40.251999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf57c7-9c91-4bac-8653-cdd91f46c6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:40.252273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf57c7-9c91-4bac-8653-cdd91f46c6b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:40.252936 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf57c7-9c91-4bac-8653-cdd91f46c6b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:20:40.253234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf57c7-9c91-4bac-8653-cdd91f46c6b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:40.259881 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf57c7-9c91-4bac-8653-cdd91f46c6b6 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:40.306657 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3cb0e4-8b47-4ea3-96f2-946ff610914a None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:40.313553 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3492/6919] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:20:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:20:40.318895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3cb0e4-8b47-4ea3-96f2-946ff610914a None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:40.333153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46aebd-157a-460f-859c-4d6664a5bd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:40.345922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46aebd-157a-460f-859c-4d6664a5bd5a admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:40.346289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46aebd-157a-460f-859c-4d6664a5bd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:40.346709 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46aebd-157a-460f-859c-4d6664a5bd5a admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:40.348227 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d46aebd-157a-460f-859c-4d6664a5bd5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:40.353796 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d46aebd-157a-460f-859c-4d6664a5bd5a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:40.431693 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3428/6920] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:20:40 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:20:40.435969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf57c7-9c91-4bac-8653-cdd91f46c6b6 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:40.457261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf57c7-9c91-4bac-8653-cdd91f46c6b6 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:40.640488 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46aebd-157a-460f-859c-4d6664a5bd5a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:40.642620 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9d46aebd-157a-460f-859c-4d6664a5bd5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:40.650073 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16779dad-9261-453c-9d75-1650f7421c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:40.650975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16779dad-9261-453c-9d75-1650f7421c6f admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:40.651332 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16779dad-9261-453c-9d75-1650f7421c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:40.651678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16779dad-9261-453c-9d75-1650f7421c6f admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:40.652382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16779dad-9261-453c-9d75-1650f7421c6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:40.654915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16779dad-9261-453c-9d75-1650f7421c6f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:40.707028 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3493/6921] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:20:40 2022] POST /identity/v3/users => generated 290 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:20:40.708318 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16779dad-9261-453c-9d75-1650f7421c6f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:40.720014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16779dad-9261-453c-9d75-1650f7421c6f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:40.725514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed849025-b7e5-4122-92d5-ea0e4a5392a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:40.726841 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed849025-b7e5-4122-92d5-ea0e4a5392a8 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:40.727397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed849025-b7e5-4122-92d5-ea0e4a5392a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:40.728692 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed849025-b7e5-4122-92d5-ea0e4a5392a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:40.729607 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed849025-b7e5-4122-92d5-ea0e4a5392a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:40.731577 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed849025-b7e5-4122-92d5-ea0e4a5392a8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:40.750585 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3494/6922] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:20:40.751896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed849025-b7e5-4122-92d5-ea0e4a5392a8 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:40.766075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed849025-b7e5-4122-92d5-ea0e4a5392a8 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:40.777860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44c66f-f1ac-49ac-b078-5b18eca45108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:40.778576 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44c66f-f1ac-49ac-b078-5b18eca45108 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:40.778979 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44c66f-f1ac-49ac-b078-5b18eca45108 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:40.779394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44c66f-f1ac-49ac-b078-5b18eca45108 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:40.780981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d44c66f-f1ac-49ac-b078-5b18eca45108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:40.782974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d44c66f-f1ac-49ac-b078-5b18eca45108 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:40.798168 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46aebd-157a-460f-859c-4d6664a5bd5a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:40.800076 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3495/6923] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:20:40.807252 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44c66f-f1ac-49ac-b078-5b18eca45108 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:40.810603 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ba840-e425-445c-b93d-3a2aabbd68f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:40.811255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ba840-e425-445c-b93d-3a2aabbd68f2 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:40.811619 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ba840-e425-445c-b93d-3a2aabbd68f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:40.811903 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ba840-e425-445c-b93d-3a2aabbd68f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:40.816668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-194ba840-e425-445c-b93d-3a2aabbd68f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:40.822042 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44c66f-f1ac-49ac-b078-5b18eca45108 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:40.834119 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700452f3-b5da-4085-93e0-1f1bed26cf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:40.834961 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700452f3-b5da-4085-93e0-1f1bed26cf3b admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:40.835378 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700452f3-b5da-4085-93e0-1f1bed26cf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:40.835634 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700452f3-b5da-4085-93e0-1f1bed26cf3b admin admin] PATH_INFO: `/v3/projects/92abb17a0da74e0cb04f085980d6f5df/users/10c5c40231b54300b0ce3ae12a97488b/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:40.854245 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700452f3-b5da-4085-93e0-1f1bed26cf3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=92abb17a0da74e0cb04f085980d6f5df, user_id=10c5c40231b54300b0ce3ae12a97488b, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:40.857880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700452f3-b5da-4085-93e0-1f1bed26cf3b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:40.868837 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ba840-e425-445c-b93d-3a2aabbd68f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:40.870252 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ba840-e425-445c-b93d-3a2aabbd68f2 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:40.887525 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3496/6924] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:20:40 2022] PUT /identity/v3/projects/92abb17a0da74e0cb04f085980d6f5df/users/10c5c40231b54300b0ce3ae12a97488b/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:20:40.890670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c68d90-e7de-4b4c-b0ff-fb0f1a70a8a0 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:40.890957 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c68d90-e7de-4b4c-b0ff-fb0f1a70a8a0 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:40.891402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c68d90-e7de-4b4c-b0ff-fb0f1a70a8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:40.912592 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3429/6925] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:20:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:20:40.931425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-32c68d90-e7de-4b4c-b0ff-fb0f1a70a8a0 None None] MFA Rules not processed for user `10c5c40231b54300b0ce3ae12a97488b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:40.932806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-32c68d90-e7de-4b4c-b0ff-fb0f1a70a8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:41.000878 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:41.043009 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3497/6926] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:20:41.049180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ba840-e425-445c-b93d-3a2aabbd68f2 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:41.076386 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ba840-e425-445c-b93d-3a2aabbd68f2 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:41.176074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc4274-8fb9-42a3-a7b3-9614c3e72e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:41.176705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc4274-8fb9-42a3-a7b3-9614c3e72e22 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:41.176985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc4274-8fb9-42a3-a7b3-9614c3e72e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:41.177259 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc4274-8fb9-42a3-a7b3-9614c3e72e22 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:41.177888 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc4274-8fb9-42a3-a7b3-9614c3e72e22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:41.179844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc4274-8fb9-42a3-a7b3-9614c3e72e22 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:41.239208 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3430/6927] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:20:41 2022] POST /identity/v3/projects => generated 381 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:20:41.242802 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c68d90-e7de-4b4c-b0ff-fb0f1a70a8a0 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:41.266434 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c68d90-e7de-4b4c-b0ff-fb0f1a70a8a0 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:41.385755 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d587ee-1945-4389-9b9c-04a8aa447e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:41.386649 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d587ee-1945-4389-9b9c-04a8aa447e29 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:41.387074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d587ee-1945-4389-9b9c-04a8aa447e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:41.387490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d587ee-1945-4389-9b9c-04a8aa447e29 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:41.389063 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d587ee-1945-4389-9b9c-04a8aa447e29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:41.391356 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d587ee-1945-4389-9b9c-04a8aa447e29 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:41.424980 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3498/6928] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:20:41 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:20:41.428944 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc4274-8fb9-42a3-a7b3-9614c3e72e22 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:41.457339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc4274-8fb9-42a3-a7b3-9614c3e72e22 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:41.463607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7d050-7b0b-43e5-aa2d-bdc5582483b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:41.464218 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7d050-7b0b-43e5-aa2d-bdc5582483b6 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:41.464504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7d050-7b0b-43e5-aa2d-bdc5582483b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:41.464783 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7d050-7b0b-43e5-aa2d-bdc5582483b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:41.465439 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c7d050-7b0b-43e5-aa2d-bdc5582483b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:41.469504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c7d050-7b0b-43e5-aa2d-bdc5582483b6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:41.504214 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3431/6929] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:20:41.509695 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d587ee-1945-4389-9b9c-04a8aa447e29 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:41.527963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d587ee-1945-4389-9b9c-04a8aa447e29 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:41.541044 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85498ab-221c-458f-8e0a-8e9792850667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:41.542114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85498ab-221c-458f-8e0a-8e9792850667 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:41.542394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85498ab-221c-458f-8e0a-8e9792850667 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:41.542713 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85498ab-221c-458f-8e0a-8e9792850667 admin admin] PATH_INFO: `/v3/projects/79389ba38bac4877a75d06663602634a/users/aa36e3d78cec4d19b0cec2663d2dd709/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:41.566672 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85498ab-221c-458f-8e0a-8e9792850667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79389ba38bac4877a75d06663602634a, user_id=aa36e3d78cec4d19b0cec2663d2dd709, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:41.573704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85498ab-221c-458f-8e0a-8e9792850667 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:41.607335 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3499/6930] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:20:41 2022] PUT /identity/v3/projects/79389ba38bac4877a75d06663602634a/users/aa36e3d78cec4d19b0cec2663d2dd709/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:20:41.610267 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7d050-7b0b-43e5-aa2d-bdc5582483b6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:41.623314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7d050-7b0b-43e5-aa2d-bdc5582483b6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:41.734284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:41.772455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41dfa1-935b-4d86-baf2-9fbe7796e1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:41.773147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41dfa1-935b-4d86-baf2-9fbe7796e1ac admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:41.773520 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41dfa1-935b-4d86-baf2-9fbe7796e1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:41.773884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41dfa1-935b-4d86-baf2-9fbe7796e1ac admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:41.775364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db41dfa1-935b-4d86-baf2-9fbe7796e1ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:41.778773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db41dfa1-935b-4d86-baf2-9fbe7796e1ac admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:41.811026 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3432/6931] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:20:41.816233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85498ab-221c-458f-8e0a-8e9792850667 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:41.850956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85498ab-221c-458f-8e0a-8e9792850667 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:41.856979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0589ea0-1213-4b31-961d-7de76b64731b None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:41.857169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4399fa1-e12e-45de-91d2-3e82960d4e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:41.857274 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0589ea0-1213-4b31-961d-7de76b64731b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:41.857575 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0589ea0-1213-4b31-961d-7de76b64731b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:41.857941 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4399fa1-e12e-45de-91d2-3e82960d4e62 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:41.858251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4399fa1-e12e-45de-91d2-3e82960d4e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:41.858677 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4399fa1-e12e-45de-91d2-3e82960d4e62 admin admin] PATH_INFO: `/v3/projects/79389ba38bac4877a75d06663602634a/users/aa36e3d78cec4d19b0cec2663d2dd709/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:41.861082 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4399fa1-e12e-45de-91d2-3e82960d4e62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79389ba38bac4877a75d06663602634a, user_id=aa36e3d78cec4d19b0cec2663d2dd709, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:41.864820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4399fa1-e12e-45de-91d2-3e82960d4e62 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:41.887612 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3500/6932] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:20:41 2022] PUT /identity/v3/projects/79389ba38bac4877a75d06663602634a/users/aa36e3d78cec4d19b0cec2663d2dd709/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:20:41.893721 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49050e33-25c4-4a55-80e0-ad62e37de27e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:41.894233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49050e33-25c4-4a55-80e0-ad62e37de27e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:41.894876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49050e33-25c4-4a55-80e0-ad62e37de27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:41.911889 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-c0589ea0-1213-4b31-961d-7de76b64731b None None] MFA Rules not processed for user `65e64ff8f2b14f70b1b05327f691701e`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:41.913535 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c0589ea0-1213-4b31-961d-7de76b64731b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:41.955505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-49050e33-25c4-4a55-80e0-ad62e37de27e None None] MFA Rules not processed for user `aa36e3d78cec4d19b0cec2663d2dd709`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:41.956915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-49050e33-25c4-4a55-80e0-ad62e37de27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:42.082999 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3501/6933] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:41 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:20:42.102992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49050e33-25c4-4a55-80e0-ad62e37de27e None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:42.104656 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-49050e33-25c4-4a55-80e0-ad62e37de27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:42.122518 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3433/6934] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:41 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:20:42.159502 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:42.216164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49050e33-25c4-4a55-80e0-ad62e37de27e None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:42.230715 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e686414-ad9d-47fd-8f57-df8d7fb5992d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:42.231354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e686414-ad9d-47fd-8f57-df8d7fb5992d service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:42.231634 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e686414-ad9d-47fd-8f57-df8d7fb5992d service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:42.231928 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e686414-ad9d-47fd-8f57-df8d7fb5992d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:42.250835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e686414-ad9d-47fd-8f57-df8d7fb5992d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:42.256669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e686414-ad9d-47fd-8f57-df8d7fb5992d service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:42.274637 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3502/6935] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:20:42 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:20:42.686786 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0589ea0-1213-4b31-961d-7de76b64731b None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:42.688668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c0589ea0-1213-4b31-961d-7de76b64731b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:42.762634 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0589ea0-1213-4b31-961d-7de76b64731b None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:42.767807 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d24367-27c9-4cb9-ae9c-9e4d3be4b956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:42.768432 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d24367-27c9-4cb9-ae9c-9e4d3be4b956 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:42.768966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d24367-27c9-4cb9-ae9c-9e4d3be4b956 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:42.769413 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d24367-27c9-4cb9-ae9c-9e4d3be4b956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:42.771383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-58d24367-27c9-4cb9-ae9c-9e4d3be4b956 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:42.785933 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d24367-27c9-4cb9-ae9c-9e4d3be4b956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:42.787507 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d24367-27c9-4cb9-ae9c-9e4d3be4b956 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:42.800775 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3434/6936] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:20:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:20:42.855756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e686414-ad9d-47fd-8f57-df8d7fb5992d service cinder] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:42.866147 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e686414-ad9d-47fd-8f57-df8d7fb5992d service cinder] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:42.871207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcafcc2-0403-4ba3-a1cb-daad74fd6418 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa36e3d78cec4d19b0cec2663d2dd709', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79389ba38bac4877a75d06663602634a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:42.872246 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcafcc2-0403-4ba3-a1cb-daad74fd6418 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:42.872246 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcafcc2-0403-4ba3-a1cb-daad74fd6418 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:42.872457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcafcc2-0403-4ba3-a1cb-daad74fd6418 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:42.872990 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcafcc2-0403-4ba3-a1cb-daad74fd6418 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:20:42.873296 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcafcc2-0403-4ba3-a1cb-daad74fd6418 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:42.875089 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcafcc2-0403-4ba3-a1cb-daad74fd6418 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:42.890909 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3503/6937] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:20:42.894900 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d24367-27c9-4cb9-ae9c-9e4d3be4b956 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:42.910979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d24367-27c9-4cb9-ae9c-9e4d3be4b956 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:42.920803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd94d1-5835-48c0-9f6f-882f8ad2a209 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa36e3d78cec4d19b0cec2663d2dd709', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79389ba38bac4877a75d06663602634a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:42.921757 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd94d1-5835-48c0-9f6f-882f8ad2a209 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:42.926171 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd94d1-5835-48c0-9f6f-882f8ad2a209 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:42.926618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd94d1-5835-48c0-9f6f-882f8ad2a209 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:42.927763 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd94d1-5835-48c0-9f6f-882f8ad2a209 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:42.934839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd94d1-5835-48c0-9f6f-882f8ad2a209 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:42.974674 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3435/6938] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:20:42 2022] POST /identity/v3/projects => generated 355 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:20:42.979048 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcafcc2-0403-4ba3-a1cb-daad74fd6418 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:42.990580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcafcc2-0403-4ba3-a1cb-daad74fd6418 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:43.071751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed060a4-7293-4d0c-8bd5-7e50b7692928 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa36e3d78cec4d19b0cec2663d2dd709', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79389ba38bac4877a75d06663602634a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:43.075311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed060a4-7293-4d0c-8bd5-7e50b7692928 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:43.075641 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed060a4-7293-4d0c-8bd5-7e50b7692928 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:43.075926 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed060a4-7293-4d0c-8bd5-7e50b7692928 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:43.076650 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed060a4-7293-4d0c-8bd5-7e50b7692928 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:20:43.077014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed060a4-7293-4d0c-8bd5-7e50b7692928 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:43.078698 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed060a4-7293-4d0c-8bd5-7e50b7692928 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:43.096865 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3504/6939] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:20:43.141907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd94d1-5835-48c0-9f6f-882f8ad2a209 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:43.172744 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd94d1-5835-48c0-9f6f-882f8ad2a209 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:43.185941 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abd441-f51a-471b-ba0b-e5277162a1c7 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa36e3d78cec4d19b0cec2663d2dd709', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79389ba38bac4877a75d06663602634a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:43.186719 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abd441-f51a-471b-ba0b-e5277162a1c7 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:43.187007 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abd441-f51a-471b-ba0b-e5277162a1c7 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:43.188906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abd441-f51a-471b-ba0b-e5277162a1c7 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] PATH_INFO: `/v3/projects/c40787bdaf524afebd356dc95df5eae4` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:43.189931 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12abd441-f51a-471b-ba0b-e5277162a1c7 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c40787bdaf524afebd356dc95df5eae4)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:43.198461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12abd441-f51a-471b-ba0b-e5277162a1c7 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:43.280668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-12abd441-f51a-471b-ba0b-e5277162a1c7 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c40787bdaf524afebd356dc95df5eae4', 'request_id': 'req-12abd441-f51a-471b-ba0b-e5277162a1c7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:43.286878 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:43.288628 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-12abd441-f51a-471b-ba0b-e5277162a1c7 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c40787bdaf524afebd356dc95df5eae4', 'request_id': 'req-12abd441-f51a-471b-ba0b-e5277162a1c7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:43.302445 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-12abd441-f51a-471b-ba0b-e5277162a1c7 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c40787bdaf524afebd356dc95df5eae4', 'request_id': 'req-12abd441-f51a-471b-ba0b-e5277162a1c7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:43.320148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-12abd441-f51a-471b-ba0b-e5277162a1c7 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] The token cache is being invalidate because project c40787bdaf524afebd356dc95df5eae4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:20:43.320452 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-12abd441-f51a-471b-ba0b-e5277162a1c7 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:43.321118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-12abd441-f51a-471b-ba0b-e5277162a1c7 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:43.323079 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3436/6940] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:20:43 2022] DELETE /identity/v3/projects/c40787bdaf524afebd356dc95df5eae4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:20:43.328260 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed060a4-7293-4d0c-8bd5-7e50b7692928 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:43.339749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2ed060a4-7293-4d0c-8bd5-7e50b7692928 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:43.625958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed060a4-7293-4d0c-8bd5-7e50b7692928 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:43.763255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abd441-f51a-471b-ba0b-e5277162a1c7 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:43.766010 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-12abd441-f51a-471b-ba0b-e5277162a1c7 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:43.942823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:43.966791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abd441-f51a-471b-ba0b-e5277162a1c7 tempest-VolumeQuotaClassesTest-1461164399 tempest-VolumeQuotaClassesTest-1461164399-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:43.979696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837be23a-1d2c-461d-bcb7-7d5d8518e819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:43.980439 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837be23a-1d2c-461d-bcb7-7d5d8518e819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:43.980712 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837be23a-1d2c-461d-bcb7-7d5d8518e819 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:43.980977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837be23a-1d2c-461d-bcb7-7d5d8518e819 admin admin] PATH_INFO: `/v3/users/10c5c40231b54300b0ce3ae12a97488b` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:43.982760 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837be23a-1d2c-461d-bcb7-7d5d8518e819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10c5c40231b54300b0ce3ae12a97488b)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:43.984338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc079e-25e2-4935-8794-242c43bb26ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:43.984638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837be23a-1d2c-461d-bcb7-7d5d8518e819 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:43.985398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc079e-25e2-4935-8794-242c43bb26ed service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:43.985863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc079e-25e2-4935-8794-242c43bb26ed service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:43.986632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc079e-25e2-4935-8794-242c43bb26ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:43.991521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e6dc079e-25e2-4935-8794-242c43bb26ed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:44.022789 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc079e-25e2-4935-8794-242c43bb26ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:44.027504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc079e-25e2-4935-8794-242c43bb26ed service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:44.055472 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-837be23a-1d2c-461d-bcb7-7d5d8518e819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10c5c40231b54300b0ce3ae12a97488b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:44.056452 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-837be23a-1d2c-461d-bcb7-7d5d8518e819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10c5c40231b54300b0ce3ae12a97488b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:44.059301 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-837be23a-1d2c-461d-bcb7-7d5d8518e819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10c5c40231b54300b0ce3ae12a97488b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:44.073132 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3505/6941] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:20:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 745 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:20:44.074912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-837be23a-1d2c-461d-bcb7-7d5d8518e819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10c5c40231b54300b0ce3ae12a97488b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:44.105964 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-837be23a-1d2c-461d-bcb7-7d5d8518e819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10c5c40231b54300b0ce3ae12a97488b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:44.151982 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3437/6942] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:20:43 2022] DELETE /identity/v3/users/10c5c40231b54300b0ce3ae12a97488b => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:20:44.153894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6413e-a693-48bc-8b5f-38e411fe75e9 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:44.154510 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6413e-a693-48bc-8b5f-38e411fe75e9 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:44.155552 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6413e-a693-48bc-8b5f-38e411fe75e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:44.196142 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-47a6413e-a693-48bc-8b5f-38e411fe75e9 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:44.197566 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-47a6413e-a693-48bc-8b5f-38e411fe75e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:44.429422 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3506/6943] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:20:44.662645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837be23a-1d2c-461d-bcb7-7d5d8518e819 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:44.664387 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-837be23a-1d2c-461d-bcb7-7d5d8518e819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:44.850302 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837be23a-1d2c-461d-bcb7-7d5d8518e819 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:44.864320 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f866cce-a283-4e90-b642-1d83f05593bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:44.867551 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f866cce-a283-4e90-b642-1d83f05593bc service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:44.867837 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f866cce-a283-4e90-b642-1d83f05593bc service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:44.868262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f866cce-a283-4e90-b642-1d83f05593bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:44.914258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f866cce-a283-4e90-b642-1d83f05593bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:44.916169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f866cce-a283-4e90-b642-1d83f05593bc service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:44.940612 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3438/6944] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:20:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:20:46.256920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6413e-a693-48bc-8b5f-38e411fe75e9 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:46.258671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-47a6413e-a693-48bc-8b5f-38e411fe75e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:46.273930 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6413e-a693-48bc-8b5f-38e411fe75e9 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:46.278653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400c2f8-4ab6-4561-bfc9-dfa61b5b6ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:46.279314 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400c2f8-4ab6-4561-bfc9-dfa61b5b6ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:46.281108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400c2f8-4ab6-4561-bfc9-dfa61b5b6ace admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:46.281409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400c2f8-4ab6-4561-bfc9-dfa61b5b6ace admin admin] PATH_INFO: `/v3/projects/92abb17a0da74e0cb04f085980d6f5df` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:46.283191 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4400c2f8-4ab6-4561-bfc9-dfa61b5b6ace admin admin] RBAC: Authorizing `identity:delete_project(project_id=92abb17a0da74e0cb04f085980d6f5df)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:46.285756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4400c2f8-4ab6-4561-bfc9-dfa61b5b6ace admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:46.372439 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4400c2f8-4ab6-4561-bfc9-dfa61b5b6ace admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92abb17a0da74e0cb04f085980d6f5df', 'request_id': 'req-4400c2f8-4ab6-4561-bfc9-dfa61b5b6ace'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:46.382770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4400c2f8-4ab6-4561-bfc9-dfa61b5b6ace admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92abb17a0da74e0cb04f085980d6f5df', 'request_id': 'req-4400c2f8-4ab6-4561-bfc9-dfa61b5b6ace'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:46.393214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4400c2f8-4ab6-4561-bfc9-dfa61b5b6ace admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92abb17a0da74e0cb04f085980d6f5df', 'request_id': 'req-4400c2f8-4ab6-4561-bfc9-dfa61b5b6ace'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:46.405983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4400c2f8-4ab6-4561-bfc9-dfa61b5b6ace admin admin] The token cache is being invalidate because project 92abb17a0da74e0cb04f085980d6f5df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:20:46.406297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4400c2f8-4ab6-4561-bfc9-dfa61b5b6ace admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:46.407158 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4400c2f8-4ab6-4561-bfc9-dfa61b5b6ace admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:46.408939 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3507/6945] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:20:46 2022] DELETE /identity/v3/projects/92abb17a0da74e0cb04f085980d6f5df => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:20:46.412926 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f866cce-a283-4e90-b642-1d83f05593bc service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:46.424388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f866cce-a283-4e90-b642-1d83f05593bc service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:46.449086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:46.539280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33f227-6792-4158-9f7a-6d7de4f13848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:46.540253 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33f227-6792-4158-9f7a-6d7de4f13848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:46.540845 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33f227-6792-4158-9f7a-6d7de4f13848 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:46.541259 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33f227-6792-4158-9f7a-6d7de4f13848 admin admin] PATH_INFO: `/v3/users/aa36e3d78cec4d19b0cec2663d2dd709` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:46.542442 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd33f227-6792-4158-9f7a-6d7de4f13848 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa36e3d78cec4d19b0cec2663d2dd709)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:46.544430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd33f227-6792-4158-9f7a-6d7de4f13848 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:46.624419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fd33f227-6792-4158-9f7a-6d7de4f13848 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa36e3d78cec4d19b0cec2663d2dd709'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:46.625530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fd33f227-6792-4158-9f7a-6d7de4f13848 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa36e3d78cec4d19b0cec2663d2dd709'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:46.626940 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fd33f227-6792-4158-9f7a-6d7de4f13848 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa36e3d78cec4d19b0cec2663d2dd709'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:46.651239 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400c2f8-4ab6-4561-bfc9-dfa61b5b6ace admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:46.651967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fd33f227-6792-4158-9f7a-6d7de4f13848 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa36e3d78cec4d19b0cec2663d2dd709'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:46.653238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4400c2f8-4ab6-4561-bfc9-dfa61b5b6ace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:46.669595 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400c2f8-4ab6-4561-bfc9-dfa61b5b6ace admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:46.674232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2714a-b633-49a6-b2e8-09fa3d395d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:46.674578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2714a-b633-49a6-b2e8-09fa3d395d84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:46.674926 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2714a-b633-49a6-b2e8-09fa3d395d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:46.675192 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2714a-b633-49a6-b2e8-09fa3d395d84 admin admin] PATH_INFO: `/v3/users/0df4535c62984c0eb8958c6e02ba7528` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:46.676442 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d2714a-b633-49a6-b2e8-09fa3d395d84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0df4535c62984c0eb8958c6e02ba7528)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:46.680595 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d2714a-b633-49a6-b2e8-09fa3d395d84 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:46.688181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fd33f227-6792-4158-9f7a-6d7de4f13848 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa36e3d78cec4d19b0cec2663d2dd709'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:46.743333 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3439/6946] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:20:46 2022] DELETE /identity/v3/users/aa36e3d78cec4d19b0cec2663d2dd709 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:20:46.758827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-94d2714a-b633-49a6-b2e8-09fa3d395d84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0df4535c62984c0eb8958c6e02ba7528'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:46.769793 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-94d2714a-b633-49a6-b2e8-09fa3d395d84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0df4535c62984c0eb8958c6e02ba7528'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:46.770504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-94d2714a-b633-49a6-b2e8-09fa3d395d84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0df4535c62984c0eb8958c6e02ba7528'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:46.771145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-94d2714a-b633-49a6-b2e8-09fa3d395d84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0df4535c62984c0eb8958c6e02ba7528'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:46.774721 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:46.793914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-94d2714a-b633-49a6-b2e8-09fa3d395d84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0df4535c62984c0eb8958c6e02ba7528'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:46.840902 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3508/6947] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:20:46 2022] DELETE /identity/v3/users/0df4535c62984c0eb8958c6e02ba7528 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:20:46.845848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc710c0-e6f1-44ee-bd4c-45b75d3cff4b None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:46.846146 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc710c0-e6f1-44ee-bd4c-45b75d3cff4b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:46.846434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc710c0-e6f1-44ee-bd4c-45b75d3cff4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:46.873376 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-1bc710c0-e6f1-44ee-bd4c-45b75d3cff4b None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:46.878874 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1bc710c0-e6f1-44ee-bd4c-45b75d3cff4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:46.966344 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3440/6948] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:20:46.990705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2714a-b633-49a6-b2e8-09fa3d395d84 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:46.992929 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-94d2714a-b633-49a6-b2e8-09fa3d395d84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:47.101049 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2714a-b633-49a6-b2e8-09fa3d395d84 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:47.107128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae7ed8-e2e0-4fbe-a2a4-0690c93fc497 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:47.108893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae7ed8-e2e0-4fbe-a2a4-0690c93fc497 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:47.109333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae7ed8-e2e0-4fbe-a2a4-0690c93fc497 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:47.109755 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae7ed8-e2e0-4fbe-a2a4-0690c93fc497 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:47.124112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae7ed8-e2e0-4fbe-a2a4-0690c93fc497 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:47.125834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae7ed8-e2e0-4fbe-a2a4-0690c93fc497 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:47.154406 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3509/6949] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:20:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:20:47.383927 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc710c0-e6f1-44ee-bd4c-45b75d3cff4b None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:47.385637 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1bc710c0-e6f1-44ee-bd4c-45b75d3cff4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:47.400149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc710c0-e6f1-44ee-bd4c-45b75d3cff4b None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:47.407722 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a12b7f-214d-430e-bcf9-72cc780e838f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:47.408446 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a12b7f-214d-430e-bcf9-72cc780e838f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:47.408791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a12b7f-214d-430e-bcf9-72cc780e838f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:47.409192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a12b7f-214d-430e-bcf9-72cc780e838f admin admin] PATH_INFO: `/v3/projects/8fb828e5b2ed45e2ae83bab910cf7c32` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:47.410529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a12b7f-214d-430e-bcf9-72cc780e838f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fb828e5b2ed45e2ae83bab910cf7c32)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:47.412873 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a12b7f-214d-430e-bcf9-72cc780e838f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:47.442398 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:47.473128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c6a12b7f-214d-430e-bcf9-72cc780e838f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fb828e5b2ed45e2ae83bab910cf7c32', 'request_id': 'req-c6a12b7f-214d-430e-bcf9-72cc780e838f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:47.480050 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c6a12b7f-214d-430e-bcf9-72cc780e838f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fb828e5b2ed45e2ae83bab910cf7c32', 'request_id': 'req-c6a12b7f-214d-430e-bcf9-72cc780e838f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:47.487312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c6a12b7f-214d-430e-bcf9-72cc780e838f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fb828e5b2ed45e2ae83bab910cf7c32', 'request_id': 'req-c6a12b7f-214d-430e-bcf9-72cc780e838f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:47.502396 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c6a12b7f-214d-430e-bcf9-72cc780e838f admin admin] The token cache is being invalidate because project 8fb828e5b2ed45e2ae83bab910cf7c32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:20:47.502800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c6a12b7f-214d-430e-bcf9-72cc780e838f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:47.503515 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c6a12b7f-214d-430e-bcf9-72cc780e838f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:47.505069 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3441/6950] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:20:47 2022] DELETE /identity/v3/projects/8fb828e5b2ed45e2ae83bab910cf7c32 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:20:47.511273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132a81f-603d-4d07-ab40-1183dc498b9c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:47.511738 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132a81f-603d-4d07-ab40-1183dc498b9c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:47.512006 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132a81f-603d-4d07-ab40-1183dc498b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:47.547155 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-2132a81f-603d-4d07-ab40-1183dc498b9c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:47.548980 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2132a81f-603d-4d07-ab40-1183dc498b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:47.641886 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab5b2d-140d-43d2-9a1b-30768f08b25f None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:47.643423 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3510/6951] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:20:47.644929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab5b2d-140d-43d2-9a1b-30768f08b25f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:47.645329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab5b2d-140d-43d2-9a1b-30768f08b25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:47.672857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-ddab5b2d-140d-43d2-9a1b-30768f08b25f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:47.674529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ddab5b2d-140d-43d2-9a1b-30768f08b25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:47.696266 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3442/6952] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:20:47.697709 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132a81f-603d-4d07-ab40-1183dc498b9c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:47.720010 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132a81f-603d-4d07-ab40-1183dc498b9c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:47.725643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ddb63-0522-4952-a413-c0444e4f6c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:47.726264 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ddb63-0522-4952-a413-c0444e4f6c20 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:47.726588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ddb63-0522-4952-a413-c0444e4f6c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:47.726954 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ddb63-0522-4952-a413-c0444e4f6c20 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:47.727617 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ddb63-0522-4952-a413-c0444e4f6c20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:20:47.727921 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ddb63-0522-4952-a413-c0444e4f6c20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:47.730085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ddb63-0522-4952-a413-c0444e4f6c20 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:47.762331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab5b2d-140d-43d2-9a1b-30768f08b25f None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:47.764333 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ddab5b2d-140d-43d2-9a1b-30768f08b25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:47.768433 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3511/6953] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:20:47.772372 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ddb63-0522-4952-a413-c0444e4f6c20 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:47.787965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab5b2d-140d-43d2-9a1b-30768f08b25f None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:47.803487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17acdb-48b7-44b7-bbd1-20dbb3bc37be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:47.804378 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17acdb-48b7-44b7-bbd1-20dbb3bc37be admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:47.804842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17acdb-48b7-44b7-bbd1-20dbb3bc37be admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:47.805358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17acdb-48b7-44b7-bbd1-20dbb3bc37be admin admin] PATH_INFO: `/v3/projects/79389ba38bac4877a75d06663602634a` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:47.808336 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17acdb-48b7-44b7-bbd1-20dbb3bc37be admin admin] RBAC: Authorizing `identity:delete_project(project_id=79389ba38bac4877a75d06663602634a)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:47.810494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17acdb-48b7-44b7-bbd1-20dbb3bc37be admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:47.820100 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ddb63-0522-4952-a413-c0444e4f6c20 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:47.837117 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b7cce-5937-4d0e-bc47-830f4d6b9296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:47.837593 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b7cce-5937-4d0e-bc47-830f4d6b9296 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:47.837876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b7cce-5937-4d0e-bc47-830f4d6b9296 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:47.838162 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b7cce-5937-4d0e-bc47-830f4d6b9296 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:47.839457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b7cce-5937-4d0e-bc47-830f4d6b9296 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:47.841485 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b7cce-5937-4d0e-bc47-830f4d6b9296 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:47.906744 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3512/6954] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:20:47 2022] POST /identity/v3/projects => generated 357 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:20:47.908228 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b7cce-5937-4d0e-bc47-830f4d6b9296 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:47.913991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2e17acdb-48b7-44b7-bbd1-20dbb3bc37be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79389ba38bac4877a75d06663602634a', 'request_id': 'req-2e17acdb-48b7-44b7-bbd1-20dbb3bc37be'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:47.924941 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2e17acdb-48b7-44b7-bbd1-20dbb3bc37be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79389ba38bac4877a75d06663602634a', 'request_id': 'req-2e17acdb-48b7-44b7-bbd1-20dbb3bc37be'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:47.933204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2e17acdb-48b7-44b7-bbd1-20dbb3bc37be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79389ba38bac4877a75d06663602634a', 'request_id': 'req-2e17acdb-48b7-44b7-bbd1-20dbb3bc37be'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:47.964467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2e17acdb-48b7-44b7-bbd1-20dbb3bc37be admin admin] The token cache is being invalidate because project 79389ba38bac4877a75d06663602634a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:20:47.964772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2e17acdb-48b7-44b7-bbd1-20dbb3bc37be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:47.970129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2e17acdb-48b7-44b7-bbd1-20dbb3bc37be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:47.979289 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3443/6955] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:20:47 2022] DELETE /identity/v3/projects/79389ba38bac4877a75d06663602634a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:20:47.980740 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47fa68-e6e3-4782-b1f1-f9cebf8e3a60 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:47.981029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47fa68-e6e3-4782-b1f1-f9cebf8e3a60 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:47.981303 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47fa68-e6e3-4782-b1f1-f9cebf8e3a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:47.981428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:48.023466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b7cce-5937-4d0e-bc47-830f4d6b9296 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:48.034082 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-8f47fa68-e6e3-4782-b1f1-f9cebf8e3a60 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:48.035364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8f47fa68-e6e3-4782-b1f1-f9cebf8e3a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:48.036621 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e3c55-cba4-4039-9f46-515fabd0fc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:48.038463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e3c55-cba4-4039-9f46-515fabd0fc8f admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:48.038890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e3c55-cba4-4039-9f46-515fabd0fc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:48.039815 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e3c55-cba4-4039-9f46-515fabd0fc8f admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:48.041552 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e3c55-cba4-4039-9f46-515fabd0fc8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:48.053404 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e3c55-cba4-4039-9f46-515fabd0fc8f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:48.058267 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3444/6956] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:20:48.066301 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da9087-cd4b-4823-b031-cc2ea66af1da None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:48.066838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da9087-cd4b-4823-b031-cc2ea66af1da None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:48.067877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da9087-cd4b-4823-b031-cc2ea66af1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:48.104948 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f5da9087-cd4b-4823-b031-cc2ea66af1da None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:48.106449 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f5da9087-cd4b-4823-b031-cc2ea66af1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:48.125718 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3445/6957] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:20:48.129965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da9087-cd4b-4823-b031-cc2ea66af1da None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:48.136055 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3513/6958] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:20:47 2022] POST /identity/v3/users => generated 279 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:20:48.138172 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e3c55-cba4-4039-9f46-515fabd0fc8f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:48.143694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7b0e3c55-cba4-4039-9f46-515fabd0fc8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:48.172316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da9087-cd4b-4823-b031-cc2ea66af1da None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:48.185655 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1589302c-8fc7-4de8-ba2b-0b8bc0814a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:48.188027 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589302c-8fc7-4de8-ba2b-0b8bc0814a50 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:48.188338 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589302c-8fc7-4de8-ba2b-0b8bc0814a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:48.188697 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589302c-8fc7-4de8-ba2b-0b8bc0814a50 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:48.191430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1589302c-8fc7-4de8-ba2b-0b8bc0814a50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:20:48.192822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1589302c-8fc7-4de8-ba2b-0b8bc0814a50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:48.193684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e3c55-cba4-4039-9f46-515fabd0fc8f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:48.196076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1589302c-8fc7-4de8-ba2b-0b8bc0814a50 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:48.222643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03535d-4adc-48d7-9c93-e362e257c32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:48.226257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03535d-4adc-48d7-9c93-e362e257c32f admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:48.229284 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03535d-4adc-48d7-9c93-e362e257c32f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:48.230982 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03535d-4adc-48d7-9c93-e362e257c32f admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:48.234767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03535d-4adc-48d7-9c93-e362e257c32f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:48.237264 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03535d-4adc-48d7-9c93-e362e257c32f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:48.239823 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3446/6959] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:20:48.244686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1589302c-8fc7-4de8-ba2b-0b8bc0814a50 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:48.267689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1589302c-8fc7-4de8-ba2b-0b8bc0814a50 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:48.269676 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3514/6960] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:20:48.273543 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49202254-1163-4dfe-af1f-cc6f63335407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:48.274271 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49202254-1163-4dfe-af1f-cc6f63335407 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:48.274700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49202254-1163-4dfe-af1f-cc6f63335407 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:48.275074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49202254-1163-4dfe-af1f-cc6f63335407 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:48.275328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03535d-4adc-48d7-9c93-e362e257c32f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:48.276602 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49202254-1163-4dfe-af1f-cc6f63335407 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:48.278119 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49202254-1163-4dfe-af1f-cc6f63335407 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:48.290449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03535d-4adc-48d7-9c93-e362e257c32f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:48.298665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b410d2-6e0f-42ea-acb2-1ad2b160ed92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:48.299842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b410d2-6e0f-42ea-acb2-1ad2b160ed92 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:48.299842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b410d2-6e0f-42ea-acb2-1ad2b160ed92 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:48.300037 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b410d2-6e0f-42ea-acb2-1ad2b160ed92 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:48.300692 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b410d2-6e0f-42ea-acb2-1ad2b160ed92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:48.303107 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b410d2-6e0f-42ea-acb2-1ad2b160ed92 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:48.326362 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3515/6961] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:20:48.327581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b410d2-6e0f-42ea-acb2-1ad2b160ed92 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:48.340427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b410d2-6e0f-42ea-acb2-1ad2b160ed92 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:48.344098 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3447/6962] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:20:48 2022] POST /identity/v3/projects => generated 389 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:20:48.349272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49202254-1163-4dfe-af1f-cc6f63335407 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:48.457198 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:48.477241 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542211a9-814c-4708-bc0b-5fbfd2b79bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:48.480735 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542211a9-814c-4708-bc0b-5fbfd2b79bcc admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:48.481024 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542211a9-814c-4708-bc0b-5fbfd2b79bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:48.482238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542211a9-814c-4708-bc0b-5fbfd2b79bcc admin admin] PATH_INFO: `/v3/projects/bd968c30757a4d1692fba7c550e14af1/users/b8bb8e1b5005491186ce77625c4a6d3c/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:48.521130 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542211a9-814c-4708-bc0b-5fbfd2b79bcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd968c30757a4d1692fba7c550e14af1, user_id=b8bb8e1b5005491186ce77625c4a6d3c, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:48.533494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542211a9-814c-4708-bc0b-5fbfd2b79bcc admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:48.543391 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49202254-1163-4dfe-af1f-cc6f63335407 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:48.554519 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3516/6963] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:20:48 2022] PUT /identity/v3/projects/bd968c30757a4d1692fba7c550e14af1/users/b8bb8e1b5005491186ce77625c4a6d3c/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:20:48.556658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c196d-0da7-4d7d-a69a-18402a58b283 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:48.557662 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c196d-0da7-4d7d-a69a-18402a58b283 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:48.558097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c196d-0da7-4d7d-a69a-18402a58b283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:48.627501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-084c196d-0da7-4d7d-a69a-18402a58b283 None None] MFA Rules not processed for user `b8bb8e1b5005491186ce77625c4a6d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:48.632549 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-084c196d-0da7-4d7d-a69a-18402a58b283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:48.643958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837591f5-18ef-4673-9d46-11ed3c033e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:48.644771 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837591f5-18ef-4673-9d46-11ed3c033e7e admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:48.645148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837591f5-18ef-4673-9d46-11ed3c033e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:48.645476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837591f5-18ef-4673-9d46-11ed3c033e7e admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:48.651163 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837591f5-18ef-4673-9d46-11ed3c033e7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:48.653914 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837591f5-18ef-4673-9d46-11ed3c033e7e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:48.708727 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3448/6964] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:20:48 2022] POST /identity/v3/users => generated 295 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:20:48.709766 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837591f5-18ef-4673-9d46-11ed3c033e7e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:48.730952 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837591f5-18ef-4673-9d46-11ed3c033e7e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:48.738390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ebcde-1257-49d8-baae-bdf1ff584604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:48.740239 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ebcde-1257-49d8-baae-bdf1ff584604 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:48.740529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ebcde-1257-49d8-baae-bdf1ff584604 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:48.740831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ebcde-1257-49d8-baae-bdf1ff584604 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:48.742237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ebcde-1257-49d8-baae-bdf1ff584604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:48.744369 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ebcde-1257-49d8-baae-bdf1ff584604 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:48.770604 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3449/6965] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:20:48.785097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ebcde-1257-49d8-baae-bdf1ff584604 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:48.806942 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ebcde-1257-49d8-baae-bdf1ff584604 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:48.820534 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84109b-209c-4298-a5f6-062ede01079a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:48.823551 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84109b-209c-4298-a5f6-062ede01079a admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:48.825074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84109b-209c-4298-a5f6-062ede01079a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:48.827039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84109b-209c-4298-a5f6-062ede01079a admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:48.830508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d84109b-209c-4298-a5f6-062ede01079a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:48.836798 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d84109b-209c-4298-a5f6-062ede01079a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:48.859985 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3517/6966] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:48 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:20:48.860739 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3450/6967] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:20:48.861767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c196d-0da7-4d7d-a69a-18402a58b283 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:48.880644 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c196d-0da7-4d7d-a69a-18402a58b283 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:48.888376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaefbbd-73ef-4ef4-8721-c02564fdb18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:48.890743 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaefbbd-73ef-4ef4-8721-c02564fdb18b admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:48.891470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaefbbd-73ef-4ef4-8721-c02564fdb18b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:48.891907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaefbbd-73ef-4ef4-8721-c02564fdb18b admin admin] PATH_INFO: `/v3/projects/0cc60bd15a3d41bfab4169351e1bfcb1/users/6341fe9e44fb4234b7de2c6c5f0ad10a/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:48.909255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84109b-209c-4298-a5f6-062ede01079a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:48.912451 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0d84109b-209c-4298-a5f6-062ede01079a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:48.927638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaefbbd-73ef-4ef4-8721-c02564fdb18b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cc60bd15a3d41bfab4169351e1bfcb1, user_id=6341fe9e44fb4234b7de2c6c5f0ad10a, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:48.931939 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaefbbd-73ef-4ef4-8721-c02564fdb18b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:48.958005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:48.972355 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3518/6968] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:20:48 2022] PUT /identity/v3/projects/0cc60bd15a3d41bfab4169351e1bfcb1/users/6341fe9e44fb4234b7de2c6c5f0ad10a/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:20:48.985019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb3182-70a6-45da-8883-007b63cbca2b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:48.986128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb3182-70a6-45da-8883-007b63cbca2b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:48.986481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb3182-70a6-45da-8883-007b63cbca2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:49.007128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84109b-209c-4298-a5f6-062ede01079a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:49.024980 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-05fb3182-70a6-45da-8883-007b63cbca2b None None] MFA Rules not processed for user `6341fe9e44fb4234b7de2c6c5f0ad10a`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:49.026413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-05fb3182-70a6-45da-8883-007b63cbca2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:49.135434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79295e-176d-4c9d-a4ca-1181344f57bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:49.136048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79295e-176d-4c9d-a4ca-1181344f57bd service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:49.136325 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79295e-176d-4c9d-a4ca-1181344f57bd service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:49.136597 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79295e-176d-4c9d-a4ca-1181344f57bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:49.163361 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:49.177996 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3519/6969] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:20:49.180548 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb3182-70a6-45da-8883-007b63cbca2b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:49.216628 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a79295e-176d-4c9d-a4ca-1181344f57bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:49.218839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a79295e-176d-4c9d-a4ca-1181344f57bd service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:49.237221 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3451/6970] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:20:48 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:20:49.307324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb3182-70a6-45da-8883-007b63cbca2b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:49.325134 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5581d-1657-4020-8122-827309c99e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:49.325968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5581d-1657-4020-8122-827309c99e5d admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:49.326375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5581d-1657-4020-8122-827309c99e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:49.329271 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5581d-1657-4020-8122-827309c99e5d admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:49.330080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5581d-1657-4020-8122-827309c99e5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:49.332371 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5581d-1657-4020-8122-827309c99e5d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:49.372533 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3520/6971] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:20:49 2022] POST /identity/v3/projects => generated 393 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:20:49.377384 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79295e-176d-4c9d-a4ca-1181344f57bd service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:49.394502 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79295e-176d-4c9d-a4ca-1181344f57bd service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:49.494915 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713cfd8-2d39-48e8-9970-b01312d1766f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:49.495657 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713cfd8-2d39-48e8-9970-b01312d1766f admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:49.496033 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713cfd8-2d39-48e8-9970-b01312d1766f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:49.496400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713cfd8-2d39-48e8-9970-b01312d1766f admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:49.497141 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713cfd8-2d39-48e8-9970-b01312d1766f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:49.500427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713cfd8-2d39-48e8-9970-b01312d1766f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:49.529981 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3452/6972] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:20:49 2022] POST /identity/v3/users => generated 303 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:20:49.534239 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5581d-1657-4020-8122-827309c99e5d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:49.563582 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5581d-1657-4020-8122-827309c99e5d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:49.569749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7975ca1-c294-4795-bb9a-c95b84789172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:49.570580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7975ca1-c294-4795-bb9a-c95b84789172 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:49.570580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7975ca1-c294-4795-bb9a-c95b84789172 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:49.579965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713cfd8-2d39-48e8-9970-b01312d1766f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:49.582523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d713cfd8-2d39-48e8-9970-b01312d1766f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:49.588080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7975ca1-c294-4795-bb9a-c95b84789172 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:49.589987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7975ca1-c294-4795-bb9a-c95b84789172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:49.597160 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7975ca1-c294-4795-bb9a-c95b84789172 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:49.615696 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3521/6973] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:20:49.622036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7975ca1-c294-4795-bb9a-c95b84789172 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:49.636362 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7975ca1-c294-4795-bb9a-c95b84789172 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:49.647297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e3c64-ae0c-4f38-8117-22d2c77da69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:49.647988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e3c64-ae0c-4f38-8117-22d2c77da69a admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:49.648269 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e3c64-ae0c-4f38-8117-22d2c77da69a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:49.650762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e3c64-ae0c-4f38-8117-22d2c77da69a admin admin] PATH_INFO: `/v3/projects/0b2ea668851743c8b757989504257549/users/08b228bac87e4cf1a4c1248f9256a2c4/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:49.689409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e3c64-ae0c-4f38-8117-22d2c77da69a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b2ea668851743c8b757989504257549, user_id=08b228bac87e4cf1a4c1248f9256a2c4, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:49.713625 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e3c64-ae0c-4f38-8117-22d2c77da69a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:49.732318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713cfd8-2d39-48e8-9970-b01312d1766f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:49.742506 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3522/6974] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:20:49 2022] PUT /identity/v3/projects/0b2ea668851743c8b757989504257549/users/08b228bac87e4cf1a4c1248f9256a2c4/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:20:49.750664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e3c64-ae0c-4f38-8117-22d2c77da69a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:49.855690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:49.877588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:49.895851 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1286cf-3a6e-404b-872e-6a63fde21805 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:49.897852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1286cf-3a6e-404b-872e-6a63fde21805 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:49.898467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1286cf-3a6e-404b-872e-6a63fde21805 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:49.898467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1286cf-3a6e-404b-872e-6a63fde21805 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:49.907280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ca1286cf-3a6e-404b-872e-6a63fde21805 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:49.921857 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e3c64-ae0c-4f38-8117-22d2c77da69a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:49.927393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85360c-8d73-46a8-ad00-eb39a92042d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:49.927980 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85360c-8d73-46a8-ad00-eb39a92042d8 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:49.928274 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85360c-8d73-46a8-ad00-eb39a92042d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:49.928549 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85360c-8d73-46a8-ad00-eb39a92042d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:49.929655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85360c-8d73-46a8-ad00-eb39a92042d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:49.931374 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85360c-8d73-46a8-ad00-eb39a92042d8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:49.947500 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3523/6975] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:20:49.947688 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1286cf-3a6e-404b-872e-6a63fde21805 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:49.949783 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1286cf-3a6e-404b-872e-6a63fde21805 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:49.951257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85360c-8d73-46a8-ad00-eb39a92042d8 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:49.963900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85360c-8d73-46a8-ad00-eb39a92042d8 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:49.970770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f110f31-5e4e-44f5-8199-7b02cbceb7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:49.973196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f110f31-5e4e-44f5-8199-7b02cbceb7fb admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:49.973590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f110f31-5e4e-44f5-8199-7b02cbceb7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:49.974039 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f110f31-5e4e-44f5-8199-7b02cbceb7fb admin admin] PATH_INFO: `/v3/projects/0b2ea668851743c8b757989504257549/users/08b228bac87e4cf1a4c1248f9256a2c4/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:49.979233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f110f31-5e4e-44f5-8199-7b02cbceb7fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b2ea668851743c8b757989504257549, user_id=08b228bac87e4cf1a4c1248f9256a2c4, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:49.982115 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f110f31-5e4e-44f5-8199-7b02cbceb7fb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:49.987592 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3453/6976] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:20:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:20:50.003106 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3524/6977] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:20:49 2022] PUT /identity/v3/projects/0b2ea668851743c8b757989504257549/users/08b228bac87e4cf1a4c1248f9256a2c4/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:20:50.008517 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31741fac-4d54-4fdf-ba32-f858e6c4864c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:50.008933 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31741fac-4d54-4fdf-ba32-f858e6c4864c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:50.009320 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31741fac-4d54-4fdf-ba32-f858e6c4864c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:50.074296 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-31741fac-4d54-4fdf-ba32-f858e6c4864c None None] MFA Rules not processed for user `08b228bac87e4cf1a4c1248f9256a2c4`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:50.076268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-31741fac-4d54-4fdf-ba32-f858e6c4864c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:50.230865 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3454/6978] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:50 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:20:50.243857 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f110f31-5e4e-44f5-8199-7b02cbceb7fb admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:50.246136 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1f110f31-5e4e-44f5-8199-7b02cbceb7fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:50.403310 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f110f31-5e4e-44f5-8199-7b02cbceb7fb admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:50.409841 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b55d6-f670-4175-9d78-c2498280e828 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:50.410727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b55d6-f670-4175-9d78-c2498280e828 service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:50.411228 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b55d6-f670-4175-9d78-c2498280e828 service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:50.411354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b55d6-f670-4175-9d78-c2498280e828 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:50.426046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b55d6-f670-4175-9d78-c2498280e828 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:50.442491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b55d6-f670-4175-9d78-c2498280e828 service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:50.461252 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3525/6979] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:20:50 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:20:50.528705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31741fac-4d54-4fdf-ba32-f858e6c4864c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:50.530328 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-31741fac-4d54-4fdf-ba32-f858e6c4864c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:50.550328 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31741fac-4d54-4fdf-ba32-f858e6c4864c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:50.554906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3e179-8812-4f7d-a749-fdc46d4caf59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:50.555521 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3e179-8812-4f7d-a749-fdc46d4caf59 service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:50.555861 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3e179-8812-4f7d-a749-fdc46d4caf59 service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:50.556143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3e179-8812-4f7d-a749-fdc46d4caf59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:50.627460 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c3e179-8812-4f7d-a749-fdc46d4caf59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:50.629062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c3e179-8812-4f7d-a749-fdc46d4caf59 service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:50.638176 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3455/6980] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:20:50 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:20:51.041486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b55d6-f670-4175-9d78-c2498280e828 service cinder] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:51.043908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-386b55d6-f670-4175-9d78-c2498280e828 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:51.141691 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b55d6-f670-4175-9d78-c2498280e828 service cinder] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:51.149471 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3a868-80a8-4c72-b74e-16b3b6846078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:51.150448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3a868-80a8-4c72-b74e-16b3b6846078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:51.150875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3a868-80a8-4c72-b74e-16b3b6846078 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:51.151250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3a868-80a8-4c72-b74e-16b3b6846078 admin admin] PATH_INFO: `/v3/users/ad95e1edd84d49ada9f06b1feb0e0d87` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:51.152690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3a868-80a8-4c72-b74e-16b3b6846078 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad95e1edd84d49ada9f06b1feb0e0d87)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:51.155341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3a868-80a8-4c72-b74e-16b3b6846078 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:51.217312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-43a3a868-80a8-4c72-b74e-16b3b6846078 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad95e1edd84d49ada9f06b1feb0e0d87'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:51.227636 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-43a3a868-80a8-4c72-b74e-16b3b6846078 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad95e1edd84d49ada9f06b1feb0e0d87'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:51.228438 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-43a3a868-80a8-4c72-b74e-16b3b6846078 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad95e1edd84d49ada9f06b1feb0e0d87'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:51.229111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-43a3a868-80a8-4c72-b74e-16b3b6846078 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad95e1edd84d49ada9f06b1feb0e0d87'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:51.241166 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-43a3a868-80a8-4c72-b74e-16b3b6846078 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad95e1edd84d49ada9f06b1feb0e0d87'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:51.248406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:51.272004 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3526/6981] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:20:51 2022] DELETE /identity/v3/users/ad95e1edd84d49ada9f06b1feb0e0d87 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:20:51.276444 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f55aa3-4c65-49ab-9dcd-e0ca524e606b None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:51.276754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f55aa3-4c65-49ab-9dcd-e0ca524e606b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:51.277022 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f55aa3-4c65-49ab-9dcd-e0ca524e606b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:51.301434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-c1f55aa3-4c65-49ab-9dcd-e0ca524e606b None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:51.302721 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c1f55aa3-4c65-49ab-9dcd-e0ca524e606b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:51.383696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:51.406591 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3456/6982] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:20:51.415421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3a868-80a8-4c72-b74e-16b3b6846078 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:51.415527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-43a3a868-80a8-4c72-b74e-16b3b6846078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:51.570503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3a868-80a8-4c72-b74e-16b3b6846078 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:51.580533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d1ceb-5a45-4d28-bf54-3a290645588c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:51.581303 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d1ceb-5a45-4d28-bf54-3a290645588c service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:51.581705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d1ceb-5a45-4d28-bf54-3a290645588c service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:51.582051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d1ceb-5a45-4d28-bf54-3a290645588c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:51.595272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d1ceb-5a45-4d28-bf54-3a290645588c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:51.598278 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d1ceb-5a45-4d28-bf54-3a290645588c service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:51.610840 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3527/6983] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:20:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:20:51.910982 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f55aa3-4c65-49ab-9dcd-e0ca524e606b None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:51.912611 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c1f55aa3-4c65-49ab-9dcd-e0ca524e606b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:51.940579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f55aa3-4c65-49ab-9dcd-e0ca524e606b None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:51.970122 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755f9ce-b1e7-49a9-a0a9-552925976d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:51.971424 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755f9ce-b1e7-49a9-a0a9-552925976d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:51.971702 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755f9ce-b1e7-49a9-a0a9-552925976d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:51.974254 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755f9ce-b1e7-49a9-a0a9-552925976d7e admin admin] PATH_INFO: `/v3/projects/4f97a82605a54f88ae4dbdda90c5a52d` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:51.978295 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c755f9ce-b1e7-49a9-a0a9-552925976d7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f97a82605a54f88ae4dbdda90c5a52d)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:51.980587 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c755f9ce-b1e7-49a9-a0a9-552925976d7e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:52.123525 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c755f9ce-b1e7-49a9-a0a9-552925976d7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f97a82605a54f88ae4dbdda90c5a52d', 'request_id': 'req-c755f9ce-b1e7-49a9-a0a9-552925976d7e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:52.132183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c755f9ce-b1e7-49a9-a0a9-552925976d7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f97a82605a54f88ae4dbdda90c5a52d', 'request_id': 'req-c755f9ce-b1e7-49a9-a0a9-552925976d7e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:52.142686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c755f9ce-b1e7-49a9-a0a9-552925976d7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f97a82605a54f88ae4dbdda90c5a52d', 'request_id': 'req-c755f9ce-b1e7-49a9-a0a9-552925976d7e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:52.168393 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c755f9ce-b1e7-49a9-a0a9-552925976d7e admin admin] The token cache is being invalidate because project 4f97a82605a54f88ae4dbdda90c5a52d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:20:52.168887 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c755f9ce-b1e7-49a9-a0a9-552925976d7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:52.170953 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c755f9ce-b1e7-49a9-a0a9-552925976d7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:52.176719 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3457/6984] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:20:51 2022] DELETE /identity/v3/projects/4f97a82605a54f88ae4dbdda90c5a52d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:20:52.177767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d18ac-d673-4473-ac34-7c70714f9e06 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:52.178205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d18ac-d673-4473-ac34-7c70714f9e06 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:52.178443 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d18ac-d673-4473-ac34-7c70714f9e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:52.218466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-e48d18ac-d673-4473-ac34-7c70714f9e06 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:52.219723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e48d18ac-d673-4473-ac34-7c70714f9e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:52.340519 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3528/6985] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:20:52.349890 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac674f-2638-4106-b5ca-e0c0bbd8111e None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:52.350137 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac674f-2638-4106-b5ca-e0c0bbd8111e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:52.351299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac674f-2638-4106-b5ca-e0c0bbd8111e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:52.411196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-43ac674f-2638-4106-b5ca-e0c0bbd8111e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:52.414437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-43ac674f-2638-4106-b5ca-e0c0bbd8111e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:52.430410 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3458/6986] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:20:52.435244 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d18ac-d673-4473-ac34-7c70714f9e06 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:52.448312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d18ac-d673-4473-ac34-7c70714f9e06 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:52.454144 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542c64f-6ce1-4f61-8748-f1c19ffafb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:52.455067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542c64f-6ce1-4f61-8748-f1c19ffafb88 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:52.455485 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542c64f-6ce1-4f61-8748-f1c19ffafb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:52.455920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542c64f-6ce1-4f61-8748-f1c19ffafb88 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:52.456605 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542c64f-6ce1-4f61-8748-f1c19ffafb88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:20:52.456915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542c64f-6ce1-4f61-8748-f1c19ffafb88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:52.458521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542c64f-6ce1-4f61-8748-f1c19ffafb88 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:52.478820 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3529/6987] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:20:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:20:52.480788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac674f-2638-4106-b5ca-e0c0bbd8111e None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:52.492768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac674f-2638-4106-b5ca-e0c0bbd8111e None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:52.498080 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1131d-ee38-4033-8b2b-b8cf1bc98903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:52.499543 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1131d-ee38-4033-8b2b-b8cf1bc98903 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:52.499829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1131d-ee38-4033-8b2b-b8cf1bc98903 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:52.500176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1131d-ee38-4033-8b2b-b8cf1bc98903 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:52.500884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e1131d-ee38-4033-8b2b-b8cf1bc98903 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:52.502973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e1131d-ee38-4033-8b2b-b8cf1bc98903 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:52.542399 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3459/6988] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:20:52 2022] POST /identity/v3/projects => generated 369 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:20:52.547529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542c64f-6ce1-4f61-8748-f1c19ffafb88 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:52.561749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542c64f-6ce1-4f61-8748-f1c19ffafb88 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:52.683596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c419d0-f71d-4ab1-a1c1-e7bbd4e86670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:52.690412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c419d0-f71d-4ab1-a1c1-e7bbd4e86670 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:52.690412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c419d0-f71d-4ab1-a1c1-e7bbd4e86670 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:52.690412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c419d0-f71d-4ab1-a1c1-e7bbd4e86670 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:52.690412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c419d0-f71d-4ab1-a1c1-e7bbd4e86670 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:52.690412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c419d0-f71d-4ab1-a1c1-e7bbd4e86670 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:52.735618 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3530/6989] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:20:52 2022] POST /identity/v3/users => generated 285 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:20:52.740030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1131d-ee38-4033-8b2b-b8cf1bc98903 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:52.755519 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1131d-ee38-4033-8b2b-b8cf1bc98903 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:52.762804 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a64e2-7ad2-42cd-a9f4-81a5ffe8ce32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:52.764627 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a64e2-7ad2-42cd-a9f4-81a5ffe8ce32 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:52.765063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a64e2-7ad2-42cd-a9f4-81a5ffe8ce32 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:52.765620 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a64e2-7ad2-42cd-a9f4-81a5ffe8ce32 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:52.766417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a64e2-7ad2-42cd-a9f4-81a5ffe8ce32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:52.768223 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a64e2-7ad2-42cd-a9f4-81a5ffe8ce32 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:52.807488 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3460/6990] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:20:52.812353 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c419d0-f71d-4ab1-a1c1-e7bbd4e86670 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:52.822098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:52.830354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c419d0-f71d-4ab1-a1c1-e7bbd4e86670 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:52.845620 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b4148-eab3-4e03-b4b2-4dafb9dbb8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:52.847518 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b4148-eab3-4e03-b4b2-4dafb9dbb8c2 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:52.849188 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b4148-eab3-4e03-b4b2-4dafb9dbb8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:52.849629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b4148-eab3-4e03-b4b2-4dafb9dbb8c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:52.850317 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b4148-eab3-4e03-b4b2-4dafb9dbb8c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:52.852671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b4148-eab3-4e03-b4b2-4dafb9dbb8c2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:52.882996 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3531/6991] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:20:52.886675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a64e2-7ad2-42cd-a9f4-81a5ffe8ce32 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:52.909768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a64e2-7ad2-42cd-a9f4-81a5ffe8ce32 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:52.937765 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311cf3b-c465-459e-8fe4-b4e5fd7b794f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:52.939258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311cf3b-c465-459e-8fe4-b4e5fd7b794f admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:52.940001 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311cf3b-c465-459e-8fe4-b4e5fd7b794f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:52.940249 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311cf3b-c465-459e-8fe4-b4e5fd7b794f admin admin] PATH_INFO: `/v3/projects/c29a26de8c8f445181bec7608ee8fcbb/users/b28aea57b6c34fcd96ec58896e175b60/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:52.966783 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311cf3b-c465-459e-8fe4-b4e5fd7b794f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c29a26de8c8f445181bec7608ee8fcbb, user_id=b28aea57b6c34fcd96ec58896e175b60, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:52.971342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311cf3b-c465-459e-8fe4-b4e5fd7b794f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:52.998839 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3461/6992] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:20:52 2022] PUT /identity/v3/projects/c29a26de8c8f445181bec7608ee8fcbb/users/b28aea57b6c34fcd96ec58896e175b60/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:20:53.010038 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f74370-5c6c-485a-bf43-b6acb425d55e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:53.010466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f74370-5c6c-485a-bf43-b6acb425d55e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:53.010787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f74370-5c6c-485a-bf43-b6acb425d55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:53.058959 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b8f74370-5c6c-485a-bf43-b6acb425d55e None None] MFA Rules not processed for user `b28aea57b6c34fcd96ec58896e175b60`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:53.061981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b8f74370-5c6c-485a-bf43-b6acb425d55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:53.099583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eac045-2701-45ae-8e7f-81d28764986c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:53.100056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eac045-2701-45ae-8e7f-81d28764986c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:53.100484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eac045-2701-45ae-8e7f-81d28764986c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:53.128903 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-19eac045-2701-45ae-8e7f-81d28764986c None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:53.136537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-19eac045-2701-45ae-8e7f-81d28764986c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:53.176372 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3532/6993] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:20:53.193502 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f74370-5c6c-485a-bf43-b6acb425d55e None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:53.197639 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b8f74370-5c6c-485a-bf43-b6acb425d55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:53.333414 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f74370-5c6c-485a-bf43-b6acb425d55e None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:53.341191 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af9f04-047e-4fab-b393-6ea771d34831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:53.342035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af9f04-047e-4fab-b393-6ea771d34831 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:53.342595 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af9f04-047e-4fab-b393-6ea771d34831 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:53.343085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af9f04-047e-4fab-b393-6ea771d34831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:53.359488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af9f04-047e-4fab-b393-6ea771d34831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:53.362273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af9f04-047e-4fab-b393-6ea771d34831 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:53.369383 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3462/6994] 10.222.0.33 () {58 vars in 967 bytes} [Sat Aug 6 21:20:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:20:53.392220 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3533/6995] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:20:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:20:53.425190 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eac045-2701-45ae-8e7f-81d28764986c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:53.430942 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-19eac045-2701-45ae-8e7f-81d28764986c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:53.499235 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:53.575092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eac045-2701-45ae-8e7f-81d28764986c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:53.585772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac930c-2a75-43a8-9fe3-8b9d18ee184e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:53.586659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac930c-2a75-43a8-9fe3-8b9d18ee184e service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:53.587113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac930c-2a75-43a8-9fe3-8b9d18ee184e service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:53.588124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac930c-2a75-43a8-9fe3-8b9d18ee184e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:53.604540 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac930c-2a75-43a8-9fe3-8b9d18ee184e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:53.606507 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac930c-2a75-43a8-9fe3-8b9d18ee184e service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:53.644384 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3463/6996] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:20:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:20:55.446531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af9f04-047e-4fab-b393-6ea771d34831 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:55.448806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a8af9f04-047e-4fab-b393-6ea771d34831 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:55.604177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af9f04-047e-4fab-b393-6ea771d34831 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:55.611447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1d701-0a3a-413b-8ae2-1c59ca214d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:55.612695 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1d701-0a3a-413b-8ae2-1c59ca214d76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:55.613190 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1d701-0a3a-413b-8ae2-1c59ca214d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:55.613675 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1d701-0a3a-413b-8ae2-1c59ca214d76 admin admin] PATH_INFO: `/v3/users/6341fe9e44fb4234b7de2c6c5f0ad10a` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:55.615127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1d701-0a3a-413b-8ae2-1c59ca214d76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6341fe9e44fb4234b7de2c6c5f0ad10a)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:55.618193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1d701-0a3a-413b-8ae2-1c59ca214d76 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:55.688992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:55.751250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3ab1d701-0a3a-413b-8ae2-1c59ca214d76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6341fe9e44fb4234b7de2c6c5f0ad10a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:55.775206 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3ab1d701-0a3a-413b-8ae2-1c59ca214d76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6341fe9e44fb4234b7de2c6c5f0ad10a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:55.777237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3ab1d701-0a3a-413b-8ae2-1c59ca214d76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6341fe9e44fb4234b7de2c6c5f0ad10a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:55.777914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3ab1d701-0a3a-413b-8ae2-1c59ca214d76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6341fe9e44fb4234b7de2c6c5f0ad10a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:55.812606 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3ab1d701-0a3a-413b-8ae2-1c59ca214d76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6341fe9e44fb4234b7de2c6c5f0ad10a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:55.866967 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3534/6997] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:20:55 2022] DELETE /identity/v3/users/6341fe9e44fb4234b7de2c6c5f0ad10a => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:20:55.876982 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed27d20-f8ad-4c12-8532-2e79e09aa053 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:55.879057 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed27d20-f8ad-4c12-8532-2e79e09aa053 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:55.879574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed27d20-f8ad-4c12-8532-2e79e09aa053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:55.949967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-2ed27d20-f8ad-4c12-8532-2e79e09aa053 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:55.955058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2ed27d20-f8ad-4c12-8532-2e79e09aa053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:56.160436 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3464/6998] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:20:56.215719 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1d701-0a3a-413b-8ae2-1c59ca214d76 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:56.222818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3ab1d701-0a3a-413b-8ae2-1c59ca214d76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:56.365397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1d701-0a3a-413b-8ae2-1c59ca214d76 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:56.372531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed27d20-f8ad-4c12-8532-2e79e09aa053 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:56.374586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2ed27d20-f8ad-4c12-8532-2e79e09aa053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:56.387459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d048da0-3682-4ac9-b445-5199e2c53fe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:56.388211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d048da0-3682-4ac9-b445-5199e2c53fe9 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:56.392693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d048da0-3682-4ac9-b445-5199e2c53fe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:56.393057 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d048da0-3682-4ac9-b445-5199e2c53fe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:56.420492 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d048da0-3682-4ac9-b445-5199e2c53fe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:56.422465 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d048da0-3682-4ac9-b445-5199e2c53fe9 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:56.446938 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3535/6999] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:20:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:20:56.552438 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed27d20-f8ad-4c12-8532-2e79e09aa053 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:56.560098 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67bca3-fbf7-4586-bc37-8d21ced723e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:56.561750 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67bca3-fbf7-4586-bc37-8d21ced723e9 service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:56.563114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67bca3-fbf7-4586-bc37-8d21ced723e9 service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:56.564053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67bca3-fbf7-4586-bc37-8d21ced723e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:56.566447 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8f67bca3-fbf7-4586-bc37-8d21ced723e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:56.587212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67bca3-fbf7-4586-bc37-8d21ced723e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:56.589881 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67bca3-fbf7-4586-bc37-8d21ced723e9 service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:56.607223 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3465/7000] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:20:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:20:57.511573 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d048da0-3682-4ac9-b445-5199e2c53fe9 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:57.513160 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4d048da0-3682-4ac9-b445-5199e2c53fe9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:57.530750 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d048da0-3682-4ac9-b445-5199e2c53fe9 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:57.548521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c2a32-baf0-4af9-befa-8c398491767c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:57.549176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c2a32-baf0-4af9-befa-8c398491767c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:57.549869 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c2a32-baf0-4af9-befa-8c398491767c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:57.550375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c2a32-baf0-4af9-befa-8c398491767c admin admin] PATH_INFO: `/v3/projects/0cc60bd15a3d41bfab4169351e1bfcb1` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:57.552172 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c2a32-baf0-4af9-befa-8c398491767c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cc60bd15a3d41bfab4169351e1bfcb1)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:57.554193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c2a32-baf0-4af9-befa-8c398491767c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:57.636856 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7b3c2a32-baf0-4af9-befa-8c398491767c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cc60bd15a3d41bfab4169351e1bfcb1', 'request_id': 'req-7b3c2a32-baf0-4af9-befa-8c398491767c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:57.644154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7b3c2a32-baf0-4af9-befa-8c398491767c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cc60bd15a3d41bfab4169351e1bfcb1', 'request_id': 'req-7b3c2a32-baf0-4af9-befa-8c398491767c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:57.660652 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7b3c2a32-baf0-4af9-befa-8c398491767c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cc60bd15a3d41bfab4169351e1bfcb1', 'request_id': 'req-7b3c2a32-baf0-4af9-befa-8c398491767c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:57.689373 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7b3c2a32-baf0-4af9-befa-8c398491767c admin admin] The token cache is being invalidate because project 0cc60bd15a3d41bfab4169351e1bfcb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:20:57.691188 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7b3c2a32-baf0-4af9-befa-8c398491767c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:57.692055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7b3c2a32-baf0-4af9-befa-8c398491767c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:57.694609 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3536/7001] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:20:57 2022] DELETE /identity/v3/projects/0cc60bd15a3d41bfab4169351e1bfcb1 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:20:57.698396 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67bca3-fbf7-4586-bc37-8d21ced723e9 service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:57.710514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67bca3-fbf7-4586-bc37-8d21ced723e9 service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:57.773091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:57.810381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a46d2a-1324-4a2d-8300-c1fe1e86a468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:57.811875 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a46d2a-1324-4a2d-8300-c1fe1e86a468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:57.812438 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a46d2a-1324-4a2d-8300-c1fe1e86a468 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:57.813219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a46d2a-1324-4a2d-8300-c1fe1e86a468 admin admin] PATH_INFO: `/v3/users/08b228bac87e4cf1a4c1248f9256a2c4` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:57.815779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a46d2a-1324-4a2d-8300-c1fe1e86a468 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08b228bac87e4cf1a4c1248f9256a2c4)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:57.821933 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a46d2a-1324-4a2d-8300-c1fe1e86a468 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:57.920411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-44a46d2a-1324-4a2d-8300-c1fe1e86a468 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08b228bac87e4cf1a4c1248f9256a2c4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:57.921795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-44a46d2a-1324-4a2d-8300-c1fe1e86a468 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08b228bac87e4cf1a4c1248f9256a2c4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:57.922443 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-44a46d2a-1324-4a2d-8300-c1fe1e86a468 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08b228bac87e4cf1a4c1248f9256a2c4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:57.933357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-44a46d2a-1324-4a2d-8300-c1fe1e86a468 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08b228bac87e4cf1a4c1248f9256a2c4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:57.949612 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-44a46d2a-1324-4a2d-8300-c1fe1e86a468 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08b228bac87e4cf1a4c1248f9256a2c4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:57.970603 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3466/7002] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:20:57 2022] DELETE /identity/v3/users/08b228bac87e4cf1a4c1248f9256a2c4 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:20:58.467583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c2a32-baf0-4af9-befa-8c398491767c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:58.469320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7b3c2a32-baf0-4af9-befa-8c398491767c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:58.484544 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c2a32-baf0-4af9-befa-8c398491767c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:58.525045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:58.562053 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382eab58-b0db-411a-99f9-17ddf6591e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:58.562728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382eab58-b0db-411a-99f9-17ddf6591e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:58.563004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382eab58-b0db-411a-99f9-17ddf6591e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:58.563469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382eab58-b0db-411a-99f9-17ddf6591e60 admin admin] PATH_INFO: `/v3/projects/0b2ea668851743c8b757989504257549` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:58.564598 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382eab58-b0db-411a-99f9-17ddf6591e60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b2ea668851743c8b757989504257549)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:58.567541 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382eab58-b0db-411a-99f9-17ddf6591e60 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:58.643801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-382eab58-b0db-411a-99f9-17ddf6591e60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b2ea668851743c8b757989504257549', 'request_id': 'req-382eab58-b0db-411a-99f9-17ddf6591e60'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:58.651084 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-382eab58-b0db-411a-99f9-17ddf6591e60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b2ea668851743c8b757989504257549', 'request_id': 'req-382eab58-b0db-411a-99f9-17ddf6591e60'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:58.665663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-382eab58-b0db-411a-99f9-17ddf6591e60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b2ea668851743c8b757989504257549', 'request_id': 'req-382eab58-b0db-411a-99f9-17ddf6591e60'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:58.696445 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-382eab58-b0db-411a-99f9-17ddf6591e60 admin admin] The token cache is being invalidate because project 0b2ea668851743c8b757989504257549 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:20:58.696872 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-382eab58-b0db-411a-99f9-17ddf6591e60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:58.698212 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-382eab58-b0db-411a-99f9-17ddf6591e60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:20:58.700593 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3537/7003] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:20:58 2022] DELETE /identity/v3/projects/0b2ea668851743c8b757989504257549 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:20:58.706070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc0900-b1bc-470b-9d43-7be8668b3ea3 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:58.706982 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc0900-b1bc-470b-9d43-7be8668b3ea3 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:58.707593 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc0900-b1bc-470b-9d43-7be8668b3ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:58.741414 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-6cdc0900-b1bc-470b-9d43-7be8668b3ea3 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:58.743563 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6cdc0900-b1bc-470b-9d43-7be8668b3ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:58.849677 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3467/7004] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:20:58.851182 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3a616-be59-4337-9ad2-47991feb1fb8 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:58.851507 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3a616-be59-4337-9ad2-47991feb1fb8 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:58.851771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3a616-be59-4337-9ad2-47991feb1fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:58.878462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-47d3a616-be59-4337-9ad2-47991feb1fb8 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:58.886980 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-47d3a616-be59-4337-9ad2-47991feb1fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:58.894118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc0900-b1bc-470b-9d43-7be8668b3ea3 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:58.894659 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3538/7005] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:20:58.907793 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc0900-b1bc-470b-9d43-7be8668b3ea3 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:58.913498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd750ffb-9e04-46ff-8bc1-d4609206e910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:58.914362 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd750ffb-9e04-46ff-8bc1-d4609206e910 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:58.914823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd750ffb-9e04-46ff-8bc1-d4609206e910 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:58.915273 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd750ffb-9e04-46ff-8bc1-d4609206e910 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:58.915919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd750ffb-9e04-46ff-8bc1-d4609206e910 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:20:58.916368 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd750ffb-9e04-46ff-8bc1-d4609206e910 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:58.918165 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd750ffb-9e04-46ff-8bc1-d4609206e910 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:58.940573 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3a616-be59-4337-9ad2-47991feb1fb8 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:58.948750 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3468/7006] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:20:58.954376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3a616-be59-4337-9ad2-47991feb1fb8 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:58.961372 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a76fb1-7e49-47f4-90e2-b04cfe35778e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:58.962666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a76fb1-7e49-47f4-90e2-b04cfe35778e admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:58.962666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a76fb1-7e49-47f4-90e2-b04cfe35778e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:58.962666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a76fb1-7e49-47f4-90e2-b04cfe35778e admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:58.963294 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a76fb1-7e49-47f4-90e2-b04cfe35778e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:58.965233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a76fb1-7e49-47f4-90e2-b04cfe35778e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:59.008635 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3539/7007] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:20:58 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:20:59.014794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd750ffb-9e04-46ff-8bc1-d4609206e910 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:59.026865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd750ffb-9e04-46ff-8bc1-d4609206e910 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:59.102500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:59.136950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c8543-fb49-4e43-a9d2-28c3c3d1a176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:59.139923 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c8543-fb49-4e43-a9d2-28c3c3d1a176 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:59.140188 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c8543-fb49-4e43-a9d2-28c3c3d1a176 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:59.140450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c8543-fb49-4e43-a9d2-28c3c3d1a176 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:59.141136 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c8543-fb49-4e43-a9d2-28c3c3d1a176 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:59.143732 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c8543-fb49-4e43-a9d2-28c3c3d1a176 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:59.184751 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3469/7008] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:20:59 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:20:59.189373 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a76fb1-7e49-47f4-90e2-b04cfe35778e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:59.204507 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a76fb1-7e49-47f4-90e2-b04cfe35778e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:59.211126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5671fe-e754-441c-9b05-5a4a3265d05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:59.211764 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5671fe-e754-441c-9b05-5a4a3265d05c admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:59.212125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5671fe-e754-441c-9b05-5a4a3265d05c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:59.212322 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5671fe-e754-441c-9b05-5a4a3265d05c admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:59.213031 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5671fe-e754-441c-9b05-5a4a3265d05c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:59.214663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5671fe-e754-441c-9b05-5a4a3265d05c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:59.226883 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3540/7009] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:20:59.230698 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c8543-fb49-4e43-a9d2-28c3c3d1a176 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:59.248097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c8543-fb49-4e43-a9d2-28c3c3d1a176 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:59.253789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4705e4-d4a0-4729-95ec-4fcb2f011cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:59.254709 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4705e4-d4a0-4729-95ec-4fcb2f011cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:59.254925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4705e4-d4a0-4729-95ec-4fcb2f011cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:59.255246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4705e4-d4a0-4729-95ec-4fcb2f011cb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:59.255935 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4705e4-d4a0-4729-95ec-4fcb2f011cb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:59.257571 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4705e4-d4a0-4729-95ec-4fcb2f011cb7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:59.271841 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3470/7010] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:20:59.276311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5671fe-e754-441c-9b05-5a4a3265d05c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:59.288734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5671fe-e754-441c-9b05-5a4a3265d05c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:59.294900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25df386-c4d9-4e40-9324-1bede5986a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:59.295779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25df386-c4d9-4e40-9324-1bede5986a3c admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:59.295981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25df386-c4d9-4e40-9324-1bede5986a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:59.296877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25df386-c4d9-4e40-9324-1bede5986a3c admin admin] PATH_INFO: `/v3/projects/62156a69d4aa4b5594705bfb60922e67/users/244cbb103e3c494aa02b72fe321ca76f/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:59.315175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25df386-c4d9-4e40-9324-1bede5986a3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=62156a69d4aa4b5594705bfb60922e67, user_id=244cbb103e3c494aa02b72fe321ca76f, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:59.317871 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25df386-c4d9-4e40-9324-1bede5986a3c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:59.338839 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3541/7011] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:20:59 2022] PUT /identity/v3/projects/62156a69d4aa4b5594705bfb60922e67/users/244cbb103e3c494aa02b72fe321ca76f/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:20:59.352514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ae235-553d-4bfc-940d-ec4448070c22 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:59.353000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ae235-553d-4bfc-940d-ec4448070c22 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:59.353919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ae235-553d-4bfc-940d-ec4448070c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:59.386201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-817ae235-553d-4bfc-940d-ec4448070c22 None None] MFA Rules not processed for user `244cbb103e3c494aa02b72fe321ca76f`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:20:59.387689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-817ae235-553d-4bfc-940d-ec4448070c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:59.487310 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3471/7012] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:20:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:20:59.506331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25df386-c4d9-4e40-9324-1bede5986a3c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:20:59.508052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c25df386-c4d9-4e40-9324-1bede5986a3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:20:59.580079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25df386-c4d9-4e40-9324-1bede5986a3c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:20:59.584084 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431d8b6-e371-4c1f-885c-7478fe59cabc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:20:59.584917 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431d8b6-e371-4c1f-885c-7478fe59cabc service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:20:59.585199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431d8b6-e371-4c1f-885c-7478fe59cabc service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:20:59.585482 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431d8b6-e371-4c1f-885c-7478fe59cabc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:20:59.596920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431d8b6-e371-4c1f-885c-7478fe59cabc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:20:59.600624 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431d8b6-e371-4c1f-885c-7478fe59cabc service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:20:59.606537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:59.614102 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3542/7013] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:20:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:03.610256 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ae235-553d-4bfc-940d-ec4448070c22 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:03.612294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-817ae235-553d-4bfc-940d-ec4448070c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:03.807124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ae235-553d-4bfc-940d-ec4448070c22 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:03.823301 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69365e7b-0560-4e3f-a271-b209443a9df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:03.824352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69365e7b-0560-4e3f-a271-b209443a9df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:03.824805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69365e7b-0560-4e3f-a271-b209443a9df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:03.825240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69365e7b-0560-4e3f-a271-b209443a9df6 admin admin] PATH_INFO: `/v3/users/ad9361a4a0c94034b5010bd2ab6d613d` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:03.828629 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69365e7b-0560-4e3f-a271-b209443a9df6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad9361a4a0c94034b5010bd2ab6d613d)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:03.832676 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69365e7b-0560-4e3f-a271-b209443a9df6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:03.927598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-69365e7b-0560-4e3f-a271-b209443a9df6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad9361a4a0c94034b5010bd2ab6d613d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:03.928275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-69365e7b-0560-4e3f-a271-b209443a9df6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad9361a4a0c94034b5010bd2ab6d613d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:03.928902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-69365e7b-0560-4e3f-a271-b209443a9df6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad9361a4a0c94034b5010bd2ab6d613d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:03.944687 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-69365e7b-0560-4e3f-a271-b209443a9df6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad9361a4a0c94034b5010bd2ab6d613d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:03.958025 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:03.969146 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-69365e7b-0560-4e3f-a271-b209443a9df6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad9361a4a0c94034b5010bd2ab6d613d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:03.995486 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3472/7014] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:21:03 2022] DELETE /identity/v3/users/ad9361a4a0c94034b5010bd2ab6d613d => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:04.001115 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1599f8-1ce9-45e3-835e-0e1f98bbab4e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:04.002050 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1599f8-1ce9-45e3-835e-0e1f98bbab4e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:04.002496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1599f8-1ce9-45e3-835e-0e1f98bbab4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:04.039874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-4c1599f8-1ce9-45e3-835e-0e1f98bbab4e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:04.041339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4c1599f8-1ce9-45e3-835e-0e1f98bbab4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:04.165256 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3543/7015] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:04.177495 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69365e7b-0560-4e3f-a271-b209443a9df6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:04.180522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-69365e7b-0560-4e3f-a271-b209443a9df6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:04.297096 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69365e7b-0560-4e3f-a271-b209443a9df6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:04.301180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b3a80-f467-43bf-ad2e-7e9fc1672b40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:04.301680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b3a80-f467-43bf-ad2e-7e9fc1672b40 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:04.301965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b3a80-f467-43bf-ad2e-7e9fc1672b40 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:04.302244 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b3a80-f467-43bf-ad2e-7e9fc1672b40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:04.315581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b3a80-f467-43bf-ad2e-7e9fc1672b40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:04.317072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b3a80-f467-43bf-ad2e-7e9fc1672b40 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:04.331785 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3473/7016] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:04.762072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1599f8-1ce9-45e3-835e-0e1f98bbab4e None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:04.764867 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4c1599f8-1ce9-45e3-835e-0e1f98bbab4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:04.783323 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1599f8-1ce9-45e3-835e-0e1f98bbab4e None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:04.808212 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a70354-c58c-41bb-ab3a-fe766b3601e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:04.809360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a70354-c58c-41bb-ab3a-fe766b3601e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:04.809832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a70354-c58c-41bb-ab3a-fe766b3601e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:04.810506 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a70354-c58c-41bb-ab3a-fe766b3601e1 admin admin] PATH_INFO: `/v3/projects/92773208ca8844d9b32b6c4e2be2b0ce` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:04.813063 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a70354-c58c-41bb-ab3a-fe766b3601e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92773208ca8844d9b32b6c4e2be2b0ce)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:04.815452 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a70354-c58c-41bb-ab3a-fe766b3601e1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:04.893715 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b5a70354-c58c-41bb-ab3a-fe766b3601e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92773208ca8844d9b32b6c4e2be2b0ce', 'request_id': 'req-b5a70354-c58c-41bb-ab3a-fe766b3601e1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:04.906157 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b5a70354-c58c-41bb-ab3a-fe766b3601e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92773208ca8844d9b32b6c4e2be2b0ce', 'request_id': 'req-b5a70354-c58c-41bb-ab3a-fe766b3601e1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:04.917763 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b5a70354-c58c-41bb-ab3a-fe766b3601e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92773208ca8844d9b32b6c4e2be2b0ce', 'request_id': 'req-b5a70354-c58c-41bb-ab3a-fe766b3601e1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:04.933461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b5a70354-c58c-41bb-ab3a-fe766b3601e1 admin admin] The token cache is being invalidate because project 92773208ca8844d9b32b6c4e2be2b0ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:21:04.933773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b5a70354-c58c-41bb-ab3a-fe766b3601e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:04.934512 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b5a70354-c58c-41bb-ab3a-fe766b3601e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:04.937953 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3544/7017] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:21:04 2022] DELETE /identity/v3/projects/92773208ca8844d9b32b6c4e2be2b0ce => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:04.942157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b3a80-f467-43bf-ad2e-7e9fc1672b40 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:04.956048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b3a80-f467-43bf-ad2e-7e9fc1672b40 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:05.077437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add649c-5d9a-4309-868a-988f86206cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:05.078097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add649c-5d9a-4309-868a-988f86206cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:05.078380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add649c-5d9a-4309-868a-988f86206cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:05.078691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add649c-5d9a-4309-868a-988f86206cd6 admin admin] PATH_INFO: `/v3/users/b415b9ddf80b4f30a8df0a74f5e4b1d9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:05.081616 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add649c-5d9a-4309-868a-988f86206cd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b415b9ddf80b4f30a8df0a74f5e4b1d9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:05.083815 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add649c-5d9a-4309-868a-988f86206cd6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:05.190617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0add649c-5d9a-4309-868a-988f86206cd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b415b9ddf80b4f30a8df0a74f5e4b1d9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:05.191180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0add649c-5d9a-4309-868a-988f86206cd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b415b9ddf80b4f30a8df0a74f5e4b1d9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:05.193838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0add649c-5d9a-4309-868a-988f86206cd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b415b9ddf80b4f30a8df0a74f5e4b1d9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:05.215270 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0add649c-5d9a-4309-868a-988f86206cd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b415b9ddf80b4f30a8df0a74f5e4b1d9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:05.244888 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0add649c-5d9a-4309-868a-988f86206cd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b415b9ddf80b4f30a8df0a74f5e4b1d9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:05.259959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:05.273188 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3474/7018] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:21:04 2022] DELETE /identity/v3/users/b415b9ddf80b4f30a8df0a74f5e4b1d9 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:06.235000 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a70354-c58c-41bb-ab3a-fe766b3601e1 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:06.241519 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b5a70354-c58c-41bb-ab3a-fe766b3601e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:06.263012 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a70354-c58c-41bb-ab3a-fe766b3601e1 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:06.276019 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add649c-5d9a-4309-868a-988f86206cd6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:06.278931 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0add649c-5d9a-4309-868a-988f86206cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:06.346391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c1807-d880-4e0e-8a26-ec90819dd8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:06.347666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c1807-d880-4e0e-8a26-ec90819dd8fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:06.348251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c1807-d880-4e0e-8a26-ec90819dd8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:06.348741 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c1807-d880-4e0e-8a26-ec90819dd8fc admin admin] PATH_INFO: `/v3/users/b8bb8e1b5005491186ce77625c4a6d3c` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:06.352375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c1807-d880-4e0e-8a26-ec90819dd8fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8bb8e1b5005491186ce77625c4a6d3c)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:06.357932 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c1807-d880-4e0e-8a26-ec90819dd8fc admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:06.381792 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add649c-5d9a-4309-868a-988f86206cd6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:06.387344 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba629de-a3a3-44d7-95ed-b3a72ee0f219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:06.388424 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba629de-a3a3-44d7-95ed-b3a72ee0f219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:06.389647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba629de-a3a3-44d7-95ed-b3a72ee0f219 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:06.390104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba629de-a3a3-44d7-95ed-b3a72ee0f219 admin admin] PATH_INFO: `/v3/projects/0e8149021087412a9bd359344ed72911` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:06.391725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba629de-a3a3-44d7-95ed-b3a72ee0f219 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e8149021087412a9bd359344ed72911)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:06.393986 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba629de-a3a3-44d7-95ed-b3a72ee0f219 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:06.404657 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:06.434946 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7a6c1807-d880-4e0e-8a26-ec90819dd8fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8bb8e1b5005491186ce77625c4a6d3c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:06.446367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7a6c1807-d880-4e0e-8a26-ec90819dd8fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8bb8e1b5005491186ce77625c4a6d3c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:06.451415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7a6c1807-d880-4e0e-8a26-ec90819dd8fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8bb8e1b5005491186ce77625c4a6d3c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:06.452536 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7a6c1807-d880-4e0e-8a26-ec90819dd8fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8bb8e1b5005491186ce77625c4a6d3c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:06.465537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7a6c1807-d880-4e0e-8a26-ec90819dd8fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8bb8e1b5005491186ce77625c4a6d3c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:06.472187 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9ba629de-a3a3-44d7-95ed-b3a72ee0f219 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e8149021087412a9bd359344ed72911', 'request_id': 'req-9ba629de-a3a3-44d7-95ed-b3a72ee0f219'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:06.489371 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9ba629de-a3a3-44d7-95ed-b3a72ee0f219 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e8149021087412a9bd359344ed72911', 'request_id': 'req-9ba629de-a3a3-44d7-95ed-b3a72ee0f219'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:06.489999 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3545/7019] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:21:06 2022] DELETE /identity/v3/users/b8bb8e1b5005491186ce77625c4a6d3c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:06.494376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b558d-fb78-4cfb-b9ec-62585b2f2898 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:06.494795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b558d-fb78-4cfb-b9ec-62585b2f2898 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:06.495073 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b558d-fb78-4cfb-b9ec-62585b2f2898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:06.503164 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9ba629de-a3a3-44d7-95ed-b3a72ee0f219 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e8149021087412a9bd359344ed72911', 'request_id': 'req-9ba629de-a3a3-44d7-95ed-b3a72ee0f219'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:06.524986 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-ef0b558d-fb78-4cfb-b9ec-62585b2f2898 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:06.525305 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9ba629de-a3a3-44d7-95ed-b3a72ee0f219 admin admin] The token cache is being invalidate because project 0e8149021087412a9bd359344ed72911 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:21:06.526517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ef0b558d-fb78-4cfb-b9ec-62585b2f2898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:06.526690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9ba629de-a3a3-44d7-95ed-b3a72ee0f219 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:06.532629 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9ba629de-a3a3-44d7-95ed-b3a72ee0f219 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:06.534539 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3475/7020] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:21:06 2022] DELETE /identity/v3/projects/0e8149021087412a9bd359344ed72911 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:06.539729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a661e-234f-4336-8588-f4e6c40a6213 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:06.540005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a661e-234f-4336-8588-f4e6c40a6213 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:06.540297 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a661e-234f-4336-8588-f4e6c40a6213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:06.573802 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-1f9a661e-234f-4336-8588-f4e6c40a6213 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:06.576047 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1f9a661e-234f-4336-8588-f4e6c40a6213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:06.634440 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3546/7021] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:06.656406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b558d-fb78-4cfb-b9ec-62585b2f2898 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:06.661104 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ef0b558d-fb78-4cfb-b9ec-62585b2f2898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:06.714753 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3476/7022] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:21:06.718338 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344da6d5-0142-4c5c-bcbf-52e81213a4f4 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:06.718759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344da6d5-0142-4c5c-bcbf-52e81213a4f4 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:06.719129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344da6d5-0142-4c5c-bcbf-52e81213a4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:06.773725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-344da6d5-0142-4c5c-bcbf-52e81213a4f4 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:06.790227 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-344da6d5-0142-4c5c-bcbf-52e81213a4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:06.791371 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b558d-fb78-4cfb-b9ec-62585b2f2898 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:06.801263 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7fc91-5334-46df-8917-b49ce86edcf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:06.803342 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7fc91-5334-46df-8917-b49ce86edcf2 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:06.807449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7fc91-5334-46df-8917-b49ce86edcf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:06.808108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7fc91-5334-46df-8917-b49ce86edcf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:06.825206 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3477/7023] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:06.826327 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344da6d5-0142-4c5c-bcbf-52e81213a4f4 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:06.847221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344da6d5-0142-4c5c-bcbf-52e81213a4f4 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:06.852271 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e7fc91-5334-46df-8917-b49ce86edcf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:06.861099 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e7fc91-5334-46df-8917-b49ce86edcf2 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:06.867322 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fba7f-c13c-4a5f-8abb-c314e83acadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:06.868381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fba7f-c13c-4a5f-8abb-c314e83acadd admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:06.868761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fba7f-c13c-4a5f-8abb-c314e83acadd admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:06.869132 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fba7f-c13c-4a5f-8abb-c314e83acadd admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:06.869953 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602fba7f-c13c-4a5f-8abb-c314e83acadd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:21:06.870362 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602fba7f-c13c-4a5f-8abb-c314e83acadd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:06.876963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602fba7f-c13c-4a5f-8abb-c314e83acadd admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:06.895174 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3478/7024] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:21:06.899984 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fba7f-c13c-4a5f-8abb-c314e83acadd admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:06.902489 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3547/7025] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:06.916207 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fba7f-c13c-4a5f-8abb-c314e83acadd admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:06.923516 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890284c-6c4c-46e6-92e8-269192082cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:06.924495 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890284c-6c4c-46e6-92e8-269192082cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:06.924959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890284c-6c4c-46e6-92e8-269192082cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:06.925335 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890284c-6c4c-46e6-92e8-269192082cb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:06.926133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890284c-6c4c-46e6-92e8-269192082cb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:06.931308 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890284c-6c4c-46e6-92e8-269192082cb2 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:06.950110 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:06.985564 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3479/7026] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:21:06 2022] POST /identity/v3/projects => generated 383 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:06.990969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7fc91-5334-46df-8917-b49ce86edcf2 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:07.010680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7fc91-5334-46df-8917-b49ce86edcf2 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:07.084813 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:07.120153 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7bd8fd-f316-452d-a932-630c7eb0ae55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:07.121023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bd8fd-f316-452d-a932-630c7eb0ae55 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:07.121434 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bd8fd-f316-452d-a932-630c7eb0ae55 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:07.121813 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bd8fd-f316-452d-a932-630c7eb0ae55 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:07.123142 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7bd8fd-f316-452d-a932-630c7eb0ae55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:07.125321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7bd8fd-f316-452d-a932-630c7eb0ae55 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:07.164698 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3548/7027] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:21:06 2022] POST /identity/v3/users => generated 292 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:07.169936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890284c-6c4c-46e6-92e8-269192082cb2 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:07.190869 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890284c-6c4c-46e6-92e8-269192082cb2 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:07.198665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f61463-9d1f-48f0-bfee-850d8199b367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:07.199403 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f61463-9d1f-48f0-bfee-850d8199b367 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:07.200001 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f61463-9d1f-48f0-bfee-850d8199b367 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:07.200385 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f61463-9d1f-48f0-bfee-850d8199b367 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:07.202285 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f61463-9d1f-48f0-bfee-850d8199b367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:07.204568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f61463-9d1f-48f0-bfee-850d8199b367 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:07.224212 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3480/7028] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:07.228729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7bd8fd-f316-452d-a932-630c7eb0ae55 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:07.247899 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7bd8fd-f316-452d-a932-630c7eb0ae55 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:07.262010 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21295f48-fd7e-4a5f-a103-0d3c98ebfb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:07.263029 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21295f48-fd7e-4a5f-a103-0d3c98ebfb53 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:07.263635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21295f48-fd7e-4a5f-a103-0d3c98ebfb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:07.264058 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21295f48-fd7e-4a5f-a103-0d3c98ebfb53 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:07.265567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21295f48-fd7e-4a5f-a103-0d3c98ebfb53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:07.267529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21295f48-fd7e-4a5f-a103-0d3c98ebfb53 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:07.284618 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3549/7029] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:07.285569 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f61463-9d1f-48f0-bfee-850d8199b367 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:07.301667 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f61463-9d1f-48f0-bfee-850d8199b367 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:07.313808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a232c-50cf-4dc6-9717-7be8424f2da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:07.315035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a232c-50cf-4dc6-9717-7be8424f2da7 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:07.315792 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a232c-50cf-4dc6-9717-7be8424f2da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:07.316434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a232c-50cf-4dc6-9717-7be8424f2da7 admin admin] PATH_INFO: `/v3/projects/c0d1d87d67b04288b9180302370543a4/users/28d291870b6444a79541df94ae90cec5/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:07.337236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a232c-50cf-4dc6-9717-7be8424f2da7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0d1d87d67b04288b9180302370543a4, user_id=28d291870b6444a79541df94ae90cec5, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:07.340955 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a232c-50cf-4dc6-9717-7be8424f2da7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:07.352686 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21295f48-fd7e-4a5f-a103-0d3c98ebfb53 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:07.355056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-21295f48-fd7e-4a5f-a103-0d3c98ebfb53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:07.374931 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3481/7030] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:07 2022] PUT /identity/v3/projects/c0d1d87d67b04288b9180302370543a4/users/28d291870b6444a79541df94ae90cec5/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:07.378783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21295f48-fd7e-4a5f-a103-0d3c98ebfb53 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:07.387994 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e5833-dc58-4893-975b-ed48c4acc4da None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:07.389253 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e5833-dc58-4893-975b-ed48c4acc4da None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:07.389881 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e5833-dc58-4893-975b-ed48c4acc4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:07.449833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d22e5833-dc58-4893-975b-ed48c4acc4da None None] MFA Rules not processed for user `28d291870b6444a79541df94ae90cec5`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:07.451586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d22e5833-dc58-4893-975b-ed48c4acc4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:07.514459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8756e-5a8f-45f7-94d4-45c6837cc766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:07.515233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8756e-5a8f-45f7-94d4-45c6837cc766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:07.515738 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8756e-5a8f-45f7-94d4-45c6837cc766 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:07.516067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8756e-5a8f-45f7-94d4-45c6837cc766 admin admin] PATH_INFO: `/v3/projects/bd968c30757a4d1692fba7c550e14af1` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:07.517289 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8756e-5a8f-45f7-94d4-45c6837cc766 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd968c30757a4d1692fba7c550e14af1)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:07.520465 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8756e-5a8f-45f7-94d4-45c6837cc766 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:07.555303 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3482/7031] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:21:07.559417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e5833-dc58-4893-975b-ed48c4acc4da None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:07.576200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e5833-dc58-4893-975b-ed48c4acc4da None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:07.585641 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fbb8756e-5a8f-45f7-94d4-45c6837cc766 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd968c30757a4d1692fba7c550e14af1', 'request_id': 'req-fbb8756e-5a8f-45f7-94d4-45c6837cc766'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:07.595340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fbb8756e-5a8f-45f7-94d4-45c6837cc766 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd968c30757a4d1692fba7c550e14af1', 'request_id': 'req-fbb8756e-5a8f-45f7-94d4-45c6837cc766'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:07.609553 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fbb8756e-5a8f-45f7-94d4-45c6837cc766 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd968c30757a4d1692fba7c550e14af1', 'request_id': 'req-fbb8756e-5a8f-45f7-94d4-45c6837cc766'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:07.624441 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fbb8756e-5a8f-45f7-94d4-45c6837cc766 admin admin] The token cache is being invalidate because project bd968c30757a4d1692fba7c550e14af1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:21:07.624785 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fbb8756e-5a8f-45f7-94d4-45c6837cc766 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:07.625477 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fbb8756e-5a8f-45f7-94d4-45c6837cc766 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:07.627275 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3550/7032] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:21:07 2022] DELETE /identity/v3/projects/bd968c30757a4d1692fba7c550e14af1 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:21:07.633247 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9eaed-2251-405b-b01c-52687dc998a9 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:07.634081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9eaed-2251-405b-b01c-52687dc998a9 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:07.634232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9eaed-2251-405b-b01c-52687dc998a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:07.657748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-dec9eaed-2251-405b-b01c-52687dc998a9 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:07.659185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-dec9eaed-2251-405b-b01c-52687dc998a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:07.670879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac83f9a-d95e-4777-900c-af68ed1f2ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:07.670879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac83f9a-d95e-4777-900c-af68ed1f2ef3 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:07.670879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac83f9a-d95e-4777-900c-af68ed1f2ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:07.670879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac83f9a-d95e-4777-900c-af68ed1f2ef3 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:07.671332 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac83f9a-d95e-4777-900c-af68ed1f2ef3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:07.671693 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac83f9a-d95e-4777-900c-af68ed1f2ef3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:07.704880 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3483/7033] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:21:07 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:21:07.709016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac83f9a-d95e-4777-900c-af68ed1f2ef3 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:07.710900 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9ac83f9a-d95e-4777-900c-af68ed1f2ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:07.724412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:07.738602 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3551/7034] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:07.746653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b43d6-1203-460c-8102-270e4102dda8 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:07.747311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b43d6-1203-460c-8102-270e4102dda8 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:07.747787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b43d6-1203-460c-8102-270e4102dda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:07.758208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:07.771950 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-3c1b43d6-1203-460c-8102-270e4102dda8 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:07.774645 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3c1b43d6-1203-460c-8102-270e4102dda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:07.805810 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac83f9a-d95e-4777-900c-af68ed1f2ef3 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:07.813773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8d31b-b9f0-4920-bcdc-6e2e60c0d5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:07.814340 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8d31b-b9f0-4920-bcdc-6e2e60c0d5c4 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:07.814650 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8d31b-b9f0-4920-bcdc-6e2e60c0d5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:07.814925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8d31b-b9f0-4920-bcdc-6e2e60c0d5c4 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:07.815737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb8d31b-b9f0-4920-bcdc-6e2e60c0d5c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:07.818738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb8d31b-b9f0-4920-bcdc-6e2e60c0d5c4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:07.849957 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3484/7035] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:21:07 2022] POST /identity/v3/users => generated 299 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:21:07.853657 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8d31b-b9f0-4920-bcdc-6e2e60c0d5c4 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:07.862591 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3552/7036] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:21:07.866118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8d31b-b9f0-4920-bcdc-6e2e60c0d5c4 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:07.867125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b43d6-1203-460c-8102-270e4102dda8 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:07.871214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb46e5-50fe-430a-a513-c7d9e26c566f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:07.871934 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb46e5-50fe-430a-a513-c7d9e26c566f admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:07.872843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb46e5-50fe-430a-a513-c7d9e26c566f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:07.873496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb46e5-50fe-430a-a513-c7d9e26c566f admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:07.874482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb46e5-50fe-430a-a513-c7d9e26c566f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:07.876134 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb46e5-50fe-430a-a513-c7d9e26c566f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:07.879906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b43d6-1203-460c-8102-270e4102dda8 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:07.886257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b60567-a108-468f-8ab1-df01215d229a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:07.887085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b60567-a108-468f-8ab1-df01215d229a admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:07.887485 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3485/7037] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:21:07.887652 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b60567-a108-468f-8ab1-df01215d229a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:07.888723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b60567-a108-468f-8ab1-df01215d229a admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:07.890037 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b60567-a108-468f-8ab1-df01215d229a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:21:07.890037 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b60567-a108-468f-8ab1-df01215d229a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:07.891286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b60567-a108-468f-8ab1-df01215d229a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:07.892839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb46e5-50fe-430a-a513-c7d9e26c566f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:07.904362 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb46e5-50fe-430a-a513-c7d9e26c566f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:07.904595 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3553/7038] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:21:07.908878 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b60567-a108-468f-8ab1-df01215d229a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:07.913097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeaa029-0866-4f39-9eac-9f6b3ce34111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:07.913097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeaa029-0866-4f39-9eac-9f6b3ce34111 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:07.913097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeaa029-0866-4f39-9eac-9f6b3ce34111 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:07.913373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeaa029-0866-4f39-9eac-9f6b3ce34111 admin admin] PATH_INFO: `/v3/projects/30849d2db00549bdb8a4a42e56594598/users/99f6921ccf8a443d89e62259402b415a/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:07.920705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b60567-a108-468f-8ab1-df01215d229a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:07.926067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16088d-c438-4bc7-902a-4d6a281ff3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:07.926838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16088d-c438-4bc7-902a-4d6a281ff3e3 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:07.927120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16088d-c438-4bc7-902a-4d6a281ff3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:07.927393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16088d-c438-4bc7-902a-4d6a281ff3e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:07.928011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16088d-c438-4bc7-902a-4d6a281ff3e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:07.929364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeaa029-0866-4f39-9eac-9f6b3ce34111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30849d2db00549bdb8a4a42e56594598, user_id=99f6921ccf8a443d89e62259402b415a, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:07.929905 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16088d-c438-4bc7-902a-4d6a281ff3e3 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:07.932288 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeaa029-0866-4f39-9eac-9f6b3ce34111 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:07.948793 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3486/7039] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:07 2022] PUT /identity/v3/projects/30849d2db00549bdb8a4a42e56594598/users/99f6921ccf8a443d89e62259402b415a/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:21:07.954526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeaa029-0866-4f39-9eac-9f6b3ce34111 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:07.967949 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3554/7040] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:21:07 2022] POST /identity/v3/projects => generated 365 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:21:07.969547 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16088d-c438-4bc7-902a-4d6a281ff3e3 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:08.037984 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeaa029-0866-4f39-9eac-9f6b3ce34111 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:08.084023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16088d-c438-4bc7-902a-4d6a281ff3e3 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:08.089266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a97d2-b80f-4c43-87f3-e51eb815f3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:08.089877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a97d2-b80f-4c43-87f3-e51eb815f3e7 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:08.090434 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a97d2-b80f-4c43-87f3-e51eb815f3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:08.090759 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a97d2-b80f-4c43-87f3-e51eb815f3e7 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:08.091815 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a97d2-b80f-4c43-87f3-e51eb815f3e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:08.093748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a97d2-b80f-4c43-87f3-e51eb815f3e7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:08.108416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5369346-ecd4-4f45-a202-17d20edfa1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:08.108701 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5369346-ecd4-4f45-a202-17d20edfa1cd admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:08.109104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5369346-ecd4-4f45-a202-17d20edfa1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:08.109468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5369346-ecd4-4f45-a202-17d20edfa1cd admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:08.110278 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5369346-ecd4-4f45-a202-17d20edfa1cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:08.112269 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5369346-ecd4-4f45-a202-17d20edfa1cd admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:08.121303 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3555/7041] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:21:07 2022] POST /identity/v3/users => generated 283 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:08.122378 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a97d2-b80f-4c43-87f3-e51eb815f3e7 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:08.124384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6d6a97d2-b80f-4c43-87f3-e51eb815f3e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:08.128571 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3487/7042] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:21:08.129601 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5369346-ecd4-4f45-a202-17d20edfa1cd admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:08.146436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a97d2-b80f-4c43-87f3-e51eb815f3e7 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:08.147860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5369346-ecd4-4f45-a202-17d20edfa1cd admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:08.159229 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24732380-a1aa-49fa-9b34-a97b6900afb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:08.159229 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24732380-a1aa-49fa-9b34-a97b6900afb9 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:08.159229 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24732380-a1aa-49fa-9b34-a97b6900afb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:08.159229 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24732380-a1aa-49fa-9b34-a97b6900afb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:08.159659 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ceaf7-e022-4dc3-b06c-9aedc56e246d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:08.160301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ceaf7-e022-4dc3-b06c-9aedc56e246d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:08.160609 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ceaf7-e022-4dc3-b06c-9aedc56e246d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:08.160838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ceaf7-e022-4dc3-b06c-9aedc56e246d admin admin] PATH_INFO: `/v3/users/244cbb103e3c494aa02b72fe321ca76f` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:08.161622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24732380-a1aa-49fa-9b34-a97b6900afb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:08.163259 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24732380-a1aa-49fa-9b34-a97b6900afb9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:08.163508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ceaf7-e022-4dc3-b06c-9aedc56e246d admin admin] RBAC: Authorizing `identity:delete_user(user_id=244cbb103e3c494aa02b72fe321ca76f)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:08.168324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ceaf7-e022-4dc3-b06c-9aedc56e246d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:08.182464 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3488/7043] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:08.183389 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24732380-a1aa-49fa-9b34-a97b6900afb9 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:08.198850 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24732380-a1aa-49fa-9b34-a97b6900afb9 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:08.207259 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017122e-08ba-4566-99df-21ff6c1cc8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:08.209037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017122e-08ba-4566-99df-21ff6c1cc8f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:08.209037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017122e-08ba-4566-99df-21ff6c1cc8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:08.209037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017122e-08ba-4566-99df-21ff6c1cc8f1 admin admin] PATH_INFO: `/v3/projects/30849d2db00549bdb8a4a42e56594598/users/99f6921ccf8a443d89e62259402b415a/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:08.211455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c017122e-08ba-4566-99df-21ff6c1cc8f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30849d2db00549bdb8a4a42e56594598, user_id=99f6921ccf8a443d89e62259402b415a, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:08.216689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c017122e-08ba-4566-99df-21ff6c1cc8f1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:08.234793 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3489/7044] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:08 2022] PUT /identity/v3/projects/30849d2db00549bdb8a4a42e56594598/users/99f6921ccf8a443d89e62259402b415a/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:08.243996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017122e-08ba-4566-99df-21ff6c1cc8f1 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:08.244159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:08.244159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a25ceaf7-e022-4dc3-b06c-9aedc56e246d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '244cbb103e3c494aa02b72fe321ca76f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:08.245584 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:08.251475 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a25ceaf7-e022-4dc3-b06c-9aedc56e246d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '244cbb103e3c494aa02b72fe321ca76f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:08.252482 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a25ceaf7-e022-4dc3-b06c-9aedc56e246d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '244cbb103e3c494aa02b72fe321ca76f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:08.253725 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a25ceaf7-e022-4dc3-b06c-9aedc56e246d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '244cbb103e3c494aa02b72fe321ca76f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:08.265317 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a25ceaf7-e022-4dc3-b06c-9aedc56e246d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '244cbb103e3c494aa02b72fe321ca76f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:08.296194 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3556/7045] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:21:08 2022] DELETE /identity/v3/users/244cbb103e3c494aa02b72fe321ca76f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:08.296194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9ef43-e6a8-4cd6-935a-2771bb9554a1 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:08.296194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9ef43-e6a8-4cd6-935a-2771bb9554a1 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:08.296842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9ef43-e6a8-4cd6-935a-2771bb9554a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:08.330637 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017122e-08ba-4566-99df-21ff6c1cc8f1 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:08.340015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-49a9ef43-e6a8-4cd6-935a-2771bb9554a1 None None] MFA Rules not processed for user `99f6921ccf8a443d89e62259402b415a`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:08.343164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-49a9ef43-e6a8-4cd6-935a-2771bb9554a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:08.434818 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28776e3a-28a0-4293-817a-1feb4bbe2479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:08.435836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28776e3a-28a0-4293-817a-1feb4bbe2479 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:08.436239 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28776e3a-28a0-4293-817a-1feb4bbe2479 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:08.436651 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28776e3a-28a0-4293-817a-1feb4bbe2479 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:08.437505 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3557/7046] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:08 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:08.438659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28776e3a-28a0-4293-817a-1feb4bbe2479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:08.439079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b756d2-9bb6-4486-93c1-c7d873ae6950 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:08.439435 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b756d2-9bb6-4486-93c1-c7d873ae6950 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:08.439893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b756d2-9bb6-4486-93c1-c7d873ae6950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:08.441155 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28776e3a-28a0-4293-817a-1feb4bbe2479 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:08.456340 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3490/7047] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:08.460113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28776e3a-28a0-4293-817a-1feb4bbe2479 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:08.460113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-28776e3a-28a0-4293-817a-1feb4bbe2479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:08.468177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-00b756d2-9bb6-4486-93c1-c7d873ae6950 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:08.469744 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-00b756d2-9bb6-4486-93c1-c7d873ae6950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:08.480325 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3558/7048] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:08.481786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b756d2-9bb6-4486-93c1-c7d873ae6950 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:08.483602 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-00b756d2-9bb6-4486-93c1-c7d873ae6950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:08.497782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b756d2-9bb6-4486-93c1-c7d873ae6950 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:08.505093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8829c-0a88-40ce-a319-68bb7ccaa717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:08.506027 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8829c-0a88-40ce-a319-68bb7ccaa717 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:08.506365 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8829c-0a88-40ce-a319-68bb7ccaa717 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:08.506651 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8829c-0a88-40ce-a319-68bb7ccaa717 admin admin] PATH_INFO: `/v3/projects/439dbec3c4864b389b7c74741be34702/users/3aa861378d3649ed8115c02e205e70b2/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:08.526313 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de8829c-0a88-40ce-a319-68bb7ccaa717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=439dbec3c4864b389b7c74741be34702, user_id=3aa861378d3649ed8115c02e205e70b2, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:08.530326 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de8829c-0a88-40ce-a319-68bb7ccaa717 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:08.548422 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3559/7049] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:08 2022] PUT /identity/v3/projects/439dbec3c4864b389b7c74741be34702/users/3aa861378d3649ed8115c02e205e70b2/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:08.550712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8829c-0a88-40ce-a319-68bb7ccaa717 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:08.555984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4de8829c-0a88-40ce-a319-68bb7ccaa717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:08.577594 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28776e3a-28a0-4293-817a-1feb4bbe2479 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:08.652855 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8829c-0a88-40ce-a319-68bb7ccaa717 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:08.657179 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ebff1-c928-4e33-ba55-952a1694463b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:08.657848 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ebff1-c928-4e33-ba55-952a1694463b service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:08.658132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ebff1-c928-4e33-ba55-952a1694463b service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:08.658398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ebff1-c928-4e33-ba55-952a1694463b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:08.665451 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2775583-fe84-44f8-89cb-8307975cdb72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:08.666457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2775583-fe84-44f8-89cb-8307975cdb72 service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:08.666974 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2775583-fe84-44f8-89cb-8307975cdb72 service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:08.667496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2775583-fe84-44f8-89cb-8307975cdb72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:08.671995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d2775583-fe84-44f8-89cb-8307975cdb72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:08.697417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:08.721141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:08.764253 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323ebff1-c928-4e33-ba55-952a1694463b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:08.765954 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323ebff1-c928-4e33-ba55-952a1694463b service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:08.768024 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2775583-fe84-44f8-89cb-8307975cdb72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:08.769561 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2775583-fe84-44f8-89cb-8307975cdb72 service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:08.776493 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3560/7050] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:08.778325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0698f6-512a-4b56-92fa-2a77907a3bd9 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:08.778325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0698f6-512a-4b56-92fa-2a77907a3bd9 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:08.778600 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0698f6-512a-4b56-92fa-2a77907a3bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:08.780204 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3491/7051] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:08.810476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-1a0698f6-512a-4b56-92fa-2a77907a3bd9 None None] MFA Rules not processed for user `3aa861378d3649ed8115c02e205e70b2`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:08.811730 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1a0698f6-512a-4b56-92fa-2a77907a3bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:08.887284 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3561/7052] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:08.893865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2775583-fe84-44f8-89cb-8307975cdb72 service cinder] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:08.909919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2775583-fe84-44f8-89cb-8307975cdb72 service cinder] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:08.915407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c1659-8aa1-42e9-a552-c35db2ea605c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:08.916025 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c1659-8aa1-42e9-a552-c35db2ea605c admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:08.916283 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c1659-8aa1-42e9-a552-c35db2ea605c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:08.916560 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c1659-8aa1-42e9-a552-c35db2ea605c admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:08.917213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c1659-8aa1-42e9-a552-c35db2ea605c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:08.919766 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c1659-8aa1-42e9-a552-c35db2ea605c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:08.972965 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0698f6-512a-4b56-92fa-2a77907a3bd9 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:08.983390 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3492/7053] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:21:08 2022] POST /identity/v3/projects => generated 361 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:08.994385 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0698f6-512a-4b56-92fa-2a77907a3bd9 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:09.091878 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9239f-4c3b-4401-96f1-77ee00de4377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:09.092929 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9239f-4c3b-4401-96f1-77ee00de4377 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:09.093559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9239f-4c3b-4401-96f1-77ee00de4377 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:09.094020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9239f-4c3b-4401-96f1-77ee00de4377 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:09.095159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9239f-4c3b-4401-96f1-77ee00de4377 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:09.098054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9239f-4c3b-4401-96f1-77ee00de4377 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:09.126002 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3562/7054] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:21:08 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:09.130348 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c1659-8aa1-42e9-a552-c35db2ea605c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:09.141250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c1659-8aa1-42e9-a552-c35db2ea605c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:09.148236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91a58f-1331-49dd-b995-98ebfaa370b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:09.149345 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91a58f-1331-49dd-b995-98ebfaa370b6 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:09.149551 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91a58f-1331-49dd-b995-98ebfaa370b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:09.149860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91a58f-1331-49dd-b995-98ebfaa370b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:09.150565 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91a58f-1331-49dd-b995-98ebfaa370b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:09.152237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91a58f-1331-49dd-b995-98ebfaa370b6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:09.164895 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3493/7055] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:09.168758 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9239f-4c3b-4401-96f1-77ee00de4377 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:09.169798 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91a58f-1331-49dd-b995-98ebfaa370b6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:09.172087 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-77d9239f-4c3b-4401-96f1-77ee00de4377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:09.181771 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91a58f-1331-49dd-b995-98ebfaa370b6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:09.187197 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f869c-9bde-4887-a4e8-f41425c3df0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:09.187865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f869c-9bde-4887-a4e8-f41425c3df0f admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:09.188247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f869c-9bde-4887-a4e8-f41425c3df0f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:09.188522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f869c-9bde-4887-a4e8-f41425c3df0f admin admin] PATH_INFO: `/v3/projects/ab38f73a40f04a56a5a92348b3a3a3d4/users/bee025a8fc2b48a6ab40912c807fefc4/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:09.194914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9239f-4c3b-4401-96f1-77ee00de4377 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:09.202783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf03a1-c1f3-47be-bb14-e4a3377f4028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:09.204238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf03a1-c1f3-47be-bb14-e4a3377f4028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:09.204532 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf03a1-c1f3-47be-bb14-e4a3377f4028 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:09.204809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf03a1-c1f3-47be-bb14-e4a3377f4028 admin admin] PATH_INFO: `/v3/users/b28aea57b6c34fcd96ec58896e175b60` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:09.206558 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf03a1-c1f3-47be-bb14-e4a3377f4028 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b28aea57b6c34fcd96ec58896e175b60)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:09.207118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f869c-9bde-4887-a4e8-f41425c3df0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab38f73a40f04a56a5a92348b3a3a3d4, user_id=bee025a8fc2b48a6ab40912c807fefc4, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:09.208847 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf03a1-c1f3-47be-bb14-e4a3377f4028 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:09.210076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f869c-9bde-4887-a4e8-f41425c3df0f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:09.246120 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3494/7056] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:09 2022] PUT /identity/v3/projects/ab38f73a40f04a56a5a92348b3a3a3d4/users/bee025a8fc2b48a6ab40912c807fefc4/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:21:09.247519 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f869c-9bde-4887-a4e8-f41425c3df0f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:09.308030 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:09.318128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-10bf03a1-c1f3-47be-bb14-e4a3377f4028 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b28aea57b6c34fcd96ec58896e175b60'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:09.334215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-10bf03a1-c1f3-47be-bb14-e4a3377f4028 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b28aea57b6c34fcd96ec58896e175b60'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:09.335462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-10bf03a1-c1f3-47be-bb14-e4a3377f4028 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b28aea57b6c34fcd96ec58896e175b60'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:09.336305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-10bf03a1-c1f3-47be-bb14-e4a3377f4028 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b28aea57b6c34fcd96ec58896e175b60'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:09.358688 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-10bf03a1-c1f3-47be-bb14-e4a3377f4028 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b28aea57b6c34fcd96ec58896e175b60'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:09.396304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f869c-9bde-4887-a4e8-f41425c3df0f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:09.397489 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3563/7057] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:21:09 2022] DELETE /identity/v3/users/b28aea57b6c34fcd96ec58896e175b60 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:09.401193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63773efb-d4d5-4e47-bf4c-8e400a1ca97c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:09.402146 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63773efb-d4d5-4e47-bf4c-8e400a1ca97c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:09.402635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63773efb-d4d5-4e47-bf4c-8e400a1ca97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:09.428743 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-63773efb-d4d5-4e47-bf4c-8e400a1ca97c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:09.430369 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-63773efb-d4d5-4e47-bf4c-8e400a1ca97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:09.479215 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5cdd82-a4ac-42e2-af35-93f2cea3aed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:09.480122 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5cdd82-a4ac-42e2-af35-93f2cea3aed3 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:09.480403 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5cdd82-a4ac-42e2-af35-93f2cea3aed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:09.480672 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5cdd82-a4ac-42e2-af35-93f2cea3aed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:09.481319 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5cdd82-a4ac-42e2-af35-93f2cea3aed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:09.484118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5cdd82-a4ac-42e2-af35-93f2cea3aed3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:09.497501 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3495/7058] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:09.501959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5cdd82-a4ac-42e2-af35-93f2cea3aed3 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:09.504795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-af5cdd82-a4ac-42e2-af35-93f2cea3aed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:09.518650 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:09.533675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5cdd82-a4ac-42e2-af35-93f2cea3aed3 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:09.543375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f424872-c57c-4e2b-af2e-1daea4d710cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:09.544904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f424872-c57c-4e2b-af2e-1daea4d710cd admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:09.545380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f424872-c57c-4e2b-af2e-1daea4d710cd admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:09.546132 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f424872-c57c-4e2b-af2e-1daea4d710cd admin admin] PATH_INFO: `/v3/projects/ab38f73a40f04a56a5a92348b3a3a3d4/users/bee025a8fc2b48a6ab40912c807fefc4/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:09.550439 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f424872-c57c-4e2b-af2e-1daea4d710cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab38f73a40f04a56a5a92348b3a3a3d4, user_id=bee025a8fc2b48a6ab40912c807fefc4, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:09.555371 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f424872-c57c-4e2b-af2e-1daea4d710cd admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:09.573946 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3496/7059] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:09 2022] PUT /identity/v3/projects/ab38f73a40f04a56a5a92348b3a3a3d4/users/bee025a8fc2b48a6ab40912c807fefc4/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:09.574478 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3564/7060] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:09.588527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63773efb-d4d5-4e47-bf4c-8e400a1ca97c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:09.593751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-63773efb-d4d5-4e47-bf4c-8e400a1ca97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:09.601195 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b353d87-63fe-4e70-b655-d934a902d2fe None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:09.601736 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b353d87-63fe-4e70-b655-d934a902d2fe None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:09.602386 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b353d87-63fe-4e70-b655-d934a902d2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:09.687842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-4b353d87-63fe-4e70-b655-d934a902d2fe None None] MFA Rules not processed for user `bee025a8fc2b48a6ab40912c807fefc4`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:09.693817 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4b353d87-63fe-4e70-b655-d934a902d2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:09.719366 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63773efb-d4d5-4e47-bf4c-8e400a1ca97c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:09.801949 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6df3d-ae10-4eeb-8126-86800bb9814a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:09.802634 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6df3d-ae10-4eeb-8126-86800bb9814a service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:09.802888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6df3d-ae10-4eeb-8126-86800bb9814a service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:09.803163 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6df3d-ae10-4eeb-8126-86800bb9814a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:09.829331 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3497/7061] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:09 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:09.830005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b353d87-63fe-4e70-b655-d934a902d2fe None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:09.831756 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4b353d87-63fe-4e70-b655-d934a902d2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:09.857637 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:09.905135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba6df3d-ae10-4eeb-8126-86800bb9814a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:09.907341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba6df3d-ae10-4eeb-8126-86800bb9814a service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:09.920145 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3565/7062] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:09.921033 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6df3d-ae10-4eeb-8126-86800bb9814a service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:09.922517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-eba6df3d-ae10-4eeb-8126-86800bb9814a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:09.931675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b353d87-63fe-4e70-b655-d934a902d2fe None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:09.945245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125eef69-7610-4614-acbc-5d42b93fd4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:09.946485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125eef69-7610-4614-acbc-5d42b93fd4d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:09.946795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125eef69-7610-4614-acbc-5d42b93fd4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:09.947073 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125eef69-7610-4614-acbc-5d42b93fd4d0 admin admin] PATH_INFO: `/v3/projects/62156a69d4aa4b5594705bfb60922e67` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:09.951216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125eef69-7610-4614-acbc-5d42b93fd4d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62156a69d4aa4b5594705bfb60922e67)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:09.959620 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125eef69-7610-4614-acbc-5d42b93fd4d0 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:10.013008 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6df3d-ae10-4eeb-8126-86800bb9814a service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:10.019152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c501fe7-651d-4ca6-b8f6-f916f50ba37c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:10.019772 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c501fe7-651d-4ca6-b8f6-f916f50ba37c service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:10.020670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c501fe7-651d-4ca6-b8f6-f916f50ba37c service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:10.020953 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c501fe7-651d-4ca6-b8f6-f916f50ba37c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:10.037517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c501fe7-651d-4ca6-b8f6-f916f50ba37c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:10.041530 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c501fe7-651d-4ca6-b8f6-f916f50ba37c service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:10.057407 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3566/7063] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:09 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:10.062765 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-125eef69-7610-4614-acbc-5d42b93fd4d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62156a69d4aa4b5594705bfb60922e67', 'request_id': 'req-125eef69-7610-4614-acbc-5d42b93fd4d0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:10.071450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-125eef69-7610-4614-acbc-5d42b93fd4d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62156a69d4aa4b5594705bfb60922e67', 'request_id': 'req-125eef69-7610-4614-acbc-5d42b93fd4d0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:10.082238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-125eef69-7610-4614-acbc-5d42b93fd4d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62156a69d4aa4b5594705bfb60922e67', 'request_id': 'req-125eef69-7610-4614-acbc-5d42b93fd4d0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:10.102072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-125eef69-7610-4614-acbc-5d42b93fd4d0 admin admin] The token cache is being invalidate because project 62156a69d4aa4b5594705bfb60922e67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:21:10.102345 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-125eef69-7610-4614-acbc-5d42b93fd4d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:10.104359 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-125eef69-7610-4614-acbc-5d42b93fd4d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:10.109149 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3498/7064] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:21:09 2022] DELETE /identity/v3/projects/62156a69d4aa4b5594705bfb60922e67 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:10.114196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f28a9-6946-40a4-a12c-23043df12094 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:10.114803 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f28a9-6946-40a4-a12c-23043df12094 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:10.115257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f28a9-6946-40a4-a12c-23043df12094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:10.158210 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-879f28a9-6946-40a4-a12c-23043df12094 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:10.159735 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-879f28a9-6946-40a4-a12c-23043df12094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:10.192899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125eef69-7610-4614-acbc-5d42b93fd4d0 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:10.196051 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-125eef69-7610-4614-acbc-5d42b93fd4d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:10.209031 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:10.286764 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3567/7065] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:21:10.287886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f28a9-6946-40a4-a12c-23043df12094 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:10.289411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-879f28a9-6946-40a4-a12c-23043df12094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:10.325513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125eef69-7610-4614-acbc-5d42b93fd4d0 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:10.334798 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c7463-a16b-4622-9e82-bbd33fee7f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:10.336613 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c7463-a16b-4622-9e82-bbd33fee7f34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:10.336613 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c7463-a16b-4622-9e82-bbd33fee7f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:10.338118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c7463-a16b-4622-9e82-bbd33fee7f34 admin admin] PATH_INFO: `/v3/projects/c29a26de8c8f445181bec7608ee8fcbb` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:10.342254 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c7463-a16b-4622-9e82-bbd33fee7f34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c29a26de8c8f445181bec7608ee8fcbb)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:10.344711 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c7463-a16b-4622-9e82-bbd33fee7f34 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:10.371067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f28a9-6946-40a4-a12c-23043df12094 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:10.377025 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b275aa-bf41-4f71-a3e0-de3f0204d8dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:10.377691 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b275aa-bf41-4f71-a3e0-de3f0204d8dd service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:10.378909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b275aa-bf41-4f71-a3e0-de3f0204d8dd service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:10.379580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b275aa-bf41-4f71-a3e0-de3f0204d8dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:10.382238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b4b275aa-bf41-4f71-a3e0-de3f0204d8dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:10.414312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:10.425631 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d31c7463-a16b-4622-9e82-bbd33fee7f34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c29a26de8c8f445181bec7608ee8fcbb', 'request_id': 'req-d31c7463-a16b-4622-9e82-bbd33fee7f34'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:10.441278 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d31c7463-a16b-4622-9e82-bbd33fee7f34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c29a26de8c8f445181bec7608ee8fcbb', 'request_id': 'req-d31c7463-a16b-4622-9e82-bbd33fee7f34'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:10.457420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d31c7463-a16b-4622-9e82-bbd33fee7f34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c29a26de8c8f445181bec7608ee8fcbb', 'request_id': 'req-d31c7463-a16b-4622-9e82-bbd33fee7f34'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:10.469102 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b275aa-bf41-4f71-a3e0-de3f0204d8dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:10.470985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b275aa-bf41-4f71-a3e0-de3f0204d8dd service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:10.482695 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3568/7066] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:10.483973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cf8e7-956a-41a8-9a41-e317065acd86 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:10.484108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d31c7463-a16b-4622-9e82-bbd33fee7f34 admin admin] The token cache is being invalidate because project c29a26de8c8f445181bec7608ee8fcbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:21:10.484312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cf8e7-956a-41a8-9a41-e317065acd86 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:10.484423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d31c7463-a16b-4622-9e82-bbd33fee7f34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:10.484629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cf8e7-956a-41a8-9a41-e317065acd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:10.486820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d31c7463-a16b-4622-9e82-bbd33fee7f34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:10.488655 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3499/7067] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:21:10 2022] DELETE /identity/v3/projects/c29a26de8c8f445181bec7608ee8fcbb => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:10.494577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682aad1-aed9-4867-9d32-41579d48baec None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:10.494577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682aad1-aed9-4867-9d32-41579d48baec None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:10.494833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682aad1-aed9-4867-9d32-41579d48baec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:10.516796 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f682aad1-aed9-4867-9d32-41579d48baec None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:10.518186 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f682aad1-aed9-4867-9d32-41579d48baec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:10.544727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-169cf8e7-956a-41a8-9a41-e317065acd86 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:10.548564 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-169cf8e7-956a-41a8-9a41-e317065acd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:10.637188 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3500/7068] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:10.642970 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c29e3-2478-4457-9e78-5a5f0c290901 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:10.643259 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c29e3-2478-4457-9e78-5a5f0c290901 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:10.643876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c29e3-2478-4457-9e78-5a5f0c290901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:10.681221 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3569/7069] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:10.687347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cf8e7-956a-41a8-9a41-e317065acd86 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:10.692829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-0b8c29e3-2478-4457-9e78-5a5f0c290901 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:10.695138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0b8c29e3-2478-4457-9e78-5a5f0c290901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:10.705107 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cf8e7-956a-41a8-9a41-e317065acd86 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:10.709455 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3501/7070] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:10.711149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8c29e3-2478-4457-9e78-5a5f0c290901 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:10.719828 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35249c89-a3cb-4827-8976-52e50ba9842a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:10.720587 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35249c89-a3cb-4827-8976-52e50ba9842a admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:10.721699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35249c89-a3cb-4827-8976-52e50ba9842a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:10.722472 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35249c89-a3cb-4827-8976-52e50ba9842a admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:10.723320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35249c89-a3cb-4827-8976-52e50ba9842a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:21:10.723786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35249c89-a3cb-4827-8976-52e50ba9842a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:10.725411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35249c89-a3cb-4827-8976-52e50ba9842a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:10.727562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8c29e3-2478-4457-9e78-5a5f0c290901 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:10.737131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef0435-22af-4d75-8b79-b020acf6037d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:10.737379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef0435-22af-4d75-8b79-b020acf6037d admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:10.737615 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef0435-22af-4d75-8b79-b020acf6037d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:10.738079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef0435-22af-4d75-8b79-b020acf6037d admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:10.739201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ef0435-22af-4d75-8b79-b020acf6037d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:21:10.739412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ef0435-22af-4d75-8b79-b020acf6037d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:10.741412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ef0435-22af-4d75-8b79-b020acf6037d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:10.742470 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3570/7071] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:21:10.747687 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35249c89-a3cb-4827-8976-52e50ba9842a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:10.770063 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3502/7072] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:21:10.772079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef0435-22af-4d75-8b79-b020acf6037d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:10.775250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35249c89-a3cb-4827-8976-52e50ba9842a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:10.785205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59641df-981d-4826-8e9c-54dc0c5a18df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:10.785973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59641df-981d-4826-8e9c-54dc0c5a18df admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:10.786354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59641df-981d-4826-8e9c-54dc0c5a18df admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:10.789230 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef0435-22af-4d75-8b79-b020acf6037d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:10.793690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59641df-981d-4826-8e9c-54dc0c5a18df admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:10.794943 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59641df-981d-4826-8e9c-54dc0c5a18df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:10.797052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40335adf-9901-41d8-a012-1bb94b7ed737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:10.797764 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40335adf-9901-41d8-a012-1bb94b7ed737 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:10.798138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40335adf-9901-41d8-a012-1bb94b7ed737 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:10.798279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59641df-981d-4826-8e9c-54dc0c5a18df admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:10.798628 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40335adf-9901-41d8-a012-1bb94b7ed737 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:10.799427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40335adf-9901-41d8-a012-1bb94b7ed737 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:10.802084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40335adf-9901-41d8-a012-1bb94b7ed737 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:10.822080 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:10.851254 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3571/7073] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:21:10 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:10.854093 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3503/7074] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:21:10 2022] POST /identity/v3/projects => generated 361 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:10.855410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40335adf-9901-41d8-a012-1bb94b7ed737 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:10.859931 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59641df-981d-4826-8e9c-54dc0c5a18df admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:10.982498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40335adf-9901-41d8-a012-1bb94b7ed737 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:11.005061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59641df-981d-4826-8e9c-54dc0c5a18df admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:11.012027 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d29e7-e488-4413-814d-c7e4eabf50ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:11.012765 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7aa51b-cb63-4f61-8081-966db7985ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:11.013578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d29e7-e488-4413-814d-c7e4eabf50ce admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:11.013871 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d29e7-e488-4413-814d-c7e4eabf50ce admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:11.014151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d29e7-e488-4413-814d-c7e4eabf50ce admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:11.014910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d29e7-e488-4413-814d-c7e4eabf50ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:11.015556 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7aa51b-cb63-4f61-8081-966db7985ede admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:11.016013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7aa51b-cb63-4f61-8081-966db7985ede admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:11.017069 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d29e7-e488-4413-814d-c7e4eabf50ce admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:11.018556 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7aa51b-cb63-4f61-8081-966db7985ede admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:11.019399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7aa51b-cb63-4f61-8081-966db7985ede admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:11.029473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7aa51b-cb63-4f61-8081-966db7985ede admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:11.049055 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3572/7075] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:21:10 2022] POST /identity/v3/users => generated 281 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:11.054023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d29e7-e488-4413-814d-c7e4eabf50ce admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:11.102860 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3504/7076] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:21:10 2022] POST /identity/v3/users => generated 288 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:11.103835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7aa51b-cb63-4f61-8081-966db7985ede admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:11.105292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d29e7-e488-4413-814d-c7e4eabf50ce admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:11.117468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fd254-2d48-4d8c-8ecd-7db2315399b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:11.118020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fd254-2d48-4d8c-8ecd-7db2315399b7 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:11.118407 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fd254-2d48-4d8c-8ecd-7db2315399b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:11.118847 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fd254-2d48-4d8c-8ecd-7db2315399b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:11.122662 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7aa51b-cb63-4f61-8081-966db7985ede admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:11.129446 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25c8e8-7e6a-4780-85b2-65a0c40b989e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:11.130286 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25c8e8-7e6a-4780-85b2-65a0c40b989e admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:11.130762 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25c8e8-7e6a-4780-85b2-65a0c40b989e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:11.131230 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25c8e8-7e6a-4780-85b2-65a0c40b989e admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:11.131346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358fd254-2d48-4d8c-8ecd-7db2315399b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:11.132294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e25c8e8-7e6a-4780-85b2-65a0c40b989e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:11.134178 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e25c8e8-7e6a-4780-85b2-65a0c40b989e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:11.138015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358fd254-2d48-4d8c-8ecd-7db2315399b7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:11.152394 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3505/7077] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:11.155632 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25c8e8-7e6a-4780-85b2-65a0c40b989e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:11.169795 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3573/7078] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:21:11.171082 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fd254-2d48-4d8c-8ecd-7db2315399b7 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:11.173478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25c8e8-7e6a-4780-85b2-65a0c40b989e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:11.178754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac88a8d-a959-4d68-b64b-c0225c76b519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:11.179844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac88a8d-a959-4d68-b64b-c0225c76b519 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:11.180471 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac88a8d-a959-4d68-b64b-c0225c76b519 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:11.181050 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac88a8d-a959-4d68-b64b-c0225c76b519 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:11.182088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac88a8d-a959-4d68-b64b-c0225c76b519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:11.185205 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac88a8d-a959-4d68-b64b-c0225c76b519 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:11.192935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fd254-2d48-4d8c-8ecd-7db2315399b7 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:11.206255 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3506/7079] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:11.207406 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac88a8d-a959-4d68-b64b-c0225c76b519 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:11.211560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00139d6a-9900-4a6f-adeb-60c85c3a9c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:11.212311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00139d6a-9900-4a6f-adeb-60c85c3a9c23 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:11.213611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00139d6a-9900-4a6f-adeb-60c85c3a9c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:11.214776 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00139d6a-9900-4a6f-adeb-60c85c3a9c23 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:11.216778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00139d6a-9900-4a6f-adeb-60c85c3a9c23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:11.220205 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac88a8d-a959-4d68-b64b-c0225c76b519 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:11.222218 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00139d6a-9900-4a6f-adeb-60c85c3a9c23 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:11.223909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:11.236749 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e615ff-f67d-4b49-a11d-dc397bdc5fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:11.237537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e615ff-f67d-4b49-a11d-dc397bdc5fd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:11.237875 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e615ff-f67d-4b49-a11d-dc397bdc5fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:11.238217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e615ff-f67d-4b49-a11d-dc397bdc5fd5 admin admin] PATH_INFO: `/v3/projects/af8471e400e24dd7a29c5bbb042ac0b9/users/8d1a2c57cf5840f7a1dcede60357580e/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:11.244035 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3574/7080] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:11.250996 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00139d6a-9900-4a6f-adeb-60c85c3a9c23 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:11.272407 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00139d6a-9900-4a6f-adeb-60c85c3a9c23 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:11.273447 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e615ff-f67d-4b49-a11d-dc397bdc5fd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af8471e400e24dd7a29c5bbb042ac0b9, user_id=8d1a2c57cf5840f7a1dcede60357580e, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:11.276975 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e615ff-f67d-4b49-a11d-dc397bdc5fd5 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:11.286989 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad35663-61fa-417d-bc72-0d95cdee59b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:11.288128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad35663-61fa-417d-bc72-0d95cdee59b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:11.288854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad35663-61fa-417d-bc72-0d95cdee59b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:11.290981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad35663-61fa-417d-bc72-0d95cdee59b5 admin admin] PATH_INFO: `/v3/projects/d55aa7aac54f4521bcca57c5e81362ee/users/6f18fd681dc0496eb27fe3e983a095bb/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:11.308592 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3507/7081] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:11 2022] PUT /identity/v3/projects/af8471e400e24dd7a29c5bbb042ac0b9/users/8d1a2c57cf5840f7a1dcede60357580e/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:11.321605 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfe74c-3a46-401a-a45c-8c7cfe7e3e09 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:11.321921 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfe74c-3a46-401a-a45c-8c7cfe7e3e09 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:11.322156 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfe74c-3a46-401a-a45c-8c7cfe7e3e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:11.346904 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad35663-61fa-417d-bc72-0d95cdee59b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d55aa7aac54f4521bcca57c5e81362ee, user_id=6f18fd681dc0496eb27fe3e983a095bb, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:11.354193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad35663-61fa-417d-bc72-0d95cdee59b5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:11.376989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-b5cfe74c-3a46-401a-a45c-8c7cfe7e3e09 None None] MFA Rules not processed for user `8d1a2c57cf5840f7a1dcede60357580e`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:11.378668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b5cfe74c-3a46-401a-a45c-8c7cfe7e3e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:11.393736 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3575/7082] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:11 2022] PUT /identity/v3/projects/d55aa7aac54f4521bcca57c5e81362ee/users/6f18fd681dc0496eb27fe3e983a095bb/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:11.404749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a76ec-14a8-498e-a1f3-f80e0055de67 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:11.405330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a76ec-14a8-498e-a1f3-f80e0055de67 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:11.405638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a76ec-14a8-498e-a1f3-f80e0055de67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:11.459450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-963a76ec-14a8-498e-a1f3-f80e0055de67 None None] MFA Rules not processed for user `6f18fd681dc0496eb27fe3e983a095bb`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:11.461182 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-963a76ec-14a8-498e-a1f3-f80e0055de67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:11.541392 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3508/7083] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:11.557310 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfe74c-3a46-401a-a45c-8c7cfe7e3e09 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:11.560263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b5cfe74c-3a46-401a-a45c-8c7cfe7e3e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:11.574171 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3576/7084] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:21:11.594771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a76ec-14a8-498e-a1f3-f80e0055de67 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:11.596258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-963a76ec-14a8-498e-a1f3-f80e0055de67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:11.607197 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:11.645187 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfe74c-3a46-401a-a45c-8c7cfe7e3e09 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:11.650355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d60aef-5ab6-47bf-ae04-a18bbcf30402 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:11.650355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d60aef-5ab6-47bf-ae04-a18bbcf30402 service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:11.650607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d60aef-5ab6-47bf-ae04-a18bbcf30402 service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:11.651061 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d60aef-5ab6-47bf-ae04-a18bbcf30402 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:11.661091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d60aef-5ab6-47bf-ae04-a18bbcf30402 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:11.662525 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d60aef-5ab6-47bf-ae04-a18bbcf30402 service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:11.669891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a76ec-14a8-498e-a1f3-f80e0055de67 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:11.676216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f856f78-d5ef-4829-a381-54ab7a65d94c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:11.677489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f856f78-d5ef-4829-a381-54ab7a65d94c service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:11.677948 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f856f78-d5ef-4829-a381-54ab7a65d94c service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:11.678185 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3509/7085] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:11.678645 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f856f78-d5ef-4829-a381-54ab7a65d94c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:11.693346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f856f78-d5ef-4829-a381-54ab7a65d94c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:11.693346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f856f78-d5ef-4829-a381-54ab7a65d94c service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:11.704874 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3577/7086] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:13.324868 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e7047-87b5-447a-b30b-6637619aa433 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:13.326960 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e7047-87b5-447a-b30b-6637619aa433 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:13.327241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e7047-87b5-447a-b30b-6637619aa433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:13.352016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-064e7047-87b5-447a-b30b-6637619aa433 None None] MFA Rules not processed for user `8d1a2c57cf5840f7a1dcede60357580e`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:13.353254 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-064e7047-87b5-447a-b30b-6637619aa433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:13.363809 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3510/7087] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:13.618796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f856f78-d5ef-4829-a381-54ab7a65d94c service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:13.621494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5f856f78-d5ef-4829-a381-54ab7a65d94c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:13.635950 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f856f78-d5ef-4829-a381-54ab7a65d94c service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:13.646380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77f743-e8c6-41bf-a218-0983199b52b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:13.647219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77f743-e8c6-41bf-a218-0983199b52b1 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:13.647771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77f743-e8c6-41bf-a218-0983199b52b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:13.649175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77f743-e8c6-41bf-a218-0983199b52b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:13.651422 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2a77f743-e8c6-41bf-a218-0983199b52b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:13.755810 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77f743-e8c6-41bf-a218-0983199b52b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:13.757278 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77f743-e8c6-41bf-a218-0983199b52b1 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:13.763304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:13.780791 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3578/7088] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:14.052397 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e7047-87b5-447a-b30b-6637619aa433 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:14.054349 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-064e7047-87b5-447a-b30b-6637619aa433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:14.087888 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e7047-87b5-447a-b30b-6637619aa433 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:14.093044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385a41d-c71a-46e6-8ca1-60a8bd3636ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:14.093749 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385a41d-c71a-46e6-8ca1-60a8bd3636ab service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:14.094334 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385a41d-c71a-46e6-8ca1-60a8bd3636ab service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:14.094734 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385a41d-c71a-46e6-8ca1-60a8bd3636ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:14.097044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7385a41d-c71a-46e6-8ca1-60a8bd3636ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:14.287758 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385a41d-c71a-46e6-8ca1-60a8bd3636ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:14.289943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385a41d-c71a-46e6-8ca1-60a8bd3636ab service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:14.306375 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3511/7089] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:19.941954 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77f743-e8c6-41bf-a218-0983199b52b1 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:19.956366 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2a77f743-e8c6-41bf-a218-0983199b52b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:19.971155 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77f743-e8c6-41bf-a218-0983199b52b1 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:19.976147 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52e7d2-926a-4bca-912b-c32bf1ad119d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:19.976793 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52e7d2-926a-4bca-912b-c32bf1ad119d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:19.977079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52e7d2-926a-4bca-912b-c32bf1ad119d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:19.977357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52e7d2-926a-4bca-912b-c32bf1ad119d admin admin] PATH_INFO: `/v3/users/3aa861378d3649ed8115c02e205e70b2` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:19.978509 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b52e7d2-926a-4bca-912b-c32bf1ad119d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aa861378d3649ed8115c02e205e70b2)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:19.980472 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b52e7d2-926a-4bca-912b-c32bf1ad119d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:20.052763 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7b52e7d2-926a-4bca-912b-c32bf1ad119d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aa861378d3649ed8115c02e205e70b2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:20.063336 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7b52e7d2-926a-4bca-912b-c32bf1ad119d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aa861378d3649ed8115c02e205e70b2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:20.064276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7b52e7d2-926a-4bca-912b-c32bf1ad119d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aa861378d3649ed8115c02e205e70b2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:20.064954 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7b52e7d2-926a-4bca-912b-c32bf1ad119d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aa861378d3649ed8115c02e205e70b2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:20.077733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7b52e7d2-926a-4bca-912b-c32bf1ad119d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aa861378d3649ed8115c02e205e70b2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:20.101675 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3579/7090] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:21:19 2022] DELETE /identity/v3/users/3aa861378d3649ed8115c02e205e70b2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:20.107232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defc89a-2059-42a2-b765-7fb2115e3469 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:20.108420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defc89a-2059-42a2-b765-7fb2115e3469 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:20.108993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defc89a-2059-42a2-b765-7fb2115e3469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:20.135431 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-5defc89a-2059-42a2-b765-7fb2115e3469 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:20.137041 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5defc89a-2059-42a2-b765-7fb2115e3469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:20.182592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52e7d2-926a-4bca-912b-c32bf1ad119d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:20.186329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7b52e7d2-926a-4bca-912b-c32bf1ad119d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:20.251240 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3512/7091] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:20.264997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defc89a-2059-42a2-b765-7fb2115e3469 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:20.266751 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5defc89a-2059-42a2-b765-7fb2115e3469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:20.304761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52e7d2-926a-4bca-912b-c32bf1ad119d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:20.312250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410cba4-399a-4556-a35a-54a5c86ef641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:20.314306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410cba4-399a-4556-a35a-54a5c86ef641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:20.314738 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410cba4-399a-4556-a35a-54a5c86ef641 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:20.315151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410cba4-399a-4556-a35a-54a5c86ef641 admin admin] PATH_INFO: `/v3/users/9b8463a42f2642aaba586380391de6fd` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:20.316589 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410cba4-399a-4556-a35a-54a5c86ef641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b8463a42f2642aaba586380391de6fd)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:20.318913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410cba4-399a-4556-a35a-54a5c86ef641 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:20.366934 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defc89a-2059-42a2-b765-7fb2115e3469 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:20.375270 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a3fdcd-8aa3-438c-81c8-1d89264cbb7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:20.376037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3fdcd-8aa3-438c-81c8-1d89264cbb7c service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:20.376330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3fdcd-8aa3-438c-81c8-1d89264cbb7c service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:20.376787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3fdcd-8aa3-438c-81c8-1d89264cbb7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:20.395900 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a3fdcd-8aa3-438c-81c8-1d89264cbb7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:20.397455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a3fdcd-8aa3-438c-81c8-1d89264cbb7c service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:20.403766 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:20.411853 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3513/7092] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:21:20.414468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5410cba4-399a-4556-a35a-54a5c86ef641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b8463a42f2642aaba586380391de6fd'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:20.423248 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5410cba4-399a-4556-a35a-54a5c86ef641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b8463a42f2642aaba586380391de6fd'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:20.424138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5410cba4-399a-4556-a35a-54a5c86ef641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b8463a42f2642aaba586380391de6fd'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:20.424778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5410cba4-399a-4556-a35a-54a5c86ef641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b8463a42f2642aaba586380391de6fd'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:20.433735 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5410cba4-399a-4556-a35a-54a5c86ef641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b8463a42f2642aaba586380391de6fd'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:20.443945 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:20.459567 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3580/7093] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:21:20 2022] DELETE /identity/v3/users/9b8463a42f2642aaba586380391de6fd => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:20.900138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a3fdcd-8aa3-438c-81c8-1d89264cbb7c service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:20.923433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a3fdcd-8aa3-438c-81c8-1d89264cbb7c service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:21.000159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410cba4-399a-4556-a35a-54a5c86ef641 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:21.002779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5410cba4-399a-4556-a35a-54a5c86ef641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:21.048057 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a2861-673c-4510-91d0-9f3cdefe45ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:21.050034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a2861-673c-4510-91d0-9f3cdefe45ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:21.051729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a2861-673c-4510-91d0-9f3cdefe45ef admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:21.051922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a2861-673c-4510-91d0-9f3cdefe45ef admin admin] PATH_INFO: `/v3/projects/9feea686598e4a0d90d716e00e3e290a` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:21.054482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a2861-673c-4510-91d0-9f3cdefe45ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=9feea686598e4a0d90d716e00e3e290a)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:21.061299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a2861-673c-4510-91d0-9f3cdefe45ef admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:21.124404 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410cba4-399a-4556-a35a-54a5c86ef641 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:21.130214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86315d0-08f1-4cc5-8062-f2c9d548503f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:21.130892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86315d0-08f1-4cc5-8062-f2c9d548503f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:21.131220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86315d0-08f1-4cc5-8062-f2c9d548503f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:21.131691 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86315d0-08f1-4cc5-8062-f2c9d548503f admin admin] PATH_INFO: `/v3/users/28d291870b6444a79541df94ae90cec5` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:21.133006 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86315d0-08f1-4cc5-8062-f2c9d548503f admin admin] RBAC: Authorizing `identity:delete_user(user_id=28d291870b6444a79541df94ae90cec5)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:21.135245 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86315d0-08f1-4cc5-8062-f2c9d548503f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:21.159747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-238a2861-673c-4510-91d0-9f3cdefe45ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9feea686598e4a0d90d716e00e3e290a', 'request_id': 'req-238a2861-673c-4510-91d0-9f3cdefe45ef'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:21.167553 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-238a2861-673c-4510-91d0-9f3cdefe45ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9feea686598e4a0d90d716e00e3e290a', 'request_id': 'req-238a2861-673c-4510-91d0-9f3cdefe45ef'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:21.179527 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-238a2861-673c-4510-91d0-9f3cdefe45ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9feea686598e4a0d90d716e00e3e290a', 'request_id': 'req-238a2861-673c-4510-91d0-9f3cdefe45ef'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:21.216468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-238a2861-673c-4510-91d0-9f3cdefe45ef admin admin] The token cache is being invalidate because project 9feea686598e4a0d90d716e00e3e290a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:21:21.218368 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-238a2861-673c-4510-91d0-9f3cdefe45ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:21.218686 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e86315d0-08f1-4cc5-8062-f2c9d548503f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28d291870b6444a79541df94ae90cec5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:21.221963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-238a2861-673c-4510-91d0-9f3cdefe45ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:21.232284 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3514/7094] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:21:20 2022] DELETE /identity/v3/projects/9feea686598e4a0d90d716e00e3e290a => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:21.233498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a2861-673c-4510-91d0-9f3cdefe45ef admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:21.234795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e86315d0-08f1-4cc5-8062-f2c9d548503f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28d291870b6444a79541df94ae90cec5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:21.235316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-238a2861-673c-4510-91d0-9f3cdefe45ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:21.236198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e86315d0-08f1-4cc5-8062-f2c9d548503f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28d291870b6444a79541df94ae90cec5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:21.238419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e86315d0-08f1-4cc5-8062-f2c9d548503f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28d291870b6444a79541df94ae90cec5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:21.254459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e86315d0-08f1-4cc5-8062-f2c9d548503f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28d291870b6444a79541df94ae90cec5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:21.289101 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3581/7095] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:21:20 2022] DELETE /identity/v3/users/28d291870b6444a79541df94ae90cec5 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:21.291211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61842a34-cf1e-4981-8c73-6fadc8aaf83f None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:21.291569 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61842a34-cf1e-4981-8c73-6fadc8aaf83f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:21.291914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61842a34-cf1e-4981-8c73-6fadc8aaf83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:21.319606 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-61842a34-cf1e-4981-8c73-6fadc8aaf83f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:21.321299 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-61842a34-cf1e-4981-8c73-6fadc8aaf83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:21.407718 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3582/7096] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:21.414194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43b49e-8014-4d50-b7ed-77f549a57e92 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:21.414194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43b49e-8014-4d50-b7ed-77f549a57e92 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:21.414194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43b49e-8014-4d50-b7ed-77f549a57e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:21.414437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a2861-673c-4510-91d0-9f3cdefe45ef admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:21.421700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46132a8-90ea-4140-8cbb-f1a2e7e4b3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:21.422408 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46132a8-90ea-4140-8cbb-f1a2e7e4b3a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:21.422730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46132a8-90ea-4140-8cbb-f1a2e7e4b3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:21.423142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46132a8-90ea-4140-8cbb-f1a2e7e4b3a8 admin admin] PATH_INFO: `/v3/projects/439dbec3c4864b389b7c74741be34702` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:21.424340 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46132a8-90ea-4140-8cbb-f1a2e7e4b3a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=439dbec3c4864b389b7c74741be34702)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:21.426330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46132a8-90ea-4140-8cbb-f1a2e7e4b3a8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:21.439767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-dc43b49e-8014-4d50-b7ed-77f549a57e92 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:21.441999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-dc43b49e-8014-4d50-b7ed-77f549a57e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:21.461804 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3583/7097] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:21.466050 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223bb56f-0f9e-46db-be5d-202a4d279c75 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:21.466994 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223bb56f-0f9e-46db-be5d-202a4d279c75 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:21.468288 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223bb56f-0f9e-46db-be5d-202a4d279c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:21.475028 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:21.480509 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:21.497879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b46132a8-90ea-4140-8cbb-f1a2e7e4b3a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '439dbec3c4864b389b7c74741be34702', 'request_id': 'req-b46132a8-90ea-4140-8cbb-f1a2e7e4b3a8'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:21.501966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-223bb56f-0f9e-46db-be5d-202a4d279c75 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:21.505128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-223bb56f-0f9e-46db-be5d-202a4d279c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:21.511476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b46132a8-90ea-4140-8cbb-f1a2e7e4b3a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '439dbec3c4864b389b7c74741be34702', 'request_id': 'req-b46132a8-90ea-4140-8cbb-f1a2e7e4b3a8'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:21.520332 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b46132a8-90ea-4140-8cbb-f1a2e7e4b3a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '439dbec3c4864b389b7c74741be34702', 'request_id': 'req-b46132a8-90ea-4140-8cbb-f1a2e7e4b3a8'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:21.539256 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b46132a8-90ea-4140-8cbb-f1a2e7e4b3a8 admin admin] The token cache is being invalidate because project 439dbec3c4864b389b7c74741be34702 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:21:21.539822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b46132a8-90ea-4140-8cbb-f1a2e7e4b3a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:21.540734 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b46132a8-90ea-4140-8cbb-f1a2e7e4b3a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:21.546604 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3515/7098] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:21:21 2022] DELETE /identity/v3/projects/439dbec3c4864b389b7c74741be34702 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:21.547854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46132a8-90ea-4140-8cbb-f1a2e7e4b3a8 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:21.550166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b46132a8-90ea-4140-8cbb-f1a2e7e4b3a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:21.609471 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3584/7099] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:21.610994 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223bb56f-0f9e-46db-be5d-202a4d279c75 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:21.613043 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-223bb56f-0f9e-46db-be5d-202a4d279c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:21.631518 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46132a8-90ea-4140-8cbb-f1a2e7e4b3a8 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:21.633077 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223bb56f-0f9e-46db-be5d-202a4d279c75 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:21.636373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d189da-b885-428d-be38-de0dd7289307 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:21.637601 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d189da-b885-428d-be38-de0dd7289307 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:21.638179 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d189da-b885-428d-be38-de0dd7289307 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:21.638742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d189da-b885-428d-be38-de0dd7289307 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:21.640631 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-24d189da-b885-428d-be38-de0dd7289307 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:21.645399 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1778582-7f13-4747-8c3f-c323aa93ca91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:21.646460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1778582-7f13-4747-8c3f-c323aa93ca91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:21.647274 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1778582-7f13-4747-8c3f-c323aa93ca91 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:21.647556 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1778582-7f13-4747-8c3f-c323aa93ca91 admin admin] PATH_INFO: `/v3/users/bee025a8fc2b48a6ab40912c807fefc4` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:21.650076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1778582-7f13-4747-8c3f-c323aa93ca91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bee025a8fc2b48a6ab40912c807fefc4)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:21.652342 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1778582-7f13-4747-8c3f-c323aa93ca91 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:21.669504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d189da-b885-428d-be38-de0dd7289307 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:21.672240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d189da-b885-428d-be38-de0dd7289307 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:21.691587 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3516/7100] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:21.692826 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d189da-b885-428d-be38-de0dd7289307 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:21.706714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d189da-b885-428d-be38-de0dd7289307 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:21.713269 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedea5d9-1517-49eb-8b95-f8009222989b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:21.713934 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedea5d9-1517-49eb-8b95-f8009222989b admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:21.714166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedea5d9-1517-49eb-8b95-f8009222989b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:21.714427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedea5d9-1517-49eb-8b95-f8009222989b admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:21.716074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedea5d9-1517-49eb-8b95-f8009222989b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:21:21.716239 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedea5d9-1517-49eb-8b95-f8009222989b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:21.718449 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedea5d9-1517-49eb-8b95-f8009222989b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:21.732671 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3517/7101] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:21:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:21:21.740665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedea5d9-1517-49eb-8b95-f8009222989b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:21.749800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e1778582-7f13-4747-8c3f-c323aa93ca91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bee025a8fc2b48a6ab40912c807fefc4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:21.756687 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedea5d9-1517-49eb-8b95-f8009222989b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:21.763414 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e1778582-7f13-4747-8c3f-c323aa93ca91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bee025a8fc2b48a6ab40912c807fefc4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:21.764293 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e1778582-7f13-4747-8c3f-c323aa93ca91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bee025a8fc2b48a6ab40912c807fefc4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:21.764926 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e1778582-7f13-4747-8c3f-c323aa93ca91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bee025a8fc2b48a6ab40912c807fefc4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:21.770537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d2486-9c91-4c80-b507-82c99d4b3511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:21.771486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d2486-9c91-4c80-b507-82c99d4b3511 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:21.771772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d2486-9c91-4c80-b507-82c99d4b3511 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:21.772306 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d2486-9c91-4c80-b507-82c99d4b3511 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:21.773159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d2486-9c91-4c80-b507-82c99d4b3511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:21.775362 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e1778582-7f13-4747-8c3f-c323aa93ca91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bee025a8fc2b48a6ab40912c807fefc4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:21.776315 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d2486-9c91-4c80-b507-82c99d4b3511 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:21.799819 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3585/7102] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:21:21 2022] DELETE /identity/v3/users/bee025a8fc2b48a6ab40912c807fefc4 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:21.823241 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3518/7103] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:21:21 2022] POST /identity/v3/projects => generated 397 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:21.829456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1778582-7f13-4747-8c3f-c323aa93ca91 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:21.830230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e1778582-7f13-4747-8c3f-c323aa93ca91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:21.918939 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1778582-7f13-4747-8c3f-c323aa93ca91 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:21.939467 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:22.003514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae829a-775d-4521-a739-78877957a3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:22.004210 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae829a-775d-4521-a739-78877957a3ec admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:22.004567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae829a-775d-4521-a739-78877957a3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:22.004839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae829a-775d-4521-a739-78877957a3ec admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:22.005460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae829a-775d-4521-a739-78877957a3ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:22.007484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae829a-775d-4521-a739-78877957a3ec admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:22.033819 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3586/7104] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:21:21 2022] POST /identity/v3/users => generated 299 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:22.042820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d2486-9c91-4c80-b507-82c99d4b3511 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:22.058364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d2486-9c91-4c80-b507-82c99d4b3511 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:22.065606 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fed17e-b8b2-4e98-969c-95d967e96694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:22.066107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fed17e-b8b2-4e98-969c-95d967e96694 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:22.066385 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fed17e-b8b2-4e98-969c-95d967e96694 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:22.066844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fed17e-b8b2-4e98-969c-95d967e96694 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:22.067495 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fed17e-b8b2-4e98-969c-95d967e96694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:22.069987 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fed17e-b8b2-4e98-969c-95d967e96694 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:22.092172 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3519/7105] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:22.092530 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae829a-775d-4521-a739-78877957a3ec admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:22.110916 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae829a-775d-4521-a739-78877957a3ec admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:22.117680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e10467-534d-4d01-97f2-aa06bcc46d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:22.118292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e10467-534d-4d01-97f2-aa06bcc46d43 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:22.118799 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e10467-534d-4d01-97f2-aa06bcc46d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:22.118929 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e10467-534d-4d01-97f2-aa06bcc46d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:22.119749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e10467-534d-4d01-97f2-aa06bcc46d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:22.121095 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e10467-534d-4d01-97f2-aa06bcc46d43 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:22.133791 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3587/7106] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:21:22.139330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fed17e-b8b2-4e98-969c-95d967e96694 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:22.150511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fed17e-b8b2-4e98-969c-95d967e96694 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:22.166634 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff7981-03c1-41d3-9539-13b4e3020812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:22.166634 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff7981-03c1-41d3-9539-13b4e3020812 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:22.166634 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff7981-03c1-41d3-9539-13b4e3020812 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:22.167386 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff7981-03c1-41d3-9539-13b4e3020812 admin admin] PATH_INFO: `/v3/projects/430d71c92050477cae2117986e31e3db/users/e63fbea26373463f8e97bd38a0bc6688/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:22.179474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff7981-03c1-41d3-9539-13b4e3020812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=430d71c92050477cae2117986e31e3db, user_id=e63fbea26373463f8e97bd38a0bc6688, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:22.183013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff7981-03c1-41d3-9539-13b4e3020812 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:22.202775 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3520/7107] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:22 2022] PUT /identity/v3/projects/430d71c92050477cae2117986e31e3db/users/e63fbea26373463f8e97bd38a0bc6688/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:22.208235 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201569ff-c4a8-43c9-a7a0-142cc62a8f70 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:22.208520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201569ff-c4a8-43c9-a7a0-142cc62a8f70 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:22.208798 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201569ff-c4a8-43c9-a7a0-142cc62a8f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:22.244248 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff7981-03c1-41d3-9539-13b4e3020812 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:22.246932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-54ff7981-03c1-41d3-9539-13b4e3020812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:22.252113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-201569ff-c4a8-43c9-a7a0-142cc62a8f70 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:22.252113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-201569ff-c4a8-43c9-a7a0-142cc62a8f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:22.374933 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:22.407727 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3588/7108] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:22.407727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201569ff-c4a8-43c9-a7a0-142cc62a8f70 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:22.408115 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-201569ff-c4a8-43c9-a7a0-142cc62a8f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:22.412637 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff7981-03c1-41d3-9539-13b4e3020812 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:22.424497 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8583e8-db02-4be3-a117-27d32d7bd96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:22.424832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201569ff-c4a8-43c9-a7a0-142cc62a8f70 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:22.425153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8583e8-db02-4be3-a117-27d32d7bd96f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:22.426026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8583e8-db02-4be3-a117-27d32d7bd96f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:22.426316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8583e8-db02-4be3-a117-27d32d7bd96f admin admin] PATH_INFO: `/v3/projects/c0d1d87d67b04288b9180302370543a4` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:22.427534 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8583e8-db02-4be3-a117-27d32d7bd96f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0d1d87d67b04288b9180302370543a4)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:22.429463 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8583e8-db02-4be3-a117-27d32d7bd96f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:22.429673 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f668f-926c-4733-b8c7-217e91517155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:22.430312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f668f-926c-4733-b8c7-217e91517155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:22.430698 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f668f-926c-4733-b8c7-217e91517155 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:22.431195 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f668f-926c-4733-b8c7-217e91517155 admin admin] PATH_INFO: `/v3/projects/ab38f73a40f04a56a5a92348b3a3a3d4` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:22.433181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f668f-926c-4733-b8c7-217e91517155 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab38f73a40f04a56a5a92348b3a3a3d4)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:22.435644 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f668f-926c-4733-b8c7-217e91517155 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:22.513626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3c8583e8-db02-4be3-a117-27d32d7bd96f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0d1d87d67b04288b9180302370543a4', 'request_id': 'req-3c8583e8-db02-4be3-a117-27d32d7bd96f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:22.520278 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3c8583e8-db02-4be3-a117-27d32d7bd96f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0d1d87d67b04288b9180302370543a4', 'request_id': 'req-3c8583e8-db02-4be3-a117-27d32d7bd96f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:22.530373 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4d8f668f-926c-4733-b8c7-217e91517155 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab38f73a40f04a56a5a92348b3a3a3d4', 'request_id': 'req-4d8f668f-926c-4733-b8c7-217e91517155'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:22.533641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3c8583e8-db02-4be3-a117-27d32d7bd96f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0d1d87d67b04288b9180302370543a4', 'request_id': 'req-3c8583e8-db02-4be3-a117-27d32d7bd96f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:22.546312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4d8f668f-926c-4733-b8c7-217e91517155 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab38f73a40f04a56a5a92348b3a3a3d4', 'request_id': 'req-4d8f668f-926c-4733-b8c7-217e91517155'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:22.555965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3c8583e8-db02-4be3-a117-27d32d7bd96f admin admin] The token cache is being invalidate because project c0d1d87d67b04288b9180302370543a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:21:22.556470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3c8583e8-db02-4be3-a117-27d32d7bd96f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:22.557101 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4d8f668f-926c-4733-b8c7-217e91517155 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab38f73a40f04a56a5a92348b3a3a3d4', 'request_id': 'req-4d8f668f-926c-4733-b8c7-217e91517155'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:22.558016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3c8583e8-db02-4be3-a117-27d32d7bd96f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:22.561599 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3521/7109] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:21:22 2022] DELETE /identity/v3/projects/c0d1d87d67b04288b9180302370543a4 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:22.562699 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8583e8-db02-4be3-a117-27d32d7bd96f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:22.566405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3c8583e8-db02-4be3-a117-27d32d7bd96f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:22.576966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4d8f668f-926c-4733-b8c7-217e91517155 admin admin] The token cache is being invalidate because project ab38f73a40f04a56a5a92348b3a3a3d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:21:22.577270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4d8f668f-926c-4733-b8c7-217e91517155 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:22.578423 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4d8f668f-926c-4733-b8c7-217e91517155 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:22.580810 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3589/7110] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:21:22 2022] DELETE /identity/v3/projects/ab38f73a40f04a56a5a92348b3a3a3d4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:22.581608 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f668f-926c-4733-b8c7-217e91517155 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:22.586584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4d8f668f-926c-4733-b8c7-217e91517155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:22.636478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:22.666594 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8583e8-db02-4be3-a117-27d32d7bd96f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:22.669002 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab53ef-e9ae-4d79-9693-a96f81742283 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:22.670384 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab53ef-e9ae-4d79-9693-a96f81742283 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:22.670706 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab53ef-e9ae-4d79-9693-a96f81742283 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:22.670971 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab53ef-e9ae-4d79-9693-a96f81742283 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:22.673101 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-13ab53ef-e9ae-4d79-9693-a96f81742283 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:22.701262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f668f-926c-4733-b8c7-217e91517155 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:22.758125 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab53ef-e9ae-4d79-9693-a96f81742283 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:22.759773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab53ef-e9ae-4d79-9693-a96f81742283 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:22.776453 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3522/7111] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:22.779153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facfad39-5233-4783-b9be-ff478670015e None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:22.779153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facfad39-5233-4783-b9be-ff478670015e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:22.779564 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facfad39-5233-4783-b9be-ff478670015e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:22.795451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07b1e5-fb4e-440c-bf4d-51233a3d4a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:22.796397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07b1e5-fb4e-440c-bf4d-51233a3d4a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:22.796659 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07b1e5-fb4e-440c-bf4d-51233a3d4a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:22.797057 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07b1e5-fb4e-440c-bf4d-51233a3d4a7b admin admin] PATH_INFO: `/v3/users/99f6921ccf8a443d89e62259402b415a` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:22.798264 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07b1e5-fb4e-440c-bf4d-51233a3d4a7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=99f6921ccf8a443d89e62259402b415a)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:22.800423 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07b1e5-fb4e-440c-bf4d-51233a3d4a7b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:22.805223 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-facfad39-5233-4783-b9be-ff478670015e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:22.807272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-facfad39-5233-4783-b9be-ff478670015e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:22.819750 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3523/7112] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:22.829373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65533302-bcc3-4b78-bf6e-c06a9ca09696 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:22.829926 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65533302-bcc3-4b78-bf6e-c06a9ca09696 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:22.831295 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65533302-bcc3-4b78-bf6e-c06a9ca09696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:22.868033 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-65533302-bcc3-4b78-bf6e-c06a9ca09696 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:22.869659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-65533302-bcc3-4b78-bf6e-c06a9ca09696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:22.873729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4d07b1e5-fb4e-440c-bf4d-51233a3d4a7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99f6921ccf8a443d89e62259402b415a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:22.883350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4d07b1e5-fb4e-440c-bf4d-51233a3d4a7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99f6921ccf8a443d89e62259402b415a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:22.884033 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3524/7113] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:22.885427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4d07b1e5-fb4e-440c-bf4d-51233a3d4a7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99f6921ccf8a443d89e62259402b415a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:22.886320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4d07b1e5-fb4e-440c-bf4d-51233a3d4a7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99f6921ccf8a443d89e62259402b415a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:22.888966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65533302-bcc3-4b78-bf6e-c06a9ca09696 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:22.900893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4d07b1e5-fb4e-440c-bf4d-51233a3d4a7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99f6921ccf8a443d89e62259402b415a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:22.906221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65533302-bcc3-4b78-bf6e-c06a9ca09696 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:22.912486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419edc57-52c1-48cd-9ce2-eaf9720a2dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:22.913671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419edc57-52c1-48cd-9ce2-eaf9720a2dac admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:22.913671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419edc57-52c1-48cd-9ce2-eaf9720a2dac admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:22.914076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419edc57-52c1-48cd-9ce2-eaf9720a2dac admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:22.915105 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419edc57-52c1-48cd-9ce2-eaf9720a2dac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:21:22.915459 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419edc57-52c1-48cd-9ce2-eaf9720a2dac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:22.917026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419edc57-52c1-48cd-9ce2-eaf9720a2dac admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:22.936199 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3525/7114] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:21:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:21:22.940063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419edc57-52c1-48cd-9ce2-eaf9720a2dac admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:22.941825 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-419edc57-52c1-48cd-9ce2-eaf9720a2dac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:22.942037 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3590/7115] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:21:22 2022] DELETE /identity/v3/users/99f6921ccf8a443d89e62259402b415a => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:22.960930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419edc57-52c1-48cd-9ce2-eaf9720a2dac admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:22.966068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:23.058314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf26a52-2e4e-455d-a1cd-8b8d6c749358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:23.059186 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf26a52-2e4e-455d-a1cd-8b8d6c749358 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:23.059591 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf26a52-2e4e-455d-a1cd-8b8d6c749358 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:23.059874 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf26a52-2e4e-455d-a1cd-8b8d6c749358 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:23.060985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf26a52-2e4e-455d-a1cd-8b8d6c749358 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:23.063331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf26a52-2e4e-455d-a1cd-8b8d6c749358 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:23.101385 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3526/7116] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:21:22 2022] POST /identity/v3/projects => generated 409 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:21:23.102636 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07b1e5-fb4e-440c-bf4d-51233a3d4a7b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:23.117451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07b1e5-fb4e-440c-bf4d-51233a3d4a7b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:23.183426 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:23.203724 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5a82c-3297-4526-a881-fd5eb76fbedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:23.204346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5a82c-3297-4526-a881-fd5eb76fbedc admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:23.204629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5a82c-3297-4526-a881-fd5eb76fbedc admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:23.205442 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5a82c-3297-4526-a881-fd5eb76fbedc admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:23.205666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5a82c-3297-4526-a881-fd5eb76fbedc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:23.207788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5a82c-3297-4526-a881-fd5eb76fbedc admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:23.233184 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3591/7117] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:21:23 2022] POST /identity/v3/users => generated 305 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:21:23.237914 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf26a52-2e4e-455d-a1cd-8b8d6c749358 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:23.250626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf26a52-2e4e-455d-a1cd-8b8d6c749358 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:23.259517 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2fa31-19b5-46a1-a3e6-29f2f1a79723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:23.260241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2fa31-19b5-46a1-a3e6-29f2f1a79723 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:23.260669 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2fa31-19b5-46a1-a3e6-29f2f1a79723 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:23.261046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2fa31-19b5-46a1-a3e6-29f2f1a79723 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:23.262517 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c2fa31-19b5-46a1-a3e6-29f2f1a79723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:23.264465 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c2fa31-19b5-46a1-a3e6-29f2f1a79723 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:23.281384 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3527/7118] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:21:23.283293 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5a82c-3297-4526-a881-fd5eb76fbedc admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:23.298611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5a82c-3297-4526-a881-fd5eb76fbedc admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:23.305036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed19ace-5f78-4900-b46a-f439e90acf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:23.305617 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed19ace-5f78-4900-b46a-f439e90acf5a admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:23.305963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed19ace-5f78-4900-b46a-f439e90acf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:23.306235 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed19ace-5f78-4900-b46a-f439e90acf5a admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:23.306896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed19ace-5f78-4900-b46a-f439e90acf5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:23.308566 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed19ace-5f78-4900-b46a-f439e90acf5a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:23.327485 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3592/7119] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:23.331228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2fa31-19b5-46a1-a3e6-29f2f1a79723 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:23.343324 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2fa31-19b5-46a1-a3e6-29f2f1a79723 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:23.348349 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73703f34-7614-4228-9cbf-4dbc04f0e6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:23.349020 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73703f34-7614-4228-9cbf-4dbc04f0e6a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:23.349303 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73703f34-7614-4228-9cbf-4dbc04f0e6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:23.349584 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73703f34-7614-4228-9cbf-4dbc04f0e6a7 admin admin] PATH_INFO: `/v3/projects/539e193f7f7140b884288209cc291d9b/users/8a3721904bb847d18a18d272a7d34949/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:23.367201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73703f34-7614-4228-9cbf-4dbc04f0e6a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=539e193f7f7140b884288209cc291d9b, user_id=8a3721904bb847d18a18d272a7d34949, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:23.369888 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73703f34-7614-4228-9cbf-4dbc04f0e6a7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:23.403084 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3528/7120] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:23 2022] PUT /identity/v3/projects/539e193f7f7140b884288209cc291d9b/users/8a3721904bb847d18a18d272a7d34949/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:21:23.413984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf11d62-47aa-4342-afa8-7a9b3b535d34 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:23.414273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf11d62-47aa-4342-afa8-7a9b3b535d34 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:23.414528 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf11d62-47aa-4342-afa8-7a9b3b535d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:23.453733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-2cf11d62-47aa-4342-afa8-7a9b3b535d34 None None] MFA Rules not processed for user `8a3721904bb847d18a18d272a7d34949`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:23.455634 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2cf11d62-47aa-4342-afa8-7a9b3b535d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:23.531097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73703f34-7614-4228-9cbf-4dbc04f0e6a7 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:23.532882 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-73703f34-7614-4228-9cbf-4dbc04f0e6a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:23.579447 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3593/7121] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:23 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:23.580493 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf11d62-47aa-4342-afa8-7a9b3b535d34 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:23.629601 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73703f34-7614-4228-9cbf-4dbc04f0e6a7 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:23.639607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9acd8-5bc9-4d9f-8821-4265d32daf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:23.640761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9acd8-5bc9-4d9f-8821-4265d32daf2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:23.640761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9acd8-5bc9-4d9f-8821-4265d32daf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:23.641174 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9acd8-5bc9-4d9f-8821-4265d32daf2e admin admin] PATH_INFO: `/v3/projects/30849d2db00549bdb8a4a42e56594598` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:23.643072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9acd8-5bc9-4d9f-8821-4265d32daf2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=30849d2db00549bdb8a4a42e56594598)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:23.645283 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9acd8-5bc9-4d9f-8821-4265d32daf2e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:23.664987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf11d62-47aa-4342-afa8-7a9b3b535d34 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:23.670068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058632ef-5548-44f3-b603-89487f7e244c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:23.670720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058632ef-5548-44f3-b603-89487f7e244c admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:23.671001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058632ef-5548-44f3-b603-89487f7e244c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:23.671279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058632ef-5548-44f3-b603-89487f7e244c admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:23.671923 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058632ef-5548-44f3-b603-89487f7e244c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:23.673977 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058632ef-5548-44f3-b603-89487f7e244c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:23.726462 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bfa9acd8-5bc9-4d9f-8821-4265d32daf2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30849d2db00549bdb8a4a42e56594598', 'request_id': 'req-bfa9acd8-5bc9-4d9f-8821-4265d32daf2e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:23.736227 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3594/7122] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:21:23 2022] POST /identity/v3/projects => generated 407 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:23.740506 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058632ef-5548-44f3-b603-89487f7e244c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:23.753465 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bfa9acd8-5bc9-4d9f-8821-4265d32daf2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30849d2db00549bdb8a4a42e56594598', 'request_id': 'req-bfa9acd8-5bc9-4d9f-8821-4265d32daf2e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:23.755185 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:23.764754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bfa9acd8-5bc9-4d9f-8821-4265d32daf2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30849d2db00549bdb8a4a42e56594598', 'request_id': 'req-bfa9acd8-5bc9-4d9f-8821-4265d32daf2e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:23.787325 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bfa9acd8-5bc9-4d9f-8821-4265d32daf2e admin admin] The token cache is being invalidate because project 30849d2db00549bdb8a4a42e56594598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:21:23.788252 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bfa9acd8-5bc9-4d9f-8821-4265d32daf2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:23.788996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bfa9acd8-5bc9-4d9f-8821-4265d32daf2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:23.790790 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3529/7123] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:21:23 2022] DELETE /identity/v3/projects/30849d2db00549bdb8a4a42e56594598 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:21:23.799331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60d3f6-ba79-4d46-9665-25106c275659 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:23.799561 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60d3f6-ba79-4d46-9665-25106c275659 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:23.799952 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60d3f6-ba79-4d46-9665-25106c275659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:23.817078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:23.825933 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-3e60d3f6-ba79-4d46-9665-25106c275659 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:23.827746 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3e60d3f6-ba79-4d46-9665-25106c275659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:23.837207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058632ef-5548-44f3-b603-89487f7e244c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:23.838187 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3530/7124] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:23.848041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf879de-9e4a-46cd-8d72-effbaaef5e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:23.848689 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf879de-9e4a-46cd-8d72-effbaaef5e51 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:23.848975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf879de-9e4a-46cd-8d72-effbaaef5e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:23.849256 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf879de-9e4a-46cd-8d72-effbaaef5e51 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:23.849889 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf879de-9e4a-46cd-8d72-effbaaef5e51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:23.850751 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1f72a-d31c-4fa0-91de-4829baac60ab None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:23.851172 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1f72a-d31c-4fa0-91de-4829baac60ab None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:23.851520 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1f72a-d31c-4fa0-91de-4829baac60ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:23.851987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf879de-9e4a-46cd-8d72-effbaaef5e51 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:23.881870 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3595/7125] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:21:23 2022] POST /identity/v3/users => generated 310 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:21:23.884742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-eff1f72a-d31c-4fa0-91de-4829baac60ab None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:23.886127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf879de-9e4a-46cd-8d72-effbaaef5e51 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:23.888547 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-eff1f72a-d31c-4fa0-91de-4829baac60ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:23.889372 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8bf879de-9e4a-46cd-8d72-effbaaef5e51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:23.898561 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3531/7126] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:23.903624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1f72a-d31c-4fa0-91de-4829baac60ab None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:23.907529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf879de-9e4a-46cd-8d72-effbaaef5e51 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:23.914156 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1f72a-d31c-4fa0-91de-4829baac60ab None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:23.916831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bf7f2-17a9-470f-8d90-e130c74b4aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:23.917768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bf7f2-17a9-470f-8d90-e130c74b4aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:23.919912 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bf7f2-17a9-470f-8d90-e130c74b4aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:23.920579 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bf7f2-17a9-470f-8d90-e130c74b4aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:23.921404 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7bf7f2-17a9-470f-8d90-e130c74b4aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:23.921550 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2d7ec-1ade-4094-becc-da8a018ff28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:23.922083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2d7ec-1ade-4094-becc-da8a018ff28d admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:23.922430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2d7ec-1ade-4094-becc-da8a018ff28d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:23.922664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2d7ec-1ade-4094-becc-da8a018ff28d admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:23.923958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc2d7ec-1ade-4094-becc-da8a018ff28d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:21:23.924089 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7bf7f2-17a9-470f-8d90-e130c74b4aa9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:23.924354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc2d7ec-1ade-4094-becc-da8a018ff28d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:23.925899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc2d7ec-1ade-4094-becc-da8a018ff28d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:23.939041 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3532/7127] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:21:23.941751 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3596/7128] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:23.945383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2d7ec-1ade-4094-becc-da8a018ff28d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:23.945533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bf7f2-17a9-470f-8d90-e130c74b4aa9 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:23.966027 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bf7f2-17a9-470f-8d90-e130c74b4aa9 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:23.968882 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2d7ec-1ade-4094-becc-da8a018ff28d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:23.976640 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655cf09-4f70-446c-83c6-fc97113daaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:23.978377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655cf09-4f70-446c-83c6-fc97113daaab admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:23.978859 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655cf09-4f70-446c-83c6-fc97113daaab admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:23.978981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca368d14-44c7-4e3c-b91d-152ec3dcd690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:23.979149 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655cf09-4f70-446c-83c6-fc97113daaab admin admin] PATH_INFO: `/v3/projects/65482a0303954645a6cd322936853c86/users/85919a7f839c47b2ae1cbdbfad8774bc/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:23.979743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca368d14-44c7-4e3c-b91d-152ec3dcd690 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:23.980039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca368d14-44c7-4e3c-b91d-152ec3dcd690 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:23.980318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca368d14-44c7-4e3c-b91d-152ec3dcd690 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:23.983836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca368d14-44c7-4e3c-b91d-152ec3dcd690 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:23.985832 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca368d14-44c7-4e3c-b91d-152ec3dcd690 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:24.001627 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0655cf09-4f70-446c-83c6-fc97113daaab admin admin] RBAC: Authorizing `identity:create_grant(project_id=65482a0303954645a6cd322936853c86, user_id=85919a7f839c47b2ae1cbdbfad8774bc, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:24.006199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0655cf09-4f70-446c-83c6-fc97113daaab admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:24.030241 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3597/7129] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:23 2022] PUT /identity/v3/projects/65482a0303954645a6cd322936853c86/users/85919a7f839c47b2ae1cbdbfad8774bc/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:21:24.036235 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655cf09-4f70-446c-83c6-fc97113daaab admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:24.041083 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3533/7130] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:21:23 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:24.045913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca368d14-44c7-4e3c-b91d-152ec3dcd690 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:24.142626 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655cf09-4f70-446c-83c6-fc97113daaab admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:24.150242 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ebcbc-d501-4aa8-9350-14f67edad7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:24.151297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ebcbc-d501-4aa8-9350-14f67edad7dc admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:24.151529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ebcbc-d501-4aa8-9350-14f67edad7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:24.151712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ebcbc-d501-4aa8-9350-14f67edad7dc admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:24.152140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca368d14-44c7-4e3c-b91d-152ec3dcd690 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:24.152386 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54ebcbc-d501-4aa8-9350-14f67edad7dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:24.155340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54ebcbc-d501-4aa8-9350-14f67edad7dc admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:24.162808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a6b60-7c48-48a4-b84b-677a2648e86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:24.164054 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a6b60-7c48-48a4-b84b-677a2648e86d admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:24.164548 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a6b60-7c48-48a4-b84b-677a2648e86d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:24.165175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a6b60-7c48-48a4-b84b-677a2648e86d admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:24.166135 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a6b60-7c48-48a4-b84b-677a2648e86d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:24.168637 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3598/7131] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:24.169534 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a6b60-7c48-48a4-b84b-677a2648e86d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:24.172406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ebcbc-d501-4aa8-9350-14f67edad7dc admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:24.185181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ebcbc-d501-4aa8-9350-14f67edad7dc admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:24.193901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e55137-091f-46c4-99da-b9d23ad394c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:24.195031 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e55137-091f-46c4-99da-b9d23ad394c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:24.195497 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e55137-091f-46c4-99da-b9d23ad394c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:24.196113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e55137-091f-46c4-99da-b9d23ad394c1 admin admin] PATH_INFO: `/v3/projects/65482a0303954645a6cd322936853c86/users/85919a7f839c47b2ae1cbdbfad8774bc/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:24.201216 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3534/7132] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:21:24 2022] POST /identity/v3/users => generated 288 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:24.202488 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a6b60-7c48-48a4-b84b-677a2648e86d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:24.205914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e55137-091f-46c4-99da-b9d23ad394c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65482a0303954645a6cd322936853c86, user_id=85919a7f839c47b2ae1cbdbfad8774bc, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:24.211218 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e55137-091f-46c4-99da-b9d23ad394c1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:24.217650 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a6b60-7c48-48a4-b84b-677a2648e86d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:24.223755 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f0eee-3795-401c-b729-c9341c8504cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:24.225039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f0eee-3795-401c-b729-c9341c8504cb admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:24.225039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f0eee-3795-401c-b729-c9341c8504cb admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:24.225217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f0eee-3795-401c-b729-c9341c8504cb admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:24.225999 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f0eee-3795-401c-b729-c9341c8504cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:24.227882 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f0eee-3795-401c-b729-c9341c8504cb admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:24.232547 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3599/7133] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:24 2022] PUT /identity/v3/projects/65482a0303954645a6cd322936853c86/users/85919a7f839c47b2ae1cbdbfad8774bc/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:24.242940 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3535/7134] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:24.243684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8018d6-7330-448a-a19c-b46a55bee01e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:24.243976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8018d6-7330-448a-a19c-b46a55bee01e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:24.244259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8018d6-7330-448a-a19c-b46a55bee01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:24.247971 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f0eee-3795-401c-b729-c9341c8504cb admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:24.263915 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f0eee-3795-401c-b729-c9341c8504cb admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:24.291006 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-8b8018d6-7330-448a-a19c-b46a55bee01e None None] MFA Rules not processed for user `85919a7f839c47b2ae1cbdbfad8774bc`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:24.294299 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8b8018d6-7330-448a-a19c-b46a55bee01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:24.363458 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bfe66-63a4-4e7f-a860-88c86861faaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:24.364076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bfe66-63a4-4e7f-a860-88c86861faaf admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:24.364353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bfe66-63a4-4e7f-a860-88c86861faaf admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:24.364625 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bfe66-63a4-4e7f-a860-88c86861faaf admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:24.366963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13bfe66-63a4-4e7f-a860-88c86861faaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:24.370275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13bfe66-63a4-4e7f-a860-88c86861faaf admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:24.386207 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3600/7135] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:24 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:21:24.387562 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3536/7136] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:24.391865 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8018d6-7330-448a-a19c-b46a55bee01e None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:24.395695 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bfe66-63a4-4e7f-a860-88c86861faaf admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:24.399565 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c13bfe66-63a4-4e7f-a860-88c86861faaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:24.408986 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8018d6-7330-448a-a19c-b46a55bee01e None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:24.416416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee169c5c-da5e-4b02-80d5-208f00629db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:24.417270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee169c5c-da5e-4b02-80d5-208f00629db5 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:24.417630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee169c5c-da5e-4b02-80d5-208f00629db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:24.419342 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee169c5c-da5e-4b02-80d5-208f00629db5 admin admin] PATH_INFO: `/v3/projects/dd235081a2584c6986aa088c734bd170/users/a0987f19a34d4275a727d1509fb6cb7a/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:24.424992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:24.430396 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:24.459208 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee169c5c-da5e-4b02-80d5-208f00629db5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd235081a2584c6986aa088c734bd170, user_id=a0987f19a34d4275a727d1509fb6cb7a, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:24.462924 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee169c5c-da5e-4b02-80d5-208f00629db5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:24.492243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bfe66-63a4-4e7f-a860-88c86861faaf admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:24.493074 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3601/7137] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:24 2022] PUT /identity/v3/projects/dd235081a2584c6986aa088c734bd170/users/a0987f19a34d4275a727d1509fb6cb7a/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:21:24.602109 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d07a1e-3529-461e-bce8-0cdf3933ef9b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:24.602478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d07a1e-3529-461e-bce8-0cdf3933ef9b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:24.602804 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d07a1e-3529-461e-bce8-0cdf3933ef9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:24.625283 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9baaf5-c0e8-489b-9a09-c888e969c813 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:24.625919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9baaf5-c0e8-489b-9a09-c888e969c813 service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:24.626205 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9baaf5-c0e8-489b-9a09-c888e969c813 service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:24.626484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9baaf5-c0e8-489b-9a09-c888e969c813 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:24.640176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-f1d07a1e-3529-461e-bce8-0cdf3933ef9b None None] MFA Rules not processed for user `a0987f19a34d4275a727d1509fb6cb7a`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:24.641472 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f1d07a1e-3529-461e-bce8-0cdf3933ef9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:24.763088 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3602/7138] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:24.776506 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d07a1e-3529-461e-bce8-0cdf3933ef9b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:24.778579 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f1d07a1e-3529-461e-bce8-0cdf3933ef9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:24.801248 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9baaf5-c0e8-489b-9a09-c888e969c813 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:24.807800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9baaf5-c0e8-489b-9a09-c888e969c813 service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:24.837761 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3537/7139] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:24 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:24.885152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d07a1e-3529-461e-bce8-0cdf3933ef9b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:24.892001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7484f86-3644-47d4-9407-2671a84fad2a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10759b2abd4cafacf338551327775e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:24.892001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7484f86-3644-47d4-9407-2671a84fad2a service glance] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:24.892001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7484f86-3644-47d4-9407-2671a84fad2a service glance] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:24.892001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7484f86-3644-47d4-9407-2671a84fad2a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:24.910275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9baaf5-c0e8-489b-9a09-c888e969c813 service cinder] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:24.910275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1c9baaf5-c0e8-489b-9a09-c888e969c813 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:24.912416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7484f86-3644-47d4-9407-2671a84fad2a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:24.913655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7484f86-3644-47d4-9407-2671a84fad2a service glance] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:24.936191 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3603/7140] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:24.994793 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9baaf5-c0e8-489b-9a09-c888e969c813 service cinder] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:25.002062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07a581-7274-490b-8467-92a0e68bb655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:25.003374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07a581-7274-490b-8467-92a0e68bb655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:25.004095 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07a581-7274-490b-8467-92a0e68bb655 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:25.004647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07a581-7274-490b-8467-92a0e68bb655 admin admin] PATH_INFO: `/v3/users/6f18fd681dc0496eb27fe3e983a095bb` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:25.005962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07a581-7274-490b-8467-92a0e68bb655 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f18fd681dc0496eb27fe3e983a095bb)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:25.008443 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07a581-7274-490b-8467-92a0e68bb655 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:25.058619 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:25.111493 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4f07a581-7274-490b-8467-92a0e68bb655 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f18fd681dc0496eb27fe3e983a095bb'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:25.112665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4f07a581-7274-490b-8467-92a0e68bb655 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f18fd681dc0496eb27fe3e983a095bb'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:25.114402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4f07a581-7274-490b-8467-92a0e68bb655 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f18fd681dc0496eb27fe3e983a095bb'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:25.125366 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4f07a581-7274-490b-8467-92a0e68bb655 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f18fd681dc0496eb27fe3e983a095bb'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:25.143304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7484f86-3644-47d4-9407-2671a84fad2a service glance] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:25.145337 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d7484f86-3644-47d4-9407-2671a84fad2a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:25.146938 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4f07a581-7274-490b-8467-92a0e68bb655 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f18fd681dc0496eb27fe3e983a095bb'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:25.167030 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3538/7141] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:21:24 2022] DELETE /identity/v3/users/6f18fd681dc0496eb27fe3e983a095bb => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:25.171188 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979376db-fe43-4165-8072-3c1b5ddb374d None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:25.171343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979376db-fe43-4165-8072-3c1b5ddb374d None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:25.171503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979376db-fe43-4165-8072-3c1b5ddb374d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:25.178567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7484f86-3644-47d4-9407-2671a84fad2a service glance] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:25.222394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-979376db-fe43-4165-8072-3c1b5ddb374d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:25.224608 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-979376db-fe43-4165-8072-3c1b5ddb374d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:25.260997 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13a1c6-a998-4f37-aa23-ad18770f0a45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:25.262818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13a1c6-a998-4f37-aa23-ad18770f0a45 service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:25.263449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13a1c6-a998-4f37-aa23-ad18770f0a45 service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:25.263906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13a1c6-a998-4f37-aa23-ad18770f0a45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:25.266069 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4f13a1c6-a998-4f37-aa23-ad18770f0a45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:25.350559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:25.375238 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3539/7142] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:21:25.385854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979376db-fe43-4165-8072-3c1b5ddb374d None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:25.388561 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-979376db-fe43-4165-8072-3c1b5ddb374d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:25.415252 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f13a1c6-a998-4f37-aa23-ad18770f0a45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:25.417072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f13a1c6-a998-4f37-aa23-ad18770f0a45 service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:25.428565 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3604/7143] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:25 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:25.516481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979376db-fe43-4165-8072-3c1b5ddb374d None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:25.521241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2886a5-7e78-486e-98f1-ed2d13e8323e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:25.522191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2886a5-7e78-486e-98f1-ed2d13e8323e service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:25.522785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2886a5-7e78-486e-98f1-ed2d13e8323e service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:25.523294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2886a5-7e78-486e-98f1-ed2d13e8323e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:25.536587 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2886a5-7e78-486e-98f1-ed2d13e8323e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:25.539684 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2886a5-7e78-486e-98f1-ed2d13e8323e service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:25.557768 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3540/7144] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:25.984688 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13a1c6-a998-4f37-aa23-ad18770f0a45 service cinder] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:25.987724 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4f13a1c6-a998-4f37-aa23-ad18770f0a45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:26.066363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13a1c6-a998-4f37-aa23-ad18770f0a45 service cinder] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:26.072656 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51444aff-1be1-4308-862e-bdc1156215e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:26.073826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51444aff-1be1-4308-862e-bdc1156215e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:26.074322 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51444aff-1be1-4308-862e-bdc1156215e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:26.074951 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51444aff-1be1-4308-862e-bdc1156215e2 admin admin] PATH_INFO: `/v3/projects/d55aa7aac54f4521bcca57c5e81362ee` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:26.076865 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51444aff-1be1-4308-862e-bdc1156215e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d55aa7aac54f4521bcca57c5e81362ee)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:26.078779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51444aff-1be1-4308-862e-bdc1156215e2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:26.172368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-51444aff-1be1-4308-862e-bdc1156215e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd55aa7aac54f4521bcca57c5e81362ee', 'request_id': 'req-51444aff-1be1-4308-862e-bdc1156215e2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:26.181271 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-51444aff-1be1-4308-862e-bdc1156215e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd55aa7aac54f4521bcca57c5e81362ee', 'request_id': 'req-51444aff-1be1-4308-862e-bdc1156215e2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:26.194995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-51444aff-1be1-4308-862e-bdc1156215e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd55aa7aac54f4521bcca57c5e81362ee', 'request_id': 'req-51444aff-1be1-4308-862e-bdc1156215e2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:26.224262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-51444aff-1be1-4308-862e-bdc1156215e2 admin admin] The token cache is being invalidate because project d55aa7aac54f4521bcca57c5e81362ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:21:26.224753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-51444aff-1be1-4308-862e-bdc1156215e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:26.225667 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-51444aff-1be1-4308-862e-bdc1156215e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:26.227723 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3605/7145] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:21:25 2022] DELETE /identity/v3/projects/d55aa7aac54f4521bcca57c5e81362ee => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:26.232535 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e88dd-a0ce-4938-8fb2-5f2e676f011d None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:26.233115 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e88dd-a0ce-4938-8fb2-5f2e676f011d None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:26.233428 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e88dd-a0ce-4938-8fb2-5f2e676f011d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:26.260150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-932e88dd-a0ce-4938-8fb2-5f2e676f011d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:26.261423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-932e88dd-a0ce-4938-8fb2-5f2e676f011d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:26.314426 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:26.362024 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3541/7146] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:26.372226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd586e0-8dd0-4e0d-92c3-1be019497e6c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:26.372886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd586e0-8dd0-4e0d-92c3-1be019497e6c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:26.373173 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd586e0-8dd0-4e0d-92c3-1be019497e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:26.410862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-fbd586e0-8dd0-4e0d-92c3-1be019497e6c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:26.412600 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-fbd586e0-8dd0-4e0d-92c3-1be019497e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:26.423382 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3606/7147] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:26.427889 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e88dd-a0ce-4938-8fb2-5f2e676f011d None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:26.448242 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e88dd-a0ce-4938-8fb2-5f2e676f011d None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:26.477224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37ef05-dfb9-4b7b-be7a-22ba40be7cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:26.478041 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37ef05-dfb9-4b7b-be7a-22ba40be7cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:26.478334 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37ef05-dfb9-4b7b-be7a-22ba40be7cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:26.478634 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37ef05-dfb9-4b7b-be7a-22ba40be7cf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:26.479310 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37ef05-dfb9-4b7b-be7a-22ba40be7cf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:21:26.482262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37ef05-dfb9-4b7b-be7a-22ba40be7cf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:26.484727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37ef05-dfb9-4b7b-be7a-22ba40be7cf6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:26.512372 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3542/7148] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:21:26.516786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd586e0-8dd0-4e0d-92c3-1be019497e6c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:26.529120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd586e0-8dd0-4e0d-92c3-1be019497e6c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:26.535951 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2c19f-910f-4adb-a4fd-cf42af3db46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:26.547780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2c19f-910f-4adb-a4fd-cf42af3db46e admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:26.548141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2c19f-910f-4adb-a4fd-cf42af3db46e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:26.548447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2c19f-910f-4adb-a4fd-cf42af3db46e admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:26.552051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2c19f-910f-4adb-a4fd-cf42af3db46e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:26.557504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2c19f-910f-4adb-a4fd-cf42af3db46e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:26.622973 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3607/7149] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:21:26 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:26.624078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37ef05-dfb9-4b7b-be7a-22ba40be7cf6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:26.636615 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37ef05-dfb9-4b7b-be7a-22ba40be7cf6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:26.720191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677660f-77fc-4c5c-8c40-95f9adbcc24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:26.721598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677660f-77fc-4c5c-8c40-95f9adbcc24e admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:26.721598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677660f-77fc-4c5c-8c40-95f9adbcc24e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:26.721843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677660f-77fc-4c5c-8c40-95f9adbcc24e admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:26.722482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677660f-77fc-4c5c-8c40-95f9adbcc24e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:26.724662 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677660f-77fc-4c5c-8c40-95f9adbcc24e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:26.795784 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3543/7150] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:21:26 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:21:26.797078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2c19f-910f-4adb-a4fd-cf42af3db46e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:26.827404 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2c19f-910f-4adb-a4fd-cf42af3db46e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:26.840972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e456b1-15b9-46fd-aa34-ff3f26ac1750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:26.842641 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e456b1-15b9-46fd-aa34-ff3f26ac1750 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:26.843085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e456b1-15b9-46fd-aa34-ff3f26ac1750 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:26.844116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e456b1-15b9-46fd-aa34-ff3f26ac1750 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:26.844937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e456b1-15b9-46fd-aa34-ff3f26ac1750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:26.847693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e456b1-15b9-46fd-aa34-ff3f26ac1750 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:26.869948 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677660f-77fc-4c5c-8c40-95f9adbcc24e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:26.870046 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3608/7151] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:26.881994 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677660f-77fc-4c5c-8c40-95f9adbcc24e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:26.888630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01770b51-2e99-4077-be0c-3f716124d0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:26.889390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01770b51-2e99-4077-be0c-3f716124d0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:26.889809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01770b51-2e99-4077-be0c-3f716124d0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:26.890185 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01770b51-2e99-4077-be0c-3f716124d0f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:26.890986 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01770b51-2e99-4077-be0c-3f716124d0f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:26.892706 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01770b51-2e99-4077-be0c-3f716124d0f4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:26.907166 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3544/7152] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:26.911712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e456b1-15b9-46fd-aa34-ff3f26ac1750 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:26.936386 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e456b1-15b9-46fd-aa34-ff3f26ac1750 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:26.950045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aff829-5150-40dc-b7fa-a4618250724b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:26.950999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aff829-5150-40dc-b7fa-a4618250724b admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:26.951972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aff829-5150-40dc-b7fa-a4618250724b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:26.952219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aff829-5150-40dc-b7fa-a4618250724b admin admin] PATH_INFO: `/v3/projects/9dd91ef1bc6a47d685581fc0013b1b3d/users/e16521ffaa0145a294a7ddecae831941/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:26.972338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aff829-5150-40dc-b7fa-a4618250724b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dd91ef1bc6a47d685581fc0013b1b3d, user_id=e16521ffaa0145a294a7ddecae831941, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:26.976380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aff829-5150-40dc-b7fa-a4618250724b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:27.002598 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3609/7153] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:26 2022] PUT /identity/v3/projects/9dd91ef1bc6a47d685581fc0013b1b3d/users/e16521ffaa0145a294a7ddecae831941/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:27.009473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b5f0a-0be3-4048-94d1-8b6561a034b2 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:27.009765 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b5f0a-0be3-4048-94d1-8b6561a034b2 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:27.010043 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b5f0a-0be3-4048-94d1-8b6561a034b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:27.054494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-2a8b5f0a-0be3-4048-94d1-8b6561a034b2 None None] MFA Rules not processed for user `e16521ffaa0145a294a7ddecae831941`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:27.056290 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2a8b5f0a-0be3-4048-94d1-8b6561a034b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:27.207517 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3545/7154] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:27.234581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aff829-5150-40dc-b7fa-a4618250724b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:27.239674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f2aff829-5150-40dc-b7fa-a4618250724b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:27.290973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:27.388016 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aff829-5150-40dc-b7fa-a4618250724b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:27.392518 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a981d-849f-46b7-bfb2-b4b520d161ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:27.393329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a981d-849f-46b7-bfb2-b4b520d161ca service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:27.393641 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a981d-849f-46b7-bfb2-b4b520d161ca service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:27.393905 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a981d-849f-46b7-bfb2-b4b520d161ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:27.409144 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a981d-849f-46b7-bfb2-b4b520d161ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:27.413022 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a981d-849f-46b7-bfb2-b4b520d161ca service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:27.447984 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3610/7155] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:27.449441 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b5f0a-0be3-4048-94d1-8b6561a034b2 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:27.534086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:27.589112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b5f0a-0be3-4048-94d1-8b6561a034b2 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:27.597664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08fa530-5c17-4d9c-b419-fd657511f282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:27.598321 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fa530-5c17-4d9c-b419-fd657511f282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:27.598623 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fa530-5c17-4d9c-b419-fd657511f282 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:27.598898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fa530-5c17-4d9c-b419-fd657511f282 admin admin] PATH_INFO: `/v3/users/e16521ffaa0145a294a7ddecae831941` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:27.600659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08fa530-5c17-4d9c-b419-fd657511f282 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e16521ffaa0145a294a7ddecae831941)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:27.602381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08fa530-5c17-4d9c-b419-fd657511f282 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:27.667790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e08fa530-5c17-4d9c-b419-fd657511f282 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e16521ffaa0145a294a7ddecae831941'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:27.669353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e08fa530-5c17-4d9c-b419-fd657511f282 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e16521ffaa0145a294a7ddecae831941'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:27.670051 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e08fa530-5c17-4d9c-b419-fd657511f282 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e16521ffaa0145a294a7ddecae831941'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:27.683149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e08fa530-5c17-4d9c-b419-fd657511f282 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e16521ffaa0145a294a7ddecae831941'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:27.698320 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e08fa530-5c17-4d9c-b419-fd657511f282 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e16521ffaa0145a294a7ddecae831941'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:27.729133 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3546/7156] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:21:27 2022] DELETE /identity/v3/users/e16521ffaa0145a294a7ddecae831941 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:27.732098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc23de0-8cce-47cc-95c7-6f9b2b6ec4b1 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:27.732490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc23de0-8cce-47cc-95c7-6f9b2b6ec4b1 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:27.732875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc23de0-8cce-47cc-95c7-6f9b2b6ec4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:27.757127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-ddc23de0-8cce-47cc-95c7-6f9b2b6ec4b1 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:27.758635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ddc23de0-8cce-47cc-95c7-6f9b2b6ec4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:27.868572 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3611/7157] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:21:27.879674 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08fa530-5c17-4d9c-b419-fd657511f282 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:27.881645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e08fa530-5c17-4d9c-b419-fd657511f282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:27.977535 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08fa530-5c17-4d9c-b419-fd657511f282 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:27.988840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93fbd05-6359-4b11-bdd2-a8c9294fa3f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:27.991279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fbd05-6359-4b11-bdd2-a8c9294fa3f4 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:27.991639 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fbd05-6359-4b11-bdd2-a8c9294fa3f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:27.991843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fbd05-6359-4b11-bdd2-a8c9294fa3f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:28.009804 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93fbd05-6359-4b11-bdd2-a8c9294fa3f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:28.014022 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93fbd05-6359-4b11-bdd2-a8c9294fa3f4 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:28.026406 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3547/7158] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:28.706938 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc23de0-8cce-47cc-95c7-6f9b2b6ec4b1 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:28.709462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ddc23de0-8cce-47cc-95c7-6f9b2b6ec4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:28.742727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc23de0-8cce-47cc-95c7-6f9b2b6ec4b1 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:28.759982 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b362ed4-2ed6-4adc-8a6c-7ccac780fadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:28.768539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b362ed4-2ed6-4adc-8a6c-7ccac780fadd admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:28.769266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b362ed4-2ed6-4adc-8a6c-7ccac780fadd admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:28.770179 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b362ed4-2ed6-4adc-8a6c-7ccac780fadd admin admin] PATH_INFO: `/v3/projects/9dd91ef1bc6a47d685581fc0013b1b3d` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:28.773490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b362ed4-2ed6-4adc-8a6c-7ccac780fadd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dd91ef1bc6a47d685581fc0013b1b3d)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:28.778157 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b362ed4-2ed6-4adc-8a6c-7ccac780fadd admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:28.899764 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8b362ed4-2ed6-4adc-8a6c-7ccac780fadd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dd91ef1bc6a47d685581fc0013b1b3d', 'request_id': 'req-8b362ed4-2ed6-4adc-8a6c-7ccac780fadd'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:28.913834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8b362ed4-2ed6-4adc-8a6c-7ccac780fadd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dd91ef1bc6a47d685581fc0013b1b3d', 'request_id': 'req-8b362ed4-2ed6-4adc-8a6c-7ccac780fadd'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:28.936690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8b362ed4-2ed6-4adc-8a6c-7ccac780fadd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dd91ef1bc6a47d685581fc0013b1b3d', 'request_id': 'req-8b362ed4-2ed6-4adc-8a6c-7ccac780fadd'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:28.953223 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8b362ed4-2ed6-4adc-8a6c-7ccac780fadd admin admin] The token cache is being invalidate because project 9dd91ef1bc6a47d685581fc0013b1b3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:21:28.953842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8b362ed4-2ed6-4adc-8a6c-7ccac780fadd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:28.955568 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8b362ed4-2ed6-4adc-8a6c-7ccac780fadd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:28.959204 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3612/7159] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:21:28 2022] DELETE /identity/v3/projects/9dd91ef1bc6a47d685581fc0013b1b3d => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:28.965755 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8c5e9-e696-446f-9a96-e52957072024 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:28.966184 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8c5e9-e696-446f-9a96-e52957072024 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:28.966715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8c5e9-e696-446f-9a96-e52957072024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:29.026282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-21d8c5e9-e696-446f-9a96-e52957072024 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:29.027681 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-21d8c5e9-e696-446f-9a96-e52957072024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:29.183231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:29.216111 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3548/7160] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:29.225037 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e2a81-d856-4ec7-90ea-d6e67e15ba5d None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:29.225648 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e2a81-d856-4ec7-90ea-d6e67e15ba5d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:29.226389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e2a81-d856-4ec7-90ea-d6e67e15ba5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:29.268974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-fc7e2a81-d856-4ec7-90ea-d6e67e15ba5d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:29.270170 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-fc7e2a81-d856-4ec7-90ea-d6e67e15ba5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:29.284275 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3613/7161] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:21:29.285492 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8c5e9-e696-446f-9a96-e52957072024 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:29.303125 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8c5e9-e696-446f-9a96-e52957072024 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:29.314152 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9678b-3843-4b45-be6f-1d70681a2312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:29.315150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9678b-3843-4b45-be6f-1d70681a2312 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:29.317802 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9678b-3843-4b45-be6f-1d70681a2312 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:29.317802 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9678b-3843-4b45-be6f-1d70681a2312 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:29.318559 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c9678b-3843-4b45-be6f-1d70681a2312 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:21:29.318874 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c9678b-3843-4b45-be6f-1d70681a2312 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:29.325417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c9678b-3843-4b45-be6f-1d70681a2312 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:29.370539 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3549/7162] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:21:29.377151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e2a81-d856-4ec7-90ea-d6e67e15ba5d None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:29.391185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e2a81-d856-4ec7-90ea-d6e67e15ba5d None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:29.401078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa37f14-523b-479b-b969-b8ca81b0fc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:29.404345 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa37f14-523b-479b-b969-b8ca81b0fc15 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:29.404797 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa37f14-523b-479b-b969-b8ca81b0fc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:29.406914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa37f14-523b-479b-b969-b8ca81b0fc15 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:29.407656 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa37f14-523b-479b-b969-b8ca81b0fc15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:29.412880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa37f14-523b-479b-b969-b8ca81b0fc15 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:29.474642 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3614/7163] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:21:29 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:29.478808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9678b-3843-4b45-be6f-1d70681a2312 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:29.494053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9678b-3843-4b45-be6f-1d70681a2312 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:29.591239 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ac5f7-fbcb-47a0-ba4d-3a0c8265e8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:29.591857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ac5f7-fbcb-47a0-ba4d-3a0c8265e8ab admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:29.592287 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ac5f7-fbcb-47a0-ba4d-3a0c8265e8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:29.592570 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ac5f7-fbcb-47a0-ba4d-3a0c8265e8ab admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:29.593233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ac5f7-fbcb-47a0-ba4d-3a0c8265e8ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:29.595227 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ac5f7-fbcb-47a0-ba4d-3a0c8265e8ab admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:29.630422 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3550/7164] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:21:29 2022] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:29.631968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa37f14-523b-479b-b969-b8ca81b0fc15 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:29.646322 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa37f14-523b-479b-b969-b8ca81b0fc15 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:29.677768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e302a-fb2f-47b5-82b7-09c988ce4101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:29.678665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e302a-fb2f-47b5-82b7-09c988ce4101 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:29.679334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e302a-fb2f-47b5-82b7-09c988ce4101 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:29.681541 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e302a-fb2f-47b5-82b7-09c988ce4101 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:29.682934 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e302a-fb2f-47b5-82b7-09c988ce4101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:29.685373 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e302a-fb2f-47b5-82b7-09c988ce4101 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:29.704806 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3615/7165] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:29.709074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ac5f7-fbcb-47a0-ba4d-3a0c8265e8ab admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:29.724801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ac5f7-fbcb-47a0-ba4d-3a0c8265e8ab admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:29.730417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99481e3b-fe29-49cd-aa45-ffe12e7d6916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:29.731422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99481e3b-fe29-49cd-aa45-ffe12e7d6916 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:29.731912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99481e3b-fe29-49cd-aa45-ffe12e7d6916 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:29.732325 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99481e3b-fe29-49cd-aa45-ffe12e7d6916 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:29.732993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99481e3b-fe29-49cd-aa45-ffe12e7d6916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:29.734673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99481e3b-fe29-49cd-aa45-ffe12e7d6916 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:29.749446 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3551/7166] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:29.753996 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e302a-fb2f-47b5-82b7-09c988ce4101 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:29.762961 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:29.770385 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e302a-fb2f-47b5-82b7-09c988ce4101 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:29.780025 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd73fc6-ac40-4c0c-8158-722267ab26c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:29.781045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd73fc6-ac40-4c0c-8158-722267ab26c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:29.781531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd73fc6-ac40-4c0c-8158-722267ab26c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:29.783117 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd73fc6-ac40-4c0c-8158-722267ab26c2 admin admin] PATH_INFO: `/v3/projects/701cafbd5f9e4ffdb4540e7479297bd2/users/6bba1c37e640467fb6693a20ad60594c/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:29.813074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd73fc6-ac40-4c0c-8158-722267ab26c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=701cafbd5f9e4ffdb4540e7479297bd2, user_id=6bba1c37e640467fb6693a20ad60594c, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:29.817308 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd73fc6-ac40-4c0c-8158-722267ab26c2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:29.836293 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3616/7167] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:29 2022] PUT /identity/v3/projects/701cafbd5f9e4ffdb4540e7479297bd2/users/6bba1c37e640467fb6693a20ad60594c/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:29.848760 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192c936-31ab-47ac-a5a4-8af2540cfe40 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:29.849131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192c936-31ab-47ac-a5a4-8af2540cfe40 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:29.849356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192c936-31ab-47ac-a5a4-8af2540cfe40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:29.890650 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-c192c936-31ab-47ac-a5a4-8af2540cfe40 None None] MFA Rules not processed for user `6bba1c37e640467fb6693a20ad60594c`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:29.891957 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c192c936-31ab-47ac-a5a4-8af2540cfe40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:30.007486 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3552/7168] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:30.012568 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd73fc6-ac40-4c0c-8158-722267ab26c2 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:30.190974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd73fc6-ac40-4c0c-8158-722267ab26c2 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:30.201374 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2de2df-17ac-4db5-a854-7cd2cf0d306e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:30.202172 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2de2df-17ac-4db5-a854-7cd2cf0d306e admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:30.202278 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2de2df-17ac-4db5-a854-7cd2cf0d306e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:30.202471 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2de2df-17ac-4db5-a854-7cd2cf0d306e admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:30.203136 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2de2df-17ac-4db5-a854-7cd2cf0d306e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:30.205233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2de2df-17ac-4db5-a854-7cd2cf0d306e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:30.265903 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3617/7169] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:21:30 2022] POST /identity/v3/projects => generated 371 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:30.268727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192c936-31ab-47ac-a5a4-8af2540cfe40 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:30.288458 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192c936-31ab-47ac-a5a4-8af2540cfe40 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:30.387937 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:30.389892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c728927-39b8-4395-b022-63ba66a6b788 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:30.390445 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c728927-39b8-4395-b022-63ba66a6b788 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:30.390842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c728927-39b8-4395-b022-63ba66a6b788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:30.405979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6368d1-f335-4f8f-bef6-63da50b3d918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:30.406688 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6368d1-f335-4f8f-bef6-63da50b3d918 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:30.407035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6368d1-f335-4f8f-bef6-63da50b3d918 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:30.407354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6368d1-f335-4f8f-bef6-63da50b3d918 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:30.408081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6368d1-f335-4f8f-bef6-63da50b3d918 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:30.410050 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6368d1-f335-4f8f-bef6-63da50b3d918 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:30.450834 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3553/7170] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:21:30 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:30.456251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6368d1-f335-4f8f-bef6-63da50b3d918 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:30.471542 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-2c728927-39b8-4395-b022-63ba66a6b788 None None] MFA Rules not processed for user `e63fbea26373463f8e97bd38a0bc6688`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:30.472302 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6368d1-f335-4f8f-bef6-63da50b3d918 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:30.472992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2c728927-39b8-4395-b022-63ba66a6b788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:30.477946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043c657-bf07-4458-85df-9b2d39036dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:30.479267 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043c657-bf07-4458-85df-9b2d39036dbd admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:30.479563 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043c657-bf07-4458-85df-9b2d39036dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:30.479839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043c657-bf07-4458-85df-9b2d39036dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:30.480753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043c657-bf07-4458-85df-9b2d39036dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:30.482385 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043c657-bf07-4458-85df-9b2d39036dbd admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:30.495680 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3554/7171] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:30.502537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043c657-bf07-4458-85df-9b2d39036dbd admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:30.519122 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043c657-bf07-4458-85df-9b2d39036dbd admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:30.532079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebddfaad-f9d5-4cf6-ae74-cf78ac3a04dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:30.532901 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddfaad-f9d5-4cf6-ae74-cf78ac3a04dc admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:30.533269 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddfaad-f9d5-4cf6-ae74-cf78ac3a04dc admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:30.533619 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddfaad-f9d5-4cf6-ae74-cf78ac3a04dc admin admin] PATH_INFO: `/v3/projects/3f28a96e49ee430f8d2b4d98bb6fab09/users/becae5b804f94314955d4e20087eb12f/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:30.564290 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebddfaad-f9d5-4cf6-ae74-cf78ac3a04dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f28a96e49ee430f8d2b4d98bb6fab09, user_id=becae5b804f94314955d4e20087eb12f, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:30.569543 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebddfaad-f9d5-4cf6-ae74-cf78ac3a04dc admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:30.599822 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3555/7172] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:30 2022] PUT /identity/v3/projects/3f28a96e49ee430f8d2b4d98bb6fab09/users/becae5b804f94314955d4e20087eb12f/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:30.605360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebddfaad-f9d5-4cf6-ae74-cf78ac3a04dc admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:30.623127 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3618/7173] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:30 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:30.630617 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac628647-8c21-4ca2-bd40-bdf79eb25830 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:30.631042 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac628647-8c21-4ca2-bd40-bdf79eb25830 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:30.631355 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac628647-8c21-4ca2-bd40-bdf79eb25830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:30.711115 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-ac628647-8c21-4ca2-bd40-bdf79eb25830 None None] MFA Rules not processed for user `e63fbea26373463f8e97bd38a0bc6688`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:30.713045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ac628647-8c21-4ca2-bd40-bdf79eb25830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:30.768788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebddfaad-f9d5-4cf6-ae74-cf78ac3a04dc admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:30.777225 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda18275-18eb-4f02-8fac-5f64f7f88716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:30.778233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda18275-18eb-4f02-8fac-5f64f7f88716 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:30.778516 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda18275-18eb-4f02-8fac-5f64f7f88716 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:30.778836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda18275-18eb-4f02-8fac-5f64f7f88716 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:30.779490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda18275-18eb-4f02-8fac-5f64f7f88716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:30.781638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda18275-18eb-4f02-8fac-5f64f7f88716 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:30.798590 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3556/7174] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:21:30.799575 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda18275-18eb-4f02-8fac-5f64f7f88716 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:30.801964 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-bda18275-18eb-4f02-8fac-5f64f7f88716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:30.823343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda18275-18eb-4f02-8fac-5f64f7f88716 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:30.829808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ad86b-7354-4539-aaa8-6e1d5bb5f619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:30.830726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ad86b-7354-4539-aaa8-6e1d5bb5f619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:30.831155 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ad86b-7354-4539-aaa8-6e1d5bb5f619 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:30.832770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ad86b-7354-4539-aaa8-6e1d5bb5f619 admin admin] PATH_INFO: `/v3/users/a0987f19a34d4275a727d1509fb6cb7a` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:30.834504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ad86b-7354-4539-aaa8-6e1d5bb5f619 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0987f19a34d4275a727d1509fb6cb7a)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:30.836922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ad86b-7354-4539-aaa8-6e1d5bb5f619 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:30.857686 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:30.868611 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3619/7175] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:30 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:30.869772 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac628647-8c21-4ca2-bd40-bdf79eb25830 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:30.885283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac628647-8c21-4ca2-bd40-bdf79eb25830 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:30.890573 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62137d5-8e0b-4eee-8a70-152b41272258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:30.891330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62137d5-8e0b-4eee-8a70-152b41272258 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:30.891622 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62137d5-8e0b-4eee-8a70-152b41272258 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:30.891935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62137d5-8e0b-4eee-8a70-152b41272258 admin admin] PATH_INFO: `/v3/projects/3f28a96e49ee430f8d2b4d98bb6fab09/users/becae5b804f94314955d4e20087eb12f/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:30.893973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62137d5-8e0b-4eee-8a70-152b41272258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f28a96e49ee430f8d2b4d98bb6fab09, user_id=becae5b804f94314955d4e20087eb12f, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:30.896710 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62137d5-8e0b-4eee-8a70-152b41272258 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:30.907324 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ed8ad86b-7354-4539-aaa8-6e1d5bb5f619 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0987f19a34d4275a727d1509fb6cb7a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:30.908033 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ed8ad86b-7354-4539-aaa8-6e1d5bb5f619 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0987f19a34d4275a727d1509fb6cb7a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:30.908814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ed8ad86b-7354-4539-aaa8-6e1d5bb5f619 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0987f19a34d4275a727d1509fb6cb7a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:30.911800 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3620/7176] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:30 2022] PUT /identity/v3/projects/3f28a96e49ee430f8d2b4d98bb6fab09/users/becae5b804f94314955d4e20087eb12f/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:30.912944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62137d5-8e0b-4eee-8a70-152b41272258 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:30.915279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b62137d5-8e0b-4eee-8a70-152b41272258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:30.925744 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ed8ad86b-7354-4539-aaa8-6e1d5bb5f619 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0987f19a34d4275a727d1509fb6cb7a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:30.942461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ed8ad86b-7354-4539-aaa8-6e1d5bb5f619 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0987f19a34d4275a727d1509fb6cb7a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:30.958720 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3557/7177] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:21:30 2022] DELETE /identity/v3/users/a0987f19a34d4275a727d1509fb6cb7a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:30.960000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2d73e-5f75-4f4c-b006-342575f30d55 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:30.960662 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2d73e-5f75-4f4c-b006-342575f30d55 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:30.961411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2d73e-5f75-4f4c-b006-342575f30d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:30.983202 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:30.997918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d9a2d73e-5f75-4f4c-b006-342575f30d55 None None] MFA Rules not processed for user `becae5b804f94314955d4e20087eb12f`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:31.001356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d9a2d73e-5f75-4f4c-b006-342575f30d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:31.042403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62137d5-8e0b-4eee-8a70-152b41272258 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:31.203623 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3558/7178] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:30 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:31.203623 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4108f0-0fe6-4cbd-8c9e-a8bf0f4340b3 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:31.203623 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4108f0-0fe6-4cbd-8c9e-a8bf0f4340b3 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:31.203623 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4108f0-0fe6-4cbd-8c9e-a8bf0f4340b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:31.257808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-7d4108f0-0fe6-4cbd-8c9e-a8bf0f4340b3 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:31.259450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7d4108f0-0fe6-4cbd-8c9e-a8bf0f4340b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:31.306214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206eb94-6067-431a-812e-58bd3399dbde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:31.307004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206eb94-6067-431a-812e-58bd3399dbde service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:31.307291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206eb94-6067-431a-812e-58bd3399dbde service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:31.307571 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206eb94-6067-431a-812e-58bd3399dbde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:31.309630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6206eb94-6067-431a-812e-58bd3399dbde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:31.343790 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3559/7179] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:31.344783 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4108f0-0fe6-4cbd-8c9e-a8bf0f4340b3 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:31.346274 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7d4108f0-0fe6-4cbd-8c9e-a8bf0f4340b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:31.381759 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206eb94-6067-431a-812e-58bd3399dbde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:31.383714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206eb94-6067-431a-812e-58bd3399dbde service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:31.395710 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3621/7180] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:30 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:31.396971 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206eb94-6067-431a-812e-58bd3399dbde service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:31.398304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6206eb94-6067-431a-812e-58bd3399dbde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:31.405315 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:31.413486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4108f0-0fe6-4cbd-8c9e-a8bf0f4340b3 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:31.419635 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b11e1-6526-4e13-918a-698d995a3bca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:31.420237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b11e1-6526-4e13-918a-698d995a3bca service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:31.420518 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b11e1-6526-4e13-918a-698d995a3bca service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:31.420788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b11e1-6526-4e13-918a-698d995a3bca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:31.431144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b11e1-6526-4e13-918a-698d995a3bca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:31.432872 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b11e1-6526-4e13-918a-698d995a3bca service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:31.451377 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3560/7181] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:31.478041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206eb94-6067-431a-812e-58bd3399dbde service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:31.481825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536cefd7-a889-4980-bba1-5f6a62a1da20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:31.482491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536cefd7-a889-4980-bba1-5f6a62a1da20 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:31.482734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536cefd7-a889-4980-bba1-5f6a62a1da20 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:31.483030 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536cefd7-a889-4980-bba1-5f6a62a1da20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:31.492599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536cefd7-a889-4980-bba1-5f6a62a1da20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:31.494094 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536cefd7-a889-4980-bba1-5f6a62a1da20 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:31.512712 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3622/7182] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:31.990913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f902c-54a4-4bbf-ab8c-cfd372083f43 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:31.991306 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f902c-54a4-4bbf-ab8c-cfd372083f43 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:31.991681 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f902c-54a4-4bbf-ab8c-cfd372083f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:32.037351 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-851f902c-54a4-4bbf-ab8c-cfd372083f43 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:32.038613 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-851f902c-54a4-4bbf-ab8c-cfd372083f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:32.136481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:32.174201 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536cefd7-a889-4980-bba1-5f6a62a1da20 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:32.175808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-536cefd7-a889-4980-bba1-5f6a62a1da20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:32.203268 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536cefd7-a889-4980-bba1-5f6a62a1da20 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:32.210946 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3561/7183] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:21:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:32.211950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f902c-54a4-4bbf-ab8c-cfd372083f43 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:32.215504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-851f902c-54a4-4bbf-ab8c-cfd372083f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:32.223428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc97a06-fdcb-4654-a74e-5ac5a82cba0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:32.224090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc97a06-fdcb-4654-a74e-5ac5a82cba0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:32.224367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc97a06-fdcb-4654-a74e-5ac5a82cba0b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:32.224638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc97a06-fdcb-4654-a74e-5ac5a82cba0b admin admin] PATH_INFO: `/v3/users/6bba1c37e640467fb6693a20ad60594c` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:32.227167 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc97a06-fdcb-4654-a74e-5ac5a82cba0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bba1c37e640467fb6693a20ad60594c)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:32.234909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc97a06-fdcb-4654-a74e-5ac5a82cba0b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:32.250512 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f902c-54a4-4bbf-ab8c-cfd372083f43 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:32.264131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f0c21-dfd2-42f4-a0f5-cb921aafd4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:32.264780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f0c21-dfd2-42f4-a0f5-cb921aafd4b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:32.265057 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f0c21-dfd2-42f4-a0f5-cb921aafd4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:32.267938 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f0c21-dfd2-42f4-a0f5-cb921aafd4b7 admin admin] PATH_INFO: `/v3/projects/dd235081a2584c6986aa088c734bd170` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:32.270066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f0c21-dfd2-42f4-a0f5-cb921aafd4b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd235081a2584c6986aa088c734bd170)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:32.275330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f0c21-dfd2-42f4-a0f5-cb921aafd4b7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:32.348081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6fc97a06-fdcb-4654-a74e-5ac5a82cba0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bba1c37e640467fb6693a20ad60594c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:32.361515 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6fc97a06-fdcb-4654-a74e-5ac5a82cba0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bba1c37e640467fb6693a20ad60594c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:32.362697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6fc97a06-fdcb-4654-a74e-5ac5a82cba0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bba1c37e640467fb6693a20ad60594c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:32.363561 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6fc97a06-fdcb-4654-a74e-5ac5a82cba0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bba1c37e640467fb6693a20ad60594c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:32.376029 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6fc97a06-fdcb-4654-a74e-5ac5a82cba0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bba1c37e640467fb6693a20ad60594c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:32.387549 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ff3f0c21-dfd2-42f4-a0f5-cb921aafd4b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd235081a2584c6986aa088c734bd170', 'request_id': 'req-ff3f0c21-dfd2-42f4-a0f5-cb921aafd4b7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:32.399351 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ff3f0c21-dfd2-42f4-a0f5-cb921aafd4b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd235081a2584c6986aa088c734bd170', 'request_id': 'req-ff3f0c21-dfd2-42f4-a0f5-cb921aafd4b7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:32.405443 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3623/7184] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:21:32 2022] DELETE /identity/v3/users/6bba1c37e640467fb6693a20ad60594c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:21:32.406387 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc97a06-fdcb-4654-a74e-5ac5a82cba0b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:32.408087 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6fc97a06-fdcb-4654-a74e-5ac5a82cba0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:32.412899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ff3f0c21-dfd2-42f4-a0f5-cb921aafd4b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd235081a2584c6986aa088c734bd170', 'request_id': 'req-ff3f0c21-dfd2-42f4-a0f5-cb921aafd4b7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:32.431406 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ff3f0c21-dfd2-42f4-a0f5-cb921aafd4b7 admin admin] The token cache is being invalidate because project dd235081a2584c6986aa088c734bd170 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:21:32.431742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ff3f0c21-dfd2-42f4-a0f5-cb921aafd4b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:32.432365 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ff3f0c21-dfd2-42f4-a0f5-cb921aafd4b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:32.435465 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3562/7185] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:21:32 2022] DELETE /identity/v3/projects/dd235081a2584c6986aa088c734bd170 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:32.439208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0593e-5b0a-4a23-8d41-71948e87e220 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:32.439208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0593e-5b0a-4a23-8d41-71948e87e220 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:32.439208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0593e-5b0a-4a23-8d41-71948e87e220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:32.461808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-2fa0593e-5b0a-4a23-8d41-71948e87e220 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:32.463348 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2fa0593e-5b0a-4a23-8d41-71948e87e220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:32.531407 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc97a06-fdcb-4654-a74e-5ac5a82cba0b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:32.540834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7d347-06a3-4e37-8974-063d7b11e5f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:32.541934 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7d347-06a3-4e37-8974-063d7b11e5f0 service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:32.542496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7d347-06a3-4e37-8974-063d7b11e5f0 service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:32.545390 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7d347-06a3-4e37-8974-063d7b11e5f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:32.548717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-74c7d347-06a3-4e37-8974-063d7b11e5f0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:32.574256 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3563/7186] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:32.577232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea668c-5a11-4f05-a1b3-c9710fb083b7 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:32.577624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea668c-5a11-4f05-a1b3-c9710fb083b7 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:32.578009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea668c-5a11-4f05-a1b3-c9710fb083b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:32.596211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:32.629940 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-aaea668c-5a11-4f05-a1b3-c9710fb083b7 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:32.634762 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-aaea668c-5a11-4f05-a1b3-c9710fb083b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:32.659834 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3564/7187] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:32.660927 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea668c-5a11-4f05-a1b3-c9710fb083b7 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:32.662484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-aaea668c-5a11-4f05-a1b3-c9710fb083b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:32.681967 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7d347-06a3-4e37-8974-063d7b11e5f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:32.685887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7d347-06a3-4e37-8974-063d7b11e5f0 service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:32.707257 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3624/7188] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:21:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:21:32.707257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd62af-e57e-4915-b5a6-43a86446dd03 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:32.707257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd62af-e57e-4915-b5a6-43a86446dd03 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:32.707257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd62af-e57e-4915-b5a6-43a86446dd03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:32.751586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-eedd62af-e57e-4915-b5a6-43a86446dd03 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:32.753254 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-eedd62af-e57e-4915-b5a6-43a86446dd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:32.781562 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3625/7189] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:32.786244 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd62af-e57e-4915-b5a6-43a86446dd03 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:32.803737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd62af-e57e-4915-b5a6-43a86446dd03 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:32.811084 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fd5dd-d0c8-4cff-b747-c750715227a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:32.811704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fd5dd-d0c8-4cff-b747-c750715227a5 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:32.811987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fd5dd-d0c8-4cff-b747-c750715227a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:32.812258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fd5dd-d0c8-4cff-b747-c750715227a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:32.812917 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5fd5dd-d0c8-4cff-b747-c750715227a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:21:32.813224 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5fd5dd-d0c8-4cff-b747-c750715227a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:32.814926 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5fd5dd-d0c8-4cff-b747-c750715227a5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:32.824894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea668c-5a11-4f05-a1b3-c9710fb083b7 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:32.829733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3af94d-9373-4c01-a287-990c219fd6c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:32.830590 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3626/7190] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:21:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:21:32.830926 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3af94d-9373-4c01-a287-990c219fd6c7 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:32.831356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3af94d-9373-4c01-a287-990c219fd6c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:32.831731 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3af94d-9373-4c01-a287-990c219fd6c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:32.835776 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fd5dd-d0c8-4cff-b747-c750715227a5 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:32.845891 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3af94d-9373-4c01-a287-990c219fd6c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:32.849578 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3af94d-9373-4c01-a287-990c219fd6c7 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:32.850178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fd5dd-d0c8-4cff-b747-c750715227a5 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:32.856778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b677906-d324-4e2f-9f1f-d077ce9d45b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:32.857577 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b677906-d324-4e2f-9f1f-d077ce9d45b1 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:32.858071 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b677906-d324-4e2f-9f1f-d077ce9d45b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:32.858465 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b677906-d324-4e2f-9f1f-d077ce9d45b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:32.859600 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b677906-d324-4e2f-9f1f-d077ce9d45b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:32.862243 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b677906-d324-4e2f-9f1f-d077ce9d45b1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:32.867508 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3565/7191] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:32.907176 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3627/7192] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:21:32 2022] POST /identity/v3/projects => generated 359 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:32.910641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3af94d-9373-4c01-a287-990c219fd6c7 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:32.920853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:32.950216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3af94d-9373-4c01-a287-990c219fd6c7 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:33.087901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b677906-d324-4e2f-9f1f-d077ce9d45b1 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:33.090468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5b677906-d324-4e2f-9f1f-d077ce9d45b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:33.132305 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e5fa8-459f-4745-b7ff-73a14b9a8d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:33.134207 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e5fa8-459f-4745-b7ff-73a14b9a8d45 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:33.134812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e5fa8-459f-4745-b7ff-73a14b9a8d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:33.135760 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e5fa8-459f-4745-b7ff-73a14b9a8d45 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:33.138686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e5fa8-459f-4745-b7ff-73a14b9a8d45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:33.146452 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e5fa8-459f-4745-b7ff-73a14b9a8d45 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:33.201405 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3566/7193] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:21:32 2022] POST /identity/v3/users => generated 280 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:21:33.205692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e5fa8-459f-4745-b7ff-73a14b9a8d45 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:33.229792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b677906-d324-4e2f-9f1f-d077ce9d45b1 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:33.236638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e5fa8-459f-4745-b7ff-73a14b9a8d45 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:33.248099 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492c820-dc7b-412c-9c10-052f53fd5807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:33.251030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492c820-dc7b-412c-9c10-052f53fd5807 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:33.251345 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492c820-dc7b-412c-9c10-052f53fd5807 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:33.251750 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492c820-dc7b-412c-9c10-052f53fd5807 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:33.252394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492c820-dc7b-412c-9c10-052f53fd5807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:33.252756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5af0b8-bc6b-4e3e-ae1c-b372f7d4ba98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:33.255235 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5af0b8-bc6b-4e3e-ae1c-b372f7d4ba98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:33.255974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5af0b8-bc6b-4e3e-ae1c-b372f7d4ba98 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:33.255974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5af0b8-bc6b-4e3e-ae1c-b372f7d4ba98 admin admin] PATH_INFO: `/v3/users/8a3721904bb847d18a18d272a7d34949` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:33.256772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492c820-dc7b-412c-9c10-052f53fd5807 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:33.258830 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5af0b8-bc6b-4e3e-ae1c-b372f7d4ba98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a3721904bb847d18a18d272a7d34949)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:33.269931 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5af0b8-bc6b-4e3e-ae1c-b372f7d4ba98 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:33.285113 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3567/7194] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:33.289729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492c820-dc7b-412c-9c10-052f53fd5807 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:33.314836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492c820-dc7b-412c-9c10-052f53fd5807 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:33.323277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ad7a7-bc83-4cb3-8086-cd6e656b285a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:33.324479 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ad7a7-bc83-4cb3-8086-cd6e656b285a admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:33.325109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ad7a7-bc83-4cb3-8086-cd6e656b285a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:33.325475 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ad7a7-bc83-4cb3-8086-cd6e656b285a admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:33.326190 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ad7a7-bc83-4cb3-8086-cd6e656b285a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:33.327813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ad7a7-bc83-4cb3-8086-cd6e656b285a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:33.350755 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3568/7195] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:33.352570 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ad7a7-bc83-4cb3-8086-cd6e656b285a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:33.364896 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ad7a7-bc83-4cb3-8086-cd6e656b285a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:33.370293 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ad5af0b8-bc6b-4e3e-ae1c-b372f7d4ba98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a3721904bb847d18a18d272a7d34949'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:33.371400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a3b2a-1039-43ea-a828-9f50b9cc63a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:33.372659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a3b2a-1039-43ea-a828-9f50b9cc63a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:33.373268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a3b2a-1039-43ea-a828-9f50b9cc63a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:33.373696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a3b2a-1039-43ea-a828-9f50b9cc63a1 admin admin] PATH_INFO: `/v3/projects/b627f91feb534f80938205f0183a755d/users/527586d0c33b4bbda03d3dabfab0fbc5/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:33.382505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ad5af0b8-bc6b-4e3e-ae1c-b372f7d4ba98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a3721904bb847d18a18d272a7d34949'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:33.383464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ad5af0b8-bc6b-4e3e-ae1c-b372f7d4ba98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a3721904bb847d18a18d272a7d34949'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:33.384200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ad5af0b8-bc6b-4e3e-ae1c-b372f7d4ba98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a3721904bb847d18a18d272a7d34949'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:33.397896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ad5af0b8-bc6b-4e3e-ae1c-b372f7d4ba98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a3721904bb847d18a18d272a7d34949'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:33.408633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a3b2a-1039-43ea-a828-9f50b9cc63a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b627f91feb534f80938205f0183a755d, user_id=527586d0c33b4bbda03d3dabfab0fbc5, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:33.427903 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a3b2a-1039-43ea-a828-9f50b9cc63a1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:33.443770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:33.462230 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3628/7196] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:21:33 2022] DELETE /identity/v3/users/8a3721904bb847d18a18d272a7d34949 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:33.466201 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3569/7197] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:33 2022] PUT /identity/v3/projects/b627f91feb534f80938205f0183a755d/users/527586d0c33b4bbda03d3dabfab0fbc5/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:21:33.467981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4b1a0-b5eb-4ca6-a3f1-6383380e9fa0 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:33.468680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4b1a0-b5eb-4ca6-a3f1-6383380e9fa0 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:33.469368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4b1a0-b5eb-4ca6-a3f1-6383380e9fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:33.480377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c568cb-b091-4242-a858-653b7a1884ea None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:33.480675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c568cb-b091-4242-a858-653b7a1884ea None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:33.481095 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c568cb-b091-4242-a858-653b7a1884ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:33.531363 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-b0c568cb-b091-4242-a858-653b7a1884ea None None] MFA Rules not processed for user `527586d0c33b4bbda03d3dabfab0fbc5`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:33.532813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b0c568cb-b091-4242-a858-653b7a1884ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:33.537645 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-30d4b1a0-b5eb-4ca6-a3f1-6383380e9fa0 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:33.538882 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-30d4b1a0-b5eb-4ca6-a3f1-6383380e9fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:33.655875 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3629/7198] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:33.656827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4b1a0-b5eb-4ca6-a3f1-6383380e9fa0 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:33.659647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-30d4b1a0-b5eb-4ca6-a3f1-6383380e9fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:33.691966 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3570/7199] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:33 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:33.693088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912d8ad-3611-49e2-a4e2-4bf40b515916 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:33.693358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912d8ad-3611-49e2-a4e2-4bf40b515916 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:33.693647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912d8ad-3611-49e2-a4e2-4bf40b515916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:33.695071 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4b1a0-b5eb-4ca6-a3f1-6383380e9fa0 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:33.701335 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018b0b7-f675-460d-80a3-75acda26889e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:33.702109 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018b0b7-f675-460d-80a3-75acda26889e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:33.702504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018b0b7-f675-460d-80a3-75acda26889e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:33.703529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018b0b7-f675-460d-80a3-75acda26889e admin admin] PATH_INFO: `/v3/projects/701cafbd5f9e4ffdb4540e7479297bd2` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:33.704509 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018b0b7-f675-460d-80a3-75acda26889e admin admin] RBAC: Authorizing `identity:delete_project(project_id=701cafbd5f9e4ffdb4540e7479297bd2)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:33.707874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018b0b7-f675-460d-80a3-75acda26889e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:33.757488 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-2912d8ad-3611-49e2-a4e2-4bf40b515916 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:33.759288 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2912d8ad-3611-49e2-a4e2-4bf40b515916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:33.803872 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:33.820189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2018b0b7-f675-460d-80a3-75acda26889e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '701cafbd5f9e4ffdb4540e7479297bd2', 'request_id': 'req-2018b0b7-f675-460d-80a3-75acda26889e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:33.829437 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2018b0b7-f675-460d-80a3-75acda26889e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '701cafbd5f9e4ffdb4540e7479297bd2', 'request_id': 'req-2018b0b7-f675-460d-80a3-75acda26889e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:33.841461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2018b0b7-f675-460d-80a3-75acda26889e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '701cafbd5f9e4ffdb4540e7479297bd2', 'request_id': 'req-2018b0b7-f675-460d-80a3-75acda26889e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:33.843179 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3571/7200] 10.222.0.33 () {58 vars in 967 bytes} [Sat Aug 6 21:21:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:33.844281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912d8ad-3611-49e2-a4e2-4bf40b515916 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:33.845635 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2912d8ad-3611-49e2-a4e2-4bf40b515916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:33.858127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2018b0b7-f675-460d-80a3-75acda26889e admin admin] The token cache is being invalidate because project 701cafbd5f9e4ffdb4540e7479297bd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:21:33.858441 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2018b0b7-f675-460d-80a3-75acda26889e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:33.859242 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2018b0b7-f675-460d-80a3-75acda26889e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:33.861429 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3630/7201] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:21:33 2022] DELETE /identity/v3/projects/701cafbd5f9e4ffdb4540e7479297bd2 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:33.862973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018b0b7-f675-460d-80a3-75acda26889e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:33.866045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2018b0b7-f675-460d-80a3-75acda26889e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:33.943297 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912d8ad-3611-49e2-a4e2-4bf40b515916 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:33.963946 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018b0b7-f675-460d-80a3-75acda26889e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:33.970460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335fef23-4af9-40e5-a269-761e28844011 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:33.970673 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fef23-4af9-40e5-a269-761e28844011 service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:33.972039 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fef23-4af9-40e5-a269-761e28844011 service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:33.972389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fef23-4af9-40e5-a269-761e28844011 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:33.976044 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-335fef23-4af9-40e5-a269-761e28844011 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:33.997911 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309ad70-bb49-44a1-a3af-4e0f86e7e1b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:33.998530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309ad70-bb49-44a1-a3af-4e0f86e7e1b6 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:33.998841 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309ad70-bb49-44a1-a3af-4e0f86e7e1b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:33.999111 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309ad70-bb49-44a1-a3af-4e0f86e7e1b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:34.000988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a309ad70-bb49-44a1-a3af-4e0f86e7e1b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:34.018953 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:34.057894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335fef23-4af9-40e5-a269-761e28844011 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:34.059644 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335fef23-4af9-40e5-a269-761e28844011 service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:34.075265 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3631/7202] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:33 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:34.076379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335fef23-4af9-40e5-a269-761e28844011 service cinder] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:34.077909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-335fef23-4af9-40e5-a269-761e28844011 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:34.078204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309ad70-bb49-44a1-a3af-4e0f86e7e1b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:34.079686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309ad70-bb49-44a1-a3af-4e0f86e7e1b6 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:34.095031 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335fef23-4af9-40e5-a269-761e28844011 service cinder] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:34.100040 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3572/7203] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:34.100524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf49a9-5da2-4077-a9ac-64e57c4331d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:34.101350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf49a9-5da2-4077-a9ac-64e57c4331d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:34.101692 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf49a9-5da2-4077-a9ac-64e57c4331d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:34.101847 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309ad70-bb49-44a1-a3af-4e0f86e7e1b6 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:34.102159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf49a9-5da2-4077-a9ac-64e57c4331d6 admin admin] PATH_INFO: `/v3/users/becae5b804f94314955d4e20087eb12f` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:34.103538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf49a9-5da2-4077-a9ac-64e57c4331d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=becae5b804f94314955d4e20087eb12f)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:34.103690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a309ad70-bb49-44a1-a3af-4e0f86e7e1b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:34.106607 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf49a9-5da2-4077-a9ac-64e57c4331d6 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:34.187508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:34.189079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-03bf49a9-5da2-4077-a9ac-64e57c4331d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'becae5b804f94314955d4e20087eb12f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:34.201471 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-03bf49a9-5da2-4077-a9ac-64e57c4331d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'becae5b804f94314955d4e20087eb12f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:34.202363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-03bf49a9-5da2-4077-a9ac-64e57c4331d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'becae5b804f94314955d4e20087eb12f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:34.203279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-03bf49a9-5da2-4077-a9ac-64e57c4331d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'becae5b804f94314955d4e20087eb12f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:34.217972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309ad70-bb49-44a1-a3af-4e0f86e7e1b6 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:34.219521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-03bf49a9-5da2-4077-a9ac-64e57c4331d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'becae5b804f94314955d4e20087eb12f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:34.226321 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb0b85c-6513-4495-9d6c-5b590cebf458 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:34.227621 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0b85c-6513-4495-9d6c-5b590cebf458 service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:34.228065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0b85c-6513-4495-9d6c-5b590cebf458 service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:34.228512 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0b85c-6513-4495-9d6c-5b590cebf458 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:34.233268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2bb0b85c-6513-4495-9d6c-5b590cebf458 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:34.247657 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3632/7204] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:21:34 2022] DELETE /identity/v3/users/becae5b804f94314955d4e20087eb12f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:34.252206 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf49a9-5da2-4077-a9ac-64e57c4331d6 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:34.254321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-03bf49a9-5da2-4077-a9ac-64e57c4331d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:34.359475 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb0b85c-6513-4495-9d6c-5b590cebf458 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:34.364949 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb0b85c-6513-4495-9d6c-5b590cebf458 service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:34.389611 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3573/7205] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:21:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:21:34.422923 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf49a9-5da2-4077-a9ac-64e57c4331d6 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:34.429956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7a841-609b-40f2-9968-d9c56ea69940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:34.431175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7a841-609b-40f2-9968-d9c56ea69940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:34.431175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7a841-609b-40f2-9968-d9c56ea69940 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:34.431707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7a841-609b-40f2-9968-d9c56ea69940 admin admin] PATH_INFO: `/v3/users/527586d0c33b4bbda03d3dabfab0fbc5` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:34.433810 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c7a841-609b-40f2-9968-d9c56ea69940 admin admin] RBAC: Authorizing `identity:delete_user(user_id=527586d0c33b4bbda03d3dabfab0fbc5)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:34.436392 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c7a841-609b-40f2-9968-d9c56ea69940 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:34.524097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c4c7a841-609b-40f2-9968-d9c56ea69940 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '527586d0c33b4bbda03d3dabfab0fbc5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:34.527490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:34.538207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c4c7a841-609b-40f2-9968-d9c56ea69940 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '527586d0c33b4bbda03d3dabfab0fbc5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:34.541446 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c4c7a841-609b-40f2-9968-d9c56ea69940 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '527586d0c33b4bbda03d3dabfab0fbc5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:34.548353 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c4c7a841-609b-40f2-9968-d9c56ea69940 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '527586d0c33b4bbda03d3dabfab0fbc5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:34.578955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c4c7a841-609b-40f2-9968-d9c56ea69940 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '527586d0c33b4bbda03d3dabfab0fbc5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:34.639033 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3633/7206] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:21:34 2022] DELETE /identity/v3/users/527586d0c33b4bbda03d3dabfab0fbc5 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:34.643860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c56426-9f98-4464-98b9-912b49c701b3 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:34.644147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c56426-9f98-4464-98b9-912b49c701b3 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:34.644418 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c56426-9f98-4464-98b9-912b49c701b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:34.703394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f5c56426-9f98-4464-98b9-912b49c701b3 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:34.705642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f5c56426-9f98-4464-98b9-912b49c701b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:34.825884 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3574/7207] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:34.870021 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7a841-609b-40f2-9968-d9c56ea69940 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:34.872768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c4c7a841-609b-40f2-9968-d9c56ea69940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:34.886765 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164e80a-8ef9-4d51-98d2-8923946f00a9 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:34.887029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164e80a-8ef9-4d51-98d2-8923946f00a9 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:34.887408 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164e80a-8ef9-4d51-98d2-8923946f00a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:34.932543 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-0164e80a-8ef9-4d51-98d2-8923946f00a9 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:34.935535 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0164e80a-8ef9-4d51-98d2-8923946f00a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:35.015721 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7a841-609b-40f2-9968-d9c56ea69940 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:35.029522 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d9650-eb70-4b09-9136-dd766a70960a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:35.030225 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d9650-eb70-4b09-9136-dd766a70960a service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:35.030510 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d9650-eb70-4b09-9136-dd766a70960a service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:35.030898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d9650-eb70-4b09-9136-dd766a70960a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:35.058909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d9650-eb70-4b09-9136-dd766a70960a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:35.067782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d9650-eb70-4b09-9136-dd766a70960a service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:35.088908 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3634/7208] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:35.090034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d9650-eb70-4b09-9136-dd766a70960a service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:35.091810 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8e7d9650-eb70-4b09-9136-dd766a70960a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:35.113820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d9650-eb70-4b09-9136-dd766a70960a service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:35.118710 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3575/7209] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:21:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:35.122828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0164e80a-8ef9-4d51-98d2-8923946f00a9 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:35.126025 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0164e80a-8ef9-4d51-98d2-8923946f00a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:35.143810 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c2300-7fcc-400c-ae23-6147ce500622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:35.144519 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c2300-7fcc-400c-ae23-6147ce500622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:35.158373 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c2300-7fcc-400c-ae23-6147ce500622 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:35.159357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c2300-7fcc-400c-ae23-6147ce500622 admin admin] PATH_INFO: `/v3/projects/3f28a96e49ee430f8d2b4d98bb6fab09` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:35.159668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0164e80a-8ef9-4d51-98d2-8923946f00a9 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:35.164519 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c2300-7fcc-400c-ae23-6147ce500622 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f28a96e49ee430f8d2b4d98bb6fab09)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:35.167917 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7740d9e0-b378-415d-9a1c-3332d7996096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:35.168722 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7740d9e0-b378-415d-9a1c-3332d7996096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:35.169715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7740d9e0-b378-415d-9a1c-3332d7996096 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:35.170100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7740d9e0-b378-415d-9a1c-3332d7996096 admin admin] PATH_INFO: `/v3/projects/539e193f7f7140b884288209cc291d9b` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:35.173419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7740d9e0-b378-415d-9a1c-3332d7996096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=539e193f7f7140b884288209cc291d9b)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:35.177091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c2300-7fcc-400c-ae23-6147ce500622 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:35.182429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7740d9e0-b378-415d-9a1c-3332d7996096 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:35.264010 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:35.290680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e54c2300-7fcc-400c-ae23-6147ce500622 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f28a96e49ee430f8d2b4d98bb6fab09', 'request_id': 'req-e54c2300-7fcc-400c-ae23-6147ce500622'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:35.296856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7740d9e0-b378-415d-9a1c-3332d7996096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '539e193f7f7140b884288209cc291d9b', 'request_id': 'req-7740d9e0-b378-415d-9a1c-3332d7996096'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:35.299342 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e54c2300-7fcc-400c-ae23-6147ce500622 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f28a96e49ee430f8d2b4d98bb6fab09', 'request_id': 'req-e54c2300-7fcc-400c-ae23-6147ce500622'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:35.311695 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7740d9e0-b378-415d-9a1c-3332d7996096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '539e193f7f7140b884288209cc291d9b', 'request_id': 'req-7740d9e0-b378-415d-9a1c-3332d7996096'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:35.315791 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e54c2300-7fcc-400c-ae23-6147ce500622 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f28a96e49ee430f8d2b4d98bb6fab09', 'request_id': 'req-e54c2300-7fcc-400c-ae23-6147ce500622'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:35.324866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7740d9e0-b378-415d-9a1c-3332d7996096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '539e193f7f7140b884288209cc291d9b', 'request_id': 'req-7740d9e0-b378-415d-9a1c-3332d7996096'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:35.348696 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e54c2300-7fcc-400c-ae23-6147ce500622 admin admin] The token cache is being invalidate because project 3f28a96e49ee430f8d2b4d98bb6fab09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:21:35.349036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e54c2300-7fcc-400c-ae23-6147ce500622 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:35.349715 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e54c2300-7fcc-400c-ae23-6147ce500622 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:35.356668 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3635/7210] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:21:35 2022] DELETE /identity/v3/projects/3f28a96e49ee430f8d2b4d98bb6fab09 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:35.356668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c2300-7fcc-400c-ae23-6147ce500622 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:35.356856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7740d9e0-b378-415d-9a1c-3332d7996096 admin admin] The token cache is being invalidate because project 539e193f7f7140b884288209cc291d9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:21:35.356856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7740d9e0-b378-415d-9a1c-3332d7996096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:35.356856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7740d9e0-b378-415d-9a1c-3332d7996096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:35.356856 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3576/7211] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:21:35 2022] DELETE /identity/v3/projects/539e193f7f7140b884288209cc291d9b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:35.358214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e54c2300-7fcc-400c-ae23-6147ce500622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:35.359927 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4ace5-865f-4f5b-92f7-8c95ee31d754 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:35.360362 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4ace5-865f-4f5b-92f7-8c95ee31d754 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:35.360530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4ace5-865f-4f5b-92f7-8c95ee31d754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:35.394225 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-afd4ace5-865f-4f5b-92f7-8c95ee31d754 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:35.395565 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-afd4ace5-865f-4f5b-92f7-8c95ee31d754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:35.450123 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:35.483066 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c2300-7fcc-400c-ae23-6147ce500622 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:35.545382 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3577/7212] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:35.545382 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4ace5-865f-4f5b-92f7-8c95ee31d754 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:35.547954 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-afd4ace5-865f-4f5b-92f7-8c95ee31d754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:35.578966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4ace5-865f-4f5b-92f7-8c95ee31d754 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:35.591884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c2733-324d-4d10-aee3-cd20286e9a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:35.592559 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c2733-324d-4d10-aee3-cd20286e9a20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:35.592864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c2733-324d-4d10-aee3-cd20286e9a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:35.593130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c2733-324d-4d10-aee3-cd20286e9a20 admin admin] PATH_INFO: `/v3/users/85919a7f839c47b2ae1cbdbfad8774bc` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:35.594369 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c2733-324d-4d10-aee3-cd20286e9a20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85919a7f839c47b2ae1cbdbfad8774bc)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:35.596401 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c2733-324d-4d10-aee3-cd20286e9a20 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:35.630277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e7953-36ef-48dc-9ce4-311bd5e0d4e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:35.631125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e7953-36ef-48dc-9ce4-311bd5e0d4e7 service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:35.631401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e7953-36ef-48dc-9ce4-311bd5e0d4e7 service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:35.632165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e7953-36ef-48dc-9ce4-311bd5e0d4e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:35.634287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3f5e7953-36ef-48dc-9ce4-311bd5e0d4e7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:35.736478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e7953-36ef-48dc-9ce4-311bd5e0d4e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:35.736747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fc4c2733-324d-4d10-aee3-cd20286e9a20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85919a7f839c47b2ae1cbdbfad8774bc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:35.737618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fc4c2733-324d-4d10-aee3-cd20286e9a20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85919a7f839c47b2ae1cbdbfad8774bc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:35.738327 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e7953-36ef-48dc-9ce4-311bd5e0d4e7 service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:35.738449 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fc4c2733-324d-4d10-aee3-cd20286e9a20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85919a7f839c47b2ae1cbdbfad8774bc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:35.757647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fc4c2733-324d-4d10-aee3-cd20286e9a20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85919a7f839c47b2ae1cbdbfad8774bc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:35.762931 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3636/7213] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:21:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:21:35.767317 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c2939-93f3-41bd-b437-b011c0eabf55 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:35.767591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c2939-93f3-41bd-b437-b011c0eabf55 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:35.767795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c2939-93f3-41bd-b437-b011c0eabf55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:35.783911 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fc4c2733-324d-4d10-aee3-cd20286e9a20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85919a7f839c47b2ae1cbdbfad8774bc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:35.813207 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3578/7214] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:21:35 2022] DELETE /identity/v3/users/85919a7f839c47b2ae1cbdbfad8774bc => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:35.816268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c2733-324d-4d10-aee3-cd20286e9a20 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:35.818989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-fc4c2733-324d-4d10-aee3-cd20286e9a20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:35.823733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-776c2939-93f3-41bd-b437-b011c0eabf55 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:35.831427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-776c2939-93f3-41bd-b437-b011c0eabf55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:35.870747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:35.962524 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c2733-324d-4d10-aee3-cd20286e9a20 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:35.968698 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3637/7215] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:35.973731 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c2939-93f3-41bd-b437-b011c0eabf55 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:35.985970 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c2939-93f3-41bd-b437-b011c0eabf55 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:35.994491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e16ba0-a1b7-4841-a4e6-dd30e1d08eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:35.995934 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e16ba0-a1b7-4841-a4e6-dd30e1d08eca admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:35.996493 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e16ba0-a1b7-4841-a4e6-dd30e1d08eca admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:35.997186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e16ba0-a1b7-4841-a4e6-dd30e1d08eca admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:35.998300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e16ba0-a1b7-4841-a4e6-dd30e1d08eca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:21:35.998854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e16ba0-a1b7-4841-a4e6-dd30e1d08eca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:36.002694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e16ba0-a1b7-4841-a4e6-dd30e1d08eca admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:36.005195 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e6baa-5f4b-4135-8a40-946679d2bfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:36.007000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e6baa-5f4b-4135-8a40-946679d2bfcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:36.007111 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e6baa-5f4b-4135-8a40-946679d2bfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:36.007347 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e6baa-5f4b-4135-8a40-946679d2bfcb admin admin] PATH_INFO: `/v3/projects/b627f91feb534f80938205f0183a755d` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:36.014356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e6baa-5f4b-4135-8a40-946679d2bfcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b627f91feb534f80938205f0183a755d)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:36.016559 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e6baa-5f4b-4135-8a40-946679d2bfcb admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:36.053419 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3638/7216] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:21:36.055756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e16ba0-a1b7-4841-a4e6-dd30e1d08eca admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:36.088850 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e16ba0-a1b7-4841-a4e6-dd30e1d08eca admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:36.096227 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876929bf-b697-48b5-90d2-05fce205f823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:36.097211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876929bf-b697-48b5-90d2-05fce205f823 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:36.097962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876929bf-b697-48b5-90d2-05fce205f823 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:36.098581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876929bf-b697-48b5-90d2-05fce205f823 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:36.101153 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876929bf-b697-48b5-90d2-05fce205f823 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:36.105940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876929bf-b697-48b5-90d2-05fce205f823 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:36.160430 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3639/7217] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:21:36 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:36.162306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876929bf-b697-48b5-90d2-05fce205f823 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:36.170878 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:36.183696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7b8e6baa-5f4b-4135-8a40-946679d2bfcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b627f91feb534f80938205f0183a755d', 'request_id': 'req-7b8e6baa-5f4b-4135-8a40-946679d2bfcb'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:36.193813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7b8e6baa-5f4b-4135-8a40-946679d2bfcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b627f91feb534f80938205f0183a755d', 'request_id': 'req-7b8e6baa-5f4b-4135-8a40-946679d2bfcb'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:36.214313 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7b8e6baa-5f4b-4135-8a40-946679d2bfcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b627f91feb534f80938205f0183a755d', 'request_id': 'req-7b8e6baa-5f4b-4135-8a40-946679d2bfcb'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:36.238171 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7b8e6baa-5f4b-4135-8a40-946679d2bfcb admin admin] The token cache is being invalidate because project b627f91feb534f80938205f0183a755d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:21:36.238464 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7b8e6baa-5f4b-4135-8a40-946679d2bfcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:36.239312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7b8e6baa-5f4b-4135-8a40-946679d2bfcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:36.242847 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3579/7218] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:21:35 2022] DELETE /identity/v3/projects/b627f91feb534f80938205f0183a755d => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:36.248929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98eb5a1-24fa-47d7-a9e6-f6db98b13532 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:36.249381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98eb5a1-24fa-47d7-a9e6-f6db98b13532 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:36.249940 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98eb5a1-24fa-47d7-a9e6-f6db98b13532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:36.256169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876929bf-b697-48b5-90d2-05fce205f823 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:36.260988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14260023-6374-4170-89e3-4aaa8a0bc518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:36.262295 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14260023-6374-4170-89e3-4aaa8a0bc518 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:36.262599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14260023-6374-4170-89e3-4aaa8a0bc518 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:36.263099 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14260023-6374-4170-89e3-4aaa8a0bc518 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:36.263630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14260023-6374-4170-89e3-4aaa8a0bc518 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:36.265561 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14260023-6374-4170-89e3-4aaa8a0bc518 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:36.278946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f98eb5a1-24fa-47d7-a9e6-f6db98b13532 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:36.280801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f98eb5a1-24fa-47d7-a9e6-f6db98b13532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:36.307129 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3580/7219] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:36.307315 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3640/7220] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:21:36 2022] POST /identity/v3/users => generated 294 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:36.312330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98eb5a1-24fa-47d7-a9e6-f6db98b13532 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:36.313866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f98eb5a1-24fa-47d7-a9e6-f6db98b13532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:36.315945 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a5d0a-724b-4d91-bfd8-1acb661c949f None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:36.316230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a5d0a-724b-4d91-bfd8-1acb661c949f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:36.316645 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a5d0a-724b-4d91-bfd8-1acb661c949f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:36.349528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98eb5a1-24fa-47d7-a9e6-f6db98b13532 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:36.363075 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc34e2-5b52-45b1-8e31-e03fc208d650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:36.365766 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc34e2-5b52-45b1-8e31-e03fc208d650 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:36.366303 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc34e2-5b52-45b1-8e31-e03fc208d650 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:36.368558 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc34e2-5b52-45b1-8e31-e03fc208d650 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:36.369386 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc34e2-5b52-45b1-8e31-e03fc208d650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:36.373047 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-952a5d0a-724b-4d91-bfd8-1acb661c949f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:36.377008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc34e2-5b52-45b1-8e31-e03fc208d650 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:36.378218 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-952a5d0a-724b-4d91-bfd8-1acb661c949f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:36.399612 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3641/7221] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:36.410399 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a5d0a-724b-4d91-bfd8-1acb661c949f None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:36.413522 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3581/7222] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:36.416073 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc34e2-5b52-45b1-8e31-e03fc208d650 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:36.432943 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a5d0a-724b-4d91-bfd8-1acb661c949f None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:36.441242 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc34e2-5b52-45b1-8e31-e03fc208d650 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:36.448296 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4ca84-39e2-4c3c-9380-e87503053239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:36.451093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4ca84-39e2-4c3c-9380-e87503053239 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:36.451388 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4ca84-39e2-4c3c-9380-e87503053239 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:36.451807 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32037ccb-800e-47d7-8478-ef309a6d6969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:36.452647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4ca84-39e2-4c3c-9380-e87503053239 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:36.453455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4ca84-39e2-4c3c-9380-e87503053239 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:21:36.453829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32037ccb-800e-47d7-8478-ef309a6d6969 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:36.454103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32037ccb-800e-47d7-8478-ef309a6d6969 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:36.454421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32037ccb-800e-47d7-8478-ef309a6d6969 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:36.455513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4ca84-39e2-4c3c-9380-e87503053239 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:36.456516 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32037ccb-800e-47d7-8478-ef309a6d6969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:36.458674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4ca84-39e2-4c3c-9380-e87503053239 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:36.460860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32037ccb-800e-47d7-8478-ef309a6d6969 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:36.493717 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3642/7223] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:21:36.496989 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eff143-52c5-41c1-a487-af0e560e4aaf None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:36.496989 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eff143-52c5-41c1-a487-af0e560e4aaf None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:36.497225 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eff143-52c5-41c1-a487-af0e560e4aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:36.501026 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3582/7224] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:36.501882 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32037ccb-800e-47d7-8478-ef309a6d6969 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:36.508505 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-32037ccb-800e-47d7-8478-ef309a6d6969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:36.530380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-52eff143-52c5-41c1-a487-af0e560e4aaf None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:36.532122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-52eff143-52c5-41c1-a487-af0e560e4aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:36.540286 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32037ccb-800e-47d7-8478-ef309a6d6969 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:36.549215 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3570ed-8f4d-4a91-8b99-ff9bc9b00f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:36.549899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3570ed-8f4d-4a91-8b99-ff9bc9b00f53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:36.550185 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3570ed-8f4d-4a91-8b99-ff9bc9b00f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:36.550464 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3570ed-8f4d-4a91-8b99-ff9bc9b00f53 admin admin] PATH_INFO: `/v3/projects/65482a0303954645a6cd322936853c86` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:36.555482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3570ed-8f4d-4a91-8b99-ff9bc9b00f53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65482a0303954645a6cd322936853c86)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:36.557445 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3570ed-8f4d-4a91-8b99-ff9bc9b00f53 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:36.619207 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3643/7225] 10.222.0.33 () {58 vars in 967 bytes} [Sat Aug 6 21:21:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:36.620085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eff143-52c5-41c1-a487-af0e560e4aaf None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:36.659968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eff143-52c5-41c1-a487-af0e560e4aaf None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:36.726500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ce3570ed-8f4d-4a91-8b99-ff9bc9b00f53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65482a0303954645a6cd322936853c86', 'request_id': 'req-ce3570ed-8f4d-4a91-8b99-ff9bc9b00f53'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:36.729996 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a54ee-0c8b-46a8-8dfe-12af182565d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:36.741964 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a54ee-0c8b-46a8-8dfe-12af182565d9 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:36.743801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a54ee-0c8b-46a8-8dfe-12af182565d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:36.746149 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a54ee-0c8b-46a8-8dfe-12af182565d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:36.747137 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a54ee-0c8b-46a8-8dfe-12af182565d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:36.752056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a54ee-0c8b-46a8-8dfe-12af182565d9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:36.759615 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ce3570ed-8f4d-4a91-8b99-ff9bc9b00f53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65482a0303954645a6cd322936853c86', 'request_id': 'req-ce3570ed-8f4d-4a91-8b99-ff9bc9b00f53'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:36.779250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ce3570ed-8f4d-4a91-8b99-ff9bc9b00f53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65482a0303954645a6cd322936853c86', 'request_id': 'req-ce3570ed-8f4d-4a91-8b99-ff9bc9b00f53'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:36.806379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ce3570ed-8f4d-4a91-8b99-ff9bc9b00f53 admin admin] The token cache is being invalidate because project 65482a0303954645a6cd322936853c86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:21:36.806379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ce3570ed-8f4d-4a91-8b99-ff9bc9b00f53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:36.807142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ce3570ed-8f4d-4a91-8b99-ff9bc9b00f53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:36.809553 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3644/7226] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:21:36 2022] POST /identity/v3/projects => generated 375 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:36.810573 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a54ee-0c8b-46a8-8dfe-12af182565d9 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:36.814467 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3583/7227] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:21:36 2022] DELETE /identity/v3/projects/65482a0303954645a6cd322936853c86 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:36.814467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3570ed-8f4d-4a91-8b99-ff9bc9b00f53 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:36.814723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d71a54ee-0c8b-46a8-8dfe-12af182565d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:36.816056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ce3570ed-8f4d-4a91-8b99-ff9bc9b00f53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:36.819147 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:36.850802 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:36.948196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a54ee-0c8b-46a8-8dfe-12af182565d9 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:36.954852 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce554dc7-c103-4b0b-a48d-99d7794e1a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:36.955751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce554dc7-c103-4b0b-a48d-99d7794e1a5c admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:36.956205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce554dc7-c103-4b0b-a48d-99d7794e1a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:36.956554 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce554dc7-c103-4b0b-a48d-99d7794e1a5c admin admin] PATH_INFO: `/v3/projects/a723e532ec7345ecbf78aaaed0c78285/users/b242ab7b6b604c529a0a2d5fd9c8d1d8/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:36.992733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3570ed-8f4d-4a91-8b99-ff9bc9b00f53 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:36.995562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce554dc7-c103-4b0b-a48d-99d7794e1a5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a723e532ec7345ecbf78aaaed0c78285, user_id=b242ab7b6b604c529a0a2d5fd9c8d1d8, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:37.000524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce554dc7-c103-4b0b-a48d-99d7794e1a5c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:37.023925 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3645/7228] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:36 2022] PUT /identity/v3/projects/a723e532ec7345ecbf78aaaed0c78285/users/b242ab7b6b604c529a0a2d5fd9c8d1d8/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:37.024800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce554dc7-c103-4b0b-a48d-99d7794e1a5c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:37.027222 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ce554dc7-c103-4b0b-a48d-99d7794e1a5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:37.099121 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499bad14-49c7-4c0a-95f4-692f72d71a6a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:37.099785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bad14-49c7-4c0a-95f4-692f72d71a6a service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:37.100739 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bad14-49c7-4c0a-95f4-692f72d71a6a service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:37.100998 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bad14-49c7-4c0a-95f4-692f72d71a6a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:37.104085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-499bad14-49c7-4c0a-95f4-692f72d71a6a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:37.111093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce554dc7-c103-4b0b-a48d-99d7794e1a5c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:37.116610 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12adfd-dc35-4e7c-b9da-f6be9b6d08a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:37.117671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12adfd-dc35-4e7c-b9da-f6be9b6d08a3 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:37.117671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12adfd-dc35-4e7c-b9da-f6be9b6d08a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:37.117851 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12adfd-dc35-4e7c-b9da-f6be9b6d08a3 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:37.118683 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d12adfd-dc35-4e7c-b9da-f6be9b6d08a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:37.122405 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d12adfd-dc35-4e7c-b9da-f6be9b6d08a3 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:37.152615 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3646/7229] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:21:37 2022] POST /identity/v3/users => generated 288 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:37.154326 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a339789-b9cb-460c-96bf-1d91ed328cba None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:37.154782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a339789-b9cb-460c-96bf-1d91ed328cba None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:37.155188 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a339789-b9cb-460c-96bf-1d91ed328cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:37.179111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-6a339789-b9cb-460c-96bf-1d91ed328cba None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:37.180835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6a339789-b9cb-460c-96bf-1d91ed328cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:37.191103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499bad14-49c7-4c0a-95f4-692f72d71a6a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:37.194777 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3647/7230] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:37.194922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499bad14-49c7-4c0a-95f4-692f72d71a6a service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:37.195003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781da26b-a241-40fa-aa2e-b39c9b86ed54 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:37.195003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781da26b-a241-40fa-aa2e-b39c9b86ed54 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:37.195003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781da26b-a241-40fa-aa2e-b39c9b86ed54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:37.202522 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3584/7231] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:21:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:21:37.203461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499bad14-49c7-4c0a-95f4-692f72d71a6a service swift] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:37.214843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499bad14-49c7-4c0a-95f4-692f72d71a6a service swift] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:37.220712 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642b6fd-d7d9-491e-b60f-7e6600bd8dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:37.221485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642b6fd-d7d9-491e-b60f-7e6600bd8dfc admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:37.221768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642b6fd-d7d9-491e-b60f-7e6600bd8dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:37.222042 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642b6fd-d7d9-491e-b60f-7e6600bd8dfc admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:37.223128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642b6fd-d7d9-491e-b60f-7e6600bd8dfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:37.224352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642b6fd-d7d9-491e-b60f-7e6600bd8dfc admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:37.237229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-781da26b-a241-40fa-aa2e-b39c9b86ed54 None None] MFA Rules not processed for user `b242ab7b6b604c529a0a2d5fd9c8d1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:37.238806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-781da26b-a241-40fa-aa2e-b39c9b86ed54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:37.241394 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3585/7232] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:37.247739 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c13210-5722-4062-b0c4-0a22435a440e None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:37.248259 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c13210-5722-4062-b0c4-0a22435a440e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:37.248618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c13210-5722-4062-b0c4-0a22435a440e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:37.273008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f7c13210-5722-4062-b0c4-0a22435a440e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:37.274349 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f7c13210-5722-4062-b0c4-0a22435a440e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:37.286000 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3586/7233] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:37.287339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c13210-5722-4062-b0c4-0a22435a440e None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:37.299209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c13210-5722-4062-b0c4-0a22435a440e None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:37.308373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442c8f7-bae5-42da-9212-3cf8d626f254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:37.309116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442c8f7-bae5-42da-9212-3cf8d626f254 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:37.309780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442c8f7-bae5-42da-9212-3cf8d626f254 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:37.310130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442c8f7-bae5-42da-9212-3cf8d626f254 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:37.310937 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3442c8f7-bae5-42da-9212-3cf8d626f254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:37.313086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3442c8f7-bae5-42da-9212-3cf8d626f254 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:37.323828 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:37.327413 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3587/7234] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:37.332349 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442c8f7-bae5-42da-9212-3cf8d626f254 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:37.334136 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3648/7235] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:37.337357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781da26b-a241-40fa-aa2e-b39c9b86ed54 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:37.346770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442c8f7-bae5-42da-9212-3cf8d626f254 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:37.354284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1bee1-8670-4cfb-a953-86a16119766a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:37.355848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1bee1-8670-4cfb-a953-86a16119766a admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:37.356466 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1bee1-8670-4cfb-a953-86a16119766a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:37.356466 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1bee1-8670-4cfb-a953-86a16119766a admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:37.358348 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781da26b-a241-40fa-aa2e-b39c9b86ed54 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:37.358510 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1bee1-8670-4cfb-a953-86a16119766a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:21:37.358510 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1bee1-8670-4cfb-a953-86a16119766a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:37.363509 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd97472-a79f-47ba-abfc-bfaaaada8bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:37.364202 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd97472-a79f-47ba-abfc-bfaaaada8bb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:37.364474 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd97472-a79f-47ba-abfc-bfaaaada8bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:37.364760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd97472-a79f-47ba-abfc-bfaaaada8bb6 admin admin] PATH_INFO: `/v3/projects/3a8806ae7e224ab38a578001b4f3bb71/users/488f1f325be7406ca724054347d85129/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:37.367141 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1bee1-8670-4cfb-a953-86a16119766a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:37.383517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd97472-a79f-47ba-abfc-bfaaaada8bb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a8806ae7e224ab38a578001b4f3bb71, user_id=488f1f325be7406ca724054347d85129, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:37.386580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd97472-a79f-47ba-abfc-bfaaaada8bb6 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:37.390495 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3588/7236] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:21:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:21:37.391418 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1bee1-8670-4cfb-a953-86a16119766a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:37.405598 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3649/7237] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:37 2022] PUT /identity/v3/projects/3a8806ae7e224ab38a578001b4f3bb71/users/488f1f325be7406ca724054347d85129/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:37.405917 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1bee1-8670-4cfb-a953-86a16119766a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:37.407148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd97472-a79f-47ba-abfc-bfaaaada8bb6 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:37.427917 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:37.502700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7af03-aa9c-49fb-9b18-c502b5b14400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:37.503330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7af03-aa9c-49fb-9b18-c502b5b14400 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:37.503589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7af03-aa9c-49fb-9b18-c502b5b14400 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:37.503864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7af03-aa9c-49fb-9b18-c502b5b14400 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:37.504547 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7af03-aa9c-49fb-9b18-c502b5b14400 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:37.507092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7af03-aa9c-49fb-9b18-c502b5b14400 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:37.507222 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd97472-a79f-47ba-abfc-bfaaaada8bb6 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:37.514784 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541cdc9-7d7b-4bec-bc12-bd3193f0876e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:37.515432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541cdc9-7d7b-4bec-bc12-bd3193f0876e admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:37.515927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541cdc9-7d7b-4bec-bc12-bd3193f0876e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:37.516209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541cdc9-7d7b-4bec-bc12-bd3193f0876e admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:37.516839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541cdc9-7d7b-4bec-bc12-bd3193f0876e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:37.518771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541cdc9-7d7b-4bec-bc12-bd3193f0876e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:37.545929 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3589/7238] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:21:37 2022] POST /identity/v3/projects => generated 387 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:37.547124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dde023-1e2d-4ae8-b4ce-f1d65828807a None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:37.547502 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dde023-1e2d-4ae8-b4ce-f1d65828807a None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:37.549230 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dde023-1e2d-4ae8-b4ce-f1d65828807a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:37.561484 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3650/7239] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:21:37 2022] POST /identity/v3/projects => generated 377 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:37.564962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541cdc9-7d7b-4bec-bc12-bd3193f0876e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:37.587599 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-69dde023-1e2d-4ae8-b4ce-f1d65828807a None None] MFA Rules not processed for user `488f1f325be7406ca724054347d85129`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:37.588787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-69dde023-1e2d-4ae8-b4ce-f1d65828807a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:37.639694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541cdc9-7d7b-4bec-bc12-bd3193f0876e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:37.645663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7f547-5c42-4fac-ada3-d82cf9666e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:37.646313 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7f547-5c42-4fac-ada3-d82cf9666e1b admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:37.646663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7f547-5c42-4fac-ada3-d82cf9666e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:37.646941 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7f547-5c42-4fac-ada3-d82cf9666e1b admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:37.647554 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7f547-5c42-4fac-ada3-d82cf9666e1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:37.649472 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7f547-5c42-4fac-ada3-d82cf9666e1b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:37.666533 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3590/7240] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:37.667428 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dde023-1e2d-4ae8-b4ce-f1d65828807a None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:37.689265 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3651/7241] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:21:37 2022] POST /identity/v3/users => generated 300 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:37.689265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7f547-5c42-4fac-ada3-d82cf9666e1b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:37.690216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-53a7f547-5c42-4fac-ada3-d82cf9666e1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:37.692876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dde023-1e2d-4ae8-b4ce-f1d65828807a None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:37.698078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ed6ee-e6fe-4a3f-b3b2-68c92c243a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:37.699352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ed6ee-e6fe-4a3f-b3b2-68c92c243a17 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:37.700476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ed6ee-e6fe-4a3f-b3b2-68c92c243a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:37.702211 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ed6ee-e6fe-4a3f-b3b2-68c92c243a17 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:37.702211 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ed6ee-e6fe-4a3f-b3b2-68c92c243a17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:37.703657 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ed6ee-e6fe-4a3f-b3b2-68c92c243a17 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:37.728887 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3591/7242] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:21:37 2022] POST /identity/v3/users => generated 289 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:37.729683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ed6ee-e6fe-4a3f-b3b2-68c92c243a17 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:37.741537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ed6ee-e6fe-4a3f-b3b2-68c92c243a17 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:37.752993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd20a2-3d26-4d28-969e-e3b597e3a939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:37.754147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd20a2-3d26-4d28-969e-e3b597e3a939 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:37.755354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd20a2-3d26-4d28-969e-e3b597e3a939 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:37.755354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd20a2-3d26-4d28-969e-e3b597e3a939 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:37.756055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd20a2-3d26-4d28-969e-e3b597e3a939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:37.758173 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd20a2-3d26-4d28-969e-e3b597e3a939 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:37.767009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:37.771870 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7f547-5c42-4fac-ada3-d82cf9666e1b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:37.786338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f03d5-486a-4a5d-bc4b-29658c4a0f43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:37.786338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f03d5-486a-4a5d-bc4b-29658c4a0f43 service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:37.786338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f03d5-486a-4a5d-bc4b-29658c4a0f43 service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:37.786338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f03d5-486a-4a5d-bc4b-29658c4a0f43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:37.787228 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3592/7243] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:37.787228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd20a2-3d26-4d28-969e-e3b597e3a939 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:37.799793 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f03d5-486a-4a5d-bc4b-29658c4a0f43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:37.800220 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd20a2-3d26-4d28-969e-e3b597e3a939 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:37.801394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f03d5-486a-4a5d-bc4b-29658c4a0f43 service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:37.807465 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897f7ea-14dd-43ee-8b4f-284b39bed0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:37.809330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897f7ea-14dd-43ee-8b4f-284b39bed0cf admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:37.809641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897f7ea-14dd-43ee-8b4f-284b39bed0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:37.809921 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897f7ea-14dd-43ee-8b4f-284b39bed0cf admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:37.810797 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897f7ea-14dd-43ee-8b4f-284b39bed0cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:37.812496 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3652/7244] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:37.812808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897f7ea-14dd-43ee-8b4f-284b39bed0cf admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:37.813442 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f03d5-486a-4a5d-bc4b-29658c4a0f43 service cinder] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:37.825343 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f03d5-486a-4a5d-bc4b-29658c4a0f43 service cinder] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:37.827122 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3593/7245] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:37.831331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897f7ea-14dd-43ee-8b4f-284b39bed0cf admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:37.833674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811257d-426b-46ac-b0be-200099b1cc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:37.834482 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811257d-426b-46ac-b0be-200099b1cc5d admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:37.834955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811257d-426b-46ac-b0be-200099b1cc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:37.835292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811257d-426b-46ac-b0be-200099b1cc5d admin admin] PATH_INFO: `/v3/projects/36775292cc4841ae8eba471a0d3b6e7c/users/579520dc7b114d758d36ca3f230a5151/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:37.848467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897f7ea-14dd-43ee-8b4f-284b39bed0cf admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:37.867802 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811257d-426b-46ac-b0be-200099b1cc5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=36775292cc4841ae8eba471a0d3b6e7c, user_id=579520dc7b114d758d36ca3f230a5151, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:37.868247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db6d5d-f64b-46b2-92db-ff16801eb6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:37.868942 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db6d5d-f64b-46b2-92db-ff16801eb6bb admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:37.869392 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db6d5d-f64b-46b2-92db-ff16801eb6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:37.869745 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db6d5d-f64b-46b2-92db-ff16801eb6bb admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:37.871138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811257d-426b-46ac-b0be-200099b1cc5d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:37.871253 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db6d5d-f64b-46b2-92db-ff16801eb6bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:37.873053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db6d5d-f64b-46b2-92db-ff16801eb6bb admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:37.895163 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3594/7246] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:21:37.898422 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3653/7247] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:37 2022] PUT /identity/v3/projects/36775292cc4841ae8eba471a0d3b6e7c/users/579520dc7b114d758d36ca3f230a5151/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:37.899944 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db6d5d-f64b-46b2-92db-ff16801eb6bb admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:37.904496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811257d-426b-46ac-b0be-200099b1cc5d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:37.923735 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db6d5d-f64b-46b2-92db-ff16801eb6bb admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:37.996311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811257d-426b-46ac-b0be-200099b1cc5d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:38.004031 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74833fa2-bcbe-45d1-b6b4-28a39839d477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:38.004754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74833fa2-bcbe-45d1-b6b4-28a39839d477 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:38.006996 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74833fa2-bcbe-45d1-b6b4-28a39839d477 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:38.007479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74833fa2-bcbe-45d1-b6b4-28a39839d477 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:38.008413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74833fa2-bcbe-45d1-b6b4-28a39839d477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:38.010687 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74833fa2-bcbe-45d1-b6b4-28a39839d477 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:38.023808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:38.035969 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3654/7248] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:38.040513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74833fa2-bcbe-45d1-b6b4-28a39839d477 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:38.053681 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74833fa2-bcbe-45d1-b6b4-28a39839d477 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:38.061140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c15d3-77bb-4ae5-9440-83e9c1052f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:38.061977 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c15d3-77bb-4ae5-9440-83e9c1052f22 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:38.062268 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c15d3-77bb-4ae5-9440-83e9c1052f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:38.062599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c15d3-77bb-4ae5-9440-83e9c1052f22 admin admin] PATH_INFO: `/v3/projects/36775292cc4841ae8eba471a0d3b6e7c/users/579520dc7b114d758d36ca3f230a5151/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:38.063720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d24d0-daa1-44db-8a8b-4c36488df6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:38.064669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c15d3-77bb-4ae5-9440-83e9c1052f22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36775292cc4841ae8eba471a0d3b6e7c, user_id=579520dc7b114d758d36ca3f230a5151, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:38.064806 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d24d0-daa1-44db-8a8b-4c36488df6eb admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:38.065009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d24d0-daa1-44db-8a8b-4c36488df6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:38.065292 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d24d0-daa1-44db-8a8b-4c36488df6eb admin admin] PATH_INFO: `/v3/projects/cd5da91b469e4b96a736fb25a6d30d4c/users/9e43dc88da334346b2f097d3a29646b1/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:38.068128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c15d3-77bb-4ae5-9440-83e9c1052f22 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:38.082634 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3655/7249] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:38 2022] PUT /identity/v3/projects/36775292cc4841ae8eba471a0d3b6e7c/users/579520dc7b114d758d36ca3f230a5151/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:38.093422 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7923fcd-d167-4948-9245-277bb1605cc8 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:38.093712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7923fcd-d167-4948-9245-277bb1605cc8 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:38.093989 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7923fcd-d167-4948-9245-277bb1605cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:38.094212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d24d0-daa1-44db-8a8b-4c36488df6eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd5da91b469e4b96a736fb25a6d30d4c, user_id=9e43dc88da334346b2f097d3a29646b1, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:38.097637 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d24d0-daa1-44db-8a8b-4c36488df6eb admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:38.116221 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3595/7250] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:37 2022] PUT /identity/v3/projects/cd5da91b469e4b96a736fb25a6d30d4c/users/9e43dc88da334346b2f097d3a29646b1/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:21:38.127902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdaee9-a814-4e85-affd-e2a017eda9d5 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:38.128066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdaee9-a814-4e85-affd-e2a017eda9d5 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:38.128267 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdaee9-a814-4e85-affd-e2a017eda9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:38.138307 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d7923fcd-d167-4948-9245-277bb1605cc8 None None] MFA Rules not processed for user `579520dc7b114d758d36ca3f230a5151`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:38.140193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d7923fcd-d167-4948-9245-277bb1605cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:38.168130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-9acdaee9-a814-4e85-affd-e2a017eda9d5 None None] MFA Rules not processed for user `9e43dc88da334346b2f097d3a29646b1`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:38.169948 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9acdaee9-a814-4e85-affd-e2a017eda9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:38.237302 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3656/7251] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:38 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:21:38.255086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7923fcd-d167-4948-9245-277bb1605cc8 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:38.301380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:38.317430 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3596/7252] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:21:38.322142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acdaee9-a814-4e85-affd-e2a017eda9d5 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:38.357788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7923fcd-d167-4948-9245-277bb1605cc8 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:38.361686 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1217632-1540-46b8-b096-27b251fd68c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:38.362539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1217632-1540-46b8-b096-27b251fd68c2 service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:38.362869 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1217632-1540-46b8-b096-27b251fd68c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:38.363153 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1217632-1540-46b8-b096-27b251fd68c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:38.374302 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1217632-1540-46b8-b096-27b251fd68c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:38.375995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1217632-1540-46b8-b096-27b251fd68c2 service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:38.388409 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3657/7253] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:38 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:38.462295 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acdaee9-a814-4e85-affd-e2a017eda9d5 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:38.467550 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2339f47-9f3f-4cc0-90ee-74fea01a6140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:38.468175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2339f47-9f3f-4cc0-90ee-74fea01a6140 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:38.468569 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2339f47-9f3f-4cc0-90ee-74fea01a6140 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:38.468799 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2339f47-9f3f-4cc0-90ee-74fea01a6140 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:38.469461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2339f47-9f3f-4cc0-90ee-74fea01a6140 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:38.471676 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2339f47-9f3f-4cc0-90ee-74fea01a6140 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:38.518585 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3597/7254] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:21:38 2022] POST /identity/v3/projects => generated 379 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:38.520846 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1217632-1540-46b8-b096-27b251fd68c2 service cinder] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:38.534114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1217632-1540-46b8-b096-27b251fd68c2 service cinder] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:38.660617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2339f47-9f3f-4cc0-90ee-74fea01a6140 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:38.705066 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2abf10b-1847-4b6a-8e9f-ac655ee94412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:38.705623 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abf10b-1847-4b6a-8e9f-ac655ee94412 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:38.705949 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abf10b-1847-4b6a-8e9f-ac655ee94412 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:38.706418 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abf10b-1847-4b6a-8e9f-ac655ee94412 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:38.707218 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2abf10b-1847-4b6a-8e9f-ac655ee94412 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:38.709392 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2abf10b-1847-4b6a-8e9f-ac655ee94412 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:38.775496 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3658/7255] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:21:38 2022] POST /identity/v3/users => generated 290 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:38.775719 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:38.779515 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2abf10b-1847-4b6a-8e9f-ac655ee94412 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:38.804660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2abf10b-1847-4b6a-8e9f-ac655ee94412 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:38.836274 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2339f47-9f3f-4cc0-90ee-74fea01a6140 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:38.836420 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a3de9-5aa3-4d27-be0f-09f200de6b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:38.836950 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a3de9-5aa3-4d27-be0f-09f200de6b1e admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:38.837225 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a3de9-5aa3-4d27-be0f-09f200de6b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:38.837494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a3de9-5aa3-4d27-be0f-09f200de6b1e admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:38.838135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a3de9-5aa3-4d27-be0f-09f200de6b1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:38.843871 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a3de9-5aa3-4d27-be0f-09f200de6b1e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:38.848904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126357cd-8955-4c65-b787-c80558930809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:38.851099 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126357cd-8955-4c65-b787-c80558930809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:38.851388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126357cd-8955-4c65-b787-c80558930809 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:38.858126 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3659/7256] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:21:38.862095 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a3de9-5aa3-4d27-be0f-09f200de6b1e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:38.862690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126357cd-8955-4c65-b787-c80558930809 admin admin] PATH_INFO: `/v3/users/b242ab7b6b604c529a0a2d5fd9c8d1d8` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:38.866804 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126357cd-8955-4c65-b787-c80558930809 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b242ab7b6b604c529a0a2d5fd9c8d1d8)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:38.868888 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126357cd-8955-4c65-b787-c80558930809 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:38.881863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a3de9-5aa3-4d27-be0f-09f200de6b1e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:38.889078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05ec07-92bd-47fc-9d11-532aef8bdaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:38.889841 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05ec07-92bd-47fc-9d11-532aef8bdaa0 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:38.890125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05ec07-92bd-47fc-9d11-532aef8bdaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:38.890487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05ec07-92bd-47fc-9d11-532aef8bdaa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:38.891455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb05ec07-92bd-47fc-9d11-532aef8bdaa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:38.893391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb05ec07-92bd-47fc-9d11-532aef8bdaa0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:38.911164 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3660/7257] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:21:38.914861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05ec07-92bd-47fc-9d11-532aef8bdaa0 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:38.927981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05ec07-92bd-47fc-9d11-532aef8bdaa0 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:38.940312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845476b-fa3f-4707-afab-de4d057fe9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:38.941458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845476b-fa3f-4707-afab-de4d057fe9e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:38.941957 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845476b-fa3f-4707-afab-de4d057fe9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:38.942602 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845476b-fa3f-4707-afab-de4d057fe9e0 admin admin] PATH_INFO: `/v3/projects/916c5a5ebb804111a59622dcb9a1b6d5/users/9423d7c6a92b4050b0ee6d0139a68fce/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:38.963866 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845476b-fa3f-4707-afab-de4d057fe9e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=916c5a5ebb804111a59622dcb9a1b6d5, user_id=9423d7c6a92b4050b0ee6d0139a68fce, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:38.968236 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845476b-fa3f-4707-afab-de4d057fe9e0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:38.975063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-126357cd-8955-4c65-b787-c80558930809 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b242ab7b6b604c529a0a2d5fd9c8d1d8'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:38.975997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-126357cd-8955-4c65-b787-c80558930809 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b242ab7b6b604c529a0a2d5fd9c8d1d8'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:38.977056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-126357cd-8955-4c65-b787-c80558930809 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b242ab7b6b604c529a0a2d5fd9c8d1d8'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:38.988935 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3661/7258] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:38 2022] PUT /identity/v3/projects/916c5a5ebb804111a59622dcb9a1b6d5/users/9423d7c6a92b4050b0ee6d0139a68fce/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:21:39.000308 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-126357cd-8955-4c65-b787-c80558930809 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b242ab7b6b604c529a0a2d5fd9c8d1d8'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:39.002454 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72f318-ec96-4e94-ac9c-9c4a9a2ce92b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:39.003026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72f318-ec96-4e94-ac9c-9c4a9a2ce92b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:39.003704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72f318-ec96-4e94-ac9c-9c4a9a2ce92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:39.022651 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-126357cd-8955-4c65-b787-c80558930809 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b242ab7b6b604c529a0a2d5fd9c8d1d8'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:39.051841 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-2d72f318-ec96-4e94-ac9c-9c4a9a2ce92b None None] MFA Rules not processed for user `9423d7c6a92b4050b0ee6d0139a68fce`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:39.053361 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2d72f318-ec96-4e94-ac9c-9c4a9a2ce92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:39.073082 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3598/7259] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:21:38 2022] DELETE /identity/v3/users/b242ab7b6b604c529a0a2d5fd9c8d1d8 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:39.079813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d67c7e-5a51-4192-bf02-23c5e45fad3c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:39.080434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d67c7e-5a51-4192-bf02-23c5e45fad3c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:39.080718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d67c7e-5a51-4192-bf02-23c5e45fad3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:39.122683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-44d67c7e-5a51-4192-bf02-23c5e45fad3c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:39.124964 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-44d67c7e-5a51-4192-bf02-23c5e45fad3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:39.172907 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3662/7260] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:39.177664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72f318-ec96-4e94-ac9c-9c4a9a2ce92b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:39.181258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2d72f318-ec96-4e94-ac9c-9c4a9a2ce92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:39.220912 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:39.277685 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3599/7261] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:39.288402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d67c7e-5a51-4192-bf02-23c5e45fad3c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:39.290109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-44d67c7e-5a51-4192-bf02-23c5e45fad3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:39.301280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72f318-ec96-4e94-ac9c-9c4a9a2ce92b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:39.307140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0be39-d7f4-47bd-a0fc-6d160a736888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:39.307745 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0be39-d7f4-47bd-a0fc-6d160a736888 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:39.308705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0be39-d7f4-47bd-a0fc-6d160a736888 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:39.309337 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0be39-d7f4-47bd-a0fc-6d160a736888 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:39.309628 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0be39-d7f4-47bd-a0fc-6d160a736888 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:39.312208 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0be39-d7f4-47bd-a0fc-6d160a736888 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:39.345452 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3663/7262] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:21:39 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:39.346581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0be39-d7f4-47bd-a0fc-6d160a736888 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:39.379585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d67c7e-5a51-4192-bf02-23c5e45fad3c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:39.397581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:39.446333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0be39-d7f4-47bd-a0fc-6d160a736888 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:39.451849 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7daba17-a816-4356-b97a-f2fb689f0579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:39.452469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7daba17-a816-4356-b97a-f2fb689f0579 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:39.453203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7daba17-a816-4356-b97a-f2fb689f0579 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:39.453203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7daba17-a816-4356-b97a-f2fb689f0579 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:39.453644 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7daba17-a816-4356-b97a-f2fb689f0579 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:39.455923 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7daba17-a816-4356-b97a-f2fb689f0579 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:39.466982 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d4fb7-1797-4cd4-8a25-533f9b883a96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:39.468113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d4fb7-1797-4cd4-8a25-533f9b883a96 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:39.468372 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d4fb7-1797-4cd4-8a25-533f9b883a96 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:39.469855 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d4fb7-1797-4cd4-8a25-533f9b883a96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:39.483448 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d4fb7-1797-4cd4-8a25-533f9b883a96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:39.485868 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d4fb7-1797-4cd4-8a25-533f9b883a96 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:39.486692 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3664/7263] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:21:39 2022] POST /identity/v3/users => generated 296 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:39.490167 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7daba17-a816-4356-b97a-f2fb689f0579 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:39.501601 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3600/7264] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:21:39.502357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7daba17-a816-4356-b97a-f2fb689f0579 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:39.507116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e51b4a-81ad-4212-b72a-05b41d8483d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:39.507724 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e51b4a-81ad-4212-b72a-05b41d8483d7 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:39.508040 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e51b4a-81ad-4212-b72a-05b41d8483d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:39.508318 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e51b4a-81ad-4212-b72a-05b41d8483d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:39.508969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e51b4a-81ad-4212-b72a-05b41d8483d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:39.510749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e51b4a-81ad-4212-b72a-05b41d8483d7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:39.522423 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3665/7265] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:21:39.528286 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d4fb7-1797-4cd4-8a25-533f9b883a96 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:39.538929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d4fb7-1797-4cd4-8a25-533f9b883a96 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:39.545416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cb745-6eb8-415f-9aa0-21db4b692bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:39.546337 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cb745-6eb8-415f-9aa0-21db4b692bb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:39.546877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cb745-6eb8-415f-9aa0-21db4b692bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:39.547161 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cb745-6eb8-415f-9aa0-21db4b692bb1 admin admin] PATH_INFO: `/v3/projects/a347645a518740308f295416356a9c3d/users/1b745e8c30714c86b2a7dc0a7089c0e2/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:39.572082 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0cb745-6eb8-415f-9aa0-21db4b692bb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a347645a518740308f295416356a9c3d, user_id=1b745e8c30714c86b2a7dc0a7089c0e2, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:39.576523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0cb745-6eb8-415f-9aa0-21db4b692bb1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:39.597099 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3601/7266] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:39 2022] PUT /identity/v3/projects/a347645a518740308f295416356a9c3d/users/1b745e8c30714c86b2a7dc0a7089c0e2/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:39.601880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e51b4a-81ad-4212-b72a-05b41d8483d7 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:39.614670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e51b4a-81ad-4212-b72a-05b41d8483d7 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:39.718750 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a63a6-427f-470c-939e-5911bc40212f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:39.719384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a63a6-427f-470c-939e-5911bc40212f admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:39.719744 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a63a6-427f-470c-939e-5911bc40212f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:39.720214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a63a6-427f-470c-939e-5911bc40212f admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:39.720992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a63a6-427f-470c-939e-5911bc40212f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:39.722671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a63a6-427f-470c-939e-5911bc40212f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:39.735973 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3666/7267] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:39.740186 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cb745-6eb8-415f-9aa0-21db4b692bb1 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:39.757387 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cb745-6eb8-415f-9aa0-21db4b692bb1 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:39.763396 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3fa1cf-144d-44a8-9004-acd604015b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:39.764463 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fa1cf-144d-44a8-9004-acd604015b9f admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:39.764802 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fa1cf-144d-44a8-9004-acd604015b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:39.765141 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fa1cf-144d-44a8-9004-acd604015b9f admin admin] PATH_INFO: `/v3/projects/a347645a518740308f295416356a9c3d/users/1b745e8c30714c86b2a7dc0a7089c0e2/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:39.767144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3fa1cf-144d-44a8-9004-acd604015b9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a347645a518740308f295416356a9c3d, user_id=1b745e8c30714c86b2a7dc0a7089c0e2, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:39.770760 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3fa1cf-144d-44a8-9004-acd604015b9f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:39.784194 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3602/7268] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:39 2022] PUT /identity/v3/projects/a347645a518740308f295416356a9c3d/users/1b745e8c30714c86b2a7dc0a7089c0e2/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:21:39.795194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14446ef-3267-416d-83a1-fd1110f82477 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:39.795696 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14446ef-3267-416d-83a1-fd1110f82477 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:39.796073 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14446ef-3267-416d-83a1-fd1110f82477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:39.831662 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:39.848647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-c14446ef-3267-416d-83a1-fd1110f82477 None None] MFA Rules not processed for user `1b745e8c30714c86b2a7dc0a7089c0e2`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:39.849708 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c14446ef-3267-416d-83a1-fd1110f82477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:39.849999 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3fa1cf-144d-44a8-9004-acd604015b9f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:39.851907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0d3fa1cf-144d-44a8-9004-acd604015b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:39.946396 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3667/7269] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:39 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:39.952498 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14446ef-3267-416d-83a1-fd1110f82477 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:39.954908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c14446ef-3267-416d-83a1-fd1110f82477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:39.975196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3fa1cf-144d-44a8-9004-acd604015b9f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:39.981642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057efe25-602d-4dff-b97c-ab7e77e292b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:39.982285 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057efe25-602d-4dff-b97c-ab7e77e292b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:39.982533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14446ef-3267-416d-83a1-fd1110f82477 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:39.982668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057efe25-602d-4dff-b97c-ab7e77e292b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:39.982904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057efe25-602d-4dff-b97c-ab7e77e292b7 admin admin] PATH_INFO: `/v3/projects/a723e532ec7345ecbf78aaaed0c78285` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:39.984035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057efe25-602d-4dff-b97c-ab7e77e292b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a723e532ec7345ecbf78aaaed0c78285)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:39.985968 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057efe25-602d-4dff-b97c-ab7e77e292b7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:39.987711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa2de9-a9cb-4926-9a95-f8e0bccf9bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:39.988751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa2de9-a9cb-4926-9a95-f8e0bccf9bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:39.988751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa2de9-a9cb-4926-9a95-f8e0bccf9bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:39.989135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa2de9-a9cb-4926-9a95-f8e0bccf9bc4 admin admin] PATH_INFO: `/v3/users/8d1a2c57cf5840f7a1dcede60357580e` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:39.990374 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa2de9-a9cb-4926-9a95-f8e0bccf9bc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d1a2c57cf5840f7a1dcede60357580e)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:39.992598 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa2de9-a9cb-4926-9a95-f8e0bccf9bc4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:40.050307 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5cfa2de9-a9cb-4926-9a95-f8e0bccf9bc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d1a2c57cf5840f7a1dcede60357580e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:40.055877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-057efe25-602d-4dff-b97c-ab7e77e292b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a723e532ec7345ecbf78aaaed0c78285', 'request_id': 'req-057efe25-602d-4dff-b97c-ab7e77e292b7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:40.060601 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5cfa2de9-a9cb-4926-9a95-f8e0bccf9bc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d1a2c57cf5840f7a1dcede60357580e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:40.061372 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5cfa2de9-a9cb-4926-9a95-f8e0bccf9bc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d1a2c57cf5840f7a1dcede60357580e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:40.062035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5cfa2de9-a9cb-4926-9a95-f8e0bccf9bc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d1a2c57cf5840f7a1dcede60357580e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:40.065396 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-057efe25-602d-4dff-b97c-ab7e77e292b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a723e532ec7345ecbf78aaaed0c78285', 'request_id': 'req-057efe25-602d-4dff-b97c-ab7e77e292b7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:40.070900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5cfa2de9-a9cb-4926-9a95-f8e0bccf9bc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d1a2c57cf5840f7a1dcede60357580e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:40.072220 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-057efe25-602d-4dff-b97c-ab7e77e292b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a723e532ec7345ecbf78aaaed0c78285', 'request_id': 'req-057efe25-602d-4dff-b97c-ab7e77e292b7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:40.087216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-057efe25-602d-4dff-b97c-ab7e77e292b7 admin admin] The token cache is being invalidate because project a723e532ec7345ecbf78aaaed0c78285 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:21:40.087584 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-057efe25-602d-4dff-b97c-ab7e77e292b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:40.088418 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-057efe25-602d-4dff-b97c-ab7e77e292b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:40.091589 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3603/7270] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:21:39 2022] DELETE /identity/v3/projects/a723e532ec7345ecbf78aaaed0c78285 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:40.092449 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057efe25-602d-4dff-b97c-ab7e77e292b7 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:40.094062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-057efe25-602d-4dff-b97c-ab7e77e292b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:40.094827 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3668/7271] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:21:39 2022] DELETE /identity/v3/users/8d1a2c57cf5840f7a1dcede60357580e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:40.095763 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa2de9-a9cb-4926-9a95-f8e0bccf9bc4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:40.098717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5cfa2de9-a9cb-4926-9a95-f8e0bccf9bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:40.106908 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:40.172211 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057efe25-602d-4dff-b97c-ab7e77e292b7 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:40.186372 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa2de9-a9cb-4926-9a95-f8e0bccf9bc4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:40.191762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e69307-c9d7-4b06-a472-25dea5aeb54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:40.192971 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e69307-c9d7-4b06-a472-25dea5aeb54d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:40.192971 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e69307-c9d7-4b06-a472-25dea5aeb54d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:40.193176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e69307-c9d7-4b06-a472-25dea5aeb54d admin admin] PATH_INFO: `/v3/users/579520dc7b114d758d36ca3f230a5151` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:40.194240 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e69307-c9d7-4b06-a472-25dea5aeb54d admin admin] RBAC: Authorizing `identity:delete_user(user_id=579520dc7b114d758d36ca3f230a5151)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:40.196308 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e69307-c9d7-4b06-a472-25dea5aeb54d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:40.210281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:40.232423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca682cd2-9b83-4ce9-aeaf-6e48513855aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:40.233179 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca682cd2-9b83-4ce9-aeaf-6e48513855aa service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:40.233693 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca682cd2-9b83-4ce9-aeaf-6e48513855aa service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:40.234110 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca682cd2-9b83-4ce9-aeaf-6e48513855aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:40.236901 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ca682cd2-9b83-4ce9-aeaf-6e48513855aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:40.283608 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d7e69307-c9d7-4b06-a472-25dea5aeb54d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '579520dc7b114d758d36ca3f230a5151'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:40.295130 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d7e69307-c9d7-4b06-a472-25dea5aeb54d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '579520dc7b114d758d36ca3f230a5151'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:40.295851 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d7e69307-c9d7-4b06-a472-25dea5aeb54d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '579520dc7b114d758d36ca3f230a5151'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:40.296476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d7e69307-c9d7-4b06-a472-25dea5aeb54d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '579520dc7b114d758d36ca3f230a5151'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:40.314118 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d7e69307-c9d7-4b06-a472-25dea5aeb54d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '579520dc7b114d758d36ca3f230a5151'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:40.347039 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3669/7272] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:21:40 2022] DELETE /identity/v3/users/579520dc7b114d758d36ca3f230a5151 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:40.348222 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191891c-f764-4426-b655-e333a0c919a6 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:40.348655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191891c-f764-4426-b655-e333a0c919a6 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:40.349087 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191891c-f764-4426-b655-e333a0c919a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:40.394600 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-5191891c-f764-4426-b655-e333a0c919a6 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:40.395394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5191891c-f764-4426-b655-e333a0c919a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:40.398920 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca682cd2-9b83-4ce9-aeaf-6e48513855aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:40.400384 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca682cd2-9b83-4ce9-aeaf-6e48513855aa service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:40.427806 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3604/7273] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:40 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:40.497572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca682cd2-9b83-4ce9-aeaf-6e48513855aa service cinder] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:40.500017 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ca682cd2-9b83-4ce9-aeaf-6e48513855aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:40.515310 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3670/7274] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:40.523238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca682cd2-9b83-4ce9-aeaf-6e48513855aa service cinder] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:40.536313 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191891c-f764-4426-b655-e333a0c919a6 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:40.541548 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5191891c-f764-4426-b655-e333a0c919a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:40.604511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cbbea-f720-49d1-bb55-810359438bb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:40.605451 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cbbea-f720-49d1-bb55-810359438bb4 service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:40.606478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cbbea-f720-49d1-bb55-810359438bb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:40.606822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cbbea-f720-49d1-bb55-810359438bb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:40.608898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-977cbbea-f720-49d1-bb55-810359438bb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:40.630244 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191891c-f764-4426-b655-e333a0c919a6 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:40.644136 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc72cf-5dee-4826-a55d-87e3de1843f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:40.644926 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc72cf-5dee-4826-a55d-87e3de1843f6 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:40.645789 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc72cf-5dee-4826-a55d-87e3de1843f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:40.645789 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc72cf-5dee-4826-a55d-87e3de1843f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:40.666758 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:40.672413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc72cf-5dee-4826-a55d-87e3de1843f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:40.674193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc72cf-5dee-4826-a55d-87e3de1843f6 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:40.695487 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3671/7275] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:40.726142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977cbbea-f720-49d1-bb55-810359438bb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:40.728591 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977cbbea-f720-49d1-bb55-810359438bb4 service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:40.743417 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3605/7276] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:40.937581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc72cf-5dee-4826-a55d-87e3de1843f6 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:40.939064 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-69cc72cf-5dee-4826-a55d-87e3de1843f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:40.953909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc72cf-5dee-4826-a55d-87e3de1843f6 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:40.958944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab3f17-a8f1-4a46-9563-552943088a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:40.959584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab3f17-a8f1-4a46-9563-552943088a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:40.959866 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab3f17-a8f1-4a46-9563-552943088a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:40.960143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab3f17-a8f1-4a46-9563-552943088a23 admin admin] PATH_INFO: `/v3/projects/36775292cc4841ae8eba471a0d3b6e7c` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:40.961309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab3f17-a8f1-4a46-9563-552943088a23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36775292cc4841ae8eba471a0d3b6e7c)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:40.964603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab3f17-a8f1-4a46-9563-552943088a23 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:40.983924 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cbbea-f720-49d1-bb55-810359438bb4 service cinder] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:40.985980 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-977cbbea-f720-49d1-bb55-810359438bb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:41.013352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cbbea-f720-49d1-bb55-810359438bb4 service cinder] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:41.021351 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42150fe-a495-4a1c-89da-fe37362ab91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:41.022933 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42150fe-a495-4a1c-89da-fe37362ab91b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:41.023526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42150fe-a495-4a1c-89da-fe37362ab91b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:41.023899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42150fe-a495-4a1c-89da-fe37362ab91b admin admin] PATH_INFO: `/v3/projects/af8471e400e24dd7a29c5bbb042ac0b9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:41.027605 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42150fe-a495-4a1c-89da-fe37362ab91b admin admin] RBAC: Authorizing `identity:delete_project(project_id=af8471e400e24dd7a29c5bbb042ac0b9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:41.029984 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42150fe-a495-4a1c-89da-fe37362ab91b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:41.031039 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:41.066307 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b2ab3f17-a8f1-4a46-9563-552943088a23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36775292cc4841ae8eba471a0d3b6e7c', 'request_id': 'req-b2ab3f17-a8f1-4a46-9563-552943088a23'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:41.075924 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b2ab3f17-a8f1-4a46-9563-552943088a23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36775292cc4841ae8eba471a0d3b6e7c', 'request_id': 'req-b2ab3f17-a8f1-4a46-9563-552943088a23'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:41.087998 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b2ab3f17-a8f1-4a46-9563-552943088a23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36775292cc4841ae8eba471a0d3b6e7c', 'request_id': 'req-b2ab3f17-a8f1-4a46-9563-552943088a23'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:41.100881 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c42150fe-a495-4a1c-89da-fe37362ab91b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af8471e400e24dd7a29c5bbb042ac0b9', 'request_id': 'req-c42150fe-a495-4a1c-89da-fe37362ab91b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:41.108902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c42150fe-a495-4a1c-89da-fe37362ab91b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af8471e400e24dd7a29c5bbb042ac0b9', 'request_id': 'req-c42150fe-a495-4a1c-89da-fe37362ab91b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:41.118232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b2ab3f17-a8f1-4a46-9563-552943088a23 admin admin] The token cache is being invalidate because project 36775292cc4841ae8eba471a0d3b6e7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:21:41.118580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b2ab3f17-a8f1-4a46-9563-552943088a23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:41.119919 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b2ab3f17-a8f1-4a46-9563-552943088a23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:41.123075 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c42150fe-a495-4a1c-89da-fe37362ab91b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af8471e400e24dd7a29c5bbb042ac0b9', 'request_id': 'req-c42150fe-a495-4a1c-89da-fe37362ab91b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:41.123710 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3672/7277] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:21:40 2022] DELETE /identity/v3/projects/36775292cc4841ae8eba471a0d3b6e7c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:41.128668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7e7aa-bb7b-427f-a296-1b95946969ad None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:41.128994 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7e7aa-bb7b-427f-a296-1b95946969ad None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:41.129392 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7e7aa-bb7b-427f-a296-1b95946969ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:41.142484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c42150fe-a495-4a1c-89da-fe37362ab91b admin admin] The token cache is being invalidate because project af8471e400e24dd7a29c5bbb042ac0b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:21:41.143362 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c42150fe-a495-4a1c-89da-fe37362ab91b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:41.144208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c42150fe-a495-4a1c-89da-fe37362ab91b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:41.147961 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3606/7278] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:21:40 2022] DELETE /identity/v3/projects/af8471e400e24dd7a29c5bbb042ac0b9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:21:41.154780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760900d-39d1-4da9-b6fa-7391286b917e None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:41.157067 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760900d-39d1-4da9-b6fa-7391286b917e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:41.159129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760900d-39d1-4da9-b6fa-7391286b917e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:41.162732 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-11d7e7aa-bb7b-427f-a296-1b95946969ad None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:41.164143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-11d7e7aa-bb7b-427f-a296-1b95946969ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:41.189383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-5760900d-39d1-4da9-b6fa-7391286b917e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:41.191072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5760900d-39d1-4da9-b6fa-7391286b917e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:41.262181 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3673/7279] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:41.271166 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cac35-894a-4931-b179-000f2cf428e1 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:41.271615 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cac35-894a-4931-b179-000f2cf428e1 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:41.272017 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cac35-894a-4931-b179-000f2cf428e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:41.289330 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3607/7280] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:41.307207 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760900d-39d1-4da9-b6fa-7391286b917e None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:41.308788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5760900d-39d1-4da9-b6fa-7391286b917e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:41.309351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-166cac35-894a-4931-b179-000f2cf428e1 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:41.310619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-166cac35-894a-4931-b179-000f2cf428e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:41.319145 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3674/7281] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:41.324841 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cac35-894a-4931-b179-000f2cf428e1 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:41.328420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760900d-39d1-4da9-b6fa-7391286b917e None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:41.335627 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d26705-2c88-45e2-bfae-1c1a79ec48d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:41.336571 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d26705-2c88-45e2-bfae-1c1a79ec48d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:41.336870 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cac35-894a-4931-b179-000f2cf428e1 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:41.336993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d26705-2c88-45e2-bfae-1c1a79ec48d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:41.337322 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d26705-2c88-45e2-bfae-1c1a79ec48d2 admin admin] PATH_INFO: `/v3/users/488f1f325be7406ca724054347d85129` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:41.339494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d26705-2c88-45e2-bfae-1c1a79ec48d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=488f1f325be7406ca724054347d85129)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:41.342106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d26705-2c88-45e2-bfae-1c1a79ec48d2 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:41.342651 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582078b6-1645-4fb5-a361-bcfb0405379d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:41.343502 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582078b6-1645-4fb5-a361-bcfb0405379d admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:41.343848 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582078b6-1645-4fb5-a361-bcfb0405379d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:41.344446 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582078b6-1645-4fb5-a361-bcfb0405379d admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:41.345281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582078b6-1645-4fb5-a361-bcfb0405379d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:21:41.345665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582078b6-1645-4fb5-a361-bcfb0405379d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:41.347776 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582078b6-1645-4fb5-a361-bcfb0405379d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:41.368730 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3675/7282] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:21:41.371190 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582078b6-1645-4fb5-a361-bcfb0405379d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:41.385595 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582078b6-1645-4fb5-a361-bcfb0405379d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:41.391792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51014991-3596-475a-a0db-cdc0009a6b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:41.392598 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51014991-3596-475a-a0db-cdc0009a6b18 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:41.393249 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51014991-3596-475a-a0db-cdc0009a6b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:41.394253 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51014991-3596-475a-a0db-cdc0009a6b18 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:41.395057 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51014991-3596-475a-a0db-cdc0009a6b18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:41.397569 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51014991-3596-475a-a0db-cdc0009a6b18 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:41.421346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b6d26705-2c88-45e2-bfae-1c1a79ec48d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '488f1f325be7406ca724054347d85129'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:41.422272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b6d26705-2c88-45e2-bfae-1c1a79ec48d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '488f1f325be7406ca724054347d85129'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:41.423255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b6d26705-2c88-45e2-bfae-1c1a79ec48d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '488f1f325be7406ca724054347d85129'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:41.425882 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:41.430249 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3676/7283] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:21:41 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:41.434993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b6d26705-2c88-45e2-bfae-1c1a79ec48d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '488f1f325be7406ca724054347d85129'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:41.435524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75958627-2946-4012-915d-b793d068bc0c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:41.435815 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75958627-2946-4012-915d-b793d068bc0c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:41.436091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75958627-2946-4012-915d-b793d068bc0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:41.450206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b6d26705-2c88-45e2-bfae-1c1a79ec48d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '488f1f325be7406ca724054347d85129'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:41.458160 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-75958627-2946-4012-915d-b793d068bc0c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:41.459469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-75958627-2946-4012-915d-b793d068bc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:41.463853 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3608/7284] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:21:41 2022] DELETE /identity/v3/users/488f1f325be7406ca724054347d85129 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:21:41.464829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d26705-2c88-45e2-bfae-1c1a79ec48d2 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:41.466290 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b6d26705-2c88-45e2-bfae-1c1a79ec48d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:41.534956 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3677/7285] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:41.536300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410791c-32a9-487d-a85d-873e557a379f None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:41.536498 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410791c-32a9-487d-a85d-873e557a379f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:41.536773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410791c-32a9-487d-a85d-873e557a379f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:41.547421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d26705-2c88-45e2-bfae-1c1a79ec48d2 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:41.552825 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d1168-a6e5-448f-95ca-f4ea47c5352f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:41.553446 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d1168-a6e5-448f-95ca-f4ea47c5352f admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:41.553761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d1168-a6e5-448f-95ca-f4ea47c5352f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:41.553997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d1168-a6e5-448f-95ca-f4ea47c5352f admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:41.554656 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d1168-a6e5-448f-95ca-f4ea47c5352f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:41.556720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d1168-a6e5-448f-95ca-f4ea47c5352f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:41.561920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-4410791c-32a9-487d-a85d-873e557a379f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:41.563546 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4410791c-32a9-487d-a85d-873e557a379f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:41.573364 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3678/7286] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:41.574660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410791c-32a9-487d-a85d-873e557a379f None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:41.587340 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3609/7287] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:21:41 2022] POST /identity/v3/users => generated 287 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:41.588373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d1168-a6e5-448f-95ca-f4ea47c5352f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:41.590443 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c62d1168-a6e5-448f-95ca-f4ea47c5352f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:41.599543 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410791c-32a9-487d-a85d-873e557a379f None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:41.606315 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cda642-465f-48fa-8614-6383e1d18b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:41.607018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cda642-465f-48fa-8614-6383e1d18b4d admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:41.607297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cda642-465f-48fa-8614-6383e1d18b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:41.607623 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cda642-465f-48fa-8614-6383e1d18b4d admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:41.608276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cda642-465f-48fa-8614-6383e1d18b4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:21:41.608579 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cda642-465f-48fa-8614-6383e1d18b4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:41.610509 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cda642-465f-48fa-8614-6383e1d18b4d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:41.612344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:41.626307 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3679/7288] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:21:41.627262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cda642-465f-48fa-8614-6383e1d18b4d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:41.637932 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cda642-465f-48fa-8614-6383e1d18b4d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:41.643317 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5e157-280d-4eb9-8fa0-fea135989752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:41.643928 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5e157-280d-4eb9-8fa0-fea135989752 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:41.644206 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5e157-280d-4eb9-8fa0-fea135989752 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:41.644482 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5e157-280d-4eb9-8fa0-fea135989752 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:41.645433 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed5e157-280d-4eb9-8fa0-fea135989752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:41.647415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed5e157-280d-4eb9-8fa0-fea135989752 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:41.664961 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3680/7289] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:41.664961 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5e157-280d-4eb9-8fa0-fea135989752 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:41.676326 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5e157-280d-4eb9-8fa0-fea135989752 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:41.681199 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d1168-a6e5-448f-95ca-f4ea47c5352f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:41.681469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda7445-060b-4cb3-8408-33e9de0f6b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:41.682080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda7445-060b-4cb3-8408-33e9de0f6b3c admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:41.682501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda7445-060b-4cb3-8408-33e9de0f6b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:41.683456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda7445-060b-4cb3-8408-33e9de0f6b3c admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:41.684125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda7445-060b-4cb3-8408-33e9de0f6b3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:41.686422 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda7445-060b-4cb3-8408-33e9de0f6b3c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:41.690445 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f0971-227d-4e92-831f-ad8b708bd970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:41.691226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f0971-227d-4e92-831f-ad8b708bd970 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:41.691602 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f0971-227d-4e92-831f-ad8b708bd970 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:41.691969 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f0971-227d-4e92-831f-ad8b708bd970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:41.705730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f0971-227d-4e92-831f-ad8b708bd970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:41.707377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f0971-227d-4e92-831f-ad8b708bd970 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:41.719704 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3610/7290] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:41.726627 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3681/7291] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:21:41 2022] POST /identity/v3/projects => generated 397 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:41.735088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f0971-227d-4e92-831f-ad8b708bd970 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:41.735945 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda7445-060b-4cb3-8408-33e9de0f6b3c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:41.749073 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f0971-227d-4e92-831f-ad8b708bd970 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:41.825502 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:41.834069 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda7445-060b-4cb3-8408-33e9de0f6b3c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:41.834276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abc55c-f876-446d-9711-6ec43ecb6a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:41.834769 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abc55c-f876-446d-9711-6ec43ecb6a0d admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:41.835100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abc55c-f876-446d-9711-6ec43ecb6a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:41.835996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abc55c-f876-446d-9711-6ec43ecb6a0d admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:41.836694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3abc55c-f876-446d-9711-6ec43ecb6a0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:41.838685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3abc55c-f876-446d-9711-6ec43ecb6a0d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:41.840688 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7562c2-9500-4163-949f-857a85d6a8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:41.841946 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7562c2-9500-4163-949f-857a85d6a8c2 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:41.842332 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7562c2-9500-4163-949f-857a85d6a8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:41.842800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7562c2-9500-4163-949f-857a85d6a8c2 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:41.843636 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7562c2-9500-4163-949f-857a85d6a8c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:41.846615 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7562c2-9500-4163-949f-857a85d6a8c2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:41.852806 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3611/7292] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:41.857146 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abc55c-f876-446d-9711-6ec43ecb6a0d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:41.874959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abc55c-f876-446d-9711-6ec43ecb6a0d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:41.878924 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3682/7293] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:21:41 2022] POST /identity/v3/users => generated 299 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:41.880816 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7562c2-9500-4163-949f-857a85d6a8c2 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:41.881669 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c7b00-d849-44bc-a8e5-0b051f78294c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:41.882865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c7b00-d849-44bc-a8e5-0b051f78294c admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:41.883311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c7b00-d849-44bc-a8e5-0b051f78294c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:41.883759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c7b00-d849-44bc-a8e5-0b051f78294c admin admin] PATH_INFO: `/v3/projects/096d48b40d054970a63041cf5c829f9d/users/d5b29f26272a4fdc8723ee775962f78b/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:41.898741 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7562c2-9500-4163-949f-857a85d6a8c2 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:41.904558 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746c7b00-d849-44bc-a8e5-0b051f78294c admin admin] RBAC: Authorizing `identity:create_grant(project_id=096d48b40d054970a63041cf5c829f9d, user_id=d5b29f26272a4fdc8723ee775962f78b, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:41.907696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746c7b00-d849-44bc-a8e5-0b051f78294c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:41.912140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaded8e2-a034-4a9a-917e-453295a89316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:41.912845 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaded8e2-a034-4a9a-917e-453295a89316 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:41.913155 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaded8e2-a034-4a9a-917e-453295a89316 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:41.913401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaded8e2-a034-4a9a-917e-453295a89316 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:41.914522 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaded8e2-a034-4a9a-917e-453295a89316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:41.916473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaded8e2-a034-4a9a-917e-453295a89316 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:41.924277 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3612/7294] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:41 2022] PUT /identity/v3/projects/096d48b40d054970a63041cf5c829f9d/users/d5b29f26272a4fdc8723ee775962f78b/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:21:41.928320 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3683/7295] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:41.932234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c7b00-d849-44bc-a8e5-0b051f78294c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:41.941412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f6142-111a-4cbf-bf04-075b741e6276 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:41.941751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f6142-111a-4cbf-bf04-075b741e6276 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:41.942031 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f6142-111a-4cbf-bf04-075b741e6276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:41.975361 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-301f6142-111a-4cbf-bf04-075b741e6276 None None] MFA Rules not processed for user `d5b29f26272a4fdc8723ee775962f78b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:41.976585 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-301f6142-111a-4cbf-bf04-075b741e6276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:42.016205 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c7b00-d849-44bc-a8e5-0b051f78294c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:42.021640 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a468ec7-89a6-4064-a5f7-444f6542f0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:42.022155 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a468ec7-89a6-4064-a5f7-444f6542f0d2 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:42.022661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a468ec7-89a6-4064-a5f7-444f6542f0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:42.022946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a468ec7-89a6-4064-a5f7-444f6542f0d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:42.023548 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a468ec7-89a6-4064-a5f7-444f6542f0d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:42.025196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a468ec7-89a6-4064-a5f7-444f6542f0d2 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:42.038608 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3613/7296] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:42.040219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a468ec7-89a6-4064-a5f7-444f6542f0d2 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:42.051565 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a468ec7-89a6-4064-a5f7-444f6542f0d2 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:42.055925 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3684/7297] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:42.060383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc99ad-4f38-4f2c-be47-7451a3243848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:42.060383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc99ad-4f38-4f2c-be47-7451a3243848 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:42.060383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc99ad-4f38-4f2c-be47-7451a3243848 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:42.060683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc99ad-4f38-4f2c-be47-7451a3243848 admin admin] PATH_INFO: `/v3/projects/fa632f6acea044ee9bdbb0da3ab88840/users/70d073ddaa5c406ea3a4311668d3b8af/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:42.070119 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f6142-111a-4cbf-bf04-075b741e6276 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:42.072338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-301f6142-111a-4cbf-bf04-075b741e6276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:42.078482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc99ad-4f38-4f2c-be47-7451a3243848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa632f6acea044ee9bdbb0da3ab88840, user_id=70d073ddaa5c406ea3a4311668d3b8af, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:42.081288 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc99ad-4f38-4f2c-be47-7451a3243848 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:42.101343 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3614/7298] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:42 2022] PUT /identity/v3/projects/fa632f6acea044ee9bdbb0da3ab88840/users/70d073ddaa5c406ea3a4311668d3b8af/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:21:42.113080 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde4f3b-e805-4248-b918-b72a4f21b752 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:42.113397 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde4f3b-e805-4248-b918-b72a4f21b752 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:42.113632 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde4f3b-e805-4248-b918-b72a4f21b752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:42.115387 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:42.144488 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-6fde4f3b-e805-4248-b918-b72a4f21b752 None None] MFA Rules not processed for user `70d073ddaa5c406ea3a4311668d3b8af`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:42.146020 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6fde4f3b-e805-4248-b918-b72a4f21b752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:42.153462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f6142-111a-4cbf-bf04-075b741e6276 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:42.215106 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3615/7299] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:42 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:42.215795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde4f3b-e805-4248-b918-b72a4f21b752 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:42.217111 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6fde4f3b-e805-4248-b918-b72a4f21b752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:42.220428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db5ec0-a85d-484c-bbf2-80dd8a00a31f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:42.221305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db5ec0-a85d-484c-bbf2-80dd8a00a31f service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:42.221657 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db5ec0-a85d-484c-bbf2-80dd8a00a31f service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:42.221989 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db5ec0-a85d-484c-bbf2-80dd8a00a31f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:42.252730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:42.287260 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db5ec0-a85d-484c-bbf2-80dd8a00a31f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:42.288700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db5ec0-a85d-484c-bbf2-80dd8a00a31f service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:42.290571 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde4f3b-e805-4248-b918-b72a4f21b752 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:42.296466 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360f095-30ef-4487-9ec6-8b1f146da892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:42.297104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360f095-30ef-4487-9ec6-8b1f146da892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:42.297386 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360f095-30ef-4487-9ec6-8b1f146da892 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:42.297713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360f095-30ef-4487-9ec6-8b1f146da892 admin admin] PATH_INFO: `/v3/projects/3a8806ae7e224ab38a578001b4f3bb71` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:42.298896 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7360f095-30ef-4487-9ec6-8b1f146da892 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a8806ae7e224ab38a578001b4f3bb71)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:42.300810 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7360f095-30ef-4487-9ec6-8b1f146da892 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:42.302062 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3685/7300] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:21:42.302987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db5ec0-a85d-484c-bbf2-80dd8a00a31f service cinder] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:42.304316 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b0db5ec0-a85d-484c-bbf2-80dd8a00a31f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:42.328734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db5ec0-a85d-484c-bbf2-80dd8a00a31f service cinder] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:42.333946 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd981749-ebf0-4506-aeb3-0ec10f7ca551 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:42.334860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd981749-ebf0-4506-aeb3-0ec10f7ca551 service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:42.335127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd981749-ebf0-4506-aeb3-0ec10f7ca551 service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:42.335518 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd981749-ebf0-4506-aeb3-0ec10f7ca551 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:42.345207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd981749-ebf0-4506-aeb3-0ec10f7ca551 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:42.346984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd981749-ebf0-4506-aeb3-0ec10f7ca551 service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:42.362973 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3686/7301] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:42 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:42.362973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd981749-ebf0-4506-aeb3-0ec10f7ca551 service cinder] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:42.363128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7360f095-30ef-4487-9ec6-8b1f146da892 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a8806ae7e224ab38a578001b4f3bb71', 'request_id': 'req-7360f095-30ef-4487-9ec6-8b1f146da892'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:42.366645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7360f095-30ef-4487-9ec6-8b1f146da892 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a8806ae7e224ab38a578001b4f3bb71', 'request_id': 'req-7360f095-30ef-4487-9ec6-8b1f146da892'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:42.373935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd981749-ebf0-4506-aeb3-0ec10f7ca551 service cinder] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:42.374752 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7360f095-30ef-4487-9ec6-8b1f146da892 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a8806ae7e224ab38a578001b4f3bb71', 'request_id': 'req-7360f095-30ef-4487-9ec6-8b1f146da892'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:42.392977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7360f095-30ef-4487-9ec6-8b1f146da892 admin admin] The token cache is being invalidate because project 3a8806ae7e224ab38a578001b4f3bb71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:21:42.393342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7360f095-30ef-4487-9ec6-8b1f146da892 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:42.394650 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7360f095-30ef-4487-9ec6-8b1f146da892 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:42.397302 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3616/7302] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:21:42 2022] DELETE /identity/v3/projects/3a8806ae7e224ab38a578001b4f3bb71 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:42.406821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966c10c-9f19-4558-a751-558f94806441 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:42.407236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966c10c-9f19-4558-a751-558f94806441 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:42.407631 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966c10c-9f19-4558-a751-558f94806441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:42.440765 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-8966c10c-9f19-4558-a751-558f94806441 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:42.442495 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8966c10c-9f19-4558-a751-558f94806441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:42.467044 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986ff8e-4a29-42ce-8ca4-4465d3fa2b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:42.468513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986ff8e-4a29-42ce-8ca4-4465d3fa2b8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:42.468869 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986ff8e-4a29-42ce-8ca4-4465d3fa2b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:42.469242 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986ff8e-4a29-42ce-8ca4-4465d3fa2b8e admin admin] PATH_INFO: `/v3/users/d5b29f26272a4fdc8723ee775962f78b` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:42.471593 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986ff8e-4a29-42ce-8ca4-4465d3fa2b8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5b29f26272a4fdc8723ee775962f78b)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:42.478509 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986ff8e-4a29-42ce-8ca4-4465d3fa2b8e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:42.519845 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3617/7303] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:42.540976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:42.548905 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ea9b5-02c8-4160-b56e-3d7d910bb79e None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:42.549352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ea9b5-02c8-4160-b56e-3d7d910bb79e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:42.551649 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ea9b5-02c8-4160-b56e-3d7d910bb79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:42.570492 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8986ff8e-4a29-42ce-8ca4-4465d3fa2b8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5b29f26272a4fdc8723ee775962f78b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:42.593971 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-928ea9b5-02c8-4160-b56e-3d7d910bb79e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:42.595380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-928ea9b5-02c8-4160-b56e-3d7d910bb79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:42.597110 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8986ff8e-4a29-42ce-8ca4-4465d3fa2b8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5b29f26272a4fdc8723ee775962f78b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:42.599124 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8986ff8e-4a29-42ce-8ca4-4465d3fa2b8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5b29f26272a4fdc8723ee775962f78b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:42.602300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8986ff8e-4a29-42ce-8ca4-4465d3fa2b8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5b29f26272a4fdc8723ee775962f78b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:42.611186 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3618/7304] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:42.612407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928ea9b5-02c8-4160-b56e-3d7d910bb79e None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:42.622337 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8986ff8e-4a29-42ce-8ca4-4465d3fa2b8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5b29f26272a4fdc8723ee775962f78b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:42.625265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928ea9b5-02c8-4160-b56e-3d7d910bb79e None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:42.630919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08120b86-5380-4b07-a460-4898abc17c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:42.632293 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08120b86-5380-4b07-a460-4898abc17c04 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:42.632755 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08120b86-5380-4b07-a460-4898abc17c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:42.633323 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08120b86-5380-4b07-a460-4898abc17c04 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:42.634332 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08120b86-5380-4b07-a460-4898abc17c04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:21:42.634929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08120b86-5380-4b07-a460-4898abc17c04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:42.637177 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08120b86-5380-4b07-a460-4898abc17c04 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:42.655437 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3619/7305] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:21:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:21:42.660507 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08120b86-5380-4b07-a460-4898abc17c04 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:42.660961 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3687/7306] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:21:42 2022] DELETE /identity/v3/users/d5b29f26272a4fdc8723ee775962f78b => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:42.674221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08120b86-5380-4b07-a460-4898abc17c04 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:42.687192 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0dcae-166e-454f-a2da-2f4f35225288 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:42.687192 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0dcae-166e-454f-a2da-2f4f35225288 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:42.687477 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0dcae-166e-454f-a2da-2f4f35225288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:42.735872 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-06f0dcae-166e-454f-a2da-2f4f35225288 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:42.737090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-06f0dcae-166e-454f-a2da-2f4f35225288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:42.742995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:42.815102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727ac40-3c47-4589-8544-230cb6454aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:42.819267 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727ac40-3c47-4589-8544-230cb6454aa1 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:42.821025 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727ac40-3c47-4589-8544-230cb6454aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:42.821472 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727ac40-3c47-4589-8544-230cb6454aa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:42.822268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e727ac40-3c47-4589-8544-230cb6454aa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:42.826578 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e727ac40-3c47-4589-8544-230cb6454aa1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:42.883818 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3688/7307] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:42.889920 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3620/7308] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:21:42 2022] POST /identity/v3/projects => generated 377 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:42.899896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0dcae-166e-454f-a2da-2f4f35225288 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:42.900070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727ac40-3c47-4589-8544-230cb6454aa1 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:42.903463 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e727ac40-3c47-4589-8544-230cb6454aa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:42.915009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0dcae-166e-454f-a2da-2f4f35225288 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:43.044068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92950b-3a0f-4c4f-9f62-fc06fdf963ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:43.044823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92950b-3a0f-4c4f-9f62-fc06fdf963ce admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:43.045353 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92950b-3a0f-4c4f-9f62-fc06fdf963ce admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:43.046489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92950b-3a0f-4c4f-9f62-fc06fdf963ce admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:43.047459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92950b-3a0f-4c4f-9f62-fc06fdf963ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:43.051820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92950b-3a0f-4c4f-9f62-fc06fdf963ce admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:43.075355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727ac40-3c47-4589-8544-230cb6454aa1 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:43.083665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052400c-166a-497b-b8c6-b835c871d83c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:43.084645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052400c-166a-497b-b8c6-b835c871d83c service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:43.085438 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052400c-166a-497b-b8c6-b835c871d83c service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:43.089886 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052400c-166a-497b-b8c6-b835c871d83c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:43.101452 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3689/7309] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:21:42 2022] POST /identity/v3/users => generated 289 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:43.103984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92950b-3a0f-4c4f-9f62-fc06fdf963ce admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:43.115688 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c052400c-166a-497b-b8c6-b835c871d83c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:43.117791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c052400c-166a-497b-b8c6-b835c871d83c service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:43.126711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92950b-3a0f-4c4f-9f62-fc06fdf963ce admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:43.153755 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3493968-3eaa-47c9-bf9c-d89018eb87a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:43.155206 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3493968-3eaa-47c9-bf9c-d89018eb87a3 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:43.156490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3493968-3eaa-47c9-bf9c-d89018eb87a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:43.156490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3493968-3eaa-47c9-bf9c-d89018eb87a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:43.171346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3493968-3eaa-47c9-bf9c-d89018eb87a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:43.172566 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3621/7310] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:43.176085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3493968-3eaa-47c9-bf9c-d89018eb87a3 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:43.190446 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3690/7311] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:43.195363 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052400c-166a-497b-b8c6-b835c871d83c service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:43.216635 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052400c-166a-497b-b8c6-b835c871d83c service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:43.228565 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ded926-0efb-43f0-afa3-1a08f84b4713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:43.229357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ded926-0efb-43f0-afa3-1a08f84b4713 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:43.230481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ded926-0efb-43f0-afa3-1a08f84b4713 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:43.231074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ded926-0efb-43f0-afa3-1a08f84b4713 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:43.231839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ded926-0efb-43f0-afa3-1a08f84b4713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:43.234118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ded926-0efb-43f0-afa3-1a08f84b4713 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:43.274439 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3622/7312] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:43.281564 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3493968-3eaa-47c9-bf9c-d89018eb87a3 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:43.295541 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3493968-3eaa-47c9-bf9c-d89018eb87a3 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:43.305295 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3becc8e-5739-4f28-85ba-1165005029ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:43.306501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3becc8e-5739-4f28-85ba-1165005029ad admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:43.306958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3becc8e-5739-4f28-85ba-1165005029ad admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:43.307532 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3becc8e-5739-4f28-85ba-1165005029ad admin admin] PATH_INFO: `/v3/projects/3663b13dd84f4d87954147b0fea50778/users/0388449c508e47c4a90a6131b8dc0997/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:43.329268 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3becc8e-5739-4f28-85ba-1165005029ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=3663b13dd84f4d87954147b0fea50778, user_id=0388449c508e47c4a90a6131b8dc0997, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:43.332104 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3becc8e-5739-4f28-85ba-1165005029ad admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:43.345145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:43.352872 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3691/7313] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:43 2022] PUT /identity/v3/projects/3663b13dd84f4d87954147b0fea50778/users/0388449c508e47c4a90a6131b8dc0997/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:43.368520 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0babc-16cb-492b-bfab-e85a7cafe282 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:43.369127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0babc-16cb-492b-bfab-e85a7cafe282 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:43.369562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0babc-16cb-492b-bfab-e85a7cafe282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:43.422071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-68a0babc-16cb-492b-bfab-e85a7cafe282 None None] MFA Rules not processed for user `0388449c508e47c4a90a6131b8dc0997`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:43.424173 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-68a0babc-16cb-492b-bfab-e85a7cafe282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:43.518010 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3623/7314] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:43.523028 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3becc8e-5739-4f28-85ba-1165005029ad admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:43.594034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0babc-16cb-492b-bfab-e85a7cafe282 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:43.595699 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-68a0babc-16cb-492b-bfab-e85a7cafe282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:43.610442 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3becc8e-5739-4f28-85ba-1165005029ad admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:43.614952 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0babc-16cb-492b-bfab-e85a7cafe282 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:43.619805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0015cc-a077-4811-b793-830666942dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:43.621189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0015cc-a077-4811-b793-830666942dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:43.621546 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0015cc-a077-4811-b793-830666942dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:43.621891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0015cc-a077-4811-b793-830666942dc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:43.622027 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6b434-c551-48a3-bffa-95f1562bc3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:43.622731 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6b434-c551-48a3-bffa-95f1562bc3cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:43.622850 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0015cc-a077-4811-b793-830666942dc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:43.623169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6b434-c551-48a3-bffa-95f1562bc3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:43.623444 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6b434-c551-48a3-bffa-95f1562bc3cd admin admin] PATH_INFO: `/v3/projects/096d48b40d054970a63041cf5c829f9d` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:43.624678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a6b434-c551-48a3-bffa-95f1562bc3cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=096d48b40d054970a63041cf5c829f9d)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:43.626748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a6b434-c551-48a3-bffa-95f1562bc3cd admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:43.637219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0015cc-a077-4811-b793-830666942dc4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:43.676320 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3692/7315] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:21:43 2022] POST /identity/v3/projects => generated 377 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:43.681057 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0015cc-a077-4811-b793-830666942dc4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:43.684931 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:43.691248 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-28a6b434-c551-48a3-bffa-95f1562bc3cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '096d48b40d054970a63041cf5c829f9d', 'request_id': 'req-28a6b434-c551-48a3-bffa-95f1562bc3cd'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:43.699444 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-28a6b434-c551-48a3-bffa-95f1562bc3cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '096d48b40d054970a63041cf5c829f9d', 'request_id': 'req-28a6b434-c551-48a3-bffa-95f1562bc3cd'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:43.708816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-28a6b434-c551-48a3-bffa-95f1562bc3cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '096d48b40d054970a63041cf5c829f9d', 'request_id': 'req-28a6b434-c551-48a3-bffa-95f1562bc3cd'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:43.725755 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-28a6b434-c551-48a3-bffa-95f1562bc3cd admin admin] The token cache is being invalidate because project 096d48b40d054970a63041cf5c829f9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:21:43.726188 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-28a6b434-c551-48a3-bffa-95f1562bc3cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:43.726871 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-28a6b434-c551-48a3-bffa-95f1562bc3cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:43.728385 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3624/7316] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:21:43 2022] DELETE /identity/v3/projects/096d48b40d054970a63041cf5c829f9d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:21:43.734451 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ed8a9-6254-4ea4-b273-5b9fd0926dc7 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:43.734767 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ed8a9-6254-4ea4-b273-5b9fd0926dc7 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:43.735048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ed8a9-6254-4ea4-b273-5b9fd0926dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:43.759030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-454ed8a9-6254-4ea4-b273-5b9fd0926dc7 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:43.760257 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-454ed8a9-6254-4ea4-b273-5b9fd0926dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:43.772764 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0015cc-a077-4811-b793-830666942dc4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:43.778480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52895ad5-a522-4d49-af10-bd572c71a484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:43.779125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52895ad5-a522-4d49-af10-bd572c71a484 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:43.779405 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52895ad5-a522-4d49-af10-bd572c71a484 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:43.779683 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52895ad5-a522-4d49-af10-bd572c71a484 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:43.780335 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52895ad5-a522-4d49-af10-bd572c71a484 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:43.782354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52895ad5-a522-4d49-af10-bd572c71a484 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:43.803910 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3693/7317] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:21:43 2022] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:43.807719 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52895ad5-a522-4d49-af10-bd572c71a484 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:43.809321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-52895ad5-a522-4d49-af10-bd572c71a484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:43.821902 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52895ad5-a522-4d49-af10-bd572c71a484 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:43.827504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f38e10-7797-4d25-898e-a47f2399121b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:43.828272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f38e10-7797-4d25-898e-a47f2399121b admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:43.828560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f38e10-7797-4d25-898e-a47f2399121b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:43.828836 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f38e10-7797-4d25-898e-a47f2399121b admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:43.829474 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f38e10-7797-4d25-898e-a47f2399121b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:43.831168 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f38e10-7797-4d25-898e-a47f2399121b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:43.832877 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3625/7318] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:43.840466 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e4b69-7b28-495f-8738-a15c07d102a7 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:43.840747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e4b69-7b28-495f-8738-a15c07d102a7 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:43.841027 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e4b69-7b28-495f-8738-a15c07d102a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:43.847234 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3694/7319] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:21:43.851106 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f38e10-7797-4d25-898e-a47f2399121b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:43.861413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f38e10-7797-4d25-898e-a47f2399121b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:43.861795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-963e4b69-7b28-495f-8738-a15c07d102a7 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:43.863022 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-963e4b69-7b28-495f-8738-a15c07d102a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:43.866081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e10922-565b-41c5-be1c-a30e491e4128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:43.866713 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e10922-565b-41c5-be1c-a30e491e4128 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:43.867004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e10922-565b-41c5-be1c-a30e491e4128 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:43.867285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e10922-565b-41c5-be1c-a30e491e4128 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:43.867919 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e10922-565b-41c5-be1c-a30e491e4128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:43.869493 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e10922-565b-41c5-be1c-a30e491e4128 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:43.874717 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3626/7320] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:43.875671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e4b69-7b28-495f-8738-a15c07d102a7 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:43.880379 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3695/7321] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:21:43.884735 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e4b69-7b28-495f-8738-a15c07d102a7 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:43.884870 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e10922-565b-41c5-be1c-a30e491e4128 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:43.890404 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9992767-2c2b-49c6-a095-cd196c2aaf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:43.891035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9992767-2c2b-49c6-a095-cd196c2aaf9a admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:43.891322 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9992767-2c2b-49c6-a095-cd196c2aaf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:43.891623 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9992767-2c2b-49c6-a095-cd196c2aaf9a admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:43.892268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9992767-2c2b-49c6-a095-cd196c2aaf9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:21:43.892570 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9992767-2c2b-49c6-a095-cd196c2aaf9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:43.894176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9992767-2c2b-49c6-a095-cd196c2aaf9a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:43.895031 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e10922-565b-41c5-be1c-a30e491e4128 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:43.899671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857c166-f8a8-4687-a598-659586b9bf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:43.900299 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857c166-f8a8-4687-a598-659586b9bf96 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:43.900577 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857c166-f8a8-4687-a598-659586b9bf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:43.900850 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857c166-f8a8-4687-a598-659586b9bf96 admin admin] PATH_INFO: `/v3/projects/a504b66cd8b2411bb499dab1cc90ed23/users/5d8d95fb9e35405882995ab4daf9f3bb/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:43.906488 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3627/7322] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:21:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:21:43.910481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9992767-2c2b-49c6-a095-cd196c2aaf9a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:43.917286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4857c166-f8a8-4687-a598-659586b9bf96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a504b66cd8b2411bb499dab1cc90ed23, user_id=5d8d95fb9e35405882995ab4daf9f3bb, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:43.920448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4857c166-f8a8-4687-a598-659586b9bf96 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:43.924205 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9992767-2c2b-49c6-a095-cd196c2aaf9a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:43.929390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863846aa-7921-4061-bad5-c303a789f5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:43.930352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863846aa-7921-4061-bad5-c303a789f5c3 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:43.930690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863846aa-7921-4061-bad5-c303a789f5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:43.931070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863846aa-7921-4061-bad5-c303a789f5c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:43.931906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863846aa-7921-4061-bad5-c303a789f5c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:43.934989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863846aa-7921-4061-bad5-c303a789f5c3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:43.940923 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3696/7323] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:43 2022] PUT /identity/v3/projects/a504b66cd8b2411bb499dab1cc90ed23/users/5d8d95fb9e35405882995ab4daf9f3bb/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:43.953154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe44942-cabd-4178-86f3-79e4d225705c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:43.953442 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe44942-cabd-4178-86f3-79e4d225705c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:43.953722 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe44942-cabd-4178-86f3-79e4d225705c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:43.970631 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3628/7324] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:21:43 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:21:43.975425 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863846aa-7921-4061-bad5-c303a789f5c3 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:43.993008 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-6fe44942-cabd-4178-86f3-79e4d225705c None None] MFA Rules not processed for user `5d8d95fb9e35405882995ab4daf9f3bb`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:43.994267 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6fe44942-cabd-4178-86f3-79e4d225705c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:44.021023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:44.074570 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863846aa-7921-4061-bad5-c303a789f5c3 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:44.080776 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3697/7325] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:44.080926 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3063d21-fbbe-4f12-8f1b-575ad09d53b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:44.081454 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3063d21-fbbe-4f12-8f1b-575ad09d53b9 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:44.081769 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3063d21-fbbe-4f12-8f1b-575ad09d53b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:44.082043 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3063d21-fbbe-4f12-8f1b-575ad09d53b9 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:44.082763 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3063d21-fbbe-4f12-8f1b-575ad09d53b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:44.084836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3063d21-fbbe-4f12-8f1b-575ad09d53b9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:44.085303 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe44942-cabd-4178-86f3-79e4d225705c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:44.099094 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe44942-cabd-4178-86f3-79e4d225705c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:44.109742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c94d88-a35a-4442-8b21-83c55bb4cff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:44.110787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c94d88-a35a-4442-8b21-83c55bb4cff3 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:44.111307 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c94d88-a35a-4442-8b21-83c55bb4cff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:44.111631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c94d88-a35a-4442-8b21-83c55bb4cff3 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:44.112706 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c94d88-a35a-4442-8b21-83c55bb4cff3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:44.112824 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3629/7326] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:21:43 2022] POST /identity/v3/users => generated 287 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:21:44.114129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3063d21-fbbe-4f12-8f1b-575ad09d53b9 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:44.115697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c94d88-a35a-4442-8b21-83c55bb4cff3 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:44.126052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3063d21-fbbe-4f12-8f1b-575ad09d53b9 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:44.133325 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e1876-0ccd-4191-b3b2-fdd7ef43deb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:44.134078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e1876-0ccd-4191-b3b2-fdd7ef43deb2 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:44.134361 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e1876-0ccd-4191-b3b2-fdd7ef43deb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:44.134672 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e1876-0ccd-4191-b3b2-fdd7ef43deb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:44.135323 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e1876-0ccd-4191-b3b2-fdd7ef43deb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:44.137116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e1876-0ccd-4191-b3b2-fdd7ef43deb2 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:44.149449 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3630/7327] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:44.154386 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e1876-0ccd-4191-b3b2-fdd7ef43deb2 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:44.164943 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3698/7328] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:21:44 2022] POST /identity/v3/projects => generated 375 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:21:44.170049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e1876-0ccd-4191-b3b2-fdd7ef43deb2 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:44.170487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c94d88-a35a-4442-8b21-83c55bb4cff3 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:44.175703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:44.287770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff5e21-7b99-4b08-b8be-54946ced4b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:44.290064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff5e21-7b99-4b08-b8be-54946ced4b22 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:44.290444 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff5e21-7b99-4b08-b8be-54946ced4b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:44.297192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff5e21-7b99-4b08-b8be-54946ced4b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:44.299735 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff5e21-7b99-4b08-b8be-54946ced4b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:44.301528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff5e21-7b99-4b08-b8be-54946ced4b22 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:44.305531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c94d88-a35a-4442-8b21-83c55bb4cff3 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:44.332395 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3631/7329] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:44.333257 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff5e21-7b99-4b08-b8be-54946ced4b22 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:44.336478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0bff5e21-7b99-4b08-b8be-54946ced4b22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:44.337116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe698a5-a3d4-491e-bad6-7c52bf737674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:44.337744 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe698a5-a3d4-491e-bad6-7c52bf737674 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:44.338026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe698a5-a3d4-491e-bad6-7c52bf737674 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:44.338318 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe698a5-a3d4-491e-bad6-7c52bf737674 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:44.339554 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe698a5-a3d4-491e-bad6-7c52bf737674 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:44.341790 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe698a5-a3d4-491e-bad6-7c52bf737674 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:44.373769 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff5e21-7b99-4b08-b8be-54946ced4b22 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:44.373925 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3699/7330] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:21:44 2022] POST /identity/v3/users => generated 294 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:44.374704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe698a5-a3d4-491e-bad6-7c52bf737674 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:44.390908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe698a5-a3d4-491e-bad6-7c52bf737674 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:44.396211 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a35f3-c243-459b-944b-34d6de3675d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:44.396862 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a35f3-c243-459b-944b-34d6de3675d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:44.397050 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aabf74-e24e-4bd2-a149-cd23f8a46aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:44.397212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a35f3-c243-459b-944b-34d6de3675d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:44.397530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a35f3-c243-459b-944b-34d6de3675d4 admin admin] PATH_INFO: `/v3/users/9e43dc88da334346b2f097d3a29646b1` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:44.397836 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aabf74-e24e-4bd2-a149-cd23f8a46aef admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:44.398234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aabf74-e24e-4bd2-a149-cd23f8a46aef admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:44.398526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aabf74-e24e-4bd2-a149-cd23f8a46aef admin admin] PATH_INFO: `/v3/projects/2c91f85759d6422ebf57d9c7258d09e8/users/c42c4a8438ea4349bac43e6a250d548b/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:44.398739 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a35f3-c243-459b-944b-34d6de3675d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e43dc88da334346b2f097d3a29646b1)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:44.401818 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a35f3-c243-459b-944b-34d6de3675d4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:44.419913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aabf74-e24e-4bd2-a149-cd23f8a46aef admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c91f85759d6422ebf57d9c7258d09e8, user_id=c42c4a8438ea4349bac43e6a250d548b, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:44.423228 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aabf74-e24e-4bd2-a149-cd23f8a46aef admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:44.450770 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3700/7331] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:44 2022] PUT /identity/v3/projects/2c91f85759d6422ebf57d9c7258d09e8/users/c42c4a8438ea4349bac43e6a250d548b/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:44.451987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aabf74-e24e-4bd2-a149-cd23f8a46aef admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:44.508279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-298a35f3-c243-459b-944b-34d6de3675d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e43dc88da334346b2f097d3a29646b1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:44.509637 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-298a35f3-c243-459b-944b-34d6de3675d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e43dc88da334346b2f097d3a29646b1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:44.510191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-298a35f3-c243-459b-944b-34d6de3675d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e43dc88da334346b2f097d3a29646b1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:44.545333 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-298a35f3-c243-459b-944b-34d6de3675d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e43dc88da334346b2f097d3a29646b1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:44.552037 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aabf74-e24e-4bd2-a149-cd23f8a46aef admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:44.558849 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba88805-b285-4e9a-ace5-092103f9a9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:44.561384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba88805-b285-4e9a-ace5-092103f9a9a5 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:44.561669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba88805-b285-4e9a-ace5-092103f9a9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:44.561959 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba88805-b285-4e9a-ace5-092103f9a9a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:44.562634 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba88805-b285-4e9a-ace5-092103f9a9a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:44.564311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba88805-b285-4e9a-ace5-092103f9a9a5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:44.564434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-298a35f3-c243-459b-944b-34d6de3675d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e43dc88da334346b2f097d3a29646b1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:44.567396 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:44.582240 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3632/7332] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:21:44 2022] DELETE /identity/v3/users/9e43dc88da334346b2f097d3a29646b1 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:44.588879 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3701/7333] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:44.588988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccfb42-d4ea-4450-a7e4-e4fac14504b4 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:44.588988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccfb42-d4ea-4450-a7e4-e4fac14504b4 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:44.588988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccfb42-d4ea-4450-a7e4-e4fac14504b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:44.589275 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7604a23-583f-48e8-82f5-61af43d6c873 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:44.589275 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7604a23-583f-48e8-82f5-61af43d6c873 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:44.589275 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7604a23-583f-48e8-82f5-61af43d6c873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:44.619705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-e6ccfb42-d4ea-4450-a7e4-e4fac14504b4 None None] MFA Rules not processed for user `c42c4a8438ea4349bac43e6a250d548b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:44.626458 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e6ccfb42-d4ea-4450-a7e4-e4fac14504b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:44.626612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-e7604a23-583f-48e8-82f5-61af43d6c873 None None] MFA Rules not processed for user `e63fbea26373463f8e97bd38a0bc6688`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:44.626612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e7604a23-583f-48e8-82f5-61af43d6c873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:44.709693 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3633/7334] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:44.710756 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3702/7335] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:44 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:44.711667 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7604a23-583f-48e8-82f5-61af43d6c873 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:44.714589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ae48e-79f0-4a39-a071-b866b0375788 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:44.714589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ae48e-79f0-4a39-a071-b866b0375788 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:44.714589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ae48e-79f0-4a39-a071-b866b0375788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:44.716121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e7604a23-583f-48e8-82f5-61af43d6c873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:44.734331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:44.749394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-138ae48e-79f0-4a39-a071-b866b0375788 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:44.750632 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-138ae48e-79f0-4a39-a071-b866b0375788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:44.808425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7604a23-583f-48e8-82f5-61af43d6c873 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:44.813216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592436d-7464-43d7-b0b3-1e487aee54fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:44.813873 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592436d-7464-43d7-b0b3-1e487aee54fb admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:44.814134 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592436d-7464-43d7-b0b3-1e487aee54fb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:44.814411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592436d-7464-43d7-b0b3-1e487aee54fb admin admin] PATH_INFO: `/v3/projects/bc3d05e8e7d94c61b269fd7393ebcd1d/users/5f40bb42a8c94eca9452d67fba3ef99f/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:44.822417 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3634/7336] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:44.827233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ae48e-79f0-4a39-a071-b866b0375788 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:44.829266 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-138ae48e-79f0-4a39-a071-b866b0375788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:44.830266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592436d-7464-43d7-b0b3-1e487aee54fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc3d05e8e7d94c61b269fd7393ebcd1d, user_id=5f40bb42a8c94eca9452d67fba3ef99f, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:44.833205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592436d-7464-43d7-b0b3-1e487aee54fb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:44.841453 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ae48e-79f0-4a39-a071-b866b0375788 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:44.846989 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3703/7337] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:44 2022] PUT /identity/v3/projects/bc3d05e8e7d94c61b269fd7393ebcd1d/users/5f40bb42a8c94eca9452d67fba3ef99f/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:44.848261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa17612-4161-4e9b-ab59-b56bc4fc6794 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:44.848539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa17612-4161-4e9b-ab59-b56bc4fc6794 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:44.848809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa17612-4161-4e9b-ab59-b56bc4fc6794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:44.868473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-7aa17612-4161-4e9b-ab59-b56bc4fc6794 None None] MFA Rules not processed for user `e63fbea26373463f8e97bd38a0bc6688`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:44.869673 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7aa17612-4161-4e9b-ab59-b56bc4fc6794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:44.903591 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e03ea-056b-495d-9b4d-f2be31c0853e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:44.904202 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e03ea-056b-495d-9b4d-f2be31c0853e admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:44.904485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e03ea-056b-495d-9b4d-f2be31c0853e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:44.904759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e03ea-056b-495d-9b4d-f2be31c0853e admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:44.905370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e03ea-056b-495d-9b4d-f2be31c0853e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:44.907333 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e03ea-056b-495d-9b4d-f2be31c0853e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:44.926849 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3704/7338] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:44 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:44.927787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa17612-4161-4e9b-ab59-b56bc4fc6794 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:44.929042 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7aa17612-4161-4e9b-ab59-b56bc4fc6794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:44.940268 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3635/7339] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:21:44 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:44.941158 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e03ea-056b-495d-9b4d-f2be31c0853e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:44.981021 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:45.008269 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa17612-4161-4e9b-ab59-b56bc4fc6794 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:45.016339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e03ea-056b-495d-9b4d-f2be31c0853e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:45.021008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9601e11-c198-4304-b0f6-1df19a07c580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:45.021608 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9601e11-c198-4304-b0f6-1df19a07c580 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:45.021884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9601e11-c198-4304-b0f6-1df19a07c580 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:45.022156 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9601e11-c198-4304-b0f6-1df19a07c580 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:45.022827 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9601e11-c198-4304-b0f6-1df19a07c580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:45.024457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9601e11-c198-4304-b0f6-1df19a07c580 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:45.035215 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3636/7340] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:45.036089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9601e11-c198-4304-b0f6-1df19a07c580 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:45.046379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9601e11-c198-4304-b0f6-1df19a07c580 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:45.051502 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28b1fe-cdb7-4a10-8a5c-4624651b5ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:45.051900 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28b1fe-cdb7-4a10-8a5c-4624651b5ec5 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:45.052203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28b1fe-cdb7-4a10-8a5c-4624651b5ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:45.052463 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28b1fe-cdb7-4a10-8a5c-4624651b5ec5 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:45.053075 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f28b1fe-cdb7-4a10-8a5c-4624651b5ec5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:45.055153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f28b1fe-cdb7-4a10-8a5c-4624651b5ec5 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:45.060819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad6386-0751-434a-a0b7-ce753b7452fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:45.061423 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad6386-0751-434a-a0b7-ce753b7452fd service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:45.061727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad6386-0751-434a-a0b7-ce753b7452fd service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:45.061996 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad6386-0751-434a-a0b7-ce753b7452fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:45.072688 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad6386-0751-434a-a0b7-ce753b7452fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:45.074858 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad6386-0751-434a-a0b7-ce753b7452fd service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:45.080816 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3637/7341] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:21:45 2022] POST /identity/v3/users => generated 293 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:45.080816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b83e7-98fd-47a3-8111-982cdd7b13c8 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:45.080816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b83e7-98fd-47a3-8111-982cdd7b13c8 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:45.080816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b83e7-98fd-47a3-8111-982cdd7b13c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:45.085030 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3705/7342] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:45.085876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad6386-0751-434a-a0b7-ce753b7452fd service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:45.095449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad6386-0751-434a-a0b7-ce753b7452fd service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:45.099743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-0f7b83e7-98fd-47a3-8111-982cdd7b13c8 None None] MFA Rules not processed for user `e63fbea26373463f8e97bd38a0bc6688`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:45.100779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9049a89-4bf3-4c53-8f42-dd87893c1bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:45.100994 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0f7b83e7-98fd-47a3-8111-982cdd7b13c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:45.101625 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9049a89-4bf3-4c53-8f42-dd87893c1bac admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:45.102335 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9049a89-4bf3-4c53-8f42-dd87893c1bac admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:45.102670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9049a89-4bf3-4c53-8f42-dd87893c1bac admin admin] PATH_INFO: `/v3/projects/bc3d05e8e7d94c61b269fd7393ebcd1d/users/5f40bb42a8c94eca9452d67fba3ef99f/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:45.105235 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9049a89-4bf3-4c53-8f42-dd87893c1bac admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc3d05e8e7d94c61b269fd7393ebcd1d, user_id=5f40bb42a8c94eca9452d67fba3ef99f, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:45.107116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:45.108264 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9049a89-4bf3-4c53-8f42-dd87893c1bac admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:45.119377 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3706/7343] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:45 2022] PUT /identity/v3/projects/bc3d05e8e7d94c61b269fd7393ebcd1d/users/5f40bb42a8c94eca9452d67fba3ef99f/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:45.120888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9049a89-4bf3-4c53-8f42-dd87893c1bac admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:45.172337 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3638/7344] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:45 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:45.173867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179308b3-4efc-44bf-a1dd-e097b73045d0 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:45.174156 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179308b3-4efc-44bf-a1dd-e097b73045d0 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:45.174430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179308b3-4efc-44bf-a1dd-e097b73045d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:45.207726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-179308b3-4efc-44bf-a1dd-e097b73045d0 None None] MFA Rules not processed for user `5f40bb42a8c94eca9452d67fba3ef99f`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:45.209614 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-179308b3-4efc-44bf-a1dd-e097b73045d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:45.212584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9049a89-4bf3-4c53-8f42-dd87893c1bac admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:45.218231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668508fd-bb31-4756-8701-9221e1c20fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:45.218872 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668508fd-bb31-4756-8701-9221e1c20fab admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:45.219180 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668508fd-bb31-4756-8701-9221e1c20fab admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:45.219430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668508fd-bb31-4756-8701-9221e1c20fab admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:45.220556 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668508fd-bb31-4756-8701-9221e1c20fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:45.221764 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668508fd-bb31-4756-8701-9221e1c20fab admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:45.233237 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3707/7345] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:45.234268 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981c4c8-3692-4420-a016-c532b667706c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:45.234580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981c4c8-3692-4420-a016-c532b667706c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:45.234992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981c4c8-3692-4420-a016-c532b667706c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:45.255218 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-2981c4c8-3692-4420-a016-c532b667706c None None] MFA Rules not processed for user `e63fbea26373463f8e97bd38a0bc6688`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:45.256453 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2981c4c8-3692-4420-a016-c532b667706c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:45.299045 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3639/7346] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:45.300719 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179308b3-4efc-44bf-a1dd-e097b73045d0 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:45.315628 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179308b3-4efc-44bf-a1dd-e097b73045d0 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:45.321535 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bbdcb-853b-4327-9f7d-f3d8c0ca7707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:45.322609 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bbdcb-853b-4327-9f7d-f3d8c0ca7707 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:45.322985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bbdcb-853b-4327-9f7d-f3d8c0ca7707 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:45.323515 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bbdcb-853b-4327-9f7d-f3d8c0ca7707 admin admin] PATH_INFO: `/v3/projects/c6b8d9eb6e844b00ab2f6166325a38e6/users/1e42d4c88f4343d886d7f1c8abfda0c7/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:45.323910 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3708/7347] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:45 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:45.324786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981c4c8-3692-4420-a016-c532b667706c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:45.326158 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2981c4c8-3692-4420-a016-c532b667706c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:45.348083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4bbdcb-853b-4327-9f7d-f3d8c0ca7707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6b8d9eb6e844b00ab2f6166325a38e6, user_id=1e42d4c88f4343d886d7f1c8abfda0c7, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:45.348618 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:45.355964 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4bbdcb-853b-4327-9f7d-f3d8c0ca7707 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:45.375970 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3640/7348] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:45 2022] PUT /identity/v3/projects/c6b8d9eb6e844b00ab2f6166325a38e6/users/1e42d4c88f4343d886d7f1c8abfda0c7/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:45.377892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203eb39-9cd9-4791-98d7-dd22408a6b79 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:45.378321 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203eb39-9cd9-4791-98d7-dd22408a6b79 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:45.378917 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203eb39-9cd9-4791-98d7-dd22408a6b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:45.404726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-8203eb39-9cd9-4791-98d7-dd22408a6b79 None None] MFA Rules not processed for user `e63fbea26373463f8e97bd38a0bc6688`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:45.407819 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8203eb39-9cd9-4791-98d7-dd22408a6b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:45.418085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981c4c8-3692-4420-a016-c532b667706c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:45.469758 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3641/7349] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:45 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:45.470659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203eb39-9cd9-4791-98d7-dd22408a6b79 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:45.477715 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874aee9c-1034-4fc0-bf32-99acacb3b8a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:45.478428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874aee9c-1034-4fc0-bf32-99acacb3b8a4 service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:45.478813 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874aee9c-1034-4fc0-bf32-99acacb3b8a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:45.479156 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874aee9c-1034-4fc0-bf32-99acacb3b8a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:45.482052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-874aee9c-1034-4fc0-bf32-99acacb3b8a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:45.525056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:45.567518 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874aee9c-1034-4fc0-bf32-99acacb3b8a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:45.569009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874aee9c-1034-4fc0-bf32-99acacb3b8a4 service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:45.579293 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203eb39-9cd9-4791-98d7-dd22408a6b79 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:45.579489 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3709/7350] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:45.580611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874aee9c-1034-4fc0-bf32-99acacb3b8a4 service cinder] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:45.581577 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-874aee9c-1034-4fc0-bf32-99acacb3b8a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:45.586573 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc93171-772f-4952-8127-9c77e5d5729b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:45.587439 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc93171-772f-4952-8127-9c77e5d5729b admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:45.587882 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc93171-772f-4952-8127-9c77e5d5729b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:45.588475 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc93171-772f-4952-8127-9c77e5d5729b admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:45.590744 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc93171-772f-4952-8127-9c77e5d5729b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:45.594062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc93171-772f-4952-8127-9c77e5d5729b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:45.596443 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874aee9c-1034-4fc0-bf32-99acacb3b8a4 service cinder] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:45.602848 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683085fb-ccc0-4c6c-be16-912a7625d269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:45.603632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683085fb-ccc0-4c6c-be16-912a7625d269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:45.603917 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683085fb-ccc0-4c6c-be16-912a7625d269 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:45.604190 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683085fb-ccc0-4c6c-be16-912a7625d269 admin admin] PATH_INFO: `/v3/projects/cd5da91b469e4b96a736fb25a6d30d4c` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:45.605718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683085fb-ccc0-4c6c-be16-912a7625d269 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd5da91b469e4b96a736fb25a6d30d4c)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:45.610625 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683085fb-ccc0-4c6c-be16-912a7625d269 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:45.611105 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3642/7351] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:45.612530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc93171-772f-4952-8127-9c77e5d5729b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:45.632613 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc93171-772f-4952-8127-9c77e5d5729b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:45.640293 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c6c1d-4a7c-401a-9e61-0a3ad89d8c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:45.640968 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c6c1d-4a7c-401a-9e61-0a3ad89d8c98 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:45.641248 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c6c1d-4a7c-401a-9e61-0a3ad89d8c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:45.641522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c6c1d-4a7c-401a-9e61-0a3ad89d8c98 admin admin] PATH_INFO: `/v3/projects/c6b8d9eb6e844b00ab2f6166325a38e6/users/1e42d4c88f4343d886d7f1c8abfda0c7/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:45.644061 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c6c1d-4a7c-401a-9e61-0a3ad89d8c98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6b8d9eb6e844b00ab2f6166325a38e6, user_id=1e42d4c88f4343d886d7f1c8abfda0c7, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:45.647663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c6c1d-4a7c-401a-9e61-0a3ad89d8c98 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:45.677555 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3643/7352] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:45 2022] PUT /identity/v3/projects/c6b8d9eb6e844b00ab2f6166325a38e6/users/1e42d4c88f4343d886d7f1c8abfda0c7/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:45.679685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f308af0-845c-449c-8695-1fc190e308d6 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:45.679832 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f308af0-845c-449c-8695-1fc190e308d6 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:45.680083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f308af0-845c-449c-8695-1fc190e308d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:45.701717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-683085fb-ccc0-4c6c-be16-912a7625d269 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd5da91b469e4b96a736fb25a6d30d4c', 'request_id': 'req-683085fb-ccc0-4c6c-be16-912a7625d269'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:45.712919 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-683085fb-ccc0-4c6c-be16-912a7625d269 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd5da91b469e4b96a736fb25a6d30d4c', 'request_id': 'req-683085fb-ccc0-4c6c-be16-912a7625d269'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:45.721507 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-8f308af0-845c-449c-8695-1fc190e308d6 None None] MFA Rules not processed for user `1e42d4c88f4343d886d7f1c8abfda0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:45.723019 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8f308af0-845c-449c-8695-1fc190e308d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:45.724940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-683085fb-ccc0-4c6c-be16-912a7625d269 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd5da91b469e4b96a736fb25a6d30d4c', 'request_id': 'req-683085fb-ccc0-4c6c-be16-912a7625d269'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:45.772315 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-683085fb-ccc0-4c6c-be16-912a7625d269 admin admin] The token cache is being invalidate because project cd5da91b469e4b96a736fb25a6d30d4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:21:45.772778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-683085fb-ccc0-4c6c-be16-912a7625d269 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:45.775199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-683085fb-ccc0-4c6c-be16-912a7625d269 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:45.787592 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3710/7353] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:21:45 2022] DELETE /identity/v3/projects/cd5da91b469e4b96a736fb25a6d30d4c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:45.789129 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683085fb-ccc0-4c6c-be16-912a7625d269 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:45.800986 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-683085fb-ccc0-4c6c-be16-912a7625d269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:45.823750 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:45.883789 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3644/7354] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:45.896669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683085fb-ccc0-4c6c-be16-912a7625d269 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:45.903335 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf20f557-bda8-4edf-8cbf-b01b86fe212e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:45.903888 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f308af0-845c-449c-8695-1fc190e308d6 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:45.904012 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20f557-bda8-4edf-8cbf-b01b86fe212e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:45.904178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20f557-bda8-4edf-8cbf-b01b86fe212e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:45.904470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20f557-bda8-4edf-8cbf-b01b86fe212e admin admin] PATH_INFO: `/v3/users/9423d7c6a92b4050b0ee6d0139a68fce` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:45.906237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf20f557-bda8-4edf-8cbf-b01b86fe212e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9423d7c6a92b4050b0ee6d0139a68fce)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:45.909091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf20f557-bda8-4edf-8cbf-b01b86fe212e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:45.909557 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8f308af0-845c-449c-8695-1fc190e308d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:46.006022 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cf20f557-bda8-4edf-8cbf-b01b86fe212e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9423d7c6a92b4050b0ee6d0139a68fce'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:46.019408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cf20f557-bda8-4edf-8cbf-b01b86fe212e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9423d7c6a92b4050b0ee6d0139a68fce'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:46.020175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cf20f557-bda8-4edf-8cbf-b01b86fe212e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9423d7c6a92b4050b0ee6d0139a68fce'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:46.020810 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cf20f557-bda8-4edf-8cbf-b01b86fe212e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9423d7c6a92b4050b0ee6d0139a68fce'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:46.030847 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cf20f557-bda8-4edf-8cbf-b01b86fe212e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9423d7c6a92b4050b0ee6d0139a68fce'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:46.048602 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f308af0-845c-449c-8695-1fc190e308d6 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:46.053360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132384cb-e1f2-4c59-a8ce-e4cebb64a50a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:46.054281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132384cb-e1f2-4c59-a8ce-e4cebb64a50a service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:46.054783 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132384cb-e1f2-4c59-a8ce-e4cebb64a50a service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:46.055148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132384cb-e1f2-4c59-a8ce-e4cebb64a50a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:46.064763 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-132384cb-e1f2-4c59-a8ce-e4cebb64a50a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:46.075728 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3711/7355] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:21:45 2022] DELETE /identity/v3/users/9423d7c6a92b4050b0ee6d0139a68fce => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:46.136416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:46.156000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132384cb-e1f2-4c59-a8ce-e4cebb64a50a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:46.158375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132384cb-e1f2-4c59-a8ce-e4cebb64a50a service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:46.170600 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3645/7356] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:46.665328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf20f557-bda8-4edf-8cbf-b01b86fe212e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:46.671453 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-cf20f557-bda8-4edf-8cbf-b01b86fe212e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:46.776046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf20f557-bda8-4edf-8cbf-b01b86fe212e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:46.781129 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389fd373-9e3e-48e8-bcfb-6965cd54bcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:46.781766 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fd373-9e3e-48e8-bcfb-6965cd54bcb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:46.782070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fd373-9e3e-48e8-bcfb-6965cd54bcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:46.782370 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fd373-9e3e-48e8-bcfb-6965cd54bcb0 admin admin] PATH_INFO: `/v3/projects/916c5a5ebb804111a59622dcb9a1b6d5` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:46.783707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389fd373-9e3e-48e8-bcfb-6965cd54bcb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=916c5a5ebb804111a59622dcb9a1b6d5)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:46.788914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389fd373-9e3e-48e8-bcfb-6965cd54bcb0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:46.833093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:46.851549 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-389fd373-9e3e-48e8-bcfb-6965cd54bcb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '916c5a5ebb804111a59622dcb9a1b6d5', 'request_id': 'req-389fd373-9e3e-48e8-bcfb-6965cd54bcb0'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:46.861162 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-389fd373-9e3e-48e8-bcfb-6965cd54bcb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '916c5a5ebb804111a59622dcb9a1b6d5', 'request_id': 'req-389fd373-9e3e-48e8-bcfb-6965cd54bcb0'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:46.870952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-389fd373-9e3e-48e8-bcfb-6965cd54bcb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '916c5a5ebb804111a59622dcb9a1b6d5', 'request_id': 'req-389fd373-9e3e-48e8-bcfb-6965cd54bcb0'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:46.884186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-389fd373-9e3e-48e8-bcfb-6965cd54bcb0 admin admin] The token cache is being invalidate because project 916c5a5ebb804111a59622dcb9a1b6d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:21:46.884486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-389fd373-9e3e-48e8-bcfb-6965cd54bcb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:46.885151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-389fd373-9e3e-48e8-bcfb-6965cd54bcb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:46.889936 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3712/7357] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:21:46 2022] DELETE /identity/v3/projects/916c5a5ebb804111a59622dcb9a1b6d5 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:46.891015 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132384cb-e1f2-4c59-a8ce-e4cebb64a50a service cinder] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:46.909696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132384cb-e1f2-4c59-a8ce-e4cebb64a50a service cinder] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:46.990455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41517e4-7e50-4137-a123-0fc6119f7791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:46.991133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41517e4-7e50-4137-a123-0fc6119f7791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:46.991412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41517e4-7e50-4137-a123-0fc6119f7791 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:46.991689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41517e4-7e50-4137-a123-0fc6119f7791 admin admin] PATH_INFO: `/v3/users/1b745e8c30714c86b2a7dc0a7089c0e2` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:46.993016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41517e4-7e50-4137-a123-0fc6119f7791 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b745e8c30714c86b2a7dc0a7089c0e2)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:46.995135 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41517e4-7e50-4137-a123-0fc6119f7791 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:47.047198 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c41517e4-7e50-4137-a123-0fc6119f7791 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b745e8c30714c86b2a7dc0a7089c0e2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:47.048364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c41517e4-7e50-4137-a123-0fc6119f7791 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b745e8c30714c86b2a7dc0a7089c0e2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:47.049013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c41517e4-7e50-4137-a123-0fc6119f7791 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b745e8c30714c86b2a7dc0a7089c0e2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:47.056703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c41517e4-7e50-4137-a123-0fc6119f7791 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b745e8c30714c86b2a7dc0a7089c0e2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:47.069365 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c41517e4-7e50-4137-a123-0fc6119f7791 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b745e8c30714c86b2a7dc0a7089c0e2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:47.082016 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3646/7358] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:21:46 2022] DELETE /identity/v3/users/1b745e8c30714c86b2a7dc0a7089c0e2 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:21:47.375115 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389fd373-9e3e-48e8-bcfb-6965cd54bcb0 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:47.377563 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-389fd373-9e3e-48e8-bcfb-6965cd54bcb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:47.463673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41517e4-7e50-4137-a123-0fc6119f7791 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:47.466098 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c41517e4-7e50-4137-a123-0fc6119f7791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:47.474227 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389fd373-9e3e-48e8-bcfb-6965cd54bcb0 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:47.538808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a426bf-a770-424b-9189-1afd817ff382 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:47.539548 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a426bf-a770-424b-9189-1afd817ff382 service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:47.539934 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a426bf-a770-424b-9189-1afd817ff382 service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:47.540311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a426bf-a770-424b-9189-1afd817ff382 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:47.543201 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-10a426bf-a770-424b-9189-1afd817ff382 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:47.564093 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41517e4-7e50-4137-a123-0fc6119f7791 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:47.569093 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ba936-6599-41e9-bc7d-3368ae657364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:47.569734 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ba936-6599-41e9-bc7d-3368ae657364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:47.570010 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ba936-6599-41e9-bc7d-3368ae657364 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:47.570281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ba936-6599-41e9-bc7d-3368ae657364 admin admin] PATH_INFO: `/v3/projects/a347645a518740308f295416356a9c3d` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:47.571449 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ba936-6599-41e9-bc7d-3368ae657364 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a347645a518740308f295416356a9c3d)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:47.573988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ba936-6599-41e9-bc7d-3368ae657364 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:47.582878 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:47.617745 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a426bf-a770-424b-9189-1afd817ff382 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:47.619516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a426bf-a770-424b-9189-1afd817ff382 service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:47.632314 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3713/7359] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:47.661312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d93ba936-6599-41e9-bc7d-3368ae657364 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a347645a518740308f295416356a9c3d', 'request_id': 'req-d93ba936-6599-41e9-bc7d-3368ae657364'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:47.670285 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d93ba936-6599-41e9-bc7d-3368ae657364 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a347645a518740308f295416356a9c3d', 'request_id': 'req-d93ba936-6599-41e9-bc7d-3368ae657364'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:47.699445 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d93ba936-6599-41e9-bc7d-3368ae657364 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a347645a518740308f295416356a9c3d', 'request_id': 'req-d93ba936-6599-41e9-bc7d-3368ae657364'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:47.721753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d93ba936-6599-41e9-bc7d-3368ae657364 admin admin] The token cache is being invalidate because project a347645a518740308f295416356a9c3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:21:47.722059 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d93ba936-6599-41e9-bc7d-3368ae657364 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:47.724890 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d93ba936-6599-41e9-bc7d-3368ae657364 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:47.727740 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3647/7360] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:21:47 2022] DELETE /identity/v3/projects/a347645a518740308f295416356a9c3d => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:21:47.735058 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e00129-e1cf-4ec5-9600-cb6d4b496a7d None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:47.735635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e00129-e1cf-4ec5-9600-cb6d4b496a7d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:47.735635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e00129-e1cf-4ec5-9600-cb6d4b496a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:47.762105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-04e00129-e1cf-4ec5-9600-cb6d4b496a7d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:47.765462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-04e00129-e1cf-4ec5-9600-cb6d4b496a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:47.840731 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:47.947675 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3714/7361] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:47.950632 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7515859-b40f-420b-b5e4-3c3923354eaf None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:47.951108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7515859-b40f-420b-b5e4-3c3923354eaf None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:47.951257 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7515859-b40f-420b-b5e4-3c3923354eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:47.999657 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e00129-e1cf-4ec5-9600-cb6d4b496a7d None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:48.001189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-04e00129-e1cf-4ec5-9600-cb6d4b496a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:48.003225 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-c7515859-b40f-420b-b5e4-3c3923354eaf None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:48.007286 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c7515859-b40f-420b-b5e4-3c3923354eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:48.037401 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3648/7362] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:48.042196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7515859-b40f-420b-b5e4-3c3923354eaf None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:48.059317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7515859-b40f-420b-b5e4-3c3923354eaf None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:48.066467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723bffb1-75e0-4a05-b175-8f0b79ed9764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:48.068452 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bffb1-75e0-4a05-b175-8f0b79ed9764 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:48.068452 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bffb1-75e0-4a05-b175-8f0b79ed9764 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:48.068452 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bffb1-75e0-4a05-b175-8f0b79ed9764 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:48.068452 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723bffb1-75e0-4a05-b175-8f0b79ed9764 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:21:48.068849 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723bffb1-75e0-4a05-b175-8f0b79ed9764 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:48.070401 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723bffb1-75e0-4a05-b175-8f0b79ed9764 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:48.095141 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3649/7363] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:21:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:21:48.096726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723bffb1-75e0-4a05-b175-8f0b79ed9764 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:48.112494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723bffb1-75e0-4a05-b175-8f0b79ed9764 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:48.119694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce4ec6-6f91-4b7f-a1d9-ebaba9c28663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:48.121014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce4ec6-6f91-4b7f-a1d9-ebaba9c28663 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:48.121578 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce4ec6-6f91-4b7f-a1d9-ebaba9c28663 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:48.121950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce4ec6-6f91-4b7f-a1d9-ebaba9c28663 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:48.122718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce4ec6-6f91-4b7f-a1d9-ebaba9c28663 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:48.125230 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce4ec6-6f91-4b7f-a1d9-ebaba9c28663 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:48.175410 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3650/7364] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:21:48 2022] POST /identity/v3/projects => generated 369 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:48.180715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce4ec6-6f91-4b7f-a1d9-ebaba9c28663 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:48.225833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e00129-e1cf-4ec5-9600-cb6d4b496a7d None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:48.378855 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce4ec6-6f91-4b7f-a1d9-ebaba9c28663 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:48.392647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae09926-3852-4dee-8be2-8b9cd8c67208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:48.393259 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae09926-3852-4dee-8be2-8b9cd8c67208 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:48.393594 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae09926-3852-4dee-8be2-8b9cd8c67208 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:48.393853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae09926-3852-4dee-8be2-8b9cd8c67208 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:48.394611 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae09926-3852-4dee-8be2-8b9cd8c67208 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:48.397001 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae09926-3852-4dee-8be2-8b9cd8c67208 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:48.417678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e5159-bb52-41b2-adaf-120e3911caea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:48.418439 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e5159-bb52-41b2-adaf-120e3911caea service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:48.419112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e5159-bb52-41b2-adaf-120e3911caea service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:48.419429 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e5159-bb52-41b2-adaf-120e3911caea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:48.422063 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-503e5159-bb52-41b2-adaf-120e3911caea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:48.438714 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3651/7365] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:21:48 2022] POST /identity/v3/users => generated 285 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:48.442063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae09926-3852-4dee-8be2-8b9cd8c67208 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:48.458230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e5159-bb52-41b2-adaf-120e3911caea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:48.460617 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e5159-bb52-41b2-adaf-120e3911caea service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:48.462526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae09926-3852-4dee-8be2-8b9cd8c67208 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:48.472267 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccff11d-466e-4039-b966-31890b33419c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:48.473491 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccff11d-466e-4039-b966-31890b33419c admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:48.474255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccff11d-466e-4039-b966-31890b33419c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:48.474797 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccff11d-466e-4039-b966-31890b33419c admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:48.477829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccff11d-466e-4039-b966-31890b33419c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:48.482126 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccff11d-466e-4039-b966-31890b33419c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:48.483446 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3715/7366] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:21:48.503727 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3652/7367] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:48.518080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e5159-bb52-41b2-adaf-120e3911caea service placement] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:48.534045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e5159-bb52-41b2-adaf-120e3911caea service placement] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:48.540788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce1958-a9c2-4aec-820d-389524b9248b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:48.542729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce1958-a9c2-4aec-820d-389524b9248b admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:48.543399 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce1958-a9c2-4aec-820d-389524b9248b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:48.544472 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce1958-a9c2-4aec-820d-389524b9248b admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:48.545365 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce1958-a9c2-4aec-820d-389524b9248b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:48.547540 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce1958-a9c2-4aec-820d-389524b9248b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:48.566630 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3716/7368] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:48.571585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccff11d-466e-4039-b966-31890b33419c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:48.587521 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccff11d-466e-4039-b966-31890b33419c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:48.597597 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27883583-7b27-41fd-a633-7dd1731c6c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:48.598141 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27883583-7b27-41fd-a633-7dd1731c6c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:48.598643 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27883583-7b27-41fd-a633-7dd1731c6c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:48.600562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27883583-7b27-41fd-a633-7dd1731c6c4f admin admin] PATH_INFO: `/v3/projects/ae2ec7ca33064d058e17d7f10e583d42/users/2a93852c0d284270bac8bfc209dc8293/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:48.628098 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27883583-7b27-41fd-a633-7dd1731c6c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae2ec7ca33064d058e17d7f10e583d42, user_id=2a93852c0d284270bac8bfc209dc8293, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:48.631910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27883583-7b27-41fd-a633-7dd1731c6c4f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:48.652817 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3653/7369] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:48 2022] PUT /identity/v3/projects/ae2ec7ca33064d058e17d7f10e583d42/users/2a93852c0d284270bac8bfc209dc8293/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:48.664193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e8fce-2c67-4272-99ef-6cf84b5225f9 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:48.664586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e8fce-2c67-4272-99ef-6cf84b5225f9 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:48.664884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e8fce-2c67-4272-99ef-6cf84b5225f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:48.697336 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a93e8fce-2c67-4272-99ef-6cf84b5225f9 None None] MFA Rules not processed for user `2a93852c0d284270bac8bfc209dc8293`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:48.699034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a93e8fce-2c67-4272-99ef-6cf84b5225f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:48.749959 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:48.805609 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3717/7370] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:48.812980 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27883583-7b27-41fd-a633-7dd1731c6c4f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:48.817389 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-27883583-7b27-41fd-a633-7dd1731c6c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:48.827947 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e8fce-2c67-4272-99ef-6cf84b5225f9 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:48.829426 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a93e8fce-2c67-4272-99ef-6cf84b5225f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:48.831838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:48.899492 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27883583-7b27-41fd-a633-7dd1731c6c4f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:48.905081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375fc0f-2f0a-4a86-9d1d-0cdeb5cca57b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10759b2abd4cafacf338551327775e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:48.905728 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375fc0f-2f0a-4a86-9d1d-0cdeb5cca57b service glance] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:48.906008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375fc0f-2f0a-4a86-9d1d-0cdeb5cca57b service glance] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:48.906963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375fc0f-2f0a-4a86-9d1d-0cdeb5cca57b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:48.918169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375fc0f-2f0a-4a86-9d1d-0cdeb5cca57b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:48.920358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375fc0f-2f0a-4a86-9d1d-0cdeb5cca57b service glance] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:48.929945 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e8fce-2c67-4272-99ef-6cf84b5225f9 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:48.936967 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3654/7371] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:48.938333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f516a9-2006-41c4-ac90-05f3d1b44ce6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:48.939103 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f516a9-2006-41c4-ac90-05f3d1b44ce6 service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:48.939456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f516a9-2006-41c4-ac90-05f3d1b44ce6 service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:48.939765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f516a9-2006-41c4-ac90-05f3d1b44ce6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:48.941990 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b8f516a9-2006-41c4-ac90-05f3d1b44ce6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:49.034804 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f516a9-2006-41c4-ac90-05f3d1b44ce6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:49.036596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f516a9-2006-41c4-ac90-05f3d1b44ce6 service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:49.047792 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3718/7372] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:48 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:49.127528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375fc0f-2f0a-4a86-9d1d-0cdeb5cca57b service glance] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:49.129007 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7375fc0f-2f0a-4a86-9d1d-0cdeb5cca57b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:49.215888 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375fc0f-2f0a-4a86-9d1d-0cdeb5cca57b service glance] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:49.222153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003df7a-e2b9-4131-8bb9-1033da9cd699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:49.223085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003df7a-e2b9-4131-8bb9-1033da9cd699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:49.223298 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003df7a-e2b9-4131-8bb9-1033da9cd699 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:49.223666 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003df7a-e2b9-4131-8bb9-1033da9cd699 admin admin] PATH_INFO: `/v3/users/c42c4a8438ea4349bac43e6a250d548b` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:49.225073 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003df7a-e2b9-4131-8bb9-1033da9cd699 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c42c4a8438ea4349bac43e6a250d548b)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:49.227283 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003df7a-e2b9-4131-8bb9-1033da9cd699 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:49.274035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f516a9-2006-41c4-ac90-05f3d1b44ce6 service cinder] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:49.277836 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b8f516a9-2006-41c4-ac90-05f3d1b44ce6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:49.305610 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f516a9-2006-41c4-ac90-05f3d1b44ce6 service cinder] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:49.309309 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c003df7a-e2b9-4131-8bb9-1033da9cd699 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c42c4a8438ea4349bac43e6a250d548b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:49.310083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c003df7a-e2b9-4131-8bb9-1033da9cd699 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c42c4a8438ea4349bac43e6a250d548b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:49.311433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c003df7a-e2b9-4131-8bb9-1033da9cd699 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c42c4a8438ea4349bac43e6a250d548b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:49.317653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4557a96f-1575-4182-80d8-1093e83f0f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:49.318368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557a96f-1575-4182-80d8-1093e83f0f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:49.318840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557a96f-1575-4182-80d8-1093e83f0f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:49.322695 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557a96f-1575-4182-80d8-1093e83f0f19 admin admin] PATH_INFO: `/v3/users/70d073ddaa5c406ea3a4311668d3b8af` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:49.324292 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c003df7a-e2b9-4131-8bb9-1033da9cd699 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c42c4a8438ea4349bac43e6a250d548b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:49.329977 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4557a96f-1575-4182-80d8-1093e83f0f19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70d073ddaa5c406ea3a4311668d3b8af)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:49.332214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4557a96f-1575-4182-80d8-1093e83f0f19 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:49.340973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c003df7a-e2b9-4131-8bb9-1033da9cd699 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c42c4a8438ea4349bac43e6a250d548b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:49.358610 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3655/7373] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:21:49 2022] DELETE /identity/v3/users/c42c4a8438ea4349bac43e6a250d548b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:49.362833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c72650-ba57-4883-8b47-c2549d021e90 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:49.363202 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c72650-ba57-4883-8b47-c2549d021e90 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:49.363576 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c72650-ba57-4883-8b47-c2549d021e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:49.388366 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-44c72650-ba57-4883-8b47-c2549d021e90 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:49.389962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-44c72650-ba57-4883-8b47-c2549d021e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:49.420467 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4557a96f-1575-4182-80d8-1093e83f0f19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70d073ddaa5c406ea3a4311668d3b8af'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:49.432069 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4557a96f-1575-4182-80d8-1093e83f0f19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70d073ddaa5c406ea3a4311668d3b8af'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:49.433071 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4557a96f-1575-4182-80d8-1093e83f0f19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70d073ddaa5c406ea3a4311668d3b8af'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:49.433891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4557a96f-1575-4182-80d8-1093e83f0f19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70d073ddaa5c406ea3a4311668d3b8af'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:49.442663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:49.445861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4557a96f-1575-4182-80d8-1093e83f0f19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70d073ddaa5c406ea3a4311668d3b8af'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:49.458342 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:49.469925 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3719/7374] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:21:49 2022] DELETE /identity/v3/users/70d073ddaa5c406ea3a4311668d3b8af => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:21:49.474499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84ca2a-6cbf-443e-8188-f2b81058a6b1 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:49.475029 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84ca2a-6cbf-443e-8188-f2b81058a6b1 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:49.475631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84ca2a-6cbf-443e-8188-f2b81058a6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:49.505770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-fc84ca2a-6cbf-443e-8188-f2b81058a6b1 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:49.507630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-fc84ca2a-6cbf-443e-8188-f2b81058a6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:49.524357 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3656/7375] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:49.539427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c72650-ba57-4883-8b47-c2549d021e90 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:49.541694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-44c72650-ba57-4883-8b47-c2549d021e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:49.591134 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3720/7376] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:49.597779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84ca2a-6cbf-443e-8188-f2b81058a6b1 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:49.599743 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-fc84ca2a-6cbf-443e-8188-f2b81058a6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:49.682514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c72650-ba57-4883-8b47-c2549d021e90 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:49.699093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84ca2a-6cbf-443e-8188-f2b81058a6b1 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:49.704647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25833539-6259-49fe-996a-3b98fe14930a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:49.705454 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25833539-6259-49fe-996a-3b98fe14930a service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:49.706522 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25833539-6259-49fe-996a-3b98fe14930a service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:49.706969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25833539-6259-49fe-996a-3b98fe14930a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:49.723916 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25833539-6259-49fe-996a-3b98fe14930a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:49.728202 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25833539-6259-49fe-996a-3b98fe14930a service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:49.744583 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3721/7377] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:21:49.781620 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce54c5b-648a-4269-8381-6ac867b34d62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:49.782466 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce54c5b-648a-4269-8381-6ac867b34d62 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:49.782885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce54c5b-648a-4269-8381-6ac867b34d62 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:49.783232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce54c5b-648a-4269-8381-6ac867b34d62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:49.802375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce54c5b-648a-4269-8381-6ac867b34d62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:49.803936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce54c5b-648a-4269-8381-6ac867b34d62 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:49.819299 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3657/7378] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:50.356596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25833539-6259-49fe-996a-3b98fe14930a service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:50.360356 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-25833539-6259-49fe-996a-3b98fe14930a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:50.389506 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25833539-6259-49fe-996a-3b98fe14930a service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:50.397365 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ed100-94f4-4b80-85be-f5a5dd4572b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:50.397365 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ed100-94f4-4b80-85be-f5a5dd4572b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:50.397651 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ed100-94f4-4b80-85be-f5a5dd4572b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:50.397829 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ed100-94f4-4b80-85be-f5a5dd4572b6 admin admin] PATH_INFO: `/v3/projects/fa632f6acea044ee9bdbb0da3ab88840` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:50.399779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ed100-94f4-4b80-85be-f5a5dd4572b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa632f6acea044ee9bdbb0da3ab88840)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:50.401239 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ed100-94f4-4b80-85be-f5a5dd4572b6 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:50.460520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f45ed100-94f4-4b80-85be-f5a5dd4572b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa632f6acea044ee9bdbb0da3ab88840', 'request_id': 'req-f45ed100-94f4-4b80-85be-f5a5dd4572b6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:50.470810 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f45ed100-94f4-4b80-85be-f5a5dd4572b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa632f6acea044ee9bdbb0da3ab88840', 'request_id': 'req-f45ed100-94f4-4b80-85be-f5a5dd4572b6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:50.481791 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f45ed100-94f4-4b80-85be-f5a5dd4572b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa632f6acea044ee9bdbb0da3ab88840', 'request_id': 'req-f45ed100-94f4-4b80-85be-f5a5dd4572b6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:50.501450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f45ed100-94f4-4b80-85be-f5a5dd4572b6 admin admin] The token cache is being invalidate because project fa632f6acea044ee9bdbb0da3ab88840 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:21:50.502069 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f45ed100-94f4-4b80-85be-f5a5dd4572b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:50.503274 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f45ed100-94f4-4b80-85be-f5a5dd4572b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:50.505520 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3722/7379] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:21:50 2022] DELETE /identity/v3/projects/fa632f6acea044ee9bdbb0da3ab88840 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:50.512589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a0882-71db-49b0-9b18-3dfe89023472 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:50.514839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a0882-71db-49b0-9b18-3dfe89023472 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:50.515227 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a0882-71db-49b0-9b18-3dfe89023472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:50.523901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ed100-94f4-4b80-85be-f5a5dd4572b6 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:50.534949 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f45ed100-94f4-4b80-85be-f5a5dd4572b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:50.556716 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-885a0882-71db-49b0-9b18-3dfe89023472 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:50.558500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-885a0882-71db-49b0-9b18-3dfe89023472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:50.576067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:50.640177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ed100-94f4-4b80-85be-f5a5dd4572b6 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:50.648113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e58a81-e28b-4583-81ad-3e70361b6a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:50.648764 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e58a81-e28b-4583-81ad-3e70361b6a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:50.649035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e58a81-e28b-4583-81ad-3e70361b6a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:50.649308 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e58a81-e28b-4583-81ad-3e70361b6a45 admin admin] PATH_INFO: `/v3/projects/2c91f85759d6422ebf57d9c7258d09e8` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:50.653280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e58a81-e28b-4583-81ad-3e70361b6a45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c91f85759d6422ebf57d9c7258d09e8)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:50.655312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e58a81-e28b-4583-81ad-3e70361b6a45 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:50.675533 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3658/7380] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:50.684457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cde2f-d8aa-4dac-8df8-c6937920d9a6 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:50.685163 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cde2f-d8aa-4dac-8df8-c6937920d9a6 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:50.685960 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cde2f-d8aa-4dac-8df8-c6937920d9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:50.722895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-4a1cde2f-d8aa-4dac-8df8-c6937920d9a6 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:50.724663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4a1cde2f-d8aa-4dac-8df8-c6937920d9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:50.743500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-78e58a81-e28b-4583-81ad-3e70361b6a45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c91f85759d6422ebf57d9c7258d09e8', 'request_id': 'req-78e58a81-e28b-4583-81ad-3e70361b6a45'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:50.753273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-78e58a81-e28b-4583-81ad-3e70361b6a45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c91f85759d6422ebf57d9c7258d09e8', 'request_id': 'req-78e58a81-e28b-4583-81ad-3e70361b6a45'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:50.760028 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:50.764388 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-78e58a81-e28b-4583-81ad-3e70361b6a45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c91f85759d6422ebf57d9c7258d09e8', 'request_id': 'req-78e58a81-e28b-4583-81ad-3e70361b6a45'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:50.777565 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-78e58a81-e28b-4583-81ad-3e70361b6a45 admin admin] The token cache is being invalidate because project 2c91f85759d6422ebf57d9c7258d09e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:21:50.777936 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-78e58a81-e28b-4583-81ad-3e70361b6a45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:50.778566 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-78e58a81-e28b-4583-81ad-3e70361b6a45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:50.780305 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3723/7381] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:21:50 2022] DELETE /identity/v3/projects/2c91f85759d6422ebf57d9c7258d09e8 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:50.784130 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e58a81-e28b-4583-81ad-3e70361b6a45 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:50.785806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-78e58a81-e28b-4583-81ad-3e70361b6a45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:50.819950 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3659/7382] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:21:50.821606 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1cde2f-d8aa-4dac-8df8-c6937920d9a6 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:50.843174 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1cde2f-d8aa-4dac-8df8-c6937920d9a6 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:50.851629 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeaffe7-a09f-4d43-ba41-ffc05c43b8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:50.852365 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeaffe7-a09f-4d43-ba41-ffc05c43b8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:50.852702 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeaffe7-a09f-4d43-ba41-ffc05c43b8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:50.852981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeaffe7-a09f-4d43-ba41-ffc05c43b8d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:50.853666 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeaffe7-a09f-4d43-ba41-ffc05c43b8d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:21:50.853993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeaffe7-a09f-4d43-ba41-ffc05c43b8d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:50.855972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeaffe7-a09f-4d43-ba41-ffc05c43b8d7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:50.875463 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3660/7383] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:21:50.875797 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e58a81-e28b-4583-81ad-3e70361b6a45 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:50.881056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11bafd-b939-424e-a990-a5a97e73678a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:50.881877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11bafd-b939-424e-a990-a5a97e73678a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:50.882229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11bafd-b939-424e-a990-a5a97e73678a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:50.882600 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11bafd-b939-424e-a990-a5a97e73678a admin admin] PATH_INFO: `/v3/users/1e42d4c88f4343d886d7f1c8abfda0c7` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:50.883921 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11bafd-b939-424e-a990-a5a97e73678a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e42d4c88f4343d886d7f1c8abfda0c7)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:50.887191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeaffe7-a09f-4d43-ba41-ffc05c43b8d7 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:50.887366 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11bafd-b939-424e-a990-a5a97e73678a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:50.909183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeaffe7-a09f-4d43-ba41-ffc05c43b8d7 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:50.924604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a580c-5c40-42ed-98dc-5f4efbad26d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:50.925556 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a580c-5c40-42ed-98dc-5f4efbad26d3 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:50.925963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a580c-5c40-42ed-98dc-5f4efbad26d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:50.926276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a580c-5c40-42ed-98dc-5f4efbad26d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:50.927157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a580c-5c40-42ed-98dc-5f4efbad26d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:50.930373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a580c-5c40-42ed-98dc-5f4efbad26d3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:50.958466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ea11bafd-b939-424e-a990-a5a97e73678a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e42d4c88f4343d886d7f1c8abfda0c7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:50.965550 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:50.969245 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ea11bafd-b939-424e-a990-a5a97e73678a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e42d4c88f4343d886d7f1c8abfda0c7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:50.970376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ea11bafd-b939-424e-a990-a5a97e73678a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e42d4c88f4343d886d7f1c8abfda0c7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:50.971402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ea11bafd-b939-424e-a990-a5a97e73678a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e42d4c88f4343d886d7f1c8abfda0c7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:50.981875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ea11bafd-b939-424e-a990-a5a97e73678a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e42d4c88f4343d886d7f1c8abfda0c7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:51.015756 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3661/7384] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:21:50 2022] POST /identity/v3/projects => generated 379 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:51.018597 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3724/7385] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:21:50 2022] DELETE /identity/v3/users/1e42d4c88f4343d886d7f1c8abfda0c7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:51.022059 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a580c-5c40-42ed-98dc-5f4efbad26d3 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:51.025244 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-542a580c-5c40-42ed-98dc-5f4efbad26d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:51.187364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a580c-5c40-42ed-98dc-5f4efbad26d3 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:51.368126 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c036b-983f-4388-9f44-25a30aaa522c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:51.369108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c036b-983f-4388-9f44-25a30aaa522c admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:51.369108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c036b-983f-4388-9f44-25a30aaa522c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:51.369332 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c036b-983f-4388-9f44-25a30aaa522c admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:51.371415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86c036b-983f-4388-9f44-25a30aaa522c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:51.373063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86c036b-983f-4388-9f44-25a30aaa522c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:51.457205 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3662/7386] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:21:51 2022] POST /identity/v3/users => generated 290 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:51.460939 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11bafd-b939-424e-a990-a5a97e73678a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:51.517814 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11bafd-b939-424e-a990-a5a97e73678a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:51.549058 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f950dc-6c90-4eee-8dfa-08209bc15b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:51.549613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f950dc-6c90-4eee-8dfa-08209bc15b7d admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:51.549898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f950dc-6c90-4eee-8dfa-08209bc15b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:51.550177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f950dc-6c90-4eee-8dfa-08209bc15b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:51.551051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f950dc-6c90-4eee-8dfa-08209bc15b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:51.552687 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f950dc-6c90-4eee-8dfa-08209bc15b7d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:51.611883 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3725/7387] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:51.612649 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c036b-983f-4388-9f44-25a30aaa522c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:51.645416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c036b-983f-4388-9f44-25a30aaa522c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:51.682148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de158eb-c712-4e02-9e57-f00a099dedea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:51.684703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de158eb-c712-4e02-9e57-f00a099dedea admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:51.689666 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de158eb-c712-4e02-9e57-f00a099dedea admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:51.691002 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de158eb-c712-4e02-9e57-f00a099dedea admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:51.695846 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de158eb-c712-4e02-9e57-f00a099dedea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:51.700025 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de158eb-c712-4e02-9e57-f00a099dedea admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:51.752356 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f950dc-6c90-4eee-8dfa-08209bc15b7d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:51.755091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a8f950dc-6c90-4eee-8dfa-08209bc15b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:51.767758 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3663/7388] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:51.771257 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de158eb-c712-4e02-9e57-f00a099dedea admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:51.787660 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de158eb-c712-4e02-9e57-f00a099dedea admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:51.807399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966c2e8-81a9-46b9-b163-ceb1a24d6759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:51.807399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966c2e8-81a9-46b9-b163-ceb1a24d6759 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:51.807399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966c2e8-81a9-46b9-b163-ceb1a24d6759 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:51.808424 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966c2e8-81a9-46b9-b163-ceb1a24d6759 admin admin] PATH_INFO: `/v3/projects/ed693b6b6ec24af8ac2e64bcd24132f5/users/84b077253cd94d51ae9dc848e62aa937/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:51.809509 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f950dc-6c90-4eee-8dfa-08209bc15b7d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:51.828044 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67cbcc4-840d-41d3-b5e7-f4ac61a79a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:51.829478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cbcc4-840d-41d3-b5e7-f4ac61a79a3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:51.829478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cbcc4-840d-41d3-b5e7-f4ac61a79a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:51.829478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cbcc4-840d-41d3-b5e7-f4ac61a79a3d admin admin] PATH_INFO: `/v3/projects/c6b8d9eb6e844b00ab2f6166325a38e6` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:51.830518 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67cbcc4-840d-41d3-b5e7-f4ac61a79a3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6b8d9eb6e844b00ab2f6166325a38e6)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:51.832680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67cbcc4-840d-41d3-b5e7-f4ac61a79a3d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:51.873621 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966c2e8-81a9-46b9-b163-ceb1a24d6759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed693b6b6ec24af8ac2e64bcd24132f5, user_id=84b077253cd94d51ae9dc848e62aa937, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:51.889987 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966c2e8-81a9-46b9-b163-ceb1a24d6759 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:51.907727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:51.935676 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b67cbcc4-840d-41d3-b5e7-f4ac61a79a3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6b8d9eb6e844b00ab2f6166325a38e6', 'request_id': 'req-b67cbcc4-840d-41d3-b5e7-f4ac61a79a3d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:51.939562 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3664/7389] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:51 2022] PUT /identity/v3/projects/ed693b6b6ec24af8ac2e64bcd24132f5/users/84b077253cd94d51ae9dc848e62aa937/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:21:51.945016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d7598-e92d-4d71-8063-70ff5d6942ec None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:51.945231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d7598-e92d-4d71-8063-70ff5d6942ec None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:51.945541 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d7598-e92d-4d71-8063-70ff5d6942ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:51.952026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b67cbcc4-840d-41d3-b5e7-f4ac61a79a3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6b8d9eb6e844b00ab2f6166325a38e6', 'request_id': 'req-b67cbcc4-840d-41d3-b5e7-f4ac61a79a3d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:51.968154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b67cbcc4-840d-41d3-b5e7-f4ac61a79a3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6b8d9eb6e844b00ab2f6166325a38e6', 'request_id': 'req-b67cbcc4-840d-41d3-b5e7-f4ac61a79a3d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:51.981053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f56d7598-e92d-4d71-8063-70ff5d6942ec None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:51.982144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f56d7598-e92d-4d71-8063-70ff5d6942ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:51.987392 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b67cbcc4-840d-41d3-b5e7-f4ac61a79a3d admin admin] The token cache is being invalidate because project c6b8d9eb6e844b00ab2f6166325a38e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:21:51.987780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b67cbcc4-840d-41d3-b5e7-f4ac61a79a3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:51.990181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b67cbcc4-840d-41d3-b5e7-f4ac61a79a3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:51.997001 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3726/7390] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:21:51 2022] DELETE /identity/v3/projects/c6b8d9eb6e844b00ab2f6166325a38e6 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:51.998859 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db98d7-147a-458c-947a-4216aec3136d None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:51.999380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db98d7-147a-458c-947a-4216aec3136d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:51.999896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db98d7-147a-458c-947a-4216aec3136d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:52.060711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-28db98d7-147a-458c-947a-4216aec3136d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:52.067830 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-28db98d7-147a-458c-947a-4216aec3136d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:52.083914 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3665/7391] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:21:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:52.087959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66a172-503f-4212-9208-05f301056e35 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:52.090101 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66a172-503f-4212-9208-05f301056e35 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:52.090408 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66a172-503f-4212-9208-05f301056e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:52.145547 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-1e66a172-503f-4212-9208-05f301056e35 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:52.148938 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1e66a172-503f-4212-9208-05f301056e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:52.205140 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3727/7392] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:52.217975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db98d7-147a-458c-947a-4216aec3136d None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:52.220871 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-28db98d7-147a-458c-947a-4216aec3136d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:52.345563 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3666/7393] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:52.346432 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66a172-503f-4212-9208-05f301056e35 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:52.358964 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1e66a172-503f-4212-9208-05f301056e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:52.388642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:52.505102 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db98d7-147a-458c-947a-4216aec3136d None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:52.522930 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91dda1-7097-4d2c-97bb-c72477703f8c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:52.523740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91dda1-7097-4d2c-97bb-c72477703f8c service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:52.523878 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91dda1-7097-4d2c-97bb-c72477703f8c service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:52.524078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91dda1-7097-4d2c-97bb-c72477703f8c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:52.543367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91dda1-7097-4d2c-97bb-c72477703f8c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:52.551505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91dda1-7097-4d2c-97bb-c72477703f8c service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:52.585025 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3728/7394] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:21:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:21:52.593426 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65769f-1552-4055-bc3a-e3c383d8556a None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:52.593848 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65769f-1552-4055-bc3a-e3c383d8556a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:52.595062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65769f-1552-4055-bc3a-e3c383d8556a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:52.605644 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66a172-503f-4212-9208-05f301056e35 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:52.614958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9753c31-297f-45fa-aa55-601a5666630f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:52.615915 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9753c31-297f-45fa-aa55-601a5666630f service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:52.616228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9753c31-297f-45fa-aa55-601a5666630f service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:52.616505 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9753c31-297f-45fa-aa55-601a5666630f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:52.642817 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-ec65769f-1552-4055-bc3a-e3c383d8556a None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:52.644630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ec65769f-1552-4055-bc3a-e3c383d8556a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:52.654921 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3729/7395] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:52.671485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9753c31-297f-45fa-aa55-601a5666630f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:52.675958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9753c31-297f-45fa-aa55-601a5666630f service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:52.684026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65769f-1552-4055-bc3a-e3c383d8556a None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:52.730013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65769f-1552-4055-bc3a-e3c383d8556a None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:52.732316 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3667/7396] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:52.739035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74684c5-b888-4cc9-951b-d2f03bfb3ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:52.739725 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74684c5-b888-4cc9-951b-d2f03bfb3ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:52.740072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74684c5-b888-4cc9-951b-d2f03bfb3ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:52.740360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74684c5-b888-4cc9-951b-d2f03bfb3ad1 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:52.741684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74684c5-b888-4cc9-951b-d2f03bfb3ad1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:21:52.741684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74684c5-b888-4cc9-951b-d2f03bfb3ad1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:52.744530 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74684c5-b888-4cc9-951b-d2f03bfb3ad1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:52.778731 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9753c31-297f-45fa-aa55-601a5666630f service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:52.791469 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3730/7397] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:21:52.801041 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9753c31-297f-45fa-aa55-601a5666630f service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:52.816508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0037e0a-0b43-4e22-9d2f-d7a5b2b07e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:52.819127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0037e0a-0b43-4e22-9d2f-d7a5b2b07e60 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:52.819127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0037e0a-0b43-4e22-9d2f-d7a5b2b07e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:52.819127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0037e0a-0b43-4e22-9d2f-d7a5b2b07e60 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:52.819706 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0037e0a-0b43-4e22-9d2f-d7a5b2b07e60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:52.824113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0037e0a-0b43-4e22-9d2f-d7a5b2b07e60 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:52.904280 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3668/7398] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:21:52 2022] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:52.905961 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74684c5-b888-4cc9-951b-d2f03bfb3ad1 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:52.926421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74684c5-b888-4cc9-951b-d2f03bfb3ad1 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:53.071456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1b68a-8bfd-4867-8526-137d456c5b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:53.072093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1b68a-8bfd-4867-8526-137d456c5b49 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:53.072376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1b68a-8bfd-4867-8526-137d456c5b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:53.072730 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1b68a-8bfd-4867-8526-137d456c5b49 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:53.075221 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1b68a-8bfd-4867-8526-137d456c5b49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:53.081406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1b68a-8bfd-4867-8526-137d456c5b49 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:53.133302 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3731/7399] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:21:52 2022] POST /identity/v3/users => generated 286 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:53.137630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0037e0a-0b43-4e22-9d2f-d7a5b2b07e60 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:53.154154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0037e0a-0b43-4e22-9d2f-d7a5b2b07e60 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:53.170111 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d37ed-c731-4b15-9a23-aaf7d1907283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:53.170794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d37ed-c731-4b15-9a23-aaf7d1907283 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:53.171086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d37ed-c731-4b15-9a23-aaf7d1907283 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:53.171372 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d37ed-c731-4b15-9a23-aaf7d1907283 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:53.172219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d37ed-c731-4b15-9a23-aaf7d1907283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:53.174115 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d37ed-c731-4b15-9a23-aaf7d1907283 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:53.201940 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3669/7400] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:53.206345 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1b68a-8bfd-4867-8526-137d456c5b49 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:53.223808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1b68a-8bfd-4867-8526-137d456c5b49 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:53.240416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c2855-9c38-4d5f-9f9d-0cf02c8ca08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:53.241049 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c2855-9c38-4d5f-9f9d-0cf02c8ca08d admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:53.241335 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c2855-9c38-4d5f-9f9d-0cf02c8ca08d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:53.241611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c2855-9c38-4d5f-9f9d-0cf02c8ca08d admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:53.242272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c2855-9c38-4d5f-9f9d-0cf02c8ca08d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:53.243914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c2855-9c38-4d5f-9f9d-0cf02c8ca08d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:53.278121 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3732/7401] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:53.278352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d37ed-c731-4b15-9a23-aaf7d1907283 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:53.298580 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d37ed-c731-4b15-9a23-aaf7d1907283 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:53.328293 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac020ac0-c80c-4ab7-b3d6-582721f92113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:53.329081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac020ac0-c80c-4ab7-b3d6-582721f92113 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:53.329485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac020ac0-c80c-4ab7-b3d6-582721f92113 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:53.329866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac020ac0-c80c-4ab7-b3d6-582721f92113 admin admin] PATH_INFO: `/v3/projects/94ee08c70f33492ea61b491137cd2ee4/users/78c647f257a546b8be6bf4983b464af1/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:53.353725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:53.382965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac020ac0-c80c-4ab7-b3d6-582721f92113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94ee08c70f33492ea61b491137cd2ee4, user_id=78c647f257a546b8be6bf4983b464af1, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:53.394380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac020ac0-c80c-4ab7-b3d6-582721f92113 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:53.438633 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3670/7402] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:53 2022] PUT /identity/v3/projects/94ee08c70f33492ea61b491137cd2ee4/users/78c647f257a546b8be6bf4983b464af1/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:21:53.450680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943da52-74fd-44b6-ba31-4113e4245818 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:53.450972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943da52-74fd-44b6-ba31-4113e4245818 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:53.451390 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943da52-74fd-44b6-ba31-4113e4245818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:53.515808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a943da52-74fd-44b6-ba31-4113e4245818 None None] MFA Rules not processed for user `78c647f257a546b8be6bf4983b464af1`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:53.517673 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a943da52-74fd-44b6-ba31-4113e4245818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:53.685004 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3733/7403] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:53.705719 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac020ac0-c80c-4ab7-b3d6-582721f92113 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:53.708121 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ac020ac0-c80c-4ab7-b3d6-582721f92113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:53.855428 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac020ac0-c80c-4ab7-b3d6-582721f92113 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:53.868948 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c3fb4-e2d9-49c4-9638-064dbd1e1f09 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10759b2abd4cafacf338551327775e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:53.870578 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c3fb4-e2d9-49c4-9638-064dbd1e1f09 service glance] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:53.871149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c3fb4-e2d9-49c4-9638-064dbd1e1f09 service glance] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:53.871752 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c3fb4-e2d9-49c4-9638-064dbd1e1f09 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:53.899315 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c3fb4-e2d9-49c4-9638-064dbd1e1f09 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:53.902372 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c3fb4-e2d9-49c4-9638-064dbd1e1f09 service glance] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:53.917720 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3671/7404] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:54.548723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681dcfd7-a320-4fd9-9d8d-2dd152727378 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:54.549838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681dcfd7-a320-4fd9-9d8d-2dd152727378 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:54.550824 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681dcfd7-a320-4fd9-9d8d-2dd152727378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:54.641880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-681dcfd7-a320-4fd9-9d8d-2dd152727378 None None] MFA Rules not processed for user `84b077253cd94d51ae9dc848e62aa937`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:54.644232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-681dcfd7-a320-4fd9-9d8d-2dd152727378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:54.701927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:54.860610 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3734/7405] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:54.865696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c3fb4-e2d9-49c4-9638-064dbd1e1f09 service glance] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:54.868148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f83c3fb4-e2d9-49c4-9638-064dbd1e1f09 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:54.935433 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681dcfd7-a320-4fd9-9d8d-2dd152727378 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:54.938470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-681dcfd7-a320-4fd9-9d8d-2dd152727378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:55.145518 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681dcfd7-a320-4fd9-9d8d-2dd152727378 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:55.149303 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c3fb4-e2d9-49c4-9638-064dbd1e1f09 service glance] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:55.155438 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5482d6c-aacd-4475-a68a-4933bfa7184b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:55.156328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5482d6c-aacd-4475-a68a-4933bfa7184b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:55.156709 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5482d6c-aacd-4475-a68a-4933bfa7184b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:55.157056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5482d6c-aacd-4475-a68a-4933bfa7184b admin admin] PATH_INFO: `/v3/users/0388449c508e47c4a90a6131b8dc0997` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:55.158210 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c36442-764f-4ebc-8353-6b2cd2570ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:55.158707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5482d6c-aacd-4475-a68a-4933bfa7184b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0388449c508e47c4a90a6131b8dc0997)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:55.159337 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c36442-764f-4ebc-8353-6b2cd2570ca1 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:55.159797 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c36442-764f-4ebc-8353-6b2cd2570ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:55.160282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c36442-764f-4ebc-8353-6b2cd2570ca1 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:55.161096 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c36442-764f-4ebc-8353-6b2cd2570ca1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:55.161662 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5482d6c-aacd-4475-a68a-4933bfa7184b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:55.163587 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c36442-764f-4ebc-8353-6b2cd2570ca1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:55.232730 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3672/7406] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:21:54 2022] POST /identity/v3/projects => generated 377 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:55.233966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c36442-764f-4ebc-8353-6b2cd2570ca1 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:55.259101 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c5482d6c-aacd-4475-a68a-4933bfa7184b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0388449c508e47c4a90a6131b8dc0997'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:55.283927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c5482d6c-aacd-4475-a68a-4933bfa7184b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0388449c508e47c4a90a6131b8dc0997'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:55.286126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c5482d6c-aacd-4475-a68a-4933bfa7184b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0388449c508e47c4a90a6131b8dc0997'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:55.289094 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c5482d6c-aacd-4475-a68a-4933bfa7184b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0388449c508e47c4a90a6131b8dc0997'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:55.311302 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c5482d6c-aacd-4475-a68a-4933bfa7184b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0388449c508e47c4a90a6131b8dc0997'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:55.341789 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3735/7407] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:21:54 2022] DELETE /identity/v3/users/0388449c508e47c4a90a6131b8dc0997 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:21:55.346061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c490a1f-617a-4368-bd41-8e122e696764 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:55.346495 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c490a1f-617a-4368-bd41-8e122e696764 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:55.346912 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c490a1f-617a-4368-bd41-8e122e696764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:55.409748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-7c490a1f-617a-4368-bd41-8e122e696764 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:55.413052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c36442-764f-4ebc-8353-6b2cd2570ca1 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:55.424030 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7c490a1f-617a-4368-bd41-8e122e696764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:55.461639 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:55.486297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:55.595536 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2eb0d7-c898-435c-93f2-bcce97e23a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:55.596163 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2eb0d7-c898-435c-93f2-bcce97e23a96 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:55.596453 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2eb0d7-c898-435c-93f2-bcce97e23a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:55.596727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2eb0d7-c898-435c-93f2-bcce97e23a96 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:55.602265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2eb0d7-c898-435c-93f2-bcce97e23a96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:55.608838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2eb0d7-c898-435c-93f2-bcce97e23a96 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:55.616976 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3736/7408] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:21:55.649696 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c490a1f-617a-4368-bd41-8e122e696764 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:55.652291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7c490a1f-617a-4368-bd41-8e122e696764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:55.690503 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3673/7409] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:21:55 2022] POST /identity/v3/users => generated 295 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:21:55.691416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2eb0d7-c898-435c-93f2-bcce97e23a96 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:55.706665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1b2eb0d7-c898-435c-93f2-bcce97e23a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:55.738193 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2eb0d7-c898-435c-93f2-bcce97e23a96 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:55.747956 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c35c12-7c0d-4c2b-a16b-1218b15ce7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:55.750284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c35c12-7c0d-4c2b-a16b-1218b15ce7a1 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:55.750647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c35c12-7c0d-4c2b-a16b-1218b15ce7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:55.750936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c35c12-7c0d-4c2b-a16b-1218b15ce7a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:55.753290 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c35c12-7c0d-4c2b-a16b-1218b15ce7a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:55.756762 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c35c12-7c0d-4c2b-a16b-1218b15ce7a1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:55.786983 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3674/7410] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:55.788551 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c35c12-7c0d-4c2b-a16b-1218b15ce7a1 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:55.801617 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c490a1f-617a-4368-bd41-8e122e696764 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:55.810446 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ce15d-b4a5-400a-956e-4aaa5edde88e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:55.811096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ce15d-b4a5-400a-956e-4aaa5edde88e service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:55.811442 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ce15d-b4a5-400a-956e-4aaa5edde88e service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:55.811777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ce15d-b4a5-400a-956e-4aaa5edde88e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:55.815816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c35c12-7c0d-4c2b-a16b-1218b15ce7a1 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:55.822642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ce15d-b4a5-400a-956e-4aaa5edde88e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:55.824442 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ce15d-b4a5-400a-956e-4aaa5edde88e service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:55.828076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbafa3-97fa-4a4d-8fd5-58fde09d23d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:55.831440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbafa3-97fa-4a4d-8fd5-58fde09d23d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:55.832382 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbafa3-97fa-4a4d-8fd5-58fde09d23d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:55.832382 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbafa3-97fa-4a4d-8fd5-58fde09d23d1 admin admin] PATH_INFO: `/v3/projects/6d82fd0ddd3c429a8de97e52b682fc58/users/341cf77726734c9bb07578960cd75017/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:55.839265 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3737/7411] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:21:55.874217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fbafa3-97fa-4a4d-8fd5-58fde09d23d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d82fd0ddd3c429a8de97e52b682fc58, user_id=341cf77726734c9bb07578960cd75017, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:55.877812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fbafa3-97fa-4a4d-8fd5-58fde09d23d1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:55.914810 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3675/7412] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:55 2022] PUT /identity/v3/projects/6d82fd0ddd3c429a8de97e52b682fc58/users/341cf77726734c9bb07578960cd75017/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:55.917463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ce15d-b4a5-400a-956e-4aaa5edde88e service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:55.935447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ce15d-b4a5-400a-956e-4aaa5edde88e service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:56.116999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07859f7a-50f5-4841-b615-2212aa07bbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:56.117780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07859f7a-50f5-4841-b615-2212aa07bbb2 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:56.118195 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07859f7a-50f5-4841-b615-2212aa07bbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:56.119052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07859f7a-50f5-4841-b615-2212aa07bbb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:56.122196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07859f7a-50f5-4841-b615-2212aa07bbb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:56.124271 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07859f7a-50f5-4841-b615-2212aa07bbb2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:56.141291 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3738/7413] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:21:56.145213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbafa3-97fa-4a4d-8fd5-58fde09d23d1 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:56.167575 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbafa3-97fa-4a4d-8fd5-58fde09d23d1 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:56.184030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b958ccc-4c9d-4670-8617-74d34c0be667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:56.187318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b958ccc-4c9d-4670-8617-74d34c0be667 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:56.189267 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b958ccc-4c9d-4670-8617-74d34c0be667 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:56.189743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b958ccc-4c9d-4670-8617-74d34c0be667 admin admin] PATH_INFO: `/v3/projects/6d82fd0ddd3c429a8de97e52b682fc58/users/341cf77726734c9bb07578960cd75017/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:56.202693 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b958ccc-4c9d-4670-8617-74d34c0be667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d82fd0ddd3c429a8de97e52b682fc58, user_id=341cf77726734c9bb07578960cd75017, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:56.210514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b958ccc-4c9d-4670-8617-74d34c0be667 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:56.250946 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3676/7414] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:21:56 2022] PUT /identity/v3/projects/6d82fd0ddd3c429a8de97e52b682fc58/users/341cf77726734c9bb07578960cd75017/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:56.652423 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07859f7a-50f5-4841-b615-2212aa07bbb2 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:56.655470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-07859f7a-50f5-4841-b615-2212aa07bbb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:56.794187 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b958ccc-4c9d-4670-8617-74d34c0be667 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:56.797166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5b958ccc-4c9d-4670-8617-74d34c0be667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:56.904817 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07859f7a-50f5-4841-b615-2212aa07bbb2 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:56.924667 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:57.003852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b958ccc-4c9d-4670-8617-74d34c0be667 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:57.020208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f38ac-0bab-4713-8e88-410a68383ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:57.021303 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f38ac-0bab-4713-8e88-410a68383ae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:57.023094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f38ac-0bab-4713-8e88-410a68383ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:57.023731 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f38ac-0bab-4713-8e88-410a68383ae6 admin admin] PATH_INFO: `/v3/projects/3663b13dd84f4d87954147b0fea50778` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:57.030873 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f38ac-0bab-4713-8e88-410a68383ae6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3663b13dd84f4d87954147b0fea50778)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:57.035589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f38ac-0bab-4713-8e88-410a68383ae6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:57.065830 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666419ae-e349-49cb-b885-56b173a67734 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:57.066787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666419ae-e349-49cb-b885-56b173a67734 service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:57.067227 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666419ae-e349-49cb-b885-56b173a67734 service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:57.067698 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666419ae-e349-49cb-b885-56b173a67734 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:57.069756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-666419ae-e349-49cb-b885-56b173a67734 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:57.113729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666419ae-e349-49cb-b885-56b173a67734 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:57.115699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666419ae-e349-49cb-b885-56b173a67734 service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:57.146947 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3739/7415] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:57.258761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b08f38ac-0bab-4713-8e88-410a68383ae6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3663b13dd84f4d87954147b0fea50778', 'request_id': 'req-b08f38ac-0bab-4713-8e88-410a68383ae6'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:57.286632 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b08f38ac-0bab-4713-8e88-410a68383ae6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3663b13dd84f4d87954147b0fea50778', 'request_id': 'req-b08f38ac-0bab-4713-8e88-410a68383ae6'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:57.300619 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b08f38ac-0bab-4713-8e88-410a68383ae6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3663b13dd84f4d87954147b0fea50778', 'request_id': 'req-b08f38ac-0bab-4713-8e88-410a68383ae6'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:57.315534 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=88,keystone:INSERT=6,keystone:DELETE=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:57.336108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b08f38ac-0bab-4713-8e88-410a68383ae6 admin admin] The token cache is being invalidate because project 3663b13dd84f4d87954147b0fea50778 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:21:57.336446 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b08f38ac-0bab-4713-8e88-410a68383ae6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:57.338063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b08f38ac-0bab-4713-8e88-410a68383ae6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:57.346066 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3677/7416] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:21:56 2022] DELETE /identity/v3/projects/3663b13dd84f4d87954147b0fea50778 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:57.351093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666419ae-e349-49cb-b885-56b173a67734 service placement] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:57.375980 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666419ae-e349-49cb-b885-56b173a67734 service placement] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:57.587882 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f22e00-aaca-43d1-a03e-b0d0c5ff569c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:57.589376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f22e00-aaca-43d1-a03e-b0d0c5ff569c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:57.589737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f22e00-aaca-43d1-a03e-b0d0c5ff569c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:57.590294 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f22e00-aaca-43d1-a03e-b0d0c5ff569c admin admin] PATH_INFO: `/v3/users/5d8d95fb9e35405882995ab4daf9f3bb` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:57.593907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f22e00-aaca-43d1-a03e-b0d0c5ff569c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d8d95fb9e35405882995ab4daf9f3bb)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:57.599581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f22e00-aaca-43d1-a03e-b0d0c5ff569c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:57.831291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a6f22e00-aaca-43d1-a03e-b0d0c5ff569c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d8d95fb9e35405882995ab4daf9f3bb'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:57.862812 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a6f22e00-aaca-43d1-a03e-b0d0c5ff569c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d8d95fb9e35405882995ab4daf9f3bb'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:57.865180 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a6f22e00-aaca-43d1-a03e-b0d0c5ff569c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d8d95fb9e35405882995ab4daf9f3bb'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:57.865860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a6f22e00-aaca-43d1-a03e-b0d0c5ff569c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d8d95fb9e35405882995ab4daf9f3bb'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:57.905674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a6f22e00-aaca-43d1-a03e-b0d0c5ff569c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d8d95fb9e35405882995ab4daf9f3bb'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:57.949439 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3740/7417] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:21:57 2022] DELETE /identity/v3/users/5d8d95fb9e35405882995ab4daf9f3bb => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:58.100600 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f38ac-0bab-4713-8e88-410a68383ae6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:58.104939 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b08f38ac-0bab-4713-8e88-410a68383ae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:58.198440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f22e00-aaca-43d1-a03e-b0d0c5ff569c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:58.201881 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a6f22e00-aaca-43d1-a03e-b0d0c5ff569c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:58.282764 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:58.354420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f38ac-0bab-4713-8e88-410a68383ae6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:58.447336 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f22e00-aaca-43d1-a03e-b0d0c5ff569c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:58.455753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e0e16-a29b-463c-b241-dca231e04d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:58.456686 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e0e16-a29b-463c-b241-dca231e04d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:58.457617 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e0e16-a29b-463c-b241-dca231e04d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:58.458023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e0e16-a29b-463c-b241-dca231e04d4c admin admin] PATH_INFO: `/v3/users/e63fbea26373463f8e97bd38a0bc6688` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:58.460234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e0e16-a29b-463c-b241-dca231e04d4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e63fbea26373463f8e97bd38a0bc6688)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:58.463839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e0e16-a29b-463c-b241-dca231e04d4c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:58.558240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b90c1-0d59-4838-b97d-acea9747144d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:58.559958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b90c1-0d59-4838-b97d-acea9747144d service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:58.560250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b90c1-0d59-4838-b97d-acea9747144d service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:58.560531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b90c1-0d59-4838-b97d-acea9747144d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:58.562401 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0a9b90c1-0d59-4838-b97d-acea9747144d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:58.577854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b90c1-0d59-4838-b97d-acea9747144d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:58.579939 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b90c1-0d59-4838-b97d-acea9747144d service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:58.609096 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3678/7418] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:58.612646 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5afe8-4df4-4f4c-8f08-2e0f59d4d168 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:58.612790 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-285e0e16-a29b-463c-b241-dca231e04d4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e63fbea26373463f8e97bd38a0bc6688'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:58.612980 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5afe8-4df4-4f4c-8f08-2e0f59d4d168 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:58.614277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5afe8-4df4-4f4c-8f08-2e0f59d4d168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:58.645205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-285e0e16-a29b-463c-b241-dca231e04d4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e63fbea26373463f8e97bd38a0bc6688'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:58.647595 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-285e0e16-a29b-463c-b241-dca231e04d4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e63fbea26373463f8e97bd38a0bc6688'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:58.649437 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-285e0e16-a29b-463c-b241-dca231e04d4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e63fbea26373463f8e97bd38a0bc6688'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:58.675569 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-285e0e16-a29b-463c-b241-dca231e04d4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e63fbea26373463f8e97bd38a0bc6688'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:58.694267 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-5cc5afe8-4df4-4f4c-8f08-2e0f59d4d168 None None] MFA Rules not processed for user `341cf77726734c9bb07578960cd75017`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:58.695624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5cc5afe8-4df4-4f4c-8f08-2e0f59d4d168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:58.742346 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3741/7419] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:21:58 2022] DELETE /identity/v3/users/e63fbea26373463f8e97bd38a0bc6688 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:58.897310 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e0e16-a29b-463c-b241-dca231e04d4c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:58.905947 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-285e0e16-a29b-463c-b241-dca231e04d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:58.907615 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3679/7420] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:58.915123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655aa89d-7ec5-42a1-9b4c-4a3a00b9b9ae None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:58.917610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655aa89d-7ec5-42a1-9b4c-4a3a00b9b9ae None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:58.917899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655aa89d-7ec5-42a1-9b4c-4a3a00b9b9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:58.998710 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-655aa89d-7ec5-42a1-9b4c-4a3a00b9b9ae None None] MFA Rules not processed for user `84b077253cd94d51ae9dc848e62aa937`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:59.000237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-655aa89d-7ec5-42a1-9b4c-4a3a00b9b9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:59.014641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:59.086952 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3680/7421] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:59.089908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e0e16-a29b-463c-b241-dca231e04d4c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:59.107327 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655aa89d-7ec5-42a1-9b4c-4a3a00b9b9ae None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:59.110537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-655aa89d-7ec5-42a1-9b4c-4a3a00b9b9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:59.118048 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9cc46-3736-4f12-81d5-553a7bafde7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:59.118895 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9cc46-3736-4f12-81d5-553a7bafde7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:59.119317 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9cc46-3736-4f12-81d5-553a7bafde7d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:59.121018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9cc46-3736-4f12-81d5-553a7bafde7d admin admin] PATH_INFO: `/v3/projects/a504b66cd8b2411bb499dab1cc90ed23` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:59.126169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9cc46-3736-4f12-81d5-553a7bafde7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a504b66cd8b2411bb499dab1cc90ed23)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:59.128543 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9cc46-3736-4f12-81d5-553a7bafde7d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:59.224668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:59.252539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1cb9cc46-3736-4f12-81d5-553a7bafde7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a504b66cd8b2411bb499dab1cc90ed23', 'request_id': 'req-1cb9cc46-3736-4f12-81d5-553a7bafde7d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:59.273935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1cb9cc46-3736-4f12-81d5-553a7bafde7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a504b66cd8b2411bb499dab1cc90ed23', 'request_id': 'req-1cb9cc46-3736-4f12-81d5-553a7bafde7d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:59.296755 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1cb9cc46-3736-4f12-81d5-553a7bafde7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a504b66cd8b2411bb499dab1cc90ed23', 'request_id': 'req-1cb9cc46-3736-4f12-81d5-553a7bafde7d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:59.309983 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655aa89d-7ec5-42a1-9b4c-4a3a00b9b9ae None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:59.334476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1cb9cc46-3736-4f12-81d5-553a7bafde7d admin admin] The token cache is being invalidate because project a504b66cd8b2411bb499dab1cc90ed23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:21:59.334902 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1cb9cc46-3736-4f12-81d5-553a7bafde7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:59.335620 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1cb9cc46-3736-4f12-81d5-553a7bafde7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:59.341823 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3742/7422] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:21:58 2022] DELETE /identity/v3/projects/a504b66cd8b2411bb499dab1cc90ed23 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:59.341823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9cc46-3736-4f12-81d5-553a7bafde7d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:59.344131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1cb9cc46-3736-4f12-81d5-553a7bafde7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:59.433514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9cc46-3736-4f12-81d5-553a7bafde7d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:59.434332 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894f160-ea52-4861-afe5-e83c042bfd0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:59.439097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc318bf-d3a3-4ff3-bbd0-83937308bb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:59.439798 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc318bf-d3a3-4ff3-bbd0-83937308bb50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:59.440056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc318bf-d3a3-4ff3-bbd0-83937308bb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:59.440332 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc318bf-d3a3-4ff3-bbd0-83937308bb50 admin admin] PATH_INFO: `/v3/projects/430d71c92050477cae2117986e31e3db` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:59.441039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894f160-ea52-4861-afe5-e83c042bfd0c service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:59.441486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc318bf-d3a3-4ff3-bbd0-83937308bb50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=430d71c92050477cae2117986e31e3db)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:59.444358 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc318bf-d3a3-4ff3-bbd0-83937308bb50 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:59.445163 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894f160-ea52-4861-afe5-e83c042bfd0c service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:59.445494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894f160-ea52-4861-afe5-e83c042bfd0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:59.451190 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b894f160-ea52-4861-afe5-e83c042bfd0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:59.533666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9cc318bf-d3a3-4ff3-bbd0-83937308bb50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '430d71c92050477cae2117986e31e3db', 'request_id': 'req-9cc318bf-d3a3-4ff3-bbd0-83937308bb50'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:59.542412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9cc318bf-d3a3-4ff3-bbd0-83937308bb50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '430d71c92050477cae2117986e31e3db', 'request_id': 'req-9cc318bf-d3a3-4ff3-bbd0-83937308bb50'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:59.563696 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9cc318bf-d3a3-4ff3-bbd0-83937308bb50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '430d71c92050477cae2117986e31e3db', 'request_id': 'req-9cc318bf-d3a3-4ff3-bbd0-83937308bb50'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:59.583526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9cc318bf-d3a3-4ff3-bbd0-83937308bb50 admin admin] The token cache is being invalidate because project 430d71c92050477cae2117986e31e3db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:21:59.584797 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9cc318bf-d3a3-4ff3-bbd0-83937308bb50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:59.585694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9cc318bf-d3a3-4ff3-bbd0-83937308bb50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:59.588183 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3743/7423] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:21:59 2022] DELETE /identity/v3/projects/430d71c92050477cae2117986e31e3db => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:59.589911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc318bf-d3a3-4ff3-bbd0-83937308bb50 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:59.591684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9cc318bf-d3a3-4ff3-bbd0-83937308bb50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:59.607210 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:59.635636 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b894f160-ea52-4861-afe5-e83c042bfd0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:59.637329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b894f160-ea52-4861-afe5-e83c042bfd0c service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:59.654673 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3681/7424] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:21:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:21:59.656102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805fabe-6722-4384-bdbb-b243590bd533 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:59.656453 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805fabe-6722-4384-bdbb-b243590bd533 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:59.656789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805fabe-6722-4384-bdbb-b243590bd533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:59.701119 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-6805fabe-6722-4384-bdbb-b243590bd533 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:59.702420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6805fabe-6722-4384-bdbb-b243590bd533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:59.778500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc318bf-d3a3-4ff3-bbd0-83937308bb50 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:59.785023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6e1b5-3286-4e03-b5f8-7619ada8bbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:59.786581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6e1b5-3286-4e03-b5f8-7619ada8bbf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:59.786866 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6e1b5-3286-4e03-b5f8-7619ada8bbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:59.787101 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6e1b5-3286-4e03-b5f8-7619ada8bbf3 admin admin] PATH_INFO: `/v3/users/5f40bb42a8c94eca9452d67fba3ef99f` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:59.788376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6e1b5-3286-4e03-b5f8-7619ada8bbf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f40bb42a8c94eca9452d67fba3ef99f)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:59.790502 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6e1b5-3286-4e03-b5f8-7619ada8bbf3 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:59.792560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:59.815728 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3682/7425] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:59.826323 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5acf049-1a19-44aa-9bf0-553a4e562c86 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:59.826646 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5acf049-1a19-44aa-9bf0-553a4e562c86 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:59.827022 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5acf049-1a19-44aa-9bf0-553a4e562c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:59.860784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a5acf049-1a19-44aa-9bf0-553a4e562c86 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:21:59.863266 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a5acf049-1a19-44aa-9bf0-553a4e562c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:59.873812 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1ef6e1b5-3286-4e03-b5f8-7619ada8bbf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f40bb42a8c94eca9452d67fba3ef99f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:59.877383 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3683/7426] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:21:59.880363 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5acf049-1a19-44aa-9bf0-553a4e562c86 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:59.886652 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1ef6e1b5-3286-4e03-b5f8-7619ada8bbf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f40bb42a8c94eca9452d67fba3ef99f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:59.887497 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1ef6e1b5-3286-4e03-b5f8-7619ada8bbf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f40bb42a8c94eca9452d67fba3ef99f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:59.888180 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1ef6e1b5-3286-4e03-b5f8-7619ada8bbf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f40bb42a8c94eca9452d67fba3ef99f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:59.900541 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5acf049-1a19-44aa-9bf0-553a4e562c86 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:21:59.900807 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1ef6e1b5-3286-4e03-b5f8-7619ada8bbf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f40bb42a8c94eca9452d67fba3ef99f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:21:59.910903 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b61f0-ab26-4b37-87da-905233043531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:21:59.914655 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b61f0-ab26-4b37-87da-905233043531 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:21:59.914961 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b61f0-ab26-4b37-87da-905233043531 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:21:59.915220 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b61f0-ab26-4b37-87da-905233043531 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:21:59.916833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b61f0-ab26-4b37-87da-905233043531 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:21:59.917412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b61f0-ab26-4b37-87da-905233043531 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:21:59.919938 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b61f0-ab26-4b37-87da-905233043531 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:21:59.941048 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3684/7427] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:21:59.941710 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3744/7428] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:21:59 2022] DELETE /identity/v3/users/5f40bb42a8c94eca9452d67fba3ef99f => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:21:59.945704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b61f0-ab26-4b37-87da-905233043531 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:21:59.948470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ca0b61f0-ab26-4b37-87da-905233043531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:21:59.962788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b61f0-ab26-4b37-87da-905233043531 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:00.131016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d90322-b3e7-4d2c-b063-f332ff227b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:00.131938 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d90322-b3e7-4d2c-b063-f332ff227b4b admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:00.132068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d90322-b3e7-4d2c-b063-f332ff227b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:00.132350 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d90322-b3e7-4d2c-b063-f332ff227b4b admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:00.133072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d90322-b3e7-4d2c-b063-f332ff227b4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:00.135543 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d90322-b3e7-4d2c-b063-f332ff227b4b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:00.175715 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3685/7429] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:21:59 2022] POST /identity/v3/projects => generated 387 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:22:00.176001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6e1b5-3286-4e03-b5f8-7619ada8bbf3 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:00.194228 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6e1b5-3286-4e03-b5f8-7619ada8bbf3 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:00.337877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff747702-67bf-40a3-af52-51b64dcd36c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:00.339093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff747702-67bf-40a3-af52-51b64dcd36c2 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:00.339375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff747702-67bf-40a3-af52-51b64dcd36c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:00.339695 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff747702-67bf-40a3-af52-51b64dcd36c2 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:00.340543 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff747702-67bf-40a3-af52-51b64dcd36c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:00.345422 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff747702-67bf-40a3-af52-51b64dcd36c2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:00.415049 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3745/7430] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:22:00 2022] POST /identity/v3/users => generated 294 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:22:00.420992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d90322-b3e7-4d2c-b063-f332ff227b4b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:00.433492 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d90322-b3e7-4d2c-b063-f332ff227b4b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:00.439311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04a435-82bc-445c-9cfe-7b8dfcf5d807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:00.439705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04a435-82bc-445c-9cfe-7b8dfcf5d807 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:00.440000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04a435-82bc-445c-9cfe-7b8dfcf5d807 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:00.440269 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04a435-82bc-445c-9cfe-7b8dfcf5d807 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:00.440916 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b04a435-82bc-445c-9cfe-7b8dfcf5d807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:00.442685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b04a435-82bc-445c-9cfe-7b8dfcf5d807 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:00.461118 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff747702-67bf-40a3-af52-51b64dcd36c2 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:00.462121 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3686/7431] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:22:00.476108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff747702-67bf-40a3-af52-51b64dcd36c2 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:00.485774 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442369b5-200a-4a3a-955b-36c30e86a8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:00.486482 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442369b5-200a-4a3a-955b-36c30e86a8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:00.486938 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442369b5-200a-4a3a-955b-36c30e86a8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:00.487524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442369b5-200a-4a3a-955b-36c30e86a8d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:00.488692 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442369b5-200a-4a3a-955b-36c30e86a8d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:00.490844 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442369b5-200a-4a3a-955b-36c30e86a8d9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:00.531313 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3746/7432] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:22:00.534418 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04a435-82bc-445c-9cfe-7b8dfcf5d807 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:00.550049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04a435-82bc-445c-9cfe-7b8dfcf5d807 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:00.591074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d3e78-0541-40b1-aab3-7f734aba5a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:00.592116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d3e78-0541-40b1-aab3-7f734aba5a2b admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:00.593831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d3e78-0541-40b1-aab3-7f734aba5a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:00.594128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d3e78-0541-40b1-aab3-7f734aba5a2b admin admin] PATH_INFO: `/v3/projects/d0fc4bb37fab4fbdb32543c22da5e199/users/c2511c9480024586999cea72a7f50826/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:00.611401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442369b5-200a-4a3a-955b-36c30e86a8d9 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:00.613567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-442369b5-200a-4a3a-955b-36c30e86a8d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:00.653276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442369b5-200a-4a3a-955b-36c30e86a8d9 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:00.658403 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d3e78-0541-40b1-aab3-7f734aba5a2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0fc4bb37fab4fbdb32543c22da5e199, user_id=c2511c9480024586999cea72a7f50826, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:00.668724 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d3e78-0541-40b1-aab3-7f734aba5a2b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:00.671262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9dead-0662-445a-bf6a-2c6c9ade7448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:00.672518 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9dead-0662-445a-bf6a-2c6c9ade7448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:00.677708 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9dead-0662-445a-bf6a-2c6c9ade7448 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:00.678145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9dead-0662-445a-bf6a-2c6c9ade7448 admin admin] PATH_INFO: `/v3/projects/bc3d05e8e7d94c61b269fd7393ebcd1d` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:00.680901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9dead-0662-445a-bf6a-2c6c9ade7448 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc3d05e8e7d94c61b269fd7393ebcd1d)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:00.686309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9dead-0662-445a-bf6a-2c6c9ade7448 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:00.711636 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3687/7433] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:22:00 2022] PUT /identity/v3/projects/d0fc4bb37fab4fbdb32543c22da5e199/users/c2511c9480024586999cea72a7f50826/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:22:00.717681 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d4f93-3756-41f2-89c8-ec93e7079ed2 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:00.718141 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d4f93-3756-41f2-89c8-ec93e7079ed2 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:00.718483 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d4f93-3756-41f2-89c8-ec93e7079ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:00.771035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d93d4f93-3756-41f2-89c8-ec93e7079ed2 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:22:00.772249 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d93d4f93-3756-41f2-89c8-ec93e7079ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:00.808825 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:00.864015 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3688/7434] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:22:00.866907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-22f9dead-0662-445a-bf6a-2c6c9ade7448 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc3d05e8e7d94c61b269fd7393ebcd1d', 'request_id': 'req-22f9dead-0662-445a-bf6a-2c6c9ade7448'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:00.875965 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=81,keystone:DELETE=15,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:00.878402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d4f93-3756-41f2-89c8-ec93e7079ed2 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:00.885914 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d93d4f93-3756-41f2-89c8-ec93e7079ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:00.894012 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-22f9dead-0662-445a-bf6a-2c6c9ade7448 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc3d05e8e7d94c61b269fd7393ebcd1d', 'request_id': 'req-22f9dead-0662-445a-bf6a-2c6c9ade7448'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:00.919918 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-22f9dead-0662-445a-bf6a-2c6c9ade7448 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc3d05e8e7d94c61b269fd7393ebcd1d', 'request_id': 'req-22f9dead-0662-445a-bf6a-2c6c9ade7448'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:00.952354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-22f9dead-0662-445a-bf6a-2c6c9ade7448 admin admin] The token cache is being invalidate because project bc3d05e8e7d94c61b269fd7393ebcd1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:22:00.952654 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-22f9dead-0662-445a-bf6a-2c6c9ade7448 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:00.956577 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-22f9dead-0662-445a-bf6a-2c6c9ade7448 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:00.958941 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3747/7435] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:22:00 2022] DELETE /identity/v3/projects/bc3d05e8e7d94c61b269fd7393ebcd1d => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:22:00.968290 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2814b9-d1c8-4e6a-acdb-6d2411ab713f None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:00.968290 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2814b9-d1c8-4e6a-acdb-6d2411ab713f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:00.968630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2814b9-d1c8-4e6a-acdb-6d2411ab713f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:00.997019 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d4f93-3756-41f2-89c8-ec93e7079ed2 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:01.002293 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-5a2814b9-d1c8-4e6a-acdb-6d2411ab713f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:22:01.003704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5a2814b9-d1c8-4e6a-acdb-6d2411ab713f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:01.103809 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3748/7436] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:22:01.106057 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab3874-2861-4dfd-a124-0d03ff7486ec None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:01.106505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab3874-2861-4dfd-a124-0d03ff7486ec None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:01.106958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab3874-2861-4dfd-a124-0d03ff7486ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:01.119664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49c09c-30ec-41af-9ed7-8bed2da78b91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:01.120478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49c09c-30ec-41af-9ed7-8bed2da78b91 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:01.120756 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49c09c-30ec-41af-9ed7-8bed2da78b91 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:01.121024 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49c09c-30ec-41af-9ed7-8bed2da78b91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:01.122966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ef49c09c-30ec-41af-9ed7-8bed2da78b91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:01.137192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49c09c-30ec-41af-9ed7-8bed2da78b91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:01.138667 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49c09c-30ec-41af-9ed7-8bed2da78b91 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:01.150134 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-1bab3874-2861-4dfd-a124-0d03ff7486ec None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:22:01.150523 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3689/7437] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:22:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:22:01.161688 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1bab3874-2861-4dfd-a124-0d03ff7486ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:01.173983 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3749/7438] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:22:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:22:01.178270 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49c09c-30ec-41af-9ed7-8bed2da78b91 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:01.195124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49c09c-30ec-41af-9ed7-8bed2da78b91 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:01.208759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e9902-7b5c-419e-a1c8-3cd890aea629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:01.210307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e9902-7b5c-419e-a1c8-3cd890aea629 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:01.210695 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e9902-7b5c-419e-a1c8-3cd890aea629 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:01.211045 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e9902-7b5c-419e-a1c8-3cd890aea629 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:01.211828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e9902-7b5c-419e-a1c8-3cd890aea629 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:22:01.212189 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e9902-7b5c-419e-a1c8-3cd890aea629 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:01.214725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e9902-7b5c-419e-a1c8-3cd890aea629 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:01.237805 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3690/7439] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:22:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:22:01.238464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab3874-2861-4dfd-a124-0d03ff7486ec None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:01.248501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab3874-2861-4dfd-a124-0d03ff7486ec None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:01.253842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7632908-9ee1-44b2-b663-1605bcd64b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:01.254734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7632908-9ee1-44b2-b663-1605bcd64b59 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:01.254929 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7632908-9ee1-44b2-b663-1605bcd64b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:01.255154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7632908-9ee1-44b2-b663-1605bcd64b59 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:01.255803 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7632908-9ee1-44b2-b663-1605bcd64b59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:01.257880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7632908-9ee1-44b2-b663-1605bcd64b59 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:01.298287 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3750/7440] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:22:01 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:22:01.303276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e9902-7b5c-419e-a1c8-3cd890aea629 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:01.314957 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e9902-7b5c-419e-a1c8-3cd890aea629 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:01.397766 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f23ec-779c-4dcb-9407-19b7de6fa330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:01.398784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f23ec-779c-4dcb-9407-19b7de6fa330 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:01.399212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f23ec-779c-4dcb-9407-19b7de6fa330 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:01.399738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f23ec-779c-4dcb-9407-19b7de6fa330 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:01.401985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f23ec-779c-4dcb-9407-19b7de6fa330 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:01.405488 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f23ec-779c-4dcb-9407-19b7de6fa330 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:01.439162 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:01.453926 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7632908-9ee1-44b2-b663-1605bcd64b59 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:01.470903 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3691/7441] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:22:01 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:22:01.475999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7632908-9ee1-44b2-b663-1605bcd64b59 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:01.491949 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b4b09-f1e5-4c0e-942f-56940950e684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:01.492966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b4b09-f1e5-4c0e-942f-56940950e684 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:01.493113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b4b09-f1e5-4c0e-942f-56940950e684 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:01.494501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b4b09-f1e5-4c0e-942f-56940950e684 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:01.496596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b4b09-f1e5-4c0e-942f-56940950e684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:01.500326 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b4b09-f1e5-4c0e-942f-56940950e684 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:01.532766 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3751/7442] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:22:01.536827 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f23ec-779c-4dcb-9407-19b7de6fa330 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:01.560319 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f23ec-779c-4dcb-9407-19b7de6fa330 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:01.567165 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487eda9-27f8-4499-962f-1183170ba1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:01.568356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487eda9-27f8-4499-962f-1183170ba1ba admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:01.569077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487eda9-27f8-4499-962f-1183170ba1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:01.569783 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487eda9-27f8-4499-962f-1183170ba1ba admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:01.571337 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3487eda9-27f8-4499-962f-1183170ba1ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:01.573781 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3487eda9-27f8-4499-962f-1183170ba1ba admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:01.601474 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3692/7443] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:22:01.601682 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b4b09-f1e5-4c0e-942f-56940950e684 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:01.632459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b4b09-f1e5-4c0e-942f-56940950e684 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:01.649933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26880b31-2f2c-414c-9557-f7b01cc1425f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:01.651230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26880b31-2f2c-414c-9557-f7b01cc1425f admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:01.651992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26880b31-2f2c-414c-9557-f7b01cc1425f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:01.652434 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26880b31-2f2c-414c-9557-f7b01cc1425f admin admin] PATH_INFO: `/v3/projects/d12f4b2bbfc3438fae396fedd6552a26/users/9c1b8e18f09047d598483fa8b5afcc9e/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:01.696079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26880b31-2f2c-414c-9557-f7b01cc1425f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d12f4b2bbfc3438fae396fedd6552a26, user_id=9c1b8e18f09047d598483fa8b5afcc9e, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:01.699457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26880b31-2f2c-414c-9557-f7b01cc1425f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:01.730223 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3752/7444] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:22:01 2022] PUT /identity/v3/projects/d12f4b2bbfc3438fae396fedd6552a26/users/9c1b8e18f09047d598483fa8b5afcc9e/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:22:01.742598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6841786-bdd0-4e3c-adba-6e8cd9348352 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:01.742598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6841786-bdd0-4e3c-adba-6e8cd9348352 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:01.749489 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6841786-bdd0-4e3c-adba-6e8cd9348352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:01.818768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-b6841786-bdd0-4e3c-adba-6e8cd9348352 None None] MFA Rules not processed for user `9c1b8e18f09047d598483fa8b5afcc9e`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:22:01.821015 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b6841786-bdd0-4e3c-adba-6e8cd9348352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:02.029446 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3693/7445] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:22:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:22:02.033491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26880b31-2f2c-414c-9557-f7b01cc1425f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:02.241607 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26880b31-2f2c-414c-9557-f7b01cc1425f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:02.249636 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c025d3-2709-4575-8c21-3f8da892d2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:02.250515 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c025d3-2709-4575-8c21-3f8da892d2e6 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:02.250969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c025d3-2709-4575-8c21-3f8da892d2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:02.251503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c025d3-2709-4575-8c21-3f8da892d2e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:02.252517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c025d3-2709-4575-8c21-3f8da892d2e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:02.254617 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c025d3-2709-4575-8c21-3f8da892d2e6 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:02.327549 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3753/7446] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:22:02 2022] POST /identity/v3/projects => generated 385 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:22:02.331902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6841786-bdd0-4e3c-adba-6e8cd9348352 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:02.348733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6841786-bdd0-4e3c-adba-6e8cd9348352 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:02.555058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ae33f-26e1-4f3c-aaa9-1e802014bafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:02.555724 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ae33f-26e1-4f3c-aaa9-1e802014bafc admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:02.555990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ae33f-26e1-4f3c-aaa9-1e802014bafc admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:02.556286 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ae33f-26e1-4f3c-aaa9-1e802014bafc admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:02.557818 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ae33f-26e1-4f3c-aaa9-1e802014bafc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:02.568267 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ae33f-26e1-4f3c-aaa9-1e802014bafc admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:02.653165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c025d3-2709-4575-8c21-3f8da892d2e6 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:02.660550 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:02.666391 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3694/7447] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:22:02 2022] POST /identity/v3/users => generated 293 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:22:02.672093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c025d3-2709-4575-8c21-3f8da892d2e6 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:02.700439 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947ed09-f375-450c-b795-ffab358d0720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:02.701347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947ed09-f375-450c-b795-ffab358d0720 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:02.701957 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947ed09-f375-450c-b795-ffab358d0720 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:02.702400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947ed09-f375-450c-b795-ffab358d0720 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:02.703234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947ed09-f375-450c-b795-ffab358d0720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:02.705014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947ed09-f375-450c-b795-ffab358d0720 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:02.749660 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3754/7448] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:22:02.753142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ae33f-26e1-4f3c-aaa9-1e802014bafc admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:02.767077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ae33f-26e1-4f3c-aaa9-1e802014bafc admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:02.785491 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd58b9-b9dd-41b0-baee-2b7ceebfec8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:02.786134 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd58b9-b9dd-41b0-baee-2b7ceebfec8d admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:02.786418 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd58b9-b9dd-41b0-baee-2b7ceebfec8d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:02.786845 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd58b9-b9dd-41b0-baee-2b7ceebfec8d admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:02.787519 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd58b9-b9dd-41b0-baee-2b7ceebfec8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:02.789192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd58b9-b9dd-41b0-baee-2b7ceebfec8d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:02.830516 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3695/7449] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:22:02.834108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947ed09-f375-450c-b795-ffab358d0720 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:02.845296 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947ed09-f375-450c-b795-ffab358d0720 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:02.875524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0f801-0c75-488d-b9c9-1838168b54bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:02.876500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0f801-0c75-488d-b9c9-1838168b54bc admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:02.877348 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0f801-0c75-488d-b9c9-1838168b54bc admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:02.878482 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0f801-0c75-488d-b9c9-1838168b54bc admin admin] PATH_INFO: `/v3/projects/9805b3f3d34b4800a88862000d9fdc16/users/2231f5e86f0642a4acf702913e559284/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:02.929130 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0f801-0c75-488d-b9c9-1838168b54bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9805b3f3d34b4800a88862000d9fdc16, user_id=2231f5e86f0642a4acf702913e559284, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:02.932755 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0f801-0c75-488d-b9c9-1838168b54bc admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:02.959652 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3755/7450] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:22:02 2022] PUT /identity/v3/projects/9805b3f3d34b4800a88862000d9fdc16/users/2231f5e86f0642a4acf702913e559284/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:22:02.971692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58cfb2-538e-4a08-9747-41eb1f947280 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:02.972051 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58cfb2-538e-4a08-9747-41eb1f947280 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:02.972292 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58cfb2-538e-4a08-9747-41eb1f947280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:03.029659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-ae58cfb2-538e-4a08-9747-41eb1f947280 None None] MFA Rules not processed for user `2231f5e86f0642a4acf702913e559284`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:22:03.031262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ae58cfb2-538e-4a08-9747-41eb1f947280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:03.138307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:03.195604 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3696/7451] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:22:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:22:03.198515 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0f801-0c75-488d-b9c9-1838168b54bc admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:03.454339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0f801-0c75-488d-b9c9-1838168b54bc admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:03.496132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee09986-fac4-4f58-952e-0b56cc01de76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:03.504481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee09986-fac4-4f58-952e-0b56cc01de76 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:03.504921 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee09986-fac4-4f58-952e-0b56cc01de76 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:03.505210 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee09986-fac4-4f58-952e-0b56cc01de76 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:03.505912 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee09986-fac4-4f58-952e-0b56cc01de76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:03.507890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee09986-fac4-4f58-952e-0b56cc01de76 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:03.635427 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3756/7452] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:22:03 2022] POST /identity/v3/projects => generated 383 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:22:03.640784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58cfb2-538e-4a08-9747-41eb1f947280 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:03.662360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58cfb2-538e-4a08-9747-41eb1f947280 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:03.926188 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164dd3e-e610-494f-936a-928ec9b21144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:03.926994 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164dd3e-e610-494f-936a-928ec9b21144 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:03.927306 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164dd3e-e610-494f-936a-928ec9b21144 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:03.929087 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164dd3e-e610-494f-936a-928ec9b21144 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:03.931584 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164dd3e-e610-494f-936a-928ec9b21144 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:03.941748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164dd3e-e610-494f-936a-928ec9b21144 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:03.996352 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3697/7453] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:22:03 2022] POST /identity/v3/users => generated 298 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:22:03.997829 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee09986-fac4-4f58-952e-0b56cc01de76 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:04.017334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee09986-fac4-4f58-952e-0b56cc01de76 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:04.045946 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3c9b0-f114-4574-886a-f17ad8cb8c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:04.046621 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3c9b0-f114-4574-886a-f17ad8cb8c42 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:04.046906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3c9b0-f114-4574-886a-f17ad8cb8c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:04.047995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3c9b0-f114-4574-886a-f17ad8cb8c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:04.048843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3c9b0-f114-4574-886a-f17ad8cb8c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:04.051265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3c9b0-f114-4574-886a-f17ad8cb8c42 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:04.068586 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3757/7454] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:22:04.074487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164dd3e-e610-494f-936a-928ec9b21144 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:04.087492 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164dd3e-e610-494f-936a-928ec9b21144 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:04.106842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df6b93-390a-4c66-b097-a089e17cdddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:04.108166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df6b93-390a-4c66-b097-a089e17cdddc admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:04.108682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df6b93-390a-4c66-b097-a089e17cdddc admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:04.109333 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df6b93-390a-4c66-b097-a089e17cdddc admin admin] PATH_INFO: `/v3/projects/536ee009602140488ef6556e2721228a/users/71c1e66a826049608caf8ea2a7ae20ba/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:04.139890 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df6b93-390a-4c66-b097-a089e17cdddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=536ee009602140488ef6556e2721228a, user_id=71c1e66a826049608caf8ea2a7ae20ba, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:04.142681 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df6b93-390a-4c66-b097-a089e17cdddc admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:04.167764 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3698/7455] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:22:04 2022] PUT /identity/v3/projects/536ee009602140488ef6556e2721228a/users/71c1e66a826049608caf8ea2a7ae20ba/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:22:04.169256 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3c9b0-f114-4574-886a-f17ad8cb8c42 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:04.185292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3c9b0-f114-4574-886a-f17ad8cb8c42 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:04.315368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016481e-811d-48f7-bf0e-b374130083ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:04.316762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016481e-811d-48f7-bf0e-b374130083ac admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:04.317375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016481e-811d-48f7-bf0e-b374130083ac admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:04.317716 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016481e-811d-48f7-bf0e-b374130083ac admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:04.318668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016481e-811d-48f7-bf0e-b374130083ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:04.324922 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016481e-811d-48f7-bf0e-b374130083ac admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:04.349676 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3758/7456] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:22:04.350412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df6b93-390a-4c66-b097-a089e17cdddc admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:04.369760 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df6b93-390a-4c66-b097-a089e17cdddc admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:04.382359 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd1fbb-ecbe-4ae8-8d79-9f82c4a56a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:04.383692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd1fbb-ecbe-4ae8-8d79-9f82c4a56a3a admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:04.384202 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd1fbb-ecbe-4ae8-8d79-9f82c4a56a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:04.384722 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd1fbb-ecbe-4ae8-8d79-9f82c4a56a3a admin admin] PATH_INFO: `/v3/projects/536ee009602140488ef6556e2721228a/users/71c1e66a826049608caf8ea2a7ae20ba/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:04.387370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd1fbb-ecbe-4ae8-8d79-9f82c4a56a3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=536ee009602140488ef6556e2721228a, user_id=71c1e66a826049608caf8ea2a7ae20ba, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:04.393457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd1fbb-ecbe-4ae8-8d79-9f82c4a56a3a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:04.436455 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3699/7457] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:22:04 2022] PUT /identity/v3/projects/536ee009602140488ef6556e2721228a/users/71c1e66a826049608caf8ea2a7ae20ba/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:22:04.449477 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae7b83-d12d-4fe9-a6b3-d4f26814b606 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:04.449947 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae7b83-d12d-4fe9-a6b3-d4f26814b606 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:04.450318 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae7b83-d12d-4fe9-a6b3-d4f26814b606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:04.486456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-79ae7b83-d12d-4fe9-a6b3-d4f26814b606 None None] MFA Rules not processed for user `71c1e66a826049608caf8ea2a7ae20ba`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:22:04.491694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-79ae7b83-d12d-4fe9-a6b3-d4f26814b606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:04.533444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:04.832438 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3759/7458] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:22:04 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:22:04.845791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd1fbb-ecbe-4ae8-8d79-9f82c4a56a3a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:04.847625 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b0bd1fbb-ecbe-4ae8-8d79-9f82c4a56a3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:04.995568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd1fbb-ecbe-4ae8-8d79-9f82c4a56a3a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:05.005583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac516b-cb95-4392-aa6b-efe60a2beb3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:05.006311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac516b-cb95-4392-aa6b-efe60a2beb3a service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:05.009110 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac516b-cb95-4392-aa6b-efe60a2beb3a service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:05.009424 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac516b-cb95-4392-aa6b-efe60a2beb3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:05.164797 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:05.197344 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac516b-cb95-4392-aa6b-efe60a2beb3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:05.199282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac516b-cb95-4392-aa6b-efe60a2beb3a service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:05.238058 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3700/7459] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:22:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:22:08.426801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae7b83-d12d-4fe9-a6b3-d4f26814b606 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:08.443764 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae7b83-d12d-4fe9-a6b3-d4f26814b606 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:08.455183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b3a5c-d0e5-45a1-8c40-204370c5a8e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:08.457979 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b3a5c-d0e5-45a1-8c40-204370c5a8e6 service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:08.458304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b3a5c-d0e5-45a1-8c40-204370c5a8e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:08.458679 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b3a5c-d0e5-45a1-8c40-204370c5a8e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:08.675876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b3a5c-d0e5-45a1-8c40-204370c5a8e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:08.675876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b3a5c-d0e5-45a1-8c40-204370c5a8e6 service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:08.707596 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3760/7460] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:22:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:22:11.987440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac516b-cb95-4392-aa6b-efe60a2beb3a service cinder] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:11.990136 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ceac516b-cb95-4392-aa6b-efe60a2beb3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:12.136930 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b3a5c-d0e5-45a1-8c40-204370c5a8e6 service cinder] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:12.139088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3e9b3a5c-d0e5-45a1-8c40-204370c5a8e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:12.172392 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b3a5c-d0e5-45a1-8c40-204370c5a8e6 service cinder] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:12.187287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a2523-2cce-4dfd-91e3-f2a2f76b2ff0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:12.190129 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a2523-2cce-4dfd-91e3-f2a2f76b2ff0 service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:12.190417 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a2523-2cce-4dfd-91e3-f2a2f76b2ff0 service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:12.190723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a2523-2cce-4dfd-91e3-f2a2f76b2ff0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:12.216423 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a2523-2cce-4dfd-91e3-f2a2f76b2ff0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:12.220622 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a2523-2cce-4dfd-91e3-f2a2f76b2ff0 service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:12.252679 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3761/7461] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:22:12 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:22:12.281481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac516b-cb95-4392-aa6b-efe60a2beb3a service cinder] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:12.287742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79456f4-12c8-4c79-a17e-c8230cd6d2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:12.288637 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79456f4-12c8-4c79-a17e-c8230cd6d2a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:12.289101 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79456f4-12c8-4c79-a17e-c8230cd6d2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:12.289525 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79456f4-12c8-4c79-a17e-c8230cd6d2a2 admin admin] PATH_INFO: `/v3/users/2a93852c0d284270bac8bfc209dc8293` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:12.292325 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79456f4-12c8-4c79-a17e-c8230cd6d2a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a93852c0d284270bac8bfc209dc8293)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:12.294835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79456f4-12c8-4c79-a17e-c8230cd6d2a2 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:12.357046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec25419-ddd6-4425-ba84-f8963afe9098 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:12.357329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec25419-ddd6-4425-ba84-f8963afe9098 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:12.357881 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec25419-ddd6-4425-ba84-f8963afe9098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:12.464328 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b79456f4-12c8-4c79-a17e-c8230cd6d2a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a93852c0d284270bac8bfc209dc8293'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:12.465503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-aec25419-ddd6-4425-ba84-f8963afe9098 None None] MFA Rules not processed for user `c2511c9480024586999cea72a7f50826`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:22:12.467114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b79456f4-12c8-4c79-a17e-c8230cd6d2a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a93852c0d284270bac8bfc209dc8293'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:12.467597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-aec25419-ddd6-4425-ba84-f8963afe9098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:12.469363 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b79456f4-12c8-4c79-a17e-c8230cd6d2a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a93852c0d284270bac8bfc209dc8293'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:12.485411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b79456f4-12c8-4c79-a17e-c8230cd6d2a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a93852c0d284270bac8bfc209dc8293'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:12.514214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b79456f4-12c8-4c79-a17e-c8230cd6d2a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a93852c0d284270bac8bfc209dc8293'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:12.539544 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3701/7462] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:22:11 2022] DELETE /identity/v3/users/2a93852c0d284270bac8bfc209dc8293 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:22:12.544068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79456f4-12c8-4c79-a17e-c8230cd6d2a2 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:12.549979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b79456f4-12c8-4c79-a17e-c8230cd6d2a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:12.704640 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:12.708025 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3762/7463] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:22:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:22:12.723270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c74d4f-6e10-4be3-ab3e-3ad122b02d3c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:12.723727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c74d4f-6e10-4be3-ab3e-3ad122b02d3c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:12.725636 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c74d4f-6e10-4be3-ab3e-3ad122b02d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:12.770151 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79456f4-12c8-4c79-a17e-c8230cd6d2a2 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:12.804392 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1d86fd-b7c0-47d8-b0ef-d6a79dae71c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:12.805310 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d86fd-b7c0-47d8-b0ef-d6a79dae71c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:12.805433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d86fd-b7c0-47d8-b0ef-d6a79dae71c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:12.805634 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d86fd-b7c0-47d8-b0ef-d6a79dae71c4 admin admin] PATH_INFO: `/v3/users/78c647f257a546b8be6bf4983b464af1` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:12.820540 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1d86fd-b7c0-47d8-b0ef-d6a79dae71c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78c647f257a546b8be6bf4983b464af1)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:12.823571 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-89c74d4f-6e10-4be3-ab3e-3ad122b02d3c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:22:12.824622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1d86fd-b7c0-47d8-b0ef-d6a79dae71c4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:12.825088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-89c74d4f-6e10-4be3-ab3e-3ad122b02d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:12.838495 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3763/7464] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:22:12.850249 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c74d4f-6e10-4be3-ab3e-3ad122b02d3c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:12.864158 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-89c74d4f-6e10-4be3-ab3e-3ad122b02d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:12.941828 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:12.959251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ed1d86fd-b7c0-47d8-b0ef-d6a79dae71c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78c647f257a546b8be6bf4983b464af1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:12.960558 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ed1d86fd-b7c0-47d8-b0ef-d6a79dae71c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78c647f257a546b8be6bf4983b464af1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:12.961594 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ed1d86fd-b7c0-47d8-b0ef-d6a79dae71c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78c647f257a546b8be6bf4983b464af1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:13.011014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ed1d86fd-b7c0-47d8-b0ef-d6a79dae71c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78c647f257a546b8be6bf4983b464af1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:13.034045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c74d4f-6e10-4be3-ab3e-3ad122b02d3c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:13.045624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ed1d86fd-b7c0-47d8-b0ef-d6a79dae71c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78c647f257a546b8be6bf4983b464af1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:13.057610 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09508d22-1870-4537-9e0c-db0373ec6f33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:13.058306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09508d22-1870-4537-9e0c-db0373ec6f33 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:13.058619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09508d22-1870-4537-9e0c-db0373ec6f33 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:13.058904 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09508d22-1870-4537-9e0c-db0373ec6f33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:13.072481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-09508d22-1870-4537-9e0c-db0373ec6f33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:13.082779 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3702/7465] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:22:12 2022] DELETE /identity/v3/users/78c647f257a546b8be6bf4983b464af1 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:22:13.093808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03514d93-2bf6-4069-a1fc-06a47f149163 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:13.094335 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03514d93-2bf6-4069-a1fc-06a47f149163 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:13.095127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03514d93-2bf6-4069-a1fc-06a47f149163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:13.144557 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09508d22-1870-4537-9e0c-db0373ec6f33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:13.146976 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-03514d93-2bf6-4069-a1fc-06a47f149163 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:22:13.150862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09508d22-1870-4537-9e0c-db0373ec6f33 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:13.151151 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-03514d93-2bf6-4069-a1fc-06a47f149163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:13.218214 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3764/7466] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:22:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:22:13.286027 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3703/7467] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:22:13.320980 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09508d22-1870-4537-9e0c-db0373ec6f33 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:13.320980 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-09508d22-1870-4537-9e0c-db0373ec6f33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:13.342335 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09508d22-1870-4537-9e0c-db0373ec6f33 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:13.472910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010b33b-319d-4d69-9dde-eeca48a435ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:13.473543 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010b33b-319d-4d69-9dde-eeca48a435ba service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:13.473823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010b33b-319d-4d69-9dde-eeca48a435ba service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:13.474099 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010b33b-319d-4d69-9dde-eeca48a435ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:13.484594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2010b33b-319d-4d69-9dde-eeca48a435ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:13.486055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2010b33b-319d-4d69-9dde-eeca48a435ba service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:13.508096 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3765/7468] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:22:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:22:14.332440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03514d93-2bf6-4069-a1fc-06a47f149163 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:14.335254 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-03514d93-2bf6-4069-a1fc-06a47f149163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:14.475002 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03514d93-2bf6-4069-a1fc-06a47f149163 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:14.490737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7de25-95c0-4506-af2c-c03f3e8be978 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:14.491402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7de25-95c0-4506-af2c-c03f3e8be978 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:14.491675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7de25-95c0-4506-af2c-c03f3e8be978 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:14.491945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7de25-95c0-4506-af2c-c03f3e8be978 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:14.495696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-49e7de25-95c0-4506-af2c-c03f3e8be978 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:14.512556 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:14.520121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010b33b-319d-4d69-9dde-eeca48a435ba service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:14.522858 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2010b33b-319d-4d69-9dde-eeca48a435ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:14.549403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010b33b-319d-4d69-9dde-eeca48a435ba service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:14.565112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1aa2b4-8a12-4043-8464-082ab1febd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:14.566121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1aa2b4-8a12-4043-8464-082ab1febd7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:14.566758 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1aa2b4-8a12-4043-8464-082ab1febd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:14.569642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1aa2b4-8a12-4043-8464-082ab1febd7f admin admin] PATH_INFO: `/v3/projects/ae2ec7ca33064d058e17d7f10e583d42` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:14.571397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1aa2b4-8a12-4043-8464-082ab1febd7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae2ec7ca33064d058e17d7f10e583d42)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:14.576267 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1aa2b4-8a12-4043-8464-082ab1febd7f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:14.695369 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7de25-95c0-4506-af2c-c03f3e8be978 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:14.697243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7de25-95c0-4506-af2c-c03f3e8be978 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:14.711595 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9a1aa2b4-8a12-4043-8464-082ab1febd7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae2ec7ca33064d058e17d7f10e583d42', 'request_id': 'req-9a1aa2b4-8a12-4043-8464-082ab1febd7f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:14.733778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9a1aa2b4-8a12-4043-8464-082ab1febd7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae2ec7ca33064d058e17d7f10e583d42', 'request_id': 'req-9a1aa2b4-8a12-4043-8464-082ab1febd7f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:14.735066 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3704/7469] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:22:14 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:22:14.737402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7de25-95c0-4506-af2c-c03f3e8be978 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:14.741392 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-49e7de25-95c0-4506-af2c-c03f3e8be978 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:14.752203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9a1aa2b4-8a12-4043-8464-082ab1febd7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae2ec7ca33064d058e17d7f10e583d42', 'request_id': 'req-9a1aa2b4-8a12-4043-8464-082ab1febd7f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:14.769719 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7de25-95c0-4506-af2c-c03f3e8be978 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:14.771905 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9a1aa2b4-8a12-4043-8464-082ab1febd7f admin admin] The token cache is being invalidate because project ae2ec7ca33064d058e17d7f10e583d42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:22:14.773137 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9a1aa2b4-8a12-4043-8464-082ab1febd7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:14.774937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9a1aa2b4-8a12-4043-8464-082ab1febd7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:14.780258 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3766/7470] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:22:14 2022] DELETE /identity/v3/projects/ae2ec7ca33064d058e17d7f10e583d42 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:22:14.786533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565aefd-75c5-466c-8da9-a8b7d36ec1f9 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:14.787306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565aefd-75c5-466c-8da9-a8b7d36ec1f9 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:14.787997 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565aefd-75c5-466c-8da9-a8b7d36ec1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:14.932266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b565aefd-75c5-466c-8da9-a8b7d36ec1f9 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:22:14.941610 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b565aefd-75c5-466c-8da9-a8b7d36ec1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:15.035772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee28ec3-8093-4192-b99e-2da232a08e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:15.042193 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee28ec3-8093-4192-b99e-2da232a08e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:15.042639 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee28ec3-8093-4192-b99e-2da232a08e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:15.046511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee28ec3-8093-4192-b99e-2da232a08e4e admin admin] PATH_INFO: `/v3/projects/94ee08c70f33492ea61b491137cd2ee4` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:15.051925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee28ec3-8093-4192-b99e-2da232a08e4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=94ee08c70f33492ea61b491137cd2ee4)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:15.061461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee28ec3-8093-4192-b99e-2da232a08e4e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:15.175010 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:15.266675 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3767/7471] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:22:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 482 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:22:15.275223 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66ba80-dbdd-4525-b673-51eea370aa71 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:15.275516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66ba80-dbdd-4525-b673-51eea370aa71 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:15.275918 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66ba80-dbdd-4525-b673-51eea370aa71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:15.304947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-cee28ec3-8093-4192-b99e-2da232a08e4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94ee08c70f33492ea61b491137cd2ee4', 'request_id': 'req-cee28ec3-8093-4192-b99e-2da232a08e4e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:15.333319 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-cee28ec3-8093-4192-b99e-2da232a08e4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94ee08c70f33492ea61b491137cd2ee4', 'request_id': 'req-cee28ec3-8093-4192-b99e-2da232a08e4e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:15.355057 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-cee28ec3-8093-4192-b99e-2da232a08e4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94ee08c70f33492ea61b491137cd2ee4', 'request_id': 'req-cee28ec3-8093-4192-b99e-2da232a08e4e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:15.356729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-5b66ba80-dbdd-4525-b673-51eea370aa71 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:22:15.357979 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5b66ba80-dbdd-4525-b673-51eea370aa71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:15.392996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-cee28ec3-8093-4192-b99e-2da232a08e4e admin admin] The token cache is being invalidate because project 94ee08c70f33492ea61b491137cd2ee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:22:15.393491 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-cee28ec3-8093-4192-b99e-2da232a08e4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:15.395104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-cee28ec3-8093-4192-b99e-2da232a08e4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:15.396976 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3705/7472] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:22:14 2022] DELETE /identity/v3/projects/94ee08c70f33492ea61b491137cd2ee4 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:22:15.402173 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2fb3e-cc77-4b81-b5ea-aaf4534951fd None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:15.410730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2fb3e-cc77-4b81-b5ea-aaf4534951fd None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:15.411014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2fb3e-cc77-4b81-b5ea-aaf4534951fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:15.457170 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-b6c2fb3e-cc77-4b81-b5ea-aaf4534951fd None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:22:15.458621 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b6c2fb3e-cc77-4b81-b5ea-aaf4534951fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:15.498004 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3768/7473] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:22:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:22:15.504071 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66ba80-dbdd-4525-b673-51eea370aa71 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:15.526136 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66ba80-dbdd-4525-b673-51eea370aa71 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:15.537182 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:15.544282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d6a0d-ed1c-45c5-8e75-2f6e8330dd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:15.544924 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d6a0d-ed1c-45c5-8e75-2f6e8330dd21 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:15.545216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d6a0d-ed1c-45c5-8e75-2f6e8330dd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:15.545604 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d6a0d-ed1c-45c5-8e75-2f6e8330dd21 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:15.546295 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d6a0d-ed1c-45c5-8e75-2f6e8330dd21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:22:15.552251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d6a0d-ed1c-45c5-8e75-2f6e8330dd21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:15.553656 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d6a0d-ed1c-45c5-8e75-2f6e8330dd21 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:15.586677 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3769/7474] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:22:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:22:15.587687 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d6a0d-ed1c-45c5-8e75-2f6e8330dd21 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:15.600951 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3706/7475] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:22:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:22:15.602709 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557c71b-79dd-4938-bb82-9f214f6411df None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:15.605180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557c71b-79dd-4938-bb82-9f214f6411df None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:15.605632 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557c71b-79dd-4938-bb82-9f214f6411df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:15.625390 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d6a0d-ed1c-45c5-8e75-2f6e8330dd21 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:15.646859 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e890f26-f893-44e8-946f-8e23650045c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:15.647876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e890f26-f893-44e8-946f-8e23650045c2 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:15.648326 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e890f26-f893-44e8-946f-8e23650045c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:15.648757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e890f26-f893-44e8-946f-8e23650045c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:15.649599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e890f26-f893-44e8-946f-8e23650045c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:15.654410 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e890f26-f893-44e8-946f-8e23650045c2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:15.663533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-5557c71b-79dd-4938-bb82-9f214f6411df None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:22:15.680139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5557c71b-79dd-4938-bb82-9f214f6411df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:15.724002 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3707/7476] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:22:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:22:15.728548 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3770/7477] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:22:15 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:22:15.730255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557c71b-79dd-4938-bb82-9f214f6411df None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:15.732542 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e890f26-f893-44e8-946f-8e23650045c2 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:15.788950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557c71b-79dd-4938-bb82-9f214f6411df None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:15.927961 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b6180-65b7-473e-b447-6457bd8144be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:15.928626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b6180-65b7-473e-b447-6457bd8144be admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:15.928912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b6180-65b7-473e-b447-6457bd8144be admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:15.929216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b6180-65b7-473e-b447-6457bd8144be admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:15.929828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b6180-65b7-473e-b447-6457bd8144be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:15.932101 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b6180-65b7-473e-b447-6457bd8144be admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:15.956309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e890f26-f893-44e8-946f-8e23650045c2 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:15.983972 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3708/7478] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:22:15 2022] POST /identity/v3/users => generated 293 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:22:15.984344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf6cff-3769-4bc9-b334-b0d52662c290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:15.987810 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b6180-65b7-473e-b447-6457bd8144be admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:15.988734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf6cff-3769-4bc9-b334-b0d52662c290 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:15.989504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf6cff-3769-4bc9-b334-b0d52662c290 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:15.989771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf6cff-3769-4bc9-b334-b0d52662c290 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:15.990461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf6cff-3769-4bc9-b334-b0d52662c290 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:22:15.996220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf6cff-3769-4bc9-b334-b0d52662c290 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:15.998402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf6cff-3769-4bc9-b334-b0d52662c290 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:16.013255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b6180-65b7-473e-b447-6457bd8144be admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:16.030849 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716ead3-f5d5-46d7-a105-5b970b916233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:16.030849 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716ead3-f5d5-46d7-a105-5b970b916233 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:16.030849 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716ead3-f5d5-46d7-a105-5b970b916233 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:16.030849 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716ead3-f5d5-46d7-a105-5b970b916233 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:16.031166 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3771/7479] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:22:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:22:16.032824 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716ead3-f5d5-46d7-a105-5b970b916233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:16.034515 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716ead3-f5d5-46d7-a105-5b970b916233 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:16.036773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf6cff-3769-4bc9-b334-b0d52662c290 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:16.070753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf6cff-3769-4bc9-b334-b0d52662c290 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:16.074617 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3709/7480] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:22:16.081901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c35264-26e7-49a5-abe8-37190b0440cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:16.082615 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716ead3-f5d5-46d7-a105-5b970b916233 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:16.083201 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c35264-26e7-49a5-abe8-37190b0440cb admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:16.083873 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c35264-26e7-49a5-abe8-37190b0440cb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:16.084445 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c35264-26e7-49a5-abe8-37190b0440cb admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:16.085220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c35264-26e7-49a5-abe8-37190b0440cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:16.088622 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c35264-26e7-49a5-abe8-37190b0440cb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:16.105113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716ead3-f5d5-46d7-a105-5b970b916233 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:16.120619 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e5692-733d-4942-9e60-9be274856c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:16.121245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e5692-733d-4942-9e60-9be274856c5c admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:16.121534 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e5692-733d-4942-9e60-9be274856c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:16.121914 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e5692-733d-4942-9e60-9be274856c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:16.122682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e5692-733d-4942-9e60-9be274856c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:16.124338 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e5692-733d-4942-9e60-9be274856c5c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:16.139935 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3710/7481] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:22:16.143549 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e5692-733d-4942-9e60-9be274856c5c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:16.159815 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e5692-733d-4942-9e60-9be274856c5c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:16.169861 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8abcf-af70-4dcf-ab97-6d73d6a3699d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:16.170838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8abcf-af70-4dcf-ab97-6d73d6a3699d admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:16.171452 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8abcf-af70-4dcf-ab97-6d73d6a3699d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:16.171828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8abcf-af70-4dcf-ab97-6d73d6a3699d admin admin] PATH_INFO: `/v3/projects/0a551e0a60084282aa0c986d737e30ce/users/d2580e8e5886464baa08bad44e397976/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:16.174888 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3772/7482] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:22:16 2022] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:22:16.179593 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c35264-26e7-49a5-abe8-37190b0440cb admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:16.205963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8abcf-af70-4dcf-ab97-6d73d6a3699d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a551e0a60084282aa0c986d737e30ce, user_id=d2580e8e5886464baa08bad44e397976, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:16.215731 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8abcf-af70-4dcf-ab97-6d73d6a3699d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:16.242510 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3711/7483] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:22:16 2022] PUT /identity/v3/projects/0a551e0a60084282aa0c986d737e30ce/users/d2580e8e5886464baa08bad44e397976/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:22:16.249310 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:16.253654 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6fb3b-1615-4990-9534-d41641d612bd None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:16.253972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6fb3b-1615-4990-9534-d41641d612bd None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:16.254372 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6fb3b-1615-4990-9534-d41641d612bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:16.317883 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-40e6fb3b-1615-4990-9534-d41641d612bd None None] MFA Rules not processed for user `d2580e8e5886464baa08bad44e397976`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:22:16.320630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-40e6fb3b-1615-4990-9534-d41641d612bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:16.355239 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c35264-26e7-49a5-abe8-37190b0440cb admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:16.427981 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3712/7484] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:22:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:22:16.451951 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6fb3b-1615-4990-9534-d41641d612bd None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:16.456649 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-40e6fb3b-1615-4990-9534-d41641d612bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:16.483366 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:16.485335 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018590a-25d2-4657-8486-771138d2daee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:16.486595 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018590a-25d2-4657-8486-771138d2daee admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:16.487965 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018590a-25d2-4657-8486-771138d2daee admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:16.487965 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018590a-25d2-4657-8486-771138d2daee admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:16.489177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8018590a-25d2-4657-8486-771138d2daee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:16.493010 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8018590a-25d2-4657-8486-771138d2daee admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:16.568995 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3773/7485] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:22:16 2022] POST /identity/v3/users => generated 288 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:22:16.573547 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018590a-25d2-4657-8486-771138d2daee admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:16.624098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018590a-25d2-4657-8486-771138d2daee admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:16.632216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d5536-512f-4564-a492-2256e0ef5974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:16.632839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d5536-512f-4564-a492-2256e0ef5974 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:16.633152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d5536-512f-4564-a492-2256e0ef5974 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:16.633429 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d5536-512f-4564-a492-2256e0ef5974 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:16.634263 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d5536-512f-4564-a492-2256e0ef5974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:16.636758 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d5536-512f-4564-a492-2256e0ef5974 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:16.654280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6fb3b-1615-4990-9534-d41641d612bd None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:16.661336 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d29a9-fe43-4d64-a7c4-2df217d2abc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:16.661895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d29a9-fe43-4d64-a7c4-2df217d2abc4 service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:16.662317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d29a9-fe43-4d64-a7c4-2df217d2abc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:16.662631 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d29a9-fe43-4d64-a7c4-2df217d2abc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:16.692977 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3774/7486] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:22:16.697211 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d29a9-fe43-4d64-a7c4-2df217d2abc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:16.698829 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d5536-512f-4564-a492-2256e0ef5974 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:16.698955 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d29a9-fe43-4d64-a7c4-2df217d2abc4 service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:16.731009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d5536-512f-4564-a492-2256e0ef5974 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:16.739187 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3713/7487] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:22:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:22:16.753751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055faf4d-7ee3-45fb-8277-85e880f92387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:16.754442 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055faf4d-7ee3-45fb-8277-85e880f92387 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:16.754754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055faf4d-7ee3-45fb-8277-85e880f92387 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:16.755163 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055faf4d-7ee3-45fb-8277-85e880f92387 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:16.755818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055faf4d-7ee3-45fb-8277-85e880f92387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:16.765016 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055faf4d-7ee3-45fb-8277-85e880f92387 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:16.787605 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3775/7488] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:22:16.788721 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d29a9-fe43-4d64-a7c4-2df217d2abc4 service cinder] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:16.825947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d29a9-fe43-4d64-a7c4-2df217d2abc4 service cinder] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:16.844968 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99f7e6-f702-4dbf-a505-7cbdbce1a123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:16.845866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99f7e6-f702-4dbf-a505-7cbdbce1a123 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:16.846153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99f7e6-f702-4dbf-a505-7cbdbce1a123 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:16.846510 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99f7e6-f702-4dbf-a505-7cbdbce1a123 admin admin] PATH_INFO: `/v3/projects/48b22626c5b54f7fa02570b7184d3d9b/users/576508c656f6423aa41c57876e740c27/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:16.881671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe99f7e6-f702-4dbf-a505-7cbdbce1a123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48b22626c5b54f7fa02570b7184d3d9b, user_id=576508c656f6423aa41c57876e740c27, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:16.884810 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe99f7e6-f702-4dbf-a505-7cbdbce1a123 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:16.918801 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3714/7489] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:22:16 2022] PUT /identity/v3/projects/48b22626c5b54f7fa02570b7184d3d9b/users/576508c656f6423aa41c57876e740c27/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:22:16.929360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91152d0a-1f20-42bd-80ad-ee5be18abb06 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:16.929655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91152d0a-1f20-42bd-80ad-ee5be18abb06 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:16.929952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91152d0a-1f20-42bd-80ad-ee5be18abb06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:16.966706 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-91152d0a-1f20-42bd-80ad-ee5be18abb06 None None] MFA Rules not processed for user `576508c656f6423aa41c57876e740c27`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:22:16.968284 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-91152d0a-1f20-42bd-80ad-ee5be18abb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:17.124497 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3776/7490] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:22:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:22:17.155325 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99f7e6-f702-4dbf-a505-7cbdbce1a123 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:17.157199 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-fe99f7e6-f702-4dbf-a505-7cbdbce1a123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:17.297473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99f7e6-f702-4dbf-a505-7cbdbce1a123 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:17.304811 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bedcd0-6395-47a1-9e3b-e8f43a193e0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:17.307856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bedcd0-6395-47a1-9e3b-e8f43a193e0e service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:17.309714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bedcd0-6395-47a1-9e3b-e8f43a193e0e service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:17.309714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bedcd0-6395-47a1-9e3b-e8f43a193e0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:17.329940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91152d0a-1f20-42bd-80ad-ee5be18abb06 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:17.331634 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-91152d0a-1f20-42bd-80ad-ee5be18abb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:17.360395 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bedcd0-6395-47a1-9e3b-e8f43a193e0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:17.361941 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bedcd0-6395-47a1-9e3b-e8f43a193e0e service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:17.404706 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3715/7491] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:22:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:22:17.407131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:17.543415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91152d0a-1f20-42bd-80ad-ee5be18abb06 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:17.548659 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553512e5-8233-4c55-a549-daef1121d446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:17.549571 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553512e5-8233-4c55-a549-daef1121d446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:17.550080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553512e5-8233-4c55-a549-daef1121d446 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:17.550528 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553512e5-8233-4c55-a549-daef1121d446 admin admin] PATH_INFO: `/v3/users/9c1b8e18f09047d598483fa8b5afcc9e` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:17.552243 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553512e5-8233-4c55-a549-daef1121d446 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c1b8e18f09047d598483fa8b5afcc9e)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:17.554442 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553512e5-8233-4c55-a549-daef1121d446 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:17.674397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-553512e5-8233-4c55-a549-daef1121d446 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c1b8e18f09047d598483fa8b5afcc9e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:17.701551 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-553512e5-8233-4c55-a549-daef1121d446 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c1b8e18f09047d598483fa8b5afcc9e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:17.702859 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-553512e5-8233-4c55-a549-daef1121d446 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c1b8e18f09047d598483fa8b5afcc9e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:17.703738 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-553512e5-8233-4c55-a549-daef1121d446 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c1b8e18f09047d598483fa8b5afcc9e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:17.717103 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-553512e5-8233-4c55-a549-daef1121d446 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c1b8e18f09047d598483fa8b5afcc9e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:17.822324 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3777/7492] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:22:17 2022] DELETE /identity/v3/users/9c1b8e18f09047d598483fa8b5afcc9e => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:22:17.829431 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f1eb3-10b4-4c16-b6fe-63f19b050c0c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:17.829981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f1eb3-10b4-4c16-b6fe-63f19b050c0c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:17.830078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f1eb3-10b4-4c16-b6fe-63f19b050c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:17.863347 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f83f1eb3-10b4-4c16-b6fe-63f19b050c0c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:22:17.864587 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f83f1eb3-10b4-4c16-b6fe-63f19b050c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:18.073787 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3716/7493] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:22:18.144086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553512e5-8233-4c55-a549-daef1121d446 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:18.145689 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-553512e5-8233-4c55-a549-daef1121d446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:18.304178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553512e5-8233-4c55-a549-daef1121d446 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:18.311179 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90aba1-be5c-41bf-bb9a-21e3ddf7e97b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:18.313383 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90aba1-be5c-41bf-bb9a-21e3ddf7e97b service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:18.313984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90aba1-be5c-41bf-bb9a-21e3ddf7e97b service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:18.314630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90aba1-be5c-41bf-bb9a-21e3ddf7e97b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:18.328754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f90aba1-be5c-41bf-bb9a-21e3ddf7e97b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:18.331101 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f90aba1-be5c-41bf-bb9a-21e3ddf7e97b service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:18.357852 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3778/7494] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:22:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:22:19.141980 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f1eb3-10b4-4c16-b6fe-63f19b050c0c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:19.143666 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f83f1eb3-10b4-4c16-b6fe-63f19b050c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:19.164466 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f1eb3-10b4-4c16-b6fe-63f19b050c0c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:19.186441 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3679af-9d89-4cff-88cd-68d4d6d01ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:19.187255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3679af-9d89-4cff-88cd-68d4d6d01ca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:19.187647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3679af-9d89-4cff-88cd-68d4d6d01ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:19.188179 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3679af-9d89-4cff-88cd-68d4d6d01ca0 admin admin] PATH_INFO: `/v3/projects/d12f4b2bbfc3438fae396fedd6552a26` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:19.189659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3679af-9d89-4cff-88cd-68d4d6d01ca0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d12f4b2bbfc3438fae396fedd6552a26)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:19.192579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3679af-9d89-4cff-88cd-68d4d6d01ca0 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:19.230309 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:19.293719 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-da3679af-9d89-4cff-88cd-68d4d6d01ca0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd12f4b2bbfc3438fae396fedd6552a26', 'request_id': 'req-da3679af-9d89-4cff-88cd-68d4d6d01ca0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:19.311550 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-da3679af-9d89-4cff-88cd-68d4d6d01ca0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd12f4b2bbfc3438fae396fedd6552a26', 'request_id': 'req-da3679af-9d89-4cff-88cd-68d4d6d01ca0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:19.330611 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-da3679af-9d89-4cff-88cd-68d4d6d01ca0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd12f4b2bbfc3438fae396fedd6552a26', 'request_id': 'req-da3679af-9d89-4cff-88cd-68d4d6d01ca0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:19.364547 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-da3679af-9d89-4cff-88cd-68d4d6d01ca0 admin admin] The token cache is being invalidate because project d12f4b2bbfc3438fae396fedd6552a26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:22:19.365054 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-da3679af-9d89-4cff-88cd-68d4d6d01ca0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:19.365912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-da3679af-9d89-4cff-88cd-68d4d6d01ca0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:19.372477 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3717/7495] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:22:19 2022] DELETE /identity/v3/projects/d12f4b2bbfc3438fae396fedd6552a26 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:22:19.378864 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90aba1-be5c-41bf-bb9a-21e3ddf7e97b service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:19.392199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90aba1-be5c-41bf-bb9a-21e3ddf7e97b service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:19.482263 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:19.548574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848f767-c29c-49a7-903b-e7e3ab0285ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:19.549736 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848f767-c29c-49a7-903b-e7e3ab0285ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:19.550171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848f767-c29c-49a7-903b-e7e3ab0285ff admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:19.550715 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848f767-c29c-49a7-903b-e7e3ab0285ff admin admin] PATH_INFO: `/v3/users/2231f5e86f0642a4acf702913e559284` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:19.552884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0848f767-c29c-49a7-903b-e7e3ab0285ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=2231f5e86f0642a4acf702913e559284)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:19.557131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0848f767-c29c-49a7-903b-e7e3ab0285ff admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:19.682270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0848f767-c29c-49a7-903b-e7e3ab0285ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2231f5e86f0642a4acf702913e559284'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:19.754677 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0848f767-c29c-49a7-903b-e7e3ab0285ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2231f5e86f0642a4acf702913e559284'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:19.755460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0848f767-c29c-49a7-903b-e7e3ab0285ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2231f5e86f0642a4acf702913e559284'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:19.757664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0848f767-c29c-49a7-903b-e7e3ab0285ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2231f5e86f0642a4acf702913e559284'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:19.797239 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0848f767-c29c-49a7-903b-e7e3ab0285ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2231f5e86f0642a4acf702913e559284'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:19.817296 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3679af-9d89-4cff-88cd-68d4d6d01ca0 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:19.820551 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-da3679af-9d89-4cff-88cd-68d4d6d01ca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:19.851341 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3679af-9d89-4cff-88cd-68d4d6d01ca0 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:19.860617 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3779/7496] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:22:19 2022] DELETE /identity/v3/users/2231f5e86f0642a4acf702913e559284 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:22:19.885539 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289488ef-2db7-4a9c-ab79-abf4f29e9923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:19.886477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289488ef-2db7-4a9c-ab79-abf4f29e9923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:19.887260 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289488ef-2db7-4a9c-ab79-abf4f29e9923 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:19.887685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289488ef-2db7-4a9c-ab79-abf4f29e9923 admin admin] PATH_INFO: `/v3/users/d2580e8e5886464baa08bad44e397976` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:19.889186 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289488ef-2db7-4a9c-ab79-abf4f29e9923 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2580e8e5886464baa08bad44e397976)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:19.891565 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289488ef-2db7-4a9c-ab79-abf4f29e9923 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:20.017124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-289488ef-2db7-4a9c-ab79-abf4f29e9923 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2580e8e5886464baa08bad44e397976'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:20.018087 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-289488ef-2db7-4a9c-ab79-abf4f29e9923 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2580e8e5886464baa08bad44e397976'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:20.018849 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-289488ef-2db7-4a9c-ab79-abf4f29e9923 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2580e8e5886464baa08bad44e397976'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:20.030219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-289488ef-2db7-4a9c-ab79-abf4f29e9923 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2580e8e5886464baa08bad44e397976'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:20.079286 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-289488ef-2db7-4a9c-ab79-abf4f29e9923 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2580e8e5886464baa08bad44e397976'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:20.090472 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848f767-c29c-49a7-903b-e7e3ab0285ff admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:20.092718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0848f767-c29c-49a7-903b-e7e3ab0285ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:20.098602 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3718/7497] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:22:19 2022] DELETE /identity/v3/users/d2580e8e5886464baa08bad44e397976 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:22:20.105088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129ea37-809e-4d42-8618-c7f6220d3d5a None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:20.105588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129ea37-809e-4d42-8618-c7f6220d3d5a None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:20.105840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129ea37-809e-4d42-8618-c7f6220d3d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:20.151536 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-b129ea37-809e-4d42-8618-c7f6220d3d5a None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:22:20.152877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b129ea37-809e-4d42-8618-c7f6220d3d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:20.198148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848f767-c29c-49a7-903b-e7e3ab0285ff admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:20.243498 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3719/7498] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:22:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:22:20.254657 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129ea37-809e-4d42-8618-c7f6220d3d5a None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:20.258059 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b129ea37-809e-4d42-8618-c7f6220d3d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:20.307630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42e0f9-47ea-4e5c-9bcf-07c0bd41c896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:20.308843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42e0f9-47ea-4e5c-9bcf-07c0bd41c896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:20.309464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42e0f9-47ea-4e5c-9bcf-07c0bd41c896 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:20.310014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42e0f9-47ea-4e5c-9bcf-07c0bd41c896 admin admin] PATH_INFO: `/v3/users/c2511c9480024586999cea72a7f50826` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:20.311970 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42e0f9-47ea-4e5c-9bcf-07c0bd41c896 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2511c9480024586999cea72a7f50826)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:20.314753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42e0f9-47ea-4e5c-9bcf-07c0bd41c896 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:20.333451 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:20.340027 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:20.396146 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129ea37-809e-4d42-8618-c7f6220d3d5a None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:20.402978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0855e7a-4528-4d6c-a780-14949cc0c230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:20.403836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0855e7a-4528-4d6c-a780-14949cc0c230 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:20.406129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0855e7a-4528-4d6c-a780-14949cc0c230 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:20.406599 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0855e7a-4528-4d6c-a780-14949cc0c230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:20.419372 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0855e7a-4528-4d6c-a780-14949cc0c230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:20.421339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0855e7a-4528-4d6c-a780-14949cc0c230 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:20.427111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dc42e0f9-47ea-4e5c-9bcf-07c0bd41c896 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2511c9480024586999cea72a7f50826'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:20.433953 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3720/7499] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:22:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:22:20.437202 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dc42e0f9-47ea-4e5c-9bcf-07c0bd41c896 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2511c9480024586999cea72a7f50826'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:20.438173 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dc42e0f9-47ea-4e5c-9bcf-07c0bd41c896 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2511c9480024586999cea72a7f50826'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:20.439087 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dc42e0f9-47ea-4e5c-9bcf-07c0bd41c896 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2511c9480024586999cea72a7f50826'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:20.448745 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dc42e0f9-47ea-4e5c-9bcf-07c0bd41c896 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2511c9480024586999cea72a7f50826'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:20.472863 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3780/7500] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:22:20 2022] DELETE /identity/v3/users/c2511c9480024586999cea72a7f50826 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:22:20.841736 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0855e7a-4528-4d6c-a780-14949cc0c230 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:20.846201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a0855e7a-4528-4d6c-a780-14949cc0c230 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:20.874243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0855e7a-4528-4d6c-a780-14949cc0c230 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:21.009286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42e0f9-47ea-4e5c-9bcf-07c0bd41c896 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:21.011624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb0e17-9dbb-4ac0-983c-8666924b49f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:21.011977 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-dc42e0f9-47ea-4e5c-9bcf-07c0bd41c896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:21.012406 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb0e17-9dbb-4ac0-983c-8666924b49f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:21.012753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb0e17-9dbb-4ac0-983c-8666924b49f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:21.013248 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb0e17-9dbb-4ac0-983c-8666924b49f2 admin admin] PATH_INFO: `/v3/projects/9805b3f3d34b4800a88862000d9fdc16` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:21.016383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb0e17-9dbb-4ac0-983c-8666924b49f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9805b3f3d34b4800a88862000d9fdc16)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:21.018338 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb0e17-9dbb-4ac0-983c-8666924b49f2 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:21.038358 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42e0f9-47ea-4e5c-9bcf-07c0bd41c896 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:21.055004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56886297-aef8-452c-99e1-f9fd2d6ea49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:21.055963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56886297-aef8-452c-99e1-f9fd2d6ea49c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:21.056354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56886297-aef8-452c-99e1-f9fd2d6ea49c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:21.056917 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56886297-aef8-452c-99e1-f9fd2d6ea49c admin admin] PATH_INFO: `/v3/projects/0a551e0a60084282aa0c986d737e30ce` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:21.057930 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56886297-aef8-452c-99e1-f9fd2d6ea49c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a551e0a60084282aa0c986d737e30ce)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:21.060243 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56886297-aef8-452c-99e1-f9fd2d6ea49c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:21.134091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2ebb0e17-9dbb-4ac0-983c-8666924b49f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9805b3f3d34b4800a88862000d9fdc16', 'request_id': 'req-2ebb0e17-9dbb-4ac0-983c-8666924b49f2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:21.148763 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2ebb0e17-9dbb-4ac0-983c-8666924b49f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9805b3f3d34b4800a88862000d9fdc16', 'request_id': 'req-2ebb0e17-9dbb-4ac0-983c-8666924b49f2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:21.171829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2ebb0e17-9dbb-4ac0-983c-8666924b49f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9805b3f3d34b4800a88862000d9fdc16', 'request_id': 'req-2ebb0e17-9dbb-4ac0-983c-8666924b49f2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:21.172459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-56886297-aef8-452c-99e1-f9fd2d6ea49c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a551e0a60084282aa0c986d737e30ce', 'request_id': 'req-56886297-aef8-452c-99e1-f9fd2d6ea49c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:21.179466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-56886297-aef8-452c-99e1-f9fd2d6ea49c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a551e0a60084282aa0c986d737e30ce', 'request_id': 'req-56886297-aef8-452c-99e1-f9fd2d6ea49c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:21.197661 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-56886297-aef8-452c-99e1-f9fd2d6ea49c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a551e0a60084282aa0c986d737e30ce', 'request_id': 'req-56886297-aef8-452c-99e1-f9fd2d6ea49c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:21.199046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2ebb0e17-9dbb-4ac0-983c-8666924b49f2 admin admin] The token cache is being invalidate because project 9805b3f3d34b4800a88862000d9fdc16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:22:21.199494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2ebb0e17-9dbb-4ac0-983c-8666924b49f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:21.201261 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2ebb0e17-9dbb-4ac0-983c-8666924b49f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:21.204063 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3721/7501] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:22:20 2022] DELETE /identity/v3/projects/9805b3f3d34b4800a88862000d9fdc16 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:22:21.205966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb0e17-9dbb-4ac0-983c-8666924b49f2 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:21.207979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2ebb0e17-9dbb-4ac0-983c-8666924b49f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:21.216389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-56886297-aef8-452c-99e1-f9fd2d6ea49c admin admin] The token cache is being invalidate because project 0a551e0a60084282aa0c986d737e30ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:22:21.217243 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-56886297-aef8-452c-99e1-f9fd2d6ea49c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:21.217408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-56886297-aef8-452c-99e1-f9fd2d6ea49c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:21.219414 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3781/7502] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:22:21 2022] DELETE /identity/v3/projects/0a551e0a60084282aa0c986d737e30ce => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:22:21.220211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56886297-aef8-452c-99e1-f9fd2d6ea49c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:21.221778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-56886297-aef8-452c-99e1-f9fd2d6ea49c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:21.315477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:21.323347 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb0e17-9dbb-4ac0-983c-8666924b49f2 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:21.331217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5cc967-816c-43f2-b93d-82d8c5f53381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:21.332393 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5cc967-816c-43f2-b93d-82d8c5f53381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:21.332674 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5cc967-816c-43f2-b93d-82d8c5f53381 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:21.332948 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5cc967-816c-43f2-b93d-82d8c5f53381 admin admin] PATH_INFO: `/v3/projects/d0fc4bb37fab4fbdb32543c22da5e199` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:21.334066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5cc967-816c-43f2-b93d-82d8c5f53381 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0fc4bb37fab4fbdb32543c22da5e199)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:21.337253 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5cc967-816c-43f2-b93d-82d8c5f53381 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:21.341762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56886297-aef8-452c-99e1-f9fd2d6ea49c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:21.350156 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccbb29b-827a-4235-9447-0fbc3c697bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:21.351194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbb29b-827a-4235-9447-0fbc3c697bbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:21.351656 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbb29b-827a-4235-9447-0fbc3c697bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:21.353213 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbb29b-827a-4235-9447-0fbc3c697bbb admin admin] PATH_INFO: `/v3/users/71c1e66a826049608caf8ea2a7ae20ba` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:21.354905 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccbb29b-827a-4235-9447-0fbc3c697bbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=71c1e66a826049608caf8ea2a7ae20ba)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:21.358247 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccbb29b-827a-4235-9447-0fbc3c697bbb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:21.404289 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:21.456629 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bb5cc967-816c-43f2-b93d-82d8c5f53381 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0fc4bb37fab4fbdb32543c22da5e199', 'request_id': 'req-bb5cc967-816c-43f2-b93d-82d8c5f53381'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:21.469030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bb5cc967-816c-43f2-b93d-82d8c5f53381 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0fc4bb37fab4fbdb32543c22da5e199', 'request_id': 'req-bb5cc967-816c-43f2-b93d-82d8c5f53381'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:21.487865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bb5cc967-816c-43f2-b93d-82d8c5f53381 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0fc4bb37fab4fbdb32543c22da5e199', 'request_id': 'req-bb5cc967-816c-43f2-b93d-82d8c5f53381'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:21.507482 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7ccbb29b-827a-4235-9447-0fbc3c697bbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71c1e66a826049608caf8ea2a7ae20ba'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:21.532569 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bb5cc967-816c-43f2-b93d-82d8c5f53381 admin admin] The token cache is being invalidate because project d0fc4bb37fab4fbdb32543c22da5e199 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:22:21.533719 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bb5cc967-816c-43f2-b93d-82d8c5f53381 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:21.534876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bb5cc967-816c-43f2-b93d-82d8c5f53381 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:21.542298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7ccbb29b-827a-4235-9447-0fbc3c697bbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71c1e66a826049608caf8ea2a7ae20ba'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:21.544352 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3722/7503] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:22:21 2022] DELETE /identity/v3/projects/d0fc4bb37fab4fbdb32543c22da5e199 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:22:21.544562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7ccbb29b-827a-4235-9447-0fbc3c697bbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71c1e66a826049608caf8ea2a7ae20ba'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:21.546358 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7ccbb29b-827a-4235-9447-0fbc3c697bbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71c1e66a826049608caf8ea2a7ae20ba'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:21.548478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87545f7-402c-4c00-a448-e1affa290916 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:21.549944 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87545f7-402c-4c00-a448-e1affa290916 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:21.550228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87545f7-402c-4c00-a448-e1affa290916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:21.564874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7ccbb29b-827a-4235-9447-0fbc3c697bbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71c1e66a826049608caf8ea2a7ae20ba'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:21.593816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-b87545f7-402c-4c00-a448-e1affa290916 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:22:21.596244 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b87545f7-402c-4c00-a448-e1affa290916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:21.601207 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3782/7504] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:22:21 2022] DELETE /identity/v3/users/71c1e66a826049608caf8ea2a7ae20ba => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:22:21.601207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78170c6e-ab1b-480b-895d-4e0562f7a34a None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:21.601207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78170c6e-ab1b-480b-895d-4e0562f7a34a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:21.612210 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78170c6e-ab1b-480b-895d-4e0562f7a34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:21.659216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-78170c6e-ab1b-480b-895d-4e0562f7a34a None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:22:21.661758 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-78170c6e-ab1b-480b-895d-4e0562f7a34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:21.786681 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3723/7505] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:22:21.796520 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f45955-bcd0-431a-9bb2-6fdde3fb1213 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:21.796812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f45955-bcd0-431a-9bb2-6fdde3fb1213 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:21.797092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f45955-bcd0-431a-9bb2-6fdde3fb1213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:21.862217 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3783/7506] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:22:21.862472 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-60f45955-bcd0-431a-9bb2-6fdde3fb1213 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:22:21.862472 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-60f45955-bcd0-431a-9bb2-6fdde3fb1213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:21.864737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40541c0-a495-43fc-9c1e-8d9174db6632 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:21.865034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40541c0-a495-43fc-9c1e-8d9174db6632 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:21.865301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40541c0-a495-43fc-9c1e-8d9174db6632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:21.896068 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3724/7507] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:22:21.900230 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f45955-bcd0-431a-9bb2-6fdde3fb1213 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:21.925744 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f45955-bcd0-431a-9bb2-6fdde3fb1213 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:21.926484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b40541c0-a495-43fc-9c1e-8d9174db6632 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:22:21.927850 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b40541c0-a495-43fc-9c1e-8d9174db6632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:21.936419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85793b27-b3a4-4dec-8a8c-4397c86c92e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:21.937053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85793b27-b3a4-4dec-8a8c-4397c86c92e6 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:21.937336 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85793b27-b3a4-4dec-8a8c-4397c86c92e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:21.937610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85793b27-b3a4-4dec-8a8c-4397c86c92e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:21.938267 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85793b27-b3a4-4dec-8a8c-4397c86c92e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:22:21.938607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85793b27-b3a4-4dec-8a8c-4397c86c92e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:21.940261 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85793b27-b3a4-4dec-8a8c-4397c86c92e6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:21.949028 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3784/7508] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:22:21.952999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40541c0-a495-43fc-9c1e-8d9174db6632 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:21.967916 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40541c0-a495-43fc-9c1e-8d9174db6632 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:21.971865 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3725/7509] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:22:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:22:21.977715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85793b27-b3a4-4dec-8a8c-4397c86c92e6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:21.981255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9c77e-0cfd-4eb2-b30f-b315b92698af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:21.982243 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9c77e-0cfd-4eb2-b30f-b315b92698af admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:21.982842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9c77e-0cfd-4eb2-b30f-b315b92698af admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:21.983528 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9c77e-0cfd-4eb2-b30f-b315b92698af admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:21.984443 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9c77e-0cfd-4eb2-b30f-b315b92698af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:22:21.985018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9c77e-0cfd-4eb2-b30f-b315b92698af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:21.986939 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9c77e-0cfd-4eb2-b30f-b315b92698af admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:22.006720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85793b27-b3a4-4dec-8a8c-4397c86c92e6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:22.011046 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3785/7510] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:22:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:22:22.012016 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9c77e-0cfd-4eb2-b30f-b315b92698af admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:22.014011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95c8e0-c90a-4ec4-9177-887fefa5023e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:22.015473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95c8e0-c90a-4ec4-9177-887fefa5023e admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:22.016877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95c8e0-c90a-4ec4-9177-887fefa5023e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:22.017170 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95c8e0-c90a-4ec4-9177-887fefa5023e admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:22.017999 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed95c8e0-c90a-4ec4-9177-887fefa5023e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:22.020800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed95c8e0-c90a-4ec4-9177-887fefa5023e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:22.024249 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9c77e-0cfd-4eb2-b30f-b315b92698af admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:22.030429 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b9ef88-2547-4fc6-ba9f-449b962168aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:22.031113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9ef88-2547-4fc6-ba9f-449b962168aa admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:22.031539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9ef88-2547-4fc6-ba9f-449b962168aa admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:22.031824 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9ef88-2547-4fc6-ba9f-449b962168aa admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:22.033300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b9ef88-2547-4fc6-ba9f-449b962168aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:22.036068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b9ef88-2547-4fc6-ba9f-449b962168aa admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:22.066089 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3726/7511] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:22:21 2022] POST /identity/v3/projects => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:22:22.074172 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95c8e0-c90a-4ec4-9177-887fefa5023e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:22.084822 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3786/7512] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:22:22 2022] POST /identity/v3/projects => generated 375 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:22:22.085904 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b9ef88-2547-4fc6-ba9f-449b962168aa admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:22.160996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:22.174351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:22.192477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95c8e0-c90a-4ec4-9177-887fefa5023e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:22.199643 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c33800-bb97-4a27-bb33-a79a2062cc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:22.201188 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c33800-bb97-4a27-bb33-a79a2062cc6a admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:22.201784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c33800-bb97-4a27-bb33-a79a2062cc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:22.201784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c33800-bb97-4a27-bb33-a79a2062cc6a admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:22.202386 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c33800-bb97-4a27-bb33-a79a2062cc6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:22.204818 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c33800-bb97-4a27-bb33-a79a2062cc6a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:22.207960 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b9ef88-2547-4fc6-ba9f-449b962168aa admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:22.216943 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282ab08-6712-473e-8fff-ba9004a434ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:22.218405 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282ab08-6712-473e-8fff-ba9004a434ce admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:22.219308 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282ab08-6712-473e-8fff-ba9004a434ce admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:22.220356 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282ab08-6712-473e-8fff-ba9004a434ce admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:22.221160 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282ab08-6712-473e-8fff-ba9004a434ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:22.224570 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282ab08-6712-473e-8fff-ba9004a434ce admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:22.231851 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3727/7513] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:22:22 2022] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:22:22.236164 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c33800-bb97-4a27-bb33-a79a2062cc6a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:22.250963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c33800-bb97-4a27-bb33-a79a2062cc6a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:22.257718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db57037a-2004-4762-8c8d-c7f0c1ce6ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:22.259134 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57037a-2004-4762-8c8d-c7f0c1ce6ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:22.259588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57037a-2004-4762-8c8d-c7f0c1ce6ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:22.259975 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57037a-2004-4762-8c8d-c7f0c1ce6ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:22.260842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db57037a-2004-4762-8c8d-c7f0c1ce6ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:22.263191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db57037a-2004-4762-8c8d-c7f0c1ce6ed5 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:22.264336 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3787/7514] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:22:22 2022] POST /identity/v3/users => generated 288 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:22:22.268533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282ab08-6712-473e-8fff-ba9004a434ce admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:22.283136 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282ab08-6712-473e-8fff-ba9004a434ce admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:22.288172 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c68da7-0884-479f-8a7b-f2ce981c6762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:22.289508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c68da7-0884-479f-8a7b-f2ce981c6762 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:22.289830 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c68da7-0884-479f-8a7b-f2ce981c6762 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:22.290232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c68da7-0884-479f-8a7b-f2ce981c6762 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:22.291265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c68da7-0884-479f-8a7b-f2ce981c6762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:22.293098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c68da7-0884-479f-8a7b-f2ce981c6762 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:22.298762 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3728/7515] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:22:22.300408 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db57037a-2004-4762-8c8d-c7f0c1ce6ed5 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:22.314615 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3788/7516] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:22:22.317340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c68da7-0884-479f-8a7b-f2ce981c6762 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:22.326646 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db57037a-2004-4762-8c8d-c7f0c1ce6ed5 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:22.332272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f8639-feba-4ea5-9dee-e55b3f715b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:22.333093 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f8639-feba-4ea5-9dee-e55b3f715b20 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:22.333584 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f8639-feba-4ea5-9dee-e55b3f715b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:22.334184 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f8639-feba-4ea5-9dee-e55b3f715b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:22.335189 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f8639-feba-4ea5-9dee-e55b3f715b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:22.336917 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f8639-feba-4ea5-9dee-e55b3f715b20 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:22.352365 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3729/7517] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:22:22.353013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c68da7-0884-479f-8a7b-f2ce981c6762 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:22.358599 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f8639-feba-4ea5-9dee-e55b3f715b20 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:22.359612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42288aac-c006-4047-8253-e3eec0e3f6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:22.360523 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42288aac-c006-4047-8253-e3eec0e3f6eb admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:22.360669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42288aac-c006-4047-8253-e3eec0e3f6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:22.360955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42288aac-c006-4047-8253-e3eec0e3f6eb admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:22.361647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42288aac-c006-4047-8253-e3eec0e3f6eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:22.363646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42288aac-c006-4047-8253-e3eec0e3f6eb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:22.383978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f8639-feba-4ea5-9dee-e55b3f715b20 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:22.385429 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3789/7518] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:22:22.392203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead7d65-b422-470f-85aa-9a7c6ec1cdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:22.393064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead7d65-b422-470f-85aa-9a7c6ec1cdc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:22.393353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead7d65-b422-470f-85aa-9a7c6ec1cdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:22.393631 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead7d65-b422-470f-85aa-9a7c6ec1cdc6 admin admin] PATH_INFO: `/v3/projects/48a90a98bcc6456086f39fb93c80b9fe/users/072374854bee412d88926414a37f1c36/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:22.396624 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42288aac-c006-4047-8253-e3eec0e3f6eb admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:22.412901 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead7d65-b422-470f-85aa-9a7c6ec1cdc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48a90a98bcc6456086f39fb93c80b9fe, user_id=072374854bee412d88926414a37f1c36, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:22.413976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42288aac-c006-4047-8253-e3eec0e3f6eb admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:22.417348 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead7d65-b422-470f-85aa-9a7c6ec1cdc6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:22.425696 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c1fa3-5fd9-448d-8c50-2e99ef9e1ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:22.426535 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c1fa3-5fd9-448d-8c50-2e99ef9e1ef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:22.426862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c1fa3-5fd9-448d-8c50-2e99ef9e1ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:22.427109 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c1fa3-5fd9-448d-8c50-2e99ef9e1ef6 admin admin] PATH_INFO: `/v3/projects/1ff5cf7fb11b4fc8aab84c3610683094/users/28aa42b542db43a1bf3d1d21d687b95b/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:22.442493 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3730/7519] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:22:22 2022] PUT /identity/v3/projects/48a90a98bcc6456086f39fb93c80b9fe/users/072374854bee412d88926414a37f1c36/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:22:22.443897 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4ae65-f01a-4cae-a30a-4122926de5df None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:22.444243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4ae65-f01a-4cae-a30a-4122926de5df None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:22.444579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4ae65-f01a-4cae-a30a-4122926de5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:22.459465 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c1fa3-5fd9-448d-8c50-2e99ef9e1ef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ff5cf7fb11b4fc8aab84c3610683094, user_id=28aa42b542db43a1bf3d1d21d687b95b, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:22.464842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c1fa3-5fd9-448d-8c50-2e99ef9e1ef6 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:22.467304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-59b4ae65-f01a-4cae-a30a-4122926de5df None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:22:22.468836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-59b4ae65-f01a-4cae-a30a-4122926de5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:22.498030 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3790/7520] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:22:22 2022] PUT /identity/v3/projects/1ff5cf7fb11b4fc8aab84c3610683094/users/28aa42b542db43a1bf3d1d21d687b95b/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:22:22.509785 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce6d97-20b9-4217-a888-3daf1019df33 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:22.510355 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce6d97-20b9-4217-a888-3daf1019df33 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:22.510355 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce6d97-20b9-4217-a888-3daf1019df33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:22.545504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-80ce6d97-20b9-4217-a888-3daf1019df33 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:22:22.547276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-80ce6d97-20b9-4217-a888-3daf1019df33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:22.564904 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3731/7521] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:22:22.566367 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4ae65-f01a-4cae-a30a-4122926de5df None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:22.569021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-59b4ae65-f01a-4cae-a30a-4122926de5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:22.584138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4ae65-f01a-4cae-a30a-4122926de5df None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:22.674429 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3791/7522] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:22:22.677876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce6d97-20b9-4217-a888-3daf1019df33 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:22.686196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-80ce6d97-20b9-4217-a888-3daf1019df33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:22.704092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db80631-d9d3-4e31-b737-6c929009eb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:22.704834 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db80631-d9d3-4e31-b737-6c929009eb19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:22.705192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db80631-d9d3-4e31-b737-6c929009eb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:22.705543 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db80631-d9d3-4e31-b737-6c929009eb19 admin admin] PATH_INFO: `/v3/projects/536ee009602140488ef6556e2721228a` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:22.706863 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db80631-d9d3-4e31-b737-6c929009eb19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=536ee009602140488ef6556e2721228a)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:22.714579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db80631-d9d3-4e31-b737-6c929009eb19 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:22.815823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:22.831718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce6d97-20b9-4217-a888-3daf1019df33 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:22.840160 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6db80631-d9d3-4e31-b737-6c929009eb19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '536ee009602140488ef6556e2721228a', 'request_id': 'req-6db80631-d9d3-4e31-b737-6c929009eb19'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:22.849492 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6db80631-d9d3-4e31-b737-6c929009eb19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '536ee009602140488ef6556e2721228a', 'request_id': 'req-6db80631-d9d3-4e31-b737-6c929009eb19'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:22.872088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6db80631-d9d3-4e31-b737-6c929009eb19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '536ee009602140488ef6556e2721228a', 'request_id': 'req-6db80631-d9d3-4e31-b737-6c929009eb19'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:22.893105 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6db80631-d9d3-4e31-b737-6c929009eb19 admin admin] The token cache is being invalidate because project 536ee009602140488ef6556e2721228a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:22:22.893776 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6db80631-d9d3-4e31-b737-6c929009eb19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:22.894765 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6db80631-d9d3-4e31-b737-6c929009eb19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:22.896572 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3732/7523] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:22:22 2022] DELETE /identity/v3/projects/536ee009602140488ef6556e2721228a => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:22:22.898284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db80631-d9d3-4e31-b737-6c929009eb19 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:22.901488 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6db80631-d9d3-4e31-b737-6c929009eb19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:22.905631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:22.911342 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef616082-d369-4cea-950e-a330eccf2a29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:22.912257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef616082-d369-4cea-950e-a330eccf2a29 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:22.912909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef616082-d369-4cea-950e-a330eccf2a29 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:22.913292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef616082-d369-4cea-950e-a330eccf2a29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:22.916023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ef616082-d369-4cea-950e-a330eccf2a29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:22.981777 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db80631-d9d3-4e31-b737-6c929009eb19 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:22.985892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d74134-1249-4079-a065-6d9c82dc621e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10759b2abd4cafacf338551327775e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:22.986513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d74134-1249-4079-a065-6d9c82dc621e service glance] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:22.986805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d74134-1249-4079-a065-6d9c82dc621e service glance] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:22.987195 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d74134-1249-4079-a065-6d9c82dc621e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:22.988959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c8d74134-1249-4079-a065-6d9c82dc621e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:23.007363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef616082-d369-4cea-950e-a330eccf2a29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:23.009603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef616082-d369-4cea-950e-a330eccf2a29 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:23.020218 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3792/7524] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:22:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:22:23.020974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef616082-d369-4cea-950e-a330eccf2a29 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:23.022419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ef616082-d369-4cea-950e-a330eccf2a29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:23.037383 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef616082-d369-4cea-950e-a330eccf2a29 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:23.043321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd1ce6-673a-42c8-a720-033bad580d7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:23.044749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd1ce6-673a-42c8-a720-033bad580d7a service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:23.045106 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd1ce6-673a-42c8-a720-033bad580d7a service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:23.045631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd1ce6-673a-42c8-a720-033bad580d7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:23.048291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5cdd1ce6-673a-42c8-a720-033bad580d7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:23.077749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd1ce6-673a-42c8-a720-033bad580d7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:23.079359 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd1ce6-673a-42c8-a720-033bad580d7a service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:23.079726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d74134-1249-4079-a065-6d9c82dc621e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:23.081903 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d74134-1249-4079-a065-6d9c82dc621e service glance] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:23.094633 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3793/7525] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:22:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:22:23.096449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843758f-d4a7-47a3-9bbf-fa4e063a0e6c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:23.096767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843758f-d4a7-47a3-9bbf-fa4e063a0e6c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:23.097051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843758f-d4a7-47a3-9bbf-fa4e063a0e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:23.100338 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3733/7526] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:22:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:22:23.121381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-6843758f-d4a7-47a3-9bbf-fa4e063a0e6c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:22:23.122713 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6843758f-d4a7-47a3-9bbf-fa4e063a0e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:23.141792 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3794/7527] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:22:23.143190 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a83a8-e38b-446b-8de1-08ccd951ed01 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:23.143482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a83a8-e38b-446b-8de1-08ccd951ed01 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:23.143891 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a83a8-e38b-446b-8de1-08ccd951ed01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:23.171998 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-0d3a83a8-e38b-446b-8de1-08ccd951ed01 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:22:23.173246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0d3a83a8-e38b-446b-8de1-08ccd951ed01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:23.186585 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3734/7528] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:22:23.192772 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843758f-d4a7-47a3-9bbf-fa4e063a0e6c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:23.205767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843758f-d4a7-47a3-9bbf-fa4e063a0e6c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:23.214918 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120414fe-8ccf-45ee-ab2c-39be89371443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:23.215620 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120414fe-8ccf-45ee-ab2c-39be89371443 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:23.216033 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120414fe-8ccf-45ee-ab2c-39be89371443 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:23.216574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120414fe-8ccf-45ee-ab2c-39be89371443 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:23.217330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120414fe-8ccf-45ee-ab2c-39be89371443 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:22:23.217679 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120414fe-8ccf-45ee-ab2c-39be89371443 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:23.219699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120414fe-8ccf-45ee-ab2c-39be89371443 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:23.231568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a83a8-e38b-446b-8de1-08ccd951ed01 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:23.238439 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3795/7529] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:22:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:22:23.244269 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120414fe-8ccf-45ee-ab2c-39be89371443 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:23.248789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a83a8-e38b-446b-8de1-08ccd951ed01 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:23.253146 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2313c7d-6000-4871-83ec-fc438eb6ef30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:23.253985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2313c7d-6000-4871-83ec-fc438eb6ef30 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:23.254269 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2313c7d-6000-4871-83ec-fc438eb6ef30 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:23.254538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2313c7d-6000-4871-83ec-fc438eb6ef30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:23.256507 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d2313c7d-6000-4871-83ec-fc438eb6ef30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:23.260139 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120414fe-8ccf-45ee-ab2c-39be89371443 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:23.267417 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb707b-6b17-4223-9026-a3ef30257c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:23.268104 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb707b-6b17-4223-9026-a3ef30257c05 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:23.268448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb707b-6b17-4223-9026-a3ef30257c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:23.268826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb707b-6b17-4223-9026-a3ef30257c05 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:23.269519 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb707b-6b17-4223-9026-a3ef30257c05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:23.271880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb707b-6b17-4223-9026-a3ef30257c05 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:23.272300 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2313c7d-6000-4871-83ec-fc438eb6ef30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:23.275213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2313c7d-6000-4871-83ec-fc438eb6ef30 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:23.291298 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3735/7530] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:22:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:22:23.318400 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3796/7531] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:22:23 2022] POST /identity/v3/projects => generated 371 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:22:23.319664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2313c7d-6000-4871-83ec-fc438eb6ef30 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:23.332033 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2313c7d-6000-4871-83ec-fc438eb6ef30 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:23.402481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:23.431352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97885d4-0e62-4610-8c5a-aa75500323ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:23.431946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97885d4-0e62-4610-8c5a-aa75500323ad admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:23.432230 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97885d4-0e62-4610-8c5a-aa75500323ad admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:23.432511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97885d4-0e62-4610-8c5a-aa75500323ad admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:23.433291 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97885d4-0e62-4610-8c5a-aa75500323ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:23.439017 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97885d4-0e62-4610-8c5a-aa75500323ad admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:23.474711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb707b-6b17-4223-9026-a3ef30257c05 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:23.478273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5fcb707b-6b17-4223-9026-a3ef30257c05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:23.482413 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3736/7532] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:22:23 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:22:23.489964 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97885d4-0e62-4610-8c5a-aa75500323ad admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:23.505481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97885d4-0e62-4610-8c5a-aa75500323ad admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:23.514999 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a66c38-22f1-4de9-a16c-6d92e6436de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:23.516341 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a66c38-22f1-4de9-a16c-6d92e6436de1 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:23.516704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a66c38-22f1-4de9-a16c-6d92e6436de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:23.517048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a66c38-22f1-4de9-a16c-6d92e6436de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:23.517803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a66c38-22f1-4de9-a16c-6d92e6436de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:23.527909 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a66c38-22f1-4de9-a16c-6d92e6436de1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:23.552062 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3737/7533] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:22:23.556950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a66c38-22f1-4de9-a16c-6d92e6436de1 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:23.582475 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a66c38-22f1-4de9-a16c-6d92e6436de1 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:23.590780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207f9ea-ce72-40a8-ad9b-1fc59e814457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:23.592019 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207f9ea-ce72-40a8-ad9b-1fc59e814457 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:23.593031 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207f9ea-ce72-40a8-ad9b-1fc59e814457 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:23.593729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb707b-6b17-4223-9026-a3ef30257c05 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:23.594275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207f9ea-ce72-40a8-ad9b-1fc59e814457 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:23.595435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207f9ea-ce72-40a8-ad9b-1fc59e814457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:23.597369 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207f9ea-ce72-40a8-ad9b-1fc59e814457 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:23.599208 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10311b3f-0b25-4ce1-b000-66823516a301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:23.599948 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10311b3f-0b25-4ce1-b000-66823516a301 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:23.600307 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10311b3f-0b25-4ce1-b000-66823516a301 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:23.600669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10311b3f-0b25-4ce1-b000-66823516a301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:23.603565 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-10311b3f-0b25-4ce1-b000-66823516a301 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:23.623169 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3738/7534] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:22:23.624237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207f9ea-ce72-40a8-ad9b-1fc59e814457 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:23.653968 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207f9ea-ce72-40a8-ad9b-1fc59e814457 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:23.662479 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed724247-2344-43e3-9ea9-ef1a30266d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:23.663790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed724247-2344-43e3-9ea9-ef1a30266d7f admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:23.664075 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed724247-2344-43e3-9ea9-ef1a30266d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:23.664350 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed724247-2344-43e3-9ea9-ef1a30266d7f admin admin] PATH_INFO: `/v3/projects/a31b7575aa0944cca8da8f093eeeb0bf/users/e286c03134e646ce962ea7b88eab4b38/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:23.677850 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:23.690589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed724247-2344-43e3-9ea9-ef1a30266d7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a31b7575aa0944cca8da8f093eeeb0bf, user_id=e286c03134e646ce962ea7b88eab4b38, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:23.695508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed724247-2344-43e3-9ea9-ef1a30266d7f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:23.705363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10311b3f-0b25-4ce1-b000-66823516a301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:23.706940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10311b3f-0b25-4ce1-b000-66823516a301 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:23.720601 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3739/7535] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:22:23 2022] PUT /identity/v3/projects/a31b7575aa0944cca8da8f093eeeb0bf/users/e286c03134e646ce962ea7b88eab4b38/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:22:23.732671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d46df-d2f6-498e-9dd8-13af33a3e8f6 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:23.732954 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d46df-d2f6-498e-9dd8-13af33a3e8f6 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:23.733219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d46df-d2f6-498e-9dd8-13af33a3e8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:23.739276 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3797/7536] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:22:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:22:23.808452 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-253d46df-d2f6-498e-9dd8-13af33a3e8f6 None None] MFA Rules not processed for user `e286c03134e646ce962ea7b88eab4b38`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:22:23.808452 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-253d46df-d2f6-498e-9dd8-13af33a3e8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:24.012278 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10311b3f-0b25-4ce1-b000-66823516a301 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:24.014194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-10311b3f-0b25-4ce1-b000-66823516a301 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:24.015184 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3740/7537] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:22:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:22:24.163624 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10311b3f-0b25-4ce1-b000-66823516a301 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:24.272999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770beea-4acd-4026-b5b2-59072ce71bfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:24.273683 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770beea-4acd-4026-b5b2-59072ce71bfe service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:24.274623 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770beea-4acd-4026-b5b2-59072ce71bfe service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:24.275138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770beea-4acd-4026-b5b2-59072ce71bfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:24.285116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e770beea-4acd-4026-b5b2-59072ce71bfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:24.286686 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e770beea-4acd-4026-b5b2-59072ce71bfe service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:24.297406 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3798/7538] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:22:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:22:26.099494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed69d2-6c4d-46c9-a4a6-bb632f3bbe68 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:26.100298 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed69d2-6c4d-46c9-a4a6-bb632f3bbe68 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:26.100730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed69d2-6c4d-46c9-a4a6-bb632f3bbe68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:26.167240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d6ed69d2-6c4d-46c9-a4a6-bb632f3bbe68 None None] MFA Rules not processed for user `e286c03134e646ce962ea7b88eab4b38`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:22:26.167240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d6ed69d2-6c4d-46c9-a4a6-bb632f3bbe68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:26.194377 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3741/7539] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:22:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:22:27.675578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c284a3d-78e2-4370-99e5-2828c3a08da0 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:27.676114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c284a3d-78e2-4370-99e5-2828c3a08da0 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:27.677063 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c284a3d-78e2-4370-99e5-2828c3a08da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:27.719320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-6c284a3d-78e2-4370-99e5-2828c3a08da0 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:22:27.720749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6c284a3d-78e2-4370-99e5-2828c3a08da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:27.856553 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3799/7540] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:22:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:22:27.893874 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed69d2-6c4d-46c9-a4a6-bb632f3bbe68 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:27.895360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d6ed69d2-6c4d-46c9-a4a6-bb632f3bbe68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:28.151476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed69d2-6c4d-46c9-a4a6-bb632f3bbe68 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:28.173064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20b8c8-c0d1-4d7a-b843-ebacdf155d93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:28.173773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20b8c8-c0d1-4d7a-b843-ebacdf155d93 service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:28.176381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20b8c8-c0d1-4d7a-b843-ebacdf155d93 service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:28.176895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20b8c8-c0d1-4d7a-b843-ebacdf155d93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:28.224761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:28.234672 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20b8c8-c0d1-4d7a-b843-ebacdf155d93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:28.249275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20b8c8-c0d1-4d7a-b843-ebacdf155d93 service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:28.271928 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3742/7541] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:22:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:22:30.326139 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c284a3d-78e2-4370-99e5-2828c3a08da0 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:30.327708 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6c284a3d-78e2-4370-99e5-2828c3a08da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:30.477222 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:30.520656 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c284a3d-78e2-4370-99e5-2828c3a08da0 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:30.537677 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba0039-703d-4b94-9ad0-0f3aaa7ed3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:30.539267 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba0039-703d-4b94-9ad0-0f3aaa7ed3f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:30.542431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba0039-703d-4b94-9ad0-0f3aaa7ed3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:30.543124 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba0039-703d-4b94-9ad0-0f3aaa7ed3f2 admin admin] PATH_INFO: `/v3/users/576508c656f6423aa41c57876e740c27` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:30.546444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba0039-703d-4b94-9ad0-0f3aaa7ed3f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=576508c656f6423aa41c57876e740c27)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:30.551589 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba0039-703d-4b94-9ad0-0f3aaa7ed3f2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:30.697207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-afba0039-703d-4b94-9ad0-0f3aaa7ed3f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '576508c656f6423aa41c57876e740c27'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:30.733560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-afba0039-703d-4b94-9ad0-0f3aaa7ed3f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '576508c656f6423aa41c57876e740c27'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:30.746042 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-afba0039-703d-4b94-9ad0-0f3aaa7ed3f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '576508c656f6423aa41c57876e740c27'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:30.747935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-afba0039-703d-4b94-9ad0-0f3aaa7ed3f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '576508c656f6423aa41c57876e740c27'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:30.780501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-afba0039-703d-4b94-9ad0-0f3aaa7ed3f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '576508c656f6423aa41c57876e740c27'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:30.891862 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3800/7542] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:22:30 2022] DELETE /identity/v3/users/576508c656f6423aa41c57876e740c27 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:22:30.894265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269afa14-f146-4d3e-8c18-af9087caa1ca None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:30.894782 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269afa14-f146-4d3e-8c18-af9087caa1ca None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:30.894866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269afa14-f146-4d3e-8c18-af9087caa1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:30.983645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-269afa14-f146-4d3e-8c18-af9087caa1ca None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:22:30.985316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-269afa14-f146-4d3e-8c18-af9087caa1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:31.174963 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3743/7543] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:22:31.184823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba0039-703d-4b94-9ad0-0f3aaa7ed3f2 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:31.187950 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-afba0039-703d-4b94-9ad0-0f3aaa7ed3f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:31.412034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba0039-703d-4b94-9ad0-0f3aaa7ed3f2 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:31.425780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d0728-954d-43d6-9f57-eb674d4720f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:31.426765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d0728-954d-43d6-9f57-eb674d4720f0 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:31.432217 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d0728-954d-43d6-9f57-eb674d4720f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:31.432808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d0728-954d-43d6-9f57-eb674d4720f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:31.473912 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660d0728-954d-43d6-9f57-eb674d4720f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:31.480638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660d0728-954d-43d6-9f57-eb674d4720f0 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:31.510991 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3801/7544] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:22:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:22:32.248334 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269afa14-f146-4d3e-8c18-af9087caa1ca None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:32.250650 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-269afa14-f146-4d3e-8c18-af9087caa1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:32.341433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269afa14-f146-4d3e-8c18-af9087caa1ca None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:32.364846 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647be6d-6cbf-4837-b075-eb3c240b6441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:32.380070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647be6d-6cbf-4837-b075-eb3c240b6441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:32.380070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647be6d-6cbf-4837-b075-eb3c240b6441 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:32.380070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647be6d-6cbf-4837-b075-eb3c240b6441 admin admin] PATH_INFO: `/v3/projects/48b22626c5b54f7fa02570b7184d3d9b` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:32.380070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647be6d-6cbf-4837-b075-eb3c240b6441 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48b22626c5b54f7fa02570b7184d3d9b)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:32.418800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647be6d-6cbf-4837-b075-eb3c240b6441 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:32.556846 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4647be6d-6cbf-4837-b075-eb3c240b6441 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48b22626c5b54f7fa02570b7184d3d9b', 'request_id': 'req-4647be6d-6cbf-4837-b075-eb3c240b6441'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:32.567673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4647be6d-6cbf-4837-b075-eb3c240b6441 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48b22626c5b54f7fa02570b7184d3d9b', 'request_id': 'req-4647be6d-6cbf-4837-b075-eb3c240b6441'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:32.603745 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4647be6d-6cbf-4837-b075-eb3c240b6441 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48b22626c5b54f7fa02570b7184d3d9b', 'request_id': 'req-4647be6d-6cbf-4837-b075-eb3c240b6441'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:32.632383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4647be6d-6cbf-4837-b075-eb3c240b6441 admin admin] The token cache is being invalidate because project 48b22626c5b54f7fa02570b7184d3d9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:22:32.633640 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4647be6d-6cbf-4837-b075-eb3c240b6441 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:32.636959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4647be6d-6cbf-4837-b075-eb3c240b6441 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:32.641757 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3744/7545] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:22:32 2022] DELETE /identity/v3/projects/48b22626c5b54f7fa02570b7184d3d9b => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:22:32.646750 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc8f99-706c-428a-a0ab-c92714b9bcbf None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:32.647298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc8f99-706c-428a-a0ab-c92714b9bcbf None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:32.647298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc8f99-706c-428a-a0ab-c92714b9bcbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:32.712433 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-befc8f99-706c-428a-a0ab-c92714b9bcbf None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:22:32.714296 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-befc8f99-706c-428a-a0ab-c92714b9bcbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:32.904288 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:32.930162 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3802/7546] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:22:32.932448 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e428e-a1d4-427c-9a3b-c66b780910ed None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:32.932902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e428e-a1d4-427c-9a3b-c66b780910ed None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:32.933325 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e428e-a1d4-427c-9a3b-c66b780910ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:32.987120 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-3a4e428e-a1d4-427c-9a3b-c66b780910ed None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:22:32.988655 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3a4e428e-a1d4-427c-9a3b-c66b780910ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:33.020296 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3745/7547] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:22:33.021441 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc8f99-706c-428a-a0ab-c92714b9bcbf None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:33.037937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc8f99-706c-428a-a0ab-c92714b9bcbf None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:33.049583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460dc3d-ac73-4391-bbe1-f752d502b468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:33.051911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460dc3d-ac73-4391-bbe1-f752d502b468 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:33.052447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460dc3d-ac73-4391-bbe1-f752d502b468 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:33.052729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460dc3d-ac73-4391-bbe1-f752d502b468 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:33.058744 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460dc3d-ac73-4391-bbe1-f752d502b468 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:22:33.060094 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460dc3d-ac73-4391-bbe1-f752d502b468 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:33.063494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460dc3d-ac73-4391-bbe1-f752d502b468 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:33.096120 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e428e-a1d4-427c-9a3b-c66b780910ed None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:33.104685 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3803/7548] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:22:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:22:33.111150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e428e-a1d4-427c-9a3b-c66b780910ed None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:33.120188 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136bb9d0-d5bb-4859-a0a1-c9dad18bc28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:33.121184 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bb9d0-d5bb-4859-a0a1-c9dad18bc28b admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:33.121569 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bb9d0-d5bb-4859-a0a1-c9dad18bc28b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:33.122199 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bb9d0-d5bb-4859-a0a1-c9dad18bc28b admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:33.122898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136bb9d0-d5bb-4859-a0a1-c9dad18bc28b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:33.124887 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136bb9d0-d5bb-4859-a0a1-c9dad18bc28b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:33.213958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460dc3d-ac73-4391-bbe1-f752d502b468 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:33.215021 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3746/7549] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:22:33 2022] POST /identity/v3/projects => generated 381 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:22:33.229767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460dc3d-ac73-4391-bbe1-f752d502b468 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:33.355867 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029db26-e9a6-4200-9e2d-2b995b16a4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:33.356730 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029db26-e9a6-4200-9e2d-2b995b16a4f8 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:33.357014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029db26-e9a6-4200-9e2d-2b995b16a4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:33.357500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029db26-e9a6-4200-9e2d-2b995b16a4f8 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:33.358746 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7029db26-e9a6-4200-9e2d-2b995b16a4f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:33.361239 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7029db26-e9a6-4200-9e2d-2b995b16a4f8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:33.439760 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3804/7550] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:22:33 2022] POST /identity/v3/users => generated 291 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:22:33.448299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136bb9d0-d5bb-4859-a0a1-c9dad18bc28b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:33.472009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136bb9d0-d5bb-4859-a0a1-c9dad18bc28b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:33.491913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb033f1-8757-4a2d-be40-01e70d151ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:33.493326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb033f1-8757-4a2d-be40-01e70d151ccf admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:33.494502 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb033f1-8757-4a2d-be40-01e70d151ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:33.497549 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb033f1-8757-4a2d-be40-01e70d151ccf admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:33.499912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb033f1-8757-4a2d-be40-01e70d151ccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:33.502582 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb033f1-8757-4a2d-be40-01e70d151ccf admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:33.546398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029db26-e9a6-4200-9e2d-2b995b16a4f8 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:33.557462 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3747/7551] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:22:33.560660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029db26-e9a6-4200-9e2d-2b995b16a4f8 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:33.588879 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768b5d3-6e1e-4d36-9881-70103cdc7cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:33.590850 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768b5d3-6e1e-4d36-9881-70103cdc7cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:33.591159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768b5d3-6e1e-4d36-9881-70103cdc7cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:33.591450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768b5d3-6e1e-4d36-9881-70103cdc7cf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:33.592130 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768b5d3-6e1e-4d36-9881-70103cdc7cf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:33.599978 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768b5d3-6e1e-4d36-9881-70103cdc7cf2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:33.627354 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3805/7552] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:22:33.631571 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb033f1-8757-4a2d-be40-01e70d151ccf admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:33.653725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb033f1-8757-4a2d-be40-01e70d151ccf admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:33.676700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86801f4e-72a3-49e4-90bb-af78e49a7976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:33.677476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86801f4e-72a3-49e4-90bb-af78e49a7976 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:33.677768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86801f4e-72a3-49e4-90bb-af78e49a7976 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:33.678195 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86801f4e-72a3-49e4-90bb-af78e49a7976 admin admin] PATH_INFO: `/v3/projects/1d5bdf0fa21e4cdb88bcfdfbd9e312d6/users/bb36f714e0144afbaa887818b484d506/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:33.750949 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86801f4e-72a3-49e4-90bb-af78e49a7976 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d5bdf0fa21e4cdb88bcfdfbd9e312d6, user_id=bb36f714e0144afbaa887818b484d506, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:33.762659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86801f4e-72a3-49e4-90bb-af78e49a7976 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:33.788038 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3748/7553] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:22:33 2022] PUT /identity/v3/projects/1d5bdf0fa21e4cdb88bcfdfbd9e312d6/users/bb36f714e0144afbaa887818b484d506/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:22:33.794051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7813db-2d46-4e17-89d7-88353968b83e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:33.794645 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7813db-2d46-4e17-89d7-88353968b83e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:33.794854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7813db-2d46-4e17-89d7-88353968b83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:33.829257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-ad7813db-2d46-4e17-89d7-88353968b83e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:22:33.832654 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ad7813db-2d46-4e17-89d7-88353968b83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:34.034202 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3806/7554] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:22:34.048965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86801f4e-72a3-49e4-90bb-af78e49a7976 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:34.050865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-86801f4e-72a3-49e4-90bb-af78e49a7976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:34.084612 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:34.197982 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86801f4e-72a3-49e4-90bb-af78e49a7976 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:34.206210 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b3269-9794-4cb9-a819-09f94e25d826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:34.206893 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b3269-9794-4cb9-a819-09f94e25d826 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:34.207173 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b3269-9794-4cb9-a819-09f94e25d826 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:34.207445 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b3269-9794-4cb9-a819-09f94e25d826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:34.233149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b3269-9794-4cb9-a819-09f94e25d826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:34.234835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b3269-9794-4cb9-a819-09f94e25d826 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:34.263418 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3749/7555] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:22:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:22:41.196760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f8a68-416b-4548-89fe-884b4ce57351 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:41.197292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f8a68-416b-4548-89fe-884b4ce57351 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:41.197292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f8a68-416b-4548-89fe-884b4ce57351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:41.263149 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-157f8a68-416b-4548-89fe-884b4ce57351 None None] MFA Rules not processed for user `28aa42b542db43a1bf3d1d21d687b95b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:22:41.264818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-157f8a68-416b-4548-89fe-884b4ce57351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:41.430653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:41.464614 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3807/7556] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:22:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:22:41.469785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b3269-9794-4cb9-a819-09f94e25d826 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:41.472374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-696b3269-9794-4cb9-a819-09f94e25d826 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:41.660110 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b3269-9794-4cb9-a819-09f94e25d826 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:41.682791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f835b-39b1-4576-a4cf-d86b48a3af18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:41.683423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f835b-39b1-4576-a4cf-d86b48a3af18 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:41.683704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f835b-39b1-4576-a4cf-d86b48a3af18 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:41.683981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f835b-39b1-4576-a4cf-d86b48a3af18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:41.710348 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f835b-39b1-4576-a4cf-d86b48a3af18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:41.712008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f835b-39b1-4576-a4cf-d86b48a3af18 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:41.745347 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3750/7557] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:22:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:22:42.141507 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e66c4-5c9c-463d-883e-9e5af7e05c58 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:42.141725 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e66c4-5c9c-463d-883e-9e5af7e05c58 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:42.142006 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e66c4-5c9c-463d-883e-9e5af7e05c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:42.186079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-377e66c4-5c9c-463d-883e-9e5af7e05c58 None None] MFA Rules not processed for user `072374854bee412d88926414a37f1c36`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:22:42.187258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-377e66c4-5c9c-463d-883e-9e5af7e05c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:42.312955 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3808/7558] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:22:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:22:42.318806 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f835b-39b1-4576-a4cf-d86b48a3af18 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:42.320195 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-347f835b-39b1-4576-a4cf-d86b48a3af18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:42.340670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f835b-39b1-4576-a4cf-d86b48a3af18 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:42.349384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e66c4-5c9c-463d-883e-9e5af7e05c58 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:42.352561 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-377e66c4-5c9c-463d-883e-9e5af7e05c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:42.357022 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59659f-77cb-4429-804e-696bfc29c33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:42.368367 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59659f-77cb-4429-804e-696bfc29c33f admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:42.368665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59659f-77cb-4429-804e-696bfc29c33f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:42.368941 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59659f-77cb-4429-804e-696bfc29c33f admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:42.369642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59659f-77cb-4429-804e-696bfc29c33f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:42.374923 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59659f-77cb-4429-804e-696bfc29c33f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:42.386306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e66c4-5c9c-463d-883e-9e5af7e05c58 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:42.398530 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e0d16-ce10-4485-88f6-3e84f0247d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:42.401420 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e0d16-ce10-4485-88f6-3e84f0247d30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:42.404005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e0d16-ce10-4485-88f6-3e84f0247d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:42.404605 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e0d16-ce10-4485-88f6-3e84f0247d30 admin admin] PATH_INFO: `/v3/users/84b077253cd94d51ae9dc848e62aa937` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:42.407225 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e0d16-ce10-4485-88f6-3e84f0247d30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84b077253cd94d51ae9dc848e62aa937)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:42.409463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e0d16-ce10-4485-88f6-3e84f0247d30 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:42.442761 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3751/7559] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:22:42 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:22:42.443835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59659f-77cb-4429-804e-696bfc29c33f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:42.503612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c51e0d16-ce10-4485-88f6-3e84f0247d30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84b077253cd94d51ae9dc848e62aa937'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:42.521514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c51e0d16-ce10-4485-88f6-3e84f0247d30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84b077253cd94d51ae9dc848e62aa937'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:42.523829 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c51e0d16-ce10-4485-88f6-3e84f0247d30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84b077253cd94d51ae9dc848e62aa937'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:42.526732 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c51e0d16-ce10-4485-88f6-3e84f0247d30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84b077253cd94d51ae9dc848e62aa937'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:42.528632 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59659f-77cb-4429-804e-696bfc29c33f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:42.534816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58bdfbc-eda5-485b-b2ae-57e3d48a720b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:42.535694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bdfbc-eda5-485b-b2ae-57e3d48a720b admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:42.536169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bdfbc-eda5-485b-b2ae-57e3d48a720b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:42.536605 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bdfbc-eda5-485b-b2ae-57e3d48a720b admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:42.538691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58bdfbc-eda5-485b-b2ae-57e3d48a720b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:42.541257 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58bdfbc-eda5-485b-b2ae-57e3d48a720b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:42.549586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c51e0d16-ce10-4485-88f6-3e84f0247d30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84b077253cd94d51ae9dc848e62aa937'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:42.577278 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3752/7560] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:22:42 2022] POST /identity/v3/users => generated 298 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:22:42.579642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58bdfbc-eda5-485b-b2ae-57e3d48a720b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:42.584571 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d58bdfbc-eda5-485b-b2ae-57e3d48a720b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:42.597951 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3809/7561] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:22:42 2022] DELETE /identity/v3/users/84b077253cd94d51ae9dc848e62aa937 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:22:42.608270 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58bdfbc-eda5-485b-b2ae-57e3d48a720b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:42.621954 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:42.745752 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f27b8-99e0-4fa5-95e6-dd905d6d2743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:42.746893 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f27b8-99e0-4fa5-95e6-dd905d6d2743 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:42.747351 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f27b8-99e0-4fa5-95e6-dd905d6d2743 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:42.748005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f27b8-99e0-4fa5-95e6-dd905d6d2743 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:42.748820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f27b8-99e0-4fa5-95e6-dd905d6d2743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:42.750811 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f27b8-99e0-4fa5-95e6-dd905d6d2743 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:42.767710 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3753/7562] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:22:42.771817 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e0d16-ce10-4485-88f6-3e84f0247d30 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:42.786940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e0d16-ce10-4485-88f6-3e84f0247d30 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:42.795936 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cadb20b-7dfb-445f-9655-7b2d6a2f8bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:42.797195 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadb20b-7dfb-445f-9655-7b2d6a2f8bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:42.797786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadb20b-7dfb-445f-9655-7b2d6a2f8bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:42.798260 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadb20b-7dfb-445f-9655-7b2d6a2f8bbe admin admin] PATH_INFO: `/v3/projects/4e56f134187745e78c39faa081e3fd9e/users/6415df36166640b69f303fe476fa86db/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:42.839863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cadb20b-7dfb-445f-9655-7b2d6a2f8bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e56f134187745e78c39faa081e3fd9e, user_id=6415df36166640b69f303fe476fa86db, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:42.842774 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cadb20b-7dfb-445f-9655-7b2d6a2f8bbe admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:42.874212 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3810/7563] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:22:42 2022] PUT /identity/v3/projects/4e56f134187745e78c39faa081e3fd9e/users/6415df36166640b69f303fe476fa86db/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:22:42.878061 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f27b8-99e0-4fa5-95e6-dd905d6d2743 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:42.902117 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f27b8-99e0-4fa5-95e6-dd905d6d2743 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:43.059466 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497164c-4913-437e-9a3a-ff2c047cf93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:43.060262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497164c-4913-437e-9a3a-ff2c047cf93c admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:43.060646 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497164c-4913-437e-9a3a-ff2c047cf93c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:43.061026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497164c-4913-437e-9a3a-ff2c047cf93c admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:43.062440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497164c-4913-437e-9a3a-ff2c047cf93c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:43.064222 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497164c-4913-437e-9a3a-ff2c047cf93c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:43.081614 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cadb20b-7dfb-445f-9655-7b2d6a2f8bbe admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:43.083505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6cadb20b-7dfb-445f-9655-7b2d6a2f8bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:43.106882 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3754/7564] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:22:43.112800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497164c-4913-437e-9a3a-ff2c047cf93c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:43.114079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cadb20b-7dfb-445f-9655-7b2d6a2f8bbe admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:43.153421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699309e-fa75-41c9-8e65-175a995ff999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:43.154085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699309e-fa75-41c9-8e65-175a995ff999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:43.154368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699309e-fa75-41c9-8e65-175a995ff999 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:43.154669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699309e-fa75-41c9-8e65-175a995ff999 admin admin] PATH_INFO: `/v3/projects/ed693b6b6ec24af8ac2e64bcd24132f5` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:43.155847 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699309e-fa75-41c9-8e65-175a995ff999 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed693b6b6ec24af8ac2e64bcd24132f5)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:43.157804 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699309e-fa75-41c9-8e65-175a995ff999 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:43.175467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497164c-4913-437e-9a3a-ff2c047cf93c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:43.196164 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa32bf1-f784-416a-974c-8364bb85dc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:43.198091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa32bf1-f784-416a-974c-8364bb85dc60 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:43.198380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa32bf1-f784-416a-974c-8364bb85dc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:43.201690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa32bf1-f784-416a-974c-8364bb85dc60 admin admin] PATH_INFO: `/v3/projects/4e56f134187745e78c39faa081e3fd9e/users/6415df36166640b69f303fe476fa86db/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:43.206532 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa32bf1-f784-416a-974c-8364bb85dc60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e56f134187745e78c39faa081e3fd9e, user_id=6415df36166640b69f303fe476fa86db, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:43.214997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa32bf1-f784-416a-974c-8364bb85dc60 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:43.230630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:43.264438 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3755/7565] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:22:43 2022] PUT /identity/v3/projects/4e56f134187745e78c39faa081e3fd9e/users/6415df36166640b69f303fe476fa86db/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:22:43.273809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3699309e-fa75-41c9-8e65-175a995ff999 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed693b6b6ec24af8ac2e64bcd24132f5', 'request_id': 'req-3699309e-fa75-41c9-8e65-175a995ff999'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:43.292432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3699309e-fa75-41c9-8e65-175a995ff999 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed693b6b6ec24af8ac2e64bcd24132f5', 'request_id': 'req-3699309e-fa75-41c9-8e65-175a995ff999'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:43.311746 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3699309e-fa75-41c9-8e65-175a995ff999 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed693b6b6ec24af8ac2e64bcd24132f5', 'request_id': 'req-3699309e-fa75-41c9-8e65-175a995ff999'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:43.336684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3699309e-fa75-41c9-8e65-175a995ff999 admin admin] The token cache is being invalidate because project ed693b6b6ec24af8ac2e64bcd24132f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:22:43.337362 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3699309e-fa75-41c9-8e65-175a995ff999 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:43.341507 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3699309e-fa75-41c9-8e65-175a995ff999 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:43.344931 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3811/7566] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:22:43 2022] DELETE /identity/v3/projects/ed693b6b6ec24af8ac2e64bcd24132f5 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:22:43.350186 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa32bf1-f784-416a-974c-8364bb85dc60 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:43.352591 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-dfa32bf1-f784-416a-974c-8364bb85dc60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:43.516822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa32bf1-f784-416a-974c-8364bb85dc60 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:43.526844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecd2a7-b194-48c3-b961-ac3b1921e380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:43.527709 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecd2a7-b194-48c3-b961-ac3b1921e380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:43.528435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecd2a7-b194-48c3-b961-ac3b1921e380 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:43.528866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecd2a7-b194-48c3-b961-ac3b1921e380 admin admin] PATH_INFO: `/v3/users/341cf77726734c9bb07578960cd75017` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:43.531016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ecd2a7-b194-48c3-b961-ac3b1921e380 admin admin] RBAC: Authorizing `identity:delete_user(user_id=341cf77726734c9bb07578960cd75017)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:43.533184 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ecd2a7-b194-48c3-b961-ac3b1921e380 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:43.619424 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:43.643883 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-07ecd2a7-b194-48c3-b961-ac3b1921e380 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '341cf77726734c9bb07578960cd75017'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:43.644649 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-07ecd2a7-b194-48c3-b961-ac3b1921e380 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '341cf77726734c9bb07578960cd75017'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:43.645307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-07ecd2a7-b194-48c3-b961-ac3b1921e380 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '341cf77726734c9bb07578960cd75017'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:43.659924 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-07ecd2a7-b194-48c3-b961-ac3b1921e380 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '341cf77726734c9bb07578960cd75017'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:43.683669 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-07ecd2a7-b194-48c3-b961-ac3b1921e380 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '341cf77726734c9bb07578960cd75017'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:43.707253 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3756/7567] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:22:43 2022] DELETE /identity/v3/users/341cf77726734c9bb07578960cd75017 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:22:45.766060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699309e-fa75-41c9-8e65-175a995ff999 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:46.018994 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699309e-fa75-41c9-8e65-175a995ff999 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:46.143021 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843a8da-f353-4e55-8c03-f6f390539686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:46.144473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843a8da-f353-4e55-8c03-f6f390539686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:46.145940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843a8da-f353-4e55-8c03-f6f390539686 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:46.145940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843a8da-f353-4e55-8c03-f6f390539686 admin admin] PATH_INFO: `/v3/projects/6d82fd0ddd3c429a8de97e52b682fc58` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:46.148648 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843a8da-f353-4e55-8c03-f6f390539686 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d82fd0ddd3c429a8de97e52b682fc58)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:46.152821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843a8da-f353-4e55-8c03-f6f390539686 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:46.253071 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1843a8da-f353-4e55-8c03-f6f390539686 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d82fd0ddd3c429a8de97e52b682fc58', 'request_id': 'req-1843a8da-f353-4e55-8c03-f6f390539686'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:46.269556 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1843a8da-f353-4e55-8c03-f6f390539686 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d82fd0ddd3c429a8de97e52b682fc58', 'request_id': 'req-1843a8da-f353-4e55-8c03-f6f390539686'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:46.285977 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1843a8da-f353-4e55-8c03-f6f390539686 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d82fd0ddd3c429a8de97e52b682fc58', 'request_id': 'req-1843a8da-f353-4e55-8c03-f6f390539686'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:46.287513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:46.312803 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1843a8da-f353-4e55-8c03-f6f390539686 admin admin] The token cache is being invalidate because project 6d82fd0ddd3c429a8de97e52b682fc58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:22:46.313208 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1843a8da-f353-4e55-8c03-f6f390539686 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:46.314380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1843a8da-f353-4e55-8c03-f6f390539686 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:22:46.316276 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3812/7568] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:22:45 2022] DELETE /identity/v3/projects/6d82fd0ddd3c429a8de97e52b682fc58 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:22:46.812386 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b16a0c-b726-43f8-ab31-2fed49214576 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:46.813434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b16a0c-b726-43f8-ab31-2fed49214576 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:46.813993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b16a0c-b726-43f8-ab31-2fed49214576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:46.853894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-58b16a0c-b726-43f8-ab31-2fed49214576 None None] MFA Rules not processed for user `28aa42b542db43a1bf3d1d21d687b95b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:22:46.859264 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-58b16a0c-b726-43f8-ab31-2fed49214576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:47.020869 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3757/7569] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:22:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:22:50.076254 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b273f-117f-4159-b44f-c5c3be9b3923 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:50.076809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b273f-117f-4159-b44f-c5c3be9b3923 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:50.076809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b273f-117f-4159-b44f-c5c3be9b3923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:50.134725 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-504b273f-117f-4159-b44f-c5c3be9b3923 None None] MFA Rules not processed for user `bb36f714e0144afbaa887818b484d506`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:22:50.144515 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-504b273f-117f-4159-b44f-c5c3be9b3923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:50.253836 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3813/7570] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:22:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:22:50.259373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b16a0c-b726-43f8-ab31-2fed49214576 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:50.261619 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-58b16a0c-b726-43f8-ab31-2fed49214576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:50.345581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b16a0c-b726-43f8-ab31-2fed49214576 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:50.352181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc88af2-d144-4062-9489-63a0288a1003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:50.353303 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc88af2-d144-4062-9489-63a0288a1003 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:50.353837 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc88af2-d144-4062-9489-63a0288a1003 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:50.354422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc88af2-d144-4062-9489-63a0288a1003 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:50.355921 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc88af2-d144-4062-9489-63a0288a1003 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:50.358283 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc88af2-d144-4062-9489-63a0288a1003 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:50.397319 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3758/7571] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:22:50 2022] POST /identity/v3/projects => generated 381 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:22:50.402158 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b273f-117f-4159-b44f-c5c3be9b3923 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:50.414397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b273f-117f-4159-b44f-c5c3be9b3923 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:50.586457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a352b-c325-4513-9bcc-a3cf31bf7300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:50.587227 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a352b-c325-4513-9bcc-a3cf31bf7300 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:50.587515 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a352b-c325-4513-9bcc-a3cf31bf7300 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:50.587841 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a352b-c325-4513-9bcc-a3cf31bf7300 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:50.588866 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a352b-c325-4513-9bcc-a3cf31bf7300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:50.593514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a352b-c325-4513-9bcc-a3cf31bf7300 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:50.630180 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3814/7572] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:22:50 2022] POST /identity/v3/users => generated 297 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:22:50.634726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc88af2-d144-4062-9489-63a0288a1003 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:50.651308 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc88af2-d144-4062-9489-63a0288a1003 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:50.687579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039e13d-42dd-48c1-8a0e-a5045848cc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:50.688292 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039e13d-42dd-48c1-8a0e-a5045848cc18 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:50.688559 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039e13d-42dd-48c1-8a0e-a5045848cc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:50.688998 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039e13d-42dd-48c1-8a0e-a5045848cc18 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:50.689659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039e13d-42dd-48c1-8a0e-a5045848cc18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:50.691565 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039e13d-42dd-48c1-8a0e-a5045848cc18 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:50.719449 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3759/7573] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:22:50.720419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a352b-c325-4513-9bcc-a3cf31bf7300 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:50.741878 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a352b-c325-4513-9bcc-a3cf31bf7300 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:50.770777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d75eb-6760-462a-b0da-e63751a93a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:50.775317 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d75eb-6760-462a-b0da-e63751a93a0e admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:50.777646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d75eb-6760-462a-b0da-e63751a93a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:50.778327 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d75eb-6760-462a-b0da-e63751a93a0e admin admin] PATH_INFO: `/v3/projects/0fb01fe6a28240089e7d0e27cb1112f9/users/38abb9e6bc1b4210bfc93bf4792870fb/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:50.810309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d75eb-6760-462a-b0da-e63751a93a0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fb01fe6a28240089e7d0e27cb1112f9, user_id=38abb9e6bc1b4210bfc93bf4792870fb, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:50.814315 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d75eb-6760-462a-b0da-e63751a93a0e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:50.836347 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3815/7574] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:22:50 2022] PUT /identity/v3/projects/0fb01fe6a28240089e7d0e27cb1112f9/users/38abb9e6bc1b4210bfc93bf4792870fb/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:22:50.840115 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039e13d-42dd-48c1-8a0e-a5045848cc18 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:50.855329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039e13d-42dd-48c1-8a0e-a5045848cc18 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:50.931204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:50.991129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2f0be-7b71-486f-a7d4-e16955c41038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:50.992220 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2f0be-7b71-486f-a7d4-e16955c41038 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:50.992819 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2f0be-7b71-486f-a7d4-e16955c41038 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:50.993338 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2f0be-7b71-486f-a7d4-e16955c41038 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:50.995136 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c2f0be-7b71-486f-a7d4-e16955c41038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:50.997555 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c2f0be-7b71-486f-a7d4-e16955c41038 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:51.011954 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3760/7575] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:22:51.020338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d75eb-6760-462a-b0da-e63751a93a0e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:51.046111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d75eb-6760-462a-b0da-e63751a93a0e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:51.057370 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3e10d-23ce-4c69-8b7d-63ab2c1de3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:51.058283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3e10d-23ce-4c69-8b7d-63ab2c1de3cb admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:51.059675 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3e10d-23ce-4c69-8b7d-63ab2c1de3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:51.060114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3e10d-23ce-4c69-8b7d-63ab2c1de3cb admin admin] PATH_INFO: `/v3/projects/0fb01fe6a28240089e7d0e27cb1112f9/users/38abb9e6bc1b4210bfc93bf4792870fb/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:51.062291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3e10d-23ce-4c69-8b7d-63ab2c1de3cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fb01fe6a28240089e7d0e27cb1112f9, user_id=38abb9e6bc1b4210bfc93bf4792870fb, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:51.066104 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3e10d-23ce-4c69-8b7d-63ab2c1de3cb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:51.089095 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3816/7576] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:22:51 2022] PUT /identity/v3/projects/0fb01fe6a28240089e7d0e27cb1112f9/users/38abb9e6bc1b4210bfc93bf4792870fb/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:22:53.585397 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac28e9-314f-4e92-b6bd-1197248817b6 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:53.585936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac28e9-314f-4e92-b6bd-1197248817b6 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:53.585936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac28e9-314f-4e92-b6bd-1197248817b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:53.607962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-64ac28e9-314f-4e92-b6bd-1197248817b6 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:22:53.609572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-64ac28e9-314f-4e92-b6bd-1197248817b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:53.691658 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3761/7577] 10.222.0.33 () {58 vars in 967 bytes} [Sat Aug 6 21:22:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:22:53.712693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3e10d-23ce-4c69-8b7d-63ab2c1de3cb admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:53.715169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4de3e10d-23ce-4c69-8b7d-63ab2c1de3cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:53.802795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:53.869601 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3e10d-23ce-4c69-8b7d-63ab2c1de3cb admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:53.880693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316e18c-8aca-4915-8f19-738ba1fac813 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:53.881350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316e18c-8aca-4915-8f19-738ba1fac813 service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:53.882232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316e18c-8aca-4915-8f19-738ba1fac813 service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:53.882600 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316e18c-8aca-4915-8f19-738ba1fac813 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:53.895849 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316e18c-8aca-4915-8f19-738ba1fac813 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:53.899372 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316e18c-8aca-4915-8f19-738ba1fac813 service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:53.911944 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3817/7578] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:22:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:22:58.189190 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113f5fc-8eea-4332-ae96-7ac665d88eef None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:58.189665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113f5fc-8eea-4332-ae96-7ac665d88eef None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:58.189761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113f5fc-8eea-4332-ae96-7ac665d88eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:58.243352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a113f5fc-8eea-4332-ae96-7ac665d88eef None None] MFA Rules not processed for user `6415df36166640b69f303fe476fa86db`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:22:58.244754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a113f5fc-8eea-4332-ae96-7ac665d88eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:58.369564 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3762/7579] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:22:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:22:58.383295 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316e18c-8aca-4915-8f19-738ba1fac813 service swift] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:22:58.385303 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6316e18c-8aca-4915-8f19-738ba1fac813 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:58.458096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316e18c-8aca-4915-8f19-738ba1fac813 service swift] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:22:58.462670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8e248-8bf3-4eb9-b0f9-99e697910460 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10759b2abd4cafacf338551327775e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:22:58.463308 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8e248-8bf3-4eb9-b0f9-99e697910460 service glance] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:22:58.463594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8e248-8bf3-4eb9-b0f9-99e697910460 service glance] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:22:58.463892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8e248-8bf3-4eb9-b0f9-99e697910460 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:22:58.465710 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2fd8e248-8bf3-4eb9-b0f9-99e697910460 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:22:58.542538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd8e248-8bf3-4eb9-b0f9-99e697910460 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:22:58.544356 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd8e248-8bf3-4eb9-b0f9-99e697910460 service glance] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:22:58.557589 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3818/7580] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:22:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:23:01.841622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f08d3-37eb-4a24-8c33-ef3411f5717b None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:01.842577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f08d3-37eb-4a24-8c33-ef3411f5717b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:01.842866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f08d3-37eb-4a24-8c33-ef3411f5717b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:01.877760 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-519f08d3-37eb-4a24-8c33-ef3411f5717b None None] MFA Rules not processed for user `38abb9e6bc1b4210bfc93bf4792870fb`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:23:01.879281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-519f08d3-37eb-4a24-8c33-ef3411f5717b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:01.926873 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:01.962321 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3763/7581] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:23:01 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:23:01.977005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8e248-8bf3-4eb9-b0f9-99e697910460 service glance] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:01.978686 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2fd8e248-8bf3-4eb9-b0f9-99e697910460 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:02.080889 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8e248-8bf3-4eb9-b0f9-99e697910460 service glance] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:02.088106 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b80e9-06ea-493d-adeb-f69b8be2e464 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:02.088720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b80e9-06ea-493d-adeb-f69b8be2e464 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:02.089004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b80e9-06ea-493d-adeb-f69b8be2e464 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:02.089275 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b80e9-06ea-493d-adeb-f69b8be2e464 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:02.095116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:02.101597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b80e9-06ea-493d-adeb-f69b8be2e464 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:02.103255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b80e9-06ea-493d-adeb-f69b8be2e464 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:02.118760 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3819/7582] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:23:01 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:23:02.400918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f08d3-37eb-4a24-8c33-ef3411f5717b None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:02.402519 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-519f08d3-37eb-4a24-8c33-ef3411f5717b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:02.481550 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f08d3-37eb-4a24-8c33-ef3411f5717b None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:02.486428 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934fa97-ae4f-4074-a9ba-fd884a0aab44 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:02.487059 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934fa97-ae4f-4074-a9ba-fd884a0aab44 service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:02.487337 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934fa97-ae4f-4074-a9ba-fd884a0aab44 service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:02.487611 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934fa97-ae4f-4074-a9ba-fd884a0aab44 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:02.489306 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c934fa97-ae4f-4074-a9ba-fd884a0aab44 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:02.504034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c934fa97-ae4f-4074-a9ba-fd884a0aab44 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:02.505818 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c934fa97-ae4f-4074-a9ba-fd884a0aab44 service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:02.518504 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3764/7583] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:23:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:23:07.156076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b80e9-06ea-493d-adeb-f69b8be2e464 service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:07.157583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a93b80e9-06ea-493d-adeb-f69b8be2e464 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:07.179668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b80e9-06ea-493d-adeb-f69b8be2e464 service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:07.188421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45aa4f-baff-438d-ba2d-893a2c4460e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:07.192248 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45aa4f-baff-438d-ba2d-893a2c4460e3 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:07.192580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45aa4f-baff-438d-ba2d-893a2c4460e3 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:07.192866 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45aa4f-baff-438d-ba2d-893a2c4460e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:07.196060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-fe45aa4f-baff-438d-ba2d-893a2c4460e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:07.302494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45aa4f-baff-438d-ba2d-893a2c4460e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:07.304809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45aa4f-baff-438d-ba2d-893a2c4460e3 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:07.315290 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3820/7584] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:23:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:23:12.512011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=44 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:12.567353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934fa97-ae4f-4074-a9ba-fd884a0aab44 service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:12.655267 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934fa97-ae4f-4074-a9ba-fd884a0aab44 service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:12.659973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed599adf-8ca1-4ddc-82b2-0eb08dcd7556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:12.660609 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed599adf-8ca1-4ddc-82b2-0eb08dcd7556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:12.660893 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed599adf-8ca1-4ddc-82b2-0eb08dcd7556 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:12.661167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed599adf-8ca1-4ddc-82b2-0eb08dcd7556 admin admin] PATH_INFO: `/v3/users/bb36f714e0144afbaa887818b484d506` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:12.662466 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed599adf-8ca1-4ddc-82b2-0eb08dcd7556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb36f714e0144afbaa887818b484d506)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:12.664461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed599adf-8ca1-4ddc-82b2-0eb08dcd7556 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:12.722176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ed599adf-8ca1-4ddc-82b2-0eb08dcd7556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb36f714e0144afbaa887818b484d506'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:12.722871 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ed599adf-8ca1-4ddc-82b2-0eb08dcd7556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb36f714e0144afbaa887818b484d506'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:12.723941 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ed599adf-8ca1-4ddc-82b2-0eb08dcd7556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb36f714e0144afbaa887818b484d506'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:12.732132 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ed599adf-8ca1-4ddc-82b2-0eb08dcd7556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb36f714e0144afbaa887818b484d506'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:12.745214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ed599adf-8ca1-4ddc-82b2-0eb08dcd7556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb36f714e0144afbaa887818b484d506'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:12.758997 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3765/7585] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:23:12 2022] DELETE /identity/v3/users/bb36f714e0144afbaa887818b484d506 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:23:12.866428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45aa4f-baff-438d-ba2d-893a2c4460e3 service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:12.868924 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-fe45aa4f-baff-438d-ba2d-893a2c4460e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:12.948486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45aa4f-baff-438d-ba2d-893a2c4460e3 service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:13.009977 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083fa06-22ab-4d83-82b5-ee41eb1e01fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:13.010685 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083fa06-22ab-4d83-82b5-ee41eb1e01fd service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:13.011135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083fa06-22ab-4d83-82b5-ee41eb1e01fd service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:13.011732 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083fa06-22ab-4d83-82b5-ee41eb1e01fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:13.013445 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9083fa06-22ab-4d83-82b5-ee41eb1e01fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:13.019191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed599adf-8ca1-4ddc-82b2-0eb08dcd7556 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:13.021127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ed599adf-8ca1-4ddc-82b2-0eb08dcd7556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:13.092016 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083fa06-22ab-4d83-82b5-ee41eb1e01fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:13.093903 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083fa06-22ab-4d83-82b5-ee41eb1e01fd service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:13.097972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:13.104985 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3821/7586] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:23:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:23:13.106090 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed599adf-8ca1-4ddc-82b2-0eb08dcd7556 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:13.110769 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfde55-367d-40d3-8a42-f7609d47e9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:13.111611 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfde55-367d-40d3-8a42-f7609d47e9b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:13.111896 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfde55-367d-40d3-8a42-f7609d47e9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:13.112168 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfde55-367d-40d3-8a42-f7609d47e9b2 admin admin] PATH_INFO: `/v3/projects/1d5bdf0fa21e4cdb88bcfdfbd9e312d6` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:13.113288 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cfde55-367d-40d3-8a42-f7609d47e9b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d5bdf0fa21e4cdb88bcfdfbd9e312d6)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:13.116161 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cfde55-367d-40d3-8a42-f7609d47e9b2 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:13.142661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:13.170854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f0cfde55-367d-40d3-8a42-f7609d47e9b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d5bdf0fa21e4cdb88bcfdfbd9e312d6', 'request_id': 'req-f0cfde55-367d-40d3-8a42-f7609d47e9b2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:13.176619 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f0cfde55-367d-40d3-8a42-f7609d47e9b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d5bdf0fa21e4cdb88bcfdfbd9e312d6', 'request_id': 'req-f0cfde55-367d-40d3-8a42-f7609d47e9b2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:13.185250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f0cfde55-367d-40d3-8a42-f7609d47e9b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d5bdf0fa21e4cdb88bcfdfbd9e312d6', 'request_id': 'req-f0cfde55-367d-40d3-8a42-f7609d47e9b2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:13.200583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f0cfde55-367d-40d3-8a42-f7609d47e9b2 admin admin] The token cache is being invalidate because project 1d5bdf0fa21e4cdb88bcfdfbd9e312d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:23:13.201097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f0cfde55-367d-40d3-8a42-f7609d47e9b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:13.201787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f0cfde55-367d-40d3-8a42-f7609d47e9b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:13.203802 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3766/7587] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:23:13 2022] DELETE /identity/v3/projects/1d5bdf0fa21e4cdb88bcfdfbd9e312d6 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:23:13.207522 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083fa06-22ab-4d83-82b5-ee41eb1e01fd service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:13.217245 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083fa06-22ab-4d83-82b5-ee41eb1e01fd service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:13.280298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42294dac-0b3a-45d0-bf37-60a9630a886d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:13.281531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42294dac-0b3a-45d0-bf37-60a9630a886d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:13.281817 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42294dac-0b3a-45d0-bf37-60a9630a886d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:13.282097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42294dac-0b3a-45d0-bf37-60a9630a886d admin admin] PATH_INFO: `/v3/users/38abb9e6bc1b4210bfc93bf4792870fb` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:13.283265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42294dac-0b3a-45d0-bf37-60a9630a886d admin admin] RBAC: Authorizing `identity:delete_user(user_id=38abb9e6bc1b4210bfc93bf4792870fb)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:13.285188 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42294dac-0b3a-45d0-bf37-60a9630a886d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:13.337608 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-42294dac-0b3a-45d0-bf37-60a9630a886d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38abb9e6bc1b4210bfc93bf4792870fb'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:13.345021 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-42294dac-0b3a-45d0-bf37-60a9630a886d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38abb9e6bc1b4210bfc93bf4792870fb'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:13.345739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-42294dac-0b3a-45d0-bf37-60a9630a886d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38abb9e6bc1b4210bfc93bf4792870fb'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:13.346364 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-42294dac-0b3a-45d0-bf37-60a9630a886d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38abb9e6bc1b4210bfc93bf4792870fb'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:13.355392 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-42294dac-0b3a-45d0-bf37-60a9630a886d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38abb9e6bc1b4210bfc93bf4792870fb'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:13.374783 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3822/7588] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:23:13 2022] DELETE /identity/v3/users/38abb9e6bc1b4210bfc93bf4792870fb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:23:13.568290 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfde55-367d-40d3-8a42-f7609d47e9b2 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:13.569912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f0cfde55-367d-40d3-8a42-f7609d47e9b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:13.586910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfde55-367d-40d3-8a42-f7609d47e9b2 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:13.649787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeffd22-2cdc-46de-87b6-306b73b9232f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:13.650418 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeffd22-2cdc-46de-87b6-306b73b9232f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:13.650726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeffd22-2cdc-46de-87b6-306b73b9232f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:13.651002 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeffd22-2cdc-46de-87b6-306b73b9232f admin admin] PATH_INFO: `/v3/projects/0fb01fe6a28240089e7d0e27cb1112f9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:13.652149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeffd22-2cdc-46de-87b6-306b73b9232f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fb01fe6a28240089e7d0e27cb1112f9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:13.654213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeffd22-2cdc-46de-87b6-306b73b9232f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:13.717568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9aeffd22-2cdc-46de-87b6-306b73b9232f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fb01fe6a28240089e7d0e27cb1112f9', 'request_id': 'req-9aeffd22-2cdc-46de-87b6-306b73b9232f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:13.723105 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9aeffd22-2cdc-46de-87b6-306b73b9232f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fb01fe6a28240089e7d0e27cb1112f9', 'request_id': 'req-9aeffd22-2cdc-46de-87b6-306b73b9232f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:13.730534 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9aeffd22-2cdc-46de-87b6-306b73b9232f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fb01fe6a28240089e7d0e27cb1112f9', 'request_id': 'req-9aeffd22-2cdc-46de-87b6-306b73b9232f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:13.747276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9aeffd22-2cdc-46de-87b6-306b73b9232f admin admin] The token cache is being invalidate because project 0fb01fe6a28240089e7d0e27cb1112f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:23:13.747568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9aeffd22-2cdc-46de-87b6-306b73b9232f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:13.748216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9aeffd22-2cdc-46de-87b6-306b73b9232f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:13.749943 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3767/7589] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:23:13 2022] DELETE /identity/v3/projects/0fb01fe6a28240089e7d0e27cb1112f9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:23:13.757581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e342185-befe-43b7-8086-3c9b79025170 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:13.757909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e342185-befe-43b7-8086-3c9b79025170 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:13.758186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e342185-befe-43b7-8086-3c9b79025170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:13.778302 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-8e342185-befe-43b7-8086-3c9b79025170 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:23:13.779545 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8e342185-befe-43b7-8086-3c9b79025170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:13.844897 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3823/7590] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:23:13.854116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38918da2-57d7-4c2c-b002-aba3aef76b44 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:13.854478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38918da2-57d7-4c2c-b002-aba3aef76b44 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:13.854875 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38918da2-57d7-4c2c-b002-aba3aef76b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:13.879712 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-38918da2-57d7-4c2c-b002-aba3aef76b44 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:23:13.883062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-38918da2-57d7-4c2c-b002-aba3aef76b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:13.899965 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3768/7591] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:23:13.901368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e342185-befe-43b7-8086-3c9b79025170 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:13.911264 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e342185-befe-43b7-8086-3c9b79025170 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:13.917728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d36b98-fda7-41cf-98fd-028e7abf82b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:13.918335 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d36b98-fda7-41cf-98fd-028e7abf82b9 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:13.918798 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d36b98-fda7-41cf-98fd-028e7abf82b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:13.919075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d36b98-fda7-41cf-98fd-028e7abf82b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:13.919725 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d36b98-fda7-41cf-98fd-028e7abf82b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:23:13.920030 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d36b98-fda7-41cf-98fd-028e7abf82b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:13.921631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d36b98-fda7-41cf-98fd-028e7abf82b9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:13.933661 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3824/7592] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:23:13.938244 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38918da2-57d7-4c2c-b002-aba3aef76b44 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:13.948426 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38918da2-57d7-4c2c-b002-aba3aef76b44 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:13.953152 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea3ca7-6976-4c7b-af3d-0edc9b626fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:13.953756 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea3ca7-6976-4c7b-af3d-0edc9b626fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:13.954036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea3ca7-6976-4c7b-af3d-0edc9b626fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:13.954305 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea3ca7-6976-4c7b-af3d-0edc9b626fb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:13.954956 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea3ca7-6976-4c7b-af3d-0edc9b626fb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:13.956858 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea3ca7-6976-4c7b-af3d-0edc9b626fb6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:13.988368 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3769/7593] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:23:13 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:23:13.989467 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d36b98-fda7-41cf-98fd-028e7abf82b9 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:13.995900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:13.999944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d36b98-fda7-41cf-98fd-028e7abf82b9 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:14.076359 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07262648-76d0-488c-adea-899f88492b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:14.077285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07262648-76d0-488c-adea-899f88492b6b admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:14.077564 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07262648-76d0-488c-adea-899f88492b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:14.078005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07262648-76d0-488c-adea-899f88492b6b admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:14.078838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07262648-76d0-488c-adea-899f88492b6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:14.081083 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07262648-76d0-488c-adea-899f88492b6b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:14.108663 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3825/7594] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:23:13 2022] POST /identity/v3/users => generated 295 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:23:14.109942 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea3ca7-6976-4c7b-af3d-0edc9b626fb6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:14.125161 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea3ca7-6976-4c7b-af3d-0edc9b626fb6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:14.130633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a4a5b-8339-4fb8-bb26-6d284a9666ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:14.131383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a4a5b-8339-4fb8-bb26-6d284a9666ce admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:14.131761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a4a5b-8339-4fb8-bb26-6d284a9666ce admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:14.132130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a4a5b-8339-4fb8-bb26-6d284a9666ce admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:14.132887 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a4a5b-8339-4fb8-bb26-6d284a9666ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:14.134653 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a4a5b-8339-4fb8-bb26-6d284a9666ce admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:14.142982 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:14.149586 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3770/7595] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:23:14.153651 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07262648-76d0-488c-adea-899f88492b6b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:14.168132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07262648-76d0-488c-adea-899f88492b6b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:14.173200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3809db-883c-4b25-b9b4-3d9be8c2cd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:14.173821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3809db-883c-4b25-b9b4-3d9be8c2cd24 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:14.174766 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3809db-883c-4b25-b9b4-3d9be8c2cd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:14.175046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3809db-883c-4b25-b9b4-3d9be8c2cd24 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:14.175698 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3809db-883c-4b25-b9b4-3d9be8c2cd24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:14.177347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3809db-883c-4b25-b9b4-3d9be8c2cd24 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:14.189034 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3826/7596] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:23:14.193098 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a4a5b-8339-4fb8-bb26-6d284a9666ce admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:14.203990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a4a5b-8339-4fb8-bb26-6d284a9666ce admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:14.210483 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11016de-e57b-46c6-9d38-39f39f46407f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:14.211197 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11016de-e57b-46c6-9d38-39f39f46407f admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:14.211479 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11016de-e57b-46c6-9d38-39f39f46407f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:14.211758 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11016de-e57b-46c6-9d38-39f39f46407f admin admin] PATH_INFO: `/v3/projects/7054b60d5cc646ec87fa19bedaa69407/users/323cbfd25ac04e829ad1c162fedf68e8/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:14.229607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11016de-e57b-46c6-9d38-39f39f46407f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7054b60d5cc646ec87fa19bedaa69407, user_id=323cbfd25ac04e829ad1c162fedf68e8, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:14.232578 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11016de-e57b-46c6-9d38-39f39f46407f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:14.250581 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3771/7597] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:23:14 2022] PUT /identity/v3/projects/7054b60d5cc646ec87fa19bedaa69407/users/323cbfd25ac04e829ad1c162fedf68e8/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:23:14.364182 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337dd66-5d30-4961-a0e2-04ccc8b87d5f None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:14.364394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337dd66-5d30-4961-a0e2-04ccc8b87d5f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:14.364660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337dd66-5d30-4961-a0e2-04ccc8b87d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:14.392834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-f337dd66-5d30-4961-a0e2-04ccc8b87d5f None None] MFA Rules not processed for user `323cbfd25ac04e829ad1c162fedf68e8`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:23:14.394137 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f337dd66-5d30-4961-a0e2-04ccc8b87d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:14.470181 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3827/7598] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:23:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:23:14.474933 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11016de-e57b-46c6-9d38-39f39f46407f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:14.544197 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11016de-e57b-46c6-9d38-39f39f46407f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:14.549577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cdc2b3-f046-4e72-b38f-42fbf4e39300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:14.550196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdc2b3-f046-4e72-b38f-42fbf4e39300 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:14.550481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdc2b3-f046-4e72-b38f-42fbf4e39300 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:14.550783 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdc2b3-f046-4e72-b38f-42fbf4e39300 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:14.551415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cdc2b3-f046-4e72-b38f-42fbf4e39300 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:14.553371 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cdc2b3-f046-4e72-b38f-42fbf4e39300 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:14.602955 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3772/7599] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:23:14 2022] POST /identity/v3/projects => generated 389 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:23:14.615227 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337dd66-5d30-4961-a0e2-04ccc8b87d5f None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:14.627981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337dd66-5d30-4961-a0e2-04ccc8b87d5f None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:14.700962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85ce4d-7600-4a72-aff9-cb73cdc10c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:14.701585 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85ce4d-7600-4a72-aff9-cb73cdc10c61 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:14.701865 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85ce4d-7600-4a72-aff9-cb73cdc10c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:14.702139 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85ce4d-7600-4a72-aff9-cb73cdc10c61 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:14.702836 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85ce4d-7600-4a72-aff9-cb73cdc10c61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:14.704773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85ce4d-7600-4a72-aff9-cb73cdc10c61 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:14.734995 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3828/7600] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:23:14 2022] POST /identity/v3/users => generated 295 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:23:14.736178 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cdc2b3-f046-4e72-b38f-42fbf4e39300 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:14.752324 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cdc2b3-f046-4e72-b38f-42fbf4e39300 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:14.765283 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe2df1-4f9b-4745-ba6a-19995cfcf472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:14.765914 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe2df1-4f9b-4745-ba6a-19995cfcf472 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:14.766198 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe2df1-4f9b-4745-ba6a-19995cfcf472 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:14.767067 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe2df1-4f9b-4745-ba6a-19995cfcf472 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:14.767208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe2df1-4f9b-4745-ba6a-19995cfcf472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:14.768770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe2df1-4f9b-4745-ba6a-19995cfcf472 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:14.790678 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3773/7601] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:23:14.794960 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85ce4d-7600-4a72-aff9-cb73cdc10c61 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:14.801088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:14.810236 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85ce4d-7600-4a72-aff9-cb73cdc10c61 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:14.816114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd39c7-3590-446f-bae4-7cb02d10f541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:14.817475 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd39c7-3590-446f-bae4-7cb02d10f541 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:14.817475 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd39c7-3590-446f-bae4-7cb02d10f541 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:14.817475 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd39c7-3590-446f-bae4-7cb02d10f541 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:14.818395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd39c7-3590-446f-bae4-7cb02d10f541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:14.820133 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd39c7-3590-446f-bae4-7cb02d10f541 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:14.832510 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3829/7602] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:23:14.838014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe2df1-4f9b-4745-ba6a-19995cfcf472 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:14.850897 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe2df1-4f9b-4745-ba6a-19995cfcf472 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:14.857343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c15bed-4b47-4327-8ab6-94470f8f145b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:14.858004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c15bed-4b47-4327-8ab6-94470f8f145b admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:14.858285 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c15bed-4b47-4327-8ab6-94470f8f145b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:14.858580 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c15bed-4b47-4327-8ab6-94470f8f145b admin admin] PATH_INFO: `/v3/projects/a0406d578a474268b74423f9cd0679b2/users/a98fadc97df74660a092df0d6be9363b/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:14.878851 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c15bed-4b47-4327-8ab6-94470f8f145b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0406d578a474268b74423f9cd0679b2, user_id=a98fadc97df74660a092df0d6be9363b, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:14.881671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c15bed-4b47-4327-8ab6-94470f8f145b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:14.907206 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3774/7603] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:23:14 2022] PUT /identity/v3/projects/a0406d578a474268b74423f9cd0679b2/users/a98fadc97df74660a092df0d6be9363b/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:23:14.918150 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf629f-6514-4ee1-9770-6efcb15b8b1d None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:14.918704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf629f-6514-4ee1-9770-6efcb15b8b1d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:14.918806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf629f-6514-4ee1-9770-6efcb15b8b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:14.955754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-9edf629f-6514-4ee1-9770-6efcb15b8b1d None None] MFA Rules not processed for user `a98fadc97df74660a092df0d6be9363b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:23:14.956760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9edf629f-6514-4ee1-9770-6efcb15b8b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:15.030917 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3830/7604] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:23:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:23:15.035556 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c15bed-4b47-4327-8ab6-94470f8f145b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:15.111231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c15bed-4b47-4327-8ab6-94470f8f145b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:15.117114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e4102-55ae-450a-9d78-a378e8673357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:15.118181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e4102-55ae-450a-9d78-a378e8673357 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:15.118775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e4102-55ae-450a-9d78-a378e8673357 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:15.119055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e4102-55ae-450a-9d78-a378e8673357 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:15.119719 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e4102-55ae-450a-9d78-a378e8673357 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:15.121677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e4102-55ae-450a-9d78-a378e8673357 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:15.155383 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3775/7605] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:23:15 2022] POST /identity/v3/projects => generated 389 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:23:15.159451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf629f-6514-4ee1-9770-6efcb15b8b1d None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:15.172837 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf629f-6514-4ee1-9770-6efcb15b8b1d None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:15.253114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba7fb6-4991-468b-9d1a-21562cb2ba50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:15.253735 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba7fb6-4991-468b-9d1a-21562cb2ba50 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:15.254020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba7fb6-4991-468b-9d1a-21562cb2ba50 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:15.254298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba7fb6-4991-468b-9d1a-21562cb2ba50 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:15.254973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba7fb6-4991-468b-9d1a-21562cb2ba50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:15.257117 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba7fb6-4991-468b-9d1a-21562cb2ba50 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:15.283348 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3831/7606] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:23:15 2022] POST /identity/v3/users => generated 301 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:23:15.284593 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e4102-55ae-450a-9d78-a378e8673357 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:15.296791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e4102-55ae-450a-9d78-a378e8673357 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:15.301610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d0a3a-2f9a-4d80-ac75-194430dfa93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:15.303294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d0a3a-2f9a-4d80-ac75-194430dfa93e admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:15.303588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d0a3a-2f9a-4d80-ac75-194430dfa93e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:15.303863 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d0a3a-2f9a-4d80-ac75-194430dfa93e admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:15.304516 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d0a3a-2f9a-4d80-ac75-194430dfa93e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:15.306233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d0a3a-2f9a-4d80-ac75-194430dfa93e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:15.312413 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:15.318676 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3776/7607] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:23:15.322846 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba7fb6-4991-468b-9d1a-21562cb2ba50 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:15.334070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba7fb6-4991-468b-9d1a-21562cb2ba50 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:15.339225 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5fbff-4635-43ad-9870-6b266c899f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:15.342818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5fbff-4635-43ad-9870-6b266c899f3f admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:15.343107 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5fbff-4635-43ad-9870-6b266c899f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:15.343528 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5fbff-4635-43ad-9870-6b266c899f3f admin admin] PATH_INFO: `/v3/projects/1c4e41974e4c438983f88b3c83ca9d82/users/078ea6976eb34f7abb0b1e0da4ee0ed7/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:15.360867 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc5fbff-4635-43ad-9870-6b266c899f3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c4e41974e4c438983f88b3c83ca9d82, user_id=078ea6976eb34f7abb0b1e0da4ee0ed7, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:15.363582 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc5fbff-4635-43ad-9870-6b266c899f3f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:15.378927 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3832/7608] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:23:15 2022] PUT /identity/v3/projects/1c4e41974e4c438983f88b3c83ca9d82/users/078ea6976eb34f7abb0b1e0da4ee0ed7/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:23:15.383974 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d0a3a-2f9a-4d80-ac75-194430dfa93e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:15.394275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d0a3a-2f9a-4d80-ac75-194430dfa93e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:15.454965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900583f7-50e2-4bf7-a9a9-058c318afc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:15.455571 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900583f7-50e2-4bf7-a9a9-058c318afc91 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:15.455846 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900583f7-50e2-4bf7-a9a9-058c318afc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:15.456113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900583f7-50e2-4bf7-a9a9-058c318afc91 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:15.456746 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900583f7-50e2-4bf7-a9a9-058c318afc91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:15.459060 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900583f7-50e2-4bf7-a9a9-058c318afc91 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:15.469580 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3777/7609] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:23:15.473737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5fbff-4635-43ad-9870-6b266c899f3f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:15.485510 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5fbff-4635-43ad-9870-6b266c899f3f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:15.490604 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b484095-dd60-4cef-9986-f9e66e0878e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:15.491211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b484095-dd60-4cef-9986-f9e66e0878e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:15.491617 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b484095-dd60-4cef-9986-f9e66e0878e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:15.491898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b484095-dd60-4cef-9986-f9e66e0878e2 admin admin] PATH_INFO: `/v3/projects/1c4e41974e4c438983f88b3c83ca9d82/users/078ea6976eb34f7abb0b1e0da4ee0ed7/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:15.493856 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b484095-dd60-4cef-9986-f9e66e0878e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c4e41974e4c438983f88b3c83ca9d82, user_id=078ea6976eb34f7abb0b1e0da4ee0ed7, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:15.496573 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b484095-dd60-4cef-9986-f9e66e0878e2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:15.507839 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3833/7610] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:23:15 2022] PUT /identity/v3/projects/1c4e41974e4c438983f88b3c83ca9d82/users/078ea6976eb34f7abb0b1e0da4ee0ed7/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:23:15.518138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaefb4c-a912-44aa-87df-e527af0376ff None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:15.518425 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaefb4c-a912-44aa-87df-e527af0376ff None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:15.518744 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaefb4c-a912-44aa-87df-e527af0376ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:15.562344 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-aeaefb4c-a912-44aa-87df-e527af0376ff None None] MFA Rules not processed for user `078ea6976eb34f7abb0b1e0da4ee0ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:23:15.563742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-aeaefb4c-a912-44aa-87df-e527af0376ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:15.650865 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3778/7611] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:23:15 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:23:15.665013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b484095-dd60-4cef-9986-f9e66e0878e2 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:15.668240 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3b484095-dd60-4cef-9986-f9e66e0878e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:15.716344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:15.767148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b484095-dd60-4cef-9986-f9e66e0878e2 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:15.773611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281872a-77e1-461c-87da-3e86bfac3128 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:15.774347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281872a-77e1-461c-87da-3e86bfac3128 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:15.774771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281872a-77e1-461c-87da-3e86bfac3128 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:15.775110 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281872a-77e1-461c-87da-3e86bfac3128 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:15.833099 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3281872a-77e1-461c-87da-3e86bfac3128 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:15.835558 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3281872a-77e1-461c-87da-3e86bfac3128 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:15.845048 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3834/7612] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:23:15 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:23:19.312247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaefb4c-a912-44aa-87df-e527af0376ff None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:19.314331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-aeaefb4c-a912-44aa-87df-e527af0376ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:19.382470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaefb4c-a912-44aa-87df-e527af0376ff None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:19.386560 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68e389-70be-4dcf-b608-daa6f5d224d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:19.387281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68e389-70be-4dcf-b608-daa6f5d224d8 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:19.387632 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68e389-70be-4dcf-b608-daa6f5d224d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:19.387978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68e389-70be-4dcf-b608-daa6f5d224d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:19.398401 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d68e389-70be-4dcf-b608-daa6f5d224d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:19.399962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d68e389-70be-4dcf-b608-daa6f5d224d8 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:19.410921 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3779/7613] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:23:19 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:23:22.037080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281872a-77e1-461c-87da-3e86bfac3128 service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:22.040400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3281872a-77e1-461c-87da-3e86bfac3128 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:22.189924 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281872a-77e1-461c-87da-3e86bfac3128 service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:22.196203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b4ccf-46d1-4d2c-857b-25f37ff1fc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:22.197575 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b4ccf-46d1-4d2c-857b-25f37ff1fc0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:22.197960 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b4ccf-46d1-4d2c-857b-25f37ff1fc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:22.198311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b4ccf-46d1-4d2c-857b-25f37ff1fc0e admin admin] PATH_INFO: `/v3/users/7cd539be9e3b426d9eb5bdba4697f849` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:22.199702 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b4ccf-46d1-4d2c-857b-25f37ff1fc0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cd539be9e3b426d9eb5bdba4697f849)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:22.201710 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b4ccf-46d1-4d2c-857b-25f37ff1fc0e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:22.274154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-240b4ccf-46d1-4d2c-857b-25f37ff1fc0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cd539be9e3b426d9eb5bdba4697f849'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:22.285088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-240b4ccf-46d1-4d2c-857b-25f37ff1fc0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cd539be9e3b426d9eb5bdba4697f849'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:22.286581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-240b4ccf-46d1-4d2c-857b-25f37ff1fc0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cd539be9e3b426d9eb5bdba4697f849'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:22.294777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-240b4ccf-46d1-4d2c-857b-25f37ff1fc0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cd539be9e3b426d9eb5bdba4697f849'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:22.322076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-240b4ccf-46d1-4d2c-857b-25f37ff1fc0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cd539be9e3b426d9eb5bdba4697f849'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:22.330335 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:22.345718 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3835/7614] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:23:22 2022] DELETE /identity/v3/users/7cd539be9e3b426d9eb5bdba4697f849 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:23:22.568533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68e389-70be-4dcf-b608-daa6f5d224d8 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:22.580801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68e389-70be-4dcf-b608-daa6f5d224d8 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:22.607181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:22.657816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71291552-55d4-41ae-8c3e-f5cf0c7bf008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:22.658669 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71291552-55d4-41ae-8c3e-f5cf0c7bf008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:22.659038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71291552-55d4-41ae-8c3e-f5cf0c7bf008 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:22.659381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71291552-55d4-41ae-8c3e-f5cf0c7bf008 admin admin] PATH_INFO: `/v3/projects/1f57cc6855ef4b98ad703de9bdc1e094` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:22.660594 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71291552-55d4-41ae-8c3e-f5cf0c7bf008 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f57cc6855ef4b98ad703de9bdc1e094)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:22.663113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71291552-55d4-41ae-8c3e-f5cf0c7bf008 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:22.744664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-71291552-55d4-41ae-8c3e-f5cf0c7bf008 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f57cc6855ef4b98ad703de9bdc1e094', 'request_id': 'req-71291552-55d4-41ae-8c3e-f5cf0c7bf008'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:22.753527 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-71291552-55d4-41ae-8c3e-f5cf0c7bf008 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f57cc6855ef4b98ad703de9bdc1e094', 'request_id': 'req-71291552-55d4-41ae-8c3e-f5cf0c7bf008'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:22.776934 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-71291552-55d4-41ae-8c3e-f5cf0c7bf008 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f57cc6855ef4b98ad703de9bdc1e094', 'request_id': 'req-71291552-55d4-41ae-8c3e-f5cf0c7bf008'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:22.803262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-71291552-55d4-41ae-8c3e-f5cf0c7bf008 admin admin] The token cache is being invalidate because project 1f57cc6855ef4b98ad703de9bdc1e094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:23:22.803560 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-71291552-55d4-41ae-8c3e-f5cf0c7bf008 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:22.804698 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-71291552-55d4-41ae-8c3e-f5cf0c7bf008 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:22.805886 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3780/7615] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:23:22 2022] DELETE /identity/v3/projects/1f57cc6855ef4b98ad703de9bdc1e094 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:23:22.810424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b4ccf-46d1-4d2c-857b-25f37ff1fc0e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:22.812220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-240b4ccf-46d1-4d2c-857b-25f37ff1fc0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:22.828002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b4ccf-46d1-4d2c-857b-25f37ff1fc0e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:22.910682 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295104b6-db7e-4f7e-86ce-2828874c7f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:22.911527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295104b6-db7e-4f7e-86ce-2828874c7f88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:22.911876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295104b6-db7e-4f7e-86ce-2828874c7f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:22.912224 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295104b6-db7e-4f7e-86ce-2828874c7f88 admin admin] PATH_INFO: `/v3/users/adc1e4e45bcb4169a52153375140977d` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:22.913514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295104b6-db7e-4f7e-86ce-2828874c7f88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adc1e4e45bcb4169a52153375140977d)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:22.915578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295104b6-db7e-4f7e-86ce-2828874c7f88 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:23.003942 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-295104b6-db7e-4f7e-86ce-2828874c7f88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adc1e4e45bcb4169a52153375140977d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:23.024282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-295104b6-db7e-4f7e-86ce-2828874c7f88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adc1e4e45bcb4169a52153375140977d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:23.033673 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-295104b6-db7e-4f7e-86ce-2828874c7f88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adc1e4e45bcb4169a52153375140977d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:23.035461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-295104b6-db7e-4f7e-86ce-2828874c7f88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adc1e4e45bcb4169a52153375140977d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:23.054200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-295104b6-db7e-4f7e-86ce-2828874c7f88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adc1e4e45bcb4169a52153375140977d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:23.081191 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3836/7616] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:23:22 2022] DELETE /identity/v3/users/adc1e4e45bcb4169a52153375140977d => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:23:23.311221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71291552-55d4-41ae-8c3e-f5cf0c7bf008 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:23.313102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-71291552-55d4-41ae-8c3e-f5cf0c7bf008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:23.332918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71291552-55d4-41ae-8c3e-f5cf0c7bf008 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:23.407076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c0d9a-2d1e-4d35-8eb3-12ef87e7e15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:23.407910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c0d9a-2d1e-4d35-8eb3-12ef87e7e15f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:23.408261 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c0d9a-2d1e-4d35-8eb3-12ef87e7e15f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:23.408610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c0d9a-2d1e-4d35-8eb3-12ef87e7e15f admin admin] PATH_INFO: `/v3/projects/bf0a320c180344daaed438931e4d377b` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:23.409968 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c0d9a-2d1e-4d35-8eb3-12ef87e7e15f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf0a320c180344daaed438931e4d377b)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:23.412825 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c0d9a-2d1e-4d35-8eb3-12ef87e7e15f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:23.474056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-df7c0d9a-2d1e-4d35-8eb3-12ef87e7e15f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf0a320c180344daaed438931e4d377b', 'request_id': 'req-df7c0d9a-2d1e-4d35-8eb3-12ef87e7e15f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:23.480430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:23.482638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-df7c0d9a-2d1e-4d35-8eb3-12ef87e7e15f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf0a320c180344daaed438931e4d377b', 'request_id': 'req-df7c0d9a-2d1e-4d35-8eb3-12ef87e7e15f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:23.492629 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-df7c0d9a-2d1e-4d35-8eb3-12ef87e7e15f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf0a320c180344daaed438931e4d377b', 'request_id': 'req-df7c0d9a-2d1e-4d35-8eb3-12ef87e7e15f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:23.525297 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-df7c0d9a-2d1e-4d35-8eb3-12ef87e7e15f admin admin] The token cache is being invalidate because project bf0a320c180344daaed438931e4d377b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:23:23.525866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-df7c0d9a-2d1e-4d35-8eb3-12ef87e7e15f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:23.526868 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-df7c0d9a-2d1e-4d35-8eb3-12ef87e7e15f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:23.531783 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3781/7617] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:23:23 2022] DELETE /identity/v3/projects/bf0a320c180344daaed438931e4d377b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:23:23.537305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996f87f-9437-4c1c-927b-1e947795c703 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:23.537724 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996f87f-9437-4c1c-927b-1e947795c703 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:23.538007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996f87f-9437-4c1c-927b-1e947795c703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:23.563764 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-8996f87f-9437-4c1c-927b-1e947795c703 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:23:23.565039 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8996f87f-9437-4c1c-927b-1e947795c703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:23.644259 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3837/7618] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:23:23.654432 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf6c4f-feab-4295-9e1c-1101ea17b1cc None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:23.655101 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf6c4f-feab-4295-9e1c-1101ea17b1cc None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:23.655101 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf6c4f-feab-4295-9e1c-1101ea17b1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:23.686732 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-c7cf6c4f-feab-4295-9e1c-1101ea17b1cc None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:23:23.688085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c7cf6c4f-feab-4295-9e1c-1101ea17b1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:23.710897 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3782/7619] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:23:23.715141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996f87f-9437-4c1c-927b-1e947795c703 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:23.726136 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996f87f-9437-4c1c-927b-1e947795c703 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:23.731556 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e41cb7-04fe-40e6-88cf-8647d0474df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:23.732182 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e41cb7-04fe-40e6-88cf-8647d0474df8 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:23.732463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e41cb7-04fe-40e6-88cf-8647d0474df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:23.732736 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e41cb7-04fe-40e6-88cf-8647d0474df8 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:23.733394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e41cb7-04fe-40e6-88cf-8647d0474df8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:23:23.733880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e41cb7-04fe-40e6-88cf-8647d0474df8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:23.736614 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e41cb7-04fe-40e6-88cf-8647d0474df8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:23.741822 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:23.762987 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3838/7620] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:23:23.767104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf6c4f-feab-4295-9e1c-1101ea17b1cc None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:23.778053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf6c4f-feab-4295-9e1c-1101ea17b1cc None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:23.783374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664bfe78-cb6e-49d6-95ea-aefa100e14e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:23.783993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664bfe78-cb6e-49d6-95ea-aefa100e14e9 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:23.784280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664bfe78-cb6e-49d6-95ea-aefa100e14e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:23.784530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664bfe78-cb6e-49d6-95ea-aefa100e14e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:23.785146 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664bfe78-cb6e-49d6-95ea-aefa100e14e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:23.787437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664bfe78-cb6e-49d6-95ea-aefa100e14e9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:23.829365 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3783/7621] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:23:23 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:23:23.833605 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e41cb7-04fe-40e6-88cf-8647d0474df8 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:23.846636 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e41cb7-04fe-40e6-88cf-8647d0474df8 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:23.954573 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ddf294-8721-4baa-8b8c-2d39c2016624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:23.955370 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddf294-8721-4baa-8b8c-2d39c2016624 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:23.955671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddf294-8721-4baa-8b8c-2d39c2016624 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:23.956547 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddf294-8721-4baa-8b8c-2d39c2016624 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:23.956785 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ddf294-8721-4baa-8b8c-2d39c2016624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:23.959592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ddf294-8721-4baa-8b8c-2d39c2016624 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:23.986754 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3839/7622] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:23:23 2022] POST /identity/v3/users => generated 288 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:23:23.991044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664bfe78-cb6e-49d6-95ea-aefa100e14e9 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:24.013446 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664bfe78-cb6e-49d6-95ea-aefa100e14e9 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:24.019125 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bae372-ccdb-4c87-8aa6-cd59c9df2486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:24.019907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bae372-ccdb-4c87-8aa6-cd59c9df2486 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:24.020477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bae372-ccdb-4c87-8aa6-cd59c9df2486 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:24.020879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bae372-ccdb-4c87-8aa6-cd59c9df2486 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:24.021823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bae372-ccdb-4c87-8aa6-cd59c9df2486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:24.025518 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bae372-ccdb-4c87-8aa6-cd59c9df2486 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:24.042957 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3784/7623] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:23:24.048012 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ddf294-8721-4baa-8b8c-2d39c2016624 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:24.073126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ddf294-8721-4baa-8b8c-2d39c2016624 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:24.075630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16134c86-f0b5-4d37-8c0a-21a280b3a063 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:24.075923 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16134c86-f0b5-4d37-8c0a-21a280b3a063 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:24.076203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16134c86-f0b5-4d37-8c0a-21a280b3a063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:24.080875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31e9b8-e680-497e-ab1b-32a45dbe98cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:24.081495 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31e9b8-e680-497e-ab1b-32a45dbe98cb admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:24.081775 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31e9b8-e680-497e-ab1b-32a45dbe98cb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:24.082050 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31e9b8-e680-497e-ab1b-32a45dbe98cb admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:24.082735 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31e9b8-e680-497e-ab1b-32a45dbe98cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:24.084343 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31e9b8-e680-497e-ab1b-32a45dbe98cb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:24.099767 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3840/7624] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:23:24.101561 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-16134c86-f0b5-4d37-8c0a-21a280b3a063 None None] MFA Rules not processed for user `323cbfd25ac04e829ad1c162fedf68e8`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:23:24.102848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-16134c86-f0b5-4d37-8c0a-21a280b3a063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:24.104015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31e9b8-e680-497e-ab1b-32a45dbe98cb admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:24.126364 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31e9b8-e680-497e-ab1b-32a45dbe98cb admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:24.131687 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf115a9-7eaf-4bde-9bf1-6a2c102ba1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:24.132357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf115a9-7eaf-4bde-9bf1-6a2c102ba1f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:24.132848 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf115a9-7eaf-4bde-9bf1-6a2c102ba1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:24.133138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf115a9-7eaf-4bde-9bf1-6a2c102ba1f1 admin admin] PATH_INFO: `/v3/projects/85e0a11a0ef84f66938d44351c7f3767/users/fad71f0aa2944599b949049697614c36/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:24.155145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf115a9-7eaf-4bde-9bf1-6a2c102ba1f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85e0a11a0ef84f66938d44351c7f3767, user_id=fad71f0aa2944599b949049697614c36, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:24.158489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf115a9-7eaf-4bde-9bf1-6a2c102ba1f1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:24.186777 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3841/7625] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:23:24 2022] PUT /identity/v3/projects/85e0a11a0ef84f66938d44351c7f3767/users/fad71f0aa2944599b949049697614c36/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:23:24.197071 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3785/7626] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:23:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:23:24.197246 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd392b94-6d09-415a-a688-dc0772bff85f None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:24.197246 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd392b94-6d09-415a-a688-dc0772bff85f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:24.197246 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd392b94-6d09-415a-a688-dc0772bff85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:24.217676 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-bd392b94-6d09-415a-a688-dc0772bff85f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:23:24.219328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-bd392b94-6d09-415a-a688-dc0772bff85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:24.298732 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3842/7627] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:23:24.309098 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16134c86-f0b5-4d37-8c0a-21a280b3a063 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:24.310991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-16134c86-f0b5-4d37-8c0a-21a280b3a063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:24.386944 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16134c86-f0b5-4d37-8c0a-21a280b3a063 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:24.451281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671690d-0bbc-4b0b-b891-15a7826095d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:24.452771 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671690d-0bbc-4b0b-b891-15a7826095d0 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:24.453111 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671690d-0bbc-4b0b-b891-15a7826095d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:24.453411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671690d-0bbc-4b0b-b891-15a7826095d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:24.467880 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671690d-0bbc-4b0b-b891-15a7826095d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:24.470747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671690d-0bbc-4b0b-b891-15a7826095d0 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:24.493831 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3786/7628] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:23:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:23:31.200056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a43b9b-cfc9-44dc-844a-b6aa1bf18d3b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:31.200622 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a43b9b-cfc9-44dc-844a-b6aa1bf18d3b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:31.200773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a43b9b-cfc9-44dc-844a-b6aa1bf18d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:31.243066 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-c3a43b9b-cfc9-44dc-844a-b6aa1bf18d3b None None] MFA Rules not processed for user `fad71f0aa2944599b949049697614c36`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:23:31.245800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c3a43b9b-cfc9-44dc-844a-b6aa1bf18d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:31.303607 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:31.352067 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3843/7629] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:23:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:23:31.362180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671690d-0bbc-4b0b-b891-15a7826095d0 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:31.373283 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671690d-0bbc-4b0b-b891-15a7826095d0 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:31.378586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58179209-4f3b-487c-bd94-96e4f3902f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:31.379268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58179209-4f3b-487c-bd94-96e4f3902f00 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:31.379545 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58179209-4f3b-487c-bd94-96e4f3902f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:31.379813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58179209-4f3b-487c-bd94-96e4f3902f00 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:31.380440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58179209-4f3b-487c-bd94-96e4f3902f00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:31.382371 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58179209-4f3b-487c-bd94-96e4f3902f00 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:31.389386 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:31.423077 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3787/7630] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:23:31 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:23:31.427803 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a43b9b-cfc9-44dc-844a-b6aa1bf18d3b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:31.440720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a43b9b-cfc9-44dc-844a-b6aa1bf18d3b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:31.509583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06791f9-afa0-44a3-a60b-33d3051757bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:31.510363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06791f9-afa0-44a3-a60b-33d3051757bb admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:31.510762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06791f9-afa0-44a3-a60b-33d3051757bb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:31.511126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06791f9-afa0-44a3-a60b-33d3051757bb admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:31.511811 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06791f9-afa0-44a3-a60b-33d3051757bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:31.513823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06791f9-afa0-44a3-a60b-33d3051757bb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:31.542089 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3844/7631] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:23:31 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:23:31.545602 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58179209-4f3b-487c-bd94-96e4f3902f00 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:31.558060 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58179209-4f3b-487c-bd94-96e4f3902f00 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:31.563126 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305df3b-7cd2-40c5-8db3-c005cfe16d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:31.563756 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305df3b-7cd2-40c5-8db3-c005cfe16d68 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:31.564034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305df3b-7cd2-40c5-8db3-c005cfe16d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:31.564303 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305df3b-7cd2-40c5-8db3-c005cfe16d68 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:31.564939 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305df3b-7cd2-40c5-8db3-c005cfe16d68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:31.566533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305df3b-7cd2-40c5-8db3-c005cfe16d68 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:31.582529 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3788/7632] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:23:31.584171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06791f9-afa0-44a3-a60b-33d3051757bb admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:31.595751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06791f9-afa0-44a3-a60b-33d3051757bb admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:31.601475 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e54a6f-e422-4818-b33f-a2e6d6a30474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:31.602155 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e54a6f-e422-4818-b33f-a2e6d6a30474 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:31.602611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e54a6f-e422-4818-b33f-a2e6d6a30474 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:31.602893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e54a6f-e422-4818-b33f-a2e6d6a30474 admin admin] PATH_INFO: `/v3/projects/39b1e62bc44b4253b2df0e7b22bfb332/users/2a19ae0801884a938a94cdfdc4de1b08/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:31.626480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e54a6f-e422-4818-b33f-a2e6d6a30474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39b1e62bc44b4253b2df0e7b22bfb332, user_id=2a19ae0801884a938a94cdfdc4de1b08, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:31.629961 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e54a6f-e422-4818-b33f-a2e6d6a30474 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:31.651921 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3845/7633] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:23:31 2022] PUT /identity/v3/projects/39b1e62bc44b4253b2df0e7b22bfb332/users/2a19ae0801884a938a94cdfdc4de1b08/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:23:31.653220 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305df3b-7cd2-40c5-8db3-c005cfe16d68 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:31.671680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305df3b-7cd2-40c5-8db3-c005cfe16d68 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:31.784300 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229729c4-ca7d-4aa4-a81e-056a452d5c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:31.784922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229729c4-ca7d-4aa4-a81e-056a452d5c50 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:31.785209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229729c4-ca7d-4aa4-a81e-056a452d5c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:31.786113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229729c4-ca7d-4aa4-a81e-056a452d5c50 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:31.786791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229729c4-ca7d-4aa4-a81e-056a452d5c50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:31.788448 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229729c4-ca7d-4aa4-a81e-056a452d5c50 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:31.799727 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3789/7634] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:23:31.804442 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e54a6f-e422-4818-b33f-a2e6d6a30474 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:31.816687 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e54a6f-e422-4818-b33f-a2e6d6a30474 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:31.826017 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2994f-58fe-47c7-af36-5980b25d1dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:31.826848 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2994f-58fe-47c7-af36-5980b25d1dfb admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:31.827131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2994f-58fe-47c7-af36-5980b25d1dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:31.827429 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2994f-58fe-47c7-af36-5980b25d1dfb admin admin] PATH_INFO: `/v3/projects/39b1e62bc44b4253b2df0e7b22bfb332/users/2a19ae0801884a938a94cdfdc4de1b08/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:31.829825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2994f-58fe-47c7-af36-5980b25d1dfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=39b1e62bc44b4253b2df0e7b22bfb332, user_id=2a19ae0801884a938a94cdfdc4de1b08, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:31.832591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2994f-58fe-47c7-af36-5980b25d1dfb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:31.849803 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3846/7635] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:23:31 2022] PUT /identity/v3/projects/39b1e62bc44b4253b2df0e7b22bfb332/users/2a19ae0801884a938a94cdfdc4de1b08/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:23:37.925045 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229729c4-ca7d-4aa4-a81e-056a452d5c50 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:37.928539 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-229729c4-ca7d-4aa4-a81e-056a452d5c50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:38.079185 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229729c4-ca7d-4aa4-a81e-056a452d5c50 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:38.185649 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f11196-c637-44de-b430-ad3210f0678d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:38.186332 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f11196-c637-44de-b430-ad3210f0678d service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:38.187019 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f11196-c637-44de-b430-ad3210f0678d service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:38.187247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f11196-c637-44de-b430-ad3210f0678d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:38.189563 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-00f11196-c637-44de-b430-ad3210f0678d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:38.302081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:38.382925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f11196-c637-44de-b430-ad3210f0678d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:38.385115 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f11196-c637-44de-b430-ad3210f0678d service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:38.415512 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3790/7636] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:23:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:23:41.841086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=53,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:44.927659 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2994f-58fe-47c7-af36-5980b25d1dfb admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:44.929920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2ba2994f-58fe-47c7-af36-5980b25d1dfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:44.963972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2994f-58fe-47c7-af36-5980b25d1dfb admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:44.982095 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f4c6c-c703-4518-a033-39000e80eaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:44.983144 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f4c6c-c703-4518-a033-39000e80eaac admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:44.983634 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f4c6c-c703-4518-a033-39000e80eaac admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:44.984129 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f4c6c-c703-4518-a033-39000e80eaac admin admin] PATH_INFO: `/v3/users/e286c03134e646ce962ea7b88eab4b38` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:44.985568 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f4c6c-c703-4518-a033-39000e80eaac admin admin] RBAC: Authorizing `identity:delete_user(user_id=e286c03134e646ce962ea7b88eab4b38)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:44.988568 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f4c6c-c703-4518-a033-39000e80eaac admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:45.113816 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-282f4c6c-c703-4518-a033-39000e80eaac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e286c03134e646ce962ea7b88eab4b38'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:45.151463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-282f4c6c-c703-4518-a033-39000e80eaac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e286c03134e646ce962ea7b88eab4b38'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:45.152881 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-282f4c6c-c703-4518-a033-39000e80eaac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e286c03134e646ce962ea7b88eab4b38'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:45.153530 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-282f4c6c-c703-4518-a033-39000e80eaac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e286c03134e646ce962ea7b88eab4b38'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:45.176843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-282f4c6c-c703-4518-a033-39000e80eaac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e286c03134e646ce962ea7b88eab4b38'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:45.218217 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3847/7637] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:23:44 2022] DELETE /identity/v3/users/e286c03134e646ce962ea7b88eab4b38 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:23:45.223092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf0761-752c-4ea3-b7ce-5fae8f0d6666 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:45.223687 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf0761-752c-4ea3-b7ce-5fae8f0d6666 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:45.223687 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf0761-752c-4ea3-b7ce-5fae8f0d6666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:45.273586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-bcaf0761-752c-4ea3-b7ce-5fae8f0d6666 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:23:45.281512 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-bcaf0761-752c-4ea3-b7ce-5fae8f0d6666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:45.454903 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3791/7638] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:23:45.465043 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f4c6c-c703-4518-a033-39000e80eaac admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:45.467234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-282f4c6c-c703-4518-a033-39000e80eaac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:45.605520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f4c6c-c703-4518-a033-39000e80eaac admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:45.615867 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b270229-9f0b-4789-b94c-c63509f938a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:45.616499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b270229-9f0b-4789-b94c-c63509f938a5 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:45.616775 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b270229-9f0b-4789-b94c-c63509f938a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:45.617045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b270229-9f0b-4789-b94c-c63509f938a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:45.639013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b270229-9f0b-4789-b94c-c63509f938a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:45.640769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b270229-9f0b-4789-b94c-c63509f938a5 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:45.669489 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3848/7639] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:23:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:23:46.390787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf0761-752c-4ea3-b7ce-5fae8f0d6666 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:46.397929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-bcaf0761-752c-4ea3-b7ce-5fae8f0d6666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:46.466329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf0761-752c-4ea3-b7ce-5fae8f0d6666 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:46.491217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf78c71-3ead-4811-9c5c-85e5473fcf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:46.495274 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf78c71-3ead-4811-9c5c-85e5473fcf87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:46.495569 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf78c71-3ead-4811-9c5c-85e5473fcf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:46.495852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf78c71-3ead-4811-9c5c-85e5473fcf87 admin admin] PATH_INFO: `/v3/projects/a31b7575aa0944cca8da8f093eeeb0bf` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:46.500448 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf78c71-3ead-4811-9c5c-85e5473fcf87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a31b7575aa0944cca8da8f093eeeb0bf)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:46.506757 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf78c71-3ead-4811-9c5c-85e5473fcf87 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:46.587682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ddf78c71-3ead-4811-9c5c-85e5473fcf87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a31b7575aa0944cca8da8f093eeeb0bf', 'request_id': 'req-ddf78c71-3ead-4811-9c5c-85e5473fcf87'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:46.595585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ddf78c71-3ead-4811-9c5c-85e5473fcf87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a31b7575aa0944cca8da8f093eeeb0bf', 'request_id': 'req-ddf78c71-3ead-4811-9c5c-85e5473fcf87'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:46.607357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ddf78c71-3ead-4811-9c5c-85e5473fcf87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a31b7575aa0944cca8da8f093eeeb0bf', 'request_id': 'req-ddf78c71-3ead-4811-9c5c-85e5473fcf87'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:46.635960 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ddf78c71-3ead-4811-9c5c-85e5473fcf87 admin admin] The token cache is being invalidate because project a31b7575aa0944cca8da8f093eeeb0bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:23:46.636255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ddf78c71-3ead-4811-9c5c-85e5473fcf87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:46.637114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ddf78c71-3ead-4811-9c5c-85e5473fcf87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:46.639381 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3792/7640] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:23:46 2022] DELETE /identity/v3/projects/a31b7575aa0944cca8da8f093eeeb0bf => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:23:46.644637 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a3d72-1efd-4358-a3fa-e74752520261 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:46.649936 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a3d72-1efd-4358-a3fa-e74752520261 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:46.650682 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a3d72-1efd-4358-a3fa-e74752520261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:46.693633 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-189a3d72-1efd-4358-a3fa-e74752520261 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:23:46.695463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-189a3d72-1efd-4358-a3fa-e74752520261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:46.818340 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3849/7641] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:23:46.827476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546b7b1-529e-4689-8e97-bbc824fda02e None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:46.827880 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546b7b1-529e-4689-8e97-bbc824fda02e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:46.828250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546b7b1-529e-4689-8e97-bbc824fda02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:46.852989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-9546b7b1-529e-4689-8e97-bbc824fda02e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:23:46.857721 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9546b7b1-529e-4689-8e97-bbc824fda02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:46.869773 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3793/7642] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:23:46.874449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a3d72-1efd-4358-a3fa-e74752520261 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:46.886122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a3d72-1efd-4358-a3fa-e74752520261 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:46.891906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b840152-b1af-4633-881e-2046558926be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:46.892214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b840152-b1af-4633-881e-2046558926be admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:46.892653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b840152-b1af-4633-881e-2046558926be admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:46.892809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b840152-b1af-4633-881e-2046558926be admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:46.893420 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b840152-b1af-4633-881e-2046558926be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:23:46.893781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b840152-b1af-4633-881e-2046558926be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:46.895909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b840152-b1af-4633-881e-2046558926be admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:46.910606 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3850/7643] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:23:46.915022 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546b7b1-529e-4689-8e97-bbc824fda02e None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:46.922358 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b840152-b1af-4633-881e-2046558926be admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:46.926125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2b840152-b1af-4633-881e-2046558926be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:46.927837 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546b7b1-529e-4689-8e97-bbc824fda02e None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:46.935871 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00bbe5-d2f3-4e65-963a-e166cc80d84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:46.936486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00bbe5-d2f3-4e65-963a-e166cc80d84e admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:46.937377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00bbe5-d2f3-4e65-963a-e166cc80d84e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:46.937669 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00bbe5-d2f3-4e65-963a-e166cc80d84e admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:46.938053 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:46.939170 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00bbe5-d2f3-4e65-963a-e166cc80d84e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:46.942938 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00bbe5-d2f3-4e65-963a-e166cc80d84e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:46.944783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b840152-b1af-4633-881e-2046558926be admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:46.952219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b21c4-57d7-4109-a438-1784cb35e6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:46.952985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b21c4-57d7-4109-a438-1784cb35e6d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:46.953487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b21c4-57d7-4109-a438-1784cb35e6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:46.953842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b21c4-57d7-4109-a438-1784cb35e6d4 admin admin] PATH_INFO: `/v3/users/072374854bee412d88926414a37f1c36` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:46.955587 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b21c4-57d7-4109-a438-1784cb35e6d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=072374854bee412d88926414a37f1c36)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:46.959478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b21c4-57d7-4109-a438-1784cb35e6d4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:46.982590 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3794/7644] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:23:46 2022] POST /identity/v3/projects => generated 375 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:23:46.987210 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00bbe5-d2f3-4e65-963a-e166cc80d84e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:47.057438 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1a6b21c4-57d7-4109-a438-1784cb35e6d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '072374854bee412d88926414a37f1c36'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:47.062513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:47.070887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1a6b21c4-57d7-4109-a438-1784cb35e6d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '072374854bee412d88926414a37f1c36'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:47.071761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1a6b21c4-57d7-4109-a438-1784cb35e6d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '072374854bee412d88926414a37f1c36'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:47.072756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1a6b21c4-57d7-4109-a438-1784cb35e6d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '072374854bee412d88926414a37f1c36'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:47.082780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1a6b21c4-57d7-4109-a438-1784cb35e6d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '072374854bee412d88926414a37f1c36'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:47.101557 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00bbe5-d2f3-4e65-963a-e166cc80d84e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:47.111024 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3851/7645] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:23:46 2022] DELETE /identity/v3/users/072374854bee412d88926414a37f1c36 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:23:47.120359 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f88275-0e9a-441a-8408-5978b3214d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:47.121180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f88275-0e9a-441a-8408-5978b3214d9c admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:47.121555 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f88275-0e9a-441a-8408-5978b3214d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:47.121957 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f88275-0e9a-441a-8408-5978b3214d9c admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:47.122727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f88275-0e9a-441a-8408-5978b3214d9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:47.126097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f88275-0e9a-441a-8408-5978b3214d9c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:47.161271 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3795/7646] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:23:46 2022] POST /identity/v3/users => generated 288 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:23:47.165464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b21c4-57d7-4109-a438-1784cb35e6d4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:47.167300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1a6b21c4-57d7-4109-a438-1784cb35e6d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:47.312863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b21c4-57d7-4109-a438-1784cb35e6d4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:47.319308 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915a302-d65f-4d62-843c-2bf7016d1433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:47.320180 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915a302-d65f-4d62-843c-2bf7016d1433 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:47.320180 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915a302-d65f-4d62-843c-2bf7016d1433 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:47.320366 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915a302-d65f-4d62-843c-2bf7016d1433 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:47.321320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915a302-d65f-4d62-843c-2bf7016d1433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:47.323463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915a302-d65f-4d62-843c-2bf7016d1433 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:47.342872 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3852/7647] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:23:47.347642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f88275-0e9a-441a-8408-5978b3214d9c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:47.358650 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915a302-d65f-4d62-843c-2bf7016d1433 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:47.369217 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1915a302-d65f-4d62-843c-2bf7016d1433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:47.373553 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f88275-0e9a-441a-8408-5978b3214d9c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:47.380464 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c1c67-78c2-4636-83e2-4153bdb1ae20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:47.381489 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c1c67-78c2-4636-83e2-4153bdb1ae20 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:47.381872 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c1c67-78c2-4636-83e2-4153bdb1ae20 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:47.382277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c1c67-78c2-4636-83e2-4153bdb1ae20 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:47.383154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c1c67-78c2-4636-83e2-4153bdb1ae20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:47.385647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c1c67-78c2-4636-83e2-4153bdb1ae20 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:47.389738 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915a302-d65f-4d62-843c-2bf7016d1433 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:47.396858 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34095c5d-17be-498b-88db-45a8514bcb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:47.397787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34095c5d-17be-498b-88db-45a8514bcb45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:47.398225 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34095c5d-17be-498b-88db-45a8514bcb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:47.398731 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34095c5d-17be-498b-88db-45a8514bcb45 admin admin] PATH_INFO: `/v3/projects/48a90a98bcc6456086f39fb93c80b9fe` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:47.400204 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34095c5d-17be-498b-88db-45a8514bcb45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48a90a98bcc6456086f39fb93c80b9fe)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:47.400388 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3796/7648] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:23:47.403122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34095c5d-17be-498b-88db-45a8514bcb45 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:47.404548 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c1c67-78c2-4636-83e2-4153bdb1ae20 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:47.419165 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c1c67-78c2-4636-83e2-4153bdb1ae20 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:47.425400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6916c3c1-4361-4b81-a660-b3ead07e9b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:47.426986 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916c3c1-4361-4b81-a660-b3ead07e9b5c admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:47.427521 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916c3c1-4361-4b81-a660-b3ead07e9b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:47.428200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916c3c1-4361-4b81-a660-b3ead07e9b5c admin admin] PATH_INFO: `/v3/projects/32fb2e2bfbe9496b99eb91a3389b780e/users/536aa7b494a74a66815b2f79c0c67fa8/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:47.450975 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6916c3c1-4361-4b81-a660-b3ead07e9b5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=32fb2e2bfbe9496b99eb91a3389b780e, user_id=536aa7b494a74a66815b2f79c0c67fa8, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:47.454231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6916c3c1-4361-4b81-a660-b3ead07e9b5c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:47.468830 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-34095c5d-17be-498b-88db-45a8514bcb45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48a90a98bcc6456086f39fb93c80b9fe', 'request_id': 'req-34095c5d-17be-498b-88db-45a8514bcb45'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:47.477326 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-34095c5d-17be-498b-88db-45a8514bcb45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48a90a98bcc6456086f39fb93c80b9fe', 'request_id': 'req-34095c5d-17be-498b-88db-45a8514bcb45'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:47.489219 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3797/7649] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:23:47 2022] PUT /identity/v3/projects/32fb2e2bfbe9496b99eb91a3389b780e/users/536aa7b494a74a66815b2f79c0c67fa8/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:23:47.499385 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d3919-42ce-4408-9d76-f1062a7071d0 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:47.503329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-34095c5d-17be-498b-88db-45a8514bcb45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48a90a98bcc6456086f39fb93c80b9fe', 'request_id': 'req-34095c5d-17be-498b-88db-45a8514bcb45'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:47.506322 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d3919-42ce-4408-9d76-f1062a7071d0 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:47.506936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d3919-42ce-4408-9d76-f1062a7071d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:47.507888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:47.530451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-34095c5d-17be-498b-88db-45a8514bcb45 admin admin] The token cache is being invalidate because project 48a90a98bcc6456086f39fb93c80b9fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:23:47.530768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-34095c5d-17be-498b-88db-45a8514bcb45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:47.532330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-34095c5d-17be-498b-88db-45a8514bcb45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:47.535695 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3853/7650] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:23:47 2022] DELETE /identity/v3/projects/48a90a98bcc6456086f39fb93c80b9fe => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:23:47.539990 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34095c5d-17be-498b-88db-45a8514bcb45 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:47.542881 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-34095c5d-17be-498b-88db-45a8514bcb45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:47.571970 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-fb1d3919-42ce-4408-9d76-f1062a7071d0 None None] MFA Rules not processed for user `536aa7b494a74a66815b2f79c0c67fa8`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:23:47.573949 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-fb1d3919-42ce-4408-9d76-f1062a7071d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:47.668461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34095c5d-17be-498b-88db-45a8514bcb45 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:47.704760 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3798/7651] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:23:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:23:47.718260 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d3919-42ce-4408-9d76-f1062a7071d0 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:47.720037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-fb1d3919-42ce-4408-9d76-f1062a7071d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:47.788697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc266a-468f-4d13-adac-1df7cd1210fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:47.789357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc266a-468f-4d13-adac-1df7cd1210fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:47.789707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc266a-468f-4d13-adac-1df7cd1210fe admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:47.790054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc266a-468f-4d13-adac-1df7cd1210fe admin admin] PATH_INFO: `/v3/users/6415df36166640b69f303fe476fa86db` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:47.792998 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc266a-468f-4d13-adac-1df7cd1210fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=6415df36166640b69f303fe476fa86db)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:47.795189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc266a-468f-4d13-adac-1df7cd1210fe admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:47.805002 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d3919-42ce-4408-9d76-f1062a7071d0 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:47.808844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838327df-4030-41cb-b31d-1be555ddfdc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:47.809556 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838327df-4030-41cb-b31d-1be555ddfdc2 service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:47.809930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838327df-4030-41cb-b31d-1be555ddfdc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:47.810299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838327df-4030-41cb-b31d-1be555ddfdc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:47.820133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838327df-4030-41cb-b31d-1be555ddfdc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:47.821723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838327df-4030-41cb-b31d-1be555ddfdc2 service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:47.832853 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3799/7652] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:23:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:23:47.860342 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-adbc266a-468f-4d13-adac-1df7cd1210fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6415df36166640b69f303fe476fa86db'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:47.873074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-adbc266a-468f-4d13-adac-1df7cd1210fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6415df36166640b69f303fe476fa86db'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:47.873983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-adbc266a-468f-4d13-adac-1df7cd1210fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6415df36166640b69f303fe476fa86db'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:47.874923 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-adbc266a-468f-4d13-adac-1df7cd1210fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6415df36166640b69f303fe476fa86db'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:47.884003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-adbc266a-468f-4d13-adac-1df7cd1210fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6415df36166640b69f303fe476fa86db'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:47.910806 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3854/7653] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:23:47 2022] DELETE /identity/v3/users/6415df36166640b69f303fe476fa86db => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:23:47.958724 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34869dba-120d-43d0-a417-1b0494e3e55a None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:47.959480 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34869dba-120d-43d0-a417-1b0494e3e55a None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:47.959966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34869dba-120d-43d0-a417-1b0494e3e55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:48.032435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-34869dba-120d-43d0-a417-1b0494e3e55a None None] MFA Rules not processed for user `2a19ae0801884a938a94cdfdc4de1b08`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:23:48.033947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-34869dba-120d-43d0-a417-1b0494e3e55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:48.057618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:48.211786 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3800/7654] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:23:47 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:23:48.235153 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc266a-468f-4d13-adac-1df7cd1210fe admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:48.236626 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-adbc266a-468f-4d13-adac-1df7cd1210fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:48.293580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:48.366540 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc266a-468f-4d13-adac-1df7cd1210fe admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:48.373459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185cbcc-7711-4c94-843f-1858dfd6504f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:48.374097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185cbcc-7711-4c94-843f-1858dfd6504f service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:48.374460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185cbcc-7711-4c94-843f-1858dfd6504f service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:48.374812 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185cbcc-7711-4c94-843f-1858dfd6504f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:48.386217 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185cbcc-7711-4c94-843f-1858dfd6504f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:48.388220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185cbcc-7711-4c94-843f-1858dfd6504f service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:48.401155 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3855/7655] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:23:48 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:23:48.418426 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34869dba-120d-43d0-a417-1b0494e3e55a None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:48.420565 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-34869dba-120d-43d0-a417-1b0494e3e55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:48.464202 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f8cd7-a2f5-4998-85c3-37dd89806a4a None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:48.464559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f8cd7-a2f5-4998-85c3-37dd89806a4a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:48.464739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f8cd7-a2f5-4998-85c3-37dd89806a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:48.517196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-691f8cd7-a2f5-4998-85c3-37dd89806a4a None None] MFA Rules not processed for user `fad71f0aa2944599b949049697614c36`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:23:48.521058 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-691f8cd7-a2f5-4998-85c3-37dd89806a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:48.561904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34869dba-120d-43d0-a417-1b0494e3e55a None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:48.570677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a33faf-c017-4e44-aeba-f9cf006f1572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:48.571669 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a33faf-c017-4e44-aeba-f9cf006f1572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:48.572218 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a33faf-c017-4e44-aeba-f9cf006f1572 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:48.572728 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a33faf-c017-4e44-aeba-f9cf006f1572 admin admin] PATH_INFO: `/v3/projects/4e56f134187745e78c39faa081e3fd9e` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:48.575214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a33faf-c017-4e44-aeba-f9cf006f1572 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e56f134187745e78c39faa081e3fd9e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:48.578137 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a33faf-c017-4e44-aeba-f9cf006f1572 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:48.688986 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3856/7656] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:23:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:23:48.720064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-27a33faf-c017-4e44-aeba-f9cf006f1572 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e56f134187745e78c39faa081e3fd9e', 'request_id': 'req-27a33faf-c017-4e44-aeba-f9cf006f1572'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:48.735405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-27a33faf-c017-4e44-aeba-f9cf006f1572 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e56f134187745e78c39faa081e3fd9e', 'request_id': 'req-27a33faf-c017-4e44-aeba-f9cf006f1572'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:48.755924 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-27a33faf-c017-4e44-aeba-f9cf006f1572 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e56f134187745e78c39faa081e3fd9e', 'request_id': 'req-27a33faf-c017-4e44-aeba-f9cf006f1572'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:48.778216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-27a33faf-c017-4e44-aeba-f9cf006f1572 admin admin] The token cache is being invalidate because project 4e56f134187745e78c39faa081e3fd9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:23:48.778513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-27a33faf-c017-4e44-aeba-f9cf006f1572 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:48.779270 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-27a33faf-c017-4e44-aeba-f9cf006f1572 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:48.781089 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3801/7657] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:23:48 2022] DELETE /identity/v3/projects/4e56f134187745e78c39faa081e3fd9e => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:23:49.868744 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f8cd7-a2f5-4998-85c3-37dd89806a4a None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:49.870269 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-691f8cd7-a2f5-4998-85c3-37dd89806a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:49.885494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f8cd7-a2f5-4998-85c3-37dd89806a4a None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:49.999323 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cec93b-3d62-4873-993d-f86701f82580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:50.000080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cec93b-3d62-4873-993d-f86701f82580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:50.000429 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cec93b-3d62-4873-993d-f86701f82580 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:50.000780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cec93b-3d62-4873-993d-f86701f82580 admin admin] PATH_INFO: `/v3/users/65e64ff8f2b14f70b1b05327f691701e` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:50.002012 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cec93b-3d62-4873-993d-f86701f82580 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65e64ff8f2b14f70b1b05327f691701e)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:50.004310 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cec93b-3d62-4873-993d-f86701f82580 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:50.061649 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-88cec93b-3d62-4873-993d-f86701f82580 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65e64ff8f2b14f70b1b05327f691701e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:50.068911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:50.074036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-88cec93b-3d62-4873-993d-f86701f82580 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65e64ff8f2b14f70b1b05327f691701e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:50.075139 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-88cec93b-3d62-4873-993d-f86701f82580 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65e64ff8f2b14f70b1b05327f691701e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:50.075756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-88cec93b-3d62-4873-993d-f86701f82580 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65e64ff8f2b14f70b1b05327f691701e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:50.089540 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-88cec93b-3d62-4873-993d-f86701f82580 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65e64ff8f2b14f70b1b05327f691701e'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:50.117547 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3857/7658] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:23:49 2022] DELETE /identity/v3/users/65e64ff8f2b14f70b1b05327f691701e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:23:50.337816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a33faf-c017-4e44-aeba-f9cf006f1572 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:50.340871 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-27a33faf-c017-4e44-aeba-f9cf006f1572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:50.363050 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a33faf-c017-4e44-aeba-f9cf006f1572 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:50.405617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:50.438862 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bafdef-e662-4c6a-a71e-f753681619ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:50.439742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bafdef-e662-4c6a-a71e-f753681619ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:50.440199 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bafdef-e662-4c6a-a71e-f753681619ff admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:50.440677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bafdef-e662-4c6a-a71e-f753681619ff admin admin] PATH_INFO: `/v3/projects/cfb3b91ed1294ea187812b7312601b27` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:50.442415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bafdef-e662-4c6a-a71e-f753681619ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfb3b91ed1294ea187812b7312601b27)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:50.444577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bafdef-e662-4c6a-a71e-f753681619ff admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:50.501422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-56bafdef-e662-4c6a-a71e-f753681619ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfb3b91ed1294ea187812b7312601b27', 'request_id': 'req-56bafdef-e662-4c6a-a71e-f753681619ff'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:50.509300 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-56bafdef-e662-4c6a-a71e-f753681619ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfb3b91ed1294ea187812b7312601b27', 'request_id': 'req-56bafdef-e662-4c6a-a71e-f753681619ff'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:50.516273 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-56bafdef-e662-4c6a-a71e-f753681619ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfb3b91ed1294ea187812b7312601b27', 'request_id': 'req-56bafdef-e662-4c6a-a71e-f753681619ff'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:50.530563 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-56bafdef-e662-4c6a-a71e-f753681619ff admin admin] The token cache is being invalidate because project cfb3b91ed1294ea187812b7312601b27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:23:50.531036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-56bafdef-e662-4c6a-a71e-f753681619ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:50.531702 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-56bafdef-e662-4c6a-a71e-f753681619ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:23:50.533439 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3802/7659] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:23:50 2022] DELETE /identity/v3/projects/cfb3b91ed1294ea187812b7312601b27 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:23:50.539110 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb0a98-e654-4c45-aaf5-a0ab6e758dd9 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:50.539424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb0a98-e654-4c45-aaf5-a0ab6e758dd9 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:50.539688 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb0a98-e654-4c45-aaf5-a0ab6e758dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:50.561434 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-eebb0a98-e654-4c45-aaf5-a0ab6e758dd9 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:23:50.562698 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-eebb0a98-e654-4c45-aaf5-a0ab6e758dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:50.632155 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3858/7660] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:23:50.640015 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d384252-24b7-475f-b495-c7bdd9a35ef1 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:50.640318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d384252-24b7-475f-b495-c7bdd9a35ef1 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:50.640572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d384252-24b7-475f-b495-c7bdd9a35ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:50.660826 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-1d384252-24b7-475f-b495-c7bdd9a35ef1 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:23:50.662048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1d384252-24b7-475f-b495-c7bdd9a35ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:50.679248 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3803/7661] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:23:50.683780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb0a98-e654-4c45-aaf5-a0ab6e758dd9 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:50.696300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb0a98-e654-4c45-aaf5-a0ab6e758dd9 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:50.701145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b28b63-df60-407b-93f9-c28e7f943305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:50.701761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b28b63-df60-407b-93f9-c28e7f943305 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:50.702045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b28b63-df60-407b-93f9-c28e7f943305 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:50.702324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b28b63-df60-407b-93f9-c28e7f943305 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:50.703150 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b28b63-df60-407b-93f9-c28e7f943305 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:23:50.703469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b28b63-df60-407b-93f9-c28e7f943305 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:50.705088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b28b63-df60-407b-93f9-c28e7f943305 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:50.718787 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3859/7662] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:23:50.724034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d384252-24b7-475f-b495-c7bdd9a35ef1 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:50.734510 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d384252-24b7-475f-b495-c7bdd9a35ef1 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:50.740938 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fffd31b-7e45-4693-a975-3efdbcf07fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:50.741839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffd31b-7e45-4693-a975-3efdbcf07fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:50.742318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffd31b-7e45-4693-a975-3efdbcf07fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:50.742872 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffd31b-7e45-4693-a975-3efdbcf07fd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:50.743704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fffd31b-7e45-4693-a975-3efdbcf07fd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:50.745936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fffd31b-7e45-4693-a975-3efdbcf07fd4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:50.795663 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3804/7663] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:23:50 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:23:50.800439 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b28b63-df60-407b-93f9-c28e7f943305 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:50.813251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b28b63-df60-407b-93f9-c28e7f943305 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:50.881683 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10dcc0-0ef1-4ada-880e-b83da44f4496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:50.882305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10dcc0-0ef1-4ada-880e-b83da44f4496 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:50.882621 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10dcc0-0ef1-4ada-880e-b83da44f4496 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:50.882905 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10dcc0-0ef1-4ada-880e-b83da44f4496 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:50.883584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10dcc0-0ef1-4ada-880e-b83da44f4496 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:50.885511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10dcc0-0ef1-4ada-880e-b83da44f4496 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:50.908163 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3860/7664] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:23:50 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:23:50.912552 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fffd31b-7e45-4693-a975-3efdbcf07fd4 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:50.923992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fffd31b-7e45-4693-a975-3efdbcf07fd4 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:50.929565 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c8f9f-e145-4634-8ba8-1c3974b76a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:50.930114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c8f9f-e145-4634-8ba8-1c3974b76a4f admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:50.930393 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c8f9f-e145-4634-8ba8-1c3974b76a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:50.930708 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c8f9f-e145-4634-8ba8-1c3974b76a4f admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:50.931382 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c8f9f-e145-4634-8ba8-1c3974b76a4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:50.933026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c8f9f-e145-4634-8ba8-1c3974b76a4f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:50.945038 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3805/7665] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:23:50.949351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10dcc0-0ef1-4ada-880e-b83da44f4496 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:50.960626 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10dcc0-0ef1-4ada-880e-b83da44f4496 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:50.965350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b9533-8deb-4a0f-8433-ff3be1e7c5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:50.965995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b9533-8deb-4a0f-8433-ff3be1e7c5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:50.966332 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b9533-8deb-4a0f-8433-ff3be1e7c5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:50.966641 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b9533-8deb-4a0f-8433-ff3be1e7c5e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:50.967295 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b9533-8deb-4a0f-8433-ff3be1e7c5e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:50.968937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b9533-8deb-4a0f-8433-ff3be1e7c5e5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:50.980926 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3861/7666] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:23:50.985120 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c8f9f-e145-4634-8ba8-1c3974b76a4f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:50.996665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c8f9f-e145-4634-8ba8-1c3974b76a4f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:51.001966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2408543-c18a-46dc-a3f6-2d19ea200a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:51.003569 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2408543-c18a-46dc-a3f6-2d19ea200a57 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:51.004077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2408543-c18a-46dc-a3f6-2d19ea200a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:51.004742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2408543-c18a-46dc-a3f6-2d19ea200a57 admin admin] PATH_INFO: `/v3/projects/cb48281491e5408b89aef10e236519aa/users/36d19078bf6642389799f23a5f74010a/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:51.021770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2408543-c18a-46dc-a3f6-2d19ea200a57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb48281491e5408b89aef10e236519aa, user_id=36d19078bf6642389799f23a5f74010a, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:51.025040 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2408543-c18a-46dc-a3f6-2d19ea200a57 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:51.042964 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3806/7667] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:23:50 2022] PUT /identity/v3/projects/cb48281491e5408b89aef10e236519aa/users/36d19078bf6642389799f23a5f74010a/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:23:51.059659 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30f3aa-0b75-43bd-92aa-1bdd6683c9be None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:51.059659 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30f3aa-0b75-43bd-92aa-1bdd6683c9be None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:51.059999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30f3aa-0b75-43bd-92aa-1bdd6683c9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:51.094305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-dc30f3aa-0b75-43bd-92aa-1bdd6683c9be None None] MFA Rules not processed for user `36d19078bf6642389799f23a5f74010a`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:23:51.095986 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-dc30f3aa-0b75-43bd-92aa-1bdd6683c9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:51.136880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:51.203956 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3862/7668] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:23:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:23:51.218875 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2408543-c18a-46dc-a3f6-2d19ea200a57 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:51.220665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f2408543-c18a-46dc-a3f6-2d19ea200a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:51.301364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:51.330861 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2408543-c18a-46dc-a3f6-2d19ea200a57 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:51.336828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3686c-0467-4323-aaa9-5fa8a8e49679 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:51.337447 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3686c-0467-4323-aaa9-5fa8a8e49679 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:51.337730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3686c-0467-4323-aaa9-5fa8a8e49679 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:51.338006 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3686c-0467-4323-aaa9-5fa8a8e49679 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:51.349160 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e3686c-0467-4323-aaa9-5fa8a8e49679 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:51.351477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e3686c-0467-4323-aaa9-5fa8a8e49679 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:51.362134 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3807/7669] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:23:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:23:51.749797 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30f3aa-0b75-43bd-92aa-1bdd6683c9be None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:51.752328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-dc30f3aa-0b75-43bd-92aa-1bdd6683c9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:51.879296 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30f3aa-0b75-43bd-92aa-1bdd6683c9be None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:51.885898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff317033-c828-477c-b102-bc0fb1ac08c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:51.887278 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff317033-c828-477c-b102-bc0fb1ac08c4 service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:51.887714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff317033-c828-477c-b102-bc0fb1ac08c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:51.888165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff317033-c828-477c-b102-bc0fb1ac08c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:51.896784 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ff317033-c828-477c-b102-bc0fb1ac08c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:51.916573 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff317033-c828-477c-b102-bc0fb1ac08c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:51.918037 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff317033-c828-477c-b102-bc0fb1ac08c4 service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:51.936996 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3863/7670] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:23:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:23:54.094197 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3686c-0467-4323-aaa9-5fa8a8e49679 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:23:54.106169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3686c-0467-4323-aaa9-5fa8a8e49679 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:23:54.109843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b217da7-2610-4de4-a3c3-1430c0a8d82b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:23:54.110395 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b217da7-2610-4de4-a3c3-1430c0a8d82b service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:54.110705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b217da7-2610-4de4-a3c3-1430c0a8d82b service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:54.111034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b217da7-2610-4de4-a3c3-1430c0a8d82b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:54.113666 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0b217da7-2610-4de4-a3c3-1430c0a8d82b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:54.129494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b217da7-2610-4de4-a3c3-1430c0a8d82b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:23:54.130985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b217da7-2610-4de4-a3c3-1430c0a8d82b service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:23:54.144096 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3808/7671] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:23:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:23:59.910130 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d6f59-2024-4598-83bf-4ca84d7bfd72 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:23:59.910587 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d6f59-2024-4598-83bf-4ca84d7bfd72 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:23:59.910719 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d6f59-2024-4598-83bf-4ca84d7bfd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:23:59.930525 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-c23d6f59-2024-4598-83bf-4ca84d7bfd72 None None] MFA Rules not processed for user `fad71f0aa2944599b949049697614c36`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:23:59.931685 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c23d6f59-2024-4598-83bf-4ca84d7bfd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:23:59.987757 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3864/7672] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:23:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:24:00.228567 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b217da7-2610-4de4-a3c3-1430c0a8d82b service cinder] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:24:00.229998 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0b217da7-2610-4de4-a3c3-1430c0a8d82b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:24:00.300853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b217da7-2610-4de4-a3c3-1430c0a8d82b service cinder] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:24:00.305018 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc46b0-e425-4fe7-b176-91f070dc4ef3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:24:00.305622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc46b0-e425-4fe7-b176-91f070dc4ef3 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:24:00.305900 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc46b0-e425-4fe7-b176-91f070dc4ef3 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:24:00.306172 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc46b0-e425-4fe7-b176-91f070dc4ef3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:24:00.307948 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-afdc46b0-e425-4fe7-b176-91f070dc4ef3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:24:00.320157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc46b0-e425-4fe7-b176-91f070dc4ef3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:24:00.321615 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc46b0-e425-4fe7-b176-91f070dc4ef3 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:24:00.331905 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3809/7673] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:24:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:24:09.980713 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=67 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:24:10.326118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=42 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:24:18.434012 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d6f59-2024-4598-83bf-4ca84d7bfd72 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:24:18.437804 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c23d6f59-2024-4598-83bf-4ca84d7bfd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:24:18.619892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d6f59-2024-4598-83bf-4ca84d7bfd72 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:24:18.628255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a623c6-a46d-4966-8cea-77c5895ba2a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:24:18.629587 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a623c6-a46d-4966-8cea-77c5895ba2a2 service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:24:18.629957 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a623c6-a46d-4966-8cea-77c5895ba2a2 service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:24:18.630588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a623c6-a46d-4966-8cea-77c5895ba2a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:24:18.633436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b7a623c6-a46d-4966-8cea-77c5895ba2a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:24:18.656932 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a623c6-a46d-4966-8cea-77c5895ba2a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:24:18.659565 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a623c6-a46d-4966-8cea-77c5895ba2a2 service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:24:18.681888 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3865/7674] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:24:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:24:21.746288 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50695645-6ee4-4ae0-86a7-ec8a32112254 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:24:21.747149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50695645-6ee4-4ae0-86a7-ec8a32112254 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:24:21.747618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50695645-6ee4-4ae0-86a7-ec8a32112254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:24:21.787143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-50695645-6ee4-4ae0-86a7-ec8a32112254 None None] MFA Rules not processed for user `323cbfd25ac04e829ad1c162fedf68e8`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:24:21.793456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-50695645-6ee4-4ae0-86a7-ec8a32112254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:24:21.914477 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3810/7675] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:24:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:24:23.620238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a623c6-a46d-4966-8cea-77c5895ba2a2 service placement] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:24:23.621744 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b7a623c6-a46d-4966-8cea-77c5895ba2a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:24:23.762060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a623c6-a46d-4966-8cea-77c5895ba2a2 service placement] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:24:23.767703 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8286b-6d19-4146-ab4a-89680d7853de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:24:23.768395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8286b-6d19-4146-ab4a-89680d7853de admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:24:23.768676 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8286b-6d19-4146-ab4a-89680d7853de admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:24:23.768949 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8286b-6d19-4146-ab4a-89680d7853de admin admin] PATH_INFO: `/v3/users/fad71f0aa2944599b949049697614c36` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:24:23.770368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8286b-6d19-4146-ab4a-89680d7853de admin admin] RBAC: Authorizing `identity:delete_user(user_id=fad71f0aa2944599b949049697614c36)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:24:23.775961 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8286b-6d19-4146-ab4a-89680d7853de admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:24:23.845847 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2ae8286b-6d19-4146-ab4a-89680d7853de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fad71f0aa2944599b949049697614c36'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:23.853493 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2ae8286b-6d19-4146-ab4a-89680d7853de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fad71f0aa2944599b949049697614c36'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:23.854261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2ae8286b-6d19-4146-ab4a-89680d7853de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fad71f0aa2944599b949049697614c36'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:23.854976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2ae8286b-6d19-4146-ab4a-89680d7853de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fad71f0aa2944599b949049697614c36'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:23.865838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2ae8286b-6d19-4146-ab4a-89680d7853de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fad71f0aa2944599b949049697614c36'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:23.896546 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3866/7676] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:24:23 2022] DELETE /identity/v3/users/fad71f0aa2944599b949049697614c36 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:24:24.140910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50695645-6ee4-4ae0-86a7-ec8a32112254 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:24:24.152670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50695645-6ee4-4ae0-86a7-ec8a32112254 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:24:24.251692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e2b77-ad10-42e1-bf2a-0a271ad0df32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:24:24.252623 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e2b77-ad10-42e1-bf2a-0a271ad0df32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:24:24.253121 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e2b77-ad10-42e1-bf2a-0a271ad0df32 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:24:24.255053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e2b77-ad10-42e1-bf2a-0a271ad0df32 admin admin] PATH_INFO: `/v3/projects/85e0a11a0ef84f66938d44351c7f3767` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:24:24.257536 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e2b77-ad10-42e1-bf2a-0a271ad0df32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85e0a11a0ef84f66938d44351c7f3767)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:24:24.260987 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e2b77-ad10-42e1-bf2a-0a271ad0df32 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:24:24.366993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5c4e2b77-ad10-42e1-bf2a-0a271ad0df32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85e0a11a0ef84f66938d44351c7f3767', 'request_id': 'req-5c4e2b77-ad10-42e1-bf2a-0a271ad0df32'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:24.384822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5c4e2b77-ad10-42e1-bf2a-0a271ad0df32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85e0a11a0ef84f66938d44351c7f3767', 'request_id': 'req-5c4e2b77-ad10-42e1-bf2a-0a271ad0df32'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:24.401497 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5c4e2b77-ad10-42e1-bf2a-0a271ad0df32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85e0a11a0ef84f66938d44351c7f3767', 'request_id': 'req-5c4e2b77-ad10-42e1-bf2a-0a271ad0df32'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:24.424558 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5c4e2b77-ad10-42e1-bf2a-0a271ad0df32 admin admin] The token cache is being invalidate because project 85e0a11a0ef84f66938d44351c7f3767 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:24:24.424855 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5c4e2b77-ad10-42e1-bf2a-0a271ad0df32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:24.425877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5c4e2b77-ad10-42e1-bf2a-0a271ad0df32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:24.428071 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3811/7677] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:24:24 2022] DELETE /identity/v3/projects/85e0a11a0ef84f66938d44351c7f3767 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:24:24.432109 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8286b-6d19-4146-ab4a-89680d7853de admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:24:24.433755 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2ae8286b-6d19-4146-ab4a-89680d7853de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:24:24.453643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8286b-6d19-4146-ab4a-89680d7853de admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:24:24.461849 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:24:24.554056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10af2f-afa3-4d65-a82e-71b5f28b7ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:24:24.554852 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10af2f-afa3-4d65-a82e-71b5f28b7ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:24:24.555053 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10af2f-afa3-4d65-a82e-71b5f28b7ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:24:24.555675 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10af2f-afa3-4d65-a82e-71b5f28b7ea5 admin admin] PATH_INFO: `/v3/users/2a19ae0801884a938a94cdfdc4de1b08` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:24:24.556767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd10af2f-afa3-4d65-a82e-71b5f28b7ea5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a19ae0801884a938a94cdfdc4de1b08)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:24:24.562812 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd10af2f-afa3-4d65-a82e-71b5f28b7ea5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:24:24.619209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fd10af2f-afa3-4d65-a82e-71b5f28b7ea5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a19ae0801884a938a94cdfdc4de1b08'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:24.628305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fd10af2f-afa3-4d65-a82e-71b5f28b7ea5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a19ae0801884a938a94cdfdc4de1b08'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:24.628935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fd10af2f-afa3-4d65-a82e-71b5f28b7ea5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a19ae0801884a938a94cdfdc4de1b08'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:24.629483 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fd10af2f-afa3-4d65-a82e-71b5f28b7ea5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a19ae0801884a938a94cdfdc4de1b08'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:24.639655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fd10af2f-afa3-4d65-a82e-71b5f28b7ea5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a19ae0801884a938a94cdfdc4de1b08'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:24.664669 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3867/7678] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:24:24 2022] DELETE /identity/v3/users/2a19ae0801884a938a94cdfdc4de1b08 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:24:24.869119 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e2b77-ad10-42e1-bf2a-0a271ad0df32 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:24:24.870739 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5c4e2b77-ad10-42e1-bf2a-0a271ad0df32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:24:24.898732 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e2b77-ad10-42e1-bf2a-0a271ad0df32 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:24:24.944887 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:24:24.981259 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d39edd5-cbe2-44d5-a35e-d9fe17c7f82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:24:24.981918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39edd5-cbe2-44d5-a35e-d9fe17c7f82c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:24:24.982204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39edd5-cbe2-44d5-a35e-d9fe17c7f82c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:24:24.982477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39edd5-cbe2-44d5-a35e-d9fe17c7f82c admin admin] PATH_INFO: `/v3/projects/39b1e62bc44b4253b2df0e7b22bfb332` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:24:24.983691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d39edd5-cbe2-44d5-a35e-d9fe17c7f82c admin admin] RBAC: Authorizing `identity:delete_project(project_id=39b1e62bc44b4253b2df0e7b22bfb332)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:24:24.986218 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d39edd5-cbe2-44d5-a35e-d9fe17c7f82c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:24:25.039321 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8d39edd5-cbe2-44d5-a35e-d9fe17c7f82c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39b1e62bc44b4253b2df0e7b22bfb332', 'request_id': 'req-8d39edd5-cbe2-44d5-a35e-d9fe17c7f82c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:25.047378 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8d39edd5-cbe2-44d5-a35e-d9fe17c7f82c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39b1e62bc44b4253b2df0e7b22bfb332', 'request_id': 'req-8d39edd5-cbe2-44d5-a35e-d9fe17c7f82c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:25.055642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8d39edd5-cbe2-44d5-a35e-d9fe17c7f82c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39b1e62bc44b4253b2df0e7b22bfb332', 'request_id': 'req-8d39edd5-cbe2-44d5-a35e-d9fe17c7f82c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:25.071083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8d39edd5-cbe2-44d5-a35e-d9fe17c7f82c admin admin] The token cache is being invalidate because project 39b1e62bc44b4253b2df0e7b22bfb332 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:24:25.071337 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8d39edd5-cbe2-44d5-a35e-d9fe17c7f82c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:25.071991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8d39edd5-cbe2-44d5-a35e-d9fe17c7f82c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:25.083263 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3812/7679] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:24:24 2022] DELETE /identity/v3/projects/39b1e62bc44b4253b2df0e7b22bfb332 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:24:34.657909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:24:35.067723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=35,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:24:47.104979 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10af2f-afa3-4d65-a82e-71b5f28b7ea5 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:24:47.107022 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-fd10af2f-afa3-4d65-a82e-71b5f28b7ea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:24:47.120612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10af2f-afa3-4d65-a82e-71b5f28b7ea5 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:24:47.178962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbc6c8-9058-48e2-9773-76c6a20d341a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:24:47.179589 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbc6c8-9058-48e2-9773-76c6a20d341a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:24:47.179869 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbc6c8-9058-48e2-9773-76c6a20d341a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:24:47.180144 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbc6c8-9058-48e2-9773-76c6a20d341a admin admin] PATH_INFO: `/v3/users/323cbfd25ac04e829ad1c162fedf68e8` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:24:47.181252 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbbc6c8-9058-48e2-9773-76c6a20d341a admin admin] RBAC: Authorizing `identity:delete_user(user_id=323cbfd25ac04e829ad1c162fedf68e8)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:24:47.183207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbbc6c8-9058-48e2-9773-76c6a20d341a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:24:47.229652 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3cbbc6c8-9058-48e2-9773-76c6a20d341a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '323cbfd25ac04e829ad1c162fedf68e8'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:47.237209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3cbbc6c8-9058-48e2-9773-76c6a20d341a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '323cbfd25ac04e829ad1c162fedf68e8'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:47.237861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3cbbc6c8-9058-48e2-9773-76c6a20d341a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '323cbfd25ac04e829ad1c162fedf68e8'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:47.238462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3cbbc6c8-9058-48e2-9773-76c6a20d341a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '323cbfd25ac04e829ad1c162fedf68e8'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:47.245667 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3cbbc6c8-9058-48e2-9773-76c6a20d341a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '323cbfd25ac04e829ad1c162fedf68e8'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:47.264727 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3868/7680] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:24:47 2022] DELETE /identity/v3/users/323cbfd25ac04e829ad1c162fedf68e8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:24:47.269756 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fe695-a165-43da-a675-8620c046a262 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:24:47.270265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fe695-a165-43da-a675-8620c046a262 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:24:47.270374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fe695-a165-43da-a675-8620c046a262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:24:47.290346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-3f1fe695-a165-43da-a675-8620c046a262 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:24:47.291503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3f1fe695-a165-43da-a675-8620c046a262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:24:47.352307 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3813/7681] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:24:47.362795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbc6c8-9058-48e2-9773-76c6a20d341a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:24:47.364634 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3cbbc6c8-9058-48e2-9773-76c6a20d341a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:24:47.428218 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbc6c8-9058-48e2-9773-76c6a20d341a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:24:47.431890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba9fab-fa34-431b-9944-e9847ccbf6bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:24:47.432483 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba9fab-fa34-431b-9944-e9847ccbf6bd service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:24:47.432758 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba9fab-fa34-431b-9944-e9847ccbf6bd service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:24:47.433027 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba9fab-fa34-431b-9944-e9847ccbf6bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:24:47.442460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba9fab-fa34-431b-9944-e9847ccbf6bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:24:47.443901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba9fab-fa34-431b-9944-e9847ccbf6bd service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:24:47.453951 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3869/7682] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:24:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:24:47.627884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1fe695-a165-43da-a675-8620c046a262 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:24:47.629430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3f1fe695-a165-43da-a675-8620c046a262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:24:47.645272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1fe695-a165-43da-a675-8620c046a262 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:24:47.658029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cdfb37-447a-4f75-89f4-d8bbbc808151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:24:47.658601 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdfb37-447a-4f75-89f4-d8bbbc808151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:24:47.658887 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdfb37-447a-4f75-89f4-d8bbbc808151 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:24:47.659184 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdfb37-447a-4f75-89f4-d8bbbc808151 admin admin] PATH_INFO: `/v3/projects/7054b60d5cc646ec87fa19bedaa69407` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:24:47.660280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cdfb37-447a-4f75-89f4-d8bbbc808151 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7054b60d5cc646ec87fa19bedaa69407)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:24:47.663361 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cdfb37-447a-4f75-89f4-d8bbbc808151 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:24:47.713862 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-19cdfb37-447a-4f75-89f4-d8bbbc808151 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7054b60d5cc646ec87fa19bedaa69407', 'request_id': 'req-19cdfb37-447a-4f75-89f4-d8bbbc808151'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:47.719603 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-19cdfb37-447a-4f75-89f4-d8bbbc808151 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7054b60d5cc646ec87fa19bedaa69407', 'request_id': 'req-19cdfb37-447a-4f75-89f4-d8bbbc808151'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:47.727329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-19cdfb37-447a-4f75-89f4-d8bbbc808151 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7054b60d5cc646ec87fa19bedaa69407', 'request_id': 'req-19cdfb37-447a-4f75-89f4-d8bbbc808151'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:47.741654 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-19cdfb37-447a-4f75-89f4-d8bbbc808151 admin admin] The token cache is being invalidate because project 7054b60d5cc646ec87fa19bedaa69407 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:24:47.741946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-19cdfb37-447a-4f75-89f4-d8bbbc808151 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:47.742599 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-19cdfb37-447a-4f75-89f4-d8bbbc808151 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:47.744146 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3814/7683] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:24:47 2022] DELETE /identity/v3/projects/7054b60d5cc646ec87fa19bedaa69407 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:24:47.748071 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba9fab-fa34-431b-9944-e9847ccbf6bd service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:24:47.758575 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba9fab-fa34-431b-9944-e9847ccbf6bd service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:24:47.779212 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:24:47.822635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6855e59-4ebf-425d-99e4-0486894d5d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:24:47.823266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6855e59-4ebf-425d-99e4-0486894d5d92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:24:47.823543 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6855e59-4ebf-425d-99e4-0486894d5d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:24:47.823882 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6855e59-4ebf-425d-99e4-0486894d5d92 admin admin] PATH_INFO: `/v3/users/a98fadc97df74660a092df0d6be9363b` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:24:47.824909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6855e59-4ebf-425d-99e4-0486894d5d92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a98fadc97df74660a092df0d6be9363b)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:24:47.826843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6855e59-4ebf-425d-99e4-0486894d5d92 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:24:47.881299 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d6855e59-4ebf-425d-99e4-0486894d5d92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a98fadc97df74660a092df0d6be9363b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:47.882308 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d6855e59-4ebf-425d-99e4-0486894d5d92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a98fadc97df74660a092df0d6be9363b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:47.883010 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d6855e59-4ebf-425d-99e4-0486894d5d92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a98fadc97df74660a092df0d6be9363b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:47.883610 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d6855e59-4ebf-425d-99e4-0486894d5d92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a98fadc97df74660a092df0d6be9363b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:47.892343 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d6855e59-4ebf-425d-99e4-0486894d5d92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a98fadc97df74660a092df0d6be9363b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:47.911847 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3870/7684] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:24:47 2022] DELETE /identity/v3/users/a98fadc97df74660a092df0d6be9363b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:24:48.188587 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cdfb37-447a-4f75-89f4-d8bbbc808151 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:24:48.190018 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-19cdfb37-447a-4f75-89f4-d8bbbc808151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:24:48.209376 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cdfb37-447a-4f75-89f4-d8bbbc808151 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:24:48.266941 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb97327-595d-4f4e-988a-5d6a2a9d9e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:24:48.267491 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb97327-595d-4f4e-988a-5d6a2a9d9e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:24:48.267772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb97327-595d-4f4e-988a-5d6a2a9d9e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:24:48.268049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb97327-595d-4f4e-988a-5d6a2a9d9e09 admin admin] PATH_INFO: `/v3/projects/a0406d578a474268b74423f9cd0679b2` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:24:48.269163 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb97327-595d-4f4e-988a-5d6a2a9d9e09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0406d578a474268b74423f9cd0679b2)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:24:48.271110 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb97327-595d-4f4e-988a-5d6a2a9d9e09 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:24:48.301814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:24:48.320207 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fdb97327-595d-4f4e-988a-5d6a2a9d9e09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0406d578a474268b74423f9cd0679b2', 'request_id': 'req-fdb97327-595d-4f4e-988a-5d6a2a9d9e09'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:48.325818 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fdb97327-595d-4f4e-988a-5d6a2a9d9e09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0406d578a474268b74423f9cd0679b2', 'request_id': 'req-fdb97327-595d-4f4e-988a-5d6a2a9d9e09'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:48.332585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fdb97327-595d-4f4e-988a-5d6a2a9d9e09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0406d578a474268b74423f9cd0679b2', 'request_id': 'req-fdb97327-595d-4f4e-988a-5d6a2a9d9e09'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:48.345448 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fdb97327-595d-4f4e-988a-5d6a2a9d9e09 admin admin] The token cache is being invalidate because project a0406d578a474268b74423f9cd0679b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:24:48.345732 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fdb97327-595d-4f4e-988a-5d6a2a9d9e09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:48.346347 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fdb97327-595d-4f4e-988a-5d6a2a9d9e09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:48.347838 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3815/7685] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:24:48 2022] DELETE /identity/v3/projects/a0406d578a474268b74423f9cd0679b2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:24:48.352017 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6855e59-4ebf-425d-99e4-0486894d5d92 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:24:48.353392 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d6855e59-4ebf-425d-99e4-0486894d5d92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:24:48.367012 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6855e59-4ebf-425d-99e4-0486894d5d92 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:24:48.423944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b53296-1a1d-44e9-bceb-d43ed8616dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:24:48.424572 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b53296-1a1d-44e9-bceb-d43ed8616dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:24:48.424854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b53296-1a1d-44e9-bceb-d43ed8616dce admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:24:48.425124 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b53296-1a1d-44e9-bceb-d43ed8616dce admin admin] PATH_INFO: `/v3/users/078ea6976eb34f7abb0b1e0da4ee0ed7` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:24:48.426231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b53296-1a1d-44e9-bceb-d43ed8616dce admin admin] RBAC: Authorizing `identity:delete_user(user_id=078ea6976eb34f7abb0b1e0da4ee0ed7)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:24:48.428183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b53296-1a1d-44e9-bceb-d43ed8616dce admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:24:48.473011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:24:48.475519 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-21b53296-1a1d-44e9-bceb-d43ed8616dce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '078ea6976eb34f7abb0b1e0da4ee0ed7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:48.484756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-21b53296-1a1d-44e9-bceb-d43ed8616dce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '078ea6976eb34f7abb0b1e0da4ee0ed7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:48.485437 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-21b53296-1a1d-44e9-bceb-d43ed8616dce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '078ea6976eb34f7abb0b1e0da4ee0ed7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:48.486032 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-21b53296-1a1d-44e9-bceb-d43ed8616dce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '078ea6976eb34f7abb0b1e0da4ee0ed7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:48.492626 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-21b53296-1a1d-44e9-bceb-d43ed8616dce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '078ea6976eb34f7abb0b1e0da4ee0ed7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:48.510759 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3871/7686] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:24:48 2022] DELETE /identity/v3/users/078ea6976eb34f7abb0b1e0da4ee0ed7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:24:48.686085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb97327-595d-4f4e-988a-5d6a2a9d9e09 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:24:48.688324 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-fdb97327-595d-4f4e-988a-5d6a2a9d9e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:24:48.704399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb97327-595d-4f4e-988a-5d6a2a9d9e09 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:24:48.763325 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f7359-2c50-4066-a974-169f885a40e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:24:48.763962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f7359-2c50-4066-a974-169f885a40e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:24:48.764241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f7359-2c50-4066-a974-169f885a40e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:24:48.764558 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f7359-2c50-4066-a974-169f885a40e0 admin admin] PATH_INFO: `/v3/projects/1c4e41974e4c438983f88b3c83ca9d82` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:24:48.765680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f7359-2c50-4066-a974-169f885a40e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c4e41974e4c438983f88b3c83ca9d82)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:24:48.767686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f7359-2c50-4066-a974-169f885a40e0 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:24:48.816318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-437f7359-2c50-4066-a974-169f885a40e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c4e41974e4c438983f88b3c83ca9d82', 'request_id': 'req-437f7359-2c50-4066-a974-169f885a40e0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:48.821608 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-437f7359-2c50-4066-a974-169f885a40e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c4e41974e4c438983f88b3c83ca9d82', 'request_id': 'req-437f7359-2c50-4066-a974-169f885a40e0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:48.827643 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-437f7359-2c50-4066-a974-169f885a40e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c4e41974e4c438983f88b3c83ca9d82', 'request_id': 'req-437f7359-2c50-4066-a974-169f885a40e0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:48.839845 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-437f7359-2c50-4066-a974-169f885a40e0 admin admin] The token cache is being invalidate because project 1c4e41974e4c438983f88b3c83ca9d82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:24:48.840131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-437f7359-2c50-4066-a974-169f885a40e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:48.840761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-437f7359-2c50-4066-a974-169f885a40e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:24:48.842238 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3816/7687] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:24:48 2022] DELETE /identity/v3/projects/1c4e41974e4c438983f88b3c83ca9d82 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:24:54.732124 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b53296-1a1d-44e9-bceb-d43ed8616dce admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:24:54.734136 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-21b53296-1a1d-44e9-bceb-d43ed8616dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:24:54.794705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b53296-1a1d-44e9-bceb-d43ed8616dce admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:24:54.842308 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c33596-a664-4759-8f8d-b9062a22dd31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:24:54.843476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c33596-a664-4759-8f8d-b9062a22dd31 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:24:54.843751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c33596-a664-4759-8f8d-b9062a22dd31 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:24:54.844019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c33596-a664-4759-8f8d-b9062a22dd31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:24:54.845721 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-89c33596-a664-4759-8f8d-b9062a22dd31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:24:54.856648 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c33596-a664-4759-8f8d-b9062a22dd31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:24:54.858056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c33596-a664-4759-8f8d-b9062a22dd31 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:24:54.868169 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3872/7688] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:24:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:24:58.836800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=13,keystone:SELECT=65,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:25:04.862937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=4,keystone:SELECT=59,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:27:01.937850 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f7359-2c50-4066-a974-169f885a40e0 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:27:01.940028 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-437f7359-2c50-4066-a974-169f885a40e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:27:02.010772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f7359-2c50-4066-a974-169f885a40e0 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:27:02.015878 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623b465-7207-4470-9858-32045e4223c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:27:02.017091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623b465-7207-4470-9858-32045e4223c4 service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:27:02.017369 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623b465-7207-4470-9858-32045e4223c4 service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:27:02.017644 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623b465-7207-4470-9858-32045e4223c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:27:02.019397 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a623b465-7207-4470-9858-32045e4223c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:27:02.032688 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a623b465-7207-4470-9858-32045e4223c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:27:02.034262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a623b465-7207-4470-9858-32045e4223c4 service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:27:02.046160 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3817/7689] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:27:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:27:03.167874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c33596-a664-4759-8f8d-b9062a22dd31 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:27:03.169281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-89c33596-a664-4759-8f8d-b9062a22dd31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:27:03.185999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c33596-a664-4759-8f8d-b9062a22dd31 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:27:03.191527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e4219b-39d2-4dea-8987-17bc76cee587 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:27:03.192117 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4219b-39d2-4dea-8987-17bc76cee587 service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:27:03.192394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4219b-39d2-4dea-8987-17bc76cee587 service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:27:03.192663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4219b-39d2-4dea-8987-17bc76cee587 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:27:03.194368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-03e4219b-39d2-4dea-8987-17bc76cee587 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:27:03.207598 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e4219b-39d2-4dea-8987-17bc76cee587 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:27:03.209148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e4219b-39d2-4dea-8987-17bc76cee587 service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:27:03.221239 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3873/7690] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:27:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:27:12.040174 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=32 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:27:13.214740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=6 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:27:41.078188 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623b465-7207-4470-9858-32045e4223c4 service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:27:41.079619 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a623b465-7207-4470-9858-32045e4223c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:27:41.153734 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623b465-7207-4470-9858-32045e4223c4 service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:27:41.157934 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acaf725-a601-4c0c-9530-cc34a75af95e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:27:41.158582 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acaf725-a601-4c0c-9530-cc34a75af95e service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:27:41.158862 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acaf725-a601-4c0c-9530-cc34a75af95e service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:27:41.159131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acaf725-a601-4c0c-9530-cc34a75af95e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:27:41.161170 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9acaf725-a601-4c0c-9530-cc34a75af95e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:27:41.220270 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acaf725-a601-4c0c-9530-cc34a75af95e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:27:41.221696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acaf725-a601-4c0c-9530-cc34a75af95e service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:27:41.230504 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3818/7691] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:27:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:27:51.226435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=53 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:28:48.590846 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e4219b-39d2-4dea-8987-17bc76cee587 service placement] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:28:48.592253 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-03e4219b-39d2-4dea-8987-17bc76cee587 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:28:48.606677 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e4219b-39d2-4dea-8987-17bc76cee587 service placement] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:28:48.610874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05d5ed-ed34-42b0-a7f9-a124e88cb15a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:28:48.611480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05d5ed-ed34-42b0-a7f9-a124e88cb15a service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:28:48.611763 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05d5ed-ed34-42b0-a7f9-a124e88cb15a service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:28:48.612037 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05d5ed-ed34-42b0-a7f9-a124e88cb15a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:28:48.613826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7d05d5ed-ed34-42b0-a7f9-a124e88cb15a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:28:48.674567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05d5ed-ed34-42b0-a7f9-a124e88cb15a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:28:48.675902 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05d5ed-ed34-42b0-a7f9-a124e88cb15a service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:28:48.684831 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3874/7692] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:28:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:28:51.169060 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acaf725-a601-4c0c-9530-cc34a75af95e service cinder] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:28:51.170480 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9acaf725-a601-4c0c-9530-cc34a75af95e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:28:51.254229 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acaf725-a601-4c0c-9530-cc34a75af95e service cinder] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:28:51.259743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a71121-1412-41f0-bc25-32cea37f1a8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:28:51.260361 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a71121-1412-41f0-bc25-32cea37f1a8d service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:28:51.260637 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a71121-1412-41f0-bc25-32cea37f1a8d service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:28:51.260906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a71121-1412-41f0-bc25-32cea37f1a8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:28:51.262609 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d5a71121-1412-41f0-bc25-32cea37f1a8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:28:51.320377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a71121-1412-41f0-bc25-32cea37f1a8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:28:51.321991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a71121-1412-41f0-bc25-32cea37f1a8d service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:28:51.331630 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3819/7693] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:28:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:28:52.411851 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05d5ed-ed34-42b0-a7f9-a124e88cb15a service cinder] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:28:52.422929 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05d5ed-ed34-42b0-a7f9-a124e88cb15a service cinder] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:28:52.426531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe54c0-0b3a-458b-8a4d-389c235be830 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:28:52.427157 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe54c0-0b3a-458b-8a4d-389c235be830 service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:28:52.427463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe54c0-0b3a-458b-8a4d-389c235be830 service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:28:52.427740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe54c0-0b3a-458b-8a4d-389c235be830 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:28:52.429451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0ebe54c0-0b3a-458b-8a4d-389c235be830 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:28:52.445558 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe54c0-0b3a-458b-8a4d-389c235be830 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:28:52.447047 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe54c0-0b3a-458b-8a4d-389c235be830 service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:28:52.459997 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3875/7694] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:28:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:28:55.653435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a71121-1412-41f0-bc25-32cea37f1a8d service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:28:55.665142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a71121-1412-41f0-bc25-32cea37f1a8d service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:28:55.668831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527bd944-60c3-453c-8795-2ca95fd03275 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:28:55.669446 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527bd944-60c3-453c-8795-2ca95fd03275 service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:28:55.669723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527bd944-60c3-453c-8795-2ca95fd03275 service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:28:55.669997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527bd944-60c3-453c-8795-2ca95fd03275 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:28:55.671957 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-527bd944-60c3-453c-8795-2ca95fd03275 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:28:55.687554 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527bd944-60c3-453c-8795-2ca95fd03275 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:28:55.689514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527bd944-60c3-453c-8795-2ca95fd03275 service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:28:55.702117 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3820/7695] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:28:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:29:02.453233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=34 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:29:05.695753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=66 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:29:45.810965 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe54c0-0b3a-458b-8a4d-389c235be830 service cinder] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:29:45.830935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe54c0-0b3a-458b-8a4d-389c235be830 service cinder] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:29:45.839336 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014619bc-093c-49bc-bb25-6a0614c3556b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:29:45.840405 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014619bc-093c-49bc-bb25-6a0614c3556b service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:29:45.841077 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014619bc-093c-49bc-bb25-6a0614c3556b service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:29:45.841354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014619bc-093c-49bc-bb25-6a0614c3556b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:29:45.843193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-014619bc-093c-49bc-bb25-6a0614c3556b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:29:45.863493 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014619bc-093c-49bc-bb25-6a0614c3556b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:29:45.865345 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014619bc-093c-49bc-bb25-6a0614c3556b service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:29:45.891867 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3876/7696] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:29:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:29:48.878805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527bd944-60c3-453c-8795-2ca95fd03275 service cinder] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:29:48.880167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-527bd944-60c3-453c-8795-2ca95fd03275 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:29:48.965144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527bd944-60c3-453c-8795-2ca95fd03275 service cinder] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:29:48.970443 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d71113-deea-42e8-bf95-625326e80352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:29:48.971123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d71113-deea-42e8-bf95-625326e80352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:29:48.971405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d71113-deea-42e8-bf95-625326e80352 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:29:48.971681 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d71113-deea-42e8-bf95-625326e80352 admin admin] PATH_INFO: `/v3/users/536aa7b494a74a66815b2f79c0c67fa8` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:29:48.972825 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d71113-deea-42e8-bf95-625326e80352 admin admin] RBAC: Authorizing `identity:delete_user(user_id=536aa7b494a74a66815b2f79c0c67fa8)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:29:48.974932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d71113-deea-42e8-bf95-625326e80352 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:29:49.027212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-94d71113-deea-42e8-bf95-625326e80352 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '536aa7b494a74a66815b2f79c0c67fa8'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:29:49.027879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-94d71113-deea-42e8-bf95-625326e80352 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '536aa7b494a74a66815b2f79c0c67fa8'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:29:49.028498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-94d71113-deea-42e8-bf95-625326e80352 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '536aa7b494a74a66815b2f79c0c67fa8'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:29:49.037173 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-94d71113-deea-42e8-bf95-625326e80352 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '536aa7b494a74a66815b2f79c0c67fa8'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:29:49.051090 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-94d71113-deea-42e8-bf95-625326e80352 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '536aa7b494a74a66815b2f79c0c67fa8'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:29:49.064291 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3821/7697] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:29:48 2022] DELETE /identity/v3/users/536aa7b494a74a66815b2f79c0c67fa8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:29:49.068622 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a677168-8c62-4c43-acf9-0904fbeffe5a None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:29:49.069147 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a677168-8c62-4c43-acf9-0904fbeffe5a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:29:49.069315 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a677168-8c62-4c43-acf9-0904fbeffe5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:29:49.092463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-8a677168-8c62-4c43-acf9-0904fbeffe5a None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:29:49.093908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8a677168-8c62-4c43-acf9-0904fbeffe5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:29:49.161117 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3877/7698] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:29:49.171074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d71113-deea-42e8-bf95-625326e80352 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:29:49.173323 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-94d71113-deea-42e8-bf95-625326e80352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:29:49.251626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d71113-deea-42e8-bf95-625326e80352 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:29:49.255422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bfab2-a547-4ae5-9a13-501846656968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:29:49.256033 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bfab2-a547-4ae5-9a13-501846656968 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:29:49.256316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bfab2-a547-4ae5-9a13-501846656968 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:29:49.256595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bfab2-a547-4ae5-9a13-501846656968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:29:49.265934 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bfab2-a547-4ae5-9a13-501846656968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:29:49.267478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bfab2-a547-4ae5-9a13-501846656968 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:29:49.277094 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3822/7699] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:29:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:29:49.568601 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a677168-8c62-4c43-acf9-0904fbeffe5a None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:29:49.570071 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8a677168-8c62-4c43-acf9-0904fbeffe5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:29:49.594014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a677168-8c62-4c43-acf9-0904fbeffe5a None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:29:49.600389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104e3c3-87f4-4e0c-b315-70f7cfe6b2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:29:49.601371 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104e3c3-87f4-4e0c-b315-70f7cfe6b2a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:29:49.601680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104e3c3-87f4-4e0c-b315-70f7cfe6b2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:29:49.601985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104e3c3-87f4-4e0c-b315-70f7cfe6b2a5 admin admin] PATH_INFO: `/v3/projects/32fb2e2bfbe9496b99eb91a3389b780e` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:29:49.603224 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104e3c3-87f4-4e0c-b315-70f7cfe6b2a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32fb2e2bfbe9496b99eb91a3389b780e)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:29:49.605477 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104e3c3-87f4-4e0c-b315-70f7cfe6b2a5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:29:49.655255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2104e3c3-87f4-4e0c-b315-70f7cfe6b2a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32fb2e2bfbe9496b99eb91a3389b780e', 'request_id': 'req-2104e3c3-87f4-4e0c-b315-70f7cfe6b2a5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:29:49.662310 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2104e3c3-87f4-4e0c-b315-70f7cfe6b2a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32fb2e2bfbe9496b99eb91a3389b780e', 'request_id': 'req-2104e3c3-87f4-4e0c-b315-70f7cfe6b2a5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:29:49.674416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2104e3c3-87f4-4e0c-b315-70f7cfe6b2a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32fb2e2bfbe9496b99eb91a3389b780e', 'request_id': 'req-2104e3c3-87f4-4e0c-b315-70f7cfe6b2a5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:29:49.690626 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2104e3c3-87f4-4e0c-b315-70f7cfe6b2a5 admin admin] The token cache is being invalidate because project 32fb2e2bfbe9496b99eb91a3389b780e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:29:49.690919 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2104e3c3-87f4-4e0c-b315-70f7cfe6b2a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:29:49.691586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2104e3c3-87f4-4e0c-b315-70f7cfe6b2a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:29:49.693593 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3878/7700] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:29:49 2022] DELETE /identity/v3/projects/32fb2e2bfbe9496b99eb91a3389b780e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:29:49.701068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519d7d9-036d-4939-9832-d7812b27235c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:29:49.701357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519d7d9-036d-4939-9832-d7812b27235c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:29:49.701637 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519d7d9-036d-4939-9832-d7812b27235c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:29:49.713196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:29:49.727133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f519d7d9-036d-4939-9832-d7812b27235c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:29:49.729213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f519d7d9-036d-4939-9832-d7812b27235c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:29:49.793645 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3823/7701] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:29:49.803016 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796da574-d3c0-4d42-b611-ae3e65775fc7 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:29:49.803372 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796da574-d3c0-4d42-b611-ae3e65775fc7 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:29:49.803983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796da574-d3c0-4d42-b611-ae3e65775fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:29:49.824062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-796da574-d3c0-4d42-b611-ae3e65775fc7 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:29:49.825366 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-796da574-d3c0-4d42-b611-ae3e65775fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:29:49.834351 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3879/7702] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:29:49.838907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519d7d9-036d-4939-9832-d7812b27235c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:29:49.849182 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519d7d9-036d-4939-9832-d7812b27235c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:29:49.854137 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059067f-360f-4227-a4eb-1cdaa81b4df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:29:49.854795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059067f-360f-4227-a4eb-1cdaa81b4df0 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:29:49.855083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059067f-360f-4227-a4eb-1cdaa81b4df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:29:49.855360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059067f-360f-4227-a4eb-1cdaa81b4df0 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:29:49.856018 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059067f-360f-4227-a4eb-1cdaa81b4df0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:29:49.856325 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059067f-360f-4227-a4eb-1cdaa81b4df0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:29:49.857936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059067f-360f-4227-a4eb-1cdaa81b4df0 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:29:49.873925 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3824/7703] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:29:49.876341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796da574-d3c0-4d42-b611-ae3e65775fc7 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:29:49.885392 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796da574-d3c0-4d42-b611-ae3e65775fc7 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:29:49.890151 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a1a314-c191-4751-b46c-1ee8dc7d58fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:29:49.890784 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1a314-c191-4751-b46c-1ee8dc7d58fe admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:29:49.891122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1a314-c191-4751-b46c-1ee8dc7d58fe admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:29:49.891450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1a314-c191-4751-b46c-1ee8dc7d58fe admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:29:49.892089 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a1a314-c191-4751-b46c-1ee8dc7d58fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:29:49.893904 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a1a314-c191-4751-b46c-1ee8dc7d58fe admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:29:49.944167 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3880/7704] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:29:49 2022] POST /identity/v3/projects => generated 375 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:29:49.945372 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059067f-360f-4227-a4eb-1cdaa81b4df0 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:29:49.956277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059067f-360f-4227-a4eb-1cdaa81b4df0 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:29:49.965633 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd524adb-01fe-4500-be93-cacaddae1dc2 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:29:49.966206 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd524adb-01fe-4500-be93-cacaddae1dc2 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:29:49.967117 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd524adb-01fe-4500-be93-cacaddae1dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:29:49.990930 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-bd524adb-01fe-4500-be93-cacaddae1dc2 None None] MFA Rules not processed for user `28aa42b542db43a1bf3d1d21d687b95b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:29:49.992158 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-bd524adb-01fe-4500-be93-cacaddae1dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:29:50.021086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856125b3-cb0d-4644-955b-7bdbf475e37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:29:50.021779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856125b3-cb0d-4644-955b-7bdbf475e37c admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:29:50.022194 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856125b3-cb0d-4644-955b-7bdbf475e37c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:29:50.022531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856125b3-cb0d-4644-955b-7bdbf475e37c admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:29:50.023180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856125b3-cb0d-4644-955b-7bdbf475e37c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:29:50.025193 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856125b3-cb0d-4644-955b-7bdbf475e37c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:29:50.032759 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:29:50.048975 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3825/7705] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:29:49 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:29:50.053057 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3881/7706] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:29:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:29:50.053193 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856125b3-cb0d-4644-955b-7bdbf475e37c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:29:50.063379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856125b3-cb0d-4644-955b-7bdbf475e37c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:29:50.068323 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc41984-ceb0-4fce-849d-3dc294d62cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:29:50.068944 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc41984-ceb0-4fce-849d-3dc294d62cae admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:29:50.069222 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc41984-ceb0-4fce-849d-3dc294d62cae admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:29:50.069492 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc41984-ceb0-4fce-849d-3dc294d62cae admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:29:50.070125 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc41984-ceb0-4fce-849d-3dc294d62cae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:29:50.071744 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc41984-ceb0-4fce-849d-3dc294d62cae admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:29:50.083643 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3826/7707] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:29:50.088097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd524adb-01fe-4500-be93-cacaddae1dc2 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:29:50.101379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd524adb-01fe-4500-be93-cacaddae1dc2 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:29:50.106184 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9e443-08a7-49b7-997f-0de46e90bbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:29:50.106892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9e443-08a7-49b7-997f-0de46e90bbb9 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:29:50.107190 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9e443-08a7-49b7-997f-0de46e90bbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:29:50.107442 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9e443-08a7-49b7-997f-0de46e90bbb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:29:50.108099 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d9e443-08a7-49b7-997f-0de46e90bbb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:29:50.111139 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d9e443-08a7-49b7-997f-0de46e90bbb9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:29:50.122589 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3882/7708] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:29:50.125690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc41984-ceb0-4fce-849d-3dc294d62cae admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:29:50.135723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc41984-ceb0-4fce-849d-3dc294d62cae admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:29:50.140878 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95bf4e3-92b0-400e-8482-058aa5f46804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:29:50.141881 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bf4e3-92b0-400e-8482-058aa5f46804 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:29:50.142163 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bf4e3-92b0-400e-8482-058aa5f46804 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:29:50.142432 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bf4e3-92b0-400e-8482-058aa5f46804 admin admin] PATH_INFO: `/v3/projects/e498ab168dde414db5130cbc6d21e325/users/896f039a62824d5bb1123d4694208aea/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:29:50.158837 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95bf4e3-92b0-400e-8482-058aa5f46804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e498ab168dde414db5130cbc6d21e325, user_id=896f039a62824d5bb1123d4694208aea, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:29:50.161784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95bf4e3-92b0-400e-8482-058aa5f46804 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:29:50.176625 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3827/7709] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:29:50 2022] PUT /identity/v3/projects/e498ab168dde414db5130cbc6d21e325/users/896f039a62824d5bb1123d4694208aea/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:29:50.187145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904755cf-349e-438b-a61a-67dc90043a71 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:29:50.187437 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904755cf-349e-438b-a61a-67dc90043a71 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:29:50.187716 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904755cf-349e-438b-a61a-67dc90043a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:29:50.216812 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-904755cf-349e-438b-a61a-67dc90043a71 None None] MFA Rules not processed for user `896f039a62824d5bb1123d4694208aea`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:29:50.218047 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-904755cf-349e-438b-a61a-67dc90043a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:29:50.286432 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3883/7710] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:29:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:29:50.292279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95bf4e3-92b0-400e-8482-058aa5f46804 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:29:50.342472 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:29:50.359981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95bf4e3-92b0-400e-8482-058aa5f46804 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:29:50.364939 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe9bc8-bee4-40c2-add8-98f7e730095e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:29:50.365550 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe9bc8-bee4-40c2-add8-98f7e730095e admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:29:50.365834 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe9bc8-bee4-40c2-add8-98f7e730095e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:29:50.366108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe9bc8-bee4-40c2-add8-98f7e730095e admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:29:50.366786 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe9bc8-bee4-40c2-add8-98f7e730095e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:29:50.368692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe9bc8-bee4-40c2-add8-98f7e730095e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:29:50.380420 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904755cf-349e-438b-a61a-67dc90043a71 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:29:50.381821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-904755cf-349e-438b-a61a-67dc90043a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:29:50.395278 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3828/7711] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:29:50 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:29:50.399262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe9bc8-bee4-40c2-add8-98f7e730095e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:29:50.444578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904755cf-349e-438b-a61a-67dc90043a71 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:29:50.464595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe9bc8-bee4-40c2-add8-98f7e730095e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:29:50.469423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff05c5a-be78-4c6c-bbfc-78c45e180e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:29:50.470029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff05c5a-be78-4c6c-bbfc-78c45e180e8c admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:29:50.470303 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff05c5a-be78-4c6c-bbfc-78c45e180e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:29:50.471253 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff05c5a-be78-4c6c-bbfc-78c45e180e8c admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:29:50.471875 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff05c5a-be78-4c6c-bbfc-78c45e180e8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:29:50.473788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff05c5a-be78-4c6c-bbfc-78c45e180e8c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:29:50.496576 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c5b09-4477-478e-9792-dd1eb492436a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:29:50.496799 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3829/7712] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:29:50 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:29:50.497112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c5b09-4477-478e-9792-dd1eb492436a service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:29:50.497483 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c5b09-4477-478e-9792-dd1eb492436a service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:29:50.497817 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c5b09-4477-478e-9792-dd1eb492436a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:29:50.499748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-694c5b09-4477-478e-9792-dd1eb492436a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:29:50.500386 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff05c5a-be78-4c6c-bbfc-78c45e180e8c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:29:50.511121 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff05c5a-be78-4c6c-bbfc-78c45e180e8c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:29:50.511947 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694c5b09-4477-478e-9792-dd1eb492436a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:29:50.513282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694c5b09-4477-478e-9792-dd1eb492436a service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:29:50.516077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edceeadc-4dd2-4772-bac1-2c498d4d0369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:29:50.517038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edceeadc-4dd2-4772-bac1-2c498d4d0369 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:29:50.517356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edceeadc-4dd2-4772-bac1-2c498d4d0369 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:29:50.517639 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edceeadc-4dd2-4772-bac1-2c498d4d0369 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:29:50.518308 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edceeadc-4dd2-4772-bac1-2c498d4d0369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:29:50.520000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edceeadc-4dd2-4772-bac1-2c498d4d0369 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:29:50.523652 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3884/7713] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:29:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:29:50.530853 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3830/7714] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:29:50.535423 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c5b09-4477-478e-9792-dd1eb492436a service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:29:50.546960 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c5b09-4477-478e-9792-dd1eb492436a service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:29:50.552100 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a8cfd-c317-4a62-a1fb-8fb43c2d7b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:29:50.552867 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a8cfd-c317-4a62-a1fb-8fb43c2d7b21 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:29:50.553147 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a8cfd-c317-4a62-a1fb-8fb43c2d7b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:29:50.553535 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a8cfd-c317-4a62-a1fb-8fb43c2d7b21 admin admin] PATH_INFO: `/v3/projects/d07859febc0a4b27aa5059b19fe1e963/users/72031a82dfa04628b81cefdb9e17eace/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:29:50.568668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1a8cfd-c317-4a62-a1fb-8fb43c2d7b21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d07859febc0a4b27aa5059b19fe1e963, user_id=72031a82dfa04628b81cefdb9e17eace, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:29:50.571565 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1a8cfd-c317-4a62-a1fb-8fb43c2d7b21 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:29:50.583174 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:29:50.589569 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3885/7715] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:29:50 2022] PUT /identity/v3/projects/d07859febc0a4b27aa5059b19fe1e963/users/72031a82dfa04628b81cefdb9e17eace/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:29:50.593546 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edceeadc-4dd2-4772-bac1-2c498d4d0369 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:29:50.604152 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edceeadc-4dd2-4772-bac1-2c498d4d0369 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:29:50.664908 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee97b9-0aa6-4047-bc7b-8be3efcf9416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:29:50.665628 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee97b9-0aa6-4047-bc7b-8be3efcf9416 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:29:50.665979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee97b9-0aa6-4047-bc7b-8be3efcf9416 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:29:50.666321 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee97b9-0aa6-4047-bc7b-8be3efcf9416 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:29:50.667072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee97b9-0aa6-4047-bc7b-8be3efcf9416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:29:50.668760 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee97b9-0aa6-4047-bc7b-8be3efcf9416 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:29:50.680596 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3831/7716] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:29:50.684834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a8cfd-c317-4a62-a1fb-8fb43c2d7b21 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:29:50.695697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a8cfd-c317-4a62-a1fb-8fb43c2d7b21 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:29:50.700678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0780a-c142-4144-a0b9-947770bb767a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:29:50.701338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0780a-c142-4144-a0b9-947770bb767a admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:29:50.701617 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0780a-c142-4144-a0b9-947770bb767a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:29:50.701887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0780a-c142-4144-a0b9-947770bb767a admin admin] PATH_INFO: `/v3/projects/d07859febc0a4b27aa5059b19fe1e963/users/72031a82dfa04628b81cefdb9e17eace/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:29:50.704159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a0780a-c142-4144-a0b9-947770bb767a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d07859febc0a4b27aa5059b19fe1e963, user_id=72031a82dfa04628b81cefdb9e17eace, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:29:50.707212 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a0780a-c142-4144-a0b9-947770bb767a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:29:50.718452 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3886/7717] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:29:50 2022] PUT /identity/v3/projects/d07859febc0a4b27aa5059b19fe1e963/users/72031a82dfa04628b81cefdb9e17eace/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:29:50.731231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ca701-a5e9-47e3-a00d-3ad4a6fb472b None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:29:50.731570 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ca701-a5e9-47e3-a00d-3ad4a6fb472b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:29:50.732013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ca701-a5e9-47e3-a00d-3ad4a6fb472b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:29:50.764581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-4a6ca701-a5e9-47e3-a00d-3ad4a6fb472b None None] MFA Rules not processed for user `72031a82dfa04628b81cefdb9e17eace`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:29:50.765788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4a6ca701-a5e9-47e3-a00d-3ad4a6fb472b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:29:50.802254 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:29:50.841515 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3832/7718] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:29:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:29:50.852813 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0780a-c142-4144-a0b9-947770bb767a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:29:50.854843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d1a0780a-c142-4144-a0b9-947770bb767a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:29:50.883936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ca701-a5e9-47e3-a00d-3ad4a6fb472b None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:29:50.885276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4a6ca701-a5e9-47e3-a00d-3ad4a6fb472b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:29:50.945690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0780a-c142-4144-a0b9-947770bb767a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:29:50.949406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c4ec2-bef6-42cb-a2aa-4879930b707a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:29:50.950012 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c4ec2-bef6-42cb-a2aa-4879930b707a service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:29:50.950283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c4ec2-bef6-42cb-a2aa-4879930b707a service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:29:50.950573 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c4ec2-bef6-42cb-a2aa-4879930b707a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:29:50.978051 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ca701-a5e9-47e3-a00d-3ad4a6fb472b None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:29:50.987250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e29ec-f032-47e0-a82b-0a23e11078ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:29:50.987941 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e29ec-f032-47e0-a82b-0a23e11078ab service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:29:50.988293 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e29ec-f032-47e0-a82b-0a23e11078ab service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:29:50.988663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e29ec-f032-47e0-a82b-0a23e11078ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:29:50.990569 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0c3e29ec-f032-47e0-a82b-0a23e11078ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:29:51.005123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e29ec-f032-47e0-a82b-0a23e11078ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:29:51.007166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e29ec-f032-47e0-a82b-0a23e11078ab service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:29:51.017909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c4ec2-bef6-42cb-a2aa-4879930b707a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:29:51.019613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c4ec2-bef6-42cb-a2aa-4879930b707a service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:29:51.026485 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3833/7719] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:29:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:29:51.031390 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3887/7720] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:29:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:29:53.753124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e29ec-f032-47e0-a82b-0a23e11078ab service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:29:53.768724 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e29ec-f032-47e0-a82b-0a23e11078ab service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:29:53.775442 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a026b2-b1d2-4b34-a522-4d2b8d2284d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:29:53.776130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a026b2-b1d2-4b34-a522-4d2b8d2284d6 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:29:53.776480 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a026b2-b1d2-4b34-a522-4d2b8d2284d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:29:53.776828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a026b2-b1d2-4b34-a522-4d2b8d2284d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:29:53.791286 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a026b2-b1d2-4b34-a522-4d2b8d2284d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:29:53.793029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a026b2-b1d2-4b34-a522-4d2b8d2284d6 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:29:53.805107 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3834/7721] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:29:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:29:55.728250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c4ec2-bef6-42cb-a2aa-4879930b707a service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:29:55.743128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c4ec2-bef6-42cb-a2aa-4879930b707a service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:29:55.748015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a1310-2cef-454c-983b-653e7102f246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:29:55.748731 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a1310-2cef-454c-983b-653e7102f246 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:29:55.749099 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a1310-2cef-454c-983b-653e7102f246 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:29:55.749562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a1310-2cef-454c-983b-653e7102f246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:29:55.752389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2c6a1310-2cef-454c-983b-653e7102f246 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:29:55.770414 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a1310-2cef-454c-983b-653e7102f246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:29:55.772208 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a1310-2cef-454c-983b-653e7102f246 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:29:55.785089 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3888/7722] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:29:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:29:58.859690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a026b2-b1d2-4b34-a522-4d2b8d2284d6 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:29:58.861572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-05a026b2-b1d2-4b34-a522-4d2b8d2284d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:29:58.960771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675763c-441b-4cf1-8747-3fa3cbf636d0 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:29:58.960771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675763c-441b-4cf1-8747-3fa3cbf636d0 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:29:58.960771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675763c-441b-4cf1-8747-3fa3cbf636d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:29:58.980291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-9675763c-441b-4cf1-8747-3fa3cbf636d0 None None] MFA Rules not processed for user `896f039a62824d5bb1123d4694208aea`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:29:58.981524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9675763c-441b-4cf1-8747-3fa3cbf636d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:29:58.991366 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3889/7723] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:29:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:29:59.025836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a026b2-b1d2-4b34-a522-4d2b8d2284d6 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:29:59.034173 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83c298-c884-4c06-9849-bfed1bf5665e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:29:59.034827 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83c298-c884-4c06-9849-bfed1bf5665e service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:29:59.035109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83c298-c884-4c06-9849-bfed1bf5665e service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:29:59.035379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83c298-c884-4c06-9849-bfed1bf5665e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:29:59.037448 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6e83c298-c884-4c06-9849-bfed1bf5665e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:29:59.053816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e83c298-c884-4c06-9849-bfed1bf5665e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:29:59.055696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e83c298-c884-4c06-9849-bfed1bf5665e service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:29:59.071814 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3835/7724] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:29:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:30:01.677022 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675763c-441b-4cf1-8747-3fa3cbf636d0 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:30:01.689332 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675763c-441b-4cf1-8747-3fa3cbf636d0 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:30:01.693033 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d155e6a-a665-4553-b1e7-5cda5c63b3c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:30:01.693679 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d155e6a-a665-4553-b1e7-5cda5c63b3c8 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:30:01.693965 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d155e6a-a665-4553-b1e7-5cda5c63b3c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:30:01.694250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d155e6a-a665-4553-b1e7-5cda5c63b3c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:30:01.696067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3d155e6a-a665-4553-b1e7-5cda5c63b3c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:30:01.710746 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d155e6a-a665-4553-b1e7-5cda5c63b3c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:30:01.712383 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d155e6a-a665-4553-b1e7-5cda5c63b3c8 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:30:01.724107 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3890/7725] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:30:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:30:01.879231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83c298-c884-4c06-9849-bfed1bf5665e service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:30:01.893298 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83c298-c884-4c06-9849-bfed1bf5665e service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:30:01.900769 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16437d41-1d2b-4ae1-bc83-a01b3fe02975 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:30:01.901400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16437d41-1d2b-4ae1-bc83-a01b3fe02975 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:30:01.901682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16437d41-1d2b-4ae1-bc83-a01b3fe02975 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:30:01.901959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16437d41-1d2b-4ae1-bc83-a01b3fe02975 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:30:01.903856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-16437d41-1d2b-4ae1-bc83-a01b3fe02975 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:30:01.920189 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16437d41-1d2b-4ae1-bc83-a01b3fe02975 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:30:01.921902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16437d41-1d2b-4ae1-bc83-a01b3fe02975 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:30:01.938660 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3836/7726] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:30:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:30:11.718014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=68,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:30:11.931079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:30:46.863565 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89565ca4-30e7-460e-8500-9f18e1cb46e8 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:30:46.864080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89565ca4-30e7-460e-8500-9f18e1cb46e8 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:30:46.864080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89565ca4-30e7-460e-8500-9f18e1cb46e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:30:46.882768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-89565ca4-30e7-460e-8500-9f18e1cb46e8 None None] MFA Rules not processed for user `896f039a62824d5bb1123d4694208aea`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:30:46.883956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-89565ca4-30e7-460e-8500-9f18e1cb46e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:30:46.890854 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3891/7727] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:30:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:30:47.220565 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16437d41-1d2b-4ae1-bc83-a01b3fe02975 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:30:47.237844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16437d41-1d2b-4ae1-bc83-a01b3fe02975 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:30:47.241688 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caecf411-9ee5-40ab-bb53-14226de4536a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:30:47.242737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecf411-9ee5-40ab-bb53-14226de4536a service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:30:47.243278 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecf411-9ee5-40ab-bb53-14226de4536a service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:30:47.243748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecf411-9ee5-40ab-bb53-14226de4536a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:30:47.246813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-caecf411-9ee5-40ab-bb53-14226de4536a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:30:47.260382 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caecf411-9ee5-40ab-bb53-14226de4536a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:30:47.261951 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caecf411-9ee5-40ab-bb53-14226de4536a service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:30:47.277571 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3837/7728] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:30:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:30:56.877967 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:30:57.267713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:31:25.856260 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89565ca4-30e7-460e-8500-9f18e1cb46e8 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:31:25.872806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89565ca4-30e7-460e-8500-9f18e1cb46e8 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:31:25.883458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ddff1-4624-48d5-a379-ddf9c1595505 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:31:25.884083 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ddff1-4624-48d5-a379-ddf9c1595505 service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:31:25.884362 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ddff1-4624-48d5-a379-ddf9c1595505 service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:31:25.884633 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ddff1-4624-48d5-a379-ddf9c1595505 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:31:25.886390 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-586ddff1-4624-48d5-a379-ddf9c1595505 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:31:25.902530 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586ddff1-4624-48d5-a379-ddf9c1595505 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:31:25.904647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586ddff1-4624-48d5-a379-ddf9c1595505 service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:31:25.921714 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3892/7729] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:31:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:31:35.911739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=6 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:31:39.949953 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59324820-8e7b-4021-b2e1-bc5c27557204 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:31:39.950605 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59324820-8e7b-4021-b2e1-bc5c27557204 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:31:39.950605 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59324820-8e7b-4021-b2e1-bc5c27557204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:31:39.983440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-59324820-8e7b-4021-b2e1-bc5c27557204 None None] MFA Rules not processed for user `896f039a62824d5bb1123d4694208aea`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:31:39.984898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-59324820-8e7b-4021-b2e1-bc5c27557204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:31:40.012053 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3838/7730] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:31:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:31:50.009387 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=15 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:32:09.210013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ddff1-4624-48d5-a379-ddf9c1595505 service placement] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:09.211415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-586ddff1-4624-48d5-a379-ddf9c1595505 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:32:09.293749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ddff1-4624-48d5-a379-ddf9c1595505 service placement] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:09.299555 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81fd8f-7c30-448d-969f-f40feb6761cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:09.300158 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81fd8f-7c30-448d-969f-f40feb6761cd service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:09.300441 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81fd8f-7c30-448d-969f-f40feb6761cd service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:09.300715 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81fd8f-7c30-448d-969f-f40feb6761cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:09.302445 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0d81fd8f-7c30-448d-969f-f40feb6761cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:32:09.316627 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81fd8f-7c30-448d-969f-f40feb6761cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:09.318200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81fd8f-7c30-448d-969f-f40feb6761cd service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:09.330498 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3893/7731] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:32:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:32:09.944771 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59324820-8e7b-4021-b2e1-bc5c27557204 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:09.959402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59324820-8e7b-4021-b2e1-bc5c27557204 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:09.964401 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6f633-2683-4bd5-b47e-c7b3a29e2255 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:09.964996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6f633-2683-4bd5-b47e-c7b3a29e2255 service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:09.965277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6f633-2683-4bd5-b47e-c7b3a29e2255 service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:09.965549 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6f633-2683-4bd5-b47e-c7b3a29e2255 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:09.968276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-19b6f633-2683-4bd5-b47e-c7b3a29e2255 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:32:09.983232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6f633-2683-4bd5-b47e-c7b3a29e2255 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:09.984808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6f633-2683-4bd5-b47e-c7b3a29e2255 service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:09.996271 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3839/7732] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:32:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:32:19.323873 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=33 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:32:19.990447 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:32:26.811916 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81fd8f-7c30-448d-969f-f40feb6761cd service placement] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:26.824204 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81fd8f-7c30-448d-969f-f40feb6761cd service placement] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:26.830530 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d9cef-b030-4131-89e6-f121d1591623 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:26.831159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d9cef-b030-4131-89e6-f121d1591623 service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:26.831439 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d9cef-b030-4131-89e6-f121d1591623 service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:26.831714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d9cef-b030-4131-89e6-f121d1591623 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:26.833449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e88d9cef-b030-4131-89e6-f121d1591623 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:32:26.847562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d9cef-b030-4131-89e6-f121d1591623 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:26.849154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d9cef-b030-4131-89e6-f121d1591623 service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:26.861784 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3894/7733] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:32:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:32:26.899675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6f633-2683-4bd5-b47e-c7b3a29e2255 service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:26.978566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6f633-2683-4bd5-b47e-c7b3a29e2255 service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:26.983642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d39bf-fca6-4f59-b9c6-bd9064749c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:26.984261 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d39bf-fca6-4f59-b9c6-bd9064749c79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:26.984566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d39bf-fca6-4f59-b9c6-bd9064749c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:26.984839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d39bf-fca6-4f59-b9c6-bd9064749c79 admin admin] PATH_INFO: `/v3/users/896f039a62824d5bb1123d4694208aea` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:26.985948 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d39bf-fca6-4f59-b9c6-bd9064749c79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=896f039a62824d5bb1123d4694208aea)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:26.987883 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d39bf-fca6-4f59-b9c6-bd9064749c79 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:27.039225 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a57d39bf-fca6-4f59-b9c6-bd9064749c79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '896f039a62824d5bb1123d4694208aea'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:27.039922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a57d39bf-fca6-4f59-b9c6-bd9064749c79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '896f039a62824d5bb1123d4694208aea'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:27.040588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a57d39bf-fca6-4f59-b9c6-bd9064749c79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '896f039a62824d5bb1123d4694208aea'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:27.048744 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a57d39bf-fca6-4f59-b9c6-bd9064749c79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '896f039a62824d5bb1123d4694208aea'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:27.063852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a57d39bf-fca6-4f59-b9c6-bd9064749c79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '896f039a62824d5bb1123d4694208aea'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:27.075905 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3840/7734] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:32:26 2022] DELETE /identity/v3/users/896f039a62824d5bb1123d4694208aea => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:32:27.080753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8149661-9e1a-4cc3-b8ca-c578e4c6e1e6 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:27.081145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8149661-9e1a-4cc3-b8ca-c578e4c6e1e6 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:27.081543 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8149661-9e1a-4cc3-b8ca-c578e4c6e1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:27.121101 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-c8149661-9e1a-4cc3-b8ca-c578e4c6e1e6 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:32:27.122986 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c8149661-9e1a-4cc3-b8ca-c578e4c6e1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:32:27.183297 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3895/7735] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:32:27.193753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d39bf-fca6-4f59-b9c6-bd9064749c79 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:27.195278 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a57d39bf-fca6-4f59-b9c6-bd9064749c79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:32:27.255750 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d39bf-fca6-4f59-b9c6-bd9064749c79 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:27.259464 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799232c2-690c-4648-b88d-d2b69df81778 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:27.260062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799232c2-690c-4648-b88d-d2b69df81778 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:27.260345 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799232c2-690c-4648-b88d-d2b69df81778 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:27.260621 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799232c2-690c-4648-b88d-d2b69df81778 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:27.270405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799232c2-690c-4648-b88d-d2b69df81778 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:27.271873 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799232c2-690c-4648-b88d-d2b69df81778 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:27.282515 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3841/7736] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:32:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:32:27.458741 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8149661-9e1a-4cc3-b8ca-c578e4c6e1e6 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:27.460199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c8149661-9e1a-4cc3-b8ca-c578e4c6e1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:32:27.472337 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8149661-9e1a-4cc3-b8ca-c578e4c6e1e6 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:27.476942 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d428751-11e5-4460-9784-8f89ef88112b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:27.477570 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d428751-11e5-4460-9784-8f89ef88112b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:27.477870 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d428751-11e5-4460-9784-8f89ef88112b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:27.478144 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d428751-11e5-4460-9784-8f89ef88112b admin admin] PATH_INFO: `/v3/projects/e498ab168dde414db5130cbc6d21e325` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:27.479350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d428751-11e5-4460-9784-8f89ef88112b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e498ab168dde414db5130cbc6d21e325)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:27.481253 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d428751-11e5-4460-9784-8f89ef88112b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:27.530004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9d428751-11e5-4460-9784-8f89ef88112b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e498ab168dde414db5130cbc6d21e325', 'request_id': 'req-9d428751-11e5-4460-9784-8f89ef88112b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:27.535726 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9d428751-11e5-4460-9784-8f89ef88112b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e498ab168dde414db5130cbc6d21e325', 'request_id': 'req-9d428751-11e5-4460-9784-8f89ef88112b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:27.543648 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9d428751-11e5-4460-9784-8f89ef88112b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e498ab168dde414db5130cbc6d21e325', 'request_id': 'req-9d428751-11e5-4460-9784-8f89ef88112b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:27.556239 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9d428751-11e5-4460-9784-8f89ef88112b admin admin] The token cache is being invalidate because project e498ab168dde414db5130cbc6d21e325 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:32:27.556593 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9d428751-11e5-4460-9784-8f89ef88112b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:27.557265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9d428751-11e5-4460-9784-8f89ef88112b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:27.559638 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3896/7737] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:32:27 2022] DELETE /identity/v3/projects/e498ab168dde414db5130cbc6d21e325 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:32:27.564240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799232c2-690c-4648-b88d-d2b69df81778 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:27.574049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799232c2-690c-4648-b88d-d2b69df81778 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:27.587810 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:32:27.639686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e9d5ed-9abf-4436-8816-09eea1ffda08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:27.640324 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9d5ed-9abf-4436-8816-09eea1ffda08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:27.640605 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9d5ed-9abf-4436-8816-09eea1ffda08 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:27.640883 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9d5ed-9abf-4436-8816-09eea1ffda08 admin admin] PATH_INFO: `/v3/users/72031a82dfa04628b81cefdb9e17eace` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:27.642009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e9d5ed-9abf-4436-8816-09eea1ffda08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72031a82dfa04628b81cefdb9e17eace)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:27.643966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e9d5ed-9abf-4436-8816-09eea1ffda08 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:27.692103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-92e9d5ed-9abf-4436-8816-09eea1ffda08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72031a82dfa04628b81cefdb9e17eace'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:27.692760 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-92e9d5ed-9abf-4436-8816-09eea1ffda08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72031a82dfa04628b81cefdb9e17eace'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:27.693369 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-92e9d5ed-9abf-4436-8816-09eea1ffda08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72031a82dfa04628b81cefdb9e17eace'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:27.700792 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-92e9d5ed-9abf-4436-8816-09eea1ffda08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72031a82dfa04628b81cefdb9e17eace'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:27.712749 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-92e9d5ed-9abf-4436-8816-09eea1ffda08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72031a82dfa04628b81cefdb9e17eace'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:27.724990 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3842/7738] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:32:27 2022] DELETE /identity/v3/users/72031a82dfa04628b81cefdb9e17eace => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:32:27.998234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d428751-11e5-4460-9784-8f89ef88112b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:27.999705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9d428751-11e5-4460-9784-8f89ef88112b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:32:28.015215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d428751-11e5-4460-9784-8f89ef88112b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:28.065071 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:32:28.076578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde9dde-941b-42fe-ab00-f45d2bff681b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:28.077166 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde9dde-941b-42fe-ab00-f45d2bff681b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:28.077491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde9dde-941b-42fe-ab00-f45d2bff681b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:28.077975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde9dde-941b-42fe-ab00-f45d2bff681b admin admin] PATH_INFO: `/v3/projects/d07859febc0a4b27aa5059b19fe1e963` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:28.079120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde9dde-941b-42fe-ab00-f45d2bff681b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d07859febc0a4b27aa5059b19fe1e963)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:28.081026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde9dde-941b-42fe-ab00-f45d2bff681b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:28.127312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6fde9dde-941b-42fe-ab00-f45d2bff681b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd07859febc0a4b27aa5059b19fe1e963', 'request_id': 'req-6fde9dde-941b-42fe-ab00-f45d2bff681b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:28.132712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6fde9dde-941b-42fe-ab00-f45d2bff681b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd07859febc0a4b27aa5059b19fe1e963', 'request_id': 'req-6fde9dde-941b-42fe-ab00-f45d2bff681b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:28.140164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6fde9dde-941b-42fe-ab00-f45d2bff681b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd07859febc0a4b27aa5059b19fe1e963', 'request_id': 'req-6fde9dde-941b-42fe-ab00-f45d2bff681b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:28.151250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6fde9dde-941b-42fe-ab00-f45d2bff681b admin admin] The token cache is being invalidate because project d07859febc0a4b27aa5059b19fe1e963 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:32:28.151539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6fde9dde-941b-42fe-ab00-f45d2bff681b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:28.152971 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6fde9dde-941b-42fe-ab00-f45d2bff681b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:28.154639 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3897/7739] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:32:27 2022] DELETE /identity/v3/projects/d07859febc0a4b27aa5059b19fe1e963 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:32:28.159747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc00633-a157-4efb-afbb-84dea9b30c18 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:28.160226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc00633-a157-4efb-afbb-84dea9b30c18 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:28.160346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc00633-a157-4efb-afbb-84dea9b30c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:28.208737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-0cc00633-a157-4efb-afbb-84dea9b30c18 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:32:28.209991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0cc00633-a157-4efb-afbb-84dea9b30c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:32:28.275803 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3843/7740] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:32:28.284138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78e3d6-05f4-4948-9902-1a442103dbc8 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:28.284428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78e3d6-05f4-4948-9902-1a442103dbc8 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:28.284707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78e3d6-05f4-4948-9902-1a442103dbc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:28.304919 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-9a78e3d6-05f4-4948-9902-1a442103dbc8 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:32:28.306122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9a78e3d6-05f4-4948-9902-1a442103dbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:32:28.314916 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3898/7741] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:32:28.319210 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc00633-a157-4efb-afbb-84dea9b30c18 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:28.329517 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc00633-a157-4efb-afbb-84dea9b30c18 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:28.333972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430d7ce-423c-4abf-97d0-8cb45782efda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:28.334614 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430d7ce-423c-4abf-97d0-8cb45782efda admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:28.334894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430d7ce-423c-4abf-97d0-8cb45782efda admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:28.335166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430d7ce-423c-4abf-97d0-8cb45782efda admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:28.335801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430d7ce-423c-4abf-97d0-8cb45782efda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:32:28.336100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430d7ce-423c-4abf-97d0-8cb45782efda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:28.337690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430d7ce-423c-4abf-97d0-8cb45782efda admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:28.340115 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:32:28.351828 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3844/7742] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:32:28.356247 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a78e3d6-05f4-4948-9902-1a442103dbc8 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:28.365624 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a78e3d6-05f4-4948-9902-1a442103dbc8 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:28.370320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdefbdf-96ee-440c-9fc1-5d0abfa72f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:28.370947 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdefbdf-96ee-440c-9fc1-5d0abfa72f66 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:28.371860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdefbdf-96ee-440c-9fc1-5d0abfa72f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:28.371860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdefbdf-96ee-440c-9fc1-5d0abfa72f66 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:28.372712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdefbdf-96ee-440c-9fc1-5d0abfa72f66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:28.374639 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdefbdf-96ee-440c-9fc1-5d0abfa72f66 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:28.403287 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3899/7743] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:32:28 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:32:28.407456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430d7ce-423c-4abf-97d0-8cb45782efda admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:28.417696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430d7ce-423c-4abf-97d0-8cb45782efda admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:28.475056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c250358-a07a-4a35-9fa5-b6f3be3f6448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:28.475661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c250358-a07a-4a35-9fa5-b6f3be3f6448 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:28.475945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c250358-a07a-4a35-9fa5-b6f3be3f6448 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:28.476219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c250358-a07a-4a35-9fa5-b6f3be3f6448 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:28.476868 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c250358-a07a-4a35-9fa5-b6f3be3f6448 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:28.478812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c250358-a07a-4a35-9fa5-b6f3be3f6448 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:28.502661 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3845/7744] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:32:28 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:32:28.504249 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdefbdf-96ee-440c-9fc1-5d0abfa72f66 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:28.515328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdefbdf-96ee-440c-9fc1-5d0abfa72f66 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:28.520067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52471a-ac11-4b8a-923a-1421e4824eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:28.520670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52471a-ac11-4b8a-923a-1421e4824eed admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:28.520957 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52471a-ac11-4b8a-923a-1421e4824eed admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:28.521235 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52471a-ac11-4b8a-923a-1421e4824eed admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:28.521875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52471a-ac11-4b8a-923a-1421e4824eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:28.523497 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52471a-ac11-4b8a-923a-1421e4824eed admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:28.534194 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3900/7745] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:32:28.538098 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c250358-a07a-4a35-9fa5-b6f3be3f6448 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:28.548992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c250358-a07a-4a35-9fa5-b6f3be3f6448 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:28.553805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139eb236-04c9-4a28-ba31-432f8206beef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:28.554400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139eb236-04c9-4a28-ba31-432f8206beef admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:28.554720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139eb236-04c9-4a28-ba31-432f8206beef admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:28.554982 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139eb236-04c9-4a28-ba31-432f8206beef admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:28.555617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139eb236-04c9-4a28-ba31-432f8206beef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:28.557193 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139eb236-04c9-4a28-ba31-432f8206beef admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:28.567375 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3846/7746] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:32:28.571462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52471a-ac11-4b8a-923a-1421e4824eed admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:28.582112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52471a-ac11-4b8a-923a-1421e4824eed admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:28.586725 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8bc6c-ecad-4658-a2b9-7017fd66218b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:28.587371 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8bc6c-ecad-4658-a2b9-7017fd66218b admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:28.587655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8bc6c-ecad-4658-a2b9-7017fd66218b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:28.587936 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8bc6c-ecad-4658-a2b9-7017fd66218b admin admin] PATH_INFO: `/v3/projects/baa08dd027704914ae33802b0449a868/users/55173e0fdca04e8eb645c538ed467cfc/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:28.602850 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c8bc6c-ecad-4658-a2b9-7017fd66218b admin admin] RBAC: Authorizing `identity:create_grant(project_id=baa08dd027704914ae33802b0449a868, user_id=55173e0fdca04e8eb645c538ed467cfc, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:28.606078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c8bc6c-ecad-4658-a2b9-7017fd66218b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:28.619017 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3901/7747] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:32:28 2022] PUT /identity/v3/projects/baa08dd027704914ae33802b0449a868/users/55173e0fdca04e8eb645c538ed467cfc/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:32:28.631174 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1be04-fa2f-4489-8401-5f1e31b8f007 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:28.631461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1be04-fa2f-4489-8401-5f1e31b8f007 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:28.631734 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1be04-fa2f-4489-8401-5f1e31b8f007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:28.660055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-40d1be04-fa2f-4489-8401-5f1e31b8f007 None None] MFA Rules not processed for user `55173e0fdca04e8eb645c538ed467cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:32:28.661245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-40d1be04-fa2f-4489-8401-5f1e31b8f007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:32:28.731324 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3847/7748] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:32:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:32:28.736143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8bc6c-ecad-4658-a2b9-7017fd66218b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:28.801093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8bc6c-ecad-4658-a2b9-7017fd66218b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:28.805755 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6a81c-bd38-4fef-9f17-bdf203d1edb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:28.806353 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6a81c-bd38-4fef-9f17-bdf203d1edb1 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:28.806664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6a81c-bd38-4fef-9f17-bdf203d1edb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:28.806935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6a81c-bd38-4fef-9f17-bdf203d1edb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:28.807550 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6a81c-bd38-4fef-9f17-bdf203d1edb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:28.809705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6a81c-bd38-4fef-9f17-bdf203d1edb1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:28.836176 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3902/7749] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:32:28 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:32:28.840659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1be04-fa2f-4489-8401-5f1e31b8f007 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:28.851732 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1be04-fa2f-4489-8401-5f1e31b8f007 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:28.908608 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfda52-5397-4932-88b7-f10a7516b753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:28.909219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfda52-5397-4932-88b7-f10a7516b753 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:28.909499 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfda52-5397-4932-88b7-f10a7516b753 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:28.909772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfda52-5397-4932-88b7-f10a7516b753 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:28.910391 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cfda52-5397-4932-88b7-f10a7516b753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:28.912350 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cfda52-5397-4932-88b7-f10a7516b753 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:28.923181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:32:28.935037 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3848/7750] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:32:28 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:32:28.939183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6a81c-bd38-4fef-9f17-bdf203d1edb1 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:28.945849 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:32:28.950512 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6a81c-bd38-4fef-9f17-bdf203d1edb1 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:28.957286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367c4be-e6a7-45fb-b835-3b06961c8576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:28.957921 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367c4be-e6a7-45fb-b835-3b06961c8576 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:28.958319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367c4be-e6a7-45fb-b835-3b06961c8576 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:28.958860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367c4be-e6a7-45fb-b835-3b06961c8576 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:28.959704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f367c4be-e6a7-45fb-b835-3b06961c8576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:28.961403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f367c4be-e6a7-45fb-b835-3b06961c8576 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:28.973257 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3903/7751] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:32:28.977435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfda52-5397-4932-88b7-f10a7516b753 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:28.988224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfda52-5397-4932-88b7-f10a7516b753 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:28.992842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166081b-0d55-4c28-9685-49600bb3a6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:28.993478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166081b-0d55-4c28-9685-49600bb3a6af admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:28.993754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166081b-0d55-4c28-9685-49600bb3a6af admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:28.994029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166081b-0d55-4c28-9685-49600bb3a6af admin admin] PATH_INFO: `/v3/projects/fbb823b230ea45b2aeccb9ff061ce696/users/032a77b5e7d54de2aea3f5da93a6e0f5/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:29.008589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e166081b-0d55-4c28-9685-49600bb3a6af admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbb823b230ea45b2aeccb9ff061ce696, user_id=032a77b5e7d54de2aea3f5da93a6e0f5, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:29.011273 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e166081b-0d55-4c28-9685-49600bb3a6af admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:29.024336 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3849/7752] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:32:28 2022] PUT /identity/v3/projects/fbb823b230ea45b2aeccb9ff061ce696/users/032a77b5e7d54de2aea3f5da93a6e0f5/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:32:29.035309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79911bf9-f7e1-4c77-951b-09ebf0cef9d5 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:29.035840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79911bf9-f7e1-4c77-951b-09ebf0cef9d5 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:29.035964 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79911bf9-f7e1-4c77-951b-09ebf0cef9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:29.064480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-79911bf9-f7e1-4c77-951b-09ebf0cef9d5 None None] MFA Rules not processed for user `032a77b5e7d54de2aea3f5da93a6e0f5`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:32:29.065675 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-79911bf9-f7e1-4c77-951b-09ebf0cef9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:32:29.131002 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3904/7753] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:32:29 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:32:29.159887 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166081b-0d55-4c28-9685-49600bb3a6af admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:29.161620 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e166081b-0d55-4c28-9685-49600bb3a6af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:32:29.252136 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166081b-0d55-4c28-9685-49600bb3a6af admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:29.257673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78f8c8-1531-4836-a578-504a86ad5a7c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:29.258272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78f8c8-1531-4836-a578-504a86ad5a7c service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:29.258563 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78f8c8-1531-4836-a578-504a86ad5a7c service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:29.258849 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78f8c8-1531-4836-a578-504a86ad5a7c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:29.267132 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78f8c8-1531-4836-a578-504a86ad5a7c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:29.268704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78f8c8-1531-4836-a578-504a86ad5a7c service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:29.276692 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3850/7754] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:32:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 678 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:32:29.843550 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79911bf9-f7e1-4c77-951b-09ebf0cef9d5 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:29.907368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79911bf9-f7e1-4c77-951b-09ebf0cef9d5 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:29.912073 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99ea8b-bcbc-402c-b3d8-8a1953b1d10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:29.912674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99ea8b-bcbc-402c-b3d8-8a1953b1d10e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:29.912951 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99ea8b-bcbc-402c-b3d8-8a1953b1d10e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:29.913220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99ea8b-bcbc-402c-b3d8-8a1953b1d10e admin admin] PATH_INFO: `/v3/users/55173e0fdca04e8eb645c538ed467cfc` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:29.914316 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99ea8b-bcbc-402c-b3d8-8a1953b1d10e admin admin] RBAC: Authorizing `identity:delete_user(user_id=55173e0fdca04e8eb645c538ed467cfc)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:29.916250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99ea8b-bcbc-402c-b3d8-8a1953b1d10e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:29.961633 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2b99ea8b-bcbc-402c-b3d8-8a1953b1d10e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55173e0fdca04e8eb645c538ed467cfc'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:29.968385 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2b99ea8b-bcbc-402c-b3d8-8a1953b1d10e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55173e0fdca04e8eb645c538ed467cfc'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:29.969043 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2b99ea8b-bcbc-402c-b3d8-8a1953b1d10e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55173e0fdca04e8eb645c538ed467cfc'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:29.969655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2b99ea8b-bcbc-402c-b3d8-8a1953b1d10e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55173e0fdca04e8eb645c538ed467cfc'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:29.976253 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2b99ea8b-bcbc-402c-b3d8-8a1953b1d10e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55173e0fdca04e8eb645c538ed467cfc'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:29.993763 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3905/7755] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:32:29 2022] DELETE /identity/v3/users/55173e0fdca04e8eb645c538ed467cfc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:32:29.998944 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965f804-fc4a-4abf-b929-58eea3c25d67 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:29.999228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965f804-fc4a-4abf-b929-58eea3c25d67 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:29.999499 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965f804-fc4a-4abf-b929-58eea3c25d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:30.018070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-e965f804-fc4a-4abf-b929-58eea3c25d67 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:32:30.019299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e965f804-fc4a-4abf-b929-58eea3c25d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:32:30.077639 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3851/7756] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:32:30.087400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99ea8b-bcbc-402c-b3d8-8a1953b1d10e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:30.088898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2b99ea8b-bcbc-402c-b3d8-8a1953b1d10e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:32:30.094318 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:32:30.153875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99ea8b-bcbc-402c-b3d8-8a1953b1d10e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:30.158051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59023a-3fea-4350-aa92-7cae973fcdbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:30.158658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59023a-3fea-4350-aa92-7cae973fcdbb service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:30.158943 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59023a-3fea-4350-aa92-7cae973fcdbb service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:30.159217 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59023a-3fea-4350-aa92-7cae973fcdbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:30.169105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59023a-3fea-4350-aa92-7cae973fcdbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:30.170529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59023a-3fea-4350-aa92-7cae973fcdbb service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:30.179975 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3906/7757] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:32:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:32:30.456277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965f804-fc4a-4abf-b929-58eea3c25d67 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:30.458132 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e965f804-fc4a-4abf-b929-58eea3c25d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:32:30.473349 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965f804-fc4a-4abf-b929-58eea3c25d67 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:30.478610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f264d5d-3120-48bb-a888-2bb0ce2afafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:30.479432 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f264d5d-3120-48bb-a888-2bb0ce2afafc admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:30.479722 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f264d5d-3120-48bb-a888-2bb0ce2afafc admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:30.479996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f264d5d-3120-48bb-a888-2bb0ce2afafc admin admin] PATH_INFO: `/v3/projects/baa08dd027704914ae33802b0449a868` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:30.481935 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f264d5d-3120-48bb-a888-2bb0ce2afafc admin admin] RBAC: Authorizing `identity:delete_project(project_id=baa08dd027704914ae33802b0449a868)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:30.483891 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f264d5d-3120-48bb-a888-2bb0ce2afafc admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:30.521525 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:INSERT=2,keystone:SELECT=96,keystone:DELETE=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:32:30.534190 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3f264d5d-3120-48bb-a888-2bb0ce2afafc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baa08dd027704914ae33802b0449a868', 'request_id': 'req-3f264d5d-3120-48bb-a888-2bb0ce2afafc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:30.539756 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3f264d5d-3120-48bb-a888-2bb0ce2afafc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baa08dd027704914ae33802b0449a868', 'request_id': 'req-3f264d5d-3120-48bb-a888-2bb0ce2afafc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:30.546412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3f264d5d-3120-48bb-a888-2bb0ce2afafc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baa08dd027704914ae33802b0449a868', 'request_id': 'req-3f264d5d-3120-48bb-a888-2bb0ce2afafc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:30.558468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3f264d5d-3120-48bb-a888-2bb0ce2afafc admin admin] The token cache is being invalidate because project baa08dd027704914ae33802b0449a868 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:32:30.558942 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3f264d5d-3120-48bb-a888-2bb0ce2afafc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:30.559582 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3f264d5d-3120-48bb-a888-2bb0ce2afafc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:30.561113 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3852/7758] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:32:30 2022] DELETE /identity/v3/projects/baa08dd027704914ae33802b0449a868 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:32:30.565111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59023a-3fea-4350-aa92-7cae973fcdbb service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:30.575237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59023a-3fea-4350-aa92-7cae973fcdbb service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:30.631482 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd18a50-4ac6-4031-80d2-5cedaf71ae26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:30.632112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd18a50-4ac6-4031-80d2-5cedaf71ae26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:30.632397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd18a50-4ac6-4031-80d2-5cedaf71ae26 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:30.632673 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd18a50-4ac6-4031-80d2-5cedaf71ae26 admin admin] PATH_INFO: `/v3/users/032a77b5e7d54de2aea3f5da93a6e0f5` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:30.633784 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd18a50-4ac6-4031-80d2-5cedaf71ae26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=032a77b5e7d54de2aea3f5da93a6e0f5)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:30.635751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd18a50-4ac6-4031-80d2-5cedaf71ae26 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:30.687347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8fd18a50-4ac6-4031-80d2-5cedaf71ae26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '032a77b5e7d54de2aea3f5da93a6e0f5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:30.694165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8fd18a50-4ac6-4031-80d2-5cedaf71ae26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '032a77b5e7d54de2aea3f5da93a6e0f5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:30.694851 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8fd18a50-4ac6-4031-80d2-5cedaf71ae26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '032a77b5e7d54de2aea3f5da93a6e0f5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:30.695469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8fd18a50-4ac6-4031-80d2-5cedaf71ae26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '032a77b5e7d54de2aea3f5da93a6e0f5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:30.703639 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8fd18a50-4ac6-4031-80d2-5cedaf71ae26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '032a77b5e7d54de2aea3f5da93a6e0f5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:30.721530 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3907/7759] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:32:30 2022] DELETE /identity/v3/users/032a77b5e7d54de2aea3f5da93a6e0f5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:32:30.995757 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f264d5d-3120-48bb-a888-2bb0ce2afafc admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:30.997262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3f264d5d-3120-48bb-a888-2bb0ce2afafc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:32:31.012022 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f264d5d-3120-48bb-a888-2bb0ce2afafc admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:31.072294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2707d4-7e80-4f4e-875f-40da131ad303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:31.072922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2707d4-7e80-4f4e-875f-40da131ad303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:31.073202 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2707d4-7e80-4f4e-875f-40da131ad303 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:31.073477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2707d4-7e80-4f4e-875f-40da131ad303 admin admin] PATH_INFO: `/v3/projects/fbb823b230ea45b2aeccb9ff061ce696` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:31.074613 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2707d4-7e80-4f4e-875f-40da131ad303 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbb823b230ea45b2aeccb9ff061ce696)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:31.076984 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2707d4-7e80-4f4e-875f-40da131ad303 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:31.123718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6f2707d4-7e80-4f4e-875f-40da131ad303 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbb823b230ea45b2aeccb9ff061ce696', 'request_id': 'req-6f2707d4-7e80-4f4e-875f-40da131ad303'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:31.129212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6f2707d4-7e80-4f4e-875f-40da131ad303 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbb823b230ea45b2aeccb9ff061ce696', 'request_id': 'req-6f2707d4-7e80-4f4e-875f-40da131ad303'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:31.135249 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6f2707d4-7e80-4f4e-875f-40da131ad303 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbb823b230ea45b2aeccb9ff061ce696', 'request_id': 'req-6f2707d4-7e80-4f4e-875f-40da131ad303'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:31.147739 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6f2707d4-7e80-4f4e-875f-40da131ad303 admin admin] The token cache is being invalidate because project fbb823b230ea45b2aeccb9ff061ce696 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:32:31.148089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6f2707d4-7e80-4f4e-875f-40da131ad303 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:31.148723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-6f2707d4-7e80-4f4e-875f-40da131ad303 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:31.150243 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3853/7760] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:32:30 2022] DELETE /identity/v3/projects/fbb823b230ea45b2aeccb9ff061ce696 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:32:31.156364 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd814e5-fa3d-4ec5-9c0d-21a7c6827f25 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:31.156877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd814e5-fa3d-4ec5-9c0d-21a7c6827f25 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:31.156988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd814e5-fa3d-4ec5-9c0d-21a7c6827f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:31.177019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-cbd814e5-fa3d-4ec5-9c0d-21a7c6827f25 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:32:31.178201 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-cbd814e5-fa3d-4ec5-9c0d-21a7c6827f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:32:31.196828 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:32:31.239685 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3908/7761] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:32:31.247248 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d861d-a77c-4da0-bb75-56e4da72c0a3 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:31.248202 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d861d-a77c-4da0-bb75-56e4da72c0a3 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:31.248523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d861d-a77c-4da0-bb75-56e4da72c0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:31.268697 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a98d861d-a77c-4da0-bb75-56e4da72c0a3 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:32:31.269903 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a98d861d-a77c-4da0-bb75-56e4da72c0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:32:31.278282 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3854/7762] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:32:31.282711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd814e5-fa3d-4ec5-9c0d-21a7c6827f25 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:31.292384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd814e5-fa3d-4ec5-9c0d-21a7c6827f25 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:31.297016 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b9917-ec54-4a2c-85b9-f0259d9d70e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:31.297634 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b9917-ec54-4a2c-85b9-f0259d9d70e8 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:31.297913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b9917-ec54-4a2c-85b9-f0259d9d70e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:31.298185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b9917-ec54-4a2c-85b9-f0259d9d70e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:31.298858 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b9917-ec54-4a2c-85b9-f0259d9d70e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:32:31.299356 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b9917-ec54-4a2c-85b9-f0259d9d70e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:31.300939 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b9917-ec54-4a2c-85b9-f0259d9d70e8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:31.313359 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3909/7763] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:32:31.317813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d861d-a77c-4da0-bb75-56e4da72c0a3 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:31.327979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d861d-a77c-4da0-bb75-56e4da72c0a3 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:31.332697 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c6895-d6c7-42b8-9c3f-3428e0171aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:31.333288 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c6895-d6c7-42b8-9c3f-3428e0171aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:31.333598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c6895-d6c7-42b8-9c3f-3428e0171aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:31.333876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c6895-d6c7-42b8-9c3f-3428e0171aa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:31.334493 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c6895-d6c7-42b8-9c3f-3428e0171aa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:31.336417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c6895-d6c7-42b8-9c3f-3428e0171aa2 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:31.364205 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3855/7764] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:32:31 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:32:31.368531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b9917-ec54-4a2c-85b9-f0259d9d70e8 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:31.379727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b9917-ec54-4a2c-85b9-f0259d9d70e8 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:31.438997 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d070d-14e7-447f-b0a6-dbafb7541929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:31.439605 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d070d-14e7-447f-b0a6-dbafb7541929 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:31.439884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d070d-14e7-447f-b0a6-dbafb7541929 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:31.440159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d070d-14e7-447f-b0a6-dbafb7541929 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:31.440781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d070d-14e7-447f-b0a6-dbafb7541929 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:31.442713 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d070d-14e7-447f-b0a6-dbafb7541929 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:31.464998 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3910/7765] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:32:31 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:32:31.469070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c6895-d6c7-42b8-9c3f-3428e0171aa2 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:31.479796 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c6895-d6c7-42b8-9c3f-3428e0171aa2 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:31.485498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604efa8c-5c52-46a9-82f5-5cfe9142bd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:31.486093 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604efa8c-5c52-46a9-82f5-5cfe9142bd62 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:31.486382 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604efa8c-5c52-46a9-82f5-5cfe9142bd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:31.486662 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604efa8c-5c52-46a9-82f5-5cfe9142bd62 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:31.487322 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604efa8c-5c52-46a9-82f5-5cfe9142bd62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:31.488919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604efa8c-5c52-46a9-82f5-5cfe9142bd62 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:31.499562 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3856/7766] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:32:31.503529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d070d-14e7-447f-b0a6-dbafb7541929 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:31.513562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d070d-14e7-447f-b0a6-dbafb7541929 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:31.518306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff6ce7-a2e1-4500-888b-4c2e8c5149c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:31.518973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff6ce7-a2e1-4500-888b-4c2e8c5149c5 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:31.519257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff6ce7-a2e1-4500-888b-4c2e8c5149c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:31.519535 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff6ce7-a2e1-4500-888b-4c2e8c5149c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:31.520201 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff6ce7-a2e1-4500-888b-4c2e8c5149c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:31.521820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff6ce7-a2e1-4500-888b-4c2e8c5149c5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:31.533720 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3911/7767] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:32:31.537684 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604efa8c-5c52-46a9-82f5-5cfe9142bd62 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:31.548254 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604efa8c-5c52-46a9-82f5-5cfe9142bd62 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:31.553227 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7faef-862c-4ad3-b23e-a353316793a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:31.553865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7faef-862c-4ad3-b23e-a353316793a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:31.554143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7faef-862c-4ad3-b23e-a353316793a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:31.554413 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7faef-862c-4ad3-b23e-a353316793a9 admin admin] PATH_INFO: `/v3/projects/5cf0a7d2509d446b89fd2892d71202b9/users/4f9c25ad36c74bae879ce0f259c76027/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:31.568475 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:32:31.573215 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7faef-862c-4ad3-b23e-a353316793a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cf0a7d2509d446b89fd2892d71202b9, user_id=4f9c25ad36c74bae879ce0f259c76027, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:31.577175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7faef-862c-4ad3-b23e-a353316793a9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:31.589827 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3857/7768] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:32:31 2022] PUT /identity/v3/projects/5cf0a7d2509d446b89fd2892d71202b9/users/4f9c25ad36c74bae879ce0f259c76027/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:32:31.594968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcb7de-4a3b-4a07-a143-99fd9685177e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:31.595254 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcb7de-4a3b-4a07-a143-99fd9685177e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:31.595524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcb7de-4a3b-4a07-a143-99fd9685177e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:31.615233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a3bcb7de-4a3b-4a07-a143-99fd9685177e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:32:31.616444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a3bcb7de-4a3b-4a07-a143-99fd9685177e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:32:31.678916 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3912/7769] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:32:31.689474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7faef-862c-4ad3-b23e-a353316793a9 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:31.691245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-69f7faef-862c-4ad3-b23e-a353316793a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:32:31.761414 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7faef-862c-4ad3-b23e-a353316793a9 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:31.765370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb9aed-5a89-4b15-bb04-7d970d8cd3a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:31.765975 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb9aed-5a89-4b15-bb04-7d970d8cd3a3 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:31.766352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb9aed-5a89-4b15-bb04-7d970d8cd3a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:31.766661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb9aed-5a89-4b15-bb04-7d970d8cd3a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:31.776058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb9aed-5a89-4b15-bb04-7d970d8cd3a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:31.777738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb9aed-5a89-4b15-bb04-7d970d8cd3a3 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:31.787703 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3858/7770] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:32:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:32:36.060848 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa059eaf-c9f7-4171-ad99-c995ecfbba1f None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:36.060848 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa059eaf-c9f7-4171-ad99-c995ecfbba1f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:36.060848 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa059eaf-c9f7-4171-ad99-c995ecfbba1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:36.093404 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-fa059eaf-c9f7-4171-ad99-c995ecfbba1f None None] MFA Rules not processed for user `4f9c25ad36c74bae879ce0f259c76027`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:32:36.094672 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-fa059eaf-c9f7-4171-ad99-c995ecfbba1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:32:36.115701 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:32:36.188732 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3913/7771] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:32:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:32:36.192682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb9aed-5a89-4b15-bb04-7d970d8cd3a3 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:36.205949 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb9aed-5a89-4b15-bb04-7d970d8cd3a3 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:36.212834 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604197b-eccd-43cf-8cd4-18a042336ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:36.213686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604197b-eccd-43cf-8cd4-18a042336ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:36.213981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604197b-eccd-43cf-8cd4-18a042336ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:36.214277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604197b-eccd-43cf-8cd4-18a042336ce5 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:36.214989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604197b-eccd-43cf-8cd4-18a042336ce5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:36.217685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604197b-eccd-43cf-8cd4-18a042336ce5 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:36.247977 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3859/7772] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:32:36 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:32:36.252020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa059eaf-c9f7-4171-ad99-c995ecfbba1f None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:36.264166 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa059eaf-c9f7-4171-ad99-c995ecfbba1f None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:36.326201 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aeaea1-ad40-4f31-a93c-32bdcb68371c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:36.326569 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aeaea1-ad40-4f31-a93c-32bdcb68371c admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:36.326903 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aeaea1-ad40-4f31-a93c-32bdcb68371c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:36.327183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aeaea1-ad40-4f31-a93c-32bdcb68371c admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:36.327819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aeaea1-ad40-4f31-a93c-32bdcb68371c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:36.329795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aeaea1-ad40-4f31-a93c-32bdcb68371c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:36.353435 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3914/7773] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:32:36 2022] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:32:36.358988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604197b-eccd-43cf-8cd4-18a042336ce5 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:36.369654 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604197b-eccd-43cf-8cd4-18a042336ce5 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:36.375046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6468d-f874-4c54-9182-693c43478268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:36.375648 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6468d-f874-4c54-9182-693c43478268 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:36.375930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6468d-f874-4c54-9182-693c43478268 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:36.376207 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6468d-f874-4c54-9182-693c43478268 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:36.377033 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6468d-f874-4c54-9182-693c43478268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:36.378681 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6468d-f874-4c54-9182-693c43478268 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:36.393251 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3860/7774] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:32:36.394488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aeaea1-ad40-4f31-a93c-32bdcb68371c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:36.406015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aeaea1-ad40-4f31-a93c-32bdcb68371c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:36.410864 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc1379-51bf-40a2-9764-cbc35f6eccfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:36.411559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc1379-51bf-40a2-9764-cbc35f6eccfa admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:36.411842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc1379-51bf-40a2-9764-cbc35f6eccfa admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:36.412116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc1379-51bf-40a2-9764-cbc35f6eccfa admin admin] PATH_INFO: `/v3/projects/145791e6aea846e98613f1bbe4df3789/users/f81655e715b94c6b9990dece1dfd07ec/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:36.428304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc1379-51bf-40a2-9764-cbc35f6eccfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=145791e6aea846e98613f1bbe4df3789, user_id=f81655e715b94c6b9990dece1dfd07ec, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:36.431031 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc1379-51bf-40a2-9764-cbc35f6eccfa admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:36.445808 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3915/7775] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:32:36 2022] PUT /identity/v3/projects/145791e6aea846e98613f1bbe4df3789/users/f81655e715b94c6b9990dece1dfd07ec/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:32:36.449923 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6468d-f874-4c54-9182-693c43478268 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:36.461742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6468d-f874-4c54-9182-693c43478268 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:36.525010 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca4e29-521e-4181-8d9f-047e354c19f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:36.525626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca4e29-521e-4181-8d9f-047e354c19f5 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:36.525910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca4e29-521e-4181-8d9f-047e354c19f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:36.526278 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca4e29-521e-4181-8d9f-047e354c19f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:36.527117 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca4e29-521e-4181-8d9f-047e354c19f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:36.529611 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca4e29-521e-4181-8d9f-047e354c19f5 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:36.540057 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3861/7776] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:32:36.544765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc1379-51bf-40a2-9764-cbc35f6eccfa admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:36.555628 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc1379-51bf-40a2-9764-cbc35f6eccfa admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:36.561313 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2cc6e-4e09-48de-90df-f14dc1d610ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:36.561984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2cc6e-4e09-48de-90df-f14dc1d610ae admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:36.562409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2cc6e-4e09-48de-90df-f14dc1d610ae admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:36.562720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2cc6e-4e09-48de-90df-f14dc1d610ae admin admin] PATH_INFO: `/v3/projects/145791e6aea846e98613f1bbe4df3789/users/f81655e715b94c6b9990dece1dfd07ec/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:36.564677 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a2cc6e-4e09-48de-90df-f14dc1d610ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=145791e6aea846e98613f1bbe4df3789, user_id=f81655e715b94c6b9990dece1dfd07ec, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:36.567415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a2cc6e-4e09-48de-90df-f14dc1d610ae admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:36.579031 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3916/7777] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:32:36 2022] PUT /identity/v3/projects/145791e6aea846e98613f1bbe4df3789/users/f81655e715b94c6b9990dece1dfd07ec/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:32:41.142145 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f1151-4f29-49d4-bc84-09904275c161 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:41.142700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f1151-4f29-49d4-bc84-09904275c161 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:41.142791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f1151-4f29-49d4-bc84-09904275c161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:41.180555 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-0d1f1151-4f29-49d4-bc84-09904275c161 None None] MFA Rules not processed for user `f81655e715b94c6b9990dece1dfd07ec`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:32:41.181967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0d1f1151-4f29-49d4-bc84-09904275c161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:32:41.228007 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:32:41.267902 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3862/7778] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:32:41 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:32:41.282474 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2cc6e-4e09-48de-90df-f14dc1d610ae admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:41.284254 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c8a2cc6e-4e09-48de-90df-f14dc1d610ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:32:41.369907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2cc6e-4e09-48de-90df-f14dc1d610ae admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:41.374213 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49de8c-f3b2-46f2-ab34-80cf54f4ff4a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10759b2abd4cafacf338551327775e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:41.374839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49de8c-f3b2-46f2-ab34-80cf54f4ff4a service glance] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:41.375121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49de8c-f3b2-46f2-ab34-80cf54f4ff4a service glance] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:41.375395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49de8c-f3b2-46f2-ab34-80cf54f4ff4a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:41.380567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:32:41.436110 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49de8c-f3b2-46f2-ab34-80cf54f4ff4a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:41.437536 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49de8c-f3b2-46f2-ab34-80cf54f4ff4a service glance] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:41.449339 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3917/7779] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:32:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:32:41.451422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f1151-4f29-49d4-bc84-09904275c161 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:41.453106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0d1f1151-4f29-49d4-bc84-09904275c161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:32:41.569271 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f1151-4f29-49d4-bc84-09904275c161 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:41.573179 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ebca8-7525-4dc9-b404-82761ed72abf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:41.573965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ebca8-7525-4dc9-b404-82761ed72abf service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:41.574312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ebca8-7525-4dc9-b404-82761ed72abf service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:41.574691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ebca8-7525-4dc9-b404-82761ed72abf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:41.577231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-eb1ebca8-7525-4dc9-b404-82761ed72abf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:32:41.677876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ebca8-7525-4dc9-b404-82761ed72abf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:41.679357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ebca8-7525-4dc9-b404-82761ed72abf service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:41.718514 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3863/7780] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:32:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:32:51.442384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=24 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:32:51.716021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=79 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:32:53.979118 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49de8c-f3b2-46f2-ab34-80cf54f4ff4a service glance] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:54.060394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49de8c-f3b2-46f2-ab34-80cf54f4ff4a service glance] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:54.065498 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de17081-9b46-47b0-9a37-05a1b1c2193b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:54.066361 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de17081-9b46-47b0-9a37-05a1b1c2193b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:54.066753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de17081-9b46-47b0-9a37-05a1b1c2193b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:54.067101 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de17081-9b46-47b0-9a37-05a1b1c2193b admin admin] PATH_INFO: `/v3/users/4f9c25ad36c74bae879ce0f259c76027` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:54.068334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de17081-9b46-47b0-9a37-05a1b1c2193b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f9c25ad36c74bae879ce0f259c76027)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:54.070773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de17081-9b46-47b0-9a37-05a1b1c2193b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:54.131265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5de17081-9b46-47b0-9a37-05a1b1c2193b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f9c25ad36c74bae879ce0f259c76027'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:54.138512 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5de17081-9b46-47b0-9a37-05a1b1c2193b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f9c25ad36c74bae879ce0f259c76027'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:54.139207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5de17081-9b46-47b0-9a37-05a1b1c2193b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f9c25ad36c74bae879ce0f259c76027'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:54.139808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5de17081-9b46-47b0-9a37-05a1b1c2193b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f9c25ad36c74bae879ce0f259c76027'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:54.147042 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5de17081-9b46-47b0-9a37-05a1b1c2193b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f9c25ad36c74bae879ce0f259c76027'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:54.165374 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3918/7781] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:32:53 2022] DELETE /identity/v3/users/4f9c25ad36c74bae879ce0f259c76027 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:32:54.345726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ebca8-7525-4dc9-b404-82761ed72abf service cinder] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:54.358178 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ebca8-7525-4dc9-b404-82761ed72abf service cinder] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:54.416299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7036c46f-46d1-4a1b-a215-45450d8c4388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:54.416939 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036c46f-46d1-4a1b-a215-45450d8c4388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:54.417225 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036c46f-46d1-4a1b-a215-45450d8c4388 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:54.417502 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036c46f-46d1-4a1b-a215-45450d8c4388 admin admin] PATH_INFO: `/v3/projects/5cf0a7d2509d446b89fd2892d71202b9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:54.419265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7036c46f-46d1-4a1b-a215-45450d8c4388 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cf0a7d2509d446b89fd2892d71202b9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:54.421194 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7036c46f-46d1-4a1b-a215-45450d8c4388 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:54.471619 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7036c46f-46d1-4a1b-a215-45450d8c4388 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cf0a7d2509d446b89fd2892d71202b9', 'request_id': 'req-7036c46f-46d1-4a1b-a215-45450d8c4388'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:54.477296 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7036c46f-46d1-4a1b-a215-45450d8c4388 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cf0a7d2509d446b89fd2892d71202b9', 'request_id': 'req-7036c46f-46d1-4a1b-a215-45450d8c4388'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:54.484154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7036c46f-46d1-4a1b-a215-45450d8c4388 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cf0a7d2509d446b89fd2892d71202b9', 'request_id': 'req-7036c46f-46d1-4a1b-a215-45450d8c4388'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:54.497584 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7036c46f-46d1-4a1b-a215-45450d8c4388 admin admin] The token cache is being invalidate because project 5cf0a7d2509d446b89fd2892d71202b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:32:54.497871 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7036c46f-46d1-4a1b-a215-45450d8c4388 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:54.498531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7036c46f-46d1-4a1b-a215-45450d8c4388 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:54.500052 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3864/7782] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:32:54 2022] DELETE /identity/v3/projects/5cf0a7d2509d446b89fd2892d71202b9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:32:54.504075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de17081-9b46-47b0-9a37-05a1b1c2193b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:54.505491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5de17081-9b46-47b0-9a37-05a1b1c2193b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:32:54.518713 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de17081-9b46-47b0-9a37-05a1b1c2193b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:54.575788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21aa43c-a703-4fc4-8671-8672ebba5320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:54.576416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21aa43c-a703-4fc4-8671-8672ebba5320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:54.576701 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21aa43c-a703-4fc4-8671-8672ebba5320 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:54.576982 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21aa43c-a703-4fc4-8671-8672ebba5320 admin admin] PATH_INFO: `/v3/users/f81655e715b94c6b9990dece1dfd07ec` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:54.578119 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21aa43c-a703-4fc4-8671-8672ebba5320 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f81655e715b94c6b9990dece1dfd07ec)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:54.580071 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21aa43c-a703-4fc4-8671-8672ebba5320 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:54.602041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:32:54.627045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f21aa43c-a703-4fc4-8671-8672ebba5320 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f81655e715b94c6b9990dece1dfd07ec'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:54.634019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f21aa43c-a703-4fc4-8671-8672ebba5320 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f81655e715b94c6b9990dece1dfd07ec'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:54.634711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f21aa43c-a703-4fc4-8671-8672ebba5320 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f81655e715b94c6b9990dece1dfd07ec'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:54.635324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f21aa43c-a703-4fc4-8671-8672ebba5320 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f81655e715b94c6b9990dece1dfd07ec'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:54.643638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f21aa43c-a703-4fc4-8671-8672ebba5320 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f81655e715b94c6b9990dece1dfd07ec'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:54.663707 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3919/7783] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:32:54 2022] DELETE /identity/v3/users/f81655e715b94c6b9990dece1dfd07ec => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:32:54.839669 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7036c46f-46d1-4a1b-a215-45450d8c4388 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:32:54.841965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7036c46f-46d1-4a1b-a215-45450d8c4388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:32:54.855090 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7036c46f-46d1-4a1b-a215-45450d8c4388 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:32:54.910097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a17f8-b3df-4457-97b7-ebcab1d49981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:32:54.910743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a17f8-b3df-4457-97b7-ebcab1d49981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:32:54.911023 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a17f8-b3df-4457-97b7-ebcab1d49981 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:32:54.911296 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a17f8-b3df-4457-97b7-ebcab1d49981 admin admin] PATH_INFO: `/v3/projects/145791e6aea846e98613f1bbe4df3789` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:32:54.912395 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309a17f8-b3df-4457-97b7-ebcab1d49981 admin admin] RBAC: Authorizing `identity:delete_project(project_id=145791e6aea846e98613f1bbe4df3789)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:32:54.914352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309a17f8-b3df-4457-97b7-ebcab1d49981 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:32:54.948901 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:32:54.963089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-309a17f8-b3df-4457-97b7-ebcab1d49981 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '145791e6aea846e98613f1bbe4df3789', 'request_id': 'req-309a17f8-b3df-4457-97b7-ebcab1d49981'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:54.968567 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-309a17f8-b3df-4457-97b7-ebcab1d49981 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '145791e6aea846e98613f1bbe4df3789', 'request_id': 'req-309a17f8-b3df-4457-97b7-ebcab1d49981'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:54.974533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-309a17f8-b3df-4457-97b7-ebcab1d49981 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '145791e6aea846e98613f1bbe4df3789', 'request_id': 'req-309a17f8-b3df-4457-97b7-ebcab1d49981'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:54.987489 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-309a17f8-b3df-4457-97b7-ebcab1d49981 admin admin] The token cache is being invalidate because project 145791e6aea846e98613f1bbe4df3789 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:32:54.987781 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-309a17f8-b3df-4457-97b7-ebcab1d49981 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:54.988412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-309a17f8-b3df-4457-97b7-ebcab1d49981 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:32:54.989921 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3865/7784] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:32:54 2022] DELETE /identity/v3/projects/145791e6aea846e98613f1bbe4df3789 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:33:04.660093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:33:04.984151 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:33:51.446766 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21aa43c-a703-4fc4-8671-8672ebba5320 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:33:51.448114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f21aa43c-a703-4fc4-8671-8672ebba5320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:33:51.549302 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21aa43c-a703-4fc4-8671-8672ebba5320 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:33:51.612094 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048d34b-24ff-43ef-a2db-094e74650d88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:33:51.612699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048d34b-24ff-43ef-a2db-094e74650d88 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:33:51.612975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048d34b-24ff-43ef-a2db-094e74650d88 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:33:51.613246 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048d34b-24ff-43ef-a2db-094e74650d88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:33:51.615896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c048d34b-24ff-43ef-a2db-094e74650d88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:33:51.696600 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048d34b-24ff-43ef-a2db-094e74650d88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:33:51.698274 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048d34b-24ff-43ef-a2db-094e74650d88 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:33:51.701755 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:33:51.717992 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3920/7785] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:33:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:33:52.799091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a17f8-b3df-4457-97b7-ebcab1d49981 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:33:52.800533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-309a17f8-b3df-4457-97b7-ebcab1d49981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:33:52.863473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a17f8-b3df-4457-97b7-ebcab1d49981 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:33:52.867147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31b04c-633b-4402-8781-ccb6e97727a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:33:52.867747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31b04c-633b-4402-8781-ccb6e97727a8 service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:33:52.868025 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31b04c-633b-4402-8781-ccb6e97727a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:33:52.868300 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31b04c-633b-4402-8781-ccb6e97727a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:33:52.870127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4f31b04c-633b-4402-8781-ccb6e97727a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:33:52.886248 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31b04c-633b-4402-8781-ccb6e97727a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:33:52.887714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31b04c-633b-4402-8781-ccb6e97727a8 service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:33:52.901068 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3866/7786] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:33:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:33:56.090013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048d34b-24ff-43ef-a2db-094e74650d88 service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:33:56.101231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048d34b-24ff-43ef-a2db-094e74650d88 service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:33:56.104771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9d55a-d99a-469f-a8a7-7a56ec036da3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:33:56.105355 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9d55a-d99a-469f-a8a7-7a56ec036da3 service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:33:56.105632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9d55a-d99a-469f-a8a7-7a56ec036da3 service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:33:56.105900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9d55a-d99a-469f-a8a7-7a56ec036da3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:33:56.107697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-86b9d55a-d99a-469f-a8a7-7a56ec036da3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:33:56.123237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9d55a-d99a-469f-a8a7-7a56ec036da3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:33:56.124672 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9d55a-d99a-469f-a8a7-7a56ec036da3 service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:33:56.138060 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3921/7787] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:33:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:34:02.893779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=26 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:34:06.130899 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=11 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:35:53.062436 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31b04c-633b-4402-8781-ccb6e97727a8 service cinder] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:53.063934 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4f31b04c-633b-4402-8781-ccb6e97727a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:35:53.129201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31b04c-633b-4402-8781-ccb6e97727a8 service cinder] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:53.134714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814afad-276d-4830-9def-468b35dea16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:53.135326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814afad-276d-4830-9def-468b35dea16c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:53.135603 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814afad-276d-4830-9def-468b35dea16c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:53.135876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814afad-276d-4830-9def-468b35dea16c admin admin] PATH_INFO: `/v3/users/36d19078bf6642389799f23a5f74010a` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:53.136972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814afad-276d-4830-9def-468b35dea16c admin admin] RBAC: Authorizing `identity:delete_user(user_id=36d19078bf6642389799f23a5f74010a)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:53.138943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814afad-276d-4830-9def-468b35dea16c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:53.184604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2814afad-276d-4830-9def-468b35dea16c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36d19078bf6642389799f23a5f74010a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:53.185244 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2814afad-276d-4830-9def-468b35dea16c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36d19078bf6642389799f23a5f74010a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:53.185843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2814afad-276d-4830-9def-468b35dea16c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36d19078bf6642389799f23a5f74010a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:53.193342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2814afad-276d-4830-9def-468b35dea16c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36d19078bf6642389799f23a5f74010a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:53.206079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2814afad-276d-4830-9def-468b35dea16c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36d19078bf6642389799f23a5f74010a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:53.217972 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3867/7788] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:35:53 2022] DELETE /identity/v3/users/36d19078bf6642389799f23a5f74010a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:35:53.222429 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf9a73-c1b0-4879-bb5a-3a4aa6266fef None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:53.222963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf9a73-c1b0-4879-bb5a-3a4aa6266fef None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:53.223085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf9a73-c1b0-4879-bb5a-3a4aa6266fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:53.242080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-69cf9a73-c1b0-4879-bb5a-3a4aa6266fef None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:35:53.243455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-69cf9a73-c1b0-4879-bb5a-3a4aa6266fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:35:53.302312 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3922/7789] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:35:53.314087 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814afad-276d-4830-9def-468b35dea16c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:53.315663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2814afad-276d-4830-9def-468b35dea16c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:35:53.375533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814afad-276d-4830-9def-468b35dea16c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:53.379337 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ce1ce-14f2-4edf-bcbf-bd1b37c6f6f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:53.379941 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ce1ce-14f2-4edf-bcbf-bd1b37c6f6f7 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:53.380220 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ce1ce-14f2-4edf-bcbf-bd1b37c6f6f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:53.380490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ce1ce-14f2-4edf-bcbf-bd1b37c6f6f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:53.389535 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ce1ce-14f2-4edf-bcbf-bd1b37c6f6f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:53.391086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ce1ce-14f2-4edf-bcbf-bd1b37c6f6f7 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:53.400573 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3868/7790] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:35:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:35:53.675960 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf9a73-c1b0-4879-bb5a-3a4aa6266fef None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:53.676934 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-69cf9a73-c1b0-4879-bb5a-3a4aa6266fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:35:53.689283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf9a73-c1b0-4879-bb5a-3a4aa6266fef None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:53.694207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75c96b-b581-4aad-b496-f069ced837f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:53.695477 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75c96b-b581-4aad-b496-f069ced837f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:53.695763 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75c96b-b581-4aad-b496-f069ced837f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:53.696043 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75c96b-b581-4aad-b496-f069ced837f1 admin admin] PATH_INFO: `/v3/projects/cb48281491e5408b89aef10e236519aa` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:53.697209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75c96b-b581-4aad-b496-f069ced837f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb48281491e5408b89aef10e236519aa)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:53.699237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75c96b-b581-4aad-b496-f069ced837f1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:53.749065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bb75c96b-b581-4aad-b496-f069ced837f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb48281491e5408b89aef10e236519aa', 'request_id': 'req-bb75c96b-b581-4aad-b496-f069ced837f1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:53.754693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bb75c96b-b581-4aad-b496-f069ced837f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb48281491e5408b89aef10e236519aa', 'request_id': 'req-bb75c96b-b581-4aad-b496-f069ced837f1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:53.761971 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bb75c96b-b581-4aad-b496-f069ced837f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb48281491e5408b89aef10e236519aa', 'request_id': 'req-bb75c96b-b581-4aad-b496-f069ced837f1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:53.773755 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bb75c96b-b581-4aad-b496-f069ced837f1 admin admin] The token cache is being invalidate because project cb48281491e5408b89aef10e236519aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:35:53.773946 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bb75c96b-b581-4aad-b496-f069ced837f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:53.774676 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bb75c96b-b581-4aad-b496-f069ced837f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:53.776175 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3923/7791] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:35:53 2022] DELETE /identity/v3/projects/cb48281491e5408b89aef10e236519aa => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:35:53.783719 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3019b6-e830-4eea-b812-320654ae8a57 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:53.784009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3019b6-e830-4eea-b812-320654ae8a57 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:53.784286 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3019b6-e830-4eea-b812-320654ae8a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:53.804932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-ee3019b6-e830-4eea-b812-320654ae8a57 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:35:53.806058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ee3019b6-e830-4eea-b812-320654ae8a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:35:53.822506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:35:53.866742 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3869/7792] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:35:53.874390 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c283989-57d9-459d-95ce-4f1ca0f55c48 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:53.874720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c283989-57d9-459d-95ce-4f1ca0f55c48 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:53.875004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c283989-57d9-459d-95ce-4f1ca0f55c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:53.894955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-3c283989-57d9-459d-95ce-4f1ca0f55c48 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:35:53.896158 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3c283989-57d9-459d-95ce-4f1ca0f55c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:35:53.904958 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3924/7793] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:35:53.909165 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3019b6-e830-4eea-b812-320654ae8a57 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:53.919614 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3019b6-e830-4eea-b812-320654ae8a57 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:53.924401 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd80e9b-ddd9-4a65-8bda-522487593c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:53.924990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd80e9b-ddd9-4a65-8bda-522487593c2d admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:53.925272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd80e9b-ddd9-4a65-8bda-522487593c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:53.925543 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd80e9b-ddd9-4a65-8bda-522487593c2d admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:53.926183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd80e9b-ddd9-4a65-8bda-522487593c2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:35:53.926483 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd80e9b-ddd9-4a65-8bda-522487593c2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:53.928122 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd80e9b-ddd9-4a65-8bda-522487593c2d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:53.939656 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3870/7794] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:35:53.943973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c283989-57d9-459d-95ce-4f1ca0f55c48 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:53.953746 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c283989-57d9-459d-95ce-4f1ca0f55c48 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:53.958477 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa17ec0-bc9d-4b14-aeb3-95fd4a9ca953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:53.959104 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa17ec0-bc9d-4b14-aeb3-95fd4a9ca953 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:53.959382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa17ec0-bc9d-4b14-aeb3-95fd4a9ca953 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:53.959654 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa17ec0-bc9d-4b14-aeb3-95fd4a9ca953 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:53.961030 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa17ec0-bc9d-4b14-aeb3-95fd4a9ca953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:53.963189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa17ec0-bc9d-4b14-aeb3-95fd4a9ca953 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:54.000473 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3925/7795] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:35:53 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:35:54.004638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd80e9b-ddd9-4a65-8bda-522487593c2d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:54.015055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd80e9b-ddd9-4a65-8bda-522487593c2d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:54.073235 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d88284-8ace-40a2-88df-e6f39dfcc610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:54.073897 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d88284-8ace-40a2-88df-e6f39dfcc610 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:54.074065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d88284-8ace-40a2-88df-e6f39dfcc610 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:54.074339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d88284-8ace-40a2-88df-e6f39dfcc610 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:54.075013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d88284-8ace-40a2-88df-e6f39dfcc610 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:54.076985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d88284-8ace-40a2-88df-e6f39dfcc610 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:54.097348 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3871/7796] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:35:54 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:35:54.102025 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa17ec0-bc9d-4b14-aeb3-95fd4a9ca953 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:54.112206 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa17ec0-bc9d-4b14-aeb3-95fd4a9ca953 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:54.116913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314bbc54-83ad-46bf-8249-090811cb0855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:54.117420 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314bbc54-83ad-46bf-8249-090811cb0855 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:54.117699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314bbc54-83ad-46bf-8249-090811cb0855 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:54.117972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314bbc54-83ad-46bf-8249-090811cb0855 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:54.118637 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314bbc54-83ad-46bf-8249-090811cb0855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:54.120215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314bbc54-83ad-46bf-8249-090811cb0855 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:54.129908 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3926/7797] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:35:54.134743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d88284-8ace-40a2-88df-e6f39dfcc610 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:54.144595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d88284-8ace-40a2-88df-e6f39dfcc610 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:54.149650 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad9ea4-408e-4692-9955-c4bd93883a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:54.150234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad9ea4-408e-4692-9955-c4bd93883a9b admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:54.150506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad9ea4-408e-4692-9955-c4bd93883a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:54.150811 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad9ea4-408e-4692-9955-c4bd93883a9b admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:54.151483 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad9ea4-408e-4692-9955-c4bd93883a9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:54.153415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad9ea4-408e-4692-9955-c4bd93883a9b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:54.164907 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3872/7798] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:35:54.168995 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314bbc54-83ad-46bf-8249-090811cb0855 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:54.180205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314bbc54-83ad-46bf-8249-090811cb0855 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:54.184851 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441792cc-4273-4421-8904-7070c1ee8705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:54.185488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441792cc-4273-4421-8904-7070c1ee8705 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:54.185765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441792cc-4273-4421-8904-7070c1ee8705 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:54.186034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441792cc-4273-4421-8904-7070c1ee8705 admin admin] PATH_INFO: `/v3/projects/3997fec4736f44f7bb16f3f33b70451f/users/121aac5c62c34b78bf67a113e42e3ff5/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:54.202346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441792cc-4273-4421-8904-7070c1ee8705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3997fec4736f44f7bb16f3f33b70451f, user_id=121aac5c62c34b78bf67a113e42e3ff5, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:54.205036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441792cc-4273-4421-8904-7070c1ee8705 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:54.218293 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3927/7799] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:35:54 2022] PUT /identity/v3/projects/3997fec4736f44f7bb16f3f33b70451f/users/121aac5c62c34b78bf67a113e42e3ff5/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:35:54.229144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ef026-7542-4cbd-a03d-166a4be4e161 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:54.229428 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ef026-7542-4cbd-a03d-166a4be4e161 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:54.229702 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ef026-7542-4cbd-a03d-166a4be4e161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:54.257673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-519ef026-7542-4cbd-a03d-166a4be4e161 None None] MFA Rules not processed for user `121aac5c62c34b78bf67a113e42e3ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:35:54.258928 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-519ef026-7542-4cbd-a03d-166a4be4e161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:35:54.324859 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3873/7800] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:35:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:35:54.329266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441792cc-4273-4421-8904-7070c1ee8705 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:54.342309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:35:54.400109 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441792cc-4273-4421-8904-7070c1ee8705 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:54.405061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa4298-de8b-4f6a-835f-d1bed1e4e573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:54.405701 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa4298-de8b-4f6a-835f-d1bed1e4e573 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:54.405988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa4298-de8b-4f6a-835f-d1bed1e4e573 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:54.406267 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa4298-de8b-4f6a-835f-d1bed1e4e573 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:54.406935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa4298-de8b-4f6a-835f-d1bed1e4e573 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:54.408938 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa4298-de8b-4f6a-835f-d1bed1e4e573 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:54.438257 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3928/7801] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:35:54 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:35:54.440475 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ef026-7542-4cbd-a03d-166a4be4e161 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:54.451924 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ef026-7542-4cbd-a03d-166a4be4e161 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:54.465089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:35:54.509614 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ddc9c8-f6fc-457a-aca2-398b798e43c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:54.510215 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddc9c8-f6fc-457a-aca2-398b798e43c6 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:54.510495 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddc9c8-f6fc-457a-aca2-398b798e43c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:54.510797 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddc9c8-f6fc-457a-aca2-398b798e43c6 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:54.511414 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ddc9c8-f6fc-457a-aca2-398b798e43c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:54.513314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ddc9c8-f6fc-457a-aca2-398b798e43c6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:54.536113 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3874/7802] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:35:54 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:35:54.541076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa4298-de8b-4f6a-835f-d1bed1e4e573 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:54.552599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa4298-de8b-4f6a-835f-d1bed1e4e573 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:54.557344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f2c50-a290-4c38-a30e-29f4fc31bc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:54.557937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f2c50-a290-4c38-a30e-29f4fc31bc11 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:54.558220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f2c50-a290-4c38-a30e-29f4fc31bc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:54.558486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f2c50-a290-4c38-a30e-29f4fc31bc11 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:54.559149 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f2c50-a290-4c38-a30e-29f4fc31bc11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:54.560734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f2c50-a290-4c38-a30e-29f4fc31bc11 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:54.572435 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3929/7803] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:35:54.576725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ddc9c8-f6fc-457a-aca2-398b798e43c6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:54.587157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ddc9c8-f6fc-457a-aca2-398b798e43c6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:54.591719 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332c50a-143c-4f62-894b-df5cddde6045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:54.592358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332c50a-143c-4f62-894b-df5cddde6045 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:54.592638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332c50a-143c-4f62-894b-df5cddde6045 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:54.592910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332c50a-143c-4f62-894b-df5cddde6045 admin admin] PATH_INFO: `/v3/projects/24f9842144494051bec9d99d4fab6b88/users/a6cec948eaa042aca1527d9615989c02/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:54.607853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7332c50a-143c-4f62-894b-df5cddde6045 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24f9842144494051bec9d99d4fab6b88, user_id=a6cec948eaa042aca1527d9615989c02, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:54.610489 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7332c50a-143c-4f62-894b-df5cddde6045 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:54.623449 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3875/7804] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:35:54 2022] PUT /identity/v3/projects/24f9842144494051bec9d99d4fab6b88/users/a6cec948eaa042aca1527d9615989c02/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:35:54.627447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f2c50-a290-4c38-a30e-29f4fc31bc11 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:54.637823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f2c50-a290-4c38-a30e-29f4fc31bc11 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:54.696858 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9ccf1-8340-4dc7-b646-843b8b11b16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:54.697459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9ccf1-8340-4dc7-b646-843b8b11b16a admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:54.697737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9ccf1-8340-4dc7-b646-843b8b11b16a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:54.698007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9ccf1-8340-4dc7-b646-843b8b11b16a admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:54.698668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9ccf1-8340-4dc7-b646-843b8b11b16a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:54.700249 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9ccf1-8340-4dc7-b646-843b8b11b16a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:54.709736 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3930/7805] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:35:54.714418 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332c50a-143c-4f62-894b-df5cddde6045 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:54.724904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332c50a-143c-4f62-894b-df5cddde6045 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:54.729604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc5482-5f8d-4423-820c-60c9371b69a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:54.730277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc5482-5f8d-4423-820c-60c9371b69a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:54.730570 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc5482-5f8d-4423-820c-60c9371b69a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:54.730857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc5482-5f8d-4423-820c-60c9371b69a2 admin admin] PATH_INFO: `/v3/projects/24f9842144494051bec9d99d4fab6b88/users/a6cec948eaa042aca1527d9615989c02/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:54.732734 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc5482-5f8d-4423-820c-60c9371b69a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24f9842144494051bec9d99d4fab6b88, user_id=a6cec948eaa042aca1527d9615989c02, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:54.735409 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc5482-5f8d-4423-820c-60c9371b69a2 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:54.745974 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3876/7806] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:35:54 2022] PUT /identity/v3/projects/24f9842144494051bec9d99d4fab6b88/users/a6cec948eaa042aca1527d9615989c02/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:35:54.757713 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9aee69-7a99-4e76-bf6d-bbeaf50a0224 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:54.758231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9aee69-7a99-4e76-bf6d-bbeaf50a0224 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:54.758714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9aee69-7a99-4e76-bf6d-bbeaf50a0224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:54.787034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-2e9aee69-7a99-4e76-bf6d-bbeaf50a0224 None None] MFA Rules not processed for user `a6cec948eaa042aca1527d9615989c02`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:35:54.788847 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2e9aee69-7a99-4e76-bf6d-bbeaf50a0224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:35:54.856057 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3931/7807] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:35:54 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:35:54.860350 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc5482-5f8d-4423-820c-60c9371b69a2 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:54.871298 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc5482-5f8d-4423-820c-60c9371b69a2 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:54.875954 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a87d4-fbf1-43d0-b951-a26871a0edf1 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:54.876546 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a87d4-fbf1-43d0-b951-a26871a0edf1 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:54.876828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a87d4-fbf1-43d0-b951-a26871a0edf1 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:54.877104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a87d4-fbf1-43d0-b951-a26871a0edf1 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:54.877750 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a87d4-fbf1-43d0-b951-a26871a0edf1 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:54.879391 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a87d4-fbf1-43d0-b951-a26871a0edf1 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:54.895938 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3877/7808] 10.222.0.33 () {60 vars in 1149 bytes} [Sat Aug 6 21:35:54 2022] POST /identity/v3/domains => generated 276 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:35:54.900468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9aee69-7a99-4e76-bf6d-bbeaf50a0224 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:54.909742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9aee69-7a99-4e76-bf6d-bbeaf50a0224 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:54.913481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:35:54.968854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a8a2f-1730-444d-a0d3-c4e10caf872b tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:54.969553 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a8a2f-1730-444d-a0d3-c4e10caf872b tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:54.969840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a8a2f-1730-444d-a0d3-c4e10caf872b tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:54.970117 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a8a2f-1730-444d-a0d3-c4e10caf872b tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:54.970773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a8a2f-1730-444d-a0d3-c4e10caf872b tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:54.972678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a8a2f-1730-444d-a0d3-c4e10caf872b tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:55.009177 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3932/7809] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:35:54 2022] POST /identity/v3/projects => generated 402 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:35:55.013275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a87d4-fbf1-43d0-b951-a26871a0edf1 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:55.024178 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a87d4-fbf1-43d0-b951-a26871a0edf1 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:55.079736 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e3d35-550a-4f70-a34c-f2624023799c tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:55.080396 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e3d35-550a-4f70-a34c-f2624023799c tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:55.080617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e3d35-550a-4f70-a34c-f2624023799c tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:55.080895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e3d35-550a-4f70-a34c-f2624023799c tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/groups` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:55.081523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e3d35-550a-4f70-a34c-f2624023799c tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:55.083484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e3d35-550a-4f70-a34c-f2624023799c tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:55.098121 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3878/7810] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:35:55 2022] POST /identity/v3/groups => generated 301 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:35:55.102355 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a8a2f-1730-444d-a0d3-c4e10caf872b tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:55.112628 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a8a2f-1730-444d-a0d3-c4e10caf872b tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:55.117282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5746dc-3fe7-4867-9351-1794c78407d9 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:55.117880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5746dc-3fe7-4867-9351-1794c78407d9 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:55.118164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5746dc-3fe7-4867-9351-1794c78407d9 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:55.118443 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5746dc-3fe7-4867-9351-1794c78407d9 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:55.119114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5746dc-3fe7-4867-9351-1794c78407d9 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:55.121036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5746dc-3fe7-4867-9351-1794c78407d9 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:55.142043 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3933/7811] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:35:55 2022] POST /identity/v3/users => generated 442 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:35:55.146488 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e3d35-550a-4f70-a34c-f2624023799c tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:55.157529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e3d35-550a-4f70-a34c-f2624023799c tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:55.162437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c25d7-a24f-4671-80fa-0d9cc91d69a5 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:55.163129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c25d7-a24f-4671-80fa-0d9cc91d69a5 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:55.163465 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c25d7-a24f-4671-80fa-0d9cc91d69a5 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:55.163747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c25d7-a24f-4671-80fa-0d9cc91d69a5 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:55.164586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c25d7-a24f-4671-80fa-0d9cc91d69a5 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:55.166176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c25d7-a24f-4671-80fa-0d9cc91d69a5 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:55.181204 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3879/7812] 10.222.0.33 () {60 vars in 1143 bytes} [Sat Aug 6 21:35:55 2022] POST /identity/v3/roles => generated 240 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:35:55.185549 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5746dc-3fe7-4867-9351-1794c78407d9 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:55.196214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5746dc-3fe7-4867-9351-1794c78407d9 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:55.201049 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde95c6f-953f-4948-bd37-f28e811fac51 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:55.201743 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde95c6f-953f-4948-bd37-f28e811fac51 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:55.202031 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde95c6f-953f-4948-bd37-f28e811fac51 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:55.202309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde95c6f-953f-4948-bd37-f28e811fac51 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/489c5d2e2386438ebeef20cbde1a2df6/groups/53db407fd5574bbaa0b38d6b79f8d30a/roles/b1fce9ea2a1c4b318ba838cf3ecb326f/inherited_to_projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:55.208615 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde95c6f-953f-4948-bd37-f28e811fac51 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:create_grant(project_id=489c5d2e2386438ebeef20cbde1a2df6, group_id=53db407fd5574bbaa0b38d6b79f8d30a, role_id=b1fce9ea2a1c4b318ba838cf3ecb326f)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:55.211311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde95c6f-953f-4948-bd37-f28e811fac51 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:55.223254 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3934/7813] 10.222.0.33 () {60 vars in 1585 bytes} [Sat Aug 6 21:35:55 2022] PUT /identity/v3/OS-INHERIT/projects/489c5d2e2386438ebeef20cbde1a2df6/groups/53db407fd5574bbaa0b38d6b79f8d30a/roles/b1fce9ea2a1c4b318ba838cf3ecb326f/inherited_to_projects => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:35:55.227524 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c25d7-a24f-4671-80fa-0d9cc91d69a5 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:55.237502 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c25d7-a24f-4671-80fa-0d9cc91d69a5 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:55.271311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:35:55.295177 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00c2af-616d-4069-a282-a7ca46c73cd0 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:55.296140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00c2af-616d-4069-a282-a7ca46c73cd0 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `HEAD` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:55.296419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00c2af-616d-4069-a282-a7ca46c73cd0 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:55.296694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00c2af-616d-4069-a282-a7ca46c73cd0 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/489c5d2e2386438ebeef20cbde1a2df6/groups/53db407fd5574bbaa0b38d6b79f8d30a/roles/b1fce9ea2a1c4b318ba838cf3ecb326f/inherited_to_projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:55.298903 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e00c2af-616d-4069-a282-a7ca46c73cd0 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:check_grant(project_id=489c5d2e2386438ebeef20cbde1a2df6, group_id=53db407fd5574bbaa0b38d6b79f8d30a, role_id=b1fce9ea2a1c4b318ba838cf3ecb326f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:55.301648 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e00c2af-616d-4069-a282-a7ca46c73cd0 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:55.309330 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3880/7814] 10.222.0.33 () {58 vars in 1567 bytes} [Sat Aug 6 21:35:55 2022] HEAD /identity/v3/OS-INHERIT/projects/489c5d2e2386438ebeef20cbde1a2df6/groups/53db407fd5574bbaa0b38d6b79f8d30a/roles/b1fce9ea2a1c4b318ba838cf3ecb326f/inherited_to_projects => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:35:55.313654 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde95c6f-953f-4948-bd37-f28e811fac51 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:55.324681 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde95c6f-953f-4948-bd37-f28e811fac51 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:55.329269 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f022b43-63ac-4289-ba44-a1fb6e90a445 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:55.329917 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f022b43-63ac-4289-ba44-a1fb6e90a445 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:55.330197 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f022b43-63ac-4289-ba44-a1fb6e90a445 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:55.330471 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f022b43-63ac-4289-ba44-a1fb6e90a445 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/489c5d2e2386438ebeef20cbde1a2df6/groups/53db407fd5574bbaa0b38d6b79f8d30a/roles/b1fce9ea2a1c4b318ba838cf3ecb326f/inherited_to_projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:55.332662 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f022b43-63ac-4289-ba44-a1fb6e90a445 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=489c5d2e2386438ebeef20cbde1a2df6, group_id=53db407fd5574bbaa0b38d6b79f8d30a, role_id=b1fce9ea2a1c4b318ba838cf3ecb326f)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:55.335671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f022b43-63ac-4289-ba44-a1fb6e90a445 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:55.342231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5f022b43-63ac-4289-ba44-a1fb6e90a445 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invalidating the token cache because role b1fce9ea2a1c4b318ba838cf3ecb326f was removed from group 53db407fd5574bbaa0b38d6b79f8d30a on project 489c5d2e2386438ebeef20cbde1a2df6. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:35:55.342529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5f022b43-63ac-4289-ba44-a1fb6e90a445 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:55.343245 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5f022b43-63ac-4289-ba44-a1fb6e90a445 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:55.356802 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3935/7815] 10.222.0.33 () {58 vars in 1569 bytes} [Sat Aug 6 21:35:55 2022] DELETE /identity/v3/OS-INHERIT/projects/489c5d2e2386438ebeef20cbde1a2df6/groups/53db407fd5574bbaa0b38d6b79f8d30a/roles/b1fce9ea2a1c4b318ba838cf3ecb326f/inherited_to_projects => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:35:55.361011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00c2af-616d-4069-a282-a7ca46c73cd0 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:55.362909 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2e00c2af-616d-4069-a282-a7ca46c73cd0 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:35:55.375918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00c2af-616d-4069-a282-a7ca46c73cd0 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:55.434450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f118aa-fdca-458c-aa41-3e0e08253214 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:55.435122 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f118aa-fdca-458c-aa41-3e0e08253214 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:55.435405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f118aa-fdca-458c-aa41-3e0e08253214 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:55.435679 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f118aa-fdca-458c-aa41-3e0e08253214 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/roles/b1fce9ea2a1c4b318ba838cf3ecb326f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:55.437085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f118aa-fdca-458c-aa41-3e0e08253214 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b1fce9ea2a1c4b318ba838cf3ecb326f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:55.438916 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f118aa-fdca-458c-aa41-3e0e08253214 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:55.475701 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-29f118aa-fdca-458c-aa41-3e0e08253214 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invalidating the token cache because role b1fce9ea2a1c4b318ba838cf3ecb326f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:35:55.476186 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-29f118aa-fdca-458c-aa41-3e0e08253214 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:55.477032 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-29f118aa-fdca-458c-aa41-3e0e08253214 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:55.479193 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3881/7816] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:35:55 2022] DELETE /identity/v3/roles/b1fce9ea2a1c4b318ba838cf3ecb326f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:35:55.484566 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f022b43-63ac-4289-ba44-a1fb6e90a445 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:55.495170 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f022b43-63ac-4289-ba44-a1fb6e90a445 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:55.550882 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e41e13-2075-4c6a-82c8-4e1e080ea3e9 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:55.551484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e41e13-2075-4c6a-82c8-4e1e080ea3e9 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:55.551766 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e41e13-2075-4c6a-82c8-4e1e080ea3e9 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:55.552042 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e41e13-2075-4c6a-82c8-4e1e080ea3e9 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:55.552700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e41e13-2075-4c6a-82c8-4e1e080ea3e9 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:55.554905 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e41e13-2075-4c6a-82c8-4e1e080ea3e9 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:55.570312 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3936/7817] 10.222.0.33 () {60 vars in 1143 bytes} [Sat Aug 6 21:35:55 2022] POST /identity/v3/roles => generated 240 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:35:55.574902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f118aa-fdca-458c-aa41-3e0e08253214 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:55.576301 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-29f118aa-fdca-458c-aa41-3e0e08253214 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:35:55.588960 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f118aa-fdca-458c-aa41-3e0e08253214 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:55.593537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a14179-03d7-4fc9-bc15-be09a9e815ae tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:55.594187 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a14179-03d7-4fc9-bc15-be09a9e815ae tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:55.594481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a14179-03d7-4fc9-bc15-be09a9e815ae tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:55.594775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a14179-03d7-4fc9-bc15-be09a9e815ae tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/489c5d2e2386438ebeef20cbde1a2df6/users/957cc8f7afbb40aa9923adf846ad864e/roles/3ad5428db28540d4939d37a2af902f78/inherited_to_projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:55.610635 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a14179-03d7-4fc9-bc15-be09a9e815ae tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:create_grant(project_id=489c5d2e2386438ebeef20cbde1a2df6, user_id=957cc8f7afbb40aa9923adf846ad864e, role_id=3ad5428db28540d4939d37a2af902f78)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:55.613351 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a14179-03d7-4fc9-bc15-be09a9e815ae tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:55.625557 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3882/7818] 10.222.0.33 () {60 vars in 1582 bytes} [Sat Aug 6 21:35:55 2022] PUT /identity/v3/OS-INHERIT/projects/489c5d2e2386438ebeef20cbde1a2df6/users/957cc8f7afbb40aa9923adf846ad864e/roles/3ad5428db28540d4939d37a2af902f78/inherited_to_projects => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:35:55.629730 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e41e13-2075-4c6a-82c8-4e1e080ea3e9 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:55.640124 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e41e13-2075-4c6a-82c8-4e1e080ea3e9 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:55.660734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:35:55.702168 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ac532-fdbd-411f-85a4-e00940e29d84 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:55.702858 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ac532-fdbd-411f-85a4-e00940e29d84 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `HEAD` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:55.703137 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ac532-fdbd-411f-85a4-e00940e29d84 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:55.703412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ac532-fdbd-411f-85a4-e00940e29d84 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/489c5d2e2386438ebeef20cbde1a2df6/users/957cc8f7afbb40aa9923adf846ad864e/roles/3ad5428db28540d4939d37a2af902f78/inherited_to_projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:55.705537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ac532-fdbd-411f-85a4-e00940e29d84 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:check_grant(project_id=489c5d2e2386438ebeef20cbde1a2df6, user_id=957cc8f7afbb40aa9923adf846ad864e, role_id=3ad5428db28540d4939d37a2af902f78)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:55.708205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ac532-fdbd-411f-85a4-e00940e29d84 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:55.713755 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3937/7819] 10.222.0.33 () {58 vars in 1564 bytes} [Sat Aug 6 21:35:55 2022] HEAD /identity/v3/OS-INHERIT/projects/489c5d2e2386438ebeef20cbde1a2df6/users/957cc8f7afbb40aa9923adf846ad864e/roles/3ad5428db28540d4939d37a2af902f78/inherited_to_projects => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:35:55.717936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a14179-03d7-4fc9-bc15-be09a9e815ae tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:55.728819 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a14179-03d7-4fc9-bc15-be09a9e815ae tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:55.733456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc316e3-fb36-45a9-814d-a433fc535ff3 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:55.734107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc316e3-fb36-45a9-814d-a433fc535ff3 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:55.734430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc316e3-fb36-45a9-814d-a433fc535ff3 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:55.734757 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc316e3-fb36-45a9-814d-a433fc535ff3 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/489c5d2e2386438ebeef20cbde1a2df6/users/957cc8f7afbb40aa9923adf846ad864e/roles/3ad5428db28540d4939d37a2af902f78/inherited_to_projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:55.736963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc316e3-fb36-45a9-814d-a433fc535ff3 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=489c5d2e2386438ebeef20cbde1a2df6, user_id=957cc8f7afbb40aa9923adf846ad864e, role_id=3ad5428db28540d4939d37a2af902f78)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:55.739701 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc316e3-fb36-45a9-814d-a433fc535ff3 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:55.745317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4fc316e3-fb36-45a9-814d-a433fc535ff3 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invalidating the token cache because role 3ad5428db28540d4939d37a2af902f78 was removed from user 957cc8f7afbb40aa9923adf846ad864e on project 489c5d2e2386438ebeef20cbde1a2df6. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:35:55.745609 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4fc316e3-fb36-45a9-814d-a433fc535ff3 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:55.746281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4fc316e3-fb36-45a9-814d-a433fc535ff3 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:55.759538 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3883/7820] 10.222.0.33 () {58 vars in 1566 bytes} [Sat Aug 6 21:35:55 2022] DELETE /identity/v3/OS-INHERIT/projects/489c5d2e2386438ebeef20cbde1a2df6/users/957cc8f7afbb40aa9923adf846ad864e/roles/3ad5428db28540d4939d37a2af902f78/inherited_to_projects => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:35:55.763612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ac532-fdbd-411f-85a4-e00940e29d84 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:55.765388 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-da1ac532-fdbd-411f-85a4-e00940e29d84 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:35:55.777828 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ac532-fdbd-411f-85a4-e00940e29d84 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:55.834832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad003a-4001-4e36-be84-d4543c27c257 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:55.836707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad003a-4001-4e36-be84-d4543c27c257 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:55.837020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad003a-4001-4e36-be84-d4543c27c257 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:55.837305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad003a-4001-4e36-be84-d4543c27c257 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/roles/3ad5428db28540d4939d37a2af902f78` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:55.838740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad003a-4001-4e36-be84-d4543c27c257 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3ad5428db28540d4939d37a2af902f78)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:55.840334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad003a-4001-4e36-be84-d4543c27c257 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:55.873605 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bbad003a-4001-4e36-be84-d4543c27c257 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invalidating the token cache because role 3ad5428db28540d4939d37a2af902f78 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:35:55.873827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bbad003a-4001-4e36-be84-d4543c27c257 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:55.874490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bbad003a-4001-4e36-be84-d4543c27c257 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:55.876304 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3938/7821] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:35:55 2022] DELETE /identity/v3/roles/3ad5428db28540d4939d37a2af902f78 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:35:55.881318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc316e3-fb36-45a9-814d-a433fc535ff3 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:55.892159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc316e3-fb36-45a9-814d-a433fc535ff3 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:55.949098 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29e751-37b3-44f0-97b8-70a7b5cdfbd0 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:55.949795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29e751-37b3-44f0-97b8-70a7b5cdfbd0 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:55.950003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29e751-37b3-44f0-97b8-70a7b5cdfbd0 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:55.950284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29e751-37b3-44f0-97b8-70a7b5cdfbd0 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:55.950969 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29e751-37b3-44f0-97b8-70a7b5cdfbd0 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:55.952598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29e751-37b3-44f0-97b8-70a7b5cdfbd0 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:55.955976 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:35:55.969821 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3884/7822] 10.222.0.33 () {60 vars in 1143 bytes} [Sat Aug 6 21:35:55 2022] POST /identity/v3/roles => generated 239 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:35:55.974039 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad003a-4001-4e36-be84-d4543c27c257 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:55.975620 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-bbad003a-4001-4e36-be84-d4543c27c257 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:35:55.988776 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad003a-4001-4e36-be84-d4543c27c257 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:55.993488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0d497-0d52-4e94-8232-ac3fde6d8cdb tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:55.994147 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0d497-0d52-4e94-8232-ac3fde6d8cdb tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:55.994428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0d497-0d52-4e94-8232-ac3fde6d8cdb tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:55.994735 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0d497-0d52-4e94-8232-ac3fde6d8cdb tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/2613968d8fcb4c36b3600c825c2aad17/groups/53db407fd5574bbaa0b38d6b79f8d30a/roles/d1857d42aece44f1bc1cd78e82d89f54/inherited_to_projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:55.996861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0d497-0d52-4e94-8232-ac3fde6d8cdb tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=2613968d8fcb4c36b3600c825c2aad17, group_id=53db407fd5574bbaa0b38d6b79f8d30a, role_id=d1857d42aece44f1bc1cd78e82d89f54)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:55.999531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0d497-0d52-4e94-8232-ac3fde6d8cdb tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:56.011907 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3939/7823] 10.222.0.33 () {60 vars in 1582 bytes} [Sat Aug 6 21:35:55 2022] PUT /identity/v3/OS-INHERIT/domains/2613968d8fcb4c36b3600c825c2aad17/groups/53db407fd5574bbaa0b38d6b79f8d30a/roles/d1857d42aece44f1bc1cd78e82d89f54/inherited_to_projects => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:35:56.016131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29e751-37b3-44f0-97b8-70a7b5cdfbd0 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:56.026618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29e751-37b3-44f0-97b8-70a7b5cdfbd0 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:56.081836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720aeaec-a477-49cf-ab90-8046fe98a983 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:56.082503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720aeaec-a477-49cf-ab90-8046fe98a983 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:56.082995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720aeaec-a477-49cf-ab90-8046fe98a983 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:56.083354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720aeaec-a477-49cf-ab90-8046fe98a983 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/2613968d8fcb4c36b3600c825c2aad17/groups/53db407fd5574bbaa0b38d6b79f8d30a/roles/inherited_to_projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:56.084964 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720aeaec-a477-49cf-ab90-8046fe98a983 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=2613968d8fcb4c36b3600c825c2aad17, group_id=53db407fd5574bbaa0b38d6b79f8d30a)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:56.086838 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-720aeaec-a477-49cf-ab90-8046fe98a983 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:35:56.086838 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:35:56.086838 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:35:56.088637 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720aeaec-a477-49cf-ab90-8046fe98a983 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:56.100359 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3885/7824] 10.222.0.33 () {58 vars in 1464 bytes} [Sat Aug 6 21:35:56 2022] GET /identity/v3/OS-INHERIT/domains/2613968d8fcb4c36b3600c825c2aad17/groups/53db407fd5574bbaa0b38d6b79f8d30a/roles/inherited_to_projects => generated 447 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:35:56.105626 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0d497-0d52-4e94-8232-ac3fde6d8cdb tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:56.115915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0d497-0d52-4e94-8232-ac3fde6d8cdb tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:56.120675 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636cdd4-5492-4de0-b244-a3b1942f1a31 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:56.121324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636cdd4-5492-4de0-b244-a3b1942f1a31 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `HEAD` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:56.121610 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636cdd4-5492-4de0-b244-a3b1942f1a31 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:56.121889 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636cdd4-5492-4de0-b244-a3b1942f1a31 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/2613968d8fcb4c36b3600c825c2aad17/groups/53db407fd5574bbaa0b38d6b79f8d30a/roles/d1857d42aece44f1bc1cd78e82d89f54/inherited_to_projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:56.124131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636cdd4-5492-4de0-b244-a3b1942f1a31 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=2613968d8fcb4c36b3600c825c2aad17, group_id=53db407fd5574bbaa0b38d6b79f8d30a, role_id=d1857d42aece44f1bc1cd78e82d89f54)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:56.126757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636cdd4-5492-4de0-b244-a3b1942f1a31 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:56.132561 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3940/7825] 10.222.0.33 () {58 vars in 1564 bytes} [Sat Aug 6 21:35:56 2022] HEAD /identity/v3/OS-INHERIT/domains/2613968d8fcb4c36b3600c825c2aad17/groups/53db407fd5574bbaa0b38d6b79f8d30a/roles/d1857d42aece44f1bc1cd78e82d89f54/inherited_to_projects => generated 0 bytes in 27 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:35:56.136410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720aeaec-a477-49cf-ab90-8046fe98a983 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:56.146007 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720aeaec-a477-49cf-ab90-8046fe98a983 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:56.151245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e225dd-1761-4da9-966b-e93f67d4cefb tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:56.151883 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e225dd-1761-4da9-966b-e93f67d4cefb tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:56.152164 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e225dd-1761-4da9-966b-e93f67d4cefb tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:56.152438 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e225dd-1761-4da9-966b-e93f67d4cefb tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/2613968d8fcb4c36b3600c825c2aad17/groups/53db407fd5574bbaa0b38d6b79f8d30a/roles/d1857d42aece44f1bc1cd78e82d89f54/inherited_to_projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:56.154530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e225dd-1761-4da9-966b-e93f67d4cefb tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=2613968d8fcb4c36b3600c825c2aad17, group_id=53db407fd5574bbaa0b38d6b79f8d30a, role_id=d1857d42aece44f1bc1cd78e82d89f54)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:56.157247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e225dd-1761-4da9-966b-e93f67d4cefb tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:56.162175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-00e225dd-1761-4da9-966b-e93f67d4cefb tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invalidating the token cache because role d1857d42aece44f1bc1cd78e82d89f54 was removed from group 53db407fd5574bbaa0b38d6b79f8d30a on domain 2613968d8fcb4c36b3600c825c2aad17. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:35:56.162461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-00e225dd-1761-4da9-966b-e93f67d4cefb tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:56.163146 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-00e225dd-1761-4da9-966b-e93f67d4cefb tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:56.176638 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3886/7826] 10.222.0.33 () {58 vars in 1566 bytes} [Sat Aug 6 21:35:56 2022] DELETE /identity/v3/OS-INHERIT/domains/2613968d8fcb4c36b3600c825c2aad17/groups/53db407fd5574bbaa0b38d6b79f8d30a/roles/d1857d42aece44f1bc1cd78e82d89f54/inherited_to_projects => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:35:56.180917 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636cdd4-5492-4de0-b244-a3b1942f1a31 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:56.182732 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3636cdd4-5492-4de0-b244-a3b1942f1a31 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:35:56.195874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636cdd4-5492-4de0-b244-a3b1942f1a31 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:56.252866 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc11bd8-ce29-4141-9db3-b17ee67b4e14 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:56.253495 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc11bd8-ce29-4141-9db3-b17ee67b4e14 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:56.253783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc11bd8-ce29-4141-9db3-b17ee67b4e14 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:56.254064 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc11bd8-ce29-4141-9db3-b17ee67b4e14 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/roles/d1857d42aece44f1bc1cd78e82d89f54` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:56.255489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc11bd8-ce29-4141-9db3-b17ee67b4e14 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d1857d42aece44f1bc1cd78e82d89f54)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:56.257085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc11bd8-ce29-4141-9db3-b17ee67b4e14 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:56.264896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:35:56.294220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0bc11bd8-ce29-4141-9db3-b17ee67b4e14 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invalidating the token cache because role d1857d42aece44f1bc1cd78e82d89f54 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:35:56.294504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0bc11bd8-ce29-4141-9db3-b17ee67b4e14 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:56.295220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0bc11bd8-ce29-4141-9db3-b17ee67b4e14 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:56.297232 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3941/7827] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:35:56 2022] DELETE /identity/v3/roles/d1857d42aece44f1bc1cd78e82d89f54 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:35:56.302487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e225dd-1761-4da9-966b-e93f67d4cefb tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:56.312858 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e225dd-1761-4da9-966b-e93f67d4cefb tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:56.369701 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084a278-681f-469d-a134-651295666347 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:56.370313 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084a278-681f-469d-a134-651295666347 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:56.370627 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084a278-681f-469d-a134-651295666347 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:56.370904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084a278-681f-469d-a134-651295666347 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:56.371558 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0084a278-681f-469d-a134-651295666347 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:56.373181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0084a278-681f-469d-a134-651295666347 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:56.388108 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3887/7828] 10.222.0.33 () {60 vars in 1143 bytes} [Sat Aug 6 21:35:56 2022] POST /identity/v3/roles => generated 239 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:35:56.392413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc11bd8-ce29-4141-9db3-b17ee67b4e14 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:56.393923 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0bc11bd8-ce29-4141-9db3-b17ee67b4e14 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:35:56.407389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc11bd8-ce29-4141-9db3-b17ee67b4e14 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:56.411993 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b439d55-ef67-4a8f-b2b7-ea25f6346b19 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:56.412641 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b439d55-ef67-4a8f-b2b7-ea25f6346b19 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:56.412921 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b439d55-ef67-4a8f-b2b7-ea25f6346b19 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:56.413195 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b439d55-ef67-4a8f-b2b7-ea25f6346b19 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/2613968d8fcb4c36b3600c825c2aad17/users/957cc8f7afbb40aa9923adf846ad864e/roles/52d7c86072b64db5bcad8c6ba8aef566/inherited_to_projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:56.415795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b439d55-ef67-4a8f-b2b7-ea25f6346b19 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=2613968d8fcb4c36b3600c825c2aad17, user_id=957cc8f7afbb40aa9923adf846ad864e, role_id=52d7c86072b64db5bcad8c6ba8aef566)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:56.418430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b439d55-ef67-4a8f-b2b7-ea25f6346b19 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:56.430451 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3942/7829] 10.222.0.33 () {60 vars in 1579 bytes} [Sat Aug 6 21:35:56 2022] PUT /identity/v3/OS-INHERIT/domains/2613968d8fcb4c36b3600c825c2aad17/users/957cc8f7afbb40aa9923adf846ad864e/roles/52d7c86072b64db5bcad8c6ba8aef566/inherited_to_projects => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:35:56.434586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084a278-681f-469d-a134-651295666347 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:56.445995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084a278-681f-469d-a134-651295666347 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:56.503208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be402a-f13c-4d94-980d-fee8bd37992c tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:56.503900 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be402a-f13c-4d94-980d-fee8bd37992c tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:56.504247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be402a-f13c-4d94-980d-fee8bd37992c tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:56.504536 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be402a-f13c-4d94-980d-fee8bd37992c tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/2613968d8fcb4c36b3600c825c2aad17/users/957cc8f7afbb40aa9923adf846ad864e/roles/inherited_to_projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:56.506217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be402a-f13c-4d94-980d-fee8bd37992c tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=2613968d8fcb4c36b3600c825c2aad17, user_id=957cc8f7afbb40aa9923adf846ad864e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:56.509297 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be402a-f13c-4d94-980d-fee8bd37992c tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:56.512179 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:INSERT=2,keystone:SELECT=97,keystone:DELETE=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:35:56.528778 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3888/7830] 10.222.0.33 () {58 vars in 1461 bytes} [Sat Aug 6 21:35:56 2022] GET /identity/v3/OS-INHERIT/domains/2613968d8fcb4c36b3600c825c2aad17/users/957cc8f7afbb40aa9923adf846ad864e/roles/inherited_to_projects => generated 446 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:35:56.534642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b439d55-ef67-4a8f-b2b7-ea25f6346b19 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:56.545011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b439d55-ef67-4a8f-b2b7-ea25f6346b19 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:56.549917 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea66a5-9ef7-4d7a-91f4-0c7063060bd7 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:56.550596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea66a5-9ef7-4d7a-91f4-0c7063060bd7 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `HEAD` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:56.550884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea66a5-9ef7-4d7a-91f4-0c7063060bd7 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:56.551166 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea66a5-9ef7-4d7a-91f4-0c7063060bd7 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/2613968d8fcb4c36b3600c825c2aad17/users/957cc8f7afbb40aa9923adf846ad864e/roles/52d7c86072b64db5bcad8c6ba8aef566/inherited_to_projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:56.553330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceea66a5-9ef7-4d7a-91f4-0c7063060bd7 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=2613968d8fcb4c36b3600c825c2aad17, user_id=957cc8f7afbb40aa9923adf846ad864e, role_id=52d7c86072b64db5bcad8c6ba8aef566)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:56.556135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceea66a5-9ef7-4d7a-91f4-0c7063060bd7 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:56.561793 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3943/7831] 10.222.0.33 () {58 vars in 1561 bytes} [Sat Aug 6 21:35:56 2022] HEAD /identity/v3/OS-INHERIT/domains/2613968d8fcb4c36b3600c825c2aad17/users/957cc8f7afbb40aa9923adf846ad864e/roles/52d7c86072b64db5bcad8c6ba8aef566/inherited_to_projects => generated 0 bytes in 28 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:35:56.565720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be402a-f13c-4d94-980d-fee8bd37992c tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:56.576951 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be402a-f13c-4d94-980d-fee8bd37992c tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:56.581997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9c775-3bb5-4d17-8fb7-faf93c423a80 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:56.582700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9c775-3bb5-4d17-8fb7-faf93c423a80 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:56.582985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9c775-3bb5-4d17-8fb7-faf93c423a80 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:56.583268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9c775-3bb5-4d17-8fb7-faf93c423a80 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/2613968d8fcb4c36b3600c825c2aad17/users/957cc8f7afbb40aa9923adf846ad864e/roles/52d7c86072b64db5bcad8c6ba8aef566/inherited_to_projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:56.585531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d9c775-3bb5-4d17-8fb7-faf93c423a80 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=2613968d8fcb4c36b3600c825c2aad17, user_id=957cc8f7afbb40aa9923adf846ad864e, role_id=52d7c86072b64db5bcad8c6ba8aef566)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:56.588383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d9c775-3bb5-4d17-8fb7-faf93c423a80 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:56.593550 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e1d9c775-3bb5-4d17-8fb7-faf93c423a80 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invalidating the token cache because role 52d7c86072b64db5bcad8c6ba8aef566 was removed from user 957cc8f7afbb40aa9923adf846ad864e on domain 2613968d8fcb4c36b3600c825c2aad17. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:35:56.593838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e1d9c775-3bb5-4d17-8fb7-faf93c423a80 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:56.594501 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e1d9c775-3bb5-4d17-8fb7-faf93c423a80 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:56.607274 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3889/7832] 10.222.0.33 () {58 vars in 1563 bytes} [Sat Aug 6 21:35:56 2022] DELETE /identity/v3/OS-INHERIT/domains/2613968d8fcb4c36b3600c825c2aad17/users/957cc8f7afbb40aa9923adf846ad864e/roles/52d7c86072b64db5bcad8c6ba8aef566/inherited_to_projects => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:35:56.611499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea66a5-9ef7-4d7a-91f4-0c7063060bd7 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:56.613228 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ceea66a5-9ef7-4d7a-91f4-0c7063060bd7 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:35:56.626261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea66a5-9ef7-4d7a-91f4-0c7063060bd7 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:56.687021 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed55640-2e51-4ec9-9d31-9fae022eade5 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:56.687648 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed55640-2e51-4ec9-9d31-9fae022eade5 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:56.687928 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed55640-2e51-4ec9-9d31-9fae022eade5 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:56.688201 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed55640-2e51-4ec9-9d31-9fae022eade5 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/roles/52d7c86072b64db5bcad8c6ba8aef566` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:56.689585 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed55640-2e51-4ec9-9d31-9fae022eade5 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:delete_role(role_id=52d7c86072b64db5bcad8c6ba8aef566)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:56.691194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed55640-2e51-4ec9-9d31-9fae022eade5 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:56.724868 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7ed55640-2e51-4ec9-9d31-9fae022eade5 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invalidating the token cache because role 52d7c86072b64db5bcad8c6ba8aef566 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:35:56.725164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7ed55640-2e51-4ec9-9d31-9fae022eade5 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:56.725830 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7ed55640-2e51-4ec9-9d31-9fae022eade5 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:56.728547 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3944/7833] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:35:56 2022] DELETE /identity/v3/roles/52d7c86072b64db5bcad8c6ba8aef566 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:35:56.733742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9c775-3bb5-4d17-8fb7-faf93c423a80 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:56.743940 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9c775-3bb5-4d17-8fb7-faf93c423a80 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:56.799795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b639c-80b0-4428-9e9e-fd83d5d0941f tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:56.800458 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b639c-80b0-4428-9e9e-fd83d5d0941f tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:56.800751 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b639c-80b0-4428-9e9e-fd83d5d0941f tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:56.801067 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b639c-80b0-4428-9e9e-fd83d5d0941f tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:56.801735 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424b639c-80b0-4428-9e9e-fd83d5d0941f tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:56.803378 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424b639c-80b0-4428-9e9e-fd83d5d0941f tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:56.817791 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3890/7834] 10.222.0.33 () {60 vars in 1143 bytes} [Sat Aug 6 21:35:56 2022] POST /identity/v3/roles => generated 239 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:35:56.822583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed55640-2e51-4ec9-9d31-9fae022eade5 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:56.823980 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7ed55640-2e51-4ec9-9d31-9fae022eade5 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:35:56.836527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed55640-2e51-4ec9-9d31-9fae022eade5 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:56.841304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d6d5d-0a2c-4347-b89c-57e23c237024 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:56.841897 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d6d5d-0a2c-4347-b89c-57e23c237024 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:56.842183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d6d5d-0a2c-4347-b89c-57e23c237024 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:56.842462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d6d5d-0a2c-4347-b89c-57e23c237024 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:56.843123 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d6d5d-0a2c-4347-b89c-57e23c237024 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:56.845009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d6d5d-0a2c-4347-b89c-57e23c237024 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:56.881703 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3945/7835] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:35:56 2022] POST /identity/v3/projects => generated 409 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:35:56.886030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b639c-80b0-4428-9e9e-fd83d5d0941f tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:56.896011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b639c-80b0-4428-9e9e-fd83d5d0941f tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:56.952113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d37368-96c1-4d3b-bb49-202eec8b25d0 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:56.952700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d37368-96c1-4d3b-bb49-202eec8b25d0 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:56.952984 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d37368-96c1-4d3b-bb49-202eec8b25d0 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:56.953266 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d37368-96c1-4d3b-bb49-202eec8b25d0 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/2613968d8fcb4c36b3600c825c2aad17/users/957cc8f7afbb40aa9923adf846ad864e/roles/660eab7feead49e19b642d487d44b6d9/inherited_to_projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:56.955486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d37368-96c1-4d3b-bb49-202eec8b25d0 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=2613968d8fcb4c36b3600c825c2aad17, user_id=957cc8f7afbb40aa9923adf846ad864e, role_id=660eab7feead49e19b642d487d44b6d9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:56.958145 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d37368-96c1-4d3b-bb49-202eec8b25d0 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:56.969385 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3891/7836] 10.222.0.33 () {60 vars in 1579 bytes} [Sat Aug 6 21:35:56 2022] PUT /identity/v3/OS-INHERIT/domains/2613968d8fcb4c36b3600c825c2aad17/users/957cc8f7afbb40aa9923adf846ad864e/roles/660eab7feead49e19b642d487d44b6d9/inherited_to_projects => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:35:56.973920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d6d5d-0a2c-4347-b89c-57e23c237024 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:56.984286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d6d5d-0a2c-4347-b89c-57e23c237024 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:57.027496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:35:57.041761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580023ac-add9-4f7d-b258-6b19d700a959 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:57.042363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580023ac-add9-4f7d-b258-6b19d700a959 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:57.042680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580023ac-add9-4f7d-b258-6b19d700a959 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:57.042961 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580023ac-add9-4f7d-b258-6b19d700a959 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:57.043672 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580023ac-add9-4f7d-b258-6b19d700a959 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Adding query filter params (scope.project.id=489c5d2e2386438ebeef20cbde1a2df6, user.id=957cc8f7afbb40aa9923adf846ad864e) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:35:57.043983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580023ac-add9-4f7d-b258-6b19d700a959 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:57.046075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580023ac-add9-4f7d-b258-6b19d700a959 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:57.091473 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3946/7837] 10.222.0.33 () {58 vars in 1356 bytes} [Sat Aug 6 21:35:56 2022] GET /identity/v3/role_assignments?scope.project.id=489c5d2e2386438ebeef20cbde1a2df6&user.id=957cc8f7afbb40aa9923adf846ad864e&effective => generated 648 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:35:57.096191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d37368-96c1-4d3b-bb49-202eec8b25d0 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:57.107438 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d37368-96c1-4d3b-bb49-202eec8b25d0 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:57.112104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48773f-4cf9-4f19-a3d6-124a23efbae8 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:57.112695 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48773f-4cf9-4f19-a3d6-124a23efbae8 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:57.112979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48773f-4cf9-4f19-a3d6-124a23efbae8 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:57.113260 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48773f-4cf9-4f19-a3d6-124a23efbae8 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:57.113979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48773f-4cf9-4f19-a3d6-124a23efbae8 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Adding query filter params (scope.project.id=8165603f9c3e4cb6ab72bbd46cee2f82, user.id=957cc8f7afbb40aa9923adf846ad864e) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:35:57.114288 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48773f-4cf9-4f19-a3d6-124a23efbae8 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:57.115335 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-3d48773f-4cf9-4f19-a3d6-124a23efbae8 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:35:57.115335 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:35:57.115335 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:35:57.116476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48773f-4cf9-4f19-a3d6-124a23efbae8 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:57.170377 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3892/7838] 10.222.0.33 () {58 vars in 1356 bytes} [Sat Aug 6 21:35:57 2022] GET /identity/v3/role_assignments?scope.project.id=8165603f9c3e4cb6ab72bbd46cee2f82&user.id=957cc8f7afbb40aa9923adf846ad864e&effective => generated 648 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:35:57.175023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580023ac-add9-4f7d-b258-6b19d700a959 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:57.185773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580023ac-add9-4f7d-b258-6b19d700a959 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:57.190488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933ecc8-c652-4779-bed6-e78429820a63 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:57.191177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933ecc8-c652-4779-bed6-e78429820a63 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:57.191457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933ecc8-c652-4779-bed6-e78429820a63 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:57.191732 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933ecc8-c652-4779-bed6-e78429820a63 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/2613968d8fcb4c36b3600c825c2aad17/users/957cc8f7afbb40aa9923adf846ad864e/roles/660eab7feead49e19b642d487d44b6d9/inherited_to_projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:57.193922 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1933ecc8-c652-4779-bed6-e78429820a63 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=2613968d8fcb4c36b3600c825c2aad17, user_id=957cc8f7afbb40aa9923adf846ad864e, role_id=660eab7feead49e19b642d487d44b6d9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:57.196921 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1933ecc8-c652-4779-bed6-e78429820a63 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:57.201910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1933ecc8-c652-4779-bed6-e78429820a63 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invalidating the token cache because role 660eab7feead49e19b642d487d44b6d9 was removed from user 957cc8f7afbb40aa9923adf846ad864e on domain 2613968d8fcb4c36b3600c825c2aad17. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:35:57.202250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1933ecc8-c652-4779-bed6-e78429820a63 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:57.202868 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1933ecc8-c652-4779-bed6-e78429820a63 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:57.215334 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3947/7839] 10.222.0.33 () {58 vars in 1563 bytes} [Sat Aug 6 21:35:57 2022] DELETE /identity/v3/OS-INHERIT/domains/2613968d8fcb4c36b3600c825c2aad17/users/957cc8f7afbb40aa9923adf846ad864e/roles/660eab7feead49e19b642d487d44b6d9/inherited_to_projects => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:35:57.219445 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48773f-4cf9-4f19-a3d6-124a23efbae8 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:57.221137 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3d48773f-4cf9-4f19-a3d6-124a23efbae8 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:35:57.234600 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48773f-4cf9-4f19-a3d6-124a23efbae8 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:57.239317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:35:57.292310 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2ecc1-5991-42cc-82d9-69f0968f14ea tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:57.292914 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2ecc1-5991-42cc-82d9-69f0968f14ea tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:57.293193 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2ecc1-5991-42cc-82d9-69f0968f14ea tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:57.293468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2ecc1-5991-42cc-82d9-69f0968f14ea tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:57.294181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf2ecc1-5991-42cc-82d9-69f0968f14ea tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Adding query filter params (scope.project.id=489c5d2e2386438ebeef20cbde1a2df6, user.id=957cc8f7afbb40aa9923adf846ad864e) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:35:57.294484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf2ecc1-5991-42cc-82d9-69f0968f14ea tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:57.296678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf2ecc1-5991-42cc-82d9-69f0968f14ea tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:57.337739 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3893/7840] 10.222.0.33 () {58 vars in 1356 bytes} [Sat Aug 6 21:35:57 2022] GET /identity/v3/role_assignments?scope.project.id=489c5d2e2386438ebeef20cbde1a2df6&user.id=957cc8f7afbb40aa9923adf846ad864e&effective => generated 228 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:35:57.341953 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933ecc8-c652-4779-bed6-e78429820a63 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:57.352898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933ecc8-c652-4779-bed6-e78429820a63 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:57.358099 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d651c-9b90-4c29-945c-35ef773c0737 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:57.358723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d651c-9b90-4c29-945c-35ef773c0737 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:57.359002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d651c-9b90-4c29-945c-35ef773c0737 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:57.359276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d651c-9b90-4c29-945c-35ef773c0737 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:57.360011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d651c-9b90-4c29-945c-35ef773c0737 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Adding query filter params (scope.project.id=8165603f9c3e4cb6ab72bbd46cee2f82, user.id=957cc8f7afbb40aa9923adf846ad864e) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:35:57.360316 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d651c-9b90-4c29-945c-35ef773c0737 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:57.362153 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d651c-9b90-4c29-945c-35ef773c0737 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:57.412449 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3948/7841] 10.222.0.33 () {58 vars in 1356 bytes} [Sat Aug 6 21:35:57 2022] GET /identity/v3/role_assignments?scope.project.id=8165603f9c3e4cb6ab72bbd46cee2f82&user.id=957cc8f7afbb40aa9923adf846ad864e&effective => generated 228 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:35:57.417144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2ecc1-5991-42cc-82d9-69f0968f14ea tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:57.427511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2ecc1-5991-42cc-82d9-69f0968f14ea tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:57.432478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab673ac8-1d82-4851-99c4-5bf8a5f82295 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:57.433100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab673ac8-1d82-4851-99c4-5bf8a5f82295 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:57.433385 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab673ac8-1d82-4851-99c4-5bf8a5f82295 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:57.433661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab673ac8-1d82-4851-99c4-5bf8a5f82295 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/projects/8165603f9c3e4cb6ab72bbd46cee2f82` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:57.434814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab673ac8-1d82-4851-99c4-5bf8a5f82295 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8165603f9c3e4cb6ab72bbd46cee2f82)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:57.436721 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab673ac8-1d82-4851-99c4-5bf8a5f82295 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:57.483078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ab673ac8-1d82-4851-99c4-5bf8a5f82295 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8165603f9c3e4cb6ab72bbd46cee2f82', 'request_id': 'req-ab673ac8-1d82-4851-99c4-5bf8a5f82295'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:57.488600 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ab673ac8-1d82-4851-99c4-5bf8a5f82295 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8165603f9c3e4cb6ab72bbd46cee2f82', 'request_id': 'req-ab673ac8-1d82-4851-99c4-5bf8a5f82295'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:57.494806 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ab673ac8-1d82-4851-99c4-5bf8a5f82295 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8165603f9c3e4cb6ab72bbd46cee2f82', 'request_id': 'req-ab673ac8-1d82-4851-99c4-5bf8a5f82295'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:57.506670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ab673ac8-1d82-4851-99c4-5bf8a5f82295 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] The token cache is being invalidate because project 8165603f9c3e4cb6ab72bbd46cee2f82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:35:57.506963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ab673ac8-1d82-4851-99c4-5bf8a5f82295 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:57.508063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ab673ac8-1d82-4851-99c4-5bf8a5f82295 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:57.509547 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3894/7842] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:35:57 2022] DELETE /identity/v3/projects/8165603f9c3e4cb6ab72bbd46cee2f82 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:35:57.513847 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d651c-9b90-4c29-945c-35ef773c0737 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:57.515601 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-825d651c-9b90-4c29-945c-35ef773c0737 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:35:57.529036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d651c-9b90-4c29-945c-35ef773c0737 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:57.593901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db2586b-f538-409f-958d-73ea634ed534 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:57.594777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2586b-f538-409f-958d-73ea634ed534 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:57.595057 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2586b-f538-409f-958d-73ea634ed534 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:57.595328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2586b-f538-409f-958d-73ea634ed534 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/roles/660eab7feead49e19b642d487d44b6d9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:57.596712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db2586b-f538-409f-958d-73ea634ed534 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:delete_role(role_id=660eab7feead49e19b642d487d44b6d9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:57.598303 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db2586b-f538-409f-958d-73ea634ed534 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:57.635032 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6db2586b-f538-409f-958d-73ea634ed534 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invalidating the token cache because role 660eab7feead49e19b642d487d44b6d9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:35:57.635322 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6db2586b-f538-409f-958d-73ea634ed534 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:57.635989 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6db2586b-f538-409f-958d-73ea634ed534 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:57.637783 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3949/7843] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:35:57 2022] DELETE /identity/v3/roles/660eab7feead49e19b642d487d44b6d9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:35:57.643037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab673ac8-1d82-4851-99c4-5bf8a5f82295 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:57.653254 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab673ac8-1d82-4851-99c4-5bf8a5f82295 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:57.706043 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:35:57.715215 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dda64c-aa1a-4808-8ed4-87df21758797 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:57.715820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dda64c-aa1a-4808-8ed4-87df21758797 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:57.716103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dda64c-aa1a-4808-8ed4-87df21758797 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:57.716380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dda64c-aa1a-4808-8ed4-87df21758797 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:57.717025 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dda64c-aa1a-4808-8ed4-87df21758797 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:57.718676 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dda64c-aa1a-4808-8ed4-87df21758797 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:57.733450 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3895/7844] 10.222.0.33 () {60 vars in 1143 bytes} [Sat Aug 6 21:35:57 2022] POST /identity/v3/roles => generated 240 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:35:57.737546 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db2586b-f538-409f-958d-73ea634ed534 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:57.738942 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6db2586b-f538-409f-958d-73ea634ed534 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:35:57.746674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:35:57.752941 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db2586b-f538-409f-958d-73ea634ed534 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:57.758271 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc7e37-828e-46ac-8cb2-1476d040dc72 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:57.758894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc7e37-828e-46ac-8cb2-1476d040dc72 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:57.759173 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc7e37-828e-46ac-8cb2-1476d040dc72 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:57.759444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc7e37-828e-46ac-8cb2-1476d040dc72 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:57.760056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc7e37-828e-46ac-8cb2-1476d040dc72 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:57.761939 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc7e37-828e-46ac-8cb2-1476d040dc72 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:57.799460 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3950/7845] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:35:57 2022] POST /identity/v3/projects => generated 409 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:35:57.800932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dda64c-aa1a-4808-8ed4-87df21758797 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:57.811231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dda64c-aa1a-4808-8ed4-87df21758797 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:57.867766 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a3f07-ee58-4378-bc21-9a7d205b6028 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:57.868429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a3f07-ee58-4378-bc21-9a7d205b6028 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:57.868714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a3f07-ee58-4378-bc21-9a7d205b6028 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:57.868992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a3f07-ee58-4378-bc21-9a7d205b6028 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/489c5d2e2386438ebeef20cbde1a2df6/users/957cc8f7afbb40aa9923adf846ad864e/roles/b908c0b7895341e682a601016573450a/inherited_to_projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:57.871232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a3f07-ee58-4378-bc21-9a7d205b6028 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:create_grant(project_id=489c5d2e2386438ebeef20cbde1a2df6, user_id=957cc8f7afbb40aa9923adf846ad864e, role_id=b908c0b7895341e682a601016573450a)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:57.873915 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a3f07-ee58-4378-bc21-9a7d205b6028 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:57.885878 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3896/7846] 10.222.0.33 () {60 vars in 1582 bytes} [Sat Aug 6 21:35:57 2022] PUT /identity/v3/OS-INHERIT/projects/489c5d2e2386438ebeef20cbde1a2df6/users/957cc8f7afbb40aa9923adf846ad864e/roles/b908c0b7895341e682a601016573450a/inherited_to_projects => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:35:57.890059 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc7e37-828e-46ac-8cb2-1476d040dc72 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:57.901019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc7e37-828e-46ac-8cb2-1476d040dc72 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:57.957068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5285a98-2c8f-4239-bcb9-89759026b8e3 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:57.957675 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5285a98-2c8f-4239-bcb9-89759026b8e3 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:57.957955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5285a98-2c8f-4239-bcb9-89759026b8e3 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:57.958226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5285a98-2c8f-4239-bcb9-89759026b8e3 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:57.958970 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5285a98-2c8f-4239-bcb9-89759026b8e3 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Adding query filter params (scope.project.id=fa831692ae624135b20a345f248227c5, user.id=957cc8f7afbb40aa9923adf846ad864e) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:35:57.959338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5285a98-2c8f-4239-bcb9-89759026b8e3 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:57.961854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5285a98-2c8f-4239-bcb9-89759026b8e3 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:58.014884 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3951/7847] 10.222.0.33 () {58 vars in 1356 bytes} [Sat Aug 6 21:35:57 2022] GET /identity/v3/role_assignments?scope.project.id=fa831692ae624135b20a345f248227c5&user.id=957cc8f7afbb40aa9923adf846ad864e&effective => generated 649 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:35:58.018950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a3f07-ee58-4378-bc21-9a7d205b6028 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:58.029777 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a3f07-ee58-4378-bc21-9a7d205b6028 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:58.034441 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5bc76-e5b0-4179-b483-e0e26e6d32e0 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:58.035130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5bc76-e5b0-4179-b483-e0e26e6d32e0 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:58.035414 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5bc76-e5b0-4179-b483-e0e26e6d32e0 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:58.035692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5bc76-e5b0-4179-b483-e0e26e6d32e0 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/489c5d2e2386438ebeef20cbde1a2df6/users/957cc8f7afbb40aa9923adf846ad864e/roles/b908c0b7895341e682a601016573450a/inherited_to_projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:58.037972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc5bc76-e5b0-4179-b483-e0e26e6d32e0 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=489c5d2e2386438ebeef20cbde1a2df6, user_id=957cc8f7afbb40aa9923adf846ad864e, role_id=b908c0b7895341e682a601016573450a)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:58.040911 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc5bc76-e5b0-4179-b483-e0e26e6d32e0 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:58.045845 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8dc5bc76-e5b0-4179-b483-e0e26e6d32e0 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invalidating the token cache because role b908c0b7895341e682a601016573450a was removed from user 957cc8f7afbb40aa9923adf846ad864e on project 489c5d2e2386438ebeef20cbde1a2df6. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:35:58.046393 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8dc5bc76-e5b0-4179-b483-e0e26e6d32e0 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:58.047100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8dc5bc76-e5b0-4179-b483-e0e26e6d32e0 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:58.059077 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3897/7848] 10.222.0.33 () {58 vars in 1566 bytes} [Sat Aug 6 21:35:58 2022] DELETE /identity/v3/OS-INHERIT/projects/489c5d2e2386438ebeef20cbde1a2df6/users/957cc8f7afbb40aa9923adf846ad864e/roles/b908c0b7895341e682a601016573450a/inherited_to_projects => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:35:58.063320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5285a98-2c8f-4239-bcb9-89759026b8e3 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:58.065027 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a5285a98-2c8f-4239-bcb9-89759026b8e3 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:35:58.078391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5285a98-2c8f-4239-bcb9-89759026b8e3 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:58.136516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16611b63-df33-4c78-801a-1e04598d69a6 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:58.137113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16611b63-df33-4c78-801a-1e04598d69a6 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:58.137398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16611b63-df33-4c78-801a-1e04598d69a6 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:58.137692 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16611b63-df33-4c78-801a-1e04598d69a6 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:58.138394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16611b63-df33-4c78-801a-1e04598d69a6 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Adding query filter params (scope.project.id=fa831692ae624135b20a345f248227c5, user.id=957cc8f7afbb40aa9923adf846ad864e) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:35:58.138736 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16611b63-df33-4c78-801a-1e04598d69a6 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:58.140582 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16611b63-df33-4c78-801a-1e04598d69a6 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:58.170516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:35:58.193369 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3952/7849] 10.222.0.33 () {58 vars in 1356 bytes} [Sat Aug 6 21:35:58 2022] GET /identity/v3/role_assignments?scope.project.id=fa831692ae624135b20a345f248227c5&user.id=957cc8f7afbb40aa9923adf846ad864e&effective => generated 228 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:35:58.198142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5bc76-e5b0-4179-b483-e0e26e6d32e0 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:58.208156 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5bc76-e5b0-4179-b483-e0e26e6d32e0 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:58.212765 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9498964-8f27-4606-acb0-66ae92157920 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:58.213370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9498964-8f27-4606-acb0-66ae92157920 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:58.213649 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9498964-8f27-4606-acb0-66ae92157920 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:58.213915 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9498964-8f27-4606-acb0-66ae92157920 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/projects/fa831692ae624135b20a345f248227c5` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:58.215041 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9498964-8f27-4606-acb0-66ae92157920 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fa831692ae624135b20a345f248227c5)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:58.216945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9498964-8f27-4606-acb0-66ae92157920 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:58.262620 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a9498964-8f27-4606-acb0-66ae92157920 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa831692ae624135b20a345f248227c5', 'request_id': 'req-a9498964-8f27-4606-acb0-66ae92157920'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:58.268066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a9498964-8f27-4606-acb0-66ae92157920 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa831692ae624135b20a345f248227c5', 'request_id': 'req-a9498964-8f27-4606-acb0-66ae92157920'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:58.274811 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a9498964-8f27-4606-acb0-66ae92157920 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa831692ae624135b20a345f248227c5', 'request_id': 'req-a9498964-8f27-4606-acb0-66ae92157920'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:58.287691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a9498964-8f27-4606-acb0-66ae92157920 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] The token cache is being invalidate because project fa831692ae624135b20a345f248227c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:35:58.287981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a9498964-8f27-4606-acb0-66ae92157920 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:58.289131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a9498964-8f27-4606-acb0-66ae92157920 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:58.290629 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3898/7850] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:35:58 2022] DELETE /identity/v3/projects/fa831692ae624135b20a345f248227c5 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:35:58.294795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16611b63-df33-4c78-801a-1e04598d69a6 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:58.296761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-16611b63-df33-4c78-801a-1e04598d69a6 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:35:58.309688 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16611b63-df33-4c78-801a-1e04598d69a6 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:58.366168 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef88f5-29a1-40e9-b2da-96bf1538d800 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:58.367398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef88f5-29a1-40e9-b2da-96bf1538d800 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:58.367681 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef88f5-29a1-40e9-b2da-96bf1538d800 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:58.367954 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef88f5-29a1-40e9-b2da-96bf1538d800 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/roles/b908c0b7895341e682a601016573450a` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:58.369338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef88f5-29a1-40e9-b2da-96bf1538d800 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b908c0b7895341e682a601016573450a)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:58.370954 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef88f5-29a1-40e9-b2da-96bf1538d800 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:58.404569 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-17ef88f5-29a1-40e9-b2da-96bf1538d800 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invalidating the token cache because role b908c0b7895341e682a601016573450a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:35:58.404860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-17ef88f5-29a1-40e9-b2da-96bf1538d800 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:58.405548 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-17ef88f5-29a1-40e9-b2da-96bf1538d800 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:58.407389 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3953/7851] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:35:58 2022] DELETE /identity/v3/roles/b908c0b7895341e682a601016573450a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:35:58.412231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9498964-8f27-4606-acb0-66ae92157920 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:58.422965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9498964-8f27-4606-acb0-66ae92157920 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:58.467787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:35:58.481203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d3883-9413-44e7-a686-070326eb8e54 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:58.481840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d3883-9413-44e7-a686-070326eb8e54 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:58.482126 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d3883-9413-44e7-a686-070326eb8e54 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:58.482403 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d3883-9413-44e7-a686-070326eb8e54 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/users/957cc8f7afbb40aa9923adf846ad864e` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:58.483614 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d3883-9413-44e7-a686-070326eb8e54 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:delete_user(user_id=957cc8f7afbb40aa9923adf846ad864e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:58.485536 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d3883-9413-44e7-a686-070326eb8e54 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:58.529049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2b5d3883-9413-44e7-a686-070326eb8e54 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '957cc8f7afbb40aa9923adf846ad864e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:58.529655 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2b5d3883-9413-44e7-a686-070326eb8e54 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '957cc8f7afbb40aa9923adf846ad864e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:58.530279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2b5d3883-9413-44e7-a686-070326eb8e54 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '957cc8f7afbb40aa9923adf846ad864e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:58.537537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2b5d3883-9413-44e7-a686-070326eb8e54 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '957cc8f7afbb40aa9923adf846ad864e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:58.550411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-2b5d3883-9413-44e7-a686-070326eb8e54 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '957cc8f7afbb40aa9923adf846ad864e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:58.562956 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3899/7852] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:35:58 2022] DELETE /identity/v3/users/957cc8f7afbb40aa9923adf846ad864e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:35:58.567078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef88f5-29a1-40e9-b2da-96bf1538d800 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:58.568496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-17ef88f5-29a1-40e9-b2da-96bf1538d800 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:35:58.581888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef88f5-29a1-40e9-b2da-96bf1538d800 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:58.643617 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4375403-8918-4bfa-87a0-35ca9f7f7132 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:58.644254 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4375403-8918-4bfa-87a0-35ca9f7f7132 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:58.644540 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4375403-8918-4bfa-87a0-35ca9f7f7132 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:58.644816 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4375403-8918-4bfa-87a0-35ca9f7f7132 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/groups/53db407fd5574bbaa0b38d6b79f8d30a` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:58.645994 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4375403-8918-4bfa-87a0-35ca9f7f7132 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:delete_group(group_id=53db407fd5574bbaa0b38d6b79f8d30a)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:58.648674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4375403-8918-4bfa-87a0-35ca9f7f7132 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:58.692515 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3954/7853] 10.222.0.33 () {58 vars in 1227 bytes} [Sat Aug 6 21:35:58 2022] DELETE /identity/v3/groups/53db407fd5574bbaa0b38d6b79f8d30a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:35:58.697117 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d3883-9413-44e7-a686-070326eb8e54 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:58.698555 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2b5d3883-9413-44e7-a686-070326eb8e54 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:35:58.711959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d3883-9413-44e7-a686-070326eb8e54 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:58.767791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3809b1-125e-49a5-9191-fa33eb3870eb tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:58.768429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3809b1-125e-49a5-9191-fa33eb3870eb tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:58.768714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3809b1-125e-49a5-9191-fa33eb3870eb tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:58.768991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3809b1-125e-49a5-9191-fa33eb3870eb tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/projects/489c5d2e2386438ebeef20cbde1a2df6` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:58.770139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3809b1-125e-49a5-9191-fa33eb3870eb tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:delete_project(project_id=489c5d2e2386438ebeef20cbde1a2df6)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:58.772158 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3809b1-125e-49a5-9191-fa33eb3870eb tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:58.819005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ad3809b1-125e-49a5-9191-fa33eb3870eb tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '489c5d2e2386438ebeef20cbde1a2df6', 'request_id': 'req-ad3809b1-125e-49a5-9191-fa33eb3870eb'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:58.824796 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ad3809b1-125e-49a5-9191-fa33eb3870eb tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '489c5d2e2386438ebeef20cbde1a2df6', 'request_id': 'req-ad3809b1-125e-49a5-9191-fa33eb3870eb'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:58.830985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ad3809b1-125e-49a5-9191-fa33eb3870eb tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '489c5d2e2386438ebeef20cbde1a2df6', 'request_id': 'req-ad3809b1-125e-49a5-9191-fa33eb3870eb'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:58.839336 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:35:58.845239 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ad3809b1-125e-49a5-9191-fa33eb3870eb tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] The token cache is being invalidate because project 489c5d2e2386438ebeef20cbde1a2df6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:35:58.845537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ad3809b1-125e-49a5-9191-fa33eb3870eb tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:58.846614 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ad3809b1-125e-49a5-9191-fa33eb3870eb tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:58.848268 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3900/7854] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:35:58 2022] DELETE /identity/v3/projects/489c5d2e2386438ebeef20cbde1a2df6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:35:58.852946 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4375403-8918-4bfa-87a0-35ca9f7f7132 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:58.854815 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b4375403-8918-4bfa-87a0-35ca9f7f7132 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:35:58.868084 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4375403-8918-4bfa-87a0-35ca9f7f7132 tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:58.871738 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:35:58.926055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b746935-d1ed-4c52-8b8f-28e3480b3f9c tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:58.926715 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b746935-d1ed-4c52-8b8f-28e3480b3f9c tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:58.927002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b746935-d1ed-4c52-8b8f-28e3480b3f9c tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:58.927275 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b746935-d1ed-4c52-8b8f-28e3480b3f9c tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/domains/2613968d8fcb4c36b3600c825c2aad17` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:58.928503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b746935-d1ed-4c52-8b8f-28e3480b3f9c tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2613968d8fcb4c36b3600c825c2aad17)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:58.930303 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b746935-d1ed-4c52-8b8f-28e3480b3f9c tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:58.951481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4b746935-d1ed-4c52-8b8f-28e3480b3f9c tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2613968d8fcb4c36b3600c825c2aad17'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:58.952165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4b746935-d1ed-4c52-8b8f-28e3480b3f9c tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2613968d8fcb4c36b3600c825c2aad17'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:58.978363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4b746935-d1ed-4c52-8b8f-28e3480b3f9c tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2613968d8fcb4c36b3600c825c2aad17'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:58.979044 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4b746935-d1ed-4c52-8b8f-28e3480b3f9c tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2613968d8fcb4c36b3600c825c2aad17'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:58.981428 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3955/7855] 10.222.0.33 () {60 vars in 1249 bytes} [Sat Aug 6 21:35:58 2022] PATCH /identity/v3/domains/2613968d8fcb4c36b3600c825c2aad17 => generated 277 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:35:58.985392 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3809b1-125e-49a5-9191-fa33eb3870eb tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:58.995874 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3809b1-125e-49a5-9191-fa33eb3870eb tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:59.052172 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e73854-630e-419a-b92e-7d7d4994f24d tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6cec948eaa042aca1527d9615989c02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f9842144494051bec9d99d4fab6b88', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:59.052799 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e73854-630e-419a-b92e-7d7d4994f24d tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:59.053080 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e73854-630e-419a-b92e-7d7d4994f24d tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:59.053352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e73854-630e-419a-b92e-7d7d4994f24d tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] PATH_INFO: `/v3/domains/2613968d8fcb4c36b3600c825c2aad17` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:59.064395 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e73854-630e-419a-b92e-7d7d4994f24d tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2613968d8fcb4c36b3600c825c2aad17)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:59.066000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e73854-630e-419a-b92e-7d7d4994f24d tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:59.089234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-55e73854-630e-419a-b92e-7d7d4994f24d tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2613968d8fcb4c36b3600c825c2aad17'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:59.098486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-55e73854-630e-419a-b92e-7d7d4994f24d tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2613968d8fcb4c36b3600c825c2aad17'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:59.137571 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-55e73854-630e-419a-b92e-7d7d4994f24d tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2613968d8fcb4c36b3600c825c2aad17', 'request_id': 'req-55e73854-630e-419a-b92e-7d7d4994f24d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:59.143088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-55e73854-630e-419a-b92e-7d7d4994f24d tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2613968d8fcb4c36b3600c825c2aad17', 'request_id': 'req-55e73854-630e-419a-b92e-7d7d4994f24d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:59.150088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-55e73854-630e-419a-b92e-7d7d4994f24d tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2613968d8fcb4c36b3600c825c2aad17', 'request_id': 'req-55e73854-630e-419a-b92e-7d7d4994f24d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:59.161953 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-55e73854-630e-419a-b92e-7d7d4994f24d tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] The token cache is being invalidate because project 2613968d8fcb4c36b3600c825c2aad17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:35:59.162401 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-55e73854-630e-419a-b92e-7d7d4994f24d tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:59.163074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-55e73854-630e-419a-b92e-7d7d4994f24d tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:59.172037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-55e73854-630e-419a-b92e-7d7d4994f24d tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2613968d8fcb4c36b3600c825c2aad17', 'request_id': 'req-55e73854-630e-419a-b92e-7d7d4994f24d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:59.172718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-55e73854-630e-419a-b92e-7d7d4994f24d tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2613968d8fcb4c36b3600c825c2aad17', 'request_id': 'req-55e73854-630e-419a-b92e-7d7d4994f24d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:59.173395 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-55e73854-630e-419a-b92e-7d7d4994f24d tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2613968d8fcb4c36b3600c825c2aad17', 'request_id': 'req-55e73854-630e-419a-b92e-7d7d4994f24d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:59.181807 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3901/7856] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:35:58 2022] DELETE /identity/v3/domains/2613968d8fcb4c36b3600c825c2aad17 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:35:59.185836 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b746935-d1ed-4c52-8b8f-28e3480b3f9c tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:59.187256 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4b746935-d1ed-4c52-8b8f-28e3480b3f9c tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:35:59.252527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b746935-d1ed-4c52-8b8f-28e3480b3f9c tempest-InheritsV3TestJSON-672731063 tempest-InheritsV3TestJSON-672731063-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:59.310121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5530d-fddb-4a9c-821d-c0210c4dbecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:59.310780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5530d-fddb-4a9c-821d-c0210c4dbecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:59.311066 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5530d-fddb-4a9c-821d-c0210c4dbecb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:59.311344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5530d-fddb-4a9c-821d-c0210c4dbecb admin admin] PATH_INFO: `/v3/users/121aac5c62c34b78bf67a113e42e3ff5` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:59.312503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a5530d-fddb-4a9c-821d-c0210c4dbecb admin admin] RBAC: Authorizing `identity:delete_user(user_id=121aac5c62c34b78bf67a113e42e3ff5)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:59.314419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a5530d-fddb-4a9c-821d-c0210c4dbecb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:59.336002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:35:59.362258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d7a5530d-fddb-4a9c-821d-c0210c4dbecb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '121aac5c62c34b78bf67a113e42e3ff5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:59.369843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d7a5530d-fddb-4a9c-821d-c0210c4dbecb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '121aac5c62c34b78bf67a113e42e3ff5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:59.370498 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d7a5530d-fddb-4a9c-821d-c0210c4dbecb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '121aac5c62c34b78bf67a113e42e3ff5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:59.371120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d7a5530d-fddb-4a9c-821d-c0210c4dbecb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '121aac5c62c34b78bf67a113e42e3ff5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:59.378390 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d7a5530d-fddb-4a9c-821d-c0210c4dbecb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '121aac5c62c34b78bf67a113e42e3ff5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:35:59.395710 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3956/7857] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:35:59 2022] DELETE /identity/v3/users/121aac5c62c34b78bf67a113e42e3ff5 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:35:59.400802 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a41308-aa7e-4b24-ad48-1f9107bc867f None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:59.401312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a41308-aa7e-4b24-ad48-1f9107bc867f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:59.401421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a41308-aa7e-4b24-ad48-1f9107bc867f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:59.422076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-c4a41308-aa7e-4b24-ad48-1f9107bc867f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:35:59.423334 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c4a41308-aa7e-4b24-ad48-1f9107bc867f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:35:59.452810 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:35:59.626576 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3902/7858] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:35:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:35:59.636937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5530d-fddb-4a9c-821d-c0210c4dbecb admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:35:59.638395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d7a5530d-fddb-4a9c-821d-c0210c4dbecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:35:59.703658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5530d-fddb-4a9c-821d-c0210c4dbecb admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:35:59.707232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559a0ca-48c1-43bf-b053-1467d88e4434 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:35:59.707851 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559a0ca-48c1-43bf-b053-1467d88e4434 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:35:59.708128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559a0ca-48c1-43bf-b053-1467d88e4434 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:35:59.708414 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559a0ca-48c1-43bf-b053-1467d88e4434 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:35:59.717309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d559a0ca-48c1-43bf-b053-1467d88e4434 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:35:59.718746 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d559a0ca-48c1-43bf-b053-1467d88e4434 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:35:59.728053 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3957/7859] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:35:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:35:59.999705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a41308-aa7e-4b24-ad48-1f9107bc867f None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:00.001250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c4a41308-aa7e-4b24-ad48-1f9107bc867f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:00.013807 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a41308-aa7e-4b24-ad48-1f9107bc867f None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:00.018709 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59d5c6-d5b1-4227-b8bd-d11da3b2cb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:00.019342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59d5c6-d5b1-4227-b8bd-d11da3b2cb6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:00.019623 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59d5c6-d5b1-4227-b8bd-d11da3b2cb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:00.019894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59d5c6-d5b1-4227-b8bd-d11da3b2cb6d admin admin] PATH_INFO: `/v3/projects/3997fec4736f44f7bb16f3f33b70451f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:00.021013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59d5c6-d5b1-4227-b8bd-d11da3b2cb6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3997fec4736f44f7bb16f3f33b70451f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:00.023527 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59d5c6-d5b1-4227-b8bd-d11da3b2cb6d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:00.069748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dd59d5c6-d5b1-4227-b8bd-d11da3b2cb6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3997fec4736f44f7bb16f3f33b70451f', 'request_id': 'req-dd59d5c6-d5b1-4227-b8bd-d11da3b2cb6d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:00.075583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dd59d5c6-d5b1-4227-b8bd-d11da3b2cb6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3997fec4736f44f7bb16f3f33b70451f', 'request_id': 'req-dd59d5c6-d5b1-4227-b8bd-d11da3b2cb6d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:00.081977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dd59d5c6-d5b1-4227-b8bd-d11da3b2cb6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3997fec4736f44f7bb16f3f33b70451f', 'request_id': 'req-dd59d5c6-d5b1-4227-b8bd-d11da3b2cb6d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:00.096219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dd59d5c6-d5b1-4227-b8bd-d11da3b2cb6d admin admin] The token cache is being invalidate because project 3997fec4736f44f7bb16f3f33b70451f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:36:00.096508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dd59d5c6-d5b1-4227-b8bd-d11da3b2cb6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:00.097158 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dd59d5c6-d5b1-4227-b8bd-d11da3b2cb6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:00.098687 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3903/7860] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:35:59 2022] DELETE /identity/v3/projects/3997fec4736f44f7bb16f3f33b70451f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:00.103491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559a0ca-48c1-43bf-b053-1467d88e4434 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:00.113163 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559a0ca-48c1-43bf-b053-1467d88e4434 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:00.173492 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa036f28-4f96-47cd-b899-fed85e06e878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:00.174127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa036f28-4f96-47cd-b899-fed85e06e878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:00.174412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa036f28-4f96-47cd-b899-fed85e06e878 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:00.174728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa036f28-4f96-47cd-b899-fed85e06e878 admin admin] PATH_INFO: `/v3/users/a6cec948eaa042aca1527d9615989c02` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:00.175852 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa036f28-4f96-47cd-b899-fed85e06e878 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6cec948eaa042aca1527d9615989c02)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:00.177777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa036f28-4f96-47cd-b899-fed85e06e878 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:00.221608 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:00.224491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-aa036f28-4f96-47cd-b899-fed85e06e878 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6cec948eaa042aca1527d9615989c02'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:00.233110 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-aa036f28-4f96-47cd-b899-fed85e06e878 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6cec948eaa042aca1527d9615989c02'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:00.233792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-aa036f28-4f96-47cd-b899-fed85e06e878 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6cec948eaa042aca1527d9615989c02'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:00.234378 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-aa036f28-4f96-47cd-b899-fed85e06e878 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6cec948eaa042aca1527d9615989c02'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:00.240709 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-aa036f28-4f96-47cd-b899-fed85e06e878 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6cec948eaa042aca1527d9615989c02'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:00.258424 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3958/7861] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:36:00 2022] DELETE /identity/v3/users/a6cec948eaa042aca1527d9615989c02 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:00.539430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59d5c6-d5b1-4227-b8bd-d11da3b2cb6d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:00.540927 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-dd59d5c6-d5b1-4227-b8bd-d11da3b2cb6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:00.555754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59d5c6-d5b1-4227-b8bd-d11da3b2cb6d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:00.613794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ef3d3-0953-4e31-830f-b55eeef3ab64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:00.614455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ef3d3-0953-4e31-830f-b55eeef3ab64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:00.614864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ef3d3-0953-4e31-830f-b55eeef3ab64 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:00.615151 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ef3d3-0953-4e31-830f-b55eeef3ab64 admin admin] PATH_INFO: `/v3/projects/24f9842144494051bec9d99d4fab6b88` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:00.616272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ef3d3-0953-4e31-830f-b55eeef3ab64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24f9842144494051bec9d99d4fab6b88)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:00.618936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ef3d3-0953-4e31-830f-b55eeef3ab64 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:00.664447 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fe7ef3d3-0953-4e31-830f-b55eeef3ab64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24f9842144494051bec9d99d4fab6b88', 'request_id': 'req-fe7ef3d3-0953-4e31-830f-b55eeef3ab64'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:00.670073 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fe7ef3d3-0953-4e31-830f-b55eeef3ab64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24f9842144494051bec9d99d4fab6b88', 'request_id': 'req-fe7ef3d3-0953-4e31-830f-b55eeef3ab64'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:00.673023 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:00.677575 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fe7ef3d3-0953-4e31-830f-b55eeef3ab64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24f9842144494051bec9d99d4fab6b88', 'request_id': 'req-fe7ef3d3-0953-4e31-830f-b55eeef3ab64'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:00.692471 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fe7ef3d3-0953-4e31-830f-b55eeef3ab64 admin admin] The token cache is being invalidate because project 24f9842144494051bec9d99d4fab6b88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:36:00.692762 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fe7ef3d3-0953-4e31-830f-b55eeef3ab64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:00.693392 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fe7ef3d3-0953-4e31-830f-b55eeef3ab64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:00.694949 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3904/7862] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:36:00 2022] DELETE /identity/v3/projects/24f9842144494051bec9d99d4fab6b88 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:00.700487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53301af7-9990-4a1c-9add-92e7f405831e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:00.700910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53301af7-9990-4a1c-9add-92e7f405831e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:00.701061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53301af7-9990-4a1c-9add-92e7f405831e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:00.722643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-53301af7-9990-4a1c-9add-92e7f405831e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:00.723871 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-53301af7-9990-4a1c-9add-92e7f405831e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:00.783076 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3959/7863] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:36:00.791118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69be809-26bb-4f52-be4b-04c1c91043be None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:00.791426 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69be809-26bb-4f52-be4b-04c1c91043be None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:00.791704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69be809-26bb-4f52-be4b-04c1c91043be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:00.810967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a69be809-26bb-4f52-be4b-04c1c91043be None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:00.812156 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a69be809-26bb-4f52-be4b-04c1c91043be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:00.820947 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3905/7864] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:36:00.825097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53301af7-9990-4a1c-9add-92e7f405831e None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:00.834755 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53301af7-9990-4a1c-9add-92e7f405831e None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:00.840408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffcc42-cfaa-4548-9559-721fbac3ebde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:00.841008 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffcc42-cfaa-4548-9559-721fbac3ebde admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:00.841284 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffcc42-cfaa-4548-9559-721fbac3ebde admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:00.841555 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffcc42-cfaa-4548-9559-721fbac3ebde admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:00.842193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dffcc42-cfaa-4548-9559-721fbac3ebde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:36:00.842493 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dffcc42-cfaa-4548-9559-721fbac3ebde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:00.844137 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dffcc42-cfaa-4548-9559-721fbac3ebde admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:00.855997 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3960/7865] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:36:00.860117 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69be809-26bb-4f52-be4b-04c1c91043be None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:00.869476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69be809-26bb-4f52-be4b-04c1c91043be None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:00.874141 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef40331-a410-4a15-9fec-c4eb2782426b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:00.874773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef40331-a410-4a15-9fec-c4eb2782426b admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:00.875049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef40331-a410-4a15-9fec-c4eb2782426b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:00.875320 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef40331-a410-4a15-9fec-c4eb2782426b admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:00.875938 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef40331-a410-4a15-9fec-c4eb2782426b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:00.877825 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef40331-a410-4a15-9fec-c4eb2782426b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:00.904850 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3906/7866] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:36:00 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:36:00.908951 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffcc42-cfaa-4548-9559-721fbac3ebde admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:00.919074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffcc42-cfaa-4548-9559-721fbac3ebde admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:00.976363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df9fb3-cd89-4e78-93af-43108eb3c28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:00.976977 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df9fb3-cd89-4e78-93af-43108eb3c28c admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:00.977352 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df9fb3-cd89-4e78-93af-43108eb3c28c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:00.977640 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df9fb3-cd89-4e78-93af-43108eb3c28c admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:00.978269 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df9fb3-cd89-4e78-93af-43108eb3c28c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:00.980229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df9fb3-cd89-4e78-93af-43108eb3c28c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:01.001119 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3961/7867] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:36:00 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:36:01.005254 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef40331-a410-4a15-9fec-c4eb2782426b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:01.016237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef40331-a410-4a15-9fec-c4eb2782426b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:01.020855 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fb600-aea4-464f-bf64-1a8d2cb22655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:01.021451 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fb600-aea4-464f-bf64-1a8d2cb22655 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:01.021728 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fb600-aea4-464f-bf64-1a8d2cb22655 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:01.021999 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fb600-aea4-464f-bf64-1a8d2cb22655 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:01.022689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14fb600-aea4-464f-bf64-1a8d2cb22655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:01.025457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14fb600-aea4-464f-bf64-1a8d2cb22655 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:01.035097 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3907/7868] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:36:01.038869 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df9fb3-cd89-4e78-93af-43108eb3c28c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:01.049361 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df9fb3-cd89-4e78-93af-43108eb3c28c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:01.054062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290744e-2c32-45d3-97cb-922eb37754bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:01.054667 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290744e-2c32-45d3-97cb-922eb37754bc admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:01.054950 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290744e-2c32-45d3-97cb-922eb37754bc admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:01.055293 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290744e-2c32-45d3-97cb-922eb37754bc admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:01.056014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e290744e-2c32-45d3-97cb-922eb37754bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:01.057723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e290744e-2c32-45d3-97cb-922eb37754bc admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:01.068233 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3962/7869] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:36:01.073204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fb600-aea4-464f-bf64-1a8d2cb22655 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:01.082974 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fb600-aea4-464f-bf64-1a8d2cb22655 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:01.087712 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f4add-bb11-4f87-824c-2596c504c60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:01.088347 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f4add-bb11-4f87-824c-2596c504c60c admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:01.088623 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f4add-bb11-4f87-824c-2596c504c60c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:01.088893 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f4add-bb11-4f87-824c-2596c504c60c admin admin] PATH_INFO: `/v3/projects/d6ac14185a3d403f880c91e16d16ad3c/users/b1aae12c1dae41f1944593068e4a4ded/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:01.103545 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f4add-bb11-4f87-824c-2596c504c60c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6ac14185a3d403f880c91e16d16ad3c, user_id=b1aae12c1dae41f1944593068e4a4ded, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:01.106155 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f4add-bb11-4f87-824c-2596c504c60c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:01.119006 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3908/7870] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:36:01 2022] PUT /identity/v3/projects/d6ac14185a3d403f880c91e16d16ad3c/users/b1aae12c1dae41f1944593068e4a4ded/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:01.128805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6d24c-fad9-4fa4-9fac-bb60e94c64a0 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:01.129087 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6d24c-fad9-4fa4-9fac-bb60e94c64a0 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:01.129357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6d24c-fad9-4fa4-9fac-bb60e94c64a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:01.156689 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-6cc6d24c-fad9-4fa4-9fac-bb60e94c64a0 None None] MFA Rules not processed for user `b1aae12c1dae41f1944593068e4a4ded`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:01.158067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6cc6d24c-fad9-4fa4-9fac-bb60e94c64a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:01.172044 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:01.224619 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3963/7871] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:36:01.229756 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f4add-bb11-4f87-824c-2596c504c60c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:01.289353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f4add-bb11-4f87-824c-2596c504c60c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:01.294700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17d6d6-0f5b-42df-909b-5aaa258af0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:01.295298 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17d6d6-0f5b-42df-909b-5aaa258af0d7 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:01.295578 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17d6d6-0f5b-42df-909b-5aaa258af0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:01.295850 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17d6d6-0f5b-42df-909b-5aaa258af0d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:01.296726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a17d6d6-0f5b-42df-909b-5aaa258af0d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:01.298624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a17d6d6-0f5b-42df-909b-5aaa258af0d7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:01.325886 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3909/7872] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:36:01 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:36:01.329967 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6d24c-fad9-4fa4-9fac-bb60e94c64a0 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:01.341658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6d24c-fad9-4fa4-9fac-bb60e94c64a0 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:01.396976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42a33c-6ea6-4417-a360-f452bc95d025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:01.397581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42a33c-6ea6-4417-a360-f452bc95d025 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:01.397861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42a33c-6ea6-4417-a360-f452bc95d025 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:01.398134 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42a33c-6ea6-4417-a360-f452bc95d025 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:01.399364 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c42a33c-6ea6-4417-a360-f452bc95d025 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:01.401374 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c42a33c-6ea6-4417-a360-f452bc95d025 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:01.422539 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3964/7873] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:36:01 2022] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:36:01.426443 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17d6d6-0f5b-42df-909b-5aaa258af0d7 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:01.436874 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17d6d6-0f5b-42df-909b-5aaa258af0d7 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:01.441647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50206e70-3336-499d-bd9e-402185658eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:01.442241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50206e70-3336-499d-bd9e-402185658eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:01.442518 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50206e70-3336-499d-bd9e-402185658eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:01.442842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50206e70-3336-499d-bd9e-402185658eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:01.443523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50206e70-3336-499d-bd9e-402185658eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:01.445070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50206e70-3336-499d-bd9e-402185658eb6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:01.455006 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3910/7874] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:36:01.459052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42a33c-6ea6-4417-a360-f452bc95d025 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:01.470060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42a33c-6ea6-4417-a360-f452bc95d025 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:01.474778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaaeedc-22bd-4e67-b70d-ad02c4133d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:01.475427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaaeedc-22bd-4e67-b70d-ad02c4133d85 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:01.475708 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaaeedc-22bd-4e67-b70d-ad02c4133d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:01.475987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaaeedc-22bd-4e67-b70d-ad02c4133d85 admin admin] PATH_INFO: `/v3/projects/624799a7dad94123b12d88512a9367e3/users/8b48c6fc2ce344ba9809537934d33a79/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:01.491724 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaaeedc-22bd-4e67-b70d-ad02c4133d85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=624799a7dad94123b12d88512a9367e3, user_id=8b48c6fc2ce344ba9809537934d33a79, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:01.495405 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaaeedc-22bd-4e67-b70d-ad02c4133d85 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:01.509932 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3965/7875] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:36:01 2022] PUT /identity/v3/projects/624799a7dad94123b12d88512a9367e3/users/8b48c6fc2ce344ba9809537934d33a79/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:01.513980 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50206e70-3336-499d-bd9e-402185658eb6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:01.523805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50206e70-3336-499d-bd9e-402185658eb6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:01.580159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10827bcd-e8d6-4403-b1fd-52f876dc62f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:01.580847 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10827bcd-e8d6-4403-b1fd-52f876dc62f4 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:01.581052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10827bcd-e8d6-4403-b1fd-52f876dc62f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:01.581339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10827bcd-e8d6-4403-b1fd-52f876dc62f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:01.581955 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10827bcd-e8d6-4403-b1fd-52f876dc62f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:01.583557 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10827bcd-e8d6-4403-b1fd-52f876dc62f4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:01.584759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:01.598185 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3911/7876] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:36:01.599399 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaaeedc-22bd-4e67-b70d-ad02c4133d85 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:01.611062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaaeedc-22bd-4e67-b70d-ad02c4133d85 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:01.615697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede6795-c248-43ad-8f59-b005072a2fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:01.616345 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede6795-c248-43ad-8f59-b005072a2fd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:01.616623 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede6795-c248-43ad-8f59-b005072a2fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:01.616896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede6795-c248-43ad-8f59-b005072a2fd5 admin admin] PATH_INFO: `/v3/projects/624799a7dad94123b12d88512a9367e3/users/8b48c6fc2ce344ba9809537934d33a79/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:01.618928 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede6795-c248-43ad-8f59-b005072a2fd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=624799a7dad94123b12d88512a9367e3, user_id=8b48c6fc2ce344ba9809537934d33a79, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:01.621551 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede6795-c248-43ad-8f59-b005072a2fd5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:01.632178 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3966/7877] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:36:01 2022] PUT /identity/v3/projects/624799a7dad94123b12d88512a9367e3/users/8b48c6fc2ce344ba9809537934d33a79/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:36:01.643998 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dad85-d36d-40fd-95d8-689d9e1a658d None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:01.644285 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dad85-d36d-40fd-95d8-689d9e1a658d None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:01.644562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dad85-d36d-40fd-95d8-689d9e1a658d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:01.675024 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-6d5dad85-d36d-40fd-95d8-689d9e1a658d None None] MFA Rules not processed for user `8b48c6fc2ce344ba9809537934d33a79`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:01.676153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6d5dad85-d36d-40fd-95d8-689d9e1a658d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:01.742482 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3912/7878] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:01 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:01.746852 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede6795-c248-43ad-8f59-b005072a2fd5 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:01.757966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede6795-c248-43ad-8f59-b005072a2fd5 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:01.763738 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8ad47-3102-4095-83de-b2f5a88da0f8 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b48c6fc2ce344ba9809537934d33a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '624799a7dad94123b12d88512a9367e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:01.764375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8ad47-3102-4095-83de-b2f5a88da0f8 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:01.764659 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8ad47-3102-4095-83de-b2f5a88da0f8 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:01.764936 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8ad47-3102-4095-83de-b2f5a88da0f8 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] PATH_INFO: `/v3/projects/d6ac14185a3d403f880c91e16d16ad3c` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:01.766075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e8ad47-3102-4095-83de-b2f5a88da0f8 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] RBAC: Authorizing `identity:get_project(project_id=d6ac14185a3d403f880c91e16d16ad3c)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:01.768176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e8ad47-3102-4095-83de-b2f5a88da0f8 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:01.769994 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3967/7879] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:36:01 2022] GET /identity/v3/projects/d6ac14185a3d403f880c91e16d16ad3c => generated 385 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:36:01.774537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5dad85-d36d-40fd-95d8-689d9e1a658d None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:01.784665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5dad85-d36d-40fd-95d8-689d9e1a658d None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:01.789466 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e933e1-4b81-4841-ae87-524827d6f733 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b48c6fc2ce344ba9809537934d33a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '624799a7dad94123b12d88512a9367e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:01.790193 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e933e1-4b81-4841-ae87-524827d6f733 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:01.790474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e933e1-4b81-4841-ae87-524827d6f733 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:01.790816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e933e1-4b81-4841-ae87-524827d6f733 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:01.791470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e933e1-4b81-4841-ae87-524827d6f733 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:01.793349 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e933e1-4b81-4841-ae87-524827d6f733 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:01.819905 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3913/7880] 10.222.0.33 () {60 vars in 1152 bytes} [Sat Aug 6 21:36:01 2022] POST /identity/v3/projects => generated 339 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:36:01.824937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8ad47-3102-4095-83de-b2f5a88da0f8 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:01.835216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8ad47-3102-4095-83de-b2f5a88da0f8 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:01.892998 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c603d-7a1b-4b82-baeb-7ac0bd25bfde tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b48c6fc2ce344ba9809537934d33a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '624799a7dad94123b12d88512a9367e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:01.893603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c603d-7a1b-4b82-baeb-7ac0bd25bfde tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:01.893887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c603d-7a1b-4b82-baeb-7ac0bd25bfde tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:01.894166 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c603d-7a1b-4b82-baeb-7ac0bd25bfde tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:01.894839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c603d-7a1b-4b82-baeb-7ac0bd25bfde tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:01.896823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c603d-7a1b-4b82-baeb-7ac0bd25bfde tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:01.904340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:01.914469 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3968/7881] 10.222.0.33 () {58 vars in 1131 bytes} [Sat Aug 6 21:36:01 2022] GET /identity/v3/projects => generated 3991 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:36:01.918732 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e933e1-4b81-4841-ae87-524827d6f733 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:01.929108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e933e1-4b81-4841-ae87-524827d6f733 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:01.934375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65277c37-09bf-46d1-b8c5-180e5d62921a tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b48c6fc2ce344ba9809537934d33a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '624799a7dad94123b12d88512a9367e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:01.935017 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65277c37-09bf-46d1-b8c5-180e5d62921a tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:01.935300 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65277c37-09bf-46d1-b8c5-180e5d62921a tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:01.935576 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65277c37-09bf-46d1-b8c5-180e5d62921a tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] PATH_INFO: `/v3/projects/d6ac14185a3d403f880c91e16d16ad3c` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:01.936699 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65277c37-09bf-46d1-b8c5-180e5d62921a tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] RBAC: Authorizing `identity:get_project(project_id=d6ac14185a3d403f880c91e16d16ad3c)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:01.938803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65277c37-09bf-46d1-b8c5-180e5d62921a tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:01.940387 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3914/7882] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:36:01 2022] GET /identity/v3/projects/d6ac14185a3d403f880c91e16d16ad3c => generated 385 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:36:01.944108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c603d-7a1b-4b82-baeb-7ac0bd25bfde tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:01.954823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c603d-7a1b-4b82-baeb-7ac0bd25bfde tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:01.959524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a1e6d-67e0-4c48-ad47-92c08d223a1b tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b48c6fc2ce344ba9809537934d33a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '624799a7dad94123b12d88512a9367e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:01.960178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a1e6d-67e0-4c48-ad47-92c08d223a1b tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:01.960608 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a1e6d-67e0-4c48-ad47-92c08d223a1b tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:01.960721 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a1e6d-67e0-4c48-ad47-92c08d223a1b tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] PATH_INFO: `/v3/projects/8a317d7b197b471c9649deec9c34e840` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:01.961958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a1e6d-67e0-4c48-ad47-92c08d223a1b tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] RBAC: Authorizing `identity:get_project(project_id=8a317d7b197b471c9649deec9c34e840)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:01.964065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a1e6d-67e0-4c48-ad47-92c08d223a1b tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:01.965672 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3969/7883] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:36:01 2022] GET /identity/v3/projects/8a317d7b197b471c9649deec9c34e840 => generated 339 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:36:01.970865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65277c37-09bf-46d1-b8c5-180e5d62921a tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:01.980928 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65277c37-09bf-46d1-b8c5-180e5d62921a tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:01.985678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374afbf-5701-49f7-88ad-d75d1f7e51f5 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b48c6fc2ce344ba9809537934d33a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '624799a7dad94123b12d88512a9367e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:01.986267 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374afbf-5701-49f7-88ad-d75d1f7e51f5 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:01.986601 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374afbf-5701-49f7-88ad-d75d1f7e51f5 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:01.986859 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374afbf-5701-49f7-88ad-d75d1f7e51f5 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:01.987488 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374afbf-5701-49f7-88ad-d75d1f7e51f5 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:01.989308 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374afbf-5701-49f7-88ad-d75d1f7e51f5 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:02.010565 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3915/7884] 10.222.0.33 () {58 vars in 1131 bytes} [Sat Aug 6 21:36:01 2022] GET /identity/v3/projects => generated 3991 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:36:02.015241 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a1e6d-67e0-4c48-ad47-92c08d223a1b tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:02.025215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a1e6d-67e0-4c48-ad47-92c08d223a1b tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:02.029846 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e779e-691b-4080-867f-182ec9caca08 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b48c6fc2ce344ba9809537934d33a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '624799a7dad94123b12d88512a9367e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:02.030656 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e779e-691b-4080-867f-182ec9caca08 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:02.030943 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e779e-691b-4080-867f-182ec9caca08 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:02.031223 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e779e-691b-4080-867f-182ec9caca08 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:02.031877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e779e-691b-4080-867f-182ec9caca08 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:36:02.032183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e779e-691b-4080-867f-182ec9caca08 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:02.034023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e779e-691b-4080-867f-182ec9caca08 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:02.054967 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3970/7885] 10.222.0.33 () {58 vars in 1166 bytes} [Sat Aug 6 21:36:02 2022] GET /identity/v3/projects?domain_id=default => generated 3660 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:36:02.059622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374afbf-5701-49f7-88ad-d75d1f7e51f5 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:02.069405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374afbf-5701-49f7-88ad-d75d1f7e51f5 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:02.074943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56c428-3263-488b-86a9-c796d5187723 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b48c6fc2ce344ba9809537934d33a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '624799a7dad94123b12d88512a9367e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:02.075531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56c428-3263-488b-86a9-c796d5187723 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:02.075815 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56c428-3263-488b-86a9-c796d5187723 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:02.076120 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56c428-3263-488b-86a9-c796d5187723 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:02.076753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56c428-3263-488b-86a9-c796d5187723 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:02.078624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56c428-3263-488b-86a9-c796d5187723 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:02.094227 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3916/7886] 10.222.0.33 () {58 vars in 1131 bytes} [Sat Aug 6 21:36:02 2022] GET /identity/v3/projects => generated 3991 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:36:02.098828 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e779e-691b-4080-867f-182ec9caca08 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:02.109002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e779e-691b-4080-867f-182ec9caca08 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:02.113890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3858cdc-fa39-49c8-8e91-0f0b41b2d2a1 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b48c6fc2ce344ba9809537934d33a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '624799a7dad94123b12d88512a9367e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:02.114484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3858cdc-fa39-49c8-8e91-0f0b41b2d2a1 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:02.114829 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3858cdc-fa39-49c8-8e91-0f0b41b2d2a1 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:02.115108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3858cdc-fa39-49c8-8e91-0f0b41b2d2a1 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:02.115764 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3858cdc-fa39-49c8-8e91-0f0b41b2d2a1 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:36:02.116070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3858cdc-fa39-49c8-8e91-0f0b41b2d2a1 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:02.118456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3858cdc-fa39-49c8-8e91-0f0b41b2d2a1 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:02.137150 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3971/7887] 10.222.0.33 () {58 vars in 1166 bytes} [Sat Aug 6 21:36:02 2022] GET /identity/v3/projects?domain_id=default => generated 3660 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:36:02.142512 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56c428-3263-488b-86a9-c796d5187723 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:02.152711 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56c428-3263-488b-86a9-c796d5187723 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:02.157537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dd787-72d9-4c9d-ba90-1b28deba04c7 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b48c6fc2ce344ba9809537934d33a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '624799a7dad94123b12d88512a9367e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:02.158127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dd787-72d9-4c9d-ba90-1b28deba04c7 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:02.158412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dd787-72d9-4c9d-ba90-1b28deba04c7 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:02.158725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dd787-72d9-4c9d-ba90-1b28deba04c7 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:02.159357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048dd787-72d9-4c9d-ba90-1b28deba04c7 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:02.161208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048dd787-72d9-4c9d-ba90-1b28deba04c7 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:02.176698 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3917/7888] 10.222.0.33 () {58 vars in 1131 bytes} [Sat Aug 6 21:36:02 2022] GET /identity/v3/projects => generated 3991 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:36:02.182138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3858cdc-fa39-49c8-8e91-0f0b41b2d2a1 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:02.192171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3858cdc-fa39-49c8-8e91-0f0b41b2d2a1 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:02.197647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71dc81-ddd1-4b45-a14e-096b3a08f774 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b48c6fc2ce344ba9809537934d33a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '624799a7dad94123b12d88512a9367e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:02.198242 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71dc81-ddd1-4b45-a14e-096b3a08f774 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:02.198525 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71dc81-ddd1-4b45-a14e-096b3a08f774 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:02.198829 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71dc81-ddd1-4b45-a14e-096b3a08f774 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:02.199486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d71dc81-ddd1-4b45-a14e-096b3a08f774 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-89372067) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:36:02.199792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d71dc81-ddd1-4b45-a14e-096b3a08f774 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:02.201635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d71dc81-ddd1-4b45-a14e-096b3a08f774 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:02.213092 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3972/7889] 10.222.0.33 () {58 vars in 1228 bytes} [Sat Aug 6 21:36:02 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-89372067 => generated 531 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:36:02.218194 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dd787-72d9-4c9d-ba90-1b28deba04c7 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:02.227968 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dd787-72d9-4c9d-ba90-1b28deba04c7 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:02.232574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564283c9-293e-4698-a019-17dd3c88d46d tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b48c6fc2ce344ba9809537934d33a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '624799a7dad94123b12d88512a9367e3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:02.233203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564283c9-293e-4698-a019-17dd3c88d46d tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:02.233487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564283c9-293e-4698-a019-17dd3c88d46d tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:02.233757 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564283c9-293e-4698-a019-17dd3c88d46d tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] PATH_INFO: `/v3/projects/8a317d7b197b471c9649deec9c34e840` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:02.234924 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564283c9-293e-4698-a019-17dd3c88d46d tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8a317d7b197b471c9649deec9c34e840)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:02.236807 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564283c9-293e-4698-a019-17dd3c88d46d tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:02.282089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-564283c9-293e-4698-a019-17dd3c88d46d tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a317d7b197b471c9649deec9c34e840', 'request_id': 'req-564283c9-293e-4698-a019-17dd3c88d46d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:02.287968 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-564283c9-293e-4698-a019-17dd3c88d46d tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a317d7b197b471c9649deec9c34e840', 'request_id': 'req-564283c9-293e-4698-a019-17dd3c88d46d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:02.294917 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-564283c9-293e-4698-a019-17dd3c88d46d tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a317d7b197b471c9649deec9c34e840', 'request_id': 'req-564283c9-293e-4698-a019-17dd3c88d46d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:02.303661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:02.309273 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-564283c9-293e-4698-a019-17dd3c88d46d tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] The token cache is being invalidate because project 8a317d7b197b471c9649deec9c34e840 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:36:02.309722 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-564283c9-293e-4698-a019-17dd3c88d46d tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:02.310831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-564283c9-293e-4698-a019-17dd3c88d46d tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:02.312452 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3918/7890] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:36:02 2022] DELETE /identity/v3/projects/8a317d7b197b471c9649deec9c34e840 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:02.316751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71dc81-ddd1-4b45-a14e-096b3a08f774 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:02.318559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7d71dc81-ddd1-4b45-a14e-096b3a08f774 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:02.383612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71dc81-ddd1-4b45-a14e-096b3a08f774 tempest-ListProjectsStaticTestJSON-246681845 tempest-ListProjectsStaticTestJSON-246681845-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:02.438841 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701b054-403a-49e4-851f-856d0a53981e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:02.439399 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701b054-403a-49e4-851f-856d0a53981e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:02.439678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701b054-403a-49e4-851f-856d0a53981e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:02.439950 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701b054-403a-49e4-851f-856d0a53981e admin admin] PATH_INFO: `/v3/users/b1aae12c1dae41f1944593068e4a4ded` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:02.441072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701b054-403a-49e4-851f-856d0a53981e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1aae12c1dae41f1944593068e4a4ded)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:02.443016 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701b054-403a-49e4-851f-856d0a53981e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:02.487508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e701b054-403a-49e4-851f-856d0a53981e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1aae12c1dae41f1944593068e4a4ded'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:02.494861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e701b054-403a-49e4-851f-856d0a53981e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1aae12c1dae41f1944593068e4a4ded'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:02.495534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e701b054-403a-49e4-851f-856d0a53981e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1aae12c1dae41f1944593068e4a4ded'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:02.496154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e701b054-403a-49e4-851f-856d0a53981e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1aae12c1dae41f1944593068e4a4ded'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:02.504150 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e701b054-403a-49e4-851f-856d0a53981e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1aae12c1dae41f1944593068e4a4ded'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:02.505383 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:02.523720 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3973/7891] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:36:02 2022] DELETE /identity/v3/users/b1aae12c1dae41f1944593068e4a4ded => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:02.528885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1db4a-b749-473e-b1eb-d400aa97f53d None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:02.529170 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1db4a-b749-473e-b1eb-d400aa97f53d None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:02.529440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1db4a-b749-473e-b1eb-d400aa97f53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:02.548543 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-01f1db4a-b749-473e-b1eb-d400aa97f53d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:02.549733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-01f1db4a-b749-473e-b1eb-d400aa97f53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:02.607274 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3919/7892] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:02.616944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701b054-403a-49e4-851f-856d0a53981e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:02.619183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e701b054-403a-49e4-851f-856d0a53981e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:02.682133 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701b054-403a-49e4-851f-856d0a53981e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:02.685871 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93c630-3553-4a47-a027-ea8b20bb4d27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:02.686473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93c630-3553-4a47-a027-ea8b20bb4d27 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:02.686789 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93c630-3553-4a47-a027-ea8b20bb4d27 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:02.687065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93c630-3553-4a47-a027-ea8b20bb4d27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:02.696245 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93c630-3553-4a47-a027-ea8b20bb4d27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:02.697744 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93c630-3553-4a47-a027-ea8b20bb4d27 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:02.707230 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3974/7893] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:36:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:36:02.973983 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1db4a-b749-473e-b1eb-d400aa97f53d None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:02.975414 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-01f1db4a-b749-473e-b1eb-d400aa97f53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:02.988780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1db4a-b749-473e-b1eb-d400aa97f53d None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:02.995532 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8347fda-6dc6-40ab-ba6c-5b78331291db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:02.996360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8347fda-6dc6-40ab-ba6c-5b78331291db admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:02.996569 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8347fda-6dc6-40ab-ba6c-5b78331291db admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:02.996855 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8347fda-6dc6-40ab-ba6c-5b78331291db admin admin] PATH_INFO: `/v3/projects/d6ac14185a3d403f880c91e16d16ad3c` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:02.998083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8347fda-6dc6-40ab-ba6c-5b78331291db admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6ac14185a3d403f880c91e16d16ad3c)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:03.000396 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8347fda-6dc6-40ab-ba6c-5b78331291db admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:03.048374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d8347fda-6dc6-40ab-ba6c-5b78331291db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6ac14185a3d403f880c91e16d16ad3c', 'request_id': 'req-d8347fda-6dc6-40ab-ba6c-5b78331291db'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:03.053815 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d8347fda-6dc6-40ab-ba6c-5b78331291db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6ac14185a3d403f880c91e16d16ad3c', 'request_id': 'req-d8347fda-6dc6-40ab-ba6c-5b78331291db'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:03.061175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d8347fda-6dc6-40ab-ba6c-5b78331291db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6ac14185a3d403f880c91e16d16ad3c', 'request_id': 'req-d8347fda-6dc6-40ab-ba6c-5b78331291db'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:03.073087 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d8347fda-6dc6-40ab-ba6c-5b78331291db admin admin] The token cache is being invalidate because project d6ac14185a3d403f880c91e16d16ad3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:36:03.073407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d8347fda-6dc6-40ab-ba6c-5b78331291db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:03.074148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d8347fda-6dc6-40ab-ba6c-5b78331291db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:03.075649 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3920/7894] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:36:02 2022] DELETE /identity/v3/projects/d6ac14185a3d403f880c91e16d16ad3c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:03.079630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93c630-3553-4a47-a027-ea8b20bb4d27 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:03.089423 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93c630-3553-4a47-a027-ea8b20bb4d27 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:03.144459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec5737-d17f-420a-a53e-5bb03d0c59cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:03.145074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec5737-d17f-420a-a53e-5bb03d0c59cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:03.145352 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec5737-d17f-420a-a53e-5bb03d0c59cc admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:03.145631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec5737-d17f-420a-a53e-5bb03d0c59cc admin admin] PATH_INFO: `/v3/users/8b48c6fc2ce344ba9809537934d33a79` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:03.146761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec5737-d17f-420a-a53e-5bb03d0c59cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b48c6fc2ce344ba9809537934d33a79)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:03.148665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec5737-d17f-420a-a53e-5bb03d0c59cc admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:03.193952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-75ec5737-d17f-420a-a53e-5bb03d0c59cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b48c6fc2ce344ba9809537934d33a79'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:03.200764 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-75ec5737-d17f-420a-a53e-5bb03d0c59cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b48c6fc2ce344ba9809537934d33a79'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:03.201440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-75ec5737-d17f-420a-a53e-5bb03d0c59cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b48c6fc2ce344ba9809537934d33a79'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:03.202081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-75ec5737-d17f-420a-a53e-5bb03d0c59cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b48c6fc2ce344ba9809537934d33a79'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:03.209231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-75ec5737-d17f-420a-a53e-5bb03d0c59cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b48c6fc2ce344ba9809537934d33a79'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:03.226297 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3975/7895] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:36:03 2022] DELETE /identity/v3/users/8b48c6fc2ce344ba9809537934d33a79 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:03.510360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8347fda-6dc6-40ab-ba6c-5b78331291db admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:03.512027 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d8347fda-6dc6-40ab-ba6c-5b78331291db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:03.525201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8347fda-6dc6-40ab-ba6c-5b78331291db admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:03.583707 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414784cc-c836-4b32-aa76-00158bed21fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:03.584337 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414784cc-c836-4b32-aa76-00158bed21fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:03.584618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414784cc-c836-4b32-aa76-00158bed21fd admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:03.584891 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414784cc-c836-4b32-aa76-00158bed21fd admin admin] PATH_INFO: `/v3/projects/624799a7dad94123b12d88512a9367e3` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:03.586021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414784cc-c836-4b32-aa76-00158bed21fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=624799a7dad94123b12d88512a9367e3)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:03.588064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414784cc-c836-4b32-aa76-00158bed21fd admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:03.612902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:03.637134 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-414784cc-c836-4b32-aa76-00158bed21fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '624799a7dad94123b12d88512a9367e3', 'request_id': 'req-414784cc-c836-4b32-aa76-00158bed21fd'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:03.642566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-414784cc-c836-4b32-aa76-00158bed21fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '624799a7dad94123b12d88512a9367e3', 'request_id': 'req-414784cc-c836-4b32-aa76-00158bed21fd'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:03.648619 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-414784cc-c836-4b32-aa76-00158bed21fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '624799a7dad94123b12d88512a9367e3', 'request_id': 'req-414784cc-c836-4b32-aa76-00158bed21fd'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:03.661177 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-414784cc-c836-4b32-aa76-00158bed21fd admin admin] The token cache is being invalidate because project 624799a7dad94123b12d88512a9367e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:36:03.661473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-414784cc-c836-4b32-aa76-00158bed21fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:03.662086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-414784cc-c836-4b32-aa76-00158bed21fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:03.663600 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3921/7896] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:36:03 2022] DELETE /identity/v3/projects/624799a7dad94123b12d88512a9367e3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:36:03.673309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16cbef-a6d4-4e3e-af22-9d77da3d238f None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:03.673309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16cbef-a6d4-4e3e-af22-9d77da3d238f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:03.673309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16cbef-a6d4-4e3e-af22-9d77da3d238f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:03.679562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:03.696955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-8c16cbef-a6d4-4e3e-af22-9d77da3d238f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:03.698274 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8c16cbef-a6d4-4e3e-af22-9d77da3d238f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:03.755609 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3976/7897] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:03.763787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be56e5d-1442-4a87-aa8f-206f9dd46f3d None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:03.764075 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be56e5d-1442-4a87-aa8f-206f9dd46f3d None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:03.764353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be56e5d-1442-4a87-aa8f-206f9dd46f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:03.783858 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-9be56e5d-1442-4a87-aa8f-206f9dd46f3d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:03.785094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9be56e5d-1442-4a87-aa8f-206f9dd46f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:03.793989 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3922/7898] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:03.798467 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16cbef-a6d4-4e3e-af22-9d77da3d238f None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:03.808923 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16cbef-a6d4-4e3e-af22-9d77da3d238f None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:03.813435 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29568ed0-80e0-44d2-ab40-72b90b1517fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:03.814019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29568ed0-80e0-44d2-ab40-72b90b1517fd admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:03.814299 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29568ed0-80e0-44d2-ab40-72b90b1517fd admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:03.814609 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29568ed0-80e0-44d2-ab40-72b90b1517fd admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:03.815251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29568ed0-80e0-44d2-ab40-72b90b1517fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:36:03.815556 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29568ed0-80e0-44d2-ab40-72b90b1517fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:03.817196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29568ed0-80e0-44d2-ab40-72b90b1517fd admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:03.828593 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3977/7899] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:36:03.832857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be56e5d-1442-4a87-aa8f-206f9dd46f3d None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:03.842144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be56e5d-1442-4a87-aa8f-206f9dd46f3d None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:03.846879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e060a8-bfa9-4408-947e-f83bb6518df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:03.847464 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e060a8-bfa9-4408-947e-f83bb6518df6 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:03.847772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e060a8-bfa9-4408-947e-f83bb6518df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:03.848050 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e060a8-bfa9-4408-947e-f83bb6518df6 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:03.848671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e060a8-bfa9-4408-947e-f83bb6518df6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:03.850648 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e060a8-bfa9-4408-947e-f83bb6518df6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:03.882630 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3923/7900] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:36:03 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:36:03.884086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29568ed0-80e0-44d2-ab40-72b90b1517fd admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:03.896451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29568ed0-80e0-44d2-ab40-72b90b1517fd admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:03.952474 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248106f-c875-4b8b-b91e-c6ade3b5c1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:03.953075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248106f-c875-4b8b-b91e-c6ade3b5c1f2 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:03.953351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248106f-c875-4b8b-b91e-c6ade3b5c1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:03.953622 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248106f-c875-4b8b-b91e-c6ade3b5c1f2 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:03.954237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a248106f-c875-4b8b-b91e-c6ade3b5c1f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:03.956171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a248106f-c875-4b8b-b91e-c6ade3b5c1f2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:03.976862 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3978/7901] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:36:03 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:36:03.981654 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e060a8-bfa9-4408-947e-f83bb6518df6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:03.991875 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e060a8-bfa9-4408-947e-f83bb6518df6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:03.997293 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4144ab-4ae5-47c0-ad96-f6285f4fff04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:03.997932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4144ab-4ae5-47c0-ad96-f6285f4fff04 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:03.998206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4144ab-4ae5-47c0-ad96-f6285f4fff04 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:03.998470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4144ab-4ae5-47c0-ad96-f6285f4fff04 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:03.999137 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4144ab-4ae5-47c0-ad96-f6285f4fff04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:04.000709 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4144ab-4ae5-47c0-ad96-f6285f4fff04 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:04.012262 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3924/7902] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:36:04.016158 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248106f-c875-4b8b-b91e-c6ade3b5c1f2 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:04.027106 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248106f-c875-4b8b-b91e-c6ade3b5c1f2 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:04.031771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99d8c3-8e26-401c-848f-b0fff4516287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:04.032417 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99d8c3-8e26-401c-848f-b0fff4516287 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:04.032700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99d8c3-8e26-401c-848f-b0fff4516287 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:04.032976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99d8c3-8e26-401c-848f-b0fff4516287 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:04.033612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99d8c3-8e26-401c-848f-b0fff4516287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:04.035253 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99d8c3-8e26-401c-848f-b0fff4516287 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:04.045115 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3979/7903] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:36:04.049317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4144ab-4ae5-47c0-ad96-f6285f4fff04 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:04.059425 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4144ab-4ae5-47c0-ad96-f6285f4fff04 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:04.064062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce0a4a-8233-4b9d-b96d-51f6018d0f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:04.064718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce0a4a-8233-4b9d-b96d-51f6018d0f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:04.065004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce0a4a-8233-4b9d-b96d-51f6018d0f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:04.065262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce0a4a-8233-4b9d-b96d-51f6018d0f0b admin admin] PATH_INFO: `/v3/projects/ed7c97ebf30f4733936b2f60874b72fe/users/a37c86512da54cc1aae536ebee063728/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:04.080347 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce0a4a-8233-4b9d-b96d-51f6018d0f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed7c97ebf30f4733936b2f60874b72fe, user_id=a37c86512da54cc1aae536ebee063728, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:04.083036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce0a4a-8233-4b9d-b96d-51f6018d0f0b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:04.096148 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3925/7904] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:36:04 2022] PUT /identity/v3/projects/ed7c97ebf30f4733936b2f60874b72fe/users/a37c86512da54cc1aae536ebee063728/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:04.108161 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f3fbc-4f39-469b-afb5-daa70d9b6be7 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:04.108656 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f3fbc-4f39-469b-afb5-daa70d9b6be7 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:04.108762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f3fbc-4f39-469b-afb5-daa70d9b6be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:04.137983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-4d9f3fbc-4f39-469b-afb5-daa70d9b6be7 None None] MFA Rules not processed for user `a37c86512da54cc1aae536ebee063728`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:04.139211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4d9f3fbc-4f39-469b-afb5-daa70d9b6be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:04.199529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:04.205757 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3980/7905] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:04.210108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce0a4a-8233-4b9d-b96d-51f6018d0f0b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:04.270818 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce0a4a-8233-4b9d-b96d-51f6018d0f0b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:04.275430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e7de1-ac58-403e-8864-484fd9e99d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:04.276017 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e7de1-ac58-403e-8864-484fd9e99d64 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:04.276294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e7de1-ac58-403e-8864-484fd9e99d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:04.276564 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e7de1-ac58-403e-8864-484fd9e99d64 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:04.277174 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e7de1-ac58-403e-8864-484fd9e99d64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:04.279085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e7de1-ac58-403e-8864-484fd9e99d64 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:04.304663 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3926/7906] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:36:04 2022] POST /identity/v3/projects => generated 371 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:36:04.309479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f3fbc-4f39-469b-afb5-daa70d9b6be7 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:04.320489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f3fbc-4f39-469b-afb5-daa70d9b6be7 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:04.378116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09684a-fa06-4806-a5db-c0b9116d583a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:04.378757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09684a-fa06-4806-a5db-c0b9116d583a admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:04.379041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09684a-fa06-4806-a5db-c0b9116d583a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:04.379320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09684a-fa06-4806-a5db-c0b9116d583a admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:04.379965 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd09684a-fa06-4806-a5db-c0b9116d583a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:04.381873 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd09684a-fa06-4806-a5db-c0b9116d583a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:04.403103 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3981/7907] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:36:04 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:36:04.407114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e7de1-ac58-403e-8864-484fd9e99d64 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:04.417651 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e7de1-ac58-403e-8864-484fd9e99d64 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:04.422499 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f8dd7-61ab-425f-a77a-0010d27d122a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:04.423126 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f8dd7-61ab-425f-a77a-0010d27d122a admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:04.423404 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f8dd7-61ab-425f-a77a-0010d27d122a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:04.423673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f8dd7-61ab-425f-a77a-0010d27d122a admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:04.424295 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f8dd7-61ab-425f-a77a-0010d27d122a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:04.425871 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f8dd7-61ab-425f-a77a-0010d27d122a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:04.436928 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3927/7908] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:36:04.440967 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09684a-fa06-4806-a5db-c0b9116d583a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:04.451896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09684a-fa06-4806-a5db-c0b9116d583a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:04.456672 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b609c8c-0243-4e65-a957-e00f600a8fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:04.457319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b609c8c-0243-4e65-a957-e00f600a8fec admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:04.457596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b609c8c-0243-4e65-a957-e00f600a8fec admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:04.457866 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b609c8c-0243-4e65-a957-e00f600a8fec admin admin] PATH_INFO: `/v3/projects/6224fc40313c48c9b8756ed244c90b8f/users/e3566eb24c8a47cf944d29c0d0f1bdb9/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:04.472405 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b609c8c-0243-4e65-a957-e00f600a8fec admin admin] RBAC: Authorizing `identity:create_grant(project_id=6224fc40313c48c9b8756ed244c90b8f, user_id=e3566eb24c8a47cf944d29c0d0f1bdb9, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:04.475433 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b609c8c-0243-4e65-a957-e00f600a8fec admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:04.487728 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3982/7909] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:36:04 2022] PUT /identity/v3/projects/6224fc40313c48c9b8756ed244c90b8f/users/e3566eb24c8a47cf944d29c0d0f1bdb9/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:04.491811 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f8dd7-61ab-425f-a77a-0010d27d122a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:04.502465 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f8dd7-61ab-425f-a77a-0010d27d122a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:04.520743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:04.563091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6e0a2-c833-4b12-b414-68e3a45d0ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:04.563622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6e0a2-c833-4b12-b414-68e3a45d0ceb admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:04.563899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6e0a2-c833-4b12-b414-68e3a45d0ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:04.564170 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6e0a2-c833-4b12-b414-68e3a45d0ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:04.564812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba6e0a2-c833-4b12-b414-68e3a45d0ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:04.566421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba6e0a2-c833-4b12-b414-68e3a45d0ceb admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:04.576713 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3928/7910] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:36:04.581066 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b609c8c-0243-4e65-a957-e00f600a8fec admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:04.591677 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b609c8c-0243-4e65-a957-e00f600a8fec admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:04.596290 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c7cc0-a1ff-4050-b311-1c61cb6250fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:04.596925 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c7cc0-a1ff-4050-b311-1c61cb6250fb admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:04.597200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c7cc0-a1ff-4050-b311-1c61cb6250fb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:04.597469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c7cc0-a1ff-4050-b311-1c61cb6250fb admin admin] PATH_INFO: `/v3/projects/6224fc40313c48c9b8756ed244c90b8f/users/e3566eb24c8a47cf944d29c0d0f1bdb9/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:04.599403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c7cc0-a1ff-4050-b311-1c61cb6250fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6224fc40313c48c9b8756ed244c90b8f, user_id=e3566eb24c8a47cf944d29c0d0f1bdb9, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:04.602005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c7cc0-a1ff-4050-b311-1c61cb6250fb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:04.612570 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3983/7911] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:36:04 2022] PUT /identity/v3/projects/6224fc40313c48c9b8756ed244c90b8f/users/e3566eb24c8a47cf944d29c0d0f1bdb9/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:04.623036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2cff2-99cf-4803-bfc9-da4c06d481df None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:04.623573 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2cff2-99cf-4803-bfc9-da4c06d481df None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:04.623573 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2cff2-99cf-4803-bfc9-da4c06d481df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:04.651581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-65a2cff2-99cf-4803-bfc9-da4c06d481df None None] MFA Rules not processed for user `e3566eb24c8a47cf944d29c0d0f1bdb9`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:04.652774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-65a2cff2-99cf-4803-bfc9-da4c06d481df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:04.722486 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3929/7912] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:04 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:04.727693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c7cc0-a1ff-4050-b311-1c61cb6250fb admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:04.738429 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c7cc0-a1ff-4050-b311-1c61cb6250fb admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:04.743314 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fe051-87a8-4ade-9875-daadb7bfd522 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3566eb24c8a47cf944d29c0d0f1bdb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6224fc40313c48c9b8756ed244c90b8f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:04.743919 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fe051-87a8-4ade-9875-daadb7bfd522 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:04.744199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fe051-87a8-4ade-9875-daadb7bfd522 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:04.744479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fe051-87a8-4ade-9875-daadb7bfd522 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:04.745089 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448fe051-87a8-4ade-9875-daadb7bfd522 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:04.746962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448fe051-87a8-4ade-9875-daadb7bfd522 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:04.779571 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3984/7913] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:36:04 2022] POST /identity/v3/projects => generated 359 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:36:04.783757 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2cff2-99cf-4803-bfc9-da4c06d481df None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:04.793066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2cff2-99cf-4803-bfc9-da4c06d481df None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:04.849461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a332444-7a94-43fd-ac5b-8c165e9757d6 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3566eb24c8a47cf944d29c0d0f1bdb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6224fc40313c48c9b8756ed244c90b8f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:04.849980 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a332444-7a94-43fd-ac5b-8c165e9757d6 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:04.850257 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a332444-7a94-43fd-ac5b-8c165e9757d6 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:04.850529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a332444-7a94-43fd-ac5b-8c165e9757d6 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:04.851180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a332444-7a94-43fd-ac5b-8c165e9757d6 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:04.853069 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a332444-7a94-43fd-ac5b-8c165e9757d6 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:04.877012 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3930/7914] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:36:04 2022] POST /identity/v3/users => generated 371 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:36:04.881341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fe051-87a8-4ade-9875-daadb7bfd522 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:04.892429 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fe051-87a8-4ade-9875-daadb7bfd522 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:04.896926 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971470b-1973-4bbe-8fbb-f0a34e6ceba8 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3566eb24c8a47cf944d29c0d0f1bdb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6224fc40313c48c9b8756ed244c90b8f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:04.897513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971470b-1973-4bbe-8fbb-f0a34e6ceba8 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:04.897793 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971470b-1973-4bbe-8fbb-f0a34e6ceba8 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:04.898066 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971470b-1973-4bbe-8fbb-f0a34e6ceba8 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:04.898813 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971470b-1973-4bbe-8fbb-f0a34e6ceba8 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:36:04.899780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971470b-1973-4bbe-8fbb-f0a34e6ceba8 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:04.901715 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971470b-1973-4bbe-8fbb-f0a34e6ceba8 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:04.927589 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3985/7915] 10.222.0.33 () {58 vars in 1157 bytes} [Sat Aug 6 21:36:04 2022] GET /identity/v3/users?domain_id=default => generated 6034 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:36:04.932885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a332444-7a94-43fd-ac5b-8c165e9757d6 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:04.943723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a332444-7a94-43fd-ac5b-8c165e9757d6 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:04.949762 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273c462-9d35-4899-a7fa-1e404aadc29e tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3566eb24c8a47cf944d29c0d0f1bdb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6224fc40313c48c9b8756ed244c90b8f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:04.950384 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273c462-9d35-4899-a7fa-1e404aadc29e tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:04.950695 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273c462-9d35-4899-a7fa-1e404aadc29e tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:04.950974 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273c462-9d35-4899-a7fa-1e404aadc29e tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] PATH_INFO: `/v3/users/2bd7e07fa88146c39f0647709e778edc` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:04.966437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273c462-9d35-4899-a7fa-1e404aadc29e tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] RBAC: Authorizing `identity:update_user(user_id=2bd7e07fa88146c39f0647709e778edc)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:04.967656 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-8273c462-9d35-4899-a7fa-1e404aadc29e tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:36:04.967656 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:36:04.967656 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:36:04.968863 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273c462-9d35-4899-a7fa-1e404aadc29e tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:04.994682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:04.998965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8273c462-9d35-4899-a7fa-1e404aadc29e tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2bd7e07fa88146c39f0647709e778edc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:05.007759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8273c462-9d35-4899-a7fa-1e404aadc29e tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] Invalidating the token cache because user 2bd7e07fa88146c39f0647709e778edc was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:36:05.008060 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8273c462-9d35-4899-a7fa-1e404aadc29e tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:05.009907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8273c462-9d35-4899-a7fa-1e404aadc29e tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:05.011845 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3931/7916] 10.222.0.33 () {60 vars in 1244 bytes} [Sat Aug 6 21:36:04 2022] PATCH /identity/v3/users/2bd7e07fa88146c39f0647709e778edc => generated 485 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:36:05.016467 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986a74b-efaa-4580-88b9-da715aed6f7c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:05.016757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986a74b-efaa-4580-88b9-da715aed6f7c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:05.017032 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986a74b-efaa-4580-88b9-da715aed6f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:05.032254 ncdv-master-1 devstack@keystone.service[102759]: WARNING keystone.auth.plugins.core [None req-e986a74b-efaa-4580-88b9-da715aed6f7c None None] User is disabled: 2bd7e07fa88146c39f0647709e778edc: AssertionError: User is disabled: 2bd7e07fa88146c39f0647709e778edc Aug 06 21:36:05.043078 ncdv-master-1 devstack@keystone.service[102759]: WARNING keystone.server.flask.application [None req-e986a74b-efaa-4580-88b9-da715aed6f7c None None] Authorization failed. The request you have made requires authentication. from 10.222.0.33: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 06 21:36:05.044382 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3986/7917] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:05 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 29 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 06 21:36:05.048650 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273c462-9d35-4899-a7fa-1e404aadc29e tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:05.050239 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8273c462-9d35-4899-a7fa-1e404aadc29e tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:05.063680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273c462-9d35-4899-a7fa-1e404aadc29e tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:05.068556 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdff5ca-cf84-45b5-98d9-a8d820f91ce1 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3566eb24c8a47cf944d29c0d0f1bdb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6224fc40313c48c9b8756ed244c90b8f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:05.069184 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdff5ca-cf84-45b5-98d9-a8d820f91ce1 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:05.069470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdff5ca-cf84-45b5-98d9-a8d820f91ce1 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:05.069751 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdff5ca-cf84-45b5-98d9-a8d820f91ce1 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] PATH_INFO: `/v3/users/2bd7e07fa88146c39f0647709e778edc` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:05.084173 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdff5ca-cf84-45b5-98d9-a8d820f91ce1 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2bd7e07fa88146c39f0647709e778edc)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:05.086094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdff5ca-cf84-45b5-98d9-a8d820f91ce1 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:05.129372 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1fdff5ca-cf84-45b5-98d9-a8d820f91ce1 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bd7e07fa88146c39f0647709e778edc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:05.129990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1fdff5ca-cf84-45b5-98d9-a8d820f91ce1 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bd7e07fa88146c39f0647709e778edc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:05.130640 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1fdff5ca-cf84-45b5-98d9-a8d820f91ce1 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bd7e07fa88146c39f0647709e778edc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:05.139165 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1fdff5ca-cf84-45b5-98d9-a8d820f91ce1 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bd7e07fa88146c39f0647709e778edc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:05.150864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-1fdff5ca-cf84-45b5-98d9-a8d820f91ce1 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bd7e07fa88146c39f0647709e778edc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:05.162780 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3932/7918] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:36:05 2022] DELETE /identity/v3/users/2bd7e07fa88146c39f0647709e778edc => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:05.166981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986a74b-efaa-4580-88b9-da715aed6f7c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:05.168881 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e986a74b-efaa-4580-88b9-da715aed6f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:05.235498 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986a74b-efaa-4580-88b9-da715aed6f7c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:05.240141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577727c-9334-453c-b237-5e144289a5df tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3566eb24c8a47cf944d29c0d0f1bdb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6224fc40313c48c9b8756ed244c90b8f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:05.240760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577727c-9334-453c-b237-5e144289a5df tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:05.241045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577727c-9334-453c-b237-5e144289a5df tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:05.241321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577727c-9334-453c-b237-5e144289a5df tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] PATH_INFO: `/v3/projects/7156ff59a4024a82bb0125ab18008383` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:05.242441 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577727c-9334-453c-b237-5e144289a5df tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7156ff59a4024a82bb0125ab18008383)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:05.244631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577727c-9334-453c-b237-5e144289a5df tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:05.256395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:05.292095 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b577727c-9334-453c-b237-5e144289a5df tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7156ff59a4024a82bb0125ab18008383', 'request_id': 'req-b577727c-9334-453c-b237-5e144289a5df'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:05.297811 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b577727c-9334-453c-b237-5e144289a5df tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7156ff59a4024a82bb0125ab18008383', 'request_id': 'req-b577727c-9334-453c-b237-5e144289a5df'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:05.305605 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b577727c-9334-453c-b237-5e144289a5df tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7156ff59a4024a82bb0125ab18008383', 'request_id': 'req-b577727c-9334-453c-b237-5e144289a5df'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:05.316955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b577727c-9334-453c-b237-5e144289a5df tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] The token cache is being invalidate because project 7156ff59a4024a82bb0125ab18008383 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:36:05.317258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b577727c-9334-453c-b237-5e144289a5df tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:05.317996 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b577727c-9334-453c-b237-5e144289a5df tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:05.319587 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3987/7919] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:36:05 2022] DELETE /identity/v3/projects/7156ff59a4024a82bb0125ab18008383 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:05.325743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdff5ca-cf84-45b5-98d9-a8d820f91ce1 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:05.336127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdff5ca-cf84-45b5-98d9-a8d820f91ce1 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:05.391835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaca57c-815a-4c3f-ae47-8c516ee9eba3 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3566eb24c8a47cf944d29c0d0f1bdb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6224fc40313c48c9b8756ed244c90b8f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:05.392360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaca57c-815a-4c3f-ae47-8c516ee9eba3 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:05.392644 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaca57c-815a-4c3f-ae47-8c516ee9eba3 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:05.392919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaca57c-815a-4c3f-ae47-8c516ee9eba3 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:05.393537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaca57c-815a-4c3f-ae47-8c516ee9eba3 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:05.395491 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaca57c-815a-4c3f-ae47-8c516ee9eba3 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:05.408479 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-dcaca57c-815a-4c3f-ae47-8c516ee9eba3 tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] Could not find domain: 37d8a13e28834870ab987a2dc788f263.: keystone.exception.DomainNotFound: Could not find domain: 37d8a13e28834870ab987a2dc788f263. Aug 06 21:36:05.408479 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:36:05.408479 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 06 21:36:05.408479 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 06 21:36:05.408479 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 21:36:05.408479 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 21:36:05.408479 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 21:36:05.408479 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 21:36:05.408479 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 37d8a13e28834870ab987a2dc788f263. Aug 06 21:36:05.408479 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:36:05.408479 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 21:36:05.408479 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:36:05.408479 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:36:05.408479 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:36:05.408479 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:36:05.413756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:36:05.413756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:36:05.413756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:36:05.413756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:36:05.413756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:36:05.413756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:36:05.413756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:36:05.413756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:36:05.413756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 06 21:36:05.413756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 06 21:36:05.413756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:36:05.413756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:36:05.413756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 21:36:05.413756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 21:36:05.413756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 21:36:05.413756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 21:36:05.413756 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Aug 06 21:36:05.416135 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Aug 06 21:36:05.416135 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:36:05.416135 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:36:05.416135 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 21:36:05.416135 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 21:36:05.416135 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 21:36:05.416135 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 21:36:05.416135 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 21:36:05.416135 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 21:36:05.416135 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 21:36:05.416135 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 21:36:05.416135 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 21:36:05.416135 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 21:36:05.416135 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 21:36:05.416135 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 21:36:05.416135 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 21:36:05.416135 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 21:36:05.417563 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 06 21:36:05.417563 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 21:36:05.417563 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 37d8a13e28834870ab987a2dc788f263. Aug 06 21:36:05.417563 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:36:05.417563 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3933/7920] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:36:05 2022] POST /identity/v3/users => generated 112 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:36:05.417998 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577727c-9334-453c-b237-5e144289a5df tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:05.417998 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b577727c-9334-453c-b237-5e144289a5df tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:05.481774 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577727c-9334-453c-b237-5e144289a5df tempest-UsersNegativeTest-1621404395 tempest-UsersNegativeTest-1621404395-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:05.486327 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebf495-1ce8-4fc7-abf0-90d63cbb5646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:05.486976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebf495-1ce8-4fc7-abf0-90d63cbb5646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:05.487254 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebf495-1ce8-4fc7-abf0-90d63cbb5646 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:05.487526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebf495-1ce8-4fc7-abf0-90d63cbb5646 admin admin] PATH_INFO: `/v3/users/a37c86512da54cc1aae536ebee063728` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:05.488679 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caebf495-1ce8-4fc7-abf0-90d63cbb5646 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a37c86512da54cc1aae536ebee063728)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:05.490619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caebf495-1ce8-4fc7-abf0-90d63cbb5646 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:05.535937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-caebf495-1ce8-4fc7-abf0-90d63cbb5646 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a37c86512da54cc1aae536ebee063728'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:05.543303 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-caebf495-1ce8-4fc7-abf0-90d63cbb5646 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a37c86512da54cc1aae536ebee063728'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:05.543973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-caebf495-1ce8-4fc7-abf0-90d63cbb5646 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a37c86512da54cc1aae536ebee063728'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:05.544590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-caebf495-1ce8-4fc7-abf0-90d63cbb5646 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a37c86512da54cc1aae536ebee063728'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:05.552367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-caebf495-1ce8-4fc7-abf0-90d63cbb5646 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a37c86512da54cc1aae536ebee063728'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:05.569759 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3988/7921] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:36:05 2022] DELETE /identity/v3/users/a37c86512da54cc1aae536ebee063728 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:05.575062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23c58b-7b5c-4f81-9f1b-ea68e257b678 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:05.575351 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23c58b-7b5c-4f81-9f1b-ea68e257b678 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:05.575624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23c58b-7b5c-4f81-9f1b-ea68e257b678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:05.594906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-cd23c58b-7b5c-4f81-9f1b-ea68e257b678 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:05.596102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-cd23c58b-7b5c-4f81-9f1b-ea68e257b678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:05.642337 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:05.656010 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3934/7922] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:05.666090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebf495-1ce8-4fc7-abf0-90d63cbb5646 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:05.667612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-caebf495-1ce8-4fc7-abf0-90d63cbb5646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:05.690458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:05.728534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebf495-1ce8-4fc7-abf0-90d63cbb5646 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:05.732190 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae7137-4a99-4e4f-915f-b316328932b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:05.732780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae7137-4a99-4e4f-915f-b316328932b2 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:05.733056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae7137-4a99-4e4f-915f-b316328932b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:05.733325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae7137-4a99-4e4f-915f-b316328932b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:05.742272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae7137-4a99-4e4f-915f-b316328932b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:05.744492 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae7137-4a99-4e4f-915f-b316328932b2 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:05.753897 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3989/7923] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:36:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:36:06.025833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23c58b-7b5c-4f81-9f1b-ea68e257b678 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:06.027311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-cd23c58b-7b5c-4f81-9f1b-ea68e257b678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:06.039448 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23c58b-7b5c-4f81-9f1b-ea68e257b678 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:06.045152 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed266fb4-7d4f-47ef-aa47-269e2ab61f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:06.045785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed266fb4-7d4f-47ef-aa47-269e2ab61f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:06.046065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed266fb4-7d4f-47ef-aa47-269e2ab61f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:06.046339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed266fb4-7d4f-47ef-aa47-269e2ab61f94 admin admin] PATH_INFO: `/v3/projects/ed7c97ebf30f4733936b2f60874b72fe` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:06.047855 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed266fb4-7d4f-47ef-aa47-269e2ab61f94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed7c97ebf30f4733936b2f60874b72fe)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:06.050141 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed266fb4-7d4f-47ef-aa47-269e2ab61f94 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:06.096805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ed266fb4-7d4f-47ef-aa47-269e2ab61f94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed7c97ebf30f4733936b2f60874b72fe', 'request_id': 'req-ed266fb4-7d4f-47ef-aa47-269e2ab61f94'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:06.102988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ed266fb4-7d4f-47ef-aa47-269e2ab61f94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed7c97ebf30f4733936b2f60874b72fe', 'request_id': 'req-ed266fb4-7d4f-47ef-aa47-269e2ab61f94'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:06.109263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ed266fb4-7d4f-47ef-aa47-269e2ab61f94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed7c97ebf30f4733936b2f60874b72fe', 'request_id': 'req-ed266fb4-7d4f-47ef-aa47-269e2ab61f94'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:06.122002 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ed266fb4-7d4f-47ef-aa47-269e2ab61f94 admin admin] The token cache is being invalidate because project ed7c97ebf30f4733936b2f60874b72fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:36:06.122288 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ed266fb4-7d4f-47ef-aa47-269e2ab61f94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:06.122934 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ed266fb4-7d4f-47ef-aa47-269e2ab61f94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:06.124391 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3935/7924] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:36:06 2022] DELETE /identity/v3/projects/ed7c97ebf30f4733936b2f60874b72fe => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:06.128586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae7137-4a99-4e4f-915f-b316328932b2 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:06.138760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae7137-4a99-4e4f-915f-b316328932b2 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:06.196422 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e9b21-e39e-42d4-ab40-96c5791aff2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:06.197191 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e9b21-e39e-42d4-ab40-96c5791aff2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:06.197191 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e9b21-e39e-42d4-ab40-96c5791aff2a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:06.197443 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e9b21-e39e-42d4-ab40-96c5791aff2a admin admin] PATH_INFO: `/v3/users/e3566eb24c8a47cf944d29c0d0f1bdb9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:06.198565 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e9b21-e39e-42d4-ab40-96c5791aff2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3566eb24c8a47cf944d29c0d0f1bdb9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:06.200504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e9b21-e39e-42d4-ab40-96c5791aff2a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:06.247202 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9e7e9b21-e39e-42d4-ab40-96c5791aff2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3566eb24c8a47cf944d29c0d0f1bdb9'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:06.253988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9e7e9b21-e39e-42d4-ab40-96c5791aff2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3566eb24c8a47cf944d29c0d0f1bdb9'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:06.254677 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9e7e9b21-e39e-42d4-ab40-96c5791aff2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3566eb24c8a47cf944d29c0d0f1bdb9'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:06.255285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9e7e9b21-e39e-42d4-ab40-96c5791aff2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3566eb24c8a47cf944d29c0d0f1bdb9'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:06.262853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9e7e9b21-e39e-42d4-ab40-96c5791aff2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3566eb24c8a47cf944d29c0d0f1bdb9'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:06.279957 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3990/7925] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:36:06 2022] DELETE /identity/v3/users/e3566eb24c8a47cf944d29c0d0f1bdb9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:06.554173 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed266fb4-7d4f-47ef-aa47-269e2ab61f94 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:06.556385 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ed266fb4-7d4f-47ef-aa47-269e2ab61f94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:06.575129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed266fb4-7d4f-47ef-aa47-269e2ab61f94 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:06.632710 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315c949-4995-4cdd-93f1-1defbd6bcb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:06.633344 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315c949-4995-4cdd-93f1-1defbd6bcb95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:06.633775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315c949-4995-4cdd-93f1-1defbd6bcb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:06.634572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315c949-4995-4cdd-93f1-1defbd6bcb95 admin admin] PATH_INFO: `/v3/projects/6224fc40313c48c9b8756ed244c90b8f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:06.635704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c315c949-4995-4cdd-93f1-1defbd6bcb95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6224fc40313c48c9b8756ed244c90b8f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:06.637618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c315c949-4995-4cdd-93f1-1defbd6bcb95 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:06.685342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c315c949-4995-4cdd-93f1-1defbd6bcb95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6224fc40313c48c9b8756ed244c90b8f', 'request_id': 'req-c315c949-4995-4cdd-93f1-1defbd6bcb95'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:06.690843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c315c949-4995-4cdd-93f1-1defbd6bcb95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6224fc40313c48c9b8756ed244c90b8f', 'request_id': 'req-c315c949-4995-4cdd-93f1-1defbd6bcb95'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:06.697459 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c315c949-4995-4cdd-93f1-1defbd6bcb95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6224fc40313c48c9b8756ed244c90b8f', 'request_id': 'req-c315c949-4995-4cdd-93f1-1defbd6bcb95'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:06.709970 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c315c949-4995-4cdd-93f1-1defbd6bcb95 admin admin] The token cache is being invalidate because project 6224fc40313c48c9b8756ed244c90b8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:36:06.710239 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c315c949-4995-4cdd-93f1-1defbd6bcb95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:06.710890 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c315c949-4995-4cdd-93f1-1defbd6bcb95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:06.713124 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3936/7926] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:36:06 2022] DELETE /identity/v3/projects/6224fc40313c48c9b8756ed244c90b8f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:06.720327 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef14cf4-de9e-487f-87da-f42c643662ad None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:06.720614 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef14cf4-de9e-487f-87da-f42c643662ad None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:06.720892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef14cf4-de9e-487f-87da-f42c643662ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:06.740886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-9ef14cf4-de9e-487f-87da-f42c643662ad None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:06.742012 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9ef14cf4-de9e-487f-87da-f42c643662ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:06.780449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:06.802960 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3991/7927] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:06.811134 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdeae56-9e26-484a-88d1-3499964ee4d6 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:06.811420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdeae56-9e26-484a-88d1-3499964ee4d6 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:06.811694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdeae56-9e26-484a-88d1-3499964ee4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:06.826583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:06.833039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-1bdeae56-9e26-484a-88d1-3499964ee4d6 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:06.834780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1bdeae56-9e26-484a-88d1-3499964ee4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:06.844316 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3937/7928] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:06.848504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef14cf4-de9e-487f-87da-f42c643662ad None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:06.858800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef14cf4-de9e-487f-87da-f42c643662ad None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:06.863427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9381d62-aa3b-4f8e-9c4b-4a99c78f698c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:06.864022 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9381d62-aa3b-4f8e-9c4b-4a99c78f698c admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:06.864301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9381d62-aa3b-4f8e-9c4b-4a99c78f698c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:06.864574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9381d62-aa3b-4f8e-9c4b-4a99c78f698c admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:06.865215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9381d62-aa3b-4f8e-9c4b-4a99c78f698c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:36:06.865521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9381d62-aa3b-4f8e-9c4b-4a99c78f698c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:06.867159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9381d62-aa3b-4f8e-9c4b-4a99c78f698c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:06.879149 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3992/7929] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:36:06.883303 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdeae56-9e26-484a-88d1-3499964ee4d6 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:06.893219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdeae56-9e26-484a-88d1-3499964ee4d6 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:06.897907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f8e05-81d4-4c7e-a60e-10b838a77afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:06.898493 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f8e05-81d4-4c7e-a60e-10b838a77afb admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:06.898801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f8e05-81d4-4c7e-a60e-10b838a77afb admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:06.899073 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f8e05-81d4-4c7e-a60e-10b838a77afb admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:06.900338 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f8e05-81d4-4c7e-a60e-10b838a77afb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:06.902217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f8e05-81d4-4c7e-a60e-10b838a77afb admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:06.932535 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3938/7930] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:36:06 2022] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:36:06.934236 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9381d62-aa3b-4f8e-9c4b-4a99c78f698c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:06.944769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9381d62-aa3b-4f8e-9c4b-4a99c78f698c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:07.001296 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b35e3-912d-4840-b77f-86ded105734b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:07.001810 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b35e3-912d-4840-b77f-86ded105734b admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:07.002090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b35e3-912d-4840-b77f-86ded105734b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:07.002362 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b35e3-912d-4840-b77f-86ded105734b admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:07.003012 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b35e3-912d-4840-b77f-86ded105734b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:07.004900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b35e3-912d-4840-b77f-86ded105734b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:07.030947 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3993/7931] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:36:06 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:36:07.032086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f8e05-81d4-4c7e-a60e-10b838a77afb admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:07.043255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f8e05-81d4-4c7e-a60e-10b838a77afb admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:07.048473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e95cb3-5535-4e2e-8641-aee698afcf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:07.049067 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e95cb3-5535-4e2e-8641-aee698afcf79 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:07.049350 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e95cb3-5535-4e2e-8641-aee698afcf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:07.049624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e95cb3-5535-4e2e-8641-aee698afcf79 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:07.050264 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e95cb3-5535-4e2e-8641-aee698afcf79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:07.051893 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e95cb3-5535-4e2e-8641-aee698afcf79 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:07.065492 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3939/7932] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:36:07.066735 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b35e3-912d-4840-b77f-86ded105734b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:07.077311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b35e3-912d-4840-b77f-86ded105734b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:07.081932 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e1a758-141e-47a3-910d-e23837d62761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:07.082524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1a758-141e-47a3-910d-e23837d62761 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:07.082838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1a758-141e-47a3-910d-e23837d62761 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:07.083116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1a758-141e-47a3-910d-e23837d62761 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:07.083753 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e1a758-141e-47a3-910d-e23837d62761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:07.085373 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e1a758-141e-47a3-910d-e23837d62761 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:07.097273 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3994/7933] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:36:07.101381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e95cb3-5535-4e2e-8641-aee698afcf79 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:07.111703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e95cb3-5535-4e2e-8641-aee698afcf79 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:07.116524 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a9faf-a2d9-4c91-addf-85aa10e4b8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:07.117171 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a9faf-a2d9-4c91-addf-85aa10e4b8c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:07.117452 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a9faf-a2d9-4c91-addf-85aa10e4b8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:07.117730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a9faf-a2d9-4c91-addf-85aa10e4b8c1 admin admin] PATH_INFO: `/v3/projects/33f15ce164f34529b220da0986e5d791/users/a2f9f39774b143d1884e9e235e5e84af/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:07.132317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a9faf-a2d9-4c91-addf-85aa10e4b8c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33f15ce164f34529b220da0986e5d791, user_id=a2f9f39774b143d1884e9e235e5e84af, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:07.135830 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a9faf-a2d9-4c91-addf-85aa10e4b8c1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:07.148567 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3940/7934] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:36:07 2022] PUT /identity/v3/projects/33f15ce164f34529b220da0986e5d791/users/a2f9f39774b143d1884e9e235e5e84af/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:07.160211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68d8b7-67d5-4296-a805-677c30608313 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:07.160497 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68d8b7-67d5-4296-a805-677c30608313 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:07.160771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68d8b7-67d5-4296-a805-677c30608313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:07.188637 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-be68d8b7-67d5-4296-a805-677c30608313 None None] MFA Rules not processed for user `a2f9f39774b143d1884e9e235e5e84af`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:07.189829 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-be68d8b7-67d5-4296-a805-677c30608313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:07.252455 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3995/7935] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:07 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:07.257277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a9faf-a2d9-4c91-addf-85aa10e4b8c1 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:07.268054 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a9faf-a2d9-4c91-addf-85aa10e4b8c1 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:07.272091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab06a9e-dda1-48b7-9cd4-31b27c689df6 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2f9f39774b143d1884e9e235e5e84af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33f15ce164f34529b220da0986e5d791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:07.272705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab06a9e-dda1-48b7-9cd4-31b27c689df6 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:07.272983 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab06a9e-dda1-48b7-9cd4-31b27c689df6 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:07.273254 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab06a9e-dda1-48b7-9cd4-31b27c689df6 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] PATH_INFO: `/v3/users/a2f9f39774b143d1884e9e235e5e84af/application_credentials` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:07.273891 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab06a9e-dda1-48b7-9cd4-31b27c689df6 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: Authorizing `identity:create_application_credential(user_id=a2f9f39774b143d1884e9e235e5e84af)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:07.275078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab06a9e-dda1-48b7-9cd4-31b27c689df6 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:07.343230 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3941/7936] 10.222.0.33 () {60 vars in 1314 bytes} [Sat Aug 6 21:36:07 2022] POST /identity/v3/users/a2f9f39774b143d1884e9e235e5e84af/application_credentials => generated 789 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:36:07.347426 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68d8b7-67d5-4296-a805-677c30608313 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:07.356114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68d8b7-67d5-4296-a805-677c30608313 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:07.360392 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c7a52-0022-44fa-bfa9-3a72b52f03b7 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2f9f39774b143d1884e9e235e5e84af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33f15ce164f34529b220da0986e5d791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:07.361011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c7a52-0022-44fa-bfa9-3a72b52f03b7 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:07.361296 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c7a52-0022-44fa-bfa9-3a72b52f03b7 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:07.361574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c7a52-0022-44fa-bfa9-3a72b52f03b7 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] PATH_INFO: `/v3/users/a2f9f39774b143d1884e9e235e5e84af/application_credentials/201f3208b51e49889d9f50671b2fd92a` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:07.371014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c7a52-0022-44fa-bfa9-3a72b52f03b7 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: Authorizing `identity:get_application_credential(user_id=a2f9f39774b143d1884e9e235e5e84af, application_credential_id=201f3208b51e49889d9f50671b2fd92a)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:07.372666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c7a52-0022-44fa-bfa9-3a72b52f03b7 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:07.374758 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3996/7937] 10.222.0.33 () {58 vars in 1392 bytes} [Sat Aug 6 21:36:07 2022] GET /identity/v3/users/a2f9f39774b143d1884e9e235e5e84af/application_credentials/201f3208b51e49889d9f50671b2fd92a => generated 689 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:36:07.378684 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98019b3d-5284-4a8d-ad69-36b1080f4304 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:07.378976 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98019b3d-5284-4a8d-ad69-36b1080f4304 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:07.379254 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98019b3d-5284-4a8d-ad69-36b1080f4304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:07.394820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-98019b3d-5284-4a8d-ad69-36b1080f4304 None None] MFA Rules not processed for user `a2f9f39774b143d1884e9e235e5e84af`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:07.396044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-98019b3d-5284-4a8d-ad69-36b1080f4304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:07.488672 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:07.498972 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3942/7938] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:07 2022] POST /identity/v3/auth/tokens => generated 3425 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Aug 06 21:36:07.503453 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c7a52-0022-44fa-bfa9-3a72b52f03b7 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:07.513534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c7a52-0022-44fa-bfa9-3a72b52f03b7 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:07.517769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5317f81-fce2-49b8-b428-a10c6bf39968 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2f9f39774b143d1884e9e235e5e84af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33f15ce164f34529b220da0986e5d791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:07.518395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5317f81-fce2-49b8-b428-a10c6bf39968 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:07.518723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5317f81-fce2-49b8-b428-a10c6bf39968 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:07.519002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5317f81-fce2-49b8-b428-a10c6bf39968 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] PATH_INFO: `/v3/users/a2f9f39774b143d1884e9e235e5e84af/application_credentials/201f3208b51e49889d9f50671b2fd92a` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:07.520124 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5317f81-fce2-49b8-b428-a10c6bf39968 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: Authorizing `identity:delete_application_credential(user_id=a2f9f39774b143d1884e9e235e5e84af, application_credential_id=201f3208b51e49889d9f50671b2fd92a)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:07.521610 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5317f81-fce2-49b8-b428-a10c6bf39968 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:07.540970 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3997/7939] 10.222.0.33 () {58 vars in 1395 bytes} [Sat Aug 6 21:36:07 2022] DELETE /identity/v3/users/a2f9f39774b143d1884e9e235e5e84af/application_credentials/201f3208b51e49889d9f50671b2fd92a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:07.546530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98019b3d-5284-4a8d-ad69-36b1080f4304 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:07.557610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98019b3d-5284-4a8d-ad69-36b1080f4304 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:07.561885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ee0ca-477f-4928-a03b-ab19f27597a9 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2f9f39774b143d1884e9e235e5e84af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33f15ce164f34529b220da0986e5d791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:07.562685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ee0ca-477f-4928-a03b-ab19f27597a9 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:07.562970 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ee0ca-477f-4928-a03b-ab19f27597a9 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:07.563248 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ee0ca-477f-4928-a03b-ab19f27597a9 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] PATH_INFO: `/v3/users/a2f9f39774b143d1884e9e235e5e84af/application_credentials` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:07.563904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ee0ca-477f-4928-a03b-ab19f27597a9 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: Authorizing `identity:create_application_credential(user_id=a2f9f39774b143d1884e9e235e5e84af)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:07.565057 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ee0ca-477f-4928-a03b-ab19f27597a9 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:07.644881 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3943/7940] 10.222.0.33 () {60 vars in 1315 bytes} [Sat Aug 6 21:36:07 2022] POST /identity/v3/users/a2f9f39774b143d1884e9e235e5e84af/application_credentials => generated 921 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:36:07.649306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5317f81-fce2-49b8-b428-a10c6bf39968 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:07.655754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:07.659632 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5317f81-fce2-49b8-b428-a10c6bf39968 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:07.666192 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1c923-6770-4d91-8ac5-f9994b2e9df6 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2f9f39774b143d1884e9e235e5e84af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33f15ce164f34529b220da0986e5d791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:07.666875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1c923-6770-4d91-8ac5-f9994b2e9df6 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:07.667227 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1c923-6770-4d91-8ac5-f9994b2e9df6 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:07.667629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1c923-6770-4d91-8ac5-f9994b2e9df6 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] PATH_INFO: `/v3/users/a2f9f39774b143d1884e9e235e5e84af/application_credentials/cb02663599584dbc9a16602825fae428` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:07.684500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1c923-6770-4d91-8ac5-f9994b2e9df6 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: Authorizing `identity:delete_application_credential(user_id=a2f9f39774b143d1884e9e235e5e84af, application_credential_id=cb02663599584dbc9a16602825fae428)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:07.686057 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1c923-6770-4d91-8ac5-f9994b2e9df6 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:07.706040 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3998/7941] 10.222.0.33 () {58 vars in 1395 bytes} [Sat Aug 6 21:36:07 2022] DELETE /identity/v3/users/a2f9f39774b143d1884e9e235e5e84af/application_credentials/cb02663599584dbc9a16602825fae428 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:07.711416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ee0ca-477f-4928-a03b-ab19f27597a9 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:07.721090 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ee0ca-477f-4928-a03b-ab19f27597a9 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:07.725254 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99498c9e-c20d-4e0e-a5f2-7bd92ef854a9 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2f9f39774b143d1884e9e235e5e84af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33f15ce164f34529b220da0986e5d791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:07.725879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99498c9e-c20d-4e0e-a5f2-7bd92ef854a9 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:07.726164 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99498c9e-c20d-4e0e-a5f2-7bd92ef854a9 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:07.726445 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99498c9e-c20d-4e0e-a5f2-7bd92ef854a9 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] PATH_INFO: `/v3/users/a2f9f39774b143d1884e9e235e5e84af/application_credentials` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:07.727129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99498c9e-c20d-4e0e-a5f2-7bd92ef854a9 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: Authorizing `identity:create_application_credential(user_id=a2f9f39774b143d1884e9e235e5e84af)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:07.728858 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99498c9e-c20d-4e0e-a5f2-7bd92ef854a9 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:07.795573 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3944/7942] 10.222.0.33 () {60 vars in 1315 bytes} [Sat Aug 6 21:36:07 2022] POST /identity/v3/users/a2f9f39774b143d1884e9e235e5e84af/application_credentials => generated 812 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:36:07.800013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1c923-6770-4d91-8ac5-f9994b2e9df6 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:07.810107 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1c923-6770-4d91-8ac5-f9994b2e9df6 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:07.814255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84433349-675d-49f5-9a57-af5b1ae27dba tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2f9f39774b143d1884e9e235e5e84af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33f15ce164f34529b220da0986e5d791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:07.814921 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84433349-675d-49f5-9a57-af5b1ae27dba tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:07.815204 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84433349-675d-49f5-9a57-af5b1ae27dba tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:07.815483 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84433349-675d-49f5-9a57-af5b1ae27dba tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] PATH_INFO: `/v3/users/a2f9f39774b143d1884e9e235e5e84af/application_credentials/66fa3fb9b4f74037a0f65b8e2f5232e1` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:07.824047 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84433349-675d-49f5-9a57-af5b1ae27dba tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: Authorizing `identity:delete_application_credential(user_id=a2f9f39774b143d1884e9e235e5e84af, application_credential_id=66fa3fb9b4f74037a0f65b8e2f5232e1)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:07.825535 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84433349-675d-49f5-9a57-af5b1ae27dba tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:07.843386 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 3999/7943] 10.222.0.33 () {58 vars in 1395 bytes} [Sat Aug 6 21:36:07 2022] DELETE /identity/v3/users/a2f9f39774b143d1884e9e235e5e84af/application_credentials/66fa3fb9b4f74037a0f65b8e2f5232e1 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:07.848423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99498c9e-c20d-4e0e-a5f2-7bd92ef854a9 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:07.858249 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99498c9e-c20d-4e0e-a5f2-7bd92ef854a9 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:07.862372 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85794a4-8550-4b71-a9cb-5cbfb6407a99 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2f9f39774b143d1884e9e235e5e84af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33f15ce164f34529b220da0986e5d791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:07.863097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85794a4-8550-4b71-a9cb-5cbfb6407a99 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:07.863374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85794a4-8550-4b71-a9cb-5cbfb6407a99 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:07.863649 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85794a4-8550-4b71-a9cb-5cbfb6407a99 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] PATH_INFO: `/v3/users/a2f9f39774b143d1884e9e235e5e84af/application_credentials` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:07.864291 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85794a4-8550-4b71-a9cb-5cbfb6407a99 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: Authorizing `identity:create_application_credential(user_id=a2f9f39774b143d1884e9e235e5e84af)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:07.865433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85794a4-8550-4b71-a9cb-5cbfb6407a99 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:07.932911 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3945/7944] 10.222.0.33 () {60 vars in 1314 bytes} [Sat Aug 6 21:36:07 2022] POST /identity/v3/users/a2f9f39774b143d1884e9e235e5e84af/application_credentials => generated 787 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:36:07.937141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84433349-675d-49f5-9a57-af5b1ae27dba tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:07.946490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84433349-675d-49f5-9a57-af5b1ae27dba tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:07.950669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f7444-8ad4-4eff-affd-ad33cf1ded69 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2f9f39774b143d1884e9e235e5e84af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33f15ce164f34529b220da0986e5d791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:07.951284 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f7444-8ad4-4eff-affd-ad33cf1ded69 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:07.951560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f7444-8ad4-4eff-affd-ad33cf1ded69 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:07.951834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f7444-8ad4-4eff-affd-ad33cf1ded69 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] PATH_INFO: `/v3/users/a2f9f39774b143d1884e9e235e5e84af/application_credentials` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:07.952475 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f7444-8ad4-4eff-affd-ad33cf1ded69 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: Authorizing `identity:create_application_credential(user_id=a2f9f39774b143d1884e9e235e5e84af)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:07.953602 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f7444-8ad4-4eff-affd-ad33cf1ded69 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:08.026102 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4000/7945] 10.222.0.33 () {60 vars in 1314 bytes} [Sat Aug 6 21:36:07 2022] POST /identity/v3/users/a2f9f39774b143d1884e9e235e5e84af/application_credentials => generated 788 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:36:08.027354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85794a4-8550-4b71-a9cb-5cbfb6407a99 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:08.036843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85794a4-8550-4b71-a9cb-5cbfb6407a99 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:08.041519 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd20d19-0bce-4601-9897-6b964edce380 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2f9f39774b143d1884e9e235e5e84af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33f15ce164f34529b220da0986e5d791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:08.042152 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd20d19-0bce-4601-9897-6b964edce380 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:08.042415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd20d19-0bce-4601-9897-6b964edce380 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:08.042717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd20d19-0bce-4601-9897-6b964edce380 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] PATH_INFO: `/v3/users/a2f9f39774b143d1884e9e235e5e84af/application_credentials` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:08.043512 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd20d19-0bce-4601-9897-6b964edce380 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: Authorizing `identity:list_application_credentials(user_id=a2f9f39774b143d1884e9e235e5e84af)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:08.045109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd20d19-0bce-4601-9897-6b964edce380 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:08.049251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:08.059402 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3946/7946] 10.222.0.33 () {58 vars in 1293 bytes} [Sat Aug 6 21:36:08 2022] GET /identity/v3/users/a2f9f39774b143d1884e9e235e5e84af/application_credentials => generated 1499 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:36:08.063623 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f7444-8ad4-4eff-affd-ad33cf1ded69 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:08.073408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f7444-8ad4-4eff-affd-ad33cf1ded69 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:08.077681 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b2d3f-5bfb-4499-ab70-120f2303ed37 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2f9f39774b143d1884e9e235e5e84af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33f15ce164f34529b220da0986e5d791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:08.078326 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b2d3f-5bfb-4499-ab70-120f2303ed37 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:08.078640 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b2d3f-5bfb-4499-ab70-120f2303ed37 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:08.078923 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b2d3f-5bfb-4499-ab70-120f2303ed37 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] PATH_INFO: `/v3/users/a2f9f39774b143d1884e9e235e5e84af/application_credentials/5390920fd73e42e198943745f1af18e3` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:08.088512 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b2d3f-5bfb-4499-ab70-120f2303ed37 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: Authorizing `identity:delete_application_credential(user_id=a2f9f39774b143d1884e9e235e5e84af, application_credential_id=5390920fd73e42e198943745f1af18e3)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:08.089800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b2d3f-5bfb-4499-ab70-120f2303ed37 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:08.109604 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4001/7947] 10.222.0.33 () {58 vars in 1395 bytes} [Sat Aug 6 21:36:08 2022] DELETE /identity/v3/users/a2f9f39774b143d1884e9e235e5e84af/application_credentials/5390920fd73e42e198943745f1af18e3 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:08.113733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd20d19-0bce-4601-9897-6b964edce380 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:08.123210 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd20d19-0bce-4601-9897-6b964edce380 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:08.127394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1de41-feaf-475e-a765-041b9fb0159a tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2f9f39774b143d1884e9e235e5e84af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33f15ce164f34529b220da0986e5d791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:08.128023 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1de41-feaf-475e-a765-041b9fb0159a tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:08.128305 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1de41-feaf-475e-a765-041b9fb0159a tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:08.128581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1de41-feaf-475e-a765-041b9fb0159a tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] PATH_INFO: `/v3/users/a2f9f39774b143d1884e9e235e5e84af/application_credentials/56edccf8a57c427983495c0bd827acdd` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:08.137483 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1de41-feaf-475e-a765-041b9fb0159a tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: Authorizing `identity:delete_application_credential(user_id=a2f9f39774b143d1884e9e235e5e84af, application_credential_id=56edccf8a57c427983495c0bd827acdd)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:08.139055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1de41-feaf-475e-a765-041b9fb0159a tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:08.158310 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3947/7948] 10.222.0.33 () {58 vars in 1395 bytes} [Sat Aug 6 21:36:08 2022] DELETE /identity/v3/users/a2f9f39774b143d1884e9e235e5e84af/application_credentials/56edccf8a57c427983495c0bd827acdd => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:08.163412 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b2d3f-5bfb-4499-ab70-120f2303ed37 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:08.173625 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b2d3f-5bfb-4499-ab70-120f2303ed37 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:08.177819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf69c06-ebb9-4372-bab1-3886892f72f0 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2f9f39774b143d1884e9e235e5e84af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33f15ce164f34529b220da0986e5d791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:08.178443 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf69c06-ebb9-4372-bab1-3886892f72f0 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:08.178758 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf69c06-ebb9-4372-bab1-3886892f72f0 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:08.179037 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf69c06-ebb9-4372-bab1-3886892f72f0 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] PATH_INFO: `/v3/users/a2f9f39774b143d1884e9e235e5e84af/application_credentials` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:08.179693 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf69c06-ebb9-4372-bab1-3886892f72f0 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: Authorizing `identity:create_application_credential(user_id=a2f9f39774b143d1884e9e235e5e84af)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:08.180925 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf69c06-ebb9-4372-bab1-3886892f72f0 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:08.244293 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:08.251039 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4002/7949] 10.222.0.33 () {60 vars in 1314 bytes} [Sat Aug 6 21:36:08 2022] POST /identity/v3/users/a2f9f39774b143d1884e9e235e5e84af/application_credentials => generated 789 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:36:08.255392 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1de41-feaf-475e-a765-041b9fb0159a tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:08.265345 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1de41-feaf-475e-a765-041b9fb0159a tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:08.269579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d97cb-60c9-45e8-a250-040e8e09c9e3 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2f9f39774b143d1884e9e235e5e84af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33f15ce164f34529b220da0986e5d791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:08.270200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d97cb-60c9-45e8-a250-040e8e09c9e3 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:08.270481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d97cb-60c9-45e8-a250-040e8e09c9e3 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:08.270792 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d97cb-60c9-45e8-a250-040e8e09c9e3 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] PATH_INFO: `/v3/users/a2f9f39774b143d1884e9e235e5e84af/application_credentials` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:08.271439 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d97cb-60c9-45e8-a250-040e8e09c9e3 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: Authorizing `identity:create_application_credential(user_id=a2f9f39774b143d1884e9e235e5e84af)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:08.272586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d97cb-60c9-45e8-a250-040e8e09c9e3 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:08.340010 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3948/7950] 10.222.0.33 () {60 vars in 1314 bytes} [Sat Aug 6 21:36:08 2022] POST /identity/v3/users/a2f9f39774b143d1884e9e235e5e84af/application_credentials => generated 788 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:36:08.344172 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf69c06-ebb9-4372-bab1-3886892f72f0 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:08.354658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf69c06-ebb9-4372-bab1-3886892f72f0 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:08.359014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8b132-e771-431b-bfd5-08ff64e660bc tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2f9f39774b143d1884e9e235e5e84af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33f15ce164f34529b220da0986e5d791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:08.359828 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8b132-e771-431b-bfd5-08ff64e660bc tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:08.360287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8b132-e771-431b-bfd5-08ff64e660bc tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:08.360769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8b132-e771-431b-bfd5-08ff64e660bc tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] PATH_INFO: `/v3/users/a2f9f39774b143d1884e9e235e5e84af/application_credentials` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:08.361907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8b132-e771-431b-bfd5-08ff64e660bc tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: Adding query filter params (name=tempest-application_credential-780837681) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:36:08.362448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8b132-e771-431b-bfd5-08ff64e660bc tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: Authorizing `identity:list_application_credentials(user_id=a2f9f39774b143d1884e9e235e5e84af)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:08.365486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8b132-e771-431b-bfd5-08ff64e660bc tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:08.377212 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4003/7951] 10.222.0.33 () {58 vars in 1384 bytes} [Sat Aug 6 21:36:08 2022] GET /identity/v3/users/a2f9f39774b143d1884e9e235e5e84af/application_credentials?name=tempest-application_credential-780837681 => generated 885 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:36:08.381583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d97cb-60c9-45e8-a250-040e8e09c9e3 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:08.391310 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d97cb-60c9-45e8-a250-040e8e09c9e3 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:08.395500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594df3e6-c673-47bb-8862-de488ef822e8 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2f9f39774b143d1884e9e235e5e84af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33f15ce164f34529b220da0986e5d791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:08.396133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594df3e6-c673-47bb-8862-de488ef822e8 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:08.396415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594df3e6-c673-47bb-8862-de488ef822e8 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:08.396690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594df3e6-c673-47bb-8862-de488ef822e8 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] PATH_INFO: `/v3/users/a2f9f39774b143d1884e9e235e5e84af/application_credentials/3115d38c138d4869b7d3442e0b5f3f25` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:08.405788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594df3e6-c673-47bb-8862-de488ef822e8 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: Authorizing `identity:delete_application_credential(user_id=a2f9f39774b143d1884e9e235e5e84af, application_credential_id=3115d38c138d4869b7d3442e0b5f3f25)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:08.407374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594df3e6-c673-47bb-8862-de488ef822e8 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:08.427245 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3949/7952] 10.222.0.33 () {58 vars in 1395 bytes} [Sat Aug 6 21:36:08 2022] DELETE /identity/v3/users/a2f9f39774b143d1884e9e235e5e84af/application_credentials/3115d38c138d4869b7d3442e0b5f3f25 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:08.432347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8b132-e771-431b-bfd5-08ff64e660bc tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:08.441824 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8b132-e771-431b-bfd5-08ff64e660bc tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:08.446037 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5ee26-2bae-40f1-a212-a46da01d3eca tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2f9f39774b143d1884e9e235e5e84af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33f15ce164f34529b220da0986e5d791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:08.447304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5ee26-2bae-40f1-a212-a46da01d3eca tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:08.447606 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5ee26-2bae-40f1-a212-a46da01d3eca tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:08.447873 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5ee26-2bae-40f1-a212-a46da01d3eca tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] PATH_INFO: `/v3/users/a2f9f39774b143d1884e9e235e5e84af/application_credentials/05452ba19cf045dd8ab4b22472aa7dd8` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:08.456421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e5ee26-2bae-40f1-a212-a46da01d3eca tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: Authorizing `identity:delete_application_credential(user_id=a2f9f39774b143d1884e9e235e5e84af, application_credential_id=05452ba19cf045dd8ab4b22472aa7dd8)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:08.458092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e5ee26-2bae-40f1-a212-a46da01d3eca tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:08.481588 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4004/7953] 10.222.0.33 () {58 vars in 1395 bytes} [Sat Aug 6 21:36:08 2022] DELETE /identity/v3/users/a2f9f39774b143d1884e9e235e5e84af/application_credentials/05452ba19cf045dd8ab4b22472aa7dd8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:08.486876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594df3e6-c673-47bb-8862-de488ef822e8 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:08.552008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594df3e6-c673-47bb-8862-de488ef822e8 tempest-ApplicationCredentialsV3Test-252094855 tempest-ApplicationCredentialsV3Test-252094855-project] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:08.557774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54589063-17c6-40ea-a3e3-36cf59ca249a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:08.558393 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54589063-17c6-40ea-a3e3-36cf59ca249a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:08.558718 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54589063-17c6-40ea-a3e3-36cf59ca249a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:08.558992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54589063-17c6-40ea-a3e3-36cf59ca249a admin admin] PATH_INFO: `/v3/users/a2f9f39774b143d1884e9e235e5e84af` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:08.560111 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54589063-17c6-40ea-a3e3-36cf59ca249a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2f9f39774b143d1884e9e235e5e84af)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:08.562060 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54589063-17c6-40ea-a3e3-36cf59ca249a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:08.594706 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:08.610203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-54589063-17c6-40ea-a3e3-36cf59ca249a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2f9f39774b143d1884e9e235e5e84af'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:08.610956 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-54589063-17c6-40ea-a3e3-36cf59ca249a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2f9f39774b143d1884e9e235e5e84af'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:08.611588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-54589063-17c6-40ea-a3e3-36cf59ca249a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2f9f39774b143d1884e9e235e5e84af'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:08.618713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-54589063-17c6-40ea-a3e3-36cf59ca249a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2f9f39774b143d1884e9e235e5e84af'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:08.638794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-54589063-17c6-40ea-a3e3-36cf59ca249a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2f9f39774b143d1884e9e235e5e84af'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:08.651934 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3950/7954] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:36:08 2022] DELETE /identity/v3/users/a2f9f39774b143d1884e9e235e5e84af => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:08.656623 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552c138-78d4-496b-8fc0-ded35b0b4e76 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:08.656906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552c138-78d4-496b-8fc0-ded35b0b4e76 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:08.657403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552c138-78d4-496b-8fc0-ded35b0b4e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:08.677132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-3552c138-78d4-496b-8fc0-ded35b0b4e76 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:08.678328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3552c138-78d4-496b-8fc0-ded35b0b4e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:08.736026 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4005/7955] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:08.746424 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54589063-17c6-40ea-a3e3-36cf59ca249a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:08.747854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-54589063-17c6-40ea-a3e3-36cf59ca249a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:08.807785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54589063-17c6-40ea-a3e3-36cf59ca249a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:08.811461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ab38e-18ba-4020-a44f-27db2afdb402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:08.812068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ab38e-18ba-4020-a44f-27db2afdb402 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:08.812344 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ab38e-18ba-4020-a44f-27db2afdb402 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:08.812612 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ab38e-18ba-4020-a44f-27db2afdb402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:08.824858 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ab38e-18ba-4020-a44f-27db2afdb402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:08.826300 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ab38e-18ba-4020-a44f-27db2afdb402 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:08.835755 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3951/7956] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:36:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:36:09.108570 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552c138-78d4-496b-8fc0-ded35b0b4e76 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:09.110098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3552c138-78d4-496b-8fc0-ded35b0b4e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:09.127054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552c138-78d4-496b-8fc0-ded35b0b4e76 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:09.131759 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ab22d-a7ee-4877-a58e-3c650893b517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:09.132403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ab22d-a7ee-4877-a58e-3c650893b517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:09.132744 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ab22d-a7ee-4877-a58e-3c650893b517 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:09.132959 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ab22d-a7ee-4877-a58e-3c650893b517 admin admin] PATH_INFO: `/v3/projects/33f15ce164f34529b220da0986e5d791` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:09.134220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ab22d-a7ee-4877-a58e-3c650893b517 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33f15ce164f34529b220da0986e5d791)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:09.136188 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ab22d-a7ee-4877-a58e-3c650893b517 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:09.186333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9d6ab22d-a7ee-4877-a58e-3c650893b517 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33f15ce164f34529b220da0986e5d791', 'request_id': 'req-9d6ab22d-a7ee-4877-a58e-3c650893b517'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:09.191876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9d6ab22d-a7ee-4877-a58e-3c650893b517 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33f15ce164f34529b220da0986e5d791', 'request_id': 'req-9d6ab22d-a7ee-4877-a58e-3c650893b517'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:09.198834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9d6ab22d-a7ee-4877-a58e-3c650893b517 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33f15ce164f34529b220da0986e5d791', 'request_id': 'req-9d6ab22d-a7ee-4877-a58e-3c650893b517'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:09.209985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9d6ab22d-a7ee-4877-a58e-3c650893b517 admin admin] The token cache is being invalidate because project 33f15ce164f34529b220da0986e5d791 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:36:09.210269 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9d6ab22d-a7ee-4877-a58e-3c650893b517 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:09.210919 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9d6ab22d-a7ee-4877-a58e-3c650893b517 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:09.212454 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4006/7957] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:36:09 2022] DELETE /identity/v3/projects/33f15ce164f34529b220da0986e5d791 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:09.219170 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60681881-7328-4bbd-8a48-9641edf1b4c0 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:09.219484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60681881-7328-4bbd-8a48-9641edf1b4c0 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:09.219759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60681881-7328-4bbd-8a48-9641edf1b4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:09.239374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-60681881-7328-4bbd-8a48-9641edf1b4c0 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:09.240555 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-60681881-7328-4bbd-8a48-9641edf1b4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:09.300379 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3952/7958] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:09.308338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31556f0f-b30a-4956-8e1d-fc4b88bb0f25 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:09.308623 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31556f0f-b30a-4956-8e1d-fc4b88bb0f25 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:09.308898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31556f0f-b30a-4956-8e1d-fc4b88bb0f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:09.329068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-31556f0f-b30a-4956-8e1d-fc4b88bb0f25 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:09.330272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-31556f0f-b30a-4956-8e1d-fc4b88bb0f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:09.338865 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4007/7959] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:09.343094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60681881-7328-4bbd-8a48-9641edf1b4c0 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:09.352879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60681881-7328-4bbd-8a48-9641edf1b4c0 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:09.357525 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93daab2-cc54-4929-b447-b3927331aa38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:09.358062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93daab2-cc54-4929-b447-b3927331aa38 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:09.358344 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93daab2-cc54-4929-b447-b3927331aa38 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:09.358656 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93daab2-cc54-4929-b447-b3927331aa38 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:09.359304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93daab2-cc54-4929-b447-b3927331aa38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:36:09.359616 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93daab2-cc54-4929-b447-b3927331aa38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:09.361266 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93daab2-cc54-4929-b447-b3927331aa38 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:09.372938 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3953/7960] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:36:09.377344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31556f0f-b30a-4956-8e1d-fc4b88bb0f25 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:09.387434 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31556f0f-b30a-4956-8e1d-fc4b88bb0f25 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:09.392225 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae76ce-a31f-4b10-8029-72829e9b4a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:09.392825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae76ce-a31f-4b10-8029-72829e9b4a98 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:09.393105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae76ce-a31f-4b10-8029-72829e9b4a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:09.393383 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae76ce-a31f-4b10-8029-72829e9b4a98 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:09.394010 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae76ce-a31f-4b10-8029-72829e9b4a98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:09.395942 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae76ce-a31f-4b10-8029-72829e9b4a98 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:09.424964 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4008/7961] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:36:09 2022] POST /identity/v3/projects => generated 359 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:36:09.428638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93daab2-cc54-4929-b447-b3927331aa38 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:09.439553 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93daab2-cc54-4929-b447-b3927331aa38 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:09.471885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:09.501511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce0cd8-f063-44c5-9715-6b9b685be386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:09.502113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce0cd8-f063-44c5-9715-6b9b685be386 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:09.502388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce0cd8-f063-44c5-9715-6b9b685be386 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:09.502693 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce0cd8-f063-44c5-9715-6b9b685be386 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:09.503301 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce0cd8-f063-44c5-9715-6b9b685be386 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:09.505208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce0cd8-f063-44c5-9715-6b9b685be386 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:09.526276 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3954/7962] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:36:09 2022] POST /identity/v3/users => generated 280 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:36:09.530292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae76ce-a31f-4b10-8029-72829e9b4a98 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:09.541684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae76ce-a31f-4b10-8029-72829e9b4a98 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:09.546318 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885ad1c-0835-4c40-9358-a6921cb8db1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:09.546942 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885ad1c-0835-4c40-9358-a6921cb8db1d admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:09.547473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885ad1c-0835-4c40-9358-a6921cb8db1d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:09.547747 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885ad1c-0835-4c40-9358-a6921cb8db1d admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:09.548384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e885ad1c-0835-4c40-9358-a6921cb8db1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:09.549969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e885ad1c-0835-4c40-9358-a6921cb8db1d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:09.552047 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:09.564976 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4009/7963] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:36:09.565746 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce0cd8-f063-44c5-9715-6b9b685be386 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:09.576066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce0cd8-f063-44c5-9715-6b9b685be386 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:09.580682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce7d46-6096-4f00-b960-cc462a9b111a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:09.581274 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce7d46-6096-4f00-b960-cc462a9b111a admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:09.581553 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce7d46-6096-4f00-b960-cc462a9b111a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:09.581823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce7d46-6096-4f00-b960-cc462a9b111a admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:09.582453 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ce7d46-6096-4f00-b960-cc462a9b111a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:09.584056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ce7d46-6096-4f00-b960-cc462a9b111a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:09.596391 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3955/7964] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:36:09.600763 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885ad1c-0835-4c40-9358-a6921cb8db1d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:09.611602 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885ad1c-0835-4c40-9358-a6921cb8db1d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:09.616119 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893ba01-d536-4994-8abe-ae3ecbf3320d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:09.616762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893ba01-d536-4994-8abe-ae3ecbf3320d admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:09.617042 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893ba01-d536-4994-8abe-ae3ecbf3320d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:09.617313 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893ba01-d536-4994-8abe-ae3ecbf3320d admin admin] PATH_INFO: `/v3/projects/7c1e899f02b04540bcc95db107da8c47/users/50295dddd7aa444dad1c5a324d21f8a1/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:09.632069 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893ba01-d536-4994-8abe-ae3ecbf3320d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c1e899f02b04540bcc95db107da8c47, user_id=50295dddd7aa444dad1c5a324d21f8a1, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:09.635452 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893ba01-d536-4994-8abe-ae3ecbf3320d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:09.648397 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4010/7965] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:36:09 2022] PUT /identity/v3/projects/7c1e899f02b04540bcc95db107da8c47/users/50295dddd7aa444dad1c5a324d21f8a1/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:36:09.658952 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6802f4-e662-4a9f-89f8-45767a0446a1 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:09.659241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6802f4-e662-4a9f-89f8-45767a0446a1 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:09.659510 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6802f4-e662-4a9f-89f8-45767a0446a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:09.689152 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-be6802f4-e662-4a9f-89f8-45767a0446a1 None None] MFA Rules not processed for user `50295dddd7aa444dad1c5a324d21f8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:09.690349 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-be6802f4-e662-4a9f-89f8-45767a0446a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:09.756978 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3956/7966] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:09 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:09.769486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893ba01-d536-4994-8abe-ae3ecbf3320d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:09.771220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3893ba01-d536-4994-8abe-ae3ecbf3320d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:09.831780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893ba01-d536-4994-8abe-ae3ecbf3320d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:09.835459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27d77c-b672-47a1-9c6a-63c1ebfe41d5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10759b2abd4cafacf338551327775e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:09.836054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27d77c-b672-47a1-9c6a-63c1ebfe41d5 service glance] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:09.836333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27d77c-b672-47a1-9c6a-63c1ebfe41d5 service glance] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:09.836609 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27d77c-b672-47a1-9c6a-63c1ebfe41d5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:09.845772 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed27d77c-b672-47a1-9c6a-63c1ebfe41d5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:09.847225 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed27d77c-b672-47a1-9c6a-63c1ebfe41d5 service glance] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:09.856371 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4011/7967] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:36:09 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:36:10.193595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6802f4-e662-4a9f-89f8-45767a0446a1 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:10.260821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6802f4-e662-4a9f-89f8-45767a0446a1 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:10.265337 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6252ea8-1721-43c0-a9db-5c7d70c311bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:10.265956 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6252ea8-1721-43c0-a9db-5c7d70c311bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:10.266232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6252ea8-1721-43c0-a9db-5c7d70c311bc admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:10.266500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6252ea8-1721-43c0-a9db-5c7d70c311bc admin admin] PATH_INFO: `/v3/users/50295dddd7aa444dad1c5a324d21f8a1` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:10.267649 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6252ea8-1721-43c0-a9db-5c7d70c311bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=50295dddd7aa444dad1c5a324d21f8a1)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:10.269634 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6252ea8-1721-43c0-a9db-5c7d70c311bc admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:10.312133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:10.314486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e6252ea8-1721-43c0-a9db-5c7d70c311bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50295dddd7aa444dad1c5a324d21f8a1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:10.315241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e6252ea8-1721-43c0-a9db-5c7d70c311bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50295dddd7aa444dad1c5a324d21f8a1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:10.316361 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e6252ea8-1721-43c0-a9db-5c7d70c311bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50295dddd7aa444dad1c5a324d21f8a1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:10.324416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e6252ea8-1721-43c0-a9db-5c7d70c311bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50295dddd7aa444dad1c5a324d21f8a1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:10.336216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e6252ea8-1721-43c0-a9db-5c7d70c311bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50295dddd7aa444dad1c5a324d21f8a1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:10.348294 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3957/7968] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:36:10 2022] DELETE /identity/v3/users/50295dddd7aa444dad1c5a324d21f8a1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:10.352835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a0793-e731-46d5-8d97-33bcb27653ff None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:10.353128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a0793-e731-46d5-8d97-33bcb27653ff None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:10.353408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a0793-e731-46d5-8d97-33bcb27653ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:10.372647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a44a0793-e731-46d5-8d97-33bcb27653ff None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:10.373860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a44a0793-e731-46d5-8d97-33bcb27653ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:10.436487 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4012/7969] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:10.446121 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6252ea8-1721-43c0-a9db-5c7d70c311bc admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:10.448163 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e6252ea8-1721-43c0-a9db-5c7d70c311bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:10.507259 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6252ea8-1721-43c0-a9db-5c7d70c311bc admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:10.511785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e318596-9315-4299-a59a-d5a78842d465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:10.512384 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e318596-9315-4299-a59a-d5a78842d465 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:10.512663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e318596-9315-4299-a59a-d5a78842d465 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:10.512938 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e318596-9315-4299-a59a-d5a78842d465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:10.522215 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e318596-9315-4299-a59a-d5a78842d465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:10.523730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e318596-9315-4299-a59a-d5a78842d465 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:10.534982 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3958/7970] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:36:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:36:10.801838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a0793-e731-46d5-8d97-33bcb27653ff None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:10.803365 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a44a0793-e731-46d5-8d97-33bcb27653ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:10.816246 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a0793-e731-46d5-8d97-33bcb27653ff None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:10.821972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147cd26b-6408-4549-bf74-212884712529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:10.822267 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cd26b-6408-4549-bf74-212884712529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:10.822764 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cd26b-6408-4549-bf74-212884712529 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:10.823045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cd26b-6408-4549-bf74-212884712529 admin admin] PATH_INFO: `/v3/projects/7c1e899f02b04540bcc95db107da8c47` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:10.824189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147cd26b-6408-4549-bf74-212884712529 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c1e899f02b04540bcc95db107da8c47)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:10.826105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147cd26b-6408-4549-bf74-212884712529 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:10.874557 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-147cd26b-6408-4549-bf74-212884712529 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c1e899f02b04540bcc95db107da8c47', 'request_id': 'req-147cd26b-6408-4549-bf74-212884712529'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:10.880024 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-147cd26b-6408-4549-bf74-212884712529 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c1e899f02b04540bcc95db107da8c47', 'request_id': 'req-147cd26b-6408-4549-bf74-212884712529'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:10.887968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-147cd26b-6408-4549-bf74-212884712529 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c1e899f02b04540bcc95db107da8c47', 'request_id': 'req-147cd26b-6408-4549-bf74-212884712529'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:10.895803 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:10.901098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-147cd26b-6408-4549-bf74-212884712529 admin admin] The token cache is being invalidate because project 7c1e899f02b04540bcc95db107da8c47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:36:10.901454 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-147cd26b-6408-4549-bf74-212884712529 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:10.902395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-147cd26b-6408-4549-bf74-212884712529 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:10.904402 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4013/7971] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:36:10 2022] DELETE /identity/v3/projects/7c1e899f02b04540bcc95db107da8c47 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:36:10.909346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4802d-fdce-4c71-afae-93bd718698d1 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:10.909817 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4802d-fdce-4c71-afae-93bd718698d1 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:10.909923 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4802d-fdce-4c71-afae-93bd718698d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:10.929353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-0fc4802d-fdce-4c71-afae-93bd718698d1 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:10.930605 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0fc4802d-fdce-4c71-afae-93bd718698d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:10.989226 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3959/7972] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:10.998958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9f9ba-4925-400d-9468-6a8d3c11032d None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:10.999243 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9f9ba-4925-400d-9468-6a8d3c11032d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:10.999570 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9f9ba-4925-400d-9468-6a8d3c11032d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:11.018851 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-5fd9f9ba-4925-400d-9468-6a8d3c11032d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:11.020037 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5fd9f9ba-4925-400d-9468-6a8d3c11032d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:11.028376 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4014/7973] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:11.032528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4802d-fdce-4c71-afae-93bd718698d1 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:11.043312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4802d-fdce-4c71-afae-93bd718698d1 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:11.048282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2c9e2-67bb-4d07-996c-dc4488f1acc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:11.048873 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2c9e2-67bb-4d07-996c-dc4488f1acc8 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:11.049152 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2c9e2-67bb-4d07-996c-dc4488f1acc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:11.049426 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2c9e2-67bb-4d07-996c-dc4488f1acc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:11.050068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2c9e2-67bb-4d07-996c-dc4488f1acc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:36:11.050372 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2c9e2-67bb-4d07-996c-dc4488f1acc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:11.052043 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2c9e2-67bb-4d07-996c-dc4488f1acc8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:11.063367 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3960/7974] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:36:11.067553 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9f9ba-4925-400d-9468-6a8d3c11032d None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:11.076797 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9f9ba-4925-400d-9468-6a8d3c11032d None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:11.081394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d5c4e-b8ec-4b6f-8b43-303291986d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:11.081979 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d5c4e-b8ec-4b6f-8b43-303291986d4f admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:11.082256 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d5c4e-b8ec-4b6f-8b43-303291986d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:11.082524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d5c4e-b8ec-4b6f-8b43-303291986d4f admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:11.083155 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d5c4e-b8ec-4b6f-8b43-303291986d4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:11.085094 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d5c4e-b8ec-4b6f-8b43-303291986d4f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:11.115794 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4015/7975] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:36:11 2022] POST /identity/v3/projects => generated 407 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:36:11.120233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2c9e2-67bb-4d07-996c-dc4488f1acc8 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:11.130165 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2c9e2-67bb-4d07-996c-dc4488f1acc8 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:11.176427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:11.187996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99c5f1-87d0-4dae-9667-4e52c0d29202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:11.188601 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99c5f1-87d0-4dae-9667-4e52c0d29202 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:11.188878 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99c5f1-87d0-4dae-9667-4e52c0d29202 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:11.189150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99c5f1-87d0-4dae-9667-4e52c0d29202 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:11.189763 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99c5f1-87d0-4dae-9667-4e52c0d29202 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:11.191722 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99c5f1-87d0-4dae-9667-4e52c0d29202 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:11.214560 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3961/7976] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:36:11 2022] POST /identity/v3/users => generated 304 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:36:11.216637 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d5c4e-b8ec-4b6f-8b43-303291986d4f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:11.226942 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d5c4e-b8ec-4b6f-8b43-303291986d4f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:11.232759 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6f9ef-d482-4e03-b2b4-059e9dcf473a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:11.233355 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6f9ef-d482-4e03-b2b4-059e9dcf473a admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:11.233634 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6f9ef-d482-4e03-b2b4-059e9dcf473a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:11.233907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6f9ef-d482-4e03-b2b4-059e9dcf473a admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:11.234572 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6f9ef-d482-4e03-b2b4-059e9dcf473a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:11.236162 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6f9ef-d482-4e03-b2b4-059e9dcf473a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:11.249928 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4016/7977] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:36:11.251247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99c5f1-87d0-4dae-9667-4e52c0d29202 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:11.261858 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99c5f1-87d0-4dae-9667-4e52c0d29202 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:11.266839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385b918-e271-46c3-9999-1c18054728ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:11.267442 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385b918-e271-46c3-9999-1c18054728ee admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:11.267733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385b918-e271-46c3-9999-1c18054728ee admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:11.268011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385b918-e271-46c3-9999-1c18054728ee admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:11.268651 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f385b918-e271-46c3-9999-1c18054728ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:11.270245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f385b918-e271-46c3-9999-1c18054728ee admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:11.282032 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3962/7978] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:36:11.286128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6f9ef-d482-4e03-b2b4-059e9dcf473a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:11.296980 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6f9ef-d482-4e03-b2b4-059e9dcf473a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:11.301959 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab752b3a-55b2-49c6-b1d6-ba926455bfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:11.302630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab752b3a-55b2-49c6-b1d6-ba926455bfbe admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:11.302909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab752b3a-55b2-49c6-b1d6-ba926455bfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:11.303178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab752b3a-55b2-49c6-b1d6-ba926455bfbe admin admin] PATH_INFO: `/v3/projects/eb36e93a749047c8b3ca6bba2d341a00/users/37fd652128c846c4bac1a08454555431/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:11.317980 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab752b3a-55b2-49c6-b1d6-ba926455bfbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb36e93a749047c8b3ca6bba2d341a00, user_id=37fd652128c846c4bac1a08454555431, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:11.320645 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab752b3a-55b2-49c6-b1d6-ba926455bfbe admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:11.333324 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4017/7979] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:36:11 2022] PUT /identity/v3/projects/eb36e93a749047c8b3ca6bba2d341a00/users/37fd652128c846c4bac1a08454555431/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:36:11.343564 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83322f0e-bcea-4635-9948-a98cf465e203 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:11.343852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83322f0e-bcea-4635-9948-a98cf465e203 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:11.344126 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83322f0e-bcea-4635-9948-a98cf465e203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:11.372697 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-83322f0e-bcea-4635-9948-a98cf465e203 None None] MFA Rules not processed for user `37fd652128c846c4bac1a08454555431`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:11.373903 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-83322f0e-bcea-4635-9948-a98cf465e203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:11.437999 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3963/7980] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:11 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:11.442520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab752b3a-55b2-49c6-b1d6-ba926455bfbe admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:11.504023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab752b3a-55b2-49c6-b1d6-ba926455bfbe admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:11.508653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a4ef3-359d-4b11-8780-e18571874108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:11.509266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a4ef3-359d-4b11-8780-e18571874108 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:11.509549 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a4ef3-359d-4b11-8780-e18571874108 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:11.509840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a4ef3-359d-4b11-8780-e18571874108 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:11.510442 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a4ef3-359d-4b11-8780-e18571874108 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:11.512380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a4ef3-359d-4b11-8780-e18571874108 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:11.541893 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4018/7981] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:36:11 2022] POST /identity/v3/projects => generated 407 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:36:11.543078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83322f0e-bcea-4635-9948-a98cf465e203 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:11.554122 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83322f0e-bcea-4635-9948-a98cf465e203 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:11.610613 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a31cb-073e-4485-a6a8-189516b4540f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:11.611209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a31cb-073e-4485-a6a8-189516b4540f admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:11.611512 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a31cb-073e-4485-a6a8-189516b4540f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:11.611786 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a31cb-073e-4485-a6a8-189516b4540f admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:11.612419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a31cb-073e-4485-a6a8-189516b4540f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:11.614381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a31cb-073e-4485-a6a8-189516b4540f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:11.635867 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3964/7982] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:36:11 2022] POST /identity/v3/users => generated 310 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:36:11.639980 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a4ef3-359d-4b11-8780-e18571874108 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:11.651500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a4ef3-359d-4b11-8780-e18571874108 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:11.656293 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d36bd-4bcb-4a06-a194-9bf83002b6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:11.656896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d36bd-4bcb-4a06-a194-9bf83002b6c0 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:11.657177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d36bd-4bcb-4a06-a194-9bf83002b6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:11.657451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d36bd-4bcb-4a06-a194-9bf83002b6c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:11.658093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d36bd-4bcb-4a06-a194-9bf83002b6c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:11.659752 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d36bd-4bcb-4a06-a194-9bf83002b6c0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:11.671175 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4019/7983] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:36:11.676021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a31cb-073e-4485-a6a8-189516b4540f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:11.687559 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a31cb-073e-4485-a6a8-189516b4540f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:11.692500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055ef8a-70a7-4e00-a5f8-81048e67896b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:11.693191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055ef8a-70a7-4e00-a5f8-81048e67896b admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:11.693471 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055ef8a-70a7-4e00-a5f8-81048e67896b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:11.693748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055ef8a-70a7-4e00-a5f8-81048e67896b admin admin] PATH_INFO: `/v3/projects/fcf460df37dc4b10bf8bce43083e245a/users/80e5171de7504268b83d8366bde782c2/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:11.709258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055ef8a-70a7-4e00-a5f8-81048e67896b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcf460df37dc4b10bf8bce43083e245a, user_id=80e5171de7504268b83d8366bde782c2, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:11.711994 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055ef8a-70a7-4e00-a5f8-81048e67896b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:11.725027 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3965/7984] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:36:11 2022] PUT /identity/v3/projects/fcf460df37dc4b10bf8bce43083e245a/users/80e5171de7504268b83d8366bde782c2/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:11.729127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d36bd-4bcb-4a06-a194-9bf83002b6c0 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:11.739089 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d36bd-4bcb-4a06-a194-9bf83002b6c0 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:11.795475 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34cf55-20ae-44cc-b9d4-ae955cbc64f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:11.796009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34cf55-20ae-44cc-b9d4-ae955cbc64f5 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:11.796291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34cf55-20ae-44cc-b9d4-ae955cbc64f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:11.796569 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34cf55-20ae-44cc-b9d4-ae955cbc64f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:11.797467 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34cf55-20ae-44cc-b9d4-ae955cbc64f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:11.799093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34cf55-20ae-44cc-b9d4-ae955cbc64f5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:11.809179 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4020/7985] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:36:11.813467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055ef8a-70a7-4e00-a5f8-81048e67896b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:11.823984 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055ef8a-70a7-4e00-a5f8-81048e67896b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:11.828677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6622c0-29bc-44f4-9cc5-64254bf9140e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:11.829322 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6622c0-29bc-44f4-9cc5-64254bf9140e admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:11.829605 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6622c0-29bc-44f4-9cc5-64254bf9140e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:11.829885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6622c0-29bc-44f4-9cc5-64254bf9140e admin admin] PATH_INFO: `/v3/projects/fcf460df37dc4b10bf8bce43083e245a/users/80e5171de7504268b83d8366bde782c2/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:11.831886 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6622c0-29bc-44f4-9cc5-64254bf9140e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcf460df37dc4b10bf8bce43083e245a, user_id=80e5171de7504268b83d8366bde782c2, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:11.834532 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6622c0-29bc-44f4-9cc5-64254bf9140e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:11.845121 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3966/7986] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:36:11 2022] PUT /identity/v3/projects/fcf460df37dc4b10bf8bce43083e245a/users/80e5171de7504268b83d8366bde782c2/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:11.856219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47bdcb-5959-45be-b259-282bbf9204ba None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:11.856507 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47bdcb-5959-45be-b259-282bbf9204ba None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:11.856792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47bdcb-5959-45be-b259-282bbf9204ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:11.870964 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:11.888489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-fa47bdcb-5959-45be-b259-282bbf9204ba None None] MFA Rules not processed for user `80e5171de7504268b83d8366bde782c2`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:11.889727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-fa47bdcb-5959-45be-b259-282bbf9204ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:11.966997 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4021/7987] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:11 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:11.976999 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6622c0-29bc-44f4-9cc5-64254bf9140e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:11.979776 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6b6622c0-29bc-44f4-9cc5-64254bf9140e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:11.993820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:12.041108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6622c0-29bc-44f4-9cc5-64254bf9140e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:12.044801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43a651-aaf1-40fe-94f4-ce991b16261b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:12.045398 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43a651-aaf1-40fe-94f4-ce991b16261b service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:12.045730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43a651-aaf1-40fe-94f4-ce991b16261b service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:12.045949 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43a651-aaf1-40fe-94f4-ce991b16261b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:12.101531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43a651-aaf1-40fe-94f4-ce991b16261b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:12.103455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43a651-aaf1-40fe-94f4-ce991b16261b service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:12.112265 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3967/7988] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:36:11 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:36:12.437580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47bdcb-5959-45be-b259-282bbf9204ba None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:12.439745 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-fa47bdcb-5959-45be-b259-282bbf9204ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:12.517011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47bdcb-5959-45be-b259-282bbf9204ba None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:12.522584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496ed60-b1bf-49a9-8f29-496baea7b2c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:12.523193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496ed60-b1bf-49a9-8f29-496baea7b2c9 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:12.523477 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496ed60-b1bf-49a9-8f29-496baea7b2c9 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:12.523749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496ed60-b1bf-49a9-8f29-496baea7b2c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:12.532992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7496ed60-b1bf-49a9-8f29-496baea7b2c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:12.534584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7496ed60-b1bf-49a9-8f29-496baea7b2c9 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:12.543890 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4022/7989] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:36:12 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:36:16.965009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43a651-aaf1-40fe-94f4-ce991b16261b service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:17.028240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43a651-aaf1-40fe-94f4-ce991b16261b service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:17.032839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f48660-40a7-48d4-96af-7a7aebba6358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:17.033458 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f48660-40a7-48d4-96af-7a7aebba6358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:17.033739 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f48660-40a7-48d4-96af-7a7aebba6358 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:17.034013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f48660-40a7-48d4-96af-7a7aebba6358 admin admin] PATH_INFO: `/v3/users/37fd652128c846c4bac1a08454555431` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:17.035150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f48660-40a7-48d4-96af-7a7aebba6358 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37fd652128c846c4bac1a08454555431)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:17.037107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f48660-40a7-48d4-96af-7a7aebba6358 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:17.083425 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-48f48660-40a7-48d4-96af-7a7aebba6358 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37fd652128c846c4bac1a08454555431'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:17.084010 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-48f48660-40a7-48d4-96af-7a7aebba6358 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37fd652128c846c4bac1a08454555431'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:17.084644 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-48f48660-40a7-48d4-96af-7a7aebba6358 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37fd652128c846c4bac1a08454555431'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:17.092218 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-48f48660-40a7-48d4-96af-7a7aebba6358 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37fd652128c846c4bac1a08454555431'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:17.102406 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:17.105147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-48f48660-40a7-48d4-96af-7a7aebba6358 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37fd652128c846c4bac1a08454555431'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:17.118772 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3968/7990] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:36:16 2022] DELETE /identity/v3/users/37fd652128c846c4bac1a08454555431 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:17.123866 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622297f7-1ac7-466d-a44b-112fd367ab54 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:17.124360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622297f7-1ac7-466d-a44b-112fd367ab54 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:17.124479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622297f7-1ac7-466d-a44b-112fd367ab54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:17.143488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-622297f7-1ac7-466d-a44b-112fd367ab54 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:17.144689 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-622297f7-1ac7-466d-a44b-112fd367ab54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:17.202680 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4023/7991] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:17.212484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f48660-40a7-48d4-96af-7a7aebba6358 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:17.213925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-48f48660-40a7-48d4-96af-7a7aebba6358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:17.272837 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f48660-40a7-48d4-96af-7a7aebba6358 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:17.276739 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529efccb-7b12-4c5f-8c00-210ba39483be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:17.277340 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529efccb-7b12-4c5f-8c00-210ba39483be service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:17.277644 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529efccb-7b12-4c5f-8c00-210ba39483be service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:17.277922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529efccb-7b12-4c5f-8c00-210ba39483be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:17.286954 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529efccb-7b12-4c5f-8c00-210ba39483be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:17.288383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529efccb-7b12-4c5f-8c00-210ba39483be service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:17.298849 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3969/7992] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:36:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:36:17.467948 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622297f7-1ac7-466d-a44b-112fd367ab54 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:17.469410 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-622297f7-1ac7-466d-a44b-112fd367ab54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:17.482456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622297f7-1ac7-466d-a44b-112fd367ab54 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:17.487928 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72873422-3dc6-47b4-9d3e-c9b51edcb0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:17.488806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72873422-3dc6-47b4-9d3e-c9b51edcb0c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:17.489087 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72873422-3dc6-47b4-9d3e-c9b51edcb0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:17.489360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72873422-3dc6-47b4-9d3e-c9b51edcb0c9 admin admin] PATH_INFO: `/v3/projects/eb36e93a749047c8b3ca6bba2d341a00` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:17.490489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72873422-3dc6-47b4-9d3e-c9b51edcb0c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb36e93a749047c8b3ca6bba2d341a00)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:17.492520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72873422-3dc6-47b4-9d3e-c9b51edcb0c9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:17.505765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:17.541186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-72873422-3dc6-47b4-9d3e-c9b51edcb0c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb36e93a749047c8b3ca6bba2d341a00', 'request_id': 'req-72873422-3dc6-47b4-9d3e-c9b51edcb0c9'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:17.547920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-72873422-3dc6-47b4-9d3e-c9b51edcb0c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb36e93a749047c8b3ca6bba2d341a00', 'request_id': 'req-72873422-3dc6-47b4-9d3e-c9b51edcb0c9'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:17.554291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-72873422-3dc6-47b4-9d3e-c9b51edcb0c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb36e93a749047c8b3ca6bba2d341a00', 'request_id': 'req-72873422-3dc6-47b4-9d3e-c9b51edcb0c9'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:17.566176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-72873422-3dc6-47b4-9d3e-c9b51edcb0c9 admin admin] The token cache is being invalidate because project eb36e93a749047c8b3ca6bba2d341a00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:36:17.566464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-72873422-3dc6-47b4-9d3e-c9b51edcb0c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:17.567127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-72873422-3dc6-47b4-9d3e-c9b51edcb0c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:17.568607 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4024/7993] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:36:17 2022] DELETE /identity/v3/projects/eb36e93a749047c8b3ca6bba2d341a00 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:36:17.572624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529efccb-7b12-4c5f-8c00-210ba39483be service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:17.582680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529efccb-7b12-4c5f-8c00-210ba39483be service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:17.643751 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a628d-432d-4464-b70d-050c2db9d06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:17.644374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a628d-432d-4464-b70d-050c2db9d06b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:17.644650 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a628d-432d-4464-b70d-050c2db9d06b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:17.644922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a628d-432d-4464-b70d-050c2db9d06b admin admin] PATH_INFO: `/v3/users/80e5171de7504268b83d8366bde782c2` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:17.646044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a628d-432d-4464-b70d-050c2db9d06b admin admin] RBAC: Authorizing `identity:delete_user(user_id=80e5171de7504268b83d8366bde782c2)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:17.647987 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a628d-432d-4464-b70d-050c2db9d06b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:17.697245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d74a628d-432d-4464-b70d-050c2db9d06b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80e5171de7504268b83d8366bde782c2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:17.697941 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d74a628d-432d-4464-b70d-050c2db9d06b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80e5171de7504268b83d8366bde782c2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:17.698573 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d74a628d-432d-4464-b70d-050c2db9d06b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80e5171de7504268b83d8366bde782c2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:17.705640 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d74a628d-432d-4464-b70d-050c2db9d06b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80e5171de7504268b83d8366bde782c2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:17.717791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d74a628d-432d-4464-b70d-050c2db9d06b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80e5171de7504268b83d8366bde782c2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:17.730537 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3970/7994] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:36:17 2022] DELETE /identity/v3/users/80e5171de7504268b83d8366bde782c2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:17.910307 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72873422-3dc6-47b4-9d3e-c9b51edcb0c9 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:17.911921 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-72873422-3dc6-47b4-9d3e-c9b51edcb0c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:17.926375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72873422-3dc6-47b4-9d3e-c9b51edcb0c9 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:17.986797 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e35c326-630d-45d1-85be-49a188e1aa1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:17.987431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35c326-630d-45d1-85be-49a188e1aa1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:17.987705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35c326-630d-45d1-85be-49a188e1aa1c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:17.987975 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35c326-630d-45d1-85be-49a188e1aa1c admin admin] PATH_INFO: `/v3/projects/fcf460df37dc4b10bf8bce43083e245a` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:17.989075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e35c326-630d-45d1-85be-49a188e1aa1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcf460df37dc4b10bf8bce43083e245a)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:17.991047 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e35c326-630d-45d1-85be-49a188e1aa1c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:18.036170 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9e35c326-630d-45d1-85be-49a188e1aa1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcf460df37dc4b10bf8bce43083e245a', 'request_id': 'req-9e35c326-630d-45d1-85be-49a188e1aa1c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:18.042147 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9e35c326-630d-45d1-85be-49a188e1aa1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcf460df37dc4b10bf8bce43083e245a', 'request_id': 'req-9e35c326-630d-45d1-85be-49a188e1aa1c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:18.049806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9e35c326-630d-45d1-85be-49a188e1aa1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcf460df37dc4b10bf8bce43083e245a', 'request_id': 'req-9e35c326-630d-45d1-85be-49a188e1aa1c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:18.061295 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9e35c326-630d-45d1-85be-49a188e1aa1c admin admin] The token cache is being invalidate because project fcf460df37dc4b10bf8bce43083e245a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:36:18.061578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9e35c326-630d-45d1-85be-49a188e1aa1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:18.062208 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-9e35c326-630d-45d1-85be-49a188e1aa1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:18.063728 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4025/7995] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:36:17 2022] DELETE /identity/v3/projects/fcf460df37dc4b10bf8bce43083e245a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:36:18.068710 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7825413-99ff-404e-8d50-fb5bca62820d None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:18.069172 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7825413-99ff-404e-8d50-fb5bca62820d None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:18.069322 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7825413-99ff-404e-8d50-fb5bca62820d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:18.083417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:18.090026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f7825413-99ff-404e-8d50-fb5bca62820d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:18.091924 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f7825413-99ff-404e-8d50-fb5bca62820d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:18.151248 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3971/7996] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:18.160573 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b949c3-29f2-4d9b-b81a-a9ee5055870b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:18.161074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b949c3-29f2-4d9b-b81a-a9ee5055870b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:18.161201 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b949c3-29f2-4d9b-b81a-a9ee5055870b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:18.181222 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-19b949c3-29f2-4d9b-b81a-a9ee5055870b None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:18.183026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-19b949c3-29f2-4d9b-b81a-a9ee5055870b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:18.191014 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4026/7997] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:18.195362 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7825413-99ff-404e-8d50-fb5bca62820d None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:18.206368 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7825413-99ff-404e-8d50-fb5bca62820d None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:18.211034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f6b07-5b41-4626-8dfe-ed1103574865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:18.211636 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f6b07-5b41-4626-8dfe-ed1103574865 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:18.211917 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f6b07-5b41-4626-8dfe-ed1103574865 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:18.212193 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f6b07-5b41-4626-8dfe-ed1103574865 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:18.212855 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f6b07-5b41-4626-8dfe-ed1103574865 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:36:18.213194 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f6b07-5b41-4626-8dfe-ed1103574865 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:18.214808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f6b07-5b41-4626-8dfe-ed1103574865 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:18.226284 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3972/7998] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:36:18.231247 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b949c3-29f2-4d9b-b81a-a9ee5055870b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:18.240591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b949c3-29f2-4d9b-b81a-a9ee5055870b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:18.245864 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1813b-0c1a-465e-8236-7d4fabcadaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:18.246450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1813b-0c1a-465e-8236-7d4fabcadaa1 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:18.246762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1813b-0c1a-465e-8236-7d4fabcadaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:18.247065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1813b-0c1a-465e-8236-7d4fabcadaa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:18.247689 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da1813b-0c1a-465e-8236-7d4fabcadaa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:18.249565 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da1813b-0c1a-465e-8236-7d4fabcadaa1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:18.278657 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4027/7999] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:36:18 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:36:18.282885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f6b07-5b41-4626-8dfe-ed1103574865 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:18.292770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f6b07-5b41-4626-8dfe-ed1103574865 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:18.350896 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b071a-3706-491c-9641-6dcb849ad7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:18.351499 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b071a-3706-491c-9641-6dcb849ad7ee admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:18.351781 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b071a-3706-491c-9641-6dcb849ad7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:18.352055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b071a-3706-491c-9641-6dcb849ad7ee admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:18.352677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b071a-3706-491c-9641-6dcb849ad7ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:18.354871 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b071a-3706-491c-9641-6dcb849ad7ee admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:18.376554 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3973/8000] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:36:18 2022] POST /identity/v3/users => generated 282 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:36:18.380831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1813b-0c1a-465e-8236-7d4fabcadaa1 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:18.386965 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:18.394079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1813b-0c1a-465e-8236-7d4fabcadaa1 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:18.399773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8435831-0a8e-48b8-a737-c7664d9b1640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:18.400373 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8435831-0a8e-48b8-a737-c7664d9b1640 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:18.400754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8435831-0a8e-48b8-a737-c7664d9b1640 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:18.401167 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8435831-0a8e-48b8-a737-c7664d9b1640 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:18.402043 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8435831-0a8e-48b8-a737-c7664d9b1640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:18.403604 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8435831-0a8e-48b8-a737-c7664d9b1640 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:18.413581 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4028/8001] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:36:18.417894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b071a-3706-491c-9641-6dcb849ad7ee admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:18.428251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b071a-3706-491c-9641-6dcb849ad7ee admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:18.433496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a24bda-3acc-4dc8-9145-d6f1656bfb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:18.434114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a24bda-3acc-4dc8-9145-d6f1656bfb73 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:18.434387 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a24bda-3acc-4dc8-9145-d6f1656bfb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:18.434692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a24bda-3acc-4dc8-9145-d6f1656bfb73 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:18.435326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a24bda-3acc-4dc8-9145-d6f1656bfb73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:18.436983 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a24bda-3acc-4dc8-9145-d6f1656bfb73 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:18.447684 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3974/8002] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:36:18.452269 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8435831-0a8e-48b8-a737-c7664d9b1640 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:18.462062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8435831-0a8e-48b8-a737-c7664d9b1640 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:18.466764 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04416f-37ab-4af0-a706-d0035acfc0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:18.467406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04416f-37ab-4af0-a706-d0035acfc0fd admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:18.467683 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04416f-37ab-4af0-a706-d0035acfc0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:18.467957 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04416f-37ab-4af0-a706-d0035acfc0fd admin admin] PATH_INFO: `/v3/projects/72217e4c33b449fb9f55176888dfa083/users/2ca48f30ee1b4d488a3b2d705d1b6298/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:18.482426 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04416f-37ab-4af0-a706-d0035acfc0fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=72217e4c33b449fb9f55176888dfa083, user_id=2ca48f30ee1b4d488a3b2d705d1b6298, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:18.485086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04416f-37ab-4af0-a706-d0035acfc0fd admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:18.499242 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4029/8003] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:36:18 2022] PUT /identity/v3/projects/72217e4c33b449fb9f55176888dfa083/users/2ca48f30ee1b4d488a3b2d705d1b6298/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:18.509568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ef227-7a74-480f-bc72-293f098bd3c0 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:18.509855 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ef227-7a74-480f-bc72-293f098bd3c0 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:18.510918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ef227-7a74-480f-bc72-293f098bd3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:18.538916 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-415ef227-7a74-480f-bc72-293f098bd3c0 None None] MFA Rules not processed for user `2ca48f30ee1b4d488a3b2d705d1b6298`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:18.540118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-415ef227-7a74-480f-bc72-293f098bd3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:18.604240 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3975/8004] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:18.608847 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04416f-37ab-4af0-a706-d0035acfc0fd admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:18.675431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04416f-37ab-4af0-a706-d0035acfc0fd admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:18.680199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39713570-8a85-4e72-bf92-7d464a7fc087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:18.680805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39713570-8a85-4e72-bf92-7d464a7fc087 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:18.681089 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39713570-8a85-4e72-bf92-7d464a7fc087 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:18.681364 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39713570-8a85-4e72-bf92-7d464a7fc087 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:18.682521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39713570-8a85-4e72-bf92-7d464a7fc087 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:18.684617 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39713570-8a85-4e72-bf92-7d464a7fc087 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:18.720104 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4030/8005] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:36:18 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:36:18.721237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ef227-7a74-480f-bc72-293f098bd3c0 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:18.726790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:18.733918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ef227-7a74-480f-bc72-293f098bd3c0 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:18.790197 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ecf2d6-f7d1-4324-bf69-ead049d8507f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:18.790826 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ecf2d6-f7d1-4324-bf69-ead049d8507f admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:18.791103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ecf2d6-f7d1-4324-bf69-ead049d8507f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:18.791451 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ecf2d6-f7d1-4324-bf69-ead049d8507f admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:18.792091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ecf2d6-f7d1-4324-bf69-ead049d8507f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:18.793991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ecf2d6-f7d1-4324-bf69-ead049d8507f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:18.816391 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3976/8006] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:36:18 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:36:18.820487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39713570-8a85-4e72-bf92-7d464a7fc087 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:18.831696 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39713570-8a85-4e72-bf92-7d464a7fc087 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:18.836339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310638f-bb9a-40ea-8a93-83d9b64435de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:18.836936 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310638f-bb9a-40ea-8a93-83d9b64435de admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:18.837214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310638f-bb9a-40ea-8a93-83d9b64435de admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:18.837487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310638f-bb9a-40ea-8a93-83d9b64435de admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:18.838125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b310638f-bb9a-40ea-8a93-83d9b64435de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:18.839998 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b310638f-bb9a-40ea-8a93-83d9b64435de admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:18.850407 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4031/8007] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:36:18.854795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ecf2d6-f7d1-4324-bf69-ead049d8507f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:18.864742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ecf2d6-f7d1-4324-bf69-ead049d8507f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:18.869336 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c59471-906d-4f61-add6-85efb4a97c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:18.870759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c59471-906d-4f61-add6-85efb4a97c0d admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:18.871035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c59471-906d-4f61-add6-85efb4a97c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:18.871307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c59471-906d-4f61-add6-85efb4a97c0d admin admin] PATH_INFO: `/v3/projects/7a996e893e624e61b7583d6f5499180c/users/cc9ae33037f34e3d96309792be051be3/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:18.886394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c59471-906d-4f61-add6-85efb4a97c0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a996e893e624e61b7583d6f5499180c, user_id=cc9ae33037f34e3d96309792be051be3, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:18.889071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c59471-906d-4f61-add6-85efb4a97c0d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:18.901461 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3977/8008] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:36:18 2022] PUT /identity/v3/projects/7a996e893e624e61b7583d6f5499180c/users/cc9ae33037f34e3d96309792be051be3/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:18.905483 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310638f-bb9a-40ea-8a93-83d9b64435de admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:18.915542 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310638f-bb9a-40ea-8a93-83d9b64435de admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:18.971986 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa597f-c854-47c8-9b8c-00dcfaf1388d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:18.972583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa597f-c854-47c8-9b8c-00dcfaf1388d admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:18.972860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa597f-c854-47c8-9b8c-00dcfaf1388d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:18.973130 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa597f-c854-47c8-9b8c-00dcfaf1388d admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:18.973759 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa597f-c854-47c8-9b8c-00dcfaf1388d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:18.975375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa597f-c854-47c8-9b8c-00dcfaf1388d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:18.984955 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4032/8009] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:36:18.989206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c59471-906d-4f61-add6-85efb4a97c0d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:19.000282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c59471-906d-4f61-add6-85efb4a97c0d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:19.004848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c08921-de6d-47ab-bb03-2a0bd72e6f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:19.005484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c08921-de6d-47ab-bb03-2a0bd72e6f3e admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:19.005759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c08921-de6d-47ab-bb03-2a0bd72e6f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:19.006029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c08921-de6d-47ab-bb03-2a0bd72e6f3e admin admin] PATH_INFO: `/v3/projects/7a996e893e624e61b7583d6f5499180c/users/cc9ae33037f34e3d96309792be051be3/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:19.007953 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c08921-de6d-47ab-bb03-2a0bd72e6f3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a996e893e624e61b7583d6f5499180c, user_id=cc9ae33037f34e3d96309792be051be3, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:19.011333 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c08921-de6d-47ab-bb03-2a0bd72e6f3e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:19.021352 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3978/8010] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:36:18 2022] PUT /identity/v3/projects/7a996e893e624e61b7583d6f5499180c/users/cc9ae33037f34e3d96309792be051be3/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:19.031502 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30658b86-18e8-49f5-8d33-f8979a48ef94 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:19.031814 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30658b86-18e8-49f5-8d33-f8979a48ef94 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:19.032095 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30658b86-18e8-49f5-8d33-f8979a48ef94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:19.060322 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-30658b86-18e8-49f5-8d33-f8979a48ef94 None None] MFA Rules not processed for user `cc9ae33037f34e3d96309792be051be3`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:19.061589 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-30658b86-18e8-49f5-8d33-f8979a48ef94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:19.088071 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:19.130352 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4033/8011] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:19 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:19.141467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c08921-de6d-47ab-bb03-2a0bd72e6f3e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:19.143306 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b9c08921-de6d-47ab-bb03-2a0bd72e6f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:19.203268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c08921-de6d-47ab-bb03-2a0bd72e6f3e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:19.207028 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e861489-beda-40b8-acc4-863b3f8006f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:19.207631 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e861489-beda-40b8-acc4-863b3f8006f4 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:19.207912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e861489-beda-40b8-acc4-863b3f8006f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:19.208183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e861489-beda-40b8-acc4-863b3f8006f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:19.217647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e861489-beda-40b8-acc4-863b3f8006f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:19.219104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e861489-beda-40b8-acc4-863b3f8006f4 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:19.228505 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3979/8012] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:36:19 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:36:21.018096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30658b86-18e8-49f5-8d33-f8979a48ef94 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:21.030618 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30658b86-18e8-49f5-8d33-f8979a48ef94 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:21.034146 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03043567-4c72-4a4d-83c6-851241a71fdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:21.034774 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03043567-4c72-4a4d-83c6-851241a71fdd service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:21.035059 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03043567-4c72-4a4d-83c6-851241a71fdd service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:21.035334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03043567-4c72-4a4d-83c6-851241a71fdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:21.092567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03043567-4c72-4a4d-83c6-851241a71fdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:21.093987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03043567-4c72-4a4d-83c6-851241a71fdd service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:21.102787 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4034/8013] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:36:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:36:22.171467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e861489-beda-40b8-acc4-863b3f8006f4 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:22.230032 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:22.234276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e861489-beda-40b8-acc4-863b3f8006f4 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:22.239724 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780a039-33ce-401c-8bf4-11e8c34370df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:22.240355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780a039-33ce-401c-8bf4-11e8c34370df admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:22.240639 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780a039-33ce-401c-8bf4-11e8c34370df admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:22.240915 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780a039-33ce-401c-8bf4-11e8c34370df admin admin] PATH_INFO: `/v3/users/2ca48f30ee1b4d488a3b2d705d1b6298` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:22.242038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780a039-33ce-401c-8bf4-11e8c34370df admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ca48f30ee1b4d488a3b2d705d1b6298)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:22.244072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780a039-33ce-401c-8bf4-11e8c34370df admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:22.291222 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f780a039-33ce-401c-8bf4-11e8c34370df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ca48f30ee1b4d488a3b2d705d1b6298'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:22.292857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f780a039-33ce-401c-8bf4-11e8c34370df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ca48f30ee1b4d488a3b2d705d1b6298'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:22.293475 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f780a039-33ce-401c-8bf4-11e8c34370df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ca48f30ee1b4d488a3b2d705d1b6298'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:22.303281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f780a039-33ce-401c-8bf4-11e8c34370df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ca48f30ee1b4d488a3b2d705d1b6298'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:22.316758 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f780a039-33ce-401c-8bf4-11e8c34370df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ca48f30ee1b4d488a3b2d705d1b6298'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:22.328780 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3980/8014] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:36:22 2022] DELETE /identity/v3/users/2ca48f30ee1b4d488a3b2d705d1b6298 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:22.333261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a19614-3581-4597-9e97-9041dffd21a2 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:22.333759 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a19614-3581-4597-9e97-9041dffd21a2 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:22.333894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a19614-3581-4597-9e97-9041dffd21a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:22.352640 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-54a19614-3581-4597-9e97-9041dffd21a2 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:22.353846 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-54a19614-3581-4597-9e97-9041dffd21a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:22.423356 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4035/8015] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:22.434227 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780a039-33ce-401c-8bf4-11e8c34370df admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:22.435686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f780a039-33ce-401c-8bf4-11e8c34370df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:22.495435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780a039-33ce-401c-8bf4-11e8c34370df admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:22.499065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679aafc-8638-4f35-b522-4c9bc43a2f43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:22.499659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679aafc-8638-4f35-b522-4c9bc43a2f43 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:22.499936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679aafc-8638-4f35-b522-4c9bc43a2f43 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:22.500204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679aafc-8638-4f35-b522-4c9bc43a2f43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:22.508958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679aafc-8638-4f35-b522-4c9bc43a2f43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:22.510489 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679aafc-8638-4f35-b522-4c9bc43a2f43 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:22.519731 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3981/8016] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:36:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:36:22.795367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a19614-3581-4597-9e97-9041dffd21a2 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:22.796894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-54a19614-3581-4597-9e97-9041dffd21a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:22.811327 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a19614-3581-4597-9e97-9041dffd21a2 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:22.816584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f2330-81a3-4824-a6fe-19d2a8588acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:22.817236 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f2330-81a3-4824-a6fe-19d2a8588acf admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:22.817520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f2330-81a3-4824-a6fe-19d2a8588acf admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:22.817797 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f2330-81a3-4824-a6fe-19d2a8588acf admin admin] PATH_INFO: `/v3/projects/72217e4c33b449fb9f55176888dfa083` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:22.819761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f2330-81a3-4824-a6fe-19d2a8588acf admin admin] RBAC: Authorizing `identity:delete_project(project_id=72217e4c33b449fb9f55176888dfa083)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:22.821698 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f2330-81a3-4824-a6fe-19d2a8588acf admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:22.873592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ab7f2330-81a3-4824-a6fe-19d2a8588acf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72217e4c33b449fb9f55176888dfa083', 'request_id': 'req-ab7f2330-81a3-4824-a6fe-19d2a8588acf'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:22.878610 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:22.880590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ab7f2330-81a3-4824-a6fe-19d2a8588acf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72217e4c33b449fb9f55176888dfa083', 'request_id': 'req-ab7f2330-81a3-4824-a6fe-19d2a8588acf'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:22.890571 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ab7f2330-81a3-4824-a6fe-19d2a8588acf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72217e4c33b449fb9f55176888dfa083', 'request_id': 'req-ab7f2330-81a3-4824-a6fe-19d2a8588acf'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:22.903841 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ab7f2330-81a3-4824-a6fe-19d2a8588acf admin admin] The token cache is being invalidate because project 72217e4c33b449fb9f55176888dfa083 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:36:22.904134 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ab7f2330-81a3-4824-a6fe-19d2a8588acf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:22.904792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ab7f2330-81a3-4824-a6fe-19d2a8588acf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:22.906505 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4036/8017] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:36:22 2022] DELETE /identity/v3/projects/72217e4c33b449fb9f55176888dfa083 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:22.910392 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679aafc-8638-4f35-b522-4c9bc43a2f43 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:22.920748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679aafc-8638-4f35-b522-4c9bc43a2f43 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:22.977632 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb7e16-9a77-4b9c-b892-85427a3403b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:22.978254 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb7e16-9a77-4b9c-b892-85427a3403b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:22.978531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb7e16-9a77-4b9c-b892-85427a3403b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:22.978833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb7e16-9a77-4b9c-b892-85427a3403b1 admin admin] PATH_INFO: `/v3/users/cc9ae33037f34e3d96309792be051be3` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:22.980029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb7e16-9a77-4b9c-b892-85427a3403b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc9ae33037f34e3d96309792be051be3)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:22.981941 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb7e16-9a77-4b9c-b892-85427a3403b1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:23.004135 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:23.029298 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f4bb7e16-9a77-4b9c-b892-85427a3403b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc9ae33037f34e3d96309792be051be3'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:23.029956 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f4bb7e16-9a77-4b9c-b892-85427a3403b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc9ae33037f34e3d96309792be051be3'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:23.030603 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f4bb7e16-9a77-4b9c-b892-85427a3403b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc9ae33037f34e3d96309792be051be3'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:23.038775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f4bb7e16-9a77-4b9c-b892-85427a3403b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc9ae33037f34e3d96309792be051be3'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:23.051546 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f4bb7e16-9a77-4b9c-b892-85427a3403b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc9ae33037f34e3d96309792be051be3'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:23.064194 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3982/8018] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:36:22 2022] DELETE /identity/v3/users/cc9ae33037f34e3d96309792be051be3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:36:23.343612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f2330-81a3-4824-a6fe-19d2a8588acf admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:23.345101 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ab7f2330-81a3-4824-a6fe-19d2a8588acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:23.360631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f2330-81a3-4824-a6fe-19d2a8588acf admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:23.419965 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570cfcf-e115-4a23-8a2c-8fe1f74dd341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:23.420596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570cfcf-e115-4a23-8a2c-8fe1f74dd341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:23.420877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570cfcf-e115-4a23-8a2c-8fe1f74dd341 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:23.421148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570cfcf-e115-4a23-8a2c-8fe1f74dd341 admin admin] PATH_INFO: `/v3/projects/7a996e893e624e61b7583d6f5499180c` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:23.422267 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570cfcf-e115-4a23-8a2c-8fe1f74dd341 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a996e893e624e61b7583d6f5499180c)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:23.424455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570cfcf-e115-4a23-8a2c-8fe1f74dd341 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:23.472332 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8570cfcf-e115-4a23-8a2c-8fe1f74dd341 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a996e893e624e61b7583d6f5499180c', 'request_id': 'req-8570cfcf-e115-4a23-8a2c-8fe1f74dd341'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:23.480531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8570cfcf-e115-4a23-8a2c-8fe1f74dd341 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a996e893e624e61b7583d6f5499180c', 'request_id': 'req-8570cfcf-e115-4a23-8a2c-8fe1f74dd341'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:23.488774 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8570cfcf-e115-4a23-8a2c-8fe1f74dd341 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a996e893e624e61b7583d6f5499180c', 'request_id': 'req-8570cfcf-e115-4a23-8a2c-8fe1f74dd341'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:23.502115 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8570cfcf-e115-4a23-8a2c-8fe1f74dd341 admin admin] The token cache is being invalidate because project 7a996e893e624e61b7583d6f5499180c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:36:23.502402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8570cfcf-e115-4a23-8a2c-8fe1f74dd341 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:23.503085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8570cfcf-e115-4a23-8a2c-8fe1f74dd341 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:23.504564 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4037/8019] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:36:23 2022] DELETE /identity/v3/projects/7a996e893e624e61b7583d6f5499180c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:36:23.511671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e257ac5-4fdf-41a9-9b5a-2e997d5f9265 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:23.512208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e257ac5-4fdf-41a9-9b5a-2e997d5f9265 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:23.512314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e257ac5-4fdf-41a9-9b5a-2e997d5f9265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:23.535938 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-8e257ac5-4fdf-41a9-9b5a-2e997d5f9265 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:23.537136 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8e257ac5-4fdf-41a9-9b5a-2e997d5f9265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:23.603066 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3983/8020] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:23.612749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f65ee7-ae91-4154-879d-caafe358714e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:23.613236 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f65ee7-ae91-4154-879d-caafe358714e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:23.613752 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f65ee7-ae91-4154-879d-caafe358714e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:23.639394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-81f65ee7-ae91-4154-879d-caafe358714e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:23.641562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-81f65ee7-ae91-4154-879d-caafe358714e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:23.651791 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4038/8021] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:23.655680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e257ac5-4fdf-41a9-9b5a-2e997d5f9265 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:23.665977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e257ac5-4fdf-41a9-9b5a-2e997d5f9265 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:23.671687 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21975eeb-5512-4ccb-9718-c3009706a1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:23.672738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21975eeb-5512-4ccb-9718-c3009706a1ae admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:23.672738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21975eeb-5512-4ccb-9718-c3009706a1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:23.672944 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21975eeb-5512-4ccb-9718-c3009706a1ae admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:23.673734 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21975eeb-5512-4ccb-9718-c3009706a1ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:36:23.674046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21975eeb-5512-4ccb-9718-c3009706a1ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:23.675705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21975eeb-5512-4ccb-9718-c3009706a1ae admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:23.689449 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3984/8022] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:36:23.694026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f65ee7-ae91-4154-879d-caafe358714e None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:23.704370 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f65ee7-ae91-4154-879d-caafe358714e None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:23.709961 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bafc47-b1e1-4b12-bb9a-29499694fa4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:23.710826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bafc47-b1e1-4b12-bb9a-29499694fa4a admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:23.711115 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bafc47-b1e1-4b12-bb9a-29499694fa4a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:23.711403 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bafc47-b1e1-4b12-bb9a-29499694fa4a admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:23.712053 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bafc47-b1e1-4b12-bb9a-29499694fa4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:23.714507 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bafc47-b1e1-4b12-bb9a-29499694fa4a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:23.749915 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4039/8023] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:36:23 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:36:23.753626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21975eeb-5512-4ccb-9718-c3009706a1ae admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:23.765296 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21975eeb-5512-4ccb-9718-c3009706a1ae admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:23.829842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f108d5-c8f9-4bf8-b523-8c8042bcce95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:23.830456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f108d5-c8f9-4bf8-b523-8c8042bcce95 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:23.830777 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f108d5-c8f9-4bf8-b523-8c8042bcce95 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:23.831051 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f108d5-c8f9-4bf8-b523-8c8042bcce95 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:23.831681 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f108d5-c8f9-4bf8-b523-8c8042bcce95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:23.833600 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f108d5-c8f9-4bf8-b523-8c8042bcce95 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:23.857495 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3985/8024] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:36:23 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:36:23.861866 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bafc47-b1e1-4b12-bb9a-29499694fa4a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:23.873123 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bafc47-b1e1-4b12-bb9a-29499694fa4a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:23.877964 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f768c4-ccfe-4c0d-b41d-2a7dc8a13c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:23.878599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f768c4-ccfe-4c0d-b41d-2a7dc8a13c24 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:23.878885 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f768c4-ccfe-4c0d-b41d-2a7dc8a13c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:23.879166 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f768c4-ccfe-4c0d-b41d-2a7dc8a13c24 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:23.879801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f768c4-ccfe-4c0d-b41d-2a7dc8a13c24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:23.881453 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f768c4-ccfe-4c0d-b41d-2a7dc8a13c24 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:23.892198 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4040/8025] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:36:23.896412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f108d5-c8f9-4bf8-b523-8c8042bcce95 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:23.907222 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f108d5-c8f9-4bf8-b523-8c8042bcce95 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:23.912756 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7167eba8-9b84-417e-862e-fd6e705d8d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:23.913358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167eba8-9b84-417e-862e-fd6e705d8d9d admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:23.913637 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167eba8-9b84-417e-862e-fd6e705d8d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:23.913906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167eba8-9b84-417e-862e-fd6e705d8d9d admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:23.914800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7167eba8-9b84-417e-862e-fd6e705d8d9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:23.916557 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7167eba8-9b84-417e-862e-fd6e705d8d9d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:23.929838 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3986/8026] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:36:23.934787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f768c4-ccfe-4c0d-b41d-2a7dc8a13c24 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:23.946356 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f768c4-ccfe-4c0d-b41d-2a7dc8a13c24 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:23.953731 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f89d1f-8a53-40ab-9d4c-9b6523d2d026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:23.954973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f89d1f-8a53-40ab-9d4c-9b6523d2d026 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:23.955449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f89d1f-8a53-40ab-9d4c-9b6523d2d026 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:23.955926 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f89d1f-8a53-40ab-9d4c-9b6523d2d026 admin admin] PATH_INFO: `/v3/projects/4162539b4cbf4f718faa54c8967287da/users/b6c879a2bb1844ec89a0a633858e2f1d/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:23.973389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f89d1f-8a53-40ab-9d4c-9b6523d2d026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4162539b4cbf4f718faa54c8967287da, user_id=b6c879a2bb1844ec89a0a633858e2f1d, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:23.976470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f89d1f-8a53-40ab-9d4c-9b6523d2d026 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:23.994193 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4041/8027] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:36:23 2022] PUT /identity/v3/projects/4162539b4cbf4f718faa54c8967287da/users/b6c879a2bb1844ec89a0a633858e2f1d/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:24.005361 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85a958-1f38-4bd9-8d70-bd179d5d77a5 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:24.005602 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85a958-1f38-4bd9-8d70-bd179d5d77a5 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:24.005875 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85a958-1f38-4bd9-8d70-bd179d5d77a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:24.015044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:24.040307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-bc85a958-1f38-4bd9-8d70-bd179d5d77a5 None None] MFA Rules not processed for user `b6c879a2bb1844ec89a0a633858e2f1d`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:24.041532 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-bc85a958-1f38-4bd9-8d70-bd179d5d77a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:24.111535 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3987/8028] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:24.122861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f89d1f-8a53-40ab-9d4c-9b6523d2d026 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:24.124605 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-27f89d1f-8a53-40ab-9d4c-9b6523d2d026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:24.141058 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:24.193208 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f89d1f-8a53-40ab-9d4c-9b6523d2d026 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:24.196940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1d069-dc2a-41f6-929a-d28327007f90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:24.197619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1d069-dc2a-41f6-929a-d28327007f90 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:24.198116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1d069-dc2a-41f6-929a-d28327007f90 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:24.198534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1d069-dc2a-41f6-929a-d28327007f90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:24.210058 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b1d069-dc2a-41f6-929a-d28327007f90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:24.211544 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b1d069-dc2a-41f6-929a-d28327007f90 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:24.221752 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4042/8029] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:36:24 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:36:34.108797 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=30 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:34.217541 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=21 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:34.779735 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85a958-1f38-4bd9-8d70-bd179d5d77a5 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:34.781236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-bc85a958-1f38-4bd9-8d70-bd179d5d77a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:34.846929 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1d069-dc2a-41f6-929a-d28327007f90 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:34.874281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85a958-1f38-4bd9-8d70-bd179d5d77a5 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:34.879694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52bfeb-3008-40b9-8642-2aba96557994 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:34.880300 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52bfeb-3008-40b9-8642-2aba96557994 service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:34.880578 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52bfeb-3008-40b9-8642-2aba96557994 service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:34.880853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52bfeb-3008-40b9-8642-2aba96557994 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:34.882624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ce52bfeb-3008-40b9-8642-2aba96557994 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:34.896748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52bfeb-3008-40b9-8642-2aba96557994 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:34.898767 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52bfeb-3008-40b9-8642-2aba96557994 service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:34.911312 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3988/8030] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:36:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:36:34.920308 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1d069-dc2a-41f6-929a-d28327007f90 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:34.925312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216d22e-87f8-4c39-9366-fda1d5a41f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:34.926075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216d22e-87f8-4c39-9366-fda1d5a41f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:34.926265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216d22e-87f8-4c39-9366-fda1d5a41f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:34.926524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216d22e-87f8-4c39-9366-fda1d5a41f63 admin admin] PATH_INFO: `/v3/users/b6c879a2bb1844ec89a0a633858e2f1d` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:34.927695 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216d22e-87f8-4c39-9366-fda1d5a41f63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6c879a2bb1844ec89a0a633858e2f1d)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:34.929616 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216d22e-87f8-4c39-9366-fda1d5a41f63 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:34.977166 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5216d22e-87f8-4c39-9366-fda1d5a41f63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6c879a2bb1844ec89a0a633858e2f1d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:34.984462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5216d22e-87f8-4c39-9366-fda1d5a41f63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6c879a2bb1844ec89a0a633858e2f1d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:34.985124 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5216d22e-87f8-4c39-9366-fda1d5a41f63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6c879a2bb1844ec89a0a633858e2f1d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:34.985729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5216d22e-87f8-4c39-9366-fda1d5a41f63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6c879a2bb1844ec89a0a633858e2f1d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:34.993187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5216d22e-87f8-4c39-9366-fda1d5a41f63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6c879a2bb1844ec89a0a633858e2f1d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:35.012172 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4043/8031] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:36:34 2022] DELETE /identity/v3/users/b6c879a2bb1844ec89a0a633858e2f1d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:36:35.016772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d983819-d545-41e1-9729-0fae8bf57ae7 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:35.017095 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d983819-d545-41e1-9729-0fae8bf57ae7 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:35.017362 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d983819-d545-41e1-9729-0fae8bf57ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:35.035956 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-9d983819-d545-41e1-9729-0fae8bf57ae7 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:35.037141 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9d983819-d545-41e1-9729-0fae8bf57ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:35.094460 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3989/8032] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:35.104154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216d22e-87f8-4c39-9366-fda1d5a41f63 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:35.106255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5216d22e-87f8-4c39-9366-fda1d5a41f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:35.164986 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216d22e-87f8-4c39-9366-fda1d5a41f63 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:35.168781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6fc905-a0b8-45f1-b9b7-e8baf5f00b8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:35.169381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fc905-a0b8-45f1-b9b7-e8baf5f00b8f service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:35.169662 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fc905-a0b8-45f1-b9b7-e8baf5f00b8f service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:35.169936 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fc905-a0b8-45f1-b9b7-e8baf5f00b8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:35.179148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6fc905-a0b8-45f1-b9b7-e8baf5f00b8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:35.180570 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6fc905-a0b8-45f1-b9b7-e8baf5f00b8f service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:35.190130 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4044/8033] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:36:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:36:35.370039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d983819-d545-41e1-9729-0fae8bf57ae7 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:35.372532 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9d983819-d545-41e1-9729-0fae8bf57ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:35.384947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d983819-d545-41e1-9729-0fae8bf57ae7 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:35.390460 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74988c8d-eba6-4edd-a3ef-02b6021090f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:35.391141 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74988c8d-eba6-4edd-a3ef-02b6021090f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:35.391424 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74988c8d-eba6-4edd-a3ef-02b6021090f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:35.391698 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74988c8d-eba6-4edd-a3ef-02b6021090f1 admin admin] PATH_INFO: `/v3/projects/4162539b4cbf4f718faa54c8967287da` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:35.392821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74988c8d-eba6-4edd-a3ef-02b6021090f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4162539b4cbf4f718faa54c8967287da)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:35.395083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74988c8d-eba6-4edd-a3ef-02b6021090f1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:35.442286 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-74988c8d-eba6-4edd-a3ef-02b6021090f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4162539b4cbf4f718faa54c8967287da', 'request_id': 'req-74988c8d-eba6-4edd-a3ef-02b6021090f1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:35.447655 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-74988c8d-eba6-4edd-a3ef-02b6021090f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4162539b4cbf4f718faa54c8967287da', 'request_id': 'req-74988c8d-eba6-4edd-a3ef-02b6021090f1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:35.453746 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-74988c8d-eba6-4edd-a3ef-02b6021090f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4162539b4cbf4f718faa54c8967287da', 'request_id': 'req-74988c8d-eba6-4edd-a3ef-02b6021090f1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:35.467357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-74988c8d-eba6-4edd-a3ef-02b6021090f1 admin admin] The token cache is being invalidate because project 4162539b4cbf4f718faa54c8967287da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:36:35.467651 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-74988c8d-eba6-4edd-a3ef-02b6021090f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:35.468330 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-74988c8d-eba6-4edd-a3ef-02b6021090f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:35.469947 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3990/8034] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:36:35 2022] DELETE /identity/v3/projects/4162539b4cbf4f718faa54c8967287da => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:35.476164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e0c44-7f3f-4470-a15b-a63b13de38fc None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:35.476702 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e0c44-7f3f-4470-a15b-a63b13de38fc None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:35.476702 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e0c44-7f3f-4470-a15b-a63b13de38fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:35.504996 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-0d0e0c44-7f3f-4470-a15b-a63b13de38fc None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:35.506423 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0d0e0c44-7f3f-4470-a15b-a63b13de38fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:35.529394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:35.592314 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4045/8035] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:35.602532 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f22923-7156-4133-919e-d96db3f63018 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:35.602842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f22923-7156-4133-919e-d96db3f63018 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:35.603157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f22923-7156-4133-919e-d96db3f63018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:35.630046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-27f22923-7156-4133-919e-d96db3f63018 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:35.631322 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-27f22923-7156-4133-919e-d96db3f63018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:35.640866 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3991/8036] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:35.645158 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e0c44-7f3f-4470-a15b-a63b13de38fc None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:35.655932 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e0c44-7f3f-4470-a15b-a63b13de38fc None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:35.660817 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda14ab-6064-403c-8eb6-2018754575f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:35.661420 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda14ab-6064-403c-8eb6-2018754575f2 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:35.661697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda14ab-6064-403c-8eb6-2018754575f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:35.661966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda14ab-6064-403c-8eb6-2018754575f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:35.663143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda14ab-6064-403c-8eb6-2018754575f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:36:35.663453 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda14ab-6064-403c-8eb6-2018754575f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:35.665056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda14ab-6064-403c-8eb6-2018754575f2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:35.683036 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4046/8037] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:36:35.687648 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f22923-7156-4133-919e-d96db3f63018 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:35.696953 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f22923-7156-4133-919e-d96db3f63018 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:35.702419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd34ddf-424b-4d36-aaaf-e3fbe461aa5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:35.703037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd34ddf-424b-4d36-aaaf-e3fbe461aa5d admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:35.703318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd34ddf-424b-4d36-aaaf-e3fbe461aa5d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:35.703589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd34ddf-424b-4d36-aaaf-e3fbe461aa5d admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:35.704194 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd34ddf-424b-4d36-aaaf-e3fbe461aa5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:35.706097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd34ddf-424b-4d36-aaaf-e3fbe461aa5d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:35.710523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:35.736590 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3992/8038] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:36:35 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:36:35.740568 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda14ab-6064-403c-8eb6-2018754575f2 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:35.751059 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda14ab-6064-403c-8eb6-2018754575f2 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:35.808158 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18fb320-79c1-491c-a58f-76e47f62d3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:35.808783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fb320-79c1-491c-a58f-76e47f62d3e8 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:35.809060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fb320-79c1-491c-a58f-76e47f62d3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:35.809361 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fb320-79c1-491c-a58f-76e47f62d3e8 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:35.809980 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18fb320-79c1-491c-a58f-76e47f62d3e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:35.811900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18fb320-79c1-491c-a58f-76e47f62d3e8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:35.832758 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4047/8039] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:36:35 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:36:35.836915 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd34ddf-424b-4d36-aaaf-e3fbe461aa5d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:35.847954 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd34ddf-424b-4d36-aaaf-e3fbe461aa5d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:35.852622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d28242-c81f-4732-be02-6a4763bdc06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:35.853216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d28242-c81f-4732-be02-6a4763bdc06f admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:35.853497 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d28242-c81f-4732-be02-6a4763bdc06f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:35.853770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d28242-c81f-4732-be02-6a4763bdc06f admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:35.854426 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d28242-c81f-4732-be02-6a4763bdc06f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:35.856089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d28242-c81f-4732-be02-6a4763bdc06f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:35.865823 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3993/8040] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:36:35.869946 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18fb320-79c1-491c-a58f-76e47f62d3e8 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:35.880301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18fb320-79c1-491c-a58f-76e47f62d3e8 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:35.884962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd8796-f8b9-40cc-aafa-77d1961179b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:35.885555 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd8796-f8b9-40cc-aafa-77d1961179b4 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:35.885838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd8796-f8b9-40cc-aafa-77d1961179b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:35.886715 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd8796-f8b9-40cc-aafa-77d1961179b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:35.887390 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd8796-f8b9-40cc-aafa-77d1961179b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:35.889006 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd8796-f8b9-40cc-aafa-77d1961179b4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:35.899899 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4048/8041] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:36:35.904946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d28242-c81f-4732-be02-6a4763bdc06f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:35.914922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d28242-c81f-4732-be02-6a4763bdc06f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:35.919574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0389f-0e59-47a7-a8bb-e5865622e709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:35.920214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0389f-0e59-47a7-a8bb-e5865622e709 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:35.920491 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0389f-0e59-47a7-a8bb-e5865622e709 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:35.920764 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0389f-0e59-47a7-a8bb-e5865622e709 admin admin] PATH_INFO: `/v3/projects/5a9c3445b6524f449a3df027184d1250/users/6bd3456e5b02470daf5d239b32149ce4/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:35.935721 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0389f-0e59-47a7-a8bb-e5865622e709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a9c3445b6524f449a3df027184d1250, user_id=6bd3456e5b02470daf5d239b32149ce4, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:35.938492 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0389f-0e59-47a7-a8bb-e5865622e709 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:35.951662 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3994/8042] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:36:35 2022] PUT /identity/v3/projects/5a9c3445b6524f449a3df027184d1250/users/6bd3456e5b02470daf5d239b32149ce4/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:35.961796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a48c43-8e4e-48e9-b94b-fbd75a4d9554 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:35.962182 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a48c43-8e4e-48e9-b94b-fbd75a4d9554 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:35.962524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a48c43-8e4e-48e9-b94b-fbd75a4d9554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:35.991530 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b6a48c43-8e4e-48e9-b94b-fbd75a4d9554 None None] MFA Rules not processed for user `6bd3456e5b02470daf5d239b32149ce4`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:35.992774 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b6a48c43-8e4e-48e9-b94b-fbd75a4d9554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:36.062850 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4049/8043] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:36.072659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0389f-0e59-47a7-a8bb-e5865622e709 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:36.074493 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-cda0389f-0e59-47a7-a8bb-e5865622e709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:36.132831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0389f-0e59-47a7-a8bb-e5865622e709 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:36.136731 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b7488-e3e7-414d-b815-910aacaec04b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:36.137324 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b7488-e3e7-414d-b815-910aacaec04b service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:36.137602 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b7488-e3e7-414d-b815-910aacaec04b service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:36.137874 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b7488-e3e7-414d-b815-910aacaec04b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:36.146100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b7488-e3e7-414d-b815-910aacaec04b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:36.147574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b7488-e3e7-414d-b815-910aacaec04b service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:36.157055 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3995/8044] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:36:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:36:44.158321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a48c43-8e4e-48e9-b94b-fbd75a4d9554 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:44.159900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b6a48c43-8e4e-48e9-b94b-fbd75a4d9554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:44.174030 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a48c43-8e4e-48e9-b94b-fbd75a4d9554 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:44.177931 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0316b9-68d4-4594-a63b-2e498b25f89a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:44.178556 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0316b9-68d4-4594-a63b-2e498b25f89a service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:44.178859 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0316b9-68d4-4594-a63b-2e498b25f89a service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:44.179138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0316b9-68d4-4594-a63b-2e498b25f89a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:44.181066 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9e0316b9-68d4-4594-a63b-2e498b25f89a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:44.196143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:44.249917 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0316b9-68d4-4594-a63b-2e498b25f89a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:44.251469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0316b9-68d4-4594-a63b-2e498b25f89a service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:44.262511 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4050/8045] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:36:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:36:46.153044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=47,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:49.021166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b7488-e3e7-414d-b815-910aacaec04b service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:49.027090 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f36b7488-e3e7-414d-b815-910aacaec04b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:49.046296 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b7488-e3e7-414d-b815-910aacaec04b service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:49.052689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70afb0b-ad4a-406a-add3-95f011610987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:49.053520 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70afb0b-ad4a-406a-add3-95f011610987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:49.053901 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70afb0b-ad4a-406a-add3-95f011610987 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:49.054369 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70afb0b-ad4a-406a-add3-95f011610987 admin admin] PATH_INFO: `/v3/users/28aa42b542db43a1bf3d1d21d687b95b` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:49.056031 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70afb0b-ad4a-406a-add3-95f011610987 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28aa42b542db43a1bf3d1d21d687b95b)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:49.058238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70afb0b-ad4a-406a-add3-95f011610987 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:49.127879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c70afb0b-ad4a-406a-add3-95f011610987 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28aa42b542db43a1bf3d1d21d687b95b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:49.128534 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c70afb0b-ad4a-406a-add3-95f011610987 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28aa42b542db43a1bf3d1d21d687b95b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:49.129149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c70afb0b-ad4a-406a-add3-95f011610987 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28aa42b542db43a1bf3d1d21d687b95b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:49.137382 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c70afb0b-ad4a-406a-add3-95f011610987 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28aa42b542db43a1bf3d1d21d687b95b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:49.153676 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c70afb0b-ad4a-406a-add3-95f011610987 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28aa42b542db43a1bf3d1d21d687b95b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:49.177602 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3996/8046] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:36:49 2022] DELETE /identity/v3/users/28aa42b542db43a1bf3d1d21d687b95b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:49.371821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0316b9-68d4-4594-a63b-2e498b25f89a service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:49.382937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0316b9-68d4-4594-a63b-2e498b25f89a service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:49.443669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa23f14-282f-49bc-b0e0-a47680834e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:49.444458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa23f14-282f-49bc-b0e0-a47680834e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:49.444870 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa23f14-282f-49bc-b0e0-a47680834e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:49.445309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa23f14-282f-49bc-b0e0-a47680834e81 admin admin] PATH_INFO: `/v3/projects/1ff5cf7fb11b4fc8aab84c3610683094` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:49.446588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa23f14-282f-49bc-b0e0-a47680834e81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ff5cf7fb11b4fc8aab84c3610683094)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:49.448583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa23f14-282f-49bc-b0e0-a47680834e81 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:49.495496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-faa23f14-282f-49bc-b0e0-a47680834e81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ff5cf7fb11b4fc8aab84c3610683094', 'request_id': 'req-faa23f14-282f-49bc-b0e0-a47680834e81'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:49.501082 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-faa23f14-282f-49bc-b0e0-a47680834e81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ff5cf7fb11b4fc8aab84c3610683094', 'request_id': 'req-faa23f14-282f-49bc-b0e0-a47680834e81'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:49.508431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-faa23f14-282f-49bc-b0e0-a47680834e81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ff5cf7fb11b4fc8aab84c3610683094', 'request_id': 'req-faa23f14-282f-49bc-b0e0-a47680834e81'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:49.522244 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-faa23f14-282f-49bc-b0e0-a47680834e81 admin admin] The token cache is being invalidate because project 1ff5cf7fb11b4fc8aab84c3610683094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:36:49.522675 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-faa23f14-282f-49bc-b0e0-a47680834e81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:49.523369 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-faa23f14-282f-49bc-b0e0-a47680834e81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:49.524901 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4051/8047] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:36:49 2022] DELETE /identity/v3/projects/1ff5cf7fb11b4fc8aab84c3610683094 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:49.531769 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fb5f8-10c7-491e-8cbe-7e5ccec20136 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:49.532058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fb5f8-10c7-491e-8cbe-7e5ccec20136 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:49.532333 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fb5f8-10c7-491e-8cbe-7e5ccec20136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:49.554533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-256fb5f8-10c7-491e-8cbe-7e5ccec20136 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:49.555815 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-256fb5f8-10c7-491e-8cbe-7e5ccec20136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:49.641118 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3997/8048] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:49.649181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba4eff-43e7-42e0-b4ed-f121d8bf6bfb None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:49.649480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba4eff-43e7-42e0-b4ed-f121d8bf6bfb None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:49.649767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba4eff-43e7-42e0-b4ed-f121d8bf6bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:49.673834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-0fba4eff-43e7-42e0-b4ed-f121d8bf6bfb None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:49.675097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0fba4eff-43e7-42e0-b4ed-f121d8bf6bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:49.684146 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4052/8049] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:49.688437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fb5f8-10c7-491e-8cbe-7e5ccec20136 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:49.698295 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fb5f8-10c7-491e-8cbe-7e5ccec20136 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:49.703663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae594f97-399d-47ad-97e4-71e5b21d7737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:49.704270 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae594f97-399d-47ad-97e4-71e5b21d7737 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:49.704552 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae594f97-399d-47ad-97e4-71e5b21d7737 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:49.704827 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae594f97-399d-47ad-97e4-71e5b21d7737 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:49.705481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae594f97-399d-47ad-97e4-71e5b21d7737 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:36:49.705788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae594f97-399d-47ad-97e4-71e5b21d7737 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:49.707429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae594f97-399d-47ad-97e4-71e5b21d7737 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:49.723336 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3998/8050] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:36:49.724507 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba4eff-43e7-42e0-b4ed-f121d8bf6bfb None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:49.734298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba4eff-43e7-42e0-b4ed-f121d8bf6bfb None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:49.739397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a814d-f7d6-493e-a10e-1aeb10c9ca80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:49.740002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a814d-f7d6-493e-a10e-1aeb10c9ca80 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:49.740286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a814d-f7d6-493e-a10e-1aeb10c9ca80 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:49.740591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a814d-f7d6-493e-a10e-1aeb10c9ca80 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:49.741211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a814d-f7d6-493e-a10e-1aeb10c9ca80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:49.743150 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a814d-f7d6-493e-a10e-1aeb10c9ca80 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:49.775699 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4053/8051] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:36:49 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:36:49.776865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae594f97-399d-47ad-97e4-71e5b21d7737 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:49.787897 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae594f97-399d-47ad-97e4-71e5b21d7737 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:49.847720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa28c22-3b68-4ef9-99ed-2339740187ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:49.848329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa28c22-3b68-4ef9-99ed-2339740187ff admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:49.848612 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa28c22-3b68-4ef9-99ed-2339740187ff admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:49.848892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa28c22-3b68-4ef9-99ed-2339740187ff admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:49.849521 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa28c22-3b68-4ef9-99ed-2339740187ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:49.851494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa28c22-3b68-4ef9-99ed-2339740187ff admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:49.859675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:49.885079 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 3999/8052] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:36:49 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:36:49.886282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a814d-f7d6-493e-a10e-1aeb10c9ca80 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:49.898179 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a814d-f7d6-493e-a10e-1aeb10c9ca80 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:49.903773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeaa651-36e4-451c-a884-55994e608912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:49.904371 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeaa651-36e4-451c-a884-55994e608912 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:49.904654 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeaa651-36e4-451c-a884-55994e608912 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:49.904927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeaa651-36e4-451c-a884-55994e608912 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:49.905599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeaa651-36e4-451c-a884-55994e608912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:49.907255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeaa651-36e4-451c-a884-55994e608912 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:49.920959 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4054/8053] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:36:49.922195 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa28c22-3b68-4ef9-99ed-2339740187ff admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:49.933141 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa28c22-3b68-4ef9-99ed-2339740187ff admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:49.938598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047cbfd5-016a-4c3f-8f56-bd4fdb746390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:49.939140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cbfd5-016a-4c3f-8f56-bd4fdb746390 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:49.939428 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cbfd5-016a-4c3f-8f56-bd4fdb746390 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:49.939704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cbfd5-016a-4c3f-8f56-bd4fdb746390 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:49.940451 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047cbfd5-016a-4c3f-8f56-bd4fdb746390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:49.941967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047cbfd5-016a-4c3f-8f56-bd4fdb746390 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:49.953913 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4000/8054] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:36:49.957933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeaa651-36e4-451c-a884-55994e608912 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:49.963287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:49.970230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeaa651-36e4-451c-a884-55994e608912 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:49.976049 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9783dd-ba30-4748-a8b6-661f69c8b739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:49.976814 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9783dd-ba30-4748-a8b6-661f69c8b739 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:49.977163 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9783dd-ba30-4748-a8b6-661f69c8b739 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:49.977507 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9783dd-ba30-4748-a8b6-661f69c8b739 admin admin] PATH_INFO: `/v3/projects/b58239511b5743eaa35d789a7a64ad7e/users/b314f44e3040410a9ad48c3fe48679de/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:49.994708 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9783dd-ba30-4748-a8b6-661f69c8b739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b58239511b5743eaa35d789a7a64ad7e, user_id=b314f44e3040410a9ad48c3fe48679de, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:49.999346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9783dd-ba30-4748-a8b6-661f69c8b739 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:50.020384 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4055/8055] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:36:49 2022] PUT /identity/v3/projects/b58239511b5743eaa35d789a7a64ad7e/users/b314f44e3040410a9ad48c3fe48679de/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:50.031496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a6446-78c9-44b3-a8ea-0d019700a8a5 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:50.032122 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a6446-78c9-44b3-a8ea-0d019700a8a5 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:50.032122 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a6446-78c9-44b3-a8ea-0d019700a8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:50.074291 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-bc4a6446-78c9-44b3-a8ea-0d019700a8a5 None None] MFA Rules not processed for user `b314f44e3040410a9ad48c3fe48679de`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:50.076814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-bc4a6446-78c9-44b3-a8ea-0d019700a8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:50.154152 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4001/8056] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:50.161740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9783dd-ba30-4748-a8b6-661f69c8b739 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:50.163625 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7e9783dd-ba30-4748-a8b6-661f69c8b739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:50.241437 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9783dd-ba30-4748-a8b6-661f69c8b739 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:50.247953 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cd24b-5528-4f5b-b560-2dd77b21a4fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:50.248570 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cd24b-5528-4f5b-b560-2dd77b21a4fa service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:50.248877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cd24b-5528-4f5b-b560-2dd77b21a4fa service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:50.249156 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cd24b-5528-4f5b-b560-2dd77b21a4fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:50.257391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89cd24b-5528-4f5b-b560-2dd77b21a4fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:50.259005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89cd24b-5528-4f5b-b560-2dd77b21a4fa service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:50.268860 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4056/8057] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:36:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:36:51.914625 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a6446-78c9-44b3-a8ea-0d019700a8a5 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:51.979281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a6446-78c9-44b3-a8ea-0d019700a8a5 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:51.984488 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd25816-a27a-44d5-bfb6-bfcf9260ec01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:51.985115 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd25816-a27a-44d5-bfb6-bfcf9260ec01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:51.985391 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd25816-a27a-44d5-bfb6-bfcf9260ec01 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:51.985660 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd25816-a27a-44d5-bfb6-bfcf9260ec01 admin admin] PATH_INFO: `/v3/users/b314f44e3040410a9ad48c3fe48679de` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:51.986807 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd25816-a27a-44d5-bfb6-bfcf9260ec01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b314f44e3040410a9ad48c3fe48679de)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:51.988731 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd25816-a27a-44d5-bfb6-bfcf9260ec01 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:52.038746 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-acd25816-a27a-44d5-bfb6-bfcf9260ec01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b314f44e3040410a9ad48c3fe48679de'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:52.039482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-acd25816-a27a-44d5-bfb6-bfcf9260ec01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b314f44e3040410a9ad48c3fe48679de'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:52.040209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-acd25816-a27a-44d5-bfb6-bfcf9260ec01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b314f44e3040410a9ad48c3fe48679de'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:52.051889 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-acd25816-a27a-44d5-bfb6-bfcf9260ec01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b314f44e3040410a9ad48c3fe48679de'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:52.063884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:52.065349 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-acd25816-a27a-44d5-bfb6-bfcf9260ec01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b314f44e3040410a9ad48c3fe48679de'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:52.081652 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4002/8058] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:36:51 2022] DELETE /identity/v3/users/b314f44e3040410a9ad48c3fe48679de => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:52.086074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ef8d3-d714-4d8e-bee4-08146e7e8b70 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:52.086579 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ef8d3-d714-4d8e-bee4-08146e7e8b70 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:52.086799 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ef8d3-d714-4d8e-bee4-08146e7e8b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:52.107892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-9f6ef8d3-d714-4d8e-bee4-08146e7e8b70 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:52.109116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9f6ef8d3-d714-4d8e-bee4-08146e7e8b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:52.177831 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4057/8059] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:36:52.187316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd25816-a27a-44d5-bfb6-bfcf9260ec01 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:52.188953 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-acd25816-a27a-44d5-bfb6-bfcf9260ec01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:52.251040 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd25816-a27a-44d5-bfb6-bfcf9260ec01 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:52.254642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e70aef-8fdc-4e82-9367-537741d7a4de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:52.255243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e70aef-8fdc-4e82-9367-537741d7a4de service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:52.255524 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e70aef-8fdc-4e82-9367-537741d7a4de service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:52.255793 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e70aef-8fdc-4e82-9367-537741d7a4de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:52.265985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e70aef-8fdc-4e82-9367-537741d7a4de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:52.267444 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e70aef-8fdc-4e82-9367-537741d7a4de service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:52.277006 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4003/8060] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:36:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:36:52.578929 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ef8d3-d714-4d8e-bee4-08146e7e8b70 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:52.580557 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9f6ef8d3-d714-4d8e-bee4-08146e7e8b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:52.602042 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ef8d3-d714-4d8e-bee4-08146e7e8b70 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:52.608546 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff41216-43b1-498e-9bee-14b5f57f943b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:52.609577 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff41216-43b1-498e-9bee-14b5f57f943b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:52.610034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff41216-43b1-498e-9bee-14b5f57f943b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:52.610485 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff41216-43b1-498e-9bee-14b5f57f943b admin admin] PATH_INFO: `/v3/projects/b58239511b5743eaa35d789a7a64ad7e` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:52.612220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff41216-43b1-498e-9bee-14b5f57f943b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b58239511b5743eaa35d789a7a64ad7e)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:52.614387 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff41216-43b1-498e-9bee-14b5f57f943b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:52.679322 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0ff41216-43b1-498e-9bee-14b5f57f943b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b58239511b5743eaa35d789a7a64ad7e', 'request_id': 'req-0ff41216-43b1-498e-9bee-14b5f57f943b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:52.685806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0ff41216-43b1-498e-9bee-14b5f57f943b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b58239511b5743eaa35d789a7a64ad7e', 'request_id': 'req-0ff41216-43b1-498e-9bee-14b5f57f943b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:52.687650 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:52.694301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0ff41216-43b1-498e-9bee-14b5f57f943b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b58239511b5743eaa35d789a7a64ad7e', 'request_id': 'req-0ff41216-43b1-498e-9bee-14b5f57f943b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:52.708180 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0ff41216-43b1-498e-9bee-14b5f57f943b admin admin] The token cache is being invalidate because project b58239511b5743eaa35d789a7a64ad7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:36:52.708469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0ff41216-43b1-498e-9bee-14b5f57f943b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:52.709694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0ff41216-43b1-498e-9bee-14b5f57f943b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:52.711311 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4058/8061] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:36:52 2022] DELETE /identity/v3/projects/b58239511b5743eaa35d789a7a64ad7e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:52.717124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874abda-2edc-496d-93df-9f9029f35e15 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:52.717410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874abda-2edc-496d-93df-9f9029f35e15 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:52.717740 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874abda-2edc-496d-93df-9f9029f35e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:52.737817 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a874abda-2edc-496d-93df-9f9029f35e15 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:52.739084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a874abda-2edc-496d-93df-9f9029f35e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:52.801643 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4004/8062] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:52.811631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db32ca-7adb-411e-b87f-95530002d493 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:52.811921 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db32ca-7adb-411e-b87f-95530002d493 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:52.812200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db32ca-7adb-411e-b87f-95530002d493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:52.834002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d0db32ca-7adb-411e-b87f-95530002d493 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:52.835273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d0db32ca-7adb-411e-b87f-95530002d493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:52.843304 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4059/8063] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:52.847669 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874abda-2edc-496d-93df-9f9029f35e15 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:52.858224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874abda-2edc-496d-93df-9f9029f35e15 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:52.863618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76c88a-76d0-4781-8e5e-4d48f3434940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:52.864219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76c88a-76d0-4781-8e5e-4d48f3434940 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:52.864501 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76c88a-76d0-4781-8e5e-4d48f3434940 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:52.864778 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76c88a-76d0-4781-8e5e-4d48f3434940 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:52.865423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a76c88a-76d0-4781-8e5e-4d48f3434940 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:36:52.865727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a76c88a-76d0-4781-8e5e-4d48f3434940 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:52.867402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a76c88a-76d0-4781-8e5e-4d48f3434940 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:52.885407 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4005/8064] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:36:52.886595 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db32ca-7adb-411e-b87f-95530002d493 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:52.897804 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db32ca-7adb-411e-b87f-95530002d493 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:52.903065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443183e2-d78d-48f6-b51b-d8b2eee8a8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:52.903765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443183e2-d78d-48f6-b51b-d8b2eee8a8b9 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:52.904046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443183e2-d78d-48f6-b51b-d8b2eee8a8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:52.904380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443183e2-d78d-48f6-b51b-d8b2eee8a8b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:52.905069 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443183e2-d78d-48f6-b51b-d8b2eee8a8b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:52.907069 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443183e2-d78d-48f6-b51b-d8b2eee8a8b9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:52.945724 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4060/8065] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:36:52 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:36:52.950665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76c88a-76d0-4781-8e5e-4d48f3434940 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:52.962987 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76c88a-76d0-4781-8e5e-4d48f3434940 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:53.033635 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12258f48-931b-4c03-b4c2-83115761e363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:53.034166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12258f48-931b-4c03-b4c2-83115761e363 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:53.034451 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12258f48-931b-4c03-b4c2-83115761e363 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:53.034745 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12258f48-931b-4c03-b4c2-83115761e363 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:53.035378 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12258f48-931b-4c03-b4c2-83115761e363 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:53.037294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12258f48-931b-4c03-b4c2-83115761e363 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:53.064578 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4006/8066] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:36:52 2022] POST /identity/v3/users => generated 288 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:36:53.067958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443183e2-d78d-48f6-b51b-d8b2eee8a8b9 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:53.081010 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443183e2-d78d-48f6-b51b-d8b2eee8a8b9 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:53.087569 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca01dd-304f-48e2-bbcb-7700650d02a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:53.088491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca01dd-304f-48e2-bbcb-7700650d02a6 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:53.088801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca01dd-304f-48e2-bbcb-7700650d02a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:53.089045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca01dd-304f-48e2-bbcb-7700650d02a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:53.089700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca01dd-304f-48e2-bbcb-7700650d02a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:53.091674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca01dd-304f-48e2-bbcb-7700650d02a6 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:53.102303 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4061/8067] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:36:53.106373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12258f48-931b-4c03-b4c2-83115761e363 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:53.116416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12258f48-931b-4c03-b4c2-83115761e363 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:53.121784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48a8b6-47e0-417e-8654-b3e0714226a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:53.122381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48a8b6-47e0-417e-8654-b3e0714226a0 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:53.122828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48a8b6-47e0-417e-8654-b3e0714226a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:53.123099 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48a8b6-47e0-417e-8654-b3e0714226a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:53.123732 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e48a8b6-47e0-417e-8654-b3e0714226a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:53.125356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e48a8b6-47e0-417e-8654-b3e0714226a0 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:53.126807 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:53.138179 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4007/8068] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:36:53.141938 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca01dd-304f-48e2-bbcb-7700650d02a6 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:53.152246 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca01dd-304f-48e2-bbcb-7700650d02a6 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:53.158435 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15119ae1-5586-48ef-bc47-3a2fb9f5aef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:53.159129 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15119ae1-5586-48ef-bc47-3a2fb9f5aef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:53.159407 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15119ae1-5586-48ef-bc47-3a2fb9f5aef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:53.159714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15119ae1-5586-48ef-bc47-3a2fb9f5aef2 admin admin] PATH_INFO: `/v3/projects/7091aeb2276e49bc8e4b3e7fba4a06da/users/dc08674d9e7e45a289840a3a99c6e4f4/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:53.175331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15119ae1-5586-48ef-bc47-3a2fb9f5aef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7091aeb2276e49bc8e4b3e7fba4a06da, user_id=dc08674d9e7e45a289840a3a99c6e4f4, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:53.178232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15119ae1-5586-48ef-bc47-3a2fb9f5aef2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:53.191696 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4062/8069] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:36:53 2022] PUT /identity/v3/projects/7091aeb2276e49bc8e4b3e7fba4a06da/users/dc08674d9e7e45a289840a3a99c6e4f4/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:53.287952 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa68de-644f-4ec9-a463-aad962328db3 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:53.288194 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa68de-644f-4ec9-a463-aad962328db3 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:53.288411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa68de-644f-4ec9-a463-aad962328db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:53.317327 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-04aa68de-644f-4ec9-a463-aad962328db3 None None] MFA Rules not processed for user `dc08674d9e7e45a289840a3a99c6e4f4`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:53.318593 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-04aa68de-644f-4ec9-a463-aad962328db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:53.383002 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4008/8070] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:53.387477 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15119ae1-5586-48ef-bc47-3a2fb9f5aef2 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:53.453797 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15119ae1-5586-48ef-bc47-3a2fb9f5aef2 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:53.458436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d29462-5567-4519-928e-251a8bb59aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:53.459073 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d29462-5567-4519-928e-251a8bb59aad admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:53.459471 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d29462-5567-4519-928e-251a8bb59aad admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:53.459751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d29462-5567-4519-928e-251a8bb59aad admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:53.460365 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d29462-5567-4519-928e-251a8bb59aad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:53.462283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d29462-5567-4519-928e-251a8bb59aad admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:53.491848 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4063/8071] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:36:53 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:36:53.496355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa68de-644f-4ec9-a463-aad962328db3 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:53.508502 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa68de-644f-4ec9-a463-aad962328db3 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:53.566075 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96880a45-4c9a-4120-b084-bb6feaf4aad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:53.566651 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96880a45-4c9a-4120-b084-bb6feaf4aad0 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:53.566931 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96880a45-4c9a-4120-b084-bb6feaf4aad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:53.567203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96880a45-4c9a-4120-b084-bb6feaf4aad0 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:53.567828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96880a45-4c9a-4120-b084-bb6feaf4aad0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:53.569753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96880a45-4c9a-4120-b084-bb6feaf4aad0 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:53.595951 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4009/8072] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:36:53 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:36:53.597778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d29462-5567-4519-928e-251a8bb59aad admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:53.609898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d29462-5567-4519-928e-251a8bb59aad admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:53.614689 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a1aeb-c26d-42ca-a677-8bd99be48e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:53.615364 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a1aeb-c26d-42ca-a677-8bd99be48e77 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:53.615652 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a1aeb-c26d-42ca-a677-8bd99be48e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:53.615927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a1aeb-c26d-42ca-a677-8bd99be48e77 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:53.616567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a1aeb-c26d-42ca-a677-8bd99be48e77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:53.618253 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a1aeb-c26d-42ca-a677-8bd99be48e77 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:53.632359 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4064/8073] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:36:53.633860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96880a45-4c9a-4120-b084-bb6feaf4aad0 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:53.650525 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96880a45-4c9a-4120-b084-bb6feaf4aad0 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:53.656131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7828d5ff-08ee-44b9-865e-364a370be3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:53.656859 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828d5ff-08ee-44b9-865e-364a370be3af admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:53.657147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828d5ff-08ee-44b9-865e-364a370be3af admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:53.657495 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828d5ff-08ee-44b9-865e-364a370be3af admin admin] PATH_INFO: `/v3/projects/3598f3b2f60745f2907e8491d2f5b93c/users/d9a06a965822409eb32322819af25cd1/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:53.677628 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7828d5ff-08ee-44b9-865e-364a370be3af admin admin] RBAC: Authorizing `identity:create_grant(project_id=3598f3b2f60745f2907e8491d2f5b93c, user_id=d9a06a965822409eb32322819af25cd1, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:53.680400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7828d5ff-08ee-44b9-865e-364a370be3af admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:53.694137 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4010/8074] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:36:53 2022] PUT /identity/v3/projects/3598f3b2f60745f2907e8491d2f5b93c/users/d9a06a965822409eb32322819af25cd1/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:36:53.698219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a1aeb-c26d-42ca-a677-8bd99be48e77 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:53.708965 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a1aeb-c26d-42ca-a677-8bd99be48e77 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:53.759710 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:53.767701 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfe6ae-77b1-4030-842e-21aa16ec70c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:53.768739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfe6ae-77b1-4030-842e-21aa16ec70c4 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:53.769265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfe6ae-77b1-4030-842e-21aa16ec70c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:53.769551 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfe6ae-77b1-4030-842e-21aa16ec70c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:53.770743 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfe6ae-77b1-4030-842e-21aa16ec70c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:53.772483 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfe6ae-77b1-4030-842e-21aa16ec70c4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:53.783520 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4065/8075] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:36:53.787419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7828d5ff-08ee-44b9-865e-364a370be3af admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:53.798562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7828d5ff-08ee-44b9-865e-364a370be3af admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:53.803614 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2db8f3-4306-45d0-9187-933514cfc7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:53.804267 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2db8f3-4306-45d0-9187-933514cfc7a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:53.804542 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2db8f3-4306-45d0-9187-933514cfc7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:53.804823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2db8f3-4306-45d0-9187-933514cfc7a9 admin admin] PATH_INFO: `/v3/projects/3598f3b2f60745f2907e8491d2f5b93c/users/d9a06a965822409eb32322819af25cd1/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:53.806902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2db8f3-4306-45d0-9187-933514cfc7a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3598f3b2f60745f2907e8491d2f5b93c, user_id=d9a06a965822409eb32322819af25cd1, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:53.810282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2db8f3-4306-45d0-9187-933514cfc7a9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:53.822344 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4011/8076] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:36:53 2022] PUT /identity/v3/projects/3598f3b2f60745f2907e8491d2f5b93c/users/d9a06a965822409eb32322819af25cd1/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:53.833081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c19c6-de12-4a3b-8c20-782cc1061227 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:53.833500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c19c6-de12-4a3b-8c20-782cc1061227 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:53.833880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c19c6-de12-4a3b-8c20-782cc1061227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:53.864270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-354c19c6-de12-4a3b-8c20-782cc1061227 None None] MFA Rules not processed for user `d9a06a965822409eb32322819af25cd1`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:53.865809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-354c19c6-de12-4a3b-8c20-782cc1061227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:53.945265 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4066/8077] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:53.950921 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2db8f3-4306-45d0-9187-933514cfc7a9 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:53.962258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2db8f3-4306-45d0-9187-933514cfc7a9 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:53.967037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b119c970-c94c-4525-a789-3583795d40fb tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9a06a965822409eb32322819af25cd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3598f3b2f60745f2907e8491d2f5b93c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:53.967644 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119c970-c94c-4525-a789-3583795d40fb tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:53.967918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119c970-c94c-4525-a789-3583795d40fb tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:53.968190 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119c970-c94c-4525-a789-3583795d40fb tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:53.968830 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b119c970-c94c-4525-a789-3583795d40fb tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:53.970409 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b119c970-c94c-4525-a789-3583795d40fb tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:53.987053 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4012/8078] 10.222.0.33 () {60 vars in 1149 bytes} [Sat Aug 6 21:36:53 2022] POST /identity/v3/domains => generated 244 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:36:53.991667 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c19c6-de12-4a3b-8c20-782cc1061227 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:54.001400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c19c6-de12-4a3b-8c20-782cc1061227 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:54.061588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293a9a2-cbd3-4313-9a9d-a023a438de6c tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9a06a965822409eb32322819af25cd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3598f3b2f60745f2907e8491d2f5b93c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:54.062210 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293a9a2-cbd3-4313-9a9d-a023a438de6c tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:54.062497 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293a9a2-cbd3-4313-9a9d-a023a438de6c tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:54.062811 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293a9a2-cbd3-4313-9a9d-a023a438de6c tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:54.063438 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b293a9a2-cbd3-4313-9a9d-a023a438de6c tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:54.065346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b293a9a2-cbd3-4313-9a9d-a023a438de6c tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:54.108285 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4067/8079] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:36:53 2022] POST /identity/v3/projects => generated 410 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:36:54.109377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b119c970-c94c-4525-a789-3583795d40fb tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:54.120232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b119c970-c94c-4525-a789-3583795d40fb tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:54.144046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:54.183004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59219bbc-009b-4d59-9629-52702501bad7 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9a06a965822409eb32322819af25cd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3598f3b2f60745f2907e8491d2f5b93c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:54.183616 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59219bbc-009b-4d59-9629-52702501bad7 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:54.184383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59219bbc-009b-4d59-9629-52702501bad7 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:54.185139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59219bbc-009b-4d59-9629-52702501bad7 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:54.185387 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59219bbc-009b-4d59-9629-52702501bad7 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:54.187356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59219bbc-009b-4d59-9629-52702501bad7 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:54.209471 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4013/8080] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:36:54 2022] POST /identity/v3/users => generated 348 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:36:54.213574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293a9a2-cbd3-4313-9a9d-a023a438de6c tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:54.224448 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293a9a2-cbd3-4313-9a9d-a023a438de6c tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:54.230920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5546985-8d6d-417b-83c4-c93c02fdab37 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9a06a965822409eb32322819af25cd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3598f3b2f60745f2907e8491d2f5b93c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:54.231491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5546985-8d6d-417b-83c4-c93c02fdab37 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:54.231768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5546985-8d6d-417b-83c4-c93c02fdab37 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:54.232038 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5546985-8d6d-417b-83c4-c93c02fdab37 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:54.232676 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5546985-8d6d-417b-83c4-c93c02fdab37 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:54.234268 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5546985-8d6d-417b-83c4-c93c02fdab37 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:54.244574 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4068/8081] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:36:54.249748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59219bbc-009b-4d59-9629-52702501bad7 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:54.259715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59219bbc-009b-4d59-9629-52702501bad7 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:54.265031 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e4a04-d6bc-42cf-b879-10278335f0eb tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9a06a965822409eb32322819af25cd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3598f3b2f60745f2907e8491d2f5b93c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:54.265689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e4a04-d6bc-42cf-b879-10278335f0eb tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:54.265971 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e4a04-d6bc-42cf-b879-10278335f0eb tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:54.266251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e4a04-d6bc-42cf-b879-10278335f0eb tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] PATH_INFO: `/v3/projects/d5cb138b9467495395cc10ad5767321f/users/6560f5a79378417a839f68b05807a7d5/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:54.281262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e4a04-d6bc-42cf-b879-10278335f0eb tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d5cb138b9467495395cc10ad5767321f, user_id=6560f5a79378417a839f68b05807a7d5, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:54.283983 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e4a04-d6bc-42cf-b879-10278335f0eb tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:54.297925 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4014/8082] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:36:54 2022] PUT /identity/v3/projects/d5cb138b9467495395cc10ad5767321f/users/6560f5a79378417a839f68b05807a7d5/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:36:54.303101 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4a1b5-764e-42d7-9e38-efabcb331a37 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:54.303499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4a1b5-764e-42d7-9e38-efabcb331a37 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:54.303789 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4a1b5-764e-42d7-9e38-efabcb331a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:54.375644 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:54.416575 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-91f4a1b5-764e-42d7-9e38-efabcb331a37 None None] MFA Rules not processed for user `6560f5a79378417a839f68b05807a7d5`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:54.417806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-91f4a1b5-764e-42d7-9e38-efabcb331a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:54.434818 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4069/8083] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:54 2022] POST /identity/v3/auth/tokens => generated 3359 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:36:54.445333 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcef67f-6dcc-4e5a-9eae-f0393adcd297 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:54.445605 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcef67f-6dcc-4e5a-9eae-f0393adcd297 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:54.445887 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcef67f-6dcc-4e5a-9eae-f0393adcd297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:54.468199 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-1fcef67f-6dcc-4e5a-9eae-f0393adcd297 None None] MFA Rules not processed for user `6560f5a79378417a839f68b05807a7d5`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:54.469407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1fcef67f-6dcc-4e5a-9eae-f0393adcd297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:54.476636 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4015/8084] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:54 2022] POST /identity/v3/auth/tokens => generated 3359 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:54.480933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4a1b5-764e-42d7-9e38-efabcb331a37 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:54.490890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4a1b5-764e-42d7-9e38-efabcb331a37 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:54.495616 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faffadb2-230e-4750-9f7c-7e261a276cee tempest-test_project-1046768746 tempest-user-1030776777] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6560f5a79378417a839f68b05807a7d5', 'user_domain_id': '91b8d039211a41379dc54a24dca67cc2', 'system_scope': None, 'project_id': 'd5cb138b9467495395cc10ad5767321f', 'project_domain_id': '91b8d039211a41379dc54a24dca67cc2', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:54.496252 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffadb2-230e-4750-9f7c-7e261a276cee tempest-test_project-1046768746 tempest-user-1030776777] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:54.496622 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffadb2-230e-4750-9f7c-7e261a276cee tempest-test_project-1046768746 tempest-user-1030776777] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:54.496901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffadb2-230e-4750-9f7c-7e261a276cee tempest-test_project-1046768746 tempest-user-1030776777] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:54.505904 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faffadb2-230e-4750-9f7c-7e261a276cee tempest-test_project-1046768746 tempest-user-1030776777] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:54.507739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faffadb2-230e-4750-9f7c-7e261a276cee tempest-test_project-1046768746 tempest-user-1030776777] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:54.518183 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4070/8085] 10.222.0.33 () {56 vars in 1284 bytes} [Sat Aug 6 21:36:54 2022] GET /identity/v3/auth/tokens => generated 3359 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:36:54.522967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcef67f-6dcc-4e5a-9eae-f0393adcd297 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:54.594200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcef67f-6dcc-4e5a-9eae-f0393adcd297 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:54.599748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4948c81-7400-46a4-90dc-0abf730bf41d tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9a06a965822409eb32322819af25cd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3598f3b2f60745f2907e8491d2f5b93c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:54.600389 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4948c81-7400-46a4-90dc-0abf730bf41d tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:54.600668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4948c81-7400-46a4-90dc-0abf730bf41d tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:54.600943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4948c81-7400-46a4-90dc-0abf730bf41d tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] PATH_INFO: `/v3/users/6560f5a79378417a839f68b05807a7d5` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:54.602087 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4948c81-7400-46a4-90dc-0abf730bf41d tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6560f5a79378417a839f68b05807a7d5)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:54.604731 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4948c81-7400-46a4-90dc-0abf730bf41d tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:54.687086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c4948c81-7400-46a4-90dc-0abf730bf41d tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6560f5a79378417a839f68b05807a7d5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:54.689676 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c4948c81-7400-46a4-90dc-0abf730bf41d tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6560f5a79378417a839f68b05807a7d5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:54.690477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c4948c81-7400-46a4-90dc-0abf730bf41d tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6560f5a79378417a839f68b05807a7d5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:54.700669 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c4948c81-7400-46a4-90dc-0abf730bf41d tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6560f5a79378417a839f68b05807a7d5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:54.716022 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-c4948c81-7400-46a4-90dc-0abf730bf41d tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6560f5a79378417a839f68b05807a7d5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:54.732328 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4016/8086] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:36:54 2022] DELETE /identity/v3/users/6560f5a79378417a839f68b05807a7d5 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:54.738139 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faffadb2-230e-4750-9f7c-7e261a276cee tempest-test_project-1046768746 tempest-user-1030776777] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:54.748237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faffadb2-230e-4750-9f7c-7e261a276cee tempest-test_project-1046768746 tempest-user-1030776777] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:54.828374 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece93a4-b86d-4741-9464-6d35faba5cf7 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9a06a965822409eb32322819af25cd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3598f3b2f60745f2907e8491d2f5b93c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:54.829026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece93a4-b86d-4741-9464-6d35faba5cf7 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:54.829314 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece93a4-b86d-4741-9464-6d35faba5cf7 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:54.829621 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece93a4-b86d-4741-9464-6d35faba5cf7 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] PATH_INFO: `/v3/projects/d5cb138b9467495395cc10ad5767321f` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:54.830792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece93a4-b86d-4741-9464-6d35faba5cf7 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d5cb138b9467495395cc10ad5767321f)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:54.832870 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece93a4-b86d-4741-9464-6d35faba5cf7 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:54.887893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bece93a4-b86d-4741-9464-6d35faba5cf7 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5cb138b9467495395cc10ad5767321f', 'request_id': 'req-bece93a4-b86d-4741-9464-6d35faba5cf7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:54.893602 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bece93a4-b86d-4741-9464-6d35faba5cf7 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5cb138b9467495395cc10ad5767321f', 'request_id': 'req-bece93a4-b86d-4741-9464-6d35faba5cf7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:54.902110 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bece93a4-b86d-4741-9464-6d35faba5cf7 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5cb138b9467495395cc10ad5767321f', 'request_id': 'req-bece93a4-b86d-4741-9464-6d35faba5cf7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:54.913581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bece93a4-b86d-4741-9464-6d35faba5cf7 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] The token cache is being invalidate because project d5cb138b9467495395cc10ad5767321f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:36:54.913867 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bece93a4-b86d-4741-9464-6d35faba5cf7 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:54.914503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bece93a4-b86d-4741-9464-6d35faba5cf7 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:54.916095 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4071/8087] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:36:54 2022] DELETE /identity/v3/projects/d5cb138b9467495395cc10ad5767321f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:54.920522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4948c81-7400-46a4-90dc-0abf730bf41d tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:54.922285 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c4948c81-7400-46a4-90dc-0abf730bf41d tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:54.930969 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:54.938560 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4948c81-7400-46a4-90dc-0abf730bf41d tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:54.998328 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4128b-846d-47cc-97db-d2affd509b52 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9a06a965822409eb32322819af25cd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3598f3b2f60745f2907e8491d2f5b93c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:54.999066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4128b-846d-47cc-97db-d2affd509b52 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:54.999347 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4128b-846d-47cc-97db-d2affd509b52 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:54.999642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4128b-846d-47cc-97db-d2affd509b52 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] PATH_INFO: `/v3/domains/91b8d039211a41379dc54a24dca67cc2` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:55.000874 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc4128b-846d-47cc-97db-d2affd509b52 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=91b8d039211a41379dc54a24dca67cc2)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:55.002500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc4128b-846d-47cc-97db-d2affd509b52 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:55.023841 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bcc4128b-846d-47cc-97db-d2affd509b52 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '91b8d039211a41379dc54a24dca67cc2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:55.024556 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bcc4128b-846d-47cc-97db-d2affd509b52 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '91b8d039211a41379dc54a24dca67cc2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:55.049589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bcc4128b-846d-47cc-97db-d2affd509b52 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '91b8d039211a41379dc54a24dca67cc2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:55.050203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bcc4128b-846d-47cc-97db-d2affd509b52 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '91b8d039211a41379dc54a24dca67cc2'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:55.055928 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4017/8088] 10.222.0.33 () {60 vars in 1249 bytes} [Sat Aug 6 21:36:54 2022] PATCH /identity/v3/domains/91b8d039211a41379dc54a24dca67cc2 => generated 245 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:36:55.057210 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece93a4-b86d-4741-9464-6d35faba5cf7 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:55.059376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-bece93a4-b86d-4741-9464-6d35faba5cf7 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:55.075174 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece93a4-b86d-4741-9464-6d35faba5cf7 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:55.104810 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:55.135625 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca01fc-c273-4946-84f8-a4a03f4e477d tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9a06a965822409eb32322819af25cd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3598f3b2f60745f2907e8491d2f5b93c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:55.136329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca01fc-c273-4946-84f8-a4a03f4e477d tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:55.136450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca01fc-c273-4946-84f8-a4a03f4e477d tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:55.136713 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca01fc-c273-4946-84f8-a4a03f4e477d tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] PATH_INFO: `/v3/domains/91b8d039211a41379dc54a24dca67cc2` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:55.148724 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca01fc-c273-4946-84f8-a4a03f4e477d tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=91b8d039211a41379dc54a24dca67cc2)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:55.150619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca01fc-c273-4946-84f8-a4a03f4e477d tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:55.178430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-87ca01fc-c273-4946-84f8-a4a03f4e477d tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '91b8d039211a41379dc54a24dca67cc2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:55.183088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-87ca01fc-c273-4946-84f8-a4a03f4e477d tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '91b8d039211a41379dc54a24dca67cc2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:55.232219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-87ca01fc-c273-4946-84f8-a4a03f4e477d tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91b8d039211a41379dc54a24dca67cc2', 'request_id': 'req-87ca01fc-c273-4946-84f8-a4a03f4e477d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:55.238372 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-87ca01fc-c273-4946-84f8-a4a03f4e477d tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91b8d039211a41379dc54a24dca67cc2', 'request_id': 'req-87ca01fc-c273-4946-84f8-a4a03f4e477d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:55.245968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-87ca01fc-c273-4946-84f8-a4a03f4e477d tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91b8d039211a41379dc54a24dca67cc2', 'request_id': 'req-87ca01fc-c273-4946-84f8-a4a03f4e477d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:55.257926 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-87ca01fc-c273-4946-84f8-a4a03f4e477d tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] The token cache is being invalidate because project 91b8d039211a41379dc54a24dca67cc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:36:55.258215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-87ca01fc-c273-4946-84f8-a4a03f4e477d tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:55.258900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-87ca01fc-c273-4946-84f8-a4a03f4e477d tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:55.267023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-87ca01fc-c273-4946-84f8-a4a03f4e477d tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '91b8d039211a41379dc54a24dca67cc2', 'request_id': 'req-87ca01fc-c273-4946-84f8-a4a03f4e477d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:55.270277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-87ca01fc-c273-4946-84f8-a4a03f4e477d tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '91b8d039211a41379dc54a24dca67cc2', 'request_id': 'req-87ca01fc-c273-4946-84f8-a4a03f4e477d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:55.270964 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-87ca01fc-c273-4946-84f8-a4a03f4e477d tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '91b8d039211a41379dc54a24dca67cc2', 'request_id': 'req-87ca01fc-c273-4946-84f8-a4a03f4e477d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:55.276594 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4072/8089] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:36:55 2022] DELETE /identity/v3/domains/91b8d039211a41379dc54a24dca67cc2 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:55.282812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4128b-846d-47cc-97db-d2affd509b52 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:55.284250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-bcc4128b-846d-47cc-97db-d2affd509b52 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:55.353402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4128b-846d-47cc-97db-d2affd509b52 tempest-TestDefaultProjectId-672300841 tempest-TestDefaultProjectId-672300841-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:55.415865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c89518-f881-41a3-9895-8f74eaf621f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:55.416567 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c89518-f881-41a3-9895-8f74eaf621f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:55.416843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c89518-f881-41a3-9895-8f74eaf621f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:55.417142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c89518-f881-41a3-9895-8f74eaf621f6 admin admin] PATH_INFO: `/v3/users/dc08674d9e7e45a289840a3a99c6e4f4` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:55.419020 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c89518-f881-41a3-9895-8f74eaf621f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc08674d9e7e45a289840a3a99c6e4f4)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:55.420910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c89518-f881-41a3-9895-8f74eaf621f6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:55.439124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:55.471987 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-10c89518-f881-41a3-9895-8f74eaf621f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc08674d9e7e45a289840a3a99c6e4f4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:55.472643 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-10c89518-f881-41a3-9895-8f74eaf621f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc08674d9e7e45a289840a3a99c6e4f4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:55.473904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-10c89518-f881-41a3-9895-8f74eaf621f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc08674d9e7e45a289840a3a99c6e4f4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:55.483526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-10c89518-f881-41a3-9895-8f74eaf621f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc08674d9e7e45a289840a3a99c6e4f4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:55.495435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-10c89518-f881-41a3-9895-8f74eaf621f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc08674d9e7e45a289840a3a99c6e4f4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:55.508436 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4018/8090] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:36:55 2022] DELETE /identity/v3/users/dc08674d9e7e45a289840a3a99c6e4f4 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:55.513119 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70892dbf-d0d2-4d20-92e2-f78b2ee1c759 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:55.513411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70892dbf-d0d2-4d20-92e2-f78b2ee1c759 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:55.513691 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70892dbf-d0d2-4d20-92e2-f78b2ee1c759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:55.534986 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-70892dbf-d0d2-4d20-92e2-f78b2ee1c759 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:55.536200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-70892dbf-d0d2-4d20-92e2-f78b2ee1c759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:55.599777 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4073/8091] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:55.610392 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c89518-f881-41a3-9895-8f74eaf621f6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:55.611908 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-10c89518-f881-41a3-9895-8f74eaf621f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:55.682170 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c89518-f881-41a3-9895-8f74eaf621f6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:55.686143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf24af-686c-4013-b150-5e8532ec87ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:55.686809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf24af-686c-4013-b150-5e8532ec87ad service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:55.687086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf24af-686c-4013-b150-5e8532ec87ad service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:55.687356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf24af-686c-4013-b150-5e8532ec87ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:55.697487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cf24af-686c-4013-b150-5e8532ec87ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:55.699149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cf24af-686c-4013-b150-5e8532ec87ad service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:55.710250 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4019/8092] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:36:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:36:56.024039 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70892dbf-d0d2-4d20-92e2-f78b2ee1c759 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:56.025558 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-70892dbf-d0d2-4d20-92e2-f78b2ee1c759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:56.042186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70892dbf-d0d2-4d20-92e2-f78b2ee1c759 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:56.049268 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe38c37-742b-4221-ac33-528e0071fd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:56.050568 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe38c37-742b-4221-ac33-528e0071fd04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:56.051244 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe38c37-742b-4221-ac33-528e0071fd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:56.051523 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe38c37-742b-4221-ac33-528e0071fd04 admin admin] PATH_INFO: `/v3/projects/7091aeb2276e49bc8e4b3e7fba4a06da` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:56.052725 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe38c37-742b-4221-ac33-528e0071fd04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7091aeb2276e49bc8e4b3e7fba4a06da)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:56.054940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe38c37-742b-4221-ac33-528e0071fd04 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:56.058414 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:56.111120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dfe38c37-742b-4221-ac33-528e0071fd04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7091aeb2276e49bc8e4b3e7fba4a06da', 'request_id': 'req-dfe38c37-742b-4221-ac33-528e0071fd04'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:56.117882 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dfe38c37-742b-4221-ac33-528e0071fd04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7091aeb2276e49bc8e4b3e7fba4a06da', 'request_id': 'req-dfe38c37-742b-4221-ac33-528e0071fd04'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:56.126131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dfe38c37-742b-4221-ac33-528e0071fd04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7091aeb2276e49bc8e4b3e7fba4a06da', 'request_id': 'req-dfe38c37-742b-4221-ac33-528e0071fd04'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:56.138268 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dfe38c37-742b-4221-ac33-528e0071fd04 admin admin] The token cache is being invalidate because project 7091aeb2276e49bc8e4b3e7fba4a06da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:36:56.138955 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dfe38c37-742b-4221-ac33-528e0071fd04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:56.139280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dfe38c37-742b-4221-ac33-528e0071fd04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:56.140786 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4074/8093] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:36:56 2022] DELETE /identity/v3/projects/7091aeb2276e49bc8e4b3e7fba4a06da => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:56.144846 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf24af-686c-4013-b150-5e8532ec87ad service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:56.155295 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf24af-686c-4013-b150-5e8532ec87ad service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:56.213695 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb0c5d-f18f-44f9-807e-51ab45913543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:56.214382 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb0c5d-f18f-44f9-807e-51ab45913543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:56.214694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb0c5d-f18f-44f9-807e-51ab45913543 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:56.214993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb0c5d-f18f-44f9-807e-51ab45913543 admin admin] PATH_INFO: `/v3/users/d9a06a965822409eb32322819af25cd1` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:56.216798 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb0c5d-f18f-44f9-807e-51ab45913543 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9a06a965822409eb32322819af25cd1)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:56.218783 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb0c5d-f18f-44f9-807e-51ab45913543 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:56.260293 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:56.268449 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d1bb0c5d-f18f-44f9-807e-51ab45913543 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9a06a965822409eb32322819af25cd1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:56.269190 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d1bb0c5d-f18f-44f9-807e-51ab45913543 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9a06a965822409eb32322819af25cd1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:56.270277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d1bb0c5d-f18f-44f9-807e-51ab45913543 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9a06a965822409eb32322819af25cd1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:56.278296 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d1bb0c5d-f18f-44f9-807e-51ab45913543 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9a06a965822409eb32322819af25cd1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:56.291533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d1bb0c5d-f18f-44f9-807e-51ab45913543 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9a06a965822409eb32322819af25cd1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:56.304627 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4020/8094] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:36:56 2022] DELETE /identity/v3/users/d9a06a965822409eb32322819af25cd1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:56.602933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe38c37-742b-4221-ac33-528e0071fd04 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:56.604551 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-dfe38c37-742b-4221-ac33-528e0071fd04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:56.622515 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe38c37-742b-4221-ac33-528e0071fd04 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:56.695747 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85d926-982f-4a0b-9873-758891895143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:56.696383 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85d926-982f-4a0b-9873-758891895143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:56.696690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85d926-982f-4a0b-9873-758891895143 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:56.696965 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85d926-982f-4a0b-9873-758891895143 admin admin] PATH_INFO: `/v3/projects/3598f3b2f60745f2907e8491d2f5b93c` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:56.698077 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec85d926-982f-4a0b-9873-758891895143 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3598f3b2f60745f2907e8491d2f5b93c)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:56.701096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec85d926-982f-4a0b-9873-758891895143 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:56.748431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ec85d926-982f-4a0b-9873-758891895143 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3598f3b2f60745f2907e8491d2f5b93c', 'request_id': 'req-ec85d926-982f-4a0b-9873-758891895143'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:56.754358 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ec85d926-982f-4a0b-9873-758891895143 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3598f3b2f60745f2907e8491d2f5b93c', 'request_id': 'req-ec85d926-982f-4a0b-9873-758891895143'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:56.762348 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ec85d926-982f-4a0b-9873-758891895143 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3598f3b2f60745f2907e8491d2f5b93c', 'request_id': 'req-ec85d926-982f-4a0b-9873-758891895143'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:56.774703 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ec85d926-982f-4a0b-9873-758891895143 admin admin] The token cache is being invalidate because project 3598f3b2f60745f2907e8491d2f5b93c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:36:56.775031 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ec85d926-982f-4a0b-9873-758891895143 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:56.776393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ec85d926-982f-4a0b-9873-758891895143 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:56.778153 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4075/8095] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:36:56 2022] DELETE /identity/v3/projects/3598f3b2f60745f2907e8491d2f5b93c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:56.783108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba3e8e-15bd-4bfb-9403-8359a587befb None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:56.783396 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba3e8e-15bd-4bfb-9403-8359a587befb None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:56.783668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba3e8e-15bd-4bfb-9403-8359a587befb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:56.804332 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f7ba3e8e-15bd-4bfb-9403-8359a587befb None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:56.805580 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f7ba3e8e-15bd-4bfb-9403-8359a587befb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:56.868709 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4021/8096] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:56.877022 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05631605-ea34-49ba-a0cf-226aaf841cb9 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:56.877313 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05631605-ea34-49ba-a0cf-226aaf841cb9 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:56.877590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05631605-ea34-49ba-a0cf-226aaf841cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:56.897782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-05631605-ea34-49ba-a0cf-226aaf841cb9 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:56.899100 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-05631605-ea34-49ba-a0cf-226aaf841cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:56.908251 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4076/8097] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:56.912766 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba3e8e-15bd-4bfb-9403-8359a587befb None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:56.923586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba3e8e-15bd-4bfb-9403-8359a587befb None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:56.929203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffbf491-c440-45c7-a480-7e93a022a400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:56.929840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbf491-c440-45c7-a480-7e93a022a400 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:56.930114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbf491-c440-45c7-a480-7e93a022a400 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:56.930383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbf491-c440-45c7-a480-7e93a022a400 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:56.931063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffbf491-c440-45c7-a480-7e93a022a400 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:36:56.931477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffbf491-c440-45c7-a480-7e93a022a400 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:56.933104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffbf491-c440-45c7-a480-7e93a022a400 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:56.945849 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4022/8098] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:36:56.950536 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05631605-ea34-49ba-a0cf-226aaf841cb9 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:56.960763 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05631605-ea34-49ba-a0cf-226aaf841cb9 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:56.966070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259a283-5491-40c6-81bf-a5ffe9f3360a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:56.966808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259a283-5491-40c6-81bf-a5ffe9f3360a admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:56.967157 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259a283-5491-40c6-81bf-a5ffe9f3360a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:56.967495 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259a283-5491-40c6-81bf-a5ffe9f3360a admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:56.968214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259a283-5491-40c6-81bf-a5ffe9f3360a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:56.970187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259a283-5491-40c6-81bf-a5ffe9f3360a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:56.986130 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:57.005898 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4077/8099] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:36:56 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:36:57.007156 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffbf491-c440-45c7-a480-7e93a022a400 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:57.017818 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffbf491-c440-45c7-a480-7e93a022a400 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:57.079490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723da35e-2104-4076-b810-73f414024c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:57.080115 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723da35e-2104-4076-b810-73f414024c94 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:57.080597 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723da35e-2104-4076-b810-73f414024c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:57.080914 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723da35e-2104-4076-b810-73f414024c94 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:57.081547 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723da35e-2104-4076-b810-73f414024c94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:57.083638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723da35e-2104-4076-b810-73f414024c94 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:57.106561 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4023/8100] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:36:57 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:36:57.110594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259a283-5491-40c6-81bf-a5ffe9f3360a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:57.121166 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259a283-5491-40c6-81bf-a5ffe9f3360a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:57.126637 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ced991-616c-4225-b342-ba7b84a3b8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:57.127230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ced991-616c-4225-b342-ba7b84a3b8a4 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:57.127510 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ced991-616c-4225-b342-ba7b84a3b8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:57.127788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ced991-616c-4225-b342-ba7b84a3b8a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:57.128429 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ced991-616c-4225-b342-ba7b84a3b8a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:57.130021 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ced991-616c-4225-b342-ba7b84a3b8a4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:57.142591 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4078/8101] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:36:57.144789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723da35e-2104-4076-b810-73f414024c94 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:57.155740 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723da35e-2104-4076-b810-73f414024c94 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:57.160485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7a886-2e93-44f1-b145-520b9c437b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:57.161077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7a886-2e93-44f1-b145-520b9c437b6d admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:57.161353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7a886-2e93-44f1-b145-520b9c437b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:57.161624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7a886-2e93-44f1-b145-520b9c437b6d admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:57.162289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d7a886-2e93-44f1-b145-520b9c437b6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:57.163875 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d7a886-2e93-44f1-b145-520b9c437b6d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:57.174745 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4024/8102] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:36:57.179235 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ced991-616c-4225-b342-ba7b84a3b8a4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:57.189652 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ced991-616c-4225-b342-ba7b84a3b8a4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:57.194254 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6c8a8-0afe-4ca3-9c17-34d38ea6a0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:57.194941 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6c8a8-0afe-4ca3-9c17-34d38ea6a0e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:57.195215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6c8a8-0afe-4ca3-9c17-34d38ea6a0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:57.195490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6c8a8-0afe-4ca3-9c17-34d38ea6a0e2 admin admin] PATH_INFO: `/v3/projects/d7d3c857a7c9432fb226bb9eeee154e0/users/ba2a1694c94f42fa91fcf8f4d5e2544c/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:57.210179 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6c8a8-0afe-4ca3-9c17-34d38ea6a0e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7d3c857a7c9432fb226bb9eeee154e0, user_id=ba2a1694c94f42fa91fcf8f4d5e2544c, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:57.212777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6c8a8-0afe-4ca3-9c17-34d38ea6a0e2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:57.226754 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4079/8103] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:36:57 2022] PUT /identity/v3/projects/d7d3c857a7c9432fb226bb9eeee154e0/users/ba2a1694c94f42fa91fcf8f4d5e2544c/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:57.236704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671ed72-4ee3-4e92-937a-e37dbfd4ed86 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:57.236989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671ed72-4ee3-4e92-937a-e37dbfd4ed86 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:57.237265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671ed72-4ee3-4e92-937a-e37dbfd4ed86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:57.267219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a671ed72-4ee3-4e92-937a-e37dbfd4ed86 None None] MFA Rules not processed for user `ba2a1694c94f42fa91fcf8f4d5e2544c`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:57.268424 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a671ed72-4ee3-4e92-937a-e37dbfd4ed86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:57.277761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:57.337610 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4025/8104] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:57.342393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6c8a8-0afe-4ca3-9c17-34d38ea6a0e2 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:57.407000 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6c8a8-0afe-4ca3-9c17-34d38ea6a0e2 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:57.412284 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917d3b7-77f0-4f41-b6e8-8bc066acebea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:57.412944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917d3b7-77f0-4f41-b6e8-8bc066acebea admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:57.413233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917d3b7-77f0-4f41-b6e8-8bc066acebea admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:57.413513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917d3b7-77f0-4f41-b6e8-8bc066acebea admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:57.414153 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917d3b7-77f0-4f41-b6e8-8bc066acebea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:57.416111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917d3b7-77f0-4f41-b6e8-8bc066acebea admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:57.444088 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4080/8105] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:36:57 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:36:57.447920 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671ed72-4ee3-4e92-937a-e37dbfd4ed86 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:57.460565 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671ed72-4ee3-4e92-937a-e37dbfd4ed86 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:57.520935 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f097497-4c4a-42d1-bbf0-a10846e9bd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:57.521581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f097497-4c4a-42d1-bbf0-a10846e9bd27 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:57.521859 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f097497-4c4a-42d1-bbf0-a10846e9bd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:57.522133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f097497-4c4a-42d1-bbf0-a10846e9bd27 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:57.522791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f097497-4c4a-42d1-bbf0-a10846e9bd27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:57.524890 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f097497-4c4a-42d1-bbf0-a10846e9bd27 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:57.548671 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4026/8106] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:36:57 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:36:57.553037 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917d3b7-77f0-4f41-b6e8-8bc066acebea admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:57.564120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917d3b7-77f0-4f41-b6e8-8bc066acebea admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:57.569628 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88732776-f924-4c68-835e-2e31ec1cdd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:57.570347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88732776-f924-4c68-835e-2e31ec1cdd67 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:57.570724 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88732776-f924-4c68-835e-2e31ec1cdd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:57.571065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88732776-f924-4c68-835e-2e31ec1cdd67 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:57.571824 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88732776-f924-4c68-835e-2e31ec1cdd67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:57.573963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88732776-f924-4c68-835e-2e31ec1cdd67 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:57.589211 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4081/8107] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:36:57.591064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f097497-4c4a-42d1-bbf0-a10846e9bd27 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:57.603494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f097497-4c4a-42d1-bbf0-a10846e9bd27 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:57.609814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f6d93-1a39-493e-a896-d05db72159f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:57.610516 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f6d93-1a39-493e-a896-d05db72159f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:57.610834 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f6d93-1a39-493e-a896-d05db72159f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:57.611162 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f6d93-1a39-493e-a896-d05db72159f8 admin admin] PATH_INFO: `/v3/projects/65d7c3e4d60c4a71aec198a001c88a79/users/c0f7b08fab8043e787a9cbf16023e09d/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:57.629137 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7f6d93-1a39-493e-a896-d05db72159f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65d7c3e4d60c4a71aec198a001c88a79, user_id=c0f7b08fab8043e787a9cbf16023e09d, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:57.631938 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7f6d93-1a39-493e-a896-d05db72159f8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:57.647512 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4027/8108] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:36:57 2022] PUT /identity/v3/projects/65d7c3e4d60c4a71aec198a001c88a79/users/c0f7b08fab8043e787a9cbf16023e09d/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:36:57.651588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88732776-f924-4c68-835e-2e31ec1cdd67 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:57.662912 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88732776-f924-4c68-835e-2e31ec1cdd67 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:57.734776 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6dbea-4202-4212-8f5a-671d32cec904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:57.735528 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6dbea-4202-4212-8f5a-671d32cec904 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:57.735816 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6dbea-4202-4212-8f5a-671d32cec904 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:57.736094 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6dbea-4202-4212-8f5a-671d32cec904 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:57.736762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b6dbea-4202-4212-8f5a-671d32cec904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:57.738363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b6dbea-4202-4212-8f5a-671d32cec904 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:57.752475 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4082/8109] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:36:57.753652 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f6d93-1a39-493e-a896-d05db72159f8 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:57.765255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f6d93-1a39-493e-a896-d05db72159f8 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:57.770023 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058288f3-551b-4432-b978-587c685f578b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:57.770721 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058288f3-551b-4432-b978-587c685f578b admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:57.771005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058288f3-551b-4432-b978-587c685f578b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:57.771288 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058288f3-551b-4432-b978-587c685f578b admin admin] PATH_INFO: `/v3/projects/65d7c3e4d60c4a71aec198a001c88a79/users/c0f7b08fab8043e787a9cbf16023e09d/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:57.773218 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058288f3-551b-4432-b978-587c685f578b admin admin] RBAC: Authorizing `identity:create_grant(project_id=65d7c3e4d60c4a71aec198a001c88a79, user_id=c0f7b08fab8043e787a9cbf16023e09d, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:57.775916 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058288f3-551b-4432-b978-587c685f578b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:57.787614 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4028/8110] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:36:57 2022] PUT /identity/v3/projects/65d7c3e4d60c4a71aec198a001c88a79/users/c0f7b08fab8043e787a9cbf16023e09d/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:36:57.798633 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272187b5-e2f0-4bc3-a7bb-7f6c3b0d255e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:57.798929 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272187b5-e2f0-4bc3-a7bb-7f6c3b0d255e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:57.799209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272187b5-e2f0-4bc3-a7bb-7f6c3b0d255e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:57.830190 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-272187b5-e2f0-4bc3-a7bb-7f6c3b0d255e None None] MFA Rules not processed for user `c0f7b08fab8043e787a9cbf16023e09d`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:57.831492 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-272187b5-e2f0-4bc3-a7bb-7f6c3b0d255e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:57.849212 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:57.903852 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4083/8111] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:57.908224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058288f3-551b-4432-b978-587c685f578b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:57.919005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058288f3-551b-4432-b978-587c685f578b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:57.923843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95642e-8a01-4302-a920-2a6aea01ef3e tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0f7b08fab8043e787a9cbf16023e09d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d7c3e4d60c4a71aec198a001c88a79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:57.924441 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95642e-8a01-4302-a920-2a6aea01ef3e tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:57.924722 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95642e-8a01-4302-a920-2a6aea01ef3e tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:57.925021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95642e-8a01-4302-a920-2a6aea01ef3e tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:57.925640 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95642e-8a01-4302-a920-2a6aea01ef3e tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:57.927842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95642e-8a01-4302-a920-2a6aea01ef3e tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:57.962618 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4029/8112] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:36:57 2022] POST /identity/v3/projects => generated 333 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:36:57.964308 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272187b5-e2f0-4bc3-a7bb-7f6c3b0d255e None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:57.974494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272187b5-e2f0-4bc3-a7bb-7f6c3b0d255e None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:58.046488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb21206-246d-4472-84b7-b4143445dfdb tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0f7b08fab8043e787a9cbf16023e09d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d7c3e4d60c4a71aec198a001c88a79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:58.047136 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb21206-246d-4472-84b7-b4143445dfdb tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:58.047445 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb21206-246d-4472-84b7-b4143445dfdb tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:58.047722 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb21206-246d-4472-84b7-b4143445dfdb tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:58.048338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb21206-246d-4472-84b7-b4143445dfdb tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:58.050188 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb21206-246d-4472-84b7-b4143445dfdb tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:58.090699 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4084/8113] 10.222.0.33 () {60 vars in 1152 bytes} [Sat Aug 6 21:36:57 2022] POST /identity/v3/projects => generated 332 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:36:58.092682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95642e-8a01-4302-a920-2a6aea01ef3e tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:58.103025 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95642e-8a01-4302-a920-2a6aea01ef3e tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:58.145701 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:58.164328 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34bf66-dfc9-49f8-b912-137fc2c90f3e tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0f7b08fab8043e787a9cbf16023e09d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d7c3e4d60c4a71aec198a001c88a79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:58.164948 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34bf66-dfc9-49f8-b912-137fc2c90f3e tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:58.165205 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34bf66-dfc9-49f8-b912-137fc2c90f3e tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:58.165476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34bf66-dfc9-49f8-b912-137fc2c90f3e tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:58.166086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34bf66-dfc9-49f8-b912-137fc2c90f3e tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:58.167966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34bf66-dfc9-49f8-b912-137fc2c90f3e tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:58.210125 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4030/8114] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:36:58 2022] POST /identity/v3/projects => generated 358 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:36:58.212023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb21206-246d-4472-84b7-b4143445dfdb tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:58.223886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb21206-246d-4472-84b7-b4143445dfdb tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:58.283245 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbdd71-94c8-4c0a-8c92-28ee6115667a tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0f7b08fab8043e787a9cbf16023e09d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d7c3e4d60c4a71aec198a001c88a79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:58.283778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbdd71-94c8-4c0a-8c92-28ee6115667a tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:58.284066 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbdd71-94c8-4c0a-8c92-28ee6115667a tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:58.284349 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbdd71-94c8-4c0a-8c92-28ee6115667a tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:58.284999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fbdd71-94c8-4c0a-8c92-28ee6115667a tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:58.287064 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fbdd71-94c8-4c0a-8c92-28ee6115667a tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:58.304533 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4085/8115] 10.222.0.33 () {58 vars in 1131 bytes} [Sat Aug 6 21:36:58 2022] GET /identity/v3/projects => generated 4629 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:36:58.309412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34bf66-dfc9-49f8-b912-137fc2c90f3e tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:58.319851 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34bf66-dfc9-49f8-b912-137fc2c90f3e tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:58.325166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e6e39-7bfd-402c-a04f-ff0cbe58365b tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0f7b08fab8043e787a9cbf16023e09d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d7c3e4d60c4a71aec198a001c88a79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:58.326071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e6e39-7bfd-402c-a04f-ff0cbe58365b tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:58.326504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e6e39-7bfd-402c-a04f-ff0cbe58365b tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:58.326815 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e6e39-7bfd-402c-a04f-ff0cbe58365b tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:58.327477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e6e39-7bfd-402c-a04f-ff0cbe58365b tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:36:58.327779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e6e39-7bfd-402c-a04f-ff0cbe58365b tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:58.329809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e6e39-7bfd-402c-a04f-ff0cbe58365b tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:58.347283 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4031/8116] 10.222.0.33 () {58 vars in 1158 bytes} [Sat Aug 6 21:36:58 2022] GET /identity/v3/projects?enabled=False => generated 444 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:36:58.352711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbdd71-94c8-4c0a-8c92-28ee6115667a tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:58.364195 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbdd71-94c8-4c0a-8c92-28ee6115667a tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:58.369108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f36c3-fbef-4f04-b1a1-8cb077299a5c tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0f7b08fab8043e787a9cbf16023e09d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d7c3e4d60c4a71aec198a001c88a79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:58.369714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f36c3-fbef-4f04-b1a1-8cb077299a5c tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:58.370001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f36c3-fbef-4f04-b1a1-8cb077299a5c tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:58.370279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f36c3-fbef-4f04-b1a1-8cb077299a5c tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:58.370970 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f36c3-fbef-4f04-b1a1-8cb077299a5c tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] RBAC: Adding query filter params (parent_id=b44f3086328344f4ae66e111a56d82b3) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:36:58.371278 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f36c3-fbef-4f04-b1a1-8cb077299a5c tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:58.374314 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f36c3-fbef-4f04-b1a1-8cb077299a5c tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:58.392464 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4086/8117] 10.222.0.33 () {58 vars in 1216 bytes} [Sat Aug 6 21:36:58 2022] GET /identity/v3/projects?parent_id=b44f3086328344f4ae66e111a56d82b3 => generated 498 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:36:58.397249 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e6e39-7bfd-402c-a04f-ff0cbe58365b tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:58.408071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e6e39-7bfd-402c-a04f-ff0cbe58365b tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:58.413274 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11e8a5-8ccc-464a-a65f-1d302e23711f tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0f7b08fab8043e787a9cbf16023e09d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d7c3e4d60c4a71aec198a001c88a79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:58.414011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11e8a5-8ccc-464a-a65f-1d302e23711f tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:58.414359 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11e8a5-8ccc-464a-a65f-1d302e23711f tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:58.414673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11e8a5-8ccc-464a-a65f-1d302e23711f tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] PATH_INFO: `/v3/projects/4f08a1fb760f4ebfa21f62aca5f4c388` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:58.415950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11e8a5-8ccc-464a-a65f-1d302e23711f tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4f08a1fb760f4ebfa21f62aca5f4c388)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:58.418040 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11e8a5-8ccc-464a-a65f-1d302e23711f tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:58.469470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4b11e8a5-8ccc-464a-a65f-1d302e23711f tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f08a1fb760f4ebfa21f62aca5f4c388', 'request_id': 'req-4b11e8a5-8ccc-464a-a65f-1d302e23711f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:58.475629 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4b11e8a5-8ccc-464a-a65f-1d302e23711f tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f08a1fb760f4ebfa21f62aca5f4c388', 'request_id': 'req-4b11e8a5-8ccc-464a-a65f-1d302e23711f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:58.482631 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4b11e8a5-8ccc-464a-a65f-1d302e23711f tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f08a1fb760f4ebfa21f62aca5f4c388', 'request_id': 'req-4b11e8a5-8ccc-464a-a65f-1d302e23711f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:58.495872 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4b11e8a5-8ccc-464a-a65f-1d302e23711f tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] The token cache is being invalidate because project 4f08a1fb760f4ebfa21f62aca5f4c388 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:36:58.496169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4b11e8a5-8ccc-464a-a65f-1d302e23711f tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:58.497224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4b11e8a5-8ccc-464a-a65f-1d302e23711f tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:58.499370 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4032/8118] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:36:58 2022] DELETE /identity/v3/projects/4f08a1fb760f4ebfa21f62aca5f4c388 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:58.503580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f36c3-fbef-4f04-b1a1-8cb077299a5c tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:58.506298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-422f36c3-fbef-4f04-b1a1-8cb077299a5c tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:58.520797 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f36c3-fbef-4f04-b1a1-8cb077299a5c tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:58.537870 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:58.588269 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a40051-aac2-4fe6-929a-2d747b85b584 tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0f7b08fab8043e787a9cbf16023e09d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d7c3e4d60c4a71aec198a001c88a79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:58.588912 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a40051-aac2-4fe6-929a-2d747b85b584 tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:58.589207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a40051-aac2-4fe6-929a-2d747b85b584 tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:58.589478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a40051-aac2-4fe6-929a-2d747b85b584 tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] PATH_INFO: `/v3/projects/b44f3086328344f4ae66e111a56d82b3` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:58.591857 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a40051-aac2-4fe6-929a-2d747b85b584 tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b44f3086328344f4ae66e111a56d82b3)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:58.593775 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a40051-aac2-4fe6-929a-2d747b85b584 tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:58.643378 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-25a40051-aac2-4fe6-929a-2d747b85b584 tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b44f3086328344f4ae66e111a56d82b3', 'request_id': 'req-25a40051-aac2-4fe6-929a-2d747b85b584'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:58.648912 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-25a40051-aac2-4fe6-929a-2d747b85b584 tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b44f3086328344f4ae66e111a56d82b3', 'request_id': 'req-25a40051-aac2-4fe6-929a-2d747b85b584'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:58.657610 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-25a40051-aac2-4fe6-929a-2d747b85b584 tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b44f3086328344f4ae66e111a56d82b3', 'request_id': 'req-25a40051-aac2-4fe6-929a-2d747b85b584'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:58.676479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-25a40051-aac2-4fe6-929a-2d747b85b584 tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] The token cache is being invalidate because project b44f3086328344f4ae66e111a56d82b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:36:58.676479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-25a40051-aac2-4fe6-929a-2d747b85b584 tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:58.676479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-25a40051-aac2-4fe6-929a-2d747b85b584 tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:58.681311 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4087/8119] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:36:58 2022] DELETE /identity/v3/projects/b44f3086328344f4ae66e111a56d82b3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:58.681797 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11e8a5-8ccc-464a-a65f-1d302e23711f tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:58.692455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11e8a5-8ccc-464a-a65f-1d302e23711f tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:58.760448 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97d176-20cf-4f7f-a260-81e5aad10cb4 tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0f7b08fab8043e787a9cbf16023e09d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d7c3e4d60c4a71aec198a001c88a79', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:58.761235 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97d176-20cf-4f7f-a260-81e5aad10cb4 tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:58.761593 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97d176-20cf-4f7f-a260-81e5aad10cb4 tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:58.762569 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97d176-20cf-4f7f-a260-81e5aad10cb4 tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] PATH_INFO: `/v3/projects/1ac9337d5be4470fae829db7f7dce2b7` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:58.764585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc97d176-20cf-4f7f-a260-81e5aad10cb4 tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1ac9337d5be4470fae829db7f7dce2b7)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:58.766911 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc97d176-20cf-4f7f-a260-81e5aad10cb4 tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:58.827675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:58.841526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bc97d176-20cf-4f7f-a260-81e5aad10cb4 tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ac9337d5be4470fae829db7f7dce2b7', 'request_id': 'req-bc97d176-20cf-4f7f-a260-81e5aad10cb4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:58.847163 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bc97d176-20cf-4f7f-a260-81e5aad10cb4 tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ac9337d5be4470fae829db7f7dce2b7', 'request_id': 'req-bc97d176-20cf-4f7f-a260-81e5aad10cb4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:58.853390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bc97d176-20cf-4f7f-a260-81e5aad10cb4 tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ac9337d5be4470fae829db7f7dce2b7', 'request_id': 'req-bc97d176-20cf-4f7f-a260-81e5aad10cb4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:58.867227 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bc97d176-20cf-4f7f-a260-81e5aad10cb4 tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] The token cache is being invalidate because project 1ac9337d5be4470fae829db7f7dce2b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:36:58.867525 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bc97d176-20cf-4f7f-a260-81e5aad10cb4 tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:58.868176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-bc97d176-20cf-4f7f-a260-81e5aad10cb4 tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:58.870125 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4033/8120] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:36:58 2022] DELETE /identity/v3/projects/1ac9337d5be4470fae829db7f7dce2b7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:58.874723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a40051-aac2-4fe6-929a-2d747b85b584 tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:58.876155 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-25a40051-aac2-4fe6-929a-2d747b85b584 tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:58.942215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a40051-aac2-4fe6-929a-2d747b85b584 tempest-ListProjectsTestJSON-1523113070 tempest-ListProjectsTestJSON-1523113070-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:58.995472 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:59.002973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070bfa4-d41d-4abc-86da-85b9bb2cb566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:59.003877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070bfa4-d41d-4abc-86da-85b9bb2cb566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:59.004413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070bfa4-d41d-4abc-86da-85b9bb2cb566 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:59.005105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070bfa4-d41d-4abc-86da-85b9bb2cb566 admin admin] PATH_INFO: `/v3/users/ba2a1694c94f42fa91fcf8f4d5e2544c` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:59.006855 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070bfa4-d41d-4abc-86da-85b9bb2cb566 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba2a1694c94f42fa91fcf8f4d5e2544c)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:59.009338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070bfa4-d41d-4abc-86da-85b9bb2cb566 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:59.056558 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e070bfa4-d41d-4abc-86da-85b9bb2cb566 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba2a1694c94f42fa91fcf8f4d5e2544c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:59.064505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e070bfa4-d41d-4abc-86da-85b9bb2cb566 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba2a1694c94f42fa91fcf8f4d5e2544c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:59.065195 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e070bfa4-d41d-4abc-86da-85b9bb2cb566 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba2a1694c94f42fa91fcf8f4d5e2544c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:59.065814 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e070bfa4-d41d-4abc-86da-85b9bb2cb566 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba2a1694c94f42fa91fcf8f4d5e2544c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:59.073599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e070bfa4-d41d-4abc-86da-85b9bb2cb566 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba2a1694c94f42fa91fcf8f4d5e2544c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:59.091904 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4088/8121] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:36:58 2022] DELETE /identity/v3/users/ba2a1694c94f42fa91fcf8f4d5e2544c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:59.096565 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30549842-f7c8-4dbe-b6c7-8fe118f45a25 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:59.096855 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30549842-f7c8-4dbe-b6c7-8fe118f45a25 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:59.097133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30549842-f7c8-4dbe-b6c7-8fe118f45a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:59.116791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-30549842-f7c8-4dbe-b6c7-8fe118f45a25 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:36:59.118258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-30549842-f7c8-4dbe-b6c7-8fe118f45a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:59.179961 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4034/8122] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:36:59.190508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070bfa4-d41d-4abc-86da-85b9bb2cb566 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:59.192025 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e070bfa4-d41d-4abc-86da-85b9bb2cb566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:59.254714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070bfa4-d41d-4abc-86da-85b9bb2cb566 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:59.259390 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb15d25-bf4b-47c3-82cf-7b4494aa8cd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:59.260266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb15d25-bf4b-47c3-82cf-7b4494aa8cd7 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:59.260740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb15d25-bf4b-47c3-82cf-7b4494aa8cd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:59.261115 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb15d25-bf4b-47c3-82cf-7b4494aa8cd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:59.272118 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb15d25-bf4b-47c3-82cf-7b4494aa8cd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:59.273567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb15d25-bf4b-47c3-82cf-7b4494aa8cd7 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:59.284326 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4089/8123] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:36:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:36:59.818820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30549842-f7c8-4dbe-b6c7-8fe118f45a25 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:59.820764 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-30549842-f7c8-4dbe-b6c7-8fe118f45a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:36:59.834992 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30549842-f7c8-4dbe-b6c7-8fe118f45a25 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:36:59.840703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22f0d6-8b29-4582-8583-fa25bcf24047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:36:59.841515 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22f0d6-8b29-4582-8583-fa25bcf24047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:36:59.841799 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22f0d6-8b29-4582-8583-fa25bcf24047 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:36:59.842079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22f0d6-8b29-4582-8583-fa25bcf24047 admin admin] PATH_INFO: `/v3/projects/d7d3c857a7c9432fb226bb9eeee154e0` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:36:59.843474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22f0d6-8b29-4582-8583-fa25bcf24047 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7d3c857a7c9432fb226bb9eeee154e0)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:36:59.845415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22f0d6-8b29-4582-8583-fa25bcf24047 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:36:59.901451 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8e22f0d6-8b29-4582-8583-fa25bcf24047 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7d3c857a7c9432fb226bb9eeee154e0', 'request_id': 'req-8e22f0d6-8b29-4582-8583-fa25bcf24047'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:59.907055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8e22f0d6-8b29-4582-8583-fa25bcf24047 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7d3c857a7c9432fb226bb9eeee154e0', 'request_id': 'req-8e22f0d6-8b29-4582-8583-fa25bcf24047'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:59.913390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8e22f0d6-8b29-4582-8583-fa25bcf24047 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7d3c857a7c9432fb226bb9eeee154e0', 'request_id': 'req-8e22f0d6-8b29-4582-8583-fa25bcf24047'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:59.927278 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8e22f0d6-8b29-4582-8583-fa25bcf24047 admin admin] The token cache is being invalidate because project d7d3c857a7c9432fb226bb9eeee154e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:36:59.927770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8e22f0d6-8b29-4582-8583-fa25bcf24047 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:59.928505 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8e22f0d6-8b29-4582-8583-fa25bcf24047 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:36:59.930392 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4035/8124] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:36:59 2022] DELETE /identity/v3/projects/d7d3c857a7c9432fb226bb9eeee154e0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:36:59.934881 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb15d25-bf4b-47c3-82cf-7b4494aa8cd7 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:36:59.945566 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb15d25-bf4b-47c3-82cf-7b4494aa8cd7 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:00.011082 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340add53-4433-4070-88c8-e8b1ff13d96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:00.011825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340add53-4433-4070-88c8-e8b1ff13d96b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:00.012874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340add53-4433-4070-88c8-e8b1ff13d96b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:00.013252 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340add53-4433-4070-88c8-e8b1ff13d96b admin admin] PATH_INFO: `/v3/users/c0f7b08fab8043e787a9cbf16023e09d` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:00.014432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340add53-4433-4070-88c8-e8b1ff13d96b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0f7b08fab8043e787a9cbf16023e09d)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:00.016450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340add53-4433-4070-88c8-e8b1ff13d96b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:00.038269 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:00.064847 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-340add53-4433-4070-88c8-e8b1ff13d96b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0f7b08fab8043e787a9cbf16023e09d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:00.072077 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-340add53-4433-4070-88c8-e8b1ff13d96b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0f7b08fab8043e787a9cbf16023e09d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:00.072785 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-340add53-4433-4070-88c8-e8b1ff13d96b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0f7b08fab8043e787a9cbf16023e09d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:00.073400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-340add53-4433-4070-88c8-e8b1ff13d96b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0f7b08fab8043e787a9cbf16023e09d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:00.083314 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-340add53-4433-4070-88c8-e8b1ff13d96b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0f7b08fab8043e787a9cbf16023e09d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:00.101107 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4090/8125] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:36:59 2022] DELETE /identity/v3/users/c0f7b08fab8043e787a9cbf16023e09d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:37:00.391468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22f0d6-8b29-4582-8583-fa25bcf24047 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:00.393563 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8e22f0d6-8b29-4582-8583-fa25bcf24047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:00.425584 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22f0d6-8b29-4582-8583-fa25bcf24047 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:00.470038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:00.486979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd24be-f094-40ad-b03b-13109389b919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:00.487645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd24be-f094-40ad-b03b-13109389b919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:00.487929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd24be-f094-40ad-b03b-13109389b919 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:00.488713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd24be-f094-40ad-b03b-13109389b919 admin admin] PATH_INFO: `/v3/projects/65d7c3e4d60c4a71aec198a001c88a79` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:00.489857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd24be-f094-40ad-b03b-13109389b919 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65d7c3e4d60c4a71aec198a001c88a79)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:00.492029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd24be-f094-40ad-b03b-13109389b919 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:00.541865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-93fd24be-f094-40ad-b03b-13109389b919 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65d7c3e4d60c4a71aec198a001c88a79', 'request_id': 'req-93fd24be-f094-40ad-b03b-13109389b919'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:00.547881 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-93fd24be-f094-40ad-b03b-13109389b919 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65d7c3e4d60c4a71aec198a001c88a79', 'request_id': 'req-93fd24be-f094-40ad-b03b-13109389b919'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:00.554447 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-93fd24be-f094-40ad-b03b-13109389b919 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65d7c3e4d60c4a71aec198a001c88a79', 'request_id': 'req-93fd24be-f094-40ad-b03b-13109389b919'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:00.568659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-93fd24be-f094-40ad-b03b-13109389b919 admin admin] The token cache is being invalidate because project 65d7c3e4d60c4a71aec198a001c88a79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:00.568966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-93fd24be-f094-40ad-b03b-13109389b919 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:00.569660 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-93fd24be-f094-40ad-b03b-13109389b919 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:00.571477 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4036/8126] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:37:00 2022] DELETE /identity/v3/projects/65d7c3e4d60c4a71aec198a001c88a79 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:00.577167 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e27af-6544-4472-af52-a5b4324c8bf4 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:00.577706 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e27af-6544-4472-af52-a5b4324c8bf4 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:00.577706 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e27af-6544-4472-af52-a5b4324c8bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:00.600727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-913e27af-6544-4472-af52-a5b4324c8bf4 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:00.601957 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-913e27af-6544-4472-af52-a5b4324c8bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:00.665397 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4091/8127] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:00.673037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5ba5e-a5e6-4d6c-a43d-cd3bf3be0647 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:00.673415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5ba5e-a5e6-4d6c-a43d-cd3bf3be0647 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:00.674506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5ba5e-a5e6-4d6c-a43d-cd3bf3be0647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:00.699517 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-20a5ba5e-a5e6-4d6c-a43d-cd3bf3be0647 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:00.700878 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-20a5ba5e-a5e6-4d6c-a43d-cd3bf3be0647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:00.709028 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4037/8128] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:37:00.713146 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e27af-6544-4472-af52-a5b4324c8bf4 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:00.722909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e27af-6544-4472-af52-a5b4324c8bf4 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:00.727617 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe752804-23f0-499f-acaa-bc2976f817b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:00.728226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe752804-23f0-499f-acaa-bc2976f817b1 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:00.728505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe752804-23f0-499f-acaa-bc2976f817b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:00.728775 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe752804-23f0-499f-acaa-bc2976f817b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:00.729416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe752804-23f0-499f-acaa-bc2976f817b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:37:00.729718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe752804-23f0-499f-acaa-bc2976f817b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:00.731607 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe752804-23f0-499f-acaa-bc2976f817b1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:00.743270 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4092/8129] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:37:00.748217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5ba5e-a5e6-4d6c-a43d-cd3bf3be0647 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:00.758818 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5ba5e-a5e6-4d6c-a43d-cd3bf3be0647 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:00.764373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3398d8-5666-4506-af96-948b5b84a0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:00.765110 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3398d8-5666-4506-af96-948b5b84a0d5 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:00.765675 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3398d8-5666-4506-af96-948b5b84a0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:00.765988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3398d8-5666-4506-af96-948b5b84a0d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:00.766627 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3398d8-5666-4506-af96-948b5b84a0d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:00.768580 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3398d8-5666-4506-af96-948b5b84a0d5 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:00.796505 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4038/8130] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:37:00 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:00.800482 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe752804-23f0-499f-acaa-bc2976f817b1 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:00.811979 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe752804-23f0-499f-acaa-bc2976f817b1 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:00.872362 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6405366-52cc-48d4-a30a-7a0a4b2803bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:00.873037 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6405366-52cc-48d4-a30a-7a0a4b2803bb admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:00.873321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6405366-52cc-48d4-a30a-7a0a4b2803bb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:00.873587 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6405366-52cc-48d4-a30a-7a0a4b2803bb admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:00.874270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6405366-52cc-48d4-a30a-7a0a4b2803bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:00.876351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6405366-52cc-48d4-a30a-7a0a4b2803bb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:00.901905 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4093/8131] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:37:00 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:00.903574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3398d8-5666-4506-af96-948b5b84a0d5 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:00.914672 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3398d8-5666-4506-af96-948b5b84a0d5 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:00.920608 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d16652-bb3c-41a6-93d7-04ae3409c776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:00.921336 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d16652-bb3c-41a6-93d7-04ae3409c776 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:00.921686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d16652-bb3c-41a6-93d7-04ae3409c776 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:00.922014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d16652-bb3c-41a6-93d7-04ae3409c776 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:00.922752 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d16652-bb3c-41a6-93d7-04ae3409c776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:00.924443 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d16652-bb3c-41a6-93d7-04ae3409c776 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:00.937196 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4039/8132] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:37:00.940943 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6405366-52cc-48d4-a30a-7a0a4b2803bb admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:00.951546 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6405366-52cc-48d4-a30a-7a0a4b2803bb admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:00.956297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ce7dd-5433-4b23-8720-0df404db3bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:00.956966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ce7dd-5433-4b23-8720-0df404db3bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:00.957320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ce7dd-5433-4b23-8720-0df404db3bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:00.957653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ce7dd-5433-4b23-8720-0df404db3bf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:00.958350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ce7dd-5433-4b23-8720-0df404db3bf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:00.960057 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ce7dd-5433-4b23-8720-0df404db3bf5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:00.970949 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4094/8133] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:37:00.975113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d16652-bb3c-41a6-93d7-04ae3409c776 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:00.985827 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d16652-bb3c-41a6-93d7-04ae3409c776 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:00.990453 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7133ad-c388-41d1-8aa5-c470566ef71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:00.991133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7133ad-c388-41d1-8aa5-c470566ef71d admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:00.991410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7133ad-c388-41d1-8aa5-c470566ef71d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:00.991683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7133ad-c388-41d1-8aa5-c470566ef71d admin admin] PATH_INFO: `/v3/projects/74a7cfecc13d4d75bc298e06f9aced8a/users/ee76056e2ecf42abbe6fcab4eac596ea/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:01.007100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7133ad-c388-41d1-8aa5-c470566ef71d admin admin] RBAC: Authorizing `identity:create_grant(project_id=74a7cfecc13d4d75bc298e06f9aced8a, user_id=ee76056e2ecf42abbe6fcab4eac596ea, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:01.009745 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7133ad-c388-41d1-8aa5-c470566ef71d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:01.023273 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4040/8134] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:37:00 2022] PUT /identity/v3/projects/74a7cfecc13d4d75bc298e06f9aced8a/users/ee76056e2ecf42abbe6fcab4eac596ea/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:01.034070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea39a9-edd2-458b-93e9-a544af87c7d3 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:01.034374 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea39a9-edd2-458b-93e9-a544af87c7d3 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:01.034682 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea39a9-edd2-458b-93e9-a544af87c7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:01.044634 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:01.069603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-fcea39a9-edd2-458b-93e9-a544af87c7d3 None None] MFA Rules not processed for user `ee76056e2ecf42abbe6fcab4eac596ea`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:01.071001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-fcea39a9-edd2-458b-93e9-a544af87c7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:01.144719 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4095/8135] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:01.149221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7133ad-c388-41d1-8aa5-c470566ef71d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:01.212820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7133ad-c388-41d1-8aa5-c470566ef71d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:01.219175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cafb6-ea73-4b26-af8f-fb64fad7b4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:01.219890 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cafb6-ea73-4b26-af8f-fb64fad7b4a4 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:01.220244 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cafb6-ea73-4b26-af8f-fb64fad7b4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:01.220617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cafb6-ea73-4b26-af8f-fb64fad7b4a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:01.221318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926cafb6-ea73-4b26-af8f-fb64fad7b4a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:01.223375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926cafb6-ea73-4b26-af8f-fb64fad7b4a4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:01.240038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:01.253472 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4041/8136] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:37:01 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:01.257745 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea39a9-edd2-458b-93e9-a544af87c7d3 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:01.269007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea39a9-edd2-458b-93e9-a544af87c7d3 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:01.341166 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedf280-408a-472d-92db-3991a770c6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:01.341657 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedf280-408a-472d-92db-3991a770c6e4 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:01.342006 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedf280-408a-472d-92db-3991a770c6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:01.342356 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedf280-408a-472d-92db-3991a770c6e4 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:01.343098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fedf280-408a-472d-92db-3991a770c6e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:01.345108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fedf280-408a-472d-92db-3991a770c6e4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:01.369550 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4096/8137] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:37:01 2022] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:01.370807 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cafb6-ea73-4b26-af8f-fb64fad7b4a4 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:01.383997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cafb6-ea73-4b26-af8f-fb64fad7b4a4 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:01.390985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a2e86-f8a8-4fa9-95d1-95e21b491b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:01.392221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a2e86-f8a8-4fa9-95d1-95e21b491b4c admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:01.392787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a2e86-f8a8-4fa9-95d1-95e21b491b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:01.392787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a2e86-f8a8-4fa9-95d1-95e21b491b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:01.393425 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a2e86-f8a8-4fa9-95d1-95e21b491b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:01.395069 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a2e86-f8a8-4fa9-95d1-95e21b491b4c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:01.408768 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4042/8138] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:37:01.411251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedf280-408a-472d-92db-3991a770c6e4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:01.422025 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedf280-408a-472d-92db-3991a770c6e4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:01.427500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3187e6-0097-4d7f-ae61-81169723f6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:01.428238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3187e6-0097-4d7f-ae61-81169723f6e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:01.428606 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3187e6-0097-4d7f-ae61-81169723f6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:01.428887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3187e6-0097-4d7f-ae61-81169723f6e1 admin admin] PATH_INFO: `/v3/projects/9c2ef996c2a8482aa38447115a544018/users/60d1c8574ecd4c11b5eb95a1da53d5be/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:01.445367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3187e6-0097-4d7f-ae61-81169723f6e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c2ef996c2a8482aa38447115a544018, user_id=60d1c8574ecd4c11b5eb95a1da53d5be, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:01.448059 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3187e6-0097-4d7f-ae61-81169723f6e1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:01.461566 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4097/8139] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:37:01 2022] PUT /identity/v3/projects/9c2ef996c2a8482aa38447115a544018/users/60d1c8574ecd4c11b5eb95a1da53d5be/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:37:01.466304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a2e86-f8a8-4fa9-95d1-95e21b491b4c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:01.476772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a2e86-f8a8-4fa9-95d1-95e21b491b4c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:01.537420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9d973-a648-4e75-acb2-d0f43e74b3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:01.538018 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9d973-a648-4e75-acb2-d0f43e74b3f3 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:01.538501 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9d973-a648-4e75-acb2-d0f43e74b3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:01.538807 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9d973-a648-4e75-acb2-d0f43e74b3f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:01.539443 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9d973-a648-4e75-acb2-d0f43e74b3f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:01.541034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9d973-a648-4e75-acb2-d0f43e74b3f3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:01.552057 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4043/8140] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:37:01.556401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3187e6-0097-4d7f-ae61-81169723f6e1 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:01.567736 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3187e6-0097-4d7f-ae61-81169723f6e1 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:01.572356 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410fa02-d38e-402c-bf5a-c85bb9c9f2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:01.573053 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410fa02-d38e-402c-bf5a-c85bb9c9f2bb admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:01.573314 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410fa02-d38e-402c-bf5a-c85bb9c9f2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:01.573616 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410fa02-d38e-402c-bf5a-c85bb9c9f2bb admin admin] PATH_INFO: `/v3/projects/9c2ef996c2a8482aa38447115a544018/users/60d1c8574ecd4c11b5eb95a1da53d5be/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:01.576384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b410fa02-d38e-402c-bf5a-c85bb9c9f2bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c2ef996c2a8482aa38447115a544018, user_id=60d1c8574ecd4c11b5eb95a1da53d5be, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:01.579039 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b410fa02-d38e-402c-bf5a-c85bb9c9f2bb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:01.589507 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4098/8141] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:37:01 2022] PUT /identity/v3/projects/9c2ef996c2a8482aa38447115a544018/users/60d1c8574ecd4c11b5eb95a1da53d5be/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:37:01.601583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6cc1b9-803f-4d30-bdda-f7a96937d4f7 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:01.602025 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6cc1b9-803f-4d30-bdda-f7a96937d4f7 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:01.602369 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6cc1b9-803f-4d30-bdda-f7a96937d4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:01.631629 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-fa6cc1b9-803f-4d30-bdda-f7a96937d4f7 None None] MFA Rules not processed for user `60d1c8574ecd4c11b5eb95a1da53d5be`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:01.632844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-fa6cc1b9-803f-4d30-bdda-f7a96937d4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:01.717729 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4044/8142] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:01.723135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410fa02-d38e-402c-bf5a-c85bb9c9f2bb admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:01.735842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410fa02-d38e-402c-bf5a-c85bb9c9f2bb admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:01.748772 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051022d4-acbe-4562-9a39-beede12d072d tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1c8574ecd4c11b5eb95a1da53d5be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c2ef996c2a8482aa38447115a544018', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:01.749508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051022d4-acbe-4562-9a39-beede12d072d tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:01.749852 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051022d4-acbe-4562-9a39-beede12d072d tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:01.750190 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051022d4-acbe-4562-9a39-beede12d072d tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:01.750978 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051022d4-acbe-4562-9a39-beede12d072d tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:01.752042 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-051022d4-acbe-4562-9a39-beede12d072d tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:37:01.752042 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:37:01.752042 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:37:01.753144 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051022d4-acbe-4562-9a39-beede12d072d tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:01.773595 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4099/8143] 10.222.0.33 () {60 vars in 1185 bytes} [Sat Aug 6 21:37:01 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:01.778228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6cc1b9-803f-4d30-bdda-f7a96937d4f7 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:01.788468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6cc1b9-803f-4d30-bdda-f7a96937d4f7 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:01.795356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffdfe21-eda5-4a87-acc7-54bcbab8034a tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1c8574ecd4c11b5eb95a1da53d5be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c2ef996c2a8482aa38447115a544018', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:01.796115 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffdfe21-eda5-4a87-acc7-54bcbab8034a tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:01.796431 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffdfe21-eda5-4a87-acc7-54bcbab8034a tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:01.796721 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffdfe21-eda5-4a87-acc7-54bcbab8034a tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/afb048cc316348cfb19181fd0a463321` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:01.797315 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffdfe21-eda5-4a87-acc7-54bcbab8034a tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=afb048cc316348cfb19181fd0a463321)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:01.799322 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-6ffdfe21-eda5-4a87-acc7-54bcbab8034a tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:37:01.799322 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:37:01.799322 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:37:01.799636 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffdfe21-eda5-4a87-acc7-54bcbab8034a tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:01.806877 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4045/8144] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Aug 6 21:37:01 2022] GET /identity/v3/OS-OAUTH1/consumers/afb048cc316348cfb19181fd0a463321 => generated 221 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:37:01.811428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051022d4-acbe-4562-9a39-beede12d072d tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:01.826004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051022d4-acbe-4562-9a39-beede12d072d tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:01.830963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66560622-14d4-458d-abc3-d4701cebe1a7 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1c8574ecd4c11b5eb95a1da53d5be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c2ef996c2a8482aa38447115a544018', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:01.831512 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66560622-14d4-458d-abc3-d4701cebe1a7 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:01.831897 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66560622-14d4-458d-abc3-d4701cebe1a7 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:01.832280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66560622-14d4-458d-abc3-d4701cebe1a7 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/afb048cc316348cfb19181fd0a463321` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:01.833008 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66560622-14d4-458d-abc3-d4701cebe1a7 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=afb048cc316348cfb19181fd0a463321)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:01.834025 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-66560622-14d4-458d-abc3-d4701cebe1a7 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:37:01.834025 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:37:01.834025 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:37:01.834938 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66560622-14d4-458d-abc3-d4701cebe1a7 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:01.835210 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-66560622-14d4-458d-abc3-d4701cebe1a7 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Invalidating token cache because consumer afb048cc316348cfb19181fd0a463321 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:01.835492 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-66560622-14d4-458d-abc3-d4701cebe1a7 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:01.836185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-66560622-14d4-458d-abc3-d4701cebe1a7 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:01.860832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-66560622-14d4-458d-abc3-d4701cebe1a7 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'afb048cc316348cfb19181fd0a463321', 'request_id': 'req-66560622-14d4-458d-abc3-d4701cebe1a7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:01.880594 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4100/8145] 10.222.0.33 () {58 vars in 1266 bytes} [Sat Aug 6 21:37:01 2022] DELETE /identity/v3/OS-OAUTH1/consumers/afb048cc316348cfb19181fd0a463321 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:37:01.885829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffdfe21-eda5-4a87-acc7-54bcbab8034a tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:01.888819 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6ffdfe21-eda5-4a87-acc7-54bcbab8034a tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:01.904151 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffdfe21-eda5-4a87-acc7-54bcbab8034a tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:01.909295 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba915b-c3fd-439a-9b7c-07bdad63709b tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1c8574ecd4c11b5eb95a1da53d5be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c2ef996c2a8482aa38447115a544018', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:01.909908 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba915b-c3fd-439a-9b7c-07bdad63709b tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:01.910189 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba915b-c3fd-439a-9b7c-07bdad63709b tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:01.910462 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba915b-c3fd-439a-9b7c-07bdad63709b tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:01.911145 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba915b-c3fd-439a-9b7c-07bdad63709b tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:01.912209 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-9dba915b-c3fd-439a-9b7c-07bdad63709b tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:37:01.912209 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:37:01.912209 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:37:01.913455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba915b-c3fd-439a-9b7c-07bdad63709b tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:01.938947 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4046/8146] 10.222.0.33 () {60 vars in 1185 bytes} [Sat Aug 6 21:37:01 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:01.940319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66560622-14d4-458d-abc3-d4701cebe1a7 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:01.953749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66560622-14d4-458d-abc3-d4701cebe1a7 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:01.959014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f724498-e3ad-4b2c-b193-87024538a0de tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1c8574ecd4c11b5eb95a1da53d5be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c2ef996c2a8482aa38447115a544018', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:01.959419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f724498-e3ad-4b2c-b193-87024538a0de tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:01.959702 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f724498-e3ad-4b2c-b193-87024538a0de tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:01.959982 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f724498-e3ad-4b2c-b193-87024538a0de tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/d6e2715bac82433eae31482eee055b64` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:01.960568 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f724498-e3ad-4b2c-b193-87024538a0de tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=d6e2715bac82433eae31482eee055b64)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:01.961587 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-9f724498-e3ad-4b2c-b193-87024538a0de tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:37:01.961587 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:37:01.961587 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:37:01.962478 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f724498-e3ad-4b2c-b193-87024538a0de tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:01.964061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:INSERT=7,keystone:DELETE=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:01.973084 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4101/8147] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Aug 6 21:37:01 2022] GET /identity/v3/OS-OAUTH1/consumers/d6e2715bac82433eae31482eee055b64 => generated 221 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:37:01.974082 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba915b-c3fd-439a-9b7c-07bdad63709b tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:01.985496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba915b-c3fd-439a-9b7c-07bdad63709b tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:01.991567 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8f7da-c685-4059-ac96-000048465f57 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1c8574ecd4c11b5eb95a1da53d5be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c2ef996c2a8482aa38447115a544018', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:01.992391 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8f7da-c685-4059-ac96-000048465f57 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:01.992770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8f7da-c685-4059-ac96-000048465f57 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:01.993228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8f7da-c685-4059-ac96-000048465f57 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/d6e2715bac82433eae31482eee055b64` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:01.994089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8f7da-c685-4059-ac96-000048465f57 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=d6e2715bac82433eae31482eee055b64)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:01.995271 ncdv-master-1 devstack@keystone.service[102758]: WARNING py.warnings [None req-b0b8f7da-c685-4059-ac96-000048465f57 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:37:01.995271 ncdv-master-1 devstack@keystone.service[102758]: warnings.warn(msg) Aug 06 21:37:01.995271 ncdv-master-1 devstack@keystone.service[102758]: Aug 06 21:37:01.998147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8f7da-c685-4059-ac96-000048465f57 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:01.998755 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b0b8f7da-c685-4059-ac96-000048465f57 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Invalidating token cache because consumer d6e2715bac82433eae31482eee055b64 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:01.999138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b0b8f7da-c685-4059-ac96-000048465f57 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:02.000161 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b0b8f7da-c685-4059-ac96-000048465f57 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:02.021120 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b0b8f7da-c685-4059-ac96-000048465f57 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'd6e2715bac82433eae31482eee055b64', 'request_id': 'req-b0b8f7da-c685-4059-ac96-000048465f57'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:02.038210 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4047/8148] 10.222.0.33 () {58 vars in 1266 bytes} [Sat Aug 6 21:37:01 2022] DELETE /identity/v3/OS-OAUTH1/consumers/d6e2715bac82433eae31482eee055b64 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:37:02.042280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f724498-e3ad-4b2c-b193-87024538a0de tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:02.044663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9f724498-e3ad-4b2c-b193-87024538a0de tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:02.060735 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f724498-e3ad-4b2c-b193-87024538a0de tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:02.066104 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e806dc-0cad-4965-b1a2-c29fabbff4aa tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1c8574ecd4c11b5eb95a1da53d5be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c2ef996c2a8482aa38447115a544018', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:02.066951 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e806dc-0cad-4965-b1a2-c29fabbff4aa tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:02.067341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e806dc-0cad-4965-b1a2-c29fabbff4aa tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:02.067715 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e806dc-0cad-4965-b1a2-c29fabbff4aa tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/d6e2715bac82433eae31482eee055b64` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:02.068418 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e806dc-0cad-4965-b1a2-c29fabbff4aa tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=d6e2715bac82433eae31482eee055b64)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:02.070583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e806dc-0cad-4965-b1a2-c29fabbff4aa tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:02.099582 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application [None req-c5e806dc-0cad-4965-b1a2-c29fabbff4aa tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Aug 06 21:37:02.099582 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:37:02.099582 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:37:02.099582 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:37:02.099582 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:37:02.099582 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:37:02.099582 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:37:02.099582 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:37:02.099582 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:37:02.099582 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:37:02.099582 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:37:02.099582 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:37:02.099582 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Aug 06 21:37:02.099582 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Aug 06 21:37:02.099582 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Aug 06 21:37:02.100886 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Aug 06 21:37:02.100886 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Aug 06 21:37:02.100886 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Aug 06 21:37:02.100886 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Aug 06 21:37:02.100886 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Aug 06 21:37:02.100886 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Aug 06 21:37:02.100886 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Aug 06 21:37:02.100886 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Aug 06 21:37:02.100886 ncdv-master-1 devstack@keystone.service[102759]: ERROR keystone.server.flask.application Aug 06 21:37:02.100886 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4102/8149] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Aug 6 21:37:02 2022] GET /identity/v3/OS-OAUTH1/consumers/d6e2715bac82433eae31482eee055b64 => generated 74 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 21:37:02.105607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8f7da-c685-4059-ac96-000048465f57 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:02.117331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8f7da-c685-4059-ac96-000048465f57 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:02.122790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1b41f-8940-4d5d-b468-613ae91e098e tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1c8574ecd4c11b5eb95a1da53d5be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c2ef996c2a8482aa38447115a544018', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:02.123446 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1b41f-8940-4d5d-b468-613ae91e098e tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:02.123725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1b41f-8940-4d5d-b468-613ae91e098e tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:02.123996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1b41f-8940-4d5d-b468-613ae91e098e tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/d6e2715bac82433eae31482eee055b64` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:02.124590 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b1b41f-8940-4d5d-b468-613ae91e098e tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=d6e2715bac82433eae31482eee055b64)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:02.126216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b1b41f-8940-4d5d-b468-613ae91e098e tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:02.126487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-13b1b41f-8940-4d5d-b468-613ae91e098e tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Invalidating token cache because consumer d6e2715bac82433eae31482eee055b64 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:02.126803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-13b1b41f-8940-4d5d-b468-613ae91e098e tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:02.127522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-13b1b41f-8940-4d5d-b468-613ae91e098e tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:02.145880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-13b1b41f-8940-4d5d-b468-613ae91e098e tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Aug 06 21:37:02.145880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:37:02.145880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:37:02.145880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:37:02.145880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:37:02.145880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:37:02.145880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:37:02.145880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:37:02.145880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:37:02.145880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:37:02.145880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:37:02.145880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:37:02.145880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Aug 06 21:37:02.145880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Aug 06 21:37:02.145880 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:37:02.147404 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:37:02.147404 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Aug 06 21:37:02.147404 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Aug 06 21:37:02.147404 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Aug 06 21:37:02.147404 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Aug 06 21:37:02.147404 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Aug 06 21:37:02.147404 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Aug 06 21:37:02.147404 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Aug 06 21:37:02.147404 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Aug 06 21:37:02.147404 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Aug 06 21:37:02.147404 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:37:02.147404 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4048/8150] 10.222.0.33 () {58 vars in 1266 bytes} [Sat Aug 6 21:37:02 2022] DELETE /identity/v3/OS-OAUTH1/consumers/d6e2715bac82433eae31482eee055b64 => generated 74 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 21:37:02.152487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e806dc-0cad-4965-b1a2-c29fabbff4aa tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:02.156088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c5e806dc-0cad-4965-b1a2-c29fabbff4aa tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:02.171716 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e806dc-0cad-4965-b1a2-c29fabbff4aa tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:02.177647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3642b-5186-4f15-b11f-ee7c98b1b51a tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1c8574ecd4c11b5eb95a1da53d5be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c2ef996c2a8482aa38447115a544018', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:02.178575 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3642b-5186-4f15-b11f-ee7c98b1b51a tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:02.178778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3642b-5186-4f15-b11f-ee7c98b1b51a tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:02.179262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3642b-5186-4f15-b11f-ee7c98b1b51a tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:02.180154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3642b-5186-4f15-b11f-ee7c98b1b51a tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:02.181889 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3642b-5186-4f15-b11f-ee7c98b1b51a tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:02.198667 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4103/8151] 10.222.0.33 () {60 vars in 1185 bytes} [Sat Aug 6 21:37:02 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:02.203166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1b41f-8940-4d5d-b468-613ae91e098e tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:02.209747 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:02.217469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1b41f-8940-4d5d-b468-613ae91e098e tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:02.224175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63fbd1-ed1f-4aac-b3de-c0b5eb6705e2 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1c8574ecd4c11b5eb95a1da53d5be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c2ef996c2a8482aa38447115a544018', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:02.225460 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63fbd1-ed1f-4aac-b3de-c0b5eb6705e2 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:02.226031 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63fbd1-ed1f-4aac-b3de-c0b5eb6705e2 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:02.226664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63fbd1-ed1f-4aac-b3de-c0b5eb6705e2 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:02.227672 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b63fbd1-ed1f-4aac-b3de-c0b5eb6705e2 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:02.230160 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b63fbd1-ed1f-4aac-b3de-c0b5eb6705e2 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:02.250071 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4049/8152] 10.222.0.33 () {60 vars in 1185 bytes} [Sat Aug 6 21:37:02 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:02.254000 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3642b-5186-4f15-b11f-ee7c98b1b51a tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:02.265737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3642b-5186-4f15-b11f-ee7c98b1b51a tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:02.271744 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943ebfe-6186-49a7-ac23-2c7597710416 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1c8574ecd4c11b5eb95a1da53d5be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c2ef996c2a8482aa38447115a544018', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:02.272641 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943ebfe-6186-49a7-ac23-2c7597710416 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:02.272880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943ebfe-6186-49a7-ac23-2c7597710416 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:02.273291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943ebfe-6186-49a7-ac23-2c7597710416 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:02.274054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943ebfe-6186-49a7-ac23-2c7597710416 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:02.276189 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-4943ebfe-6186-49a7-ac23-2c7597710416 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:37:02.276189 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:37:02.276189 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:37:02.276899 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943ebfe-6186-49a7-ac23-2c7597710416 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:02.284780 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4104/8153] 10.222.0.33 () {58 vars in 1164 bytes} [Sat Aug 6 21:37:02 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 537 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:37:02.288722 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63fbd1-ed1f-4aac-b3de-c0b5eb6705e2 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:02.300569 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63fbd1-ed1f-4aac-b3de-c0b5eb6705e2 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:02.306362 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa439f-3ce9-4fbc-9cb0-8bb5f5901509 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1c8574ecd4c11b5eb95a1da53d5be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c2ef996c2a8482aa38447115a544018', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:02.307312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa439f-3ce9-4fbc-9cb0-8bb5f5901509 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:02.307604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa439f-3ce9-4fbc-9cb0-8bb5f5901509 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:02.307908 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa439f-3ce9-4fbc-9cb0-8bb5f5901509 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/686da2b2341e4da69945c37dd6f78244` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:02.308640 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa439f-3ce9-4fbc-9cb0-8bb5f5901509 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=686da2b2341e4da69945c37dd6f78244)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:02.311489 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa439f-3ce9-4fbc-9cb0-8bb5f5901509 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:02.311767 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7faa439f-3ce9-4fbc-9cb0-8bb5f5901509 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Invalidating token cache because consumer 686da2b2341e4da69945c37dd6f78244 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:02.312380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7faa439f-3ce9-4fbc-9cb0-8bb5f5901509 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:02.313922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7faa439f-3ce9-4fbc-9cb0-8bb5f5901509 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:02.330634 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7faa439f-3ce9-4fbc-9cb0-8bb5f5901509 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '686da2b2341e4da69945c37dd6f78244', 'request_id': 'req-7faa439f-3ce9-4fbc-9cb0-8bb5f5901509'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:02.355018 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4050/8154] 10.222.0.33 () {58 vars in 1266 bytes} [Sat Aug 6 21:37:02 2022] DELETE /identity/v3/OS-OAUTH1/consumers/686da2b2341e4da69945c37dd6f78244 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:02.356622 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943ebfe-6186-49a7-ac23-2c7597710416 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:02.358706 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4943ebfe-6186-49a7-ac23-2c7597710416 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:02.376375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943ebfe-6186-49a7-ac23-2c7597710416 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:02.382285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a0f1f-1021-4e1e-9b41-4b79b1ff7d06 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1c8574ecd4c11b5eb95a1da53d5be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c2ef996c2a8482aa38447115a544018', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:02.383050 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a0f1f-1021-4e1e-9b41-4b79b1ff7d06 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:02.383622 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a0f1f-1021-4e1e-9b41-4b79b1ff7d06 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:02.383897 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a0f1f-1021-4e1e-9b41-4b79b1ff7d06 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/17093b7471434e89978d5674345302a5` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:02.384715 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a0f1f-1021-4e1e-9b41-4b79b1ff7d06 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=17093b7471434e89978d5674345302a5)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:02.386411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a0f1f-1021-4e1e-9b41-4b79b1ff7d06 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:02.386777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7c3a0f1f-1021-4e1e-9b41-4b79b1ff7d06 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Invalidating token cache because consumer 17093b7471434e89978d5674345302a5 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:02.387580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7c3a0f1f-1021-4e1e-9b41-4b79b1ff7d06 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:02.388716 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7c3a0f1f-1021-4e1e-9b41-4b79b1ff7d06 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:02.406414 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7c3a0f1f-1021-4e1e-9b41-4b79b1ff7d06 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '17093b7471434e89978d5674345302a5', 'request_id': 'req-7c3a0f1f-1021-4e1e-9b41-4b79b1ff7d06'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:02.423626 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4105/8155] 10.222.0.33 () {58 vars in 1266 bytes} [Sat Aug 6 21:37:02 2022] DELETE /identity/v3/OS-OAUTH1/consumers/17093b7471434e89978d5674345302a5 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:02.428975 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa439f-3ce9-4fbc-9cb0-8bb5f5901509 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:02.441285 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa439f-3ce9-4fbc-9cb0-8bb5f5901509 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:02.446898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a04dc-4fb7-4058-94a0-9c58f13bd131 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1c8574ecd4c11b5eb95a1da53d5be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c2ef996c2a8482aa38447115a544018', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:02.447686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a04dc-4fb7-4058-94a0-9c58f13bd131 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:02.447973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a04dc-4fb7-4058-94a0-9c58f13bd131 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:02.448245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a04dc-4fb7-4058-94a0-9c58f13bd131 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:02.449085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a04dc-4fb7-4058-94a0-9c58f13bd131 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:02.451754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a04dc-4fb7-4058-94a0-9c58f13bd131 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:02.467570 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4051/8156] 10.222.0.33 () {60 vars in 1185 bytes} [Sat Aug 6 21:37:02 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:02.471473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a0f1f-1021-4e1e-9b41-4b79b1ff7d06 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:02.473092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7c3a0f1f-1021-4e1e-9b41-4b79b1ff7d06 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:02.486826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a0f1f-1021-4e1e-9b41-4b79b1ff7d06 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:02.491951 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078ae93-e741-4ebd-afe3-c24d9027cf41 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1c8574ecd4c11b5eb95a1da53d5be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c2ef996c2a8482aa38447115a544018', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:02.492708 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078ae93-e741-4ebd-afe3-c24d9027cf41 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:02.493065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078ae93-e741-4ebd-afe3-c24d9027cf41 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:02.493534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078ae93-e741-4ebd-afe3-c24d9027cf41 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/2e64a352473c44b2a623efb1a439609e` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:02.494333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078ae93-e741-4ebd-afe3-c24d9027cf41 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=2e64a352473c44b2a623efb1a439609e)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:02.495531 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-3078ae93-e741-4ebd-afe3-c24d9027cf41 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:37:02.495531 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:37:02.495531 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:37:02.496428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078ae93-e741-4ebd-afe3-c24d9027cf41 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:02.518751 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4106/8157] 10.222.0.33 () {60 vars in 1285 bytes} [Sat Aug 6 21:37:02 2022] PATCH /identity/v3/OS-OAUTH1/consumers/2e64a352473c44b2a623efb1a439609e => generated 221 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:37:02.522740 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a04dc-4fb7-4058-94a0-9c58f13bd131 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:02.538932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a04dc-4fb7-4058-94a0-9c58f13bd131 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:02.545315 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590407a7-40b5-49c7-8c52-47264d806e22 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1c8574ecd4c11b5eb95a1da53d5be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c2ef996c2a8482aa38447115a544018', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:02.546430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590407a7-40b5-49c7-8c52-47264d806e22 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:02.546430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590407a7-40b5-49c7-8c52-47264d806e22 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:02.546909 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590407a7-40b5-49c7-8c52-47264d806e22 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/2e64a352473c44b2a623efb1a439609e` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:02.548561 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590407a7-40b5-49c7-8c52-47264d806e22 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=2e64a352473c44b2a623efb1a439609e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:02.551033 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590407a7-40b5-49c7-8c52-47264d806e22 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:02.558513 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4052/8158] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Aug 6 21:37:02 2022] GET /identity/v3/OS-OAUTH1/consumers/2e64a352473c44b2a623efb1a439609e => generated 221 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:37:02.562651 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078ae93-e741-4ebd-afe3-c24d9027cf41 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:02.583395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078ae93-e741-4ebd-afe3-c24d9027cf41 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:02.595073 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627fe4e-26bd-416c-979e-63294b5fac67 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60d1c8574ecd4c11b5eb95a1da53d5be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c2ef996c2a8482aa38447115a544018', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:02.596855 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627fe4e-26bd-416c-979e-63294b5fac67 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:02.597385 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627fe4e-26bd-416c-979e-63294b5fac67 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:02.597831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627fe4e-26bd-416c-979e-63294b5fac67 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/2e64a352473c44b2a623efb1a439609e` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:02.598832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627fe4e-26bd-416c-979e-63294b5fac67 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=2e64a352473c44b2a623efb1a439609e)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:02.600627 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627fe4e-26bd-416c-979e-63294b5fac67 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:02.601084 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5627fe4e-26bd-416c-979e-63294b5fac67 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Invalidating token cache because consumer 2e64a352473c44b2a623efb1a439609e has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:02.602017 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5627fe4e-26bd-416c-979e-63294b5fac67 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:02.603543 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5627fe4e-26bd-416c-979e-63294b5fac67 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:02.617994 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5627fe4e-26bd-416c-979e-63294b5fac67 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '2e64a352473c44b2a623efb1a439609e', 'request_id': 'req-5627fe4e-26bd-416c-979e-63294b5fac67'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:02.639877 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4107/8159] 10.222.0.33 () {58 vars in 1266 bytes} [Sat Aug 6 21:37:02 2022] DELETE /identity/v3/OS-OAUTH1/consumers/2e64a352473c44b2a623efb1a439609e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:02.641374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590407a7-40b5-49c7-8c52-47264d806e22 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:02.643537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-590407a7-40b5-49c7-8c52-47264d806e22 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:02.746189 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590407a7-40b5-49c7-8c52-47264d806e22 tempest-OAUTHConsumersV3Test-217501717 tempest-OAUTHConsumersV3Test-217501717-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:02.751811 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3807cfc-32cb-4ffb-b46a-bbe409233e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:02.752566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3807cfc-32cb-4ffb-b46a-bbe409233e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:02.753018 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3807cfc-32cb-4ffb-b46a-bbe409233e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:02.753341 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3807cfc-32cb-4ffb-b46a-bbe409233e28 admin admin] PATH_INFO: `/v3/users/ee76056e2ecf42abbe6fcab4eac596ea` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:02.755090 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3807cfc-32cb-4ffb-b46a-bbe409233e28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee76056e2ecf42abbe6fcab4eac596ea)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:02.757178 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3807cfc-32cb-4ffb-b46a-bbe409233e28 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:02.841283 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e3807cfc-32cb-4ffb-b46a-bbe409233e28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee76056e2ecf42abbe6fcab4eac596ea'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:02.842025 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e3807cfc-32cb-4ffb-b46a-bbe409233e28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee76056e2ecf42abbe6fcab4eac596ea'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:02.842491 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e3807cfc-32cb-4ffb-b46a-bbe409233e28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee76056e2ecf42abbe6fcab4eac596ea'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:02.851053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e3807cfc-32cb-4ffb-b46a-bbe409233e28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee76056e2ecf42abbe6fcab4eac596ea'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:02.873351 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e3807cfc-32cb-4ffb-b46a-bbe409233e28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee76056e2ecf42abbe6fcab4eac596ea'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:02.894333 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4053/8160] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:37:02 2022] DELETE /identity/v3/users/ee76056e2ecf42abbe6fcab4eac596ea => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:02.896027 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9bdcb0-3040-4d6b-a867-c2186db80294 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:02.896363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9bdcb0-3040-4d6b-a867-c2186db80294 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:02.896647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9bdcb0-3040-4d6b-a867-c2186db80294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:02.920740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-2d9bdcb0-3040-4d6b-a867-c2186db80294 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:02.921983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2d9bdcb0-3040-4d6b-a867-c2186db80294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:02.991643 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4108/8161] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:37:03.003427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3807cfc-32cb-4ffb-b46a-bbe409233e28 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:03.004733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e3807cfc-32cb-4ffb-b46a-bbe409233e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:03.035756 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:03.073913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3807cfc-32cb-4ffb-b46a-bbe409233e28 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:03.078876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105ce31-89fd-41c7-ac6b-0df8815170da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:03.079486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105ce31-89fd-41c7-ac6b-0df8815170da service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:03.079768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105ce31-89fd-41c7-ac6b-0df8815170da service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:03.080048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105ce31-89fd-41c7-ac6b-0df8815170da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:03.090154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105ce31-89fd-41c7-ac6b-0df8815170da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:03.092482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105ce31-89fd-41c7-ac6b-0df8815170da service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:03.103854 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4054/8162] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:37:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:37:03.404800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9bdcb0-3040-4d6b-a867-c2186db80294 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:03.406702 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2d9bdcb0-3040-4d6b-a867-c2186db80294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:03.427702 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9bdcb0-3040-4d6b-a867-c2186db80294 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:03.435634 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18dd7fb-0b4a-4eff-8352-c4905dcda325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:03.436516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18dd7fb-0b4a-4eff-8352-c4905dcda325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:03.436800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18dd7fb-0b4a-4eff-8352-c4905dcda325 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:03.437340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18dd7fb-0b4a-4eff-8352-c4905dcda325 admin admin] PATH_INFO: `/v3/projects/74a7cfecc13d4d75bc298e06f9aced8a` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:03.438667 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18dd7fb-0b4a-4eff-8352-c4905dcda325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74a7cfecc13d4d75bc298e06f9aced8a)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:03.440861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18dd7fb-0b4a-4eff-8352-c4905dcda325 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:03.498728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f18dd7fb-0b4a-4eff-8352-c4905dcda325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74a7cfecc13d4d75bc298e06f9aced8a', 'request_id': 'req-f18dd7fb-0b4a-4eff-8352-c4905dcda325'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:03.504832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=9,keystone:UPDATE=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:03.507407 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f18dd7fb-0b4a-4eff-8352-c4905dcda325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74a7cfecc13d4d75bc298e06f9aced8a', 'request_id': 'req-f18dd7fb-0b4a-4eff-8352-c4905dcda325'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:03.516349 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f18dd7fb-0b4a-4eff-8352-c4905dcda325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74a7cfecc13d4d75bc298e06f9aced8a', 'request_id': 'req-f18dd7fb-0b4a-4eff-8352-c4905dcda325'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:03.535783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f18dd7fb-0b4a-4eff-8352-c4905dcda325 admin admin] The token cache is being invalidate because project 74a7cfecc13d4d75bc298e06f9aced8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:03.536791 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f18dd7fb-0b4a-4eff-8352-c4905dcda325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:03.537450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f18dd7fb-0b4a-4eff-8352-c4905dcda325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:03.539565 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4109/8163] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:37:03 2022] DELETE /identity/v3/projects/74a7cfecc13d4d75bc298e06f9aced8a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:03.543344 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105ce31-89fd-41c7-ac6b-0df8815170da service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:03.555440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105ce31-89fd-41c7-ac6b-0df8815170da service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:03.630629 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc3bac-d5df-4c40-a8ac-78a8145f9aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:03.631335 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc3bac-d5df-4c40-a8ac-78a8145f9aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:03.631753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc3bac-d5df-4c40-a8ac-78a8145f9aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:03.632037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc3bac-d5df-4c40-a8ac-78a8145f9aa9 admin admin] PATH_INFO: `/v3/users/60d1c8574ecd4c11b5eb95a1da53d5be` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:03.633375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebc3bac-d5df-4c40-a8ac-78a8145f9aa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60d1c8574ecd4c11b5eb95a1da53d5be)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:03.635955 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebc3bac-d5df-4c40-a8ac-78a8145f9aa9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:03.705971 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5ebc3bac-d5df-4c40-a8ac-78a8145f9aa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60d1c8574ecd4c11b5eb95a1da53d5be'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:03.706854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5ebc3bac-d5df-4c40-a8ac-78a8145f9aa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60d1c8574ecd4c11b5eb95a1da53d5be'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:03.707777 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5ebc3bac-d5df-4c40-a8ac-78a8145f9aa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60d1c8574ecd4c11b5eb95a1da53d5be'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:03.725768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5ebc3bac-d5df-4c40-a8ac-78a8145f9aa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60d1c8574ecd4c11b5eb95a1da53d5be'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:03.749833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5ebc3bac-d5df-4c40-a8ac-78a8145f9aa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60d1c8574ecd4c11b5eb95a1da53d5be'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:03.766669 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4055/8164] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:37:03 2022] DELETE /identity/v3/users/60d1c8574ecd4c11b5eb95a1da53d5be => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:04.294263 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18dd7fb-0b4a-4eff-8352-c4905dcda325 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:04.296243 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f18dd7fb-0b4a-4eff-8352-c4905dcda325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:04.318084 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18dd7fb-0b4a-4eff-8352-c4905dcda325 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:04.388590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f2c50c-3803-4472-ae69-4dd6e9a73131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:04.389248 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2c50c-3803-4472-ae69-4dd6e9a73131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:04.389524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2c50c-3803-4472-ae69-4dd6e9a73131 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:04.389796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2c50c-3803-4472-ae69-4dd6e9a73131 admin admin] PATH_INFO: `/v3/projects/9c2ef996c2a8482aa38447115a544018` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:04.390944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f2c50c-3803-4472-ae69-4dd6e9a73131 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c2ef996c2a8482aa38447115a544018)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:04.392829 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f2c50c-3803-4472-ae69-4dd6e9a73131 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:04.440428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c1f2c50c-3803-4472-ae69-4dd6e9a73131 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c2ef996c2a8482aa38447115a544018', 'request_id': 'req-c1f2c50c-3803-4472-ae69-4dd6e9a73131'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:04.446401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c1f2c50c-3803-4472-ae69-4dd6e9a73131 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c2ef996c2a8482aa38447115a544018', 'request_id': 'req-c1f2c50c-3803-4472-ae69-4dd6e9a73131'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:04.455762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c1f2c50c-3803-4472-ae69-4dd6e9a73131 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c2ef996c2a8482aa38447115a544018', 'request_id': 'req-c1f2c50c-3803-4472-ae69-4dd6e9a73131'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:04.468185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c1f2c50c-3803-4472-ae69-4dd6e9a73131 admin admin] The token cache is being invalidate because project 9c2ef996c2a8482aa38447115a544018 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:04.468474 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c1f2c50c-3803-4472-ae69-4dd6e9a73131 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:04.469201 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c1f2c50c-3803-4472-ae69-4dd6e9a73131 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:04.471539 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4110/8165] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:37:04 2022] DELETE /identity/v3/projects/9c2ef996c2a8482aa38447115a544018 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:04.477202 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15759d67-3483-4f3f-8d54-4ff69f23b045 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:04.477709 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15759d67-3483-4f3f-8d54-4ff69f23b045 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:04.477995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15759d67-3483-4f3f-8d54-4ff69f23b045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:04.499973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-15759d67-3483-4f3f-8d54-4ff69f23b045 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:04.501180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-15759d67-3483-4f3f-8d54-4ff69f23b045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:04.541983 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:04.564223 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4056/8166] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:04.572193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de672d-3621-469e-bfea-e8799f3824c2 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:04.572482 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de672d-3621-469e-bfea-e8799f3824c2 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:04.572759 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de672d-3621-469e-bfea-e8799f3824c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:04.595457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-f0de672d-3621-469e-bfea-e8799f3824c2 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:04.596854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f0de672d-3621-469e-bfea-e8799f3824c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:04.605241 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4111/8167] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:37:04.610086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15759d67-3483-4f3f-8d54-4ff69f23b045 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:04.620520 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15759d67-3483-4f3f-8d54-4ff69f23b045 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:04.626040 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c29b11-707e-487d-b674-430a27276c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:04.626676 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c29b11-707e-487d-b674-430a27276c88 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:04.626956 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c29b11-707e-487d-b674-430a27276c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:04.627255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c29b11-707e-487d-b674-430a27276c88 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:04.627902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c29b11-707e-487d-b674-430a27276c88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:37:04.628203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c29b11-707e-487d-b674-430a27276c88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:04.629812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c29b11-707e-487d-b674-430a27276c88 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:04.645033 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4057/8168] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:37:04.649525 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de672d-3621-469e-bfea-e8799f3824c2 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:04.660390 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de672d-3621-469e-bfea-e8799f3824c2 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:04.665346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab3671-1327-4cf3-af27-fc8b175d226e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:04.666518 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab3671-1327-4cf3-af27-fc8b175d226e admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:04.666518 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab3671-1327-4cf3-af27-fc8b175d226e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:04.666518 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab3671-1327-4cf3-af27-fc8b175d226e admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:04.667255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab3671-1327-4cf3-af27-fc8b175d226e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:04.669200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab3671-1327-4cf3-af27-fc8b175d226e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:04.697183 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4112/8169] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:37:04 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:04.702086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c29b11-707e-487d-b674-430a27276c88 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:04.718406 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c29b11-707e-487d-b674-430a27276c88 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:04.777869 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad1f7b-5779-40a7-8aaa-a91fc290d318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:04.779042 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad1f7b-5779-40a7-8aaa-a91fc290d318 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:04.779375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad1f7b-5779-40a7-8aaa-a91fc290d318 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:04.779658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad1f7b-5779-40a7-8aaa-a91fc290d318 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:04.780290 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad1f7b-5779-40a7-8aaa-a91fc290d318 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:04.782266 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad1f7b-5779-40a7-8aaa-a91fc290d318 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:04.806348 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4058/8170] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:37:04 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:04.810899 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab3671-1327-4cf3-af27-fc8b175d226e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:04.821785 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab3671-1327-4cf3-af27-fc8b175d226e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:04.826762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf9856-ac9a-4e1a-a982-7380acb8b8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:04.827591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf9856-ac9a-4e1a-a982-7380acb8b8c6 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:04.827880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf9856-ac9a-4e1a-a982-7380acb8b8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:04.828150 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf9856-ac9a-4e1a-a982-7380acb8b8c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:04.828789 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf9856-ac9a-4e1a-a982-7380acb8b8c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:04.830367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf9856-ac9a-4e1a-a982-7380acb8b8c6 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:04.840818 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4113/8171] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:37:04.845097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad1f7b-5779-40a7-8aaa-a91fc290d318 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:04.855505 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad1f7b-5779-40a7-8aaa-a91fc290d318 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:04.860865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cf987-ea67-47c6-948c-8d6c1f050226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:04.861473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cf987-ea67-47c6-948c-8d6c1f050226 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:04.861761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cf987-ea67-47c6-948c-8d6c1f050226 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:04.862158 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cf987-ea67-47c6-948c-8d6c1f050226 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:04.862715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cf987-ea67-47c6-948c-8d6c1f050226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:04.864851 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cf987-ea67-47c6-948c-8d6c1f050226 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:04.877911 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4059/8172] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:37:04.882011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf9856-ac9a-4e1a-a982-7380acb8b8c6 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:04.895917 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf9856-ac9a-4e1a-a982-7380acb8b8c6 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:04.904490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eedfd8b-3dc4-4989-9463-bb70240da39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:04.904907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedfd8b-3dc4-4989-9463-bb70240da39c admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:04.905187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedfd8b-3dc4-4989-9463-bb70240da39c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:04.905463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedfd8b-3dc4-4989-9463-bb70240da39c admin admin] PATH_INFO: `/v3/projects/6eb580db19c94d38be337fb6ddce82ea/users/4f541b4a6edc4f1ba4c8bdc20affd75d/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:04.922236 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eedfd8b-3dc4-4989-9463-bb70240da39c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eb580db19c94d38be337fb6ddce82ea, user_id=4f541b4a6edc4f1ba4c8bdc20affd75d, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:04.925007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eedfd8b-3dc4-4989-9463-bb70240da39c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:04.946675 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4114/8173] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:37:04 2022] PUT /identity/v3/projects/6eb580db19c94d38be337fb6ddce82ea/users/4f541b4a6edc4f1ba4c8bdc20affd75d/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:37:04.958791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279ecae-6d32-4af6-b3bb-4d26ebe2a7e4 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:04.959081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279ecae-6d32-4af6-b3bb-4d26ebe2a7e4 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:04.959361 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279ecae-6d32-4af6-b3bb-4d26ebe2a7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:04.992685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-6279ecae-6d32-4af6-b3bb-4d26ebe2a7e4 None None] MFA Rules not processed for user `4f541b4a6edc4f1ba4c8bdc20affd75d`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:04.993933 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6279ecae-6d32-4af6-b3bb-4d26ebe2a7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:05.074372 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4060/8174] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:05.079283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eedfd8b-3dc4-4989-9463-bb70240da39c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:05.090917 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:05.146440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eedfd8b-3dc4-4989-9463-bb70240da39c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:05.151068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac34057-2c7a-4d96-97f4-5ca075cc632f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:05.151682 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac34057-2c7a-4d96-97f4-5ca075cc632f admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:05.151963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac34057-2c7a-4d96-97f4-5ca075cc632f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:05.154800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac34057-2c7a-4d96-97f4-5ca075cc632f admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:05.155619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac34057-2c7a-4d96-97f4-5ca075cc632f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:05.157846 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac34057-2c7a-4d96-97f4-5ca075cc632f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:05.187560 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4115/8175] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:37:05 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:05.191592 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279ecae-6d32-4af6-b3bb-4d26ebe2a7e4 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:05.206967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279ecae-6d32-4af6-b3bb-4d26ebe2a7e4 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:05.249048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:05.270190 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3425cc-ea20-4169-b11f-4aa9991bddfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:05.270840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3425cc-ea20-4169-b11f-4aa9991bddfe admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:05.271130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3425cc-ea20-4169-b11f-4aa9991bddfe admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:05.271403 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3425cc-ea20-4169-b11f-4aa9991bddfe admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:05.272020 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3425cc-ea20-4169-b11f-4aa9991bddfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:05.273955 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3425cc-ea20-4169-b11f-4aa9991bddfe admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:05.295991 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4061/8176] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:37:05 2022] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:37:05.300006 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac34057-2c7a-4d96-97f4-5ca075cc632f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:05.311254 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac34057-2c7a-4d96-97f4-5ca075cc632f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:05.316717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a13f2-1cac-44be-a50f-cf3c78637a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:05.317316 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a13f2-1cac-44be-a50f-cf3c78637a30 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:05.317594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a13f2-1cac-44be-a50f-cf3c78637a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:05.317868 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a13f2-1cac-44be-a50f-cf3c78637a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:05.318503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a13f2-1cac-44be-a50f-cf3c78637a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:05.320181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a13f2-1cac-44be-a50f-cf3c78637a30 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:05.332344 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4116/8177] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:37:05.336903 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3425cc-ea20-4169-b11f-4aa9991bddfe admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:05.347041 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3425cc-ea20-4169-b11f-4aa9991bddfe admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:05.351664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5474a-15f1-4acf-a05a-c406f66634b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:05.352312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5474a-15f1-4acf-a05a-c406f66634b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:05.352590 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5474a-15f1-4acf-a05a-c406f66634b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:05.352868 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5474a-15f1-4acf-a05a-c406f66634b4 admin admin] PATH_INFO: `/v3/projects/6ffb0467fee446bea4fc9af6ba6797c7/users/4a16a8531e77491abd6a57c55469d2e7/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:05.369937 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff5474a-15f1-4acf-a05a-c406f66634b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ffb0467fee446bea4fc9af6ba6797c7, user_id=4a16a8531e77491abd6a57c55469d2e7, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:05.373215 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff5474a-15f1-4acf-a05a-c406f66634b4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:05.387393 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4062/8178] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:37:05 2022] PUT /identity/v3/projects/6ffb0467fee446bea4fc9af6ba6797c7/users/4a16a8531e77491abd6a57c55469d2e7/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:37:05.391635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a13f2-1cac-44be-a50f-cf3c78637a30 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:05.403277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a13f2-1cac-44be-a50f-cf3c78637a30 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:05.472091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e08d6-11ea-48a0-a17c-5f3f438b2319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:05.472702 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e08d6-11ea-48a0-a17c-5f3f438b2319 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:05.472982 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e08d6-11ea-48a0-a17c-5f3f438b2319 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:05.473262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e08d6-11ea-48a0-a17c-5f3f438b2319 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:05.473908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e08d6-11ea-48a0-a17c-5f3f438b2319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:05.475600 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e08d6-11ea-48a0-a17c-5f3f438b2319 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:05.490731 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4117/8179] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:37:05.494702 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5474a-15f1-4acf-a05a-c406f66634b4 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:05.511598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5474a-15f1-4acf-a05a-c406f66634b4 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:05.519849 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da166b12-0541-4ee5-8b62-5168b90905c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:05.520559 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da166b12-0541-4ee5-8b62-5168b90905c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:05.520842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da166b12-0541-4ee5-8b62-5168b90905c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:05.521120 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da166b12-0541-4ee5-8b62-5168b90905c7 admin admin] PATH_INFO: `/v3/projects/6ffb0467fee446bea4fc9af6ba6797c7/users/4a16a8531e77491abd6a57c55469d2e7/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:05.523912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da166b12-0541-4ee5-8b62-5168b90905c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ffb0467fee446bea4fc9af6ba6797c7, user_id=4a16a8531e77491abd6a57c55469d2e7, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:05.526665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da166b12-0541-4ee5-8b62-5168b90905c7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:05.540273 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4063/8180] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:37:05 2022] PUT /identity/v3/projects/6ffb0467fee446bea4fc9af6ba6797c7/users/4a16a8531e77491abd6a57c55469d2e7/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:05.551356 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6419ca6-df9f-4e5f-9c91-8d193a2b58c2 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:05.551638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6419ca6-df9f-4e5f-9c91-8d193a2b58c2 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:05.555485 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6419ca6-df9f-4e5f-9c91-8d193a2b58c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:05.596739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b6419ca6-df9f-4e5f-9c91-8d193a2b58c2 None None] MFA Rules not processed for user `4a16a8531e77491abd6a57c55469d2e7`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:05.598129 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b6419ca6-df9f-4e5f-9c91-8d193a2b58c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:05.699148 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4118/8181] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:05 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:05.704876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da166b12-0541-4ee5-8b62-5168b90905c7 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:05.717720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da166b12-0541-4ee5-8b62-5168b90905c7 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:05.728701 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc1bc8-9e4e-485f-a2bc-8530782024e9 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a16a8531e77491abd6a57c55469d2e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ffb0467fee446bea4fc9af6ba6797c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:05.729333 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc1bc8-9e4e-485f-a2bc-8530782024e9 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:05.729611 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc1bc8-9e4e-485f-a2bc-8530782024e9 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:05.729884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc1bc8-9e4e-485f-a2bc-8530782024e9 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:05.730501 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc1bc8-9e4e-485f-a2bc-8530782024e9 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:05.732560 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc1bc8-9e4e-485f-a2bc-8530782024e9 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:05.774038 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4064/8182] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:37:05 2022] POST /identity/v3/projects => generated 359 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:05.775219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6419ca6-df9f-4e5f-9c91-8d193a2b58c2 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:05.781658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:05.787999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6419ca6-df9f-4e5f-9c91-8d193a2b58c2 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:05.879238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ea8b6-9297-49ff-8745-a7597b577262 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a16a8531e77491abd6a57c55469d2e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ffb0467fee446bea4fc9af6ba6797c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:05.880675 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ea8b6-9297-49ff-8745-a7597b577262 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:05.881100 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ea8b6-9297-49ff-8745-a7597b577262 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:05.881386 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ea8b6-9297-49ff-8745-a7597b577262 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] PATH_INFO: `/v3/projects/f1295acbe7f94b7aa9cb6b217d0d93a8/tags/tempest-tag-2059169026` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:05.882970 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ea8b6-9297-49ff-8745-a7597b577262 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=f1295acbe7f94b7aa9cb6b217d0d93a8, value=tempest-tag-2059169026)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:05.885347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ea8b6-9297-49ff-8745-a7597b577262 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:05.964220 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-1a5ea8b6-9297-49ff-8745-a7597b577262 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-2059169026. To ensure interoperability, identifiers should be a valid uuid. Aug 06 21:37:05.964220 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 06 21:37:05.964220 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:37:05.977189 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4119/8183] 10.222.0.33 () {60 vars in 1333 bytes} [Sat Aug 6 21:37:05 2022] PUT /identity/v3/projects/f1295acbe7f94b7aa9cb6b217d0d93a8/tags/tempest-tag-2059169026 => generated 0 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 291 bytes (2 switches on core 0) Aug 06 21:37:05.977949 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc1bc8-9e4e-485f-a2bc-8530782024e9 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:05.993485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc1bc8-9e4e-485f-a2bc-8530782024e9 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:05.999640 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea98620-d00a-4855-9640-3f18d82d170e tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a16a8531e77491abd6a57c55469d2e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ffb0467fee446bea4fc9af6ba6797c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:06.000449 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea98620-d00a-4855-9640-3f18d82d170e tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:06.000800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea98620-d00a-4855-9640-3f18d82d170e tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:06.001289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea98620-d00a-4855-9640-3f18d82d170e tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] PATH_INFO: `/v3/projects/f1295acbe7f94b7aa9cb6b217d0d93a8/tags/tempest-tag-2059169026` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:06.018137 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea98620-d00a-4855-9640-3f18d82d170e tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=f1295acbe7f94b7aa9cb6b217d0d93a8, value=tempest-tag-2059169026)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:06.021541 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea98620-d00a-4855-9640-3f18d82d170e tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:06.037229 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4065/8184] 10.222.0.33 () {58 vars in 1314 bytes} [Sat Aug 6 21:37:05 2022] GET /identity/v3/projects/f1295acbe7f94b7aa9cb6b217d0d93a8/tags/tempest-tag-2059169026 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:06.038377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ea8b6-9297-49ff-8745-a7597b577262 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:06.053094 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ea8b6-9297-49ff-8745-a7597b577262 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:06.058721 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cfe0d-41ba-4514-b354-2607d997caa2 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a16a8531e77491abd6a57c55469d2e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ffb0467fee446bea4fc9af6ba6797c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:06.060392 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cfe0d-41ba-4514-b354-2607d997caa2 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:06.061071 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cfe0d-41ba-4514-b354-2607d997caa2 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:06.061465 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cfe0d-41ba-4514-b354-2607d997caa2 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] PATH_INFO: `/v3/projects/f1295acbe7f94b7aa9cb6b217d0d93a8/tags` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:06.062397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7cfe0d-41ba-4514-b354-2607d997caa2 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=f1295acbe7f94b7aa9cb6b217d0d93a8)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:06.064563 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7cfe0d-41ba-4514-b354-2607d997caa2 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:06.122663 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4120/8185] 10.222.0.33 () {60 vars in 1265 bytes} [Sat Aug 6 21:37:06 2022] PUT /identity/v3/projects/f1295acbe7f94b7aa9cb6b217d0d93a8/tags => generated 140 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:37:06.124737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea98620-d00a-4855-9640-3f18d82d170e tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:06.138570 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea98620-d00a-4855-9640-3f18d82d170e tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:06.145001 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885bb7e-ed74-40c6-af1c-e4c5c89392bb tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a16a8531e77491abd6a57c55469d2e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ffb0467fee446bea4fc9af6ba6797c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:06.145782 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885bb7e-ed74-40c6-af1c-e4c5c89392bb tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:06.146167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885bb7e-ed74-40c6-af1c-e4c5c89392bb tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:06.146565 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885bb7e-ed74-40c6-af1c-e4c5c89392bb tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] PATH_INFO: `/v3/projects/f1295acbe7f94b7aa9cb6b217d0d93a8/tags` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:06.164594 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0885bb7e-ed74-40c6-af1c-e4c5c89392bb tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=f1295acbe7f94b7aa9cb6b217d0d93a8)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:06.167660 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0885bb7e-ed74-40c6-af1c-e4c5c89392bb tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:06.187418 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4066/8186] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:37:06 2022] GET /identity/v3/projects/f1295acbe7f94b7aa9cb6b217d0d93a8/tags => generated 140 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:37:06.189295 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cfe0d-41ba-4514-b354-2607d997caa2 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:06.200231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cfe0d-41ba-4514-b354-2607d997caa2 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:06.205930 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23107a-c78e-4c3c-9c8b-516563821fed tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a16a8531e77491abd6a57c55469d2e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ffb0467fee446bea4fc9af6ba6797c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:06.206875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23107a-c78e-4c3c-9c8b-516563821fed tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:06.206988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23107a-c78e-4c3c-9c8b-516563821fed tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:06.207184 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23107a-c78e-4c3c-9c8b-516563821fed tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] PATH_INFO: `/v3/projects/f1295acbe7f94b7aa9cb6b217d0d93a8/tags/tempest-tag-299156135` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:06.208471 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23107a-c78e-4c3c-9c8b-516563821fed tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=f1295acbe7f94b7aa9cb6b217d0d93a8, value=tempest-tag-299156135)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:06.213994 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23107a-c78e-4c3c-9c8b-516563821fed tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:06.260283 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-6f23107a-c78e-4c3c-9c8b-516563821fed tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-299156135. To ensure interoperability, identifiers should be a valid uuid. Aug 06 21:37:06.260283 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 06 21:37:06.260283 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:37:06.266476 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4121/8187] 10.222.0.33 () {58 vars in 1314 bytes} [Sat Aug 6 21:37:06 2022] DELETE /identity/v3/projects/f1295acbe7f94b7aa9cb6b217d0d93a8/tags/tempest-tag-299156135 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:06.270737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885bb7e-ed74-40c6-af1c-e4c5c89392bb tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:06.281921 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885bb7e-ed74-40c6-af1c-e4c5c89392bb tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:06.286923 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555290f-1264-40b5-ba9c-7f1cfccd87a3 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a16a8531e77491abd6a57c55469d2e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ffb0467fee446bea4fc9af6ba6797c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:06.287578 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555290f-1264-40b5-ba9c-7f1cfccd87a3 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:06.287868 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555290f-1264-40b5-ba9c-7f1cfccd87a3 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:06.288151 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555290f-1264-40b5-ba9c-7f1cfccd87a3 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] PATH_INFO: `/v3/projects/f1295acbe7f94b7aa9cb6b217d0d93a8/tags/tempest-tag-299156135` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:06.300215 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9555290f-1264-40b5-ba9c-7f1cfccd87a3 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=f1295acbe7f94b7aa9cb6b217d0d93a8, value=tempest-tag-299156135)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:06.302736 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9555290f-1264-40b5-ba9c-7f1cfccd87a3 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:06.318473 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-9555290f-1264-40b5-ba9c-7f1cfccd87a3 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] Could not find project tag: tempest-tag-299156135.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-299156135. Aug 06 21:37:06.318473 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:37:06.318473 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:37:06.318473 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:37:06.318473 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:37:06.318473 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:37:06.318473 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:37:06.318473 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:37:06.318473 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:37:06.318473 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:37:06.318473 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:37:06.318473 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:37:06.318473 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Aug 06 21:37:06.318473 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Aug 06 21:37:06.319872 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:37:06.319872 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:37:06.319872 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Aug 06 21:37:06.319872 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Aug 06 21:37:06.319872 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-299156135. Aug 06 21:37:06.319872 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:37:06.320846 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4067/8188] 10.222.0.33 () {58 vars in 1311 bytes} [Sat Aug 6 21:37:06 2022] GET /identity/v3/projects/f1295acbe7f94b7aa9cb6b217d0d93a8/tags/tempest-tag-299156135 => generated 106 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:37:06.325556 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23107a-c78e-4c3c-9c8b-516563821fed tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:06.336574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23107a-c78e-4c3c-9c8b-516563821fed tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:06.342219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cf16e-cac3-40d9-9b9b-20abbef876d3 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a16a8531e77491abd6a57c55469d2e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ffb0467fee446bea4fc9af6ba6797c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:06.342885 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cf16e-cac3-40d9-9b9b-20abbef876d3 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:06.343169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cf16e-cac3-40d9-9b9b-20abbef876d3 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:06.343457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cf16e-cac3-40d9-9b9b-20abbef876d3 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] PATH_INFO: `/v3/projects/f1295acbe7f94b7aa9cb6b217d0d93a8/tags` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:06.344630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1cf16e-cac3-40d9-9b9b-20abbef876d3 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=f1295acbe7f94b7aa9cb6b217d0d93a8)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:06.346960 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1cf16e-cac3-40d9-9b9b-20abbef876d3 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:06.398126 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4122/8189] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Aug 6 21:37:06 2022] DELETE /identity/v3/projects/f1295acbe7f94b7aa9cb6b217d0d93a8/tags => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:06.398417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555290f-1264-40b5-ba9c-7f1cfccd87a3 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:06.408910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555290f-1264-40b5-ba9c-7f1cfccd87a3 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:06.413923 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011de16-38f0-48f9-91ac-51648277d684 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a16a8531e77491abd6a57c55469d2e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ffb0467fee446bea4fc9af6ba6797c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:06.414678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011de16-38f0-48f9-91ac-51648277d684 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:06.415049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011de16-38f0-48f9-91ac-51648277d684 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:06.415670 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011de16-38f0-48f9-91ac-51648277d684 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] PATH_INFO: `/v3/projects/f1295acbe7f94b7aa9cb6b217d0d93a8/tags` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:06.430918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7011de16-38f0-48f9-91ac-51648277d684 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=f1295acbe7f94b7aa9cb6b217d0d93a8)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:06.433452 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7011de16-38f0-48f9-91ac-51648277d684 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:06.449612 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4068/8190] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:37:06 2022] GET /identity/v3/projects/f1295acbe7f94b7aa9cb6b217d0d93a8/tags => generated 66 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 06 21:37:06.451639 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cf16e-cac3-40d9-9b9b-20abbef876d3 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:06.457082 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:06.465090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cf16e-cac3-40d9-9b9b-20abbef876d3 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:06.472621 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435c9ec-a415-4d21-8359-1b6684d36f12 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a16a8531e77491abd6a57c55469d2e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ffb0467fee446bea4fc9af6ba6797c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:06.473554 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435c9ec-a415-4d21-8359-1b6684d36f12 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:06.474013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435c9ec-a415-4d21-8359-1b6684d36f12 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:06.474467 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435c9ec-a415-4d21-8359-1b6684d36f12 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] PATH_INFO: `/v3/projects/f1295acbe7f94b7aa9cb6b217d0d93a8` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:06.475866 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435c9ec-a415-4d21-8359-1b6684d36f12 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f1295acbe7f94b7aa9cb6b217d0d93a8)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:06.478616 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435c9ec-a415-4d21-8359-1b6684d36f12 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:06.535711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1435c9ec-a415-4d21-8359-1b6684d36f12 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1295acbe7f94b7aa9cb6b217d0d93a8', 'request_id': 'req-1435c9ec-a415-4d21-8359-1b6684d36f12'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:06.545457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1435c9ec-a415-4d21-8359-1b6684d36f12 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1295acbe7f94b7aa9cb6b217d0d93a8', 'request_id': 'req-1435c9ec-a415-4d21-8359-1b6684d36f12'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:06.555445 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1435c9ec-a415-4d21-8359-1b6684d36f12 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1295acbe7f94b7aa9cb6b217d0d93a8', 'request_id': 'req-1435c9ec-a415-4d21-8359-1b6684d36f12'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:06.571033 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1435c9ec-a415-4d21-8359-1b6684d36f12 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] The token cache is being invalidate because project f1295acbe7f94b7aa9cb6b217d0d93a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:06.571033 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1435c9ec-a415-4d21-8359-1b6684d36f12 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:06.571826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1435c9ec-a415-4d21-8359-1b6684d36f12 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:06.573540 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4123/8191] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:37:06 2022] DELETE /identity/v3/projects/f1295acbe7f94b7aa9cb6b217d0d93a8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:06.579524 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011de16-38f0-48f9-91ac-51648277d684 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:06.582361 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7011de16-38f0-48f9-91ac-51648277d684 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:06.630488 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:06.653905 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011de16-38f0-48f9-91ac-51648277d684 tempest-IdentityV3ProjectTagsTest-214061112 tempest-IdentityV3ProjectTagsTest-214061112-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:06.724430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db03e6-a714-4455-95af-2663ca6461ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:06.725123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db03e6-a714-4455-95af-2663ca6461ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:06.725343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db03e6-a714-4455-95af-2663ca6461ca admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:06.725617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db03e6-a714-4455-95af-2663ca6461ca admin admin] PATH_INFO: `/v3/users/4f541b4a6edc4f1ba4c8bdc20affd75d` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:06.726956 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db03e6-a714-4455-95af-2663ca6461ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f541b4a6edc4f1ba4c8bdc20affd75d)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:06.728999 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db03e6-a714-4455-95af-2663ca6461ca admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:06.780866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a7db03e6-a714-4455-95af-2663ca6461ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f541b4a6edc4f1ba4c8bdc20affd75d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:06.781633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a7db03e6-a714-4455-95af-2663ca6461ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f541b4a6edc4f1ba4c8bdc20affd75d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:06.782314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a7db03e6-a714-4455-95af-2663ca6461ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f541b4a6edc4f1ba4c8bdc20affd75d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:06.790263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a7db03e6-a714-4455-95af-2663ca6461ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f541b4a6edc4f1ba4c8bdc20affd75d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:06.803811 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a7db03e6-a714-4455-95af-2663ca6461ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f541b4a6edc4f1ba4c8bdc20affd75d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:06.820715 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4069/8192] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:37:06 2022] DELETE /identity/v3/users/4f541b4a6edc4f1ba4c8bdc20affd75d => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:06.823107 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08560f06-fc99-4e6e-9183-6e415df7ab02 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:06.823592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08560f06-fc99-4e6e-9183-6e415df7ab02 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:06.823974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08560f06-fc99-4e6e-9183-6e415df7ab02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:06.844213 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-08560f06-fc99-4e6e-9183-6e415df7ab02 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:06.845428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-08560f06-fc99-4e6e-9183-6e415df7ab02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:06.907914 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4124/8193] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:06.917538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db03e6-a714-4455-95af-2663ca6461ca admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:06.920034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a7db03e6-a714-4455-95af-2663ca6461ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:06.987984 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db03e6-a714-4455-95af-2663ca6461ca admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:06.992110 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35684ca-9c79-4fe3-94dc-43982565804d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:06.992722 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35684ca-9c79-4fe3-94dc-43982565804d service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:06.993008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35684ca-9c79-4fe3-94dc-43982565804d service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:06.993287 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35684ca-9c79-4fe3-94dc-43982565804d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:07.002998 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35684ca-9c79-4fe3-94dc-43982565804d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:07.004553 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35684ca-9c79-4fe3-94dc-43982565804d service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:07.015025 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4070/8194] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:37:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:37:07.419360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08560f06-fc99-4e6e-9183-6e415df7ab02 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:07.420859 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-08560f06-fc99-4e6e-9183-6e415df7ab02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:07.432879 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08560f06-fc99-4e6e-9183-6e415df7ab02 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:07.438938 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6531f-5490-4b0c-8e2e-3195d7d39e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:07.439566 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6531f-5490-4b0c-8e2e-3195d7d39e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:07.439843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6531f-5490-4b0c-8e2e-3195d7d39e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:07.440115 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6531f-5490-4b0c-8e2e-3195d7d39e46 admin admin] PATH_INFO: `/v3/projects/6eb580db19c94d38be337fb6ddce82ea` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:07.441250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6531f-5490-4b0c-8e2e-3195d7d39e46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eb580db19c94d38be337fb6ddce82ea)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:07.443167 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6531f-5490-4b0c-8e2e-3195d7d39e46 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:07.499229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ceb6531f-5490-4b0c-8e2e-3195d7d39e46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eb580db19c94d38be337fb6ddce82ea', 'request_id': 'req-ceb6531f-5490-4b0c-8e2e-3195d7d39e46'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:07.505120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ceb6531f-5490-4b0c-8e2e-3195d7d39e46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eb580db19c94d38be337fb6ddce82ea', 'request_id': 'req-ceb6531f-5490-4b0c-8e2e-3195d7d39e46'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:07.513580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ceb6531f-5490-4b0c-8e2e-3195d7d39e46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eb580db19c94d38be337fb6ddce82ea', 'request_id': 'req-ceb6531f-5490-4b0c-8e2e-3195d7d39e46'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:07.525220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ceb6531f-5490-4b0c-8e2e-3195d7d39e46 admin admin] The token cache is being invalidate because project 6eb580db19c94d38be337fb6ddce82ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:07.525511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ceb6531f-5490-4b0c-8e2e-3195d7d39e46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:07.526297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-ceb6531f-5490-4b0c-8e2e-3195d7d39e46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:07.531674 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4125/8195] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:37:07 2022] DELETE /identity/v3/projects/6eb580db19c94d38be337fb6ddce82ea => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:07.532795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35684ca-9c79-4fe3-94dc-43982565804d service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:07.560914 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35684ca-9c79-4fe3-94dc-43982565804d service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:07.571300 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:07.635325 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be084053-d6eb-4b6f-90cb-d9b4a4945f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:07.635963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be084053-d6eb-4b6f-90cb-d9b4a4945f34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:07.636242 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be084053-d6eb-4b6f-90cb-d9b4a4945f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:07.636514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be084053-d6eb-4b6f-90cb-d9b4a4945f34 admin admin] PATH_INFO: `/v3/users/4a16a8531e77491abd6a57c55469d2e7` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:07.639038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be084053-d6eb-4b6f-90cb-d9b4a4945f34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a16a8531e77491abd6a57c55469d2e7)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:07.641016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be084053-d6eb-4b6f-90cb-d9b4a4945f34 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:07.705445 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-be084053-d6eb-4b6f-90cb-d9b4a4945f34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a16a8531e77491abd6a57c55469d2e7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:07.706120 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-be084053-d6eb-4b6f-90cb-d9b4a4945f34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a16a8531e77491abd6a57c55469d2e7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:07.706768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-be084053-d6eb-4b6f-90cb-d9b4a4945f34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a16a8531e77491abd6a57c55469d2e7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:07.714132 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-be084053-d6eb-4b6f-90cb-d9b4a4945f34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a16a8531e77491abd6a57c55469d2e7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:07.727827 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-be084053-d6eb-4b6f-90cb-d9b4a4945f34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a16a8531e77491abd6a57c55469d2e7'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:07.742011 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4071/8196] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:37:07 2022] DELETE /identity/v3/users/4a16a8531e77491abd6a57c55469d2e7 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:08.035613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6531f-5490-4b0c-8e2e-3195d7d39e46 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:08.037262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ceb6531f-5490-4b0c-8e2e-3195d7d39e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:08.055363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6531f-5490-4b0c-8e2e-3195d7d39e46 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:08.061434 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:08.120357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07df1fb-9973-48ce-aa59-574e167a5f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:08.121433 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07df1fb-9973-48ce-aa59-574e167a5f9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:08.122371 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07df1fb-9973-48ce-aa59-574e167a5f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:08.122678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07df1fb-9973-48ce-aa59-574e167a5f9b admin admin] PATH_INFO: `/v3/projects/6ffb0467fee446bea4fc9af6ba6797c7` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:08.123816 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07df1fb-9973-48ce-aa59-574e167a5f9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ffb0467fee446bea4fc9af6ba6797c7)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:08.125750 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07df1fb-9973-48ce-aa59-574e167a5f9b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:08.174258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c07df1fb-9973-48ce-aa59-574e167a5f9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ffb0467fee446bea4fc9af6ba6797c7', 'request_id': 'req-c07df1fb-9973-48ce-aa59-574e167a5f9b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:08.180591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c07df1fb-9973-48ce-aa59-574e167a5f9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ffb0467fee446bea4fc9af6ba6797c7', 'request_id': 'req-c07df1fb-9973-48ce-aa59-574e167a5f9b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:08.188874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c07df1fb-9973-48ce-aa59-574e167a5f9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ffb0467fee446bea4fc9af6ba6797c7', 'request_id': 'req-c07df1fb-9973-48ce-aa59-574e167a5f9b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:08.202234 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c07df1fb-9973-48ce-aa59-574e167a5f9b admin admin] The token cache is being invalidate because project 6ffb0467fee446bea4fc9af6ba6797c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:08.202598 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c07df1fb-9973-48ce-aa59-574e167a5f9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:08.203090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c07df1fb-9973-48ce-aa59-574e167a5f9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:08.204618 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4126/8197] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:37:08 2022] DELETE /identity/v3/projects/6ffb0467fee446bea4fc9af6ba6797c7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:08.209693 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f6018-e996-4090-a22e-3051a5f58e74 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:08.209986 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f6018-e996-4090-a22e-3051a5f58e74 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:08.210256 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f6018-e996-4090-a22e-3051a5f58e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:08.232748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-846f6018-e996-4090-a22e-3051a5f58e74 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:08.234138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-846f6018-e996-4090-a22e-3051a5f58e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:08.306581 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4072/8198] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:08.315072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3119aa8-125d-498d-809e-8eade5203b38 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:08.315366 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3119aa8-125d-498d-809e-8eade5203b38 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:08.315645 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3119aa8-125d-498d-809e-8eade5203b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:08.339024 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d3119aa8-125d-498d-809e-8eade5203b38 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:08.340311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d3119aa8-125d-498d-809e-8eade5203b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:08.348453 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4127/8199] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:08.352865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f6018-e996-4090-a22e-3051a5f58e74 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:08.363459 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f6018-e996-4090-a22e-3051a5f58e74 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:08.368316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f6092-5dbb-44ef-bf53-b3afa8b9ae90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:08.368995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f6092-5dbb-44ef-bf53-b3afa8b9ae90 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:08.369350 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f6092-5dbb-44ef-bf53-b3afa8b9ae90 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:08.369630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f6092-5dbb-44ef-bf53-b3afa8b9ae90 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:08.370280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f6092-5dbb-44ef-bf53-b3afa8b9ae90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:37:08.370623 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f6092-5dbb-44ef-bf53-b3afa8b9ae90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:08.372456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f6092-5dbb-44ef-bf53-b3afa8b9ae90 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:08.384519 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4073/8200] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:37:08.389782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3119aa8-125d-498d-809e-8eade5203b38 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:08.402900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3119aa8-125d-498d-809e-8eade5203b38 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:08.409337 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69934ce-1cb7-46bb-94f0-b21a1c1c4306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:08.409946 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69934ce-1cb7-46bb-94f0-b21a1c1c4306 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:08.410224 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69934ce-1cb7-46bb-94f0-b21a1c1c4306 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:08.410496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69934ce-1cb7-46bb-94f0-b21a1c1c4306 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:08.411141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69934ce-1cb7-46bb-94f0-b21a1c1c4306 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:08.413013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69934ce-1cb7-46bb-94f0-b21a1c1c4306 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:08.441324 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4128/8201] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:37:08 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:08.445519 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f6092-5dbb-44ef-bf53-b3afa8b9ae90 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:08.456444 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f6092-5dbb-44ef-bf53-b3afa8b9ae90 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:08.472017 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:08.524630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a835397-2d42-45db-a052-611582fcc6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:08.525239 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a835397-2d42-45db-a052-611582fcc6c9 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:08.525518 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a835397-2d42-45db-a052-611582fcc6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:08.525789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a835397-2d42-45db-a052-611582fcc6c9 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:08.526423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a835397-2d42-45db-a052-611582fcc6c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:08.528967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a835397-2d42-45db-a052-611582fcc6c9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:08.553835 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4074/8202] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:37:08 2022] POST /identity/v3/users => generated 283 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:08.555054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69934ce-1cb7-46bb-94f0-b21a1c1c4306 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:08.566001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69934ce-1cb7-46bb-94f0-b21a1c1c4306 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:08.570959 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a91ba-5ca2-421d-8c84-a4b23416920b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:08.571567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a91ba-5ca2-421d-8c84-a4b23416920b admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:08.571842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a91ba-5ca2-421d-8c84-a4b23416920b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:08.572113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a91ba-5ca2-421d-8c84-a4b23416920b admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:08.572749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a91ba-5ca2-421d-8c84-a4b23416920b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:08.574335 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a91ba-5ca2-421d-8c84-a4b23416920b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:08.588545 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4129/8203] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:37:08.589985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a835397-2d42-45db-a052-611582fcc6c9 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:08.601218 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a835397-2d42-45db-a052-611582fcc6c9 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:08.606429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c754bd2-cbd4-4d48-8f52-7268e01e34ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:08.607700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c754bd2-cbd4-4d48-8f52-7268e01e34ae admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:08.607987 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c754bd2-cbd4-4d48-8f52-7268e01e34ae admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:08.608268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c754bd2-cbd4-4d48-8f52-7268e01e34ae admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:08.608896 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c754bd2-cbd4-4d48-8f52-7268e01e34ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:08.610498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c754bd2-cbd4-4d48-8f52-7268e01e34ae admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:08.625244 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4075/8204] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:37:08.626457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a91ba-5ca2-421d-8c84-a4b23416920b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:08.636707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a91ba-5ca2-421d-8c84-a4b23416920b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:08.645824 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b1428-1c66-41c4-9d61-a45a2e472500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:08.646511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b1428-1c66-41c4-9d61-a45a2e472500 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:08.646833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b1428-1c66-41c4-9d61-a45a2e472500 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:08.647118 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b1428-1c66-41c4-9d61-a45a2e472500 admin admin] PATH_INFO: `/v3/projects/a0e851824b864fe4a5ecba7b36b605c0/users/f36ab1e21cfc48728feb6bd462da7f4d/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:08.663686 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b1428-1c66-41c4-9d61-a45a2e472500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0e851824b864fe4a5ecba7b36b605c0, user_id=f36ab1e21cfc48728feb6bd462da7f4d, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:08.667431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b1428-1c66-41c4-9d61-a45a2e472500 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:08.687532 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4130/8205] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:37:08 2022] PUT /identity/v3/projects/a0e851824b864fe4a5ecba7b36b605c0/users/f36ab1e21cfc48728feb6bd462da7f4d/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:08.698722 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb2785-3292-4017-add7-96a8ca45645c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:08.699014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb2785-3292-4017-add7-96a8ca45645c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:08.699287 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb2785-3292-4017-add7-96a8ca45645c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:08.728785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-6efb2785-3292-4017-add7-96a8ca45645c None None] MFA Rules not processed for user `f36ab1e21cfc48728feb6bd462da7f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:08.730014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6efb2785-3292-4017-add7-96a8ca45645c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:08.799554 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4076/8206] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:08.804529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b1428-1c66-41c4-9d61-a45a2e472500 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:08.851144 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:08.883064 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b1428-1c66-41c4-9d61-a45a2e472500 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:08.889363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b78fba-75e1-4503-8e64-ad0fb6ed00bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:08.890101 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b78fba-75e1-4503-8e64-ad0fb6ed00bb admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:08.890490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b78fba-75e1-4503-8e64-ad0fb6ed00bb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:08.890881 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b78fba-75e1-4503-8e64-ad0fb6ed00bb admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:08.891613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b78fba-75e1-4503-8e64-ad0fb6ed00bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:08.893822 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b78fba-75e1-4503-8e64-ad0fb6ed00bb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:08.929556 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4131/8207] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:37:08 2022] POST /identity/v3/projects => generated 367 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:08.933609 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb2785-3292-4017-add7-96a8ca45645c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:08.948163 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb2785-3292-4017-add7-96a8ca45645c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:09.014282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56ab2d-6760-462b-8864-8fa0f3d11591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:09.015007 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56ab2d-6760-462b-8864-8fa0f3d11591 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:09.015286 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56ab2d-6760-462b-8864-8fa0f3d11591 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:09.015579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56ab2d-6760-462b-8864-8fa0f3d11591 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:09.016234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56ab2d-6760-462b-8864-8fa0f3d11591 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:09.018152 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56ab2d-6760-462b-8864-8fa0f3d11591 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:09.041362 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4077/8208] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:37:08 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:09.046153 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b78fba-75e1-4503-8e64-ad0fb6ed00bb admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:09.057476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b78fba-75e1-4503-8e64-ad0fb6ed00bb admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:09.065823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84780afa-1f78-406e-9c27-5a9137c74208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:09.066486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84780afa-1f78-406e-9c27-5a9137c74208 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:09.066803 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84780afa-1f78-406e-9c27-5a9137c74208 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:09.067083 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84780afa-1f78-406e-9c27-5a9137c74208 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:09.067734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84780afa-1f78-406e-9c27-5a9137c74208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:09.069692 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84780afa-1f78-406e-9c27-5a9137c74208 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:09.082295 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4132/8209] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:37:09.086798 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56ab2d-6760-462b-8864-8fa0f3d11591 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:09.098077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56ab2d-6760-462b-8864-8fa0f3d11591 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:09.102933 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831d4dc-b97e-45f3-abc7-410f70da0ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:09.103609 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831d4dc-b97e-45f3-abc7-410f70da0ec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:09.103875 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831d4dc-b97e-45f3-abc7-410f70da0ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:09.104148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831d4dc-b97e-45f3-abc7-410f70da0ec0 admin admin] PATH_INFO: `/v3/projects/45427a5587ca4449b7f1b94524b32348/users/a788d4c1c651449db36d77e8e39d8f40/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:09.118645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:09.122586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831d4dc-b97e-45f3-abc7-410f70da0ec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45427a5587ca4449b7f1b94524b32348, user_id=a788d4c1c651449db36d77e8e39d8f40, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:09.125279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831d4dc-b97e-45f3-abc7-410f70da0ec0 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:09.144360 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4078/8210] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:37:09 2022] PUT /identity/v3/projects/45427a5587ca4449b7f1b94524b32348/users/a788d4c1c651449db36d77e8e39d8f40/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:09.148281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84780afa-1f78-406e-9c27-5a9137c74208 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:09.162671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84780afa-1f78-406e-9c27-5a9137c74208 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:09.229281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfa823-4afc-46e8-a551-fa23d49475d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:09.229888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfa823-4afc-46e8-a551-fa23d49475d0 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:09.230167 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfa823-4afc-46e8-a551-fa23d49475d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:09.230440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfa823-4afc-46e8-a551-fa23d49475d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:09.231125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfa823-4afc-46e8-a551-fa23d49475d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:09.232814 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfa823-4afc-46e8-a551-fa23d49475d0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:09.242630 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4133/8211] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:37:09.247346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831d4dc-b97e-45f3-abc7-410f70da0ec0 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:09.258499 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831d4dc-b97e-45f3-abc7-410f70da0ec0 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:09.263837 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e378e-9f49-4b16-92c2-f0c624d54d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:09.264574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e378e-9f49-4b16-92c2-f0c624d54d91 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:09.264927 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e378e-9f49-4b16-92c2-f0c624d54d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:09.265200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e378e-9f49-4b16-92c2-f0c624d54d91 admin admin] PATH_INFO: `/v3/projects/45427a5587ca4449b7f1b94524b32348/users/a788d4c1c651449db36d77e8e39d8f40/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:09.267182 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e378e-9f49-4b16-92c2-f0c624d54d91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45427a5587ca4449b7f1b94524b32348, user_id=a788d4c1c651449db36d77e8e39d8f40, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:09.269854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e378e-9f49-4b16-92c2-f0c624d54d91 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:09.281146 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4079/8212] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:37:09 2022] PUT /identity/v3/projects/45427a5587ca4449b7f1b94524b32348/users/a788d4c1c651449db36d77e8e39d8f40/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:09.291446 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c7c86-bfaf-4334-86e4-0d974fb8236c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:09.291740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c7c86-bfaf-4334-86e4-0d974fb8236c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:09.292005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c7c86-bfaf-4334-86e4-0d974fb8236c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:09.321261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-3b5c7c86-bfaf-4334-86e4-0d974fb8236c None None] MFA Rules not processed for user `a788d4c1c651449db36d77e8e39d8f40`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:09.322526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3b5c7c86-bfaf-4334-86e4-0d974fb8236c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:09.397257 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4134/8213] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:09 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:09.402337 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e378e-9f49-4b16-92c2-f0c624d54d91 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:09.414116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e378e-9f49-4b16-92c2-f0c624d54d91 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:09.419497 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4f13d-9178-4269-a5be-0c2e4b52b4ab tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a788d4c1c651449db36d77e8e39d8f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45427a5587ca4449b7f1b94524b32348', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:09.420103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4f13d-9178-4269-a5be-0c2e4b52b4ab tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:09.420379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4f13d-9178-4269-a5be-0c2e4b52b4ab tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:09.420651 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4f13d-9178-4269-a5be-0c2e4b52b4ab tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:09.421278 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc4f13d-9178-4269-a5be-0c2e4b52b4ab tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:09.423236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc4f13d-9178-4269-a5be-0c2e4b52b4ab tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:09.460642 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4080/8214] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:37:09 2022] POST /identity/v3/projects => generated 359 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:37:09.461857 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c7c86-bfaf-4334-86e4-0d974fb8236c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:09.471769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c7c86-bfaf-4334-86e4-0d974fb8236c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:09.501042 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:09.531275 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114675fc-c44a-4358-a7f0-9cb2f7d77a02 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a788d4c1c651449db36d77e8e39d8f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45427a5587ca4449b7f1b94524b32348', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:09.531893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114675fc-c44a-4358-a7f0-9cb2f7d77a02 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:09.532179 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114675fc-c44a-4358-a7f0-9cb2f7d77a02 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:09.532458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114675fc-c44a-4358-a7f0-9cb2f7d77a02 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:09.533084 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114675fc-c44a-4358-a7f0-9cb2f7d77a02 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:09.534981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114675fc-c44a-4358-a7f0-9cb2f7d77a02 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:09.561056 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4135/8215] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:37:09 2022] POST /identity/v3/users => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:09.565350 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4f13d-9178-4269-a5be-0c2e4b52b4ab tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:09.577476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4f13d-9178-4269-a5be-0c2e4b52b4ab tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:09.582385 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004c7a2-8657-45cc-899e-5e575dfc3418 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a788d4c1c651449db36d77e8e39d8f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45427a5587ca4449b7f1b94524b32348', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:09.583072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004c7a2-8657-45cc-899e-5e575dfc3418 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:09.583356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004c7a2-8657-45cc-899e-5e575dfc3418 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:09.583636 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004c7a2-8657-45cc-899e-5e575dfc3418 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] PATH_INFO: `/v3/users/0ed3c4339a6a4d20aefc53842bf96cba` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:09.598439 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6004c7a2-8657-45cc-899e-5e575dfc3418 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorizing `identity:get_user(user_id=0ed3c4339a6a4d20aefc53842bf96cba)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:09.600778 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6004c7a2-8657-45cc-899e-5e575dfc3418 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:09.602463 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4081/8216] 10.222.0.33 () {58 vars in 1221 bytes} [Sat Aug 6 21:37:09 2022] GET /identity/v3/users/0ed3c4339a6a4d20aefc53842bf96cba => generated 373 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:37:09.607377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114675fc-c44a-4358-a7f0-9cb2f7d77a02 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:09.619472 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114675fc-c44a-4358-a7f0-9cb2f7d77a02 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:09.626798 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e07485-957d-413f-b25f-298715ca3982 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a788d4c1c651449db36d77e8e39d8f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45427a5587ca4449b7f1b94524b32348', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:09.627483 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e07485-957d-413f-b25f-298715ca3982 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:09.627765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e07485-957d-413f-b25f-298715ca3982 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:09.628037 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e07485-957d-413f-b25f-298715ca3982 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] PATH_INFO: `/v3/users/0ed3c4339a6a4d20aefc53842bf96cba` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:09.629310 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e07485-957d-413f-b25f-298715ca3982 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0ed3c4339a6a4d20aefc53842bf96cba)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:09.631522 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e07485-957d-413f-b25f-298715ca3982 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:09.690429 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-51e07485-957d-413f-b25f-298715ca3982 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ed3c4339a6a4d20aefc53842bf96cba'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:09.697675 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-51e07485-957d-413f-b25f-298715ca3982 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ed3c4339a6a4d20aefc53842bf96cba'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:09.698527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-51e07485-957d-413f-b25f-298715ca3982 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ed3c4339a6a4d20aefc53842bf96cba'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:09.699254 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-51e07485-957d-413f-b25f-298715ca3982 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ed3c4339a6a4d20aefc53842bf96cba'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:09.708409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-51e07485-957d-413f-b25f-298715ca3982 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ed3c4339a6a4d20aefc53842bf96cba'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:09.728964 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4136/8217] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:37:09 2022] DELETE /identity/v3/users/0ed3c4339a6a4d20aefc53842bf96cba => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:09.732951 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004c7a2-8657-45cc-899e-5e575dfc3418 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:09.735850 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6004c7a2-8657-45cc-899e-5e575dfc3418 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:09.758113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004c7a2-8657-45cc-899e-5e575dfc3418 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:09.821229 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c67f9-719e-4234-988e-200d2b36f7c5 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a788d4c1c651449db36d77e8e39d8f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45427a5587ca4449b7f1b94524b32348', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:09.821875 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c67f9-719e-4234-988e-200d2b36f7c5 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:09.822156 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c67f9-719e-4234-988e-200d2b36f7c5 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:09.822430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c67f9-719e-4234-988e-200d2b36f7c5 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] PATH_INFO: `/v3/projects/4d8aee0b095c430da0ae2f175c0374c1` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:09.823628 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c67f9-719e-4234-988e-200d2b36f7c5 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4d8aee0b095c430da0ae2f175c0374c1)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:09.826358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c67f9-719e-4234-988e-200d2b36f7c5 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:09.876493 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7e7c67f9-719e-4234-988e-200d2b36f7c5 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d8aee0b095c430da0ae2f175c0374c1', 'request_id': 'req-7e7c67f9-719e-4234-988e-200d2b36f7c5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:09.883261 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7e7c67f9-719e-4234-988e-200d2b36f7c5 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d8aee0b095c430da0ae2f175c0374c1', 'request_id': 'req-7e7c67f9-719e-4234-988e-200d2b36f7c5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:09.890279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7e7c67f9-719e-4234-988e-200d2b36f7c5 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d8aee0b095c430da0ae2f175c0374c1', 'request_id': 'req-7e7c67f9-719e-4234-988e-200d2b36f7c5'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:09.903737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7e7c67f9-719e-4234-988e-200d2b36f7c5 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] The token cache is being invalidate because project 4d8aee0b095c430da0ae2f175c0374c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:09.904035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7e7c67f9-719e-4234-988e-200d2b36f7c5 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:09.904783 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7e7c67f9-719e-4234-988e-200d2b36f7c5 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:09.906356 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4082/8218] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:37:09 2022] DELETE /identity/v3/projects/4d8aee0b095c430da0ae2f175c0374c1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:09.912075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e07485-957d-413f-b25f-298715ca3982 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:09.922487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e07485-957d-413f-b25f-298715ca3982 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:09.986115 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da444bb3-e827-4ab1-a8b2-f50dca82ae95 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a788d4c1c651449db36d77e8e39d8f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45427a5587ca4449b7f1b94524b32348', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:09.986773 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da444bb3-e827-4ab1-a8b2-f50dca82ae95 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:09.987064 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da444bb3-e827-4ab1-a8b2-f50dca82ae95 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:09.987342 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da444bb3-e827-4ab1-a8b2-f50dca82ae95 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:09.987964 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da444bb3-e827-4ab1-a8b2-f50dca82ae95 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:09.989815 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da444bb3-e827-4ab1-a8b2-f50dca82ae95 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:10.026481 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4137/8219] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:37:09 2022] POST /identity/v3/projects => generated 358 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:37:10.027627 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c67f9-719e-4234-988e-200d2b36f7c5 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:10.029118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7e7c67f9-719e-4234-988e-200d2b36f7c5 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:10.042493 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c67f9-719e-4234-988e-200d2b36f7c5 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:10.073392 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:10.105481 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45a27b-e45d-4bb1-af17-3eef4452dfb8 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a788d4c1c651449db36d77e8e39d8f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45427a5587ca4449b7f1b94524b32348', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:10.106972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45a27b-e45d-4bb1-af17-3eef4452dfb8 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:10.107289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45a27b-e45d-4bb1-af17-3eef4452dfb8 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:10.107568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45a27b-e45d-4bb1-af17-3eef4452dfb8 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:10.108259 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45a27b-e45d-4bb1-af17-3eef4452dfb8 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:10.110162 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45a27b-e45d-4bb1-af17-3eef4452dfb8 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:10.138520 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4083/8220] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:37:10 2022] POST /identity/v3/users => generated 417 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:37:10.144160 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da444bb3-e827-4ab1-a8b2-f50dca82ae95 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:10.159218 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da444bb3-e827-4ab1-a8b2-f50dca82ae95 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:10.164589 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997c13d-ffb6-40ff-b270-bc3857f9d7c0 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a788d4c1c651449db36d77e8e39d8f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45427a5587ca4449b7f1b94524b32348', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:10.165200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997c13d-ffb6-40ff-b270-bc3857f9d7c0 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:10.165506 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997c13d-ffb6-40ff-b270-bc3857f9d7c0 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:10.165779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997c13d-ffb6-40ff-b270-bc3857f9d7c0 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:10.166435 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997c13d-ffb6-40ff-b270-bc3857f9d7c0 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:10.168249 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997c13d-ffb6-40ff-b270-bc3857f9d7c0 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:10.184204 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4138/8221] 10.222.0.33 () {60 vars in 1143 bytes} [Sat Aug 6 21:37:10 2022] POST /identity/v3/roles => generated 240 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:10.188909 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45a27b-e45d-4bb1-af17-3eef4452dfb8 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:10.199383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45a27b-e45d-4bb1-af17-3eef4452dfb8 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:10.204331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72d78e-0e94-4c69-9c58-253c43221efc tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a788d4c1c651449db36d77e8e39d8f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45427a5587ca4449b7f1b94524b32348', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:10.204999 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72d78e-0e94-4c69-9c58-253c43221efc tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:10.205286 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72d78e-0e94-4c69-9c58-253c43221efc tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:10.205564 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72d78e-0e94-4c69-9c58-253c43221efc tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] PATH_INFO: `/v3/users/913e71e6562e41c69f86c91270aeef04` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:10.221003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a72d78e-0e94-4c69-9c58-253c43221efc tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorizing `identity:get_user(user_id=913e71e6562e41c69f86c91270aeef04)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:10.223328 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a72d78e-0e94-4c69-9c58-253c43221efc tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:10.227810 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4084/8222] 10.222.0.33 () {58 vars in 1221 bytes} [Sat Aug 6 21:37:10 2022] GET /identity/v3/users/913e71e6562e41c69f86c91270aeef04 => generated 417 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:37:10.228963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997c13d-ffb6-40ff-b270-bc3857f9d7c0 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:10.236586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:10.240980 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997c13d-ffb6-40ff-b270-bc3857f9d7c0 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:10.247923 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655641a-2e1c-477b-a1bd-b35569d89902 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a788d4c1c651449db36d77e8e39d8f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45427a5587ca4449b7f1b94524b32348', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:10.248813 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655641a-2e1c-477b-a1bd-b35569d89902 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:10.249556 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655641a-2e1c-477b-a1bd-b35569d89902 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:10.249939 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655641a-2e1c-477b-a1bd-b35569d89902 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] PATH_INFO: `/v3/roles/ad0abab3e16e4502917ca3e57f3f9d49` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:10.252003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655641a-2e1c-477b-a1bd-b35569d89902 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorizing `identity:get_role(role_id=ad0abab3e16e4502917ca3e57f3f9d49)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:10.254146 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655641a-2e1c-477b-a1bd-b35569d89902 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:10.258493 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4139/8223] 10.222.0.33 () {58 vars in 1221 bytes} [Sat Aug 6 21:37:10 2022] GET /identity/v3/roles/ad0abab3e16e4502917ca3e57f3f9d49 => generated 240 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:37:10.259629 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72d78e-0e94-4c69-9c58-253c43221efc tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:10.272012 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72d78e-0e94-4c69-9c58-253c43221efc tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:10.276893 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6526d-5067-410e-bfd5-c951fd69a95c tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a788d4c1c651449db36d77e8e39d8f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45427a5587ca4449b7f1b94524b32348', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:10.277494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6526d-5067-410e-bfd5-c951fd69a95c tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:10.277779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6526d-5067-410e-bfd5-c951fd69a95c tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:10.278063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6526d-5067-410e-bfd5-c951fd69a95c tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:10.278822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6526d-5067-410e-bfd5-c951fd69a95c tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:10.280753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6526d-5067-410e-bfd5-c951fd69a95c tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:10.313033 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4085/8224] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:37:10 2022] POST /identity/v3/projects => generated 360 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:10.317065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655641a-2e1c-477b-a1bd-b35569d89902 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:10.327635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655641a-2e1c-477b-a1bd-b35569d89902 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:10.389584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc29d3f-fd98-49ef-805e-1189ea34ad02 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a788d4c1c651449db36d77e8e39d8f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45427a5587ca4449b7f1b94524b32348', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:10.390380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc29d3f-fd98-49ef-805e-1189ea34ad02 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:10.390757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc29d3f-fd98-49ef-805e-1189ea34ad02 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:10.391193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc29d3f-fd98-49ef-805e-1189ea34ad02 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] PATH_INFO: `/v3/projects/37182a35743a4d84980a4d7c924d1ecc` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:10.392950 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc29d3f-fd98-49ef-805e-1189ea34ad02 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorizing `identity:get_project(project_id=37182a35743a4d84980a4d7c924d1ecc)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:10.396714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc29d3f-fd98-49ef-805e-1189ea34ad02 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:10.399035 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4140/8225] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:37:10 2022] GET /identity/v3/projects/37182a35743a4d84980a4d7c924d1ecc => generated 360 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:37:10.403270 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6526d-5067-410e-bfd5-c951fd69a95c tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:10.416333 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6526d-5067-410e-bfd5-c951fd69a95c tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:10.423368 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb61ec4-a620-45a1-ac06-dadf1b317732 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a788d4c1c651449db36d77e8e39d8f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45427a5587ca4449b7f1b94524b32348', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:10.424122 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb61ec4-a620-45a1-ac06-dadf1b317732 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:10.424430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb61ec4-a620-45a1-ac06-dadf1b317732 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:10.424854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb61ec4-a620-45a1-ac06-dadf1b317732 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] PATH_INFO: `/v3/projects/37182a35743a4d84980a4d7c924d1ecc/users/913e71e6562e41c69f86c91270aeef04/roles/ad0abab3e16e4502917ca3e57f3f9d49` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:10.427629 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb61ec4-a620-45a1-ac06-dadf1b317732 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorizing `identity:create_grant(project_id=37182a35743a4d84980a4d7c924d1ecc, user_id=913e71e6562e41c69f86c91270aeef04, role_id=ad0abab3e16e4502917ca3e57f3f9d49)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:10.441026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb61ec4-a620-45a1-ac06-dadf1b317732 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:10.458386 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4086/8226] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:37:10 2022] PUT /identity/v3/projects/37182a35743a4d84980a4d7c924d1ecc/users/913e71e6562e41c69f86c91270aeef04/roles/ad0abab3e16e4502917ca3e57f3f9d49 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:10.462732 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc29d3f-fd98-49ef-805e-1189ea34ad02 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:10.473760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc29d3f-fd98-49ef-805e-1189ea34ad02 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:10.540035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683476f2-796a-4850-8cd3-03de29830157 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a788d4c1c651449db36d77e8e39d8f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45427a5587ca4449b7f1b94524b32348', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:10.540664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683476f2-796a-4850-8cd3-03de29830157 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:10.540977 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683476f2-796a-4850-8cd3-03de29830157 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:10.541258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683476f2-796a-4850-8cd3-03de29830157 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:10.541898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683476f2-796a-4850-8cd3-03de29830157 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:10.544383 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683476f2-796a-4850-8cd3-03de29830157 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:10.586488 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4141/8227] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:37:10 2022] POST /identity/v3/projects => generated 358 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:10.588009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb61ec4-a620-45a1-ac06-dadf1b317732 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:10.604366 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb61ec4-a620-45a1-ac06-dadf1b317732 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:10.665342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd11f90-cf59-47db-bc20-b02a1cf3987a tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a788d4c1c651449db36d77e8e39d8f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45427a5587ca4449b7f1b94524b32348', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:10.665901 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd11f90-cf59-47db-bc20-b02a1cf3987a tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:10.666189 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd11f90-cf59-47db-bc20-b02a1cf3987a tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:10.666480 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd11f90-cf59-47db-bc20-b02a1cf3987a tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] PATH_INFO: `/v3/projects/f231f1feaeec48e7b946645f045cf5aa` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:10.667663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd11f90-cf59-47db-bc20-b02a1cf3987a tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorizing `identity:get_project(project_id=f231f1feaeec48e7b946645f045cf5aa)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:10.670454 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd11f90-cf59-47db-bc20-b02a1cf3987a tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:10.672350 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4087/8228] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:37:10 2022] GET /identity/v3/projects/f231f1feaeec48e7b946645f045cf5aa => generated 358 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:37:10.676628 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683476f2-796a-4850-8cd3-03de29830157 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:10.688611 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683476f2-796a-4850-8cd3-03de29830157 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:10.694243 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a5bd2-8bbe-45b8-a2ec-7115f3e50654 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a788d4c1c651449db36d77e8e39d8f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45427a5587ca4449b7f1b94524b32348', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:10.694582 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a5bd2-8bbe-45b8-a2ec-7115f3e50654 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:10.694944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a5bd2-8bbe-45b8-a2ec-7115f3e50654 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:10.695290 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a5bd2-8bbe-45b8-a2ec-7115f3e50654 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] PATH_INFO: `/v3/projects/f231f1feaeec48e7b946645f045cf5aa/users/913e71e6562e41c69f86c91270aeef04/roles/ad0abab3e16e4502917ca3e57f3f9d49` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:10.697626 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a5bd2-8bbe-45b8-a2ec-7115f3e50654 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f231f1feaeec48e7b946645f045cf5aa, user_id=913e71e6562e41c69f86c91270aeef04, role_id=ad0abab3e16e4502917ca3e57f3f9d49)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:10.700692 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a5bd2-8bbe-45b8-a2ec-7115f3e50654 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:10.714006 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4142/8229] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:37:10 2022] PUT /identity/v3/projects/f231f1feaeec48e7b946645f045cf5aa/users/913e71e6562e41c69f86c91270aeef04/roles/ad0abab3e16e4502917ca3e57f3f9d49 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:10.718962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd11f90-cf59-47db-bc20-b02a1cf3987a tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:10.729116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd11f90-cf59-47db-bc20-b02a1cf3987a tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:10.787677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c96cf9-5eab-4d82-a1aa-c800d23c77f8 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a788d4c1c651449db36d77e8e39d8f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45427a5587ca4449b7f1b94524b32348', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:10.788323 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c96cf9-5eab-4d82-a1aa-c800d23c77f8 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:10.788536 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c96cf9-5eab-4d82-a1aa-c800d23c77f8 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:10.788812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c96cf9-5eab-4d82-a1aa-c800d23c77f8 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] PATH_INFO: `/v3/users/913e71e6562e41c69f86c91270aeef04/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:10.790027 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c96cf9-5eab-4d82-a1aa-c800d23c77f8 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=913e71e6562e41c69f86c91270aeef04)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:10.792226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c96cf9-5eab-4d82-a1aa-c800d23c77f8 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:10.811318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:10.836992 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4088/8230] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Aug 6 21:37:10 2022] GET /identity/v3/users/913e71e6562e41c69f86c91270aeef04/projects => generated 842 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:37:10.838184 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a5bd2-8bbe-45b8-a2ec-7115f3e50654 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:10.849500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a5bd2-8bbe-45b8-a2ec-7115f3e50654 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:10.854347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508ca43-1ba7-4d0b-9bf6-9ef82fbdf6bc tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a788d4c1c651449db36d77e8e39d8f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45427a5587ca4449b7f1b94524b32348', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:10.854991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508ca43-1ba7-4d0b-9bf6-9ef82fbdf6bc tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:10.855272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508ca43-1ba7-4d0b-9bf6-9ef82fbdf6bc tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:10.855553 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508ca43-1ba7-4d0b-9bf6-9ef82fbdf6bc tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] PATH_INFO: `/v3/projects/f231f1feaeec48e7b946645f045cf5aa` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:10.857333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508ca43-1ba7-4d0b-9bf6-9ef82fbdf6bc tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f231f1feaeec48e7b946645f045cf5aa)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:10.859262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508ca43-1ba7-4d0b-9bf6-9ef82fbdf6bc tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:10.912961 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0508ca43-1ba7-4d0b-9bf6-9ef82fbdf6bc tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f231f1feaeec48e7b946645f045cf5aa', 'request_id': 'req-0508ca43-1ba7-4d0b-9bf6-9ef82fbdf6bc'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:10.923538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0508ca43-1ba7-4d0b-9bf6-9ef82fbdf6bc tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f231f1feaeec48e7b946645f045cf5aa', 'request_id': 'req-0508ca43-1ba7-4d0b-9bf6-9ef82fbdf6bc'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:10.934111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0508ca43-1ba7-4d0b-9bf6-9ef82fbdf6bc tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f231f1feaeec48e7b946645f045cf5aa', 'request_id': 'req-0508ca43-1ba7-4d0b-9bf6-9ef82fbdf6bc'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:10.944171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:10.949232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0508ca43-1ba7-4d0b-9bf6-9ef82fbdf6bc tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] The token cache is being invalidate because project f231f1feaeec48e7b946645f045cf5aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:10.950025 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0508ca43-1ba7-4d0b-9bf6-9ef82fbdf6bc tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:10.956763 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0508ca43-1ba7-4d0b-9bf6-9ef82fbdf6bc tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:10.958964 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4143/8231] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:37:10 2022] DELETE /identity/v3/projects/f231f1feaeec48e7b946645f045cf5aa => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:10.962775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c96cf9-5eab-4d82-a1aa-c800d23c77f8 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:10.964925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-87c96cf9-5eab-4d82-a1aa-c800d23c77f8 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:10.981820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c96cf9-5eab-4d82-a1aa-c800d23c77f8 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:11.051441 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1d6d6-6284-496b-beb5-a7cf10149795 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a788d4c1c651449db36d77e8e39d8f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45427a5587ca4449b7f1b94524b32348', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:11.052081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1d6d6-6284-496b-beb5-a7cf10149795 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:11.052612 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1d6d6-6284-496b-beb5-a7cf10149795 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:11.052895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1d6d6-6284-496b-beb5-a7cf10149795 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] PATH_INFO: `/v3/projects/37182a35743a4d84980a4d7c924d1ecc` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:11.054008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1d6d6-6284-496b-beb5-a7cf10149795 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorizing `identity:delete_project(project_id=37182a35743a4d84980a4d7c924d1ecc)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:11.055939 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1d6d6-6284-496b-beb5-a7cf10149795 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:11.112749 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-04e1d6d6-6284-496b-beb5-a7cf10149795 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37182a35743a4d84980a4d7c924d1ecc', 'request_id': 'req-04e1d6d6-6284-496b-beb5-a7cf10149795'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:11.119046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-04e1d6d6-6284-496b-beb5-a7cf10149795 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37182a35743a4d84980a4d7c924d1ecc', 'request_id': 'req-04e1d6d6-6284-496b-beb5-a7cf10149795'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:11.126837 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-04e1d6d6-6284-496b-beb5-a7cf10149795 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37182a35743a4d84980a4d7c924d1ecc', 'request_id': 'req-04e1d6d6-6284-496b-beb5-a7cf10149795'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:11.140748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-04e1d6d6-6284-496b-beb5-a7cf10149795 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] The token cache is being invalidate because project 37182a35743a4d84980a4d7c924d1ecc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:11.141043 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-04e1d6d6-6284-496b-beb5-a7cf10149795 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:11.141827 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-04e1d6d6-6284-496b-beb5-a7cf10149795 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:11.143659 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4089/8232] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:37:10 2022] DELETE /identity/v3/projects/37182a35743a4d84980a4d7c924d1ecc => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:37:11.147812 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508ca43-1ba7-4d0b-9bf6-9ef82fbdf6bc tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:11.158334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508ca43-1ba7-4d0b-9bf6-9ef82fbdf6bc tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:11.217903 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c08967-b4fd-4d95-8953-78b499d75c87 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a788d4c1c651449db36d77e8e39d8f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45427a5587ca4449b7f1b94524b32348', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:11.218561 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c08967-b4fd-4d95-8953-78b499d75c87 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:11.218853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c08967-b4fd-4d95-8953-78b499d75c87 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:11.219129 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c08967-b4fd-4d95-8953-78b499d75c87 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] PATH_INFO: `/v3/roles/ad0abab3e16e4502917ca3e57f3f9d49` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:11.220511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c08967-b4fd-4d95-8953-78b499d75c87 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ad0abab3e16e4502917ca3e57f3f9d49)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:11.222091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c08967-b4fd-4d95-8953-78b499d75c87 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:11.258421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b6c08967-b4fd-4d95-8953-78b499d75c87 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invalidating the token cache because role ad0abab3e16e4502917ca3e57f3f9d49 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:11.258740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b6c08967-b4fd-4d95-8953-78b499d75c87 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:11.259423 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b6c08967-b4fd-4d95-8953-78b499d75c87 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:11.261353 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4144/8233] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:37:11 2022] DELETE /identity/v3/roles/ad0abab3e16e4502917ca3e57f3f9d49 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:37:11.265921 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1d6d6-6284-496b-beb5-a7cf10149795 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:11.267516 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-04e1d6d6-6284-496b-beb5-a7cf10149795 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:11.280339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1d6d6-6284-496b-beb5-a7cf10149795 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:11.340076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247af0f-6ef5-4344-9248-85d080848108 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a788d4c1c651449db36d77e8e39d8f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45427a5587ca4449b7f1b94524b32348', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:11.341312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247af0f-6ef5-4344-9248-85d080848108 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:11.341740 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247af0f-6ef5-4344-9248-85d080848108 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:11.342041 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247af0f-6ef5-4344-9248-85d080848108 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] PATH_INFO: `/v3/users/913e71e6562e41c69f86c91270aeef04` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:11.343303 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247af0f-6ef5-4344-9248-85d080848108 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorizing `identity:delete_user(user_id=913e71e6562e41c69f86c91270aeef04)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:11.345275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247af0f-6ef5-4344-9248-85d080848108 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:11.359800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:11.390689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5247af0f-6ef5-4344-9248-85d080848108 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '913e71e6562e41c69f86c91270aeef04'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:11.391380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5247af0f-6ef5-4344-9248-85d080848108 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '913e71e6562e41c69f86c91270aeef04'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:11.392004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5247af0f-6ef5-4344-9248-85d080848108 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '913e71e6562e41c69f86c91270aeef04'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:11.399647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5247af0f-6ef5-4344-9248-85d080848108 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '913e71e6562e41c69f86c91270aeef04'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:11.416520 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5247af0f-6ef5-4344-9248-85d080848108 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '913e71e6562e41c69f86c91270aeef04'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:11.429505 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4090/8234] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:37:11 2022] DELETE /identity/v3/users/913e71e6562e41c69f86c91270aeef04 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:11.434066 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c08967-b4fd-4d95-8953-78b499d75c87 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:11.436357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b6c08967-b4fd-4d95-8953-78b499d75c87 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:11.450008 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c08967-b4fd-4d95-8953-78b499d75c87 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:11.512292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9413c6-e29b-4d87-ab8d-eca455a6ba10 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a788d4c1c651449db36d77e8e39d8f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45427a5587ca4449b7f1b94524b32348', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:11.513664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9413c6-e29b-4d87-ab8d-eca455a6ba10 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:11.513951 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9413c6-e29b-4d87-ab8d-eca455a6ba10 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:11.514255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9413c6-e29b-4d87-ab8d-eca455a6ba10 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] PATH_INFO: `/v3/projects/49fa7a5f177a43d094b55c56208bc68a` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:11.515477 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9413c6-e29b-4d87-ab8d-eca455a6ba10 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorizing `identity:delete_project(project_id=49fa7a5f177a43d094b55c56208bc68a)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:11.517389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9413c6-e29b-4d87-ab8d-eca455a6ba10 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:11.569884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-db9413c6-e29b-4d87-ab8d-eca455a6ba10 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49fa7a5f177a43d094b55c56208bc68a', 'request_id': 'req-db9413c6-e29b-4d87-ab8d-eca455a6ba10'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:11.576162 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-db9413c6-e29b-4d87-ab8d-eca455a6ba10 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49fa7a5f177a43d094b55c56208bc68a', 'request_id': 'req-db9413c6-e29b-4d87-ab8d-eca455a6ba10'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:11.584064 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-db9413c6-e29b-4d87-ab8d-eca455a6ba10 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49fa7a5f177a43d094b55c56208bc68a', 'request_id': 'req-db9413c6-e29b-4d87-ab8d-eca455a6ba10'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:11.585494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:11.599147 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-db9413c6-e29b-4d87-ab8d-eca455a6ba10 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] The token cache is being invalidate because project 49fa7a5f177a43d094b55c56208bc68a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:11.599367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-db9413c6-e29b-4d87-ab8d-eca455a6ba10 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:11.600035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-db9413c6-e29b-4d87-ab8d-eca455a6ba10 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:11.601561 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4145/8235] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:37:11 2022] DELETE /identity/v3/projects/49fa7a5f177a43d094b55c56208bc68a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:37:11.607785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247af0f-6ef5-4344-9248-85d080848108 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:11.608674 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5247af0f-6ef5-4344-9248-85d080848108 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:11.621673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247af0f-6ef5-4344-9248-85d080848108 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:11.691944 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbfe0b8-a43f-4f23-98fe-1fc9cc535218 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a788d4c1c651449db36d77e8e39d8f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45427a5587ca4449b7f1b94524b32348', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:11.692708 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfe0b8-a43f-4f23-98fe-1fc9cc535218 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:11.692997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfe0b8-a43f-4f23-98fe-1fc9cc535218 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:11.693274 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfe0b8-a43f-4f23-98fe-1fc9cc535218 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] PATH_INFO: `/v3/users/f36ab1e21cfc48728feb6bd462da7f4d` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:11.694521 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbfe0b8-a43f-4f23-98fe-1fc9cc535218 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorizing `identity:update_user(user_id=f36ab1e21cfc48728feb6bd462da7f4d)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:11.696589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbfe0b8-a43f-4f23-98fe-1fc9cc535218 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:11.734052 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-cdbfe0b8-a43f-4f23-98fe-1fc9cc535218 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f36ab1e21cfc48728feb6bd462da7f4d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:11.742770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-cdbfe0b8-a43f-4f23-98fe-1fc9cc535218 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invalidating the token cache because user f36ab1e21cfc48728feb6bd462da7f4d was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:11.743089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-cdbfe0b8-a43f-4f23-98fe-1fc9cc535218 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:11.743742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-cdbfe0b8-a43f-4f23-98fe-1fc9cc535218 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:11.745663 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4091/8236] 10.222.0.33 () {60 vars in 1243 bytes} [Sat Aug 6 21:37:11 2022] PATCH /identity/v3/users/f36ab1e21cfc48728feb6bd462da7f4d => generated 296 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:37:11.750698 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b8f3c-fb0c-456a-8f73-4ed8f1e25422 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:11.750987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b8f3c-fb0c-456a-8f73-4ed8f1e25422 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:11.751316 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b8f3c-fb0c-456a-8f73-4ed8f1e25422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:11.782254 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-cb2b8f3c-fb0c-456a-8f73-4ed8f1e25422 None None] MFA Rules not processed for user `f36ab1e21cfc48728feb6bd462da7f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:11.783492 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-cb2b8f3c-fb0c-456a-8f73-4ed8f1e25422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:11.786576 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4146/8237] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:11 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 21:37:11.790845 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbfe0b8-a43f-4f23-98fe-1fc9cc535218 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:11.792274 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-cdbfe0b8-a43f-4f23-98fe-1fc9cc535218 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:11.805703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbfe0b8-a43f-4f23-98fe-1fc9cc535218 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:11.810732 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbf753-fd32-4466-bec6-d8d9ca6147ad tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a788d4c1c651449db36d77e8e39d8f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45427a5587ca4449b7f1b94524b32348', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:11.811512 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbf753-fd32-4466-bec6-d8d9ca6147ad tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:11.811802 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbf753-fd32-4466-bec6-d8d9ca6147ad tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:11.812070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbf753-fd32-4466-bec6-d8d9ca6147ad tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] PATH_INFO: `/v3/users/f36ab1e21cfc48728feb6bd462da7f4d` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:11.813288 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cbf753-fd32-4466-bec6-d8d9ca6147ad tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorizing `identity:update_user(user_id=f36ab1e21cfc48728feb6bd462da7f4d)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:11.815247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cbf753-fd32-4466-bec6-d8d9ca6147ad tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:11.853917 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-96cbf753-fd32-4466-bec6-d8d9ca6147ad tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f36ab1e21cfc48728feb6bd462da7f4d'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:11.862264 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-96cbf753-fd32-4466-bec6-d8d9ca6147ad tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invalidating the token cache because user f36ab1e21cfc48728feb6bd462da7f4d was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:11.863624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-96cbf753-fd32-4466-bec6-d8d9ca6147ad tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:11.863624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-96cbf753-fd32-4466-bec6-d8d9ca6147ad tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:11.865045 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4092/8238] 10.222.0.33 () {60 vars in 1243 bytes} [Sat Aug 6 21:37:11 2022] PATCH /identity/v3/users/f36ab1e21cfc48728feb6bd462da7f4d => generated 296 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:37:11.868992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b8f3c-fb0c-456a-8f73-4ed8f1e25422 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:11.881386 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b8f3c-fb0c-456a-8f73-4ed8f1e25422 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:11.885928 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c85ec3-c352-4ce0-89da-2b67e16a1b2d tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a788d4c1c651449db36d77e8e39d8f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45427a5587ca4449b7f1b94524b32348', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:11.886638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c85ec3-c352-4ce0-89da-2b67e16a1b2d tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:11.886873 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c85ec3-c352-4ce0-89da-2b67e16a1b2d tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:11.887174 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c85ec3-c352-4ce0-89da-2b67e16a1b2d tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] PATH_INFO: `/v3/users/f36ab1e21cfc48728feb6bd462da7f4d` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:11.902489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c85ec3-c352-4ce0-89da-2b67e16a1b2d tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorizing `identity:update_user(user_id=f36ab1e21cfc48728feb6bd462da7f4d)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:11.905228 ncdv-master-1 devstack@keystone.service[102759]: WARNING py.warnings [None req-e3c85ec3-c352-4ce0-89da-2b67e16a1b2d tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:37:11.905228 ncdv-master-1 devstack@keystone.service[102759]: warnings.warn(msg) Aug 06 21:37:11.905228 ncdv-master-1 devstack@keystone.service[102759]: Aug 06 21:37:11.906498 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c85ec3-c352-4ce0-89da-2b67e16a1b2d tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:11.942733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e3c85ec3-c352-4ce0-89da-2b67e16a1b2d tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f36ab1e21cfc48728feb6bd462da7f4d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:11.951657 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e3c85ec3-c352-4ce0-89da-2b67e16a1b2d tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invalidating the token cache because user f36ab1e21cfc48728feb6bd462da7f4d was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:11.951958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e3c85ec3-c352-4ce0-89da-2b67e16a1b2d tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:11.952628 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-e3c85ec3-c352-4ce0-89da-2b67e16a1b2d tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:11.957290 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4147/8239] 10.222.0.33 () {60 vars in 1243 bytes} [Sat Aug 6 21:37:11 2022] PATCH /identity/v3/users/f36ab1e21cfc48728feb6bd462da7f4d => generated 296 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:37:11.959011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68f322-abc8-49f7-828d-f54673058285 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:11.959369 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68f322-abc8-49f7-828d-f54673058285 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:11.959673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68f322-abc8-49f7-828d-f54673058285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:11.993037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-fb68f322-abc8-49f7-828d-f54673058285 None None] MFA Rules not processed for user `f36ab1e21cfc48728feb6bd462da7f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:11.994243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-fb68f322-abc8-49f7-828d-f54673058285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:12.008918 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4093/8240] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:11 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 21:37:12.009601 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c85ec3-c352-4ce0-89da-2b67e16a1b2d tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:12.012370 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e3c85ec3-c352-4ce0-89da-2b67e16a1b2d tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:12.033357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c85ec3-c352-4ce0-89da-2b67e16a1b2d tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:12.039319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf82f41-5fd0-459a-ace4-4cc07a9de0dd tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a788d4c1c651449db36d77e8e39d8f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45427a5587ca4449b7f1b94524b32348', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:12.040055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf82f41-5fd0-459a-ace4-4cc07a9de0dd tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:12.040414 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf82f41-5fd0-459a-ace4-4cc07a9de0dd tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:12.040765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf82f41-5fd0-459a-ace4-4cc07a9de0dd tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] PATH_INFO: `/v3/users/f36ab1e21cfc48728feb6bd462da7f4d` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:12.042116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf82f41-5fd0-459a-ace4-4cc07a9de0dd tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorizing `identity:update_user(user_id=f36ab1e21cfc48728feb6bd462da7f4d)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:12.044272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf82f41-5fd0-459a-ace4-4cc07a9de0dd tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:12.083170 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cdf82f41-5fd0-459a-ace4-4cc07a9de0dd tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f36ab1e21cfc48728feb6bd462da7f4d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:12.093821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cdf82f41-5fd0-459a-ace4-4cc07a9de0dd tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invalidating the token cache because user f36ab1e21cfc48728feb6bd462da7f4d was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:12.094259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cdf82f41-5fd0-459a-ace4-4cc07a9de0dd tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:12.095667 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cdf82f41-5fd0-459a-ace4-4cc07a9de0dd tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:12.098003 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4148/8241] 10.222.0.33 () {60 vars in 1243 bytes} [Sat Aug 6 21:37:12 2022] PATCH /identity/v3/users/f36ab1e21cfc48728feb6bd462da7f4d => generated 296 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:37:12.103141 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68f322-abc8-49f7-828d-f54673058285 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:12.119303 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68f322-abc8-49f7-828d-f54673058285 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:12.126368 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76eed8-5cc3-4277-bc68-25af01cd653e tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a788d4c1c651449db36d77e8e39d8f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45427a5587ca4449b7f1b94524b32348', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:12.126898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76eed8-5cc3-4277-bc68-25af01cd653e tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:12.127182 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76eed8-5cc3-4277-bc68-25af01cd653e tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:12.127460 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76eed8-5cc3-4277-bc68-25af01cd653e tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:12.128088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76eed8-5cc3-4277-bc68-25af01cd653e tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:12.129949 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76eed8-5cc3-4277-bc68-25af01cd653e tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:12.163868 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4094/8242] 10.222.0.33 () {60 vars in 1143 bytes} [Sat Aug 6 21:37:12 2022] POST /identity/v3/users => generated 264 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:37:12.165107 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf82f41-5fd0-459a-ace4-4cc07a9de0dd tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:12.166562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-cdf82f41-5fd0-459a-ace4-4cc07a9de0dd tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:12.187490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf82f41-5fd0-459a-ace4-4cc07a9de0dd tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:12.192438 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97689bfa-4f3d-431d-9a68-2a2f0ef1d6aa tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a788d4c1c651449db36d77e8e39d8f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45427a5587ca4449b7f1b94524b32348', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:12.193088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97689bfa-4f3d-431d-9a68-2a2f0ef1d6aa tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:12.193369 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97689bfa-4f3d-431d-9a68-2a2f0ef1d6aa tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:12.193642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97689bfa-4f3d-431d-9a68-2a2f0ef1d6aa tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] PATH_INFO: `/v3/users/554fdea7b47f4c88b6541b7902dcff5a/password` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:12.267314 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-97689bfa-4f3d-431d-9a68-2a2f0ef1d6aa tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '554fdea7b47f4c88b6541b7902dcff5a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:12.278648 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4149/8243] 10.222.0.33 () {60 vars in 1269 bytes} [Sat Aug 6 21:37:12 2022] POST /identity/v3/users/554fdea7b47f4c88b6541b7902dcff5a/password => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:12.956116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76eed8-5cc3-4277-bc68-25af01cd653e tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:12.958181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0d76eed8-5cc3-4277-bc68-25af01cd653e tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:12.963610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=79,keystone:DELETE=11,keystone:INSERT=8,keystone:UPDATE=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:13.041131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76eed8-5cc3-4277-bc68-25af01cd653e tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:13.047154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10557e2a-9222-4480-b5cb-96eb1d492710 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:13.047888 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10557e2a-9222-4480-b5cb-96eb1d492710 service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:13.048222 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10557e2a-9222-4480-b5cb-96eb1d492710 service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:13.048506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10557e2a-9222-4480-b5cb-96eb1d492710 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:13.050487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-10557e2a-9222-4480-b5cb-96eb1d492710 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:13.065607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10557e2a-9222-4480-b5cb-96eb1d492710 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:13.067344 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10557e2a-9222-4480-b5cb-96eb1d492710 service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:13.080740 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4095/8244] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:37:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:37:13.197474 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97689bfa-4f3d-431d-9a68-2a2f0ef1d6aa tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:13.199813 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-97689bfa-4f3d-431d-9a68-2a2f0ef1d6aa tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:13.220318 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97689bfa-4f3d-431d-9a68-2a2f0ef1d6aa tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:13.226104 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42481a04-6eff-4be7-941b-9df1b9697998 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:13.226866 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42481a04-6eff-4be7-941b-9df1b9697998 service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:13.227213 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42481a04-6eff-4be7-941b-9df1b9697998 service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:13.227556 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42481a04-6eff-4be7-941b-9df1b9697998 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:13.229398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-42481a04-6eff-4be7-941b-9df1b9697998 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:13.244700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42481a04-6eff-4be7-941b-9df1b9697998 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:13.246395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42481a04-6eff-4be7-941b-9df1b9697998 service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:13.259056 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4150/8245] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:37:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:37:13.284071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087aaeb9-5b2a-4614-8a77-e0d2f8b4522b None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:13.284361 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087aaeb9-5b2a-4614-8a77-e0d2f8b4522b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:13.284644 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087aaeb9-5b2a-4614-8a77-e0d2f8b4522b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:13.304879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-087aaeb9-5b2a-4614-8a77-e0d2f8b4522b None None] MFA Rules not processed for user `554fdea7b47f4c88b6541b7902dcff5a`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:13.306156 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-087aaeb9-5b2a-4614-8a77-e0d2f8b4522b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:13.310151 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4096/8246] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:13 2022] POST /identity/v3/auth/tokens => generated 329 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 21:37:13.315193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42481a04-6eff-4be7-941b-9df1b9697998 service placement] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:13.326537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42481a04-6eff-4be7-941b-9df1b9697998 service placement] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:13.331263 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ec69a-5335-4c11-8b5d-121308b76445 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a788d4c1c651449db36d77e8e39d8f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45427a5587ca4449b7f1b94524b32348', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:13.331947 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ec69a-5335-4c11-8b5d-121308b76445 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:13.332195 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ec69a-5335-4c11-8b5d-121308b76445 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:13.332421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ec69a-5335-4c11-8b5d-121308b76445 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:13.338754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ec69a-5335-4c11-8b5d-121308b76445 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:13.341084 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ec69a-5335-4c11-8b5d-121308b76445 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:13.348197 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4151/8247] 10.222.0.33 () {56 vars in 1263 bytes} [Sat Aug 6 21:37:13 2022] GET /identity/v3/auth/tokens => generated 329 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 21:37:13.352266 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087aaeb9-5b2a-4614-8a77-e0d2f8b4522b None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:13.365410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087aaeb9-5b2a-4614-8a77-e0d2f8b4522b None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:13.370387 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33575532-b95e-4e9d-959d-ba79f73748bb tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a788d4c1c651449db36d77e8e39d8f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45427a5587ca4449b7f1b94524b32348', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:13.371502 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33575532-b95e-4e9d-959d-ba79f73748bb tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:13.371885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33575532-b95e-4e9d-959d-ba79f73748bb tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:13.372342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33575532-b95e-4e9d-959d-ba79f73748bb tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] PATH_INFO: `/v3/users/554fdea7b47f4c88b6541b7902dcff5a` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:13.373790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33575532-b95e-4e9d-959d-ba79f73748bb tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorizing `identity:delete_user(user_id=554fdea7b47f4c88b6541b7902dcff5a)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:13.376000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33575532-b95e-4e9d-959d-ba79f73748bb tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:13.427046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-33575532-b95e-4e9d-959d-ba79f73748bb tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '554fdea7b47f4c88b6541b7902dcff5a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:13.427976 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-33575532-b95e-4e9d-959d-ba79f73748bb tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '554fdea7b47f4c88b6541b7902dcff5a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:13.428692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-33575532-b95e-4e9d-959d-ba79f73748bb tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '554fdea7b47f4c88b6541b7902dcff5a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:13.436901 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-33575532-b95e-4e9d-959d-ba79f73748bb tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '554fdea7b47f4c88b6541b7902dcff5a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:13.450217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-33575532-b95e-4e9d-959d-ba79f73748bb tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '554fdea7b47f4c88b6541b7902dcff5a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:13.463825 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4097/8248] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:37:13 2022] DELETE /identity/v3/users/554fdea7b47f4c88b6541b7902dcff5a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:13.469242 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ec69a-5335-4c11-8b5d-121308b76445 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:13.479229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ec69a-5335-4c11-8b5d-121308b76445 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:13.523779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=86,keystone:UPDATE=3,keystone:INSERT=6,keystone:DELETE=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:13.543075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf424e5-4a0d-4947-bae3-96cb7f9e12f9 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a788d4c1c651449db36d77e8e39d8f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45427a5587ca4449b7f1b94524b32348', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:13.543777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf424e5-4a0d-4947-bae3-96cb7f9e12f9 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:13.544702 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf424e5-4a0d-4947-bae3-96cb7f9e12f9 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:13.544979 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf424e5-4a0d-4947-bae3-96cb7f9e12f9 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:13.545638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf424e5-4a0d-4947-bae3-96cb7f9e12f9 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:13.547457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf424e5-4a0d-4947-bae3-96cb7f9e12f9 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:13.572802 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4152/8249] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:37:13 2022] POST /identity/v3/users => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:13.577160 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33575532-b95e-4e9d-959d-ba79f73748bb tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:13.578699 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-33575532-b95e-4e9d-959d-ba79f73748bb tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:13.592413 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33575532-b95e-4e9d-959d-ba79f73748bb tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:13.597187 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294065c-1900-4b88-a780-bbdf10411f2b tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a788d4c1c651449db36d77e8e39d8f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45427a5587ca4449b7f1b94524b32348', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:13.597918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294065c-1900-4b88-a780-bbdf10411f2b tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:13.598272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294065c-1900-4b88-a780-bbdf10411f2b tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:13.598648 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294065c-1900-4b88-a780-bbdf10411f2b tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:13.600094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b294065c-1900-4b88-a780-bbdf10411f2b tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:13.601313 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b294065c-1900-4b88-a780-bbdf10411f2b tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:13.641739 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4098/8250] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:37:13 2022] POST /identity/v3/projects => generated 359 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:13.643224 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf424e5-4a0d-4947-bae3-96cb7f9e12f9 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:13.653866 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf424e5-4a0d-4947-bae3-96cb7f9e12f9 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:13.722242 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7bdc1-c6fe-4800-b355-e0ecbfc3e6a7 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a788d4c1c651449db36d77e8e39d8f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45427a5587ca4449b7f1b94524b32348', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:13.722901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7bdc1-c6fe-4800-b355-e0ecbfc3e6a7 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] REQUEST_METHOD: `PATCH` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:13.723208 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7bdc1-c6fe-4800-b355-e0ecbfc3e6a7 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:13.723482 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7bdc1-c6fe-4800-b355-e0ecbfc3e6a7 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] PATH_INFO: `/v3/users/b91b448af41a4815b18fa84a7a05ce8e` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:13.738003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae7bdc1-c6fe-4800-b355-e0ecbfc3e6a7 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorizing `identity:update_user(user_id=b91b448af41a4815b18fa84a7a05ce8e)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:13.740227 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae7bdc1-c6fe-4800-b355-e0ecbfc3e6a7 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:13.777874 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4153/8251] 10.222.0.33 () {60 vars in 1244 bytes} [Sat Aug 6 21:37:13 2022] PATCH /identity/v3/users/b91b448af41a4815b18fa84a7a05ce8e => generated 524 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:37:13.782959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294065c-1900-4b88-a780-bbdf10411f2b tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:13.793511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294065c-1900-4b88-a780-bbdf10411f2b tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:13.798489 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed14bb-22a0-489f-a2b7-a9a2d8a82b61 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a788d4c1c651449db36d77e8e39d8f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45427a5587ca4449b7f1b94524b32348', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:13.799150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed14bb-22a0-489f-a2b7-a9a2d8a82b61 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:13.799436 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed14bb-22a0-489f-a2b7-a9a2d8a82b61 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:13.799709 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed14bb-22a0-489f-a2b7-a9a2d8a82b61 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] PATH_INFO: `/v3/users/b91b448af41a4815b18fa84a7a05ce8e` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:13.815166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed14bb-22a0-489f-a2b7-a9a2d8a82b61 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorizing `identity:get_user(user_id=b91b448af41a4815b18fa84a7a05ce8e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:13.818091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed14bb-22a0-489f-a2b7-a9a2d8a82b61 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:13.820239 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4099/8252] 10.222.0.33 () {58 vars in 1221 bytes} [Sat Aug 6 21:37:13 2022] GET /identity/v3/users/b91b448af41a4815b18fa84a7a05ce8e => generated 390 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:37:13.824444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7bdc1-c6fe-4800-b355-e0ecbfc3e6a7 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:13.834929 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7bdc1-c6fe-4800-b355-e0ecbfc3e6a7 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:13.839860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a264bd-21f9-4b44-a796-7cf083581fe2 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a788d4c1c651449db36d77e8e39d8f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45427a5587ca4449b7f1b94524b32348', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:13.840578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a264bd-21f9-4b44-a796-7cf083581fe2 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:13.841484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a264bd-21f9-4b44-a796-7cf083581fe2 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:13.841832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a264bd-21f9-4b44-a796-7cf083581fe2 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] PATH_INFO: `/v3/projects/9c58c52026c142638a71fd6e55e17795` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:13.842997 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a264bd-21f9-4b44-a796-7cf083581fe2 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9c58c52026c142638a71fd6e55e17795)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:13.844882 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a264bd-21f9-4b44-a796-7cf083581fe2 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:13.893624 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c4a264bd-21f9-4b44-a796-7cf083581fe2 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c58c52026c142638a71fd6e55e17795', 'request_id': 'req-c4a264bd-21f9-4b44-a796-7cf083581fe2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:13.899691 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c4a264bd-21f9-4b44-a796-7cf083581fe2 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c58c52026c142638a71fd6e55e17795', 'request_id': 'req-c4a264bd-21f9-4b44-a796-7cf083581fe2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:13.908042 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c4a264bd-21f9-4b44-a796-7cf083581fe2 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c58c52026c142638a71fd6e55e17795', 'request_id': 'req-c4a264bd-21f9-4b44-a796-7cf083581fe2'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:13.920153 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c4a264bd-21f9-4b44-a796-7cf083581fe2 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] The token cache is being invalidate because project 9c58c52026c142638a71fd6e55e17795 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:13.920450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c4a264bd-21f9-4b44-a796-7cf083581fe2 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:13.921204 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c4a264bd-21f9-4b44-a796-7cf083581fe2 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:13.922817 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4154/8253] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:37:13 2022] DELETE /identity/v3/projects/9c58c52026c142638a71fd6e55e17795 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:13.927101 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed14bb-22a0-489f-a2b7-a9a2d8a82b61 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:13.930105 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f6ed14bb-22a0-489f-a2b7-a9a2d8a82b61 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:13.946154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed14bb-22a0-489f-a2b7-a9a2d8a82b61 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:13.967148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:14.021156 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb05fe-910b-4cac-a804-be9e9253e849 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a788d4c1c651449db36d77e8e39d8f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45427a5587ca4449b7f1b94524b32348', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:14.021928 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb05fe-910b-4cac-a804-be9e9253e849 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:14.022314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb05fe-910b-4cac-a804-be9e9253e849 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:14.022752 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb05fe-910b-4cac-a804-be9e9253e849 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] PATH_INFO: `/v3/users/b91b448af41a4815b18fa84a7a05ce8e` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:14.025005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb05fe-910b-4cac-a804-be9e9253e849 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b91b448af41a4815b18fa84a7a05ce8e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:14.027648 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb05fe-910b-4cac-a804-be9e9253e849 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:14.084819 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0ebb05fe-910b-4cac-a804-be9e9253e849 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b91b448af41a4815b18fa84a7a05ce8e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:14.087005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0ebb05fe-910b-4cac-a804-be9e9253e849 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b91b448af41a4815b18fa84a7a05ce8e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:14.088069 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0ebb05fe-910b-4cac-a804-be9e9253e849 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b91b448af41a4815b18fa84a7a05ce8e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:14.101145 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0ebb05fe-910b-4cac-a804-be9e9253e849 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b91b448af41a4815b18fa84a7a05ce8e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:14.116151 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0ebb05fe-910b-4cac-a804-be9e9253e849 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b91b448af41a4815b18fa84a7a05ce8e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:14.129943 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4100/8254] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:37:13 2022] DELETE /identity/v3/users/b91b448af41a4815b18fa84a7a05ce8e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:14.135072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a264bd-21f9-4b44-a796-7cf083581fe2 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:14.136694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c4a264bd-21f9-4b44-a796-7cf083581fe2 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:14.168099 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:UPDATE=2,keystone:DELETE=7 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:14.206916 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a264bd-21f9-4b44-a796-7cf083581fe2 tempest-UsersV3TestJSON-1784147092 tempest-UsersV3TestJSON-1784147092-project-admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:14.265858 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0fb7b9-6f7b-4903-a445-35a281aaa437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:14.266499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fb7b9-6f7b-4903-a445-35a281aaa437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:14.266832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fb7b9-6f7b-4903-a445-35a281aaa437 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:14.267113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fb7b9-6f7b-4903-a445-35a281aaa437 admin admin] PATH_INFO: `/v3/users/f36ab1e21cfc48728feb6bd462da7f4d` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:14.282256 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0fb7b9-6f7b-4903-a445-35a281aaa437 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f36ab1e21cfc48728feb6bd462da7f4d)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:14.284281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0fb7b9-6f7b-4903-a445-35a281aaa437 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:14.336261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-db0fb7b9-6f7b-4903-a445-35a281aaa437 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f36ab1e21cfc48728feb6bd462da7f4d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:14.346419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-db0fb7b9-6f7b-4903-a445-35a281aaa437 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f36ab1e21cfc48728feb6bd462da7f4d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:14.347174 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-db0fb7b9-6f7b-4903-a445-35a281aaa437 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f36ab1e21cfc48728feb6bd462da7f4d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:14.347796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-db0fb7b9-6f7b-4903-a445-35a281aaa437 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f36ab1e21cfc48728feb6bd462da7f4d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:14.354536 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-db0fb7b9-6f7b-4903-a445-35a281aaa437 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f36ab1e21cfc48728feb6bd462da7f4d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:14.372766 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4155/8255] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:37:14 2022] DELETE /identity/v3/users/f36ab1e21cfc48728feb6bd462da7f4d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:37:14.377353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164af3df-fd0c-44d1-a8c2-62d15ef87295 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:14.377717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164af3df-fd0c-44d1-a8c2-62d15ef87295 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:14.378065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164af3df-fd0c-44d1-a8c2-62d15ef87295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:14.397798 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-164af3df-fd0c-44d1-a8c2-62d15ef87295 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:14.399061 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-164af3df-fd0c-44d1-a8c2-62d15ef87295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:14.462892 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4101/8256] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:14.497880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0fb7b9-6f7b-4903-a445-35a281aaa437 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:14.499299 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-db0fb7b9-6f7b-4903-a445-35a281aaa437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:14.547502 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:14.564102 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0fb7b9-6f7b-4903-a445-35a281aaa437 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:14.567940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf8fe8-e53d-44b5-b103-41ff954f288b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:14.568548 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf8fe8-e53d-44b5-b103-41ff954f288b service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:14.568979 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf8fe8-e53d-44b5-b103-41ff954f288b service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:14.569258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf8fe8-e53d-44b5-b103-41ff954f288b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:14.579289 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf8fe8-e53d-44b5-b103-41ff954f288b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:14.580726 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf8fe8-e53d-44b5-b103-41ff954f288b service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:14.590502 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4156/8257] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:37:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:37:15.013756 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164af3df-fd0c-44d1-a8c2-62d15ef87295 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:15.015337 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-164af3df-fd0c-44d1-a8c2-62d15ef87295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:15.028225 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164af3df-fd0c-44d1-a8c2-62d15ef87295 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:15.034566 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3258f-10ac-40c8-bca4-6e103a8a4cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:15.035318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3258f-10ac-40c8-bca4-6e103a8a4cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:15.035700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3258f-10ac-40c8-bca4-6e103a8a4cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:15.036610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3258f-10ac-40c8-bca4-6e103a8a4cd9 admin admin] PATH_INFO: `/v3/projects/a0e851824b864fe4a5ecba7b36b605c0` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:15.037323 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3258f-10ac-40c8-bca4-6e103a8a4cd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0e851824b864fe4a5ecba7b36b605c0)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:15.039646 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3258f-10ac-40c8-bca4-6e103a8a4cd9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:15.084776 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:15.096880 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-71b3258f-10ac-40c8-bca4-6e103a8a4cd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0e851824b864fe4a5ecba7b36b605c0', 'request_id': 'req-71b3258f-10ac-40c8-bca4-6e103a8a4cd9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:15.103810 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-71b3258f-10ac-40c8-bca4-6e103a8a4cd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0e851824b864fe4a5ecba7b36b605c0', 'request_id': 'req-71b3258f-10ac-40c8-bca4-6e103a8a4cd9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:15.112110 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-71b3258f-10ac-40c8-bca4-6e103a8a4cd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0e851824b864fe4a5ecba7b36b605c0', 'request_id': 'req-71b3258f-10ac-40c8-bca4-6e103a8a4cd9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:15.126507 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-71b3258f-10ac-40c8-bca4-6e103a8a4cd9 admin admin] The token cache is being invalidate because project a0e851824b864fe4a5ecba7b36b605c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:15.126927 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-71b3258f-10ac-40c8-bca4-6e103a8a4cd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:15.127573 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-71b3258f-10ac-40c8-bca4-6e103a8a4cd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:15.129087 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4102/8258] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:37:15 2022] DELETE /identity/v3/projects/a0e851824b864fe4a5ecba7b36b605c0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:15.133209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf8fe8-e53d-44b5-b103-41ff954f288b service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:15.144704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf8fe8-e53d-44b5-b103-41ff954f288b service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:15.210475 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c27004-f394-42db-b9fd-9263b7e16d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:15.211227 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c27004-f394-42db-b9fd-9263b7e16d84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:15.211456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c27004-f394-42db-b9fd-9263b7e16d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:15.211747 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c27004-f394-42db-b9fd-9263b7e16d84 admin admin] PATH_INFO: `/v3/users/a788d4c1c651449db36d77e8e39d8f40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:15.212881 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c27004-f394-42db-b9fd-9263b7e16d84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a788d4c1c651449db36d77e8e39d8f40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:15.214871 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c27004-f394-42db-b9fd-9263b7e16d84 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:15.267245 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b1c27004-f394-42db-b9fd-9263b7e16d84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a788d4c1c651449db36d77e8e39d8f40'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:15.274072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b1c27004-f394-42db-b9fd-9263b7e16d84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a788d4c1c651449db36d77e8e39d8f40'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:15.274811 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b1c27004-f394-42db-b9fd-9263b7e16d84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a788d4c1c651449db36d77e8e39d8f40'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:15.275436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b1c27004-f394-42db-b9fd-9263b7e16d84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a788d4c1c651449db36d77e8e39d8f40'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:15.283008 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b1c27004-f394-42db-b9fd-9263b7e16d84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a788d4c1c651449db36d77e8e39d8f40'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:15.301715 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4157/8259] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:37:15 2022] DELETE /identity/v3/users/a788d4c1c651449db36d77e8e39d8f40 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:16.087425 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3258f-10ac-40c8-bca4-6e103a8a4cd9 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:16.089210 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-71b3258f-10ac-40c8-bca4-6e103a8a4cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:16.103536 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3258f-10ac-40c8-bca4-6e103a8a4cd9 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:16.175440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de067755-64c9-4df1-9ff2-55b86129f20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:16.176680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de067755-64c9-4df1-9ff2-55b86129f20e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:16.177781 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de067755-64c9-4df1-9ff2-55b86129f20e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:16.178233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de067755-64c9-4df1-9ff2-55b86129f20e admin admin] PATH_INFO: `/v3/projects/45427a5587ca4449b7f1b94524b32348` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:16.180595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de067755-64c9-4df1-9ff2-55b86129f20e admin admin] RBAC: Authorizing `identity:delete_project(project_id=45427a5587ca4449b7f1b94524b32348)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:16.183157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de067755-64c9-4df1-9ff2-55b86129f20e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:16.235682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-de067755-64c9-4df1-9ff2-55b86129f20e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45427a5587ca4449b7f1b94524b32348', 'request_id': 'req-de067755-64c9-4df1-9ff2-55b86129f20e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:16.241843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-de067755-64c9-4df1-9ff2-55b86129f20e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45427a5587ca4449b7f1b94524b32348', 'request_id': 'req-de067755-64c9-4df1-9ff2-55b86129f20e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:16.249993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-de067755-64c9-4df1-9ff2-55b86129f20e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45427a5587ca4449b7f1b94524b32348', 'request_id': 'req-de067755-64c9-4df1-9ff2-55b86129f20e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:16.263078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-de067755-64c9-4df1-9ff2-55b86129f20e admin admin] The token cache is being invalidate because project 45427a5587ca4449b7f1b94524b32348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:16.263596 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-de067755-64c9-4df1-9ff2-55b86129f20e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:16.264324 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-de067755-64c9-4df1-9ff2-55b86129f20e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:16.265872 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4103/8260] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:37:16 2022] DELETE /identity/v3/projects/45427a5587ca4449b7f1b94524b32348 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:16.271991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d5017-3f02-4230-a524-284048634eca None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:16.272534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d5017-3f02-4230-a524-284048634eca None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:16.272643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d5017-3f02-4230-a524-284048634eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:16.292797 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-209d5017-3f02-4230-a524-284048634eca None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:16.294571 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-209d5017-3f02-4230-a524-284048634eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:16.356305 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4158/8261] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:16.364787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebefcc5-09e9-4540-ba22-1bf1fbf1a49c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:16.365079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebefcc5-09e9-4540-ba22-1bf1fbf1a49c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:16.365366 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebefcc5-09e9-4540-ba22-1bf1fbf1a49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:16.385284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-5ebefcc5-09e9-4540-ba22-1bf1fbf1a49c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:16.386499 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5ebefcc5-09e9-4540-ba22-1bf1fbf1a49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:16.395495 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4104/8262] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:16.399981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d5017-3f02-4230-a524-284048634eca None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:16.407076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:16.411394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d5017-3f02-4230-a524-284048634eca None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:16.418736 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35261dd4-485c-4229-b332-865d23816c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:16.419549 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35261dd4-485c-4229-b332-865d23816c58 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:16.419959 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35261dd4-485c-4229-b332-865d23816c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:16.420237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35261dd4-485c-4229-b332-865d23816c58 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:16.420888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35261dd4-485c-4229-b332-865d23816c58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:37:16.421197 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35261dd4-485c-4229-b332-865d23816c58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:16.422826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35261dd4-485c-4229-b332-865d23816c58 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:16.436185 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4159/8263] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:37:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:37:16.440492 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebefcc5-09e9-4540-ba22-1bf1fbf1a49c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:16.449788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebefcc5-09e9-4540-ba22-1bf1fbf1a49c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:16.456038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9d08e-2616-4127-b48e-0dbc1a3314d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:16.456620 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9d08e-2616-4127-b48e-0dbc1a3314d6 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:16.456895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9d08e-2616-4127-b48e-0dbc1a3314d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:16.457166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9d08e-2616-4127-b48e-0dbc1a3314d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:16.457784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9d08e-2616-4127-b48e-0dbc1a3314d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:16.459738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9d08e-2616-4127-b48e-0dbc1a3314d6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:16.491134 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4105/8264] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:37:16 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:37:16.492305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35261dd4-485c-4229-b332-865d23816c58 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:16.504744 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35261dd4-485c-4229-b332-865d23816c58 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:16.561416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454dc01-bfce-4517-9451-5edc938c00e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:16.562026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454dc01-bfce-4517-9451-5edc938c00e5 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:16.562304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454dc01-bfce-4517-9451-5edc938c00e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:16.562620 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454dc01-bfce-4517-9451-5edc938c00e5 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:16.563249 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454dc01-bfce-4517-9451-5edc938c00e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:16.565144 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454dc01-bfce-4517-9451-5edc938c00e5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:16.588912 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4160/8265] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:37:16 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:37:16.590236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9d08e-2616-4127-b48e-0dbc1a3314d6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:16.601862 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9d08e-2616-4127-b48e-0dbc1a3314d6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:16.607554 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a106f2-6300-4f5d-ad7f-0987158251ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:16.608279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a106f2-6300-4f5d-ad7f-0987158251ca admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:16.608906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a106f2-6300-4f5d-ad7f-0987158251ca admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:16.608906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a106f2-6300-4f5d-ad7f-0987158251ca admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:16.609523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a106f2-6300-4f5d-ad7f-0987158251ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:16.611166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a106f2-6300-4f5d-ad7f-0987158251ca admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:16.625591 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4106/8266] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:37:16.626832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454dc01-bfce-4517-9451-5edc938c00e5 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:16.637407 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454dc01-bfce-4517-9451-5edc938c00e5 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:16.643238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4fe75-0aee-4882-8967-92b747277e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:16.643988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4fe75-0aee-4882-8967-92b747277e24 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:16.644269 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4fe75-0aee-4882-8967-92b747277e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:16.644544 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4fe75-0aee-4882-8967-92b747277e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:16.645186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab4fe75-0aee-4882-8967-92b747277e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:16.646974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab4fe75-0aee-4882-8967-92b747277e24 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:16.659761 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4161/8267] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:37:16.663813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a106f2-6300-4f5d-ad7f-0987158251ca admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:16.678476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a106f2-6300-4f5d-ad7f-0987158251ca admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:16.683309 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ab672-cc79-4a3c-b3c5-410b87d4fe34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:16.683973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ab672-cc79-4a3c-b3c5-410b87d4fe34 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:16.684275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ab672-cc79-4a3c-b3c5-410b87d4fe34 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:16.685124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ab672-cc79-4a3c-b3c5-410b87d4fe34 admin admin] PATH_INFO: `/v3/projects/d5392d62763646b4acb0e2278b6d38c8/users/7c3d841be849413b980b7142789ebaca/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:16.697120 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:16.702418 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ab672-cc79-4a3c-b3c5-410b87d4fe34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5392d62763646b4acb0e2278b6d38c8, user_id=7c3d841be849413b980b7142789ebaca, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:16.705899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ab672-cc79-4a3c-b3c5-410b87d4fe34 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:16.721043 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4107/8268] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:37:16 2022] PUT /identity/v3/projects/d5392d62763646b4acb0e2278b6d38c8/users/7c3d841be849413b980b7142789ebaca/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:16.732724 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5b675-8afe-4d48-a3eb-54a9f932e1e2 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:16.733011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5b675-8afe-4d48-a3eb-54a9f932e1e2 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:16.733289 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5b675-8afe-4d48-a3eb-54a9f932e1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:16.762580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-10a5b675-8afe-4d48-a3eb-54a9f932e1e2 None None] MFA Rules not processed for user `7c3d841be849413b980b7142789ebaca`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:16.765059 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-10a5b675-8afe-4d48-a3eb-54a9f932e1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:16.834016 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4162/8269] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:16.839473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ab672-cc79-4a3c-b3c5-410b87d4fe34 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:16.850740 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ab672-cc79-4a3c-b3c5-410b87d4fe34 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:16.854981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01435e7e-b6c5-4049-aae2-3407edfc40e9 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c3d841be849413b980b7142789ebaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5392d62763646b4acb0e2278b6d38c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:16.855774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01435e7e-b6c5-4049-aae2-3407edfc40e9 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:16.856143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01435e7e-b6c5-4049-aae2-3407edfc40e9 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:16.856617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01435e7e-b6c5-4049-aae2-3407edfc40e9 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] PATH_INFO: `/v3/users/7c3d841be849413b980b7142789ebaca/credentials/OS-EC2` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:16.857297 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01435e7e-b6c5-4049-aae2-3407edfc40e9 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=7c3d841be849413b980b7142789ebaca)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:16.858937 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01435e7e-b6c5-4049-aae2-3407edfc40e9 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:16.883162 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5b675-8afe-4d48-a3eb-54a9f932e1e2 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:16.886518 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4108/8270] 10.222.0.33 () {60 vars in 1299 bytes} [Sat Aug 6 21:37:16 2022] POST /identity/v3/users/7c3d841be849413b980b7142789ebaca/credentials/OS-EC2 => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:16.890941 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5b675-8afe-4d48-a3eb-54a9f932e1e2 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:16.895950 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48dff86-5deb-4522-9635-97bd03811344 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c3d841be849413b980b7142789ebaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5392d62763646b4acb0e2278b6d38c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:16.896815 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48dff86-5deb-4522-9635-97bd03811344 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:16.897100 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48dff86-5deb-4522-9635-97bd03811344 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:16.897373 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48dff86-5deb-4522-9635-97bd03811344 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] PATH_INFO: `/v3/users/7c3d841be849413b980b7142789ebaca/credentials/OS-EC2/0d94de1d010a42c38f39c3d58b4fe402` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:16.899547 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48dff86-5deb-4522-9635-97bd03811344 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=7c3d841be849413b980b7142789ebaca, credential_id=0d94de1d010a42c38f39c3d58b4fe402)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:16.900978 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48dff86-5deb-4522-9635-97bd03811344 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:16.920175 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4163/8271] 10.222.0.33 () {58 vars in 1380 bytes} [Sat Aug 6 21:37:16 2022] DELETE /identity/v3/users/7c3d841be849413b980b7142789ebaca/credentials/OS-EC2/0d94de1d010a42c38f39c3d58b4fe402 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:16.925177 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01435e7e-b6c5-4049-aae2-3407edfc40e9 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:16.936369 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01435e7e-b6c5-4049-aae2-3407edfc40e9 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:16.940857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed13bf-89e9-4cfc-9392-d5d72df357ad tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c3d841be849413b980b7142789ebaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5392d62763646b4acb0e2278b6d38c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:16.941496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed13bf-89e9-4cfc-9392-d5d72df357ad tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:16.941778 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed13bf-89e9-4cfc-9392-d5d72df357ad tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:16.942049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed13bf-89e9-4cfc-9392-d5d72df357ad tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] PATH_INFO: `/v3/users/7c3d841be849413b980b7142789ebaca/credentials/OS-EC2` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:16.942704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed13bf-89e9-4cfc-9392-d5d72df357ad tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=7c3d841be849413b980b7142789ebaca)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:16.944226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed13bf-89e9-4cfc-9392-d5d72df357ad tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:16.960530 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4109/8272] 10.222.0.33 () {60 vars in 1299 bytes} [Sat Aug 6 21:37:16 2022] POST /identity/v3/users/7c3d841be849413b980b7142789ebaca/credentials/OS-EC2 => generated 367 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:37:16.964595 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48dff86-5deb-4522-9635-97bd03811344 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:16.974097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48dff86-5deb-4522-9635-97bd03811344 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:16.978190 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52be104-f151-4c3f-8755-b20813c5b1df tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c3d841be849413b980b7142789ebaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5392d62763646b4acb0e2278b6d38c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:16.978861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52be104-f151-4c3f-8755-b20813c5b1df tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:16.979146 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52be104-f151-4c3f-8755-b20813c5b1df tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:16.979414 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52be104-f151-4c3f-8755-b20813c5b1df tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] PATH_INFO: `/v3/users/7c3d841be849413b980b7142789ebaca/credentials/OS-EC2/556bbf28dbe94c77b6c190104f1a8379` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:16.982005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52be104-f151-4c3f-8755-b20813c5b1df tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=7c3d841be849413b980b7142789ebaca, credential_id=556bbf28dbe94c77b6c190104f1a8379)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:16.984012 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52be104-f151-4c3f-8755-b20813c5b1df tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:17.000940 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4164/8273] 10.222.0.33 () {58 vars in 1380 bytes} [Sat Aug 6 21:37:16 2022] DELETE /identity/v3/users/7c3d841be849413b980b7142789ebaca/credentials/OS-EC2/556bbf28dbe94c77b6c190104f1a8379 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:17.005291 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed13bf-89e9-4cfc-9392-d5d72df357ad tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:17.016011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed13bf-89e9-4cfc-9392-d5d72df357ad tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:17.020362 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3220c61-283e-45fb-9d0a-5658b13ce20e tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c3d841be849413b980b7142789ebaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5392d62763646b4acb0e2278b6d38c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:17.021001 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3220c61-283e-45fb-9d0a-5658b13ce20e tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:17.021288 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3220c61-283e-45fb-9d0a-5658b13ce20e tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:17.021562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3220c61-283e-45fb-9d0a-5658b13ce20e tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] PATH_INFO: `/v3/users/7c3d841be849413b980b7142789ebaca/credentials/OS-EC2/556bbf28dbe94c77b6c190104f1a8379` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:17.049385 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application [None req-f3220c61-283e-45fb-9d0a-5658b13ce20e tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] Could not find credential: 8e21087b9fedead908099ffb1c947150cb4c376c45f4675df5130b299bd6e2ff.: keystone.exception.CredentialNotFound: Could not find credential: 8e21087b9fedead908099ffb1c947150cb4c376c45f4675df5130b299bd6e2ff. Aug 06 21:37:17.049385 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 21:37:17.049385 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 21:37:17.049385 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 21:37:17.049385 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 21:37:17.049385 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 21:37:17.049385 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 21:37:17.049385 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 21:37:17.049385 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 21:37:17.049385 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 21:37:17.049385 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 21:37:17.049385 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 21:37:17.049385 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Aug 06 21:37:17.049385 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Aug 06 21:37:17.050704 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 06 21:37:17.050704 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 06 21:37:17.050704 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Aug 06 21:37:17.050704 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Aug 06 21:37:17.050704 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 21:37:17.050704 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 21:37:17.050704 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Aug 06 21:37:17.050704 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Aug 06 21:37:17.050704 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 21:37:17.050704 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 21:37:17.050704 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 21:37:17.050704 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 21:37:17.050704 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 21:37:17.050704 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application with Lock( Aug 06 21:37:17.050704 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 21:37:17.050704 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._enter() Aug 06 21:37:17.052182 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 21:37:17.052182 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 21:37:17.052182 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 21:37:17.052182 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.creator() Aug 06 21:37:17.052182 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 21:37:17.052182 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application created_value = creator( Aug 06 21:37:17.052182 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Aug 06 21:37:17.052182 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Aug 06 21:37:17.052182 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Aug 06 21:37:17.052182 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Aug 06 21:37:17.052182 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Aug 06 21:37:17.052182 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Aug 06 21:37:17.052182 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: 8e21087b9fedead908099ffb1c947150cb4c376c45f4675df5130b299bd6e2ff. Aug 06 21:37:17.052182 ncdv-master-1 devstack@keystone.service[102758]: ERROR keystone.server.flask.application Aug 06 21:37:17.052182 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4110/8274] 10.222.0.33 () {58 vars in 1377 bytes} [Sat Aug 6 21:37:17 2022] GET /identity/v3/users/7c3d841be849413b980b7142789ebaca/credentials/OS-EC2/556bbf28dbe94c77b6c190104f1a8379 => generated 148 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 06 21:37:17.055940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52be104-f151-4c3f-8755-b20813c5b1df tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:17.066622 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52be104-f151-4c3f-8755-b20813c5b1df tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:17.070817 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363be5c1-0e40-40e8-8bf0-1c2f90950b27 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c3d841be849413b980b7142789ebaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5392d62763646b4acb0e2278b6d38c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:17.071445 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363be5c1-0e40-40e8-8bf0-1c2f90950b27 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:17.071727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363be5c1-0e40-40e8-8bf0-1c2f90950b27 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:17.072002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363be5c1-0e40-40e8-8bf0-1c2f90950b27 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] PATH_INFO: `/v3/users/7c3d841be849413b980b7142789ebaca/credentials/OS-EC2` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:17.072602 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363be5c1-0e40-40e8-8bf0-1c2f90950b27 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=7c3d841be849413b980b7142789ebaca)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:17.074082 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363be5c1-0e40-40e8-8bf0-1c2f90950b27 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:17.091958 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4165/8275] 10.222.0.33 () {60 vars in 1299 bytes} [Sat Aug 6 21:37:17 2022] POST /identity/v3/users/7c3d841be849413b980b7142789ebaca/credentials/OS-EC2 => generated 367 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:17.096639 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3220c61-283e-45fb-9d0a-5658b13ce20e tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:17.107617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3220c61-283e-45fb-9d0a-5658b13ce20e tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:17.111769 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d70fb-1f87-4441-a7b0-0b2204dfe28a tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c3d841be849413b980b7142789ebaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5392d62763646b4acb0e2278b6d38c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:17.112395 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d70fb-1f87-4441-a7b0-0b2204dfe28a tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:17.112673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d70fb-1f87-4441-a7b0-0b2204dfe28a tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:17.112946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d70fb-1f87-4441-a7b0-0b2204dfe28a tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] PATH_INFO: `/v3/users/7c3d841be849413b980b7142789ebaca/credentials/OS-EC2` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:17.113562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d70fb-1f87-4441-a7b0-0b2204dfe28a tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=7c3d841be849413b980b7142789ebaca)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:17.115099 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d70fb-1f87-4441-a7b0-0b2204dfe28a tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:17.134116 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4111/8276] 10.222.0.33 () {60 vars in 1299 bytes} [Sat Aug 6 21:37:17 2022] POST /identity/v3/users/7c3d841be849413b980b7142789ebaca/credentials/OS-EC2 => generated 367 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:17.135762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363be5c1-0e40-40e8-8bf0-1c2f90950b27 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:17.149343 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363be5c1-0e40-40e8-8bf0-1c2f90950b27 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:17.153932 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d23b8-c227-4fbe-a69a-58be1abdc8e6 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c3d841be849413b980b7142789ebaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5392d62763646b4acb0e2278b6d38c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:17.154670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d23b8-c227-4fbe-a69a-58be1abdc8e6 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:17.154956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d23b8-c227-4fbe-a69a-58be1abdc8e6 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:17.155233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d23b8-c227-4fbe-a69a-58be1abdc8e6 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] PATH_INFO: `/v3/users/7c3d841be849413b980b7142789ebaca/credentials/OS-EC2` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:17.155818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d23b8-c227-4fbe-a69a-58be1abdc8e6 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=7c3d841be849413b980b7142789ebaca)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:17.157430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d23b8-c227-4fbe-a69a-58be1abdc8e6 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:17.169795 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4166/8277] 10.222.0.33 () {58 vars in 1278 bytes} [Sat Aug 6 21:37:17 2022] GET /identity/v3/users/7c3d841be849413b980b7142789ebaca/credentials/OS-EC2 => generated 865 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:37:17.174002 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d70fb-1f87-4441-a7b0-0b2204dfe28a tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:17.183805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d70fb-1f87-4441-a7b0-0b2204dfe28a tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:17.188986 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91d2b5-b3a6-4f8f-97ed-42323c31f6db tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c3d841be849413b980b7142789ebaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5392d62763646b4acb0e2278b6d38c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:17.189620 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91d2b5-b3a6-4f8f-97ed-42323c31f6db tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:17.189907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91d2b5-b3a6-4f8f-97ed-42323c31f6db tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:17.190182 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91d2b5-b3a6-4f8f-97ed-42323c31f6db tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] PATH_INFO: `/v3/users/7c3d841be849413b980b7142789ebaca/credentials/OS-EC2/ecbf4820dee242e199226cfdede80902` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:17.192168 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91d2b5-b3a6-4f8f-97ed-42323c31f6db tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=7c3d841be849413b980b7142789ebaca, credential_id=ecbf4820dee242e199226cfdede80902)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:17.193587 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91d2b5-b3a6-4f8f-97ed-42323c31f6db tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:17.210393 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4112/8278] 10.222.0.33 () {58 vars in 1380 bytes} [Sat Aug 6 21:37:17 2022] DELETE /identity/v3/users/7c3d841be849413b980b7142789ebaca/credentials/OS-EC2/ecbf4820dee242e199226cfdede80902 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:17.214503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d23b8-c227-4fbe-a69a-58be1abdc8e6 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:17.224215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d23b8-c227-4fbe-a69a-58be1abdc8e6 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:17.228314 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c3106-157b-4067-8a4c-ab3bc769db37 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c3d841be849413b980b7142789ebaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5392d62763646b4acb0e2278b6d38c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:17.228953 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c3106-157b-4067-8a4c-ab3bc769db37 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:17.229233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c3106-157b-4067-8a4c-ab3bc769db37 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:17.229505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c3106-157b-4067-8a4c-ab3bc769db37 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] PATH_INFO: `/v3/users/7c3d841be849413b980b7142789ebaca/credentials/OS-EC2/c848af9d2d3e440b88183e72c941c0e1` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:17.232020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c3106-157b-4067-8a4c-ab3bc769db37 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=7c3d841be849413b980b7142789ebaca, credential_id=c848af9d2d3e440b88183e72c941c0e1)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:17.233425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c3106-157b-4067-8a4c-ab3bc769db37 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:17.237139 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:17.251950 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4167/8279] 10.222.0.33 () {58 vars in 1380 bytes} [Sat Aug 6 21:37:17 2022] DELETE /identity/v3/users/7c3d841be849413b980b7142789ebaca/credentials/OS-EC2/c848af9d2d3e440b88183e72c941c0e1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:17.257318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91d2b5-b3a6-4f8f-97ed-42323c31f6db tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:17.267422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91d2b5-b3a6-4f8f-97ed-42323c31f6db tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:17.271731 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591f32d-92f6-43af-84f2-265f532a499f tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c3d841be849413b980b7142789ebaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5392d62763646b4acb0e2278b6d38c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:17.272369 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591f32d-92f6-43af-84f2-265f532a499f tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:17.272653 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591f32d-92f6-43af-84f2-265f532a499f tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:17.272928 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591f32d-92f6-43af-84f2-265f532a499f tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] PATH_INFO: `/v3/users/7c3d841be849413b980b7142789ebaca/credentials/OS-EC2` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:17.273534 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6591f32d-92f6-43af-84f2-265f532a499f tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=7c3d841be849413b980b7142789ebaca)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:17.275100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6591f32d-92f6-43af-84f2-265f532a499f tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:17.290702 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4113/8280] 10.222.0.33 () {60 vars in 1299 bytes} [Sat Aug 6 21:37:17 2022] POST /identity/v3/users/7c3d841be849413b980b7142789ebaca/credentials/OS-EC2 => generated 367 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:17.295433 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c3106-157b-4067-8a4c-ab3bc769db37 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:17.305229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c3106-157b-4067-8a4c-ab3bc769db37 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:17.309381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e263d6a-2efd-4f8a-a219-a213064debf8 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c3d841be849413b980b7142789ebaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5392d62763646b4acb0e2278b6d38c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:17.310075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e263d6a-2efd-4f8a-a219-a213064debf8 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:17.310481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e263d6a-2efd-4f8a-a219-a213064debf8 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:17.310668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e263d6a-2efd-4f8a-a219-a213064debf8 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] PATH_INFO: `/v3/users/7c3d841be849413b980b7142789ebaca/credentials/OS-EC2/ec6a44f006ff462291bd0e7b8c1554b4` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:17.312606 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e263d6a-2efd-4f8a-a219-a213064debf8 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=7c3d841be849413b980b7142789ebaca, credential_id=ec6a44f006ff462291bd0e7b8c1554b4)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:17.314127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e263d6a-2efd-4f8a-a219-a213064debf8 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:17.316912 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4168/8281] 10.222.0.33 () {58 vars in 1377 bytes} [Sat Aug 6 21:37:17 2022] GET /identity/v3/users/7c3d841be849413b980b7142789ebaca/credentials/OS-EC2/ec6a44f006ff462291bd0e7b8c1554b4 => generated 367 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:37:17.321133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591f32d-92f6-43af-84f2-265f532a499f tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:17.331216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591f32d-92f6-43af-84f2-265f532a499f tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:17.335479 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64602e41-025c-41a8-896e-f5f0113f7fa6 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c3d841be849413b980b7142789ebaca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5392d62763646b4acb0e2278b6d38c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:17.336116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64602e41-025c-41a8-896e-f5f0113f7fa6 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:17.336397 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64602e41-025c-41a8-896e-f5f0113f7fa6 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:17.336674 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64602e41-025c-41a8-896e-f5f0113f7fa6 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] PATH_INFO: `/v3/users/7c3d841be849413b980b7142789ebaca/credentials/OS-EC2/ec6a44f006ff462291bd0e7b8c1554b4` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:17.338633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64602e41-025c-41a8-896e-f5f0113f7fa6 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=7c3d841be849413b980b7142789ebaca, credential_id=ec6a44f006ff462291bd0e7b8c1554b4)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:17.340080 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64602e41-025c-41a8-896e-f5f0113f7fa6 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:17.357631 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4114/8282] 10.222.0.33 () {58 vars in 1380 bytes} [Sat Aug 6 21:37:17 2022] DELETE /identity/v3/users/7c3d841be849413b980b7142789ebaca/credentials/OS-EC2/ec6a44f006ff462291bd0e7b8c1554b4 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:17.362536 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e263d6a-2efd-4f8a-a219-a213064debf8 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:17.442776 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e263d6a-2efd-4f8a-a219-a213064debf8 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:17.447467 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48916c37-1819-4334-81c8-c3076934df45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:17.448092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48916c37-1819-4334-81c8-c3076934df45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:17.448370 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48916c37-1819-4334-81c8-c3076934df45 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:17.448640 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48916c37-1819-4334-81c8-c3076934df45 admin admin] PATH_INFO: `/v3/users/7c3d841be849413b980b7142789ebaca` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:17.449942 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48916c37-1819-4334-81c8-c3076934df45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c3d841be849413b980b7142789ebaca)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:17.452933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48916c37-1819-4334-81c8-c3076934df45 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:17.470151 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64602e41-025c-41a8-896e-f5f0113f7fa6 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:17.471905 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-64602e41-025c-41a8-896e-f5f0113f7fa6 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:17.487431 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64602e41-025c-41a8-896e-f5f0113f7fa6 tempest-EC2CredentialsTest-518445156 tempest-EC2CredentialsTest-518445156-project] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:17.492510 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d1d97-cc12-4dc5-aeaf-88977be260f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:17.493277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d1d97-cc12-4dc5-aeaf-88977be260f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:17.493556 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d1d97-cc12-4dc5-aeaf-88977be260f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:17.493853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d1d97-cc12-4dc5-aeaf-88977be260f4 admin admin] PATH_INFO: `/v3/users/6bd3456e5b02470daf5d239b32149ce4` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:17.495148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d1d97-cc12-4dc5-aeaf-88977be260f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bd3456e5b02470daf5d239b32149ce4)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:17.497072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d1d97-cc12-4dc5-aeaf-88977be260f4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:17.509510 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-48916c37-1819-4334-81c8-c3076934df45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c3d841be849413b980b7142789ebaca'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:17.517658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-48916c37-1819-4334-81c8-c3076934df45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c3d841be849413b980b7142789ebaca'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:17.518352 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-48916c37-1819-4334-81c8-c3076934df45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c3d841be849413b980b7142789ebaca'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:17.519021 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-48916c37-1819-4334-81c8-c3076934df45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c3d841be849413b980b7142789ebaca'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:17.526986 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-48916c37-1819-4334-81c8-c3076934df45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c3d841be849413b980b7142789ebaca'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:17.546578 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4169/8283] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:37:17 2022] DELETE /identity/v3/users/7c3d841be849413b980b7142789ebaca => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:17.551188 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a404ae-9343-4e7e-a27c-8aa630630438 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:17.551541 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a404ae-9343-4e7e-a27c-8aa630630438 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:17.551814 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a404ae-9343-4e7e-a27c-8aa630630438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:17.552331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-896d1d97-cc12-4dc5-aeaf-88977be260f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bd3456e5b02470daf5d239b32149ce4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:17.553291 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-896d1d97-cc12-4dc5-aeaf-88977be260f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bd3456e5b02470daf5d239b32149ce4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:17.553928 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-896d1d97-cc12-4dc5-aeaf-88977be260f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bd3456e5b02470daf5d239b32149ce4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:17.562942 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-896d1d97-cc12-4dc5-aeaf-88977be260f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bd3456e5b02470daf5d239b32149ce4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:17.572457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-76a404ae-9343-4e7e-a27c-8aa630630438 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:17.573878 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-76a404ae-9343-4e7e-a27c-8aa630630438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:17.574825 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-896d1d97-cc12-4dc5-aeaf-88977be260f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bd3456e5b02470daf5d239b32149ce4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:17.588119 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4115/8284] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:37:17 2022] DELETE /identity/v3/users/6bd3456e5b02470daf5d239b32149ce4 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:37:17.594261 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf248ea-6f10-449c-aeff-cd7f63121bc6 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:17.594538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf248ea-6f10-449c-aeff-cd7f63121bc6 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:17.594898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf248ea-6f10-449c-aeff-cd7f63121bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:17.615705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-daf248ea-6f10-449c-aeff-cd7f63121bc6 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:17.616899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-daf248ea-6f10-449c-aeff-cd7f63121bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:17.637629 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4170/8285] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:37:17.643035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=82,keystone:INSERT=6,keystone:DELETE=12 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:17.648159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a404ae-9343-4e7e-a27c-8aa630630438 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:17.649629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-76a404ae-9343-4e7e-a27c-8aa630630438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:17.660186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:17.689326 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4116/8286] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:17.699616 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf248ea-6f10-449c-aeff-cd7f63121bc6 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:17.701558 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-daf248ea-6f10-449c-aeff-cd7f63121bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:17.721460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a404ae-9343-4e7e-a27c-8aa630630438 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:17.764603 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf248ea-6f10-449c-aeff-cd7f63121bc6 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:17.768715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77466bce-2262-4472-bf15-93499df964f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:17.769353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77466bce-2262-4472-bf15-93499df964f8 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:17.769638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77466bce-2262-4472-bf15-93499df964f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:17.769908 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77466bce-2262-4472-bf15-93499df964f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:17.770476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6767833-f280-4730-b552-b9f7d1c0ce28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:17.771116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6767833-f280-4730-b552-b9f7d1c0ce28 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:17.771395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6767833-f280-4730-b552-b9f7d1c0ce28 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:17.771672 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6767833-f280-4730-b552-b9f7d1c0ce28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:17.780550 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77466bce-2262-4472-bf15-93499df964f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:17.781607 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6767833-f280-4730-b552-b9f7d1c0ce28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:17.781998 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77466bce-2262-4472-bf15-93499df964f8 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:17.783312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6767833-f280-4730-b552-b9f7d1c0ce28 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:17.792340 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4117/8287] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:37:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:37:17.793371 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4171/8288] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:37:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:37:17.971699 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77466bce-2262-4472-bf15-93499df964f8 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:17.973886 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-77466bce-2262-4472-bf15-93499df964f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:17.999894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77466bce-2262-4472-bf15-93499df964f8 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:18.005285 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cdc5fe-c7d5-4b99-99d0-306e0e7d2d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:18.005922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdc5fe-c7d5-4b99-99d0-306e0e7d2d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:18.006203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdc5fe-c7d5-4b99-99d0-306e0e7d2d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:18.006479 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdc5fe-c7d5-4b99-99d0-306e0e7d2d67 admin admin] PATH_INFO: `/v3/projects/5a9c3445b6524f449a3df027184d1250` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:18.008247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cdc5fe-c7d5-4b99-99d0-306e0e7d2d67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a9c3445b6524f449a3df027184d1250)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:18.010165 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cdc5fe-c7d5-4b99-99d0-306e0e7d2d67 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:18.061437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-18cdc5fe-c7d5-4b99-99d0-306e0e7d2d67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a9c3445b6524f449a3df027184d1250', 'request_id': 'req-18cdc5fe-c7d5-4b99-99d0-306e0e7d2d67'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:18.067474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-18cdc5fe-c7d5-4b99-99d0-306e0e7d2d67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a9c3445b6524f449a3df027184d1250', 'request_id': 'req-18cdc5fe-c7d5-4b99-99d0-306e0e7d2d67'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:18.073953 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-18cdc5fe-c7d5-4b99-99d0-306e0e7d2d67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a9c3445b6524f449a3df027184d1250', 'request_id': 'req-18cdc5fe-c7d5-4b99-99d0-306e0e7d2d67'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:18.081189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6767833-f280-4730-b552-b9f7d1c0ce28 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:18.082647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d6767833-f280-4730-b552-b9f7d1c0ce28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:18.088633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-18cdc5fe-c7d5-4b99-99d0-306e0e7d2d67 admin admin] The token cache is being invalidate because project 5a9c3445b6524f449a3df027184d1250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:18.088933 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-18cdc5fe-c7d5-4b99-99d0-306e0e7d2d67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:18.089608 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-18cdc5fe-c7d5-4b99-99d0-306e0e7d2d67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:18.098177 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4118/8289] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:37:17 2022] DELETE /identity/v3/projects/5a9c3445b6524f449a3df027184d1250 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:18.099593 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee3059-cd3e-4cf3-85a5-b0ad51875623 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:18.099885 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee3059-cd3e-4cf3-85a5-b0ad51875623 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:18.100162 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee3059-cd3e-4cf3-85a5-b0ad51875623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:18.105381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6767833-f280-4730-b552-b9f7d1c0ce28 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:18.121848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-73ee3059-cd3e-4cf3-85a5-b0ad51875623 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:18.123788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-73ee3059-cd3e-4cf3-85a5-b0ad51875623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:18.167667 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc14952-329c-4ca4-abd5-cff8e3cab2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:18.168306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc14952-329c-4ca4-abd5-cff8e3cab2e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:18.168590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc14952-329c-4ca4-abd5-cff8e3cab2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:18.168869 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc14952-329c-4ca4-abd5-cff8e3cab2e0 admin admin] PATH_INFO: `/v3/projects/d5392d62763646b4acb0e2278b6d38c8` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:18.170206 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc14952-329c-4ca4-abd5-cff8e3cab2e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5392d62763646b4acb0e2278b6d38c8)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:18.172162 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc14952-329c-4ca4-abd5-cff8e3cab2e0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:18.173316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:18.187925 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4119/8290] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:18.195596 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391c19c-f5d6-4f23-be15-ad674f874c54 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:18.195890 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391c19c-f5d6-4f23-be15-ad674f874c54 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:18.196154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391c19c-f5d6-4f23-be15-ad674f874c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:18.216320 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-b391c19c-f5d6-4f23-be15-ad674f874c54 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:18.217519 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b391c19c-f5d6-4f23-be15-ad674f874c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:18.220709 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0dc14952-329c-4ca4-abd5-cff8e3cab2e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5392d62763646b4acb0e2278b6d38c8', 'request_id': 'req-0dc14952-329c-4ca4-abd5-cff8e3cab2e0'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:18.226508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0dc14952-329c-4ca4-abd5-cff8e3cab2e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5392d62763646b4acb0e2278b6d38c8', 'request_id': 'req-0dc14952-329c-4ca4-abd5-cff8e3cab2e0'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:18.234639 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0dc14952-329c-4ca4-abd5-cff8e3cab2e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5392d62763646b4acb0e2278b6d38c8', 'request_id': 'req-0dc14952-329c-4ca4-abd5-cff8e3cab2e0'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:18.236633 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:18.248581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0dc14952-329c-4ca4-abd5-cff8e3cab2e0 admin admin] The token cache is being invalidate because project d5392d62763646b4acb0e2278b6d38c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:18.249042 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0dc14952-329c-4ca4-abd5-cff8e3cab2e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:18.249768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0dc14952-329c-4ca4-abd5-cff8e3cab2e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:18.251352 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4172/8291] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:37:18 2022] DELETE /identity/v3/projects/d5392d62763646b4acb0e2278b6d38c8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:37:18.255867 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b4e52-cee6-419c-88f5-b50ec34d5538 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:18.256155 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b4e52-cee6-419c-88f5-b50ec34d5538 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:18.256429 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b4e52-cee6-419c-88f5-b50ec34d5538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:18.275883 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-766b4e52-cee6-419c-88f5-b50ec34d5538 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:18.277000 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-766b4e52-cee6-419c-88f5-b50ec34d5538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:18.280219 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4120/8292] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:37:18.284423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391c19c-f5d6-4f23-be15-ad674f874c54 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:18.285216 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4173/8293] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:37:18.292479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877723d-d9ae-4d21-b097-7157e7c90ebf None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:18.292760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877723d-d9ae-4d21-b097-7157e7c90ebf None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:18.293028 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877723d-d9ae-4d21-b097-7157e7c90ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:18.293594 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391c19c-f5d6-4f23-be15-ad674f874c54 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:18.298338 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76f150-53ff-4cd2-ae95-04bc762066ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:18.298961 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76f150-53ff-4cd2-ae95-04bc762066ec admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:18.299242 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76f150-53ff-4cd2-ae95-04bc762066ec admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:18.299519 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76f150-53ff-4cd2-ae95-04bc762066ec admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:18.300164 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76f150-53ff-4cd2-ae95-04bc762066ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:37:18.300469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76f150-53ff-4cd2-ae95-04bc762066ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:18.302068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76f150-53ff-4cd2-ae95-04bc762066ec admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:18.312545 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-5877723d-d9ae-4d21-b097-7157e7c90ebf None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:18.313730 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5877723d-d9ae-4d21-b097-7157e7c90ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:18.318197 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4121/8294] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:37:18.319382 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76f150-53ff-4cd2-ae95-04bc762066ec admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:18.321822 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4174/8295] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:37:18.325705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877723d-d9ae-4d21-b097-7157e7c90ebf None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:18.329596 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76f150-53ff-4cd2-ae95-04bc762066ec admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:18.334408 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527ad1c-b819-48a9-9421-d77420b76c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:18.335038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527ad1c-b819-48a9-9421-d77420b76c42 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:18.335317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527ad1c-b819-48a9-9421-d77420b76c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:18.335505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877723d-d9ae-4d21-b097-7157e7c90ebf None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:18.335626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527ad1c-b819-48a9-9421-d77420b76c42 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:18.336188 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1527ad1c-b819-48a9-9421-d77420b76c42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:18.338079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1527ad1c-b819-48a9-9421-d77420b76c42 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:18.340162 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecfbd6b-1862-40b1-9f9f-0931e794fa03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:18.340742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecfbd6b-1862-40b1-9f9f-0931e794fa03 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:18.341657 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecfbd6b-1862-40b1-9f9f-0931e794fa03 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:18.342062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecfbd6b-1862-40b1-9f9f-0931e794fa03 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:18.342783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecfbd6b-1862-40b1-9f9f-0931e794fa03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:37:18.343088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecfbd6b-1862-40b1-9f9f-0931e794fa03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:18.344647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecfbd6b-1862-40b1-9f9f-0931e794fa03 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:18.356545 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4175/8296] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:37:18.361749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecfbd6b-1862-40b1-9f9f-0931e794fa03 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:18.370634 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4122/8297] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:37:18 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:37:18.371593 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527ad1c-b819-48a9-9421-d77420b76c42 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:18.375700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecfbd6b-1862-40b1-9f9f-0931e794fa03 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:18.433549 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9225316-cac3-48fe-a639-c3f3f26c0e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:18.434157 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9225316-cac3-48fe-a639-c3f3f26c0e42 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:18.434346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527ad1c-b819-48a9-9421-d77420b76c42 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:18.434472 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9225316-cac3-48fe-a639-c3f3f26c0e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:18.434958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9225316-cac3-48fe-a639-c3f3f26c0e42 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:18.435633 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9225316-cac3-48fe-a639-c3f3f26c0e42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:18.437594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9225316-cac3-48fe-a639-c3f3f26c0e42 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:18.439269 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05022c-fa28-411f-87b3-e71c7c0230cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:18.439869 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05022c-fa28-411f-87b3-e71c7c0230cd admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:18.440152 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05022c-fa28-411f-87b3-e71c7c0230cd admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:18.440427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05022c-fa28-411f-87b3-e71c7c0230cd admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:18.441041 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05022c-fa28-411f-87b3-e71c7c0230cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:18.443005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05022c-fa28-411f-87b3-e71c7c0230cd admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:18.469384 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4123/8298] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:37:18 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:37:18.469737 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4176/8299] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:37:18 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:37:18.470575 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05022c-fa28-411f-87b3-e71c7c0230cd admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:18.470723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9225316-cac3-48fe-a639-c3f3f26c0e42 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:18.480276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05022c-fa28-411f-87b3-e71c7c0230cd admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:18.526949 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:18.535619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9225316-cac3-48fe-a639-c3f3f26c0e42 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:18.538092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568425d-b853-4db0-9230-66df7f8ec28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:18.538737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568425d-b853-4db0-9230-66df7f8ec28f admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:18.539076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568425d-b853-4db0-9230-66df7f8ec28f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:18.539356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568425d-b853-4db0-9230-66df7f8ec28f admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:18.539972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568425d-b853-4db0-9230-66df7f8ec28f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:18.540453 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90828c91-6e00-434a-89ac-35140d9b9d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:18.541085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90828c91-6e00-434a-89ac-35140d9b9d0a admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:18.541367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90828c91-6e00-434a-89ac-35140d9b9d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:18.541646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90828c91-6e00-434a-89ac-35140d9b9d0a admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:18.541929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568425d-b853-4db0-9230-66df7f8ec28f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:18.542287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90828c91-6e00-434a-89ac-35140d9b9d0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:18.543945 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90828c91-6e00-434a-89ac-35140d9b9d0a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:18.555421 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4177/8300] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:37:18.560564 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90828c91-6e00-434a-89ac-35140d9b9d0a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:18.566424 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4124/8301] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:37:18 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:18.570367 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568425d-b853-4db0-9230-66df7f8ec28f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:18.570997 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90828c91-6e00-434a-89ac-35140d9b9d0a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:18.576244 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ca509-3f14-4bf3-9386-a07a75ce69cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:18.577434 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ca509-3f14-4bf3-9386-a07a75ce69cb admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:18.577710 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ca509-3f14-4bf3-9386-a07a75ce69cb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:18.577983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ca509-3f14-4bf3-9386-a07a75ce69cb admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:18.578660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ca509-3f14-4bf3-9386-a07a75ce69cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:18.580231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ca509-3f14-4bf3-9386-a07a75ce69cb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:18.580507 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568425d-b853-4db0-9230-66df7f8ec28f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:18.585488 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edc248-073b-43a7-a827-f8d893ed0da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:18.586071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edc248-073b-43a7-a827-f8d893ed0da6 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:18.586354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edc248-073b-43a7-a827-f8d893ed0da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:18.586665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edc248-073b-43a7-a827-f8d893ed0da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:18.587312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78edc248-073b-43a7-a827-f8d893ed0da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:18.588901 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78edc248-073b-43a7-a827-f8d893ed0da6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:18.590329 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4178/8302] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:37:18.594828 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ca509-3f14-4bf3-9386-a07a75ce69cb admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:18.600315 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4125/8303] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:37:18.604070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edc248-073b-43a7-a827-f8d893ed0da6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:18.605005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ca509-3f14-4bf3-9386-a07a75ce69cb admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:18.610976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75767b-c712-4815-b81f-38e9417b0aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:18.611613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75767b-c712-4815-b81f-38e9417b0aa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:18.611891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75767b-c712-4815-b81f-38e9417b0aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:18.612160 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75767b-c712-4815-b81f-38e9417b0aa0 admin admin] PATH_INFO: `/v3/projects/f1717e5962c04361a60d4cdf11feb845/users/a9f375fee6814e138c932f214d4babc9/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:18.614705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edc248-073b-43a7-a827-f8d893ed0da6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:18.619513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb75097-f435-4021-b80d-0e1644279f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:18.620109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb75097-f435-4021-b80d-0e1644279f07 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:18.620389 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb75097-f435-4021-b80d-0e1644279f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:18.620664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb75097-f435-4021-b80d-0e1644279f07 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:18.621290 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb75097-f435-4021-b80d-0e1644279f07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:18.623585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb75097-f435-4021-b80d-0e1644279f07 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:18.627809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c75767b-c712-4815-b81f-38e9417b0aa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1717e5962c04361a60d4cdf11feb845, user_id=a9f375fee6814e138c932f214d4babc9, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:18.630514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c75767b-c712-4815-b81f-38e9417b0aa0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:18.633810 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4126/8304] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:37:18.638331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb75097-f435-4021-b80d-0e1644279f07 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:18.650763 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4179/8305] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:37:18 2022] PUT /identity/v3/projects/f1717e5962c04361a60d4cdf11feb845/users/a9f375fee6814e138c932f214d4babc9/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:18.652248 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb75097-f435-4021-b80d-0e1644279f07 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:18.667286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f2642-4280-496f-be3a-8ed5e8ea991c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:18.667286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f2642-4280-496f-be3a-8ed5e8ea991c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:18.667286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f2642-4280-496f-be3a-8ed5e8ea991c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:18.695532 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-514f2642-4280-496f-be3a-8ed5e8ea991c None None] MFA Rules not processed for user `a9f375fee6814e138c932f214d4babc9`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:18.696740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-514f2642-4280-496f-be3a-8ed5e8ea991c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:18.700720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:18.718337 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c2894-eb3c-48de-bd46-ccab6c45b7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:18.719023 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c2894-eb3c-48de-bd46-ccab6c45b7de admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:18.719297 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c2894-eb3c-48de-bd46-ccab6c45b7de admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:18.719567 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c2894-eb3c-48de-bd46-ccab6c45b7de admin admin] PATH_INFO: `/v3/projects/fb06c358792c463bbd4173fc213946d9/users/f3e7154abb5840d2a72a299e8aa0e476/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:18.734724 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c2894-eb3c-48de-bd46-ccab6c45b7de admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb06c358792c463bbd4173fc213946d9, user_id=f3e7154abb5840d2a72a299e8aa0e476, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:18.737375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c2894-eb3c-48de-bd46-ccab6c45b7de admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:18.752307 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4127/8306] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:37:18 2022] PUT /identity/v3/projects/fb06c358792c463bbd4173fc213946d9/users/f3e7154abb5840d2a72a299e8aa0e476/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:37:18.763203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8a7b9-4aa1-42a6-889c-5a5083d50269 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:18.763500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8a7b9-4aa1-42a6-889c-5a5083d50269 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:18.764019 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8a7b9-4aa1-42a6-889c-5a5083d50269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:18.765460 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4180/8307] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:37:18.769741 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f2642-4280-496f-be3a-8ed5e8ea991c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:18.780812 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f2642-4280-496f-be3a-8ed5e8ea991c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:18.793892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d6c8a7b9-4aa1-42a6-889c-5a5083d50269 None None] MFA Rules not processed for user `f3e7154abb5840d2a72a299e8aa0e476`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:18.795770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d6c8a7b9-4aa1-42a6-889c-5a5083d50269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:18.845630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79777ded-5a7d-4e44-ade9-cfee192248c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:18.846239 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79777ded-5a7d-4e44-ade9-cfee192248c3 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:18.846563 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79777ded-5a7d-4e44-ade9-cfee192248c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:18.846851 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79777ded-5a7d-4e44-ade9-cfee192248c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:18.847488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79777ded-5a7d-4e44-ade9-cfee192248c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:18.849447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79777ded-5a7d-4e44-ade9-cfee192248c3 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:18.867342 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4128/8308] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:37:18.872045 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8a7b9-4aa1-42a6-889c-5a5083d50269 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:18.878178 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4181/8309] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:37:18 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:37:18.881979 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79777ded-5a7d-4e44-ade9-cfee192248c3 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:18.885514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8a7b9-4aa1-42a6-889c-5a5083d50269 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:18.914859 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:18.944020 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf22a2c-7efc-46c5-a43e-211c16432466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:18.944632 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf22a2c-7efc-46c5-a43e-211c16432466 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:18.944839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79777ded-5a7d-4e44-ade9-cfee192248c3 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:18.944999 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf22a2c-7efc-46c5-a43e-211c16432466 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:18.945365 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf22a2c-7efc-46c5-a43e-211c16432466 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:18.945918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf22a2c-7efc-46c5-a43e-211c16432466 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:18.947903 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf22a2c-7efc-46c5-a43e-211c16432466 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:18.949685 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8a5ec-d605-42c2-969e-7dbf96db97f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:18.950311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8a5ec-d605-42c2-969e-7dbf96db97f4 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:18.951203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8a5ec-d605-42c2-969e-7dbf96db97f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:18.951590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8a5ec-d605-42c2-969e-7dbf96db97f4 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:18.952201 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b8a5ec-d605-42c2-969e-7dbf96db97f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:18.954089 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b8a5ec-d605-42c2-969e-7dbf96db97f4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:18.976080 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4182/8310] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:37:18 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:37:18.976319 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4129/8310] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:37:18 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:37:18.980152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8a5ec-d605-42c2-969e-7dbf96db97f4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:18.983386 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf22a2c-7efc-46c5-a43e-211c16432466 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:18.990418 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8a5ec-d605-42c2-969e-7dbf96db97f4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:19.006947 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:19.045818 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf22a2c-7efc-46c5-a43e-211c16432466 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:19.049177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81085773-7479-4048-99ce-95014ff1fe4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:19.049783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81085773-7479-4048-99ce-95014ff1fe4c admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:19.050090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81085773-7479-4048-99ce-95014ff1fe4c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:19.050345 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c1836-554b-4908-bc36-e345631673b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:19.050481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81085773-7479-4048-99ce-95014ff1fe4c admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:19.050966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c1836-554b-4908-bc36-e345631673b9 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:19.051085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81085773-7479-4048-99ce-95014ff1fe4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:19.051243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c1836-554b-4908-bc36-e345631673b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:19.051514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c1836-554b-4908-bc36-e345631673b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:19.052140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c1836-554b-4908-bc36-e345631673b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:19.053143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81085773-7479-4048-99ce-95014ff1fe4c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:19.053979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c1836-554b-4908-bc36-e345631673b9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:19.064541 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4130/8311] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:37:19.068883 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c1836-554b-4908-bc36-e345631673b9 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:19.075736 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4183/8312] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:37:18 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:19.079332 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81085773-7479-4048-99ce-95014ff1fe4c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:19.080869 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c1836-554b-4908-bc36-e345631673b9 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:19.085786 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce59448-a6bd-4aa5-bad8-6f207f6efac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:19.086439 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce59448-a6bd-4aa5-bad8-6f207f6efac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:19.086755 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce59448-a6bd-4aa5-bad8-6f207f6efac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:19.087036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce59448-a6bd-4aa5-bad8-6f207f6efac3 admin admin] PATH_INFO: `/v3/projects/a6a9b4847e074bed97a7fb1b2ba63901/users/9f8b51fba6b94f5ea75641c2b7622adb/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:19.089232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81085773-7479-4048-99ce-95014ff1fe4c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:19.094717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf4d6b-edb0-4cbe-8d95-1d540d09b42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:19.095196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf4d6b-edb0-4cbe-8d95-1d540d09b42d admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:19.095473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf4d6b-edb0-4cbe-8d95-1d540d09b42d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:19.095876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf4d6b-edb0-4cbe-8d95-1d540d09b42d admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:19.096516 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf4d6b-edb0-4cbe-8d95-1d540d09b42d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:19.098130 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf4d6b-edb0-4cbe-8d95-1d540d09b42d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:19.103671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce59448-a6bd-4aa5-bad8-6f207f6efac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6a9b4847e074bed97a7fb1b2ba63901, user_id=9f8b51fba6b94f5ea75641c2b7622adb, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:19.106444 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce59448-a6bd-4aa5-bad8-6f207f6efac3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:19.111320 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4184/8313] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:37:19.115290 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf4d6b-edb0-4cbe-8d95-1d540d09b42d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:19.120803 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4131/8314] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:37:19 2022] PUT /identity/v3/projects/a6a9b4847e074bed97a7fb1b2ba63901/users/9f8b51fba6b94f5ea75641c2b7622adb/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:19.124473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce59448-a6bd-4aa5-bad8-6f207f6efac3 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:19.125298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf4d6b-edb0-4cbe-8d95-1d540d09b42d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:19.183612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daca0a2-9850-4e5c-ab43-061d2ef170a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:19.184214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daca0a2-9850-4e5c-ab43-061d2ef170a2 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:19.184490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daca0a2-9850-4e5c-ab43-061d2ef170a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:19.184793 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daca0a2-9850-4e5c-ab43-061d2ef170a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:19.185464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daca0a2-9850-4e5c-ab43-061d2ef170a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:19.187094 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daca0a2-9850-4e5c-ab43-061d2ef170a2 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:19.188660 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce59448-a6bd-4aa5-bad8-6f207f6efac3 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:19.193291 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf92ed-6372-41ce-949e-2f6a3baaf32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:19.193890 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf92ed-6372-41ce-949e-2f6a3baaf32b admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:19.194163 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf92ed-6372-41ce-949e-2f6a3baaf32b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:19.194440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf92ed-6372-41ce-949e-2f6a3baaf32b admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:19.195100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf92ed-6372-41ce-949e-2f6a3baaf32b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:19.196672 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf92ed-6372-41ce-949e-2f6a3baaf32b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:19.197276 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4185/8316] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:37:19.203893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daca0a2-9850-4e5c-ab43-061d2ef170a2 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:19.208425 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4132/8317] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:37:19.212404 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf92ed-6372-41ce-949e-2f6a3baaf32b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:19.213532 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daca0a2-9850-4e5c-ab43-061d2ef170a2 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:19.218340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9f622-9e4a-41e1-ad98-d0861e530381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:19.219016 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9f622-9e4a-41e1-ad98-d0861e530381 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:19.219297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9f622-9e4a-41e1-ad98-d0861e530381 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:19.219572 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9f622-9e4a-41e1-ad98-d0861e530381 admin admin] PATH_INFO: `/v3/projects/282ba1108a4c4fbe94794ea9985f09a3/users/81d7bc1899034d4db1fd0dea9239f77b/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:19.222061 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf92ed-6372-41ce-949e-2f6a3baaf32b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:19.229325 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739a5a5-b2cd-44a6-aba8-7a7f516243e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:19.230084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739a5a5-b2cd-44a6-aba8-7a7f516243e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:19.230380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739a5a5-b2cd-44a6-aba8-7a7f516243e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:19.230689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739a5a5-b2cd-44a6-aba8-7a7f516243e4 admin admin] PATH_INFO: `/v3/projects/a6a9b4847e074bed97a7fb1b2ba63901/users/9f8b51fba6b94f5ea75641c2b7622adb/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:19.233441 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739a5a5-b2cd-44a6-aba8-7a7f516243e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6a9b4847e074bed97a7fb1b2ba63901, user_id=9f8b51fba6b94f5ea75641c2b7622adb, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:19.234811 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df9f622-9e4a-41e1-ad98-d0861e530381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=282ba1108a4c4fbe94794ea9985f09a3, user_id=81d7bc1899034d4db1fd0dea9239f77b, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:19.236225 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739a5a5-b2cd-44a6-aba8-7a7f516243e4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:19.237436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df9f622-9e4a-41e1-ad98-d0861e530381 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:19.246667 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4133/8318] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:37:19 2022] PUT /identity/v3/projects/a6a9b4847e074bed97a7fb1b2ba63901/users/9f8b51fba6b94f5ea75641c2b7622adb/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:37:19.251762 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4186/8319] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:37:19 2022] PUT /identity/v3/projects/282ba1108a4c4fbe94794ea9985f09a3/users/81d7bc1899034d4db1fd0dea9239f77b/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:19.257542 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44257b-707d-44f8-a3dc-417cb3142190 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:19.257832 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44257b-707d-44f8-a3dc-417cb3142190 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:19.258106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44257b-707d-44f8-a3dc-417cb3142190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:19.262949 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d58b1-85b4-4e55-8beb-66ca897817ab None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:19.263241 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d58b1-85b4-4e55-8beb-66ca897817ab None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:19.263519 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d58b1-85b4-4e55-8beb-66ca897817ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:19.279967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:19.289144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-ba44257b-707d-44f8-a3dc-417cb3142190 None None] MFA Rules not processed for user `9f8b51fba6b94f5ea75641c2b7622adb`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:19.290791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ba44257b-707d-44f8-a3dc-417cb3142190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:19.290998 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d12d58b1-85b4-4e55-8beb-66ca897817ab None None] MFA Rules not processed for user `81d7bc1899034d4db1fd0dea9239f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:19.292199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d12d58b1-85b4-4e55-8beb-66ca897817ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:19.358183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:19.362584 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4187/8320] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:19.367017 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d58b1-85b4-4e55-8beb-66ca897817ab None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:19.367510 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4134/8321] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:19.380394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44257b-707d-44f8-a3dc-417cb3142190 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:19.381808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ba44257b-707d-44f8-a3dc-417cb3142190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:19.426017 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d58b1-85b4-4e55-8beb-66ca897817ab None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:19.430738 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f88b6b-2887-40fe-98fc-841ee98caff5 tempest-IdentityV3ProjectsTest-2030698056 tempest-IdentityV3ProjectsTest-2030698056-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3e7154abb5840d2a72a299e8aa0e476', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb06c358792c463bbd4173fc213946d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:19.431364 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f88b6b-2887-40fe-98fc-841ee98caff5 tempest-IdentityV3ProjectsTest-2030698056 tempest-IdentityV3ProjectsTest-2030698056-project] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:19.431642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f88b6b-2887-40fe-98fc-841ee98caff5 tempest-IdentityV3ProjectsTest-2030698056 tempest-IdentityV3ProjectsTest-2030698056-project] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:19.431912 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f88b6b-2887-40fe-98fc-841ee98caff5 tempest-IdentityV3ProjectsTest-2030698056 tempest-IdentityV3ProjectsTest-2030698056-project] PATH_INFO: `/v3/users/f3e7154abb5840d2a72a299e8aa0e476/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:19.433073 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f88b6b-2887-40fe-98fc-841ee98caff5 tempest-IdentityV3ProjectsTest-2030698056 tempest-IdentityV3ProjectsTest-2030698056-project] RBAC: Authorizing `identity:list_user_projects(user_id=f3e7154abb5840d2a72a299e8aa0e476)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:19.435050 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f88b6b-2887-40fe-98fc-841ee98caff5 tempest-IdentityV3ProjectsTest-2030698056 tempest-IdentityV3ProjectsTest-2030698056-project] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:19.441989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44257b-707d-44f8-a3dc-417cb3142190 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:19.445599 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b084fb-ff3f-4ef3-89ed-30fbb8a60fbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:19.446192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b084fb-ff3f-4ef3-89ed-30fbb8a60fbc service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:19.446466 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b084fb-ff3f-4ef3-89ed-30fbb8a60fbc service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:19.446791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b084fb-ff3f-4ef3-89ed-30fbb8a60fbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:19.456543 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b084fb-ff3f-4ef3-89ed-30fbb8a60fbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:19.457974 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b084fb-ff3f-4ef3-89ed-30fbb8a60fbc service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:19.468799 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4135/8322] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:37:19 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:37:19.474620 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4188/8323] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Aug 6 21:37:19 2022] GET /identity/v3/users/f3e7154abb5840d2a72a299e8aa0e476/projects => generated 517 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:37:19.478831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24654f4b-9d46-446e-bc7c-04cf6320acac None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:19.479116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24654f4b-9d46-446e-bc7c-04cf6320acac None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:19.479395 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24654f4b-9d46-446e-bc7c-04cf6320acac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:19.508460 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-24654f4b-9d46-446e-bc7c-04cf6320acac None None] MFA Rules not processed for user `f3e7154abb5840d2a72a299e8aa0e476`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:19.509659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-24654f4b-9d46-446e-bc7c-04cf6320acac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:19.518098 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4136/8324] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:19.522771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e7696-605f-4f99-ad6a-3825d9d74be7 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:19.523055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e7696-605f-4f99-ad6a-3825d9d74be7 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:19.523325 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e7696-605f-4f99-ad6a-3825d9d74be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:19.544939 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-c70e7696-605f-4f99-ad6a-3825d9d74be7 None None] MFA Rules not processed for user `f3e7154abb5840d2a72a299e8aa0e476`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:19.546131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c70e7696-605f-4f99-ad6a-3825d9d74be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:19.549614 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24654f4b-9d46-446e-bc7c-04cf6320acac None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:19.562890 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24654f4b-9d46-446e-bc7c-04cf6320acac None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:19.566749 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e6aca-2389-41ea-8c18-7303353aab86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:19.567347 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e6aca-2389-41ea-8c18-7303353aab86 service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:19.567624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e6aca-2389-41ea-8c18-7303353aab86 service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:19.567892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e6aca-2389-41ea-8c18-7303353aab86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:19.593361 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.models.token_model [None req-c70e7696-605f-4f99-ad6a-3825d9d74be7 None None] User f3e7154abb5840d2a72a299e8aa0e476 has no access to project 282ba1108a4c4fbe94794ea9985f09a3 {{(pid=102759) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Aug 06 21:37:19.597087 ncdv-master-1 devstack@keystone.service[102759]: WARNING keystone.server.flask.application [None req-c70e7696-605f-4f99-ad6a-3825d9d74be7 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.33: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 06 21:37:19.598485 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4189/8325] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:19 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 77 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 06 21:37:19.603404 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e7696-605f-4f99-ad6a-3825d9d74be7 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:19.629123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e6aca-2389-41ea-8c18-7303353aab86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:19.630506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e6aca-2389-41ea-8c18-7303353aab86 service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:19.640633 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4137/8326] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:37:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:37:19.679337 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e7696-605f-4f99-ad6a-3825d9d74be7 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:19.690634 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67e7c3-8ffd-451c-b083-3441ea550c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:19.691643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67e7c3-8ffd-451c-b083-3441ea550c9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:19.692111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67e7c3-8ffd-451c-b083-3441ea550c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:19.692959 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67e7c3-8ffd-451c-b083-3441ea550c9f admin admin] PATH_INFO: `/v3/users/f3e7154abb5840d2a72a299e8aa0e476` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:19.694320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67e7c3-8ffd-451c-b083-3441ea550c9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3e7154abb5840d2a72a299e8aa0e476)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:19.697203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67e7c3-8ffd-451c-b083-3441ea550c9f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:19.729028 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:19.749440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-be67e7c3-8ffd-451c-b083-3441ea550c9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3e7154abb5840d2a72a299e8aa0e476'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:19.757880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-be67e7c3-8ffd-451c-b083-3441ea550c9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3e7154abb5840d2a72a299e8aa0e476'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:19.758973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-be67e7c3-8ffd-451c-b083-3441ea550c9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3e7154abb5840d2a72a299e8aa0e476'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:19.759949 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-be67e7c3-8ffd-451c-b083-3441ea550c9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3e7154abb5840d2a72a299e8aa0e476'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:19.769788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-be67e7c3-8ffd-451c-b083-3441ea550c9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3e7154abb5840d2a72a299e8aa0e476'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:19.789264 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4190/8327] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:37:19 2022] DELETE /identity/v3/users/f3e7154abb5840d2a72a299e8aa0e476 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:37:19.793801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d19d8-bc07-46f8-a537-f2b037296aa9 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:19.794162 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d19d8-bc07-46f8-a537-f2b037296aa9 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:19.794448 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d19d8-bc07-46f8-a537-f2b037296aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:19.814062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-cb6d19d8-bc07-46f8-a537-f2b037296aa9 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:19.815292 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-cb6d19d8-bc07-46f8-a537-f2b037296aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:19.834206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:19.874170 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4138/8328] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:19.884068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67e7c3-8ffd-451c-b083-3441ea550c9f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:19.885809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-be67e7c3-8ffd-451c-b083-3441ea550c9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:19.945959 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67e7c3-8ffd-451c-b083-3441ea550c9f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:19.949583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cddcf1c-9155-4318-aba5-523481426141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:19.950179 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddcf1c-9155-4318-aba5-523481426141 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:19.951020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddcf1c-9155-4318-aba5-523481426141 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:19.951291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddcf1c-9155-4318-aba5-523481426141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:19.960077 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cddcf1c-9155-4318-aba5-523481426141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:19.961839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cddcf1c-9155-4318-aba5-523481426141 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:19.971158 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4191/8329] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:37:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:37:20.246201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d19d8-bc07-46f8-a537-f2b037296aa9 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:20.247864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-cb6d19d8-bc07-46f8-a537-f2b037296aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:20.260277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d19d8-bc07-46f8-a537-f2b037296aa9 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:20.265525 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b4dab-2520-45bd-a380-2b76438f6e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:20.266159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b4dab-2520-45bd-a380-2b76438f6e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:20.266440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b4dab-2520-45bd-a380-2b76438f6e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:20.266745 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b4dab-2520-45bd-a380-2b76438f6e74 admin admin] PATH_INFO: `/v3/projects/fb06c358792c463bbd4173fc213946d9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:20.267998 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b4dab-2520-45bd-a380-2b76438f6e74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb06c358792c463bbd4173fc213946d9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:20.269913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b4dab-2520-45bd-a380-2b76438f6e74 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:20.316634 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4c5b4dab-2520-45bd-a380-2b76438f6e74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb06c358792c463bbd4173fc213946d9', 'request_id': 'req-4c5b4dab-2520-45bd-a380-2b76438f6e74'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:20.322089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4c5b4dab-2520-45bd-a380-2b76438f6e74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb06c358792c463bbd4173fc213946d9', 'request_id': 'req-4c5b4dab-2520-45bd-a380-2b76438f6e74'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:20.328778 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4c5b4dab-2520-45bd-a380-2b76438f6e74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb06c358792c463bbd4173fc213946d9', 'request_id': 'req-4c5b4dab-2520-45bd-a380-2b76438f6e74'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:20.341703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4c5b4dab-2520-45bd-a380-2b76438f6e74 admin admin] The token cache is being invalidate because project fb06c358792c463bbd4173fc213946d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:20.342161 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4c5b4dab-2520-45bd-a380-2b76438f6e74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:20.342826 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-4c5b4dab-2520-45bd-a380-2b76438f6e74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:20.344306 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4139/8330] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:37:20 2022] DELETE /identity/v3/projects/fb06c358792c463bbd4173fc213946d9 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:20.348288 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cddcf1c-9155-4318-aba5-523481426141 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:20.358180 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cddcf1c-9155-4318-aba5-523481426141 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:20.412820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706854f-7ed0-40f5-a65e-91da0cba6e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:20.413496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706854f-7ed0-40f5-a65e-91da0cba6e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:20.413786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706854f-7ed0-40f5-a65e-91da0cba6e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:20.414069 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706854f-7ed0-40f5-a65e-91da0cba6e72 admin admin] PATH_INFO: `/v3/users/81d7bc1899034d4db1fd0dea9239f77b` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:20.415243 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706854f-7ed0-40f5-a65e-91da0cba6e72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81d7bc1899034d4db1fd0dea9239f77b)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:20.417339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706854f-7ed0-40f5-a65e-91da0cba6e72 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:20.464047 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3706854f-7ed0-40f5-a65e-91da0cba6e72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81d7bc1899034d4db1fd0dea9239f77b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:20.465264 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:20.475191 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3706854f-7ed0-40f5-a65e-91da0cba6e72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81d7bc1899034d4db1fd0dea9239f77b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:20.475861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3706854f-7ed0-40f5-a65e-91da0cba6e72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81d7bc1899034d4db1fd0dea9239f77b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:20.476484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3706854f-7ed0-40f5-a65e-91da0cba6e72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81d7bc1899034d4db1fd0dea9239f77b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:20.483615 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3706854f-7ed0-40f5-a65e-91da0cba6e72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81d7bc1899034d4db1fd0dea9239f77b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:20.500983 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4192/8331] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:37:20 2022] DELETE /identity/v3/users/81d7bc1899034d4db1fd0dea9239f77b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:20.780848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b4dab-2520-45bd-a380-2b76438f6e74 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:20.782354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4c5b4dab-2520-45bd-a380-2b76438f6e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:20.802589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b4dab-2520-45bd-a380-2b76438f6e74 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:20.866145 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd75d8-3722-4103-91b5-25a04b437082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:20.866926 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd75d8-3722-4103-91b5-25a04b437082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:20.867316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd75d8-3722-4103-91b5-25a04b437082 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:20.867595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd75d8-3722-4103-91b5-25a04b437082 admin admin] PATH_INFO: `/v3/projects/282ba1108a4c4fbe94794ea9985f09a3` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:20.868722 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd75d8-3722-4103-91b5-25a04b437082 admin admin] RBAC: Authorizing `identity:delete_project(project_id=282ba1108a4c4fbe94794ea9985f09a3)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:20.870778 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd75d8-3722-4103-91b5-25a04b437082 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:20.925303 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-87cd75d8-3722-4103-91b5-25a04b437082 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '282ba1108a4c4fbe94794ea9985f09a3', 'request_id': 'req-87cd75d8-3722-4103-91b5-25a04b437082'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:20.925303 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:20.926600 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-87cd75d8-3722-4103-91b5-25a04b437082 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '282ba1108a4c4fbe94794ea9985f09a3', 'request_id': 'req-87cd75d8-3722-4103-91b5-25a04b437082'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:20.934606 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-87cd75d8-3722-4103-91b5-25a04b437082 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '282ba1108a4c4fbe94794ea9985f09a3', 'request_id': 'req-87cd75d8-3722-4103-91b5-25a04b437082'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:20.948338 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-87cd75d8-3722-4103-91b5-25a04b437082 admin admin] The token cache is being invalidate because project 282ba1108a4c4fbe94794ea9985f09a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:20.948628 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-87cd75d8-3722-4103-91b5-25a04b437082 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:20.949258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-87cd75d8-3722-4103-91b5-25a04b437082 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:20.951629 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4140/8332] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:37:20 2022] DELETE /identity/v3/projects/282ba1108a4c4fbe94794ea9985f09a3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:37:20.957981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecabf0-07b9-4bbc-8a41-c7ff52800a4c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:20.958411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecabf0-07b9-4bbc-8a41-c7ff52800a4c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:20.958715 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecabf0-07b9-4bbc-8a41-c7ff52800a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:20.978993 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-c5ecabf0-07b9-4bbc-8a41-c7ff52800a4c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:20.980192 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c5ecabf0-07b9-4bbc-8a41-c7ff52800a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:21.044098 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4193/8333] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:21.057021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602f4ec-5ed5-434c-be60-666a419fd145 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:21.057182 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602f4ec-5ed5-434c-be60-666a419fd145 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:21.057421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602f4ec-5ed5-434c-be60-666a419fd145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:21.079156 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a602f4ec-5ed5-434c-be60-666a419fd145 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:21.080364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a602f4ec-5ed5-434c-be60-666a419fd145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:21.088688 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4141/8334] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:21.093076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecabf0-07b9-4bbc-8a41-c7ff52800a4c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:21.102821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecabf0-07b9-4bbc-8a41-c7ff52800a4c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:21.108142 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d914da-0303-4219-a187-841e9658b3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:21.108806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d914da-0303-4219-a187-841e9658b3b5 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:21.109213 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d914da-0303-4219-a187-841e9658b3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:21.109598 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d914da-0303-4219-a187-841e9658b3b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:21.110508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d914da-0303-4219-a187-841e9658b3b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:37:21.111017 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d914da-0303-4219-a187-841e9658b3b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:21.112915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d914da-0303-4219-a187-841e9658b3b5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:21.125731 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4194/8335] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:37:21.130244 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602f4ec-5ed5-434c-be60-666a419fd145 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:21.141011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602f4ec-5ed5-434c-be60-666a419fd145 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:21.145932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e674d-59ec-458b-a543-9c65b8a89447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:21.146532 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e674d-59ec-458b-a543-9c65b8a89447 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:21.146835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e674d-59ec-458b-a543-9c65b8a89447 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:21.147104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e674d-59ec-458b-a543-9c65b8a89447 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:21.147715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e674d-59ec-458b-a543-9c65b8a89447 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:21.149672 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e674d-59ec-458b-a543-9c65b8a89447 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:21.179001 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4142/8336] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:37:21 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:21.183205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d914da-0303-4219-a187-841e9658b3b5 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:21.194054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d914da-0303-4219-a187-841e9658b3b5 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:21.261117 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e0a452-819e-40d7-a0d2-29ea636417e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:21.261733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0a452-819e-40d7-a0d2-29ea636417e1 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:21.262017 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0a452-819e-40d7-a0d2-29ea636417e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:21.262320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0a452-819e-40d7-a0d2-29ea636417e1 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:21.263657 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e0a452-819e-40d7-a0d2-29ea636417e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:21.265577 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e0a452-819e-40d7-a0d2-29ea636417e1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:21.287424 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4195/8337] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:37:21 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:21.291723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e674d-59ec-458b-a543-9c65b8a89447 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:21.302041 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e674d-59ec-458b-a543-9c65b8a89447 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:21.306907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd313f-2f52-41ad-8465-5159b1f1b58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:21.307496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd313f-2f52-41ad-8465-5159b1f1b58b admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:21.307770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd313f-2f52-41ad-8465-5159b1f1b58b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:21.308036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd313f-2f52-41ad-8465-5159b1f1b58b admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:21.308665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd313f-2f52-41ad-8465-5159b1f1b58b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:21.310946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd313f-2f52-41ad-8465-5159b1f1b58b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:21.320637 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4143/8338] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:37:21.324576 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e0a452-819e-40d7-a0d2-29ea636417e1 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:21.335293 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e0a452-819e-40d7-a0d2-29ea636417e1 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:21.339872 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b49b3a-2f05-4432-9042-ab17f708ab67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:21.340458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b49b3a-2f05-4432-9042-ab17f708ab67 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:21.340735 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b49b3a-2f05-4432-9042-ab17f708ab67 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:21.341009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b49b3a-2f05-4432-9042-ab17f708ab67 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:21.341705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b49b3a-2f05-4432-9042-ab17f708ab67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:21.343341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b49b3a-2f05-4432-9042-ab17f708ab67 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:21.353651 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4196/8339] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:37:21.357914 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd313f-2f52-41ad-8465-5159b1f1b58b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:21.368067 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd313f-2f52-41ad-8465-5159b1f1b58b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:21.373296 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e3638-3f91-4dac-a100-3a6bd5f2f33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:21.373943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e3638-3f91-4dac-a100-3a6bd5f2f33f admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:21.374227 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e3638-3f91-4dac-a100-3a6bd5f2f33f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:21.374500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e3638-3f91-4dac-a100-3a6bd5f2f33f admin admin] PATH_INFO: `/v3/projects/3bbb14f621fc443f9d683fc336bcbe1f/users/fe68d02b9924410aa30c84441838dd1b/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:21.389773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e3638-3f91-4dac-a100-3a6bd5f2f33f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bbb14f621fc443f9d683fc336bcbe1f, user_id=fe68d02b9924410aa30c84441838dd1b, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:21.392476 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e3638-3f91-4dac-a100-3a6bd5f2f33f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:21.405148 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4144/8340] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:37:21 2022] PUT /identity/v3/projects/3bbb14f621fc443f9d683fc336bcbe1f/users/fe68d02b9924410aa30c84441838dd1b/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:21.416950 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4b24e-8ce6-4fd4-b253-b0bf78ba7a7d None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:21.417487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4b24e-8ce6-4fd4-b253-b0bf78ba7a7d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:21.417597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4b24e-8ce6-4fd4-b253-b0bf78ba7a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:21.445719 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-e5d4b24e-8ce6-4fd4-b253-b0bf78ba7a7d None None] MFA Rules not processed for user `fe68d02b9924410aa30c84441838dd1b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:21.446878 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e5d4b24e-8ce6-4fd4-b253-b0bf78ba7a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:21.465749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:21.514707 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4197/8341] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:21.526860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e3638-3f91-4dac-a100-3a6bd5f2f33f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:21.528568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-de3e3638-3f91-4dac-a100-3a6bd5f2f33f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:21.587926 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e3638-3f91-4dac-a100-3a6bd5f2f33f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:21.591684 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ef2ef-bee7-4b43-897c-be91c9ac4e8f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10759b2abd4cafacf338551327775e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:21.592264 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ef2ef-bee7-4b43-897c-be91c9ac4e8f service glance] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:21.592546 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ef2ef-bee7-4b43-897c-be91c9ac4e8f service glance] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:21.592816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ef2ef-bee7-4b43-897c-be91c9ac4e8f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:21.601053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ef2ef-bee7-4b43-897c-be91c9ac4e8f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:21.602471 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ef2ef-bee7-4b43-897c-be91c9ac4e8f service glance] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:21.611597 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4145/8342] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:37:21 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:37:21.732357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797cc36-3e41-4831-9499-9a4b700e1df7 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:21.732643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797cc36-3e41-4831-9499-9a4b700e1df7 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:21.732920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797cc36-3e41-4831-9499-9a4b700e1df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:21.791970 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-5797cc36-3e41-4831-9499-9a4b700e1df7 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:21.793191 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5797cc36-3e41-4831-9499-9a4b700e1df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:21.859041 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4198/8343] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:37:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:21.905833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ef2ef-bee7-4b43-897c-be91c9ac4e8f service glance] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:21.907427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a72ef2ef-bee7-4b43-897c-be91c9ac4e8f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:21.979493 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ef2ef-bee7-4b43-897c-be91c9ac4e8f service glance] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:21.985071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd70e1-b7ac-4d57-a74b-5f1975a0e7b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:21.985672 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd70e1-b7ac-4d57-a74b-5f1975a0e7b5 service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:21.985953 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd70e1-b7ac-4d57-a74b-5f1975a0e7b5 service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:21.986226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd70e1-b7ac-4d57-a74b-5f1975a0e7b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:21.994326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd70e1-b7ac-4d57-a74b-5f1975a0e7b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:21.995977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd70e1-b7ac-4d57-a74b-5f1975a0e7b5 service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:22.003951 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4146/8344] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:37:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 06 21:37:22.311197 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaede82-5e12-4eb5-b503-abcb42e92358 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:22.311397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaede82-5e12-4eb5-b503-abcb42e92358 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:22.311725 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaede82-5e12-4eb5-b503-abcb42e92358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:22.330247 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-cbaede82-5e12-4eb5-b503-abcb42e92358 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:22.331490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-cbaede82-5e12-4eb5-b503-abcb42e92358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:22.338625 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4199/8345] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:37:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:22.352151 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd70e1-b7ac-4d57-a74b-5f1975a0e7b5 service swift] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:22.372175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd70e1-b7ac-4d57-a74b-5f1975a0e7b5 service swift] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:22.378269 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d397f2-d77f-4edc-bff8-1528381e2847 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:22.378899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d397f2-d77f-4edc-bff8-1528381e2847 service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:22.379176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d397f2-d77f-4edc-bff8-1528381e2847 service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:22.379450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d397f2-d77f-4edc-bff8-1528381e2847 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:22.384617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:22.391197 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d397f2-d77f-4edc-bff8-1528381e2847 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:22.393119 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d397f2-d77f-4edc-bff8-1528381e2847 service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:22.403019 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4147/8346] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:37:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 06 21:37:22.781415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80641b06-04b8-4175-ace3-8e487a151ed2 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:22.781879 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80641b06-04b8-4175-ace3-8e487a151ed2 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:22.781981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80641b06-04b8-4175-ace3-8e487a151ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:22.802256 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-80641b06-04b8-4175-ace3-8e487a151ed2 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:22.803845 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-80641b06-04b8-4175-ace3-8e487a151ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:22.811638 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4200/8347] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:37:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:22.824591 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d397f2-d77f-4edc-bff8-1528381e2847 service swift] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:22.838637 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d397f2-d77f-4edc-bff8-1528381e2847 service swift] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:22.843996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbbd291-0d69-4e88-a603-6470d588c049 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:22.844594 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbd291-0d69-4e88-a603-6470d588c049 service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:22.844874 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbd291-0d69-4e88-a603-6470d588c049 service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:22.845147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbd291-0d69-4e88-a603-6470d588c049 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:22.853372 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbbd291-0d69-4e88-a603-6470d588c049 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:22.855019 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbbd291-0d69-4e88-a603-6470d588c049 service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:22.863354 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4148/8348] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:37:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:37:23.014090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a3956-e813-4556-ba2a-7b22bd1a0a32 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:23.014372 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a3956-e813-4556-ba2a-7b22bd1a0a32 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:23.014710 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a3956-e813-4556-ba2a-7b22bd1a0a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:23.034306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-705a3956-e813-4556-ba2a-7b22bd1a0a32 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:23.035488 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-705a3956-e813-4556-ba2a-7b22bd1a0a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:23.042750 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4201/8349] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:37:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:23.055560 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbbd291-0d69-4e88-a603-6470d588c049 service swift] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:23.068739 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbbd291-0d69-4e88-a603-6470d588c049 service swift] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:23.073919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d09ca-7c84-4bf1-89b0-3ee33e15525b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:23.074538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d09ca-7c84-4bf1-89b0-3ee33e15525b service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:23.074842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d09ca-7c84-4bf1-89b0-3ee33e15525b service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:23.075110 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d09ca-7c84-4bf1-89b0-3ee33e15525b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:23.083840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d09ca-7c84-4bf1-89b0-3ee33e15525b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:23.085498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d09ca-7c84-4bf1-89b0-3ee33e15525b service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:23.094007 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4149/8350] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:37:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:37:23.390722 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034363e0-4345-470c-98f7-21acf43e94ba None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:23.391005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034363e0-4345-470c-98f7-21acf43e94ba None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:23.391277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034363e0-4345-470c-98f7-21acf43e94ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:23.410627 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-034363e0-4345-470c-98f7-21acf43e94ba None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:23.411833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-034363e0-4345-470c-98f7-21acf43e94ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:23.419101 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4202/8351] 10.222.0.33 () {58 vars in 967 bytes} [Sat Aug 6 21:37:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:23.432161 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d09ca-7c84-4bf1-89b0-3ee33e15525b service swift] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:23.445366 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d09ca-7c84-4bf1-89b0-3ee33e15525b service swift] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:23.450295 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2356afc-fc95-47cf-b22f-39cf1c82bacb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:23.451110 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2356afc-fc95-47cf-b22f-39cf1c82bacb service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:23.451246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2356afc-fc95-47cf-b22f-39cf1c82bacb service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:23.451478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2356afc-fc95-47cf-b22f-39cf1c82bacb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:23.459486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2356afc-fc95-47cf-b22f-39cf1c82bacb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:23.461099 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2356afc-fc95-47cf-b22f-39cf1c82bacb service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:23.469728 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4150/8352] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:37:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:37:23.639381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4105e5-b9f3-4298-9dbb-26a7706f7ce1 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:23.639665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4105e5-b9f3-4298-9dbb-26a7706f7ce1 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:23.639936 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4105e5-b9f3-4298-9dbb-26a7706f7ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:23.659134 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-4f4105e5-b9f3-4298-9dbb-26a7706f7ce1 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:23.660311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4f4105e5-b9f3-4298-9dbb-26a7706f7ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:23.667833 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4203/8353] 10.222.0.33 () {58 vars in 967 bytes} [Sat Aug 6 21:37:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:23.682377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2356afc-fc95-47cf-b22f-39cf1c82bacb service swift] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:23.695704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2356afc-fc95-47cf-b22f-39cf1c82bacb service swift] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:23.701280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f8e18-d81b-4d6f-bc50-3a9616170874 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:23.701874 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f8e18-d81b-4d6f-bc50-3a9616170874 service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:23.702152 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f8e18-d81b-4d6f-bc50-3a9616170874 service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:23.702437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f8e18-d81b-4d6f-bc50-3a9616170874 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:23.710513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f8e18-d81b-4d6f-bc50-3a9616170874 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:23.712114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f8e18-d81b-4d6f-bc50-3a9616170874 service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:23.721644 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4151/8354] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:37:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:37:23.844438 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4105e5-b9f3-4298-9dbb-26a7706f7ce1 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:23.898615 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:23.914508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4105e5-b9f3-4298-9dbb-26a7706f7ce1 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:23.919877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc55953b-efb1-4481-affe-49b1f2201743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:23.920807 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55953b-efb1-4481-affe-49b1f2201743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:23.921110 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55953b-efb1-4481-affe-49b1f2201743 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:23.921397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55953b-efb1-4481-affe-49b1f2201743 admin admin] PATH_INFO: `/v3/users/fe68d02b9924410aa30c84441838dd1b` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:23.922756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc55953b-efb1-4481-affe-49b1f2201743 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe68d02b9924410aa30c84441838dd1b)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:23.927093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc55953b-efb1-4481-affe-49b1f2201743 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:23.981680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cc55953b-efb1-4481-affe-49b1f2201743 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe68d02b9924410aa30c84441838dd1b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:23.989409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cc55953b-efb1-4481-affe-49b1f2201743 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe68d02b9924410aa30c84441838dd1b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:23.990076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cc55953b-efb1-4481-affe-49b1f2201743 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe68d02b9924410aa30c84441838dd1b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:23.990793 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cc55953b-efb1-4481-affe-49b1f2201743 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe68d02b9924410aa30c84441838dd1b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:23.998907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cc55953b-efb1-4481-affe-49b1f2201743 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe68d02b9924410aa30c84441838dd1b'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:24.019061 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4204/8355] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:37:23 2022] DELETE /identity/v3/users/fe68d02b9924410aa30c84441838dd1b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:24.023208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ebfe0-2f2b-4bc3-95f4-96bc04d9be3d None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:24.023496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ebfe0-2f2b-4bc3-95f4-96bc04d9be3d None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:24.023770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ebfe0-2f2b-4bc3-95f4-96bc04d9be3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:24.043650 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f09ebfe0-2f2b-4bc3-95f4-96bc04d9be3d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:24.044869 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f09ebfe0-2f2b-4bc3-95f4-96bc04d9be3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:24.106946 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4152/8356] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:24.117537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc55953b-efb1-4481-affe-49b1f2201743 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:24.118990 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-cc55953b-efb1-4481-affe-49b1f2201743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:24.171448 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ebfe0-2f2b-4bc3-95f4-96bc04d9be3d None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:24.172805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f09ebfe0-2f2b-4bc3-95f4-96bc04d9be3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:24.183536 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc55953b-efb1-4481-affe-49b1f2201743 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:24.184716 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ebfe0-2f2b-4bc3-95f4-96bc04d9be3d None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:24.187820 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51395c-339b-4881-84be-72314b1e2259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:24.188429 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51395c-339b-4881-84be-72314b1e2259 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:24.188707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51395c-339b-4881-84be-72314b1e2259 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:24.188976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51395c-339b-4881-84be-72314b1e2259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:24.189818 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1da655-4b14-45db-9085-f8e6a05e3815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:24.190432 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1da655-4b14-45db-9085-f8e6a05e3815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:24.190741 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1da655-4b14-45db-9085-f8e6a05e3815 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:24.191012 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1da655-4b14-45db-9085-f8e6a05e3815 admin admin] PATH_INFO: `/v3/users/a9f375fee6814e138c932f214d4babc9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:24.192135 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1da655-4b14-45db-9085-f8e6a05e3815 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9f375fee6814e138c932f214d4babc9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:24.194037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1da655-4b14-45db-9085-f8e6a05e3815 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:24.197991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51395c-339b-4881-84be-72314b1e2259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:24.199450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51395c-339b-4881-84be-72314b1e2259 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:24.209519 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4205/8357] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:37:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:37:24.242417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5b1da655-4b14-45db-9085-f8e6a05e3815 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9f375fee6814e138c932f214d4babc9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:24.243178 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5b1da655-4b14-45db-9085-f8e6a05e3815 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9f375fee6814e138c932f214d4babc9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:24.243828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5b1da655-4b14-45db-9085-f8e6a05e3815 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9f375fee6814e138c932f214d4babc9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:24.251711 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5b1da655-4b14-45db-9085-f8e6a05e3815 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9f375fee6814e138c932f214d4babc9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:24.265147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5b1da655-4b14-45db-9085-f8e6a05e3815 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9f375fee6814e138c932f214d4babc9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:24.277265 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4153/8358] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:37:24 2022] DELETE /identity/v3/users/a9f375fee6814e138c932f214d4babc9 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:37:24.282307 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad12d84-7d37-403c-8be5-2a10ef51785d None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:24.282634 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad12d84-7d37-403c-8be5-2a10ef51785d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:24.282922 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad12d84-7d37-403c-8be5-2a10ef51785d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:24.303513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-4ad12d84-7d37-403c-8be5-2a10ef51785d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:24.304731 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4ad12d84-7d37-403c-8be5-2a10ef51785d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:24.374244 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4206/8359] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:24.384874 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1da655-4b14-45db-9085-f8e6a05e3815 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:24.386296 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5b1da655-4b14-45db-9085-f8e6a05e3815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:24.401943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:24.454456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1da655-4b14-45db-9085-f8e6a05e3815 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:24.459092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f10f143-50d6-4705-b46b-cfffaf8e0034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:24.459857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10f143-50d6-4705-b46b-cfffaf8e0034 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:24.460214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10f143-50d6-4705-b46b-cfffaf8e0034 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:24.460552 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10f143-50d6-4705-b46b-cfffaf8e0034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:24.472152 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f10f143-50d6-4705-b46b-cfffaf8e0034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:24.473730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f10f143-50d6-4705-b46b-cfffaf8e0034 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:24.486055 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4154/8360] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:37:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:37:24.503346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad12d84-7d37-403c-8be5-2a10ef51785d None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:24.505582 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4ad12d84-7d37-403c-8be5-2a10ef51785d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:24.520116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad12d84-7d37-403c-8be5-2a10ef51785d None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:24.526719 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539d0a6-9a0c-4b0d-a7b5-4a6b8cde1edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:24.527355 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539d0a6-9a0c-4b0d-a7b5-4a6b8cde1edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:24.527643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539d0a6-9a0c-4b0d-a7b5-4a6b8cde1edb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:24.527912 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539d0a6-9a0c-4b0d-a7b5-4a6b8cde1edb admin admin] PATH_INFO: `/v3/projects/3bbb14f621fc443f9d683fc336bcbe1f` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:24.530446 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1539d0a6-9a0c-4b0d-a7b5-4a6b8cde1edb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bbb14f621fc443f9d683fc336bcbe1f)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:24.533005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1539d0a6-9a0c-4b0d-a7b5-4a6b8cde1edb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:24.545307 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:24.607380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1539d0a6-9a0c-4b0d-a7b5-4a6b8cde1edb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bbb14f621fc443f9d683fc336bcbe1f', 'request_id': 'req-1539d0a6-9a0c-4b0d-a7b5-4a6b8cde1edb'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:24.611317 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1539d0a6-9a0c-4b0d-a7b5-4a6b8cde1edb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bbb14f621fc443f9d683fc336bcbe1f', 'request_id': 'req-1539d0a6-9a0c-4b0d-a7b5-4a6b8cde1edb'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:24.619061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1539d0a6-9a0c-4b0d-a7b5-4a6b8cde1edb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bbb14f621fc443f9d683fc336bcbe1f', 'request_id': 'req-1539d0a6-9a0c-4b0d-a7b5-4a6b8cde1edb'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:24.636100 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1539d0a6-9a0c-4b0d-a7b5-4a6b8cde1edb admin admin] The token cache is being invalidate because project 3bbb14f621fc443f9d683fc336bcbe1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:24.636393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1539d0a6-9a0c-4b0d-a7b5-4a6b8cde1edb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:24.637068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1539d0a6-9a0c-4b0d-a7b5-4a6b8cde1edb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:24.639676 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4207/8361] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:37:24 2022] DELETE /identity/v3/projects/3bbb14f621fc443f9d683fc336bcbe1f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:24.644938 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1e620-6c88-480c-95c0-f11585381a24 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:24.645221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1e620-6c88-480c-95c0-f11585381a24 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:24.645501 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1e620-6c88-480c-95c0-f11585381a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:24.671828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-94a1e620-6c88-480c-95c0-f11585381a24 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:24.673471 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-94a1e620-6c88-480c-95c0-f11585381a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:24.754702 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4155/8362] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:24.758830 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8538530-b941-4f7a-a692-2a30cf1607b4 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:24.759120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8538530-b941-4f7a-a692-2a30cf1607b4 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:24.759398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8538530-b941-4f7a-a692-2a30cf1607b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:24.781320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a8538530-b941-4f7a-a692-2a30cf1607b4 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:24.782678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a8538530-b941-4f7a-a692-2a30cf1607b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:24.792070 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4208/8363] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:24.798256 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1e620-6c88-480c-95c0-f11585381a24 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:24.811629 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1e620-6c88-480c-95c0-f11585381a24 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:24.822727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f65de5-5125-46a0-9e06-4d01e24cc73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:24.824011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f65de5-5125-46a0-9e06-4d01e24cc73e admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:24.824859 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f65de5-5125-46a0-9e06-4d01e24cc73e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:24.825132 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f65de5-5125-46a0-9e06-4d01e24cc73e admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:24.826102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f65de5-5125-46a0-9e06-4d01e24cc73e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:37:24.826576 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f65de5-5125-46a0-9e06-4d01e24cc73e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:24.828311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f65de5-5125-46a0-9e06-4d01e24cc73e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:24.840447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8538530-b941-4f7a-a692-2a30cf1607b4 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:24.843312 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a8538530-b941-4f7a-a692-2a30cf1607b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:24.843564 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4156/8364] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:37:24.848603 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f65de5-5125-46a0-9e06-4d01e24cc73e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:24.861233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f65de5-5125-46a0-9e06-4d01e24cc73e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:24.866899 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8538530-b941-4f7a-a692-2a30cf1607b4 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:24.868625 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feede59f-39ad-400f-91fa-17cbc4e17419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:24.869587 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feede59f-39ad-400f-91fa-17cbc4e17419 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:24.870031 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feede59f-39ad-400f-91fa-17cbc4e17419 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:24.870774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feede59f-39ad-400f-91fa-17cbc4e17419 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:24.871803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feede59f-39ad-400f-91fa-17cbc4e17419 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:24.873841 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33274c-3c8b-4d53-9f3c-41710679d5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:24.874605 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feede59f-39ad-400f-91fa-17cbc4e17419 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:24.874732 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33274c-3c8b-4d53-9f3c-41710679d5d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:24.874835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33274c-3c8b-4d53-9f3c-41710679d5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:24.875042 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33274c-3c8b-4d53-9f3c-41710679d5d4 admin admin] PATH_INFO: `/v3/projects/f1717e5962c04361a60d4cdf11feb845` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:24.876206 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33274c-3c8b-4d53-9f3c-41710679d5d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1717e5962c04361a60d4cdf11feb845)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:24.878943 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33274c-3c8b-4d53-9f3c-41710679d5d4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:24.908385 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4157/8365] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:37:24 2022] POST /identity/v3/projects => generated 393 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:37:24.913539 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feede59f-39ad-400f-91fa-17cbc4e17419 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:24.937432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5e33274c-3c8b-4d53-9f3c-41710679d5d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1717e5962c04361a60d4cdf11feb845', 'request_id': 'req-5e33274c-3c8b-4d53-9f3c-41710679d5d4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:24.945193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5e33274c-3c8b-4d53-9f3c-41710679d5d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1717e5962c04361a60d4cdf11feb845', 'request_id': 'req-5e33274c-3c8b-4d53-9f3c-41710679d5d4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:24.954765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5e33274c-3c8b-4d53-9f3c-41710679d5d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1717e5962c04361a60d4cdf11feb845', 'request_id': 'req-5e33274c-3c8b-4d53-9f3c-41710679d5d4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:24.966825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5e33274c-3c8b-4d53-9f3c-41710679d5d4 admin admin] The token cache is being invalidate because project f1717e5962c04361a60d4cdf11feb845 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:24.967140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5e33274c-3c8b-4d53-9f3c-41710679d5d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:24.967799 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5e33274c-3c8b-4d53-9f3c-41710679d5d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:24.969324 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4209/8366] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:37:24 2022] DELETE /identity/v3/projects/f1717e5962c04361a60d4cdf11feb845 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:37:24.973507 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33274c-3c8b-4d53-9f3c-41710679d5d4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:24.975200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5e33274c-3c8b-4d53-9f3c-41710679d5d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:24.995874 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feede59f-39ad-400f-91fa-17cbc4e17419 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:25.025323 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:25.060488 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef20023-869d-4d25-83b8-bb5b8e7e572c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:25.061114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef20023-869d-4d25-83b8-bb5b8e7e572c admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:25.061418 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef20023-869d-4d25-83b8-bb5b8e7e572c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:25.061692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef20023-869d-4d25-83b8-bb5b8e7e572c admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:25.062982 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef20023-869d-4d25-83b8-bb5b8e7e572c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:25.063500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33274c-3c8b-4d53-9f3c-41710679d5d4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:25.065363 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef20023-869d-4d25-83b8-bb5b8e7e572c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:25.071898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabfbeaf-c723-457c-8119-3da7de56ac31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:25.073009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfbeaf-c723-457c-8119-3da7de56ac31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:25.073394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfbeaf-c723-457c-8119-3da7de56ac31 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:25.073675 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfbeaf-c723-457c-8119-3da7de56ac31 admin admin] PATH_INFO: `/v3/users/9f8b51fba6b94f5ea75641c2b7622adb` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:25.076588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabfbeaf-c723-457c-8119-3da7de56ac31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f8b51fba6b94f5ea75641c2b7622adb)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:25.078643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabfbeaf-c723-457c-8119-3da7de56ac31 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:25.089491 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4158/8367] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:37:24 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:37:25.094434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef20023-869d-4d25-83b8-bb5b8e7e572c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:25.094901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:25.096665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5ef20023-869d-4d25-83b8-bb5b8e7e572c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:25.111342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef20023-869d-4d25-83b8-bb5b8e7e572c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:25.119669 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21794acf-9f66-43f3-a51a-5d94dfa81c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:25.120306 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21794acf-9f66-43f3-a51a-5d94dfa81c14 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:25.120659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21794acf-9f66-43f3-a51a-5d94dfa81c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:25.120953 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21794acf-9f66-43f3-a51a-5d94dfa81c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:25.121582 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21794acf-9f66-43f3-a51a-5d94dfa81c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:25.125611 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21794acf-9f66-43f3-a51a-5d94dfa81c14 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:25.136566 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4159/8368] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:37:25.140285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-aabfbeaf-c723-457c-8119-3da7de56ac31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f8b51fba6b94f5ea75641c2b7622adb'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:25.141413 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21794acf-9f66-43f3-a51a-5d94dfa81c14 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:25.148358 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-aabfbeaf-c723-457c-8119-3da7de56ac31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f8b51fba6b94f5ea75641c2b7622adb'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:25.149092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-aabfbeaf-c723-457c-8119-3da7de56ac31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f8b51fba6b94f5ea75641c2b7622adb'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:25.149726 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-aabfbeaf-c723-457c-8119-3da7de56ac31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f8b51fba6b94f5ea75641c2b7622adb'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:25.153194 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21794acf-9f66-43f3-a51a-5d94dfa81c14 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:25.158426 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-aabfbeaf-c723-457c-8119-3da7de56ac31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f8b51fba6b94f5ea75641c2b7622adb'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:25.159809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457fc49-99a9-4896-896d-086850f1561a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:25.160567 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457fc49-99a9-4896-896d-086850f1561a admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:25.160852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457fc49-99a9-4896-896d-086850f1561a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:25.161126 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457fc49-99a9-4896-896d-086850f1561a admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:25.161766 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c457fc49-99a9-4896-896d-086850f1561a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:25.163420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c457fc49-99a9-4896-896d-086850f1561a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:25.180364 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4160/8369] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:37:25.180642 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4210/8370] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:37:24 2022] DELETE /identity/v3/users/9f8b51fba6b94f5ea75641c2b7622adb => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:37:25.181570 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457fc49-99a9-4896-896d-086850f1561a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:25.183673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c457fc49-99a9-4896-896d-086850f1561a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:25.197553 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457fc49-99a9-4896-896d-086850f1561a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:25.268541 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b09b5-e831-4131-a71d-55caf9565e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:25.269216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b09b5-e831-4131-a71d-55caf9565e79 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:25.269495 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b09b5-e831-4131-a71d-55caf9565e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:25.269769 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b09b5-e831-4131-a71d-55caf9565e79 admin admin] PATH_INFO: `/v3/projects/f112c7eec77f4fee88dfa98f4943dc92/users/2546206081194220b74969ae610ae5be/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:25.289081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b09b5-e831-4131-a71d-55caf9565e79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f112c7eec77f4fee88dfa98f4943dc92, user_id=2546206081194220b74969ae610ae5be, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:25.292057 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b09b5-e831-4131-a71d-55caf9565e79 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:25.311973 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4161/8371] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:37:25 2022] PUT /identity/v3/projects/f112c7eec77f4fee88dfa98f4943dc92/users/2546206081194220b74969ae610ae5be/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:25.325293 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e88c15-cac6-461e-af7b-4c720f98c6f5 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:25.325630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e88c15-cac6-461e-af7b-4c720f98c6f5 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:25.325991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e88c15-cac6-461e-af7b-4c720f98c6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:25.356506 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b0e88c15-cac6-461e-af7b-4c720f98c6f5 None None] MFA Rules not processed for user `2546206081194220b74969ae610ae5be`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:25.358483 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b0e88c15-cac6-461e-af7b-4c720f98c6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:25.426909 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4211/8372] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:25.437813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b09b5-e831-4131-a71d-55caf9565e79 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:25.439623 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-025b09b5-e831-4131-a71d-55caf9565e79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:25.488084 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e88c15-cac6-461e-af7b-4c720f98c6f5 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:25.489709 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b0e88c15-cac6-461e-af7b-4c720f98c6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:25.506418 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b09b5-e831-4131-a71d-55caf9565e79 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:25.511507 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7351a6-54bc-4aa7-9103-623e55a2f830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:25.512116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7351a6-54bc-4aa7-9103-623e55a2f830 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:25.512390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7351a6-54bc-4aa7-9103-623e55a2f830 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:25.512656 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7351a6-54bc-4aa7-9103-623e55a2f830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:25.522836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7351a6-54bc-4aa7-9103-623e55a2f830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:25.524291 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7351a6-54bc-4aa7-9103-623e55a2f830 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:25.534261 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4162/8373] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:37:25 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:37:25.560988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e88c15-cac6-461e-af7b-4c720f98c6f5 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:25.566714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e7c368-622d-4298-b999-d98a820cfe11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:25.567424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7c368-622d-4298-b999-d98a820cfe11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:25.567779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7c368-622d-4298-b999-d98a820cfe11 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:25.568246 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7c368-622d-4298-b999-d98a820cfe11 admin admin] PATH_INFO: `/v3/projects/a6a9b4847e074bed97a7fb1b2ba63901` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:25.569463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e7c368-622d-4298-b999-d98a820cfe11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6a9b4847e074bed97a7fb1b2ba63901)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:25.571500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e7c368-622d-4298-b999-d98a820cfe11 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:25.598568 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:25.623434 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-76e7c368-622d-4298-b999-d98a820cfe11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6a9b4847e074bed97a7fb1b2ba63901', 'request_id': 'req-76e7c368-622d-4298-b999-d98a820cfe11'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:25.629421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-76e7c368-622d-4298-b999-d98a820cfe11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6a9b4847e074bed97a7fb1b2ba63901', 'request_id': 'req-76e7c368-622d-4298-b999-d98a820cfe11'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:25.636226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-76e7c368-622d-4298-b999-d98a820cfe11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6a9b4847e074bed97a7fb1b2ba63901', 'request_id': 'req-76e7c368-622d-4298-b999-d98a820cfe11'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:25.648699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-76e7c368-622d-4298-b999-d98a820cfe11 admin admin] The token cache is being invalidate because project a6a9b4847e074bed97a7fb1b2ba63901 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:25.648988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-76e7c368-622d-4298-b999-d98a820cfe11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:25.649656 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-76e7c368-622d-4298-b999-d98a820cfe11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:25.651433 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4212/8374] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:37:25 2022] DELETE /identity/v3/projects/a6a9b4847e074bed97a7fb1b2ba63901 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:37:25.656932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e6a35-7990-4f20-8692-e05a7826aec5 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:25.657149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e6a35-7990-4f20-8692-e05a7826aec5 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:25.657427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e6a35-7990-4f20-8692-e05a7826aec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:25.686745 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-262e6a35-7990-4f20-8692-e05a7826aec5 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:25.688038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-262e6a35-7990-4f20-8692-e05a7826aec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:25.711020 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:25.757522 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4163/8375] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:25.766410 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfa886-a58d-418a-9ec6-022d3faba621 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:25.766744 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfa886-a58d-418a-9ec6-022d3faba621 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:25.767072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfa886-a58d-418a-9ec6-022d3faba621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:25.789340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-1ecfa886-a58d-418a-9ec6-022d3faba621 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:25.790720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1ecfa886-a58d-418a-9ec6-022d3faba621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:25.799771 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4213/8376] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:37:25.805925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e6a35-7990-4f20-8692-e05a7826aec5 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:25.817218 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e6a35-7990-4f20-8692-e05a7826aec5 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:25.826252 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37c425-836b-4864-a58d-667625ecf205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:25.827494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37c425-836b-4864-a58d-667625ecf205 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:25.828012 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37c425-836b-4864-a58d-667625ecf205 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:25.828457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37c425-836b-4864-a58d-667625ecf205 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:25.829339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37c425-836b-4864-a58d-667625ecf205 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:37:25.829858 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37c425-836b-4864-a58d-667625ecf205 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:25.832200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37c425-836b-4864-a58d-667625ecf205 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:25.845552 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4164/8377] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:37:25.850104 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfa886-a58d-418a-9ec6-022d3faba621 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:25.860604 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfa886-a58d-418a-9ec6-022d3faba621 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:25.867041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8f1bc-1e3b-4897-b8e3-4384becf3695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:25.867840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8f1bc-1e3b-4897-b8e3-4384becf3695 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:25.868158 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8f1bc-1e3b-4897-b8e3-4384becf3695 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:25.869232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8f1bc-1e3b-4897-b8e3-4384becf3695 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:25.869992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8f1bc-1e3b-4897-b8e3-4384becf3695 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:25.873682 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8f1bc-1e3b-4897-b8e3-4384becf3695 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:25.913828 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4214/8378] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:37:25 2022] POST /identity/v3/projects => generated 369 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:37:25.917642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37c425-836b-4864-a58d-667625ecf205 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:25.928668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37c425-836b-4864-a58d-667625ecf205 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:25.994975 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca8988-8e6b-4d9f-8420-67be17a37c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:25.995614 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca8988-8e6b-4d9f-8420-67be17a37c3d admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:25.995899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca8988-8e6b-4d9f-8420-67be17a37c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:25.996172 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca8988-8e6b-4d9f-8420-67be17a37c3d admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:25.996792 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca8988-8e6b-4d9f-8420-67be17a37c3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:25.999543 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca8988-8e6b-4d9f-8420-67be17a37c3d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:26.022594 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4165/8379] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:37:25 2022] POST /identity/v3/users => generated 285 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:37:26.027168 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8f1bc-1e3b-4897-b8e3-4384becf3695 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:26.038020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8f1bc-1e3b-4897-b8e3-4384becf3695 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:26.043694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a8c4b-7208-4769-b8e3-1fc9b99e87b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:26.044930 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a8c4b-7208-4769-b8e3-1fc9b99e87b1 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:26.045287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a8c4b-7208-4769-b8e3-1fc9b99e87b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:26.045705 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a8c4b-7208-4769-b8e3-1fc9b99e87b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:26.046359 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a8c4b-7208-4769-b8e3-1fc9b99e87b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:26.048158 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a8c4b-7208-4769-b8e3-1fc9b99e87b1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:26.060750 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4215/8380] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:37:26.064811 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca8988-8e6b-4d9f-8420-67be17a37c3d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:26.075315 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca8988-8e6b-4d9f-8420-67be17a37c3d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:26.080805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069e9ef-cc67-46a9-8d38-6bcf71a67e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:26.081474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069e9ef-cc67-46a9-8d38-6bcf71a67e13 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:26.081767 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069e9ef-cc67-46a9-8d38-6bcf71a67e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:26.082043 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069e9ef-cc67-46a9-8d38-6bcf71a67e13 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:26.082720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6069e9ef-cc67-46a9-8d38-6bcf71a67e13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:26.084363 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6069e9ef-cc67-46a9-8d38-6bcf71a67e13 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:26.096652 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4166/8381] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:37:26.100678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a8c4b-7208-4769-b8e3-1fc9b99e87b1 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:26.110951 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a8c4b-7208-4769-b8e3-1fc9b99e87b1 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:26.115616 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec92ac-6b8e-4c89-9445-2d10f772bbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:26.116276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec92ac-6b8e-4c89-9445-2d10f772bbcb admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:26.116559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec92ac-6b8e-4c89-9445-2d10f772bbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:26.116839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec92ac-6b8e-4c89-9445-2d10f772bbcb admin admin] PATH_INFO: `/v3/projects/4ffe7203d70542a0afae0ee938560dc5/users/232387173c7e4609bfd6a4e344cbf69c/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:26.132559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec92ac-6b8e-4c89-9445-2d10f772bbcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ffe7203d70542a0afae0ee938560dc5, user_id=232387173c7e4609bfd6a4e344cbf69c, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:26.135282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec92ac-6b8e-4c89-9445-2d10f772bbcb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:26.148852 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4216/8382] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:37:26 2022] PUT /identity/v3/projects/4ffe7203d70542a0afae0ee938560dc5/users/232387173c7e4609bfd6a4e344cbf69c/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:26.245037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63270b1a-f79d-4152-ab8c-283d2b1c3d78 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:26.245342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63270b1a-f79d-4152-ab8c-283d2b1c3d78 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:26.245612 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63270b1a-f79d-4152-ab8c-283d2b1c3d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:26.274899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-63270b1a-f79d-4152-ab8c-283d2b1c3d78 None None] MFA Rules not processed for user `232387173c7e4609bfd6a4e344cbf69c`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:26.276133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-63270b1a-f79d-4152-ab8c-283d2b1c3d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:26.352488 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4167/8383] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:26.357701 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec92ac-6b8e-4c89-9445-2d10f772bbcb admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:26.441157 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec92ac-6b8e-4c89-9445-2d10f772bbcb admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:26.448228 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fe6ad-edff-4a5c-9369-4d4640d7b79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:26.448843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fe6ad-edff-4a5c-9369-4d4640d7b79d admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:26.449169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fe6ad-edff-4a5c-9369-4d4640d7b79d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:26.449444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fe6ad-edff-4a5c-9369-4d4640d7b79d admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:26.450072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82fe6ad-edff-4a5c-9369-4d4640d7b79d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:26.452728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82fe6ad-edff-4a5c-9369-4d4640d7b79d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:26.486630 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4217/8384] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:37:26 2022] POST /identity/v3/projects => generated 367 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:26.488378 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63270b1a-f79d-4152-ab8c-283d2b1c3d78 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:26.501439 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63270b1a-f79d-4152-ab8c-283d2b1c3d78 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:26.519801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:26.583228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422e992-ee16-4d42-86ae-e064e167641d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:26.583963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422e992-ee16-4d42-86ae-e064e167641d admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:26.584795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422e992-ee16-4d42-86ae-e064e167641d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:26.585148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422e992-ee16-4d42-86ae-e064e167641d admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:26.586450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422e992-ee16-4d42-86ae-e064e167641d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:26.588999 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422e992-ee16-4d42-86ae-e064e167641d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:26.611368 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4168/8385] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:37:26 2022] POST /identity/v3/users => generated 290 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:26.615651 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fe6ad-edff-4a5c-9369-4d4640d7b79d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:26.626369 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fe6ad-edff-4a5c-9369-4d4640d7b79d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:26.631556 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d6b23-1f68-4d30-9863-a4413985f2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:26.632252 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d6b23-1f68-4d30-9863-a4413985f2de admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:26.632600 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d6b23-1f68-4d30-9863-a4413985f2de admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:26.632941 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d6b23-1f68-4d30-9863-a4413985f2de admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:26.633646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d6b23-1f68-4d30-9863-a4413985f2de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:26.635350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d6b23-1f68-4d30-9863-a4413985f2de admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:26.646930 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4218/8386] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:37:26.650928 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422e992-ee16-4d42-86ae-e064e167641d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:26.662074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422e992-ee16-4d42-86ae-e064e167641d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:26.672918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c719b-0322-4136-b2a0-83930ebe53c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:26.673694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c719b-0322-4136-b2a0-83930ebe53c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:26.674076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c719b-0322-4136-b2a0-83930ebe53c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:26.674398 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c719b-0322-4136-b2a0-83930ebe53c5 admin admin] PATH_INFO: `/v3/projects/9488524e7cb94a33ba1877370c83893a/users/9d4e3d472d8e4c439bdab3d81bb9915c/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:26.691832 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c719b-0322-4136-b2a0-83930ebe53c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9488524e7cb94a33ba1877370c83893a, user_id=9d4e3d472d8e4c439bdab3d81bb9915c, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:26.694514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c719b-0322-4136-b2a0-83930ebe53c5 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:26.708940 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4169/8387] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:37:26 2022] PUT /identity/v3/projects/9488524e7cb94a33ba1877370c83893a/users/9d4e3d472d8e4c439bdab3d81bb9915c/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:26.713078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d6b23-1f68-4d30-9863-a4413985f2de admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:26.724899 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d6b23-1f68-4d30-9863-a4413985f2de admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:26.749838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:26.812283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414f13c-4864-4385-b1a4-e134a66d679b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:26.812977 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414f13c-4864-4385-b1a4-e134a66d679b admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:26.813275 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414f13c-4864-4385-b1a4-e134a66d679b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:26.814097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414f13c-4864-4385-b1a4-e134a66d679b admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:26.815094 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414f13c-4864-4385-b1a4-e134a66d679b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:26.817276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414f13c-4864-4385-b1a4-e134a66d679b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:26.837457 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4219/8388] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:37:26.839795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c719b-0322-4136-b2a0-83930ebe53c5 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:26.852094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c719b-0322-4136-b2a0-83930ebe53c5 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:26.857372 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266afb07-5ca9-45e0-8dac-92b6d54db4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:26.858674 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266afb07-5ca9-45e0-8dac-92b6d54db4fe admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:26.859500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266afb07-5ca9-45e0-8dac-92b6d54db4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:26.859500 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266afb07-5ca9-45e0-8dac-92b6d54db4fe admin admin] PATH_INFO: `/v3/projects/9488524e7cb94a33ba1877370c83893a/users/9d4e3d472d8e4c439bdab3d81bb9915c/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:26.861464 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266afb07-5ca9-45e0-8dac-92b6d54db4fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=9488524e7cb94a33ba1877370c83893a, user_id=9d4e3d472d8e4c439bdab3d81bb9915c, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:26.864432 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266afb07-5ca9-45e0-8dac-92b6d54db4fe admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:26.877619 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4170/8389] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:37:26 2022] PUT /identity/v3/projects/9488524e7cb94a33ba1877370c83893a/users/9d4e3d472d8e4c439bdab3d81bb9915c/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:26.887970 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff68f2-5f90-4cda-b686-b58c967d9d78 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:26.888583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff68f2-5f90-4cda-b686-b58c967d9d78 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:26.889130 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff68f2-5f90-4cda-b686-b58c967d9d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:26.918399 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b0ff68f2-5f90-4cda-b686-b58c967d9d78 None None] MFA Rules not processed for user `9d4e3d472d8e4c439bdab3d81bb9915c`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:26.920032 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b0ff68f2-5f90-4cda-b686-b58c967d9d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:27.037103 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4220/8390] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:26 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:27.046325 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266afb07-5ca9-45e0-8dac-92b6d54db4fe admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:27.048131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-266afb07-5ca9-45e0-8dac-92b6d54db4fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:27.122042 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266afb07-5ca9-45e0-8dac-92b6d54db4fe admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:27.126752 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7fd7a-7098-4a1a-af5d-62ff6b6b9c4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:27.127550 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7fd7a-7098-4a1a-af5d-62ff6b6b9c4c service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:27.128085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7fd7a-7098-4a1a-af5d-62ff6b6b9c4c service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:27.128426 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7fd7a-7098-4a1a-af5d-62ff6b6b9c4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:27.141205 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7fd7a-7098-4a1a-af5d-62ff6b6b9c4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:27.142735 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7fd7a-7098-4a1a-af5d-62ff6b6b9c4c service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:27.153933 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4171/8391] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:37:27 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:37:28.842038 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff68f2-5f90-4cda-b686-b58c967d9d78 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:28.942752 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff68f2-5f90-4cda-b686-b58c967d9d78 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:28.947789 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1108e-bdc5-4ded-ba3f-ca4c456e8d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:28.948730 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1108e-bdc5-4ded-ba3f-ca4c456e8d04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:28.949226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1108e-bdc5-4ded-ba3f-ca4c456e8d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:28.949704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1108e-bdc5-4ded-ba3f-ca4c456e8d04 admin admin] PATH_INFO: `/v3/users/232387173c7e4609bfd6a4e344cbf69c` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:28.951981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1108e-bdc5-4ded-ba3f-ca4c456e8d04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=232387173c7e4609bfd6a4e344cbf69c)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:28.955245 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1108e-bdc5-4ded-ba3f-ca4c456e8d04 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:29.020134 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:29.022789 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dba1108e-bdc5-4ded-ba3f-ca4c456e8d04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '232387173c7e4609bfd6a4e344cbf69c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:29.034274 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dba1108e-bdc5-4ded-ba3f-ca4c456e8d04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '232387173c7e4609bfd6a4e344cbf69c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:29.035231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dba1108e-bdc5-4ded-ba3f-ca4c456e8d04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '232387173c7e4609bfd6a4e344cbf69c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:29.035910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dba1108e-bdc5-4ded-ba3f-ca4c456e8d04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '232387173c7e4609bfd6a4e344cbf69c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:29.048283 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-dba1108e-bdc5-4ded-ba3f-ca4c456e8d04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '232387173c7e4609bfd6a4e344cbf69c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:29.071592 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4221/8392] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:37:28 2022] DELETE /identity/v3/users/232387173c7e4609bfd6a4e344cbf69c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:29.077009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce35ff8-a3ad-4a7b-b4fc-f99342821e1c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:29.077501 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce35ff8-a3ad-4a7b-b4fc-f99342821e1c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:29.077697 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce35ff8-a3ad-4a7b-b4fc-f99342821e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:29.099736 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-7ce35ff8-a3ad-4a7b-b4fc-f99342821e1c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:29.101239 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7ce35ff8-a3ad-4a7b-b4fc-f99342821e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:29.184637 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4172/8393] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:29.199379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1108e-bdc5-4ded-ba3f-ca4c456e8d04 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:29.201554 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-dba1108e-bdc5-4ded-ba3f-ca4c456e8d04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:29.287786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1108e-bdc5-4ded-ba3f-ca4c456e8d04 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:29.292181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d05f3-963c-45e2-8f01-ef48263d5f1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:29.292743 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d05f3-963c-45e2-8f01-ef48263d5f1f service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:29.293096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d05f3-963c-45e2-8f01-ef48263d5f1f service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:29.293306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d05f3-963c-45e2-8f01-ef48263d5f1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:29.306288 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d05f3-963c-45e2-8f01-ef48263d5f1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:29.307930 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d05f3-963c-45e2-8f01-ef48263d5f1f service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:29.319293 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4222/8394] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:37:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:37:29.787121 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce35ff8-a3ad-4a7b-b4fc-f99342821e1c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:29.788749 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7ce35ff8-a3ad-4a7b-b4fc-f99342821e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:29.823589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce35ff8-a3ad-4a7b-b4fc-f99342821e1c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:29.831809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbdafe-b2b0-4f13-97a5-5626f85efa6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:29.833589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbdafe-b2b0-4f13-97a5-5626f85efa6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:29.834081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbdafe-b2b0-4f13-97a5-5626f85efa6a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:29.834538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbdafe-b2b0-4f13-97a5-5626f85efa6a admin admin] PATH_INFO: `/v3/projects/4ffe7203d70542a0afae0ee938560dc5` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:29.836236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcbdafe-b2b0-4f13-97a5-5626f85efa6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ffe7203d70542a0afae0ee938560dc5)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:29.838417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcbdafe-b2b0-4f13-97a5-5626f85efa6a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:29.848633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:29.895115 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8bcbdafe-b2b0-4f13-97a5-5626f85efa6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ffe7203d70542a0afae0ee938560dc5', 'request_id': 'req-8bcbdafe-b2b0-4f13-97a5-5626f85efa6a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:29.901369 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8bcbdafe-b2b0-4f13-97a5-5626f85efa6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ffe7203d70542a0afae0ee938560dc5', 'request_id': 'req-8bcbdafe-b2b0-4f13-97a5-5626f85efa6a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:29.908787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8bcbdafe-b2b0-4f13-97a5-5626f85efa6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ffe7203d70542a0afae0ee938560dc5', 'request_id': 'req-8bcbdafe-b2b0-4f13-97a5-5626f85efa6a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:29.924025 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8bcbdafe-b2b0-4f13-97a5-5626f85efa6a admin admin] The token cache is being invalidate because project 4ffe7203d70542a0afae0ee938560dc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:29.924315 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8bcbdafe-b2b0-4f13-97a5-5626f85efa6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:29.924981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8bcbdafe-b2b0-4f13-97a5-5626f85efa6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:29.926858 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4173/8395] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:37:29 2022] DELETE /identity/v3/projects/4ffe7203d70542a0afae0ee938560dc5 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:29.930982 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d05f3-963c-45e2-8f01-ef48263d5f1f service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:29.942563 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d05f3-963c-45e2-8f01-ef48263d5f1f service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:30.016940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0e493-f75f-4d10-836c-3776f01e1221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:30.017584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0e493-f75f-4d10-836c-3776f01e1221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:30.017893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0e493-f75f-4d10-836c-3776f01e1221 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:30.018538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0e493-f75f-4d10-836c-3776f01e1221 admin admin] PATH_INFO: `/v3/users/9d4e3d472d8e4c439bdab3d81bb9915c` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:30.020045 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0e493-f75f-4d10-836c-3776f01e1221 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d4e3d472d8e4c439bdab3d81bb9915c)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:30.022661 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0e493-f75f-4d10-836c-3776f01e1221 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:30.093186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6eb0e493-f75f-4d10-836c-3776f01e1221 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d4e3d472d8e4c439bdab3d81bb9915c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:30.102470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6eb0e493-f75f-4d10-836c-3776f01e1221 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d4e3d472d8e4c439bdab3d81bb9915c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:30.104263 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6eb0e493-f75f-4d10-836c-3776f01e1221 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d4e3d472d8e4c439bdab3d81bb9915c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:30.105636 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6eb0e493-f75f-4d10-836c-3776f01e1221 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d4e3d472d8e4c439bdab3d81bb9915c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:30.118432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6eb0e493-f75f-4d10-836c-3776f01e1221 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d4e3d472d8e4c439bdab3d81bb9915c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:30.127886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:30.158655 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4223/8396] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:37:29 2022] DELETE /identity/v3/users/9d4e3d472d8e4c439bdab3d81bb9915c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:30.401784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbdafe-b2b0-4f13-97a5-5626f85efa6a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:30.403362 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8bcbdafe-b2b0-4f13-97a5-5626f85efa6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:30.424930 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbdafe-b2b0-4f13-97a5-5626f85efa6a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:30.465731 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0e493-f75f-4d10-836c-3776f01e1221 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:30.468843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6eb0e493-f75f-4d10-836c-3776f01e1221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:30.493560 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb77040-419a-422d-bbb9-6f89be75b766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:30.494192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb77040-419a-422d-bbb9-6f89be75b766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:30.494474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb77040-419a-422d-bbb9-6f89be75b766 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:30.494779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb77040-419a-422d-bbb9-6f89be75b766 admin admin] PATH_INFO: `/v3/users/2546206081194220b74969ae610ae5be` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:30.495909 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb77040-419a-422d-bbb9-6f89be75b766 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2546206081194220b74969ae610ae5be)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:30.498122 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb77040-419a-422d-bbb9-6f89be75b766 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:30.547746 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fbb77040-419a-422d-bbb9-6f89be75b766 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2546206081194220b74969ae610ae5be'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:30.548484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fbb77040-419a-422d-bbb9-6f89be75b766 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2546206081194220b74969ae610ae5be'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:30.549117 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fbb77040-419a-422d-bbb9-6f89be75b766 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2546206081194220b74969ae610ae5be'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:30.550502 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0e493-f75f-4d10-836c-3776f01e1221 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:30.555658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d124db6-07bb-49aa-af8e-6a062c7d116d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:30.556307 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d124db6-07bb-49aa-af8e-6a062c7d116d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:30.556468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fbb77040-419a-422d-bbb9-6f89be75b766 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2546206081194220b74969ae610ae5be'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:30.556572 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d124db6-07bb-49aa-af8e-6a062c7d116d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:30.556863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d124db6-07bb-49aa-af8e-6a062c7d116d admin admin] PATH_INFO: `/v3/projects/9488524e7cb94a33ba1877370c83893a` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:30.558050 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d124db6-07bb-49aa-af8e-6a062c7d116d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9488524e7cb94a33ba1877370c83893a)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:30.559997 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d124db6-07bb-49aa-af8e-6a062c7d116d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:30.570740 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-fbb77040-419a-422d-bbb9-6f89be75b766 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2546206081194220b74969ae610ae5be'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:30.584615 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4174/8397] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:37:30 2022] DELETE /identity/v3/users/2546206081194220b74969ae610ae5be => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:30.588861 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b69a9-10ce-424c-800b-5dbb3ba49810 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:30.589144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b69a9-10ce-424c-800b-5dbb3ba49810 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:30.589409 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b69a9-10ce-424c-800b-5dbb3ba49810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:30.607573 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2d124db6-07bb-49aa-af8e-6a062c7d116d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9488524e7cb94a33ba1877370c83893a', 'request_id': 'req-2d124db6-07bb-49aa-af8e-6a062c7d116d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:30.609440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-2f3b69a9-10ce-424c-800b-5dbb3ba49810 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:30.610674 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2f3b69a9-10ce-424c-800b-5dbb3ba49810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:30.613360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2d124db6-07bb-49aa-af8e-6a062c7d116d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9488524e7cb94a33ba1877370c83893a', 'request_id': 'req-2d124db6-07bb-49aa-af8e-6a062c7d116d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:30.621116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:30.621633 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2d124db6-07bb-49aa-af8e-6a062c7d116d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9488524e7cb94a33ba1877370c83893a', 'request_id': 'req-2d124db6-07bb-49aa-af8e-6a062c7d116d'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:30.634447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2d124db6-07bb-49aa-af8e-6a062c7d116d admin admin] The token cache is being invalidate because project 9488524e7cb94a33ba1877370c83893a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:30.634852 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2d124db6-07bb-49aa-af8e-6a062c7d116d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:30.635510 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-2d124db6-07bb-49aa-af8e-6a062c7d116d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:30.637094 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4224/8398] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:37:30 2022] DELETE /identity/v3/projects/9488524e7cb94a33ba1877370c83893a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:37:30.643936 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39284d29-6827-4277-84a5-55bc033ed110 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:30.644224 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39284d29-6827-4277-84a5-55bc033ed110 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:30.644497 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39284d29-6827-4277-84a5-55bc033ed110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:30.664495 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-39284d29-6827-4277-84a5-55bc033ed110 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:30.665896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-39284d29-6827-4277-84a5-55bc033ed110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:30.678166 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4175/8399] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:37:30.691742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b69a9-10ce-424c-800b-5dbb3ba49810 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:30.693188 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2f3b69a9-10ce-424c-800b-5dbb3ba49810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:30.729865 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4225/8400] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:37:30.739970 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec745207-47c8-4796-8058-b8f3873eb726 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:30.740341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec745207-47c8-4796-8058-b8f3873eb726 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:30.740688 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec745207-47c8-4796-8058-b8f3873eb726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:30.755009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b69a9-10ce-424c-800b-5dbb3ba49810 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:30.758964 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8ef63-fce2-4d83-a065-d6f6f16d82ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:30.759577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8ef63-fce2-4d83-a065-d6f6f16d82ba service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:30.759861 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8ef63-fce2-4d83-a065-d6f6f16d82ba service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:30.760137 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8ef63-fce2-4d83-a065-d6f6f16d82ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:30.760556 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-ec745207-47c8-4796-8058-b8f3873eb726 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:30.761777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ec745207-47c8-4796-8058-b8f3873eb726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:30.770355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de8ef63-fce2-4d83-a065-d6f6f16d82ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:30.770535 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4226/8401] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:30.771811 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de8ef63-fce2-4d83-a065-d6f6f16d82ba service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:30.774569 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec745207-47c8-4796-8058-b8f3873eb726 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:30.782140 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4176/8402] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:37:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:37:30.784930 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec745207-47c8-4796-8058-b8f3873eb726 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:30.790509 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa524bc-dc75-49dd-9509-8c3a6c93e279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:30.790809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa524bc-dc75-49dd-9509-8c3a6c93e279 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:30.791091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa524bc-dc75-49dd-9509-8c3a6c93e279 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:30.791362 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa524bc-dc75-49dd-9509-8c3a6c93e279 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:30.792002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa524bc-dc75-49dd-9509-8c3a6c93e279 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:37:30.792297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa524bc-dc75-49dd-9509-8c3a6c93e279 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:30.793880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa524bc-dc75-49dd-9509-8c3a6c93e279 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:30.797383 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:30.812971 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4227/8403] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:37:30.817183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8ef63-fce2-4d83-a065-d6f6f16d82ba service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:30.828104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8ef63-fce2-4d83-a065-d6f6f16d82ba service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:30.835711 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66317a4-823f-4230-ae42-3f2f7e380c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:30.836256 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66317a4-823f-4230-ae42-3f2f7e380c8d admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:30.836538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66317a4-823f-4230-ae42-3f2f7e380c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:30.836807 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66317a4-823f-4230-ae42-3f2f7e380c8d admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:30.837442 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66317a4-823f-4230-ae42-3f2f7e380c8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:30.840438 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66317a4-823f-4230-ae42-3f2f7e380c8d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:30.873845 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4177/8404] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:37:30 2022] POST /identity/v3/projects => generated 399 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:30.875514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa524bc-dc75-49dd-9509-8c3a6c93e279 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:30.885936 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa524bc-dc75-49dd-9509-8c3a6c93e279 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:30.955170 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abddaac9-d6cc-4e5f-a133-d970d7e2d1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:30.955876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddaac9-d6cc-4e5f-a133-d970d7e2d1c9 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:30.956288 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddaac9-d6cc-4e5f-a133-d970d7e2d1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:30.956443 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddaac9-d6cc-4e5f-a133-d970d7e2d1c9 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:30.957134 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abddaac9-d6cc-4e5f-a133-d970d7e2d1c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:30.959099 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abddaac9-d6cc-4e5f-a133-d970d7e2d1c9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:30.964412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66317a4-823f-4230-ae42-3f2f7e380c8d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:30.966233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b66317a4-823f-4230-ae42-3f2f7e380c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:30.990173 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4228/8405] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:37:30 2022] POST /identity/v3/users => generated 300 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:30.991580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abddaac9-d6cc-4e5f-a133-d970d7e2d1c9 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:30.993169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66317a4-823f-4230-ae42-3f2f7e380c8d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:30.999128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fdc2a4-d7da-42d3-aa2e-ea08ed9a748b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:30.999128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdc2a4-d7da-42d3-aa2e-ea08ed9a748b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:30.999128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdc2a4-d7da-42d3-aa2e-ea08ed9a748b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:30.999468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdc2a4-d7da-42d3-aa2e-ea08ed9a748b admin admin] PATH_INFO: `/v3/projects/f112c7eec77f4fee88dfa98f4943dc92` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:31.000443 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fdc2a4-d7da-42d3-aa2e-ea08ed9a748b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f112c7eec77f4fee88dfa98f4943dc92)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:31.002347 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fdc2a4-d7da-42d3-aa2e-ea08ed9a748b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:31.003115 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abddaac9-d6cc-4e5f-a133-d970d7e2d1c9 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:31.007917 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6197103-0689-41e7-9861-da556098a690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:31.008592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6197103-0689-41e7-9861-da556098a690 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:31.009152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6197103-0689-41e7-9861-da556098a690 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:31.009430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6197103-0689-41e7-9861-da556098a690 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:31.010148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6197103-0689-41e7-9861-da556098a690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:31.011846 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6197103-0689-41e7-9861-da556098a690 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:31.026446 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4229/8406] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:37:31.027519 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6197103-0689-41e7-9861-da556098a690 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:31.038626 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6197103-0689-41e7-9861-da556098a690 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:31.051376 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-40fdc2a4-d7da-42d3-aa2e-ea08ed9a748b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f112c7eec77f4fee88dfa98f4943dc92', 'request_id': 'req-40fdc2a4-d7da-42d3-aa2e-ea08ed9a748b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:31.057118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-40fdc2a4-d7da-42d3-aa2e-ea08ed9a748b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f112c7eec77f4fee88dfa98f4943dc92', 'request_id': 'req-40fdc2a4-d7da-42d3-aa2e-ea08ed9a748b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:31.063473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-40fdc2a4-d7da-42d3-aa2e-ea08ed9a748b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f112c7eec77f4fee88dfa98f4943dc92', 'request_id': 'req-40fdc2a4-d7da-42d3-aa2e-ea08ed9a748b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:31.076598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-40fdc2a4-d7da-42d3-aa2e-ea08ed9a748b admin admin] The token cache is being invalidate because project f112c7eec77f4fee88dfa98f4943dc92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:31.076928 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-40fdc2a4-d7da-42d3-aa2e-ea08ed9a748b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:31.077538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-40fdc2a4-d7da-42d3-aa2e-ea08ed9a748b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:31.079100 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4178/8407] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:37:30 2022] DELETE /identity/v3/projects/f112c7eec77f4fee88dfa98f4943dc92 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:31.083784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b37582-fb03-4e6e-a9e2-2e460b76dff3 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:31.084065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b37582-fb03-4e6e-a9e2-2e460b76dff3 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:31.084335 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b37582-fb03-4e6e-a9e2-2e460b76dff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:31.101237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a1ea7-b93d-4fe6-93ec-3a0e0877898f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:31.101770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a1ea7-b93d-4fe6-93ec-3a0e0877898f admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:31.102052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a1ea7-b93d-4fe6-93ec-3a0e0877898f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:31.102340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a1ea7-b93d-4fe6-93ec-3a0e0877898f admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:31.103015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a1ea7-b93d-4fe6-93ec-3a0e0877898f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:31.104435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-93b37582-fb03-4e6e-a9e2-2e460b76dff3 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:31.104607 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a1ea7-b93d-4fe6-93ec-3a0e0877898f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:31.105617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-93b37582-fb03-4e6e-a9e2-2e460b76dff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:31.114085 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4179/8408] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:31.116092 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4230/8409] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:37:31.120156 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b37582-fb03-4e6e-a9e2-2e460b76dff3 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:31.121590 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-93b37582-fb03-4e6e-a9e2-2e460b76dff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:31.123265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbb245-b311-4e88-9425-cc525654385b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:31.123554 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbb245-b311-4e88-9425-cc525654385b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:31.123833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbb245-b311-4e88-9425-cc525654385b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:31.133829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b37582-fb03-4e6e-a9e2-2e460b76dff3 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:31.138753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7b9fe-5832-4d93-bc12-15bdd8aef655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:31.139428 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7b9fe-5832-4d93-bc12-15bdd8aef655 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:31.139714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7b9fe-5832-4d93-bc12-15bdd8aef655 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:31.139991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7b9fe-5832-4d93-bc12-15bdd8aef655 admin admin] PATH_INFO: `/v3/projects/ef6a33c0c31a4baa8a2e522ecb706d35/users/ad3b8b75b7374f4b9c3b6dd34e40fd0a/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:31.143167 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-66bbb245-b311-4e88-9425-cc525654385b None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:31.144382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-66bbb245-b311-4e88-9425-cc525654385b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:31.151524 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:31.152610 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4231/8410] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:37:31.157495 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbb245-b311-4e88-9425-cc525654385b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:31.159464 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d7b9fe-5832-4d93-bc12-15bdd8aef655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef6a33c0c31a4baa8a2e522ecb706d35, user_id=ad3b8b75b7374f4b9c3b6dd34e40fd0a, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:31.163062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d7b9fe-5832-4d93-bc12-15bdd8aef655 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:31.166898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbb245-b311-4e88-9425-cc525654385b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:31.172351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ac55a-e2b0-4032-81e4-0a3dc2b65c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:31.172942 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ac55a-e2b0-4032-81e4-0a3dc2b65c47 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:31.173223 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ac55a-e2b0-4032-81e4-0a3dc2b65c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:31.173491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ac55a-e2b0-4032-81e4-0a3dc2b65c47 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:31.174133 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ac55a-e2b0-4032-81e4-0a3dc2b65c47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:37:31.174440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ac55a-e2b0-4032-81e4-0a3dc2b65c47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:31.176033 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ac55a-e2b0-4032-81e4-0a3dc2b65c47 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:31.177454 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4180/8411] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:37:31 2022] PUT /identity/v3/projects/ef6a33c0c31a4baa8a2e522ecb706d35/users/ad3b8b75b7374f4b9c3b6dd34e40fd0a/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:31.188246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f67e8-3800-46f2-aa95-a96e8a364da1 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:31.188533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f67e8-3800-46f2-aa95-a96e8a364da1 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:31.188812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f67e8-3800-46f2-aa95-a96e8a364da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:31.192584 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4232/8412] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:37:31.193597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ac55a-e2b0-4032-81e4-0a3dc2b65c47 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:31.203421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ac55a-e2b0-4032-81e4-0a3dc2b65c47 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:31.217134 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-df1f67e8-3800-46f2-aa95-a96e8a364da1 None None] MFA Rules not processed for user `ad3b8b75b7374f4b9c3b6dd34e40fd0a`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:31.218350 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-df1f67e8-3800-46f2-aa95-a96e8a364da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:31.251108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:31.262901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27b1de-d9f7-4ead-a914-29b81b873c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:31.264052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27b1de-d9f7-4ead-a914-29b81b873c6d admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:31.264370 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27b1de-d9f7-4ead-a914-29b81b873c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:31.264649 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27b1de-d9f7-4ead-a914-29b81b873c6d admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:31.265287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc27b1de-d9f7-4ead-a914-29b81b873c6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:31.267206 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc27b1de-d9f7-4ead-a914-29b81b873c6d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:31.285586 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4181/8413] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:31 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:37:31.290179 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f67e8-3800-46f2-aa95-a96e8a364da1 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:31.296123 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4233/8414] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:37:31 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:31.300174 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27b1de-d9f7-4ead-a914-29b81b873c6d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:31.301910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f67e8-3800-46f2-aa95-a96e8a364da1 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:31.359848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4fc40-abf7-44eb-9440-1feeebf5316c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:31.360348 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4fc40-abf7-44eb-9440-1feeebf5316c admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:31.360630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4fc40-abf7-44eb-9440-1feeebf5316c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:31.360901 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4fc40-abf7-44eb-9440-1feeebf5316c admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:31.361508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b4fc40-abf7-44eb-9440-1feeebf5316c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:31.363442 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b4fc40-abf7-44eb-9440-1feeebf5316c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:31.363584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27b1de-d9f7-4ead-a914-29b81b873c6d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:31.368104 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692af3d-c6f9-4e2b-905a-1bc2a038b0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:31.368707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692af3d-c6f9-4e2b-905a-1bc2a038b0cd admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:31.368984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692af3d-c6f9-4e2b-905a-1bc2a038b0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:31.369276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692af3d-c6f9-4e2b-905a-1bc2a038b0cd admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:31.369862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692af3d-c6f9-4e2b-905a-1bc2a038b0cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:31.371775 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692af3d-c6f9-4e2b-905a-1bc2a038b0cd admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:31.392000 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4182/8415] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:37:31 2022] POST /identity/v3/projects => generated 401 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:37:31.394067 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4234/8416] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:37:31 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:37:31.395742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4fc40-abf7-44eb-9440-1feeebf5316c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:31.398235 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692af3d-c6f9-4e2b-905a-1bc2a038b0cd admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:31.408988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692af3d-c6f9-4e2b-905a-1bc2a038b0cd admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:31.459222 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4fc40-abf7-44eb-9440-1feeebf5316c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:31.464199 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b46d5-ab15-41ef-939f-5421f061298d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:31.464805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b46d5-ab15-41ef-939f-5421f061298d admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:31.465092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b46d5-ab15-41ef-939f-5421f061298d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:31.465367 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b46d5-ab15-41ef-939f-5421f061298d admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:31.466013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b46d5-ab15-41ef-939f-5421f061298d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:31.466352 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a5e2b-5d3c-4ce1-8359-15bc5fbb3dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:31.467662 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a5e2b-5d3c-4ce1-8359-15bc5fbb3dbc admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:31.468125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a5e2b-5d3c-4ce1-8359-15bc5fbb3dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:31.468402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a5e2b-5d3c-4ce1-8359-15bc5fbb3dbc admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:31.468821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b46d5-ab15-41ef-939f-5421f061298d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:31.469036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a5e2b-5d3c-4ce1-8359-15bc5fbb3dbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:31.470655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a5e2b-5d3c-4ce1-8359-15bc5fbb3dbc admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:31.478703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:31.480670 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4235/8417] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:37:31.484849 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a5e2b-5d3c-4ce1-8359-15bc5fbb3dbc admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:31.493690 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4183/8418] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:37:31 2022] POST /identity/v3/users => generated 307 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:37:31.495533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a5e2b-5d3c-4ce1-8359-15bc5fbb3dbc admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:31.497564 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b46d5-ab15-41ef-939f-5421f061298d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:31.500284 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e2c8f-1135-4b69-b2f5-a7fb2b26275d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:31.500872 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e2c8f-1135-4b69-b2f5-a7fb2b26275d admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:31.501150 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e2c8f-1135-4b69-b2f5-a7fb2b26275d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:31.501445 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e2c8f-1135-4b69-b2f5-a7fb2b26275d admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:31.502072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e2c8f-1135-4b69-b2f5-a7fb2b26275d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:31.503711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e2c8f-1135-4b69-b2f5-a7fb2b26275d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:31.507405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b46d5-ab15-41ef-939f-5421f061298d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:31.512350 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a612534-3824-42f0-90e4-180d244e8ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:31.512925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a612534-3824-42f0-90e4-180d244e8ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:31.513207 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a612534-3824-42f0-90e4-180d244e8ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:31.514011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a612534-3824-42f0-90e4-180d244e8ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:31.514688 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a612534-3824-42f0-90e4-180d244e8ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:31.518429 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4236/8419] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:37:31.518611 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a612534-3824-42f0-90e4-180d244e8ae1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:31.519293 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e2c8f-1135-4b69-b2f5-a7fb2b26275d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:31.530447 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4184/8420] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:37:31.530689 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e2c8f-1135-4b69-b2f5-a7fb2b26275d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:31.531334 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a612534-3824-42f0-90e4-180d244e8ae1 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:31.533985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e744653-6283-414c-820d-160e33b57e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:31.534691 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e744653-6283-414c-820d-160e33b57e9d admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:31.534968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e744653-6283-414c-820d-160e33b57e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:31.535238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e744653-6283-414c-820d-160e33b57e9d admin admin] PATH_INFO: `/v3/projects/845932048d7e4ddd93537f16369cd54f/users/8db6256eb83f445c951d947f38fb6f1b/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:31.541077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a612534-3824-42f0-90e4-180d244e8ae1 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:31.546617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93b70e-e260-4a47-a7bd-8a322b5f42ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:31.547311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93b70e-e260-4a47-a7bd-8a322b5f42ca admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:31.547677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93b70e-e260-4a47-a7bd-8a322b5f42ca admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:31.548233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93b70e-e260-4a47-a7bd-8a322b5f42ca admin admin] PATH_INFO: `/v3/projects/0a2796890f8443f3b12a87acef76a56d/users/2782b3a69e6f479187a5b9c5dfa8a847/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:31.551666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e744653-6283-414c-820d-160e33b57e9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=845932048d7e4ddd93537f16369cd54f, user_id=8db6256eb83f445c951d947f38fb6f1b, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:31.554640 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e744653-6283-414c-820d-160e33b57e9d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:31.564196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93b70e-e260-4a47-a7bd-8a322b5f42ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a2796890f8443f3b12a87acef76a56d, user_id=2782b3a69e6f479187a5b9c5dfa8a847, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:31.567077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93b70e-e260-4a47-a7bd-8a322b5f42ca admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:31.569169 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4237/8421] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:37:31 2022] PUT /identity/v3/projects/845932048d7e4ddd93537f16369cd54f/users/8db6256eb83f445c951d947f38fb6f1b/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:37:31.579817 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6948fc-7220-474f-a908-a79d5549eba7 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:31.580053 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4185/8422] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:37:31 2022] PUT /identity/v3/projects/0a2796890f8443f3b12a87acef76a56d/users/2782b3a69e6f479187a5b9c5dfa8a847/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:31.582886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6948fc-7220-474f-a908-a79d5549eba7 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:31.583202 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6948fc-7220-474f-a908-a79d5549eba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:31.583661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93b70e-e260-4a47-a7bd-8a322b5f42ca admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:31.612061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-1f6948fc-7220-474f-a908-a79d5549eba7 None None] MFA Rules not processed for user `8db6256eb83f445c951d947f38fb6f1b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:31.613352 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1f6948fc-7220-474f-a908-a79d5549eba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:31.626562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:31.647216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93b70e-e260-4a47-a7bd-8a322b5f42ca admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:31.652220 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721197d4-a845-4434-a8c0-8f54bb69bc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:31.652829 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721197d4-a845-4434-a8c0-8f54bb69bc13 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:31.653111 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721197d4-a845-4434-a8c0-8f54bb69bc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:31.653455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721197d4-a845-4434-a8c0-8f54bb69bc13 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:31.654673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721197d4-a845-4434-a8c0-8f54bb69bc13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:31.656436 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721197d4-a845-4434-a8c0-8f54bb69bc13 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:31.666671 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4186/8423] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:37:31.673425 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721197d4-a845-4434-a8c0-8f54bb69bc13 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:31.683996 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721197d4-a845-4434-a8c0-8f54bb69bc13 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:31.689705 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4238/8424] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:37:31.694005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c552bbcf-871f-4688-9365-622626eeacfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:31.694521 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552bbcf-871f-4688-9365-622626eeacfd admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:31.694840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552bbcf-871f-4688-9365-622626eeacfd admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:31.695118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552bbcf-871f-4688-9365-622626eeacfd admin admin] PATH_INFO: `/v3/projects/0a2796890f8443f3b12a87acef76a56d/users/2782b3a69e6f479187a5b9c5dfa8a847/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:31.697114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c552bbcf-871f-4688-9365-622626eeacfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a2796890f8443f3b12a87acef76a56d, user_id=2782b3a69e6f479187a5b9c5dfa8a847, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:31.700035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c552bbcf-871f-4688-9365-622626eeacfd admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:31.703345 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6948fc-7220-474f-a908-a79d5549eba7 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:31.704644 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1f6948fc-7220-474f-a908-a79d5549eba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:31.711731 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4187/8425] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:37:31 2022] PUT /identity/v3/projects/0a2796890f8443f3b12a87acef76a56d/users/2782b3a69e6f479187a5b9c5dfa8a847/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:31.723086 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdde0c-44c5-4aa8-bf52-0e0fa7c5147c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:31.723373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdde0c-44c5-4aa8-bf52-0e0fa7c5147c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:31.723648 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdde0c-44c5-4aa8-bf52-0e0fa7c5147c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:31.752345 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-6cfdde0c-44c5-4aa8-bf52-0e0fa7c5147c None None] MFA Rules not processed for user `2782b3a69e6f479187a5b9c5dfa8a847`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:31.753714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6cfdde0c-44c5-4aa8-bf52-0e0fa7c5147c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:31.769620 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6948fc-7220-474f-a908-a79d5549eba7 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:31.819781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86452eb-6f70-47ed-ab98-8f14ccc44473 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:31.820650 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86452eb-6f70-47ed-ab98-8f14ccc44473 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:31.821055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86452eb-6f70-47ed-ab98-8f14ccc44473 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:31.821367 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86452eb-6f70-47ed-ab98-8f14ccc44473 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:31.829795 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4188/8426] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:31 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:37:31.837266 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfdde0c-44c5-4aa8-bf52-0e0fa7c5147c None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:31.838659 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6cfdde0c-44c5-4aa8-bf52-0e0fa7c5147c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:31.868381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:31.882300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86452eb-6f70-47ed-ab98-8f14ccc44473 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:31.883906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86452eb-6f70-47ed-ab98-8f14ccc44473 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:31.894773 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4239/8427] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:37:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:37:31.899586 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfdde0c-44c5-4aa8-bf52-0e0fa7c5147c None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:31.903497 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e569985-d6d3-45f4-a4af-d1e7fc6f8ea8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:31.904427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e569985-d6d3-45f4-a4af-d1e7fc6f8ea8 service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:31.904968 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e569985-d6d3-45f4-a4af-d1e7fc6f8ea8 service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:31.904968 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e569985-d6d3-45f4-a4af-d1e7fc6f8ea8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:31.914263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e569985-d6d3-45f4-a4af-d1e7fc6f8ea8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:31.915788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e569985-d6d3-45f4-a4af-d1e7fc6f8ea8 service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:31.927264 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4189/8428] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:37:31 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:37:32.012288 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86452eb-6f70-47ed-ab98-8f14ccc44473 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:32.025788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86452eb-6f70-47ed-ab98-8f14ccc44473 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:32.031546 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d45eb-a2f8-4de5-8c1d-f70c9270b5b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:32.032274 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d45eb-a2f8-4de5-8c1d-f70c9270b5b3 service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:32.032650 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d45eb-a2f8-4de5-8c1d-f70c9270b5b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:32.032928 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d45eb-a2f8-4de5-8c1d-f70c9270b5b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:32.098681 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:32.145724 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d45eb-a2f8-4de5-8c1d-f70c9270b5b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:32.147324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d45eb-a2f8-4de5-8c1d-f70c9270b5b3 service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:32.157720 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4240/8429] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:37:32 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:37:33.848890 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e569985-d6d3-45f4-a4af-d1e7fc6f8ea8 service cinder] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:33.916429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e569985-d6d3-45f4-a4af-d1e7fc6f8ea8 service cinder] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:33.921425 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89301d-8be8-40cc-8d1e-e9ce98c74f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:33.922062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89301d-8be8-40cc-8d1e-e9ce98c74f8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:33.922348 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89301d-8be8-40cc-8d1e-e9ce98c74f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:33.922628 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89301d-8be8-40cc-8d1e-e9ce98c74f8f admin admin] PATH_INFO: `/v3/users/ad3b8b75b7374f4b9c3b6dd34e40fd0a` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:33.923973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e89301d-8be8-40cc-8d1e-e9ce98c74f8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad3b8b75b7374f4b9c3b6dd34e40fd0a)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:33.925912 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e89301d-8be8-40cc-8d1e-e9ce98c74f8f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:33.974945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7e89301d-8be8-40cc-8d1e-e9ce98c74f8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad3b8b75b7374f4b9c3b6dd34e40fd0a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:33.975667 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7e89301d-8be8-40cc-8d1e-e9ce98c74f8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad3b8b75b7374f4b9c3b6dd34e40fd0a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:33.976272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7e89301d-8be8-40cc-8d1e-e9ce98c74f8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad3b8b75b7374f4b9c3b6dd34e40fd0a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:33.983385 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7e89301d-8be8-40cc-8d1e-e9ce98c74f8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad3b8b75b7374f4b9c3b6dd34e40fd0a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:33.996124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7e89301d-8be8-40cc-8d1e-e9ce98c74f8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad3b8b75b7374f4b9c3b6dd34e40fd0a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:34.009660 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4190/8430] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:37:33 2022] DELETE /identity/v3/users/ad3b8b75b7374f4b9c3b6dd34e40fd0a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:34.014103 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4b13b-ab33-4a7d-995a-61a2533c6484 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:34.014657 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4b13b-ab33-4a7d-995a-61a2533c6484 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:34.014785 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4b13b-ab33-4a7d-995a-61a2533c6484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:34.034683 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-99d4b13b-ab33-4a7d-995a-61a2533c6484 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:34.035909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-99d4b13b-ab33-4a7d-995a-61a2533c6484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:34.108330 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4241/8431] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:34.118171 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89301d-8be8-40cc-8d1e-e9ce98c74f8f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:34.119635 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7e89301d-8be8-40cc-8d1e-e9ce98c74f8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:34.175698 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:34.184085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89301d-8be8-40cc-8d1e-e9ce98c74f8f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:34.189638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6a964-40b2-4799-9ab2-3b16e5a3c71f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:34.190277 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6a964-40b2-4799-9ab2-3b16e5a3c71f service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:34.190613 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6a964-40b2-4799-9ab2-3b16e5a3c71f service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:34.190867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6a964-40b2-4799-9ab2-3b16e5a3c71f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:34.200477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6a964-40b2-4799-9ab2-3b16e5a3c71f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:34.202422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6a964-40b2-4799-9ab2-3b16e5a3c71f service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:34.212578 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4191/8432] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:37:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:37:34.547823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4b13b-ab33-4a7d-995a-61a2533c6484 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:34.549339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-99d4b13b-ab33-4a7d-995a-61a2533c6484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:34.564094 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4b13b-ab33-4a7d-995a-61a2533c6484 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:34.569612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51376f5b-a300-49f4-bc25-31d73b255323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:34.570321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51376f5b-a300-49f4-bc25-31d73b255323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:34.570635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51376f5b-a300-49f4-bc25-31d73b255323 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:34.570921 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51376f5b-a300-49f4-bc25-31d73b255323 admin admin] PATH_INFO: `/v3/projects/ef6a33c0c31a4baa8a2e522ecb706d35` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:34.573001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51376f5b-a300-49f4-bc25-31d73b255323 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef6a33c0c31a4baa8a2e522ecb706d35)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:34.575233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51376f5b-a300-49f4-bc25-31d73b255323 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:34.628813 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-51376f5b-a300-49f4-bc25-31d73b255323 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef6a33c0c31a4baa8a2e522ecb706d35', 'request_id': 'req-51376f5b-a300-49f4-bc25-31d73b255323'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:34.634649 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-51376f5b-a300-49f4-bc25-31d73b255323 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef6a33c0c31a4baa8a2e522ecb706d35', 'request_id': 'req-51376f5b-a300-49f4-bc25-31d73b255323'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:34.644041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-51376f5b-a300-49f4-bc25-31d73b255323 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef6a33c0c31a4baa8a2e522ecb706d35', 'request_id': 'req-51376f5b-a300-49f4-bc25-31d73b255323'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:34.656852 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-51376f5b-a300-49f4-bc25-31d73b255323 admin admin] The token cache is being invalidate because project ef6a33c0c31a4baa8a2e522ecb706d35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:34.657142 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-51376f5b-a300-49f4-bc25-31d73b255323 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:34.657782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-51376f5b-a300-49f4-bc25-31d73b255323 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:34.659547 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4242/8433] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:37:34 2022] DELETE /identity/v3/projects/ef6a33c0c31a4baa8a2e522ecb706d35 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:34.663764 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6a964-40b2-4799-9ab2-3b16e5a3c71f service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:34.681728 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6a964-40b2-4799-9ab2-3b16e5a3c71f service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:34.744914 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff404c-1576-4517-b3ca-5e09b2491ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:34.745325 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff404c-1576-4517-b3ca-5e09b2491ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:34.745610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff404c-1576-4517-b3ca-5e09b2491ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:34.745882 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff404c-1576-4517-b3ca-5e09b2491ad0 admin admin] PATH_INFO: `/v3/users/2782b3a69e6f479187a5b9c5dfa8a847` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:34.747085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff404c-1576-4517-b3ca-5e09b2491ad0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2782b3a69e6f479187a5b9c5dfa8a847)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:34.749057 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff404c-1576-4517-b3ca-5e09b2491ad0 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:34.805226 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9eff404c-1576-4517-b3ca-5e09b2491ad0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2782b3a69e6f479187a5b9c5dfa8a847'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:34.806107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9eff404c-1576-4517-b3ca-5e09b2491ad0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2782b3a69e6f479187a5b9c5dfa8a847'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:34.806816 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9eff404c-1576-4517-b3ca-5e09b2491ad0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2782b3a69e6f479187a5b9c5dfa8a847'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:34.815038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9eff404c-1576-4517-b3ca-5e09b2491ad0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2782b3a69e6f479187a5b9c5dfa8a847'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:34.829707 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-9eff404c-1576-4517-b3ca-5e09b2491ad0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2782b3a69e6f479187a5b9c5dfa8a847'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:34.843369 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4192/8434] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:37:34 2022] DELETE /identity/v3/users/2782b3a69e6f479187a5b9c5dfa8a847 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:35.231922 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51376f5b-a300-49f4-bc25-31d73b255323 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:35.235171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-51376f5b-a300-49f4-bc25-31d73b255323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:35.249178 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51376f5b-a300-49f4-bc25-31d73b255323 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:35.309592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:35.324083 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30187971-9272-45d1-8fda-eb85c26bdff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:35.324807 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30187971-9272-45d1-8fda-eb85c26bdff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:35.325158 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30187971-9272-45d1-8fda-eb85c26bdff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:35.325524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30187971-9272-45d1-8fda-eb85c26bdff5 admin admin] PATH_INFO: `/v3/projects/0a2796890f8443f3b12a87acef76a56d` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:35.327512 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30187971-9272-45d1-8fda-eb85c26bdff5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a2796890f8443f3b12a87acef76a56d)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:35.329583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30187971-9272-45d1-8fda-eb85c26bdff5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:35.381653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-30187971-9272-45d1-8fda-eb85c26bdff5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a2796890f8443f3b12a87acef76a56d', 'request_id': 'req-30187971-9272-45d1-8fda-eb85c26bdff5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:35.387686 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-30187971-9272-45d1-8fda-eb85c26bdff5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a2796890f8443f3b12a87acef76a56d', 'request_id': 'req-30187971-9272-45d1-8fda-eb85c26bdff5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:35.397224 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-30187971-9272-45d1-8fda-eb85c26bdff5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a2796890f8443f3b12a87acef76a56d', 'request_id': 'req-30187971-9272-45d1-8fda-eb85c26bdff5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:35.410428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-30187971-9272-45d1-8fda-eb85c26bdff5 admin admin] The token cache is being invalidate because project 0a2796890f8443f3b12a87acef76a56d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:35.410776 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-30187971-9272-45d1-8fda-eb85c26bdff5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:35.411401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-30187971-9272-45d1-8fda-eb85c26bdff5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:35.412890 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4243/8435] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:37:35 2022] DELETE /identity/v3/projects/0a2796890f8443f3b12a87acef76a56d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:35.417686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa371c2-aeaf-4ab0-90d5-ad44be706bc9 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:35.418209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa371c2-aeaf-4ab0-90d5-ad44be706bc9 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:35.418209 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa371c2-aeaf-4ab0-90d5-ad44be706bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:35.440167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-aaa371c2-aeaf-4ab0-90d5-ad44be706bc9 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:35.441385 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-aaa371c2-aeaf-4ab0-90d5-ad44be706bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:35.509758 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4193/8436] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:35.518508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231355e-72dc-4899-8f3f-890df0571a42 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:35.518825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231355e-72dc-4899-8f3f-890df0571a42 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:35.519110 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231355e-72dc-4899-8f3f-890df0571a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:35.549875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d231355e-72dc-4899-8f3f-890df0571a42 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:35.551152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d231355e-72dc-4899-8f3f-890df0571a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:35.565791 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4244/8437] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:35.572755 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa371c2-aeaf-4ab0-90d5-ad44be706bc9 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:35.582536 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa371c2-aeaf-4ab0-90d5-ad44be706bc9 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:35.588364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d164288-c37c-43f1-9f82-ac2b431268a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:35.589010 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d164288-c37c-43f1-9f82-ac2b431268a3 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:35.589294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d164288-c37c-43f1-9f82-ac2b431268a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:35.589567 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d164288-c37c-43f1-9f82-ac2b431268a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:35.590325 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d164288-c37c-43f1-9f82-ac2b431268a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:37:35.590723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d164288-c37c-43f1-9f82-ac2b431268a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:35.592634 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d164288-c37c-43f1-9f82-ac2b431268a3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:35.601727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:35.612223 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4194/8438] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:37:35.613311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231355e-72dc-4899-8f3f-890df0571a42 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:35.622713 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231355e-72dc-4899-8f3f-890df0571a42 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:35.628026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832ab40-8cf6-44a4-b540-1a7627135bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:35.629461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832ab40-8cf6-44a4-b540-1a7627135bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:35.629461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832ab40-8cf6-44a4-b540-1a7627135bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:35.629461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832ab40-8cf6-44a4-b540-1a7627135bb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:35.629835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832ab40-8cf6-44a4-b540-1a7627135bb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:35.631800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832ab40-8cf6-44a4-b540-1a7627135bb5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:35.669414 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4245/8439] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:37:35 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:37:35.678929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d164288-c37c-43f1-9f82-ac2b431268a3 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:35.690520 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d164288-c37c-43f1-9f82-ac2b431268a3 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:35.758345 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256bcf7-8171-48dc-b301-59f682758db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:35.758986 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256bcf7-8171-48dc-b301-59f682758db0 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:35.759265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256bcf7-8171-48dc-b301-59f682758db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:35.759534 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256bcf7-8171-48dc-b301-59f682758db0 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:35.760158 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256bcf7-8171-48dc-b301-59f682758db0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:35.762066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256bcf7-8171-48dc-b301-59f682758db0 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:35.789804 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4195/8440] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:37:35 2022] POST /identity/v3/users => generated 291 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:35.793842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832ab40-8cf6-44a4-b540-1a7627135bb5 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:35.806700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832ab40-8cf6-44a4-b540-1a7627135bb5 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:35.811871 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfeaaba-672e-4974-9770-933fc50aa81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:35.812485 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfeaaba-672e-4974-9770-933fc50aa81c admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:35.812770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfeaaba-672e-4974-9770-933fc50aa81c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:35.813046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfeaaba-672e-4974-9770-933fc50aa81c admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:35.813687 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfeaaba-672e-4974-9770-933fc50aa81c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:35.815328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfeaaba-672e-4974-9770-933fc50aa81c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:35.827887 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4246/8441] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:37:35.831964 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256bcf7-8171-48dc-b301-59f682758db0 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:35.843941 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256bcf7-8171-48dc-b301-59f682758db0 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:35.849265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f4d7d-7c6c-4bb3-9f39-e4e86e8d00fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:35.849978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f4d7d-7c6c-4bb3-9f39-e4e86e8d00fa admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:35.850260 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f4d7d-7c6c-4bb3-9f39-e4e86e8d00fa admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:35.850535 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f4d7d-7c6c-4bb3-9f39-e4e86e8d00fa admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:35.851191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193f4d7d-7c6c-4bb3-9f39-e4e86e8d00fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:35.852825 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193f4d7d-7c6c-4bb3-9f39-e4e86e8d00fa admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:35.863796 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4196/8442] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:37:35.868100 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfeaaba-672e-4974-9770-933fc50aa81c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:35.878525 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfeaaba-672e-4974-9770-933fc50aa81c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:35.883368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921509b-936c-4d24-8de4-af74b8aa784d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:35.884030 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921509b-936c-4d24-8de4-af74b8aa784d admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:35.884384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921509b-936c-4d24-8de4-af74b8aa784d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:35.884731 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921509b-936c-4d24-8de4-af74b8aa784d admin admin] PATH_INFO: `/v3/projects/3fc4a4c2565347efaaa1a680c7fb47db/users/2ceca23b9faa48b8bf8d2e80120a3180/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:35.901047 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921509b-936c-4d24-8de4-af74b8aa784d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fc4a4c2565347efaaa1a680c7fb47db, user_id=2ceca23b9faa48b8bf8d2e80120a3180, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:35.904017 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921509b-936c-4d24-8de4-af74b8aa784d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:35.918155 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4247/8443] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:37:35 2022] PUT /identity/v3/projects/3fc4a4c2565347efaaa1a680c7fb47db/users/2ceca23b9faa48b8bf8d2e80120a3180/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:37:35.928570 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0da4f-7127-4c78-89b5-3e2c3c2160e7 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:35.928864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0da4f-7127-4c78-89b5-3e2c3c2160e7 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:35.929394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0da4f-7127-4c78-89b5-3e2c3c2160e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:35.957044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-04d0da4f-7127-4c78-89b5-3e2c3c2160e7 None None] MFA Rules not processed for user `2ceca23b9faa48b8bf8d2e80120a3180`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:35.958252 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-04d0da4f-7127-4c78-89b5-3e2c3c2160e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:36.053312 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4197/8444] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:36.063349 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921509b-936c-4d24-8de4-af74b8aa784d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:36.140876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921509b-936c-4d24-8de4-af74b8aa784d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:36.146952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220c8dd-a835-4131-ba0d-159edefaa9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:36.147569 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220c8dd-a835-4131-ba0d-159edefaa9b7 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:36.147850 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220c8dd-a835-4131-ba0d-159edefaa9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:36.148503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220c8dd-a835-4131-ba0d-159edefaa9b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:36.148756 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9220c8dd-a835-4131-ba0d-159edefaa9b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:36.150768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9220c8dd-a835-4131-ba0d-159edefaa9b7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:36.179851 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:36.190835 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4248/8445] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:37:36 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:37:36.192249 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0da4f-7127-4c78-89b5-3e2c3c2160e7 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:36.209800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0da4f-7127-4c78-89b5-3e2c3c2160e7 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:36.306923 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4afb1d4-1c65-4bc2-82ba-80efbd0cf400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:36.307524 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afb1d4-1c65-4bc2-82ba-80efbd0cf400 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:36.307807 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afb1d4-1c65-4bc2-82ba-80efbd0cf400 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:36.308105 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afb1d4-1c65-4bc2-82ba-80efbd0cf400 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:36.308736 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4afb1d4-1c65-4bc2-82ba-80efbd0cf400 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:36.310864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4afb1d4-1c65-4bc2-82ba-80efbd0cf400 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:36.324615 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:36.340924 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4198/8446] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:37:36 2022] POST /identity/v3/users => generated 296 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:36.342838 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220c8dd-a835-4131-ba0d-159edefaa9b7 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:36.355415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220c8dd-a835-4131-ba0d-159edefaa9b7 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:36.361619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184eae92-c33f-4d92-9b9f-f536f16b4b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:36.362243 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184eae92-c33f-4d92-9b9f-f536f16b4b1e admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:36.362526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184eae92-c33f-4d92-9b9f-f536f16b4b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:36.363041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184eae92-c33f-4d92-9b9f-f536f16b4b1e admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:36.363696 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184eae92-c33f-4d92-9b9f-f536f16b4b1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:36.365305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184eae92-c33f-4d92-9b9f-f536f16b4b1e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:36.405904 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4249/8447] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:37:36.410301 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4afb1d4-1c65-4bc2-82ba-80efbd0cf400 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:36.424284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4afb1d4-1c65-4bc2-82ba-80efbd0cf400 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:36.428990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde89456-f116-4841-8bd0-a9cd3b1eb4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:36.429906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde89456-f116-4841-8bd0-a9cd3b1eb4f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:36.430184 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde89456-f116-4841-8bd0-a9cd3b1eb4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:36.430458 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde89456-f116-4841-8bd0-a9cd3b1eb4f2 admin admin] PATH_INFO: `/v3/projects/0c35124371fc4c958b73b0d01bfabefb/users/c8354f411e9448058a0d815b5eca5f37/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:36.457494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde89456-f116-4841-8bd0-a9cd3b1eb4f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c35124371fc4c958b73b0d01bfabefb, user_id=c8354f411e9448058a0d815b5eca5f37, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:36.458124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde89456-f116-4841-8bd0-a9cd3b1eb4f2 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:36.475602 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4199/8448] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:37:36 2022] PUT /identity/v3/projects/0c35124371fc4c958b73b0d01bfabefb/users/c8354f411e9448058a0d815b5eca5f37/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:36.480317 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184eae92-c33f-4d92-9b9f-f536f16b4b1e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:36.494174 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184eae92-c33f-4d92-9b9f-f536f16b4b1e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:36.564424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1aad1c-eb71-4c1c-9f8d-765ae60a2888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:36.565232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1aad1c-eb71-4c1c-9f8d-765ae60a2888 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:36.565615 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1aad1c-eb71-4c1c-9f8d-765ae60a2888 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:36.565992 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1aad1c-eb71-4c1c-9f8d-765ae60a2888 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:36.566754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1aad1c-eb71-4c1c-9f8d-765ae60a2888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:36.568550 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1aad1c-eb71-4c1c-9f8d-765ae60a2888 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:36.580959 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4250/8449] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:37:36.585191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde89456-f116-4841-8bd0-a9cd3b1eb4f2 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:36.597062 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde89456-f116-4841-8bd0-a9cd3b1eb4f2 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:36.601814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16219012-ca12-4112-b887-5d62152628bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:36.602502 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16219012-ca12-4112-b887-5d62152628bd admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:36.602866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16219012-ca12-4112-b887-5d62152628bd admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:36.603144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16219012-ca12-4112-b887-5d62152628bd admin admin] PATH_INFO: `/v3/projects/0c35124371fc4c958b73b0d01bfabefb/users/c8354f411e9448058a0d815b5eca5f37/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:36.605192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16219012-ca12-4112-b887-5d62152628bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c35124371fc4c958b73b0d01bfabefb, user_id=c8354f411e9448058a0d815b5eca5f37, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:36.608769 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16219012-ca12-4112-b887-5d62152628bd admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:36.619421 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4200/8450] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:37:36 2022] PUT /identity/v3/projects/0c35124371fc4c958b73b0d01bfabefb/users/c8354f411e9448058a0d815b5eca5f37/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:36.631508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f8d97-1002-4033-90d9-8e940574209e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:36.631844 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f8d97-1002-4033-90d9-8e940574209e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:36.632155 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f8d97-1002-4033-90d9-8e940574209e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:36.660209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-629f8d97-1002-4033-90d9-8e940574209e None None] MFA Rules not processed for user `c8354f411e9448058a0d815b5eca5f37`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:36.661331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-629f8d97-1002-4033-90d9-8e940574209e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:36.750304 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4251/8451] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:36 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:36.761131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16219012-ca12-4112-b887-5d62152628bd admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:36.762848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-16219012-ca12-4112-b887-5d62152628bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:36.834267 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16219012-ca12-4112-b887-5d62152628bd admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:36.838233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567a794-4723-436c-98f7-ae7d3fad4a49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:36.838907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567a794-4723-436c-98f7-ae7d3fad4a49 service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:36.839188 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567a794-4723-436c-98f7-ae7d3fad4a49 service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:36.839461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567a794-4723-436c-98f7-ae7d3fad4a49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:36.849607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6567a794-4723-436c-98f7-ae7d3fad4a49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:36.851093 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6567a794-4723-436c-98f7-ae7d3fad4a49 service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:36.861138 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4201/8452] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:37:36 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:37:37.314407 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f8d97-1002-4033-90d9-8e940574209e None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:37.391656 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f8d97-1002-4033-90d9-8e940574209e None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:37.397329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab8c8a-1d47-4f4e-b1e3-6c62cc3bce0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:37.398311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab8c8a-1d47-4f4e-b1e3-6c62cc3bce0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:37.398905 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab8c8a-1d47-4f4e-b1e3-6c62cc3bce0d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:37.399393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab8c8a-1d47-4f4e-b1e3-6c62cc3bce0d admin admin] PATH_INFO: `/v3/users/2ceca23b9faa48b8bf8d2e80120a3180` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:37.401329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab8c8a-1d47-4f4e-b1e3-6c62cc3bce0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ceca23b9faa48b8bf8d2e80120a3180)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:37.403586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab8c8a-1d47-4f4e-b1e3-6c62cc3bce0d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:37.421107 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:37.464522 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d8ab8c8a-1d47-4f4e-b1e3-6c62cc3bce0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ceca23b9faa48b8bf8d2e80120a3180'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:37.474948 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d8ab8c8a-1d47-4f4e-b1e3-6c62cc3bce0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ceca23b9faa48b8bf8d2e80120a3180'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:37.476021 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d8ab8c8a-1d47-4f4e-b1e3-6c62cc3bce0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ceca23b9faa48b8bf8d2e80120a3180'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:37.476796 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d8ab8c8a-1d47-4f4e-b1e3-6c62cc3bce0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ceca23b9faa48b8bf8d2e80120a3180'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:37.485130 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-d8ab8c8a-1d47-4f4e-b1e3-6c62cc3bce0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ceca23b9faa48b8bf8d2e80120a3180'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:37.506420 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4252/8453] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:37:37 2022] DELETE /identity/v3/users/2ceca23b9faa48b8bf8d2e80120a3180 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:37:37.511374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2ada4-500d-4650-ba20-3301e09e5f56 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:37.511863 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2ada4-500d-4650-ba20-3301e09e5f56 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:37.512144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2ada4-500d-4650-ba20-3301e09e5f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:37.534920 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a8b2ada4-500d-4650-ba20-3301e09e5f56 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:37.536204 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a8b2ada4-500d-4650-ba20-3301e09e5f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:37.631834 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4202/8454] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:37.641272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab8c8a-1d47-4f4e-b1e3-6c62cc3bce0d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:37.643358 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d8ab8c8a-1d47-4f4e-b1e3-6c62cc3bce0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:37.737201 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab8c8a-1d47-4f4e-b1e3-6c62cc3bce0d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:37.741739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02707853-ea8d-433c-bb24-1636cc12456b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:37.742449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02707853-ea8d-433c-bb24-1636cc12456b service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:37.742770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02707853-ea8d-433c-bb24-1636cc12456b service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:37.743050 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02707853-ea8d-433c-bb24-1636cc12456b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:37.753912 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02707853-ea8d-433c-bb24-1636cc12456b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:37.755400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02707853-ea8d-433c-bb24-1636cc12456b service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:37.766885 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4253/8455] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:37:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:37:38.088191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2ada4-500d-4650-ba20-3301e09e5f56 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:38.090045 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a8b2ada4-500d-4650-ba20-3301e09e5f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:38.115106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2ada4-500d-4650-ba20-3301e09e5f56 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:38.130825 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aadc64c-348b-4351-9338-3e80d6717a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:38.131484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadc64c-348b-4351-9338-3e80d6717a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:38.131769 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadc64c-348b-4351-9338-3e80d6717a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:38.132047 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadc64c-348b-4351-9338-3e80d6717a1a admin admin] PATH_INFO: `/v3/projects/3fc4a4c2565347efaaa1a680c7fb47db` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:38.135033 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aadc64c-348b-4351-9338-3e80d6717a1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fc4a4c2565347efaaa1a680c7fb47db)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:38.137009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aadc64c-348b-4351-9338-3e80d6717a1a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:38.185313 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02707853-ea8d-433c-bb24-1636cc12456b service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:38.186845 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-02707853-ea8d-433c-bb24-1636cc12456b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:38.189783 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8aadc64c-348b-4351-9338-3e80d6717a1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fc4a4c2565347efaaa1a680c7fb47db', 'request_id': 'req-8aadc64c-348b-4351-9338-3e80d6717a1a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:38.194896 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:38.196738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8aadc64c-348b-4351-9338-3e80d6717a1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fc4a4c2565347efaaa1a680c7fb47db', 'request_id': 'req-8aadc64c-348b-4351-9338-3e80d6717a1a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:38.204691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8aadc64c-348b-4351-9338-3e80d6717a1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fc4a4c2565347efaaa1a680c7fb47db', 'request_id': 'req-8aadc64c-348b-4351-9338-3e80d6717a1a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:38.222511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8aadc64c-348b-4351-9338-3e80d6717a1a admin admin] The token cache is being invalidate because project 3fc4a4c2565347efaaa1a680c7fb47db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:38.224115 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8aadc64c-348b-4351-9338-3e80d6717a1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:38.224944 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8aadc64c-348b-4351-9338-3e80d6717a1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:38.226998 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4203/8456] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:37:38 2022] DELETE /identity/v3/projects/3fc4a4c2565347efaaa1a680c7fb47db => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:38.230467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aadc64c-348b-4351-9338-3e80d6717a1a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:38.233698 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8aadc64c-348b-4351-9338-3e80d6717a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:38.281803 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02707853-ea8d-433c-bb24-1636cc12456b service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:38.327922 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:38.328766 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aadc64c-348b-4351-9338-3e80d6717a1a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:38.334732 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d5664-3d52-4841-8a86-677b4737d3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:38.335388 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d5664-3d52-4841-8a86-677b4737d3f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:38.335665 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d5664-3d52-4841-8a86-677b4737d3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:38.336096 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d5664-3d52-4841-8a86-677b4737d3f1 admin admin] PATH_INFO: `/v3/users/c8354f411e9448058a0d815b5eca5f37` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:38.337156 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d5664-3d52-4841-8a86-677b4737d3f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8354f411e9448058a0d815b5eca5f37)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:38.339302 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d5664-3d52-4841-8a86-677b4737d3f1 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:38.364135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6ddda-5813-4e3d-a0c2-b4f3ed0b0af9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:38.365521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6ddda-5813-4e3d-a0c2-b4f3ed0b0af9 service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:38.365808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6ddda-5813-4e3d-a0c2-b4f3ed0b0af9 service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:38.366089 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6ddda-5813-4e3d-a0c2-b4f3ed0b0af9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:38.367890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6fb6ddda-5813-4e3d-a0c2-b4f3ed0b0af9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:38.388613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6ddda-5813-4e3d-a0c2-b4f3ed0b0af9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:38.391077 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6ddda-5813-4e3d-a0c2-b4f3ed0b0af9 service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:38.398091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8c8d5664-3d52-4841-8a86-677b4737d3f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8354f411e9448058a0d815b5eca5f37'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:38.399182 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8c8d5664-3d52-4841-8a86-677b4737d3f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8354f411e9448058a0d815b5eca5f37'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:38.402418 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8c8d5664-3d52-4841-8a86-677b4737d3f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8354f411e9448058a0d815b5eca5f37'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:38.407821 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4254/8457] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:37:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:37:38.411521 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8c8d5664-3d52-4841-8a86-677b4737d3f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8354f411e9448058a0d815b5eca5f37'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:38.426305 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8c8d5664-3d52-4841-8a86-677b4737d3f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8354f411e9448058a0d815b5eca5f37'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:38.441214 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4204/8458] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:37:38 2022] DELETE /identity/v3/users/c8354f411e9448058a0d815b5eca5f37 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:37:38.743428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6ddda-5813-4e3d-a0c2-b4f3ed0b0af9 service placement] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:38.762762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6ddda-5813-4e3d-a0c2-b4f3ed0b0af9 service placement] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:38.826763 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb5519-521f-4eba-8e1c-749d397e3c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:38.827329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb5519-521f-4eba-8e1c-749d397e3c80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:38.827605 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb5519-521f-4eba-8e1c-749d397e3c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:38.827880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb5519-521f-4eba-8e1c-749d397e3c80 admin admin] PATH_INFO: `/v3/projects/0c35124371fc4c958b73b0d01bfabefb` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:38.829042 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb5519-521f-4eba-8e1c-749d397e3c80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c35124371fc4c958b73b0d01bfabefb)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:38.831270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb5519-521f-4eba-8e1c-749d397e3c80 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:38.887434 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fccb5519-521f-4eba-8e1c-749d397e3c80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c35124371fc4c958b73b0d01bfabefb', 'request_id': 'req-fccb5519-521f-4eba-8e1c-749d397e3c80'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:38.894566 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fccb5519-521f-4eba-8e1c-749d397e3c80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c35124371fc4c958b73b0d01bfabefb', 'request_id': 'req-fccb5519-521f-4eba-8e1c-749d397e3c80'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:38.905698 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fccb5519-521f-4eba-8e1c-749d397e3c80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c35124371fc4c958b73b0d01bfabefb', 'request_id': 'req-fccb5519-521f-4eba-8e1c-749d397e3c80'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:38.918927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fccb5519-521f-4eba-8e1c-749d397e3c80 admin admin] The token cache is being invalidate because project 0c35124371fc4c958b73b0d01bfabefb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:38.919233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fccb5519-521f-4eba-8e1c-749d397e3c80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:38.919968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fccb5519-521f-4eba-8e1c-749d397e3c80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:38.921552 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4255/8459] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:37:38 2022] DELETE /identity/v3/projects/0c35124371fc4c958b73b0d01bfabefb => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:38.926350 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0f7d4-a01d-4f59-8d4d-ad6d21828dac None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:38.926898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0f7d4-a01d-4f59-8d4d-ad6d21828dac None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:38.927022 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0f7d4-a01d-4f59-8d4d-ad6d21828dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:38.948370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-e7e0f7d4-a01d-4f59-8d4d-ad6d21828dac None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:38.949605 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e7e0f7d4-a01d-4f59-8d4d-ad6d21828dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:39.028721 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4205/8460] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:39.031869 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530afe42-f4c3-43e4-81f3-2e7d095c7419 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:39.032945 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530afe42-f4c3-43e4-81f3-2e7d095c7419 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:39.033294 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530afe42-f4c3-43e4-81f3-2e7d095c7419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:39.061758 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-530afe42-f4c3-43e4-81f3-2e7d095c7419 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:39.063247 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-530afe42-f4c3-43e4-81f3-2e7d095c7419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:39.073096 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4256/8461] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:37:39.077709 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0f7d4-a01d-4f59-8d4d-ad6d21828dac None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:39.085619 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:39.092714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0f7d4-a01d-4f59-8d4d-ad6d21828dac None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:39.101129 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958aa201-3cdc-47a7-9c6a-374d1b779437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:39.102029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958aa201-3cdc-47a7-9c6a-374d1b779437 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:39.102814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958aa201-3cdc-47a7-9c6a-374d1b779437 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:39.103370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958aa201-3cdc-47a7-9c6a-374d1b779437 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:39.104391 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958aa201-3cdc-47a7-9c6a-374d1b779437 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:37:39.104925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958aa201-3cdc-47a7-9c6a-374d1b779437 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:39.107266 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958aa201-3cdc-47a7-9c6a-374d1b779437 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:39.129044 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4206/8462] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:37:39.130215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530afe42-f4c3-43e4-81f3-2e7d095c7419 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:39.140963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530afe42-f4c3-43e4-81f3-2e7d095c7419 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:39.147953 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc554e0-9b68-4c65-b999-985176f2ccfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:39.149691 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc554e0-9b68-4c65-b999-985176f2ccfb admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:39.150297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc554e0-9b68-4c65-b999-985176f2ccfb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:39.151644 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc554e0-9b68-4c65-b999-985176f2ccfb admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:39.152500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc554e0-9b68-4c65-b999-985176f2ccfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:39.155561 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc554e0-9b68-4c65-b999-985176f2ccfb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:39.191945 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4257/8463] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:37:39 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:39.196244 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958aa201-3cdc-47a7-9c6a-374d1b779437 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:39.208298 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958aa201-3cdc-47a7-9c6a-374d1b779437 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:39.267365 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115589c-27a2-4b89-a016-858fb08e7b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:39.267980 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115589c-27a2-4b89-a016-858fb08e7b91 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:39.268264 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115589c-27a2-4b89-a016-858fb08e7b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:39.268542 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115589c-27a2-4b89-a016-858fb08e7b91 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:39.269157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115589c-27a2-4b89-a016-858fb08e7b91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:39.271116 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115589c-27a2-4b89-a016-858fb08e7b91 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:39.293481 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4207/8464] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:37:39 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:37:39.298304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc554e0-9b68-4c65-b999-985176f2ccfb admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:39.309118 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc554e0-9b68-4c65-b999-985176f2ccfb admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:39.314562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f96e65-adcd-4ae4-9594-285f3ecf4c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:39.315265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f96e65-adcd-4ae4-9594-285f3ecf4c19 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:39.315612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f96e65-adcd-4ae4-9594-285f3ecf4c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:39.315893 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f96e65-adcd-4ae4-9594-285f3ecf4c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:39.316588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f96e65-adcd-4ae4-9594-285f3ecf4c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:39.318130 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f96e65-adcd-4ae4-9594-285f3ecf4c19 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:39.332330 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4258/8465] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:37:39.333806 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115589c-27a2-4b89-a016-858fb08e7b91 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:39.345092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115589c-27a2-4b89-a016-858fb08e7b91 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:39.349755 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f94f68-0e45-4973-91ae-40c17ea38182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:39.350359 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f94f68-0e45-4973-91ae-40c17ea38182 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:39.350762 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f94f68-0e45-4973-91ae-40c17ea38182 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:39.351109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f94f68-0e45-4973-91ae-40c17ea38182 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:39.351757 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f94f68-0e45-4973-91ae-40c17ea38182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:39.353360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f94f68-0e45-4973-91ae-40c17ea38182 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:39.365120 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4208/8466] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:37:39.369373 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f96e65-adcd-4ae4-9594-285f3ecf4c19 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:39.383252 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f96e65-adcd-4ae4-9594-285f3ecf4c19 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:39.391389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7089a-b991-48a3-9e5e-11fafeed92e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:39.392084 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7089a-b991-48a3-9e5e-11fafeed92e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:39.392368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7089a-b991-48a3-9e5e-11fafeed92e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:39.392647 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7089a-b991-48a3-9e5e-11fafeed92e7 admin admin] PATH_INFO: `/v3/projects/d74b70de06af4ba5b9bb86cf32c80fd3/users/31b4f7478bbd4ff59e4248d2e2f3355a/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:39.407203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:39.410604 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b7089a-b991-48a3-9e5e-11fafeed92e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d74b70de06af4ba5b9bb86cf32c80fd3, user_id=31b4f7478bbd4ff59e4248d2e2f3355a, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:39.413315 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b7089a-b991-48a3-9e5e-11fafeed92e7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:39.431776 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4259/8467] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:37:39 2022] PUT /identity/v3/projects/d74b70de06af4ba5b9bb86cf32c80fd3/users/31b4f7478bbd4ff59e4248d2e2f3355a/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:37:39.443299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7dcf7-a262-4c0f-9197-88818dace6cd None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:39.443658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7dcf7-a262-4c0f-9197-88818dace6cd None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:39.444270 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7dcf7-a262-4c0f-9197-88818dace6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:39.478618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-abb7dcf7-a262-4c0f-9197-88818dace6cd None None] MFA Rules not processed for user `31b4f7478bbd4ff59e4248d2e2f3355a`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:39.479891 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-abb7dcf7-a262-4c0f-9197-88818dace6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:39.566674 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4209/8468] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:37:39.576074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7089a-b991-48a3-9e5e-11fafeed92e7 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:39.578536 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-25b7089a-b991-48a3-9e5e-11fafeed92e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:39.682759 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7089a-b991-48a3-9e5e-11fafeed92e7 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:39.689656 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb0de7-7bea-4038-bc2c-9e03004396d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:39.690287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb0de7-7bea-4038-bc2c-9e03004396d9 service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:39.690657 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb0de7-7bea-4038-bc2c-9e03004396d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:39.690875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb0de7-7bea-4038-bc2c-9e03004396d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:39.704829 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb0de7-7bea-4038-bc2c-9e03004396d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:39.706335 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb0de7-7bea-4038-bc2c-9e03004396d9 service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:39.718824 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4260/8469] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:37:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:37:41.309218 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7dcf7-a262-4c0f-9197-88818dace6cd None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:41.376728 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7dcf7-a262-4c0f-9197-88818dace6cd None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:41.381404 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46370b2-8d80-4491-9c86-7e1708a43043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:41.382050 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46370b2-8d80-4491-9c86-7e1708a43043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:41.382337 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46370b2-8d80-4491-9c86-7e1708a43043 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:41.382638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46370b2-8d80-4491-9c86-7e1708a43043 admin admin] PATH_INFO: `/v3/users/31b4f7478bbd4ff59e4248d2e2f3355a` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:41.383776 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46370b2-8d80-4491-9c86-7e1708a43043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31b4f7478bbd4ff59e4248d2e2f3355a)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:41.385710 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46370b2-8d80-4491-9c86-7e1708a43043 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:41.387385 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:41.438936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a46370b2-8d80-4491-9c86-7e1708a43043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31b4f7478bbd4ff59e4248d2e2f3355a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:41.439600 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a46370b2-8d80-4491-9c86-7e1708a43043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31b4f7478bbd4ff59e4248d2e2f3355a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:41.440205 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a46370b2-8d80-4491-9c86-7e1708a43043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31b4f7478bbd4ff59e4248d2e2f3355a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:41.447320 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a46370b2-8d80-4491-9c86-7e1708a43043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31b4f7478bbd4ff59e4248d2e2f3355a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:41.462224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a46370b2-8d80-4491-9c86-7e1708a43043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31b4f7478bbd4ff59e4248d2e2f3355a'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:41.475001 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4210/8470] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:37:41 2022] DELETE /identity/v3/users/31b4f7478bbd4ff59e4248d2e2f3355a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:41.479592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e73ce0-0a8e-4a3a-a85a-c17bc2baaf68 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:41.480075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e73ce0-0a8e-4a3a-a85a-c17bc2baaf68 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:41.480216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e73ce0-0a8e-4a3a-a85a-c17bc2baaf68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:41.501930 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-c8e73ce0-0a8e-4a3a-a85a-c17bc2baaf68 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:41.504014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c8e73ce0-0a8e-4a3a-a85a-c17bc2baaf68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:41.575917 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4261/8471] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:41.587422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46370b2-8d80-4491-9c86-7e1708a43043 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:41.588905 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a46370b2-8d80-4491-9c86-7e1708a43043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:41.653706 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46370b2-8d80-4491-9c86-7e1708a43043 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:41.658409 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0db59-049a-4761-a779-ee43674fa623 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:41.659054 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0db59-049a-4761-a779-ee43674fa623 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:41.659334 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0db59-049a-4761-a779-ee43674fa623 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:41.659606 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0db59-049a-4761-a779-ee43674fa623 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:41.669631 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0db59-049a-4761-a779-ee43674fa623 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:41.671190 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0db59-049a-4761-a779-ee43674fa623 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:41.681928 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4211/8472] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:37:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:37:42.001190 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e73ce0-0a8e-4a3a-a85a-c17bc2baaf68 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:42.002752 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c8e73ce0-0a8e-4a3a-a85a-c17bc2baaf68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:42.015337 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e73ce0-0a8e-4a3a-a85a-c17bc2baaf68 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:42.020146 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2ee97-7b01-4d30-90ba-68662c2b55c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:42.020930 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2ee97-7b01-4d30-90ba-68662c2b55c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:42.021066 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2ee97-7b01-4d30-90ba-68662c2b55c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:42.021316 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2ee97-7b01-4d30-90ba-68662c2b55c4 admin admin] PATH_INFO: `/v3/projects/d74b70de06af4ba5b9bb86cf32c80fd3` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:42.022454 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a2ee97-7b01-4d30-90ba-68662c2b55c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d74b70de06af4ba5b9bb86cf32c80fd3)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:42.024523 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a2ee97-7b01-4d30-90ba-68662c2b55c4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:42.096669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-37a2ee97-7b01-4d30-90ba-68662c2b55c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd74b70de06af4ba5b9bb86cf32c80fd3', 'request_id': 'req-37a2ee97-7b01-4d30-90ba-68662c2b55c4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:42.102377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-37a2ee97-7b01-4d30-90ba-68662c2b55c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd74b70de06af4ba5b9bb86cf32c80fd3', 'request_id': 'req-37a2ee97-7b01-4d30-90ba-68662c2b55c4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:42.111733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-37a2ee97-7b01-4d30-90ba-68662c2b55c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd74b70de06af4ba5b9bb86cf32c80fd3', 'request_id': 'req-37a2ee97-7b01-4d30-90ba-68662c2b55c4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:42.126925 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-37a2ee97-7b01-4d30-90ba-68662c2b55c4 admin admin] The token cache is being invalidate because project d74b70de06af4ba5b9bb86cf32c80fd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:42.127227 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-37a2ee97-7b01-4d30-90ba-68662c2b55c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:42.127965 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-37a2ee97-7b01-4d30-90ba-68662c2b55c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:42.129776 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4262/8473] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:37:42 2022] DELETE /identity/v3/projects/d74b70de06af4ba5b9bb86cf32c80fd3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:42.135079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb0040-f2f9-4a17-a292-8bcc311e6406 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:42.135369 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb0040-f2f9-4a17-a292-8bcc311e6406 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:42.135647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb0040-f2f9-4a17-a292-8bcc311e6406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:42.156946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-61cb0040-f2f9-4a17-a292-8bcc311e6406 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:42.158167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-61cb0040-f2f9-4a17-a292-8bcc311e6406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:42.222670 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4212/8474] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:37:42.231671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265be84-30e0-483c-af00-e11c11537787 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:42.231973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265be84-30e0-483c-af00-e11c11537787 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:42.232253 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265be84-30e0-483c-af00-e11c11537787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:42.253277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d265be84-30e0-483c-af00-e11c11537787 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:42.254481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d265be84-30e0-483c-af00-e11c11537787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:42.268575 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4263/8475] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:42.273070 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb0040-f2f9-4a17-a292-8bcc311e6406 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:42.283477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb0040-f2f9-4a17-a292-8bcc311e6406 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:42.288165 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccdf13-f6ac-4ab6-a4df-b076eab5a9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:42.288775 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccdf13-f6ac-4ab6-a4df-b076eab5a9ed admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:42.289053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccdf13-f6ac-4ab6-a4df-b076eab5a9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:42.289325 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccdf13-f6ac-4ab6-a4df-b076eab5a9ed admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:42.289972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaccdf13-f6ac-4ab6-a4df-b076eab5a9ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:37:42.290275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaccdf13-f6ac-4ab6-a4df-b076eab5a9ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:42.291913 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaccdf13-f6ac-4ab6-a4df-b076eab5a9ed admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:42.309189 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4213/8476] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:37:42.311309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265be84-30e0-483c-af00-e11c11537787 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:42.322490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265be84-30e0-483c-af00-e11c11537787 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:42.328136 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9a057-e337-459b-ab19-f9afd5083405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:42.328754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9a057-e337-459b-ab19-f9afd5083405 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:42.329035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9a057-e337-459b-ab19-f9afd5083405 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:42.329310 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9a057-e337-459b-ab19-f9afd5083405 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:42.329956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c9a057-e337-459b-ab19-f9afd5083405 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:42.331958 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c9a057-e337-459b-ab19-f9afd5083405 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:42.342860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:42.364983 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4264/8477] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:37:42 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:42.369640 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccdf13-f6ac-4ab6-a4df-b076eab5a9ed admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:42.380729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccdf13-f6ac-4ab6-a4df-b076eab5a9ed admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:42.385741 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:42.440693 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4bd23-e3ab-4db7-98d2-322062e6c591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:42.441307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4bd23-e3ab-4db7-98d2-322062e6c591 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:42.441590 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4bd23-e3ab-4db7-98d2-322062e6c591 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:42.441865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4bd23-e3ab-4db7-98d2-322062e6c591 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:42.442485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4bd23-e3ab-4db7-98d2-322062e6c591 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:42.444444 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4bd23-e3ab-4db7-98d2-322062e6c591 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:42.467647 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4214/8478] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:37:42 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:42.471534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9a057-e337-459b-ab19-f9afd5083405 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:42.482215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9a057-e337-459b-ab19-f9afd5083405 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:42.487381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4ea78-501b-40fb-b55c-305bfacea7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:42.488064 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4ea78-501b-40fb-b55c-305bfacea7ed admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:42.488539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4ea78-501b-40fb-b55c-305bfacea7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:42.488811 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4ea78-501b-40fb-b55c-305bfacea7ed admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:42.489461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4ea78-501b-40fb-b55c-305bfacea7ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:42.491098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4ea78-501b-40fb-b55c-305bfacea7ed admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:42.502081 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4265/8479] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:37:42.506202 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4bd23-e3ab-4db7-98d2-322062e6c591 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:42.517658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4bd23-e3ab-4db7-98d2-322062e6c591 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:42.522447 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45d034-8d83-4ce9-bd1a-922b38fc74c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:42.523095 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45d034-8d83-4ce9-bd1a-922b38fc74c5 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:42.523380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45d034-8d83-4ce9-bd1a-922b38fc74c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:42.524119 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45d034-8d83-4ce9-bd1a-922b38fc74c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:42.524311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45d034-8d83-4ce9-bd1a-922b38fc74c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:42.525903 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45d034-8d83-4ce9-bd1a-922b38fc74c5 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:42.537479 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4215/8480] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:37:42.541769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4ea78-501b-40fb-b55c-305bfacea7ed admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:42.552009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4ea78-501b-40fb-b55c-305bfacea7ed admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:42.557060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb3b31-85c9-4aa6-b037-53c38609e4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:42.557711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb3b31-85c9-4aa6-b037-53c38609e4cf admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:42.557988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb3b31-85c9-4aa6-b037-53c38609e4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:42.558261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb3b31-85c9-4aa6-b037-53c38609e4cf admin admin] PATH_INFO: `/v3/projects/9775ff60ee1f4565825ee506b570dc89/users/5eb8a0a41b0b433cb48726dce021f4aa/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:42.574099 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb3b31-85c9-4aa6-b037-53c38609e4cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9775ff60ee1f4565825ee506b570dc89, user_id=5eb8a0a41b0b433cb48726dce021f4aa, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:42.577682 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb3b31-85c9-4aa6-b037-53c38609e4cf admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:42.591135 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4266/8481] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:37:42 2022] PUT /identity/v3/projects/9775ff60ee1f4565825ee506b570dc89/users/5eb8a0a41b0b433cb48726dce021f4aa/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:37:42.597201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcafe9-b7fe-4015-bd35-7baf95ac4651 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:42.597518 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcafe9-b7fe-4015-bd35-7baf95ac4651 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:42.597801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcafe9-b7fe-4015-bd35-7baf95ac4651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:42.617170 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-7cbcafe9-b7fe-4015-bd35-7baf95ac4651 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:42.618383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7cbcafe9-b7fe-4015-bd35-7baf95ac4651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:42.684689 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4216/8482] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:42.699410 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb3b31-85c9-4aa6-b037-53c38609e4cf admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:42.702015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-bbcb3b31-85c9-4aa6-b037-53c38609e4cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:42.774578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb3b31-85c9-4aa6-b037-53c38609e4cf admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:42.778605 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d986340-8a87-4994-9073-dd6dcc885ffb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:42.779238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d986340-8a87-4994-9073-dd6dcc885ffb service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:42.779782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d986340-8a87-4994-9073-dd6dcc885ffb service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:42.780067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d986340-8a87-4994-9073-dd6dcc885ffb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:42.790033 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d986340-8a87-4994-9073-dd6dcc885ffb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:42.791513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d986340-8a87-4994-9073-dd6dcc885ffb service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:42.802691 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4267/8483] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:37:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:37:43.760220 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13099871-393e-4bd1-9b4b-6845acc742f6 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:43.760758 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13099871-393e-4bd1-9b4b-6845acc742f6 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:43.760758 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13099871-393e-4bd1-9b4b-6845acc742f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:43.789997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-13099871-393e-4bd1-9b4b-6845acc742f6 None None] MFA Rules not processed for user `5eb8a0a41b0b433cb48726dce021f4aa`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:43.791406 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-13099871-393e-4bd1-9b4b-6845acc742f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:43.883342 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4217/8484] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:37:43.890559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d986340-8a87-4994-9073-dd6dcc885ffb service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:43.892164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1d986340-8a87-4994-9073-dd6dcc885ffb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:43.975131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d986340-8a87-4994-9073-dd6dcc885ffb service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:43.978783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557e02f-09b1-4271-88be-fd082c8c95b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:43.979390 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557e02f-09b1-4271-88be-fd082c8c95b5 service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:43.979694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557e02f-09b1-4271-88be-fd082c8c95b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:43.979970 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557e02f-09b1-4271-88be-fd082c8c95b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:43.989286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557e02f-09b1-4271-88be-fd082c8c95b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:43.990775 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557e02f-09b1-4271-88be-fd082c8c95b5 service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:44.002667 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4268/8485] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:37:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:37:46.221780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13099871-393e-4bd1-9b4b-6845acc742f6 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:46.242512 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13099871-393e-4bd1-9b4b-6845acc742f6 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:46.253489 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f30c1-83b8-4912-80dd-ebf0e2377c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:46.254465 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f30c1-83b8-4912-80dd-ebf0e2377c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:46.254779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f30c1-83b8-4912-80dd-ebf0e2377c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:46.255236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f30c1-83b8-4912-80dd-ebf0e2377c97 admin admin] PATH_INFO: `/v3/users/5eb8a0a41b0b433cb48726dce021f4aa` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:46.258113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f30c1-83b8-4912-80dd-ebf0e2377c97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eb8a0a41b0b433cb48726dce021f4aa)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:46.260103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f30c1-83b8-4912-80dd-ebf0e2377c97 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:46.288198 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:46.330168 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ab9f30c1-83b8-4912-80dd-ebf0e2377c97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eb8a0a41b0b433cb48726dce021f4aa'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:46.331011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ab9f30c1-83b8-4912-80dd-ebf0e2377c97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eb8a0a41b0b433cb48726dce021f4aa'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:46.331743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ab9f30c1-83b8-4912-80dd-ebf0e2377c97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eb8a0a41b0b433cb48726dce021f4aa'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:46.340991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ab9f30c1-83b8-4912-80dd-ebf0e2377c97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eb8a0a41b0b433cb48726dce021f4aa'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:46.354916 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ab9f30c1-83b8-4912-80dd-ebf0e2377c97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eb8a0a41b0b433cb48726dce021f4aa'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:46.371279 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4218/8486] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:37:46 2022] DELETE /identity/v3/users/5eb8a0a41b0b433cb48726dce021f4aa => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:46.567757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557e02f-09b1-4271-88be-fd082c8c95b5 service cinder] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:46.583679 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557e02f-09b1-4271-88be-fd082c8c95b5 service cinder] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:46.648674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:46.668689 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98234a-096f-4a6f-8e63-57d7f27da62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:46.669346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98234a-096f-4a6f-8e63-57d7f27da62f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:46.672671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98234a-096f-4a6f-8e63-57d7f27da62f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:46.672982 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98234a-096f-4a6f-8e63-57d7f27da62f admin admin] PATH_INFO: `/v3/projects/9775ff60ee1f4565825ee506b570dc89` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:46.674462 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98234a-096f-4a6f-8e63-57d7f27da62f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9775ff60ee1f4565825ee506b570dc89)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:46.678868 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98234a-096f-4a6f-8e63-57d7f27da62f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:46.741850 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4d98234a-096f-4a6f-8e63-57d7f27da62f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9775ff60ee1f4565825ee506b570dc89', 'request_id': 'req-4d98234a-096f-4a6f-8e63-57d7f27da62f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:46.752715 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4d98234a-096f-4a6f-8e63-57d7f27da62f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9775ff60ee1f4565825ee506b570dc89', 'request_id': 'req-4d98234a-096f-4a6f-8e63-57d7f27da62f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:46.765916 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4d98234a-096f-4a6f-8e63-57d7f27da62f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9775ff60ee1f4565825ee506b570dc89', 'request_id': 'req-4d98234a-096f-4a6f-8e63-57d7f27da62f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:46.779074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4d98234a-096f-4a6f-8e63-57d7f27da62f admin admin] The token cache is being invalidate because project 9775ff60ee1f4565825ee506b570dc89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:37:46.780098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4d98234a-096f-4a6f-8e63-57d7f27da62f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:46.780900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-4d98234a-096f-4a6f-8e63-57d7f27da62f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:37:46.784263 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4269/8487] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:37:46 2022] DELETE /identity/v3/projects/9775ff60ee1f4565825ee506b570dc89 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:46.791861 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80192a8d-2ae3-4d55-8c0f-523aa6a372de None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:46.792149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80192a8d-2ae3-4d55-8c0f-523aa6a372de None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:46.792424 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80192a8d-2ae3-4d55-8c0f-523aa6a372de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:46.816528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-80192a8d-2ae3-4d55-8c0f-523aa6a372de None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:46.817891 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-80192a8d-2ae3-4d55-8c0f-523aa6a372de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:46.897792 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4219/8488] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:46.906096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ea8e7-1ce4-4866-99e7-b8a4b83167d5 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:46.906382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ea8e7-1ce4-4866-99e7-b8a4b83167d5 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:46.906916 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ea8e7-1ce4-4866-99e7-b8a4b83167d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:46.929652 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-7c7ea8e7-1ce4-4866-99e7-b8a4b83167d5 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:46.931315 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7c7ea8e7-1ce4-4866-99e7-b8a4b83167d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:46.940529 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4270/8489] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:37:46.944855 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80192a8d-2ae3-4d55-8c0f-523aa6a372de None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:46.955457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80192a8d-2ae3-4d55-8c0f-523aa6a372de None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:46.962026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e986ec-abc6-4920-a0d5-06ec9e4550f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:46.962883 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e986ec-abc6-4920-a0d5-06ec9e4550f5 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:46.963295 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e986ec-abc6-4920-a0d5-06ec9e4550f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:46.963580 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e986ec-abc6-4920-a0d5-06ec9e4550f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:46.964267 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e986ec-abc6-4920-a0d5-06ec9e4550f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:37:46.964579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e986ec-abc6-4920-a0d5-06ec9e4550f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:46.966648 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e986ec-abc6-4920-a0d5-06ec9e4550f5 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:46.981062 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4220/8490] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:37:46.985664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ea8e7-1ce4-4866-99e7-b8a4b83167d5 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:46.995871 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ea8e7-1ce4-4866-99e7-b8a4b83167d5 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:47.002771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94cd07-62e4-41a5-9fe6-206f566bc235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:47.003827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94cd07-62e4-41a5-9fe6-206f566bc235 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:47.004564 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94cd07-62e4-41a5-9fe6-206f566bc235 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:47.004564 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94cd07-62e4-41a5-9fe6-206f566bc235 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:47.005347 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94cd07-62e4-41a5-9fe6-206f566bc235 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:47.007659 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94cd07-62e4-41a5-9fe6-206f566bc235 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:47.049479 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4271/8491] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:37:46 2022] POST /identity/v3/projects => generated 391 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:37:47.053486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e986ec-abc6-4920-a0d5-06ec9e4550f5 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:47.066311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e986ec-abc6-4920-a0d5-06ec9e4550f5 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:47.133856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5682386-6de5-452a-9f8b-073b55f46b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:47.134479 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5682386-6de5-452a-9f8b-073b55f46b18 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:47.134794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5682386-6de5-452a-9f8b-073b55f46b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:47.135071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5682386-6de5-452a-9f8b-073b55f46b18 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:47.135892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5682386-6de5-452a-9f8b-073b55f46b18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:47.137956 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5682386-6de5-452a-9f8b-073b55f46b18 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:47.162741 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4221/8492] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:37:47 2022] POST /identity/v3/users => generated 296 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:37:47.166967 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94cd07-62e4-41a5-9fe6-206f566bc235 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:47.180445 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94cd07-62e4-41a5-9fe6-206f566bc235 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:47.188862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b566e-93ac-41f6-b323-6a9d608ebcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:47.189613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b566e-93ac-41f6-b323-6a9d608ebcb5 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:47.190738 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b566e-93ac-41f6-b323-6a9d608ebcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:47.191084 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b566e-93ac-41f6-b323-6a9d608ebcb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:47.191774 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b566e-93ac-41f6-b323-6a9d608ebcb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:47.193588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b566e-93ac-41f6-b323-6a9d608ebcb5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:47.206189 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4272/8493] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:37:47.210386 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5682386-6de5-452a-9f8b-073b55f46b18 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:47.222588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5682386-6de5-452a-9f8b-073b55f46b18 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:47.227435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c5f31-ae15-43ab-832e-4aefc216eff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:47.228054 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c5f31-ae15-43ab-832e-4aefc216eff4 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:47.228338 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c5f31-ae15-43ab-832e-4aefc216eff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:47.228765 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c5f31-ae15-43ab-832e-4aefc216eff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:47.229420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c5f31-ae15-43ab-832e-4aefc216eff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:47.231079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c5f31-ae15-43ab-832e-4aefc216eff4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:47.233292 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:47.245385 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4222/8494] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:37:47.250135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b566e-93ac-41f6-b323-6a9d608ebcb5 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:47.260731 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b566e-93ac-41f6-b323-6a9d608ebcb5 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:47.266751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf9325-b66b-479d-9486-0f506881133f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:47.267418 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf9325-b66b-479d-9486-0f506881133f admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:47.268333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf9325-b66b-479d-9486-0f506881133f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:47.268449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf9325-b66b-479d-9486-0f506881133f admin admin] PATH_INFO: `/v3/projects/084ca5bfad90430bb2da5f3a13fd76d8/users/7c192e32cff047039b46c50e69dfc9c1/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:47.284806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf9325-b66b-479d-9486-0f506881133f admin admin] RBAC: Authorizing `identity:create_grant(project_id=084ca5bfad90430bb2da5f3a13fd76d8, user_id=7c192e32cff047039b46c50e69dfc9c1, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:47.287520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf9325-b66b-479d-9486-0f506881133f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:47.302649 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4273/8495] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:37:47 2022] PUT /identity/v3/projects/084ca5bfad90430bb2da5f3a13fd76d8/users/7c192e32cff047039b46c50e69dfc9c1/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:47.315081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e4ca1-0422-4067-bdc0-ba9dd54105bc None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:47.315446 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e4ca1-0422-4067-bdc0-ba9dd54105bc None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:47.315794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e4ca1-0422-4067-bdc0-ba9dd54105bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:47.344742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a94e4ca1-0422-4067-bdc0-ba9dd54105bc None None] MFA Rules not processed for user `7c192e32cff047039b46c50e69dfc9c1`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:47.345979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a94e4ca1-0422-4067-bdc0-ba9dd54105bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:47.424337 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4223/8496] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:47.425496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf9325-b66b-479d-9486-0f506881133f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:47.498067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf9325-b66b-479d-9486-0f506881133f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:47.503695 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab0a72-27ec-4d7e-b448-a5720934e524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:47.504318 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab0a72-27ec-4d7e-b448-a5720934e524 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:47.504598 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab0a72-27ec-4d7e-b448-a5720934e524 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:47.504873 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab0a72-27ec-4d7e-b448-a5720934e524 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:47.505645 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab0a72-27ec-4d7e-b448-a5720934e524 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:47.507631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab0a72-27ec-4d7e-b448-a5720934e524 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:47.535319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:47.543885 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4274/8497] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:37:47 2022] POST /identity/v3/projects => generated 393 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:37:47.550414 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e4ca1-0422-4067-bdc0-ba9dd54105bc None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:47.561902 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e4ca1-0422-4067-bdc0-ba9dd54105bc None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:47.633341 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee087a-5082-4c55-a561-0fa9c8b1d173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:47.633864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee087a-5082-4c55-a561-0fa9c8b1d173 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:47.634145 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee087a-5082-4c55-a561-0fa9c8b1d173 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:47.634417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee087a-5082-4c55-a561-0fa9c8b1d173 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:47.635305 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee087a-5082-4c55-a561-0fa9c8b1d173 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:47.637774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee087a-5082-4c55-a561-0fa9c8b1d173 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:47.663307 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4224/8498] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:37:47 2022] POST /identity/v3/users => generated 303 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:37:47.667777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab0a72-27ec-4d7e-b448-a5720934e524 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:47.679491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab0a72-27ec-4d7e-b448-a5720934e524 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:47.687333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd01e8-40f5-4935-aca0-768d12bb7637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:47.688529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd01e8-40f5-4935-aca0-768d12bb7637 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:47.688529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd01e8-40f5-4935-aca0-768d12bb7637 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:47.688529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd01e8-40f5-4935-aca0-768d12bb7637 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:47.689297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd01e8-40f5-4935-aca0-768d12bb7637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:47.691013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd01e8-40f5-4935-aca0-768d12bb7637 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:47.703608 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4275/8499] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:37:47.708463 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee087a-5082-4c55-a561-0fa9c8b1d173 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:47.720776 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee087a-5082-4c55-a561-0fa9c8b1d173 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:47.725432 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a70e6-012b-4380-b775-59b5f3df0b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:47.726094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a70e6-012b-4380-b775-59b5f3df0b66 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:47.726379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a70e6-012b-4380-b775-59b5f3df0b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:47.726682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a70e6-012b-4380-b775-59b5f3df0b66 admin admin] PATH_INFO: `/v3/projects/5ee81fb612e64d278277698b4f721414/users/2daf7e8662ec45b2a5b8d92876546ff4/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:47.742738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323a70e6-012b-4380-b775-59b5f3df0b66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ee81fb612e64d278277698b4f721414, user_id=2daf7e8662ec45b2a5b8d92876546ff4, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:47.745661 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323a70e6-012b-4380-b775-59b5f3df0b66 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:47.765082 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4225/8500] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:37:47 2022] PUT /identity/v3/projects/5ee81fb612e64d278277698b4f721414/users/2daf7e8662ec45b2a5b8d92876546ff4/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:37:47.769285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd01e8-40f5-4935-aca0-768d12bb7637 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:47.779787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd01e8-40f5-4935-aca0-768d12bb7637 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:47.844767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193de00-4618-4112-afca-36c49da19de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:47.845658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193de00-4618-4112-afca-36c49da19de5 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:47.846489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193de00-4618-4112-afca-36c49da19de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:47.846489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193de00-4618-4112-afca-36c49da19de5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:47.847030 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193de00-4618-4112-afca-36c49da19de5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:47.848745 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193de00-4618-4112-afca-36c49da19de5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:47.863653 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4276/8501] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:37:47.864549 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a70e6-012b-4380-b775-59b5f3df0b66 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:47.876346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a70e6-012b-4380-b775-59b5f3df0b66 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:47.883991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd172ba3-669a-4246-8f1b-df03d6858bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:47.884684 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd172ba3-669a-4246-8f1b-df03d6858bd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:47.884972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd172ba3-669a-4246-8f1b-df03d6858bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:47.885263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd172ba3-669a-4246-8f1b-df03d6858bd3 admin admin] PATH_INFO: `/v3/projects/5ee81fb612e64d278277698b4f721414/users/2daf7e8662ec45b2a5b8d92876546ff4/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:47.887354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd172ba3-669a-4246-8f1b-df03d6858bd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ee81fb612e64d278277698b4f721414, user_id=2daf7e8662ec45b2a5b8d92876546ff4, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:47.890791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd172ba3-669a-4246-8f1b-df03d6858bd3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:47.902618 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4226/8502] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:37:47 2022] PUT /identity/v3/projects/5ee81fb612e64d278277698b4f721414/users/2daf7e8662ec45b2a5b8d92876546ff4/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:37:47.912874 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58939dac-123d-4b1c-8bca-ef6e1dac6187 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:47.913454 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58939dac-123d-4b1c-8bca-ef6e1dac6187 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:47.914021 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58939dac-123d-4b1c-8bca-ef6e1dac6187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:47.946620 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-58939dac-123d-4b1c-8bca-ef6e1dac6187 None None] MFA Rules not processed for user `2daf7e8662ec45b2a5b8d92876546ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:47.948181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-58939dac-123d-4b1c-8bca-ef6e1dac6187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:48.030803 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4277/8503] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:47 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:48.049249 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd172ba3-669a-4246-8f1b-df03d6858bd3 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:48.052034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-fd172ba3-669a-4246-8f1b-df03d6858bd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:48.142923 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:48.190378 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd172ba3-669a-4246-8f1b-df03d6858bd3 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:48.197033 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7378ab2-1dc1-4601-9586-dfdbcc50434a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:48.197740 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7378ab2-1dc1-4601-9586-dfdbcc50434a service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:48.198021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7378ab2-1dc1-4601-9586-dfdbcc50434a service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:48.198298 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7378ab2-1dc1-4601-9586-dfdbcc50434a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:48.279273 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7378ab2-1dc1-4601-9586-dfdbcc50434a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:48.281338 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7378ab2-1dc1-4601-9586-dfdbcc50434a service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:48.292594 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4227/8504] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:37:48 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:37:52.277762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58939dac-123d-4b1c-8bca-ef6e1dac6187 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:52.279592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-58939dac-123d-4b1c-8bca-ef6e1dac6187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:52.396899 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58939dac-123d-4b1c-8bca-ef6e1dac6187 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:52.403262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8152f-8e0d-4ce0-b137-49f6b88f97d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:52.404304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8152f-8e0d-4ce0-b137-49f6b88f97d6 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:52.405238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8152f-8e0d-4ce0-b137-49f6b88f97d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:52.406097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8152f-8e0d-4ce0-b137-49f6b88f97d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:52.419581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d8152f-8e0d-4ce0-b137-49f6b88f97d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:52.425939 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d8152f-8e0d-4ce0-b137-49f6b88f97d6 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:52.441006 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4278/8505] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:37:52 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:37:56.513874 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6864c-fbd7-4194-b7d9-3f21577e6f09 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:56.515364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6864c-fbd7-4194-b7d9-3f21577e6f09 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:56.515873 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6864c-fbd7-4194-b7d9-3f21577e6f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:56.536744 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-5fb6864c-fbd7-4194-b7d9-3f21577e6f09 None None] MFA Rules not processed for user `7c192e32cff047039b46c50e69dfc9c1`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:37:56.538657 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5fb6864c-fbd7-4194-b7d9-3f21577e6f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:56.554588 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4228/8506] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:37:56 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:37:57.505397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8152f-8e0d-4ce0-b137-49f6b88f97d6 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:57.525427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8152f-8e0d-4ce0-b137-49f6b88f97d6 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:57.536902 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ecec41-12b3-447e-bd4c-8354c9a93f6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:57.538002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecec41-12b3-447e-bd4c-8354c9a93f6e service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:57.541658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecec41-12b3-447e-bd4c-8354c9a93f6e service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:57.543306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecec41-12b3-447e-bd4c-8354c9a93f6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:57.547027 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c1ecec41-12b3-447e-bd4c-8354c9a93f6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:57.578071 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ecec41-12b3-447e-bd4c-8354c9a93f6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:57.602179 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ecec41-12b3-447e-bd4c-8354c9a93f6e service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:57.645054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:57.654385 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4279/8507] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:37:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:37:58.132496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6864c-fbd7-4194-b7d9-3f21577e6f09 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:37:58.132496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5fb6864c-fbd7-4194-b7d9-3f21577e6f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:58.235125 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6864c-fbd7-4194-b7d9-3f21577e6f09 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:37:58.244047 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2f0d4-f9ea-4abb-b555-85d886ff70d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:37:58.245102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2f0d4-f9ea-4abb-b555-85d886ff70d7 service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:37:58.245485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2f0d4-f9ea-4abb-b555-85d886ff70d7 service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:37:58.245860 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2f0d4-f9ea-4abb-b555-85d886ff70d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:37:58.250326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0cb2f0d4-f9ea-4abb-b555-85d886ff70d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:37:58.271048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2f0d4-f9ea-4abb-b555-85d886ff70d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:37:58.273151 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2f0d4-f9ea-4abb-b555-85d886ff70d7 service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:37:58.294049 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4229/8508] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:37:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:38:00.856017 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ecec41-12b3-447e-bd4c-8354c9a93f6e service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:38:00.873566 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ecec41-12b3-447e-bd4c-8354c9a93f6e service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:38:00.882386 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc61a79-2e51-40ca-aa75-864c04311330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:38:00.883051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc61a79-2e51-40ca-aa75-864c04311330 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:38:00.883330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc61a79-2e51-40ca-aa75-864c04311330 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:38:00.883603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc61a79-2e51-40ca-aa75-864c04311330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:38:00.885970 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3dc61a79-2e51-40ca-aa75-864c04311330 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:38:00.900777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc61a79-2e51-40ca-aa75-864c04311330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:38:00.902776 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc61a79-2e51-40ca-aa75-864c04311330 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:38:00.916405 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4280/8509] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:38:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:38:01.920754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2f0d4-f9ea-4abb-b555-85d886ff70d7 service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:38:01.945950 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2f0d4-f9ea-4abb-b555-85d886ff70d7 service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:38:01.954323 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965279de-0113-41ce-a0a0-ba7a0c56680f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:38:01.955203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965279de-0113-41ce-a0a0-ba7a0c56680f service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:38:01.955624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965279de-0113-41ce-a0a0-ba7a0c56680f service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:38:01.956486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965279de-0113-41ce-a0a0-ba7a0c56680f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:38:01.958450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-965279de-0113-41ce-a0a0-ba7a0c56680f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:38:01.981059 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965279de-0113-41ce-a0a0-ba7a0c56680f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:38:01.983909 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965279de-0113-41ce-a0a0-ba7a0c56680f service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:38:02.005293 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4230/8510] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:38:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:38:08.785391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc61a79-2e51-40ca-aa75-864c04311330 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:38:08.787026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3dc61a79-2e51-40ca-aa75-864c04311330 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:38:08.807477 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc61a79-2e51-40ca-aa75-864c04311330 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:38:08.814154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd186b66-69f2-4775-9b1e-ca650c875914 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:38:08.815017 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd186b66-69f2-4775-9b1e-ca650c875914 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:38:08.815270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd186b66-69f2-4775-9b1e-ca650c875914 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:38:08.815546 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd186b66-69f2-4775-9b1e-ca650c875914 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:38:08.817350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-dd186b66-69f2-4775-9b1e-ca650c875914 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:38:08.834680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd186b66-69f2-4775-9b1e-ca650c875914 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:38:08.836481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd186b66-69f2-4775-9b1e-ca650c875914 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:38:08.852536 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4281/8511] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:38:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:38:11.992128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=80 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:38:18.844602 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=12 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:38:19.994088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965279de-0113-41ce-a0a0-ba7a0c56680f service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:38:19.995682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-965279de-0113-41ce-a0a0-ba7a0c56680f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:38:20.063268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965279de-0113-41ce-a0a0-ba7a0c56680f service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:38:20.068940 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4ae91-1398-4c9d-8afa-8a2a5f5ad06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:38:20.069699 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4ae91-1398-4c9d-8afa-8a2a5f5ad06f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:38:20.070006 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4ae91-1398-4c9d-8afa-8a2a5f5ad06f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:38:20.070289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4ae91-1398-4c9d-8afa-8a2a5f5ad06f admin admin] PATH_INFO: `/v3/users/8db6256eb83f445c951d947f38fb6f1b` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:38:20.071543 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a4ae91-1398-4c9d-8afa-8a2a5f5ad06f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8db6256eb83f445c951d947f38fb6f1b)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:38:20.073521 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a4ae91-1398-4c9d-8afa-8a2a5f5ad06f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:38:20.128682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d9a4ae91-1398-4c9d-8afa-8a2a5f5ad06f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8db6256eb83f445c951d947f38fb6f1b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:38:20.129329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d9a4ae91-1398-4c9d-8afa-8a2a5f5ad06f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8db6256eb83f445c951d947f38fb6f1b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:38:20.129924 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d9a4ae91-1398-4c9d-8afa-8a2a5f5ad06f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8db6256eb83f445c951d947f38fb6f1b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:38:20.138019 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d9a4ae91-1398-4c9d-8afa-8a2a5f5ad06f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8db6256eb83f445c951d947f38fb6f1b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:38:20.152464 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-d9a4ae91-1398-4c9d-8afa-8a2a5f5ad06f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8db6256eb83f445c951d947f38fb6f1b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:38:20.166278 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4231/8512] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:38:19 2022] DELETE /identity/v3/users/8db6256eb83f445c951d947f38fb6f1b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:38:20.171003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f365dd-2cb5-4c0d-9162-5ef5eb9856bb None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:38:20.171537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f365dd-2cb5-4c0d-9162-5ef5eb9856bb None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:38:20.171783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f365dd-2cb5-4c0d-9162-5ef5eb9856bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:38:20.191263 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-02f365dd-2cb5-4c0d-9162-5ef5eb9856bb None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:38:20.192469 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-02f365dd-2cb5-4c0d-9162-5ef5eb9856bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:38:20.250581 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4282/8513] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:38:20.260744 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4ae91-1398-4c9d-8afa-8a2a5f5ad06f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:38:20.262140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d9a4ae91-1398-4c9d-8afa-8a2a5f5ad06f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:38:20.322162 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4ae91-1398-4c9d-8afa-8a2a5f5ad06f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:38:20.325787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08baedf-c6cb-44ca-a01b-81a278ab5684 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:38:20.326379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08baedf-c6cb-44ca-a01b-81a278ab5684 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:38:20.326687 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08baedf-c6cb-44ca-a01b-81a278ab5684 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:38:20.326957 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08baedf-c6cb-44ca-a01b-81a278ab5684 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:38:20.336523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08baedf-c6cb-44ca-a01b-81a278ab5684 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:38:20.337943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08baedf-c6cb-44ca-a01b-81a278ab5684 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:38:20.347656 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4232/8514] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:38:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:38:20.520679 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f365dd-2cb5-4c0d-9162-5ef5eb9856bb None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:38:20.522093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-02f365dd-2cb5-4c0d-9162-5ef5eb9856bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:38:20.534141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f365dd-2cb5-4c0d-9162-5ef5eb9856bb None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:38:20.539027 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98eb77-19e2-48db-8f67-6a10afccfce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:38:20.539661 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98eb77-19e2-48db-8f67-6a10afccfce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:38:20.539936 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98eb77-19e2-48db-8f67-6a10afccfce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:38:20.540207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98eb77-19e2-48db-8f67-6a10afccfce6 admin admin] PATH_INFO: `/v3/projects/845932048d7e4ddd93537f16369cd54f` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:38:20.541461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98eb77-19e2-48db-8f67-6a10afccfce6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=845932048d7e4ddd93537f16369cd54f)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:38:20.543388 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98eb77-19e2-48db-8f67-6a10afccfce6 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:38:20.591513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5f98eb77-19e2-48db-8f67-6a10afccfce6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '845932048d7e4ddd93537f16369cd54f', 'request_id': 'req-5f98eb77-19e2-48db-8f67-6a10afccfce6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:38:20.597471 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5f98eb77-19e2-48db-8f67-6a10afccfce6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '845932048d7e4ddd93537f16369cd54f', 'request_id': 'req-5f98eb77-19e2-48db-8f67-6a10afccfce6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:38:20.604819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5f98eb77-19e2-48db-8f67-6a10afccfce6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '845932048d7e4ddd93537f16369cd54f', 'request_id': 'req-5f98eb77-19e2-48db-8f67-6a10afccfce6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:38:20.617130 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5f98eb77-19e2-48db-8f67-6a10afccfce6 admin admin] The token cache is being invalidate because project 845932048d7e4ddd93537f16369cd54f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:38:20.617416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5f98eb77-19e2-48db-8f67-6a10afccfce6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:38:20.618042 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5f98eb77-19e2-48db-8f67-6a10afccfce6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:38:20.619557 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4283/8515] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:38:20 2022] DELETE /identity/v3/projects/845932048d7e4ddd93537f16369cd54f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:38:20.624343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb5642-17b4-4b47-8b7e-58133be114b3 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:38:20.625731 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb5642-17b4-4b47-8b7e-58133be114b3 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:38:20.626014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb5642-17b4-4b47-8b7e-58133be114b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:38:20.645508 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-89fb5642-17b4-4b47-8b7e-58133be114b3 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:38:20.646680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-89fb5642-17b4-4b47-8b7e-58133be114b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:38:20.663690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:38:20.709193 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4233/8516] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:38:20.717065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e5e26-b1bb-4843-a120-1587dabb7cee None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:38:20.717352 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e5e26-b1bb-4843-a120-1587dabb7cee None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:38:20.717625 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e5e26-b1bb-4843-a120-1587dabb7cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:38:20.737603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-474e5e26-b1bb-4843-a120-1587dabb7cee None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:38:20.738822 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-474e5e26-b1bb-4843-a120-1587dabb7cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:38:20.747058 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4284/8517] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:38:20.753147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb5642-17b4-4b47-8b7e-58133be114b3 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:38:20.762942 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb5642-17b4-4b47-8b7e-58133be114b3 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:38:20.767507 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5238db7-c588-45e6-9be5-56d1afd2d722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:38:20.768096 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5238db7-c588-45e6-9be5-56d1afd2d722 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:38:20.768368 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5238db7-c588-45e6-9be5-56d1afd2d722 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:38:20.768633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5238db7-c588-45e6-9be5-56d1afd2d722 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:38:20.769263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5238db7-c588-45e6-9be5-56d1afd2d722 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:38:20.769561 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5238db7-c588-45e6-9be5-56d1afd2d722 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:38:20.771207 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5238db7-c588-45e6-9be5-56d1afd2d722 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:38:20.784340 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4234/8518] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:38:20.788614 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e5e26-b1bb-4843-a120-1587dabb7cee None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:38:20.798931 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e5e26-b1bb-4843-a120-1587dabb7cee None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:38:20.804135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df7b7b-6dca-49f3-b14c-d761898aba6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:38:20.804738 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df7b7b-6dca-49f3-b14c-d761898aba6c admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:38:20.805016 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df7b7b-6dca-49f3-b14c-d761898aba6c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:38:20.805287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df7b7b-6dca-49f3-b14c-d761898aba6c admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:38:20.805911 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df7b7b-6dca-49f3-b14c-d761898aba6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:38:20.808130 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df7b7b-6dca-49f3-b14c-d761898aba6c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:38:20.836093 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4285/8519] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:38:20 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:38:20.840012 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5238db7-c588-45e6-9be5-56d1afd2d722 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:38:20.850894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5238db7-c588-45e6-9be5-56d1afd2d722 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:38:20.906232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81548d7f-6bcd-4ec1-8d18-30e559a90d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:38:20.906940 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81548d7f-6bcd-4ec1-8d18-30e559a90d0f admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:38:20.907212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81548d7f-6bcd-4ec1-8d18-30e559a90d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:38:20.907482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81548d7f-6bcd-4ec1-8d18-30e559a90d0f admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:38:20.908097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81548d7f-6bcd-4ec1-8d18-30e559a90d0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:38:20.910012 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81548d7f-6bcd-4ec1-8d18-30e559a90d0f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:38:20.930873 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4235/8520] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:38:20 2022] POST /identity/v3/users => generated 282 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:38:20.935270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df7b7b-6dca-49f3-b14c-d761898aba6c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:38:20.946021 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df7b7b-6dca-49f3-b14c-d761898aba6c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:38:20.950882 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0bf72e-79d1-4131-a4d6-aa547f173ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:38:20.951521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bf72e-79d1-4131-a4d6-aa547f173ebf admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:38:20.951798 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bf72e-79d1-4131-a4d6-aa547f173ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:38:20.952066 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bf72e-79d1-4131-a4d6-aa547f173ebf admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:38:20.952868 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0bf72e-79d1-4131-a4d6-aa547f173ebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:38:20.954505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0bf72e-79d1-4131-a4d6-aa547f173ebf admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:38:20.964353 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4286/8521] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:38:20.968843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81548d7f-6bcd-4ec1-8d18-30e559a90d0f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:38:20.978648 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81548d7f-6bcd-4ec1-8d18-30e559a90d0f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:38:20.983234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39ea7e-ed45-4e59-ac1f-9cad6ba4e151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:38:20.984483 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39ea7e-ed45-4e59-ac1f-9cad6ba4e151 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:38:20.984780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39ea7e-ed45-4e59-ac1f-9cad6ba4e151 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:38:20.985049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39ea7e-ed45-4e59-ac1f-9cad6ba4e151 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:38:20.985705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b39ea7e-ed45-4e59-ac1f-9cad6ba4e151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:38:20.987325 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b39ea7e-ed45-4e59-ac1f-9cad6ba4e151 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:38:20.997641 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4236/8522] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:38:21.001657 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0bf72e-79d1-4131-a4d6-aa547f173ebf admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:38:21.011815 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0bf72e-79d1-4131-a4d6-aa547f173ebf admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:38:21.016817 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0071a6-0e23-4efc-a9bf-ac95d3313a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:38:21.017541 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0071a6-0e23-4efc-a9bf-ac95d3313a28 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:38:21.017834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0071a6-0e23-4efc-a9bf-ac95d3313a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:38:21.018111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0071a6-0e23-4efc-a9bf-ac95d3313a28 admin admin] PATH_INFO: `/v3/projects/8b7e45a8f27b4c0393d3dcfc817d31b9/users/33b565121af143afb8e0fb0b612d29d6/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:38:21.033233 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0071a6-0e23-4efc-a9bf-ac95d3313a28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b7e45a8f27b4c0393d3dcfc817d31b9, user_id=33b565121af143afb8e0fb0b612d29d6, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:38:21.035937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0071a6-0e23-4efc-a9bf-ac95d3313a28 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:38:21.049981 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4287/8523] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:38:21 2022] PUT /identity/v3/projects/8b7e45a8f27b4c0393d3dcfc817d31b9/users/33b565121af143afb8e0fb0b612d29d6/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:38:21.060469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673001fb-4a41-42e8-a72d-5d9d5246ba59 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:38:21.060762 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673001fb-4a41-42e8-a72d-5d9d5246ba59 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:38:21.061054 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673001fb-4a41-42e8-a72d-5d9d5246ba59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:38:21.088617 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-673001fb-4a41-42e8-a72d-5d9d5246ba59 None None] MFA Rules not processed for user `33b565121af143afb8e0fb0b612d29d6`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:38:21.089848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-673001fb-4a41-42e8-a72d-5d9d5246ba59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:38:21.154245 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4237/8524] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:38:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:38:21.164350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0071a6-0e23-4efc-a9bf-ac95d3313a28 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:38:21.166025 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ae0071a6-0e23-4efc-a9bf-ac95d3313a28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:38:21.188714 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:38:21.228223 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0071a6-0e23-4efc-a9bf-ac95d3313a28 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:38:21.231933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce19cc-3629-40e2-81e0-8274c93066ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:38:21.232532 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce19cc-3629-40e2-81e0-8274c93066ee service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:38:21.232810 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce19cc-3629-40e2-81e0-8274c93066ee service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:38:21.233081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce19cc-3629-40e2-81e0-8274c93066ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:38:21.242496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce19cc-3629-40e2-81e0-8274c93066ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:38:21.243937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce19cc-3629-40e2-81e0-8274c93066ee service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:38:21.253256 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4288/8525] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:38:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:38:31.151498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:38:31.248784 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=17 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:38:46.837338 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673001fb-4a41-42e8-a72d-5d9d5246ba59 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:38:46.850297 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673001fb-4a41-42e8-a72d-5d9d5246ba59 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:38:46.854435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51475f69-62e6-471c-95f9-ea83d6a9beb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:38:46.855071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51475f69-62e6-471c-95f9-ea83d6a9beb7 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:38:46.855940 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51475f69-62e6-471c-95f9-ea83d6a9beb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:38:46.856132 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51475f69-62e6-471c-95f9-ea83d6a9beb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:38:46.857915 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-51475f69-62e6-471c-95f9-ea83d6a9beb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:38:46.871490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51475f69-62e6-471c-95f9-ea83d6a9beb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:38:46.873302 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51475f69-62e6-471c-95f9-ea83d6a9beb7 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:38:46.886486 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4238/8526] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:38:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:38:46.948386 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d960e3-47c7-49b2-9cce-2b0e7fa61f85 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:38:46.948925 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d960e3-47c7-49b2-9cce-2b0e7fa61f85 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:38:46.948925 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d960e3-47c7-49b2-9cce-2b0e7fa61f85 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:38:46.950244 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4289/8527] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 21:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 21:38:46.957679 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed00fb8-84dd-4999-acc2-9b0d475fdb08 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:38:46.957964 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed00fb8-84dd-4999-acc2-9b0d475fdb08 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:38:46.958242 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed00fb8-84dd-4999-acc2-9b0d475fdb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:38:47.004414 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-8ed00fb8-84dd-4999-acc2-9b0d475fdb08 None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:38:47.006260 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8ed00fb8-84dd-4999-acc2-9b0d475fdb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:38:47.091770 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4239/8528] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:38:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:38:47.115177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d960e3-47c7-49b2-9cce-2b0e7fa61f85 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:38:47.116884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-17d960e3-47c7-49b2-9cce-2b0e7fa61f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:38:47.137673 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d960e3-47c7-49b2-9cce-2b0e7fa61f85 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:38:47.143536 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0effcd2-8b5c-4417-b504-66593c6c898d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:38:47.144186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0effcd2-8b5c-4417-b504-66593c6c898d service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:38:47.144467 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0effcd2-8b5c-4417-b504-66593c6c898d service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:38:47.144909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0effcd2-8b5c-4417-b504-66593c6c898d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:38:47.153248 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0effcd2-8b5c-4417-b504-66593c6c898d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:38:47.154842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0effcd2-8b5c-4417-b504-66593c6c898d service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:38:47.165320 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4290/8529] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:38:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:38:47.381842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed00fb8-84dd-4999-acc2-9b0d475fdb08 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:38:47.383975 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8ed00fb8-84dd-4999-acc2-9b0d475fdb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:38:47.404568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed00fb8-84dd-4999-acc2-9b0d475fdb08 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:38:47.410691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5dad1-5123-460d-b3dc-7e8c2e474303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:38:47.411626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5dad1-5123-460d-b3dc-7e8c2e474303 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:38:47.412004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5dad1-5123-460d-b3dc-7e8c2e474303 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:38:47.412479 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5dad1-5123-460d-b3dc-7e8c2e474303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:38:47.414395 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f5d5dad1-5123-460d-b3dc-7e8c2e474303 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:38:47.429284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d5dad1-5123-460d-b3dc-7e8c2e474303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:38:47.431395 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d5dad1-5123-460d-b3dc-7e8c2e474303 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:38:47.450388 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4240/8530] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:38:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:38:47.607982 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868b15a-db7d-4655-a4e2-e7da36507311 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:38:47.608388 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868b15a-db7d-4655-a4e2-e7da36507311 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:38:47.608873 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868b15a-db7d-4655-a4e2-e7da36507311 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:38:47.611484 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4291/8531] 10.222.0.33 () {54 vars in 921 bytes} [Sat Aug 6 21:38:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 21:38:47.620660 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ceaf34-3292-4cf7-8eb8-de3a0825eef8 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:38:47.621155 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ceaf34-3292-4cf7-8eb8-de3a0825eef8 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:38:47.621467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ceaf34-3292-4cf7-8eb8-de3a0825eef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:38:47.646049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-26ceaf34-3292-4cf7-8eb8-de3a0825eef8 None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:38:47.647405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-26ceaf34-3292-4cf7-8eb8-de3a0825eef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:38:47.657140 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4241/8532] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 21:38:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:38:47.692873 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868b15a-db7d-4655-a4e2-e7da36507311 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:38:47.694616 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f868b15a-db7d-4655-a4e2-e7da36507311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:38:47.714535 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868b15a-db7d-4655-a4e2-e7da36507311 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:38:47.719938 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b779b8-4d7b-430a-9536-cfbdfa7c190f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:38:47.720568 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b779b8-4d7b-430a-9536-cfbdfa7c190f service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:38:47.720850 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b779b8-4d7b-430a-9536-cfbdfa7c190f service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:38:47.721124 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b779b8-4d7b-430a-9536-cfbdfa7c190f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:38:47.730458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b779b8-4d7b-430a-9536-cfbdfa7c190f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:38:47.732086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b779b8-4d7b-430a-9536-cfbdfa7c190f service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:38:47.743851 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4292/8533] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:38:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:38:47.932061 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ceaf34-3292-4cf7-8eb8-de3a0825eef8 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:38:47.944708 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ceaf34-3292-4cf7-8eb8-de3a0825eef8 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:38:47.948401 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44cac2d-b314-470d-818d-51546c00235f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:38:47.949071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cac2d-b314-470d-818d-51546c00235f service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:38:47.949417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cac2d-b314-470d-818d-51546c00235f service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:38:47.949788 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cac2d-b314-470d-818d-51546c00235f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:38:47.951635 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a44cac2d-b314-470d-818d-51546c00235f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:38:48.030030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44cac2d-b314-470d-818d-51546c00235f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:38:48.031533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44cac2d-b314-470d-818d-51546c00235f service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:38:48.045514 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4242/8534] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:38:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:38:53.579890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b779b8-4d7b-430a-9536-cfbdfa7c190f service placement] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:38:53.592070 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b779b8-4d7b-430a-9536-cfbdfa7c190f service placement] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:38:53.595779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f256e-1cfd-4696-aab3-6922390146ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:38:53.596375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f256e-1cfd-4696-aab3-6922390146ad service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:38:53.596651 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f256e-1cfd-4696-aab3-6922390146ad service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:38:53.596920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f256e-1cfd-4696-aab3-6922390146ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:38:53.598741 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-616f256e-1cfd-4696-aab3-6922390146ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:38:53.616854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f256e-1cfd-4696-aab3-6922390146ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:38:53.619171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f256e-1cfd-4696-aab3-6922390146ad service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:38:53.648176 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4293/8535] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:38:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:38:57.451494 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44cac2d-b314-470d-818d-51546c00235f service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:38:57.463201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44cac2d-b314-470d-818d-51546c00235f service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:38:57.467538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff37417-fc8f-4286-84a5-db2e65d2a81f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:38:57.468301 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff37417-fc8f-4286-84a5-db2e65d2a81f service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:38:57.468682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff37417-fc8f-4286-84a5-db2e65d2a81f service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:38:57.469056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff37417-fc8f-4286-84a5-db2e65d2a81f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:38:57.471408 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9ff37417-fc8f-4286-84a5-db2e65d2a81f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:38:57.490207 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff37417-fc8f-4286-84a5-db2e65d2a81f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:38:57.491887 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff37417-fc8f-4286-84a5-db2e65d2a81f service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:38:57.508976 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4243/8536] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:38:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:39:01.640176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f256e-1cfd-4696-aab3-6922390146ad service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:01.654051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f256e-1cfd-4696-aab3-6922390146ad service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:01.658969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032063b-cf39-4c5a-af53-5e1bbd1ac4de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:01.659697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032063b-cf39-4c5a-af53-5e1bbd1ac4de service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:01.660062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032063b-cf39-4c5a-af53-5e1bbd1ac4de service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:01.660406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032063b-cf39-4c5a-af53-5e1bbd1ac4de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:01.662449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3032063b-cf39-4c5a-af53-5e1bbd1ac4de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:01.691031 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032063b-cf39-4c5a-af53-5e1bbd1ac4de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:01.692489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032063b-cf39-4c5a-af53-5e1bbd1ac4de service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:01.704602 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4294/8537] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:39:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:39:02.576474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff37417-fc8f-4286-84a5-db2e65d2a81f service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:02.579814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9ff37417-fc8f-4286-84a5-db2e65d2a81f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:02.616731 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff37417-fc8f-4286-84a5-db2e65d2a81f service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:02.626869 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43b1cb-aea8-4fd6-91d5-29b1624d86a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:02.627545 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43b1cb-aea8-4fd6-91d5-29b1624d86a0 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:02.627906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43b1cb-aea8-4fd6-91d5-29b1624d86a0 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:02.628183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43b1cb-aea8-4fd6-91d5-29b1624d86a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:02.630032 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-cd43b1cb-aea8-4fd6-91d5-29b1624d86a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:02.656274 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43b1cb-aea8-4fd6-91d5-29b1624d86a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:02.658048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43b1cb-aea8-4fd6-91d5-29b1624d86a0 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:02.684730 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4244/8538] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:39:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:39:06.216866 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032063b-cf39-4c5a-af53-5e1bbd1ac4de service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:06.289514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032063b-cf39-4c5a-af53-5e1bbd1ac4de service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:06.294081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bf3b8-cf89-4d5f-aad2-e0614695628d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:06.294739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bf3b8-cf89-4d5f-aad2-e0614695628d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:06.295022 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bf3b8-cf89-4d5f-aad2-e0614695628d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:06.295296 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bf3b8-cf89-4d5f-aad2-e0614695628d admin admin] PATH_INFO: `/v3/users/33b565121af143afb8e0fb0b612d29d6` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:06.296430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580bf3b8-cf89-4d5f-aad2-e0614695628d admin admin] RBAC: Authorizing `identity:delete_user(user_id=33b565121af143afb8e0fb0b612d29d6)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:06.298967 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580bf3b8-cf89-4d5f-aad2-e0614695628d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:06.347914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-580bf3b8-cf89-4d5f-aad2-e0614695628d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33b565121af143afb8e0fb0b612d29d6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:06.355027 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-580bf3b8-cf89-4d5f-aad2-e0614695628d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33b565121af143afb8e0fb0b612d29d6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:06.355822 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-580bf3b8-cf89-4d5f-aad2-e0614695628d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33b565121af143afb8e0fb0b612d29d6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:06.356446 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-580bf3b8-cf89-4d5f-aad2-e0614695628d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33b565121af143afb8e0fb0b612d29d6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:06.365585 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-580bf3b8-cf89-4d5f-aad2-e0614695628d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33b565121af143afb8e0fb0b612d29d6'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:06.383848 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4295/8539] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:39:06 2022] DELETE /identity/v3/users/33b565121af143afb8e0fb0b612d29d6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:39:06.388323 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dc8d2-d379-4fc7-99ce-6a0559933e83 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:06.388800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dc8d2-d379-4fc7-99ce-6a0559933e83 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:06.388892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dc8d2-d379-4fc7-99ce-6a0559933e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:06.409754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-ac1dc8d2-d379-4fc7-99ce-6a0559933e83 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:39:06.411099 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ac1dc8d2-d379-4fc7-99ce-6a0559933e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:06.415138 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=100 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:06.473434 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4245/8540] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:39:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:39:06.483503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bf3b8-cf89-4d5f-aad2-e0614695628d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:06.484913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-580bf3b8-cf89-4d5f-aad2-e0614695628d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:06.506290 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:06.550840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bf3b8-cf89-4d5f-aad2-e0614695628d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:06.554454 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269c8ba-8997-4ecd-aa79-fe1e26dd085d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:06.555104 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269c8ba-8997-4ecd-aa79-fe1e26dd085d service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:06.555382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269c8ba-8997-4ecd-aa79-fe1e26dd085d service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:06.555655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269c8ba-8997-4ecd-aa79-fe1e26dd085d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:06.566776 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269c8ba-8997-4ecd-aa79-fe1e26dd085d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:06.568524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269c8ba-8997-4ecd-aa79-fe1e26dd085d service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:06.580941 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4296/8541] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:39:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:39:07.171105 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1dc8d2-d379-4fc7-99ce-6a0559933e83 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:07.173654 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ac1dc8d2-d379-4fc7-99ce-6a0559933e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:07.190482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1dc8d2-d379-4fc7-99ce-6a0559933e83 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:07.196014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c917c4-a106-4c5a-810f-b5b04e2d7f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:07.197128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c917c4-a106-4c5a-810f-b5b04e2d7f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:07.197408 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c917c4-a106-4c5a-810f-b5b04e2d7f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:07.197681 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c917c4-a106-4c5a-810f-b5b04e2d7f95 admin admin] PATH_INFO: `/v3/projects/8b7e45a8f27b4c0393d3dcfc817d31b9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:07.199338 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c917c4-a106-4c5a-810f-b5b04e2d7f95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b7e45a8f27b4c0393d3dcfc817d31b9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:07.201609 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c917c4-a106-4c5a-810f-b5b04e2d7f95 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:07.252083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f0c917c4-a106-4c5a-810f-b5b04e2d7f95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b7e45a8f27b4c0393d3dcfc817d31b9', 'request_id': 'req-f0c917c4-a106-4c5a-810f-b5b04e2d7f95'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:07.257846 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f0c917c4-a106-4c5a-810f-b5b04e2d7f95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b7e45a8f27b4c0393d3dcfc817d31b9', 'request_id': 'req-f0c917c4-a106-4c5a-810f-b5b04e2d7f95'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:07.264441 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f0c917c4-a106-4c5a-810f-b5b04e2d7f95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b7e45a8f27b4c0393d3dcfc817d31b9', 'request_id': 'req-f0c917c4-a106-4c5a-810f-b5b04e2d7f95'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:07.278519 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f0c917c4-a106-4c5a-810f-b5b04e2d7f95 admin admin] The token cache is being invalidate because project 8b7e45a8f27b4c0393d3dcfc817d31b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:39:07.278838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f0c917c4-a106-4c5a-810f-b5b04e2d7f95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:07.279486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-f0c917c4-a106-4c5a-810f-b5b04e2d7f95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:07.280976 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4246/8542] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:39:07 2022] DELETE /identity/v3/projects/8b7e45a8f27b4c0393d3dcfc817d31b9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:39:07.287029 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb15fa4-0e33-446f-923b-d70c768d2967 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:07.287503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb15fa4-0e33-446f-923b-d70c768d2967 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:07.287597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb15fa4-0e33-446f-923b-d70c768d2967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:07.307884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-3fb15fa4-0e33-446f-923b-d70c768d2967 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:39:07.309107 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3fb15fa4-0e33-446f-923b-d70c768d2967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:07.372981 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4297/8543] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:39:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:39:07.381678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a7dfd-0f44-43b5-844c-147be886fb93 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:07.381964 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a7dfd-0f44-43b5-844c-147be886fb93 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:07.382239 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a7dfd-0f44-43b5-844c-147be886fb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:07.402305 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-1f2a7dfd-0f44-43b5-844c-147be886fb93 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:39:07.403536 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1f2a7dfd-0f44-43b5-844c-147be886fb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:07.411989 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4247/8544] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:39:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:39:07.416415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb15fa4-0e33-446f-923b-d70c768d2967 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:07.426600 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb15fa4-0e33-446f-923b-d70c768d2967 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:07.431202 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190c70d-ac8e-4d72-8103-b13f40c6aa42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:07.431806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190c70d-ac8e-4d72-8103-b13f40c6aa42 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:07.432081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190c70d-ac8e-4d72-8103-b13f40c6aa42 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:07.432351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190c70d-ac8e-4d72-8103-b13f40c6aa42 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:07.432989 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5190c70d-ac8e-4d72-8103-b13f40c6aa42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:39:07.433292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5190c70d-ac8e-4d72-8103-b13f40c6aa42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:07.434903 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5190c70d-ac8e-4d72-8103-b13f40c6aa42 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:07.451166 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4298/8545] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 21:39:07.452381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a7dfd-0f44-43b5-844c-147be886fb93 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:07.462721 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a7dfd-0f44-43b5-844c-147be886fb93 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:07.467787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e19df-8d56-4467-9da3-335c5784bb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:07.468419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e19df-8d56-4467-9da3-335c5784bb12 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:07.468722 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e19df-8d56-4467-9da3-335c5784bb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:07.468993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e19df-8d56-4467-9da3-335c5784bb12 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:07.470143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e19df-8d56-4467-9da3-335c5784bb12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:07.472100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e19df-8d56-4467-9da3-335c5784bb12 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:07.499804 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4248/8546] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:39:07 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:39:07.504562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190c70d-ac8e-4d72-8103-b13f40c6aa42 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:07.514539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190c70d-ac8e-4d72-8103-b13f40c6aa42 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:07.574366 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e24abc-1076-4f5b-895e-69a725b7ca10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:07.575095 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e24abc-1076-4f5b-895e-69a725b7ca10 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:07.575381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e24abc-1076-4f5b-895e-69a725b7ca10 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:07.575656 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e24abc-1076-4f5b-895e-69a725b7ca10 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:07.576275 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e24abc-1076-4f5b-895e-69a725b7ca10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:07.578188 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e24abc-1076-4f5b-895e-69a725b7ca10 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:07.607489 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4299/8547] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:39:07 2022] POST /identity/v3/users => generated 303 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:39:07.609469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e19df-8d56-4467-9da3-335c5784bb12 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:07.622336 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e19df-8d56-4467-9da3-335c5784bb12 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:07.627441 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdf591-d456-4acd-be6c-48a621297bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:07.628153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdf591-d456-4acd-be6c-48a621297bda admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:07.628424 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdf591-d456-4acd-be6c-48a621297bda admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:07.628692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdf591-d456-4acd-be6c-48a621297bda admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:07.629331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cdf591-d456-4acd-be6c-48a621297bda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:07.630993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cdf591-d456-4acd-be6c-48a621297bda admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:07.641908 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4249/8548] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:39:07.646077 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e24abc-1076-4f5b-895e-69a725b7ca10 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:07.656255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e24abc-1076-4f5b-895e-69a725b7ca10 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:07.661576 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b2072-8bdd-47a1-86fb-660cb4384997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:07.662120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b2072-8bdd-47a1-86fb-660cb4384997 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:07.662406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b2072-8bdd-47a1-86fb-660cb4384997 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:07.662735 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b2072-8bdd-47a1-86fb-660cb4384997 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:07.663373 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b2072-8bdd-47a1-86fb-660cb4384997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:07.664979 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b2072-8bdd-47a1-86fb-660cb4384997 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:07.679759 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4300/8549] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:39:07.680892 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdf591-d456-4acd-be6c-48a621297bda admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:07.691314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdf591-d456-4acd-be6c-48a621297bda admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:07.696238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850e731-d393-40d2-a376-60a27e7d4783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:07.696907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850e731-d393-40d2-a376-60a27e7d4783 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:07.697191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850e731-d393-40d2-a376-60a27e7d4783 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:07.697466 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850e731-d393-40d2-a376-60a27e7d4783 admin admin] PATH_INFO: `/v3/projects/f40d2d7c15d5433aa405f3ed54a875d2/users/b54f86b4feb4430781bd7f28aed6d36c/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:07.713441 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8850e731-d393-40d2-a376-60a27e7d4783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f40d2d7c15d5433aa405f3ed54a875d2, user_id=b54f86b4feb4430781bd7f28aed6d36c, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:07.716231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8850e731-d393-40d2-a376-60a27e7d4783 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:07.730096 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4250/8550] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:39:07 2022] PUT /identity/v3/projects/f40d2d7c15d5433aa405f3ed54a875d2/users/b54f86b4feb4430781bd7f28aed6d36c/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:39:07.736046 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9d3d7-418f-4dbc-9af2-d0b214c574f3 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:07.736422 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9d3d7-418f-4dbc-9af2-d0b214c574f3 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:07.736701 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9d3d7-418f-4dbc-9af2-d0b214c574f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:07.756501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-e5d9d3d7-418f-4dbc-9af2-d0b214c574f3 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:39:07.757715 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e5d9d3d7-418f-4dbc-9af2-d0b214c574f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:07.778332 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:07.837554 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4301/8551] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:39:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:39:07.847439 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850e731-d393-40d2-a376-60a27e7d4783 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:07.849443 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8850e731-d393-40d2-a376-60a27e7d4783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:07.886959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:07.920705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850e731-d393-40d2-a376-60a27e7d4783 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:07.926272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a1836-e8a0-4ad9-9e67-341d61bd2f0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:07.927112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a1836-e8a0-4ad9-9e67-341d61bd2f0d service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:07.927462 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a1836-e8a0-4ad9-9e67-341d61bd2f0d service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:07.927743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a1836-e8a0-4ad9-9e67-341d61bd2f0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:07.940762 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a1836-e8a0-4ad9-9e67-341d61bd2f0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:07.942220 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a1836-e8a0-4ad9-9e67-341d61bd2f0d service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:07.955201 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4251/8552] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:39:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:39:08.745855 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e0f18-8843-4c94-888a-357c27c8b468 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:08.746339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e0f18-8843-4c94-888a-357c27c8b468 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:08.746457 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e0f18-8843-4c94-888a-357c27c8b468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:08.775523 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-403e0f18-8843-4c94-888a-357c27c8b468 None None] MFA Rules not processed for user `b54f86b4feb4430781bd7f28aed6d36c`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:39:08.776725 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-403e0f18-8843-4c94-888a-357c27c8b468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:08.850808 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4302/8553] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:39:08 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:39:08.855281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a1836-e8a0-4ad9-9e67-341d61bd2f0d service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:08.865857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a1836-e8a0-4ad9-9e67-341d61bd2f0d service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:08.870399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89079f9c-02f8-491a-9d78-2cab9c976f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:08.871046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89079f9c-02f8-491a-9d78-2cab9c976f62 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:08.871328 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89079f9c-02f8-491a-9d78-2cab9c976f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:08.871604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89079f9c-02f8-491a-9d78-2cab9c976f62 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:08.872214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89079f9c-02f8-491a-9d78-2cab9c976f62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:08.874121 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89079f9c-02f8-491a-9d78-2cab9c976f62 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:08.900855 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4252/8554] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:39:08 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:39:08.905212 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e0f18-8843-4c94-888a-357c27c8b468 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:08.918137 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e0f18-8843-4c94-888a-357c27c8b468 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:08.976163 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a195840-0031-487a-8598-b80ae83abf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:08.976780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a195840-0031-487a-8598-b80ae83abf3e admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:08.977065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a195840-0031-487a-8598-b80ae83abf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:08.977344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a195840-0031-487a-8598-b80ae83abf3e admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:08.977967 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a195840-0031-487a-8598-b80ae83abf3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:08.979936 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a195840-0031-487a-8598-b80ae83abf3e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:09.004595 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4303/8555] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:39:08 2022] POST /identity/v3/users => generated 309 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:39:09.005666 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89079f9c-02f8-491a-9d78-2cab9c976f62 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:09.018030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89079f9c-02f8-491a-9d78-2cab9c976f62 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:09.023537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb87ca8-bbed-4acf-9844-1d92915b736a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:09.024249 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb87ca8-bbed-4acf-9844-1d92915b736a admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:09.024595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb87ca8-bbed-4acf-9844-1d92915b736a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:09.024943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb87ca8-bbed-4acf-9844-1d92915b736a admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:09.025660 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb87ca8-bbed-4acf-9844-1d92915b736a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:09.027468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb87ca8-bbed-4acf-9844-1d92915b736a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:09.039347 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4253/8556] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:39:09.043679 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a195840-0031-487a-8598-b80ae83abf3e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:09.054972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a195840-0031-487a-8598-b80ae83abf3e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:09.059680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45201ff-636d-411b-8890-414144cf6cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:09.060608 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45201ff-636d-411b-8890-414144cf6cf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:09.060888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45201ff-636d-411b-8890-414144cf6cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:09.061164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45201ff-636d-411b-8890-414144cf6cf6 admin admin] PATH_INFO: `/v3/projects/8727a4f3a313445d8b8c7e2d141bb649/users/a276f774ffa7441ea85f4ee36531a862/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:09.077246 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45201ff-636d-411b-8890-414144cf6cf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8727a4f3a313445d8b8c7e2d141bb649, user_id=a276f774ffa7441ea85f4ee36531a862, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:09.080373 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45201ff-636d-411b-8890-414144cf6cf6 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:09.096037 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4304/8557] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:39:09 2022] PUT /identity/v3/projects/8727a4f3a313445d8b8c7e2d141bb649/users/a276f774ffa7441ea85f4ee36531a862/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:39:09.100065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb87ca8-bbed-4acf-9844-1d92915b736a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:09.110795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb87ca8-bbed-4acf-9844-1d92915b736a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:09.170564 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583e421-142c-4640-a8fa-b9c8606218a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:09.171198 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583e421-142c-4640-a8fa-b9c8606218a9 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:09.171479 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583e421-142c-4640-a8fa-b9c8606218a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:09.171753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583e421-142c-4640-a8fa-b9c8606218a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:09.172419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583e421-142c-4640-a8fa-b9c8606218a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:09.174068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583e421-142c-4640-a8fa-b9c8606218a9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:09.187816 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4254/8558] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:39:09.189075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45201ff-636d-411b-8890-414144cf6cf6 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:09.199466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45201ff-636d-411b-8890-414144cf6cf6 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:09.204947 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7cd333-43ad-4469-a8f5-e550db4c2f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:09.205844 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cd333-43ad-4469-a8f5-e550db4c2f10 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:09.206123 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cd333-43ad-4469-a8f5-e550db4c2f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:09.206400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cd333-43ad-4469-a8f5-e550db4c2f10 admin admin] PATH_INFO: `/v3/projects/8727a4f3a313445d8b8c7e2d141bb649/users/a276f774ffa7441ea85f4ee36531a862/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:09.208400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7cd333-43ad-4469-a8f5-e550db4c2f10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8727a4f3a313445d8b8c7e2d141bb649, user_id=a276f774ffa7441ea85f4ee36531a862, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:09.211086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7cd333-43ad-4469-a8f5-e550db4c2f10 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:09.222925 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4305/8559] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:39:09 2022] PUT /identity/v3/projects/8727a4f3a313445d8b8c7e2d141bb649/users/a276f774ffa7441ea85f4ee36531a862/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:39:09.859024 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2f74c-d87b-4c7c-8134-77b9b04be5e0 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:09.859515 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2f74c-d87b-4c7c-8134-77b9b04be5e0 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:09.859764 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2f74c-d87b-4c7c-8134-77b9b04be5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:09.896458 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-49c2f74c-d87b-4c7c-8134-77b9b04be5e0 None None] MFA Rules not processed for user `a276f774ffa7441ea85f4ee36531a862`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:39:09.897839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-49c2f74c-d87b-4c7c-8134-77b9b04be5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:09.978766 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4255/8560] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:39:09 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:39:11.293691 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7cd333-43ad-4469-a8f5-e550db4c2f10 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:11.307235 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:11.363009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7cd333-43ad-4469-a8f5-e550db4c2f10 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:11.367572 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd26d24-5fbf-44a2-9bed-58defbaf4bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:11.368197 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd26d24-5fbf-44a2-9bed-58defbaf4bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:11.368477 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd26d24-5fbf-44a2-9bed-58defbaf4bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:11.368751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd26d24-5fbf-44a2-9bed-58defbaf4bc4 admin admin] PATH_INFO: `/v3/users/b54f86b4feb4430781bd7f28aed6d36c` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:11.369855 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd26d24-5fbf-44a2-9bed-58defbaf4bc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b54f86b4feb4430781bd7f28aed6d36c)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:11.371814 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd26d24-5fbf-44a2-9bed-58defbaf4bc4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:11.422447 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5cd26d24-5fbf-44a2-9bed-58defbaf4bc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b54f86b4feb4430781bd7f28aed6d36c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:11.430053 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5cd26d24-5fbf-44a2-9bed-58defbaf4bc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b54f86b4feb4430781bd7f28aed6d36c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:11.430743 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5cd26d24-5fbf-44a2-9bed-58defbaf4bc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b54f86b4feb4430781bd7f28aed6d36c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:11.431349 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5cd26d24-5fbf-44a2-9bed-58defbaf4bc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b54f86b4feb4430781bd7f28aed6d36c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:11.438972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5cd26d24-5fbf-44a2-9bed-58defbaf4bc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b54f86b4feb4430781bd7f28aed6d36c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:11.457450 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4306/8561] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:39:11 2022] DELETE /identity/v3/users/b54f86b4feb4430781bd7f28aed6d36c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:39:11.634124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2f74c-d87b-4c7c-8134-77b9b04be5e0 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:11.650951 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2f74c-d87b-4c7c-8134-77b9b04be5e0 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:11.669756 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:11.711625 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9884b-b08e-4f41-94c8-3e521ee5d286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:11.712247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9884b-b08e-4f41-94c8-3e521ee5d286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:11.712522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9884b-b08e-4f41-94c8-3e521ee5d286 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:11.712793 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9884b-b08e-4f41-94c8-3e521ee5d286 admin admin] PATH_INFO: `/v3/projects/f40d2d7c15d5433aa405f3ed54a875d2` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:11.713894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9884b-b08e-4f41-94c8-3e521ee5d286 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f40d2d7c15d5433aa405f3ed54a875d2)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:11.715851 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9884b-b08e-4f41-94c8-3e521ee5d286 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:11.763002 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a0d9884b-b08e-4f41-94c8-3e521ee5d286 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f40d2d7c15d5433aa405f3ed54a875d2', 'request_id': 'req-a0d9884b-b08e-4f41-94c8-3e521ee5d286'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:11.768486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a0d9884b-b08e-4f41-94c8-3e521ee5d286 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f40d2d7c15d5433aa405f3ed54a875d2', 'request_id': 'req-a0d9884b-b08e-4f41-94c8-3e521ee5d286'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:11.774708 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a0d9884b-b08e-4f41-94c8-3e521ee5d286 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f40d2d7c15d5433aa405f3ed54a875d2', 'request_id': 'req-a0d9884b-b08e-4f41-94c8-3e521ee5d286'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:11.787717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a0d9884b-b08e-4f41-94c8-3e521ee5d286 admin admin] The token cache is being invalidate because project f40d2d7c15d5433aa405f3ed54a875d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:39:11.788004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a0d9884b-b08e-4f41-94c8-3e521ee5d286 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:11.788622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a0d9884b-b08e-4f41-94c8-3e521ee5d286 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:11.790128 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4256/8562] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:39:11 2022] DELETE /identity/v3/projects/f40d2d7c15d5433aa405f3ed54a875d2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:39:11.794153 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd26d24-5fbf-44a2-9bed-58defbaf4bc4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:11.795588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5cd26d24-5fbf-44a2-9bed-58defbaf4bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:11.808868 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd26d24-5fbf-44a2-9bed-58defbaf4bc4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:11.867292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd69395-3463-4b8a-8211-7c2ca205b9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:11.867921 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd69395-3463-4b8a-8211-7c2ca205b9f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:11.868219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd69395-3463-4b8a-8211-7c2ca205b9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:11.868473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd69395-3463-4b8a-8211-7c2ca205b9f0 admin admin] PATH_INFO: `/v3/users/a276f774ffa7441ea85f4ee36531a862` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:11.869591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd69395-3463-4b8a-8211-7c2ca205b9f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a276f774ffa7441ea85f4ee36531a862)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:11.871543 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd69395-3463-4b8a-8211-7c2ca205b9f0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:11.905128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:11.919340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0dd69395-3463-4b8a-8211-7c2ca205b9f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a276f774ffa7441ea85f4ee36531a862'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:11.926560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0dd69395-3463-4b8a-8211-7c2ca205b9f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a276f774ffa7441ea85f4ee36531a862'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:11.927232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0dd69395-3463-4b8a-8211-7c2ca205b9f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a276f774ffa7441ea85f4ee36531a862'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:11.927873 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0dd69395-3463-4b8a-8211-7c2ca205b9f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a276f774ffa7441ea85f4ee36531a862'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:11.934817 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0dd69395-3463-4b8a-8211-7c2ca205b9f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a276f774ffa7441ea85f4ee36531a862'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:11.952509 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4307/8563] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:39:11 2022] DELETE /identity/v3/users/a276f774ffa7441ea85f4ee36531a862 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:39:12.124278 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9884b-b08e-4f41-94c8-3e521ee5d286 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:12.126393 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a0d9884b-b08e-4f41-94c8-3e521ee5d286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:12.139938 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9884b-b08e-4f41-94c8-3e521ee5d286 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:12.201250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa23972-cee3-4bb6-9745-4b97a6e9fb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:12.201808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa23972-cee3-4bb6-9745-4b97a6e9fb3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:12.202083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa23972-cee3-4bb6-9745-4b97a6e9fb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:12.202353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa23972-cee3-4bb6-9745-4b97a6e9fb3e admin admin] PATH_INFO: `/v3/projects/8727a4f3a313445d8b8c7e2d141bb649` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:12.203489 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa23972-cee3-4bb6-9745-4b97a6e9fb3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8727a4f3a313445d8b8c7e2d141bb649)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:12.206019 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa23972-cee3-4bb6-9745-4b97a6e9fb3e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:12.252981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-afa23972-cee3-4bb6-9745-4b97a6e9fb3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8727a4f3a313445d8b8c7e2d141bb649', 'request_id': 'req-afa23972-cee3-4bb6-9745-4b97a6e9fb3e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:12.254931 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:12.259462 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-afa23972-cee3-4bb6-9745-4b97a6e9fb3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8727a4f3a313445d8b8c7e2d141bb649', 'request_id': 'req-afa23972-cee3-4bb6-9745-4b97a6e9fb3e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:12.267451 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-afa23972-cee3-4bb6-9745-4b97a6e9fb3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8727a4f3a313445d8b8c7e2d141bb649', 'request_id': 'req-afa23972-cee3-4bb6-9745-4b97a6e9fb3e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:12.279791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-afa23972-cee3-4bb6-9745-4b97a6e9fb3e admin admin] The token cache is being invalidate because project 8727a4f3a313445d8b8c7e2d141bb649 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:39:12.280076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-afa23972-cee3-4bb6-9745-4b97a6e9fb3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:12.280686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-afa23972-cee3-4bb6-9745-4b97a6e9fb3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:12.282229 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4257/8564] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:39:12 2022] DELETE /identity/v3/projects/8727a4f3a313445d8b8c7e2d141bb649 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:39:12.287390 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e643cd-8a5d-4e58-9e34-4f4e5ee7846b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:12.287684 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e643cd-8a5d-4e58-9e34-4f4e5ee7846b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:12.287964 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e643cd-8a5d-4e58-9e34-4f4e5ee7846b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:12.307901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-25e643cd-8a5d-4e58-9e34-4f4e5ee7846b None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:39:12.309102 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-25e643cd-8a5d-4e58-9e34-4f4e5ee7846b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:12.370979 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4308/8565] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:39:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:39:12.379373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504ff98-86f0-46b4-81a6-1e0e5ca1d6c8 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:12.379648 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504ff98-86f0-46b4-81a6-1e0e5ca1d6c8 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:12.379922 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504ff98-86f0-46b4-81a6-1e0e5ca1d6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:12.399103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a504ff98-86f0-46b4-81a6-1e0e5ca1d6c8 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:39:12.400293 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a504ff98-86f0-46b4-81a6-1e0e5ca1d6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:12.408184 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4258/8566] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:39:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:39:12.412306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e643cd-8a5d-4e58-9e34-4f4e5ee7846b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:12.421900 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e643cd-8a5d-4e58-9e34-4f4e5ee7846b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:12.427381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee268c5-a4d7-4f9c-99f6-32f794cb3302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:12.427980 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee268c5-a4d7-4f9c-99f6-32f794cb3302 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:12.428259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee268c5-a4d7-4f9c-99f6-32f794cb3302 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:12.428532 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee268c5-a4d7-4f9c-99f6-32f794cb3302 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:12.429203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee268c5-a4d7-4f9c-99f6-32f794cb3302 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:39:12.429501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee268c5-a4d7-4f9c-99f6-32f794cb3302 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:12.431125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee268c5-a4d7-4f9c-99f6-32f794cb3302 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:12.444164 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4309/8567] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:39:12.448498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a504ff98-86f0-46b4-81a6-1e0e5ca1d6c8 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:12.457800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a504ff98-86f0-46b4-81a6-1e0e5ca1d6c8 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:12.462484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12974d6-2b23-41fa-926d-25ad5de0883f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:12.463100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12974d6-2b23-41fa-926d-25ad5de0883f admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:12.463381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12974d6-2b23-41fa-926d-25ad5de0883f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:12.463647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12974d6-2b23-41fa-926d-25ad5de0883f admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:12.464251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12974d6-2b23-41fa-926d-25ad5de0883f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:12.466143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12974d6-2b23-41fa-926d-25ad5de0883f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:12.492742 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4259/8568] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:39:12 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:39:12.497026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee268c5-a4d7-4f9c-99f6-32f794cb3302 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:12.508291 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee268c5-a4d7-4f9c-99f6-32f794cb3302 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:12.570877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043afa73-1341-46be-8024-347c4744dfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:12.571481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043afa73-1341-46be-8024-347c4744dfe9 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:12.571759 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043afa73-1341-46be-8024-347c4744dfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:12.572034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043afa73-1341-46be-8024-347c4744dfe9 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:12.572658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043afa73-1341-46be-8024-347c4744dfe9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:12.574600 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043afa73-1341-46be-8024-347c4744dfe9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:12.597174 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4310/8569] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:39:12 2022] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:39:12.601439 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12974d6-2b23-41fa-926d-25ad5de0883f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:12.614201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12974d6-2b23-41fa-926d-25ad5de0883f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:12.618814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31763cb3-1479-49d0-b16f-507fd054a7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:12.619450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31763cb3-1479-49d0-b16f-507fd054a7cf admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:12.619725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31763cb3-1479-49d0-b16f-507fd054a7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:12.619995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31763cb3-1479-49d0-b16f-507fd054a7cf admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:12.620623 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31763cb3-1479-49d0-b16f-507fd054a7cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:12.622246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31763cb3-1479-49d0-b16f-507fd054a7cf admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:12.632762 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4260/8570] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:39:12.636710 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043afa73-1341-46be-8024-347c4744dfe9 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:12.647115 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043afa73-1341-46be-8024-347c4744dfe9 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:12.651686 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ea1a1-1d7f-400f-b20a-b9f9b26bd898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:12.652298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ea1a1-1d7f-400f-b20a-b9f9b26bd898 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:12.652576 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ea1a1-1d7f-400f-b20a-b9f9b26bd898 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:12.652845 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ea1a1-1d7f-400f-b20a-b9f9b26bd898 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:12.653480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ea1a1-1d7f-400f-b20a-b9f9b26bd898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:12.655078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ea1a1-1d7f-400f-b20a-b9f9b26bd898 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:12.666250 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4311/8571] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:39:12.670666 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31763cb3-1479-49d0-b16f-507fd054a7cf admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:12.681773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31763cb3-1479-49d0-b16f-507fd054a7cf admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:12.686995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be50147-aa60-45d0-98bb-9f9a215e4dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:12.687638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be50147-aa60-45d0-98bb-9f9a215e4dc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:12.687916 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be50147-aa60-45d0-98bb-9f9a215e4dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:12.688215 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be50147-aa60-45d0-98bb-9f9a215e4dc8 admin admin] PATH_INFO: `/v3/projects/898180c9333e4603b425b6d23e161274/users/08ede57a1ca84d4f8e01ee23cd6ec5fc/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:12.702677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be50147-aa60-45d0-98bb-9f9a215e4dc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=898180c9333e4603b425b6d23e161274, user_id=08ede57a1ca84d4f8e01ee23cd6ec5fc, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:12.705549 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be50147-aa60-45d0-98bb-9f9a215e4dc8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:12.718443 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4261/8572] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:39:12 2022] PUT /identity/v3/projects/898180c9333e4603b425b6d23e161274/users/08ede57a1ca84d4f8e01ee23cd6ec5fc/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:39:12.730836 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38373b-4588-42dd-901f-e0067015088a None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:12.731120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38373b-4588-42dd-901f-e0067015088a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:12.731393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38373b-4588-42dd-901f-e0067015088a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:12.762853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:12.765907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-af38373b-4588-42dd-901f-e0067015088a None None] MFA Rules not processed for user `08ede57a1ca84d4f8e01ee23cd6ec5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:39:12.768463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-af38373b-4588-42dd-901f-e0067015088a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:12.835076 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4312/8573] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:39:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:39:12.839712 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be50147-aa60-45d0-98bb-9f9a215e4dc8 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:12.904060 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be50147-aa60-45d0-98bb-9f9a215e4dc8 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:12.909326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dcd3ce-9b11-4405-8e12-71198cdeb62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:12.909925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcd3ce-9b11-4405-8e12-71198cdeb62f admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:12.910206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcd3ce-9b11-4405-8e12-71198cdeb62f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:12.910483 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcd3ce-9b11-4405-8e12-71198cdeb62f admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:12.911137 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dcd3ce-9b11-4405-8e12-71198cdeb62f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:12.913081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dcd3ce-9b11-4405-8e12-71198cdeb62f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:12.942088 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4262/8574] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:39:12 2022] POST /identity/v3/projects => generated 365 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:39:12.946036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38373b-4588-42dd-901f-e0067015088a None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:12.956880 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38373b-4588-42dd-901f-e0067015088a None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:13.012496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79e77c-0686-4c7c-bd84-10303ffd46fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:13.013028 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79e77c-0686-4c7c-bd84-10303ffd46fb admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:13.013305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79e77c-0686-4c7c-bd84-10303ffd46fb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:13.013578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79e77c-0686-4c7c-bd84-10303ffd46fb admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:13.014200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c79e77c-0686-4c7c-bd84-10303ffd46fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:13.016139 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c79e77c-0686-4c7c-bd84-10303ffd46fb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:13.037045 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4313/8575] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:39:12 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:39:13.040972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dcd3ce-9b11-4405-8e12-71198cdeb62f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:13.052034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dcd3ce-9b11-4405-8e12-71198cdeb62f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:13.056710 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5633a-3927-4b25-9650-1560f329e928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:13.057302 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5633a-3927-4b25-9650-1560f329e928 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:13.057582 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5633a-3927-4b25-9650-1560f329e928 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:13.057854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5633a-3927-4b25-9650-1560f329e928 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:13.058514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5633a-3927-4b25-9650-1560f329e928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:13.060150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5633a-3927-4b25-9650-1560f329e928 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:13.071926 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4263/8576] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:39:13.075925 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79e77c-0686-4c7c-bd84-10303ffd46fb admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:13.085844 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79e77c-0686-4c7c-bd84-10303ffd46fb admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:13.090444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97a4df-9dae-4f50-bd63-9e6fb0f4df04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:13.091112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97a4df-9dae-4f50-bd63-9e6fb0f4df04 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:13.091389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97a4df-9dae-4f50-bd63-9e6fb0f4df04 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:13.091663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97a4df-9dae-4f50-bd63-9e6fb0f4df04 admin admin] PATH_INFO: `/v3/projects/6d2788b81875449f8bdf8902361c3d76/users/08ca8462b7314d5b8be87f2b943803d9/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:13.108414 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97a4df-9dae-4f50-bd63-9e6fb0f4df04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d2788b81875449f8bdf8902361c3d76, user_id=08ca8462b7314d5b8be87f2b943803d9, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:13.111699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97a4df-9dae-4f50-bd63-9e6fb0f4df04 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:13.124315 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4314/8577] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:39:13 2022] PUT /identity/v3/projects/6d2788b81875449f8bdf8902361c3d76/users/08ca8462b7314d5b8be87f2b943803d9/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:39:13.129254 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5633a-3927-4b25-9650-1560f329e928 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:13.139471 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5633a-3927-4b25-9650-1560f329e928 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:13.186624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:13.198322 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625e597-49eb-4a25-a3ee-f6bf4367cf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:13.198954 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625e597-49eb-4a25-a3ee-f6bf4367cf85 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:13.199236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625e597-49eb-4a25-a3ee-f6bf4367cf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:13.199507 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625e597-49eb-4a25-a3ee-f6bf4367cf85 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:13.200130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625e597-49eb-4a25-a3ee-f6bf4367cf85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:13.201724 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625e597-49eb-4a25-a3ee-f6bf4367cf85 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:13.211625 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4264/8578] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:39:13.215703 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97a4df-9dae-4f50-bd63-9e6fb0f4df04 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:13.225888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97a4df-9dae-4f50-bd63-9e6fb0f4df04 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:13.230480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce64c98-6efa-439c-9fef-358caaa38bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:13.231148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce64c98-6efa-439c-9fef-358caaa38bd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:13.231425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce64c98-6efa-439c-9fef-358caaa38bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:13.231696 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce64c98-6efa-439c-9fef-358caaa38bd9 admin admin] PATH_INFO: `/v3/projects/6d2788b81875449f8bdf8902361c3d76/users/08ca8462b7314d5b8be87f2b943803d9/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:13.233579 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce64c98-6efa-439c-9fef-358caaa38bd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d2788b81875449f8bdf8902361c3d76, user_id=08ca8462b7314d5b8be87f2b943803d9, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:13.236788 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce64c98-6efa-439c-9fef-358caaa38bd9 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:13.246816 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4315/8579] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:39:13 2022] PUT /identity/v3/projects/6d2788b81875449f8bdf8902361c3d76/users/08ca8462b7314d5b8be87f2b943803d9/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:39:13.256807 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad715629-b893-4840-b3a0-82de475c4476 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:13.257170 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad715629-b893-4840-b3a0-82de475c4476 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:13.257453 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad715629-b893-4840-b3a0-82de475c4476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:13.286350 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-ad715629-b893-4840-b3a0-82de475c4476 None None] MFA Rules not processed for user `08ca8462b7314d5b8be87f2b943803d9`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:39:13.287503 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ad715629-b893-4840-b3a0-82de475c4476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:13.355395 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4265/8580] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:39:13 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:39:13.367917 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce64c98-6efa-439c-9fef-358caaa38bd9 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:13.369671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5ce64c98-6efa-439c-9fef-358caaa38bd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:13.430335 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce64c98-6efa-439c-9fef-358caaa38bd9 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:13.434055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb370e6b-aa11-4ee8-8382-221b103b29ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:13.434691 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb370e6b-aa11-4ee8-8382-221b103b29ee service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:13.435001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb370e6b-aa11-4ee8-8382-221b103b29ee service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:13.435278 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb370e6b-aa11-4ee8-8382-221b103b29ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:13.445395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb370e6b-aa11-4ee8-8382-221b103b29ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:13.446847 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb370e6b-aa11-4ee8-8382-221b103b29ee service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:13.450691 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:13.458400 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4316/8581] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:39:13 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:39:13.870110 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad715629-b893-4840-b3a0-82de475c4476 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:13.932453 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad715629-b893-4840-b3a0-82de475c4476 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:13.937313 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868744cb-c487-4333-9bc0-9611ddde29c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:13.937964 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868744cb-c487-4333-9bc0-9611ddde29c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:13.938276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868744cb-c487-4333-9bc0-9611ddde29c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:13.939120 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868744cb-c487-4333-9bc0-9611ddde29c8 admin admin] PATH_INFO: `/v3/users/08ede57a1ca84d4f8e01ee23cd6ec5fc` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:13.940212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868744cb-c487-4333-9bc0-9611ddde29c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08ede57a1ca84d4f8e01ee23cd6ec5fc)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:13.942167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868744cb-c487-4333-9bc0-9611ddde29c8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:13.987537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-868744cb-c487-4333-9bc0-9611ddde29c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08ede57a1ca84d4f8e01ee23cd6ec5fc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:13.988181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-868744cb-c487-4333-9bc0-9611ddde29c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08ede57a1ca84d4f8e01ee23cd6ec5fc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:13.988786 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-868744cb-c487-4333-9bc0-9611ddde29c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08ede57a1ca84d4f8e01ee23cd6ec5fc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:13.995724 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-868744cb-c487-4333-9bc0-9611ddde29c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08ede57a1ca84d4f8e01ee23cd6ec5fc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:14.008595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-868744cb-c487-4333-9bc0-9611ddde29c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08ede57a1ca84d4f8e01ee23cd6ec5fc'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:14.010595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:14.023143 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4266/8582] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:39:13 2022] DELETE /identity/v3/users/08ede57a1ca84d4f8e01ee23cd6ec5fc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:39:14.027747 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32d7ca-dd48-419c-a1e6-a2fdd19148fd None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:14.028034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32d7ca-dd48-419c-a1e6-a2fdd19148fd None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:14.028338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32d7ca-dd48-419c-a1e6-a2fdd19148fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:14.048111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-4f32d7ca-dd48-419c-a1e6-a2fdd19148fd None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:39:14.049511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4f32d7ca-dd48-419c-a1e6-a2fdd19148fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:14.108865 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4317/8583] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:39:14.118607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868744cb-c487-4333-9bc0-9611ddde29c8 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:14.120015 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-868744cb-c487-4333-9bc0-9611ddde29c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:14.179673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868744cb-c487-4333-9bc0-9611ddde29c8 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:14.183376 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4becd40-fbc5-4af6-a6f8-80dc5410ec40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:14.183975 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4becd40-fbc5-4af6-a6f8-80dc5410ec40 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:14.184258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4becd40-fbc5-4af6-a6f8-80dc5410ec40 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:14.184536 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4becd40-fbc5-4af6-a6f8-80dc5410ec40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:14.194296 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4becd40-fbc5-4af6-a6f8-80dc5410ec40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:14.195758 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4becd40-fbc5-4af6-a6f8-80dc5410ec40 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:14.205794 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4267/8584] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:39:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:39:14.477548 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32d7ca-dd48-419c-a1e6-a2fdd19148fd None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:14.479118 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4f32d7ca-dd48-419c-a1e6-a2fdd19148fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:14.492765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32d7ca-dd48-419c-a1e6-a2fdd19148fd None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:14.497451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506e947-3e2a-482d-8054-74e991564c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:14.498108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506e947-3e2a-482d-8054-74e991564c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:14.498385 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506e947-3e2a-482d-8054-74e991564c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:14.498683 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506e947-3e2a-482d-8054-74e991564c65 admin admin] PATH_INFO: `/v3/projects/898180c9333e4603b425b6d23e161274` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:14.499807 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506e947-3e2a-482d-8054-74e991564c65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=898180c9333e4603b425b6d23e161274)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:14.502503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506e947-3e2a-482d-8054-74e991564c65 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:14.549696 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7506e947-3e2a-482d-8054-74e991564c65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '898180c9333e4603b425b6d23e161274', 'request_id': 'req-7506e947-3e2a-482d-8054-74e991564c65'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:14.555063 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7506e947-3e2a-482d-8054-74e991564c65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '898180c9333e4603b425b6d23e161274', 'request_id': 'req-7506e947-3e2a-482d-8054-74e991564c65'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:14.564194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7506e947-3e2a-482d-8054-74e991564c65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '898180c9333e4603b425b6d23e161274', 'request_id': 'req-7506e947-3e2a-482d-8054-74e991564c65'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:14.575270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7506e947-3e2a-482d-8054-74e991564c65 admin admin] The token cache is being invalidate because project 898180c9333e4603b425b6d23e161274 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:39:14.575562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7506e947-3e2a-482d-8054-74e991564c65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:14.576191 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-7506e947-3e2a-482d-8054-74e991564c65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:14.577672 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4318/8585] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:39:14 2022] DELETE /identity/v3/projects/898180c9333e4603b425b6d23e161274 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:39:14.581674 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4becd40-fbc5-4af6-a6f8-80dc5410ec40 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:14.591579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4becd40-fbc5-4af6-a6f8-80dc5410ec40 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:14.647693 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7081bf-72e4-44be-a645-e908d3d92e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:14.648251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7081bf-72e4-44be-a645-e908d3d92e4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:14.648531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7081bf-72e4-44be-a645-e908d3d92e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:14.648837 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7081bf-72e4-44be-a645-e908d3d92e4f admin admin] PATH_INFO: `/v3/users/08ca8462b7314d5b8be87f2b943803d9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:14.649952 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7081bf-72e4-44be-a645-e908d3d92e4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=08ca8462b7314d5b8be87f2b943803d9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:14.651937 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7081bf-72e4-44be-a645-e908d3d92e4f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:14.699301 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ad7081bf-72e4-44be-a645-e908d3d92e4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08ca8462b7314d5b8be87f2b943803d9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:14.699954 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ad7081bf-72e4-44be-a645-e908d3d92e4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08ca8462b7314d5b8be87f2b943803d9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:14.700552 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ad7081bf-72e4-44be-a645-e908d3d92e4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08ca8462b7314d5b8be87f2b943803d9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:14.708051 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ad7081bf-72e4-44be-a645-e908d3d92e4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08ca8462b7314d5b8be87f2b943803d9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:14.719655 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ad7081bf-72e4-44be-a645-e908d3d92e4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08ca8462b7314d5b8be87f2b943803d9'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:14.731780 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4268/8586] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:39:14 2022] DELETE /identity/v3/users/08ca8462b7314d5b8be87f2b943803d9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:39:15.014071 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506e947-3e2a-482d-8054-74e991564c65 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:15.015551 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7506e947-3e2a-482d-8054-74e991564c65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:15.029381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506e947-3e2a-482d-8054-74e991564c65 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:15.087421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df132ff7-7053-45a7-aac5-c09d39939d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:15.088074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df132ff7-7053-45a7-aac5-c09d39939d81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:15.088358 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df132ff7-7053-45a7-aac5-c09d39939d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:15.088636 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df132ff7-7053-45a7-aac5-c09d39939d81 admin admin] PATH_INFO: `/v3/projects/6d2788b81875449f8bdf8902361c3d76` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:15.089751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df132ff7-7053-45a7-aac5-c09d39939d81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d2788b81875449f8bdf8902361c3d76)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:15.091769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df132ff7-7053-45a7-aac5-c09d39939d81 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:15.116610 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:15.140801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-df132ff7-7053-45a7-aac5-c09d39939d81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d2788b81875449f8bdf8902361c3d76', 'request_id': 'req-df132ff7-7053-45a7-aac5-c09d39939d81'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:15.147091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-df132ff7-7053-45a7-aac5-c09d39939d81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d2788b81875449f8bdf8902361c3d76', 'request_id': 'req-df132ff7-7053-45a7-aac5-c09d39939d81'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:15.155211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-df132ff7-7053-45a7-aac5-c09d39939d81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d2788b81875449f8bdf8902361c3d76', 'request_id': 'req-df132ff7-7053-45a7-aac5-c09d39939d81'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:15.167991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-df132ff7-7053-45a7-aac5-c09d39939d81 admin admin] The token cache is being invalidate because project 6d2788b81875449f8bdf8902361c3d76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:39:15.168262 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-df132ff7-7053-45a7-aac5-c09d39939d81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:15.168841 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-df132ff7-7053-45a7-aac5-c09d39939d81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:15.170334 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4319/8587] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:39:15 2022] DELETE /identity/v3/projects/6d2788b81875449f8bdf8902361c3d76 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:39:15.175927 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ce9a7-0524-406e-942c-5c22a099edfb None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:15.176316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ce9a7-0524-406e-942c-5c22a099edfb None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:15.176477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ce9a7-0524-406e-942c-5c22a099edfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:15.197396 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f38ce9a7-0524-406e-942c-5c22a099edfb None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:39:15.198448 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f38ce9a7-0524-406e-942c-5c22a099edfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:15.207224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:15.263877 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4269/8588] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:39:15.273356 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637697b-1a91-448e-b357-c12cef1c9061 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:15.273660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637697b-1a91-448e-b357-c12cef1c9061 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:15.273998 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637697b-1a91-448e-b357-c12cef1c9061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:15.294890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-0637697b-1a91-448e-b357-c12cef1c9061 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:39:15.296087 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0637697b-1a91-448e-b357-c12cef1c9061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:15.304419 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4320/8589] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:39:15.308484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ce9a7-0524-406e-942c-5c22a099edfb None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:15.318812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ce9a7-0524-406e-942c-5c22a099edfb None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:15.323498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ed89d-aff3-4e99-9856-9c8e6ffa0fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:15.324093 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ed89d-aff3-4e99-9856-9c8e6ffa0fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:15.324373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ed89d-aff3-4e99-9856-9c8e6ffa0fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:15.324645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ed89d-aff3-4e99-9856-9c8e6ffa0fa0 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:15.325312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ed89d-aff3-4e99-9856-9c8e6ffa0fa0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:39:15.325612 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ed89d-aff3-4e99-9856-9c8e6ffa0fa0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:15.327261 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ed89d-aff3-4e99-9856-9c8e6ffa0fa0 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:15.339781 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4270/8590] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:39:15.343777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637697b-1a91-448e-b357-c12cef1c9061 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:15.353940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637697b-1a91-448e-b357-c12cef1c9061 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:15.358538 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d388390-7ee3-48ec-ad8c-b49b5f0c9320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:15.359144 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d388390-7ee3-48ec-ad8c-b49b5f0c9320 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:15.359419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d388390-7ee3-48ec-ad8c-b49b5f0c9320 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:15.359688 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d388390-7ee3-48ec-ad8c-b49b5f0c9320 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:15.360335 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d388390-7ee3-48ec-ad8c-b49b5f0c9320 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:15.362314 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d388390-7ee3-48ec-ad8c-b49b5f0c9320 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:15.389791 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4321/8591] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:39:15 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:39:15.394663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ed89d-aff3-4e99-9856-9c8e6ffa0fa0 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:15.404740 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ed89d-aff3-4e99-9856-9c8e6ffa0fa0 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:15.464746 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15950110-56c8-4b10-a324-568a2f43251c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:15.465357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15950110-56c8-4b10-a324-568a2f43251c admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:15.465641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15950110-56c8-4b10-a324-568a2f43251c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:15.465916 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15950110-56c8-4b10-a324-568a2f43251c admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:15.466568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15950110-56c8-4b10-a324-568a2f43251c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:15.468495 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15950110-56c8-4b10-a324-568a2f43251c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:15.489422 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4271/8592] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:39:15 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:39:15.493699 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d388390-7ee3-48ec-ad8c-b49b5f0c9320 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:15.505250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d388390-7ee3-48ec-ad8c-b49b5f0c9320 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:15.509890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a3812-61d5-4c28-ad1b-8fd4881518bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:15.510484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a3812-61d5-4c28-ad1b-8fd4881518bd admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:15.510798 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a3812-61d5-4c28-ad1b-8fd4881518bd admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:15.511072 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a3812-61d5-4c28-ad1b-8fd4881518bd admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:15.511702 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a3812-61d5-4c28-ad1b-8fd4881518bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:15.513286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a3812-61d5-4c28-ad1b-8fd4881518bd admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:15.523635 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4322/8593] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:39:15.527612 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15950110-56c8-4b10-a324-568a2f43251c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:15.538385 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15950110-56c8-4b10-a324-568a2f43251c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:15.543010 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee98b91-9643-4040-88ba-a21ef0e5e901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:15.543590 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee98b91-9643-4040-88ba-a21ef0e5e901 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:15.543867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee98b91-9643-4040-88ba-a21ef0e5e901 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:15.544139 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee98b91-9643-4040-88ba-a21ef0e5e901 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:15.544770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee98b91-9643-4040-88ba-a21ef0e5e901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:15.546350 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee98b91-9643-4040-88ba-a21ef0e5e901 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:15.557297 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4272/8594] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:39:15.561663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a3812-61d5-4c28-ad1b-8fd4881518bd admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:15.571737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a3812-61d5-4c28-ad1b-8fd4881518bd admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:15.576410 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e36d2-3285-4cef-95ec-44d78a9fa8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:15.577056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e36d2-3285-4cef-95ec-44d78a9fa8c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:15.577338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e36d2-3285-4cef-95ec-44d78a9fa8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:15.577615 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e36d2-3285-4cef-95ec-44d78a9fa8c8 admin admin] PATH_INFO: `/v3/projects/60d95565413f4e04b67720bbea8ac6e2/users/ea34226c99e242a2bed02d4610849ed7/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:15.591840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e36d2-3285-4cef-95ec-44d78a9fa8c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60d95565413f4e04b67720bbea8ac6e2, user_id=ea34226c99e242a2bed02d4610849ed7, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:15.594490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e36d2-3285-4cef-95ec-44d78a9fa8c8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:15.607350 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4323/8595] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:39:15 2022] PUT /identity/v3/projects/60d95565413f4e04b67720bbea8ac6e2/users/ea34226c99e242a2bed02d4610849ed7/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:39:15.618470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866f12a-f1f8-444f-9957-db468db2b0c9 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:15.618781 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866f12a-f1f8-444f-9957-db468db2b0c9 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:15.619083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866f12a-f1f8-444f-9957-db468db2b0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:15.646570 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d866f12a-f1f8-444f-9957-db468db2b0c9 None None] MFA Rules not processed for user `ea34226c99e242a2bed02d4610849ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:39:15.647826 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d866f12a-f1f8-444f-9957-db468db2b0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:15.713908 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4273/8596] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:39:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:39:15.718406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e36d2-3285-4cef-95ec-44d78a9fa8c8 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:15.779913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e36d2-3285-4cef-95ec-44d78a9fa8c8 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:15.785296 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e1314-c44b-4be5-a0cd-b21a3738a0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:15.785887 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e1314-c44b-4be5-a0cd-b21a3738a0b7 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:15.786164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e1314-c44b-4be5-a0cd-b21a3738a0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:15.786436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e1314-c44b-4be5-a0cd-b21a3738a0b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:15.787092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e1314-c44b-4be5-a0cd-b21a3738a0b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:15.788982 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e1314-c44b-4be5-a0cd-b21a3738a0b7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:15.817212 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4324/8597] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:39:15 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:39:15.819668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866f12a-f1f8-444f-9957-db468db2b0c9 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:15.831090 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866f12a-f1f8-444f-9957-db468db2b0c9 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:15.836502 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:15.889666 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e94ab-2a40-406a-8e3f-23e785e1437f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:15.890274 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e94ab-2a40-406a-8e3f-23e785e1437f admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:15.890577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e94ab-2a40-406a-8e3f-23e785e1437f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:15.890852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e94ab-2a40-406a-8e3f-23e785e1437f admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:15.891970 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e94ab-2a40-406a-8e3f-23e785e1437f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:15.893958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e94ab-2a40-406a-8e3f-23e785e1437f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:15.915030 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4274/8598] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:39:15 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:39:15.919805 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e1314-c44b-4be5-a0cd-b21a3738a0b7 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:15.930751 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e1314-c44b-4be5-a0cd-b21a3738a0b7 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:15.936639 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d01f9-9472-4d0d-93df-53cb982b2813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:15.937297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d01f9-9472-4d0d-93df-53cb982b2813 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:15.937599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d01f9-9472-4d0d-93df-53cb982b2813 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:15.937870 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d01f9-9472-4d0d-93df-53cb982b2813 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:15.938680 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d01f9-9472-4d0d-93df-53cb982b2813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:15.940286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d01f9-9472-4d0d-93df-53cb982b2813 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:15.954527 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4325/8599] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:39:15.956328 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e94ab-2a40-406a-8e3f-23e785e1437f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:15.966603 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e94ab-2a40-406a-8e3f-23e785e1437f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:15.973094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee268ec-fc1a-4a19-9679-5c620de3ccb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:15.973687 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee268ec-fc1a-4a19-9679-5c620de3ccb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:15.974003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee268ec-fc1a-4a19-9679-5c620de3ccb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:15.974256 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee268ec-fc1a-4a19-9679-5c620de3ccb8 admin admin] PATH_INFO: `/v3/projects/7457c50c6f834d0e9454ffdc8a904860/users/ea992468d6a54d1cb7f7707142ffa01f/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:15.989990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee268ec-fc1a-4a19-9679-5c620de3ccb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7457c50c6f834d0e9454ffdc8a904860, user_id=ea992468d6a54d1cb7f7707142ffa01f, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:15.992820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee268ec-fc1a-4a19-9679-5c620de3ccb8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:16.005431 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4275/8600] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:39:15 2022] PUT /identity/v3/projects/7457c50c6f834d0e9454ffdc8a904860/users/ea992468d6a54d1cb7f7707142ffa01f/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:39:16.009377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d01f9-9472-4d0d-93df-53cb982b2813 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:16.019997 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d01f9-9472-4d0d-93df-53cb982b2813 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:16.038984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:16.078713 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8864f3-9643-4ad5-9ba2-9a9a20d31158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:16.079818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8864f3-9643-4ad5-9ba2-9a9a20d31158 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:16.080098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8864f3-9643-4ad5-9ba2-9a9a20d31158 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:16.080362 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8864f3-9643-4ad5-9ba2-9a9a20d31158 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:16.080993 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8864f3-9643-4ad5-9ba2-9a9a20d31158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:16.082587 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8864f3-9643-4ad5-9ba2-9a9a20d31158 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:16.092334 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4326/8601] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:39:16.096635 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee268ec-fc1a-4a19-9679-5c620de3ccb8 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:16.107041 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee268ec-fc1a-4a19-9679-5c620de3ccb8 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:16.112169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392d027-2738-42c3-820f-ae2e2f10a305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:16.112809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392d027-2738-42c3-820f-ae2e2f10a305 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:16.113089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392d027-2738-42c3-820f-ae2e2f10a305 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:16.113457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392d027-2738-42c3-820f-ae2e2f10a305 admin admin] PATH_INFO: `/v3/projects/7457c50c6f834d0e9454ffdc8a904860/users/ea992468d6a54d1cb7f7707142ffa01f/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:16.115440 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9392d027-2738-42c3-820f-ae2e2f10a305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7457c50c6f834d0e9454ffdc8a904860, user_id=ea992468d6a54d1cb7f7707142ffa01f, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:16.118076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9392d027-2738-42c3-820f-ae2e2f10a305 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:16.128773 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4276/8602] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:39:16 2022] PUT /identity/v3/projects/7457c50c6f834d0e9454ffdc8a904860/users/ea992468d6a54d1cb7f7707142ffa01f/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:39:16.139199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41785f-5202-451b-8f40-807b384880b8 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:16.139536 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41785f-5202-451b-8f40-807b384880b8 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:16.139811 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41785f-5202-451b-8f40-807b384880b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:16.167350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-fe41785f-5202-451b-8f40-807b384880b8 None None] MFA Rules not processed for user `ea992468d6a54d1cb7f7707142ffa01f`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:39:16.168757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-fe41785f-5202-451b-8f40-807b384880b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:16.237655 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4327/8603] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:39:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:39:16.248621 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392d027-2738-42c3-820f-ae2e2f10a305 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:16.250395 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9392d027-2738-42c3-820f-ae2e2f10a305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:16.314523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392d027-2738-42c3-820f-ae2e2f10a305 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:16.318213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873243f3-c293-4c15-b47e-77b5d0f9369b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:16.318842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873243f3-c293-4c15-b47e-77b5d0f9369b service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:16.319123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873243f3-c293-4c15-b47e-77b5d0f9369b service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:16.319392 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873243f3-c293-4c15-b47e-77b5d0f9369b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:16.328318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873243f3-c293-4c15-b47e-77b5d0f9369b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:16.330754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873243f3-c293-4c15-b47e-77b5d0f9369b service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:16.340177 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4277/8604] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:39:16 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:39:16.511190 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41785f-5202-451b-8f40-807b384880b8 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:16.573297 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41785f-5202-451b-8f40-807b384880b8 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:16.577875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de992e16-82d7-4545-a760-1e2ebe6f07cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:16.578494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de992e16-82d7-4545-a760-1e2ebe6f07cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:16.578806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de992e16-82d7-4545-a760-1e2ebe6f07cf admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:16.579179 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de992e16-82d7-4545-a760-1e2ebe6f07cf admin admin] PATH_INFO: `/v3/users/ea34226c99e242a2bed02d4610849ed7` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:16.580407 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de992e16-82d7-4545-a760-1e2ebe6f07cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea34226c99e242a2bed02d4610849ed7)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:16.582318 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de992e16-82d7-4545-a760-1e2ebe6f07cf admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:16.626132 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:16.627978 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-de992e16-82d7-4545-a760-1e2ebe6f07cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea34226c99e242a2bed02d4610849ed7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:16.636278 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-de992e16-82d7-4545-a760-1e2ebe6f07cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea34226c99e242a2bed02d4610849ed7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:16.636969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-de992e16-82d7-4545-a760-1e2ebe6f07cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea34226c99e242a2bed02d4610849ed7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:16.637574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-de992e16-82d7-4545-a760-1e2ebe6f07cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea34226c99e242a2bed02d4610849ed7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:16.645497 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-de992e16-82d7-4545-a760-1e2ebe6f07cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea34226c99e242a2bed02d4610849ed7'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:16.663377 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4328/8605] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:39:16 2022] DELETE /identity/v3/users/ea34226c99e242a2bed02d4610849ed7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:39:16.668037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100be00-7d10-4b35-9fc3-829479265134 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:16.668433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100be00-7d10-4b35-9fc3-829479265134 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:16.668776 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100be00-7d10-4b35-9fc3-829479265134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:16.687638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-5100be00-7d10-4b35-9fc3-829479265134 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:39:16.688880 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5100be00-7d10-4b35-9fc3-829479265134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:16.750845 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4278/8606] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:39:16.760976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de992e16-82d7-4545-a760-1e2ebe6f07cf admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:16.762379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-de992e16-82d7-4545-a760-1e2ebe6f07cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:16.822056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de992e16-82d7-4545-a760-1e2ebe6f07cf admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:16.825728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff79cf-b269-4e78-9813-473846a78dc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:16.826331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff79cf-b269-4e78-9813-473846a78dc6 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:16.826638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff79cf-b269-4e78-9813-473846a78dc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:16.826912 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff79cf-b269-4e78-9813-473846a78dc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:16.837257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff79cf-b269-4e78-9813-473846a78dc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:16.838721 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff79cf-b269-4e78-9813-473846a78dc6 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:16.851998 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4329/8607] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:39:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:39:17.135680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100be00-7d10-4b35-9fc3-829479265134 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:17.137118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5100be00-7d10-4b35-9fc3-829479265134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:17.147236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:17.156505 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100be00-7d10-4b35-9fc3-829479265134 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:17.162093 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1919e-fa29-4ae9-853c-8319e1962aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:17.163035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1919e-fa29-4ae9-853c-8319e1962aea admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:17.163435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1919e-fa29-4ae9-853c-8319e1962aea admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:17.163796 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1919e-fa29-4ae9-853c-8319e1962aea admin admin] PATH_INFO: `/v3/projects/60d95565413f4e04b67720bbea8ac6e2` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:17.165036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1919e-fa29-4ae9-853c-8319e1962aea admin admin] RBAC: Authorizing `identity:delete_project(project_id=60d95565413f4e04b67720bbea8ac6e2)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:17.167009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1919e-fa29-4ae9-853c-8319e1962aea admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:17.215252 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-13d1919e-fa29-4ae9-853c-8319e1962aea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60d95565413f4e04b67720bbea8ac6e2', 'request_id': 'req-13d1919e-fa29-4ae9-853c-8319e1962aea'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:17.220905 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-13d1919e-fa29-4ae9-853c-8319e1962aea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60d95565413f4e04b67720bbea8ac6e2', 'request_id': 'req-13d1919e-fa29-4ae9-853c-8319e1962aea'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:17.227197 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-13d1919e-fa29-4ae9-853c-8319e1962aea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60d95565413f4e04b67720bbea8ac6e2', 'request_id': 'req-13d1919e-fa29-4ae9-853c-8319e1962aea'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:17.239685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-13d1919e-fa29-4ae9-853c-8319e1962aea admin admin] The token cache is being invalidate because project 60d95565413f4e04b67720bbea8ac6e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:39:17.240024 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-13d1919e-fa29-4ae9-853c-8319e1962aea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:17.240673 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-13d1919e-fa29-4ae9-853c-8319e1962aea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:17.242186 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4279/8608] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:39:17 2022] DELETE /identity/v3/projects/60d95565413f4e04b67720bbea8ac6e2 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:39:17.246152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff79cf-b269-4e78-9813-473846a78dc6 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:17.256350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff79cf-b269-4e78-9813-473846a78dc6 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:17.312099 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c172709-ceb6-4afa-be13-a1c292a67649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:17.312728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c172709-ceb6-4afa-be13-a1c292a67649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:17.313005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c172709-ceb6-4afa-be13-a1c292a67649 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:17.313276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c172709-ceb6-4afa-be13-a1c292a67649 admin admin] PATH_INFO: `/v3/users/ea992468d6a54d1cb7f7707142ffa01f` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:17.314940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c172709-ceb6-4afa-be13-a1c292a67649 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea992468d6a54d1cb7f7707142ffa01f)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:17.316847 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c172709-ceb6-4afa-be13-a1c292a67649 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:17.361678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5c172709-ceb6-4afa-be13-a1c292a67649 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea992468d6a54d1cb7f7707142ffa01f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:17.368509 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5c172709-ceb6-4afa-be13-a1c292a67649 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea992468d6a54d1cb7f7707142ffa01f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:17.369169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5c172709-ceb6-4afa-be13-a1c292a67649 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea992468d6a54d1cb7f7707142ffa01f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:17.369782 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5c172709-ceb6-4afa-be13-a1c292a67649 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea992468d6a54d1cb7f7707142ffa01f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:17.377446 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-5c172709-ceb6-4afa-be13-a1c292a67649 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea992468d6a54d1cb7f7707142ffa01f'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:17.381837 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:17.395951 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4330/8609] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:39:17 2022] DELETE /identity/v3/users/ea992468d6a54d1cb7f7707142ffa01f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:39:17.668313 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1919e-fa29-4ae9-853c-8319e1962aea admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:17.670143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-13d1919e-fa29-4ae9-853c-8319e1962aea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:17.686026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1919e-fa29-4ae9-853c-8319e1962aea admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:17.745646 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060a0d4-a63a-45f9-8531-2aaf59660f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:17.746438 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060a0d4-a63a-45f9-8531-2aaf59660f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:17.746865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060a0d4-a63a-45f9-8531-2aaf59660f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:17.747243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060a0d4-a63a-45f9-8531-2aaf59660f68 admin admin] PATH_INFO: `/v3/projects/7457c50c6f834d0e9454ffdc8a904860` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:17.748375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060a0d4-a63a-45f9-8531-2aaf59660f68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7457c50c6f834d0e9454ffdc8a904860)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:17.750446 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060a0d4-a63a-45f9-8531-2aaf59660f68 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:17.796655 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3060a0d4-a63a-45f9-8531-2aaf59660f68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7457c50c6f834d0e9454ffdc8a904860', 'request_id': 'req-3060a0d4-a63a-45f9-8531-2aaf59660f68'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:17.802105 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3060a0d4-a63a-45f9-8531-2aaf59660f68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7457c50c6f834d0e9454ffdc8a904860', 'request_id': 'req-3060a0d4-a63a-45f9-8531-2aaf59660f68'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:17.808260 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3060a0d4-a63a-45f9-8531-2aaf59660f68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7457c50c6f834d0e9454ffdc8a904860', 'request_id': 'req-3060a0d4-a63a-45f9-8531-2aaf59660f68'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:17.821953 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3060a0d4-a63a-45f9-8531-2aaf59660f68 admin admin] The token cache is being invalidate because project 7457c50c6f834d0e9454ffdc8a904860 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:39:17.822307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3060a0d4-a63a-45f9-8531-2aaf59660f68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:17.823016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3060a0d4-a63a-45f9-8531-2aaf59660f68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:17.824583 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4280/8610] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:39:17 2022] DELETE /identity/v3/projects/7457c50c6f834d0e9454ffdc8a904860 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:39:17.833243 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5e36f-ccf9-40e6-a47c-f58aa9b24a80 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:17.833759 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5e36f-ccf9-40e6-a47c-f58aa9b24a80 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:17.834101 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5e36f-ccf9-40e6-a47c-f58aa9b24a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:17.857304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-42b5e36f-ccf9-40e6-a47c-f58aa9b24a80 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:39:17.858496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-42b5e36f-ccf9-40e6-a47c-f58aa9b24a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:17.916584 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4331/8611] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:39:17.925317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155a55a-1803-46e3-8103-cf0aa27e026a None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:17.925604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155a55a-1803-46e3-8103-cf0aa27e026a None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:17.925879 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155a55a-1803-46e3-8103-cf0aa27e026a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:17.946882 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-7155a55a-1803-46e3-8103-cf0aa27e026a None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:39:17.948067 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7155a55a-1803-46e3-8103-cf0aa27e026a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:17.956401 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4281/8612] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:39:17.960542 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5e36f-ccf9-40e6-a47c-f58aa9b24a80 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:17.970361 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5e36f-ccf9-40e6-a47c-f58aa9b24a80 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:17.975450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7b050-722c-4003-be70-12412ba16414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:17.976043 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7b050-722c-4003-be70-12412ba16414 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:17.976329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7b050-722c-4003-be70-12412ba16414 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:17.976600 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7b050-722c-4003-be70-12412ba16414 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:17.977241 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d7b050-722c-4003-be70-12412ba16414 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:39:17.977544 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d7b050-722c-4003-be70-12412ba16414 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:17.979187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d7b050-722c-4003-be70-12412ba16414 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:17.991309 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4332/8613] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:39:17.995542 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155a55a-1803-46e3-8103-cf0aa27e026a None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:18.005579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155a55a-1803-46e3-8103-cf0aa27e026a None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:18.010332 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc2202-04d6-439b-b849-bb79aa3ec1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:18.010969 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc2202-04d6-439b-b849-bb79aa3ec1c0 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:18.011246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc2202-04d6-439b-b849-bb79aa3ec1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:18.011517 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc2202-04d6-439b-b849-bb79aa3ec1c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:18.012130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc2202-04d6-439b-b849-bb79aa3ec1c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:18.014053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc2202-04d6-439b-b849-bb79aa3ec1c0 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:18.024456 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:18.042237 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4282/8614] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:39:17 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:39:18.046388 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7b050-722c-4003-be70-12412ba16414 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:18.056608 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7b050-722c-4003-be70-12412ba16414 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:18.112908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c962fa-5784-4975-a1c1-2478ef9b1442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:18.113508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c962fa-5784-4975-a1c1-2478ef9b1442 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:18.113789 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c962fa-5784-4975-a1c1-2478ef9b1442 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:18.114060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c962fa-5784-4975-a1c1-2478ef9b1442 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:18.114720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c962fa-5784-4975-a1c1-2478ef9b1442 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:18.116623 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c962fa-5784-4975-a1c1-2478ef9b1442 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:18.137433 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4333/8615] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:39:18 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:39:18.142246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc2202-04d6-439b-b849-bb79aa3ec1c0 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:18.152688 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc2202-04d6-439b-b849-bb79aa3ec1c0 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:18.157281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7eecc-0e50-48ee-8e35-0668f1413bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:18.157945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7eecc-0e50-48ee-8e35-0668f1413bae admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:18.158219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7eecc-0e50-48ee-8e35-0668f1413bae admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:18.158499 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7eecc-0e50-48ee-8e35-0668f1413bae admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:18.159158 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7eecc-0e50-48ee-8e35-0668f1413bae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:18.160746 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7eecc-0e50-48ee-8e35-0668f1413bae admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:18.170426 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4283/8616] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:39:18.175389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c962fa-5784-4975-a1c1-2478ef9b1442 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:18.185298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c962fa-5784-4975-a1c1-2478ef9b1442 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:18.191138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72365cbe-0a8a-43ca-9544-921b6a665326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:18.191771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72365cbe-0a8a-43ca-9544-921b6a665326 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:18.192056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72365cbe-0a8a-43ca-9544-921b6a665326 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:18.192330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72365cbe-0a8a-43ca-9544-921b6a665326 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:18.193001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72365cbe-0a8a-43ca-9544-921b6a665326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:18.194661 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72365cbe-0a8a-43ca-9544-921b6a665326 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:18.205540 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4334/8617] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:39:18.209539 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7eecc-0e50-48ee-8e35-0668f1413bae admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:18.219472 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7eecc-0e50-48ee-8e35-0668f1413bae admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:18.224547 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6f16c-49ca-4377-a70c-2ca90017d126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:18.225256 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6f16c-49ca-4377-a70c-2ca90017d126 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:18.225512 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6f16c-49ca-4377-a70c-2ca90017d126 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:18.225783 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6f16c-49ca-4377-a70c-2ca90017d126 admin admin] PATH_INFO: `/v3/projects/f7cb11cd2bd34e619347fb2cb0fff071/users/fdca6e4d27c748d1bb59781a7e71da37/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:18.240580 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6f16c-49ca-4377-a70c-2ca90017d126 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7cb11cd2bd34e619347fb2cb0fff071, user_id=fdca6e4d27c748d1bb59781a7e71da37, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:18.243246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6f16c-49ca-4377-a70c-2ca90017d126 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:18.257118 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4284/8618] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:39:18 2022] PUT /identity/v3/projects/f7cb11cd2bd34e619347fb2cb0fff071/users/fdca6e4d27c748d1bb59781a7e71da37/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:39:18.262065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a876875-3a77-4b99-8361-6f2f3fd6c254 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:18.262372 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a876875-3a77-4b99-8361-6f2f3fd6c254 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:18.262672 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a876875-3a77-4b99-8361-6f2f3fd6c254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:18.281612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-1a876875-3a77-4b99-8361-6f2f3fd6c254 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:39:18.283333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-1a876875-3a77-4b99-8361-6f2f3fd6c254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:18.328028 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:18.345819 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4335/8619] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:39:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:39:18.355487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6f16c-49ca-4377-a70c-2ca90017d126 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:18.357244 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-25d6f16c-49ca-4377-a70c-2ca90017d126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:18.417479 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6f16c-49ca-4377-a70c-2ca90017d126 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:18.421154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116aa444-1a46-49f7-b1ff-020b1d12c092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:18.421758 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116aa444-1a46-49f7-b1ff-020b1d12c092 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:18.422044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116aa444-1a46-49f7-b1ff-020b1d12c092 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:18.422339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116aa444-1a46-49f7-b1ff-020b1d12c092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:18.431512 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116aa444-1a46-49f7-b1ff-020b1d12c092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:18.432942 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116aa444-1a46-49f7-b1ff-020b1d12c092 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:18.442982 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4285/8620] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:39:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:39:19.077105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8aa91-f7b1-4ae0-9502-0a17c1c8617c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:19.077597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8aa91-f7b1-4ae0-9502-0a17c1c8617c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:19.077789 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8aa91-f7b1-4ae0-9502-0a17c1c8617c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:19.106060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-00b8aa91-f7b1-4ae0-9502-0a17c1c8617c None None] MFA Rules not processed for user `fdca6e4d27c748d1bb59781a7e71da37`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:39:19.107389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-00b8aa91-f7b1-4ae0-9502-0a17c1c8617c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:19.178346 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4336/8621] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:39:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:39:19.182452 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116aa444-1a46-49f7-b1ff-020b1d12c092 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:19.193545 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116aa444-1a46-49f7-b1ff-020b1d12c092 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:19.198189 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1553b83-968a-415f-9ba5-b220b2de884a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:19.198821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1553b83-968a-415f-9ba5-b220b2de884a admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:19.199096 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1553b83-968a-415f-9ba5-b220b2de884a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:19.199366 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1553b83-968a-415f-9ba5-b220b2de884a admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:19.199984 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1553b83-968a-415f-9ba5-b220b2de884a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:19.201883 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1553b83-968a-415f-9ba5-b220b2de884a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:19.233460 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4286/8622] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:39:19 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:39:19.234932 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8aa91-f7b1-4ae0-9502-0a17c1c8617c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:19.246584 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8aa91-f7b1-4ae0-9502-0a17c1c8617c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:19.303152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b455b6a-3e56-4ca2-99bb-e88d1e44846c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:19.303765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b455b6a-3e56-4ca2-99bb-e88d1e44846c admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:19.304041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b455b6a-3e56-4ca2-99bb-e88d1e44846c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:19.304318 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b455b6a-3e56-4ca2-99bb-e88d1e44846c admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:19.305005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b455b6a-3e56-4ca2-99bb-e88d1e44846c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:19.306998 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b455b6a-3e56-4ca2-99bb-e88d1e44846c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:19.329005 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4337/8623] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:39:19 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:39:19.333934 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1553b83-968a-415f-9ba5-b220b2de884a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:19.344414 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1553b83-968a-415f-9ba5-b220b2de884a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:19.349606 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf043c-cf1d-46d0-8908-ebde4cfb8fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:19.350198 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf043c-cf1d-46d0-8908-ebde4cfb8fbf admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:19.350479 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf043c-cf1d-46d0-8908-ebde4cfb8fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:19.350837 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf043c-cf1d-46d0-8908-ebde4cfb8fbf admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:19.351499 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf043c-cf1d-46d0-8908-ebde4cfb8fbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:19.353094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf043c-cf1d-46d0-8908-ebde4cfb8fbf admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:19.364102 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4287/8624] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:39:19.368137 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b455b6a-3e56-4ca2-99bb-e88d1e44846c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:19.379244 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b455b6a-3e56-4ca2-99bb-e88d1e44846c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:19.383815 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b1b95-de19-4745-888d-ff648a7548a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:19.384467 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b1b95-de19-4745-888d-ff648a7548a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:19.384734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b1b95-de19-4745-888d-ff648a7548a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:19.385003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b1b95-de19-4745-888d-ff648a7548a0 admin admin] PATH_INFO: `/v3/projects/248da865d2404c80a5112a86f9e3e598/users/840a705d1df9477ab8c44601f1867845/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:19.399945 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b1b95-de19-4745-888d-ff648a7548a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=248da865d2404c80a5112a86f9e3e598, user_id=840a705d1df9477ab8c44601f1867845, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:19.402623 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b1b95-de19-4745-888d-ff648a7548a0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:19.415985 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4338/8625] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:39:19 2022] PUT /identity/v3/projects/248da865d2404c80a5112a86f9e3e598/users/840a705d1df9477ab8c44601f1867845/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:39:19.419876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf043c-cf1d-46d0-8908-ebde4cfb8fbf admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:19.430909 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf043c-cf1d-46d0-8908-ebde4cfb8fbf admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:19.489402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453aae5-c98c-4919-8f6a-84735b988df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:19.490014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453aae5-c98c-4919-8f6a-84735b988df9 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:19.490297 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453aae5-c98c-4919-8f6a-84735b988df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:19.490602 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453aae5-c98c-4919-8f6a-84735b988df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:19.491237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453aae5-c98c-4919-8f6a-84735b988df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:19.492836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453aae5-c98c-4919-8f6a-84735b988df9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:19.503309 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4288/8626] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:39:19.507375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b1b95-de19-4745-888d-ff648a7548a0 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:19.518224 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b1b95-de19-4745-888d-ff648a7548a0 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:19.522952 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4cb491-e93a-4a4f-898b-dea422e612d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:19.523603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cb491-e93a-4a4f-898b-dea422e612d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:19.523906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cb491-e93a-4a4f-898b-dea422e612d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:19.524164 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cb491-e93a-4a4f-898b-dea422e612d4 admin admin] PATH_INFO: `/v3/projects/248da865d2404c80a5112a86f9e3e598/users/840a705d1df9477ab8c44601f1867845/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:19.526098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4cb491-e93a-4a4f-898b-dea422e612d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=248da865d2404c80a5112a86f9e3e598, user_id=840a705d1df9477ab8c44601f1867845, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:19.528802 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4cb491-e93a-4a4f-898b-dea422e612d4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:19.539336 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4339/8627] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:39:19 2022] PUT /identity/v3/projects/248da865d2404c80a5112a86f9e3e598/users/840a705d1df9477ab8c44601f1867845/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:39:20.165389 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f2cb5-6139-4c0f-bfa3-eca354c60f33 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:20.165764 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f2cb5-6139-4c0f-bfa3-eca354c60f33 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:20.166107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f2cb5-6139-4c0f-bfa3-eca354c60f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:20.197952 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-2a6f2cb5-6139-4c0f-bfa3-eca354c60f33 None None] MFA Rules not processed for user `840a705d1df9477ab8c44601f1867845`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:39:20.199332 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2a6f2cb5-6139-4c0f-bfa3-eca354c60f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:20.208576 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:20.275690 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4289/8628] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:39:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:39:20.288067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c1286-7996-4378-954f-2440b5a74aef None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:20.288578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c1286-7996-4378-954f-2440b5a74aef None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:20.288730 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c1286-7996-4378-954f-2440b5a74aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:20.309086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-612c1286-7996-4378-954f-2440b5a74aef None None] MFA Rules not processed for user `fdca6e4d27c748d1bb59781a7e71da37`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:39:20.310215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-612c1286-7996-4378-954f-2440b5a74aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:20.340521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:20.370973 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4340/8629] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:39:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:39:20.384969 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f2cb5-6139-4c0f-bfa3-eca354c60f33 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:20.386490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2a6f2cb5-6139-4c0f-bfa3-eca354c60f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:20.462789 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f2cb5-6139-4c0f-bfa3-eca354c60f33 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:20.468280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6846d-23c6-412d-9adf-37079e99093f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:20.468878 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6846d-23c6-412d-9adf-37079e99093f service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:20.469154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6846d-23c6-412d-9adf-37079e99093f service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:20.469430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6846d-23c6-412d-9adf-37079e99093f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:20.478097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc6846d-23c6-412d-9adf-37079e99093f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:20.479742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc6846d-23c6-412d-9adf-37079e99093f service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:20.488513 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4290/8630] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:39:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:39:30.364139 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=10 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:30.484480 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=59 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:43.726093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c1286-7996-4378-954f-2440b5a74aef None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:43.802825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c1286-7996-4378-954f-2440b5a74aef None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:43.808633 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc718b-ab09-42ab-b878-0528a2f128d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:43.809274 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc718b-ab09-42ab-b878-0528a2f128d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:43.809554 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc718b-ab09-42ab-b878-0528a2f128d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:43.809825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc718b-ab09-42ab-b878-0528a2f128d7 admin admin] PATH_INFO: `/v3/users/fdca6e4d27c748d1bb59781a7e71da37` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:43.811128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc718b-ab09-42ab-b878-0528a2f128d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdca6e4d27c748d1bb59781a7e71da37)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:43.813313 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc718b-ab09-42ab-b878-0528a2f128d7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:43.868502 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-02bc718b-ab09-42ab-b878-0528a2f128d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdca6e4d27c748d1bb59781a7e71da37'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:43.875833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-02bc718b-ab09-42ab-b878-0528a2f128d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdca6e4d27c748d1bb59781a7e71da37'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:43.876521 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-02bc718b-ab09-42ab-b878-0528a2f128d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdca6e4d27c748d1bb59781a7e71da37'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:43.877961 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-02bc718b-ab09-42ab-b878-0528a2f128d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdca6e4d27c748d1bb59781a7e71da37'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:43.887532 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-02bc718b-ab09-42ab-b878-0528a2f128d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdca6e4d27c748d1bb59781a7e71da37'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:43.919154 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4341/8631] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:39:43 2022] DELETE /identity/v3/users/fdca6e4d27c748d1bb59781a7e71da37 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:39:44.146312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6846d-23c6-412d-9adf-37079e99093f service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:44.159306 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6846d-23c6-412d-9adf-37079e99093f service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:44.261281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4481f-1b20-4345-9208-c22521a6611f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:44.263074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4481f-1b20-4345-9208-c22521a6611f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:44.263588 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4481f-1b20-4345-9208-c22521a6611f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:44.263877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4481f-1b20-4345-9208-c22521a6611f admin admin] PATH_INFO: `/v3/projects/f7cb11cd2bd34e619347fb2cb0fff071` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:44.265120 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac4481f-1b20-4345-9208-c22521a6611f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7cb11cd2bd34e619347fb2cb0fff071)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:44.267981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac4481f-1b20-4345-9208-c22521a6611f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:44.321725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3ac4481f-1b20-4345-9208-c22521a6611f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7cb11cd2bd34e619347fb2cb0fff071', 'request_id': 'req-3ac4481f-1b20-4345-9208-c22521a6611f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:44.327633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3ac4481f-1b20-4345-9208-c22521a6611f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7cb11cd2bd34e619347fb2cb0fff071', 'request_id': 'req-3ac4481f-1b20-4345-9208-c22521a6611f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:44.334810 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3ac4481f-1b20-4345-9208-c22521a6611f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7cb11cd2bd34e619347fb2cb0fff071', 'request_id': 'req-3ac4481f-1b20-4345-9208-c22521a6611f'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:44.349393 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3ac4481f-1b20-4345-9208-c22521a6611f admin admin] The token cache is being invalidate because project f7cb11cd2bd34e619347fb2cb0fff071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:39:44.349655 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3ac4481f-1b20-4345-9208-c22521a6611f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:44.350287 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-3ac4481f-1b20-4345-9208-c22521a6611f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:44.355011 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4291/8632] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:39:44 2022] DELETE /identity/v3/projects/f7cb11cd2bd34e619347fb2cb0fff071 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:39:44.359156 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc718b-ab09-42ab-b878-0528a2f128d7 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:44.360967 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-02bc718b-ab09-42ab-b878-0528a2f128d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:44.374318 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc718b-ab09-42ab-b878-0528a2f128d7 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:44.435110 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907eb42-96c3-49d9-ba77-688052d77377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:44.435935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907eb42-96c3-49d9-ba77-688052d77377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:44.436292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907eb42-96c3-49d9-ba77-688052d77377 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:44.436575 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907eb42-96c3-49d9-ba77-688052d77377 admin admin] PATH_INFO: `/v3/users/840a705d1df9477ab8c44601f1867845` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:44.438230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6907eb42-96c3-49d9-ba77-688052d77377 admin admin] RBAC: Authorizing `identity:delete_user(user_id=840a705d1df9477ab8c44601f1867845)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:44.440761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6907eb42-96c3-49d9-ba77-688052d77377 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:44.465862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:44.494299 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6907eb42-96c3-49d9-ba77-688052d77377 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '840a705d1df9477ab8c44601f1867845'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:44.501727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6907eb42-96c3-49d9-ba77-688052d77377 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '840a705d1df9477ab8c44601f1867845'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:44.502427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6907eb42-96c3-49d9-ba77-688052d77377 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '840a705d1df9477ab8c44601f1867845'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:44.503174 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6907eb42-96c3-49d9-ba77-688052d77377 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '840a705d1df9477ab8c44601f1867845'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:44.511518 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-6907eb42-96c3-49d9-ba77-688052d77377 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '840a705d1df9477ab8c44601f1867845'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:44.530608 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4342/8633] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:39:44 2022] DELETE /identity/v3/users/840a705d1df9477ab8c44601f1867845 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:39:44.780645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4481f-1b20-4345-9208-c22521a6611f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:44.782111 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3ac4481f-1b20-4345-9208-c22521a6611f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:44.810669 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4481f-1b20-4345-9208-c22521a6611f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:44.875926 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc192189-1a6e-4fe8-a759-f1ce12d71177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:44.877316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc192189-1a6e-4fe8-a759-f1ce12d71177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:44.877724 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc192189-1a6e-4fe8-a759-f1ce12d71177 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:44.878212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc192189-1a6e-4fe8-a759-f1ce12d71177 admin admin] PATH_INFO: `/v3/projects/248da865d2404c80a5112a86f9e3e598` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:44.879644 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc192189-1a6e-4fe8-a759-f1ce12d71177 admin admin] RBAC: Authorizing `identity:delete_project(project_id=248da865d2404c80a5112a86f9e3e598)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:44.881678 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc192189-1a6e-4fe8-a759-f1ce12d71177 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:44.919932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:44.935681 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dc192189-1a6e-4fe8-a759-f1ce12d71177 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '248da865d2404c80a5112a86f9e3e598', 'request_id': 'req-dc192189-1a6e-4fe8-a759-f1ce12d71177'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:44.942243 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dc192189-1a6e-4fe8-a759-f1ce12d71177 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '248da865d2404c80a5112a86f9e3e598', 'request_id': 'req-dc192189-1a6e-4fe8-a759-f1ce12d71177'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:44.949242 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dc192189-1a6e-4fe8-a759-f1ce12d71177 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '248da865d2404c80a5112a86f9e3e598', 'request_id': 'req-dc192189-1a6e-4fe8-a759-f1ce12d71177'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:44.962403 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dc192189-1a6e-4fe8-a759-f1ce12d71177 admin admin] The token cache is being invalidate because project 248da865d2404c80a5112a86f9e3e598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:39:44.962741 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dc192189-1a6e-4fe8-a759-f1ce12d71177 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:44.963386 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dc192189-1a6e-4fe8-a759-f1ce12d71177 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:44.964880 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4292/8634] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:39:44 2022] DELETE /identity/v3/projects/248da865d2404c80a5112a86f9e3e598 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:39:44.969945 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc67a76-0d1f-4911-a6e4-167d3b129cd8 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:44.971043 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc67a76-0d1f-4911-a6e4-167d3b129cd8 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:44.971258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc67a76-0d1f-4911-a6e4-167d3b129cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:44.993860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-8fc67a76-0d1f-4911-a6e4-167d3b129cd8 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:39:44.995126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8fc67a76-0d1f-4911-a6e4-167d3b129cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:45.062118 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4343/8635] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:39:45.070919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6dd1e-d1e1-4fc4-a252-011d3c0b132f None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:45.071754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6dd1e-d1e1-4fc4-a252-011d3c0b132f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:45.072268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6dd1e-d1e1-4fc4-a252-011d3c0b132f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:45.098809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-ebd6dd1e-d1e1-4fc4-a252-011d3c0b132f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:39:45.100184 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ebd6dd1e-d1e1-4fc4-a252-011d3c0b132f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:45.112812 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4293/8636] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:39:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:39:45.114036 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc67a76-0d1f-4911-a6e4-167d3b129cd8 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:45.125296 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc67a76-0d1f-4911-a6e4-167d3b129cd8 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:45.130413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926320e2-0a84-4f67-8b7d-1e39242bc38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:45.131080 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926320e2-0a84-4f67-8b7d-1e39242bc38f admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:45.131358 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926320e2-0a84-4f67-8b7d-1e39242bc38f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:45.131627 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926320e2-0a84-4f67-8b7d-1e39242bc38f admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:45.132268 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926320e2-0a84-4f67-8b7d-1e39242bc38f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:39:45.132567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926320e2-0a84-4f67-8b7d-1e39242bc38f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:45.134158 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926320e2-0a84-4f67-8b7d-1e39242bc38f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:45.150725 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4344/8637] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:39:45.152183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd6dd1e-d1e1-4fc4-a252-011d3c0b132f None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:45.162199 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd6dd1e-d1e1-4fc4-a252-011d3c0b132f None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:45.167695 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c23f32-43b7-4712-9d09-e999da0631ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:45.168307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c23f32-43b7-4712-9d09-e999da0631ab admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:45.168585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c23f32-43b7-4712-9d09-e999da0631ab admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:45.168855 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c23f32-43b7-4712-9d09-e999da0631ab admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:45.169517 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c23f32-43b7-4712-9d09-e999da0631ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:45.171611 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c23f32-43b7-4712-9d09-e999da0631ab admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:45.200493 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4294/8638] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:39:45 2022] POST /identity/v3/projects => generated 359 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:39:45.204666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926320e2-0a84-4f67-8b7d-1e39242bc38f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:45.216321 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926320e2-0a84-4f67-8b7d-1e39242bc38f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:45.279154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bfbd5e-f02d-45fd-8db0-39fe11e2309e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:45.279774 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfbd5e-f02d-45fd-8db0-39fe11e2309e admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:45.280042 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfbd5e-f02d-45fd-8db0-39fe11e2309e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:45.280313 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfbd5e-f02d-45fd-8db0-39fe11e2309e admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:45.280948 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bfbd5e-f02d-45fd-8db0-39fe11e2309e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:45.282888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bfbd5e-f02d-45fd-8db0-39fe11e2309e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:45.305197 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4345/8639] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:39:45 2022] POST /identity/v3/users => generated 280 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:39:45.309348 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c23f32-43b7-4712-9d09-e999da0631ab admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:45.320627 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c23f32-43b7-4712-9d09-e999da0631ab admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:45.325306 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95292dcb-ff6d-4950-9ebf-e27e07d2e3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:45.325899 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95292dcb-ff6d-4950-9ebf-e27e07d2e3a9 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:45.326175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95292dcb-ff6d-4950-9ebf-e27e07d2e3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:45.326444 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95292dcb-ff6d-4950-9ebf-e27e07d2e3a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:45.327118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95292dcb-ff6d-4950-9ebf-e27e07d2e3a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:45.328743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95292dcb-ff6d-4950-9ebf-e27e07d2e3a9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:45.338744 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4295/8640] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:39:45.342844 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bfbd5e-f02d-45fd-8db0-39fe11e2309e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:45.353278 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bfbd5e-f02d-45fd-8db0-39fe11e2309e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:45.358196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332036f0-d746-48f8-b824-d091a1468436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:45.358835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332036f0-d746-48f8-b824-d091a1468436 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:45.359118 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332036f0-d746-48f8-b824-d091a1468436 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:45.359397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332036f0-d746-48f8-b824-d091a1468436 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:45.360037 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332036f0-d746-48f8-b824-d091a1468436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:45.362276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332036f0-d746-48f8-b824-d091a1468436 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:45.373239 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4346/8641] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:39:45.378355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95292dcb-ff6d-4950-9ebf-e27e07d2e3a9 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:45.388593 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95292dcb-ff6d-4950-9ebf-e27e07d2e3a9 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:45.394434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eec2fe-9855-423b-b900-146287e75ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:45.395192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eec2fe-9855-423b-b900-146287e75ddd admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:45.395478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eec2fe-9855-423b-b900-146287e75ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:45.395752 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eec2fe-9855-423b-b900-146287e75ddd admin admin] PATH_INFO: `/v3/projects/fbf51ef539d840ecba3c734eab4ff802/users/a8a7d9bcfba249d3b6eb04a1a9af8a82/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:45.411577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eec2fe-9855-423b-b900-146287e75ddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf51ef539d840ecba3c734eab4ff802, user_id=a8a7d9bcfba249d3b6eb04a1a9af8a82, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:45.414292 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eec2fe-9855-423b-b900-146287e75ddd admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:45.428493 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4296/8642] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:39:45 2022] PUT /identity/v3/projects/fbf51ef539d840ecba3c734eab4ff802/users/a8a7d9bcfba249d3b6eb04a1a9af8a82/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:39:45.440479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1515b-9dd6-4578-b994-5b60948ff0ce None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:45.440781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1515b-9dd6-4578-b994-5b60948ff0ce None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:45.441035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1515b-9dd6-4578-b994-5b60948ff0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:45.449112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:45.471913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-17c1515b-9dd6-4578-b994-5b60948ff0ce None None] MFA Rules not processed for user `a8a7d9bcfba249d3b6eb04a1a9af8a82`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:39:45.473127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-17c1515b-9dd6-4578-b994-5b60948ff0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:45.545286 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4347/8643] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:39:45 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:39:45.553352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eec2fe-9855-423b-b900-146287e75ddd admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:45.555133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d7eec2fe-9855-423b-b900-146287e75ddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:45.616475 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eec2fe-9855-423b-b900-146287e75ddd admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:45.620171 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e4fa0-e0f2-4ed7-a2e3-32dfd5533133 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:45.620769 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e4fa0-e0f2-4ed7-a2e3-32dfd5533133 service cinder] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:45.621046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e4fa0-e0f2-4ed7-a2e3-32dfd5533133 service cinder] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:45.621314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e4fa0-e0f2-4ed7-a2e3-32dfd5533133 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:45.630301 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e4fa0-e0f2-4ed7-a2e3-32dfd5533133 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:45.631778 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e4fa0-e0f2-4ed7-a2e3-32dfd5533133 service cinder] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:45.640449 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4297/8644] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:39:45 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:39:49.905962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1c043-92ff-457d-84d9-be27e66edc91 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:49.906814 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1c043-92ff-457d-84d9-be27e66edc91 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:49.907231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1c043-92ff-457d-84d9-be27e66edc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:49.932602 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-36b1c043-92ff-457d-84d9-be27e66edc91 None None] MFA Rules not processed for user `7c192e32cff047039b46c50e69dfc9c1`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:39:49.933909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-36b1c043-92ff-457d-84d9-be27e66edc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:50.004174 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4348/8645] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:39:49 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:39:50.715642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e4fa0-e0f2-4ed7-a2e3-32dfd5533133 service cinder] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:50.812239 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:50.830192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e4fa0-e0f2-4ed7-a2e3-32dfd5533133 service cinder] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:50.838040 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448895f-9b67-4c8f-be06-714a735e193a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:50.840321 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448895f-9b67-4c8f-be06-714a735e193a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:50.840866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448895f-9b67-4c8f-be06-714a735e193a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:50.842001 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448895f-9b67-4c8f-be06-714a735e193a admin admin] PATH_INFO: `/v3/users/a8a7d9bcfba249d3b6eb04a1a9af8a82` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:50.843657 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448895f-9b67-4c8f-be06-714a735e193a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8a7d9bcfba249d3b6eb04a1a9af8a82)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:50.847980 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448895f-9b67-4c8f-be06-714a735e193a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:50.918840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0448895f-9b67-4c8f-be06-714a735e193a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8a7d9bcfba249d3b6eb04a1a9af8a82'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:50.919681 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0448895f-9b67-4c8f-be06-714a735e193a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8a7d9bcfba249d3b6eb04a1a9af8a82'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:50.920349 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0448895f-9b67-4c8f-be06-714a735e193a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8a7d9bcfba249d3b6eb04a1a9af8a82'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:50.932343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0448895f-9b67-4c8f-be06-714a735e193a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8a7d9bcfba249d3b6eb04a1a9af8a82'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:50.947794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-0448895f-9b67-4c8f-be06-714a735e193a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8a7d9bcfba249d3b6eb04a1a9af8a82'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:50.962938 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4298/8646] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:39:50 2022] DELETE /identity/v3/users/a8a7d9bcfba249d3b6eb04a1a9af8a82 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:39:50.967819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef7327-d09a-452d-903b-af4a3114f2d6 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:50.968175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef7327-d09a-452d-903b-af4a3114f2d6 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:50.968175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef7327-d09a-452d-903b-af4a3114f2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:50.991896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-e9ef7327-d09a-452d-903b-af4a3114f2d6 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:39:50.993123 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e9ef7327-d09a-452d-903b-af4a3114f2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:51.060900 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4349/8647] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:39:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:39:51.071982 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448895f-9b67-4c8f-be06-714a735e193a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:51.073572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0448895f-9b67-4c8f-be06-714a735e193a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:51.161603 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448895f-9b67-4c8f-be06-714a735e193a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:51.165986 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909d0fb-5390-415b-9094-343c170a470b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:51.166743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909d0fb-5390-415b-9094-343c170a470b service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:51.167089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909d0fb-5390-415b-9094-343c170a470b service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:51.167962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909d0fb-5390-415b-9094-343c170a470b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:51.178958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909d0fb-5390-415b-9094-343c170a470b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:51.180496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909d0fb-5390-415b-9094-343c170a470b service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:51.198842 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4299/8648] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:39:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:39:51.524414 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef7327-d09a-452d-903b-af4a3114f2d6 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:51.526226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e9ef7327-d09a-452d-903b-af4a3114f2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:51.543486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef7327-d09a-452d-903b-af4a3114f2d6 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:51.549524 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b103e-ee52-47b9-ae52-b3079e6248f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:51.550418 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b103e-ee52-47b9-ae52-b3079e6248f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:51.550729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b103e-ee52-47b9-ae52-b3079e6248f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:51.550998 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b103e-ee52-47b9-ae52-b3079e6248f8 admin admin] PATH_INFO: `/v3/projects/fbf51ef539d840ecba3c734eab4ff802` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:51.552143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b103e-ee52-47b9-ae52-b3079e6248f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbf51ef539d840ecba3c734eab4ff802)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:51.554050 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b103e-ee52-47b9-ae52-b3079e6248f8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:51.595339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:51.607207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bc2b103e-ee52-47b9-ae52-b3079e6248f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbf51ef539d840ecba3c734eab4ff802', 'request_id': 'req-bc2b103e-ee52-47b9-ae52-b3079e6248f8'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:51.613666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bc2b103e-ee52-47b9-ae52-b3079e6248f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbf51ef539d840ecba3c734eab4ff802', 'request_id': 'req-bc2b103e-ee52-47b9-ae52-b3079e6248f8'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:51.622004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bc2b103e-ee52-47b9-ae52-b3079e6248f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbf51ef539d840ecba3c734eab4ff802', 'request_id': 'req-bc2b103e-ee52-47b9-ae52-b3079e6248f8'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:51.635420 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bc2b103e-ee52-47b9-ae52-b3079e6248f8 admin admin] The token cache is being invalidate because project fbf51ef539d840ecba3c734eab4ff802 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:39:51.635713 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bc2b103e-ee52-47b9-ae52-b3079e6248f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:51.636387 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bc2b103e-ee52-47b9-ae52-b3079e6248f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:51.638107 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4350/8649] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:39:51 2022] DELETE /identity/v3/projects/fbf51ef539d840ecba3c734eab4ff802 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:39:51.643414 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08bc6b-da48-4a10-bc17-ce0397bc69e0 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:51.643713 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08bc6b-da48-4a10-bc17-ce0397bc69e0 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:51.643990 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08bc6b-da48-4a10-bc17-ce0397bc69e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:51.664579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-7e08bc6b-da48-4a10-bc17-ce0397bc69e0 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:39:51.665790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7e08bc6b-da48-4a10-bc17-ce0397bc69e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:51.732503 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4300/8650] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:39:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:39:51.741007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c63a70-fa76-4ece-b6f6-bcd068e0653b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:51.741293 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c63a70-fa76-4ece-b6f6-bcd068e0653b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:51.741600 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c63a70-fa76-4ece-b6f6-bcd068e0653b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:51.761888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a5c63a70-fa76-4ece-b6f6-bcd068e0653b None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:39:51.763127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a5c63a70-fa76-4ece-b6f6-bcd068e0653b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:51.775292 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4351/8651] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:39:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:39:51.777715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e08bc6b-da48-4a10-bc17-ce0397bc69e0 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:51.785222 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:51.791304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e08bc6b-da48-4a10-bc17-ce0397bc69e0 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:51.798351 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94357db-428d-4d44-99c4-b20e4b2bba21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:51.800541 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94357db-428d-4d44-99c4-b20e4b2bba21 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:51.800969 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94357db-428d-4d44-99c4-b20e4b2bba21 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:51.801487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94357db-428d-4d44-99c4-b20e4b2bba21 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:51.802422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94357db-428d-4d44-99c4-b20e4b2bba21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:39:51.802846 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94357db-428d-4d44-99c4-b20e4b2bba21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:51.805786 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94357db-428d-4d44-99c4-b20e4b2bba21 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:51.826940 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4301/8652] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:39:51.828272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c63a70-fa76-4ece-b6f6-bcd068e0653b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:51.840590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c63a70-fa76-4ece-b6f6-bcd068e0653b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:51.847157 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08221065-1d37-40f8-8ccb-9a3592ff4d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:51.848535 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08221065-1d37-40f8-8ccb-9a3592ff4d69 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:51.848819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08221065-1d37-40f8-8ccb-9a3592ff4d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:51.849090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08221065-1d37-40f8-8ccb-9a3592ff4d69 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:51.850082 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08221065-1d37-40f8-8ccb-9a3592ff4d69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:51.851689 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08221065-1d37-40f8-8ccb-9a3592ff4d69 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:51.886324 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4352/8653] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:39:51 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:39:51.899366 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94357db-428d-4d44-99c4-b20e4b2bba21 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:51.927787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94357db-428d-4d44-99c4-b20e4b2bba21 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:52.072228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b523cf1-6740-4f8d-91dd-396ca3676bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:52.072851 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b523cf1-6740-4f8d-91dd-396ca3676bea admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:52.073131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b523cf1-6740-4f8d-91dd-396ca3676bea admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:52.073405 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b523cf1-6740-4f8d-91dd-396ca3676bea admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:52.074464 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b523cf1-6740-4f8d-91dd-396ca3676bea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:52.076003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b523cf1-6740-4f8d-91dd-396ca3676bea admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:52.111783 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4302/8654] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:39:51 2022] POST /identity/v3/users => generated 287 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:39:52.115658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08221065-1d37-40f8-8ccb-9a3592ff4d69 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:52.129270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08221065-1d37-40f8-8ccb-9a3592ff4d69 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:52.135267 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa2878-0ac3-4dff-b143-53e4ee5e57fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:52.138472 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa2878-0ac3-4dff-b143-53e4ee5e57fe admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:52.138777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa2878-0ac3-4dff-b143-53e4ee5e57fe admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:52.139086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa2878-0ac3-4dff-b143-53e4ee5e57fe admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:52.139749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa2878-0ac3-4dff-b143-53e4ee5e57fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:52.141360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa2878-0ac3-4dff-b143-53e4ee5e57fe admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:52.157080 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4353/8655] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:39:52.161352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b523cf1-6740-4f8d-91dd-396ca3676bea admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:52.177780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b523cf1-6740-4f8d-91dd-396ca3676bea admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:52.184005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0a5d2-d62e-44e1-bc10-2c67bb4c2af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:52.184916 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0a5d2-d62e-44e1-bc10-2c67bb4c2af5 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:52.185377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0a5d2-d62e-44e1-bc10-2c67bb4c2af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:52.185825 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0a5d2-d62e-44e1-bc10-2c67bb4c2af5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:52.186762 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0a5d2-d62e-44e1-bc10-2c67bb4c2af5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:52.189769 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0a5d2-d62e-44e1-bc10-2c67bb4c2af5 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:52.207832 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4303/8656] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:39:52.212113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa2878-0ac3-4dff-b143-53e4ee5e57fe admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:52.224839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa2878-0ac3-4dff-b143-53e4ee5e57fe admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:52.229827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48501c-eae4-49b4-827a-ee28f00a20b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:52.230809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48501c-eae4-49b4-827a-ee28f00a20b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:52.233742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48501c-eae4-49b4-827a-ee28f00a20b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:52.234389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48501c-eae4-49b4-827a-ee28f00a20b4 admin admin] PATH_INFO: `/v3/projects/1d00aa055cb841d499679591097f839e/users/daf82e9f987140e7a9185ed0a24cd52c/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:52.256793 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea48501c-eae4-49b4-827a-ee28f00a20b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d00aa055cb841d499679591097f839e, user_id=daf82e9f987140e7a9185ed0a24cd52c, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:52.259460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea48501c-eae4-49b4-827a-ee28f00a20b4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:52.278613 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4354/8657] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:39:52 2022] PUT /identity/v3/projects/1d00aa055cb841d499679591097f839e/users/daf82e9f987140e7a9185ed0a24cd52c/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:39:52.291119 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238116b-c5f6-4d30-bd17-fa4a560676d6 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:52.291528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238116b-c5f6-4d30-bd17-fa4a560676d6 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:52.291905 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238116b-c5f6-4d30-bd17-fa4a560676d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:52.328007 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a238116b-c5f6-4d30-bd17-fa4a560676d6 None None] MFA Rules not processed for user `daf82e9f987140e7a9185ed0a24cd52c`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:39:52.330844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a238116b-c5f6-4d30-bd17-fa4a560676d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:52.421981 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4304/8658] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:39:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:39:52.434430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48501c-eae4-49b4-827a-ee28f00a20b4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:52.436272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ea48501c-eae4-49b4-827a-ee28f00a20b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:52.522589 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48501c-eae4-49b4-827a-ee28f00a20b4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:52.529490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13c1d4-e49d-471a-8403-a0fc3afbed3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf8ac27ec04117937e87749d69fe3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:52.530228 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13c1d4-e49d-471a-8403-a0fc3afbed3d service cinder] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:52.530772 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13c1d4-e49d-471a-8403-a0fc3afbed3d service cinder] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:52.531555 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13c1d4-e49d-471a-8403-a0fc3afbed3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:52.545085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13c1d4-e49d-471a-8403-a0fc3afbed3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:52.546872 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13c1d4-e49d-471a-8403-a0fc3afbed3d service cinder] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:52.560248 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4355/8659] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:39:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:39:52.589199 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238116b-c5f6-4d30-bd17-fa4a560676d6 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:52.671746 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238116b-c5f6-4d30-bd17-fa4a560676d6 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:52.683550 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca57e143-7be2-4feb-a9ed-ea5e72c8c064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:52.685261 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57e143-7be2-4feb-a9ed-ea5e72c8c064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:52.686654 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57e143-7be2-4feb-a9ed-ea5e72c8c064 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:52.687715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57e143-7be2-4feb-a9ed-ea5e72c8c064 admin admin] PATH_INFO: `/v3/users/daf82e9f987140e7a9185ed0a24cd52c` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:52.689818 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca57e143-7be2-4feb-a9ed-ea5e72c8c064 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daf82e9f987140e7a9185ed0a24cd52c)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:52.692620 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca57e143-7be2-4feb-a9ed-ea5e72c8c064 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:52.695367 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:52.755305 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ca57e143-7be2-4feb-a9ed-ea5e72c8c064 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daf82e9f987140e7a9185ed0a24cd52c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:52.756148 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ca57e143-7be2-4feb-a9ed-ea5e72c8c064 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daf82e9f987140e7a9185ed0a24cd52c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:52.756929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ca57e143-7be2-4feb-a9ed-ea5e72c8c064 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daf82e9f987140e7a9185ed0a24cd52c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:52.766269 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ca57e143-7be2-4feb-a9ed-ea5e72c8c064 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daf82e9f987140e7a9185ed0a24cd52c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:52.780827 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ca57e143-7be2-4feb-a9ed-ea5e72c8c064 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daf82e9f987140e7a9185ed0a24cd52c'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:52.795995 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4305/8660] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:39:52 2022] DELETE /identity/v3/users/daf82e9f987140e7a9185ed0a24cd52c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:39:52.801896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e5e86-c92f-4735-a443-e3e1336c2b18 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:52.802194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e5e86-c92f-4735-a443-e3e1336c2b18 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:52.802525 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e5e86-c92f-4735-a443-e3e1336c2b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:52.824404 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-819e5e86-c92f-4735-a443-e3e1336c2b18 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:39:52.825774 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-819e5e86-c92f-4735-a443-e3e1336c2b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:52.928202 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4356/8661] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:39:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:39:52.939014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca57e143-7be2-4feb-a9ed-ea5e72c8c064 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:52.941055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ca57e143-7be2-4feb-a9ed-ea5e72c8c064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:53.027373 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca57e143-7be2-4feb-a9ed-ea5e72c8c064 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:53.034468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3636c49-bf9d-48e9-a300-9ac39701e172 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:53.035234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3636c49-bf9d-48e9-a300-9ac39701e172 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:53.036377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3636c49-bf9d-48e9-a300-9ac39701e172 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:53.036801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3636c49-bf9d-48e9-a300-9ac39701e172 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:53.049927 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3636c49-bf9d-48e9-a300-9ac39701e172 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:53.051498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3636c49-bf9d-48e9-a300-9ac39701e172 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:53.068867 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4306/8662] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:39:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:39:53.655276 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e5e86-c92f-4735-a443-e3e1336c2b18 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:39:53.656808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-819e5e86-c92f-4735-a443-e3e1336c2b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:39:53.664814 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:53.676136 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e5e86-c92f-4735-a443-e3e1336c2b18 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:39:53.681932 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388f392-ed81-4620-81e0-0cef21af3c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:39:53.682743 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388f392-ed81-4620-81e0-0cef21af3c12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:39:53.682892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388f392-ed81-4620-81e0-0cef21af3c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:39:53.683339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388f392-ed81-4620-81e0-0cef21af3c12 admin admin] PATH_INFO: `/v3/projects/1d00aa055cb841d499679591097f839e` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:39:53.684662 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388f392-ed81-4620-81e0-0cef21af3c12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d00aa055cb841d499679591097f839e)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:39:53.686587 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388f392-ed81-4620-81e0-0cef21af3c12 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:39:53.744998 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0388f392-ed81-4620-81e0-0cef21af3c12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d00aa055cb841d499679591097f839e', 'request_id': 'req-0388f392-ed81-4620-81e0-0cef21af3c12'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:53.752342 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0388f392-ed81-4620-81e0-0cef21af3c12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d00aa055cb841d499679591097f839e', 'request_id': 'req-0388f392-ed81-4620-81e0-0cef21af3c12'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:53.760885 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0388f392-ed81-4620-81e0-0cef21af3c12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d00aa055cb841d499679591097f839e', 'request_id': 'req-0388f392-ed81-4620-81e0-0cef21af3c12'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:53.774309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0388f392-ed81-4620-81e0-0cef21af3c12 admin admin] The token cache is being invalidate because project 1d00aa055cb841d499679591097f839e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:39:53.774722 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0388f392-ed81-4620-81e0-0cef21af3c12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:53.775765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0388f392-ed81-4620-81e0-0cef21af3c12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:39:53.777523 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4357/8663] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:39:53 2022] DELETE /identity/v3/projects/1d00aa055cb841d499679591097f839e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:40:03.058414 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=52,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:40:03.780246 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=26,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:40:36.970706 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3636c49-bf9d-48e9-a300-9ac39701e172 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:40:36.972126 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e3636c49-bf9d-48e9-a300-9ac39701e172 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:40:37.053188 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3636c49-bf9d-48e9-a300-9ac39701e172 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:40:37.112050 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b55b57-da26-4d87-ab2c-294916988117 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:40:37.112654 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b55b57-da26-4d87-ab2c-294916988117 service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:40:37.112939 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b55b57-da26-4d87-ab2c-294916988117 service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:40:37.113214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b55b57-da26-4d87-ab2c-294916988117 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:40:37.114979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e5b55b57-da26-4d87-ab2c-294916988117 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:40:37.128630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b55b57-da26-4d87-ab2c-294916988117 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:40:37.130213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b55b57-da26-4d87-ab2c-294916988117 service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:40:37.143117 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4307/8664] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:40:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:40:37.291084 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388f392-ed81-4620-81e0-0cef21af3c12 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:40:37.292528 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0388f392-ed81-4620-81e0-0cef21af3c12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:40:37.355480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388f392-ed81-4620-81e0-0cef21af3c12 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:40:37.359470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e4265-ffc6-469d-bae8-2726100306c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:40:37.360084 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e4265-ffc6-469d-bae8-2726100306c3 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:40:37.360366 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e4265-ffc6-469d-bae8-2726100306c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:40:37.360639 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e4265-ffc6-469d-bae8-2726100306c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:40:37.362507 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-839e4265-ffc6-469d-bae8-2726100306c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:40:37.376296 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e4265-ffc6-469d-bae8-2726100306c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:40:37.377745 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e4265-ffc6-469d-bae8-2726100306c3 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:40:37.389408 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4358/8665] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:40:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:40:37.478339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3122ac-6a65-48b0-b553-686351889c98 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:40:37.478651 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3122ac-6a65-48b0-b553-686351889c98 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:40:37.478927 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3122ac-6a65-48b0-b553-686351889c98 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:40:37.480285 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4308/8666] 10.222.0.33 () {54 vars in 921 bytes} [Sat Aug 6 21:40:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 21:40:37.485309 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330b7df-f04f-42d9-94a1-42ef3ff81aff None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:40:37.485594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330b7df-f04f-42d9-94a1-42ef3ff81aff None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:40:37.485869 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330b7df-f04f-42d9-94a1-42ef3ff81aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:40:37.506037 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-2330b7df-f04f-42d9-94a1-42ef3ff81aff None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:40:37.507273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2330b7df-f04f-42d9-94a1-42ef3ff81aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:40:37.515942 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4359/8667] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 21:40:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:40:37.536492 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3122ac-6a65-48b0-b553-686351889c98 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:40:37.538253 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8f3122ac-6a65-48b0-b553-686351889c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:40:37.557910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3122ac-6a65-48b0-b553-686351889c98 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:40:37.563050 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee7b9e-71ca-4d54-aaca-a07af18947c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:40:37.563638 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee7b9e-71ca-4d54-aaca-a07af18947c0 service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:40:37.563914 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee7b9e-71ca-4d54-aaca-a07af18947c0 service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:40:37.564190 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee7b9e-71ca-4d54-aaca-a07af18947c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:40:37.573294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee7b9e-71ca-4d54-aaca-a07af18947c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:40:37.574911 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee7b9e-71ca-4d54-aaca-a07af18947c0 service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:40:37.584307 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4309/8668] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:40:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:40:37.755324 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330b7df-f04f-42d9-94a1-42ef3ff81aff None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:40:37.767410 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330b7df-f04f-42d9-94a1-42ef3ff81aff None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:40:37.771002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3114c06-d6c0-4359-91a3-52c7225b1d35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:40:37.771588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3114c06-d6c0-4359-91a3-52c7225b1d35 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:40:37.771862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3114c06-d6c0-4359-91a3-52c7225b1d35 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:40:37.772128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3114c06-d6c0-4359-91a3-52c7225b1d35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:40:37.774030 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e3114c06-d6c0-4359-91a3-52c7225b1d35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:40:37.847808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3114c06-d6c0-4359-91a3-52c7225b1d35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:40:37.849238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3114c06-d6c0-4359-91a3-52c7225b1d35 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:40:37.868651 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4360/8669] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:40:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:40:47.580359 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=68 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:40:47.860166 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=63 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:41:43.727728 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee7b9e-71ca-4d54-aaca-a07af18947c0 service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:41:43.741869 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee7b9e-71ca-4d54-aaca-a07af18947c0 service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:41:43.747597 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed8614-17c1-458a-9480-52e9ee01dd9c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:41:43.748237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed8614-17c1-458a-9480-52e9ee01dd9c service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:41:43.748519 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed8614-17c1-458a-9480-52e9ee01dd9c service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:41:43.748794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed8614-17c1-458a-9480-52e9ee01dd9c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:41:43.750886 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-15ed8614-17c1-458a-9480-52e9ee01dd9c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:41:43.770390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed8614-17c1-458a-9480-52e9ee01dd9c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:41:43.772083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed8614-17c1-458a-9480-52e9ee01dd9c service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:41:43.787506 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4310/8670] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:41:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:41:50.454499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a7c9b-78f5-4295-a2ad-cbcc9e0d0702 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:41:50.455016 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a7c9b-78f5-4295-a2ad-cbcc9e0d0702 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:41:50.455226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a7c9b-78f5-4295-a2ad-cbcc9e0d0702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:41:50.476994 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-389a7c9b-78f5-4295-a2ad-cbcc9e0d0702 None None] MFA Rules not processed for user `7c192e32cff047039b46c50e69dfc9c1`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:41:50.478383 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-389a7c9b-78f5-4295-a2ad-cbcc9e0d0702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:41:50.551775 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4361/8671] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:41:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:41:53.778824 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:42:00.544336 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=25 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:42:17.219042 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed8614-17c1-458a-9480-52e9ee01dd9c service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:42:17.262984 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed8614-17c1-458a-9480-52e9ee01dd9c service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:42:17.268625 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464be32c-62e5-41a5-aacd-f80dde90fe2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:42:17.269225 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464be32c-62e5-41a5-aacd-f80dde90fe2d service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:42:17.269507 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464be32c-62e5-41a5-aacd-f80dde90fe2d service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:42:17.269784 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464be32c-62e5-41a5-aacd-f80dde90fe2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:42:17.272247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-464be32c-62e5-41a5-aacd-f80dde90fe2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:42:17.318771 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464be32c-62e5-41a5-aacd-f80dde90fe2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:42:17.320612 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464be32c-62e5-41a5-aacd-f80dde90fe2d service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:42:17.333462 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4311/8672] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:42:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:42:17.964058 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a7c9b-78f5-4295-a2ad-cbcc9e0d0702 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:42:17.965480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-389a7c9b-78f5-4295-a2ad-cbcc9e0d0702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:42:18.010009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a7c9b-78f5-4295-a2ad-cbcc9e0d0702 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:42:18.015049 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f1df6-7f5b-4830-b582-0480ff72f4f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:42:18.015650 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f1df6-7f5b-4830-b582-0480ff72f4f7 service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:42:18.015926 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f1df6-7f5b-4830-b582-0480ff72f4f7 service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:42:18.016194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f1df6-7f5b-4830-b582-0480ff72f4f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:42:18.017924 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6a8f1df6-7f5b-4830-b582-0480ff72f4f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:42:18.032167 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f1df6-7f5b-4830-b582-0480ff72f4f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:42:18.033731 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f1df6-7f5b-4830-b582-0480ff72f4f7 service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:42:18.046031 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4362/8673] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:42:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:42:27.326536 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=33 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:42:28.039460 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=18 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:42:37.333427 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfed68-7f29-4c29-9f60-df84abc23690 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:42:37.333943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfed68-7f29-4c29-9f60-df84abc23690 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:42:37.333943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfed68-7f29-4c29-9f60-df84abc23690 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:42:37.335408 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4312/8674] 10.222.0.33 () {54 vars in 921 bytes} [Sat Aug 6 21:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 21:42:37.340426 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8caa734-fa33-441b-b81b-e1fcd721c915 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:42:37.340871 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8caa734-fa33-441b-b81b-e1fcd721c915 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:42:37.340970 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8caa734-fa33-441b-b81b-e1fcd721c915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:42:37.370093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-f8caa734-fa33-441b-b81b-e1fcd721c915 None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:42:37.371341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f8caa734-fa33-441b-b81b-e1fcd721c915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:42:37.380430 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4363/8675] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 21:42:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:42:37.401450 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cfed68-7f29-4c29-9f60-df84abc23690 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:42:37.418159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cfed68-7f29-4c29-9f60-df84abc23690 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:42:37.423140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389e0f8-d1a3-4229-af2c-1c2cd75c0ff8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:42:37.423725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389e0f8-d1a3-4229-af2c-1c2cd75c0ff8 service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:42:37.424000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389e0f8-d1a3-4229-af2c-1c2cd75c0ff8 service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:42:37.424269 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389e0f8-d1a3-4229-af2c-1c2cd75c0ff8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:42:37.432671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d389e0f8-d1a3-4229-af2c-1c2cd75c0ff8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:42:37.434505 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d389e0f8-d1a3-4229-af2c-1c2cd75c0ff8 service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:42:37.444978 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4313/8676] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:42:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:42:37.728150 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae87b41-be9e-4569-8036-83991592facc None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:42:37.728461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae87b41-be9e-4569-8036-83991592facc None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:42:37.728748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae87b41-be9e-4569-8036-83991592facc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:42:37.749238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-eae87b41-be9e-4569-8036-83991592facc None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:42:37.750472 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-eae87b41-be9e-4569-8036-83991592facc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:42:37.759940 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4364/8677] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 21:42:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:42:37.772704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389e0f8-d1a3-4229-af2c-1c2cd75c0ff8 service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:42:37.786246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389e0f8-d1a3-4229-af2c-1c2cd75c0ff8 service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:42:37.791406 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8072d33-4876-4367-8f28-b606d22598cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:42:37.791993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8072d33-4876-4367-8f28-b606d22598cb service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:42:37.792268 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8072d33-4876-4367-8f28-b606d22598cb service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:42:37.792536 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8072d33-4876-4367-8f28-b606d22598cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:42:37.800737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8072d33-4876-4367-8f28-b606d22598cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:42:37.802869 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8072d33-4876-4367-8f28-b606d22598cb service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:42:37.812330 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4314/8678] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:42:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:42:47.744358 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=10 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:42:47.808383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=12 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:42:48.559152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae87b41-be9e-4569-8036-83991592facc None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:42:48.560710 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-eae87b41-be9e-4569-8036-83991592facc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:42:48.581554 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae87b41-be9e-4569-8036-83991592facc None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:42:48.588808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82352ca3-2148-4f60-b5ef-7a4c3493ccf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:42:48.589691 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82352ca3-2148-4f60-b5ef-7a4c3493ccf1 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:42:48.590066 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82352ca3-2148-4f60-b5ef-7a4c3493ccf1 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:42:48.590577 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82352ca3-2148-4f60-b5ef-7a4c3493ccf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:42:48.593124 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-82352ca3-2148-4f60-b5ef-7a4c3493ccf1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:42:48.608213 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82352ca3-2148-4f60-b5ef-7a4c3493ccf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:42:48.609990 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82352ca3-2148-4f60-b5ef-7a4c3493ccf1 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:42:48.620293 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4365/8679] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:42:48 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:42:54.142883 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8072d33-4876-4367-8f28-b606d22598cb service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:42:54.164949 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8072d33-4876-4367-8f28-b606d22598cb service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:42:54.172308 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84b3d2-777c-4fcb-88fc-90435ef660e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:42:54.173381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84b3d2-777c-4fcb-88fc-90435ef660e8 service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:42:54.173818 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84b3d2-777c-4fcb-88fc-90435ef660e8 service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:42:54.174260 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84b3d2-777c-4fcb-88fc-90435ef660e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:42:54.177140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ed84b3d2-777c-4fcb-88fc-90435ef660e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:42:54.196106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84b3d2-777c-4fcb-88fc-90435ef660e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:42:54.198260 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84b3d2-777c-4fcb-88fc-90435ef660e8 service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:42:54.219698 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4315/8680] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:42:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:42:57.329138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e9e0e-0f2b-49a0-83e9-edc63d802911 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:42:57.329633 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e9e0e-0f2b-49a0-83e9-edc63d802911 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:42:57.329817 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e9e0e-0f2b-49a0-83e9-edc63d802911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:42:57.380419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-599e9e0e-0f2b-49a0-83e9-edc63d802911 None None] MFA Rules not processed for user `174e91100a184740b7c604730266dc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:42:57.381631 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-599e9e0e-0f2b-49a0-83e9-edc63d802911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:42:57.388179 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4366/8681] 10.222.0.33 () {58 vars in 1062 bytes} [Sat Aug 6 21:42:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:42:57.394093 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84b3d2-777c-4fcb-88fc-90435ef660e8 service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:42:57.403853 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84b3d2-777c-4fcb-88fc-90435ef660e8 service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:42:57.407419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7ba48-3366-4c14-b3ed-084ba78896e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:42:57.408031 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7ba48-3366-4c14-b3ed-084ba78896e9 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:42:57.408307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7ba48-3366-4c14-b3ed-084ba78896e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:42:57.408576 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7ba48-3366-4c14-b3ed-084ba78896e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:42:57.410293 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ffa7ba48-3366-4c14-b3ed-084ba78896e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:42:57.476936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7ba48-3366-4c14-b3ed-084ba78896e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:42:57.478786 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7ba48-3366-4c14-b3ed-084ba78896e9 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:42:57.488552 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4316/8682] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:42:57 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:43:00.451270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ca14f-f774-4f1a-97af-cb984961bbb8 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:43:00.452695 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ca14f-f774-4f1a-97af-cb984961bbb8 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:43:00.453236 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ca14f-f774-4f1a-97af-cb984961bbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:43:00.474225 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-293ca14f-f774-4f1a-97af-cb984961bbb8 None None] MFA Rules not processed for user `7c192e32cff047039b46c50e69dfc9c1`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:43:00.475548 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-293ca14f-f774-4f1a-97af-cb984961bbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:43:00.484207 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4367/8683] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:43:00 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:43:00.855791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7ba48-3366-4c14-b3ed-084ba78896e9 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:43:00.865121 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7ba48-3366-4c14-b3ed-084ba78896e9 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:43:00.869540 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd3d46-afe6-445f-ad2e-41bf7b1eadc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:43:00.870230 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd3d46-afe6-445f-ad2e-41bf7b1eadc5 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:43:00.870605 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd3d46-afe6-445f-ad2e-41bf7b1eadc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:43:00.870917 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd3d46-afe6-445f-ad2e-41bf7b1eadc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:43:00.872742 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0bdd3d46-afe6-445f-ad2e-41bf7b1eadc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:43:00.886326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd3d46-afe6-445f-ad2e-41bf7b1eadc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:43:00.887817 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd3d46-afe6-445f-ad2e-41bf7b1eadc5 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:43:00.899831 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4317/8684] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:43:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:43:01.232167 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51aaad-d415-41e1-9c0f-0a4cd8e18bbe None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:43:01.232459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51aaad-d415-41e1-9c0f-0a4cd8e18bbe None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:43:01.232740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51aaad-d415-41e1-9c0f-0a4cd8e18bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:43:01.257173 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-6d51aaad-d415-41e1-9c0f-0a4cd8e18bbe None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:43:01.259120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6d51aaad-d415-41e1-9c0f-0a4cd8e18bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:43:01.268186 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4368/8685] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 21:43:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:43:01.293827 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd3d46-afe6-445f-ad2e-41bf7b1eadc5 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:43:01.304729 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd3d46-afe6-445f-ad2e-41bf7b1eadc5 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:43:01.309845 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60bb9a-f5bf-4b8d-86c2-20fe2646292b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:43:01.310451 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60bb9a-f5bf-4b8d-86c2-20fe2646292b service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:43:01.310770 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60bb9a-f5bf-4b8d-86c2-20fe2646292b service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:43:01.311165 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60bb9a-f5bf-4b8d-86c2-20fe2646292b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:43:01.321552 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60bb9a-f5bf-4b8d-86c2-20fe2646292b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:43:01.323205 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60bb9a-f5bf-4b8d-86c2-20fe2646292b service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:43:01.333449 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4318/8686] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:43:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:43:03.201382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf1851-d38b-45a8-bfed-c88129b3b805 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:43:03.201885 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf1851-d38b-45a8-bfed-c88129b3b805 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:43:03.201962 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf1851-d38b-45a8-bfed-c88129b3b805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:43:03.223408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-ffdf1851-d38b-45a8-bfed-c88129b3b805 None None] MFA Rules not processed for user `174e91100a184740b7c604730266dc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:43:03.224763 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ffdf1851-d38b-45a8-bfed-c88129b3b805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:43:03.232343 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4369/8687] 10.222.0.33 () {58 vars in 1062 bytes} [Sat Aug 6 21:43:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:43:03.238725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60bb9a-f5bf-4b8d-86c2-20fe2646292b service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:43:03.250370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60bb9a-f5bf-4b8d-86c2-20fe2646292b service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:43:03.254255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d69e50-5643-4155-8c5a-504cc0aa24e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:43:03.254897 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d69e50-5643-4155-8c5a-504cc0aa24e9 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:43:03.255406 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d69e50-5643-4155-8c5a-504cc0aa24e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:43:03.255498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d69e50-5643-4155-8c5a-504cc0aa24e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:43:03.257252 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-13d69e50-5643-4155-8c5a-504cc0aa24e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:43:03.275927 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d69e50-5643-4155-8c5a-504cc0aa24e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:43:03.277432 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d69e50-5643-4155-8c5a-504cc0aa24e9 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:43:03.291314 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4319/8688] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:43:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:43:10.089005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf1851-d38b-45a8-bfed-c88129b3b805 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:43:10.090456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ffdf1851-d38b-45a8-bfed-c88129b3b805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:43:10.109454 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf1851-d38b-45a8-bfed-c88129b3b805 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:43:10.115120 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16393c70-998a-486c-91a7-d0c9ab327c13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:43:10.115839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16393c70-998a-486c-91a7-d0c9ab327c13 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:43:10.116125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16393c70-998a-486c-91a7-d0c9ab327c13 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:43:10.116392 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16393c70-998a-486c-91a7-d0c9ab327c13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:43:10.118961 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-16393c70-998a-486c-91a7-d0c9ab327c13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:43:10.134422 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16393c70-998a-486c-91a7-d0c9ab327c13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:43:10.136138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16393c70-998a-486c-91a7-d0c9ab327c13 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:43:10.149819 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4370/8689] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:43:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:43:13.285092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=54 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:43:20.142320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=35 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:43:54.132985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d69e50-5643-4155-8c5a-504cc0aa24e9 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:43:54.141424 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d69e50-5643-4155-8c5a-504cc0aa24e9 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:43:54.145125 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed42ab-6962-468d-8f1a-d0487a175128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:43:54.145723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed42ab-6962-468d-8f1a-d0487a175128 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:43:54.146002 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed42ab-6962-468d-8f1a-d0487a175128 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:43:54.146273 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed42ab-6962-468d-8f1a-d0487a175128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:43:54.148128 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1bed42ab-6962-468d-8f1a-d0487a175128 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:43:54.184486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed42ab-6962-468d-8f1a-d0487a175128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:43:54.185903 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed42ab-6962-468d-8f1a-d0487a175128 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:43:54.199533 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4320/8690] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:43:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:43:57.729640 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16393c70-998a-486c-91a7-d0c9ab327c13 service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:43:57.738725 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16393c70-998a-486c-91a7-d0c9ab327c13 service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:43:57.742232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b218fc-3135-43b9-aef5-e496bf7ffdaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:43:57.742859 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b218fc-3135-43b9-aef5-e496bf7ffdaa service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:43:57.743137 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b218fc-3135-43b9-aef5-e496bf7ffdaa service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:43:57.743409 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b218fc-3135-43b9-aef5-e496bf7ffdaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:43:57.745778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c3b218fc-3135-43b9-aef5-e496bf7ffdaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:43:57.762214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b218fc-3135-43b9-aef5-e496bf7ffdaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:43:57.763653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b218fc-3135-43b9-aef5-e496bf7ffdaa service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:43:57.777451 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4371/8691] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:43:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:44:04.191801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=14 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:44:07.769578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=6 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:44:42.226960 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed42ab-6962-468d-8f1a-d0487a175128 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:44:42.248046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed42ab-6962-468d-8f1a-d0487a175128 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:44:42.253782 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b122b6-abac-4336-9b28-45adf1c19e80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:44:42.254428 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b122b6-abac-4336-9b28-45adf1c19e80 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:44:42.254794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b122b6-abac-4336-9b28-45adf1c19e80 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:44:42.255015 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b122b6-abac-4336-9b28-45adf1c19e80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:44:42.256988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-05b122b6-abac-4336-9b28-45adf1c19e80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:44:42.277489 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b122b6-abac-4336-9b28-45adf1c19e80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:44:42.279690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b122b6-abac-4336-9b28-45adf1c19e80 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:44:42.298240 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4321/8692] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:44:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:44:44.197961 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b218fc-3135-43b9-aef5-e496bf7ffdaa service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:44:44.213003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b218fc-3135-43b9-aef5-e496bf7ffdaa service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:44:44.219340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc119eec-fdc1-41fc-a8ed-335bb71e9c41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:44:44.219954 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc119eec-fdc1-41fc-a8ed-335bb71e9c41 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:44:44.220231 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc119eec-fdc1-41fc-a8ed-335bb71e9c41 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:44:44.220697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc119eec-fdc1-41fc-a8ed-335bb71e9c41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:44:44.222495 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-dc119eec-fdc1-41fc-a8ed-335bb71e9c41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:44:44.237759 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc119eec-fdc1-41fc-a8ed-335bb71e9c41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:44:44.239449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc119eec-fdc1-41fc-a8ed-335bb71e9c41 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:44:44.253175 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4372/8693] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:44:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:44:48.184681 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b122b6-abac-4336-9b28-45adf1c19e80 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:44:48.186014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-05b122b6-abac-4336-9b28-45adf1c19e80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:44:48.296216 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b122b6-abac-4336-9b28-45adf1c19e80 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:44:48.302264 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2013279-a149-433a-a2a0-b43a7e88128c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:44:48.303135 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2013279-a149-433a-a2a0-b43a7e88128c admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:44:48.303497 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2013279-a149-433a-a2a0-b43a7e88128c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:44:48.303846 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2013279-a149-433a-a2a0-b43a7e88128c admin admin] PATH_INFO: `/v3/users/7c192e32cff047039b46c50e69dfc9c1` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:44:48.305320 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2013279-a149-433a-a2a0-b43a7e88128c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c192e32cff047039b46c50e69dfc9c1)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:44:48.307514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2013279-a149-433a-a2a0-b43a7e88128c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:44:48.377314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e2013279-a149-433a-a2a0-b43a7e88128c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c192e32cff047039b46c50e69dfc9c1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:44:48.377979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e2013279-a149-433a-a2a0-b43a7e88128c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c192e32cff047039b46c50e69dfc9c1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:44:48.378634 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e2013279-a149-433a-a2a0-b43a7e88128c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c192e32cff047039b46c50e69dfc9c1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:44:48.386025 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e2013279-a149-433a-a2a0-b43a7e88128c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c192e32cff047039b46c50e69dfc9c1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:44:48.399290 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e2013279-a149-433a-a2a0-b43a7e88128c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c192e32cff047039b46c50e69dfc9c1'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:44:48.412321 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4322/8694] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:44:48 2022] DELETE /identity/v3/users/7c192e32cff047039b46c50e69dfc9c1 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:44:48.416837 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01016b0-b016-4bf9-b2c8-001cafd3ed9d None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:44:48.417265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01016b0-b016-4bf9-b2c8-001cafd3ed9d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:44:48.417397 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01016b0-b016-4bf9-b2c8-001cafd3ed9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:44:48.445407 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d01016b0-b016-4bf9-b2c8-001cafd3ed9d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:44:48.446614 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d01016b0-b016-4bf9-b2c8-001cafd3ed9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:44:48.507384 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4373/8695] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:44:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:44:48.517196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2013279-a149-433a-a2a0-b43a7e88128c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:44:48.518613 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e2013279-a149-433a-a2a0-b43a7e88128c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:44:48.570276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:44:48.576910 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2013279-a149-433a-a2a0-b43a7e88128c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:44:48.581253 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7977c-a8f6-4829-9d7e-8a37848502d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:44:48.581855 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7977c-a8f6-4829-9d7e-8a37848502d6 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:44:48.582133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7977c-a8f6-4829-9d7e-8a37848502d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:44:48.582438 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7977c-a8f6-4829-9d7e-8a37848502d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:44:48.591529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7977c-a8f6-4829-9d7e-8a37848502d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:44:48.592964 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7977c-a8f6-4829-9d7e-8a37848502d6 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:44:48.602330 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4323/8696] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:44:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:44:48.778207 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01016b0-b016-4bf9-b2c8-001cafd3ed9d None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:44:48.779665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d01016b0-b016-4bf9-b2c8-001cafd3ed9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:44:48.794811 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01016b0-b016-4bf9-b2c8-001cafd3ed9d None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:44:48.799471 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0268f48-9a3c-4bc5-b59b-0394e5438e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:44:48.801112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0268f48-9a3c-4bc5-b59b-0394e5438e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:44:48.801402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0268f48-9a3c-4bc5-b59b-0394e5438e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:44:48.801695 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0268f48-9a3c-4bc5-b59b-0394e5438e05 admin admin] PATH_INFO: `/v3/projects/084ca5bfad90430bb2da5f3a13fd76d8` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:44:48.802898 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0268f48-9a3c-4bc5-b59b-0394e5438e05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=084ca5bfad90430bb2da5f3a13fd76d8)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:44:48.804709 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0268f48-9a3c-4bc5-b59b-0394e5438e05 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:44:49.002342 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a0268f48-9a3c-4bc5-b59b-0394e5438e05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '084ca5bfad90430bb2da5f3a13fd76d8', 'request_id': 'req-a0268f48-9a3c-4bc5-b59b-0394e5438e05'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:44:49.007826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a0268f48-9a3c-4bc5-b59b-0394e5438e05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '084ca5bfad90430bb2da5f3a13fd76d8', 'request_id': 'req-a0268f48-9a3c-4bc5-b59b-0394e5438e05'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:44:49.015201 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a0268f48-9a3c-4bc5-b59b-0394e5438e05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '084ca5bfad90430bb2da5f3a13fd76d8', 'request_id': 'req-a0268f48-9a3c-4bc5-b59b-0394e5438e05'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:44:49.027486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a0268f48-9a3c-4bc5-b59b-0394e5438e05 admin admin] The token cache is being invalidate because project 084ca5bfad90430bb2da5f3a13fd76d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:44:49.027779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a0268f48-9a3c-4bc5-b59b-0394e5438e05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:44:49.028445 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-a0268f48-9a3c-4bc5-b59b-0394e5438e05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:44:49.029932 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4374/8697] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:44:48 2022] DELETE /identity/v3/projects/084ca5bfad90430bb2da5f3a13fd76d8 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:44:49.033927 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7977c-a8f6-4829-9d7e-8a37848502d6 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:44:49.044491 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7977c-a8f6-4829-9d7e-8a37848502d6 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:44:49.099748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1e6c5-4808-4d55-af38-6488534bec71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:44:49.100387 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1e6c5-4808-4d55-af38-6488534bec71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:44:49.100664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1e6c5-4808-4d55-af38-6488534bec71 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:44:49.100991 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1e6c5-4808-4d55-af38-6488534bec71 admin admin] PATH_INFO: `/v3/users/2daf7e8662ec45b2a5b8d92876546ff4` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:44:49.102123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1e6c5-4808-4d55-af38-6488534bec71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2daf7e8662ec45b2a5b8d92876546ff4)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:44:49.104072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1e6c5-4808-4d55-af38-6488534bec71 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:44:49.148621 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-75a1e6c5-4808-4d55-af38-6488534bec71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2daf7e8662ec45b2a5b8d92876546ff4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:44:49.149265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-75a1e6c5-4808-4d55-af38-6488534bec71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2daf7e8662ec45b2a5b8d92876546ff4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:44:49.149875 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-75a1e6c5-4808-4d55-af38-6488534bec71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2daf7e8662ec45b2a5b8d92876546ff4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:44:49.157635 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-75a1e6c5-4808-4d55-af38-6488534bec71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2daf7e8662ec45b2a5b8d92876546ff4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:44:49.171144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-75a1e6c5-4808-4d55-af38-6488534bec71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2daf7e8662ec45b2a5b8d92876546ff4'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:44:49.183046 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4324/8698] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:44:49 2022] DELETE /identity/v3/users/2daf7e8662ec45b2a5b8d92876546ff4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:44:49.357854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0268f48-9a3c-4bc5-b59b-0394e5438e05 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:44:49.359465 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a0268f48-9a3c-4bc5-b59b-0394e5438e05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:44:49.374065 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0268f48-9a3c-4bc5-b59b-0394e5438e05 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:44:49.432683 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268ee3f-9c3e-4e4c-a416-79d32f7f10b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:44:49.433853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268ee3f-9c3e-4e4c-a416-79d32f7f10b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:44:49.434140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268ee3f-9c3e-4e4c-a416-79d32f7f10b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:44:49.434416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268ee3f-9c3e-4e4c-a416-79d32f7f10b3 admin admin] PATH_INFO: `/v3/projects/5ee81fb612e64d278277698b4f721414` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:44:49.435562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268ee3f-9c3e-4e4c-a416-79d32f7f10b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ee81fb612e64d278277698b4f721414)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:44:49.437452 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268ee3f-9c3e-4e4c-a416-79d32f7f10b3 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:44:49.443496 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:44:49.484646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1268ee3f-9c3e-4e4c-a416-79d32f7f10b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ee81fb612e64d278277698b4f721414', 'request_id': 'req-1268ee3f-9c3e-4e4c-a416-79d32f7f10b3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:44:49.490191 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1268ee3f-9c3e-4e4c-a416-79d32f7f10b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ee81fb612e64d278277698b4f721414', 'request_id': 'req-1268ee3f-9c3e-4e4c-a416-79d32f7f10b3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:44:49.497408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1268ee3f-9c3e-4e4c-a416-79d32f7f10b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ee81fb612e64d278277698b4f721414', 'request_id': 'req-1268ee3f-9c3e-4e4c-a416-79d32f7f10b3'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:44:49.509111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1268ee3f-9c3e-4e4c-a416-79d32f7f10b3 admin admin] The token cache is being invalidate because project 5ee81fb612e64d278277698b4f721414 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:44:49.509399 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1268ee3f-9c3e-4e4c-a416-79d32f7f10b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:44:49.510029 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-1268ee3f-9c3e-4e4c-a416-79d32f7f10b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:44:49.512074 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4375/8699] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:44:49 2022] DELETE /identity/v3/projects/5ee81fb612e64d278277698b4f721414 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:44:59.179644 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=58,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:44:59.271976 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076489ff-2b19-4c31-bb28-b557fb7a6d70 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:44:59.272235 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076489ff-2b19-4c31-bb28-b557fb7a6d70 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:44:59.272517 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076489ff-2b19-4c31-bb28-b557fb7a6d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:44:59.315842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-076489ff-2b19-4c31-bb28-b557fb7a6d70 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:44:59.317046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-076489ff-2b19-4c31-bb28-b557fb7a6d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:44:59.378342 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4325/8700] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:44:59.387991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad8e48-1e8e-447d-a9d4-7b83e2aea7a4 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:44:59.388490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad8e48-1e8e-447d-a9d4-7b83e2aea7a4 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:44:59.388613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad8e48-1e8e-447d-a9d4-7b83e2aea7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:44:59.408026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-bbad8e48-1e8e-447d-a9d4-7b83e2aea7a4 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:44:59.409230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-bbad8e48-1e8e-447d-a9d4-7b83e2aea7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:44:59.417009 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4376/8701] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:44:59.422424 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076489ff-2b19-4c31-bb28-b557fb7a6d70 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:44:59.432270 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076489ff-2b19-4c31-bb28-b557fb7a6d70 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:44:59.437053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f105de2-e0e5-4557-a0d5-96b16d53c283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:44:59.437644 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f105de2-e0e5-4557-a0d5-96b16d53c283 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:44:59.437924 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f105de2-e0e5-4557-a0d5-96b16d53c283 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:44:59.438198 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f105de2-e0e5-4557-a0d5-96b16d53c283 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:44:59.438876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f105de2-e0e5-4557-a0d5-96b16d53c283 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:44:59.439185 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f105de2-e0e5-4557-a0d5-96b16d53c283 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:44:59.440779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f105de2-e0e5-4557-a0d5-96b16d53c283 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:44:59.452850 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4326/8702] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:44:59.470702 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad8e48-1e8e-447d-a9d4-7b83e2aea7a4 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:44:59.480047 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad8e48-1e8e-447d-a9d4-7b83e2aea7a4 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:44:59.485226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c2ba6-3b4e-4cdd-ad01-57c87cb90293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:44:59.485818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c2ba6-3b4e-4cdd-ad01-57c87cb90293 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:44:59.486092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c2ba6-3b4e-4cdd-ad01-57c87cb90293 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:44:59.486360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c2ba6-3b4e-4cdd-ad01-57c87cb90293 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:44:59.487012 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c2ba6-3b4e-4cdd-ad01-57c87cb90293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:44:59.488885 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c2ba6-3b4e-4cdd-ad01-57c87cb90293 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:44:59.515265 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4377/8703] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:44:59 2022] POST /identity/v3/projects => generated 393 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:44:59.519690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f105de2-e0e5-4557-a0d5-96b16d53c283 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:44:59.530353 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f105de2-e0e5-4557-a0d5-96b16d53c283 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:44:59.585791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7e363-3974-43f4-938d-a10b493c7341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:44:59.586401 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7e363-3974-43f4-938d-a10b493c7341 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:44:59.586724 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7e363-3974-43f4-938d-a10b493c7341 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:44:59.587000 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7e363-3974-43f4-938d-a10b493c7341 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:44:59.587622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e7e363-3974-43f4-938d-a10b493c7341 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:44:59.590055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e7e363-3974-43f4-938d-a10b493c7341 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:44:59.609684 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4327/8704] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:44:59 2022] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:44:59.613650 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c2ba6-3b4e-4cdd-ad01-57c87cb90293 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:44:59.624790 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c2ba6-3b4e-4cdd-ad01-57c87cb90293 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:44:59.629591 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf655c-c405-4cfd-bfe7-9ac4e2b565d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:44:59.630179 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf655c-c405-4cfd-bfe7-9ac4e2b565d4 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:44:59.630454 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf655c-c405-4cfd-bfe7-9ac4e2b565d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:44:59.630752 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf655c-c405-4cfd-bfe7-9ac4e2b565d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:44:59.631406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf655c-c405-4cfd-bfe7-9ac4e2b565d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:44:59.633019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf655c-c405-4cfd-bfe7-9ac4e2b565d4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:44:59.643070 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4378/8705] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:44:59.646915 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7e363-3974-43f4-938d-a10b493c7341 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:44:59.657497 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7e363-3974-43f4-938d-a10b493c7341 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:44:59.662111 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72be5d-6c99-43e9-9f2c-afc720328866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:44:59.662739 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72be5d-6c99-43e9-9f2c-afc720328866 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:44:59.663023 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72be5d-6c99-43e9-9f2c-afc720328866 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:44:59.663298 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72be5d-6c99-43e9-9f2c-afc720328866 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:44:59.664365 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed72be5d-6c99-43e9-9f2c-afc720328866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:44:59.665967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed72be5d-6c99-43e9-9f2c-afc720328866 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:44:59.677082 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4328/8706] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:44:59.681760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf655c-c405-4cfd-bfe7-9ac4e2b565d4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:44:59.692219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf655c-c405-4cfd-bfe7-9ac4e2b565d4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:44:59.696819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c860dc-43f7-4910-84e1-35746d70b8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:44:59.697463 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c860dc-43f7-4910-84e1-35746d70b8fb admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:44:59.697743 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c860dc-43f7-4910-84e1-35746d70b8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:44:59.698115 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c860dc-43f7-4910-84e1-35746d70b8fb admin admin] PATH_INFO: `/v3/projects/bd60ac6ebd8c4ae48c9fcf9aa86a7d45/users/d8f2e0934e5f416abee4bc74e57941e8/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:44:59.713134 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c860dc-43f7-4910-84e1-35746d70b8fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd60ac6ebd8c4ae48c9fcf9aa86a7d45, user_id=d8f2e0934e5f416abee4bc74e57941e8, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:44:59.716398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c860dc-43f7-4910-84e1-35746d70b8fb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:44:59.728951 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4379/8707] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:44:59 2022] PUT /identity/v3/projects/bd60ac6ebd8c4ae48c9fcf9aa86a7d45/users/d8f2e0934e5f416abee4bc74e57941e8/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:44:59.742251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3de13c-aeda-4e5e-a719-b71d25628fef None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:44:59.742538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3de13c-aeda-4e5e-a719-b71d25628fef None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:44:59.742831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3de13c-aeda-4e5e-a719-b71d25628fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:44:59.770961 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-cf3de13c-aeda-4e5e-a719-b71d25628fef None None] MFA Rules not processed for user `d8f2e0934e5f416abee4bc74e57941e8`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:44:59.772198 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-cf3de13c-aeda-4e5e-a719-b71d25628fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:44:59.812515 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:44:59.838082 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4329/8708] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:44:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:44:59.843522 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c860dc-43f7-4910-84e1-35746d70b8fb admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:44:59.913514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c860dc-43f7-4910-84e1-35746d70b8fb admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:44:59.918304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9517e-aed4-4744-828a-f531e3a10ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:44:59.918938 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9517e-aed4-4744-828a-f531e3a10ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:44:59.919217 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9517e-aed4-4744-828a-f531e3a10ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:44:59.919494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9517e-aed4-4744-828a-f531e3a10ae0 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:44:59.920127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a9517e-aed4-4744-828a-f531e3a10ae0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:44:59.922026 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a9517e-aed4-4744-828a-f531e3a10ae0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:44:59.950616 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4380/8709] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:44:59 2022] POST /identity/v3/projects => generated 391 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:44:59.954607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3de13c-aeda-4e5e-a719-b71d25628fef None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:44:59.966068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3de13c-aeda-4e5e-a719-b71d25628fef None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:45:00.023160 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9457fd-87d9-4b22-bb30-db1e4ae20dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:45:00.023774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9457fd-87d9-4b22-bb30-db1e4ae20dab admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:45:00.024056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9457fd-87d9-4b22-bb30-db1e4ae20dab admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:45:00.024331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9457fd-87d9-4b22-bb30-db1e4ae20dab admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:45:00.024951 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9457fd-87d9-4b22-bb30-db1e4ae20dab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:45:00.027563 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9457fd-87d9-4b22-bb30-db1e4ae20dab admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:45:00.048564 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4330/8710] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:44:59 2022] POST /identity/v3/users => generated 302 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:45:00.052822 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9517e-aed4-4744-828a-f531e3a10ae0 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:45:00.063784 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9517e-aed4-4744-828a-f531e3a10ae0 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:45:00.068331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231c7ed-2f64-4196-9571-eaa6dfb84956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:45:00.068915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231c7ed-2f64-4196-9571-eaa6dfb84956 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:45:00.069189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231c7ed-2f64-4196-9571-eaa6dfb84956 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:45:00.069456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231c7ed-2f64-4196-9571-eaa6dfb84956 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:45:00.070082 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231c7ed-2f64-4196-9571-eaa6dfb84956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:45:00.071707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231c7ed-2f64-4196-9571-eaa6dfb84956 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:45:00.081931 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4381/8711] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:45:00.086113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9457fd-87d9-4b22-bb30-db1e4ae20dab admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:45:00.096622 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9457fd-87d9-4b22-bb30-db1e4ae20dab admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:45:00.101265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6075c-d34c-453a-8d88-be93e0692d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:45:00.101908 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6075c-d34c-453a-8d88-be93e0692d1e admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:45:00.102185 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6075c-d34c-453a-8d88-be93e0692d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:45:00.102457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6075c-d34c-453a-8d88-be93e0692d1e admin admin] PATH_INFO: `/v3/projects/4715401611d0493fa27da4233f2d2fc1/users/dd0b6bf5588944f38ff123a8d2bc3e49/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:45:00.117478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6075c-d34c-453a-8d88-be93e0692d1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4715401611d0493fa27da4233f2d2fc1, user_id=dd0b6bf5588944f38ff123a8d2bc3e49, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:45:00.120251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6075c-d34c-453a-8d88-be93e0692d1e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:45:00.133542 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4331/8712] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:45:00 2022] PUT /identity/v3/projects/4715401611d0493fa27da4233f2d2fc1/users/dd0b6bf5588944f38ff123a8d2bc3e49/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:45:00.138290 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231c7ed-2f64-4196-9571-eaa6dfb84956 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:45:00.144789 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:45:00.149015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231c7ed-2f64-4196-9571-eaa6dfb84956 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:45:00.209203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1306a-1400-4bda-9b85-e729f7f45158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:45:00.209740 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1306a-1400-4bda-9b85-e729f7f45158 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:45:00.210022 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1306a-1400-4bda-9b85-e729f7f45158 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:45:00.210292 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1306a-1400-4bda-9b85-e729f7f45158 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:45:00.210968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1306a-1400-4bda-9b85-e729f7f45158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:45:00.212550 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1306a-1400-4bda-9b85-e729f7f45158 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:45:00.222493 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4382/8713] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:45:00.227029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6075c-d34c-453a-8d88-be93e0692d1e admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:45:00.237839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6075c-d34c-453a-8d88-be93e0692d1e admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:45:00.242478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c66cda-48bb-450a-b51f-5d3875902804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:45:00.243141 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c66cda-48bb-450a-b51f-5d3875902804 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:45:00.243422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c66cda-48bb-450a-b51f-5d3875902804 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:45:00.243692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c66cda-48bb-450a-b51f-5d3875902804 admin admin] PATH_INFO: `/v3/projects/4715401611d0493fa27da4233f2d2fc1/users/dd0b6bf5588944f38ff123a8d2bc3e49/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:45:00.246393 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c66cda-48bb-450a-b51f-5d3875902804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4715401611d0493fa27da4233f2d2fc1, user_id=dd0b6bf5588944f38ff123a8d2bc3e49, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:45:00.249321 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c66cda-48bb-450a-b51f-5d3875902804 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:45:00.259315 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4332/8714] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:45:00 2022] PUT /identity/v3/projects/4715401611d0493fa27da4233f2d2fc1/users/dd0b6bf5588944f38ff123a8d2bc3e49/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:45:00.270270 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853756c6-0da9-4cc8-9b42-52a514a56a01 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:45:00.270576 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853756c6-0da9-4cc8-9b42-52a514a56a01 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:45:00.270892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853756c6-0da9-4cc8-9b42-52a514a56a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:45:00.299282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-853756c6-0da9-4cc8-9b42-52a514a56a01 None None] MFA Rules not processed for user `dd0b6bf5588944f38ff123a8d2bc3e49`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:45:00.300480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-853756c6-0da9-4cc8-9b42-52a514a56a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:45:00.367250 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4383/8715] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:45:00 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:45:00.380130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7d7a8-51b6-4084-92c9-7101195420e3 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:45:00.380442 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7d7a8-51b6-4084-92c9-7101195420e3 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:45:00.380719 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7d7a8-51b6-4084-92c9-7101195420e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:45:00.400285 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-4fa7d7a8-51b6-4084-92c9-7101195420e3 None None] MFA Rules not processed for user `d8f2e0934e5f416abee4bc74e57941e8`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:45:00.401514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4fa7d7a8-51b6-4084-92c9-7101195420e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:45:00.458160 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4333/8716] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:45:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:45:00.471688 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853756c6-0da9-4cc8-9b42-52a514a56a01 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:45:00.473254 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-853756c6-0da9-4cc8-9b42-52a514a56a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:45:00.548859 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853756c6-0da9-4cc8-9b42-52a514a56a01 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:45:00.554374 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871a058-6148-42b0-b875-8ed850f4eefa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:45:00.555019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871a058-6148-42b0-b875-8ed850f4eefa service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:45:00.555295 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871a058-6148-42b0-b875-8ed850f4eefa service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:45:00.555566 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871a058-6148-42b0-b875-8ed850f4eefa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:45:00.563810 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871a058-6148-42b0-b875-8ed850f4eefa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:45:00.565363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871a058-6148-42b0-b875-8ed850f4eefa service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:45:00.574218 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4384/8717] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:45:00 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:45:10.451301 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=78,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:45:10.456988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7d7a8-51b6-4084-92c9-7101195420e3 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:45:10.458390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4fa7d7a8-51b6-4084-92c9-7101195420e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:45:10.477528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7d7a8-51b6-4084-92c9-7101195420e3 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:45:10.483369 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e00637-00ce-4820-a828-4edeca827ac2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:45:10.483962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e00637-00ce-4820-a828-4edeca827ac2 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:45:10.484238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e00637-00ce-4820-a828-4edeca827ac2 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:45:10.484507 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e00637-00ce-4820-a828-4edeca827ac2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:45:10.492502 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e00637-00ce-4820-a828-4edeca827ac2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:45:10.494067 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e00637-00ce-4820-a828-4edeca827ac2 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:45:10.504126 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4334/8718] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:45:10 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:45:10.519019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7535d9d-832e-4f16-8fcd-a39a07d4a729 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:45:10.519419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7535d9d-832e-4f16-8fcd-a39a07d4a729 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:45:10.519555 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7535d9d-832e-4f16-8fcd-a39a07d4a729 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:45:10.520874 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4385/8719] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 21:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 21:45:10.525471 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e00637-00ce-4820-a828-4edeca827ac2 service nova] Authenticating service token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 21:45:10.539935 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e00637-00ce-4820-a828-4edeca827ac2 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:45:10.548779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e00637-00ce-4820-a828-4edeca827ac2 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:45:10.553389 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96209cfa-fa8d-436f-b336-6fa74f1c7d28 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0b6bf5588944f38ff123a8d2bc3e49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4715401611d0493fa27da4233f2d2fc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:45:10.554006 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96209cfa-fa8d-436f-b336-6fa74f1c7d28 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:45:10.554288 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96209cfa-fa8d-436f-b336-6fa74f1c7d28 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:45:10.554587 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96209cfa-fa8d-436f-b336-6fa74f1c7d28 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] PATH_INFO: `/v3/projects/4715401611d0493fa27da4233f2d2fc1` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:45:10.555720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96209cfa-fa8d-436f-b336-6fa74f1c7d28 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] RBAC: Authorizing `identity:get_project(project_id=4715401611d0493fa27da4233f2d2fc1)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:45:10.557502 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96209cfa-fa8d-436f-b336-6fa74f1c7d28 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:45:10.559146 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4335/8720] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 21:45:10 2022] GET /identity/v3/projects/4715401611d0493fa27da4233f2d2fc1 => generated 391 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:45:10.570033 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:45:10.719977 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7535d9d-832e-4f16-8fcd-a39a07d4a729 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:45:10.721716 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c7535d9d-832e-4f16-8fcd-a39a07d4a729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:45:10.777513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7535d9d-832e-4f16-8fcd-a39a07d4a729 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:45:10.781543 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352d043-eaf3-47a6-ace9-a21c6b086378 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:45:10.782139 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352d043-eaf3-47a6-ace9-a21c6b086378 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:45:10.782418 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352d043-eaf3-47a6-ace9-a21c6b086378 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:45:10.782729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352d043-eaf3-47a6-ace9-a21c6b086378 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:45:10.784395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c352d043-eaf3-47a6-ace9-a21c6b086378 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:45:10.796672 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c352d043-eaf3-47a6-ace9-a21c6b086378 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:45:10.798081 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c352d043-eaf3-47a6-ace9-a21c6b086378 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:45:10.808340 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4386/8721] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:45:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:45:10.964911 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940e1e7-d0d5-4cee-aa1e-9b7ba5079126 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:45:10.965200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940e1e7-d0d5-4cee-aa1e-9b7ba5079126 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:45:10.966237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940e1e7-d0d5-4cee-aa1e-9b7ba5079126 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:45:10.967766 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4336/8722] 10.222.0.33 () {54 vars in 912 bytes} [Sat Aug 6 21:45:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 21:45:10.972601 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352d043-eaf3-47a6-ace9-a21c6b086378 service neutron] Authenticating service token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 06 21:45:10.988096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352d043-eaf3-47a6-ace9-a21c6b086378 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:45:10.998050 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352d043-eaf3-47a6-ace9-a21c6b086378 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:45:11.002709 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2718384-798d-4a26-9695-8f1772f6deeb tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0b6bf5588944f38ff123a8d2bc3e49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4715401611d0493fa27da4233f2d2fc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:45:11.003328 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2718384-798d-4a26-9695-8f1772f6deeb tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:45:11.003607 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2718384-798d-4a26-9695-8f1772f6deeb tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:45:11.003877 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2718384-798d-4a26-9695-8f1772f6deeb tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] PATH_INFO: `/v3/projects/4715401611d0493fa27da4233f2d2fc1` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:45:11.005001 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2718384-798d-4a26-9695-8f1772f6deeb tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] RBAC: Authorizing `identity:get_project(project_id=4715401611d0493fa27da4233f2d2fc1)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:45:11.006799 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2718384-798d-4a26-9695-8f1772f6deeb tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:45:11.008620 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4387/8723] 10.222.0.33 () {58 vars in 1443 bytes} [Sat Aug 6 21:45:10 2022] GET /identity/v3/projects/4715401611d0493fa27da4233f2d2fc1 => generated 391 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:45:13.818629 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940e1e7-d0d5-4cee-aa1e-9b7ba5079126 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:45:13.884038 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940e1e7-d0d5-4cee-aa1e-9b7ba5079126 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:45:13.889399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63026a0-87a7-42e4-a879-8388c54ccb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:45:13.890026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63026a0-87a7-42e4-a879-8388c54ccb31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:45:13.890334 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63026a0-87a7-42e4-a879-8388c54ccb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:45:13.890646 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63026a0-87a7-42e4-a879-8388c54ccb31 admin admin] PATH_INFO: `/v3/users/d8f2e0934e5f416abee4bc74e57941e8` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:45:13.891786 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63026a0-87a7-42e4-a879-8388c54ccb31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8f2e0934e5f416abee4bc74e57941e8)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:45:13.893723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63026a0-87a7-42e4-a879-8388c54ccb31 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:45:13.940091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a63026a0-87a7-42e4-a879-8388c54ccb31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8f2e0934e5f416abee4bc74e57941e8'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:45:13.940772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a63026a0-87a7-42e4-a879-8388c54ccb31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8f2e0934e5f416abee4bc74e57941e8'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:45:13.941407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a63026a0-87a7-42e4-a879-8388c54ccb31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8f2e0934e5f416abee4bc74e57941e8'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:45:13.948200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a63026a0-87a7-42e4-a879-8388c54ccb31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8f2e0934e5f416abee4bc74e57941e8'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:45:13.960453 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-a63026a0-87a7-42e4-a879-8388c54ccb31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8f2e0934e5f416abee4bc74e57941e8'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:45:13.972352 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4337/8724] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:45:13 2022] DELETE /identity/v3/users/d8f2e0934e5f416abee4bc74e57941e8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:45:13.976787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b8f68-ce73-4678-9f5d-fb3a124a4f71 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:45:13.977295 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b8f68-ce73-4678-9f5d-fb3a124a4f71 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:45:13.977389 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b8f68-ce73-4678-9f5d-fb3a124a4f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:45:13.997290 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-135b8f68-ce73-4678-9f5d-fb3a124a4f71 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:45:13.998626 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-135b8f68-ce73-4678-9f5d-fb3a124a4f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:45:14.056311 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4388/8725] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:45:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:45:14.066748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63026a0-87a7-42e4-a879-8388c54ccb31 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:45:14.068146 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a63026a0-87a7-42e4-a879-8388c54ccb31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:45:14.126010 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63026a0-87a7-42e4-a879-8388c54ccb31 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:45:14.129641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483238a-e0ea-4ee8-9d14-0dc0c31d0847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:45:14.130230 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483238a-e0ea-4ee8-9d14-0dc0c31d0847 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:45:14.130507 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483238a-e0ea-4ee8-9d14-0dc0c31d0847 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:45:14.130806 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483238a-e0ea-4ee8-9d14-0dc0c31d0847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:45:14.139878 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3483238a-e0ea-4ee8-9d14-0dc0c31d0847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:45:14.141294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3483238a-e0ea-4ee8-9d14-0dc0c31d0847 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:45:14.146193 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:45:14.151413 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4338/8726] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:45:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:45:14.328859 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b8f68-ce73-4678-9f5d-fb3a124a4f71 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:45:14.330337 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-135b8f68-ce73-4678-9f5d-fb3a124a4f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:45:14.343583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b8f68-ce73-4678-9f5d-fb3a124a4f71 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:45:14.348243 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d185c-702d-4319-8561-00b1361eb1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:45:14.348875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d185c-702d-4319-8561-00b1361eb1c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:45:14.349695 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d185c-702d-4319-8561-00b1361eb1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:45:14.349951 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d185c-702d-4319-8561-00b1361eb1c4 admin admin] PATH_INFO: `/v3/projects/bd60ac6ebd8c4ae48c9fcf9aa86a7d45` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:45:14.351282 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d185c-702d-4319-8561-00b1361eb1c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd60ac6ebd8c4ae48c9fcf9aa86a7d45)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:45:14.353200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d185c-702d-4319-8561-00b1361eb1c4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:45:14.399663 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b07d185c-702d-4319-8561-00b1361eb1c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd60ac6ebd8c4ae48c9fcf9aa86a7d45', 'request_id': 'req-b07d185c-702d-4319-8561-00b1361eb1c4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:45:14.405670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b07d185c-702d-4319-8561-00b1361eb1c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd60ac6ebd8c4ae48c9fcf9aa86a7d45', 'request_id': 'req-b07d185c-702d-4319-8561-00b1361eb1c4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:45:14.413123 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b07d185c-702d-4319-8561-00b1361eb1c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd60ac6ebd8c4ae48c9fcf9aa86a7d45', 'request_id': 'req-b07d185c-702d-4319-8561-00b1361eb1c4'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:45:14.424977 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b07d185c-702d-4319-8561-00b1361eb1c4 admin admin] The token cache is being invalidate because project bd60ac6ebd8c4ae48c9fcf9aa86a7d45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:45:14.425267 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b07d185c-702d-4319-8561-00b1361eb1c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:45:14.425899 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b07d185c-702d-4319-8561-00b1361eb1c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:45:14.427408 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4389/8727] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:45:14 2022] DELETE /identity/v3/projects/bd60ac6ebd8c4ae48c9fcf9aa86a7d45 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:45:14.431461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483238a-e0ea-4ee8-9d14-0dc0c31d0847 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:45:14.441583 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483238a-e0ea-4ee8-9d14-0dc0c31d0847 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:45:14.497669 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5367d5a2-32af-4d67-96dd-f2ab0f8e06b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:45:14.498295 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367d5a2-32af-4d67-96dd-f2ab0f8e06b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:45:14.498604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367d5a2-32af-4d67-96dd-f2ab0f8e06b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:45:14.498886 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367d5a2-32af-4d67-96dd-f2ab0f8e06b8 admin admin] PATH_INFO: `/v3/users/dd0b6bf5588944f38ff123a8d2bc3e49` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:45:14.500027 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5367d5a2-32af-4d67-96dd-f2ab0f8e06b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd0b6bf5588944f38ff123a8d2bc3e49)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:45:14.501959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5367d5a2-32af-4d67-96dd-f2ab0f8e06b8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:45:14.548049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5367d5a2-32af-4d67-96dd-f2ab0f8e06b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd0b6bf5588944f38ff123a8d2bc3e49'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:45:14.548712 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5367d5a2-32af-4d67-96dd-f2ab0f8e06b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd0b6bf5588944f38ff123a8d2bc3e49'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:45:14.549337 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5367d5a2-32af-4d67-96dd-f2ab0f8e06b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd0b6bf5588944f38ff123a8d2bc3e49'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:45:14.556562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5367d5a2-32af-4d67-96dd-f2ab0f8e06b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd0b6bf5588944f38ff123a8d2bc3e49'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:45:14.568483 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5367d5a2-32af-4d67-96dd-f2ab0f8e06b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd0b6bf5588944f38ff123a8d2bc3e49'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:45:14.580846 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4339/8728] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:45:14 2022] DELETE /identity/v3/users/dd0b6bf5588944f38ff123a8d2bc3e49 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:45:14.856818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d185c-702d-4319-8561-00b1361eb1c4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:45:14.858344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b07d185c-702d-4319-8561-00b1361eb1c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:45:14.877996 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d185c-702d-4319-8561-00b1361eb1c4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:45:14.892539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:45:14.938107 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e23b4-bc99-486c-9b9e-c851e72e70f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:45:14.938808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e23b4-bc99-486c-9b9e-c851e72e70f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:45:14.939089 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e23b4-bc99-486c-9b9e-c851e72e70f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:45:14.939363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e23b4-bc99-486c-9b9e-c851e72e70f5 admin admin] PATH_INFO: `/v3/projects/4715401611d0493fa27da4233f2d2fc1` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:45:14.940481 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e23b4-bc99-486c-9b9e-c851e72e70f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4715401611d0493fa27da4233f2d2fc1)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:45:14.942383 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e23b4-bc99-486c-9b9e-c851e72e70f5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:45:14.988771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f79e23b4-bc99-486c-9b9e-c851e72e70f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4715401611d0493fa27da4233f2d2fc1', 'request_id': 'req-f79e23b4-bc99-486c-9b9e-c851e72e70f5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:45:14.994641 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f79e23b4-bc99-486c-9b9e-c851e72e70f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4715401611d0493fa27da4233f2d2fc1', 'request_id': 'req-f79e23b4-bc99-486c-9b9e-c851e72e70f5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:45:15.002357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f79e23b4-bc99-486c-9b9e-c851e72e70f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4715401611d0493fa27da4233f2d2fc1', 'request_id': 'req-f79e23b4-bc99-486c-9b9e-c851e72e70f5'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:45:15.014615 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f79e23b4-bc99-486c-9b9e-c851e72e70f5 admin admin] The token cache is being invalidate because project 4715401611d0493fa27da4233f2d2fc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:45:15.014906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f79e23b4-bc99-486c-9b9e-c851e72e70f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:45:15.015552 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-f79e23b4-bc99-486c-9b9e-c851e72e70f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:45:15.017028 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4390/8729] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:45:14 2022] DELETE /identity/v3/projects/4715401611d0493fa27da4233f2d2fc1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:45:15.022962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d778aef-361b-4df5-bd88-c4552e512a2e None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:45:15.023420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d778aef-361b-4df5-bd88-c4552e512a2e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:45:15.023515 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d778aef-361b-4df5-bd88-c4552e512a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:45:15.044392 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-1d778aef-361b-4df5-bd88-c4552e512a2e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:45:15.045603 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1d778aef-361b-4df5-bd88-c4552e512a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:45:15.112421 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4340/8730] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:45:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:45:15.120790 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843c249-4002-4bca-9a6e-72ba5ae3e593 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:45:15.121079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843c249-4002-4bca-9a6e-72ba5ae3e593 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:45:15.121343 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843c249-4002-4bca-9a6e-72ba5ae3e593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:45:15.142620 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-3843c249-4002-4bca-9a6e-72ba5ae3e593 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:45:15.143856 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-3843c249-4002-4bca-9a6e-72ba5ae3e593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:45:15.152066 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4391/8731] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:45:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:45:15.157309 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d778aef-361b-4df5-bd88-c4552e512a2e None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:45:15.167399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d778aef-361b-4df5-bd88-c4552e512a2e None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:45:15.172748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b443db-7d79-40e4-88f6-6f243f7bb1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:45:15.173357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b443db-7d79-40e4-88f6-6f243f7bb1ef admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:45:15.173633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b443db-7d79-40e4-88f6-6f243f7bb1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:45:15.173903 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b443db-7d79-40e4-88f6-6f243f7bb1ef admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:45:15.174598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b443db-7d79-40e4-88f6-6f243f7bb1ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:45:15.174903 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b443db-7d79-40e4-88f6-6f243f7bb1ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:45:15.176516 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b443db-7d79-40e4-88f6-6f243f7bb1ef admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:45:15.189167 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4341/8732] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:45:15.193742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843c249-4002-4bca-9a6e-72ba5ae3e593 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:45:15.204507 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843c249-4002-4bca-9a6e-72ba5ae3e593 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:45:15.211028 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a636fd-f3be-4a04-ad71-3ad56d446b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:45:15.212769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a636fd-f3be-4a04-ad71-3ad56d446b66 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:45:15.213122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a636fd-f3be-4a04-ad71-3ad56d446b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:45:15.213426 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a636fd-f3be-4a04-ad71-3ad56d446b66 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:45:15.214077 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a636fd-f3be-4a04-ad71-3ad56d446b66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:45:15.216379 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a636fd-f3be-4a04-ad71-3ad56d446b66 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:45:15.249461 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4392/8733] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:45:15 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:45:15.253727 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b443db-7d79-40e4-88f6-6f243f7bb1ef admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:45:15.264519 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b443db-7d79-40e4-88f6-6f243f7bb1ef admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:45:15.268089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:45:15.323801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147032c-dac1-4e8f-9518-a927d10ad121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:45:15.324401 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147032c-dac1-4e8f-9518-a927d10ad121 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:45:15.324683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147032c-dac1-4e8f-9518-a927d10ad121 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:45:15.325859 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147032c-dac1-4e8f-9518-a927d10ad121 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:45:15.326467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d147032c-dac1-4e8f-9518-a927d10ad121 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:45:15.328479 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d147032c-dac1-4e8f-9518-a927d10ad121 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:45:15.348810 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4342/8734] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:45:15 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:45:15.353126 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a636fd-f3be-4a04-ad71-3ad56d446b66 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:45:15.363720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a636fd-f3be-4a04-ad71-3ad56d446b66 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:45:15.368261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51578d3c-66c8-43e1-8917-f7d2b6705536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:45:15.368854 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51578d3c-66c8-43e1-8917-f7d2b6705536 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:45:15.369138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51578d3c-66c8-43e1-8917-f7d2b6705536 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:45:15.369414 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51578d3c-66c8-43e1-8917-f7d2b6705536 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:45:15.370078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51578d3c-66c8-43e1-8917-f7d2b6705536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:45:15.372251 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51578d3c-66c8-43e1-8917-f7d2b6705536 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:45:15.382123 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4393/8735] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:45:15.385989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147032c-dac1-4e8f-9518-a927d10ad121 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:45:15.397153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147032c-dac1-4e8f-9518-a927d10ad121 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:45:15.401813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef543e3-ed65-4fde-843c-f4acf79d76db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:45:15.402402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef543e3-ed65-4fde-843c-f4acf79d76db admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:45:15.402730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef543e3-ed65-4fde-843c-f4acf79d76db admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:45:15.403158 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef543e3-ed65-4fde-843c-f4acf79d76db admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:45:15.403798 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef543e3-ed65-4fde-843c-f4acf79d76db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:45:15.405409 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef543e3-ed65-4fde-843c-f4acf79d76db admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:45:15.415950 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4343/8736] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:45:15.420830 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51578d3c-66c8-43e1-8917-f7d2b6705536 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:45:15.430754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51578d3c-66c8-43e1-8917-f7d2b6705536 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:45:15.435915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa7e94-ae84-41f6-b470-c66b7abda0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:45:15.436560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa7e94-ae84-41f6-b470-c66b7abda0d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:45:15.436843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa7e94-ae84-41f6-b470-c66b7abda0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:45:15.437122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa7e94-ae84-41f6-b470-c66b7abda0d3 admin admin] PATH_INFO: `/v3/projects/2dd9f422e6e34a65bbc620eba89593ad/users/6311a8ce4c4848cea0cf3af1730ca67b/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:45:15.451734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa7e94-ae84-41f6-b470-c66b7abda0d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dd9f422e6e34a65bbc620eba89593ad, user_id=6311a8ce4c4848cea0cf3af1730ca67b, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:45:15.454383 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa7e94-ae84-41f6-b470-c66b7abda0d3 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:45:15.467293 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4394/8737] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:45:15 2022] PUT /identity/v3/projects/2dd9f422e6e34a65bbc620eba89593ad/users/6311a8ce4c4848cea0cf3af1730ca67b/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:45:15.472338 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c3acd-de5c-4b17-a1e0-a3cdf717dfea None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:45:15.472753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c3acd-de5c-4b17-a1e0-a3cdf717dfea None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:45:15.473032 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c3acd-de5c-4b17-a1e0-a3cdf717dfea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:45:15.491943 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-797c3acd-de5c-4b17-a1e0-a3cdf717dfea None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:45:15.493132 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-797c3acd-de5c-4b17-a1e0-a3cdf717dfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:45:15.551392 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4344/8738] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:45:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:45:15.561395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa7e94-ae84-41f6-b470-c66b7abda0d3 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:45:15.563121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-10aa7e94-ae84-41f6-b470-c66b7abda0d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:45:15.610290 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:45:15.622203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa7e94-ae84-41f6-b470-c66b7abda0d3 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:45:15.626359 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c784d99-8536-44e3-9d35-5246f7be998b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:45:15.627069 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c784d99-8536-44e3-9d35-5246f7be998b service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:45:15.627349 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c784d99-8536-44e3-9d35-5246f7be998b service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:45:15.627623 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c784d99-8536-44e3-9d35-5246f7be998b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:45:15.636619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c784d99-8536-44e3-9d35-5246f7be998b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:45:15.638682 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c784d99-8536-44e3-9d35-5246f7be998b service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:45:15.647995 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4395/8739] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:45:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:45:19.381281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640a148-278e-43de-889f-2f40731da992 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:45:19.381725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640a148-278e-43de-889f-2f40731da992 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:45:19.381818 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640a148-278e-43de-889f-2f40731da992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:45:19.411242 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-e640a148-278e-43de-889f-2f40731da992 None None] MFA Rules not processed for user `6311a8ce4c4848cea0cf3af1730ca67b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:45:19.412387 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e640a148-278e-43de-889f-2f40731da992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:45:19.490007 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4345/8740] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:45:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:45:19.494569 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38039a1-7714-4e45-93e2-c7b9ff1679a0 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:45:19.495079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38039a1-7714-4e45-93e2-c7b9ff1679a0 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:45:19.495171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38039a1-7714-4e45-93e2-c7b9ff1679a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:45:19.514603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-f38039a1-7714-4e45-93e2-c7b9ff1679a0 None None] MFA Rules not processed for user `6311a8ce4c4848cea0cf3af1730ca67b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:45:19.515821 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f38039a1-7714-4e45-93e2-c7b9ff1679a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:45:19.522843 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4396/8741] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:45:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:45:19.539453 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640a148-278e-43de-889f-2f40731da992 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:45:19.540964 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e640a148-278e-43de-889f-2f40731da992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:45:19.561452 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:45:19.625655 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640a148-278e-43de-889f-2f40731da992 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:45:19.631217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0b3fc-aa48-4e28-8da1-8963209b730b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:45:19.631827 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0b3fc-aa48-4e28-8da1-8963209b730b service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:45:19.632104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0b3fc-aa48-4e28-8da1-8963209b730b service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:45:19.632399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0b3fc-aa48-4e28-8da1-8963209b730b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:45:19.640893 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0b3fc-aa48-4e28-8da1-8963209b730b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:45:19.642591 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0b3fc-aa48-4e28-8da1-8963209b730b service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:45:19.651767 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4346/8742] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:45:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:45:29.509281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=9 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:45:29.647615 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=27 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:45:33.416671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38039a1-7714-4e45-93e2-c7b9ff1679a0 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:45:33.418341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f38039a1-7714-4e45-93e2-c7b9ff1679a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:45:33.431569 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38039a1-7714-4e45-93e2-c7b9ff1679a0 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:45:33.438277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e2351-35f5-4ed8-8a1a-97cbfa0c205a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:45:33.439131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e2351-35f5-4ed8-8a1a-97cbfa0c205a service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:45:33.439407 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e2351-35f5-4ed8-8a1a-97cbfa0c205a service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:45:33.439672 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e2351-35f5-4ed8-8a1a-97cbfa0c205a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:45:33.441405 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c40e2351-35f5-4ed8-8a1a-97cbfa0c205a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:45:33.455450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e2351-35f5-4ed8-8a1a-97cbfa0c205a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:45:33.456888 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e2351-35f5-4ed8-8a1a-97cbfa0c205a service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:45:33.470082 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4397/8743] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:45:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:45:33.551432 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbdfdf-e37d-4bfc-a225-3634a24850ed None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:45:33.551960 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbdfdf-e37d-4bfc-a225-3634a24850ed None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:45:33.551960 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbdfdf-e37d-4bfc-a225-3634a24850ed None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:45:33.553377 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4347/8744] 10.222.0.33 () {54 vars in 921 bytes} [Sat Aug 6 21:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 21:45:33.558118 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02601e57-2445-475f-83ab-4099e8460833 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:45:33.558436 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02601e57-2445-475f-83ab-4099e8460833 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:45:33.558741 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02601e57-2445-475f-83ab-4099e8460833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:45:33.578509 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-02601e57-2445-475f-83ab-4099e8460833 None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:45:33.579728 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-02601e57-2445-475f-83ab-4099e8460833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:45:33.641418 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4398/8745] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 21:45:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:45:33.662144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbbdfdf-e37d-4bfc-a225-3634a24850ed None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:45:33.663907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-cfbbdfdf-e37d-4bfc-a225-3634a24850ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:45:33.683533 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbbdfdf-e37d-4bfc-a225-3634a24850ed None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:45:33.689029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244535a0-be66-499b-9654-dd4d3f05722e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:45:33.689618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244535a0-be66-499b-9654-dd4d3f05722e service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:45:33.689898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244535a0-be66-499b-9654-dd4d3f05722e service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:45:33.690169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244535a0-be66-499b-9654-dd4d3f05722e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:45:33.698817 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244535a0-be66-499b-9654-dd4d3f05722e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:45:33.700714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244535a0-be66-499b-9654-dd4d3f05722e service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:45:33.711057 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4348/8746] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:45:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:45:43.632343 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=35 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:45:43.706849 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:46:02.339007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02601e57-2445-475f-83ab-4099e8460833 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:46:02.350119 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02601e57-2445-475f-83ab-4099e8460833 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:46:02.353761 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a0794-c794-45dc-916a-99db00759567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:46:02.354360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a0794-c794-45dc-916a-99db00759567 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:46:02.354670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a0794-c794-45dc-916a-99db00759567 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:46:02.354937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a0794-c794-45dc-916a-99db00759567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:46:02.356686 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4b5a0794-c794-45dc-916a-99db00759567 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:46:02.369978 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a0794-c794-45dc-916a-99db00759567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:46:02.371411 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a0794-c794-45dc-916a-99db00759567 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:46:02.381705 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4399/8747] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:46:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:46:12.375749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=6 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:46:12.566631 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244535a0-be66-499b-9654-dd4d3f05722e service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:46:12.580191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244535a0-be66-499b-9654-dd4d3f05722e service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:46:12.585579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b990d2d6-606e-46cd-b845-cd5f0c186258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:46:12.586232 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990d2d6-606e-46cd-b845-cd5f0c186258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:46:12.586647 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990d2d6-606e-46cd-b845-cd5f0c186258 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:46:12.586963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990d2d6-606e-46cd-b845-cd5f0c186258 admin admin] PATH_INFO: `/v3/users/6311a8ce4c4848cea0cf3af1730ca67b` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:46:12.588158 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b990d2d6-606e-46cd-b845-cd5f0c186258 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6311a8ce4c4848cea0cf3af1730ca67b)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:46:12.590094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b990d2d6-606e-46cd-b845-cd5f0c186258 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:46:12.639847 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b990d2d6-606e-46cd-b845-cd5f0c186258 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6311a8ce4c4848cea0cf3af1730ca67b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:46:12.640487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b990d2d6-606e-46cd-b845-cd5f0c186258 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6311a8ce4c4848cea0cf3af1730ca67b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:46:12.641084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b990d2d6-606e-46cd-b845-cd5f0c186258 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6311a8ce4c4848cea0cf3af1730ca67b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:46:12.648807 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b990d2d6-606e-46cd-b845-cd5f0c186258 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6311a8ce4c4848cea0cf3af1730ca67b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:46:12.660411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-b990d2d6-606e-46cd-b845-cd5f0c186258 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6311a8ce4c4848cea0cf3af1730ca67b'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:46:12.672978 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4349/8748] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:46:12 2022] DELETE /identity/v3/users/6311a8ce4c4848cea0cf3af1730ca67b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:46:12.855333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a0794-c794-45dc-916a-99db00759567 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:46:12.867765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a0794-c794-45dc-916a-99db00759567 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:46:12.925655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8740b7-8370-4b80-bf5b-0e15edd555c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:46:12.926280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8740b7-8370-4b80-bf5b-0e15edd555c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:46:12.926580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8740b7-8370-4b80-bf5b-0e15edd555c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:46:12.926857 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8740b7-8370-4b80-bf5b-0e15edd555c1 admin admin] PATH_INFO: `/v3/projects/2dd9f422e6e34a65bbc620eba89593ad` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:46:12.927965 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8740b7-8370-4b80-bf5b-0e15edd555c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dd9f422e6e34a65bbc620eba89593ad)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:46:12.930122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8740b7-8370-4b80-bf5b-0e15edd555c1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:46:12.977870 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fd8740b7-8370-4b80-bf5b-0e15edd555c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dd9f422e6e34a65bbc620eba89593ad', 'request_id': 'req-fd8740b7-8370-4b80-bf5b-0e15edd555c1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:46:12.983187 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fd8740b7-8370-4b80-bf5b-0e15edd555c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dd9f422e6e34a65bbc620eba89593ad', 'request_id': 'req-fd8740b7-8370-4b80-bf5b-0e15edd555c1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:46:12.995145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fd8740b7-8370-4b80-bf5b-0e15edd555c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dd9f422e6e34a65bbc620eba89593ad', 'request_id': 'req-fd8740b7-8370-4b80-bf5b-0e15edd555c1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:46:13.007279 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fd8740b7-8370-4b80-bf5b-0e15edd555c1 admin admin] The token cache is being invalidate because project 2dd9f422e6e34a65bbc620eba89593ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:46:13.007564 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fd8740b7-8370-4b80-bf5b-0e15edd555c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:46:13.008199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-fd8740b7-8370-4b80-bf5b-0e15edd555c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:46:13.009661 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4400/8749] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:46:12 2022] DELETE /identity/v3/projects/2dd9f422e6e34a65bbc620eba89593ad => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:46:13.014715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c5015-7be7-442b-b3ae-e01e541f14a4 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:46:13.015074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c5015-7be7-442b-b3ae-e01e541f14a4 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:46:13.015357 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c5015-7be7-442b-b3ae-e01e541f14a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:46:13.035831 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-425c5015-7be7-442b-b3ae-e01e541f14a4 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:46:13.037035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-425c5015-7be7-442b-b3ae-e01e541f14a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:46:13.099911 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4350/8750] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:46:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:46:13.107681 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95761bb-27fd-4c74-b71c-dadb6764f9c1 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:46:13.107971 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95761bb-27fd-4c74-b71c-dadb6764f9c1 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:46:13.108247 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95761bb-27fd-4c74-b71c-dadb6764f9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:46:13.128703 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-e95761bb-27fd-4c74-b71c-dadb6764f9c1 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:46:13.129886 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-e95761bb-27fd-4c74-b71c-dadb6764f9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:46:13.137985 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4401/8751] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:46:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:46:13.142106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c5015-7be7-442b-b3ae-e01e541f14a4 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:46:13.152078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c5015-7be7-442b-b3ae-e01e541f14a4 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:46:13.156721 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d62ad-ada7-4713-a656-48bfabde1fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:46:13.157311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d62ad-ada7-4713-a656-48bfabde1fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:46:13.157591 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d62ad-ada7-4713-a656-48bfabde1fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:46:13.157864 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d62ad-ada7-4713-a656-48bfabde1fa0 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:46:13.158824 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d62ad-ada7-4713-a656-48bfabde1fa0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:46:13.158935 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d62ad-ada7-4713-a656-48bfabde1fa0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:46:13.160497 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d62ad-ada7-4713-a656-48bfabde1fa0 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:46:13.171844 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4351/8752] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:46:13.176712 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95761bb-27fd-4c74-b71c-dadb6764f9c1 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:46:13.186041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95761bb-27fd-4c74-b71c-dadb6764f9c1 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:46:13.191243 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe0b9f-5bec-4450-a160-f8314a6dbdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:46:13.191829 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe0b9f-5bec-4450-a160-f8314a6dbdb4 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:46:13.192107 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe0b9f-5bec-4450-a160-f8314a6dbdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:46:13.192375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe0b9f-5bec-4450-a160-f8314a6dbdb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:46:13.192994 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe0b9f-5bec-4450-a160-f8314a6dbdb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:46:13.194916 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe0b9f-5bec-4450-a160-f8314a6dbdb4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:46:13.233321 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4402/8753] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:46:13 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:46:13.237512 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d62ad-ada7-4713-a656-48bfabde1fa0 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:46:13.247580 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d62ad-ada7-4713-a656-48bfabde1fa0 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:46:13.304219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc8799-a233-464c-937c-716645860cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:46:13.304848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc8799-a233-464c-937c-716645860cfa admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:46:13.305127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc8799-a233-464c-937c-716645860cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:46:13.305399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc8799-a233-464c-937c-716645860cfa admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:46:13.306002 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc8799-a233-464c-937c-716645860cfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:46:13.308021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc8799-a233-464c-937c-716645860cfa admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:46:13.316360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:46:13.332024 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4352/8754] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:46:13 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:46:13.336398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe0b9f-5bec-4450-a160-f8314a6dbdb4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:46:13.347915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe0b9f-5bec-4450-a160-f8314a6dbdb4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:46:13.352783 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc52c4f-6dbe-4f6f-9af8-9635c7a0bae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:46:13.353406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc52c4f-6dbe-4f6f-9af8-9635c7a0bae5 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:46:13.353670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc52c4f-6dbe-4f6f-9af8-9635c7a0bae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:46:13.353939 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc52c4f-6dbe-4f6f-9af8-9635c7a0bae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:46:13.354597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc52c4f-6dbe-4f6f-9af8-9635c7a0bae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:46:13.356167 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc52c4f-6dbe-4f6f-9af8-9635c7a0bae5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:46:13.366190 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4403/8755] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:46:13.370056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc8799-a233-464c-937c-716645860cfa admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:46:13.382034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc8799-a233-464c-937c-716645860cfa admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:46:13.386637 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34b7f7-8979-43b0-9bc1-3ab70b31a4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:46:13.387229 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34b7f7-8979-43b0-9bc1-3ab70b31a4fc admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:46:13.387506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34b7f7-8979-43b0-9bc1-3ab70b31a4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:46:13.387780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34b7f7-8979-43b0-9bc1-3ab70b31a4fc admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:46:13.388415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34b7f7-8979-43b0-9bc1-3ab70b31a4fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:46:13.390004 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34b7f7-8979-43b0-9bc1-3ab70b31a4fc admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:46:13.401263 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4353/8756] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:46:13.405323 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc52c4f-6dbe-4f6f-9af8-9635c7a0bae5 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:46:13.415792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc52c4f-6dbe-4f6f-9af8-9635c7a0bae5 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:46:13.420359 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ae0dc-c91b-4245-8a61-5d5172694aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:46:13.420998 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ae0dc-c91b-4245-8a61-5d5172694aeb admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:46:13.421274 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ae0dc-c91b-4245-8a61-5d5172694aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:46:13.421547 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ae0dc-c91b-4245-8a61-5d5172694aeb admin admin] PATH_INFO: `/v3/projects/1f27f640dfae44bd939f5b63372929a1/users/82eb6abeb4a549499466ea0425b60f86/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:46:13.436483 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ae0dc-c91b-4245-8a61-5d5172694aeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f27f640dfae44bd939f5b63372929a1, user_id=82eb6abeb4a549499466ea0425b60f86, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:46:13.439137 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ae0dc-c91b-4245-8a61-5d5172694aeb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:46:13.452420 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4404/8757] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:46:13 2022] PUT /identity/v3/projects/1f27f640dfae44bd939f5b63372929a1/users/82eb6abeb4a549499466ea0425b60f86/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:46:13.458115 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8e8cd-f3d2-4406-b0f1-3789bd017048 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:46:13.458404 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8e8cd-f3d2-4406-b0f1-3789bd017048 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:46:13.458723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8e8cd-f3d2-4406-b0f1-3789bd017048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:46:13.478334 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-3fa8e8cd-f3d2-4406-b0f1-3789bd017048 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:46:13.479558 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3fa8e8cd-f3d2-4406-b0f1-3789bd017048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:46:13.537574 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4354/8758] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:46:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:46:13.547128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ae0dc-c91b-4245-8a61-5d5172694aeb admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:46:13.548822 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-291ae0dc-c91b-4245-8a61-5d5172694aeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:46:13.569360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:46:13.608814 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ae0dc-c91b-4245-8a61-5d5172694aeb admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:46:13.612599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd3cd4-7ef7-4fcb-91d9-c975e0f372ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:46:13.613198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd3cd4-7ef7-4fcb-91d9-c975e0f372ae service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:46:13.613479 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd3cd4-7ef7-4fcb-91d9-c975e0f372ae service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:46:13.613757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd3cd4-7ef7-4fcb-91d9-c975e0f372ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:46:13.622658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd3cd4-7ef7-4fcb-91d9-c975e0f372ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:46:13.624075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd3cd4-7ef7-4fcb-91d9-c975e0f372ae service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:46:13.633917 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4405/8759] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:46:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:46:18.054191 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8dd265-1887-450f-a00f-0f26e09fcd45 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:46:18.054769 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8dd265-1887-450f-a00f-0f26e09fcd45 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:46:18.054878 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8dd265-1887-450f-a00f-0f26e09fcd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:46:18.085589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-fa8dd265-1887-450f-a00f-0f26e09fcd45 None None] MFA Rules not processed for user `82eb6abeb4a549499466ea0425b60f86`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:46:18.086682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-fa8dd265-1887-450f-a00f-0f26e09fcd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:46:18.152825 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4355/8760] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:46:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:46:18.164458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6bceb-8d91-4db7-9ddf-eca9fbd7b575 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:46:18.164969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6bceb-8d91-4db7-9ddf-eca9fbd7b575 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:46:18.165067 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6bceb-8d91-4db7-9ddf-eca9fbd7b575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:46:18.185391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-2cc6bceb-8d91-4db7-9ddf-eca9fbd7b575 None None] MFA Rules not processed for user `82eb6abeb4a549499466ea0425b60f86`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:46:18.186507 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2cc6bceb-8d91-4db7-9ddf-eca9fbd7b575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:46:18.194250 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4406/8761] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:46:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:46:18.206739 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8dd265-1887-450f-a00f-0f26e09fcd45 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:46:18.208180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-fa8dd265-1887-450f-a00f-0f26e09fcd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:46:18.287117 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8dd265-1887-450f-a00f-0f26e09fcd45 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:46:18.295217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40efed1-8ee4-4748-9bad-fc6f548c14c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:46:18.295835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40efed1-8ee4-4748-9bad-fc6f548c14c8 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:46:18.296118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40efed1-8ee4-4748-9bad-fc6f548c14c8 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:46:18.296395 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40efed1-8ee4-4748-9bad-fc6f548c14c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:46:18.301758 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:46:18.306641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40efed1-8ee4-4748-9bad-fc6f548c14c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:46:18.308955 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40efed1-8ee4-4748-9bad-fc6f548c14c8 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:46:18.318130 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4356/8762] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:46:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:46:28.179987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=21 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:46:28.208391 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85a4ba-2109-4afb-9c62-f15c2eb87c71 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:46:28.208598 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85a4ba-2109-4afb-9c62-f15c2eb87c71 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:46:28.208852 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85a4ba-2109-4afb-9c62-f15c2eb87c71 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:46:28.210194 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4407/8763] 10.222.0.33 () {54 vars in 921 bytes} [Sat Aug 6 21:46:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 21:46:28.215313 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fde92-bd95-4e24-bcc2-d8bf557d1d2b None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:46:28.215802 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fde92-bd95-4e24-bcc2-d8bf557d1d2b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:46:28.216087 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fde92-bd95-4e24-bcc2-d8bf557d1d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:46:28.237241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-b20fde92-bd95-4e24-bcc2-d8bf557d1d2b None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:46:28.238462 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b20fde92-bd95-4e24-bcc2-d8bf557d1d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:46:28.304048 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4357/8764] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 21:46:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:46:28.325303 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85a4ba-2109-4afb-9c62-f15c2eb87c71 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:46:28.327245 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-bd85a4ba-2109-4afb-9c62-f15c2eb87c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:46:28.347572 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85a4ba-2109-4afb-9c62-f15c2eb87c71 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:46:28.352529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46e2a7-e0c8-41ea-b0c6-3da21f9d2097 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:46:28.353113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46e2a7-e0c8-41ea-b0c6-3da21f9d2097 service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:46:28.353390 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46e2a7-e0c8-41ea-b0c6-3da21f9d2097 service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:46:28.353661 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46e2a7-e0c8-41ea-b0c6-3da21f9d2097 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:46:28.362605 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b46e2a7-e0c8-41ea-b0c6-3da21f9d2097 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:46:28.364444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b46e2a7-e0c8-41ea-b0c6-3da21f9d2097 service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:46:28.374095 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4408/8765] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:46:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:46:28.550917 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20fde92-bd95-4e24-bcc2-d8bf557d1d2b None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:46:28.552464 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b20fde92-bd95-4e24-bcc2-d8bf557d1d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:46:28.563865 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20fde92-bd95-4e24-bcc2-d8bf557d1d2b None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:46:28.567721 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71c720-4e37-4879-8e04-f9e8451eae07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:46:28.568385 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71c720-4e37-4879-8e04-f9e8451eae07 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:46:28.568751 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71c720-4e37-4879-8e04-f9e8451eae07 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:46:28.569184 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71c720-4e37-4879-8e04-f9e8451eae07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:46:28.571014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-fa71c720-4e37-4879-8e04-f9e8451eae07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:46:28.587005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71c720-4e37-4879-8e04-f9e8451eae07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:46:28.588422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71c720-4e37-4879-8e04-f9e8451eae07 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:46:28.602396 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4358/8766] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:46:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:46:38.370064 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=6 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:46:38.594615 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=38 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:47:04.882537 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9086778-7b23-43c9-9c52-1e6494a8720f None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:47:04.883121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9086778-7b23-43c9-9c52-1e6494a8720f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:47:04.883121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9086778-7b23-43c9-9c52-1e6494a8720f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:47:04.902073 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-f9086778-7b23-43c9-9c52-1e6494a8720f None None] MFA Rules not processed for user `82eb6abeb4a549499466ea0425b60f86`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:47:04.903303 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f9086778-7b23-43c9-9c52-1e6494a8720f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:47:04.910666 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4409/8767] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:47:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:47:14.897337 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:47:15.425921 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecc024-3205-4bd3-b515-0d7b5d56f663 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:47:15.426516 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecc024-3205-4bd3-b515-0d7b5d56f663 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:47:15.426516 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecc024-3205-4bd3-b515-0d7b5d56f663 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:47:15.427848 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4359/8768] 10.222.0.33 () {54 vars in 921 bytes} [Sat Aug 6 21:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 21:47:15.432804 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f050c6-d0a5-485c-9800-e32b62b648b2 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:47:15.433096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f050c6-d0a5-485c-9800-e32b62b648b2 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:47:15.433376 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f050c6-d0a5-485c-9800-e32b62b648b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:47:15.453863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-45f050c6-d0a5-485c-9800-e32b62b648b2 None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:47:15.455890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-45f050c6-d0a5-485c-9800-e32b62b648b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:47:15.464577 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4410/8769] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 21:47:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:47:15.486372 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ecc024-3205-4bd3-b515-0d7b5d56f663 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:47:15.488084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c6ecc024-3205-4bd3-b515-0d7b5d56f663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:47:15.507555 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ecc024-3205-4bd3-b515-0d7b5d56f663 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:47:15.512486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819602d9-3bdb-42b0-8aa6-96da90939667 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:47:15.513068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819602d9-3bdb-42b0-8aa6-96da90939667 service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:47:15.513342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819602d9-3bdb-42b0-8aa6-96da90939667 service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:47:15.513609 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819602d9-3bdb-42b0-8aa6-96da90939667 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:47:15.521878 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819602d9-3bdb-42b0-8aa6-96da90939667 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:47:15.523466 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819602d9-3bdb-42b0-8aa6-96da90939667 service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:47:15.533066 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4360/8770] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:47:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:47:20.208504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f050c6-d0a5-485c-9800-e32b62b648b2 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:47:20.224779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f050c6-d0a5-485c-9800-e32b62b648b2 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:47:20.230418 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d6d59-36de-4cf7-82ae-836d4955be63 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:47:20.231066 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d6d59-36de-4cf7-82ae-836d4955be63 service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:47:20.231368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d6d59-36de-4cf7-82ae-836d4955be63 service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:47:20.231670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d6d59-36de-4cf7-82ae-836d4955be63 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:47:20.233440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-756d6d59-36de-4cf7-82ae-836d4955be63 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:47:20.249503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d6d59-36de-4cf7-82ae-836d4955be63 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:47:20.251987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d6d59-36de-4cf7-82ae-836d4955be63 service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:47:20.265301 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4411/8771] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:47:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:47:21.935130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819602d9-3bdb-42b0-8aa6-96da90939667 service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:47:21.948442 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819602d9-3bdb-42b0-8aa6-96da90939667 service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:47:21.953683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a08a04-5863-4e9e-ab9c-7c279b032beb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:47:21.954303 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a08a04-5863-4e9e-ab9c-7c279b032beb service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:47:21.954607 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a08a04-5863-4e9e-ab9c-7c279b032beb service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:47:21.954878 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a08a04-5863-4e9e-ab9c-7c279b032beb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:47:21.956557 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-34a08a04-5863-4e9e-ab9c-7c279b032beb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:47:21.970976 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a08a04-5863-4e9e-ab9c-7c279b032beb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:47:21.972598 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a08a04-5863-4e9e-ab9c-7c279b032beb service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:47:21.984919 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4361/8772] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:47:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:47:30.258400 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=9 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:47:31.978140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=12 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:47:56.969966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d6d59-36de-4cf7-82ae-836d4955be63 service placement] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:47:56.984024 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d6d59-36de-4cf7-82ae-836d4955be63 service placement] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:47:56.989650 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7034c1-494e-4961-946d-274a64717ff4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:47:56.990246 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7034c1-494e-4961-946d-274a64717ff4 service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:47:56.990523 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7034c1-494e-4961-946d-274a64717ff4 service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:47:56.990828 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7034c1-494e-4961-946d-274a64717ff4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:47:56.992626 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0d7034c1-494e-4961-946d-274a64717ff4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:47:57.007948 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7034c1-494e-4961-946d-274a64717ff4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:47:57.009560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7034c1-494e-4961-946d-274a64717ff4 service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:47:57.022653 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4412/8773] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:47:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:47:57.037781 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a08a04-5863-4e9e-ab9c-7c279b032beb service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:47:57.049152 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a08a04-5863-4e9e-ab9c-7c279b032beb service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:47:57.054578 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43a033-60d3-4f11-bd6c-8ac900fdb342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:47:57.055262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43a033-60d3-4f11-bd6c-8ac900fdb342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:47:57.055546 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43a033-60d3-4f11-bd6c-8ac900fdb342 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:47:57.055822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43a033-60d3-4f11-bd6c-8ac900fdb342 admin admin] PATH_INFO: `/v3/users/82eb6abeb4a549499466ea0425b60f86` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:47:57.056975 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43a033-60d3-4f11-bd6c-8ac900fdb342 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82eb6abeb4a549499466ea0425b60f86)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:47:57.058918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43a033-60d3-4f11-bd6c-8ac900fdb342 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:47:57.106969 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8b43a033-60d3-4f11-bd6c-8ac900fdb342 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82eb6abeb4a549499466ea0425b60f86'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:47:57.107623 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8b43a033-60d3-4f11-bd6c-8ac900fdb342 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82eb6abeb4a549499466ea0425b60f86'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:47:57.108228 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8b43a033-60d3-4f11-bd6c-8ac900fdb342 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82eb6abeb4a549499466ea0425b60f86'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:47:57.115608 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8b43a033-60d3-4f11-bd6c-8ac900fdb342 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82eb6abeb4a549499466ea0425b60f86'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:47:57.128063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8b43a033-60d3-4f11-bd6c-8ac900fdb342 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82eb6abeb4a549499466ea0425b60f86'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:47:57.140130 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4362/8774] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:47:57 2022] DELETE /identity/v3/users/82eb6abeb4a549499466ea0425b60f86 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:47:57.314871 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7034c1-494e-4961-946d-274a64717ff4 service placement] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:47:57.325263 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7034c1-494e-4961-946d-274a64717ff4 service placement] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:47:57.386723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe06a1-d836-453d-bd36-5d6a51ce4499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:47:57.387355 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe06a1-d836-453d-bd36-5d6a51ce4499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:47:57.387635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe06a1-d836-453d-bd36-5d6a51ce4499 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:47:57.387910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe06a1-d836-453d-bd36-5d6a51ce4499 admin admin] PATH_INFO: `/v3/projects/1f27f640dfae44bd939f5b63372929a1` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:47:57.389023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe06a1-d836-453d-bd36-5d6a51ce4499 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f27f640dfae44bd939f5b63372929a1)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:47:57.390964 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe06a1-d836-453d-bd36-5d6a51ce4499 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:47:57.437088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3bbe06a1-d836-453d-bd36-5d6a51ce4499 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f27f640dfae44bd939f5b63372929a1', 'request_id': 'req-3bbe06a1-d836-453d-bd36-5d6a51ce4499'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:47:57.443210 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3bbe06a1-d836-453d-bd36-5d6a51ce4499 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f27f640dfae44bd939f5b63372929a1', 'request_id': 'req-3bbe06a1-d836-453d-bd36-5d6a51ce4499'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:47:57.450655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3bbe06a1-d836-453d-bd36-5d6a51ce4499 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f27f640dfae44bd939f5b63372929a1', 'request_id': 'req-3bbe06a1-d836-453d-bd36-5d6a51ce4499'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:47:57.462750 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3bbe06a1-d836-453d-bd36-5d6a51ce4499 admin admin] The token cache is being invalidate because project 1f27f640dfae44bd939f5b63372929a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:47:57.463037 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3bbe06a1-d836-453d-bd36-5d6a51ce4499 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:47:57.463674 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3bbe06a1-d836-453d-bd36-5d6a51ce4499 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:47:57.465145 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4413/8775] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:47:57 2022] DELETE /identity/v3/projects/1f27f640dfae44bd939f5b63372929a1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:47:57.470103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5c8d6-42fb-4039-b61e-e498bab011e6 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:47:57.470395 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5c8d6-42fb-4039-b61e-e498bab011e6 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:47:57.470896 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5c8d6-42fb-4039-b61e-e498bab011e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:47:57.490805 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-94d5c8d6-42fb-4039-b61e-e498bab011e6 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:47:57.491946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-94d5c8d6-42fb-4039-b61e-e498bab011e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:47:57.550017 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4363/8776] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:47:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:47:57.557747 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb3d16-3fa6-400c-8577-24f655fe37b3 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:47:57.558035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb3d16-3fa6-400c-8577-24f655fe37b3 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:47:57.558313 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb3d16-3fa6-400c-8577-24f655fe37b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:47:57.578373 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-46cb3d16-3fa6-400c-8577-24f655fe37b3 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:47:57.579616 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-46cb3d16-3fa6-400c-8577-24f655fe37b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:47:57.587465 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4414/8777] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:47:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:47:57.591648 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5c8d6-42fb-4039-b61e-e498bab011e6 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:47:57.601833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5c8d6-42fb-4039-b61e-e498bab011e6 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:47:57.606451 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22236c-5d3f-4203-ba1e-68b3d456000a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:47:57.607076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22236c-5d3f-4203-ba1e-68b3d456000a admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:47:57.607359 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22236c-5d3f-4203-ba1e-68b3d456000a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:47:57.607634 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22236c-5d3f-4203-ba1e-68b3d456000a admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:47:57.608271 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff22236c-5d3f-4203-ba1e-68b3d456000a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:47:57.608603 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff22236c-5d3f-4203-ba1e-68b3d456000a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:47:57.610206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff22236c-5d3f-4203-ba1e-68b3d456000a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:47:57.622639 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4364/8778] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:47:57.627353 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb3d16-3fa6-400c-8577-24f655fe37b3 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:47:57.636968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb3d16-3fa6-400c-8577-24f655fe37b3 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:47:57.642434 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a50bb-4956-4bc5-9aea-ad5474203dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:47:57.643265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a50bb-4956-4bc5-9aea-ad5474203dcc admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:47:57.643547 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a50bb-4956-4bc5-9aea-ad5474203dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:47:57.643822 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a50bb-4956-4bc5-9aea-ad5474203dcc admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:47:57.644451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a50bb-4956-4bc5-9aea-ad5474203dcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:47:57.646332 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a50bb-4956-4bc5-9aea-ad5474203dcc admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:47:57.676129 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4415/8779] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:47:57 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:47:57.680151 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22236c-5d3f-4203-ba1e-68b3d456000a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:47:57.690182 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22236c-5d3f-4203-ba1e-68b3d456000a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:47:57.746560 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62630e9-c453-4723-a8f4-6672b566c38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:47:57.747114 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62630e9-c453-4723-a8f4-6672b566c38b admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:47:57.747395 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62630e9-c453-4723-a8f4-6672b566c38b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:47:57.747669 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62630e9-c453-4723-a8f4-6672b566c38b admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:47:57.748308 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62630e9-c453-4723-a8f4-6672b566c38b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:47:57.750266 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62630e9-c453-4723-a8f4-6672b566c38b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:47:57.758107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:47:57.775613 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4365/8780] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:47:57 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:47:57.777085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a50bb-4956-4bc5-9aea-ad5474203dcc admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:47:57.788152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a50bb-4956-4bc5-9aea-ad5474203dcc admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:47:57.792794 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aabff4-97d7-4768-949d-e48ceb678afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:47:57.793388 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aabff4-97d7-4768-949d-e48ceb678afa admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:47:57.793668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aabff4-97d7-4768-949d-e48ceb678afa admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:47:57.793942 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aabff4-97d7-4768-949d-e48ceb678afa admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:47:57.794608 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aabff4-97d7-4768-949d-e48ceb678afa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:47:57.796354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aabff4-97d7-4768-949d-e48ceb678afa admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:47:57.806591 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4416/8781] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:47:57.810401 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62630e9-c453-4723-a8f4-6672b566c38b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:47:57.821514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62630e9-c453-4723-a8f4-6672b566c38b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:47:57.826140 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f88e6f-99c5-4c1e-941f-a4ae030da808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:47:57.826767 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f88e6f-99c5-4c1e-941f-a4ae030da808 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:47:57.827048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f88e6f-99c5-4c1e-941f-a4ae030da808 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:47:57.827340 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f88e6f-99c5-4c1e-941f-a4ae030da808 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:47:57.828227 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f88e6f-99c5-4c1e-941f-a4ae030da808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:47:57.829995 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f88e6f-99c5-4c1e-941f-a4ae030da808 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:47:57.840620 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4366/8782] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:47:57.844642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aabff4-97d7-4768-949d-e48ceb678afa admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:47:57.855137 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aabff4-97d7-4768-949d-e48ceb678afa admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:47:57.860394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2ad21-f7cc-4680-a11d-e280aad0e9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:47:57.861668 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2ad21-f7cc-4680-a11d-e280aad0e9f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:47:57.861945 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2ad21-f7cc-4680-a11d-e280aad0e9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:47:57.862214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2ad21-f7cc-4680-a11d-e280aad0e9f7 admin admin] PATH_INFO: `/v3/projects/31dd0cdecacf498d8623f2be190dc57c/users/7e3cdb291b6146bb8d30f96ed07f1a46/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:47:57.877468 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c2ad21-f7cc-4680-a11d-e280aad0e9f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31dd0cdecacf498d8623f2be190dc57c, user_id=7e3cdb291b6146bb8d30f96ed07f1a46, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:47:57.880307 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c2ad21-f7cc-4680-a11d-e280aad0e9f7 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:47:57.892639 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4417/8783] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:47:57 2022] PUT /identity/v3/projects/31dd0cdecacf498d8623f2be190dc57c/users/7e3cdb291b6146bb8d30f96ed07f1a46/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:47:57.897857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c9f62-300e-4497-b7ff-b9157aedbbca None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:47:57.898143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c9f62-300e-4497-b7ff-b9157aedbbca None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:47:57.898448 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c9f62-300e-4497-b7ff-b9157aedbbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:47:57.918063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-fd6c9f62-300e-4497-b7ff-b9157aedbbca None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:47:57.919314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-fd6c9f62-300e-4497-b7ff-b9157aedbbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:47:57.979363 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4367/8784] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:47:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:47:57.989466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2ad21-f7cc-4680-a11d-e280aad0e9f7 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:47:57.991332 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-10c2ad21-f7cc-4680-a11d-e280aad0e9f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:47:58.007531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:47:58.051780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2ad21-f7cc-4680-a11d-e280aad0e9f7 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:47:58.055503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cf03e-8fbc-4b28-a8f9-968c24260a3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:47:58.056100 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cf03e-8fbc-4b28-a8f9-968c24260a3f service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:47:58.056381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cf03e-8fbc-4b28-a8f9-968c24260a3f service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:47:58.056659 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cf03e-8fbc-4b28-a8f9-968c24260a3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:47:58.066087 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118cf03e-8fbc-4b28-a8f9-968c24260a3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:47:58.067541 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118cf03e-8fbc-4b28-a8f9-968c24260a3f service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:47:58.076789 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4418/8785] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:47:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:48:01.858039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89095e76-03fa-4ff9-81e3-67fbe5adcbfb None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:48:01.858585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89095e76-03fa-4ff9-81e3-67fbe5adcbfb None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:48:01.858683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89095e76-03fa-4ff9-81e3-67fbe5adcbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:48:01.888577 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-89095e76-03fa-4ff9-81e3-67fbe5adcbfb None None] MFA Rules not processed for user `7e3cdb291b6146bb8d30f96ed07f1a46`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:48:01.889510 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-89095e76-03fa-4ff9-81e3-67fbe5adcbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:48:01.955528 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4368/8786] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:48:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:48:01.969739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cf03e-8fbc-4b28-a8f9-968c24260a3f service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:48:01.972419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-118cf03e-8fbc-4b28-a8f9-968c24260a3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:48:02.052119 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cf03e-8fbc-4b28-a8f9-968c24260a3f service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:48:02.057670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d561a8d-639a-4320-8a20-06e3e44f9a12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:48:02.058213 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d561a8d-639a-4320-8a20-06e3e44f9a12 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:48:02.058491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d561a8d-639a-4320-8a20-06e3e44f9a12 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:48:02.058793 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d561a8d-639a-4320-8a20-06e3e44f9a12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:48:02.066951 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d561a8d-639a-4320-8a20-06e3e44f9a12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:48:02.068595 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d561a8d-639a-4320-8a20-06e3e44f9a12 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:48:02.078067 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4419/8787] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:48:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:48:03.471839 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7096bec-cee9-4b16-8635-60b06fdd1abf None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:48:03.472331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7096bec-cee9-4b16-8635-60b06fdd1abf None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:48:03.472411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7096bec-cee9-4b16-8635-60b06fdd1abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:48:03.491833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f7096bec-cee9-4b16-8635-60b06fdd1abf None None] MFA Rules not processed for user `7e3cdb291b6146bb8d30f96ed07f1a46`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:48:03.493026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f7096bec-cee9-4b16-8635-60b06fdd1abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:48:03.499817 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4369/8788] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:48:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:48:03.820928 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d561a8d-639a-4320-8a20-06e3e44f9a12 service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:48:03.831263 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d561a8d-639a-4320-8a20-06e3e44f9a12 service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:48:03.835021 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12426ecc-3e87-4172-8ad5-63b5a9d37414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:48:03.835618 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12426ecc-3e87-4172-8ad5-63b5a9d37414 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:48:03.835896 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12426ecc-3e87-4172-8ad5-63b5a9d37414 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:48:03.836201 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12426ecc-3e87-4172-8ad5-63b5a9d37414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:48:03.837953 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-12426ecc-3e87-4172-8ad5-63b5a9d37414 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:48:03.851054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12426ecc-3e87-4172-8ad5-63b5a9d37414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:48:03.852589 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12426ecc-3e87-4172-8ad5-63b5a9d37414 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:48:03.868781 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4420/8789] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:48:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:48:04.192748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7096bec-cee9-4b16-8635-60b06fdd1abf None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:48:04.195580 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f7096bec-cee9-4b16-8635-60b06fdd1abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:48:04.270011 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:48:04.278680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7096bec-cee9-4b16-8635-60b06fdd1abf None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:48:04.284513 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce046e-7208-44c4-9591-7819c1acd16c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:48:04.286852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce046e-7208-44c4-9591-7819c1acd16c service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:48:04.287160 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce046e-7208-44c4-9591-7819c1acd16c service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:48:04.287442 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce046e-7208-44c4-9591-7819c1acd16c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:48:04.289238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-78ce046e-7208-44c4-9591-7819c1acd16c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:48:04.301750 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce046e-7208-44c4-9591-7819c1acd16c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:48:04.303414 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce046e-7208-44c4-9591-7819c1acd16c service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:48:04.313484 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4370/8790] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:48:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:48:12.409306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12426ecc-3e87-4172-8ad5-63b5a9d37414 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:48:12.427029 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12426ecc-3e87-4172-8ad5-63b5a9d37414 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:48:12.432549 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f475fe-7f8e-47bc-a2d5-8688f0fb221e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:48:12.433148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f475fe-7f8e-47bc-a2d5-8688f0fb221e service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:48:12.433424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f475fe-7f8e-47bc-a2d5-8688f0fb221e service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:48:12.433692 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f475fe-7f8e-47bc-a2d5-8688f0fb221e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:48:12.435424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-22f475fe-7f8e-47bc-a2d5-8688f0fb221e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:48:12.450514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f475fe-7f8e-47bc-a2d5-8688f0fb221e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:48:12.452118 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f475fe-7f8e-47bc-a2d5-8688f0fb221e service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:48:12.465778 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4421/8791] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:48:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:48:14.309175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:48:22.460615 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=66 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:48:50.957568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e4793-8f8e-48b9-994d-4510043a8538 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:48:50.958108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e4793-8f8e-48b9-994d-4510043a8538 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:48:50.958108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e4793-8f8e-48b9-994d-4510043a8538 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:48:50.959514 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4371/8792] 10.222.0.33 () {54 vars in 921 bytes} [Sat Aug 6 21:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 21:48:50.964534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20421e6-85be-40ef-9417-91ff77b833f7 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:48:50.965004 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20421e6-85be-40ef-9417-91ff77b833f7 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:48:50.965112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20421e6-85be-40ef-9417-91ff77b833f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:48:51.016599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b20421e6-85be-40ef-9417-91ff77b833f7 None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:48:51.017845 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b20421e6-85be-40ef-9417-91ff77b833f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:48:51.026371 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4422/8793] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 21:48:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:48:51.048081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e4793-8f8e-48b9-994d-4510043a8538 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:48:51.049731 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ce9e4793-8f8e-48b9-994d-4510043a8538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:48:51.069179 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e4793-8f8e-48b9-994d-4510043a8538 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:48:51.074188 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35a8fe-f627-4ff1-aaa1-2f36df84fe7c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:48:51.074804 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35a8fe-f627-4ff1-aaa1-2f36df84fe7c service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:48:51.075092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35a8fe-f627-4ff1-aaa1-2f36df84fe7c service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:48:51.075367 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35a8fe-f627-4ff1-aaa1-2f36df84fe7c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:48:51.083951 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b35a8fe-f627-4ff1-aaa1-2f36df84fe7c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:48:51.085530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b35a8fe-f627-4ff1-aaa1-2f36df84fe7c service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:48:51.095687 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4372/8794] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:48:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:48:51.334020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20421e6-85be-40ef-9417-91ff77b833f7 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:48:51.347574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20421e6-85be-40ef-9417-91ff77b833f7 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:48:51.352755 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf48bd9-5d32-47d0-b6d1-deeccdc5bbe2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:48:51.353348 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf48bd9-5d32-47d0-b6d1-deeccdc5bbe2 service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:48:51.353624 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf48bd9-5d32-47d0-b6d1-deeccdc5bbe2 service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:48:51.353894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf48bd9-5d32-47d0-b6d1-deeccdc5bbe2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:48:51.355664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9bf48bd9-5d32-47d0-b6d1-deeccdc5bbe2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:48:51.367574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf48bd9-5d32-47d0-b6d1-deeccdc5bbe2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:48:51.369155 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf48bd9-5d32-47d0-b6d1-deeccdc5bbe2 service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:48:51.380364 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4423/8795] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:48:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:48:55.574804 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35a8fe-f627-4ff1-aaa1-2f36df84fe7c service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:48:55.576281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2b35a8fe-f627-4ff1-aaa1-2f36df84fe7c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:48:55.588088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35a8fe-f627-4ff1-aaa1-2f36df84fe7c service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:48:55.591579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04510d-3371-47c8-8419-92cff04a1bca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:48:55.592168 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04510d-3371-47c8-8419-92cff04a1bca service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:48:55.592446 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04510d-3371-47c8-8419-92cff04a1bca service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:48:55.592715 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04510d-3371-47c8-8419-92cff04a1bca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:48:55.594876 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9d04510d-3371-47c8-8419-92cff04a1bca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:48:55.610858 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d04510d-3371-47c8-8419-92cff04a1bca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:48:55.612284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d04510d-3371-47c8-8419-92cff04a1bca service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:48:55.634521 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4373/8796] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:48:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:48:59.160822 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf48bd9-5d32-47d0-b6d1-deeccdc5bbe2 service placement] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:48:59.169935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf48bd9-5d32-47d0-b6d1-deeccdc5bbe2 service placement] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:48:59.174375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7138f-8d99-4077-b435-7ac1794de804 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:48:59.175008 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7138f-8d99-4077-b435-7ac1794de804 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:48:59.175284 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7138f-8d99-4077-b435-7ac1794de804 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:48:59.175555 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7138f-8d99-4077-b435-7ac1794de804 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:48:59.177254 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-92e7138f-8d99-4077-b435-7ac1794de804 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:48:59.193274 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7138f-8d99-4077-b435-7ac1794de804 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:48:59.194726 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7138f-8d99-4077-b435-7ac1794de804 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:48:59.208637 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4424/8797] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:48:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:49:04.685058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04510d-3371-47c8-8419-92cff04a1bca service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:49:04.694153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04510d-3371-47c8-8419-92cff04a1bca service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:49:04.697978 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cb166-0c67-444d-ad2a-903351ffd981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:49:04.698772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cb166-0c67-444d-ad2a-903351ffd981 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:49:04.699047 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cb166-0c67-444d-ad2a-903351ffd981 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:49:04.699316 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cb166-0c67-444d-ad2a-903351ffd981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:49:04.701064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-db0cb166-0c67-444d-ad2a-903351ffd981 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:49:04.714055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0cb166-0c67-444d-ad2a-903351ffd981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:49:04.715491 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0cb166-0c67-444d-ad2a-903351ffd981 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:49:04.726977 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4374/8798] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:49:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:49:09.200853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=25 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:49:13.596428 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ebd25-e7d9-4d58-b2a3-a7666dbed933 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:49:13.596997 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ebd25-e7d9-4d58-b2a3-a7666dbed933 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:49:13.596997 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ebd25-e7d9-4d58-b2a3-a7666dbed933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:49:13.616374 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-5a9ebd25-e7d9-4d58-b2a3-a7666dbed933 None None] MFA Rules not processed for user `7e3cdb291b6146bb8d30f96ed07f1a46`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:49:13.617589 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5a9ebd25-e7d9-4d58-b2a3-a7666dbed933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:49:13.630115 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4425/8799] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:49:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:49:14.720900 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=22 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:49:23.611315 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:49:23.941810 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f129655-ba6d-4c0a-8c4d-e840cd0f6257 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:49:23.942329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f129655-ba6d-4c0a-8c4d-e840cd0f6257 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:49:23.942430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f129655-ba6d-4c0a-8c4d-e840cd0f6257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:49:23.962127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-8f129655-ba6d-4c0a-8c4d-e840cd0f6257 None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:49:23.963542 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8f129655-ba6d-4c0a-8c4d-e840cd0f6257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:49:23.972951 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4375/8800] 10.222.0.40 () {58 vars in 1015 bytes} [Sat Aug 6 21:49:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:49:23.986018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ebd25-e7d9-4d58-b2a3-a7666dbed933 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:49:24.001023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ebd25-e7d9-4d58-b2a3-a7666dbed933 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:49:24.006030 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb57a66-65e8-47e5-b067-0efb61a5814e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:49:24.006659 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb57a66-65e8-47e5-b067-0efb61a5814e service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:49:24.006938 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb57a66-65e8-47e5-b067-0efb61a5814e service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:49:24.007205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb57a66-65e8-47e5-b067-0efb61a5814e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:49:24.015934 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb57a66-65e8-47e5-b067-0efb61a5814e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:49:24.017501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb57a66-65e8-47e5-b067-0efb61a5814e service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:49:24.027249 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4426/8801] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:49:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:49:33.957241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:49:34.023166 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=6 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:50:08.880236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68ec58-5977-462c-a7a6-6b306f28d9c6 None None] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:50:08.880812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68ec58-5977-462c-a7a6-6b306f28d9c6 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:50:08.880812 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68ec58-5977-462c-a7a6-6b306f28d9c6 None None] PATH_INFO: `/` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:50:08.882209 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4376/8802] 10.222.0.33 () {54 vars in 921 bytes} [Sat Aug 6 21:50:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 21:50:08.888059 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38415933-b830-401f-b506-70d3ab7c9a2c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:50:08.888579 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38415933-b830-401f-b506-70d3ab7c9a2c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:50:08.888739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38415933-b830-401f-b506-70d3ab7c9a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:50:08.909005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-38415933-b830-401f-b506-70d3ab7c9a2c None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:50:08.910211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-38415933-b830-401f-b506-70d3ab7c9a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:50:08.919087 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4427/8803] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 21:50:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:50:08.940356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb3130-be26-49ad-a663-883d13a62e09 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:50:08.940644 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb3130-be26-49ad-a663-883d13a62e09 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:50:08.940921 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb3130-be26-49ad-a663-883d13a62e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:50:08.961751 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-b1cb3130-be26-49ad-a663-883d13a62e09 None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:50:08.962969 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b1cb3130-be26-49ad-a663-883d13a62e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:50:08.972268 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4377/8804] 10.222.0.33 () {58 vars in 1058 bytes} [Sat Aug 6 21:50:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:50:08.978127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38415933-b830-401f-b506-70d3ab7c9a2c None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:50:08.989503 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38415933-b830-401f-b506-70d3ab7c9a2c None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:50:08.994518 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecabe7e-ca27-4c2e-a3ec-81cda0a7a996 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:50:08.995135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecabe7e-ca27-4c2e-a3ec-81cda0a7a996 service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:50:08.995413 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecabe7e-ca27-4c2e-a3ec-81cda0a7a996 service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:50:08.995679 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecabe7e-ca27-4c2e-a3ec-81cda0a7a996 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:50:09.004084 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecabe7e-ca27-4c2e-a3ec-81cda0a7a996 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:50:09.005635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecabe7e-ca27-4c2e-a3ec-81cda0a7a996 service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:50:09.015480 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4428/8805] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:50:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:50:09.577406 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bcd7e-6bfc-440b-a788-01c184225d14 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:50:09.577732 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bcd7e-6bfc-440b-a788-01c184225d14 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:50:09.577936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bcd7e-6bfc-440b-a788-01c184225d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:50:09.597963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-861bcd7e-6bfc-440b-a788-01c184225d14 None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:50:09.599186 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-861bcd7e-6bfc-440b-a788-01c184225d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:50:09.607834 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4378/8806] 10.222.0.23 () {58 vars in 1015 bytes} [Sat Aug 6 21:50:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:50:09.622465 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecabe7e-ca27-4c2e-a3ec-81cda0a7a996 service placement] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:50:09.636261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecabe7e-ca27-4c2e-a3ec-81cda0a7a996 service placement] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:50:09.641354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb86310-a4d5-4974-8e0b-1cda1f7fd7ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:50:09.641947 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb86310-a4d5-4974-8e0b-1cda1f7fd7ad service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:50:09.642226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb86310-a4d5-4974-8e0b-1cda1f7fd7ad service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:50:09.642499 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb86310-a4d5-4974-8e0b-1cda1f7fd7ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:50:09.650778 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb86310-a4d5-4974-8e0b-1cda1f7fd7ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:50:09.652335 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb86310-a4d5-4974-8e0b-1cda1f7fd7ad service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:50:09.662469 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4429/8807] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:50:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:50:12.836145 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bcd7e-6bfc-440b-a788-01c184225d14 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:50:12.852035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bcd7e-6bfc-440b-a788-01c184225d14 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:50:12.857955 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219ff91-a8a5-4002-af79-52884054fadf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:50:12.858591 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219ff91-a8a5-4002-af79-52884054fadf service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:50:12.858861 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219ff91-a8a5-4002-af79-52884054fadf service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:50:12.859133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219ff91-a8a5-4002-af79-52884054fadf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:50:12.860844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5219ff91-a8a5-4002-af79-52884054fadf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:50:12.876802 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219ff91-a8a5-4002-af79-52884054fadf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:50:12.878488 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219ff91-a8a5-4002-af79-52884054fadf service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:50:12.894594 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4379/8808] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:50:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:50:19.658432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=15 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:50:22.885669 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=12 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:50:23.004455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bcb58-3d69-406f-874e-1804b73a8512 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:50:23.004973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bcb58-3d69-406f-874e-1804b73a8512 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:50:23.005073 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bcb58-3d69-406f-874e-1804b73a8512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:50:23.026531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-992bcb58-3d69-406f-874e-1804b73a8512 None None] MFA Rules not processed for user `7e3cdb291b6146bb8d30f96ed07f1a46`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:50:23.027786 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-992bcb58-3d69-406f-874e-1804b73a8512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:50:23.035413 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4430/8809] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:50:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:50:23.364319 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219ff91-a8a5-4002-af79-52884054fadf service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:50:23.383433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219ff91-a8a5-4002-af79-52884054fadf service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:50:23.387574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea952c-3769-4d1b-b716-b89c856e75ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:50:23.388281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea952c-3769-4d1b-b716-b89c856e75ac service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:50:23.388658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea952c-3769-4d1b-b716-b89c856e75ac service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:50:23.389033 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea952c-3769-4d1b-b716-b89c856e75ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:50:23.392039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-31ea952c-3769-4d1b-b716-b89c856e75ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:50:23.404039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea952c-3769-4d1b-b716-b89c856e75ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:50:23.405459 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea952c-3769-4d1b-b716-b89c856e75ac service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:50:23.417491 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4380/8810] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:50:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:50:33.021920 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:50:33.411402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=10 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:50:35.263092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bcb58-3d69-406f-874e-1804b73a8512 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:50:35.279215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bcb58-3d69-406f-874e-1804b73a8512 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:50:35.285348 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df4f97-f5ee-4a29-8586-48efb2d464c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:50:35.285953 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df4f97-f5ee-4a29-8586-48efb2d464c4 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:50:35.286264 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df4f97-f5ee-4a29-8586-48efb2d464c4 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:50:35.286532 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df4f97-f5ee-4a29-8586-48efb2d464c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:50:35.288317 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b2df4f97-f5ee-4a29-8586-48efb2d464c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:50:35.304598 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2df4f97-f5ee-4a29-8586-48efb2d464c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:50:35.306194 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2df4f97-f5ee-4a29-8586-48efb2d464c4 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:50:35.320076 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4431/8811] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:50:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:50:45.313334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=6 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:51:08.329423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea952c-3769-4d1b-b716-b89c856e75ac service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:51:08.338496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea952c-3769-4d1b-b716-b89c856e75ac service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:51:08.342435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ea43a-794a-4e43-a8ca-16df0406d150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:51:08.343074 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ea43a-794a-4e43-a8ca-16df0406d150 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:51:08.343445 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ea43a-794a-4e43-a8ca-16df0406d150 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:51:08.343777 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ea43a-794a-4e43-a8ca-16df0406d150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:51:08.346292 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d37ea43a-794a-4e43-a8ca-16df0406d150 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:51:08.363118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ea43a-794a-4e43-a8ca-16df0406d150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:51:08.364573 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ea43a-794a-4e43-a8ca-16df0406d150 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:51:08.376478 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4381/8812] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:51:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:51:08.458396 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704d0e6-006c-4f44-9cb0-7e292d7c3b12 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:51:08.458857 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704d0e6-006c-4f44-9cb0-7e292d7c3b12 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:51:08.459139 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704d0e6-006c-4f44-9cb0-7e292d7c3b12 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:51:08.460524 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4432/8813] 10.222.0.33 () {54 vars in 921 bytes} [Sat Aug 6 21:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 21:51:08.465778 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663c328-3195-4e04-ae4c-f89008d8c9d6 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:51:08.466061 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663c328-3195-4e04-ae4c-f89008d8c9d6 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:51:08.466359 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663c328-3195-4e04-ae4c-f89008d8c9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:51:08.487030 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-c663c328-3195-4e04-ae4c-f89008d8c9d6 None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:51:08.488263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c663c328-3195-4e04-ae4c-f89008d8c9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:51:08.506481 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4382/8814] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 21:51:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:51:08.530263 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704d0e6-006c-4f44-9cb0-7e292d7c3b12 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:51:08.548176 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704d0e6-006c-4f44-9cb0-7e292d7c3b12 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:51:08.553223 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b9027-20bf-4e80-8140-4969474bc10e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:51:08.553817 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b9027-20bf-4e80-8140-4969474bc10e service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:51:08.554096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b9027-20bf-4e80-8140-4969474bc10e service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:51:08.554374 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b9027-20bf-4e80-8140-4969474bc10e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:51:08.562998 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b9027-20bf-4e80-8140-4969474bc10e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:51:08.564592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b9027-20bf-4e80-8140-4969474bc10e service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:51:08.574161 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4433/8815] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:51:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:51:18.507130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=13 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:51:18.570089 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=6 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:51:26.987369 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663c328-3195-4e04-ae4c-f89008d8c9d6 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:51:26.996716 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663c328-3195-4e04-ae4c-f89008d8c9d6 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:51:27.000285 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d6653-1c86-4b8c-b589-043be197535b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:51:27.000881 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d6653-1c86-4b8c-b589-043be197535b service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:51:27.001156 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d6653-1c86-4b8c-b589-043be197535b service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:51:27.002484 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d6653-1c86-4b8c-b589-043be197535b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:51:27.003917 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5f3d6653-1c86-4b8c-b589-043be197535b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:51:27.015945 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d6653-1c86-4b8c-b589-043be197535b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:51:27.018012 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d6653-1c86-4b8c-b589-043be197535b service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:51:27.028614 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4383/8816] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:51:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:51:37.022486 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:51:41.361935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87a9d5-0a55-4049-9cc2-36aeff991c21 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:51:41.362408 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87a9d5-0a55-4049-9cc2-36aeff991c21 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:51:41.362505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87a9d5-0a55-4049-9cc2-36aeff991c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:51:41.381288 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-be87a9d5-0a55-4049-9cc2-36aeff991c21 None None] MFA Rules not processed for user `7e3cdb291b6146bb8d30f96ed07f1a46`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:51:41.382465 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-be87a9d5-0a55-4049-9cc2-36aeff991c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:51:41.389167 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4434/8817] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:51:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:51:42.320383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e80f2a-20a9-4ca0-94c7-db8673d2c627 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:51:42.320814 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e80f2a-20a9-4ca0-94c7-db8673d2c627 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:51:42.320918 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e80f2a-20a9-4ca0-94c7-db8673d2c627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:51:42.361185 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f8e80f2a-20a9-4ca0-94c7-db8673d2c627 None None] MFA Rules not processed for user `5f9d53147a57402f8b9818590bc1fc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:51:42.362473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f8e80f2a-20a9-4ca0-94c7-db8673d2c627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:51:42.372708 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4384/8818] 10.222.0.33 () {58 vars in 1059 bytes} [Sat Aug 6 21:51:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:51:43.490404 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f08e1-386b-4247-943b-54751d6618e9 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:51:43.490996 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f08e1-386b-4247-943b-54751d6618e9 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:51:43.490996 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f08e1-386b-4247-943b-54751d6618e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:51:43.511862 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-af4f08e1-386b-4247-943b-54751d6618e9 None None] MFA Rules not processed for user `5f9d53147a57402f8b9818590bc1fc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:51:43.512990 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-af4f08e1-386b-4247-943b-54751d6618e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:51:43.523689 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4435/8819] 10.222.0.33 () {58 vars in 1059 bytes} [Sat Aug 6 21:51:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:51:47.065721 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be0523-ea6a-43dc-804b-e5d6d2222cd7 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:51:47.066252 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be0523-ea6a-43dc-804b-e5d6d2222cd7 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:51:47.066349 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be0523-ea6a-43dc-804b-e5d6d2222cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:51:47.085658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-05be0523-ea6a-43dc-804b-e5d6d2222cd7 None None] MFA Rules not processed for user `5f9d53147a57402f8b9818590bc1fc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:51:47.086946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-05be0523-ea6a-43dc-804b-e5d6d2222cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:51:47.095912 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4385/8820] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:51:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:51:47.106498 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f08e1-386b-4247-943b-54751d6618e9 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:51:47.116156 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f08e1-386b-4247-943b-54751d6618e9 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:51:47.119922 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ab636-98d0-4e35-b3b1-09c64c442902 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:51:47.120527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ab636-98d0-4e35-b3b1-09c64c442902 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:51:47.120809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ab636-98d0-4e35-b3b1-09c64c442902 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:51:47.121084 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ab636-98d0-4e35-b3b1-09c64c442902 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:51:47.132075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ab636-98d0-4e35-b3b1-09c64c442902 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:51:47.133527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ab636-98d0-4e35-b3b1-09c64c442902 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:51:47.144707 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4436/8821] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:51:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:51:48.321619 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fee7a-3254-418c-8fde-75f370ff9a31 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:51:48.322183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fee7a-3254-418c-8fde-75f370ff9a31 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:51:48.322438 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fee7a-3254-418c-8fde-75f370ff9a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:51:48.343031 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-be5fee7a-3254-418c-8fde-75f370ff9a31 None None] MFA Rules not processed for user `5f9d53147a57402f8b9818590bc1fc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:51:48.344249 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-be5fee7a-3254-418c-8fde-75f370ff9a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:51:48.354750 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4386/8822] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:51:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:51:48.366425 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ab636-98d0-4e35-b3b1-09c64c442902 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:51:48.375230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ab636-98d0-4e35-b3b1-09c64c442902 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:51:48.379082 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3991c61-0491-48f7-aef4-cbc6e75e06fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:51:48.379691 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3991c61-0491-48f7-aef4-cbc6e75e06fc service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:51:48.380202 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3991c61-0491-48f7-aef4-cbc6e75e06fc service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:51:48.380475 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3991c61-0491-48f7-aef4-cbc6e75e06fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:51:48.390891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3991c61-0491-48f7-aef4-cbc6e75e06fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:51:48.392608 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3991c61-0491-48f7-aef4-cbc6e75e06fc service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:51:48.403658 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4437/8823] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:51:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:51:53.131941 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4781924-1161-4656-8dff-dab0ca921dfc None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:51:53.132523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4781924-1161-4656-8dff-dab0ca921dfc None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:51:53.132738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4781924-1161-4656-8dff-dab0ca921dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:51:53.153514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d4781924-1161-4656-8dff-dab0ca921dfc None None] MFA Rules not processed for user `174e91100a184740b7c604730266dc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:51:53.154759 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d4781924-1161-4656-8dff-dab0ca921dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:51:53.162253 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4387/8824] 10.222.0.40 () {58 vars in 1015 bytes} [Sat Aug 6 21:51:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:51:53.174588 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3991c61-0491-48f7-aef4-cbc6e75e06fc service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:51:53.183180 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3991c61-0491-48f7-aef4-cbc6e75e06fc service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:51:53.186939 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dde91d-7f87-45c2-8499-6a563b3881e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:51:53.187623 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dde91d-7f87-45c2-8499-6a563b3881e9 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:51:53.188266 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dde91d-7f87-45c2-8499-6a563b3881e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:51:53.188540 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dde91d-7f87-45c2-8499-6a563b3881e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:51:53.196407 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dde91d-7f87-45c2-8499-6a563b3881e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:51:53.197830 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dde91d-7f87-45c2-8499-6a563b3881e9 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:51:53.206983 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4438/8825] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:51:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:52:03.148221 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=18 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:52:03.202917 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=24 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:52:32.237263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0222d2-569d-4ed1-b54f-ead12d2268b7 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:52:32.237767 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0222d2-569d-4ed1-b54f-ead12d2268b7 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:52:32.237857 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0222d2-569d-4ed1-b54f-ead12d2268b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:52:32.275981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-da0222d2-569d-4ed1-b54f-ead12d2268b7 None None] MFA Rules not processed for user `5f9d53147a57402f8b9818590bc1fc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:52:32.277201 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-da0222d2-569d-4ed1-b54f-ead12d2268b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:52:32.338120 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4388/8826] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 21:52:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:52:32.352487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dde91d-7f87-45c2-8499-6a563b3881e9 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:52:32.381108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dde91d-7f87-45c2-8499-6a563b3881e9 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:52:32.386676 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420fd11-7ade-4249-a4e0-175336384807 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:52:32.387281 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420fd11-7ade-4249-a4e0-175336384807 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:52:32.387571 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420fd11-7ade-4249-a4e0-175336384807 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:52:32.387845 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420fd11-7ade-4249-a4e0-175336384807 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:52:32.397690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2420fd11-7ade-4249-a4e0-175336384807 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:52:32.399329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2420fd11-7ade-4249-a4e0-175336384807 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:52:32.410398 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4439/8827] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:52:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:52:37.116728 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0222d2-569d-4ed1-b54f-ead12d2268b7 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:52:37.138939 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0222d2-569d-4ed1-b54f-ead12d2268b7 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:52:37.143686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa0a1b-08a6-4c64-b4c7-ff9f1fc18ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:52:37.144335 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa0a1b-08a6-4c64-b4c7-ff9f1fc18ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:52:37.144619 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa0a1b-08a6-4c64-b4c7-ff9f1fc18ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:52:37.144896 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa0a1b-08a6-4c64-b4c7-ff9f1fc18ea9 admin admin] PATH_INFO: `/v3/users/7e3cdb291b6146bb8d30f96ed07f1a46` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:52:37.146321 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fa0a1b-08a6-4c64-b4c7-ff9f1fc18ea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e3cdb291b6146bb8d30f96ed07f1a46)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:52:37.148374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fa0a1b-08a6-4c64-b4c7-ff9f1fc18ea9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:52:37.196800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-58fa0a1b-08a6-4c64-b4c7-ff9f1fc18ea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e3cdb291b6146bb8d30f96ed07f1a46'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:52:37.197469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-58fa0a1b-08a6-4c64-b4c7-ff9f1fc18ea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e3cdb291b6146bb8d30f96ed07f1a46'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:52:37.198088 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-58fa0a1b-08a6-4c64-b4c7-ff9f1fc18ea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e3cdb291b6146bb8d30f96ed07f1a46'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:52:37.206358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-58fa0a1b-08a6-4c64-b4c7-ff9f1fc18ea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e3cdb291b6146bb8d30f96ed07f1a46'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:52:37.218720 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-58fa0a1b-08a6-4c64-b4c7-ff9f1fc18ea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e3cdb291b6146bb8d30f96ed07f1a46'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:52:37.231341 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4389/8828] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:52:37 2022] DELETE /identity/v3/users/7e3cdb291b6146bb8d30f96ed07f1a46 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:52:37.407498 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420fd11-7ade-4249-a4e0-175336384807 service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:52:37.419029 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420fd11-7ade-4249-a4e0-175336384807 service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:52:37.478613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53f646-8c79-4541-81f1-5dd7c39be635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:52:37.479238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53f646-8c79-4541-81f1-5dd7c39be635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:52:37.479513 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53f646-8c79-4541-81f1-5dd7c39be635 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:52:37.479781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53f646-8c79-4541-81f1-5dd7c39be635 admin admin] PATH_INFO: `/v3/projects/31dd0cdecacf498d8623f2be190dc57c` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:52:37.480863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53f646-8c79-4541-81f1-5dd7c39be635 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31dd0cdecacf498d8623f2be190dc57c)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:52:37.482800 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53f646-8c79-4541-81f1-5dd7c39be635 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:52:37.527398 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cf53f646-8c79-4541-81f1-5dd7c39be635 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31dd0cdecacf498d8623f2be190dc57c', 'request_id': 'req-cf53f646-8c79-4541-81f1-5dd7c39be635'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:52:37.533109 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cf53f646-8c79-4541-81f1-5dd7c39be635 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31dd0cdecacf498d8623f2be190dc57c', 'request_id': 'req-cf53f646-8c79-4541-81f1-5dd7c39be635'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:52:37.541574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cf53f646-8c79-4541-81f1-5dd7c39be635 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31dd0cdecacf498d8623f2be190dc57c', 'request_id': 'req-cf53f646-8c79-4541-81f1-5dd7c39be635'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:52:37.553392 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cf53f646-8c79-4541-81f1-5dd7c39be635 admin admin] The token cache is being invalidate because project 31dd0cdecacf498d8623f2be190dc57c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:52:37.553678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cf53f646-8c79-4541-81f1-5dd7c39be635 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:52:37.554319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-cf53f646-8c79-4541-81f1-5dd7c39be635 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:52:37.555811 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4440/8829] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:52:37 2022] DELETE /identity/v3/projects/31dd0cdecacf498d8623f2be190dc57c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:52:37.560795 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76692596-ef8f-4ba1-9956-48af11c5a5d3 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:52:37.561182 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76692596-ef8f-4ba1-9956-48af11c5a5d3 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:52:37.561461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76692596-ef8f-4ba1-9956-48af11c5a5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:52:37.591404 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-76692596-ef8f-4ba1-9956-48af11c5a5d3 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:52:37.592614 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-76692596-ef8f-4ba1-9956-48af11c5a5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:52:37.643383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:52:37.654092 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4390/8830] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:52:37.665360 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123af52-b81b-45d2-aaba-8ef03fbd15dd None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:52:37.665870 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123af52-b81b-45d2-aaba-8ef03fbd15dd None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:52:37.666377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123af52-b81b-45d2-aaba-8ef03fbd15dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:52:37.688372 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-5123af52-b81b-45d2-aaba-8ef03fbd15dd None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:52:37.689575 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5123af52-b81b-45d2-aaba-8ef03fbd15dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:52:37.698247 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4441/8831] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:52:37.702624 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76692596-ef8f-4ba1-9956-48af11c5a5d3 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:52:37.713585 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76692596-ef8f-4ba1-9956-48af11c5a5d3 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:52:37.718240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb1e4d-fc7b-4cb2-8529-041452615390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:52:37.718868 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb1e4d-fc7b-4cb2-8529-041452615390 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:52:37.719154 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb1e4d-fc7b-4cb2-8529-041452615390 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:52:37.719429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb1e4d-fc7b-4cb2-8529-041452615390 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:52:37.720096 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb1e4d-fc7b-4cb2-8529-041452615390 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:52:37.720402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb1e4d-fc7b-4cb2-8529-041452615390 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:52:37.722005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb1e4d-fc7b-4cb2-8529-041452615390 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:52:37.734588 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4391/8832] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:52:37.739610 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123af52-b81b-45d2-aaba-8ef03fbd15dd None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:52:37.749430 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123af52-b81b-45d2-aaba-8ef03fbd15dd None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:52:37.754198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f089a-d14a-419e-9002-0cfcb679ef0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:52:37.755456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f089a-d14a-419e-9002-0cfcb679ef0d admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:52:37.755739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f089a-d14a-419e-9002-0cfcb679ef0d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:52:37.756010 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f089a-d14a-419e-9002-0cfcb679ef0d admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:52:37.756625 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f089a-d14a-419e-9002-0cfcb679ef0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:52:37.758515 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f089a-d14a-419e-9002-0cfcb679ef0d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:52:37.788177 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4442/8833] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:52:37 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:52:37.792257 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb1e4d-fc7b-4cb2-8529-041452615390 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:52:37.802077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb1e4d-fc7b-4cb2-8529-041452615390 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:52:37.858081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85a8cc-be67-4831-8158-7070501c7717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:52:37.858709 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85a8cc-be67-4831-8158-7070501c7717 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:52:37.858988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85a8cc-be67-4831-8158-7070501c7717 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:52:37.859257 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85a8cc-be67-4831-8158-7070501c7717 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:52:37.859870 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85a8cc-be67-4831-8158-7070501c7717 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:52:37.861774 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85a8cc-be67-4831-8158-7070501c7717 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:52:37.883018 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4392/8834] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:52:37 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:52:37.887155 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f089a-d14a-419e-9002-0cfcb679ef0d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:52:37.898048 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f089a-d14a-419e-9002-0cfcb679ef0d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:52:37.902719 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f72bfe-91ba-4be5-87ff-ba5998d98b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:52:37.903320 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f72bfe-91ba-4be5-87ff-ba5998d98b90 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:52:37.903599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f72bfe-91ba-4be5-87ff-ba5998d98b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:52:37.903867 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f72bfe-91ba-4be5-87ff-ba5998d98b90 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:52:37.904534 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f72bfe-91ba-4be5-87ff-ba5998d98b90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:52:37.906107 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f72bfe-91ba-4be5-87ff-ba5998d98b90 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:52:37.916532 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4443/8835] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:52:37.920509 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85a8cc-be67-4831-8158-7070501c7717 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:52:37.931107 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85a8cc-be67-4831-8158-7070501c7717 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:52:37.935704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796fcb2-febb-4b90-a271-3dc927426e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:52:37.936289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796fcb2-febb-4b90-a271-3dc927426e6a admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:52:37.936565 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796fcb2-febb-4b90-a271-3dc927426e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:52:37.936832 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796fcb2-febb-4b90-a271-3dc927426e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:52:37.937455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e796fcb2-febb-4b90-a271-3dc927426e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:52:37.939082 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e796fcb2-febb-4b90-a271-3dc927426e6a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:52:37.950399 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4393/8836] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:52:37.954630 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f72bfe-91ba-4be5-87ff-ba5998d98b90 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:52:37.964937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f72bfe-91ba-4be5-87ff-ba5998d98b90 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:52:37.969526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14be7c-54a6-4537-bdc5-b1d82d954a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:52:37.970165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14be7c-54a6-4537-bdc5-b1d82d954a22 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:52:37.970439 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14be7c-54a6-4537-bdc5-b1d82d954a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:52:37.970748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14be7c-54a6-4537-bdc5-b1d82d954a22 admin admin] PATH_INFO: `/v3/projects/4f472e712d724af589c11ca6a4d4be0f/users/3704af7501d24e93935fbc61a532d293/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:52:37.985265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14be7c-54a6-4537-bdc5-b1d82d954a22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f472e712d724af589c11ca6a4d4be0f, user_id=3704af7501d24e93935fbc61a532d293, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:52:37.987925 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14be7c-54a6-4537-bdc5-b1d82d954a22 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:52:38.001656 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4444/8837] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:52:37 2022] PUT /identity/v3/projects/4f472e712d724af589c11ca6a4d4be0f/users/3704af7501d24e93935fbc61a532d293/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:52:38.007391 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854604eb-d86f-4a7f-9df4-7b9deb5f587c None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:52:38.007683 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854604eb-d86f-4a7f-9df4-7b9deb5f587c None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:52:38.007963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854604eb-d86f-4a7f-9df4-7b9deb5f587c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:52:38.026658 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-854604eb-d86f-4a7f-9df4-7b9deb5f587c None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:52:38.027888 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-854604eb-d86f-4a7f-9df4-7b9deb5f587c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:52:38.086276 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4394/8838] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:52:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:52:38.095974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14be7c-54a6-4537-bdc5-b1d82d954a22 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:52:38.097754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-cc14be7c-54a6-4537-bdc5-b1d82d954a22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:52:38.103382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:52:38.155483 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14be7c-54a6-4537-bdc5-b1d82d954a22 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:52:38.159115 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a9f47-e6cc-480f-b98c-847cc01949f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:52:38.159709 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a9f47-e6cc-480f-b98c-847cc01949f5 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:52:38.159991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a9f47-e6cc-480f-b98c-847cc01949f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:52:38.160261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a9f47-e6cc-480f-b98c-847cc01949f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:52:38.169323 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a9f47-e6cc-480f-b98c-847cc01949f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:52:38.170770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a9f47-e6cc-480f-b98c-847cc01949f5 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:52:38.180719 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4445/8839] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:52:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:52:42.472474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f70be8-7a1d-4aee-aa8e-3f911e015c9b None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:52:42.473009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f70be8-7a1d-4aee-aa8e-3f911e015c9b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:52:42.473202 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f70be8-7a1d-4aee-aa8e-3f911e015c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:52:42.512473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-99f70be8-7a1d-4aee-aa8e-3f911e015c9b None None] MFA Rules not processed for user `3704af7501d24e93935fbc61a532d293`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:52:42.513596 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-99f70be8-7a1d-4aee-aa8e-3f911e015c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:52:42.591907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:52:42.607012 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4395/8840] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:52:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:52:42.618491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175cf67-8fb0-4c64-a8c6-4f298eccac60 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:52:42.619088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175cf67-8fb0-4c64-a8c6-4f298eccac60 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:52:42.619088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175cf67-8fb0-4c64-a8c6-4f298eccac60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:52:42.639420 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-0175cf67-8fb0-4c64-a8c6-4f298eccac60 None None] MFA Rules not processed for user `3704af7501d24e93935fbc61a532d293`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:52:42.640990 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0175cf67-8fb0-4c64-a8c6-4f298eccac60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:52:42.649381 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4446/8841] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:52:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:52:42.666639 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f70be8-7a1d-4aee-aa8e-3f911e015c9b None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:52:42.670147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-99f70be8-7a1d-4aee-aa8e-3f911e015c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:52:42.757101 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f70be8-7a1d-4aee-aa8e-3f911e015c9b None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:52:42.763229 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d076324-5098-4b92-9a06-2a7f59fac1b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:52:42.763855 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d076324-5098-4b92-9a06-2a7f59fac1b6 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:52:42.764152 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d076324-5098-4b92-9a06-2a7f59fac1b6 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:52:42.764743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d076324-5098-4b92-9a06-2a7f59fac1b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:52:42.778596 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d076324-5098-4b92-9a06-2a7f59fac1b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:52:42.780211 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d076324-5098-4b92-9a06-2a7f59fac1b6 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:52:42.794209 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4396/8842] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:52:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:52:43.075014 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb7fbd-951a-40bf-afe0-718247fa8218 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:52:43.075306 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb7fbd-951a-40bf-afe0-718247fa8218 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:52:43.075585 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb7fbd-951a-40bf-afe0-718247fa8218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:52:43.095871 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a9cb7fbd-951a-40bf-afe0-718247fa8218 None None] MFA Rules not processed for user `174e91100a184740b7c604730266dc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:52:43.097055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a9cb7fbd-951a-40bf-afe0-718247fa8218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:52:43.104690 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4447/8843] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:52:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:52:43.116060 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d076324-5098-4b92-9a06-2a7f59fac1b6 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:52:43.125265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d076324-5098-4b92-9a06-2a7f59fac1b6 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:52:43.128821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe63e57-8d61-4f84-b3f1-d211ebd2262c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:52:43.129414 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe63e57-8d61-4f84-b3f1-d211ebd2262c service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:52:43.129866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe63e57-8d61-4f84-b3f1-d211ebd2262c service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:52:43.130212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe63e57-8d61-4f84-b3f1-d211ebd2262c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:52:43.137307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe63e57-8d61-4f84-b3f1-d211ebd2262c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:52:43.138826 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe63e57-8d61-4f84-b3f1-d211ebd2262c service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:52:43.147612 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4397/8844] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:52:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:52:50.776230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4f6ae-b1f2-48a8-935e-f59f89e0bd97 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:52:50.776741 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4f6ae-b1f2-48a8-935e-f59f89e0bd97 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:52:50.776923 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4f6ae-b1f2-48a8-935e-f59f89e0bd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:52:50.798331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-02e4f6ae-b1f2-48a8-935e-f59f89e0bd97 None None] MFA Rules not processed for user `5f9d53147a57402f8b9818590bc1fc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:52:50.800127 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-02e4f6ae-b1f2-48a8-935e-f59f89e0bd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:52:50.818718 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4448/8845] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 21:52:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:52:50.835613 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe63e57-8d61-4f84-b3f1-d211ebd2262c service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:52:50.856068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe63e57-8d61-4f84-b3f1-d211ebd2262c service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:52:50.861625 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98d5c5-88bf-4365-9990-02d660405375 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:52:50.862272 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98d5c5-88bf-4365-9990-02d660405375 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:52:50.862567 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98d5c5-88bf-4365-9990-02d660405375 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:52:50.862844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98d5c5-88bf-4365-9990-02d660405375 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:52:50.872639 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98d5c5-88bf-4365-9990-02d660405375 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:52:50.874214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98d5c5-88bf-4365-9990-02d660405375 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:52:50.884415 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4398/8846] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:52:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:52:53.073342 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f63333-e0e0-4df6-85c2-98f81ee9eea8 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:52:53.073935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f63333-e0e0-4df6-85c2-98f81ee9eea8 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:52:53.073935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f63333-e0e0-4df6-85c2-98f81ee9eea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:52:53.093394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-91f63333-e0e0-4df6-85c2-98f81ee9eea8 None None] MFA Rules not processed for user `3704af7501d24e93935fbc61a532d293`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:52:53.094506 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-91f63333-e0e0-4df6-85c2-98f81ee9eea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:52:53.102368 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4449/8847] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:52:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:52:55.611415 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aead2ab-07e4-4271-b278-fe4ab2d07bdb None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:52:55.612017 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aead2ab-07e4-4271-b278-fe4ab2d07bdb None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:52:55.612282 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aead2ab-07e4-4271-b278-fe4ab2d07bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:52:55.634224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-4aead2ab-07e4-4271-b278-fe4ab2d07bdb None None] MFA Rules not processed for user `174e91100a184740b7c604730266dc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:52:55.635762 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4aead2ab-07e4-4271-b278-fe4ab2d07bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:52:55.642988 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4399/8848] 10.222.0.23 () {58 vars in 1015 bytes} [Sat Aug 6 21:52:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:52:55.655602 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f63333-e0e0-4df6-85c2-98f81ee9eea8 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:52:55.657141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-91f63333-e0e0-4df6-85c2-98f81ee9eea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:52:55.671455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f63333-e0e0-4df6-85c2-98f81ee9eea8 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:52:55.676275 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80b101-ba2b-4c09-88b9-eb5a351897ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:52:55.676645 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80b101-ba2b-4c09-88b9-eb5a351897ec service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:52:55.677086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80b101-ba2b-4c09-88b9-eb5a351897ec service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:52:55.678272 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80b101-ba2b-4c09-88b9-eb5a351897ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:52:55.686386 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80b101-ba2b-4c09-88b9-eb5a351897ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:52:55.687901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80b101-ba2b-4c09-88b9-eb5a351897ec service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:52:55.697152 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4450/8849] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:52:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:53:05.627881 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=51 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:53:05.692643 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=43 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:53:12.945390 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aead2ab-07e4-4271-b278-fe4ab2d07bdb None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:12.947008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4aead2ab-07e4-4271-b278-fe4ab2d07bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:53:13.012247 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80b101-ba2b-4c09-88b9-eb5a351897ec service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:13.025005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80b101-ba2b-4c09-88b9-eb5a351897ec service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:13.029842 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c4097-118f-4878-aef3-cb9b3d44f91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:13.030474 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c4097-118f-4878-aef3-cb9b3d44f91d admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:13.030954 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c4097-118f-4878-aef3-cb9b3d44f91d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:13.031230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c4097-118f-4878-aef3-cb9b3d44f91d admin admin] PATH_INFO: `/v3/users/3704af7501d24e93935fbc61a532d293` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:13.032348 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c4097-118f-4878-aef3-cb9b3d44f91d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3704af7501d24e93935fbc61a532d293)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:13.034248 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c4097-118f-4878-aef3-cb9b3d44f91d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:13.041058 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aead2ab-07e4-4271-b278-fe4ab2d07bdb None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:13.046053 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe6609-2655-43fa-a411-ba8db374f9b2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:13.046687 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe6609-2655-43fa-a411-ba8db374f9b2 service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:13.046963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe6609-2655-43fa-a411-ba8db374f9b2 service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:13.047235 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe6609-2655-43fa-a411-ba8db374f9b2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:13.048960 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a4fe6609-2655-43fa-a411-ba8db374f9b2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:53:13.065237 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe6609-2655-43fa-a411-ba8db374f9b2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:13.067587 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe6609-2655-43fa-a411-ba8db374f9b2 service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:13.083394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-658c4097-118f-4878-aef3-cb9b3d44f91d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3704af7501d24e93935fbc61a532d293'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:53:13.083655 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4400/8850] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:53:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:53:13.091984 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-658c4097-118f-4878-aef3-cb9b3d44f91d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3704af7501d24e93935fbc61a532d293'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:53:13.092707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-658c4097-118f-4878-aef3-cb9b3d44f91d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3704af7501d24e93935fbc61a532d293'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:53:13.093333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-658c4097-118f-4878-aef3-cb9b3d44f91d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3704af7501d24e93935fbc61a532d293'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:53:13.102637 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-658c4097-118f-4878-aef3-cb9b3d44f91d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3704af7501d24e93935fbc61a532d293'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:53:13.123200 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4451/8851] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:53:13 2022] DELETE /identity/v3/users/3704af7501d24e93935fbc61a532d293 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:53:13.302223 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe6609-2655-43fa-a411-ba8db374f9b2 service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:13.313060 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe6609-2655-43fa-a411-ba8db374f9b2 service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:13.370801 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e568f6-1494-4bdc-8f9b-ceaefef82a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:13.371461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e568f6-1494-4bdc-8f9b-ceaefef82a04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:13.371743 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e568f6-1494-4bdc-8f9b-ceaefef82a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:13.372054 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e568f6-1494-4bdc-8f9b-ceaefef82a04 admin admin] PATH_INFO: `/v3/projects/4f472e712d724af589c11ca6a4d4be0f` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:13.373159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e568f6-1494-4bdc-8f9b-ceaefef82a04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f472e712d724af589c11ca6a4d4be0f)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:13.375137 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e568f6-1494-4bdc-8f9b-ceaefef82a04 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:13.422046 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e6e568f6-1494-4bdc-8f9b-ceaefef82a04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f472e712d724af589c11ca6a4d4be0f', 'request_id': 'req-e6e568f6-1494-4bdc-8f9b-ceaefef82a04'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:53:13.427621 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e6e568f6-1494-4bdc-8f9b-ceaefef82a04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f472e712d724af589c11ca6a4d4be0f', 'request_id': 'req-e6e568f6-1494-4bdc-8f9b-ceaefef82a04'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:53:13.434496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e6e568f6-1494-4bdc-8f9b-ceaefef82a04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f472e712d724af589c11ca6a4d4be0f', 'request_id': 'req-e6e568f6-1494-4bdc-8f9b-ceaefef82a04'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:53:13.447716 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e6e568f6-1494-4bdc-8f9b-ceaefef82a04 admin admin] The token cache is being invalidate because project 4f472e712d724af589c11ca6a4d4be0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:53:13.448003 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e6e568f6-1494-4bdc-8f9b-ceaefef82a04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:53:13.448645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-e6e568f6-1494-4bdc-8f9b-ceaefef82a04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:53:13.450135 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4401/8852] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:53:13 2022] DELETE /identity/v3/projects/4f472e712d724af589c11ca6a4d4be0f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:53:13.455615 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26873b-34f9-48dd-8815-18862ce7cf3e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:13.455906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26873b-34f9-48dd-8815-18862ce7cf3e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:13.456184 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26873b-34f9-48dd-8815-18862ce7cf3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:13.476215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-aa26873b-34f9-48dd-8815-18862ce7cf3e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:53:13.477456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-aa26873b-34f9-48dd-8815-18862ce7cf3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:53:13.540653 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4452/8853] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:53:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:53:13.548895 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b1bf4-3819-43d1-a55d-1ec3c636f6fa None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:13.549122 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b1bf4-3819-43d1-a55d-1ec3c636f6fa None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:13.549400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b1bf4-3819-43d1-a55d-1ec3c636f6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:13.569249 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-3f6b1bf4-3819-43d1-a55d-1ec3c636f6fa None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:53:13.571094 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3f6b1bf4-3819-43d1-a55d-1ec3c636f6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:53:13.578972 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4402/8854] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:53:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:53:13.583547 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26873b-34f9-48dd-8815-18862ce7cf3e None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:13.593490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26873b-34f9-48dd-8815-18862ce7cf3e None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:13.598055 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60fc39b-2cff-493a-bd35-fd5f0f3ca41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:13.598679 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fc39b-2cff-493a-bd35-fd5f0f3ca41d admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:13.598956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fc39b-2cff-493a-bd35-fd5f0f3ca41d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:13.599223 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fc39b-2cff-493a-bd35-fd5f0f3ca41d admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:13.599884 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60fc39b-2cff-493a-bd35-fd5f0f3ca41d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:53:13.600185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60fc39b-2cff-493a-bd35-fd5f0f3ca41d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:13.601973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60fc39b-2cff-493a-bd35-fd5f0f3ca41d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:13.613447 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4453/8855] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:53:13.618730 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b1bf4-3819-43d1-a55d-1ec3c636f6fa None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:13.623066 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:53:13.629712 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b1bf4-3819-43d1-a55d-1ec3c636f6fa None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:13.636292 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d6f28-fd47-44f3-9906-3d7d5ece6235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:13.636887 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d6f28-fd47-44f3-9906-3d7d5ece6235 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:13.637165 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d6f28-fd47-44f3-9906-3d7d5ece6235 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:13.637437 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d6f28-fd47-44f3-9906-3d7d5ece6235 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:13.638055 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15d6f28-fd47-44f3-9906-3d7d5ece6235 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:13.640009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15d6f28-fd47-44f3-9906-3d7d5ece6235 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:13.671008 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4403/8856] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:53:13 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:53:13.672242 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60fc39b-2cff-493a-bd35-fd5f0f3ca41d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:13.682866 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60fc39b-2cff-493a-bd35-fd5f0f3ca41d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:13.737930 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7708c19-3046-45f5-bb49-396933e5ecb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:13.738526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7708c19-3046-45f5-bb49-396933e5ecb4 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:13.738835 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7708c19-3046-45f5-bb49-396933e5ecb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:13.739108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7708c19-3046-45f5-bb49-396933e5ecb4 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:13.739711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7708c19-3046-45f5-bb49-396933e5ecb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:13.742142 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7708c19-3046-45f5-bb49-396933e5ecb4 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:13.749902 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:53:13.765336 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4454/8857] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:53:13 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:53:13.769677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d6f28-fd47-44f3-9906-3d7d5ece6235 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:13.780327 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d6f28-fd47-44f3-9906-3d7d5ece6235 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:13.785021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c07bf2-b472-4245-b872-732d6b45dbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:13.785620 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c07bf2-b472-4245-b872-732d6b45dbc7 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:13.785901 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c07bf2-b472-4245-b872-732d6b45dbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:13.786173 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c07bf2-b472-4245-b872-732d6b45dbc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:13.786847 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c07bf2-b472-4245-b872-732d6b45dbc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:13.789173 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c07bf2-b472-4245-b872-732d6b45dbc7 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:13.799071 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4404/8858] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:53:13.802875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7708c19-3046-45f5-bb49-396933e5ecb4 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:13.813526 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7708c19-3046-45f5-bb49-396933e5ecb4 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:13.818193 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9990cd-f7da-430e-bd3f-9d367530980f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:13.818826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9990cd-f7da-430e-bd3f-9d367530980f admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:13.819113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9990cd-f7da-430e-bd3f-9d367530980f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:13.819387 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9990cd-f7da-430e-bd3f-9d367530980f admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:13.820146 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9990cd-f7da-430e-bd3f-9d367530980f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:13.822219 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9990cd-f7da-430e-bd3f-9d367530980f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:13.833637 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4455/8859] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:53:13.838234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c07bf2-b472-4245-b872-732d6b45dbc7 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:13.848962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c07bf2-b472-4245-b872-732d6b45dbc7 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:13.854252 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76085c24-0098-49b3-8fbe-f991db58f978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:13.854932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76085c24-0098-49b3-8fbe-f991db58f978 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:13.855212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76085c24-0098-49b3-8fbe-f991db58f978 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:13.855487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76085c24-0098-49b3-8fbe-f991db58f978 admin admin] PATH_INFO: `/v3/projects/8a2dec32ca8e40c69b825bc5b101bac8/users/87937691582e40808d40ecaecab4b16e/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:13.870653 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76085c24-0098-49b3-8fbe-f991db58f978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a2dec32ca8e40c69b825bc5b101bac8, user_id=87937691582e40808d40ecaecab4b16e, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:13.873319 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76085c24-0098-49b3-8fbe-f991db58f978 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:13.886782 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4405/8860] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:53:13 2022] PUT /identity/v3/projects/8a2dec32ca8e40c69b825bc5b101bac8/users/87937691582e40808d40ecaecab4b16e/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:53:13.898671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce75ed-44ac-4486-9d28-e68ba0a26b25 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:13.898965 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce75ed-44ac-4486-9d28-e68ba0a26b25 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:13.899332 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce75ed-44ac-4486-9d28-e68ba0a26b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:13.927926 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-acce75ed-44ac-4486-9d28-e68ba0a26b25 None None] MFA Rules not processed for user `87937691582e40808d40ecaecab4b16e`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:53:13.929967 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-acce75ed-44ac-4486-9d28-e68ba0a26b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:53:13.994328 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4456/8861] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:53:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:53:14.004473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76085c24-0098-49b3-8fbe-f991db58f978 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:14.006270 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-76085c24-0098-49b3-8fbe-f991db58f978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:53:14.074932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76085c24-0098-49b3-8fbe-f991db58f978 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:14.078506 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2730f9c-c752-4b6c-93b6-c0e4b5e037a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:14.079131 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2730f9c-c752-4b6c-93b6-c0e4b5e037a3 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:14.079412 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2730f9c-c752-4b6c-93b6-c0e4b5e037a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:14.079686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2730f9c-c752-4b6c-93b6-c0e4b5e037a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:14.089014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2730f9c-c752-4b6c-93b6-c0e4b5e037a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:14.090592 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2730f9c-c752-4b6c-93b6-c0e4b5e037a3 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:14.099964 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4406/8862] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:53:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:53:19.248421 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f8362-c5af-485e-bb89-df8d4e329df8 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:19.248910 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f8362-c5af-485e-bb89-df8d4e329df8 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:19.249053 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f8362-c5af-485e-bb89-df8d4e329df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:19.269112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-7a8f8362-c5af-485e-bb89-df8d4e329df8 None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:53:19.270249 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7a8f8362-c5af-485e-bb89-df8d4e329df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:53:19.351414 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4457/8863] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 21:53:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:53:19.363498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2730f9c-c752-4b6c-93b6-c0e4b5e037a3 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:19.364989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f2730f9c-c752-4b6c-93b6-c0e4b5e037a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:53:19.380919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2730f9c-c752-4b6c-93b6-c0e4b5e037a3 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:19.387244 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b77f2-0197-4bab-ae25-55de47391003 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:19.388014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b77f2-0197-4bab-ae25-55de47391003 service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:19.388526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b77f2-0197-4bab-ae25-55de47391003 service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:19.388798 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b77f2-0197-4bab-ae25-55de47391003 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:19.398269 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b77f2-0197-4bab-ae25-55de47391003 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:19.400097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b77f2-0197-4bab-ae25-55de47391003 service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:19.410329 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4407/8864] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:53:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:53:20.435894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f8362-c5af-485e-bb89-df8d4e329df8 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:20.446981 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f8362-c5af-485e-bb89-df8d4e329df8 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:20.452520 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f616d11-65d4-4432-95e3-2847f614ccda service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:20.453344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f616d11-65d4-4432-95e3-2847f614ccda service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:20.453624 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f616d11-65d4-4432-95e3-2847f614ccda service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:20.453899 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f616d11-65d4-4432-95e3-2847f614ccda service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:20.456024 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-5f616d11-65d4-4432-95e3-2847f614ccda service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:53:20.472913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f616d11-65d4-4432-95e3-2847f614ccda service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:20.474515 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f616d11-65d4-4432-95e3-2847f614ccda service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:20.489194 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4458/8865] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:53:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:53:25.656404 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b77f2-0197-4bab-ae25-55de47391003 service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:25.727410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b77f2-0197-4bab-ae25-55de47391003 service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:25.732167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff53d93-446f-4b7e-b49c-52c3875e9b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:25.732791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff53d93-446f-4b7e-b49c-52c3875e9b5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:25.733072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff53d93-446f-4b7e-b49c-52c3875e9b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:25.733347 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff53d93-446f-4b7e-b49c-52c3875e9b5b admin admin] PATH_INFO: `/v3/users/87937691582e40808d40ecaecab4b16e` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:25.734461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff53d93-446f-4b7e-b49c-52c3875e9b5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=87937691582e40808d40ecaecab4b16e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:25.736477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff53d93-446f-4b7e-b49c-52c3875e9b5b admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:25.765075 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:53:25.785294 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dff53d93-446f-4b7e-b49c-52c3875e9b5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87937691582e40808d40ecaecab4b16e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:53:25.785969 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dff53d93-446f-4b7e-b49c-52c3875e9b5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87937691582e40808d40ecaecab4b16e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:53:25.786626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dff53d93-446f-4b7e-b49c-52c3875e9b5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87937691582e40808d40ecaecab4b16e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:53:25.796532 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dff53d93-446f-4b7e-b49c-52c3875e9b5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87937691582e40808d40ecaecab4b16e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:53:25.809253 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-dff53d93-446f-4b7e-b49c-52c3875e9b5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87937691582e40808d40ecaecab4b16e'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:53:25.821262 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4408/8866] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:53:25 2022] DELETE /identity/v3/users/87937691582e40808d40ecaecab4b16e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:53:25.825749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3cd99-213d-4c46-89b6-ca06b2cd9f09 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:25.826319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3cd99-213d-4c46-89b6-ca06b2cd9f09 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:25.826319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3cd99-213d-4c46-89b6-ca06b2cd9f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:25.845608 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-f6f3cd99-213d-4c46-89b6-ca06b2cd9f09 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:53:25.846819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f6f3cd99-213d-4c46-89b6-ca06b2cd9f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:53:25.893446 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:53:25.910579 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4459/8867] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:53:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:53:25.921076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff53d93-446f-4b7e-b49c-52c3875e9b5b admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:25.922509 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-dff53d93-446f-4b7e-b49c-52c3875e9b5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:53:25.984118 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff53d93-446f-4b7e-b49c-52c3875e9b5b admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:25.988249 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece35cb-9436-4ac6-8509-779373997618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:25.988866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece35cb-9436-4ac6-8509-779373997618 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:25.989137 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece35cb-9436-4ac6-8509-779373997618 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:25.989407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece35cb-9436-4ac6-8509-779373997618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:25.999725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece35cb-9436-4ac6-8509-779373997618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:26.001159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece35cb-9436-4ac6-8509-779373997618 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:26.010760 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4409/8868] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:53:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:53:26.182380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3cd99-213d-4c46-89b6-ca06b2cd9f09 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:26.183988 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f6f3cd99-213d-4c46-89b6-ca06b2cd9f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:53:26.197818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3cd99-213d-4c46-89b6-ca06b2cd9f09 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:26.202554 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f2b60-6af0-47ed-8c38-626aefc9f137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:26.203212 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f2b60-6af0-47ed-8c38-626aefc9f137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:26.203491 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f2b60-6af0-47ed-8c38-626aefc9f137 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:26.203762 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f2b60-6af0-47ed-8c38-626aefc9f137 admin admin] PATH_INFO: `/v3/projects/8a2dec32ca8e40c69b825bc5b101bac8` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:26.204875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f2b60-6af0-47ed-8c38-626aefc9f137 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a2dec32ca8e40c69b825bc5b101bac8)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:26.207078 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f2b60-6af0-47ed-8c38-626aefc9f137 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:26.254353 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-da0f2b60-6af0-47ed-8c38-626aefc9f137 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a2dec32ca8e40c69b825bc5b101bac8', 'request_id': 'req-da0f2b60-6af0-47ed-8c38-626aefc9f137'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:53:26.259767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-da0f2b60-6af0-47ed-8c38-626aefc9f137 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a2dec32ca8e40c69b825bc5b101bac8', 'request_id': 'req-da0f2b60-6af0-47ed-8c38-626aefc9f137'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:53:26.267011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-da0f2b60-6af0-47ed-8c38-626aefc9f137 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a2dec32ca8e40c69b825bc5b101bac8', 'request_id': 'req-da0f2b60-6af0-47ed-8c38-626aefc9f137'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:53:26.278438 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-da0f2b60-6af0-47ed-8c38-626aefc9f137 admin admin] The token cache is being invalidate because project 8a2dec32ca8e40c69b825bc5b101bac8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:53:26.278765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-da0f2b60-6af0-47ed-8c38-626aefc9f137 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:53:26.279383 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-da0f2b60-6af0-47ed-8c38-626aefc9f137 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:53:26.280986 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4460/8869] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:53:26 2022] DELETE /identity/v3/projects/8a2dec32ca8e40c69b825bc5b101bac8 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:53:26.286376 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78eca6-037b-40a9-952c-8b29d466a1f1 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:26.286702 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78eca6-037b-40a9-952c-8b29d466a1f1 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:26.287007 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78eca6-037b-40a9-952c-8b29d466a1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:26.308119 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-7e78eca6-037b-40a9-952c-8b29d466a1f1 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:53:26.309313 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7e78eca6-037b-40a9-952c-8b29d466a1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:53:26.368948 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4410/8870] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:53:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:53:26.376657 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15730fb3-5854-4bd8-a37a-6a2d8879c652 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:26.376966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15730fb3-5854-4bd8-a37a-6a2d8879c652 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:26.377238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15730fb3-5854-4bd8-a37a-6a2d8879c652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:26.396235 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-15730fb3-5854-4bd8-a37a-6a2d8879c652 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:53:26.397976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-15730fb3-5854-4bd8-a37a-6a2d8879c652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:53:26.405812 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4461/8871] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:53:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:53:26.409891 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78eca6-037b-40a9-952c-8b29d466a1f1 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:26.420468 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78eca6-037b-40a9-952c-8b29d466a1f1 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:26.424982 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f5c5c-e8fd-450a-9a65-00c2d35d1d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:26.425817 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f5c5c-e8fd-450a-9a65-00c2d35d1d81 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:26.426101 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f5c5c-e8fd-450a-9a65-00c2d35d1d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:26.426374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f5c5c-e8fd-450a-9a65-00c2d35d1d81 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:26.427399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f5c5c-e8fd-450a-9a65-00c2d35d1d81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:53:26.429400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f5c5c-e8fd-450a-9a65-00c2d35d1d81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:26.431036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f5c5c-e8fd-450a-9a65-00c2d35d1d81 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:26.442374 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4411/8872] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:53:26.447432 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15730fb3-5854-4bd8-a37a-6a2d8879c652 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:26.456810 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15730fb3-5854-4bd8-a37a-6a2d8879c652 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:26.461695 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de26bc-d982-461b-ab56-b813a6f6907c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:26.462294 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de26bc-d982-461b-ab56-b813a6f6907c admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:26.462596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de26bc-d982-461b-ab56-b813a6f6907c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:26.462875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de26bc-d982-461b-ab56-b813a6f6907c admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:26.463502 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de26bc-d982-461b-ab56-b813a6f6907c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:26.465393 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de26bc-d982-461b-ab56-b813a6f6907c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:26.493683 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4462/8873] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:53:26 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:53:26.497870 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f5c5c-e8fd-450a-9a65-00c2d35d1d81 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:26.508528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f5c5c-e8fd-450a-9a65-00c2d35d1d81 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:26.540649 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:53:26.572465 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00554e3a-0727-499b-8556-dc4b590b7bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:26.573077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00554e3a-0727-499b-8556-dc4b590b7bd9 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:26.573359 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00554e3a-0727-499b-8556-dc4b590b7bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:26.573635 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00554e3a-0727-499b-8556-dc4b590b7bd9 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:26.574266 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00554e3a-0727-499b-8556-dc4b590b7bd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:26.576400 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00554e3a-0727-499b-8556-dc4b590b7bd9 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:26.599336 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4412/8874] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:53:26 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:53:26.605287 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de26bc-d982-461b-ab56-b813a6f6907c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:26.616250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de26bc-d982-461b-ab56-b813a6f6907c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:26.620943 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c133dc-875a-4c11-9f0a-b486120f6449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:26.621542 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c133dc-875a-4c11-9f0a-b486120f6449 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:26.621827 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c133dc-875a-4c11-9f0a-b486120f6449 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:26.622088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c133dc-875a-4c11-9f0a-b486120f6449 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:26.622767 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c133dc-875a-4c11-9f0a-b486120f6449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:26.624354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c133dc-875a-4c11-9f0a-b486120f6449 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:26.634950 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4463/8875] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:53:26.638825 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00554e3a-0727-499b-8556-dc4b590b7bd9 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:26.649602 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00554e3a-0727-499b-8556-dc4b590b7bd9 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:26.654334 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb814a-6688-4cac-bca0-2c48505a31d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:26.654962 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb814a-6688-4cac-bca0-2c48505a31d2 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:26.655248 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb814a-6688-4cac-bca0-2c48505a31d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:26.655523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb814a-6688-4cac-bca0-2c48505a31d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:26.656161 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb814a-6688-4cac-bca0-2c48505a31d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:26.657768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb814a-6688-4cac-bca0-2c48505a31d2 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:26.670361 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4413/8876] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:53:26.672195 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c133dc-875a-4c11-9f0a-b486120f6449 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:26.682801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c133dc-875a-4c11-9f0a-b486120f6449 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:26.687596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed803e7-12c8-4c0a-bdf6-9da496d6a7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:26.688249 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed803e7-12c8-4c0a-bdf6-9da496d6a7b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:26.688533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed803e7-12c8-4c0a-bdf6-9da496d6a7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:26.688833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed803e7-12c8-4c0a-bdf6-9da496d6a7b8 admin admin] PATH_INFO: `/v3/projects/f553ca7a11e74ea6a15c25a1e131f9a2/users/a7bd11a46e0248e59feba426577fd9a8/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:26.705738 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed803e7-12c8-4c0a-bdf6-9da496d6a7b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f553ca7a11e74ea6a15c25a1e131f9a2, user_id=a7bd11a46e0248e59feba426577fd9a8, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:26.708640 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed803e7-12c8-4c0a-bdf6-9da496d6a7b8 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:26.721747 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4464/8877] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:53:26 2022] PUT /identity/v3/projects/f553ca7a11e74ea6a15c25a1e131f9a2/users/a7bd11a46e0248e59feba426577fd9a8/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:53:26.732346 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74637cf1-5070-42e7-9d87-bc5b775094c9 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:26.732634 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74637cf1-5070-42e7-9d87-bc5b775094c9 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:26.732907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74637cf1-5070-42e7-9d87-bc5b775094c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:26.760889 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-74637cf1-5070-42e7-9d87-bc5b775094c9 None None] MFA Rules not processed for user `a7bd11a46e0248e59feba426577fd9a8`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:53:26.762029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-74637cf1-5070-42e7-9d87-bc5b775094c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:53:26.826670 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4414/8878] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:53:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:53:26.837489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed803e7-12c8-4c0a-bdf6-9da496d6a7b8 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:26.839395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-2ed803e7-12c8-4c0a-bdf6-9da496d6a7b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:53:26.894906 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed803e7-12c8-4c0a-bdf6-9da496d6a7b8 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:26.900108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70aba26-663c-427c-91ef-756c4671cf33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:26.900894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70aba26-663c-427c-91ef-756c4671cf33 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:26.901387 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70aba26-663c-427c-91ef-756c4671cf33 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:26.901879 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70aba26-663c-427c-91ef-756c4671cf33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:26.910388 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70aba26-663c-427c-91ef-756c4671cf33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:26.911871 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70aba26-663c-427c-91ef-756c4671cf33 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:26.920845 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4465/8879] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:53:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:53:30.565279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74637cf1-5070-42e7-9d87-bc5b775094c9 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:30.628414 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74637cf1-5070-42e7-9d87-bc5b775094c9 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:30.633657 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739ebf0-b6c2-44e7-a006-30688ed242a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:30.634281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739ebf0-b6c2-44e7-a006-30688ed242a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:30.634590 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739ebf0-b6c2-44e7-a006-30688ed242a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:30.634873 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739ebf0-b6c2-44e7-a006-30688ed242a4 admin admin] PATH_INFO: `/v3/users/a7bd11a46e0248e59feba426577fd9a8` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:30.635999 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739ebf0-b6c2-44e7-a006-30688ed242a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7bd11a46e0248e59feba426577fd9a8)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:30.637906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739ebf0-b6c2-44e7-a006-30688ed242a4 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:30.689749 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:53:30.693247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5739ebf0-b6c2-44e7-a006-30688ed242a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7bd11a46e0248e59feba426577fd9a8'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:53:30.694696 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5739ebf0-b6c2-44e7-a006-30688ed242a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7bd11a46e0248e59feba426577fd9a8'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:53:30.695732 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5739ebf0-b6c2-44e7-a006-30688ed242a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7bd11a46e0248e59feba426577fd9a8'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:53:30.703189 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5739ebf0-b6c2-44e7-a006-30688ed242a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7bd11a46e0248e59feba426577fd9a8'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:53:30.715663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-5739ebf0-b6c2-44e7-a006-30688ed242a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7bd11a46e0248e59feba426577fd9a8'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:53:30.727949 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4415/8880] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:53:30 2022] DELETE /identity/v3/users/a7bd11a46e0248e59feba426577fd9a8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:53:30.732494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99ce0d-0bb6-4b4e-9cd8-04cafb6a263f None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:30.732972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99ce0d-0bb6-4b4e-9cd8-04cafb6a263f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:30.733076 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99ce0d-0bb6-4b4e-9cd8-04cafb6a263f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:30.752116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-dc99ce0d-0bb6-4b4e-9cd8-04cafb6a263f None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:53:30.753310 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-dc99ce0d-0bb6-4b4e-9cd8-04cafb6a263f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:53:30.762005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:53:30.814809 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4466/8881] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:53:30.824898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739ebf0-b6c2-44e7-a006-30688ed242a4 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:30.826298 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5739ebf0-b6c2-44e7-a006-30688ed242a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:53:30.885020 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739ebf0-b6c2-44e7-a006-30688ed242a4 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:30.888536 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0b1fc-ea0f-4659-9c64-83261c82c5a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:30.889130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0b1fc-ea0f-4659-9c64-83261c82c5a4 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:30.889411 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0b1fc-ea0f-4659-9c64-83261c82c5a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:30.889677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0b1fc-ea0f-4659-9c64-83261c82c5a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:30.899641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0b1fc-ea0f-4659-9c64-83261c82c5a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:30.901420 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0b1fc-ea0f-4659-9c64-83261c82c5a4 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:30.911898 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4416/8882] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:53:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:53:31.084253 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99ce0d-0bb6-4b4e-9cd8-04cafb6a263f None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:31.086954 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-dc99ce0d-0bb6-4b4e-9cd8-04cafb6a263f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:53:31.099605 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99ce0d-0bb6-4b4e-9cd8-04cafb6a263f None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:31.105380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f73d77-b114-41a3-bc1a-aa267306cba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:31.106157 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f73d77-b114-41a3-bc1a-aa267306cba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:31.106535 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f73d77-b114-41a3-bc1a-aa267306cba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:31.107079 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f73d77-b114-41a3-bc1a-aa267306cba0 admin admin] PATH_INFO: `/v3/projects/f553ca7a11e74ea6a15c25a1e131f9a2` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:31.109475 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f73d77-b114-41a3-bc1a-aa267306cba0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f553ca7a11e74ea6a15c25a1e131f9a2)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:31.111757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f73d77-b114-41a3-bc1a-aa267306cba0 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:31.159879 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b5f73d77-b114-41a3-bc1a-aa267306cba0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f553ca7a11e74ea6a15c25a1e131f9a2', 'request_id': 'req-b5f73d77-b114-41a3-bc1a-aa267306cba0'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:53:31.165833 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b5f73d77-b114-41a3-bc1a-aa267306cba0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f553ca7a11e74ea6a15c25a1e131f9a2', 'request_id': 'req-b5f73d77-b114-41a3-bc1a-aa267306cba0'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:53:31.173416 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b5f73d77-b114-41a3-bc1a-aa267306cba0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f553ca7a11e74ea6a15c25a1e131f9a2', 'request_id': 'req-b5f73d77-b114-41a3-bc1a-aa267306cba0'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:53:31.185566 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b5f73d77-b114-41a3-bc1a-aa267306cba0 admin admin] The token cache is being invalidate because project f553ca7a11e74ea6a15c25a1e131f9a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:53:31.185935 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b5f73d77-b114-41a3-bc1a-aa267306cba0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:53:31.186606 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-b5f73d77-b114-41a3-bc1a-aa267306cba0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:53:31.188094 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4467/8883] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:53:31 2022] DELETE /identity/v3/projects/f553ca7a11e74ea6a15c25a1e131f9a2 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:53:31.194010 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aca5f0-54c9-4ba5-b793-1ceec6a38091 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:31.194664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aca5f0-54c9-4ba5-b793-1ceec6a38091 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:31.194877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aca5f0-54c9-4ba5-b793-1ceec6a38091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:31.214669 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-39aca5f0-54c9-4ba5-b793-1ceec6a38091 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:53:31.215932 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-39aca5f0-54c9-4ba5-b793-1ceec6a38091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:53:31.273236 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4417/8884] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:53:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:53:31.281009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d38f1-e745-4eb7-9e3e-b1ad59d5d709 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:31.281300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d38f1-e745-4eb7-9e3e-b1ad59d5d709 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:31.281577 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d38f1-e745-4eb7-9e3e-b1ad59d5d709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:31.301171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-f25d38f1-e745-4eb7-9e3e-b1ad59d5d709 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:53:31.302378 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f25d38f1-e745-4eb7-9e3e-b1ad59d5d709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:53:31.310961 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4468/8885] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:53:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:53:31.315072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aca5f0-54c9-4ba5-b793-1ceec6a38091 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:31.324686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aca5f0-54c9-4ba5-b793-1ceec6a38091 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:31.329238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd65e88-8abd-426a-8f1e-f97f697400f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:31.329825 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd65e88-8abd-426a-8f1e-f97f697400f5 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:31.330355 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd65e88-8abd-426a-8f1e-f97f697400f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:31.330687 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd65e88-8abd-426a-8f1e-f97f697400f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:31.331319 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd65e88-8abd-426a-8f1e-f97f697400f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:53:31.331618 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd65e88-8abd-426a-8f1e-f97f697400f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:31.333200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd65e88-8abd-426a-8f1e-f97f697400f5 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:31.348238 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4418/8886] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:53:31.349444 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d38f1-e745-4eb7-9e3e-b1ad59d5d709 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:31.361527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d38f1-e745-4eb7-9e3e-b1ad59d5d709 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:31.366843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26460c8e-4b73-44cd-bb47-e19a89372fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:31.367442 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26460c8e-4b73-44cd-bb47-e19a89372fed admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:31.367717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26460c8e-4b73-44cd-bb47-e19a89372fed admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:31.367985 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26460c8e-4b73-44cd-bb47-e19a89372fed admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:31.368598 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26460c8e-4b73-44cd-bb47-e19a89372fed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:31.370696 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26460c8e-4b73-44cd-bb47-e19a89372fed admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:31.399095 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4469/8887] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:53:31 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:53:31.403410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd65e88-8abd-426a-8f1e-f97f697400f5 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:31.413523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd65e88-8abd-426a-8f1e-f97f697400f5 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:31.460546 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:53:31.471690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080104bf-b37c-46e8-842b-e6a6519c7317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:31.472300 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080104bf-b37c-46e8-842b-e6a6519c7317 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:31.472608 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080104bf-b37c-46e8-842b-e6a6519c7317 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:31.472883 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080104bf-b37c-46e8-842b-e6a6519c7317 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:31.473493 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080104bf-b37c-46e8-842b-e6a6519c7317 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:31.476032 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080104bf-b37c-46e8-842b-e6a6519c7317 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:31.497301 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4419/8888] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:53:31 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:53:31.501586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26460c8e-4b73-44cd-bb47-e19a89372fed admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:31.513056 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26460c8e-4b73-44cd-bb47-e19a89372fed admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:31.517784 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adffdab-bc42-4dc8-9e2b-a904ba8a8d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:31.518383 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adffdab-bc42-4dc8-9e2b-a904ba8a8d6b admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:31.518710 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adffdab-bc42-4dc8-9e2b-a904ba8a8d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:31.518990 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adffdab-bc42-4dc8-9e2b-a904ba8a8d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:31.519628 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adffdab-bc42-4dc8-9e2b-a904ba8a8d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:31.521258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adffdab-bc42-4dc8-9e2b-a904ba8a8d6b admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:31.531229 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4470/8889] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 21:53:31.535184 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080104bf-b37c-46e8-842b-e6a6519c7317 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:31.545354 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080104bf-b37c-46e8-842b-e6a6519c7317 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:31.550186 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f6b47-1296-4a54-b261-4f00e550340e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:31.550811 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f6b47-1296-4a54-b261-4f00e550340e admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:31.551100 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f6b47-1296-4a54-b261-4f00e550340e admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:31.551379 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f6b47-1296-4a54-b261-4f00e550340e admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:31.552087 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f6b47-1296-4a54-b261-4f00e550340e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:31.554190 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f6b47-1296-4a54-b261-4f00e550340e admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:31.565247 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4420/8890] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:53:31.569919 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adffdab-bc42-4dc8-9e2b-a904ba8a8d6b admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:31.580427 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adffdab-bc42-4dc8-9e2b-a904ba8a8d6b admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:31.585578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a14e6-5c0d-473d-9213-a38caee7af22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:31.586215 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a14e6-5c0d-473d-9213-a38caee7af22 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:31.586493 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a14e6-5c0d-473d-9213-a38caee7af22 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:31.586807 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a14e6-5c0d-473d-9213-a38caee7af22 admin admin] PATH_INFO: `/v3/projects/429e90fa99b8422db34aff5fe9d28430/users/a4d571e08f5a4eb6a79cc1ef853e53a9/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:31.600933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a14e6-5c0d-473d-9213-a38caee7af22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=429e90fa99b8422db34aff5fe9d28430, user_id=a4d571e08f5a4eb6a79cc1ef853e53a9, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:31.603589 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a14e6-5c0d-473d-9213-a38caee7af22 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:31.617019 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4471/8891] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:53:31 2022] PUT /identity/v3/projects/429e90fa99b8422db34aff5fe9d28430/users/a4d571e08f5a4eb6a79cc1ef853e53a9/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:53:31.622336 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da629305-62d5-44b3-bc80-236fb3307130 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:31.622817 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da629305-62d5-44b3-bc80-236fb3307130 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:31.623035 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da629305-62d5-44b3-bc80-236fb3307130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:31.642060 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-da629305-62d5-44b3-bc80-236fb3307130 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:53:31.643287 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-da629305-62d5-44b3-bc80-236fb3307130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:53:31.702842 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4421/8892] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:53:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:53:31.712879 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a14e6-5c0d-473d-9213-a38caee7af22 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:31.714660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-118a14e6-5c0d-473d-9213-a38caee7af22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:53:31.750784 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:53:31.774472 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a14e6-5c0d-473d-9213-a38caee7af22 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:31.778196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a8b56-bc34-4bdc-bd59-09a910916e29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:31.778851 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a8b56-bc34-4bdc-bd59-09a910916e29 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:31.779131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a8b56-bc34-4bdc-bd59-09a910916e29 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:31.779402 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a8b56-bc34-4bdc-bd59-09a910916e29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:31.788966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a8b56-bc34-4bdc-bd59-09a910916e29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:31.790394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a8b56-bc34-4bdc-bd59-09a910916e29 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:31.799767 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4472/8893] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:53:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:53:35.882753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d875c1-7319-43ca-9b01-9907cdc82c44 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:35.883255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d875c1-7319-43ca-9b01-9907cdc82c44 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:35.883255 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d875c1-7319-43ca-9b01-9907cdc82c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:35.918296 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-40d875c1-7319-43ca-9b01-9907cdc82c44 None None] MFA Rules not processed for user `a4d571e08f5a4eb6a79cc1ef853e53a9`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:53:35.919562 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-40d875c1-7319-43ca-9b01-9907cdc82c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:53:35.989169 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4422/8894] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:53:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:53:35.995074 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a8b56-bc34-4bdc-bd59-09a910916e29 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:36.024509 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a8b56-bc34-4bdc-bd59-09a910916e29 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:36.034982 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188f1cf-da37-4cc0-99f9-3aa3e17a6124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:36.035592 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188f1cf-da37-4cc0-99f9-3aa3e17a6124 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:36.035915 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188f1cf-da37-4cc0-99f9-3aa3e17a6124 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:36.036211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188f1cf-da37-4cc0-99f9-3aa3e17a6124 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:36.036875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188f1cf-da37-4cc0-99f9-3aa3e17a6124 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:36.039166 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188f1cf-da37-4cc0-99f9-3aa3e17a6124 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:36.072430 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4473/8895] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:53:35 2022] POST /identity/v3/projects => generated 385 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:53:36.076791 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d875c1-7319-43ca-9b01-9907cdc82c44 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:36.089121 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d875c1-7319-43ca-9b01-9907cdc82c44 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:36.151894 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c190fe8-9402-4214-afa3-9c47312fdfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:36.152549 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c190fe8-9402-4214-afa3-9c47312fdfb6 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:36.152845 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c190fe8-9402-4214-afa3-9c47312fdfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:36.153112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c190fe8-9402-4214-afa3-9c47312fdfb6 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:36.154079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c190fe8-9402-4214-afa3-9c47312fdfb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:36.156101 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c190fe8-9402-4214-afa3-9c47312fdfb6 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:36.164793 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:53:36.181235 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4423/8896] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:53:36 2022] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:53:36.185494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188f1cf-da37-4cc0-99f9-3aa3e17a6124 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:36.196560 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188f1cf-da37-4cc0-99f9-3aa3e17a6124 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:36.201433 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8e073-7385-407e-9def-42922001b26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:36.202155 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8e073-7385-407e-9def-42922001b26d admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:36.202401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8e073-7385-407e-9def-42922001b26d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:36.202798 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8e073-7385-407e-9def-42922001b26d admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:36.203646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8e073-7385-407e-9def-42922001b26d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:36.205660 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8e073-7385-407e-9def-42922001b26d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:36.217931 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4474/8897] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:53:36.222183 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c190fe8-9402-4214-afa3-9c47312fdfb6 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:36.233187 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c190fe8-9402-4214-afa3-9c47312fdfb6 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:36.237988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0bb8d4-05c4-45c8-bb52-4ec237a4d1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:36.238755 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bb8d4-05c4-45c8-bb52-4ec237a4d1cb admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:36.239127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bb8d4-05c4-45c8-bb52-4ec237a4d1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:36.239408 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bb8d4-05c4-45c8-bb52-4ec237a4d1cb admin admin] PATH_INFO: `/v3/projects/31b9b2025b844347ae9263c89102842e/users/03451946e8d24413b37363da313ebc5a/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:36.257695 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0bb8d4-05c4-45c8-bb52-4ec237a4d1cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=31b9b2025b844347ae9263c89102842e, user_id=03451946e8d24413b37363da313ebc5a, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:36.260972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0bb8d4-05c4-45c8-bb52-4ec237a4d1cb admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:36.276485 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4424/8898] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:53:36 2022] PUT /identity/v3/projects/31b9b2025b844347ae9263c89102842e/users/03451946e8d24413b37363da313ebc5a/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:53:36.280841 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8e073-7385-407e-9def-42922001b26d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:36.292228 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8e073-7385-407e-9def-42922001b26d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:36.353214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0018a-627a-458f-9009-9fc2c4551ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:36.353839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0018a-627a-458f-9009-9fc2c4551ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:36.354122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0018a-627a-458f-9009-9fc2c4551ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:36.354399 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0018a-627a-458f-9009-9fc2c4551ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:36.355179 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0018a-627a-458f-9009-9fc2c4551ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:36.356792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0018a-627a-458f-9009-9fc2c4551ab5 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:36.371808 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4475/8899] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:53:36.375938 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0bb8d4-05c4-45c8-bb52-4ec237a4d1cb admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:36.387269 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0bb8d4-05c4-45c8-bb52-4ec237a4d1cb admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:36.392219 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50543c-25f5-456d-af0f-79c65a66bede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:36.392891 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50543c-25f5-456d-af0f-79c65a66bede admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:36.393165 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50543c-25f5-456d-af0f-79c65a66bede admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:36.393438 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50543c-25f5-456d-af0f-79c65a66bede admin admin] PATH_INFO: `/v3/projects/31b9b2025b844347ae9263c89102842e/users/03451946e8d24413b37363da313ebc5a/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:36.395383 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a50543c-25f5-456d-af0f-79c65a66bede admin admin] RBAC: Authorizing `identity:create_grant(project_id=31b9b2025b844347ae9263c89102842e, user_id=03451946e8d24413b37363da313ebc5a, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:36.398800 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a50543c-25f5-456d-af0f-79c65a66bede admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:36.409963 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4425/8900] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:53:36 2022] PUT /identity/v3/projects/31b9b2025b844347ae9263c89102842e/users/03451946e8d24413b37363da313ebc5a/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:53:41.051564 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bd136-b593-4757-9e4b-a1531a86a61b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:41.052091 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bd136-b593-4757-9e4b-a1531a86a61b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:41.052299 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bd136-b593-4757-9e4b-a1531a86a61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:41.082101 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-f01bd136-b593-4757-9e4b-a1531a86a61b None None] MFA Rules not processed for user `03451946e8d24413b37363da313ebc5a`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:53:41.083415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f01bd136-b593-4757-9e4b-a1531a86a61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:53:41.160817 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4476/8901] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:53:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:53:41.187464 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe013e-987c-434e-b56d-dff4c53871b7 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:41.187906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe013e-987c-434e-b56d-dff4c53871b7 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:41.188012 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe013e-987c-434e-b56d-dff4c53871b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:41.244690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-b7fe013e-987c-434e-b56d-dff4c53871b7 None None] MFA Rules not processed for user `1e10759b2abd4cafacf338551327775e`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:53:41.245937 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b7fe013e-987c-434e-b56d-dff4c53871b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:53:41.313187 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4426/8902] 10.222.0.33 () {58 vars in 1063 bytes} [Sat Aug 6 21:53:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:53:41.319757 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bd136-b593-4757-9e4b-a1531a86a61b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:41.329596 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bd136-b593-4757-9e4b-a1531a86a61b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:41.333546 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b432de-b93c-46d3-a307-ea531225a3a6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10759b2abd4cafacf338551327775e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:41.334673 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b432de-b93c-46d3-a307-ea531225a3a6 service glance] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:41.334979 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b432de-b93c-46d3-a307-ea531225a3a6 service glance] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:41.335255 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b432de-b93c-46d3-a307-ea531225a3a6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:41.362577 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:53:41.403708 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b432de-b93c-46d3-a307-ea531225a3a6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:41.405257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b432de-b93c-46d3-a307-ea531225a3a6 service glance] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:41.415505 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4477/8903] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:53:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:53:41.585915 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8890c9-4804-475c-af5b-642ff6e4796f None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:41.586376 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8890c9-4804-475c-af5b-642ff6e4796f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:41.586734 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8890c9-4804-475c-af5b-642ff6e4796f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:41.642749 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-ff8890c9-4804-475c-af5b-642ff6e4796f None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:53:41.644102 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ff8890c9-4804-475c-af5b-642ff6e4796f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:53:41.710787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:53:41.715867 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4427/8904] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:53:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:53:41.785121 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b648a-6055-4a4c-9c6e-88a263047b4c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:41.785494 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b648a-6055-4a4c-9c6e-88a263047b4c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:41.785772 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b648a-6055-4a4c-9c6e-88a263047b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:41.845960 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-dd9b648a-6055-4a4c-9c6e-88a263047b4c None None] MFA Rules not processed for user `cd3e0e177f934f7ba5abe52ac8bf8bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:53:41.847232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-dd9b648a-6055-4a4c-9c6e-88a263047b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:53:41.931297 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4478/8905] 10.222.0.33 () {58 vars in 1040 bytes} [Sat Aug 6 21:53:41 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:53:41.937691 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8890c9-4804-475c-af5b-642ff6e4796f None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:41.951374 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8890c9-4804-475c-af5b-642ff6e4796f None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:41.956685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52fa29a-2b9b-45f3-8e28-82e96c4cbd61 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:41.957299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fa29a-2b9b-45f3-8e28-82e96c4cbd61 service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:41.957579 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fa29a-2b9b-45f3-8e28-82e96c4cbd61 service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:41.957867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fa29a-2b9b-45f3-8e28-82e96c4cbd61 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:41.967558 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52fa29a-2b9b-45f3-8e28-82e96c4cbd61 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:41.969168 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52fa29a-2b9b-45f3-8e28-82e96c4cbd61 service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:41.979211 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4428/8906] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:53:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:53:50.685130 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38abef73-3bc8-491e-9696-19a3fa0e44d2 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:50.685694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38abef73-3bc8-491e-9696-19a3fa0e44d2 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:50.685694 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38abef73-3bc8-491e-9696-19a3fa0e44d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:50.704362 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-38abef73-3bc8-491e-9696-19a3fa0e44d2 None None] MFA Rules not processed for user `a4d571e08f5a4eb6a79cc1ef853e53a9`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:53:50.705831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-38abef73-3bc8-491e-9696-19a3fa0e44d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:53:50.712727 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4479/8907] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:53:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:53:51.288897 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52fa29a-2b9b-45f3-8e28-82e96c4cbd61 service swift] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:51.290328 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c52fa29a-2b9b-45f3-8e28-82e96c4cbd61 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:53:51.361144 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52fa29a-2b9b-45f3-8e28-82e96c4cbd61 service swift] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:51.366817 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11057e58-3adb-4939-be5c-a90f47a646b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:51.367430 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11057e58-3adb-4939-be5c-a90f47a646b0 service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:51.367714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11057e58-3adb-4939-be5c-a90f47a646b0 service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:51.367993 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11057e58-3adb-4939-be5c-a90f47a646b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:51.369723 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-11057e58-3adb-4939-be5c-a90f47a646b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:53:51.381722 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11057e58-3adb-4939-be5c-a90f47a646b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:51.383433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11057e58-3adb-4939-be5c-a90f47a646b0 service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:51.395358 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4429/8908] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:53:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:53:52.619202 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3775f-c1cf-41a2-9048-b286242e90d7 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:52.619727 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3775f-c1cf-41a2-9048-b286242e90d7 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:52.619845 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3775f-c1cf-41a2-9048-b286242e90d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:52.642679 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-cbb3775f-c1cf-41a2-9048-b286242e90d7 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:53:52.643891 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-cbb3775f-c1cf-41a2-9048-b286242e90d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:53:52.651098 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4480/8909] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:53:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:53:52.663407 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11057e58-3adb-4939-be5c-a90f47a646b0 service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:53:52.676254 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11057e58-3adb-4939-be5c-a90f47a646b0 service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:53:52.682343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb81109-d9ac-405b-922f-62039803a931 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:53:52.683045 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb81109-d9ac-405b-922f-62039803a931 service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:53:52.683389 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb81109-d9ac-405b-922f-62039803a931 service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:53:52.683836 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb81109-d9ac-405b-922f-62039803a931 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:53:52.692202 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb81109-d9ac-405b-922f-62039803a931 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:53:52.694155 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb81109-d9ac-405b-922f-62039803a931 service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:53:52.702393 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4430/8910] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:53:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:54:02.637358 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=67 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:54:02.699123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=44 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:54:11.513185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6a95f-70c2-4ef8-8010-8b2c11bc8094 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:54:11.513638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6a95f-70c2-4ef8-8010-8b2c11bc8094 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:54:11.513749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6a95f-70c2-4ef8-8010-8b2c11bc8094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:54:11.534349 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-91f6a95f-70c2-4ef8-8010-8b2c11bc8094 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:54:11.535576 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-91f6a95f-70c2-4ef8-8010-8b2c11bc8094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:54:11.549412 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4481/8911] 10.222.0.33 () {58 vars in 967 bytes} [Sat Aug 6 21:54:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:54:11.562310 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb81109-d9ac-405b-922f-62039803a931 service swift] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:54:11.573141 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb81109-d9ac-405b-922f-62039803a931 service swift] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:54:11.578089 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f81dbf-fda6-45d3-8d9d-4682a568070b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:54:11.578716 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f81dbf-fda6-45d3-8d9d-4682a568070b service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:54:11.578994 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f81dbf-fda6-45d3-8d9d-4682a568070b service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:54:11.579262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f81dbf-fda6-45d3-8d9d-4682a568070b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:54:11.587384 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f81dbf-fda6-45d3-8d9d-4682a568070b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:54:11.588949 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f81dbf-fda6-45d3-8d9d-4682a568070b service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:54:11.596853 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4431/8912] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:54:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:54:12.096415 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822017a8-e02e-44de-a589-85832beb7c1c None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:54:12.096701 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822017a8-e02e-44de-a589-85832beb7c1c None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:54:12.096976 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822017a8-e02e-44de-a589-85832beb7c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:54:12.117015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-822017a8-e02e-44de-a589-85832beb7c1c None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:54:12.118824 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-822017a8-e02e-44de-a589-85832beb7c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:54:12.125895 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4482/8913] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:54:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:54:12.138489 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f81dbf-fda6-45d3-8d9d-4682a568070b service swift] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:54:12.149474 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f81dbf-fda6-45d3-8d9d-4682a568070b service swift] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:54:12.155537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b733947c-83d2-42e9-b90a-76e89c6a3436 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:54:12.156150 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733947c-83d2-42e9-b90a-76e89c6a3436 service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:54:12.156425 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733947c-83d2-42e9-b90a-76e89c6a3436 service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:54:12.156694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733947c-83d2-42e9-b90a-76e89c6a3436 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:54:12.165332 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b733947c-83d2-42e9-b90a-76e89c6a3436 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:54:12.166965 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b733947c-83d2-42e9-b90a-76e89c6a3436 service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:54:12.174956 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4432/8914] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:54:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:54:20.485122 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c3fbd-a25f-4d08-b0af-6649d10da3a3 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:54:20.485678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c3fbd-a25f-4d08-b0af-6649d10da3a3 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:54:20.485678 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c3fbd-a25f-4d08-b0af-6649d10da3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:54:20.505200 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-c62c3fbd-a25f-4d08-b0af-6649d10da3a3 None None] MFA Rules not processed for user `a4d571e08f5a4eb6a79cc1ef853e53a9`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:54:20.506396 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c62c3fbd-a25f-4d08-b0af-6649d10da3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:54:20.513785 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4483/8915] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:54:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:54:20.770672 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17244e71-34d3-4e0d-ae56-ca2ae4258bca None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:54:20.771217 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17244e71-34d3-4e0d-ae56-ca2ae4258bca None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:54:20.771442 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17244e71-34d3-4e0d-ae56-ca2ae4258bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:54:20.811364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-17244e71-34d3-4e0d-ae56-ca2ae4258bca None None] MFA Rules not processed for user `174e91100a184740b7c604730266dc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:54:20.812568 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-17244e71-34d3-4e0d-ae56-ca2ae4258bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:54:20.865726 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4433/8916] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:54:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:54:20.877627 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c3fbd-a25f-4d08-b0af-6649d10da3a3 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:54:20.879097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c62c3fbd-a25f-4d08-b0af-6649d10da3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:54:20.891381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c3fbd-a25f-4d08-b0af-6649d10da3a3 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:54:20.894905 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa40d9d-31fb-4734-a0c3-ad3db4eef8e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:54:20.895500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa40d9d-31fb-4734-a0c3-ad3db4eef8e5 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:54:20.895781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa40d9d-31fb-4734-a0c3-ad3db4eef8e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:54:20.896054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa40d9d-31fb-4734-a0c3-ad3db4eef8e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:54:20.903754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa40d9d-31fb-4734-a0c3-ad3db4eef8e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:54:20.905137 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa40d9d-31fb-4734-a0c3-ad3db4eef8e5 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:54:20.913020 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4484/8917] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:54:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:54:21.237185 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20df53-8141-479c-b91b-8c814efb8570 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:54:21.237479 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20df53-8141-479c-b91b-8c814efb8570 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:54:21.237760 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20df53-8141-479c-b91b-8c814efb8570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:54:21.258872 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-ba20df53-8141-479c-b91b-8c814efb8570 None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:54:21.260112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ba20df53-8141-479c-b91b-8c814efb8570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:54:21.269967 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4434/8918] 10.222.0.33 () {58 vars in 1058 bytes} [Sat Aug 6 21:54:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:54:21.277865 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa40d9d-31fb-4734-a0c3-ad3db4eef8e5 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:54:21.290531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa40d9d-31fb-4734-a0c3-ad3db4eef8e5 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:54:21.295638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d8474-8e06-46df-8464-1040997e39c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:54:21.296305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d8474-8e06-46df-8464-1040997e39c0 service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:54:21.296723 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d8474-8e06-46df-8464-1040997e39c0 service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:54:21.297066 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d8474-8e06-46df-8464-1040997e39c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:54:21.298861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ae4d8474-8e06-46df-8464-1040997e39c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:54:21.310972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d8474-8e06-46df-8464-1040997e39c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:54:21.312533 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d8474-8e06-46df-8464-1040997e39c0 service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:54:21.323336 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4485/8919] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:54:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:54:22.424149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396e648-60f4-4b76-a83e-d06f3e78d186 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:54:22.424708 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396e648-60f4-4b76-a83e-d06f3e78d186 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:54:22.424708 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396e648-60f4-4b76-a83e-d06f3e78d186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:54:22.445240 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a396e648-60f4-4b76-a83e-d06f3e78d186 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:54:22.446845 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a396e648-60f4-4b76-a83e-d06f3e78d186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:54:22.454088 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4435/8920] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 21:54:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:54:22.466450 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d8474-8e06-46df-8464-1040997e39c0 service placement] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:54:22.478261 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d8474-8e06-46df-8464-1040997e39c0 service placement] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:54:22.483557 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa54f7-7aa9-42b6-b7eb-6021bd6ab993 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:54:22.484159 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa54f7-7aa9-42b6-b7eb-6021bd6ab993 service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:54:22.484434 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa54f7-7aa9-42b6-b7eb-6021bd6ab993 service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:54:22.484707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa54f7-7aa9-42b6-b7eb-6021bd6ab993 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:54:22.493319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa54f7-7aa9-42b6-b7eb-6021bd6ab993 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:54:22.494922 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa54f7-7aa9-42b6-b7eb-6021bd6ab993 service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:54:22.503493 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4486/8921] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:54:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:54:31.038781 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396e648-60f4-4b76-a83e-d06f3e78d186 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:54:31.052325 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396e648-60f4-4b76-a83e-d06f3e78d186 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:54:31.058726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962da4d9-8529-4301-bfd0-0486c79396ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:54:31.059380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962da4d9-8529-4301-bfd0-0486c79396ef service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:54:31.059663 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962da4d9-8529-4301-bfd0-0486c79396ef service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:54:31.059940 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962da4d9-8529-4301-bfd0-0486c79396ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:54:31.061826 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-962da4d9-8529-4301-bfd0-0486c79396ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:54:31.076672 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962da4d9-8529-4301-bfd0-0486c79396ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:54:31.078419 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962da4d9-8529-4301-bfd0-0486c79396ef service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:54:31.089888 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4436/8922] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:54:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:54:32.500152 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=30 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:54:41.084710 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=53 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:54:44.227655 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a3607-2ae7-46c7-9dbb-b16b7b5063f6 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:54:44.228140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a3607-2ae7-46c7-9dbb-b16b7b5063f6 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:54:44.228250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a3607-2ae7-46c7-9dbb-b16b7b5063f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:54:44.248057 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-054a3607-2ae7-46c7-9dbb-b16b7b5063f6 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:54:44.249253 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-054a3607-2ae7-46c7-9dbb-b16b7b5063f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:54:44.256360 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4487/8923] 10.222.0.33 () {58 vars in 967 bytes} [Sat Aug 6 21:54:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:54:44.278966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962da4d9-8529-4301-bfd0-0486c79396ef service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:54:44.290157 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962da4d9-8529-4301-bfd0-0486c79396ef service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:54:44.295180 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ea1ac-1e1f-4c54-9409-ef2493a75014 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:54:44.295771 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ea1ac-1e1f-4c54-9409-ef2493a75014 service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:54:44.296056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ea1ac-1e1f-4c54-9409-ef2493a75014 service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:54:44.296331 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ea1ac-1e1f-4c54-9409-ef2493a75014 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:54:44.304601 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ea1ac-1e1f-4c54-9409-ef2493a75014 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:54:44.306171 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ea1ac-1e1f-4c54-9409-ef2493a75014 service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:54:44.314187 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4437/8924] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 21:54:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 21:54:50.814792 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a3607-2ae7-46c7-9dbb-b16b7b5063f6 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:54:50.893350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a3607-2ae7-46c7-9dbb-b16b7b5063f6 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:54:50.897929 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79d143-4bc9-43fe-834e-38e9b39cdf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:54:50.898629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79d143-4bc9-43fe-834e-38e9b39cdf20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:54:50.899007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79d143-4bc9-43fe-834e-38e9b39cdf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:54:50.899184 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79d143-4bc9-43fe-834e-38e9b39cdf20 admin admin] PATH_INFO: `/v3/users/a4d571e08f5a4eb6a79cc1ef853e53a9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:54:50.900303 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b79d143-4bc9-43fe-834e-38e9b39cdf20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4d571e08f5a4eb6a79cc1ef853e53a9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:54:50.902229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b79d143-4bc9-43fe-834e-38e9b39cdf20 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:54:50.950734 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8b79d143-4bc9-43fe-834e-38e9b39cdf20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4d571e08f5a4eb6a79cc1ef853e53a9'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:54:50.957899 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8b79d143-4bc9-43fe-834e-38e9b39cdf20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4d571e08f5a4eb6a79cc1ef853e53a9'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:54:50.958597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8b79d143-4bc9-43fe-834e-38e9b39cdf20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4d571e08f5a4eb6a79cc1ef853e53a9'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:54:50.959211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8b79d143-4bc9-43fe-834e-38e9b39cdf20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4d571e08f5a4eb6a79cc1ef853e53a9'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:54:50.966683 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-8b79d143-4bc9-43fe-834e-38e9b39cdf20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4d571e08f5a4eb6a79cc1ef853e53a9'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:54:50.984065 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4488/8925] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:54:50 2022] DELETE /identity/v3/users/a4d571e08f5a4eb6a79cc1ef853e53a9 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:54:51.158292 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ea1ac-1e1f-4c54-9409-ef2493a75014 service swift] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:54:51.169514 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ea1ac-1e1f-4c54-9409-ef2493a75014 service swift] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:54:51.229981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da288068-650e-4047-a47e-e651e79296b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:54:51.230535 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da288068-650e-4047-a47e-e651e79296b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:54:51.230843 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da288068-650e-4047-a47e-e651e79296b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:54:51.231142 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da288068-650e-4047-a47e-e651e79296b3 admin admin] PATH_INFO: `/v3/projects/429e90fa99b8422db34aff5fe9d28430` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:54:51.232254 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da288068-650e-4047-a47e-e651e79296b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=429e90fa99b8422db34aff5fe9d28430)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:54:51.234236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da288068-650e-4047-a47e-e651e79296b3 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:54:51.282299 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-da288068-650e-4047-a47e-e651e79296b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '429e90fa99b8422db34aff5fe9d28430', 'request_id': 'req-da288068-650e-4047-a47e-e651e79296b3'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:54:51.287763 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-da288068-650e-4047-a47e-e651e79296b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '429e90fa99b8422db34aff5fe9d28430', 'request_id': 'req-da288068-650e-4047-a47e-e651e79296b3'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:54:51.295317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-da288068-650e-4047-a47e-e651e79296b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '429e90fa99b8422db34aff5fe9d28430', 'request_id': 'req-da288068-650e-4047-a47e-e651e79296b3'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:54:51.320264 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-da288068-650e-4047-a47e-e651e79296b3 admin admin] The token cache is being invalidate because project 429e90fa99b8422db34aff5fe9d28430 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:54:51.320985 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-da288068-650e-4047-a47e-e651e79296b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:54:51.321626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-da288068-650e-4047-a47e-e651e79296b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:54:51.323207 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4438/8926] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:54:51 2022] DELETE /identity/v3/projects/429e90fa99b8422db34aff5fe9d28430 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:54:51.327216 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79d143-4bc9-43fe-834e-38e9b39cdf20 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:54:51.328614 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8b79d143-4bc9-43fe-834e-38e9b39cdf20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:54:51.344167 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79d143-4bc9-43fe-834e-38e9b39cdf20 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:54:51.400697 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a14b6-1573-4cc4-8ebc-e88d4da065ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:54:51.401331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a14b6-1573-4cc4-8ebc-e88d4da065ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:54:51.401612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a14b6-1573-4cc4-8ebc-e88d4da065ac admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:54:51.401913 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a14b6-1573-4cc4-8ebc-e88d4da065ac admin admin] PATH_INFO: `/v3/users/03451946e8d24413b37363da313ebc5a` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:54:51.403112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a14b6-1573-4cc4-8ebc-e88d4da065ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=03451946e8d24413b37363da313ebc5a)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:54:51.405040 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a14b6-1573-4cc4-8ebc-e88d4da065ac admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:54:51.409613 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:54:51.455420 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c15a14b6-1573-4cc4-8ebc-e88d4da065ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03451946e8d24413b37363da313ebc5a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:54:51.462527 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c15a14b6-1573-4cc4-8ebc-e88d4da065ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03451946e8d24413b37363da313ebc5a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:54:51.463210 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c15a14b6-1573-4cc4-8ebc-e88d4da065ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03451946e8d24413b37363da313ebc5a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:54:51.463806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c15a14b6-1573-4cc4-8ebc-e88d4da065ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03451946e8d24413b37363da313ebc5a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:54:51.471096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c15a14b6-1573-4cc4-8ebc-e88d4da065ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03451946e8d24413b37363da313ebc5a'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:54:51.488614 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4489/8927] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 21:54:51 2022] DELETE /identity/v3/users/03451946e8d24413b37363da313ebc5a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:54:51.674223 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da288068-650e-4047-a47e-e651e79296b3 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:54:51.676461 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-da288068-650e-4047-a47e-e651e79296b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:54:51.692923 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da288068-650e-4047-a47e-e651e79296b3 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:54:51.751845 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302563fb-ceca-4d0c-8be3-bcc7cba41474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:54:51.752410 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302563fb-ceca-4d0c-8be3-bcc7cba41474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:54:51.752689 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302563fb-ceca-4d0c-8be3-bcc7cba41474 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:54:51.752961 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302563fb-ceca-4d0c-8be3-bcc7cba41474 admin admin] PATH_INFO: `/v3/projects/31b9b2025b844347ae9263c89102842e` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:54:51.754169 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302563fb-ceca-4d0c-8be3-bcc7cba41474 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31b9b2025b844347ae9263c89102842e)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:54:51.756159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302563fb-ceca-4d0c-8be3-bcc7cba41474 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:54:51.764844 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:54:51.804210 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-302563fb-ceca-4d0c-8be3-bcc7cba41474 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31b9b2025b844347ae9263c89102842e', 'request_id': 'req-302563fb-ceca-4d0c-8be3-bcc7cba41474'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:54:51.809906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-302563fb-ceca-4d0c-8be3-bcc7cba41474 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31b9b2025b844347ae9263c89102842e', 'request_id': 'req-302563fb-ceca-4d0c-8be3-bcc7cba41474'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:54:51.816352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-302563fb-ceca-4d0c-8be3-bcc7cba41474 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31b9b2025b844347ae9263c89102842e', 'request_id': 'req-302563fb-ceca-4d0c-8be3-bcc7cba41474'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:54:51.828633 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-302563fb-ceca-4d0c-8be3-bcc7cba41474 admin admin] The token cache is being invalidate because project 31b9b2025b844347ae9263c89102842e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:54:51.828915 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-302563fb-ceca-4d0c-8be3-bcc7cba41474 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:54:51.829531 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-302563fb-ceca-4d0c-8be3-bcc7cba41474 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:54:51.831331 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4439/8928] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:54:51 2022] DELETE /identity/v3/projects/31b9b2025b844347ae9263c89102842e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:54:51.837013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d0276-e81d-4d5b-bed4-105409bfad2b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:54:51.837486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d0276-e81d-4d5b-bed4-105409bfad2b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:54:51.837658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d0276-e81d-4d5b-bed4-105409bfad2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:54:51.864914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-6e6d0276-e81d-4d5b-bed4-105409bfad2b None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:54:51.866103 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-6e6d0276-e81d-4d5b-bed4-105409bfad2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:54:51.925522 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4490/8929] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:54:51.934359 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153c8cc-0833-432b-bae1-e33df08ef93d None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:54:51.934682 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153c8cc-0833-432b-bae1-e33df08ef93d None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:54:51.934967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153c8cc-0833-432b-bae1-e33df08ef93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:54:51.957184 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-5153c8cc-0833-432b-bae1-e33df08ef93d None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:54:51.958377 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5153c8cc-0833-432b-bae1-e33df08ef93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:54:51.967155 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4440/8930] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:54:51.971455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d0276-e81d-4d5b-bed4-105409bfad2b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:54:51.981186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d0276-e81d-4d5b-bed4-105409bfad2b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:54:51.985676 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2f065-22de-41e6-88c8-4b7281a1acd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:54:51.986264 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2f065-22de-41e6-88c8-4b7281a1acd3 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:54:51.986539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2f065-22de-41e6-88c8-4b7281a1acd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:54:51.986840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2f065-22de-41e6-88c8-4b7281a1acd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:54:51.987472 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2f065-22de-41e6-88c8-4b7281a1acd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 21:54:51.987771 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2f065-22de-41e6-88c8-4b7281a1acd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:54:51.989363 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2f065-22de-41e6-88c8-4b7281a1acd3 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:54:52.001386 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4491/8931] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 21:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 21:54:52.005641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153c8cc-0833-432b-bae1-e33df08ef93d None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:54:52.015748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153c8cc-0833-432b-bae1-e33df08ef93d None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:54:52.020487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7604e-170f-4e64-a466-ae99a1614f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:54:52.021079 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7604e-170f-4e64-a466-ae99a1614f24 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:54:52.021358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7604e-170f-4e64-a466-ae99a1614f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:54:52.021629 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7604e-170f-4e64-a466-ae99a1614f24 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:54:52.022241 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7604e-170f-4e64-a466-ae99a1614f24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:54:52.024208 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7604e-170f-4e64-a466-ae99a1614f24 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:54:52.051442 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4441/8932] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:54:52 2022] POST /identity/v3/projects => generated 393 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:54:52.056341 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2f065-22de-41e6-88c8-4b7281a1acd3 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:54:52.066197 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2f065-22de-41e6-88c8-4b7281a1acd3 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:54:52.122748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f3b36-db07-4b8b-a58a-3ca8d28f8e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:54:52.123338 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f3b36-db07-4b8b-a58a-3ca8d28f8e8e admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:54:52.123615 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f3b36-db07-4b8b-a58a-3ca8d28f8e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:54:52.123883 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f3b36-db07-4b8b-a58a-3ca8d28f8e8e admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:54:52.124484 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f3b36-db07-4b8b-a58a-3ca8d28f8e8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:54:52.126358 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f3b36-db07-4b8b-a58a-3ca8d28f8e8e admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:54:52.136435 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:54:52.149566 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4492/8933] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:54:52 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:54:52.153690 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7604e-170f-4e64-a466-ae99a1614f24 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:54:52.164172 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7604e-170f-4e64-a466-ae99a1614f24 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:54:52.168711 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96747876-c2e8-43ee-9632-f2d023716209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:54:52.169302 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96747876-c2e8-43ee-9632-f2d023716209 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:54:52.169580 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96747876-c2e8-43ee-9632-f2d023716209 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:54:52.169852 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96747876-c2e8-43ee-9632-f2d023716209 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:54:52.170478 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96747876-c2e8-43ee-9632-f2d023716209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:54:52.172097 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96747876-c2e8-43ee-9632-f2d023716209 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:54:52.182719 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4442/8934] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:54:52.186511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f3b36-db07-4b8b-a58a-3ca8d28f8e8e admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:54:52.197749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f3b36-db07-4b8b-a58a-3ca8d28f8e8e admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:54:52.202368 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6f273-2480-4a3a-af54-a1b80a299eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:54:52.203000 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6f273-2480-4a3a-af54-a1b80a299eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:54:52.203278 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6f273-2480-4a3a-af54-a1b80a299eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:54:52.203550 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6f273-2480-4a3a-af54-a1b80a299eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:54:52.204220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e6f273-2480-4a3a-af54-a1b80a299eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:54:52.206063 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e6f273-2480-4a3a-af54-a1b80a299eb6 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:54:52.216241 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4493/8935] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:54:52.222646 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96747876-c2e8-43ee-9632-f2d023716209 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:54:52.233033 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96747876-c2e8-43ee-9632-f2d023716209 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:54:52.237778 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0548121-8690-4301-8afa-c3e65801e10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:54:52.238448 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0548121-8690-4301-8afa-c3e65801e10d admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:54:52.238754 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0548121-8690-4301-8afa-c3e65801e10d admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:54:52.239028 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0548121-8690-4301-8afa-c3e65801e10d admin admin] PATH_INFO: `/v3/projects/1ac47bb71e6e4ecf9f5197f217a159da/users/1f605e9c98464387b21755ec13a52070/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:54:52.255342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0548121-8690-4301-8afa-c3e65801e10d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ac47bb71e6e4ecf9f5197f217a159da, user_id=1f605e9c98464387b21755ec13a52070, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:54:52.258769 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0548121-8690-4301-8afa-c3e65801e10d admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:54:52.271411 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4443/8936] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:54:52 2022] PUT /identity/v3/projects/1ac47bb71e6e4ecf9f5197f217a159da/users/1f605e9c98464387b21755ec13a52070/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:54:52.281644 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e89e0-f0c5-4862-8630-68d21d99e880 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:54:52.281973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e89e0-f0c5-4862-8630-68d21d99e880 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:54:52.282259 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e89e0-f0c5-4862-8630-68d21d99e880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:54:52.310746 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-d37e89e0-f0c5-4862-8630-68d21d99e880 None None] MFA Rules not processed for user `1f605e9c98464387b21755ec13a52070`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:54:52.312003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-d37e89e0-f0c5-4862-8630-68d21d99e880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:54:52.376884 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4494/8937] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:54:52 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:54:52.381426 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0548121-8690-4301-8afa-c3e65801e10d admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:54:52.442523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0548121-8690-4301-8afa-c3e65801e10d admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:54:52.448039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704c225-2869-43eb-a13e-56662b052772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:54:52.448655 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704c225-2869-43eb-a13e-56662b052772 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:54:52.448923 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704c225-2869-43eb-a13e-56662b052772 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:54:52.449200 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704c225-2869-43eb-a13e-56662b052772 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:54:52.449823 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0704c225-2869-43eb-a13e-56662b052772 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:54:52.451761 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0704c225-2869-43eb-a13e-56662b052772 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:54:52.481828 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4444/8938] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 21:54:52 2022] POST /identity/v3/projects => generated 393 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 21:54:52.483011 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e89e0-f0c5-4862-8630-68d21d99e880 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:54:52.493901 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e89e0-f0c5-4862-8630-68d21d99e880 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:54:52.549844 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a3384-21c1-4c26-9431-04efe3055b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:54:52.550354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a3384-21c1-4c26-9431-04efe3055b82 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:54:52.550664 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a3384-21c1-4c26-9431-04efe3055b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:54:52.550938 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a3384-21c1-4c26-9431-04efe3055b82 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:54:52.551559 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a3384-21c1-4c26-9431-04efe3055b82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:54:52.553487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a3384-21c1-4c26-9431-04efe3055b82 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:54:52.576408 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4495/8939] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 21:54:52 2022] POST /identity/v3/users => generated 303 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 21:54:52.580717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704c225-2869-43eb-a13e-56662b052772 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:54:52.591772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704c225-2869-43eb-a13e-56662b052772 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:54:52.596375 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b161f2-4cda-438c-8db2-039fa86088ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:54:52.596969 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b161f2-4cda-438c-8db2-039fa86088ed admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:54:52.597249 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b161f2-4cda-438c-8db2-039fa86088ed admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:54:52.597526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b161f2-4cda-438c-8db2-039fa86088ed admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:54:52.598155 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b161f2-4cda-438c-8db2-039fa86088ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:54:52.599832 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b161f2-4cda-438c-8db2-039fa86088ed admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:54:52.610387 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4445/8940] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:54:52.614562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a3384-21c1-4c26-9431-04efe3055b82 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:54:52.625002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a3384-21c1-4c26-9431-04efe3055b82 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:54:52.629848 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95608d03-7bbf-4223-888a-5ebe4439d00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:54:52.630502 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95608d03-7bbf-4223-888a-5ebe4439d00d admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:54:52.630819 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95608d03-7bbf-4223-888a-5ebe4439d00d admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:54:52.631096 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95608d03-7bbf-4223-888a-5ebe4439d00d admin admin] PATH_INFO: `/v3/projects/1d5911b48c2943e39e58e049decca380/users/7bc4fc58dd244c0792da5dfdf2d1246c/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:54:52.646708 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95608d03-7bbf-4223-888a-5ebe4439d00d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d5911b48c2943e39e58e049decca380, user_id=7bc4fc58dd244c0792da5dfdf2d1246c, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:54:52.649802 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95608d03-7bbf-4223-888a-5ebe4439d00d admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:54:52.662278 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4496/8941] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:54:52 2022] PUT /identity/v3/projects/1d5911b48c2943e39e58e049decca380/users/7bc4fc58dd244c0792da5dfdf2d1246c/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:54:52.666967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b161f2-4cda-438c-8db2-039fa86088ed admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:54:52.677327 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b161f2-4cda-438c-8db2-039fa86088ed admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:54:52.681952 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:54:52.736867 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f1cdf-1ae4-4f8c-afa7-ea17c1afcd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:54:52.737473 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f1cdf-1ae4-4f8c-afa7-ea17c1afcd90 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:54:52.737757 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f1cdf-1ae4-4f8c-afa7-ea17c1afcd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:54:52.738036 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f1cdf-1ae4-4f8c-afa7-ea17c1afcd90 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:54:52.738705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f1cdf-1ae4-4f8c-afa7-ea17c1afcd90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:54:52.740311 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f1cdf-1ae4-4f8c-afa7-ea17c1afcd90 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:54:52.750150 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4446/8942] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 21:54:52.754505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95608d03-7bbf-4223-888a-5ebe4439d00d admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:54:52.765530 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95608d03-7bbf-4223-888a-5ebe4439d00d admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:54:52.770170 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437a851-bbbd-4cd4-9007-120119ca6675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:54:52.770852 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437a851-bbbd-4cd4-9007-120119ca6675 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:54:52.771133 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437a851-bbbd-4cd4-9007-120119ca6675 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:54:52.771410 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437a851-bbbd-4cd4-9007-120119ca6675 admin admin] PATH_INFO: `/v3/projects/1d5911b48c2943e39e58e049decca380/users/7bc4fc58dd244c0792da5dfdf2d1246c/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:54:52.773314 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f437a851-bbbd-4cd4-9007-120119ca6675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d5911b48c2943e39e58e049decca380, user_id=7bc4fc58dd244c0792da5dfdf2d1246c, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:54:52.776927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f437a851-bbbd-4cd4-9007-120119ca6675 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:54:52.786981 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4497/8943] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 21:54:52 2022] PUT /identity/v3/projects/1d5911b48c2943e39e58e049decca380/users/7bc4fc58dd244c0792da5dfdf2d1246c/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:54:52.797782 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a690996-d4ea-4868-a31b-232a5fe59065 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:54:52.798071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a690996-d4ea-4868-a31b-232a5fe59065 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:54:52.798348 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a690996-d4ea-4868-a31b-232a5fe59065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:54:52.826110 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-9a690996-d4ea-4868-a31b-232a5fe59065 None None] MFA Rules not processed for user `7bc4fc58dd244c0792da5dfdf2d1246c`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:54:52.827307 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9a690996-d4ea-4868-a31b-232a5fe59065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:54:52.896430 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4447/8944] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:54:52 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:54:52.913998 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437a851-bbbd-4cd4-9007-120119ca6675 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:54:52.916662 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-f437a851-bbbd-4cd4-9007-120119ca6675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:54:52.943578 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:54:53.017280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437a851-bbbd-4cd4-9007-120119ca6675 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:54:53.023311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c17d6-3f05-40ab-80f6-ad2f1a763236 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:54:53.024433 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c17d6-3f05-40ab-80f6-ad2f1a763236 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:54:53.024704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c17d6-3f05-40ab-80f6-ad2f1a763236 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:54:53.024970 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c17d6-3f05-40ab-80f6-ad2f1a763236 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:54:53.079386 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c17d6-3f05-40ab-80f6-ad2f1a763236 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:54:53.081171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c17d6-3f05-40ab-80f6-ad2f1a763236 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:54:53.090518 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4498/8945] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:54:52 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:54:55.769543 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a690996-d4ea-4868-a31b-232a5fe59065 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:54:55.771014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9a690996-d4ea-4868-a31b-232a5fe59065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:54:55.829475 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a690996-d4ea-4868-a31b-232a5fe59065 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:54:55.833337 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b3e7f-6a1e-4efc-b974-151c2b882270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:54:55.833940 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b3e7f-6a1e-4efc-b974-151c2b882270 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:54:55.834220 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b3e7f-6a1e-4efc-b974-151c2b882270 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:54:55.834493 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b3e7f-6a1e-4efc-b974-151c2b882270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:54:55.844026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b3e7f-6a1e-4efc-b974-151c2b882270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:54:55.845460 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b3e7f-6a1e-4efc-b974-151c2b882270 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:54:55.855209 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4448/8946] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:54:55 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:54:58.783504 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec70e2-79ce-441d-ae57-804e1b51ddb4 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:54:58.784035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec70e2-79ce-441d-ae57-804e1b51ddb4 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:54:58.784035 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec70e2-79ce-441d-ae57-804e1b51ddb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:54:58.803860 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a4ec70e2-79ce-441d-ae57-804e1b51ddb4 None None] MFA Rules not processed for user `1f605e9c98464387b21755ec13a52070`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:54:58.805621 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a4ec70e2-79ce-441d-ae57-804e1b51ddb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:54:58.812865 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4499/8947] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:54:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:55:05.850652 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=86 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:55:08.801128 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=53 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:55:10.967392 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47da46-cb70-4f0f-bbde-6b29f73f9b2e None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:55:10.967948 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47da46-cb70-4f0f-bbde-6b29f73f9b2e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:55:10.967948 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47da46-cb70-4f0f-bbde-6b29f73f9b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:55:10.989655 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-1f47da46-cb70-4f0f-bbde-6b29f73f9b2e None None] MFA Rules not processed for user `5f9d53147a57402f8b9818590bc1fc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:55:10.990906 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1f47da46-cb70-4f0f-bbde-6b29f73f9b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:55:11.001248 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4449/8948] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 21:55:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:55:11.016642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec70e2-79ce-441d-ae57-804e1b51ddb4 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:55:11.018198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a4ec70e2-79ce-441d-ae57-804e1b51ddb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:55:11.036736 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec70e2-79ce-441d-ae57-804e1b51ddb4 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:55:11.043746 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32bc30-7228-4269-8c44-2842db089b58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:55:11.044493 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32bc30-7228-4269-8c44-2842db089b58 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:55:11.044779 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32bc30-7228-4269-8c44-2842db089b58 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:55:11.045060 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32bc30-7228-4269-8c44-2842db089b58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:55:11.056629 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32bc30-7228-4269-8c44-2842db089b58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:55:11.058175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32bc30-7228-4269-8c44-2842db089b58 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:55:11.069480 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4500/8949] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:55:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:55:20.984005 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:55:21.065221 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=6 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:55:26.191966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f47da46-cb70-4f0f-bbde-6b29f73f9b2e None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:55:26.193417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1f47da46-cb70-4f0f-bbde-6b29f73f9b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:55:26.262203 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f47da46-cb70-4f0f-bbde-6b29f73f9b2e None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:55:26.267227 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57dce3-a23d-46d5-9669-9527c9057551 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:55:26.267833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57dce3-a23d-46d5-9669-9527c9057551 service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:55:26.268113 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57dce3-a23d-46d5-9669-9527c9057551 service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:55:26.268384 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57dce3-a23d-46d5-9669-9527c9057551 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:55:26.270104 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6f57dce3-a23d-46d5-9669-9527c9057551 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:55:26.281963 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57dce3-a23d-46d5-9669-9527c9057551 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:55:26.283569 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57dce3-a23d-46d5-9669-9527c9057551 service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:55:26.293269 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4450/8950] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:55:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:55:36.289220 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=32 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:55:57.938275 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af881412-b84c-4088-a238-4577406adb77 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:55:57.939359 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af881412-b84c-4088-a238-4577406adb77 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:55:57.939840 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af881412-b84c-4088-a238-4577406adb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:55:57.961061 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-af881412-b84c-4088-a238-4577406adb77 None None] MFA Rules not processed for user `1f605e9c98464387b21755ec13a52070`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:55:57.962295 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-af881412-b84c-4088-a238-4577406adb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:55:57.969337 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4501/8951] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:55:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:56:07.954742 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:56:47.652830 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57dce3-a23d-46d5-9669-9527c9057551 service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:56:47.654249 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-6f57dce3-a23d-46d5-9669-9527c9057551 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:56:47.666078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57dce3-a23d-46d5-9669-9527c9057551 service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:56:47.669841 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438285d-d5e9-470c-b030-65d2621e2837 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:56:47.670444 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438285d-d5e9-470c-b030-65d2621e2837 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:56:47.670821 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438285d-d5e9-470c-b030-65d2621e2837 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:56:47.671096 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438285d-d5e9-470c-b030-65d2621e2837 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:56:47.672933 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b438285d-d5e9-470c-b030-65d2621e2837 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:56:47.688970 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438285d-d5e9-470c-b030-65d2621e2837 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:56:47.690399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438285d-d5e9-470c-b030-65d2621e2837 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:56:47.701487 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4451/8952] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:56:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:56:48.881749 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af881412-b84c-4088-a238-4577406adb77 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:56:48.891189 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af881412-b84c-4088-a238-4577406adb77 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:56:48.894721 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bddca8-d666-40f8-b5c3-04482be92263 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:56:48.895825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bddca8-d666-40f8-b5c3-04482be92263 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:56:48.896098 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bddca8-d666-40f8-b5c3-04482be92263 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:56:48.896365 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bddca8-d666-40f8-b5c3-04482be92263 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:56:48.898049 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-93bddca8-d666-40f8-b5c3-04482be92263 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:56:48.911565 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bddca8-d666-40f8-b5c3-04482be92263 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:56:48.913085 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bddca8-d666-40f8-b5c3-04482be92263 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:56:48.924604 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4502/8953] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:56:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:56:57.696685 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:56:58.919811 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=6 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:57:33.190469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438285d-d5e9-470c-b030-65d2621e2837 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:57:33.202891 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438285d-d5e9-470c-b030-65d2621e2837 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:57:33.209344 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65f990-7b27-4861-99e8-1231f6491896 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:57:33.209976 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65f990-7b27-4861-99e8-1231f6491896 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:57:33.210267 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65f990-7b27-4861-99e8-1231f6491896 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:57:33.210539 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65f990-7b27-4861-99e8-1231f6491896 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:57:33.212496 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-2d65f990-7b27-4861-99e8-1231f6491896 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:57:33.225429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d65f990-7b27-4861-99e8-1231f6491896 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:57:33.227041 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d65f990-7b27-4861-99e8-1231f6491896 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:57:33.237950 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4452/8954] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:57:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:57:37.792834 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cf92b-96f6-4bc1-be6a-cc62ff1f0793 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:57:37.793304 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cf92b-96f6-4bc1-be6a-cc62ff1f0793 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:57:37.793406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cf92b-96f6-4bc1-be6a-cc62ff1f0793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:57:37.812653 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-ac4cf92b-96f6-4bc1-be6a-cc62ff1f0793 None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:57:37.813861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ac4cf92b-96f6-4bc1-be6a-cc62ff1f0793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:57:37.822771 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4503/8955] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 21:57:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:57:37.849313 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65f990-7b27-4861-99e8-1231f6491896 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:57:37.861958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65f990-7b27-4861-99e8-1231f6491896 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:57:37.867688 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc16333-332c-469a-9a4b-a638d723bbd8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:57:37.869016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc16333-332c-469a-9a4b-a638d723bbd8 service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:57:37.869342 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc16333-332c-469a-9a4b-a638d723bbd8 service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:57:37.869558 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc16333-332c-469a-9a4b-a638d723bbd8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:57:37.879078 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc16333-332c-469a-9a4b-a638d723bbd8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:57:37.884988 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc16333-332c-469a-9a4b-a638d723bbd8 service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:57:37.896313 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4453/8956] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:57:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:57:43.919581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b28b8-3931-4a0e-a7e1-126c7e7df2d4 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:57:43.919581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b28b8-3931-4a0e-a7e1-126c7e7df2d4 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:57:43.919581 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b28b8-3931-4a0e-a7e1-126c7e7df2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:57:43.944401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-343b28b8-3931-4a0e-a7e1-126c7e7df2d4 None None] MFA Rules not processed for user `1f605e9c98464387b21755ec13a52070`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:57:43.945419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-343b28b8-3931-4a0e-a7e1-126c7e7df2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:57:43.956776 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4504/8957] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:57:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:57:44.327946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc16333-332c-469a-9a4b-a638d723bbd8 service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:57:44.339012 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc16333-332c-469a-9a4b-a638d723bbd8 service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:57:44.350605 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6dead-9d97-4345-a4b9-5ce55141d3f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:57:44.351692 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6dead-9d97-4345-a4b9-5ce55141d3f9 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:57:44.351980 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6dead-9d97-4345-a4b9-5ce55141d3f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:57:44.352257 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6dead-9d97-4345-a4b9-5ce55141d3f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:57:44.356971 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-37f6dead-9d97-4345-a4b9-5ce55141d3f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:57:44.371090 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6dead-9d97-4345-a4b9-5ce55141d3f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:57:44.372817 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6dead-9d97-4345-a4b9-5ce55141d3f9 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:57:44.397257 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4454/8958] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:57:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:57:46.632197 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b28b8-3931-4a0e-a7e1-126c7e7df2d4 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:57:46.643013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b28b8-3931-4a0e-a7e1-126c7e7df2d4 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:57:46.647780 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8207b5-a79f-48a4-bd09-96316738e979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:57:46.648595 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8207b5-a79f-48a4-bd09-96316738e979 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:57:46.648875 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8207b5-a79f-48a4-bd09-96316738e979 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:57:46.649175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8207b5-a79f-48a4-bd09-96316738e979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:57:46.651034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ac8207b5-a79f-48a4-bd09-96316738e979 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:57:46.662075 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8207b5-a79f-48a4-bd09-96316738e979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:57:46.663567 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8207b5-a79f-48a4-bd09-96316738e979 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:57:46.676617 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4505/8959] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:57:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:57:52.127218 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6dead-9d97-4345-a4b9-5ce55141d3f9 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:57:52.141457 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6dead-9d97-4345-a4b9-5ce55141d3f9 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:57:52.147021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a410ef-618e-4aac-938f-b30b39b9c491 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:57:52.147623 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a410ef-618e-4aac-938f-b30b39b9c491 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:57:52.147903 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a410ef-618e-4aac-938f-b30b39b9c491 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:57:52.148176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a410ef-618e-4aac-938f-b30b39b9c491 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:57:52.149890 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c6a410ef-618e-4aac-938f-b30b39b9c491 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:57:52.162043 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a410ef-618e-4aac-938f-b30b39b9c491 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:57:52.163648 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a410ef-618e-4aac-938f-b30b39b9c491 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:57:52.175055 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4455/8960] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:57:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:57:56.669852 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=12 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:58:02.169903 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=24 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:58:29.048354 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb41748-0768-4361-b0bc-933781540b1e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:58:29.048951 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb41748-0768-4361-b0bc-933781540b1e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:58:29.048951 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb41748-0768-4361-b0bc-933781540b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:58:29.069475 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-fdb41748-0768-4361-b0bc-933781540b1e None None] MFA Rules not processed for user `174e91100a184740b7c604730266dc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:58:29.070718 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-fdb41748-0768-4361-b0bc-933781540b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:58:29.078181 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4506/8961] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 21:58:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:58:29.091547 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a410ef-618e-4aac-938f-b30b39b9c491 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:58:29.101705 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a410ef-618e-4aac-938f-b30b39b9c491 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:58:29.105339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164219b2-2ff9-4320-b1f8-df4c830ea922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:58:29.105967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164219b2-2ff9-4320-b1f8-df4c830ea922 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:58:29.106245 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164219b2-2ff9-4320-b1f8-df4c830ea922 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:58:29.106524 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164219b2-2ff9-4320-b1f8-df4c830ea922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:58:29.114443 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164219b2-2ff9-4320-b1f8-df4c830ea922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:58:29.116037 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164219b2-2ff9-4320-b1f8-df4c830ea922 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:58:29.124452 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4456/8962] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:58:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:58:29.213737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad181d7-5be3-4bff-80ed-28938ccf1f21 None None] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:58:29.214025 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad181d7-5be3-4bff-80ed-28938ccf1f21 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:58:29.214301 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad181d7-5be3-4bff-80ed-28938ccf1f21 None None] PATH_INFO: `/` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:58:29.215688 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4507/8963] 10.222.0.33 () {54 vars in 921 bytes} [Sat Aug 6 21:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 21:58:29.220280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7eddd-c5ab-4adb-bd47-03f58e358f61 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:58:29.220575 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7eddd-c5ab-4adb-bd47-03f58e358f61 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:58:29.220835 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7eddd-c5ab-4adb-bd47-03f58e358f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:58:29.241394 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-12d7eddd-c5ab-4adb-bd47-03f58e358f61 None None] MFA Rules not processed for user `aeafb87d52414c979a774861a2d49ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:58:29.242641 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-12d7eddd-c5ab-4adb-bd47-03f58e358f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:58:29.251133 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4457/8964] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 21:58:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 21:58:29.271556 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad181d7-5be3-4bff-80ed-28938ccf1f21 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:58:29.273217 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-4ad181d7-5be3-4bff-80ed-28938ccf1f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:58:29.290228 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad181d7-5be3-4bff-80ed-28938ccf1f21 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:58:29.295419 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cee5e-33b8-4753-944d-72007f497917 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:58:29.296013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cee5e-33b8-4753-944d-72007f497917 service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:58:29.296289 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cee5e-33b8-4753-944d-72007f497917 service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:58:29.296575 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cee5e-33b8-4753-944d-72007f497917 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:58:29.305329 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232cee5e-33b8-4753-944d-72007f497917 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:58:29.306944 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232cee5e-33b8-4753-944d-72007f497917 service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:58:29.317005 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4508/8965] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:58:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:58:30.493578 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4e3d5-01bd-4182-89fb-8e97d2480c01 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:58:30.493981 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4e3d5-01bd-4182-89fb-8e97d2480c01 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:58:30.494130 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4e3d5-01bd-4182-89fb-8e97d2480c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:58:30.513959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-f1c4e3d5-01bd-4182-89fb-8e97d2480c01 None None] MFA Rules not processed for user `5f9d53147a57402f8b9818590bc1fc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:58:30.515176 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-f1c4e3d5-01bd-4182-89fb-8e97d2480c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:58:30.524549 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4458/8966] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 21:58:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:58:30.536020 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cee5e-33b8-4753-944d-72007f497917 service placement] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:58:30.545149 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cee5e-33b8-4753-944d-72007f497917 service placement] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:58:30.548704 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4aca52-d238-468b-954d-17f869f9f968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:58:30.549892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4aca52-d238-468b-954d-17f869f9f968 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:58:30.550165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4aca52-d238-468b-954d-17f869f9f968 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:58:30.550431 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4aca52-d238-468b-954d-17f869f9f968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:58:30.560334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4aca52-d238-468b-954d-17f869f9f968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:58:30.561735 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4aca52-d238-468b-954d-17f869f9f968 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:58:30.572408 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4509/8967] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:58:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:58:40.508873 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=12 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:58:40.567857 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=15 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:58:46.800966 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4e3d5-01bd-4182-89fb-8e97d2480c01 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:58:46.810926 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4e3d5-01bd-4182-89fb-8e97d2480c01 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:58:46.814804 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b235630-3ad0-4ebf-b344-74ec20856170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:58:46.816198 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b235630-3ad0-4ebf-b344-74ec20856170 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:58:46.816493 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b235630-3ad0-4ebf-b344-74ec20856170 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:58:46.816762 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b235630-3ad0-4ebf-b344-74ec20856170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:58:46.818498 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-0b235630-3ad0-4ebf-b344-74ec20856170 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:58:46.828515 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b235630-3ad0-4ebf-b344-74ec20856170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:58:46.830212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b235630-3ad0-4ebf-b344-74ec20856170 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:58:46.839738 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4459/8968] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:58:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 21:58:56.835627 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:59:33.147377 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be7ece-ffaa-4dc9-ac16-9507465c436f None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:59:33.147963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be7ece-ffaa-4dc9-ac16-9507465c436f None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:59:33.147963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be7ece-ffaa-4dc9-ac16-9507465c436f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:59:33.168473 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-c6be7ece-ffaa-4dc9-ac16-9507465c436f None None] MFA Rules not processed for user `1f605e9c98464387b21755ec13a52070`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 21:59:33.169889 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c6be7ece-ffaa-4dc9-ac16-9507465c436f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:59:33.177155 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4510/8969] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 21:59:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 21:59:33.908213 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b235630-3ad0-4ebf-b344-74ec20856170 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:59:33.925039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b235630-3ad0-4ebf-b344-74ec20856170 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:59:33.933064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307a9cf-7ebd-4ab2-b7b4-694a483eceb6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:59:33.934206 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307a9cf-7ebd-4ab2-b7b4-694a483eceb6 service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:59:33.934717 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307a9cf-7ebd-4ab2-b7b4-694a483eceb6 service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:59:33.935167 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307a9cf-7ebd-4ab2-b7b4-694a483eceb6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:59:33.937470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-4307a9cf-7ebd-4ab2-b7b4-694a483eceb6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:59:33.945809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be7ece-ffaa-4dc9-ac16-9507465c436f None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:59:33.952748 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4307a9cf-7ebd-4ab2-b7b4-694a483eceb6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:59:33.955032 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4307a9cf-7ebd-4ab2-b7b4-694a483eceb6 service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:59:33.961047 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be7ece-ffaa-4dc9-ac16-9507465c436f None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:59:33.966243 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee2505-24d7-452b-8b11-05d359e295e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:59:33.971047 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee2505-24d7-452b-8b11-05d359e295e7 service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:59:33.971530 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee2505-24d7-452b-8b11-05d359e295e7 service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:59:33.972169 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee2505-24d7-452b-8b11-05d359e295e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:59:33.975615 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-39ee2505-24d7-452b-8b11-05d359e295e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:59:33.980492 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4460/8970] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:59:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:59:33.989230 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee2505-24d7-452b-8b11-05d359e295e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:59:33.991241 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee2505-24d7-452b-8b11-05d359e295e7 service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:59:34.002054 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4511/8971] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 21:59:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:59:43.962657 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:59:43.997583 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=9 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:00:05.907168 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307a9cf-7ebd-4ab2-b7b4-694a483eceb6 service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:00:05.929550 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307a9cf-7ebd-4ab2-b7b4-694a483eceb6 service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:00:05.935616 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b941a3-00b0-45cb-8e49-01e43ef368fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:00:05.936211 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b941a3-00b0-45cb-8e49-01e43ef368fc service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:00:05.936490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b941a3-00b0-45cb-8e49-01e43ef368fc service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:00:05.936763 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b941a3-00b0-45cb-8e49-01e43ef368fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:00:05.945314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b941a3-00b0-45cb-8e49-01e43ef368fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:00:05.946929 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b941a3-00b0-45cb-8e49-01e43ef368fc service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:00:05.956176 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4461/8972] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:00:05 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 22:00:15.951907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=10 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:00:35.205101 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee2505-24d7-452b-8b11-05d359e295e7 service placement] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:00:35.215671 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee2505-24d7-452b-8b11-05d359e295e7 service placement] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:00:35.220670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d286c-cb71-4fca-975f-83b5550f15d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:00:35.221258 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d286c-cb71-4fca-975f-83b5550f15d0 service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:00:35.221557 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d286c-cb71-4fca-975f-83b5550f15d0 service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:00:35.221828 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d286c-cb71-4fca-975f-83b5550f15d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:00:35.230586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d286c-cb71-4fca-975f-83b5550f15d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:00:35.231999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d286c-cb71-4fca-975f-83b5550f15d0 service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:00:35.241880 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4512/8973] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:00:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 22:00:45.237735 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=6 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:01:13.301643 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b941a3-00b0-45cb-8e49-01e43ef368fc service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:01:13.330714 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b941a3-00b0-45cb-8e49-01e43ef368fc service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:01:13.336103 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a06e2-a1b8-420b-9513-5fc1dabf26e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:01:13.337312 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a06e2-a1b8-420b-9513-5fc1dabf26e1 service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:01:13.337596 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a06e2-a1b8-420b-9513-5fc1dabf26e1 service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:01:13.337874 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a06e2-a1b8-420b-9513-5fc1dabf26e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:01:13.340278 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-888a06e2-a1b8-420b-9513-5fc1dabf26e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:01:13.353936 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a06e2-a1b8-420b-9513-5fc1dabf26e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:01:13.355842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a06e2-a1b8-420b-9513-5fc1dabf26e1 service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:01:13.380948 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4462/8974] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:01:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 22:01:16.515226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d286c-cb71-4fca-975f-83b5550f15d0 service placement] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:01:16.535769 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d286c-cb71-4fca-975f-83b5550f15d0 service placement] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:01:16.539644 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d78f1-c939-481e-86bf-c1b36e44d1a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:01:16.540453 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d78f1-c939-481e-86bf-c1b36e44d1a8 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:01:16.540808 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d78f1-c939-481e-86bf-c1b36e44d1a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:01:16.541768 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d78f1-c939-481e-86bf-c1b36e44d1a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:01:16.551480 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d78f1-c939-481e-86bf-c1b36e44d1a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:01:16.552999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d78f1-c939-481e-86bf-c1b36e44d1a8 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:01:16.564093 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4513/8975] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:01:16 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 22:01:19.261809 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fab89-dab6-4ece-a2b4-6715a0b4294e None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:01:19.263878 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fab89-dab6-4ece-a2b4-6715a0b4294e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:01:19.264467 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fab89-dab6-4ece-a2b4-6715a0b4294e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:01:19.292435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-1e0fab89-dab6-4ece-a2b4-6715a0b4294e None None] MFA Rules not processed for user `1f605e9c98464387b21755ec13a52070`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 22:01:19.293855 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-1e0fab89-dab6-4ece-a2b4-6715a0b4294e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:01:19.305803 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4463/8976] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 22:01:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 22:01:20.023433 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d78f1-c939-481e-86bf-c1b36e44d1a8 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:01:20.037905 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d78f1-c939-481e-86bf-c1b36e44d1a8 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:01:20.048722 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c87c3-89d3-4368-a5c7-17505d718ab6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:01:20.049339 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c87c3-89d3-4368-a5c7-17505d718ab6 service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:01:20.049748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c87c3-89d3-4368-a5c7-17505d718ab6 service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:01:20.050131 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c87c3-89d3-4368-a5c7-17505d718ab6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:01:20.053190 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-056c87c3-89d3-4368-a5c7-17505d718ab6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:01:20.072013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c87c3-89d3-4368-a5c7-17505d718ab6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:01:20.074186 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c87c3-89d3-4368-a5c7-17505d718ab6 service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:01:20.086932 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4514/8977] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:01:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 22:01:29.281948 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=13 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:01:30.081947 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=16 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:01:32.830278 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0fab89-dab6-4ece-a2b4-6715a0b4294e None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:01:32.844535 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0fab89-dab6-4ece-a2b4-6715a0b4294e None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:01:32.849940 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08c7b7-2bc5-454d-9458-d844eba11025 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:01:32.850567 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08c7b7-2bc5-454d-9458-d844eba11025 service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:01:32.850847 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08c7b7-2bc5-454d-9458-d844eba11025 service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:01:32.851119 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08c7b7-2bc5-454d-9458-d844eba11025 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:01:32.861184 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e08c7b7-2bc5-454d-9458-d844eba11025 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:01:32.862883 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e08c7b7-2bc5-454d-9458-d844eba11025 service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:01:32.874846 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4464/8978] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:01:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 22:01:42.869887 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:02:05.442619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c87c3-89d3-4368-a5c7-17505d718ab6 service placement] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:02:05.452177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c87c3-89d3-4368-a5c7-17505d718ab6 service placement] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:02:05.456015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75953745-4ce7-40f3-acd6-faf03411a6c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:02:05.456598 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75953745-4ce7-40f3-acd6-faf03411a6c2 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:02:05.456872 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75953745-4ce7-40f3-acd6-faf03411a6c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:02:05.457140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75953745-4ce7-40f3-acd6-faf03411a6c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:02:05.467188 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75953745-4ce7-40f3-acd6-faf03411a6c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:02:05.468587 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75953745-4ce7-40f3-acd6-faf03411a6c2 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:02:05.481159 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4515/8979] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:02:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 22:02:07.001160 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08c7b7-2bc5-454d-9458-d844eba11025 service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:02:07.010462 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08c7b7-2bc5-454d-9458-d844eba11025 service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:02:07.014049 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ef1ff-e797-4a58-8fca-b59074e9da41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:02:07.014671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ef1ff-e797-4a58-8fca-b59074e9da41 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:02:07.014946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ef1ff-e797-4a58-8fca-b59074e9da41 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:02:07.015212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ef1ff-e797-4a58-8fca-b59074e9da41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:02:07.024972 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ef1ff-e797-4a58-8fca-b59074e9da41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:02:07.026382 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ef1ff-e797-4a58-8fca-b59074e9da41 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:02:07.037106 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4465/8980] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:02:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 22:02:15.475791 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=6 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:02:17.032901 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:02:18.081183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75953745-4ce7-40f3-acd6-faf03411a6c2 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:02:18.149803 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75953745-4ce7-40f3-acd6-faf03411a6c2 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:02:18.155007 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e50e8-fa8b-48e2-80ac-2ade8be82205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:02:18.155665 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e50e8-fa8b-48e2-80ac-2ade8be82205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:02:18.155940 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e50e8-fa8b-48e2-80ac-2ade8be82205 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:02:18.156209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e50e8-fa8b-48e2-80ac-2ade8be82205 admin admin] PATH_INFO: `/v3/users/1f605e9c98464387b21755ec13a52070` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:02:18.157310 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e50e8-fa8b-48e2-80ac-2ade8be82205 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f605e9c98464387b21755ec13a52070)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:02:18.159273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e50e8-fa8b-48e2-80ac-2ade8be82205 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:02:18.205265 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-924e50e8-fa8b-48e2-80ac-2ade8be82205 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f605e9c98464387b21755ec13a52070'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:02:18.212203 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-924e50e8-fa8b-48e2-80ac-2ade8be82205 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f605e9c98464387b21755ec13a52070'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:02:18.212864 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-924e50e8-fa8b-48e2-80ac-2ade8be82205 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f605e9c98464387b21755ec13a52070'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:02:18.213471 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-924e50e8-fa8b-48e2-80ac-2ade8be82205 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f605e9c98464387b21755ec13a52070'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:02:18.220861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-924e50e8-fa8b-48e2-80ac-2ade8be82205 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f605e9c98464387b21755ec13a52070'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:02:18.237909 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4516/8981] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 22:02:18 2022] DELETE /identity/v3/users/1f605e9c98464387b21755ec13a52070 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 22:02:18.242799 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360a50d-f7ea-410e-80ef-c0b031c9c079 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:02:18.243259 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360a50d-f7ea-410e-80ef-c0b031c9c079 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:02:18.243384 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360a50d-f7ea-410e-80ef-c0b031c9c079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:02:18.262043 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-5360a50d-f7ea-410e-80ef-c0b031c9c079 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 22:02:18.263970 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5360a50d-f7ea-410e-80ef-c0b031c9c079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:02:18.322568 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4466/8982] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 22:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 22:02:18.333627 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e50e8-fa8b-48e2-80ac-2ade8be82205 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:02:18.335050 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-924e50e8-fa8b-48e2-80ac-2ade8be82205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:02:18.392725 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e50e8-fa8b-48e2-80ac-2ade8be82205 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:02:18.396316 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac642ba4-31ad-4eb9-b8d5-150a1fe11cf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:02:18.396903 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac642ba4-31ad-4eb9-b8d5-150a1fe11cf7 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:02:18.397183 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac642ba4-31ad-4eb9-b8d5-150a1fe11cf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:02:18.397456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac642ba4-31ad-4eb9-b8d5-150a1fe11cf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:02:18.407125 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac642ba4-31ad-4eb9-b8d5-150a1fe11cf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:02:18.408907 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac642ba4-31ad-4eb9-b8d5-150a1fe11cf7 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:02:18.418344 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4517/8983] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:02:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 22:02:18.596095 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5360a50d-f7ea-410e-80ef-c0b031c9c079 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:02:18.597671 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5360a50d-f7ea-410e-80ef-c0b031c9c079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:02:18.610666 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5360a50d-f7ea-410e-80ef-c0b031c9c079 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:02:18.615537 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac917165-a728-4575-a7a8-21a23abdd1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:02:18.616246 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac917165-a728-4575-a7a8-21a23abdd1ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:02:18.616600 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac917165-a728-4575-a7a8-21a23abdd1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:02:18.616941 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac917165-a728-4575-a7a8-21a23abdd1ea admin admin] PATH_INFO: `/v3/projects/1ac47bb71e6e4ecf9f5197f217a159da` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:02:18.618166 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac917165-a728-4575-a7a8-21a23abdd1ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ac47bb71e6e4ecf9f5197f217a159da)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:02:18.620192 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac917165-a728-4575-a7a8-21a23abdd1ea admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:02:18.681842 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ac917165-a728-4575-a7a8-21a23abdd1ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ac47bb71e6e4ecf9f5197f217a159da', 'request_id': 'req-ac917165-a728-4575-a7a8-21a23abdd1ea'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:02:18.687813 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ac917165-a728-4575-a7a8-21a23abdd1ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ac47bb71e6e4ecf9f5197f217a159da', 'request_id': 'req-ac917165-a728-4575-a7a8-21a23abdd1ea'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:02:18.694012 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ac917165-a728-4575-a7a8-21a23abdd1ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ac47bb71e6e4ecf9f5197f217a159da', 'request_id': 'req-ac917165-a728-4575-a7a8-21a23abdd1ea'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:02:18.707048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ac917165-a728-4575-a7a8-21a23abdd1ea admin admin] The token cache is being invalidate because project 1ac47bb71e6e4ecf9f5197f217a159da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 22:02:18.707333 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ac917165-a728-4575-a7a8-21a23abdd1ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:02:18.707947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-ac917165-a728-4575-a7a8-21a23abdd1ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:02:18.709518 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4467/8984] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 22:02:18 2022] DELETE /identity/v3/projects/1ac47bb71e6e4ecf9f5197f217a159da => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 22:02:18.713642 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac642ba4-31ad-4eb9-b8d5-150a1fe11cf7 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:02:18.723514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac642ba4-31ad-4eb9-b8d5-150a1fe11cf7 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:02:18.741745 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:02:18.785682 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e5603-2890-481b-a555-3e24c5d1368a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:02:18.786350 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e5603-2890-481b-a555-3e24c5d1368a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:02:18.786738 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e5603-2890-481b-a555-3e24c5d1368a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:02:18.787135 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e5603-2890-481b-a555-3e24c5d1368a admin admin] PATH_INFO: `/v3/users/7bc4fc58dd244c0792da5dfdf2d1246c` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:02:18.788531 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e5603-2890-481b-a555-3e24c5d1368a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bc4fc58dd244c0792da5dfdf2d1246c)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:02:18.790461 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e5603-2890-481b-a555-3e24c5d1368a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:02:18.836505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-523e5603-2890-481b-a555-3e24c5d1368a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bc4fc58dd244c0792da5dfdf2d1246c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:02:18.844459 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-523e5603-2890-481b-a555-3e24c5d1368a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bc4fc58dd244c0792da5dfdf2d1246c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:02:18.845175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-523e5603-2890-481b-a555-3e24c5d1368a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bc4fc58dd244c0792da5dfdf2d1246c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:02:18.845804 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-523e5603-2890-481b-a555-3e24c5d1368a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bc4fc58dd244c0792da5dfdf2d1246c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:02:18.852274 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-523e5603-2890-481b-a555-3e24c5d1368a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bc4fc58dd244c0792da5dfdf2d1246c'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:02:18.869647 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4518/8985] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 22:02:18 2022] DELETE /identity/v3/users/7bc4fc58dd244c0792da5dfdf2d1246c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 22:02:19.183249 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac917165-a728-4575-a7a8-21a23abdd1ea admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:02:19.184859 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ac917165-a728-4575-a7a8-21a23abdd1ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:02:19.198077 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac917165-a728-4575-a7a8-21a23abdd1ea admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:02:19.257328 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb719bb5-a53b-40fb-bbd9-179dbe08bcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:02:19.257977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb719bb5-a53b-40fb-bbd9-179dbe08bcad admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:02:19.258175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb719bb5-a53b-40fb-bbd9-179dbe08bcad admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:02:19.258477 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb719bb5-a53b-40fb-bbd9-179dbe08bcad admin admin] PATH_INFO: `/v3/projects/1d5911b48c2943e39e58e049decca380` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:02:19.259621 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb719bb5-a53b-40fb-bbd9-179dbe08bcad admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d5911b48c2943e39e58e049decca380)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:02:19.261552 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb719bb5-a53b-40fb-bbd9-179dbe08bcad admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:02:19.293065 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:02:19.310664 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-cb719bb5-a53b-40fb-bbd9-179dbe08bcad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d5911b48c2943e39e58e049decca380', 'request_id': 'req-cb719bb5-a53b-40fb-bbd9-179dbe08bcad'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:02:19.316081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-cb719bb5-a53b-40fb-bbd9-179dbe08bcad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d5911b48c2943e39e58e049decca380', 'request_id': 'req-cb719bb5-a53b-40fb-bbd9-179dbe08bcad'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:02:19.322280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-cb719bb5-a53b-40fb-bbd9-179dbe08bcad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d5911b48c2943e39e58e049decca380', 'request_id': 'req-cb719bb5-a53b-40fb-bbd9-179dbe08bcad'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:02:19.334817 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-cb719bb5-a53b-40fb-bbd9-179dbe08bcad admin admin] The token cache is being invalidate because project 1d5911b48c2943e39e58e049decca380 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102758) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 22:02:19.335108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-cb719bb5-a53b-40fb-bbd9-179dbe08bcad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:02:19.335783 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-cb719bb5-a53b-40fb-bbd9-179dbe08bcad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:02:19.337603 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4468/8986] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 22:02:19 2022] DELETE /identity/v3/projects/1d5911b48c2943e39e58e049decca380 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 22:02:19.343676 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92832b0a-c2ad-4e5d-926d-081d8a458c53 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:02:19.344168 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92832b0a-c2ad-4e5d-926d-081d8a458c53 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:02:19.344346 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92832b0a-c2ad-4e5d-926d-081d8a458c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:02:19.383214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-92832b0a-c2ad-4e5d-926d-081d8a458c53 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 22:02:19.384417 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-92832b0a-c2ad-4e5d-926d-081d8a458c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:02:19.443322 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4519/8987] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 22:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 22:02:19.451733 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacc77b-6f97-4f4a-8eba-477fc99ac813 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:02:19.452022 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacc77b-6f97-4f4a-8eba-477fc99ac813 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:02:19.452303 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacc77b-6f97-4f4a-8eba-477fc99ac813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:02:19.473914 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-9aacc77b-6f97-4f4a-8eba-477fc99ac813 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 22:02:19.475159 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9aacc77b-6f97-4f4a-8eba-477fc99ac813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:02:19.483877 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4469/8988] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 22:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 22:02:19.487974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92832b0a-c2ad-4e5d-926d-081d8a458c53 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:02:19.497603 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92832b0a-c2ad-4e5d-926d-081d8a458c53 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:02:19.502196 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20666729-4956-4ee4-a2fa-4e6cb8b65b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:02:19.502814 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20666729-4956-4ee4-a2fa-4e6cb8b65b6a admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:02:19.503092 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20666729-4956-4ee4-a2fa-4e6cb8b65b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:02:19.503362 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20666729-4956-4ee4-a2fa-4e6cb8b65b6a admin admin] PATH_INFO: `/v3/domains` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:02:19.503996 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20666729-4956-4ee4-a2fa-4e6cb8b65b6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102759) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 22:02:19.504294 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20666729-4956-4ee4-a2fa-4e6cb8b65b6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:02:19.505870 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20666729-4956-4ee4-a2fa-4e6cb8b65b6a admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:02:19.517292 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4520/8989] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 22:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 22:02:19.521418 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacc77b-6f97-4f4a-8eba-477fc99ac813 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:02:19.531279 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacc77b-6f97-4f4a-8eba-477fc99ac813 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:02:19.535947 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa91ff-8fcd-4840-8227-54273b10d044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:02:19.536538 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa91ff-8fcd-4840-8227-54273b10d044 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:02:19.536817 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa91ff-8fcd-4840-8227-54273b10d044 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:02:19.537090 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa91ff-8fcd-4840-8227-54273b10d044 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:02:19.537737 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aa91ff-8fcd-4840-8227-54273b10d044 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:02:19.539767 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aa91ff-8fcd-4840-8227-54273b10d044 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:02:19.577296 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4470/8990] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 22:02:19 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 22:02:19.581739 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20666729-4956-4ee4-a2fa-4e6cb8b65b6a admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:02:19.592489 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20666729-4956-4ee4-a2fa-4e6cb8b65b6a admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:02:19.601470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:02:19.656285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf3c7c-fa9a-4289-a27a-d0cbadc2e690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:02:19.656892 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf3c7c-fa9a-4289-a27a-d0cbadc2e690 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:02:19.657260 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf3c7c-fa9a-4289-a27a-d0cbadc2e690 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:02:19.657446 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf3c7c-fa9a-4289-a27a-d0cbadc2e690 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:02:19.658066 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf3c7c-fa9a-4289-a27a-d0cbadc2e690 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:02:19.660013 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf3c7c-fa9a-4289-a27a-d0cbadc2e690 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:02:19.682922 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4521/8991] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 22:02:19 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 22:02:19.687499 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa91ff-8fcd-4840-8227-54273b10d044 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:02:19.697781 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa91ff-8fcd-4840-8227-54273b10d044 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:02:19.703149 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80b26c-e9a4-4eac-99c7-321588471af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:02:19.704028 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80b26c-e9a4-4eac-99c7-321588471af5 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:02:19.704308 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80b26c-e9a4-4eac-99c7-321588471af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:02:19.704581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80b26c-e9a4-4eac-99c7-321588471af5 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:02:19.705251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a80b26c-e9a4-4eac-99c7-321588471af5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:02:19.706884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a80b26c-e9a4-4eac-99c7-321588471af5 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:02:19.717405 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4471/8992] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 22:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 22:02:19.721331 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf3c7c-fa9a-4289-a27a-d0cbadc2e690 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:02:19.731264 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf3c7c-fa9a-4289-a27a-d0cbadc2e690 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:02:19.735983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b6d20-deb0-468d-b0ea-ed26c35346cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:02:19.736574 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b6d20-deb0-468d-b0ea-ed26c35346cb admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:02:19.736966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b6d20-deb0-468d-b0ea-ed26c35346cb admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:02:19.737298 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b6d20-deb0-468d-b0ea-ed26c35346cb admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:02:19.737937 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b6d20-deb0-468d-b0ea-ed26c35346cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:02:19.739579 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b6d20-deb0-468d-b0ea-ed26c35346cb admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:02:19.750021 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4522/8993] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 22:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 22:02:19.754085 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80b26c-e9a4-4eac-99c7-321588471af5 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:02:19.764570 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80b26c-e9a4-4eac-99c7-321588471af5 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:02:19.769188 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba10f1-80f9-41db-b4a5-2aa042e87edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:02:19.769767 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba10f1-80f9-41db-b4a5-2aa042e87edb admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:02:19.770044 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba10f1-80f9-41db-b4a5-2aa042e87edb admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:02:19.770318 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba10f1-80f9-41db-b4a5-2aa042e87edb admin admin] PATH_INFO: `/v3/projects/169cc994a698408ba8bc2297e0b92fc7/users/7ace3bf8975f45cb8b454d637cc4e917/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:02:19.785358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba10f1-80f9-41db-b4a5-2aa042e87edb admin admin] RBAC: Authorizing `identity:create_grant(project_id=169cc994a698408ba8bc2297e0b92fc7, user_id=7ace3bf8975f45cb8b454d637cc4e917, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:02:19.788084 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba10f1-80f9-41db-b4a5-2aa042e87edb admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:02:19.800796 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4472/8994] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 22:02:19 2022] PUT /identity/v3/projects/169cc994a698408ba8bc2297e0b92fc7/users/7ace3bf8975f45cb8b454d637cc4e917/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 22:02:19.805823 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc47f8-7e2b-4e11-b18a-7437d0cd37fd None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:02:19.806112 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc47f8-7e2b-4e11-b18a-7437d0cd37fd None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:02:19.806392 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc47f8-7e2b-4e11-b18a-7437d0cd37fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:02:19.825198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-52bc47f8-7e2b-4e11-b18a-7437d0cd37fd None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 22:02:19.827333 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-52bc47f8-7e2b-4e11-b18a-7437d0cd37fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:02:19.887540 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4523/8995] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 22:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 22:02:19.897710 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba10f1-80f9-41db-b4a5-2aa042e87edb admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:02:19.899433 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-daba10f1-80f9-41db-b4a5-2aa042e87edb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:02:19.957680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba10f1-80f9-41db-b4a5-2aa042e87edb admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:02:19.961745 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72506992-8419-4fda-b050-39324bec00c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:02:19.962360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72506992-8419-4fda-b050-39324bec00c7 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:02:19.962674 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72506992-8419-4fda-b050-39324bec00c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:02:19.962956 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72506992-8419-4fda-b050-39324bec00c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:02:19.972524 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72506992-8419-4fda-b050-39324bec00c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:02:19.973954 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72506992-8419-4fda-b050-39324bec00c7 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:02:19.983587 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4473/8996] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:02:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 22:02:24.119974 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c01340-4e40-483e-8419-8c0e883e6b42 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:02:24.120458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c01340-4e40-483e-8419-8c0e883e6b42 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:02:24.120554 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c01340-4e40-483e-8419-8c0e883e6b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:02:24.158424 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b6c01340-4e40-483e-8419-8c0e883e6b42 None None] MFA Rules not processed for user `7ace3bf8975f45cb8b454d637cc4e917`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 22:02:24.160264 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b6c01340-4e40-483e-8419-8c0e883e6b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:02:24.231514 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4524/8997] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 22:02:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 22:02:24.237012 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72506992-8419-4fda-b050-39324bec00c7 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:02:24.247171 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72506992-8419-4fda-b050-39324bec00c7 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:02:24.253196 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd994e-3f9f-4b59-b0c7-b91d78ebaed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:02:24.253797 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd994e-3f9f-4b59-b0c7-b91d78ebaed2 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:02:24.254072 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd994e-3f9f-4b59-b0c7-b91d78ebaed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:02:24.254339 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd994e-3f9f-4b59-b0c7-b91d78ebaed2 admin admin] PATH_INFO: `/v3/projects` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:02:24.254989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbd994e-3f9f-4b59-b0c7-b91d78ebaed2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:02:24.256884 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbd994e-3f9f-4b59-b0c7-b91d78ebaed2 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:02:24.286581 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4474/8998] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 22:02:24 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 22:02:24.287748 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c01340-4e40-483e-8419-8c0e883e6b42 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:02:24.300529 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c01340-4e40-483e-8419-8c0e883e6b42 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:02:24.319232 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:02:24.358947 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d88fe7-44fc-4768-9a3a-b8913d6d0b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:02:24.359553 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d88fe7-44fc-4768-9a3a-b8913d6d0b56 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:02:24.359832 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d88fe7-44fc-4768-9a3a-b8913d6d0b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:02:24.360106 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d88fe7-44fc-4768-9a3a-b8913d6d0b56 admin admin] PATH_INFO: `/v3/users` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:02:24.360733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d88fe7-44fc-4768-9a3a-b8913d6d0b56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:02:24.362662 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d88fe7-44fc-4768-9a3a-b8913d6d0b56 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:02:24.385063 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4525/8999] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 22:02:24 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 22:02:24.389300 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd994e-3f9f-4b59-b0c7-b91d78ebaed2 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:02:24.400124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd994e-3f9f-4b59-b0c7-b91d78ebaed2 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:02:24.405417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d3e9e-a618-48d3-a043-85f9c4340c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:02:24.406009 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d3e9e-a618-48d3-a043-85f9c4340c5c admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:02:24.406286 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d3e9e-a618-48d3-a043-85f9c4340c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:02:24.406572 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d3e9e-a618-48d3-a043-85f9c4340c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:02:24.407234 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d3e9e-a618-48d3-a043-85f9c4340c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:02:24.408832 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d3e9e-a618-48d3-a043-85f9c4340c5c admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:02:24.420738 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4475/9000] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 22:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 22:02:24.424617 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d88fe7-44fc-4768-9a3a-b8913d6d0b56 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:02:24.435273 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d88fe7-44fc-4768-9a3a-b8913d6d0b56 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:02:24.440053 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d47b80-e9c4-488f-ba73-f08c2c748c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:02:24.440716 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d47b80-e9c4-488f-ba73-f08c2c748c61 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:02:24.440999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d47b80-e9c4-488f-ba73-f08c2c748c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:02:24.441277 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d47b80-e9c4-488f-ba73-f08c2c748c61 admin admin] PATH_INFO: `/v3/projects/12b84521be6c461ab675e1059a5a5677/users/cf1465316e8b4a2c89d51cfc20135fff/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:02:24.457275 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d47b80-e9c4-488f-ba73-f08c2c748c61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12b84521be6c461ab675e1059a5a5677, user_id=cf1465316e8b4a2c89d51cfc20135fff, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:02:24.460005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d47b80-e9c4-488f-ba73-f08c2c748c61 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:02:24.473575 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4526/9001] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 22:02:24 2022] PUT /identity/v3/projects/12b84521be6c461ab675e1059a5a5677/users/cf1465316e8b4a2c89d51cfc20135fff/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 22:02:24.477438 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d3e9e-a618-48d3-a043-85f9c4340c5c admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:02:24.488278 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d3e9e-a618-48d3-a043-85f9c4340c5c admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:02:24.496083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:02:24.547802 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae036fa-6516-4033-9e5d-de31691217c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:02:24.548409 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae036fa-6516-4033-9e5d-de31691217c8 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:02:24.548693 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae036fa-6516-4033-9e5d-de31691217c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:02:24.548969 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae036fa-6516-4033-9e5d-de31691217c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:02:24.549608 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae036fa-6516-4033-9e5d-de31691217c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:02:24.551251 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae036fa-6516-4033-9e5d-de31691217c8 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:02:24.560970 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4476/9002] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 22:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 22:02:24.565160 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d47b80-e9c4-488f-ba73-f08c2c748c61 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:02:24.575443 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d47b80-e9c4-488f-ba73-f08c2c748c61 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:02:24.580384 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04f1b0-0d2b-4035-b1eb-ff7176a96b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:02:24.581034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04f1b0-0d2b-4035-b1eb-ff7176a96b84 admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:02:24.581314 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04f1b0-0d2b-4035-b1eb-ff7176a96b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:02:24.581587 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04f1b0-0d2b-4035-b1eb-ff7176a96b84 admin admin] PATH_INFO: `/v3/projects/12b84521be6c461ab675e1059a5a5677/users/cf1465316e8b4a2c89d51cfc20135fff/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:02:24.583557 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04f1b0-0d2b-4035-b1eb-ff7176a96b84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12b84521be6c461ab675e1059a5a5677, user_id=cf1465316e8b4a2c89d51cfc20135fff, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:02:24.586209 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04f1b0-0d2b-4035-b1eb-ff7176a96b84 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:02:24.597002 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4527/9003] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 22:02:24 2022] PUT /identity/v3/projects/12b84521be6c461ab675e1059a5a5677/users/cf1465316e8b4a2c89d51cfc20135fff/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 22:02:28.822039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1978e-4330-4fb7-a2d5-0a8d5e4e1d30 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:02:28.822971 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1978e-4330-4fb7-a2d5-0a8d5e4e1d30 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:02:28.823423 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1978e-4330-4fb7-a2d5-0a8d5e4e1d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:02:28.863642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d0d1978e-4330-4fb7-a2d5-0a8d5e4e1d30 None None] MFA Rules not processed for user `cf1465316e8b4a2c89d51cfc20135fff`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 22:02:28.865153 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d0d1978e-4330-4fb7-a2d5-0a8d5e4e1d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:02:29.049205 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4477/9004] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 22:02:28 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 22:02:29.066801 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04f1b0-0d2b-4035-b1eb-ff7176a96b84 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:02:29.069967 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0f04f1b0-0d2b-4035-b1eb-ff7176a96b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:02:29.192456 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04f1b0-0d2b-4035-b1eb-ff7176a96b84 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:02:29.200211 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa03426-9cdf-4e68-91ff-670c6c502995 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:02:29.202088 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa03426-9cdf-4e68-91ff-670c6c502995 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:02:29.202361 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa03426-9cdf-4e68-91ff-670c6c502995 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:02:29.202737 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa03426-9cdf-4e68-91ff-670c6c502995 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:02:29.279597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa03426-9cdf-4e68-91ff-670c6c502995 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:02:29.283700 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa03426-9cdf-4e68-91ff-670c6c502995 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:02:29.303913 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4528/9005] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:02:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 22:02:30.672356 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c2996-63a2-404d-a71a-38fa37fc6e86 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:02:30.672877 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c2996-63a2-404d-a71a-38fa37fc6e86 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:02:30.672989 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c2996-63a2-404d-a71a-38fa37fc6e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:02:30.702680 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-a41c2996-63a2-404d-a71a-38fa37fc6e86 None None] MFA Rules not processed for user `7ace3bf8975f45cb8b454d637cc4e917`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 22:02:30.704231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a41c2996-63a2-404d-a71a-38fa37fc6e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:02:30.711113 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4478/9006] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 22:02:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 22:02:33.953114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa03426-9cdf-4e68-91ff-670c6c502995 service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:02:33.955094 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-aaa03426-9cdf-4e68-91ff-670c6c502995 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:02:33.970158 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:02:34.027607 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa03426-9cdf-4e68-91ff-670c6c502995 service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:02:34.034198 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce2e72-4c6d-455b-aff5-1a4104e9b5e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:02:34.035212 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce2e72-4c6d-455b-aff5-1a4104e9b5e1 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:02:34.035505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce2e72-4c6d-455b-aff5-1a4104e9b5e1 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:02:34.035777 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce2e72-4c6d-455b-aff5-1a4104e9b5e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:02:34.037853 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-52ce2e72-4c6d-455b-aff5-1a4104e9b5e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:02:34.051876 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce2e72-4c6d-455b-aff5-1a4104e9b5e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:02:34.053466 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce2e72-4c6d-455b-aff5-1a4104e9b5e1 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:02:34.065114 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4529/9007] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:02:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 22:02:40.696314 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=61 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:02:42.327409 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c2996-63a2-404d-a71a-38fa37fc6e86 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:02:42.329133 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-a41c2996-63a2-404d-a71a-38fa37fc6e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:02:42.398406 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c2996-63a2-404d-a71a-38fa37fc6e86 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:02:42.402090 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f422a6-925f-4d58-bd60-66d13a29fed5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:02:42.402726 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f422a6-925f-4d58-bd60-66d13a29fed5 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:02:42.403548 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f422a6-925f-4d58-bd60-66d13a29fed5 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:02:42.403822 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f422a6-925f-4d58-bd60-66d13a29fed5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:02:42.412806 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f422a6-925f-4d58-bd60-66d13a29fed5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:02:42.414236 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f422a6-925f-4d58-bd60-66d13a29fed5 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:02:42.424682 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4479/9008] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:02:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 22:02:44.060490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=23 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:02:52.420250 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=32 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:04:33.935003 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce2e72-4c6d-455b-aff5-1a4104e9b5e1 service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:04:33.944108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce2e72-4c6d-455b-aff5-1a4104e9b5e1 service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:04:33.947716 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2246e-8087-4010-ad1c-deb7a1e4d887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:04:33.948340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2246e-8087-4010-ad1c-deb7a1e4d887 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:04:33.948729 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2246e-8087-4010-ad1c-deb7a1e4d887 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:04:33.948858 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2246e-8087-4010-ad1c-deb7a1e4d887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:04:33.950618 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c1e2246e-8087-4010-ad1c-deb7a1e4d887 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:04:33.974502 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e2246e-8087-4010-ad1c-deb7a1e4d887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:04:33.975957 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e2246e-8087-4010-ad1c-deb7a1e4d887 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:04:33.984533 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4530/9009] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:04:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 22:04:38.909826 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f422a6-925f-4d58-bd60-66d13a29fed5 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:04:38.911252 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-e6f422a6-925f-4d58-bd60-66d13a29fed5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:04:38.993458 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f422a6-925f-4d58-bd60-66d13a29fed5 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:04:38.998645 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d05f5e-5022-41ad-9b02-5e4ce31cce65 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:04:38.999247 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d05f5e-5022-41ad-9b02-5e4ce31cce65 service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:04:38.999523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d05f5e-5022-41ad-9b02-5e4ce31cce65 service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:04:38.999794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d05f5e-5022-41ad-9b02-5e4ce31cce65 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:04:39.001482 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-91d05f5e-5022-41ad-9b02-5e4ce31cce65 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:04:39.012700 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d05f5e-5022-41ad-9b02-5e4ce31cce65 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:04:39.014263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d05f5e-5022-41ad-9b02-5e4ce31cce65 service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:04:39.023812 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4480/9010] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:04:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 22:04:43.980997 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=11 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:04:49.019768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=37 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:04:52.209008 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387162d-2fe7-4330-a47b-d547994228d4 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:04:52.209507 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387162d-2fe7-4330-a47b-d547994228d4 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:04:52.209624 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387162d-2fe7-4330-a47b-d547994228d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:04:52.270558 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-7387162d-2fe7-4330-a47b-d547994228d4 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 22:04:52.271807 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7387162d-2fe7-4330-a47b-d547994228d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:04:52.347562 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4531/9011] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 22:04:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 22:04:52.398703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d05f5e-5022-41ad-9b02-5e4ce31cce65 service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:04:52.400112 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-91d05f5e-5022-41ad-9b02-5e4ce31cce65 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:04:52.500840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d05f5e-5022-41ad-9b02-5e4ce31cce65 service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:04:52.505954 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78542bc7-76c1-4ad4-98d4-40fa7e7d063c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:04:52.506587 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78542bc7-76c1-4ad4-98d4-40fa7e7d063c service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:04:52.507958 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78542bc7-76c1-4ad4-98d4-40fa7e7d063c service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:04:52.508230 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78542bc7-76c1-4ad4-98d4-40fa7e7d063c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:04:52.516681 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78542bc7-76c1-4ad4-98d4-40fa7e7d063c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:04:52.518281 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78542bc7-76c1-4ad4-98d4-40fa7e7d063c service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:04:52.527584 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4481/9012] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 22:04:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 22:04:53.347019 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7387162d-2fe7-4330-a47b-d547994228d4 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:04:53.366388 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7387162d-2fe7-4330-a47b-d547994228d4 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:04:53.372987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470a03a-e07b-49f3-b24a-865fb34de553 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:04:53.373612 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470a03a-e07b-49f3-b24a-865fb34de553 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:04:53.373894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470a03a-e07b-49f3-b24a-865fb34de553 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:04:53.374171 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470a03a-e07b-49f3-b24a-865fb34de553 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:04:53.376002 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-8470a03a-e07b-49f3-b24a-865fb34de553 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:04:53.412904 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470a03a-e07b-49f3-b24a-865fb34de553 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:04:53.414562 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470a03a-e07b-49f3-b24a-865fb34de553 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:04:53.428902 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4532/9013] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:04:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 22:05:02.523295 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=41 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:05:03.423586 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=58 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:05:04.632917 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78542bc7-76c1-4ad4-98d4-40fa7e7d063c service swift] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:05:04.642429 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78542bc7-76c1-4ad4-98d4-40fa7e7d063c service swift] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:05:04.646026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21d861-abf6-43ed-b993-3038525bb281 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:05:04.646657 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21d861-abf6-43ed-b993-3038525bb281 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:05:04.646939 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21d861-abf6-43ed-b993-3038525bb281 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:05:04.647215 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21d861-abf6-43ed-b993-3038525bb281 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:05:04.648970 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ec21d861-abf6-43ed-b993-3038525bb281 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:05:04.659145 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec21d861-abf6-43ed-b993-3038525bb281 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:05:04.660575 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec21d861-abf6-43ed-b993-3038525bb281 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:05:04.670115 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4482/9014] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:05:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 22:05:04.786437 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc3469-35f7-457b-b533-070e10106d79 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:05:04.787052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc3469-35f7-457b-b533-070e10106d79 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:05:04.787052 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc3469-35f7-457b-b533-070e10106d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:05:04.836666 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-27fc3469-35f7-457b-b533-070e10106d79 None None] MFA Rules not processed for user `5f9d53147a57402f8b9818590bc1fc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 22:05:04.838407 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-27fc3469-35f7-457b-b533-070e10106d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:05:04.848192 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4533/9015] 10.222.0.33 () {58 vars in 1018 bytes} [Sat Aug 6 22:05:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 22:05:04.861034 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21d861-abf6-43ed-b993-3038525bb281 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:05:04.862417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ec21d861-abf6-43ed-b993-3038525bb281 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:05:04.942694 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21d861-abf6-43ed-b993-3038525bb281 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:05:04.946284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ced6e-2bbb-4b1a-8929-879a24fc606e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10759b2abd4cafacf338551327775e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:05:04.947421 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ced6e-2bbb-4b1a-8929-879a24fc606e service glance] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:05:04.947699 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ced6e-2bbb-4b1a-8929-879a24fc606e service glance] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:05:04.947969 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ced6e-2bbb-4b1a-8929-879a24fc606e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:05:04.958704 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ced6e-2bbb-4b1a-8929-879a24fc606e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:05:04.960231 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ced6e-2bbb-4b1a-8929-879a24fc606e service glance] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:05:04.971635 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4483/9016] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:05:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 22:05:05.038912 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc3469-35f7-457b-b533-070e10106d79 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:05:05.049111 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc3469-35f7-457b-b533-070e10106d79 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:05:05.052687 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20adae69-9d5e-489c-bdcc-8b937a98921b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:05:05.053275 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20adae69-9d5e-489c-bdcc-8b937a98921b service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:05:05.053552 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20adae69-9d5e-489c-bdcc-8b937a98921b service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:05:05.053822 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20adae69-9d5e-489c-bdcc-8b937a98921b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:05:05.055528 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-20adae69-9d5e-489c-bdcc-8b937a98921b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:05:05.065116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20adae69-9d5e-489c-bdcc-8b937a98921b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:05:05.066519 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20adae69-9d5e-489c-bdcc-8b937a98921b service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:05:05.074868 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4534/9017] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:05:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 22:05:05.148530 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ced6e-2bbb-4b1a-8929-879a24fc606e service glance] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:05:05.158048 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ced6e-2bbb-4b1a-8929-879a24fc606e service glance] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:05:05.161653 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ed74d-6500-42e2-a5d8-62a6d352aae9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:05:05.162242 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ed74d-6500-42e2-a5d8-62a6d352aae9 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:05:05.162520 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ed74d-6500-42e2-a5d8-62a6d352aae9 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:05:05.162820 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ed74d-6500-42e2-a5d8-62a6d352aae9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:05:05.164515 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-560ed74d-6500-42e2-a5d8-62a6d352aae9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:05:05.178071 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ed74d-6500-42e2-a5d8-62a6d352aae9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:05:05.179455 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ed74d-6500-42e2-a5d8-62a6d352aae9 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:05:05.190697 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4484/9018] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:05:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 22:05:06.006508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20adae69-9d5e-489c-bdcc-8b937a98921b service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:05:06.020373 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20adae69-9d5e-489c-bdcc-8b937a98921b service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:05:06.024382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3345fc-3254-4553-99a2-b74a01fda836 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:05:06.025686 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3345fc-3254-4553-99a2-b74a01fda836 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:05:06.026034 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3345fc-3254-4553-99a2-b74a01fda836 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:05:06.026303 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3345fc-3254-4553-99a2-b74a01fda836 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:05:06.029140 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-ab3345fc-3254-4553-99a2-b74a01fda836 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:05:06.061787 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3345fc-3254-4553-99a2-b74a01fda836 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:05:06.063464 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3345fc-3254-4553-99a2-b74a01fda836 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:05:06.072777 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4535/9019] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:05:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 22:05:07.499317 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884b255-22a9-42f4-83e0-28b8b2f99521 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:05:07.499762 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884b255-22a9-42f4-83e0-28b8b2f99521 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:05:07.499866 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884b255-22a9-42f4-83e0-28b8b2f99521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:05:07.519123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-9884b255-22a9-42f4-83e0-28b8b2f99521 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 22:05:07.520305 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9884b255-22a9-42f4-83e0-28b8b2f99521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:05:07.527848 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4485/9020] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 22:05:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 22:05:07.539544 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3345fc-3254-4553-99a2-b74a01fda836 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:05:07.552410 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3345fc-3254-4553-99a2-b74a01fda836 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:05:07.557381 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611f06e-9c9f-4991-92a3-2f71666d72fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:05:07.558005 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611f06e-9c9f-4991-92a3-2f71666d72fc service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:05:07.558286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611f06e-9c9f-4991-92a3-2f71666d72fc service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:05:07.558593 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611f06e-9c9f-4991-92a3-2f71666d72fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:05:07.566709 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f611f06e-9c9f-4991-92a3-2f71666d72fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:05:07.568310 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f611f06e-9c9f-4991-92a3-2f71666d72fc service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:05:07.576374 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4536/9021] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 22:05:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 22:05:17.514223 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=50 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:05:17.574471 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=31 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:05:21.247453 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad56c2-41f9-43f6-91d1-c3853795edf8 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:05:21.247967 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad56c2-41f9-43f6-91d1-c3853795edf8 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:05:21.248067 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad56c2-41f9-43f6-91d1-c3853795edf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:05:21.267640 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-abad56c2-41f9-43f6-91d1-c3853795edf8 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 22:05:21.268768 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-abad56c2-41f9-43f6-91d1-c3853795edf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:05:21.276245 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4486/9022] 10.222.0.33 () {58 vars in 967 bytes} [Sat Aug 6 22:05:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 22:05:21.288356 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611f06e-9c9f-4991-92a3-2f71666d72fc service swift] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:05:21.299143 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611f06e-9c9f-4991-92a3-2f71666d72fc service swift] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:05:21.304382 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f5386-f92f-4891-939f-44e661bbc0da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:05:21.304973 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f5386-f92f-4891-939f-44e661bbc0da service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:05:21.305799 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f5386-f92f-4891-939f-44e661bbc0da service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:05:21.306093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f5386-f92f-4891-939f-44e661bbc0da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:05:21.314349 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69f5386-f92f-4891-939f-44e661bbc0da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:05:21.315953 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69f5386-f92f-4891-939f-44e661bbc0da service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:05:21.324571 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4537/9023] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 22:05:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 22:05:31.262223 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:05:31.320868 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=6 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:05:42.186854 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad56c2-41f9-43f6-91d1-c3853795edf8 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:05:42.199008 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad56c2-41f9-43f6-91d1-c3853795edf8 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:05:42.204252 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b71b00-82fc-4f71-b820-07952e2e54cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:05:42.204869 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b71b00-82fc-4f71-b820-07952e2e54cb service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:05:42.205147 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b71b00-82fc-4f71-b820-07952e2e54cb service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:05:42.205417 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b71b00-82fc-4f71-b820-07952e2e54cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:05:42.207127 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c8b71b00-82fc-4f71-b820-07952e2e54cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:05:42.218785 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b71b00-82fc-4f71-b820-07952e2e54cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:05:42.220343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b71b00-82fc-4f71-b820-07952e2e54cb service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:05:42.230580 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4487/9024] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:05:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 22:05:52.225830 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:06:38.594044 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850934c1-62dd-435e-bcb2-a0f0ee0b609d None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:06:38.594599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850934c1-62dd-435e-bcb2-a0f0ee0b609d None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:06:38.594599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850934c1-62dd-435e-bcb2-a0f0ee0b609d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:06:38.612968 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-850934c1-62dd-435e-bcb2-a0f0ee0b609d None None] MFA Rules not processed for user `7ace3bf8975f45cb8b454d637cc4e917`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 22:06:38.614160 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-850934c1-62dd-435e-bcb2-a0f0ee0b609d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:06:38.621196 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4538/9025] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 22:06:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 22:06:43.670422 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b71b00-82fc-4f71-b820-07952e2e54cb service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:06:43.674029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c8b71b00-82fc-4f71-b820-07952e2e54cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:06:43.686828 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b71b00-82fc-4f71-b820-07952e2e54cb service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:06:43.692612 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ede372-1a4c-4672-baa3-42347a4db9f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:06:43.693284 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ede372-1a4c-4672-baa3-42347a4db9f1 service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:06:43.693573 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ede372-1a4c-4672-baa3-42347a4db9f1 service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:06:43.693845 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ede372-1a4c-4672-baa3-42347a4db9f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:06:43.695780 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b4ede372-1a4c-4672-baa3-42347a4db9f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:06:43.709561 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ede372-1a4c-4672-baa3-42347a4db9f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:06:43.711725 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ede372-1a4c-4672-baa3-42347a4db9f1 service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:06:43.723753 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4488/9026] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:06:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 22:06:46.892017 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850934c1-62dd-435e-bcb2-a0f0ee0b609d None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:06:46.908044 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850934c1-62dd-435e-bcb2-a0f0ee0b609d None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:06:46.914799 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec4328-0f67-4a82-8dac-b8289d1d18ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:06:46.915511 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec4328-0f67-4a82-8dac-b8289d1d18ac service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:06:46.915818 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec4328-0f67-4a82-8dac-b8289d1d18ac service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:06:46.916113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec4328-0f67-4a82-8dac-b8289d1d18ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:06:46.918205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-31ec4328-0f67-4a82-8dac-b8289d1d18ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:06:46.931090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ec4328-0f67-4a82-8dac-b8289d1d18ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:06:46.933175 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ec4328-0f67-4a82-8dac-b8289d1d18ac service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:06:46.953075 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4539/9027] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:06:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 22:06:46.959269 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ede372-1a4c-4672-baa3-42347a4db9f1 service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:06:47.044416 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ede372-1a4c-4672-baa3-42347a4db9f1 service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:06:47.048903 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7522a82f-e5b6-4e25-948e-d0287d8a761f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:06:47.049529 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522a82f-e5b6-4e25-948e-d0287d8a761f admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:06:47.049808 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522a82f-e5b6-4e25-948e-d0287d8a761f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:06:47.050083 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522a82f-e5b6-4e25-948e-d0287d8a761f admin admin] PATH_INFO: `/v3/users/7ace3bf8975f45cb8b454d637cc4e917` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:06:47.051266 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7522a82f-e5b6-4e25-948e-d0287d8a761f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ace3bf8975f45cb8b454d637cc4e917)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:06:47.053210 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7522a82f-e5b6-4e25-948e-d0287d8a761f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:06:47.107883 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7522a82f-e5b6-4e25-948e-d0287d8a761f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ace3bf8975f45cb8b454d637cc4e917'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:06:47.108587 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7522a82f-e5b6-4e25-948e-d0287d8a761f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ace3bf8975f45cb8b454d637cc4e917'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:06:47.109288 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7522a82f-e5b6-4e25-948e-d0287d8a761f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ace3bf8975f45cb8b454d637cc4e917'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:06:47.118609 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7522a82f-e5b6-4e25-948e-d0287d8a761f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ace3bf8975f45cb8b454d637cc4e917'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:06:47.131722 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-7522a82f-e5b6-4e25-948e-d0287d8a761f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ace3bf8975f45cb8b454d637cc4e917'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:06:47.144768 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4489/9028] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 22:06:46 2022] DELETE /identity/v3/users/7ace3bf8975f45cb8b454d637cc4e917 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 22:06:47.319618 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec4328-0f67-4a82-8dac-b8289d1d18ac service placement] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:06:47.330733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec4328-0f67-4a82-8dac-b8289d1d18ac service placement] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:06:47.389237 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7cad3-f62c-4efa-98c9-06bda0735de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:06:47.389866 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7cad3-f62c-4efa-98c9-06bda0735de1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:06:47.390145 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7cad3-f62c-4efa-98c9-06bda0735de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:06:47.390418 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7cad3-f62c-4efa-98c9-06bda0735de1 admin admin] PATH_INFO: `/v3/projects/169cc994a698408ba8bc2297e0b92fc7` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:06:47.391558 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7cad3-f62c-4efa-98c9-06bda0735de1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=169cc994a698408ba8bc2297e0b92fc7)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:06:47.393449 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7cad3-f62c-4efa-98c9-06bda0735de1 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:06:47.439933 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0bf7cad3-f62c-4efa-98c9-06bda0735de1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '169cc994a698408ba8bc2297e0b92fc7', 'request_id': 'req-0bf7cad3-f62c-4efa-98c9-06bda0735de1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:06:47.445458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0bf7cad3-f62c-4efa-98c9-06bda0735de1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '169cc994a698408ba8bc2297e0b92fc7', 'request_id': 'req-0bf7cad3-f62c-4efa-98c9-06bda0735de1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:06:47.453455 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0bf7cad3-f62c-4efa-98c9-06bda0735de1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '169cc994a698408ba8bc2297e0b92fc7', 'request_id': 'req-0bf7cad3-f62c-4efa-98c9-06bda0735de1'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:06:47.479330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0bf7cad3-f62c-4efa-98c9-06bda0735de1 admin admin] The token cache is being invalidate because project 169cc994a698408ba8bc2297e0b92fc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 22:06:47.479623 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0bf7cad3-f62c-4efa-98c9-06bda0735de1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:06:47.480246 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-0bf7cad3-f62c-4efa-98c9-06bda0735de1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:06:47.481718 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4540/9029] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 22:06:47 2022] DELETE /identity/v3/projects/169cc994a698408ba8bc2297e0b92fc7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 22:06:47.485772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7522a82f-e5b6-4e25-948e-d0287d8a761f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:06:47.487308 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-7522a82f-e5b6-4e25-948e-d0287d8a761f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:06:47.500603 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7522a82f-e5b6-4e25-948e-d0287d8a761f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:06:47.546096 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:06:47.559380 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13787c31-eab7-4fcb-a961-3975554c740a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:06:47.560014 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13787c31-eab7-4fcb-a961-3975554c740a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:06:47.560298 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13787c31-eab7-4fcb-a961-3975554c740a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:06:47.560574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13787c31-eab7-4fcb-a961-3975554c740a admin admin] PATH_INFO: `/v3/users/cf1465316e8b4a2c89d51cfc20135fff` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:06:47.561710 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13787c31-eab7-4fcb-a961-3975554c740a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf1465316e8b4a2c89d51cfc20135fff)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:06:47.563677 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13787c31-eab7-4fcb-a961-3975554c740a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:06:47.609668 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-13787c31-eab7-4fcb-a961-3975554c740a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf1465316e8b4a2c89d51cfc20135fff'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:06:47.610329 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-13787c31-eab7-4fcb-a961-3975554c740a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf1465316e8b4a2c89d51cfc20135fff'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:06:47.610970 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-13787c31-eab7-4fcb-a961-3975554c740a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf1465316e8b4a2c89d51cfc20135fff'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:06:47.618068 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-13787c31-eab7-4fcb-a961-3975554c740a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf1465316e8b4a2c89d51cfc20135fff'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:06:47.630091 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-13787c31-eab7-4fcb-a961-3975554c740a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf1465316e8b4a2c89d51cfc20135fff'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:06:47.642971 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4490/9030] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 22:06:47 2022] DELETE /identity/v3/users/cf1465316e8b4a2c89d51cfc20135fff => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 22:06:47.819199 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7cad3-f62c-4efa-98c9-06bda0735de1 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:06:47.821508 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-0bf7cad3-f62c-4efa-98c9-06bda0735de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:06:47.837113 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7cad3-f62c-4efa-98c9-06bda0735de1 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:06:47.896181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cd9d3-0e3e-4e35-9284-1d7901dec9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:06:47.896836 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cd9d3-0e3e-4e35-9284-1d7901dec9ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:06:47.897077 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cd9d3-0e3e-4e35-9284-1d7901dec9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:06:47.897353 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cd9d3-0e3e-4e35-9284-1d7901dec9ad admin admin] PATH_INFO: `/v3/projects/12b84521be6c461ab675e1059a5a5677` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:06:47.899217 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8cd9d3-0e3e-4e35-9284-1d7901dec9ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=12b84521be6c461ab675e1059a5a5677)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:06:47.901141 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8cd9d3-0e3e-4e35-9284-1d7901dec9ad admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:06:47.902589 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:06:47.949825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3f8cd9d3-0e3e-4e35-9284-1d7901dec9ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12b84521be6c461ab675e1059a5a5677', 'request_id': 'req-3f8cd9d3-0e3e-4e35-9284-1d7901dec9ad'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:06:47.955399 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3f8cd9d3-0e3e-4e35-9284-1d7901dec9ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12b84521be6c461ab675e1059a5a5677', 'request_id': 'req-3f8cd9d3-0e3e-4e35-9284-1d7901dec9ad'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:06:47.963227 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3f8cd9d3-0e3e-4e35-9284-1d7901dec9ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12b84521be6c461ab675e1059a5a5677', 'request_id': 'req-3f8cd9d3-0e3e-4e35-9284-1d7901dec9ad'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:06:47.974681 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3f8cd9d3-0e3e-4e35-9284-1d7901dec9ad admin admin] The token cache is being invalidate because project 12b84521be6c461ab675e1059a5a5677 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 22:06:47.974966 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3f8cd9d3-0e3e-4e35-9284-1d7901dec9ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:06:47.975594 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-3f8cd9d3-0e3e-4e35-9284-1d7901dec9ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:06:47.977749 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4541/9031] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 22:06:47 2022] DELETE /identity/v3/projects/12b84521be6c461ab675e1059a5a5677 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 22:06:47.982772 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff8c9e-8030-4225-8e7c-16c1da20c58e None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:06:47.983248 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff8c9e-8030-4225-8e7c-16c1da20c58e None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:06:47.983363 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff8c9e-8030-4225-8e7c-16c1da20c58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:06:48.012315 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-d9ff8c9e-8030-4225-8e7c-16c1da20c58e None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 22:06:48.013487 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-d9ff8c9e-8030-4225-8e7c-16c1da20c58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:06:48.071604 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4491/9032] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 22:06:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 22:06:48.080351 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c1ddc-2fb0-40c4-863b-76d7eeb59e41 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:06:48.080635 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c1ddc-2fb0-40c4-863b-76d7eeb59e41 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:06:48.080908 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c1ddc-2fb0-40c4-863b-76d7eeb59e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:06:48.100863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b04c1ddc-2fb0-40c4-863b-76d7eeb59e41 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 22:06:48.102760 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b04c1ddc-2fb0-40c4-863b-76d7eeb59e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:06:48.110818 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4542/9033] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 22:06:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 22:06:48.115262 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff8c9e-8030-4225-8e7c-16c1da20c58e None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:06:48.125810 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff8c9e-8030-4225-8e7c-16c1da20c58e None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:06:48.130404 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ed377-1b7f-4481-b2eb-bf4f5b19e04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:06:48.131041 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ed377-1b7f-4481-b2eb-bf4f5b19e04a admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:06:48.131319 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ed377-1b7f-4481-b2eb-bf4f5b19e04a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:06:48.131592 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ed377-1b7f-4481-b2eb-bf4f5b19e04a admin admin] PATH_INFO: `/v3/domains` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:06:48.132224 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ed377-1b7f-4481-b2eb-bf4f5b19e04a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=102758) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 22:06:48.132526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ed377-1b7f-4481-b2eb-bf4f5b19e04a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:06:48.134181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ed377-1b7f-4481-b2eb-bf4f5b19e04a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:06:48.145768 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4492/9034] 10.222.0.33 () {58 vars in 1153 bytes} [Sat Aug 6 22:06:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 22:06:48.150490 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c1ddc-2fb0-40c4-863b-76d7eeb59e41 None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:06:48.159846 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c1ddc-2fb0-40c4-863b-76d7eeb59e41 None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:06:48.165138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f873c-a1e5-458c-9ee4-006731821cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:06:48.165726 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f873c-a1e5-458c-9ee4-006731821cdd admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:06:48.166009 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f873c-a1e5-458c-9ee4-006731821cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:06:48.166286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f873c-a1e5-458c-9ee4-006731821cdd admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:06:48.166941 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f873c-a1e5-458c-9ee4-006731821cdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:06:48.168839 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f873c-a1e5-458c-9ee4-006731821cdd admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:06:48.196051 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4543/9035] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 22:06:48 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 22:06:48.200370 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ed377-1b7f-4481-b2eb-bf4f5b19e04a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:06:48.210767 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ed377-1b7f-4481-b2eb-bf4f5b19e04a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:06:48.255654 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:06:48.269485 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c010362-829f-4249-afec-7a388720d3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:06:48.270023 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c010362-829f-4249-afec-7a388720d3dc admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:06:48.270306 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c010362-829f-4249-afec-7a388720d3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:06:48.270614 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c010362-829f-4249-afec-7a388720d3dc admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:06:48.271225 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c010362-829f-4249-afec-7a388720d3dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:06:48.273207 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c010362-829f-4249-afec-7a388720d3dc admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:06:48.294356 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4493/9036] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 22:06:48 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 22:06:48.298638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f873c-a1e5-458c-9ee4-006731821cdd admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:06:48.311580 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f873c-a1e5-458c-9ee4-006731821cdd admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:06:48.316290 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70307b9-209d-4b15-92b4-d019a2929109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:06:48.316890 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70307b9-209d-4b15-92b4-d019a2929109 admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:06:48.317174 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70307b9-209d-4b15-92b4-d019a2929109 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:06:48.317451 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70307b9-209d-4b15-92b4-d019a2929109 admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:06:48.318086 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70307b9-209d-4b15-92b4-d019a2929109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:06:48.319707 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70307b9-209d-4b15-92b4-d019a2929109 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:06:48.330534 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4544/9037] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 22:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 22:06:48.334604 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c010362-829f-4249-afec-7a388720d3dc admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:06:48.345269 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c010362-829f-4249-afec-7a388720d3dc admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:06:48.349927 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9495f2-080b-4368-b9e2-daf2f9a15c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:06:48.350522 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9495f2-080b-4368-b9e2-daf2f9a15c77 admin admin] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:06:48.350840 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9495f2-080b-4368-b9e2-daf2f9a15c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:06:48.351135 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9495f2-080b-4368-b9e2-daf2f9a15c77 admin admin] PATH_INFO: `/v3/roles` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:06:48.351787 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9495f2-080b-4368-b9e2-daf2f9a15c77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:06:48.353352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9495f2-080b-4368-b9e2-daf2f9a15c77 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:06:48.364881 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4494/9038] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 22:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 22:06:48.369177 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70307b9-209d-4b15-92b4-d019a2929109 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:06:48.379275 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70307b9-209d-4b15-92b4-d019a2929109 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:06:48.384843 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8dd2b4-b5ba-4f9d-82d6-6f533474742c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:06:48.385486 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8dd2b4-b5ba-4f9d-82d6-6f533474742c admin admin] REQUEST_METHOD: `PUT` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:06:48.385770 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8dd2b4-b5ba-4f9d-82d6-6f533474742c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:06:48.386041 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8dd2b4-b5ba-4f9d-82d6-6f533474742c admin admin] PATH_INFO: `/v3/projects/78afe718095c4863be33305daa8eefdc/users/25a65a3d3d7440bf83d44c5bd567ecd0/roles/1a212772e06344478184ce7d44a58b40` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:06:48.402319 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8dd2b4-b5ba-4f9d-82d6-6f533474742c admin admin] RBAC: Authorizing `identity:create_grant(project_id=78afe718095c4863be33305daa8eefdc, user_id=25a65a3d3d7440bf83d44c5bd567ecd0, role_id=1a212772e06344478184ce7d44a58b40)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:06:48.404991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8dd2b4-b5ba-4f9d-82d6-6f533474742c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:06:48.417936 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4545/9039] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 22:06:48 2022] PUT /identity/v3/projects/78afe718095c4863be33305daa8eefdc/users/25a65a3d3d7440bf83d44c5bd567ecd0/roles/1a212772e06344478184ce7d44a58b40 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 22:06:48.423073 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754d31b-d2f1-4913-8d8c-5d54a21c91a6 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:06:48.423360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754d31b-d2f1-4913-8d8c-5d54a21c91a6 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:06:48.423630 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754d31b-d2f1-4913-8d8c-5d54a21c91a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:06:48.442790 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-9754d31b-d2f1-4913-8d8c-5d54a21c91a6 None None] MFA Rules not processed for user `051007d94d8d4d818b5d4705a31e110b`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 22:06:48.443977 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-9754d31b-d2f1-4913-8d8c-5d54a21c91a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:06:48.502438 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4495/9040] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 22:06:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 22:06:48.512961 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8dd2b4-b5ba-4f9d-82d6-6f533474742c admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:06:48.514861 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-9e8dd2b4-b5ba-4f9d-82d6-6f533474742c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:06:48.571500 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8dd2b4-b5ba-4f9d-82d6-6f533474742c admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:06:48.575051 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da402089-0ea4-44a9-9741-d6b7101c769c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:06:48.575641 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da402089-0ea4-44a9-9741-d6b7101c769c service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:06:48.575917 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da402089-0ea4-44a9-9741-d6b7101c769c service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:06:48.576181 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da402089-0ea4-44a9-9741-d6b7101c769c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:06:48.585286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da402089-0ea4-44a9-9741-d6b7101c769c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:06:48.587336 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da402089-0ea4-44a9-9741-d6b7101c769c service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:06:48.596754 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4546/9041] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:06:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 22:06:52.592067 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a026ce7-2bda-491f-a994-4170c8cd539f None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:06:52.592599 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a026ce7-2bda-491f-a994-4170c8cd539f None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:06:52.592599 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a026ce7-2bda-491f-a994-4170c8cd539f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:06:52.633610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-5a026ce7-2bda-491f-a994-4170c8cd539f None None] MFA Rules not processed for user `25a65a3d3d7440bf83d44c5bd567ecd0`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 22:06:52.635040 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-5a026ce7-2bda-491f-a994-4170c8cd539f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:06:52.716403 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4496/9042] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 22:06:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 22:06:52.720927 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da402089-0ea4-44a9-9741-d6b7101c769c service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:06:52.732553 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da402089-0ea4-44a9-9741-d6b7101c769c service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:06:52.737330 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f7bf9-a7bb-4c1b-8587-ea0a42d4a093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:06:52.737945 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f7bf9-a7bb-4c1b-8587-ea0a42d4a093 admin admin] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:06:52.738229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f7bf9-a7bb-4c1b-8587-ea0a42d4a093 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:06:52.738690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f7bf9-a7bb-4c1b-8587-ea0a42d4a093 admin admin] PATH_INFO: `/v3/projects` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:06:52.739365 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f7bf9-a7bb-4c1b-8587-ea0a42d4a093 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:06:52.741288 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f7bf9-a7bb-4c1b-8587-ea0a42d4a093 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:06:52.770301 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4547/9043] 10.222.0.33 () {60 vars in 1153 bytes} [Sat Aug 6 22:06:52 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 22:06:52.775716 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a026ce7-2bda-491f-a994-4170c8cd539f None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:06:52.786914 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a026ce7-2bda-491f-a994-4170c8cd539f None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:06:52.844469 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:06:52.851352 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f79c8b-1274-4479-a5c5-8829c4c96d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:06:52.851968 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f79c8b-1274-4479-a5c5-8829c4c96d66 admin admin] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:06:52.852762 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f79c8b-1274-4479-a5c5-8829c4c96d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:06:52.853274 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f79c8b-1274-4479-a5c5-8829c4c96d66 admin admin] PATH_INFO: `/v3/users` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:06:52.853959 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f79c8b-1274-4479-a5c5-8829c4c96d66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:06:52.856434 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f79c8b-1274-4479-a5c5-8829c4c96d66 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:06:52.881991 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4497/9044] 10.222.0.33 () {60 vars in 1144 bytes} [Sat Aug 6 22:06:52 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 22:06:52.884059 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f7bf9-a7bb-4c1b-8587-ea0a42d4a093 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:06:52.894956 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f7bf9-a7bb-4c1b-8587-ea0a42d4a093 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:06:52.899825 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590bab1-e1d3-4be4-ad36-25b720fd510f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:06:52.900440 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590bab1-e1d3-4be4-ad36-25b720fd510f admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:06:52.900717 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590bab1-e1d3-4be4-ad36-25b720fd510f admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:06:52.900987 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590bab1-e1d3-4be4-ad36-25b720fd510f admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:06:52.901625 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7590bab1-e1d3-4be4-ad36-25b720fd510f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:06:52.903252 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7590bab1-e1d3-4be4-ad36-25b720fd510f admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:06:52.904733 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:06:52.919926 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4548/9045] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 22:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 22:06:52.921326 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f79c8b-1274-4479-a5c5-8829c4c96d66 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:06:52.932276 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f79c8b-1274-4479-a5c5-8829c4c96d66 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:06:52.937106 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940ef7f-e17c-46a5-9fad-756c2fed1d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:06:52.937779 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940ef7f-e17c-46a5-9fad-756c2fed1d1f admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:06:52.938063 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940ef7f-e17c-46a5-9fad-756c2fed1d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:06:52.938340 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940ef7f-e17c-46a5-9fad-756c2fed1d1f admin admin] PATH_INFO: `/v3/projects/27d3da081cef444590274a146675484e/users/192422d0670b412187601b801f8e8744/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:06:52.955109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940ef7f-e17c-46a5-9fad-756c2fed1d1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d3da081cef444590274a146675484e, user_id=192422d0670b412187601b801f8e8744, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:06:52.957679 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940ef7f-e17c-46a5-9fad-756c2fed1d1f admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:06:52.972944 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4498/9046] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 22:06:52 2022] PUT /identity/v3/projects/27d3da081cef444590274a146675484e/users/192422d0670b412187601b801f8e8744/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 22:06:52.977576 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590bab1-e1d3-4be4-ad36-25b720fd510f admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:06:52.989220 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590bab1-e1d3-4be4-ad36-25b720fd510f admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:06:53.051210 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c3726-1f08-421e-b073-b2aabaee5b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:06:53.051826 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c3726-1f08-421e-b073-b2aabaee5b1c admin admin] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:06:53.052105 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c3726-1f08-421e-b073-b2aabaee5b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:06:53.052380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c3726-1f08-421e-b073-b2aabaee5b1c admin admin] PATH_INFO: `/v3/roles` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:06:53.053023 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c3726-1f08-421e-b073-b2aabaee5b1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:06:53.054925 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c3726-1f08-421e-b073-b2aabaee5b1c admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:06:53.066077 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4549/9047] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 22:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 22:06:53.070919 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940ef7f-e17c-46a5-9fad-756c2fed1d1f admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:06:53.090833 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940ef7f-e17c-46a5-9fad-756c2fed1d1f admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:06:53.096526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef495453-159f-4e64-bc54-a66b742c8897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:06:53.097438 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef495453-159f-4e64-bc54-a66b742c8897 admin admin] REQUEST_METHOD: `PUT` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:06:53.097762 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef495453-159f-4e64-bc54-a66b742c8897 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:06:53.098075 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef495453-159f-4e64-bc54-a66b742c8897 admin admin] PATH_INFO: `/v3/projects/27d3da081cef444590274a146675484e/users/192422d0670b412187601b801f8e8744/roles/ab245eea8a714462a00c4546309de9c9` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:06:53.100321 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef495453-159f-4e64-bc54-a66b742c8897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d3da081cef444590274a146675484e, user_id=192422d0670b412187601b801f8e8744, role_id=ab245eea8a714462a00c4546309de9c9)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:06:53.103418 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef495453-159f-4e64-bc54-a66b742c8897 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:06:53.118639 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4499/9048] 10.222.0.33 () {60 vars in 1483 bytes} [Sat Aug 6 22:06:53 2022] PUT /identity/v3/projects/27d3da081cef444590274a146675484e/users/192422d0670b412187601b801f8e8744/roles/ab245eea8a714462a00c4546309de9c9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 22:06:57.841223 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f69bbe-e4ea-4897-abe5-4e317c8f3d9a None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:06:57.841670 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f69bbe-e4ea-4897-abe5-4e317c8f3d9a None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:06:57.841960 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f69bbe-e4ea-4897-abe5-4e317c8f3d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:06:57.888253 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-59f69bbe-e4ea-4897-abe5-4e317c8f3d9a None None] MFA Rules not processed for user `192422d0670b412187601b801f8e8744`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 22:06:57.889551 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-59f69bbe-e4ea-4897-abe5-4e317c8f3d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:06:58.015214 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4550/9049] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 22:06:57 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 22:06:58.032613 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef495453-159f-4e64-bc54-a66b742c8897 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:06:58.035261 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ef495453-159f-4e64-bc54-a66b742c8897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:06:58.154264 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef495453-159f-4e64-bc54-a66b742c8897 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:06:58.159753 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a09e6-e02a-41dc-8b91-e8bb26504dbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:06:58.160360 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a09e6-e02a-41dc-8b91-e8bb26504dbc service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:06:58.160642 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a09e6-e02a-41dc-8b91-e8bb26504dbc service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:06:58.160921 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a09e6-e02a-41dc-8b91-e8bb26504dbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:06:58.228229 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a09e6-e02a-41dc-8b91-e8bb26504dbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:06:58.229897 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a09e6-e02a-41dc-8b91-e8bb26504dbc service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:06:58.240909 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4500/9050] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:06:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 22:06:59.307305 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95430bd7-9cf3-402a-a80c-92b7b39f23fd None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:06:59.307831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95430bd7-9cf3-402a-a80c-92b7b39f23fd None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:06:59.307831 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95430bd7-9cf3-402a-a80c-92b7b39f23fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:06:59.328064 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-95430bd7-9cf3-402a-a80c-92b7b39f23fd None None] MFA Rules not processed for user `25a65a3d3d7440bf83d44c5bd567ecd0`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 22:06:59.329313 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-95430bd7-9cf3-402a-a80c-92b7b39f23fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:06:59.342318 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4551/9051] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 22:06:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 22:06:59.684124 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a09e6-e02a-41dc-8b91-e8bb26504dbc service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:06:59.685571 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-769a09e6-e02a-41dc-8b91-e8bb26504dbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:06:59.742745 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:06:59.748445 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a09e6-e02a-41dc-8b91-e8bb26504dbc service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:06:59.753786 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14688dc-4ce5-4fbe-bec6-97a2f3e565b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:06:59.754589 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14688dc-4ce5-4fbe-bec6-97a2f3e565b4 service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:06:59.754893 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14688dc-4ce5-4fbe-bec6-97a2f3e565b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:06:59.755376 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14688dc-4ce5-4fbe-bec6-97a2f3e565b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:06:59.757402 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c14688dc-4ce5-4fbe-bec6-97a2f3e565b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:06:59.767540 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14688dc-4ce5-4fbe-bec6-97a2f3e565b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:06:59.769092 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14688dc-4ce5-4fbe-bec6-97a2f3e565b4 service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:06:59.778394 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4501/9052] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:06:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 22:07:00.138110 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95430bd7-9cf3-402a-a80c-92b7b39f23fd None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:07:00.140054 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-95430bd7-9cf3-402a-a80c-92b7b39f23fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:07:00.216476 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95430bd7-9cf3-402a-a80c-92b7b39f23fd None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:07:00.222285 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ecc37-e83d-405d-9f4f-99b87f37374e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:07:00.222942 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ecc37-e83d-405d-9f4f-99b87f37374e service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:07:00.223229 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ecc37-e83d-405d-9f4f-99b87f37374e service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:07:00.223505 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ecc37-e83d-405d-9f4f-99b87f37374e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:07:00.225344 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a78ecc37-e83d-405d-9f4f-99b87f37374e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:07:00.238244 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ecc37-e83d-405d-9f4f-99b87f37374e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:07:00.239895 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ecc37-e83d-405d-9f4f-99b87f37374e service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:07:00.246669 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=100 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:07:00.253129 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4552/9053] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:07:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 22:07:06.021403 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14688dc-4ce5-4fbe-bec6-97a2f3e565b4 service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:07:06.032056 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14688dc-4ce5-4fbe-bec6-97a2f3e565b4 service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:07:06.035911 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0694bb-3e5f-462b-beef-4ef07553b16e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:07:06.036519 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0694bb-3e5f-462b-beef-4ef07553b16e service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:07:06.036794 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0694bb-3e5f-462b-beef-4ef07553b16e service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:07:06.037067 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0694bb-3e5f-462b-beef-4ef07553b16e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:07:06.039039 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ce0694bb-3e5f-462b-beef-4ef07553b16e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:07:06.053304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0694bb-3e5f-462b-beef-4ef07553b16e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:07:06.055447 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0694bb-3e5f-462b-beef-4ef07553b16e service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:07:06.066946 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4502/9054] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:07:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 22:07:07.251090 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ecc37-e83d-405d-9f4f-99b87f37374e service placement] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:07:07.260337 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ecc37-e83d-405d-9f4f-99b87f37374e service placement] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:07:07.263882 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5163da-164f-4468-9a5f-4e8de31fc7af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:07:07.264467 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5163da-164f-4468-9a5f-4e8de31fc7af service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:07:07.264743 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5163da-164f-4468-9a5f-4e8de31fc7af service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:07:07.265015 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5163da-164f-4468-9a5f-4e8de31fc7af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:07:07.266720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-7d5163da-164f-4468-9a5f-4e8de31fc7af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:07:07.279713 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5163da-164f-4468-9a5f-4e8de31fc7af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:07:07.281123 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5163da-164f-4468-9a5f-4e8de31fc7af service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:07:07.292386 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4553/9055] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:07:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 22:07:10.021738 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0694bb-3e5f-462b-beef-4ef07553b16e service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:07:10.031263 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0694bb-3e5f-462b-beef-4ef07553b16e service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:07:10.034940 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ef72f-b8bd-441a-a818-e02435f911ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:07:10.035526 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ef72f-b8bd-441a-a818-e02435f911ca service neutron] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:07:10.035802 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ef72f-b8bd-441a-a818-e02435f911ca service neutron] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:07:10.036073 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ef72f-b8bd-441a-a818-e02435f911ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:07:10.045233 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ef72f-b8bd-441a-a818-e02435f911ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:07:10.046746 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ef72f-b8bd-441a-a818-e02435f911ca service neutron] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:07:10.056310 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4503/9056] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:07:10 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 22:07:17.287097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=6 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:07:20.051875 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=17 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:09:13.123114 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ca455-ac04-422e-9f3d-76ea804de34e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:09:13.123619 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ca455-ac04-422e-9f3d-76ea804de34e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:09:13.123709 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ca455-ac04-422e-9f3d-76ea804de34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:09:13.144108 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-b82ca455-ac04-422e-9f3d-76ea804de34e None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 22:09:13.146205 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b82ca455-ac04-422e-9f3d-76ea804de34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:09:13.204865 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4554/9057] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 22:09:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 22:09:13.253109 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ef72f-b8bd-441a-a818-e02435f911ca service neutron] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:09:13.255165 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-624ef72f-b8bd-441a-a818-e02435f911ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:09:13.332174 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ef72f-b8bd-441a-a818-e02435f911ca service neutron] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:09:13.338358 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee9008-d318-4700-99d3-5716ef86751b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:09:13.339235 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee9008-d318-4700-99d3-5716ef86751b service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:09:13.339501 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee9008-d318-4700-99d3-5716ef86751b service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:09:13.339771 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee9008-d318-4700-99d3-5716ef86751b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:09:13.348490 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee9008-d318-4700-99d3-5716ef86751b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:09:13.350403 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee9008-d318-4700-99d3-5716ef86751b service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:09:13.358933 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4504/9058] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 22:09:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 22:09:22.916165 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e16f49-f64a-4086-bb47-b972d418d4f5 None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:09:22.916716 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e16f49-f64a-4086-bb47-b972d418d4f5 None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:09:22.916716 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e16f49-f64a-4086-bb47-b972d418d4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:09:22.936100 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-a6e16f49-f64a-4086-bb47-b972d418d4f5 None None] MFA Rules not processed for user `25a65a3d3d7440bf83d44c5bd567ecd0`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 22:09:22.937214 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a6e16f49-f64a-4086-bb47-b972d418d4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:09:22.944079 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4555/9059] 10.222.0.33 () {58 vars in 958 bytes} [Sat Aug 6 22:09:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 22:09:23.355925 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=32 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:09:23.601323 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee9008-d318-4700-99d3-5716ef86751b service swift] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:09:23.612564 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee9008-d318-4700-99d3-5716ef86751b service swift] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:09:23.618580 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4f4d8-718b-4716-8f56-f42852b596df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:09:23.619175 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4f4d8-718b-4716-8f56-f42852b596df service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:09:23.619453 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4f4d8-718b-4716-8f56-f42852b596df service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:09:23.619722 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4f4d8-718b-4716-8f56-f42852b596df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:09:23.621528 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-b4d4f4d8-718b-4716-8f56-f42852b596df service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:09:23.635064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d4f4d8-718b-4716-8f56-f42852b596df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:09:23.636655 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d4f4d8-718b-4716-8f56-f42852b596df service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:09:23.647014 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4505/9060] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:09:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 22:09:24.788068 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d72950-f0cd-432f-83c7-5e3bac4a2b1e None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:09:24.788599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d72950-f0cd-432f-83c7-5e3bac4a2b1e None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:09:24.788599 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d72950-f0cd-432f-83c7-5e3bac4a2b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:09:24.807997 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-72d72950-f0cd-432f-83c7-5e3bac4a2b1e None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 22:09:24.809190 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-72d72950-f0cd-432f-83c7-5e3bac4a2b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:09:24.816301 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4556/9061] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 22:09:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 22:09:24.829013 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4f4d8-718b-4716-8f56-f42852b596df service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:09:24.840710 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4f4d8-718b-4716-8f56-f42852b596df service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:09:24.846081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae940715-acbd-404f-9de3-56e8bb0daf30 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:09:24.846803 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae940715-acbd-404f-9de3-56e8bb0daf30 service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:09:24.847158 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae940715-acbd-404f-9de3-56e8bb0daf30 service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:09:24.847504 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae940715-acbd-404f-9de3-56e8bb0daf30 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:09:24.856435 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae940715-acbd-404f-9de3-56e8bb0daf30 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:09:24.858105 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae940715-acbd-404f-9de3-56e8bb0daf30 service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:09:24.867108 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4506/9062] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 22:09:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 22:09:34.803539 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=31 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:09:34.863073 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=12 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:09:35.059150 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d72950-f0cd-432f-83c7-5e3bac4a2b1e None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:09:35.069859 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d72950-f0cd-432f-83c7-5e3bac4a2b1e None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:09:35.073514 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772fb115-2c11-4513-b69c-bcc45cdd4114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:09:35.074115 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fb115-2c11-4513-b69c-bcc45cdd4114 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:09:35.074401 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fb115-2c11-4513-b69c-bcc45cdd4114 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:09:35.074711 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fb115-2c11-4513-b69c-bcc45cdd4114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:09:35.076458 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-772fb115-2c11-4513-b69c-bcc45cdd4114 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:09:35.086806 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772fb115-2c11-4513-b69c-bcc45cdd4114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:09:35.088238 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772fb115-2c11-4513-b69c-bcc45cdd4114 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:09:35.096077 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4557/9063] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:09:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 22:09:36.078581 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae940715-acbd-404f-9de3-56e8bb0daf30 service swift] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:09:36.080227 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ae940715-acbd-404f-9de3-56e8bb0daf30 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:09:36.099520 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae940715-acbd-404f-9de3-56e8bb0daf30 service swift] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:09:36.106252 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44259c-2fc4-4f0e-9510-0cf7049233fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:09:36.106898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44259c-2fc4-4f0e-9510-0cf7049233fe service nova] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:09:36.107181 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44259c-2fc4-4f0e-9510-0cf7049233fe service nova] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:09:36.107458 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44259c-2fc4-4f0e-9510-0cf7049233fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:09:36.109222 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-ed44259c-2fc4-4f0e-9510-0cf7049233fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:09:36.124081 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44259c-2fc4-4f0e-9510-0cf7049233fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:09:36.125686 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44259c-2fc4-4f0e-9510-0cf7049233fe service nova] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:09:36.136719 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4507/9064] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:09:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 22:09:44.963909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772fb115-2c11-4513-b69c-bcc45cdd4114 service neutron] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:09:44.977658 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772fb115-2c11-4513-b69c-bcc45cdd4114 service neutron] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:09:44.983754 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca0e76-b33c-47f7-93f0-5ee14349efbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:09:44.984375 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca0e76-b33c-47f7-93f0-5ee14349efbd service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:09:44.984638 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca0e76-b33c-47f7-93f0-5ee14349efbd service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:09:44.984909 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca0e76-b33c-47f7-93f0-5ee14349efbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:09:44.986781 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-a2ca0e76-b33c-47f7-93f0-5ee14349efbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:09:45.000487 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca0e76-b33c-47f7-93f0-5ee14349efbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:09:45.002116 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca0e76-b33c-47f7-93f0-5ee14349efbd service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:09:45.013899 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4558/9065] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:09:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 22:09:46.132108 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=6 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:09:55.009406 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=12 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:10:40.943830 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44259c-2fc4-4f0e-9510-0cf7049233fe service nova] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:10:40.955214 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44259c-2fc4-4f0e-9510-0cf7049233fe service nova] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:10:40.960143 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07460c6c-5f3e-4989-abff-6afccf1cdd34 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:10:40.960728 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07460c6c-5f3e-4989-abff-6afccf1cdd34 service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:10:40.961033 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07460c6c-5f3e-4989-abff-6afccf1cdd34 service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:10:40.961304 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07460c6c-5f3e-4989-abff-6afccf1cdd34 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:10:40.963029 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-07460c6c-5f3e-4989-abff-6afccf1cdd34 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:10:40.974728 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07460c6c-5f3e-4989-abff-6afccf1cdd34 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:10:40.976289 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07460c6c-5f3e-4989-abff-6afccf1cdd34 service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:10:40.987266 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4508/9066] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:10:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 22:10:43.672337 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca0e76-b33c-47f7-93f0-5ee14349efbd service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:10:43.682280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca0e76-b33c-47f7-93f0-5ee14349efbd service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:10:43.685963 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e21c9-18a7-4ab7-920e-72e23b29b421 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '174e91100a184740b7c604730266dc7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:10:43.686576 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e21c9-18a7-4ab7-920e-72e23b29b421 service neutron] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:10:43.686867 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e21c9-18a7-4ab7-920e-72e23b29b421 service neutron] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:10:43.687138 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e21c9-18a7-4ab7-920e-72e23b29b421 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:10:43.689517 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-be5e21c9-18a7-4ab7-920e-72e23b29b421 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:10:43.698845 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e21c9-18a7-4ab7-920e-72e23b29b421 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:10:43.700249 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e21c9-18a7-4ab7-920e-72e23b29b421 service neutron] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:10:43.708462 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4559/9067] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:10:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 22:10:45.215848 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07460c6c-5f3e-4989-abff-6afccf1cdd34 service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:10:45.217258 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-07460c6c-5f3e-4989-abff-6afccf1cdd34 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:10:45.230979 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07460c6c-5f3e-4989-abff-6afccf1cdd34 service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:10:45.236033 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9472dc6-b891-41f9-b777-9b2a8ee6b412 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:10:45.236626 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9472dc6-b891-41f9-b777-9b2a8ee6b412 service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:10:45.236904 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9472dc6-b891-41f9-b777-9b2a8ee6b412 service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:10:45.237179 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9472dc6-b891-41f9-b777-9b2a8ee6b412 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:10:45.239021 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-c9472dc6-b891-41f9-b777-9b2a8ee6b412 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:10:45.250275 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9472dc6-b891-41f9-b777-9b2a8ee6b412 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:10:45.251976 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9472dc6-b891-41f9-b777-9b2a8ee6b412 service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:10:45.261575 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4509/9068] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:10:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 22:10:53.705257 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=6 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:10:55.257547 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=12 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:11:17.560280 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025aee88-da5c-410c-afaf-23c4595e135b None None] REQUEST_METHOD: `POST` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:11:17.560852 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025aee88-da5c-410c-afaf-23c4595e135b None None] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:11:17.560969 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025aee88-da5c-410c-afaf-23c4595e135b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:11:17.580999 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.auth.core [None req-025aee88-da5c-410c-afaf-23c4595e135b None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102759) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 22:11:17.582264 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-025aee88-da5c-410c-afaf-23c4595e135b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:11:17.590686 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4560/9069] 10.222.0.33 () {58 vars in 1009 bytes} [Sat Aug 6 22:11:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 22:11:17.633002 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9472dc6-b891-41f9-b777-9b2a8ee6b412 service placement] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:11:17.644280 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9472dc6-b891-41f9-b777-9b2a8ee6b412 service placement] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:11:17.650523 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1acfdd7-3737-4fac-b731-d15ab486145e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:11:17.651235 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acfdd7-3737-4fac-b731-d15ab486145e service swift] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:11:17.651574 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acfdd7-3737-4fac-b731-d15ab486145e service swift] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:11:17.651909 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acfdd7-3737-4fac-b731-d15ab486145e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:11:17.660265 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1acfdd7-3737-4fac-b731-d15ab486145e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:11:17.662703 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1acfdd7-3737-4fac-b731-d15ab486145e service swift] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:11:17.672287 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4510/9070] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 22:11:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 22:11:19.244453 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025aee88-da5c-410c-afaf-23c4595e135b None None] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:11:19.278097 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025aee88-da5c-410c-afaf-23c4595e135b None None] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:11:19.284071 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d23a09-2f10-49c1-a677-4b781d696fb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9d53147a57402f8b9818590bc1fc1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:11:19.284690 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d23a09-2f10-49c1-a677-4b781d696fb6 service nova] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:11:19.284972 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d23a09-2f10-49c1-a677-4b781d696fb6 service nova] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:11:19.285245 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d23a09-2f10-49c1-a677-4b781d696fb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:11:19.287154 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-b6d23a09-2f10-49c1-a677-4b781d696fb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:11:19.301174 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d23a09-2f10-49c1-a677-4b781d696fb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:11:19.304547 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d23a09-2f10-49c1-a677-4b781d696fb6 service nova] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:11:19.322749 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4561/9071] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:11:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 22:11:26.820556 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd73b6-025e-422d-bb73-584b87f6a88b None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:11:26.821101 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd73b6-025e-422d-bb73-584b87f6a88b None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:11:26.821101 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd73b6-025e-422d-bb73-584b87f6a88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:11:26.841212 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-cbbd73b6-025e-422d-bb73-584b87f6a88b None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 22:11:26.842401 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-cbbd73b6-025e-422d-bb73-584b87f6a88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:11:26.850281 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4511/9072] 10.222.0.33 () {58 vars in 967 bytes} [Sat Aug 6 22:11:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 22:11:26.862166 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d23a09-2f10-49c1-a677-4b781d696fb6 service nova] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:11:26.874470 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d23a09-2f10-49c1-a677-4b781d696fb6 service nova] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:11:26.879380 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8be13-cb25-4ed8-94b9-c8a3a65feeb0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:11:26.880557 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8be13-cb25-4ed8-94b9-c8a3a65feeb0 service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:11:26.880991 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8be13-cb25-4ed8-94b9-c8a3a65feeb0 service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:11:26.881286 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8be13-cb25-4ed8-94b9-c8a3a65feeb0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:11:26.889185 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8be13-cb25-4ed8-94b9-c8a3a65feeb0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:11:26.890772 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8be13-cb25-4ed8-94b9-c8a3a65feeb0 service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:11:26.899673 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4562/9073] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 22:11:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 22:11:31.784470 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de820cb4-b81d-40e5-bd41-111172500a48 None None] REQUEST_METHOD: `POST` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:11:31.784896 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de820cb4-b81d-40e5-bd41-111172500a48 None None] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:11:31.785016 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de820cb4-b81d-40e5-bd41-111172500a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:11:31.803997 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.auth.core [None req-de820cb4-b81d-40e5-bd41-111172500a48 None None] MFA Rules not processed for user `384893600b094d9982c2f98cdac52c77`. Rule list: `[]` (Enabled: `True`). {{(pid=102758) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 22:11:31.805162 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-de820cb4-b81d-40e5-bd41-111172500a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:11:31.812990 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4512/9074] 10.222.0.33 () {58 vars in 967 bytes} [Sat Aug 6 22:11:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 22:11:31.825579 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8be13-cb25-4ed8-94b9-c8a3a65feeb0 service swift] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:11:31.836474 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8be13-cb25-4ed8-94b9-c8a3a65feeb0 service swift] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:11:31.841914 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc532044-9d28-407a-bfe4-1ddaf54cf000 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd3e0e177f934f7ba5abe52ac8bf8bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:11:31.842501 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc532044-9d28-407a-bfe4-1ddaf54cf000 service swift] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:11:31.842809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc532044-9d28-407a-bfe4-1ddaf54cf000 service swift] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:11:31.843082 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc532044-9d28-407a-bfe4-1ddaf54cf000 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:11:31.851394 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc532044-9d28-407a-bfe4-1ddaf54cf000 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:11:31.852994 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc532044-9d28-407a-bfe4-1ddaf54cf000 service swift] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:11:31.861468 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4563/9075] 10.222.0.33 () {60 vars in 1384 bytes} [Sat Aug 6 22:11:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 22:11:41.798401 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=12 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:11:41.857863 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=25 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:11:44.521076 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de820cb4-b81d-40e5-bd41-111172500a48 None None] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:11:44.583917 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de820cb4-b81d-40e5-bd41-111172500a48 None None] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:11:44.588364 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a232c-f2bd-431a-9a38-d0e6bd64d32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:11:44.589064 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a232c-f2bd-431a-9a38-d0e6bd64d32a admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:11:44.589343 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a232c-f2bd-431a-9a38-d0e6bd64d32a admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:11:44.589610 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a232c-f2bd-431a-9a38-d0e6bd64d32a admin admin] PATH_INFO: `/v3/users/25a65a3d3d7440bf83d44c5bd567ecd0` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:11:44.590773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a232c-f2bd-431a-9a38-d0e6bd64d32a admin admin] RBAC: Authorizing `identity:delete_user(user_id=25a65a3d3d7440bf83d44c5bd567ecd0)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:11:44.592946 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a232c-f2bd-431a-9a38-d0e6bd64d32a admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:11:44.640838 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8a5a232c-f2bd-431a-9a38-d0e6bd64d32a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25a65a3d3d7440bf83d44c5bd567ecd0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:11:44.641511 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8a5a232c-f2bd-431a-9a38-d0e6bd64d32a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25a65a3d3d7440bf83d44c5bd567ecd0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:11:44.642120 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8a5a232c-f2bd-431a-9a38-d0e6bd64d32a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25a65a3d3d7440bf83d44c5bd567ecd0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:11:44.651480 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8a5a232c-f2bd-431a-9a38-d0e6bd64d32a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25a65a3d3d7440bf83d44c5bd567ecd0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:11:44.664846 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-8a5a232c-f2bd-431a-9a38-d0e6bd64d32a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25a65a3d3d7440bf83d44c5bd567ecd0'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:11:44.678028 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4513/9076] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 22:11:44 2022] DELETE /identity/v3/users/25a65a3d3d7440bf83d44c5bd567ecd0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 22:11:44.854017 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc532044-9d28-407a-bfe4-1ddaf54cf000 service swift] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:11:44.870284 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc532044-9d28-407a-bfe4-1ddaf54cf000 service swift] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:11:44.931686 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61d69c-f24b-4688-9965-1eb41cfa6f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:11:44.932311 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61d69c-f24b-4688-9965-1eb41cfa6f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:11:44.932590 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61d69c-f24b-4688-9965-1eb41cfa6f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:11:44.932922 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61d69c-f24b-4688-9965-1eb41cfa6f95 admin admin] PATH_INFO: `/v3/projects/78afe718095c4863be33305daa8eefdc` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:11:44.934062 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61d69c-f24b-4688-9965-1eb41cfa6f95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78afe718095c4863be33305daa8eefdc)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:11:44.935983 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61d69c-f24b-4688-9965-1eb41cfa6f95 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:11:44.983148 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bd61d69c-f24b-4688-9965-1eb41cfa6f95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78afe718095c4863be33305daa8eefdc', 'request_id': 'req-bd61d69c-f24b-4688-9965-1eb41cfa6f95'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:11:44.989250 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bd61d69c-f24b-4688-9965-1eb41cfa6f95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78afe718095c4863be33305daa8eefdc', 'request_id': 'req-bd61d69c-f24b-4688-9965-1eb41cfa6f95'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:11:44.996894 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bd61d69c-f24b-4688-9965-1eb41cfa6f95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78afe718095c4863be33305daa8eefdc', 'request_id': 'req-bd61d69c-f24b-4688-9965-1eb41cfa6f95'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:11:45.008795 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bd61d69c-f24b-4688-9965-1eb41cfa6f95 admin admin] The token cache is being invalidate because project 78afe718095c4863be33305daa8eefdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 22:11:45.009082 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bd61d69c-f24b-4688-9965-1eb41cfa6f95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:11:45.009720 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-bd61d69c-f24b-4688-9965-1eb41cfa6f95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:11:45.011238 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4564/9077] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 22:11:44 2022] DELETE /identity/v3/projects/78afe718095c4863be33305daa8eefdc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 22:11:45.015401 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a232c-f2bd-431a-9a38-d0e6bd64d32a admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:11:45.016798 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-8a5a232c-f2bd-431a-9a38-d0e6bd64d32a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:11:45.030381 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a232c-f2bd-431a-9a38-d0e6bd64d32a admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:11:45.086238 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94630d87-ba35-47a6-940f-8bf4ce036768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:11:45.086907 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94630d87-ba35-47a6-940f-8bf4ce036768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:11:45.087184 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94630d87-ba35-47a6-940f-8bf4ce036768 admin admin] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:11:45.087488 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94630d87-ba35-47a6-940f-8bf4ce036768 admin admin] PATH_INFO: `/v3/users/192422d0670b412187601b801f8e8744` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:11:45.088773 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94630d87-ba35-47a6-940f-8bf4ce036768 admin admin] RBAC: Authorizing `identity:delete_user(user_id=192422d0670b412187601b801f8e8744)` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:11:45.090905 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94630d87-ba35-47a6-940f-8bf4ce036768 admin admin] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:11:45.112026 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:11:45.136744 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-94630d87-ba35-47a6-940f-8bf4ce036768 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '192422d0670b412187601b801f8e8744'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:11:45.137396 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-94630d87-ba35-47a6-940f-8bf4ce036768 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '192422d0670b412187601b801f8e8744'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:11:45.138010 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-94630d87-ba35-47a6-940f-8bf4ce036768 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '192422d0670b412187601b801f8e8744'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:11:45.145495 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-94630d87-ba35-47a6-940f-8bf4ce036768 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '192422d0670b412187601b801f8e8744'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:11:45.160399 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.notifications [None req-94630d87-ba35-47a6-940f-8bf4ce036768 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '192422d0670b412187601b801f8e8744'} {{(pid=102758) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:11:45.173315 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4514/9078] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 22:11:45 2022] DELETE /identity/v3/users/192422d0670b412187601b801f8e8744 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 22:11:45.367752 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61d69c-f24b-4688-9965-1eb41cfa6f95 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:11:45.369334 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-bd61d69c-f24b-4688-9965-1eb41cfa6f95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:11:45.383349 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61d69c-f24b-4688-9965-1eb41cfa6f95 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:11:45.445327 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3c4cd-8f43-40e7-bac5-ad861e5cf245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051007d94d8d4d818b5d4705a31e110b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f3affb323c4555adb3a84fee8265cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:11:45.446018 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3c4cd-8f43-40e7-bac5-ad861e5cf245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:11:45.446300 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3c4cd-8f43-40e7-bac5-ad861e5cf245 admin admin] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:11:45.446597 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3c4cd-8f43-40e7-bac5-ad861e5cf245 admin admin] PATH_INFO: `/v3/projects/27d3da081cef444590274a146675484e` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:11:45.447722 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3c4cd-8f43-40e7-bac5-ad861e5cf245 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27d3da081cef444590274a146675484e)` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:11:45.449614 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3c4cd-8f43-40e7-bac5-ad861e5cf245 admin admin] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:11:45.484765 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:11:45.499395 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c9b3c4cd-8f43-40e7-bac5-ad861e5cf245 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27d3da081cef444590274a146675484e', 'request_id': 'req-c9b3c4cd-8f43-40e7-bac5-ad861e5cf245'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:11:45.505124 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c9b3c4cd-8f43-40e7-bac5-ad861e5cf245 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27d3da081cef444590274a146675484e', 'request_id': 'req-c9b3c4cd-8f43-40e7-bac5-ad861e5cf245'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:11:45.512294 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c9b3c4cd-8f43-40e7-bac5-ad861e5cf245 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27d3da081cef444590274a146675484e', 'request_id': 'req-c9b3c4cd-8f43-40e7-bac5-ad861e5cf245'} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:11:45.523365 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c9b3c4cd-8f43-40e7-bac5-ad861e5cf245 admin admin] The token cache is being invalidate because project 27d3da081cef444590274a146675484e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=102759) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 22:11:45.523646 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c9b3c4cd-8f43-40e7-bac5-ad861e5cf245 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:11:45.524271 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.notifications [None req-c9b3c4cd-8f43-40e7-bac5-ad861e5cf245 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=102759) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 22:11:45.525735 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4565/9079] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 22:11:45 2022] DELETE /identity/v3/projects/27d3da081cef444590274a146675484e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 22:11:55.169724 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:11:55.520357 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:15:45.880024 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94630d87-ba35-47a6-940f-8bf4ce036768 admin admin] Authenticating user token {{(pid=102758) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:15:45.881409 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-94630d87-ba35-47a6-940f-8bf4ce036768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:15:46.020973 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94630d87-ba35-47a6-940f-8bf4ce036768 admin admin] Validating token access rules against request {{(pid=102758) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:15:46.079974 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b074892-379e-4411-abf0-6368b8aae874 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102758) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:15:46.080573 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b074892-379e-4411-abf0-6368b8aae874 service placement] REQUEST_METHOD: `GET` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:15:46.080856 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b074892-379e-4411-abf0-6368b8aae874 service placement] SCRIPT_NAME: `/identity` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:15:46.081123 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b074892-379e-4411-abf0-6368b8aae874 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102758) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:15:46.082875 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.fernet_utils [None req-3b074892-379e-4411-abf0-6368b8aae874 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102758) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:15:46.094315 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b074892-379e-4411-abf0-6368b8aae874 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:15:46.095898 ncdv-master-1 devstack@keystone.service[102758]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b074892-379e-4411-abf0-6368b8aae874 service placement] RBAC: Authorization granted {{(pid=102758) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:15:46.105624 ncdv-master-1 devstack@keystone.service[102758]: [pid: 102758|app: 0|req: 4515/9080] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:15:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 22:15:46.160809 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3c4cd-8f43-40e7-bac5-ad861e5cf245 admin admin] Authenticating user token {{(pid=102759) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 22:15:46.162226 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-c9b3c4cd-8f43-40e7-bac5-ad861e5cf245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:15:46.202930 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3c4cd-8f43-40e7-bac5-ad861e5cf245 admin admin] Validating token access rules against request {{(pid=102759) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 22:15:46.208182 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2eacd-020b-4b41-8e5c-4a3556d7bf9e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeafb87d52414c979a774861a2d49ab0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102759) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 22:15:46.208785 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2eacd-020b-4b41-8e5c-4a3556d7bf9e service placement] REQUEST_METHOD: `GET` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 22:15:46.209066 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2eacd-020b-4b41-8e5c-4a3556d7bf9e service placement] SCRIPT_NAME: `/identity` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 22:15:46.209340 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2eacd-020b-4b41-8e5c-4a3556d7bf9e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=102759) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 22:15:46.211103 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.fernet_utils [None req-51c2eacd-020b-4b41-8e5c-4a3556d7bf9e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=102759) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 22:15:46.223093 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2eacd-020b-4b41-8e5c-4a3556d7bf9e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 22:15:46.224932 ncdv-master-1 devstack@keystone.service[102759]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2eacd-020b-4b41-8e5c-4a3556d7bf9e service placement] RBAC: Authorization granted {{(pid=102759) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 22:15:46.235463 ncdv-master-1 devstack@keystone.service[102759]: [pid: 102759|app: 0|req: 4566/9081] 10.222.0.33 () {60 vars in 1365 bytes} [Sat Aug 6 22:15:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 22:15:56.101595 ncdv-master-1 devstack@keystone.service[102758]: DEBUG dbcounter [-] [102758] Writing DB stats keystone:SELECT=89 {{(pid=102758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:15:56.230571 ncdv-master-1 devstack@keystone.service[102759]: DEBUG dbcounter [-] [102759] Writing DB stats keystone:SELECT=17 {{(pid=102759) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}